-- Logs begin at Mon 2022-08-29 14:32:49 UTC, end at Mon 2022-08-29 17:02:28 UTC. -- Aug 29 15:09:02.604365 n-d-854882-3 systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 15:09:02.613000 n-d-854882-3 devstack@keystone.service[89665]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 15:09:02.615961 n-d-854882-3 devstack@keystone.service[89665]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 15:09:02 2022] *** Aug 29 15:09:02.617494 n-d-854882-3 devstack@keystone.service[89665]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 15:09:02.617668 n-d-854882-3 devstack@keystone.service[89665]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 15:09:02.617842 n-d-854882-3 devstack@keystone.service[89665]: nodename: n-d-854882-3 Aug 29 15:09:02.618000 n-d-854882-3 devstack@keystone.service[89665]: machine: x86_64 Aug 29 15:09:02.618151 n-d-854882-3 devstack@keystone.service[89665]: clock source: unix Aug 29 15:09:02.618292 n-d-854882-3 devstack@keystone.service[89665]: pcre jit disabled Aug 29 15:09:02.618437 n-d-854882-3 devstack@keystone.service[89665]: detected number of CPU cores: 4 Aug 29 15:09:02.618577 n-d-854882-3 devstack@keystone.service[89665]: current working directory: / Aug 29 15:09:02.618698 n-d-854882-3 devstack@keystone.service[89665]: detected binary path: /usr/bin/uwsgi-core Aug 29 15:09:02.618851 n-d-854882-3 devstack@keystone.service[89665]: your processes number limit is 47680 Aug 29 15:09:02.618994 n-d-854882-3 devstack@keystone.service[89665]: your memory page size is 4096 bytes Aug 29 15:09:02.619133 n-d-854882-3 devstack@keystone.service[89665]: detected max file descriptor number: 2048 Aug 29 15:09:02.619275 n-d-854882-3 devstack@keystone.service[89665]: lock engine: pthread robust mutexes Aug 29 15:09:02.619591 n-d-854882-3 devstack@keystone.service[89665]: thunder lock: enabled Aug 29 15:09:02.619942 n-d-854882-3 devstack@keystone.service[89665]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 15:09:02.620165 n-d-854882-3 devstack@keystone.service[89665]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 15:09:02.662708 n-d-854882-3 devstack@keystone.service[89665]: Python main interpreter initialized at 0x5602f57349c0 Aug 29 15:09:02.662708 n-d-854882-3 devstack@keystone.service[89665]: python threads support enabled Aug 29 15:09:02.662708 n-d-854882-3 devstack@keystone.service[89665]: your server socket listen backlog is limited to 100 connections Aug 29 15:09:02.662708 n-d-854882-3 devstack@keystone.service[89665]: your mercy for graceful operations on workers is 90 seconds Aug 29 15:09:02.663124 n-d-854882-3 devstack@keystone.service[89665]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 15:09:02.663200 n-d-854882-3 devstack@keystone.service[89665]: *** Operational MODE: preforking *** Aug 29 15:09:02.663491 n-d-854882-3 devstack@keystone.service[89665]: *** uWSGI is running in multiple interpreter mode *** Aug 29 15:09:02.663491 n-d-854882-3 devstack@keystone.service[89665]: spawned uWSGI master process (pid: 89665) Aug 29 15:09:02.663712 n-d-854882-3 systemd[1]: Started Devstack devstack@keystone.service. Aug 29 15:09:02.665430 n-d-854882-3 devstack@keystone.service[89665]: spawned uWSGI worker 1 (pid: 89680, cores: 1) Aug 29 15:09:02.665430 n-d-854882-3 devstack@keystone.service[89665]: spawned uWSGI worker 2 (pid: 89681, cores: 1) Aug 29 15:09:02.665430 n-d-854882-3 devstack@keystone.service[89665]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 15:09:07.010374 n-d-854882-3 devstack@keystone.service[89680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:09:07.010374 n-d-854882-3 devstack@keystone.service[89680]: from cryptography.utils import int_from_bytes Aug 29 15:09:07.011152 n-d-854882-3 devstack@keystone.service[89680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:09:07.011152 n-d-854882-3 devstack@keystone.service[89680]: from cryptography.utils import int_from_bytes Aug 29 15:09:07.061523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:09:07.061704 n-d-854882-3 devstack@keystone.service[89681]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:09:07.061704 n-d-854882-3 devstack@keystone.service[89681]: from cryptography.utils import int_from_bytes Aug 29 15:09:07.062223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:09:07.062223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] command line args: [] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:09:07.062374 n-d-854882-3 devstack@keystone.service[89681]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:09:07.062374 n-d-854882-3 devstack@keystone.service[89681]: from cryptography.utils import int_from_bytes Aug 29 15:09:07.062508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:09:07.062508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ================================================================================ {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:09:07.062635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] admin_token = **** {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.062780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] config_dir = [] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.062965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.063149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] config_source = [] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.063328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] debug = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.063531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.064696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.064696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] insecure_debug = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.064696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.064696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.064952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] list_limit = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.064952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] log_config_append = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.065182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.065281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] log_dir = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.065448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] log_file = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.065688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.065935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.066181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.066424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.066598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.066773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.067015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.067255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.067488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.067719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.067949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.068177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.068421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.068664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] notification_format = cadf {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.068936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.069456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.069638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] publish_errors = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.069874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.070107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.070279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.070526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.070759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.070993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] standard_threads = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.071220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] strict_password_check = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.071460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.071634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] use_eventlog = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.071808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] use_journal = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.071981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] use_json = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.072152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] use_stderr = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.072325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] use_syslog = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.072552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] watch_log_file = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.072809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.073052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.073311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.073572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.073819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.074611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.074858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.075092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.075338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.075581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.075832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.076065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.076311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.076544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.076788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.077033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.077268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.077548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.077801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.078045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.078278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.078528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.078790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.079040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.079286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.079515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.079745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.079972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.080204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.080451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.080697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.080925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.081153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.081415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.081660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.081897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.082144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.082373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.082608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.082845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.083081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.083310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.083539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.083768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.084001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.084246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.084476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.084712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.084940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.085172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.085424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.085671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.085900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.086134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.086367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.086602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.086835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.087067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.087295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.087543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.087773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.088009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.088237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.088493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.088724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.088961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.089195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.089457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.089759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.090004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.090248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.090494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.090729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.090965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.091198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.091443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.enabled = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.091680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.091915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.092156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.092394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.092639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.092876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.093100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.093333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.093595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.093814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.094081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.094319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.094565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.094804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.095041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.095273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.095509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.095746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.095984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.096212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.096441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.096671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.096903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.097132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.097371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.097626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.097875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.098147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.098407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.098667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.098907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.099140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] auth.external = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.099368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] auth.mapped = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.099663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.099896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.100124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] auth.password = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.100354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] auth.token = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.100593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.100825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] catalog.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.101070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.101300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.101568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.101814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.102044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.102278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] credential.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.102523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] credential.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.102768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.103013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.103260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.103503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.103736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.104049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.104231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.104467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.104718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.105015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.105277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.105563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.105804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.106058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.106290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] federation.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.106525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.106769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] federation.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.107013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.107241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.107487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.107722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.107974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.108206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.108459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.108714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.108939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.109172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.109433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.109681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.109914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.110146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.110390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.110618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.110853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.111099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.111348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.111580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.111810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.112040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.112281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.112525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.112771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.113022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.113269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.113563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.113802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.114038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.114266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.114502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.114731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.114809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:09:07.114963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:09:07.115042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.115183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] command line args: [] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:09:07.115270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.115424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.115508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:09:07.115671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.115754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ================================================================================ {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:09:07.115902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.115981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] admin_token = **** {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.116148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.116228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] config_dir = [] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.116376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.116453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.116561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] config_source = [] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.116639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.116744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] debug = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.116846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.116969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.117081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.117233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.117322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.117460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] insecure_debug = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.117551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.117766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.117845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.password = **** {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.118000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.118086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.118237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.118316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] list_limit = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.118469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] log_config_append = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.118546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.118672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.118759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.118874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] log_dir = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.118943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.119073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] log_file = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.119141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.119337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.119414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.119591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.119659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.119823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.119891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.120070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.120147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.120271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.120339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.120471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.120546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.121261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.121339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.121530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.121601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.121765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.121833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.122005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.122086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.122262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.122341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.122493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.122572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.122739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.122819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.122983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.123113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] notification_format = cadf {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.123231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.123319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.123464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.123702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.123827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.123956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.124034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] publish_errors = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.124145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.124225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.124379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.124453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.124609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.124691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.124852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.124931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.125093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.125170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.125335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.125433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] standard_threads = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.125602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.125724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] strict_password_check = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.125847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.125931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.126075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.126153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] use_eventlog = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.126253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] use_journal = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.126332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.126445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] use_json = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.126525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.126645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] use_stderr = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.126763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.126842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] use_syslog = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.126997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.127086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] watch_log_file = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:09:07.127229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.127308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.127475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.127562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.127719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.127805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.127954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.128054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.128206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] policy.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.128331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.128433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.128592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.128671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.128879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.128958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.129117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] receipt.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.129201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.129353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.129480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.129697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.129776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.129975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.130054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.130206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.130285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.130443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.130522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.130684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] resource.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.130763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.130933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.131013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.131183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] resource.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.131261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.131420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.131499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.131670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.131751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.131923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.132040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.132158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] revoke.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.132316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.132405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.132559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.132644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.132839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.132919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] role.cache_time = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.133078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] role.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.133167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.133325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] role.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.133421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.133580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] role.list_limit = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.133661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.133830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.133917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.134075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.134159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.134312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.134391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.134551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.134631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.134795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.134874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.135041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.135119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.135273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.135352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.135511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.135590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.135764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.135850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.135988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.136068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.136226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.136305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.136538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.137121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.137281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.137362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.137574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.137714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.137815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.137950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.138037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.138198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.138277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.138445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.138524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.138692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.138778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.138934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.139011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.139163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.139241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.139404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.139490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.139653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.139737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.139892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.139976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.140123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.140209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.140354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.140432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.140604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.140691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.140832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.140919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.141086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.141165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.141335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.141465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.141595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.141684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.141830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.141908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.142060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] token.cache_time = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.142139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.142294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] token.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.142374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.142530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.142608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.142777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] token.provider = fernet {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.142855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.143012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.143092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.143274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.143352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.143519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.143600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.143755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.143841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.143992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.144070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.144231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.144309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.144467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.144553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] trust.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.144698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.144776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.144937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.145015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.145169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.145255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.145435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.145518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.145685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.145763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.145926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.146020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.146163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.146251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.146410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.enabled = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.146489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.146653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.146732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.connection = **** {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.146893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.146973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.147136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.147214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.147372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.147451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.147607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.147686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.148102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.148182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.148338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.148416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.148572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.148652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.148804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.148883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.149046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.149125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.149279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.149403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.149543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.149684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.149763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.149960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.150051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.150225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.150305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.150467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.150546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.150695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.150782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.150931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.151011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.151164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.151243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.151315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:09:07.151450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.151688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.151941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.152225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.152467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.152725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.153009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.153276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.153599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.153896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.154183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.154486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.154739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.154998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] auth.external = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.155258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] auth.mapped = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.155564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.155827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.156089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] auth.password = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.156364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] auth.token = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.156633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.156911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] catalog.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.157168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.157432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.157683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.157969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.158228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.158490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] credential.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.158745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] credential.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.159030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.159307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.159586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.159878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.160141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.160406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.160656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.160904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.161186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.161531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.161804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.162094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.162362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.162647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.162892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] federation.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.163134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.163385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] federation.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.163637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.163873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.164124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.164384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.164664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.164942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.165203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.165487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.165772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.166038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.166306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.166564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.166817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.167076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.167349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.167605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.168384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.168678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.168951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.169209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.169504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.169773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.170028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.170281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.170536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.170796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.171047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.171323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.171567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.171810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.172046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.172287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.172522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.172762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.173011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.173253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.173528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.173765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.174016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.174266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.174503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.174751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.175001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.175235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.175475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.175710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.password = **** {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.175949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.176189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.176434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.176674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.177086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.177370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.177687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.177928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.178203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.178483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.178777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.179021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.179264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.179507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.179745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.179993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.180275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.180531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.180616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.180805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.180902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.181022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.181108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.181319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.181584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.181823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.182066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.182339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.182602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.182863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.183117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.183952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.184204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.184477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.184769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.185027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.185281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.185547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.185791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.186033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.186282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.186556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.186828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.187089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.187356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] policy.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.187644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.187887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.188150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.188418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] receipt.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.188686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.188957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.189225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.189513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.189810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.189944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.190055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] resource.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.190341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.190601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] resource.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.190875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.191130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.191386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.191626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] revoke.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.191876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.192117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.192362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] role.cache_time = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.192602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] role.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.192860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] role.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.193095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] role.list_limit = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.193349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.193629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.193882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.194168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.194439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.194714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.194993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.195269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.195529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.195812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.196089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.196360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.196611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.197020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.197259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.197558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.197834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.198111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.198385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.198644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.198927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.199184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.199430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.199669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.199906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.200143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.200399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.200658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.200910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.201153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.201419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.201648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] token.cache_time = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.201887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] token.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.202128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.202377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] token.provider = fernet {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.202618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.202918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.203196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.203456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.203738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.204006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.204259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] trust.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.204518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.204785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.205057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.205339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.205703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.205963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.206246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.206550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.206836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.connection = **** {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.207088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.207364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.207624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.207901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.208163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.208439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.208685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.208945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.209212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.209506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.209792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.210054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.210310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.210589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.210863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.211128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.211393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.211670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:09:07.211864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:09:07.217106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.217340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.238368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.238602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.238832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.248465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.267822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.268023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.270811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.308170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.320662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.320894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.345634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.345880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.475793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.476033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.476245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.476463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.476678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.476892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.491474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.491725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.491972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.492216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.492460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.492713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.501122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.501352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.501607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.501829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.502042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.502251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.502461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.506243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.506496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.506748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.507007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.507249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.507487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.507722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.513342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.515883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.525986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.526168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.526391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.526611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.526829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.527089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.527319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.527901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.528137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.528364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.528590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.528810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.529102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.529304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89681) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 15:09:07.544433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.544639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 15:09:07.544978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.545175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 15:09:07.545324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.545488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.545639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 15:09:07.545772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.545903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.546032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.546173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 15:09:07.546303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.546432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.546595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.546862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.547158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.555732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.556002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.556271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.556553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.557261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.557598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.557875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.558163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.564035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.566223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.566918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.567204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.567488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.567769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.568051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.568310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.568579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.568853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.569122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.569322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.569563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.569711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.569850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.570000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.570362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.570708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.571032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.571314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.571714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.572039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.572364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.572681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.594701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.596179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.596462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.599328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.600847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.600976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.601171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.601300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.601517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.606809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.607127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.607561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.608509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.608798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.612720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.613011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.613293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.613600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.613873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.614644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.614958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.615922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.616218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.616503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.619325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.619637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.619959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.620395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.620710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.621079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.621361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.621696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.631721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.631999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.635779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.638885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.639182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.639519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.639806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.643440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.643686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.646514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.646807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.647220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.649816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.650115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.650399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.650683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.650962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.651344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.651736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.655567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.658936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.659238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.659539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.659994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.660304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.660614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.667339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.667626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.668459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.668724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.675446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.677097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.678099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.678391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.678656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.678793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.678933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.679066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.681555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.681849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.682133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.682414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.682705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.686769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.688461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.690353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.690828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.694022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.694308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.694588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.694718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.694858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.694988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.695120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.695251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.695392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.695532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.695664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.695821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.707665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.707950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.708237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.708530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.708818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.709100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.709407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.711211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.714239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.717659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.719095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.720566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.720849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.721150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.725685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.727693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.728708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.729156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.732571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.732708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.732869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.733155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.733457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.734852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.736850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.737138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.737465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.741295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.741606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.741888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.745808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.748183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.748726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=89680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.749011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.749297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.749601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.749878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.750167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.750444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.750727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.750999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.751277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.751411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.751542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.751702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.751843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.752002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.752135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.752295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.752438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=89680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.760883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.761219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.761573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.769072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=89681) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 15:09:07.769378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.769724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.770042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.770324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.770605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.770897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.771184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.771463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.771751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.772026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.772295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.772574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.773119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=89681) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 15:09:07.787211 n-d-854882-3 devstack@keystone.service[89680]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5602f57349c0 pid: 89680 (default app) Aug 29 15:09:07.790889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6223af-c825-4e2b-b648-32a2896f9777 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:07.791173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6223af-c825-4e2b-b648-32a2896f9777 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:07.791445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6223af-c825-4e2b-b648-32a2896f9777 None None] PATH_INFO: `/v3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:07.796224 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Mon Aug 29 15:09:07 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:07.810905 n-d-854882-3 devstack@keystone.service[89681]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5602f57349c0 pid: 89681 (default app) Aug 29 15:09:14.712256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f355eb6-f21d-45c2-82f8-b3c26b06150f None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:14.712823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f355eb6-f21d-45c2-82f8-b3c26b06150f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:14.712823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f355eb6-f21d-45c2-82f8-b3c26b06150f None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:14.714234 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:09:14.725901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc22afc-22f1-4b4a-bed6-6ec06d3ea517 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:14.726571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc22afc-22f1-4b4a-bed6-6ec06d3ea517 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:14.726571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc22afc-22f1-4b4a-bed6-6ec06d3ea517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:14.798913 n-d-854882-3 devstack@keystone.service[89681]: INFO dbcounter [None req-cfc22afc-22f1-4b4a-bed6-6ec06d3ea517 None None] Registered counter for database keystone Aug 29 15:09:14.819099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG oslo_db.sqlalchemy.engines [None req-cfc22afc-22f1-4b4a-bed6-6ec06d3ea517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:09:14.826664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writer thread running {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:09:15.032788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG passlib.handlers.bcrypt [None req-cfc22afc-22f1-4b4a-bed6-6ec06d3ea517 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=89681) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 15:09:15.033169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG passlib.handlers.bcrypt [None req-cfc22afc-22f1-4b4a-bed6-6ec06d3ea517 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=89681) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 15:09:15.093786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cfc22afc-22f1-4b4a-bed6-6ec06d3ea517 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:15.095471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cfc22afc-22f1-4b4a-bed6-6ec06d3ea517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:15.254948 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1/3] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 15:09:15.784421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f355eb6-f21d-45c2-82f8-b3c26b06150f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:15.854701 n-d-854882-3 devstack@keystone.service[89680]: INFO dbcounter [None req-6f355eb6-f21d-45c2-82f8-b3c26b06150f None None] Registered counter for database keystone Aug 29 15:09:15.876821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG oslo_db.sqlalchemy.engines [None req-6f355eb6-f21d-45c2-82f8-b3c26b06150f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:09:15.883830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writer thread running {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:09:16.005252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f355eb6-f21d-45c2-82f8-b3c26b06150f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:16.009994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609e88d-ae1c-42e8-8232-21ef001a9428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:16.010648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609e88d-ae1c-42e8-8232-21ef001a9428 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:16.010928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609e88d-ae1c-42e8-8232-21ef001a9428 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:16.011197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609e88d-ae1c-42e8-8232-21ef001a9428 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:16.021098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609e88d-ae1c-42e8-8232-21ef001a9428 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:16.072906 n-d-854882-3 devstack@keystone.service[89680]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6609e88d-ae1c-42e8-8232-21ef001a9428 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 15:09:16.073301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609e88d-ae1c-42e8-8232-21ef001a9428 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:16.084665 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Aug 29 15:09:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:09:16.090883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc22afc-22f1-4b4a-bed6-6ec06d3ea517 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:16.106724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc22afc-22f1-4b4a-bed6-6ec06d3ea517 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:16.111396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adaa70-9135-4559-af10-0409ef29260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:16.112598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adaa70-9135-4559-af10-0409ef29260e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:16.112882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adaa70-9135-4559-af10-0409ef29260e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:16.113158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adaa70-9135-4559-af10-0409ef29260e admin admin] PATH_INFO: `/v3/projects/981474d13fc1406aa4961a388692a3c0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:16.114789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06adaa70-9135-4559-af10-0409ef29260e admin admin] RBAC: Authorizing `identity:get_project(project_id=981474d13fc1406aa4961a388692a3c0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:16.169241 n-d-854882-3 devstack@keystone.service[89681]: WARNING keystone.common.rbac_enforcer.enforcer [None req-06adaa70-9135-4559-af10-0409ef29260e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 15:09:16.169759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06adaa70-9135-4559-af10-0409ef29260e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:16.174658 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2/5] 10.222.0.16 () {56 vars in 1207 bytes} [Mon Aug 29 15:09:16 2022] GET /identity/v3/projects/981474d13fc1406aa4961a388692a3c0 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:18.242836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc22f1-39ea-4b45-8446-58930ad75570 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:18.243490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc22f1-39ea-4b45-8446-58930ad75570 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:18.243490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc22f1-39ea-4b45-8446-58930ad75570 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:18.247996 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4/6] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:18.255228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee4fa-c856-46e4-84b1-4d7a033709d4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:18.255785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee4fa-c856-46e4-84b1-4d7a033709d4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:18.256123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caee4fa-c856-46e4-84b1-4d7a033709d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:18.288215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8caee4fa-c856-46e4-84b1-4d7a033709d4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:18.290394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8caee4fa-c856-46e4-84b1-4d7a033709d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:18.302810 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 15:09:18.597737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc22f1-39ea-4b45-8446-58930ad75570 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:18.610575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc22f1-39ea-4b45-8446-58930ad75570 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:18.615480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f48c0-812b-4a0c-9464-b34b1b5a4faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:18.616135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f48c0-812b-4a0c-9464-b34b1b5a4faf admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:18.616418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f48c0-812b-4a0c-9464-b34b1b5a4faf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:18.616692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f48c0-812b-4a0c-9464-b34b1b5a4faf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:18.625613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f48c0-812b-4a0c-9464-b34b1b5a4faf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:18.627531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f48c0-812b-4a0c-9464-b34b1b5a4faf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:18.641955 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Aug 29 15:09:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:09:18.648175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caee4fa-c856-46e4-84b1-4d7a033709d4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:18.658618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caee4fa-c856-46e4-84b1-4d7a033709d4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:18.663299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e74dca-cca7-4eb2-9c1f-8d031853dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:18.663991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74dca-cca7-4eb2-9c1f-8d031853dc10 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:18.664274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74dca-cca7-4eb2-9c1f-8d031853dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:18.664548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74dca-cca7-4eb2-9c1f-8d031853dc10 admin admin] PATH_INFO: `/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:18.666019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74dca-cca7-4eb2-9c1f-8d031853dc10 admin admin] RBAC: Authorizing `identity:get_user(user_id=2731c4a0421d4cc19a655aaf52f9a3b8)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:18.667935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74dca-cca7-4eb2-9c1f-8d031853dc10 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:18.669593 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4/9] 10.222.0.16 () {56 vars in 1198 bytes} [Mon Aug 29 15:09:18 2022] GET /identity/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:20.687264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b833b02-7309-46e1-8c31-13acdb4b838c None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:20.687803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b833b02-7309-46e1-8c31-13acdb4b838c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:20.687803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b833b02-7309-46e1-8c31-13acdb4b838c None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:20.689428 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:20.695806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fa972-dc47-42ae-b730-da0ff77821e1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:20.696333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fa972-dc47-42ae-b730-da0ff77821e1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:20.696661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fa972-dc47-42ae-b730-da0ff77821e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:20.724166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-522fa972-dc47-42ae-b730-da0ff77821e1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:20.726050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-522fa972-dc47-42ae-b730-da0ff77821e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:20.823194 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:20.903143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae876b-d486-4c77-b6ec-24481bfeacbc None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:20.903532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae876b-d486-4c77-b6ec-24481bfeacbc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:20.903934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae876b-d486-4c77-b6ec-24481bfeacbc None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:20.905946 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 7/12] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:20.913370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c004cb0-2e7e-43ea-8f69-59bdf7fc71b0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:20.913798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c004cb0-2e7e-43ea-8f69-59bdf7fc71b0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:20.913940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c004cb0-2e7e-43ea-8f69-59bdf7fc71b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:20.934829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9c004cb0-2e7e-43ea-8f69-59bdf7fc71b0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:20.936028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9c004cb0-2e7e-43ea-8f69-59bdf7fc71b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:20.956132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:21.026968 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:09:21.095942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae876b-d486-4c77-b6ec-24481bfeacbc None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:21.265874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae876b-d486-4c77-b6ec-24481bfeacbc None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:21.306425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94ebe-ba70-45e0-bb84-30fa979aa051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:21.307734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94ebe-ba70-45e0-bb84-30fa979aa051 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:21.308055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94ebe-ba70-45e0-bb84-30fa979aa051 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:21.308359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94ebe-ba70-45e0-bb84-30fa979aa051 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:21.311972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c004cb0-2e7e-43ea-8f69-59bdf7fc71b0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:21.326973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc94ebe-ba70-45e0-bb84-30fa979aa051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-dbc94ebe-ba70-45e0-bb84-30fa979aa051 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:21.340857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:21.342516 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:21.343980 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 8/14] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:09:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:21.351957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94ebe-ba70-45e0-bb84-30fa979aa051 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:21.399511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:21.466096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c004cb0-2e7e-43ea-8f69-59bdf7fc71b0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:21.485885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94ebe-ba70-45e0-bb84-30fa979aa051 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:21.509345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec957-0a2d-4fbf-9d27-584e92c8c5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:21.510234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec957-0a2d-4fbf-9d27-584e92c8c5a2 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:21.510653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec957-0a2d-4fbf-9d27-584e92c8c5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:21.511063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec957-0a2d-4fbf-9d27-584e92c8c5a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:21.532671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acfef-e714-44ae-bf19-68f8bc3171cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:21.533317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acfef-e714-44ae-bf19-68f8bc3171cb None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:21.533623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acfef-e714-44ae-bf19-68f8bc3171cb None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:21.533896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acfef-e714-44ae-bf19-68f8bc3171cb None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:21.534580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5acfef-e714-44ae-bf19-68f8bc3171cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:21.534879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5acfef-e714-44ae-bf19-68f8bc3171cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:21.536286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5acfef-e714-44ae-bf19-68f8bc3171cb None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:21.549425 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 9/15] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:21.555222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acfef-e714-44ae-bf19-68f8bc3171cb None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:21.559112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:21.630297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec957-0a2d-4fbf-9d27-584e92c8c5a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:21.632489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec957-0a2d-4fbf-9d27-584e92c8c5a2 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:21.660927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:21.668281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acfef-e714-44ae-bf19-68f8bc3171cb None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:21.709240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e145e4-b84e-4543-aee8-5f5adc4b4771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:21.710034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e145e4-b84e-4543-aee8-5f5adc4b4771 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:21.710180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e145e4-b84e-4543-aee8-5f5adc4b4771 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:21.710659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e145e4-b84e-4543-aee8-5f5adc4b4771 None admin] PATH_INFO: `/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:21.712323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e145e4-b84e-4543-aee8-5f5adc4b4771 None admin] RBAC: Authorizing `identity:get_user(user_id=2731c4a0421d4cc19a655aaf52f9a3b8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:21.714087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e145e4-b84e-4543-aee8-5f5adc4b4771 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:21.716466 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 10/16] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:21 2022] GET /identity/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:21.722492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e145e4-b84e-4543-aee8-5f5adc4b4771 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:21.789576 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 7/17] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:09:21.798298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec957-0a2d-4fbf-9d27-584e92c8c5a2 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:21.862005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:21.866104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e145e4-b84e-4543-aee8-5f5adc4b4771 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:21.902204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db8941-eaeb-49cf-95f4-93a99f12e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:21.903301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db8941-eaeb-49cf-95f4-93a99f12e4cc None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:21.903579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db8941-eaeb-49cf-95f4-93a99f12e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:21.903850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db8941-eaeb-49cf-95f4-93a99f12e4cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:21.905128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db8941-eaeb-49cf-95f4-93a99f12e4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:21.906649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db8941-eaeb-49cf-95f4-93a99f12e4cc None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:21.908253 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 11/18] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:21.914451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db8941-eaeb-49cf-95f4-93a99f12e4cc None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:21.943029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec957-0a2d-4fbf-9d27-584e92c8c5a2 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:21.950525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:21.989520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cca47-a1cc-42c7-acca-ecaa388c3904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:21.990174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cca47-a1cc-42c7-acca-ecaa388c3904 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:21.990451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cca47-a1cc-42c7-acca-ecaa388c3904 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:21.990728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cca47-a1cc-42c7-acca-ecaa388c3904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:22.003139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cca47-a1cc-42c7-acca-ecaa388c3904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:22.004681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cca47-a1cc-42c7-acca-ecaa388c3904 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-ca2cca47-a1cc-42c7-acca-ecaa388c3904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:09:22.026007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:22.027074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:09:22.028453 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:09:22.028453 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:09:22.028453 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:22.028453 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 8/19] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:09:22.033871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cca47-a1cc-42c7-acca-ecaa388c3904 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:22.040206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db8941-eaeb-49cf-95f4-93a99f12e4cc None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:22.102324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad14d34-134b-43f6-aa63-6b92dbc3fccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:22.102942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14d34-134b-43f6-aa63-6b92dbc3fccf None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:22.103221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14d34-134b-43f6-aa63-6b92dbc3fccf None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:22.103495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14d34-134b-43f6-aa63-6b92dbc3fccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:22.104248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad14d34-134b-43f6-aa63-6b92dbc3fccf None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.domain.id=default, user.id=2731c4a0421d4cc19a655aaf52f9a3b8) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:22.104552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad14d34-134b-43f6-aa63-6b92dbc3fccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:22.106645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad14d34-134b-43f6-aa63-6b92dbc3fccf None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:22.116742 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 12/20] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Aug 29 15:09:21 2022] GET /identity/v3/role_assignments?user.id=2731c4a0421d4cc19a655aaf52f9a3b8&scope.domain.id=default&role.id=be89abac608f45a6921181bcc574f721 => generated 233 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:22.173179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cca47-a1cc-42c7-acca-ecaa388c3904 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:22.176149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:22.218971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a2105-2d37-4730-b7e7-21a66f253721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:22.219643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a2105-2d37-4730-b7e7-21a66f253721 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:22.219925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a2105-2d37-4730-b7e7-21a66f253721 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:22.220238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a2105-2d37-4730-b7e7-21a66f253721 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:22.221179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a2105-2d37-4730-b7e7-21a66f253721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:22.221540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a2105-2d37-4730-b7e7-21a66f253721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:22.223169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a2105-2d37-4730-b7e7-21a66f253721 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:22.245111 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 9/21] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:24.483168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069f767-5078-42c8-b07a-c209babddaf2 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:24.483732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069f767-5078-42c8-b07a-c209babddaf2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:24.483732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069f767-5078-42c8-b07a-c209babddaf2 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:24.485098 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 13/22] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:24.490708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74e86c-73e5-4a9c-82f4-8c81a3bffa01 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:24.491228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74e86c-73e5-4a9c-82f4-8c81a3bffa01 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:24.491228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74e86c-73e5-4a9c-82f4-8c81a3bffa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:24.517600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-eb74e86c-73e5-4a9c-82f4-8c81a3bffa01 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:24.518836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-eb74e86c-73e5-4a9c-82f4-8c81a3bffa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:24.624969 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 10/23] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:09:24.909796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2525df-f751-4d88-b3c9-d8aeda955f16 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:24.910053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2525df-f751-4d88-b3c9-d8aeda955f16 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:24.910465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2525df-f751-4d88-b3c9-d8aeda955f16 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:24.911972 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 14/24] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:09:24.917084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362fea6-eccd-4475-b7e6-1b56c1799e26 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:24.917400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362fea6-eccd-4475-b7e6-1b56c1799e26 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:24.917658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362fea6-eccd-4475-b7e6-1b56c1799e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:24.943178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8362fea6-eccd-4475-b7e6-1b56c1799e26 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:24.944360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8362fea6-eccd-4475-b7e6-1b56c1799e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:25.038521 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 11/25] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:25.144371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2525df-f751-4d88-b3c9-d8aeda955f16 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:25.236993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66155a22-c652-45b9-9975-2fa49b66ae40 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:25.237237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66155a22-c652-45b9-9975-2fa49b66ae40 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:25.237636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66155a22-c652-45b9-9975-2fa49b66ae40 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:25.239179 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 12/26] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:09:25.245158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8358f-d382-41ce-a8e1-cdaa7e70e41c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:25.245616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8358f-d382-41ce-a8e1-cdaa7e70e41c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:25.245872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8358f-d382-41ce-a8e1-cdaa7e70e41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:25.267486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-19d8358f-d382-41ce-a8e1-cdaa7e70e41c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:25.268843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-19d8358f-d382-41ce-a8e1-cdaa7e70e41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:25.285907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:25.308125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2525df-f751-4d88-b3c9-d8aeda955f16 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:25.335414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:25.375416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233d2bc-56b0-4a8b-9e6f-4f6d00ef36b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:25.376452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233d2bc-56b0-4a8b-9e6f-4f6d00ef36b8 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:25.376929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233d2bc-56b0-4a8b-9e6f-4f6d00ef36b8 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:25.377412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233d2bc-56b0-4a8b-9e6f-4f6d00ef36b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:25.405280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233d2bc-56b0-4a8b-9e6f-4f6d00ef36b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-f233d2bc-56b0-4a8b-9e6f-4f6d00ef36b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:25.416226 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:25.417171 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:25.418535 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:25.419121 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 15/27] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:09:25.439340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233d2bc-56b0-4a8b-9e6f-4f6d00ef36b8 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:25.472839 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 13/28] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:09:25.504146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874cad-f6f5-44ee-a156-808706fde38c None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:25.505076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874cad-f6f5-44ee-a156-808706fde38c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:25.505076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b874cad-f6f5-44ee-a156-808706fde38c None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:25.506730 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 14/29] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:09:25.518260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a83cfb-021a-4e1b-b197-8c7aa1506c1e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:25.518612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a83cfb-021a-4e1b-b197-8c7aa1506c1e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:25.518883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a83cfb-021a-4e1b-b197-8c7aa1506c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:25.554534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-71a83cfb-021a-4e1b-b197-8c7aa1506c1e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:25.556449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-71a83cfb-021a-4e1b-b197-8c7aa1506c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:25.673458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233d2bc-56b0-4a8b-9e6f-4f6d00ef36b8 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:25.707293 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 15/30] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:09:25.708155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a83cfb-021a-4e1b-b197-8c7aa1506c1e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:25.743393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b3f9-1948-43e4-afcb-33165c2cd4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:25.744005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b3f9-1948-43e4-afcb-33165c2cd4ba None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:25.744521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b3f9-1948-43e4-afcb-33165c2cd4ba None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:25.744804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b3f9-1948-43e4-afcb-33165c2cd4ba None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:25.746510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296b3f9-1948-43e4-afcb-33165c2cd4ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:25.746822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296b3f9-1948-43e4-afcb-33165c2cd4ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:25.748237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296b3f9-1948-43e4-afcb-33165c2cd4ba None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:25.768284 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:25.778512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b3f9-1948-43e4-afcb-33165c2cd4ba None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:25.812493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:25.861124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:25.909275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a83cfb-021a-4e1b-b197-8c7aa1506c1e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:26.004271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831bb24-0d6e-4c95-8eb3-d6dbc7deadd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:26.004912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831bb24-0d6e-4c95-8eb3-d6dbc7deadd5 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:26.005191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831bb24-0d6e-4c95-8eb3-d6dbc7deadd5 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:26.005477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831bb24-0d6e-4c95-8eb3-d6dbc7deadd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:26.018007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831bb24-0d6e-4c95-8eb3-d6dbc7deadd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:26.019574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831bb24-0d6e-4c95-8eb3-d6dbc7deadd5 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-a831bb24-0d6e-4c95-8eb3-d6dbc7deadd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:09:26.038493 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:26.039541 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:09:26.040393 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:09:26.040393 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:09:26.040393 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:26.040393 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 16/32] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:26.041099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831bb24-0d6e-4c95-8eb3-d6dbc7deadd5 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:26.042426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b3f9-1948-43e4-afcb-33165c2cd4ba None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:26.117289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aebf9c-c4fc-423d-8408-b43de1d3e7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:26.118081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aebf9c-c4fc-423d-8408-b43de1d3e7ee None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:26.118425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aebf9c-c4fc-423d-8408-b43de1d3e7ee None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:26.118717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aebf9c-c4fc-423d-8408-b43de1d3e7ee None admin] PATH_INFO: `/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:26.121592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aebf9c-c4fc-423d-8408-b43de1d3e7ee None admin] RBAC: Authorizing `identity:get_user(user_id=2731c4a0421d4cc19a655aaf52f9a3b8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:26.123347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aebf9c-c4fc-423d-8408-b43de1d3e7ee None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:26.125301 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 17/33] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:25 2022] GET /identity/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8 => generated 247 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:26.126159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aebf9c-c4fc-423d-8408-b43de1d3e7ee None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:26.193820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831bb24-0d6e-4c95-8eb3-d6dbc7deadd5 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:26.242052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb68d-889e-4f2b-b571-07e7146b0dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:26.242676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb68d-889e-4f2b-b571-07e7146b0dce None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:26.242955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb68d-889e-4f2b-b571-07e7146b0dce None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:26.243230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb68d-889e-4f2b-b571-07e7146b0dce None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:26.243958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb68d-889e-4f2b-b571-07e7146b0dce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:26.245446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb68d-889e-4f2b-b571-07e7146b0dce None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:26.253025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:26.269745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:26.289366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aebf9c-c4fc-423d-8408-b43de1d3e7ee None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:26.334923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c33d4-b8eb-44ce-a280-40ab7992bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:26.336127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c33d4-b8eb-44ce-a280-40ab7992bfdd None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:26.336614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c33d4-b8eb-44ce-a280-40ab7992bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:26.337119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c33d4-b8eb-44ce-a280-40ab7992bfdd None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:26.338437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c33d4-b8eb-44ce-a280-40ab7992bfdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:26.339001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c33d4-b8eb-44ce-a280-40ab7992bfdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:26.341451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c33d4-b8eb-44ce-a280-40ab7992bfdd None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:26.367150 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 18/34] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:26.368385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c33d4-b8eb-44ce-a280-40ab7992bfdd None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:26.401200 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 17/35] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Aug 29 15:09:26 2022] POST /identity/v3/roles => generated 219 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:09:26.406065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb68d-889e-4f2b-b571-07e7146b0dce None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:26.544781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c33d4-b8eb-44ce-a280-40ab7992bfdd None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:26.574142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb68d-889e-4f2b-b571-07e7146b0dce None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:26.604488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7fe03-8432-4648-a4d9-23a94c294cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:26.605336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fe03-8432-4648-a4d9-23a94c294cef None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:26.605762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fe03-8432-4648-a4d9-23a94c294cef None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:26.606119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fe03-8432-4648-a4d9-23a94c294cef None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:26.607173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7fe03-8432-4648-a4d9-23a94c294cef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:26.609258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7fe03-8432-4648-a4d9-23a94c294cef None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:26.631991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d505fa-0bbf-472e-bb47-1ac311ac8035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:26.632643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d505fa-0bbf-472e-bb47-1ac311ac8035 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:26.632939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d505fa-0bbf-472e-bb47-1ac311ac8035 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:26.633227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d505fa-0bbf-472e-bb47-1ac311ac8035 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:26.637680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d505fa-0bbf-472e-bb47-1ac311ac8035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:26.639402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d505fa-0bbf-472e-bb47-1ac311ac8035 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:26.640678 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 18/36] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:26.642417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d505fa-0bbf-472e-bb47-1ac311ac8035 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:26.722305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:26.747712 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Aug 29 15:09:26 2022] POST /identity/v3/roles => generated 225 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:09:26.749416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fec9e-249b-44a9-8eac-acbd80d9749e None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:26.749709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fec9e-249b-44a9-8eac-acbd80d9749e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:26.750007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fec9e-249b-44a9-8eac-acbd80d9749e None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:26.751493 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 20/38] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:26.752818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc39c6-3e3c-4331-9909-9f3d68c31b02 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:26.753035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc39c6-3e3c-4331-9909-9f3d68c31b02 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:26.753314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc39c6-3e3c-4331-9909-9f3d68c31b02 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:26.757187 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 21/39] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:26.757187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc39c6-3e3c-4331-9909-9f3d68c31b02 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:26.771686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:26.805147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d505fa-0bbf-472e-bb47-1ac311ac8035 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:26.857824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62104318-617b-448a-9fac-feef4f8be126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:26.858630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62104318-617b-448a-9fac-feef4f8be126 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:26.858987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62104318-617b-448a-9fac-feef4f8be126 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:26.859329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62104318-617b-448a-9fac-feef4f8be126 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:26.860120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62104318-617b-448a-9fac-feef4f8be126 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:26.861874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62104318-617b-448a-9fac-feef4f8be126 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:26.907738 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 19/40] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:09:26 2022] POST /identity/v3/projects => generated 301 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:09:26.907738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc19233-2877-4d1e-882e-57e59f223106 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:26.907738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc19233-2877-4d1e-882e-57e59f223106 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:26.907738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc19233-2877-4d1e-882e-57e59f223106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:26.922306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc39c6-3e3c-4331-9909-9f3d68c31b02 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:26.980804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7242f90-380f-4f7c-85b7-ebe3e6a0f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:26.982419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7242f90-380f-4f7c-85b7-ebe3e6a0f1fc None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:26.983218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7242f90-380f-4f7c-85b7-ebe3e6a0f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:26.983694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7242f90-380f-4f7c-85b7-ebe3e6a0f1fc None admin] PATH_INFO: `/v3/domains/default/users/2731c4a0421d4cc19a655aaf52f9a3b8/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:26.987413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7242f90-380f-4f7c-85b7-ebe3e6a0f1fc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2731c4a0421d4cc19a655aaf52f9a3b8, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:26.989213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7242f90-380f-4f7c-85b7-ebe3e6a0f1fc None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:27.010862 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 22/41] 10.222.0.16 () {58 vars in 1361 bytes} [Mon Aug 29 15:09:26 2022] PUT /identity/v3/domains/default/users/2731c4a0421d4cc19a655aaf52f9a3b8/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:09:27.014008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038680-8dd3-4964-8747-f3ad18a7eb51 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:27.014300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038680-8dd3-4964-8747-f3ad18a7eb51 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:27.014667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038680-8dd3-4964-8747-f3ad18a7eb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:27.039599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG passlib.handlers.bcrypt [None req-b4038680-8dd3-4964-8747-f3ad18a7eb51 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=89680) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 15:09:27.040117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG passlib.handlers.bcrypt [None req-b4038680-8dd3-4964-8747-f3ad18a7eb51 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=89680) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 15:09:27.076833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-edc19233-2877-4d1e-882e-57e59f223106 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:27.078701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-edc19233-2877-4d1e-882e-57e59f223106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:27.092109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b4038680-8dd3-4964-8747-f3ad18a7eb51 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:27.093805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b4038680-8dd3-4964-8747-f3ad18a7eb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:27.195335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:27.209424 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:27.209666 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 20/43] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:27.494893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4038680-8dd3-4964-8747-f3ad18a7eb51 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:27.503323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc19233-2877-4d1e-882e-57e59f223106 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:27.587160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:27.671710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4038680-8dd3-4964-8747-f3ad18a7eb51 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:27.677378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc19233-2877-4d1e-882e-57e59f223106 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:27.723690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7715aaf-e4db-475c-a1d1-6b203501a5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:27.724612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7715aaf-e4db-475c-a1d1-6b203501a5b8 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:27.724891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7715aaf-e4db-475c-a1d1-6b203501a5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:27.725160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7715aaf-e4db-475c-a1d1-6b203501a5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:27.726068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7715aaf-e4db-475c-a1d1-6b203501a5b8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:27.727641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7715aaf-e4db-475c-a1d1-6b203501a5b8 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:27.735958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949492c2-2b62-49c8-9156-f127ef647c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:27.737092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949492c2-2b62-49c8-9156-f127ef647c5c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:27.737609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949492c2-2b62-49c8-9156-f127ef647c5c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:27.737972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949492c2-2b62-49c8-9156-f127ef647c5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:27.739286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949492c2-2b62-49c8-9156-f127ef647c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:27.741370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949492c2-2b62-49c8-9156-f127ef647c5c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:27.743737 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 21/44] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:27.753531 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 24/45] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Aug 29 15:09:27 2022] POST /identity/v3/roles => generated 223 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:09:27.754273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949492c2-2b62-49c8-9156-f127ef647c5c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:27.902017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949492c2-2b62-49c8-9156-f127ef647c5c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:27.922930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:27.950497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690aea1c-7ba2-4108-b45c-75afee1d52a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:27.951115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aea1c-7ba2-4108-b45c-75afee1d52a1 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:27.951396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aea1c-7ba2-4108-b45c-75afee1d52a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:27.951676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aea1c-7ba2-4108-b45c-75afee1d52a1 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:27.952346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aea1c-7ba2-4108-b45c-75afee1d52a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:27.954035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aea1c-7ba2-4108-b45c-75afee1d52a1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:27.984605 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 22/46] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:09:27 2022] POST /identity/v3/projects => generated 312 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:09:29.136576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a7ccc-0f60-4a81-985d-9bd58ee71943 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:29.137641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a7ccc-0f60-4a81-985d-9bd58ee71943 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:29.137754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a7ccc-0f60-4a81-985d-9bd58ee71943 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:29.139057 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 25/47] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:09:29.145570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f30235-d0ce-41ad-9728-d27509de9b35 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:29.146088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f30235-d0ce-41ad-9728-d27509de9b35 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:29.146179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f30235-d0ce-41ad-9728-d27509de9b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:29.167714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-54f30235-d0ce-41ad-9728-d27509de9b35 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:29.169623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-54f30235-d0ce-41ad-9728-d27509de9b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:29.245680 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 23/48] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:29.521632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a7ccc-0f60-4a81-985d-9bd58ee71943 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:29.588134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:29.642539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a7ccc-0f60-4a81-985d-9bd58ee71943 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:29.679996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7bb4-a8cd-4dbd-9fcf-2b685072cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:29.680684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7bb4-a8cd-4dbd-9fcf-2b685072cce1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:29.680995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7bb4-a8cd-4dbd-9fcf-2b685072cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:29.681267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7bb4-a8cd-4dbd-9fcf-2b685072cce1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:29.695672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e7bb4-a8cd-4dbd-9fcf-2b685072cce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-726e7bb4-a8cd-4dbd-9fcf-2b685072cce1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:29.705927 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:29.706982 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:29.707916 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 26/49] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:09:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:29.715044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f30235-d0ce-41ad-9728-d27509de9b35 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:29.818196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:29.829022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f30235-d0ce-41ad-9728-d27509de9b35 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:29.872688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008f197-2e80-47a5-8045-883ebb4c9e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:29.873345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008f197-2e80-47a5-8045-883ebb4c9e4d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:29.873691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008f197-2e80-47a5-8045-883ebb4c9e4d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:29.873970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008f197-2e80-47a5-8045-883ebb4c9e4d None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:29.875045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008f197-2e80-47a5-8045-883ebb4c9e4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:29.875532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008f197-2e80-47a5-8045-883ebb4c9e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:29.877725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008f197-2e80-47a5-8045-883ebb4c9e4d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:29.892741 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 24/50] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:29.898365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7bb4-a8cd-4dbd-9fcf-2b685072cce1 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:30.031011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7bb4-a8cd-4dbd-9fcf-2b685072cce1 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:30.045828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4de298-1d78-4751-91e3-9ae93ef6366d None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:30.046122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4de298-1d78-4751-91e3-9ae93ef6366d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:30.046402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4de298-1d78-4751-91e3-9ae93ef6366d None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:30.047764 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 25/51] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:09:30.049840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:30.053240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715899db-05c0-49db-9068-6b4babc15b29 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:30.053579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715899db-05c0-49db-9068-6b4babc15b29 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:30.053857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715899db-05c0-49db-9068-6b4babc15b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:30.072101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f37dd-0587-4a27-a6b4-9a96badcfbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:30.072649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f37dd-0587-4a27-a6b4-9a96badcfbb3 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:30.072963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f37dd-0587-4a27-a6b4-9a96badcfbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:30.073370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f37dd-0587-4a27-a6b4-9a96badcfbb3 None admin] PATH_INFO: `/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:30.073823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-715899db-05c0-49db-9068-6b4babc15b29 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:30.075114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-715899db-05c0-49db-9068-6b4babc15b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:30.075444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f37dd-0587-4a27-a6b4-9a96badcfbb3 None admin] RBAC: Authorizing `identity:get_user(user_id=2731c4a0421d4cc19a655aaf52f9a3b8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:30.077412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f37dd-0587-4a27-a6b4-9a96badcfbb3 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:30.079078 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 27/52] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:29 2022] GET /identity/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:30.085008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f37dd-0587-4a27-a6b4-9a96badcfbb3 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:30.159451 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 26/53] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:09:30.208366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f37dd-0587-4a27-a6b4-9a96badcfbb3 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:30.245288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afd662-eb4e-49c9-b458-c6dc1c0ab98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:30.245954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afd662-eb4e-49c9-b458-c6dc1c0ab98d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:30.246268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afd662-eb4e-49c9-b458-c6dc1c0ab98d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:30.246546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afd662-eb4e-49c9-b458-c6dc1c0ab98d None admin] PATH_INFO: `/v3/domains/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:30.247702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afd662-eb4e-49c9-b458-c6dc1c0ab98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:30.249151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afd662-eb4e-49c9-b458-c6dc1c0ab98d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:30.250784 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 28/54] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:30.260962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715899db-05c0-49db-9068-6b4babc15b29 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:30.378724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:30.392078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715899db-05c0-49db-9068-6b4babc15b29 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:30.442197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afd662-eb4e-49c9-b458-c6dc1c0ab98d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:30.443749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69fe8-aaf1-4d71-884e-17300adcbdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:30.444768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69fe8-aaf1-4d71-884e-17300adcbdd7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:30.445564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69fe8-aaf1-4d71-884e-17300adcbdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:30.445916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69fe8-aaf1-4d71-884e-17300adcbdd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:30.447332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e69fe8-aaf1-4d71-884e-17300adcbdd7 None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.domain.id=default, user.id=2731c4a0421d4cc19a655aaf52f9a3b8) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:30.447850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e69fe8-aaf1-4d71-884e-17300adcbdd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:30.450145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e69fe8-aaf1-4d71-884e-17300adcbdd7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:30.458669 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Aug 29 15:09:30 2022] GET /identity/v3/role_assignments?user.id=2731c4a0421d4cc19a655aaf52f9a3b8&scope.domain.id=default&role.id=be89abac608f45a6921181bcc574f721 => generated 530 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:30.508253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:30.564642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afd662-eb4e-49c9-b458-c6dc1c0ab98d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:30.612807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b39df0-2100-43bf-b0e5-a08dbae40219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:30.613514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b39df0-2100-43bf-b0e5-a08dbae40219 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:30.613799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b39df0-2100-43bf-b0e5-a08dbae40219 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:30.614077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b39df0-2100-43bf-b0e5-a08dbae40219 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:30.615318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b39df0-2100-43bf-b0e5-a08dbae40219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:30.616803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b39df0-2100-43bf-b0e5-a08dbae40219 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:30.618479 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 29/56] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:30.624911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69fe8-aaf1-4d71-884e-17300adcbdd7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:30.754080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69fe8-aaf1-4d71-884e-17300adcbdd7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:30.790576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74d84f-6aca-42b7-b341-cdfc6a13a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:30.791356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d84f-6aca-42b7-b341-cdfc6a13a12e None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:30.791856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d84f-6aca-42b7-b341-cdfc6a13a12e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:30.792207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d84f-6aca-42b7-b341-cdfc6a13a12e None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:30.793674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74d84f-6aca-42b7-b341-cdfc6a13a12e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:30.795259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74d84f-6aca-42b7-b341-cdfc6a13a12e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:30.826000 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 28/57] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Aug 29 15:09:30 2022] POST /identity/v3/projects => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:09:32.808380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998980-3943-4c06-bf04-1d8e23b80a7e None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:32.808880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998980-3943-4c06-bf04-1d8e23b80a7e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:32.808880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998980-3943-4c06-bf04-1d8e23b80a7e None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:32.810802 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 30/58] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:32.818178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc16b41-0cd7-4238-a9cf-ca61527a474f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:32.818688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc16b41-0cd7-4238-a9cf-ca61527a474f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:32.818893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc16b41-0cd7-4238-a9cf-ca61527a474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:32.828306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:32.842229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dbc16b41-0cd7-4238-a9cf-ca61527a474f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:32.843683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dbc16b41-0cd7-4238-a9cf-ca61527a474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:32.922862 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:33.216272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998980-3943-4c06-bf04-1d8e23b80a7e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:33.337210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998980-3943-4c06-bf04-1d8e23b80a7e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:33.362516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:33.377933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fad75-cbcb-4541-abab-288c31462f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:33.378673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fad75-cbcb-4541-abab-288c31462f28 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:33.378995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fad75-cbcb-4541-abab-288c31462f28 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:33.379344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fad75-cbcb-4541-abab-288c31462f28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:33.380541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fad75-cbcb-4541-abab-288c31462f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:33.382243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fad75-cbcb-4541-abab-288c31462f28 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:33.384207 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 31/60] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:33.390446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc16b41-0cd7-4238-a9cf-ca61527a474f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:33.505046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc16b41-0cd7-4238-a9cf-ca61527a474f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:33.541938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b62fd-4e91-41c9-89e4-da596d7fa934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:33.542555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b62fd-4e91-41c9-89e4-da596d7fa934 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:33.542837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b62fd-4e91-41c9-89e4-da596d7fa934 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:33.543142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b62fd-4e91-41c9-89e4-da596d7fa934 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:33.543811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b62fd-4e91-41c9-89e4-da596d7fa934 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:33.545279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b62fd-4e91-41c9-89e4-da596d7fa934 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:33.555393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:33.573341 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:09:33 2022] POST /identity/v3/users => generated 275 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:09:36.826899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84b9f-8e64-4385-a2d6-04ae12b0281a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:36.828021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84b9f-8e64-4385-a2d6-04ae12b0281a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:36.828561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84b9f-8e64-4385-a2d6-04ae12b0281a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:36.830439 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 32/62] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:36.836661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb18196-a3ac-48fe-892f-d94276b60530 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:36.837212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb18196-a3ac-48fe-892f-d94276b60530 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:36.837212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb18196-a3ac-48fe-892f-d94276b60530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:36.867517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-deb18196-a3ac-48fe-892f-d94276b60530 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:36.868786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-deb18196-a3ac-48fe-892f-d94276b60530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:36.964111 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 31/63] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:37.130894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf98401-d714-4b8a-a31f-102c84421016 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:37.130894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf98401-d714-4b8a-a31f-102c84421016 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:37.130894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf98401-d714-4b8a-a31f-102c84421016 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:37.130894 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 33/64] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:37.151631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bda55-6a42-4e93-9508-1bef4e15ea02 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:37.151914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bda55-6a42-4e93-9508-1bef4e15ea02 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:37.152436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bda55-6a42-4e93-9508-1bef4e15ea02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:37.180916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2a5bda55-6a42-4e93-9508-1bef4e15ea02 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:37.182510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2a5bda55-6a42-4e93-9508-1bef4e15ea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:37.291926 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 32/65] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:37.316309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf98401-d714-4b8a-a31f-102c84421016 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:37.422376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b048b-2973-422c-97fb-707b7772d72d None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:37.423212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b048b-2973-422c-97fb-707b7772d72d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:37.423784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b048b-2973-422c-97fb-707b7772d72d None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:37.426737 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 33/66] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:37.433454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7320690-e6eb-4691-81ec-71a0f8d30a2d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:37.433723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7320690-e6eb-4691-81ec-71a0f8d30a2d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:37.433919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7320690-e6eb-4691-81ec-71a0f8d30a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:37.473305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a7320690-e6eb-4691-81ec-71a0f8d30a2d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:37.474564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a7320690-e6eb-4691-81ec-71a0f8d30a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:37.589880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:37.628326 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:09:37.629620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7320690-e6eb-4691-81ec-71a0f8d30a2d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:37.676623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf98401-d714-4b8a-a31f-102c84421016 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:37.717253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c51cd-c215-47a7-b6b7-40cb5ee167ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:37.718161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c51cd-c215-47a7-b6b7-40cb5ee167ef None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:37.718622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c51cd-c215-47a7-b6b7-40cb5ee167ef None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:37.719187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c51cd-c215-47a7-b6b7-40cb5ee167ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:37.731905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c51cd-c215-47a7-b6b7-40cb5ee167ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-895c51cd-c215-47a7-b6b7-40cb5ee167ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:37.738046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:37.739055 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:37.739864 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:37.742561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 34/68] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:37.744922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64625e-5119-41a7-a5f4-3c9aa9be73bd None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:37.745560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64625e-5119-41a7-a5f4-3c9aa9be73bd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:37.746073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64625e-5119-41a7-a5f4-3c9aa9be73bd None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:37.748705 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 35/69] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:37.749829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64625e-5119-41a7-a5f4-3c9aa9be73bd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:37.773254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7320690-e6eb-4691-81ec-71a0f8d30a2d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:37.818043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:37.838755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa54591-f44b-458f-ba04-59be3f3eb057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:37.839584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa54591-f44b-458f-ba04-59be3f3eb057 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:37.840190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa54591-f44b-458f-ba04-59be3f3eb057 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:37.840915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa54591-f44b-458f-ba04-59be3f3eb057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:37.859573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa54591-f44b-458f-ba04-59be3f3eb057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-daa54591-f44b-458f-ba04-59be3f3eb057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:37.869921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:37.871001 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:37.872427 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 35/70] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:09:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:37.875787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401bc6c-ec9c-4e48-833a-b546244d445b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:37.876410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401bc6c-ec9c-4e48-833a-b546244d445b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:37.876912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401bc6c-ec9c-4e48-833a-b546244d445b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:37.899048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64625e-5119-41a7-a5f4-3c9aa9be73bd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:37.906577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8401bc6c-ec9c-4e48-833a-b546244d445b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:37.908161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8401bc6c-ec9c-4e48-833a-b546244d445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:37.941150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a989ed0-4079-4f9b-8c5d-38cd07781cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:37.942083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a989ed0-4079-4f9b-8c5d-38cd07781cd7 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:37.942364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a989ed0-4079-4f9b-8c5d-38cd07781cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:37.942645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a989ed0-4079-4f9b-8c5d-38cd07781cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:37.943324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a989ed0-4079-4f9b-8c5d-38cd07781cd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:37.943626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a989ed0-4079-4f9b-8c5d-38cd07781cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:37.945004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a989ed0-4079-4f9b-8c5d-38cd07781cd7 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:37.955765 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:09:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:37.957477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02443f18-3b95-4beb-bd91-1ce51d276b2c None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:37.957888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02443f18-3b95-4beb-bd91-1ce51d276b2c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:37.958172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02443f18-3b95-4beb-bd91-1ce51d276b2c None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:37.960000 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 37/72] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:37.960894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02443f18-3b95-4beb-bd91-1ce51d276b2c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:37.963447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:38.006581 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 36/73] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:38.007561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401bc6c-ec9c-4e48-833a-b546244d445b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:38.102834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02443f18-3b95-4beb-bd91-1ce51d276b2c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:38.119932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:38.142825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401bc6c-ec9c-4e48-833a-b546244d445b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:38.152005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d226bf-851d-4f4c-aded-e52e69687ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:38.152631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d226bf-851d-4f4c-aded-e52e69687ef7 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:38.155347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d226bf-851d-4f4c-aded-e52e69687ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:38.155347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d226bf-851d-4f4c-aded-e52e69687ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:38.155347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d226bf-851d-4f4c-aded-e52e69687ef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:38.155347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d226bf-851d-4f4c-aded-e52e69687ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:38.158710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d226bf-851d-4f4c-aded-e52e69687ef7 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:38.176124 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:38.176124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d226bf-851d-4f4c-aded-e52e69687ef7 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:38.194647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14085b-bf26-4d9e-87c8-6833ae09ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:38.195251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14085b-bf26-4d9e-87c8-6833ae09ec17 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:38.195581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14085b-bf26-4d9e-87c8-6833ae09ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:38.195893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14085b-bf26-4d9e-87c8-6833ae09ec17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:38.209623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14085b-bf26-4d9e-87c8-6833ae09ec17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-eb14085b-bf26-4d9e-87c8-6833ae09ec17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:38.214793 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:38.215827 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:38.216630 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:09:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:38.217909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3012559-4125-4ebd-ac29-892b8e433800 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:38.217909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3012559-4125-4ebd-ac29-892b8e433800 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:38.218076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3012559-4125-4ebd-ac29-892b8e433800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:38.239848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b3012559-4125-4ebd-ac29-892b8e433800 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:38.241165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b3012559-4125-4ebd-ac29-892b8e433800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:38.282381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:38.321744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d226bf-851d-4f4c-aded-e52e69687ef7 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:38.335124 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 38/76] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:38.335988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3012559-4125-4ebd-ac29-892b8e433800 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:38.370072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90425457-9d47-487a-a0db-e86ee0083075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:38.370818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90425457-9d47-487a-a0db-e86ee0083075 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:38.371168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90425457-9d47-487a-a0db-e86ee0083075 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:38.371532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90425457-9d47-487a-a0db-e86ee0083075 None admin] PATH_INFO: `/v3/users/dc4f177107dd484bb54b563adc03c2c7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:38.388554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90425457-9d47-487a-a0db-e86ee0083075 None admin] RBAC: Authorizing `identity:get_user(user_id=dc4f177107dd484bb54b563adc03c2c7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:38.390468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90425457-9d47-487a-a0db-e86ee0083075 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:38.392228 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 39/77] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:38 2022] GET /identity/v3/users/dc4f177107dd484bb54b563adc03c2c7 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:38.393033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90425457-9d47-487a-a0db-e86ee0083075 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:38.445282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:38.476642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3012559-4125-4ebd-ac29-892b8e433800 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:38.522541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd037652-1a00-4232-8a07-c361ec762c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:38.523331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd037652-1a00-4232-8a07-c361ec762c64 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:38.523722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd037652-1a00-4232-8a07-c361ec762c64 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:38.524013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd037652-1a00-4232-8a07-c361ec762c64 None admin] PATH_INFO: `/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:38.525528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd037652-1a00-4232-8a07-c361ec762c64 None admin] RBAC: Authorizing `identity:get_user(user_id=2731c4a0421d4cc19a655aaf52f9a3b8)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:38.527341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd037652-1a00-4232-8a07-c361ec762c64 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:38.529350 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 39/78] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:38 2022] GET /identity/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:38.530155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd037652-1a00-4232-8a07-c361ec762c64 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:38.539325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90425457-9d47-487a-a0db-e86ee0083075 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:38.570927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:38.585865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2cae6-969c-4453-bbbc-f57549ea4272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:38.586639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2cae6-969c-4453-bbbc-f57549ea4272 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:38.587036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2cae6-969c-4453-bbbc-f57549ea4272 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:38.587408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2cae6-969c-4453-bbbc-f57549ea4272 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:38.588104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2cae6-969c-4453-bbbc-f57549ea4272 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:38.588771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2cae6-969c-4453-bbbc-f57549ea4272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:38.591303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2cae6-969c-4453-bbbc-f57549ea4272 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:38.608649 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:09:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:38.608649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2cae6-969c-4453-bbbc-f57549ea4272 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:38.673660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd037652-1a00-4232-8a07-c361ec762c64 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:38.716981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455632d-69e2-4358-baf8-957800372913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:38.717995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455632d-69e2-4358-baf8-957800372913 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:38.718485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455632d-69e2-4358-baf8-957800372913 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:38.718967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455632d-69e2-4358-baf8-957800372913 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:38.729555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:38.736960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455632d-69e2-4358-baf8-957800372913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:38.739887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2cae6-969c-4453-bbbc-f57549ea4272 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-0455632d-69e2-4358-baf8-957800372913 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:38.747502 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:38.748658 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:38.749666 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 40/80] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:38.751143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455632d-69e2-4358-baf8-957800372913 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:38.783113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fa54e-c101-4062-bb95-6a6ad1335cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:38.783758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa54e-c101-4062-bb95-6a6ad1335cd1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:38.784039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa54e-c101-4062-bb95-6a6ad1335cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:38.784320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa54e-c101-4062-bb95-6a6ad1335cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:38.872217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fa54e-c101-4062-bb95-6a6ad1335cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:38.873529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fa54e-c101-4062-bb95-6a6ad1335cd1 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:38.885558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:38.900156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455632d-69e2-4358-baf8-957800372913 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:38.941780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795e60a-ce69-4265-a0ba-503e17ccbf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:38.942451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e60a-ce69-4265-a0ba-503e17ccbf5b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:38.942738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e60a-ce69-4265-a0ba-503e17ccbf5b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:38.943019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e60a-ce69-4265-a0ba-503e17ccbf5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:38.976515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:38.991054 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 41/81] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:38.992345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fa54e-c101-4062-bb95-6a6ad1335cd1 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:39.020084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795e60a-ce69-4265-a0ba-503e17ccbf5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:39.021608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795e60a-ce69-4265-a0ba-503e17ccbf5b None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:39.106005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fa54e-c101-4062-bb95-6a6ad1335cd1 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:39.118300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:39.133637 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 41/82] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:39.134527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795e60a-ce69-4265-a0ba-503e17ccbf5b None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:39.150752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2b23-e93f-452a-bd7a-36359794b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:39.151405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2b23-e93f-452a-bd7a-36359794b611 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:39.151687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2b23-e93f-452a-bd7a-36359794b611 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:39.151963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2b23-e93f-452a-bd7a-36359794b611 None admin] PATH_INFO: `/v3/users/dc4f177107dd484bb54b563adc03c2c7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:39.153146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c2b23-e93f-452a-bd7a-36359794b611 None admin] RBAC: Authorizing `identity:get_user(user_id=dc4f177107dd484bb54b563adc03c2c7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:39.154662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c2b23-e93f-452a-bd7a-36359794b611 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:39.156342 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 42/83] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:38 2022] GET /identity/v3/users/dc4f177107dd484bb54b563adc03c2c7 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:39.157147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2b23-e93f-452a-bd7a-36359794b611 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:39.233755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:39.243604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795e60a-ce69-4265-a0ba-503e17ccbf5b None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:39.283992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2b23-e93f-452a-bd7a-36359794b611 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:39.285986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53fae-ed6a-4f30-b46c-21f2b596017a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:39.286627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53fae-ed6a-4f30-b46c-21f2b596017a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:39.286914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53fae-ed6a-4f30-b46c-21f2b596017a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:39.287187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53fae-ed6a-4f30-b46c-21f2b596017a None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:39.288334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53fae-ed6a-4f30-b46c-21f2b596017a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:39.289954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53fae-ed6a-4f30-b46c-21f2b596017a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:39.291587 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 42/84] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:39.295093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53fae-ed6a-4f30-b46c-21f2b596017a None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:39.328062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7c6fa-70a9-48e3-97cb-d75bcfd54c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:39.328690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7c6fa-70a9-48e3-97cb-d75bcfd54c3d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:39.328975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7c6fa-70a9-48e3-97cb-d75bcfd54c3d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:39.329261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7c6fa-70a9-48e3-97cb-d75bcfd54c3d None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:39.329979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7c6fa-70a9-48e3-97cb-d75bcfd54c3d None admin] RBAC: Adding query filter params (name=member) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:39.330285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7c6fa-70a9-48e3-97cb-d75bcfd54c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:39.331737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7c6fa-70a9-48e3-97cb-d75bcfd54c3d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:39.341728 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 43/85] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:09:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:39.342757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7c6fa-70a9-48e3-97cb-d75bcfd54c3d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:39.357661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:39.410094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53fae-ed6a-4f30-b46c-21f2b596017a None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:39.450475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2357c6-5268-4ca5-812c-8dab7b69f40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:39.451425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2357c6-5268-4ca5-812c-8dab7b69f40d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:39.451706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2357c6-5268-4ca5-812c-8dab7b69f40d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:39.451976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2357c6-5268-4ca5-812c-8dab7b69f40d None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:39.453743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2357c6-5268-4ca5-812c-8dab7b69f40d None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:39.455611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2357c6-5268-4ca5-812c-8dab7b69f40d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:39.457515 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 43/86] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:39 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:39.458150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2357c6-5268-4ca5-812c-8dab7b69f40d None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:39.464736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7c6fa-70a9-48e3-97cb-d75bcfd54c3d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:39.490255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:39.503793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56131f30-eead-43c9-b24d-41918bc1a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:39.504493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56131f30-eead-43c9-b24d-41918bc1a91b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:39.504814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56131f30-eead-43c9-b24d-41918bc1a91b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:39.505123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56131f30-eead-43c9-b24d-41918bc1a91b None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:39.506425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56131f30-eead-43c9-b24d-41918bc1a91b None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:39.508063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56131f30-eead-43c9-b24d-41918bc1a91b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:39.509911 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 44/87] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:39 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:39.510743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56131f30-eead-43c9-b24d-41918bc1a91b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:39.573893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2357c6-5268-4ca5-812c-8dab7b69f40d None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:39.598872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:39.609757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b42ae-57f0-4456-950a-8f09972bac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:39.610495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b42ae-57f0-4456-950a-8f09972bac39 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:39.610782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b42ae-57f0-4456-950a-8f09972bac39 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:39.611063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b42ae-57f0-4456-950a-8f09972bac39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:39.617168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56131f30-eead-43c9-b24d-41918bc1a91b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:39.652726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be7143-1762-40c9-b8e8-b734ca21658f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:39.653409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be7143-1762-40c9-b8e8-b734ca21658f None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:39.653719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be7143-1762-40c9-b8e8-b734ca21658f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:39.654051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be7143-1762-40c9-b8e8-b734ca21658f None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:39.654779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be7143-1762-40c9-b8e8-b734ca21658f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:39.656386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be7143-1762-40c9-b8e8-b734ca21658f None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:39.679748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b42ae-57f0-4456-950a-8f09972bac39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:39.681612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b42ae-57f0-4456-950a-8f09972bac39 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:39.685752 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 45/88] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:09:39 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:09:39.686587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be7143-1762-40c9-b8e8-b734ca21658f None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:39.749064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:39.810893 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 44/89] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:39.812320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b42ae-57f0-4456-950a-8f09972bac39 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:39.838156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be7143-1762-40c9-b8e8-b734ca21658f None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:39.865443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:39.896986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb393e-d016-4188-ad4d-5dc3ab19c112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:39.898036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb393e-d016-4188-ad4d-5dc3ab19c112 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:39.898486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb393e-d016-4188-ad4d-5dc3ab19c112 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:39.898972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb393e-d016-4188-ad4d-5dc3ab19c112 None admin] PATH_INFO: `/v3/users/dc4f177107dd484bb54b563adc03c2c7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:39.901157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb393e-d016-4188-ad4d-5dc3ab19c112 None admin] RBAC: Authorizing `identity:get_user(user_id=dc4f177107dd484bb54b563adc03c2c7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:39.903499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb393e-d016-4188-ad4d-5dc3ab19c112 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:39.906896 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 46/90] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:39 2022] GET /identity/v3/users/dc4f177107dd484bb54b563adc03c2c7 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:39.908206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb393e-d016-4188-ad4d-5dc3ab19c112 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:39.973621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b42ae-57f0-4456-950a-8f09972bac39 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:40.041562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0ff17-1e5d-4f04-abab-8ff339046623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:40.042186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0ff17-1e5d-4f04-abab-8ff339046623 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:40.042467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0ff17-1e5d-4f04-abab-8ff339046623 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:40.042743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0ff17-1e5d-4f04-abab-8ff339046623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:40.044188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0ff17-1e5d-4f04-abab-8ff339046623 None admin] RBAC: Adding query filter params (role.id=0aaef5fae9d1491bb3548a12be30bd2d, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9, user.id=dc4f177107dd484bb54b563adc03c2c7) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:40.044188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0ff17-1e5d-4f04-abab-8ff339046623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:40.045272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0ff17-1e5d-4f04-abab-8ff339046623 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:40.052162 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 45/91] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:39 2022] GET /identity/v3/role_assignments?user.id=dc4f177107dd484bb54b563adc03c2c7&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:40.053538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0ff17-1e5d-4f04-abab-8ff339046623 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:40.083925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb393e-d016-4188-ad4d-5dc3ab19c112 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:40.104423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:40.133050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19184c-2ae9-469c-9c95-56f41714a5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:40.133782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19184c-2ae9-469c-9c95-56f41714a5fc None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:40.134070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19184c-2ae9-469c-9c95-56f41714a5fc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:40.134352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19184c-2ae9-469c-9c95-56f41714a5fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:40.135114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19184c-2ae9-469c-9c95-56f41714a5fc None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9, user.id=2731c4a0421d4cc19a655aaf52f9a3b8) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:40.135429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19184c-2ae9-469c-9c95-56f41714a5fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:40.137303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19184c-2ae9-469c-9c95-56f41714a5fc None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:40.143978 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 47/92] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:39 2022] GET /identity/v3/role_assignments?user.id=2731c4a0421d4cc19a655aaf52f9a3b8&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=be89abac608f45a6921181bcc574f721 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:40.144813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19184c-2ae9-469c-9c95-56f41714a5fc None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:40.189267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:40.232030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0ff17-1e5d-4f04-abab-8ff339046623 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:40.312354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a98e9c-887a-49cd-a21d-1b4d5db1893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:40.312933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a98e9c-887a-49cd-a21d-1b4d5db1893c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:40.313217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a98e9c-887a-49cd-a21d-1b4d5db1893c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:40.313520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a98e9c-887a-49cd-a21d-1b4d5db1893c None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:40.314877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a98e9c-887a-49cd-a21d-1b4d5db1893c None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:40.316391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a98e9c-887a-49cd-a21d-1b4d5db1893c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:40.321291 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 46/93] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:40 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:40.324032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a98e9c-887a-49cd-a21d-1b4d5db1893c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:40.348652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19184c-2ae9-469c-9c95-56f41714a5fc None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:40.389920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721aca4d-7875-4fe6-8dab-288445f207a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:40.391336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721aca4d-7875-4fe6-8dab-288445f207a1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:40.392091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721aca4d-7875-4fe6-8dab-288445f207a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:40.392901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721aca4d-7875-4fe6-8dab-288445f207a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:40.470297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:40.505153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721aca4d-7875-4fe6-8dab-288445f207a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:40.507495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721aca4d-7875-4fe6-8dab-288445f207a1 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:40.607543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a98e9c-887a-49cd-a21d-1b4d5db1893c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:40.713833 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 48/94] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:40.722254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82003a-7dae-4fbb-9eb6-cb81b181b210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:40.722885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82003a-7dae-4fbb-9eb6-cb81b181b210 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:40.723163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82003a-7dae-4fbb-9eb6-cb81b181b210 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:40.723439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82003a-7dae-4fbb-9eb6-cb81b181b210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:40.724192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82003a-7dae-4fbb-9eb6-cb81b181b210 None admin] RBAC: Adding query filter params (role.id=066bc2c3c4ad43baaa2e35afdba859e5, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9, user.id=dc4f177107dd484bb54b563adc03c2c7) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:40.724503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82003a-7dae-4fbb-9eb6-cb81b181b210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:40.725441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721aca4d-7875-4fe6-8dab-288445f207a1 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:40.734248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82003a-7dae-4fbb-9eb6-cb81b181b210 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:40.759428 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 47/95] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:40 2022] GET /identity/v3/role_assignments?user.id=dc4f177107dd484bb54b563adc03c2c7&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=066bc2c3c4ad43baaa2e35afdba859e5 => generated 259 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:40.929902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:40.971958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721aca4d-7875-4fe6-8dab-288445f207a1 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:41.034346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17360ae-e80f-4c3e-abea-0f31429ee226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:41.035081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17360ae-e80f-4c3e-abea-0f31429ee226 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:41.035367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17360ae-e80f-4c3e-abea-0f31429ee226 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:41.035746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17360ae-e80f-4c3e-abea-0f31429ee226 None admin] PATH_INFO: `/v3/projects/5103dbc142bc4cb8a27b72747f170e94` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:41.042119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17360ae-e80f-4c3e-abea-0f31429ee226 None admin] RBAC: Authorizing `identity:get_project(project_id=5103dbc142bc4cb8a27b72747f170e94)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:41.044194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17360ae-e80f-4c3e-abea-0f31429ee226 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:41.046174 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:40 2022] GET /identity/v3/projects/5103dbc142bc4cb8a27b72747f170e94 => generated 312 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:41.054490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82003a-7dae-4fbb-9eb6-cb81b181b210 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:41.135955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:41.300334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82003a-7dae-4fbb-9eb6-cb81b181b210 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:41.354220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd4e8f-abfa-4ec8-9a22-5deae6e1debf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:41.355201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd4e8f-abfa-4ec8-9a22-5deae6e1debf None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:41.355705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd4e8f-abfa-4ec8-9a22-5deae6e1debf None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:41.356705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd4e8f-abfa-4ec8-9a22-5deae6e1debf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:41.357717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd4e8f-abfa-4ec8-9a22-5deae6e1debf None admin] RBAC: Adding query filter params (role.id=0aaef5fae9d1491bb3548a12be30bd2d, scope.project.id=5103dbc142bc4cb8a27b72747f170e94, user.id=dc4f177107dd484bb54b563adc03c2c7) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:41.358259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd4e8f-abfa-4ec8-9a22-5deae6e1debf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:41.359907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd4e8f-abfa-4ec8-9a22-5deae6e1debf None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:41.370332 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 48/97] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:41 2022] GET /identity/v3/role_assignments?user.id=dc4f177107dd484bb54b563adc03c2c7&scope.project.id=5103dbc142bc4cb8a27b72747f170e94&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 259 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:42.640687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8e82-ba25-44b5-8ad7-68790059aa62 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:42.641185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8e82-ba25-44b5-8ad7-68790059aa62 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:42.641258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8e82-ba25-44b5-8ad7-68790059aa62 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:42.642812 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 50/98] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:42.648079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60fac-4837-4dfe-a147-887d468d01f2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:42.648524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60fac-4837-4dfe-a147-887d468d01f2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:42.648720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60fac-4837-4dfe-a147-887d468d01f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:42.674738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e1b60fac-4837-4dfe-a147-887d468d01f2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:42.675938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e1b60fac-4837-4dfe-a147-887d468d01f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:42.758919 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 49/99] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:09:42.898250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f2498-a7cc-4d2c-85ce-cbfee20bd9ef None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:42.899074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f2498-a7cc-4d2c-85ce-cbfee20bd9ef None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:42.900009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f2498-a7cc-4d2c-85ce-cbfee20bd9ef None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:42.902749 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 51/100] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:42.907886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cf16b-89a9-4591-9e92-12d0ae0c4146 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:42.908182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cf16b-89a9-4591-9e92-12d0ae0c4146 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:42.908457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cf16b-89a9-4591-9e92-12d0ae0c4146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:42.930544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b61cf16b-89a9-4591-9e92-12d0ae0c4146 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:42.931732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b61cf16b-89a9-4591-9e92-12d0ae0c4146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:42.946143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:43.028399 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 50/101] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:43.089040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba570d-2d94-4686-9930-a5a69cfe7819 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:43.089350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba570d-2d94-4686-9930-a5a69cfe7819 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:43.089648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba570d-2d94-4686-9930-a5a69cfe7819 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:43.091521 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 52/102] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:43.096832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6de2b-8d06-490b-ba80-42504adf9c59 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:43.097123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6de2b-8d06-490b-ba80-42504adf9c59 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:43.097415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6de2b-8d06-490b-ba80-42504adf9c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:43.126416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-58f6de2b-8d06-490b-ba80-42504adf9c59 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:43.127623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-58f6de2b-8d06-490b-ba80-42504adf9c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:43.218901 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 51/103] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:43.244059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba570d-2d94-4686-9930-a5a69cfe7819 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:43.386580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba570d-2d94-4686-9930-a5a69cfe7819 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:43.432964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6de2b-8d06-490b-ba80-42504adf9c59 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:43.433264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f9f08-8376-4432-8a73-40b8c2f77a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:43.433901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9f08-8376-4432-8a73-40b8c2f77a35 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:43.434709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9f08-8376-4432-8a73-40b8c2f77a35 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:43.434987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9f08-8376-4432-8a73-40b8c2f77a35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:43.436250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f9f08-8376-4432-8a73-40b8c2f77a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:43.437607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f9f08-8376-4432-8a73-40b8c2f77a35 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:43.439319 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 53/104] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:43.442631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0b50-934d-4a9d-859a-d334a5d71b63 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:43.442930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0b50-934d-4a9d-859a-d334a5d71b63 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:43.443190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0b50-934d-4a9d-859a-d334a5d71b63 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:43.444428 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 54/105] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:09:43.452012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0b50-934d-4a9d-859a-d334a5d71b63 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:43.479525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:43.562792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:43.593624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6de2b-8d06-490b-ba80-42504adf9c59 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:43.611934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0b50-934d-4a9d-859a-d334a5d71b63 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:43.632130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9113057-490f-4234-aa39-d4cc1765fdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:43.632997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9113057-490f-4234-aa39-d4cc1765fdc5 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:43.633469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9113057-490f-4234-aa39-d4cc1765fdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:43.633880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9113057-490f-4234-aa39-d4cc1765fdc5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:43.645900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9113057-490f-4234-aa39-d4cc1765fdc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:43.650645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34348e31-1d3e-4788-b31f-d2ec67573c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:43.651267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348e31-1d3e-4788-b31f-d2ec67573c06 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:43.651553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348e31-1d3e-4788-b31f-d2ec67573c06 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:43.651827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348e31-1d3e-4788-b31f-d2ec67573c06 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:43.652559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34348e31-1d3e-4788-b31f-d2ec67573c06 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-d9113057-490f-4234-aa39-d4cc1765fdc5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:43.653657 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:43.654923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:09:43.655878 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:43.656463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34348e31-1d3e-4788-b31f-d2ec67573c06 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:43.657974 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 52/106] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:09:43.659345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fc1ae-974a-4ef5-aaff-80ac83c9bc0a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:43.659832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fc1ae-974a-4ef5-aaff-80ac83c9bc0a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:43.660229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fc1ae-974a-4ef5-aaff-80ac83c9bc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:43.680167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-942fc1ae-974a-4ef5-aaff-80ac83c9bc0a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:43.681904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-942fc1ae-974a-4ef5-aaff-80ac83c9bc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:43.692987 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 55/107] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:09:43 2022] POST /identity/v3/projects => generated 302 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:09:43.694488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34348e31-1d3e-4788-b31f-d2ec67573c06 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:43.834092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:43.866877 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 53/108] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:43.867880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fc1ae-974a-4ef5-aaff-80ac83c9bc0a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:43.877894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34348e31-1d3e-4788-b31f-d2ec67573c06 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:43.921048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ed8d3-e4cb-4b7e-9cf1-8a8efcd7b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:43.922169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed8d3-e4cb-4b7e-9cf1-8a8efcd7b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:43.922655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed8d3-e4cb-4b7e-9cf1-8a8efcd7b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:43.923105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed8d3-e4cb-4b7e-9cf1-8a8efcd7b6b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:43.937540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ed8d3-e4cb-4b7e-9cf1-8a8efcd7b6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-197ed8d3-e4cb-4b7e-9cf1-8a8efcd7b6b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:43.943454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:43.944368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:43.945167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:43.947167 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 56/109] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:09:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:43.948257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7609-2bc7-4bfe-81ef-67e222add04e None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:43.948548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7609-2bc7-4bfe-81ef-67e222add04e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:43.948831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7609-2bc7-4bfe-81ef-67e222add04e None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:43.950794 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 57/110] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:43.955803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb7609-2bc7-4bfe-81ef-67e222add04e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:44.002586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:44.050330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fc1ae-974a-4ef5-aaff-80ac83c9bc0a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:44.089923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed7838-0c0c-4498-9383-13141008ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:44.090510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed7838-0c0c-4498-9383-13141008ea94 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:44.090796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed7838-0c0c-4498-9383-13141008ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:44.091079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed7838-0c0c-4498-9383-13141008ea94 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:44.092519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed7838-0c0c-4498-9383-13141008ea94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:44.092710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed7838-0c0c-4498-9383-13141008ea94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:44.094203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed7838-0c0c-4498-9383-13141008ea94 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:44.097269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb7609-2bc7-4bfe-81ef-67e222add04e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:44.104960 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 54/111] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:09:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:44.106703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea680928-a803-46a6-b29e-f370e4625180 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:44.106815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea680928-a803-46a6-b29e-f370e4625180 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:44.107135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea680928-a803-46a6-b29e-f370e4625180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:44.127803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ea680928-a803-46a6-b29e-f370e4625180 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:44.129067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ea680928-a803-46a6-b29e-f370e4625180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:44.130582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:44.142913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13fd31-a177-44a6-824f-c6f0d944928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:44.144196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13fd31-a177-44a6-824f-c6f0d944928b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:44.144956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13fd31-a177-44a6-824f-c6f0d944928b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:44.145574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13fd31-a177-44a6-824f-c6f0d944928b None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:44.146609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13fd31-a177-44a6-824f-c6f0d944928b None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:44.147131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13fd31-a177-44a6-824f-c6f0d944928b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:44.149429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13fd31-a177-44a6-824f-c6f0d944928b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:44.161602 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 58/112] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:44.163501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13fd31-a177-44a6-824f-c6f0d944928b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:44.215205 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 55/113] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:44.216818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea680928-a803-46a6-b29e-f370e4625180 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:44.327814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:44.328594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13fd31-a177-44a6-824f-c6f0d944928b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:44.369319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81019b42-4a6a-45e7-a667-f282c148ee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:44.370365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81019b42-4a6a-45e7-a667-f282c148ee86 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:44.370829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81019b42-4a6a-45e7-a667-f282c148ee86 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:44.371295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81019b42-4a6a-45e7-a667-f282c148ee86 None admin] PATH_INFO: `/v3/users/4e7ce6cf8bb84e3fbd57758d4cda093d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:44.385262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea680928-a803-46a6-b29e-f370e4625180 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:44.386538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81019b42-4a6a-45e7-a667-f282c148ee86 None admin] RBAC: Authorizing `identity:get_user(user_id=4e7ce6cf8bb84e3fbd57758d4cda093d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:44.388425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81019b42-4a6a-45e7-a667-f282c148ee86 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:44.390403 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 59/114] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:44 2022] GET /identity/v3/users/4e7ce6cf8bb84e3fbd57758d4cda093d => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:44.391815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732bf86-6d6c-4646-8ea5-55473edba086 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:44.392292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732bf86-6d6c-4646-8ea5-55473edba086 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:44.392754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732bf86-6d6c-4646-8ea5-55473edba086 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:44.394375 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 60/115] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:44.399077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732bf86-6d6c-4646-8ea5-55473edba086 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:44.426082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15b2eb-f69b-4b1c-a6a4-d0dd77602b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:44.427098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15b2eb-f69b-4b1c-a6a4-d0dd77602b81 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:44.427590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15b2eb-f69b-4b1c-a6a4-d0dd77602b81 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:44.428066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15b2eb-f69b-4b1c-a6a4-d0dd77602b81 None admin] PATH_INFO: `/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:44.429540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15b2eb-f69b-4b1c-a6a4-d0dd77602b81 None admin] RBAC: Authorizing `identity:get_user(user_id=2731c4a0421d4cc19a655aaf52f9a3b8)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:44.431244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15b2eb-f69b-4b1c-a6a4-d0dd77602b81 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:44.438505 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 56/116] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:44 2022] GET /identity/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:44.440340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15b2eb-f69b-4b1c-a6a4-d0dd77602b81 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:44.460347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:44.531524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732bf86-6d6c-4646-8ea5-55473edba086 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:44.562922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15b2eb-f69b-4b1c-a6a4-d0dd77602b81 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:44.569006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a65f2-e52e-437a-9912-9c3741baf510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:44.569735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a65f2-e52e-437a-9912-9c3741baf510 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:44.570019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a65f2-e52e-437a-9912-9c3741baf510 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:44.570346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a65f2-e52e-437a-9912-9c3741baf510 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:44.582305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a65f2-e52e-437a-9912-9c3741baf510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-b22a65f2-e52e-437a-9912-9c3741baf510 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:44.587136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:44.588020 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:44.588796 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 61/117] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:44.589475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737912-e4f7-4943-8fb1-1314f6f29b57 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:44.592694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737912-e4f7-4943-8fb1-1314f6f29b57 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:44.592694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737912-e4f7-4943-8fb1-1314f6f29b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:44.593252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:44.607859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5674b-1a6f-4b0c-94fa-119f4f54c7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:44.608525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5674b-1a6f-4b0c-94fa-119f4f54c7d3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:44.608810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5674b-1a6f-4b0c-94fa-119f4f54c7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:44.609139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5674b-1a6f-4b0c-94fa-119f4f54c7d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:44.610521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-00737912-e4f7-4943-8fb1-1314f6f29b57 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:44.611710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-00737912-e4f7-4943-8fb1-1314f6f29b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:44.685438 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 62/118] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:44.687095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00737912-e4f7-4943-8fb1-1314f6f29b57 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:44.687254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5674b-1a6f-4b0c-94fa-119f4f54c7d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:44.688610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5674b-1a6f-4b0c-94fa-119f4f54c7d3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:44.731402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:44.805651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00737912-e4f7-4943-8fb1-1314f6f29b57 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:44.828677 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 57/119] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:44.829792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5674b-1a6f-4b0c-94fa-119f4f54c7d3 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:44.860622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aec512-3f5b-4f34-ac3a-54b1d2976f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:44.861220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:44.861509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aec512-3f5b-4f34-ac3a-54b1d2976f70 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:44.862295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aec512-3f5b-4f34-ac3a-54b1d2976f70 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:44.862295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aec512-3f5b-4f34-ac3a-54b1d2976f70 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:44.864139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aec512-3f5b-4f34-ac3a-54b1d2976f70 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:44.866103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aec512-3f5b-4f34-ac3a-54b1d2976f70 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:44.868095 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 63/120] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:44 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:44.868990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aec512-3f5b-4f34-ac3a-54b1d2976f70 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:44.957882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5674b-1a6f-4b0c-94fa-119f4f54c7d3 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:44.996750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae351cf-3ec2-429a-901b-6af1347f2e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:44.997404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae351cf-3ec2-429a-901b-6af1347f2e55 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:44.997695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae351cf-3ec2-429a-901b-6af1347f2e55 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:44.997972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae351cf-3ec2-429a-901b-6af1347f2e55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:45.010035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae351cf-3ec2-429a-901b-6af1347f2e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-7ae351cf-3ec2-429a-901b-6af1347f2e55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:45.016831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:45.017876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:45.018688 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 58/121] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:09:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:45.019354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae351cf-3ec2-429a-901b-6af1347f2e55 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:45.036593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aec512-3f5b-4f34-ac3a-54b1d2976f70 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:45.039803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:45.078421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f80d3-e42b-437f-b44d-52a177016fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:45.079460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f80d3-e42b-437f-b44d-52a177016fd6 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:45.079947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f80d3-e42b-437f-b44d-52a177016fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:45.080425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f80d3-e42b-437f-b44d-52a177016fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:45.081297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f80d3-e42b-437f-b44d-52a177016fd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:45.081837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f80d3-e42b-437f-b44d-52a177016fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:45.083453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f80d3-e42b-437f-b44d-52a177016fd6 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:45.098110 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 64/122] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:09:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:45.099307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f80d3-e42b-437f-b44d-52a177016fd6 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:45.123039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:45.144613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae351cf-3ec2-429a-901b-6af1347f2e55 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:45.181628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e06f5e-44ad-41ec-9038-560c16fc116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:45.182262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06f5e-44ad-41ec-9038-560c16fc116d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:45.182548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06f5e-44ad-41ec-9038-560c16fc116d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:45.182827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06f5e-44ad-41ec-9038-560c16fc116d None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:45.184513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e06f5e-44ad-41ec-9038-560c16fc116d None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:45.186007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e06f5e-44ad-41ec-9038-560c16fc116d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:45.187832 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 59/123] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:45 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:45.188444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e06f5e-44ad-41ec-9038-560c16fc116d None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:45.235596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f80d3-e42b-437f-b44d-52a177016fd6 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:45.280002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9094e6-1c9a-432f-9947-c12291396cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:45.280938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9094e6-1c9a-432f-9947-c12291396cbd None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:45.281487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9094e6-1c9a-432f-9947-c12291396cbd None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:45.282003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9094e6-1c9a-432f-9947-c12291396cbd None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/users/2731c4a0421d4cc19a655aaf52f9a3b8/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:45.285441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9094e6-1c9a-432f-9947-c12291396cbd None admin] RBAC: Authorizing `identity:create_grant(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9, user_id=2731c4a0421d4cc19a655aaf52f9a3b8, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:45.288097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9094e6-1c9a-432f-9947-c12291396cbd None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:45.305858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e06f5e-44ad-41ec-9038-560c16fc116d None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:45.307746 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 65/124] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:09:45 2022] PUT /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/users/2731c4a0421d4cc19a655aaf52f9a3b8/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:09:45.308852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9094e6-1c9a-432f-9947-c12291396cbd None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:45.346820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:45.377732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa7d8e-1cfa-4822-8a0b-31efd471e858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:45.378690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa7d8e-1cfa-4822-8a0b-31efd471e858 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:45.379174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa7d8e-1cfa-4822-8a0b-31efd471e858 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:45.379601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa7d8e-1cfa-4822-8a0b-31efd471e858 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:45.403160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa7d8e-1cfa-4822-8a0b-31efd471e858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-9baa7d8e-1cfa-4822-8a0b-31efd471e858 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:45.411955 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:45.413095 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:45.414107 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:45.416141 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 60/125] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:45.417148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa7d8e-1cfa-4822-8a0b-31efd471e858 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:45.439874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:45.457306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9094e6-1c9a-432f-9947-c12291396cbd None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:45.510475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b5ee-1e26-4e48-9cdc-d0ba0a485667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:45.511498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b5ee-1e26-4e48-9cdc-d0ba0a485667 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:45.511918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b5ee-1e26-4e48-9cdc-d0ba0a485667 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:45.512393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b5ee-1e26-4e48-9cdc-d0ba0a485667 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:45.513279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808b5ee-1e26-4e48-9cdc-d0ba0a485667 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:45.513773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808b5ee-1e26-4e48-9cdc-d0ba0a485667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:45.515457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808b5ee-1e26-4e48-9cdc-d0ba0a485667 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:45.527782 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 66/126] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:09:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:45.529017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b5ee-1e26-4e48-9cdc-d0ba0a485667 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:45.575293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa7d8e-1cfa-4822-8a0b-31efd471e858 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:45.614784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834fc18-3f89-4fcb-a54d-471e777390e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:45.615763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834fc18-3f89-4fcb-a54d-471e777390e3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:45.616328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834fc18-3f89-4fcb-a54d-471e777390e3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:45.616876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834fc18-3f89-4fcb-a54d-471e777390e3 None admin] PATH_INFO: `/v3/users/dc4f177107dd484bb54b563adc03c2c7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:45.618402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834fc18-3f89-4fcb-a54d-471e777390e3 None admin] RBAC: Authorizing `identity:get_user(user_id=dc4f177107dd484bb54b563adc03c2c7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:45.620049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834fc18-3f89-4fcb-a54d-471e777390e3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:45.622053 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 61/127] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:45 2022] GET /identity/v3/users/dc4f177107dd484bb54b563adc03c2c7 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:45.623665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834fc18-3f89-4fcb-a54d-471e777390e3 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:45.660699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:45.683508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b5ee-1e26-4e48-9cdc-d0ba0a485667 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:45.724511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:45.735818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de3a1b-9d82-4d8a-868d-b347f531864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:45.736600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de3a1b-9d82-4d8a-868d-b347f531864c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:45.736776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de3a1b-9d82-4d8a-868d-b347f531864c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:45.737011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de3a1b-9d82-4d8a-868d-b347f531864c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:45.737763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de3a1b-9d82-4d8a-868d-b347f531864c None admin] RBAC: Adding query filter params (role.id=dcca49656a484f299d30879c98961cd9, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9, user.id=4e7ce6cf8bb84e3fbd57758d4cda093d) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:45.738556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de3a1b-9d82-4d8a-868d-b347f531864c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:45.740336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de3a1b-9d82-4d8a-868d-b347f531864c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:45.748028 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 67/128] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:45 2022] GET /identity/v3/role_assignments?user.id=4e7ce6cf8bb84e3fbd57758d4cda093d&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=dcca49656a484f299d30879c98961cd9 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:45.749221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de3a1b-9d82-4d8a-868d-b347f531864c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:45.757674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834fc18-3f89-4fcb-a54d-471e777390e3 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:45.810033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee72fa-0767-4b06-9718-3e840a832ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:45.810598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee72fa-0767-4b06-9718-3e840a832ba9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:45.811017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee72fa-0767-4b06-9718-3e840a832ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:45.811340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee72fa-0767-4b06-9718-3e840a832ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:45.812584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee72fa-0767-4b06-9718-3e840a832ba9 None admin] RBAC: Adding query filter params (name=member) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:45.813155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee72fa-0767-4b06-9718-3e840a832ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:45.815086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee72fa-0767-4b06-9718-3e840a832ba9 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:45.828103 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 62/129] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:09:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:45.833098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee72fa-0767-4b06-9718-3e840a832ba9 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:45.890766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de3a1b-9d82-4d8a-868d-b347f531864c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:45.937635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c56027-a741-407e-bfeb-728d4860a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:45.938774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c56027-a741-407e-bfeb-728d4860a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:45.939262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c56027-a741-407e-bfeb-728d4860a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:45.939729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c56027-a741-407e-bfeb-728d4860a4c3 None admin] PATH_INFO: `/v3/users/dc4f177107dd484bb54b563adc03c2c7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:45.941219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c56027-a741-407e-bfeb-728d4860a4c3 None admin] RBAC: Authorizing `identity:get_user(user_id=dc4f177107dd484bb54b563adc03c2c7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:45.943070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c56027-a741-407e-bfeb-728d4860a4c3 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:45.945297 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 68/130] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:45 2022] GET /identity/v3/users/dc4f177107dd484bb54b563adc03c2c7 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:45.946456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c56027-a741-407e-bfeb-728d4860a4c3 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:45.972435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee72fa-0767-4b06-9718-3e840a832ba9 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:45.973037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:46.032136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08254780-d493-4ca0-9009-4470b1c0a354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:46.032783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08254780-d493-4ca0-9009-4470b1c0a354 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:46.033067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08254780-d493-4ca0-9009-4470b1c0a354 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:46.033347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08254780-d493-4ca0-9009-4470b1c0a354 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:46.035386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08254780-d493-4ca0-9009-4470b1c0a354 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:46.036880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08254780-d493-4ca0-9009-4470b1c0a354 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:46.039746 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 63/131] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:45 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:46.040301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08254780-d493-4ca0-9009-4470b1c0a354 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:46.056160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:46.107183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c56027-a741-407e-bfeb-728d4860a4c3 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:46.150446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8272ac-c086-4055-80e5-89502309c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:46.151399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8272ac-c086-4055-80e5-89502309c1c4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:46.152388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8272ac-c086-4055-80e5-89502309c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:46.153420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8272ac-c086-4055-80e5-89502309c1c4 None admin] PATH_INFO: `/v3/users/dc4f177107dd484bb54b563adc03c2c7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:46.155428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8272ac-c086-4055-80e5-89502309c1c4 None admin] RBAC: Authorizing `identity:get_user(user_id=dc4f177107dd484bb54b563adc03c2c7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:46.157346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8272ac-c086-4055-80e5-89502309c1c4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:46.159949 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 69/132] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:45 2022] GET /identity/v3/users/dc4f177107dd484bb54b563adc03c2c7 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:46.165441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4928930-5300-4868-984c-97afc138b59a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:46.166278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4928930-5300-4868-984c-97afc138b59a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:46.166580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4928930-5300-4868-984c-97afc138b59a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:46.168165 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 70/133] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:46.169290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4928930-5300-4868-984c-97afc138b59a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:46.210516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08254780-d493-4ca0-9009-4470b1c0a354 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:46.248469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43195f54-9207-4c43-bd6d-f3bfc08ff1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:46.249295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43195f54-9207-4c43-bd6d-f3bfc08ff1e7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:46.249674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43195f54-9207-4c43-bd6d-f3bfc08ff1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:46.250025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43195f54-9207-4c43-bd6d-f3bfc08ff1e7 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:46.251334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43195f54-9207-4c43-bd6d-f3bfc08ff1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:46.252903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43195f54-9207-4c43-bd6d-f3bfc08ff1e7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:46.255457 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 64/134] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:46 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:46.256405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43195f54-9207-4c43-bd6d-f3bfc08ff1e7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:46.268923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:46.285720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4928930-5300-4868-984c-97afc138b59a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:46.324353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bab141-bcad-4f52-95ce-e12b7bb371bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:46.325675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab141-bcad-4f52-95ce-e12b7bb371bd None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:46.325964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab141-bcad-4f52-95ce-e12b7bb371bd None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:46.326242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab141-bcad-4f52-95ce-e12b7bb371bd None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/users/dc4f177107dd484bb54b563adc03c2c7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:46.328325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bab141-bcad-4f52-95ce-e12b7bb371bd None admin] RBAC: Authorizing `identity:create_grant(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9, user_id=dc4f177107dd484bb54b563adc03c2c7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:46.329950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bab141-bcad-4f52-95ce-e12b7bb371bd None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:46.347245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:46.348291 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 71/135] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:09:46 2022] PUT /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/users/dc4f177107dd484bb54b563adc03c2c7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:09:46.350063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbeebc-65af-48cd-ab60-ee56f0c2a8d8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:46.350672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbeebc-65af-48cd-ab60-ee56f0c2a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:46.351285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbeebc-65af-48cd-ab60-ee56f0c2a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:46.374604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-21fbeebc-65af-48cd-ab60-ee56f0c2a8d8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:46.376592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-21fbeebc-65af-48cd-ab60-ee56f0c2a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:46.383356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43195f54-9207-4c43-bd6d-f3bfc08ff1e7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:46.432830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431defc6-1616-4868-9289-c826adf8ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:46.433560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431defc6-1616-4868-9289-c826adf8ef50 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:46.434331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431defc6-1616-4868-9289-c826adf8ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:46.434624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431defc6-1616-4868-9289-c826adf8ef50 None admin] PATH_INFO: `/v3/projects/5103dbc142bc4cb8a27b72747f170e94` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:46.435900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431defc6-1616-4868-9289-c826adf8ef50 None admin] RBAC: Authorizing `identity:get_project(project_id=5103dbc142bc4cb8a27b72747f170e94)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:46.438152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431defc6-1616-4868-9289-c826adf8ef50 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:46.440251 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 65/136] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:46 2022] GET /identity/v3/projects/5103dbc142bc4cb8a27b72747f170e94 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:46.444763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431defc6-1616-4868-9289-c826adf8ef50 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:46.471130 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 72/137] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:46.472397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbeebc-65af-48cd-ab60-ee56f0c2a8d8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:46.565317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431defc6-1616-4868-9289-c826adf8ef50 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:46.602427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:46.605252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7a9d7-4815-4bea-b268-83a0db803cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:46.606739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7a9d7-4815-4bea-b268-83a0db803cc2 None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:46.607530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7a9d7-4815-4bea-b268-83a0db803cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:46.607820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7a9d7-4815-4bea-b268-83a0db803cc2 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/users/dc4f177107dd484bb54b563adc03c2c7/roles/066bc2c3c4ad43baaa2e35afdba859e5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:46.611244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7a9d7-4815-4bea-b268-83a0db803cc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9, user_id=dc4f177107dd484bb54b563adc03c2c7, role_id=066bc2c3c4ad43baaa2e35afdba859e5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:46.612740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7a9d7-4815-4bea-b268-83a0db803cc2 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:46.631823 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 66/138] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:09:46 2022] PUT /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/users/dc4f177107dd484bb54b563adc03c2c7/roles/066bc2c3c4ad43baaa2e35afdba859e5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:09:46.662162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbeebc-65af-48cd-ab60-ee56f0c2a8d8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:46.709255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eee329-a3fd-4010-bc52-366146df14db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:46.710050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee329-a3fd-4010-bc52-366146df14db None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:46.710357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee329-a3fd-4010-bc52-366146df14db None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:46.710700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee329-a3fd-4010-bc52-366146df14db None admin] PATH_INFO: `/v3/projects/5103dbc142bc4cb8a27b72747f170e94/users/dc4f177107dd484bb54b563adc03c2c7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:46.713141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eee329-a3fd-4010-bc52-366146df14db None admin] RBAC: Authorizing `identity:create_grant(project_id=5103dbc142bc4cb8a27b72747f170e94, user_id=dc4f177107dd484bb54b563adc03c2c7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:46.714865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eee329-a3fd-4010-bc52-366146df14db None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:46.734565 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 73/139] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:09:46 2022] PUT /identity/v3/projects/5103dbc142bc4cb8a27b72747f170e94/users/dc4f177107dd484bb54b563adc03c2c7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:09:46.890599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7a9d7-4815-4bea-b268-83a0db803cc2 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:46.901702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:47.026169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7a9d7-4815-4bea-b268-83a0db803cc2 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:47.063164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1c47-eedf-4ce3-af04-015338be817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:47.064284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1c47-eedf-4ce3-af04-015338be817c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:47.064763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1c47-eedf-4ce3-af04-015338be817c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:47.065423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1c47-eedf-4ce3-af04-015338be817c None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:47.068354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b1c47-eedf-4ce3-af04-015338be817c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:47.070149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b1c47-eedf-4ce3-af04-015338be817c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:47.072302 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 67/140] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:47.078569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eee329-a3fd-4010-bc52-366146df14db None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:47.187702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eee329-a3fd-4010-bc52-366146df14db None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:47.226895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c7a9d-537a-4efc-a706-5ef1c702eb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:47.227925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7a9d-537a-4efc-a706-5ef1c702eb0b None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:47.228400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7a9d-537a-4efc-a706-5ef1c702eb0b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:47.228869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7a9d-537a-4efc-a706-5ef1c702eb0b None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:47.229815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c7a9d-537a-4efc-a706-5ef1c702eb0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:47.232103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c7a9d-537a-4efc-a706-5ef1c702eb0b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:47.249858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:47.270903 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 74/141] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:09:47 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:09:47.789337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f74b-cfcd-4174-9ee7-0e8e627d1e78 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:47.790015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f74b-cfcd-4174-9ee7-0e8e627d1e78 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:47.790605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f74b-cfcd-4174-9ee7-0e8e627d1e78 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:47.792504 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 68/142] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:47.798177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40288a2c-76d6-4007-820a-cfe1657c26d5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:47.798747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40288a2c-76d6-4007-820a-cfe1657c26d5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:47.799307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40288a2c-76d6-4007-820a-cfe1657c26d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:47.822472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-40288a2c-76d6-4007-820a-cfe1657c26d5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:47.823664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-40288a2c-76d6-4007-820a-cfe1657c26d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:47.915480 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 75/143] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:48.327283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb51ad-5992-4073-95d1-7862beedaa2e None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:48.328289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb51ad-5992-4073-95d1-7862beedaa2e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:48.328795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb51ad-5992-4073-95d1-7862beedaa2e None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:48.330489 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 69/144] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:48.336526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1a68-a99f-43ad-9fd9-fbf5774b7ef1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:48.337014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1a68-a99f-43ad-9fd9-fbf5774b7ef1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:48.337084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1a68-a99f-43ad-9fd9-fbf5774b7ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:48.361801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4a8c1a68-a99f-43ad-9fd9-fbf5774b7ef1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:48.363004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4a8c1a68-a99f-43ad-9fd9-fbf5774b7ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:48.451933 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 76/145] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:48.522396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb51ad-5992-4073-95d1-7862beedaa2e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:48.623388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:48.654805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb51ad-5992-4073-95d1-7862beedaa2e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:48.695036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82017f1b-e0a9-4fdb-838c-594434b1245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:48.695681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82017f1b-e0a9-4fdb-838c-594434b1245f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:48.695959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82017f1b-e0a9-4fdb-838c-594434b1245f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:48.696232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82017f1b-e0a9-4fdb-838c-594434b1245f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:48.711713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82017f1b-e0a9-4fdb-838c-594434b1245f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-82017f1b-e0a9-4fdb-838c-594434b1245f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:48.717182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:48.718134 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:48.718947 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 70/146] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:09:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:48.724167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c1a68-a99f-43ad-9fd9-fbf5774b7ef1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:48.813599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:48.868993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c1a68-a99f-43ad-9fd9-fbf5774b7ef1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:48.912546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77300c24-7dce-4073-8d47-f2cfc594a374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:48.913413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300c24-7dce-4073-8d47-f2cfc594a374 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:48.913852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300c24-7dce-4073-8d47-f2cfc594a374 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:48.914289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77300c24-7dce-4073-8d47-f2cfc594a374 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:48.915109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77300c24-7dce-4073-8d47-f2cfc594a374 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:48.915564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77300c24-7dce-4073-8d47-f2cfc594a374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:48.917097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77300c24-7dce-4073-8d47-f2cfc594a374 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:48.929175 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 77/147] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:48.935197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82017f1b-e0a9-4fdb-838c-594434b1245f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:49.071734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82017f1b-e0a9-4fdb-838c-594434b1245f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:49.108744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425acf-4d45-4651-9f40-bbedf34305e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:49.109407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425acf-4d45-4651-9f40-bbedf34305e4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:49.109694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425acf-4d45-4651-9f40-bbedf34305e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:49.109970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425acf-4d45-4651-9f40-bbedf34305e4 None admin] PATH_INFO: `/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:49.111128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b425acf-4d45-4651-9f40-bbedf34305e4 None admin] RBAC: Authorizing `identity:get_user(user_id=2731c4a0421d4cc19a655aaf52f9a3b8)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:49.112585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b425acf-4d45-4651-9f40-bbedf34305e4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:49.114398 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 71/148] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:48 2022] GET /identity/v3/users/2731c4a0421d4cc19a655aaf52f9a3b8 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:49.119925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77300c24-7dce-4073-8d47-f2cfc594a374 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:49.238399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425acf-4d45-4651-9f40-bbedf34305e4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:49.242000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:49.254955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77300c24-7dce-4073-8d47-f2cfc594a374 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:49.278189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:49.315553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a15f4-d571-4946-8334-7fe846ed1cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:49.316187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a15f4-d571-4946-8334-7fe846ed1cb3 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:49.316470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a15f4-d571-4946-8334-7fe846ed1cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:49.316745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a15f4-d571-4946-8334-7fe846ed1cb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:49.386986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425acf-4d45-4651-9f40-bbedf34305e4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:49.432131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26287ea-7519-404d-a112-af3198739595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:49.433129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26287ea-7519-404d-a112-af3198739595 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:49.433665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26287ea-7519-404d-a112-af3198739595 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:49.434305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26287ea-7519-404d-a112-af3198739595 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:49.454175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26287ea-7519-404d-a112-af3198739595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-c26287ea-7519-404d-a112-af3198739595 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:49.460450 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:49.461336 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:09:49.462159 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:49.469772 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 72/149] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:09:49.470974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a15f4-d571-4946-8334-7fe846ed1cb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:49.472993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a15f4-d571-4946-8334-7fe846ed1cb3 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:49.475931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26287ea-7519-404d-a112-af3198739595 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:49.622170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:49.706672 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 78/150] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:49.708535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26287ea-7519-404d-a112-af3198739595 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:49.716999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a15f4-d571-4946-8334-7fe846ed1cb3 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:49.753755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:49.791578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d9fd6-b1d6-4ba6-89ba-7b3eaf81316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:49.792048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d9fd6-b1d6-4ba6-89ba-7b3eaf81316f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:49.792313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d9fd6-b1d6-4ba6-89ba-7b3eaf81316f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:49.792601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d9fd6-b1d6-4ba6-89ba-7b3eaf81316f None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:49.793283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d9fd6-b1d6-4ba6-89ba-7b3eaf81316f None admin] RBAC: Adding query filter params (name=reader) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:49.793631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d9fd6-b1d6-4ba6-89ba-7b3eaf81316f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:49.795031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d9fd6-b1d6-4ba6-89ba-7b3eaf81316f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:49.813821 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 73/151] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:09:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:49.821606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d9fd6-b1d6-4ba6-89ba-7b3eaf81316f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:49.941937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a15f4-d571-4946-8334-7fe846ed1cb3 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:50.035141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2da4b-1753-47ff-81ec-010f41b06e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:50.035850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2da4b-1753-47ff-81ec-010f41b06e76 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.036131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2da4b-1753-47ff-81ec-010f41b06e76 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.036453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2da4b-1753-47ff-81ec-010f41b06e76 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.038355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2da4b-1753-47ff-81ec-010f41b06e76 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:50.039866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2da4b-1753-47ff-81ec-010f41b06e76 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:50.042031 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 79/152] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:49 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:50.043253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfe2d4-07dd-4ffc-9287-9cea3705825d None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.043572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfe2d4-07dd-4ffc-9287-9cea3705825d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.043840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfe2d4-07dd-4ffc-9287-9cea3705825d None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.045093 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 80/153] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:50.051097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4abc2d-a8e6-4a23-aaf8-4cbcc2b6050f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.051404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4abc2d-a8e6-4a23-aaf8-4cbcc2b6050f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.051647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4abc2d-a8e6-4a23-aaf8-4cbcc2b6050f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.052753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d9fd6-b1d6-4ba6-89ba-7b3eaf81316f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:50.086495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fa4abc2d-a8e6-4a23-aaf8-4cbcc2b6050f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:50.087697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fa4abc2d-a8e6-4a23-aaf8-4cbcc2b6050f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:50.118645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:50.158253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc47a78-4f83-4d8b-a981-6c4ada912161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:50.158924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc47a78-4f83-4d8b-a981-6c4ada912161 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.159209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc47a78-4f83-4d8b-a981-6c4ada912161 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.159485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc47a78-4f83-4d8b-a981-6c4ada912161 None admin] PATH_INFO: `/v3/users/4e7ce6cf8bb84e3fbd57758d4cda093d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.161428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc47a78-4f83-4d8b-a981-6c4ada912161 None admin] RBAC: Authorizing `identity:get_user(user_id=4e7ce6cf8bb84e3fbd57758d4cda093d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:50.163932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc47a78-4f83-4d8b-a981-6c4ada912161 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:50.166846 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 74/154] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:49 2022] GET /identity/v3/users/4e7ce6cf8bb84e3fbd57758d4cda093d => generated 289 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:50.168034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc47a78-4f83-4d8b-a981-6c4ada912161 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:50.227834 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 81/155] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 15:09:50.230435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f1332-8ab6-4483-ad42-e2f87b5d92fd None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.230721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f1332-8ab6-4483-ad42-e2f87b5d92fd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.231055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f1332-8ab6-4483-ad42-e2f87b5d92fd None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.232600 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 82/156] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:50.234386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f1332-8ab6-4483-ad42-e2f87b5d92fd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:50.278447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:50.406004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc47a78-4f83-4d8b-a981-6c4ada912161 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:50.436447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f1332-8ab6-4483-ad42-e2f87b5d92fd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:50.474651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab9430-3373-46b9-b166-a28e8b124595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:50.475304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab9430-3373-46b9-b166-a28e8b124595 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.475556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab9430-3373-46b9-b166-a28e8b124595 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.475835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab9430-3373-46b9-b166-a28e8b124595 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.476978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab9430-3373-46b9-b166-a28e8b124595 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:50.479626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab9430-3373-46b9-b166-a28e8b124595 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:50.484290 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 83/157] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:50 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:50.486517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dbfba-1d47-4bbb-ab4d-71365f645e26 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.486993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dbfba-1d47-4bbb-ab4d-71365f645e26 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.487480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dbfba-1d47-4bbb-ab4d-71365f645e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.509178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-732dbfba-1d47-4bbb-ab4d-71365f645e26 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:50.510682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-732dbfba-1d47-4bbb-ab4d-71365f645e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:50.515883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b281d-7305-42ed-b832-19d17a27a691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:50.516550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b281d-7305-42ed-b832-19d17a27a691 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.516825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b281d-7305-42ed-b832-19d17a27a691 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.517143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b281d-7305-42ed-b832-19d17a27a691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.517913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b281d-7305-42ed-b832-19d17a27a691 None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9, user.id=2731c4a0421d4cc19a655aaf52f9a3b8) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:50.518221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b281d-7305-42ed-b832-19d17a27a691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:50.519709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b281d-7305-42ed-b832-19d17a27a691 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:50.547691 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 75/158] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:50 2022] GET /identity/v3/role_assignments?user.id=2731c4a0421d4cc19a655aaf52f9a3b8&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=be89abac608f45a6921181bcc574f721 => generated 608 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:50.548793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0788-bb91-4c02-b9be-933b7c58409a None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.549073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0788-bb91-4c02-b9be-933b7c58409a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.549433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0788-bb91-4c02-b9be-933b7c58409a None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.550601 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 76/159] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:50.551282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e0788-bb91-4c02-b9be-933b7c58409a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:50.612789 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 84/160] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:50.618980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8708d-feb9-46c2-96db-6b92ae056a9d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.619279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8708d-feb9-46c2-96db-6b92ae056a9d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.619564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8708d-feb9-46c2-96db-6b92ae056a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.649602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-39c8708d-feb9-46c2-96db-6b92ae056a9d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:50.651090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-39c8708d-feb9-46c2-96db-6b92ae056a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:50.669831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:50.692828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:50.764416 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 85/161] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:50.770181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8708d-feb9-46c2-96db-6b92ae056a9d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:50.774639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e0788-bb91-4c02-b9be-933b7c58409a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:50.838116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731089b-f421-4366-b8cb-d4399f555d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:50.838789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731089b-f421-4366-b8cb-d4399f555d1f None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.839080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731089b-f421-4366-b8cb-d4399f555d1f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.839337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731089b-f421-4366-b8cb-d4399f555d1f None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/users/4e7ce6cf8bb84e3fbd57758d4cda093d/roles/dcca49656a484f299d30879c98961cd9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.841421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731089b-f421-4366-b8cb-d4399f555d1f None admin] RBAC: Authorizing `identity:create_grant(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9, user_id=4e7ce6cf8bb84e3fbd57758d4cda093d, role_id=dcca49656a484f299d30879c98961cd9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:50.842882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731089b-f421-4366-b8cb-d4399f555d1f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:50.867520 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 77/162] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:09:50 2022] PUT /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/users/4e7ce6cf8bb84e3fbd57758d4cda093d/roles/dcca49656a484f299d30879c98961cd9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:09:50.906699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8708d-feb9-46c2-96db-6b92ae056a9d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:50.945087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db6bb6-7285-4196-bf04-59e34d88b790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:50.945683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db6bb6-7285-4196-bf04-59e34d88b790 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:50.945968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db6bb6-7285-4196-bf04-59e34d88b790 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:50.946248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db6bb6-7285-4196-bf04-59e34d88b790 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:50.958526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db6bb6-7285-4196-bf04-59e34d88b790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-67db6bb6-7285-4196-bf04-59e34d88b790 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:50.963735 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:50.964721 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:50.965650 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 86/163] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:50.973113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731089b-f421-4366-b8cb-d4399f555d1f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:51.118970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731089b-f421-4366-b8cb-d4399f555d1f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:51.141813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:51.161035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf65581-e9b9-4632-bd4c-169a54f76e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:51.161722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf65581-e9b9-4632-bd4c-169a54f76e86 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:51.162002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf65581-e9b9-4632-bd4c-169a54f76e86 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:51.162270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf65581-e9b9-4632-bd4c-169a54f76e86 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:51.162947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf65581-e9b9-4632-bd4c-169a54f76e86 None admin] RBAC: Adding query filter params (name=member) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:51.163249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf65581-e9b9-4632-bd4c-169a54f76e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:51.164778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf65581-e9b9-4632-bd4c-169a54f76e86 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:51.177628 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 78/164] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:09:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:51.183448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db6bb6-7285-4196-bf04-59e34d88b790 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:51.187387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:51.250527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf65581-e9b9-4632-bd4c-169a54f76e86 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:51.392502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf65581-e9b9-4632-bd4c-169a54f76e86 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:51.404220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db6bb6-7285-4196-bf04-59e34d88b790 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:51.463108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2b88-f8d3-4cdd-91ea-212a31471f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:51.463764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2b88-f8d3-4cdd-91ea-212a31471f8f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:51.464037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2b88-f8d3-4cdd-91ea-212a31471f8f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:51.464303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce2b88-f8d3-4cdd-91ea-212a31471f8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:51.494188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cbb68-64d4-440e-a3a6-8cbf4d75d4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:51.494733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce2b88-f8d3-4cdd-91ea-212a31471f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:51.494945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cbb68-64d4-440e-a3a6-8cbf4d75d4e0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:51.495116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cbb68-64d4-440e-a3a6-8cbf4d75d4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:51.495399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cbb68-64d4-440e-a3a6-8cbf4d75d4e0 None admin] PATH_INFO: `/v3/users/dc4f177107dd484bb54b563adc03c2c7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:51.496657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cbb68-64d4-440e-a3a6-8cbf4d75d4e0 None admin] RBAC: Authorizing `identity:get_user(user_id=dc4f177107dd484bb54b563adc03c2c7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:51.498146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cbb68-64d4-440e-a3a6-8cbf4d75d4e0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:51.499757 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 87/165] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:51 2022] GET /identity/v3/users/dc4f177107dd484bb54b563adc03c2c7 => generated 275 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-78ce2b88-f8d3-4cdd-91ea-212a31471f8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:51.500218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:51.501133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:09:51.502721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:51.503351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cbb68-64d4-440e-a3a6-8cbf4d75d4e0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:51.505890 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 79/166] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:09:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:09:51.511563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2b88-f8d3-4cdd-91ea-212a31471f8f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:51.597678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:51.681285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:51.712295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cbb68-64d4-440e-a3a6-8cbf4d75d4e0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:51.743548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce2b88-f8d3-4cdd-91ea-212a31471f8f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:51.752933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748ea93-4716-480a-9cea-9bb0435b7854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:51.753641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748ea93-4716-480a-9cea-9bb0435b7854 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:51.754004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748ea93-4716-480a-9cea-9bb0435b7854 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:51.754347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748ea93-4716-480a-9cea-9bb0435b7854 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:51.766186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748ea93-4716-480a-9cea-9bb0435b7854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-3748ea93-4716-480a-9cea-9bb0435b7854 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:51.771315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:51.772222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:51.773309 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 88/167] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:51.774284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748ea93-4716-480a-9cea-9bb0435b7854 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:51.818111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7380cf-0f1a-4145-ae2a-d25c0a64bff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:51.818733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7380cf-0f1a-4145-ae2a-d25c0a64bff1 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:51.819013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7380cf-0f1a-4145-ae2a-d25c0a64bff1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:51.819285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7380cf-0f1a-4145-ae2a-d25c0a64bff1 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:51.819977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7380cf-0f1a-4145-ae2a-d25c0a64bff1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:51.820281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7380cf-0f1a-4145-ae2a-d25c0a64bff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:51.821703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7380cf-0f1a-4145-ae2a-d25c0a64bff1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:51.847592 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 80/168] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:09:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:51.848881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122a4ab-19ed-4f93-ae22-484ff7abe65b None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:51.849172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122a4ab-19ed-4f93-ae22-484ff7abe65b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:51.849467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122a4ab-19ed-4f93-ae22-484ff7abe65b None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:51.850954 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 81/169] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:51.851675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122a4ab-19ed-4f93-ae22-484ff7abe65b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:51.893781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748ea93-4716-480a-9cea-9bb0435b7854 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:51.959214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:51.982105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b36e09-b702-4bb9-9ba0-e40818eb3019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:51.982716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b36e09-b702-4bb9-9ba0-e40818eb3019 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:51.982995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b36e09-b702-4bb9-9ba0-e40818eb3019 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:51.983264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b36e09-b702-4bb9-9ba0-e40818eb3019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:52.010189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:52.016231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122a4ab-19ed-4f93-ae22-484ff7abe65b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:52.091516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b36e09-b702-4bb9-9ba0-e40818eb3019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:52.093515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b36e09-b702-4bb9-9ba0-e40818eb3019 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:52.102683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e1f48-42d5-4d83-b3d4-4b51c30f7a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:52.103310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e1f48-42d5-4d83-b3d4-4b51c30f7a69 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:52.103591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e1f48-42d5-4d83-b3d4-4b51c30f7a69 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:52.103860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e1f48-42d5-4d83-b3d4-4b51c30f7a69 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:52.104532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e1f48-42d5-4d83-b3d4-4b51c30f7a69 None admin] RBAC: Adding query filter params (name=member) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:52.104829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e1f48-42d5-4d83-b3d4-4b51c30f7a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:52.106435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e1f48-42d5-4d83-b3d4-4b51c30f7a69 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:52.131608 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 82/170] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:09:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:52.132617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a81ab-de47-42ab-84b0-c8993863b535 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:52.132899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a81ab-de47-42ab-84b0-c8993863b535 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:52.133170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a81ab-de47-42ab-84b0-c8993863b535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:52.179148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d43a81ab-de47-42ab-84b0-c8993863b535 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:52.180354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d43a81ab-de47-42ab-84b0-c8993863b535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:52.213679 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 89/171] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:52.214628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b36e09-b702-4bb9-9ba0-e40818eb3019 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:52.246418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:52.332127 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 83/172] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:52.332740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a81ab-de47-42ab-84b0-c8993863b535 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:52.366060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b36e09-b702-4bb9-9ba0-e40818eb3019 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:52.427088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fccb0-9f4f-40a8-8799-e68f181b7b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:52.428552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fccb0-9f4f-40a8-8799-e68f181b7b56 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:52.429291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fccb0-9f4f-40a8-8799-e68f181b7b56 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:52.429735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fccb0-9f4f-40a8-8799-e68f181b7b56 None admin] PATH_INFO: `/v3/users/dc4f177107dd484bb54b563adc03c2c7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:52.431345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fccb0-9f4f-40a8-8799-e68f181b7b56 None admin] RBAC: Authorizing `identity:get_user(user_id=dc4f177107dd484bb54b563adc03c2c7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:52.433770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fccb0-9f4f-40a8-8799-e68f181b7b56 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:52.436604 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 90/173] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:52 2022] GET /identity/v3/users/dc4f177107dd484bb54b563adc03c2c7 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:52.437587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fccb0-9f4f-40a8-8799-e68f181b7b56 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:52.453674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:52.467029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a81ab-de47-42ab-84b0-c8993863b535 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:52.512618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14d7ed-8e9b-49c4-aca0-7dbc8d4d6aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:52.513590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14d7ed-8e9b-49c4-aca0-7dbc8d4d6aa8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:52.514331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14d7ed-8e9b-49c4-aca0-7dbc8d4d6aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:52.514814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14d7ed-8e9b-49c4-aca0-7dbc8d4d6aa8 None admin] PATH_INFO: `/v3/users/dc4f177107dd484bb54b563adc03c2c7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:52.516372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14d7ed-8e9b-49c4-aca0-7dbc8d4d6aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=dc4f177107dd484bb54b563adc03c2c7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:52.518705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14d7ed-8e9b-49c4-aca0-7dbc8d4d6aa8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:52.521794 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 84/174] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:52 2022] GET /identity/v3/users/dc4f177107dd484bb54b563adc03c2c7 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:52.523983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3420c-2f1c-4713-9d45-a0746669d7c0 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:52.524815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3420c-2f1c-4713-9d45-a0746669d7c0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:52.525886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3420c-2f1c-4713-9d45-a0746669d7c0 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:52.529265 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 85/175] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:52.534217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4c0ca-57c4-49f6-9458-ba919c89200e None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:52.534758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4c0ca-57c4-49f6-9458-ba919c89200e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:52.535208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4c0ca-57c4-49f6-9458-ba919c89200e None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:52.542115 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 86/176] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:52.543136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4c0ca-57c4-49f6-9458-ba919c89200e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:52.577300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:52.583148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fccb0-9f4f-40a8-8799-e68f181b7b56 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:52.643601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b4b8e-e631-447d-97cb-12d81d0b5b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:52.644848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b4b8e-e631-447d-97cb-12d81d0b5b94 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:52.645355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b4b8e-e631-447d-97cb-12d81d0b5b94 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:52.646511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b4b8e-e631-447d-97cb-12d81d0b5b94 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:52.648100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b4b8e-e631-447d-97cb-12d81d0b5b94 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:52.650222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b4b8e-e631-447d-97cb-12d81d0b5b94 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:52.654173 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 91/177] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:52 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:52.655627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b4b8e-e631-447d-97cb-12d81d0b5b94 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:52.690989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4c0ca-57c4-49f6-9458-ba919c89200e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:52.736722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dbaad-d5a7-4b17-88e0-56abba17ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:52.738114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbaad-d5a7-4b17-88e0-56abba17ba6a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:52.738781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbaad-d5a7-4b17-88e0-56abba17ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:52.739561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbaad-d5a7-4b17-88e0-56abba17ba6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:52.773279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:52.796711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b4b8e-e631-447d-97cb-12d81d0b5b94 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:52.829735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dbaad-d5a7-4b17-88e0-56abba17ba6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:52.831539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dbaad-d5a7-4b17-88e0-56abba17ba6a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:52.849107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db3a2d-8db4-43cd-910d-cc4e52693f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:52.849674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db3a2d-8db4-43cd-910d-cc4e52693f69 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:52.849957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db3a2d-8db4-43cd-910d-cc4e52693f69 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:52.850224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db3a2d-8db4-43cd-910d-cc4e52693f69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:52.909215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:52.949219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db3a2d-8db4-43cd-910d-cc4e52693f69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:52.951107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db3a2d-8db4-43cd-910d-cc4e52693f69 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:52.959070 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 87/178] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:52.960332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6c59-9f83-4e86-a28e-8a864d9daf48 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:52.960635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6c59-9f83-4e86-a28e-8a864d9daf48 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:52.960896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6c59-9f83-4e86-a28e-8a864d9daf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:52.978454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-48db6c59-9f83-4e86-a28e-8a864d9daf48 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:52.979650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-48db6c59-9f83-4e86-a28e-8a864d9daf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:53.046724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:53.067579 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 92/179] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:53.069026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655e5fb-cf28-4458-b146-f1df01b0e997 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:53.069466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655e5fb-cf28-4458-b146-f1df01b0e997 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:53.069869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655e5fb-cf28-4458-b146-f1df01b0e997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:53.077534 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 88/180] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:53.078661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db6c59-9f83-4e86-a28e-8a864d9daf48 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:53.092728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d655e5fb-cf28-4458-b146-f1df01b0e997 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:53.094745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d655e5fb-cf28-4458-b146-f1df01b0e997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:53.177256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:53.193515 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 93/181] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:53.195202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655e5fb-cf28-4458-b146-f1df01b0e997 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:53.212685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db6c59-9f83-4e86-a28e-8a864d9daf48 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:53.280274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f36ee1-c1e0-41eb-b285-08ad9eb4970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:53.281038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f36ee1-c1e0-41eb-b285-08ad9eb4970e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:53.281313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f36ee1-c1e0-41eb-b285-08ad9eb4970e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:53.281611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f36ee1-c1e0-41eb-b285-08ad9eb4970e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:53.293249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f36ee1-c1e0-41eb-b285-08ad9eb4970e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-f6f36ee1-c1e0-41eb-b285-08ad9eb4970e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:53.299103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:53.300036 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:53.300906 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 89/182] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:09:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:53.301608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f36ee1-c1e0-41eb-b285-08ad9eb4970e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:53.343631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655e5fb-cf28-4458-b146-f1df01b0e997 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:53.361542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:53.383321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f642f-d3e8-4f5b-b4ff-c7e036d67e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:53.384811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f642f-d3e8-4f5b-b4ff-c7e036d67e4a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:53.385089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f642f-d3e8-4f5b-b4ff-c7e036d67e4a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:53.385364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f642f-d3e8-4f5b-b4ff-c7e036d67e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:53.386129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f642f-d3e8-4f5b-b4ff-c7e036d67e4a None admin] RBAC: Adding query filter params (role.id=0aaef5fae9d1491bb3548a12be30bd2d, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9, user.id=dc4f177107dd484bb54b563adc03c2c7) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:53.386435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f642f-d3e8-4f5b-b4ff-c7e036d67e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:53.387942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f642f-d3e8-4f5b-b4ff-c7e036d67e4a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:53.396127 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 94/183] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:53 2022] GET /identity/v3/role_assignments?user.id=dc4f177107dd484bb54b563adc03c2c7&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:53.396928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f642f-d3e8-4f5b-b4ff-c7e036d67e4a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:53.422175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f36ee1-c1e0-41eb-b285-08ad9eb4970e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:53.470465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:53.485564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e159d7-f558-4bfd-a928-369e952f2d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:53.486858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e159d7-f558-4bfd-a928-369e952f2d33 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:53.487290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e159d7-f558-4bfd-a928-369e952f2d33 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:53.487704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e159d7-f558-4bfd-a928-369e952f2d33 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:53.489104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e159d7-f558-4bfd-a928-369e952f2d33 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:53.491664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e159d7-f558-4bfd-a928-369e952f2d33 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:53.494741 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 90/184] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:53 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:53.501321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b82280-f790-4983-aaec-d46b6a590381 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:53.501321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b82280-f790-4983-aaec-d46b6a590381 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:53.501321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b82280-f790-4983-aaec-d46b6a590381 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:53.505991 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 91/185] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:53.507557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b82280-f790-4983-aaec-d46b6a590381 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:53.529895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f642f-d3e8-4f5b-b4ff-c7e036d67e4a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:53.574493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a9c97-f84c-4385-98f8-e85e52e14297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:53.575227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9c97-f84c-4385-98f8-e85e52e14297 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:53.575507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9c97-f84c-4385-98f8-e85e52e14297 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:53.575784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a9c97-f84c-4385-98f8-e85e52e14297 None admin] PATH_INFO: `/v3/projects/5103dbc142bc4cb8a27b72747f170e94` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:53.576985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a9c97-f84c-4385-98f8-e85e52e14297 None admin] RBAC: Authorizing `identity:get_project(project_id=5103dbc142bc4cb8a27b72747f170e94)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:53.578472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a9c97-f84c-4385-98f8-e85e52e14297 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:53.585069 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 95/186] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:53 2022] GET /identity/v3/projects/5103dbc142bc4cb8a27b72747f170e94 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:53.585069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a9c97-f84c-4385-98f8-e85e52e14297 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:53.640771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b82280-f790-4983-aaec-d46b6a590381 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:53.658498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:53.676156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853d8ff-84e5-44dc-a302-1b3797308f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:53.676762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853d8ff-84e5-44dc-a302-1b3797308f69 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:53.677041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853d8ff-84e5-44dc-a302-1b3797308f69 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:53.677315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853d8ff-84e5-44dc-a302-1b3797308f69 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:53.678009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853d8ff-84e5-44dc-a302-1b3797308f69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:53.678311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853d8ff-84e5-44dc-a302-1b3797308f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:53.679705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853d8ff-84e5-44dc-a302-1b3797308f69 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:53.688134 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 92/187] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:53.688961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853d8ff-84e5-44dc-a302-1b3797308f69 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:53.696459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a9c97-f84c-4385-98f8-e85e52e14297 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:53.723358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:53.731992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6103e2-174b-4211-82db-a5f155864f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:53.732621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6103e2-174b-4211-82db-a5f155864f87 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:53.732900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6103e2-174b-4211-82db-a5f155864f87 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:53.733173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6103e2-174b-4211-82db-a5f155864f87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:53.734588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6103e2-174b-4211-82db-a5f155864f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:53.736034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6103e2-174b-4211-82db-a5f155864f87 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:53.737832 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 96/188] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:53.738789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df829c-3523-40f6-82aa-d75ba6d0c387 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:53.739070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df829c-3523-40f6-82aa-d75ba6d0c387 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:53.739345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df829c-3523-40f6-82aa-d75ba6d0c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:53.756820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-89df829c-3523-40f6-82aa-d75ba6d0c387 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:53.758026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-89df829c-3523-40f6-82aa-d75ba6d0c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:53.794856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853d8ff-84e5-44dc-a302-1b3797308f69 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:53.829483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd27c4-8748-4457-bdea-055477c96af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:53.830099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd27c4-8748-4457-bdea-055477c96af8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:53.830380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd27c4-8748-4457-bdea-055477c96af8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:53.830504 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 97/189] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:53.831002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd27c4-8748-4457-bdea-055477c96af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:53.831360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df829c-3523-40f6-82aa-d75ba6d0c387 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:53.831827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd27c4-8748-4457-bdea-055477c96af8 None admin] RBAC: Adding query filter params (role.id=066bc2c3c4ad43baaa2e35afdba859e5, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9, user.id=dc4f177107dd484bb54b563adc03c2c7) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:53.832141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd27c4-8748-4457-bdea-055477c96af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:53.833627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd27c4-8748-4457-bdea-055477c96af8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:53.843084 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 93/190] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:53 2022] GET /identity/v3/role_assignments?user.id=dc4f177107dd484bb54b563adc03c2c7&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=066bc2c3c4ad43baaa2e35afdba859e5 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:53.844027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd27c4-8748-4457-bdea-055477c96af8 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:53.913276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:53.973890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df829c-3523-40f6-82aa-d75ba6d0c387 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:53.990450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd27c4-8748-4457-bdea-055477c96af8 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:54.005315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:54.019071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42961436-a465-4b5b-b397-ed16ec449e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:54.019722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961436-a465-4b5b-b397-ed16ec449e40 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:54.020000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961436-a465-4b5b-b397-ed16ec449e40 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:54.020276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961436-a465-4b5b-b397-ed16ec449e40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:54.038959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42961436-a465-4b5b-b397-ed16ec449e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:54.040715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978e4f8-8119-465d-bd93-14b4f828abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:54.041323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978e4f8-8119-465d-bd93-14b4f828abcb None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:54.041652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978e4f8-8119-465d-bd93-14b4f828abcb None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:54.041924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978e4f8-8119-465d-bd93-14b4f828abcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-42961436-a465-4b5b-b397-ed16ec449e40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:54.043949 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:54.044857 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:09:54.045696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:54.046305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978e4f8-8119-465d-bd93-14b4f828abcb None admin] RBAC: Adding query filter params (role.id=0aaef5fae9d1491bb3548a12be30bd2d, scope.project.id=5103dbc142bc4cb8a27b72747f170e94, user.id=dc4f177107dd484bb54b563adc03c2c7) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:54.046305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978e4f8-8119-465d-bd93-14b4f828abcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:54.046969 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 98/191] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:09:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:54.047046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978e4f8-8119-465d-bd93-14b4f828abcb None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:54.050856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42961436-a465-4b5b-b397-ed16ec449e40 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:54.055835 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 94/192] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:53 2022] GET /identity/v3/role_assignments?user.id=dc4f177107dd484bb54b563adc03c2c7&scope.project.id=5103dbc142bc4cb8a27b72747f170e94&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:54.057369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978e4f8-8119-465d-bd93-14b4f828abcb None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:54.184538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42961436-a465-4b5b-b397-ed16ec449e40 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:54.188627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978e4f8-8119-465d-bd93-14b4f828abcb None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:54.201519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:54.224281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3828988-cfc5-40b8-a8f2-b49b63b4ef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:54.224970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828988-cfc5-40b8-a8f2-b49b63b4ef3c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:54.225565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828988-cfc5-40b8-a8f2-b49b63b4ef3c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:54.225565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828988-cfc5-40b8-a8f2-b49b63b4ef3c None admin] PATH_INFO: `/v3/users/a64877decf83416f8bf0286bf1666e89` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:54.232956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b9769-7eae-442a-aba7-80983c082c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:54.236752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b9769-7eae-442a-aba7-80983c082c88 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:54.236752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b9769-7eae-442a-aba7-80983c082c88 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:54.236752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b9769-7eae-442a-aba7-80983c082c88 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:54.236752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b9769-7eae-442a-aba7-80983c082c88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:54.237236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b9769-7eae-442a-aba7-80983c082c88 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:54.243260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3828988-cfc5-40b8-a8f2-b49b63b4ef3c None admin] RBAC: Authorizing `identity:get_user(user_id=a64877decf83416f8bf0286bf1666e89)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:54.244732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3828988-cfc5-40b8-a8f2-b49b63b4ef3c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:54.247143 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 99/193] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:54 2022] GET /identity/v3/users/a64877decf83416f8bf0286bf1666e89 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:54.248879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3828988-cfc5-40b8-a8f2-b49b63b4ef3c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:54.270487 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 95/194] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:09:54 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:09:54.271356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b9769-7eae-442a-aba7-80983c082c88 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:54.307569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:54.383712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3828988-cfc5-40b8-a8f2-b49b63b4ef3c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:54.403543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b9769-7eae-442a-aba7-80983c082c88 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:54.423895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734208-362c-4083-b3b0-5496bca8a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:54.424507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734208-362c-4083-b3b0-5496bca8a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:54.424784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734208-362c-4083-b3b0-5496bca8a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:54.425056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734208-362c-4083-b3b0-5496bca8a0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:54.426149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734208-362c-4083-b3b0-5496bca8a0b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:54.426149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734208-362c-4083-b3b0-5496bca8a0b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:54.427719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734208-362c-4083-b3b0-5496bca8a0b0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:54.438109 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 100/195] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:09:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:54.438956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734208-362c-4083-b3b0-5496bca8a0b0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:54.449208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569828ae-307f-4ff4-8e22-7c3b745d4bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:54.450529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569828ae-307f-4ff4-8e22-7c3b745d4bb2 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:54.450808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569828ae-307f-4ff4-8e22-7c3b745d4bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:54.451455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569828ae-307f-4ff4-8e22-7c3b745d4bb2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:54.463936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569828ae-307f-4ff4-8e22-7c3b745d4bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-569828ae-307f-4ff4-8e22-7c3b745d4bb2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:54.469360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:54.470280 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:09:54.471076 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 96/196] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:54.471724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569828ae-307f-4ff4-8e22-7c3b745d4bb2 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:54.509583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:54.577183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734208-362c-4083-b3b0-5496bca8a0b0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:54.586280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:54.622920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569828ae-307f-4ff4-8e22-7c3b745d4bb2 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:54.631908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a625c38-752b-4110-8bd6-f3ccb570daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:54.632525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a625c38-752b-4110-8bd6-f3ccb570daa2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:54.632806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a625c38-752b-4110-8bd6-f3ccb570daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:54.633514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a625c38-752b-4110-8bd6-f3ccb570daa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:54.660066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661a0e3-793a-4201-9964-801f0ae3ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:54.660758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661a0e3-793a-4201-9964-801f0ae3ce89 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:54.661044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661a0e3-793a-4201-9964-801f0ae3ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:54.661320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661a0e3-793a-4201-9964-801f0ae3ce89 None admin] PATH_INFO: `/v3/users/a64877decf83416f8bf0286bf1666e89` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:54.662600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661a0e3-793a-4201-9964-801f0ae3ce89 None admin] RBAC: Authorizing `identity:get_user(user_id=a64877decf83416f8bf0286bf1666e89)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:54.664108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661a0e3-793a-4201-9964-801f0ae3ce89 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:54.665997 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 97/197] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:54 2022] GET /identity/v3/users/a64877decf83416f8bf0286bf1666e89 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:54.666603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661a0e3-793a-4201-9964-801f0ae3ce89 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:54.721469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a625c38-752b-4110-8bd6-f3ccb570daa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:54.723684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a625c38-752b-4110-8bd6-f3ccb570daa2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:54.783581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661a0e3-793a-4201-9964-801f0ae3ce89 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:54.805837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:54.830520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe539092-c194-48d6-a95b-d54e91667e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:54.831141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539092-c194-48d6-a95b-d54e91667e1c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:54.831458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539092-c194-48d6-a95b-d54e91667e1c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:54.831791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539092-c194-48d6-a95b-d54e91667e1c None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:54.832682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe539092-c194-48d6-a95b-d54e91667e1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:54.833089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe539092-c194-48d6-a95b-d54e91667e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:54.834521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe539092-c194-48d6-a95b-d54e91667e1c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:54.845908 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 98/198] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:09:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:54.847272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe539092-c194-48d6-a95b-d54e91667e1c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:54.868383 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 101/199] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:54.869373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a625c38-752b-4110-8bd6-f3ccb570daa2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:54.884052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:54.971819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe539092-c194-48d6-a95b-d54e91667e1c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:54.992206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a625c38-752b-4110-8bd6-f3ccb570daa2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:55.008670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496fa63-de8a-451f-8cf0-2d3c7aec1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:55.009281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fa63-de8a-451f-8cf0-2d3c7aec1103 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:55.009605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fa63-de8a-451f-8cf0-2d3c7aec1103 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:55.009881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496fa63-de8a-451f-8cf0-2d3c7aec1103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:55.032362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551276e-85de-4545-a6fe-466e2b3f6379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:55.033002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551276e-85de-4545-a6fe-466e2b3f6379 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:55.033329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551276e-85de-4545-a6fe-466e2b3f6379 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:55.033687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551276e-85de-4545-a6fe-466e2b3f6379 None admin] PATH_INFO: `/v3/users/4e7ce6cf8bb84e3fbd57758d4cda093d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:55.041546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551276e-85de-4545-a6fe-466e2b3f6379 None admin] RBAC: Authorizing `identity:get_user(user_id=4e7ce6cf8bb84e3fbd57758d4cda093d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:55.041546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551276e-85de-4545-a6fe-466e2b3f6379 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:55.041546 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 102/200] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:54 2022] GET /identity/v3/users/4e7ce6cf8bb84e3fbd57758d4cda093d => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:55.041546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551276e-85de-4545-a6fe-466e2b3f6379 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:55.047869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:55.096143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496fa63-de8a-451f-8cf0-2d3c7aec1103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:55.098015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496fa63-de8a-451f-8cf0-2d3c7aec1103 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:55.123484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:55.152234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551276e-85de-4545-a6fe-466e2b3f6379 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:55.191176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08a61b-f91b-49ea-8789-27d368fed76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:55.191947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08a61b-f91b-49ea-8789-27d368fed76d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:55.192278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08a61b-f91b-49ea-8789-27d368fed76d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:55.192606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08a61b-f91b-49ea-8789-27d368fed76d None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:55.193866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08a61b-f91b-49ea-8789-27d368fed76d None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:55.195429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08a61b-f91b-49ea-8789-27d368fed76d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:55.197260 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 103/201] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:55 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:55.198452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08a61b-f91b-49ea-8789-27d368fed76d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:55.214569 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 99/202] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:55.216213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496fa63-de8a-451f-8cf0-2d3c7aec1103 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:55.279881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:55.312680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08a61b-f91b-49ea-8789-27d368fed76d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:55.332735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496fa63-de8a-451f-8cf0-2d3c7aec1103 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:55.351209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f10a-c476-48f7-889c-120816a232fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:55.351832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f10a-c476-48f7-889c-120816a232fe None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:55.352171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f10a-c476-48f7-889c-120816a232fe None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:55.352444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f10a-c476-48f7-889c-120816a232fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:55.366875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:55.373065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed47bd-915e-4fa3-928d-d98616f268fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:55.374094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed47bd-915e-4fa3-928d-d98616f268fb None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:55.374573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed47bd-915e-4fa3-928d-d98616f268fb None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:55.375132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed47bd-915e-4fa3-928d-d98616f268fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:55.376089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed47bd-915e-4fa3-928d-d98616f268fb None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=04786f98561745b7b9db0c5057cb24fd, user.id=a64877decf83416f8bf0286bf1666e89) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:55.376597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed47bd-915e-4fa3-928d-d98616f268fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:55.378400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed47bd-915e-4fa3-928d-d98616f268fb None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:55.384825 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 100/203] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:55 2022] GET /identity/v3/role_assignments?user.id=a64877decf83416f8bf0286bf1666e89&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=be89abac608f45a6921181bcc574f721 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:55.386015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed47bd-915e-4fa3-928d-d98616f268fb None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:55.450811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734f10a-c476-48f7-889c-120816a232fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:55.452504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734f10a-c476-48f7-889c-120816a232fe None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:55.505292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed47bd-915e-4fa3-928d-d98616f268fb None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:55.527758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:55.547395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32408164-a16b-49cc-a88c-7215008c38c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:55.548399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408164-a16b-49cc-a88c-7215008c38c7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:55.548930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408164-a16b-49cc-a88c-7215008c38c7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:55.549433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408164-a16b-49cc-a88c-7215008c38c7 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:55.551092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32408164-a16b-49cc-a88c-7215008c38c7 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:55.552789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32408164-a16b-49cc-a88c-7215008c38c7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:55.554957 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 101/204] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:55 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:55.562548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32408164-a16b-49cc-a88c-7215008c38c7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:55.581516 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 104/205] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:55.583417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f10a-c476-48f7-889c-120816a232fe None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:55.665790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:55.747494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32408164-a16b-49cc-a88c-7215008c38c7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:55.785158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f10a-c476-48f7-889c-120816a232fe None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:55.813421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc275-fecc-45a8-bc88-b184b653d78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:55.814457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc275-fecc-45a8-bc88-b184b653d78a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:55.814949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc275-fecc-45a8-bc88-b184b653d78a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:55.815432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bc275-fecc-45a8-bc88-b184b653d78a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:55.816794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bc275-fecc-45a8-bc88-b184b653d78a None admin] RBAC: Adding query filter params (role.id=066bc2c3c4ad43baaa2e35afdba859e5, scope.project.id=04786f98561745b7b9db0c5057cb24fd, user.id=a64877decf83416f8bf0286bf1666e89) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:55.817342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bc275-fecc-45a8-bc88-b184b653d78a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:55.819817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bc275-fecc-45a8-bc88-b184b653d78a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:55.826624 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 102/206] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:55 2022] GET /identity/v3/role_assignments?user.id=a64877decf83416f8bf0286bf1666e89&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=066bc2c3c4ad43baaa2e35afdba859e5 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:55.875508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643231ae-2267-4dc7-b302-aad774162290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:55.876116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643231ae-2267-4dc7-b302-aad774162290 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:55.876403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643231ae-2267-4dc7-b302-aad774162290 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:55.876682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643231ae-2267-4dc7-b302-aad774162290 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:55.882453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643231ae-2267-4dc7-b302-aad774162290 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:55.884018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643231ae-2267-4dc7-b302-aad774162290 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:55.886326 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 105/207] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:55 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:55.892266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc275-fecc-45a8-bc88-b184b653d78a None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:55.995389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:56.078271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bc275-fecc-45a8-bc88-b184b653d78a None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:56.127326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faa3c8-a21a-4df0-89a4-6962ee723e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:56.127888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faa3c8-a21a-4df0-89a4-6962ee723e55 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:56.128175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faa3c8-a21a-4df0-89a4-6962ee723e55 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:56.128452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faa3c8-a21a-4df0-89a4-6962ee723e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:56.129199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faa3c8-a21a-4df0-89a4-6962ee723e55 None admin] RBAC: Adding query filter params (role.id=dcca49656a484f299d30879c98961cd9, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9, user.id=4e7ce6cf8bb84e3fbd57758d4cda093d) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:56.129543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faa3c8-a21a-4df0-89a4-6962ee723e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:56.131111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faa3c8-a21a-4df0-89a4-6962ee723e55 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:56.138552 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 103/208] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:55 2022] GET /identity/v3/role_assignments?user.id=4e7ce6cf8bb84e3fbd57758d4cda093d&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=dcca49656a484f299d30879c98961cd9 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:56.495648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753de961-b6cd-41b2-9ed9-3153d9758073 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:56.495932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753de961-b6cd-41b2-9ed9-3153d9758073 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:56.496116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753de961-b6cd-41b2-9ed9-3153d9758073 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:56.501420 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 106/209] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:56.508310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ac164-80b7-497a-94b8-4092b93e7227 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:56.508614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ac164-80b7-497a-94b8-4092b93e7227 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:56.508869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ac164-80b7-497a-94b8-4092b93e7227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:56.535114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cf1ac164-80b7-497a-94b8-4092b93e7227 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:56.537106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cf1ac164-80b7-497a-94b8-4092b93e7227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:56.613503 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 104/210] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:56.629052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274552c9-0657-4b94-ba2b-e7dff57a238a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:56.629715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274552c9-0657-4b94-ba2b-e7dff57a238a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:56.630191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274552c9-0657-4b94-ba2b-e7dff57a238a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:56.631735 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 107/211] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:56.637344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff06f51-bac3-40a8-b4c6-31c46349fbfd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:56.638140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff06f51-bac3-40a8-b4c6-31c46349fbfd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:56.638416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff06f51-bac3-40a8-b4c6-31c46349fbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:56.657121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9ff06f51-bac3-40a8-b4c6-31c46349fbfd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:56.658320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9ff06f51-bac3-40a8-b4c6-31c46349fbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:56.704858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:56.736792 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 105/212] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:56.898024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274552c9-0657-4b94-ba2b-e7dff57a238a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:57.009913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274552c9-0657-4b94-ba2b-e7dff57a238a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:57.013087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff06f51-bac3-40a8-b4c6-31c46349fbfd None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:57.023408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:57.050694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fc305-7f40-49f4-bd77-f1fd6dc1b333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:57.051767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fc305-7f40-49f4-bd77-f1fd6dc1b333 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:57.052367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fc305-7f40-49f4-bd77-f1fd6dc1b333 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:57.052953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fc305-7f40-49f4-bd77-f1fd6dc1b333 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:57.065230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fc305-7f40-49f4-bd77-f1fd6dc1b333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-d39fc305-7f40-49f4-bd77-f1fd6dc1b333 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:57.070983 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:57.071888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:09:57.072719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:57.075572 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 108/213] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:57.081717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fc305-7f40-49f4-bd77-f1fd6dc1b333 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:57.131908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff06f51-bac3-40a8-b4c6-31c46349fbfd None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:57.170096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07755ee1-7596-422d-bc1d-95b85da07605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:57.171060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07755ee1-7596-422d-bc1d-95b85da07605 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:57.171551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07755ee1-7596-422d-bc1d-95b85da07605 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:57.172031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07755ee1-7596-422d-bc1d-95b85da07605 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:57.173381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07755ee1-7596-422d-bc1d-95b85da07605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:57.175111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07755ee1-7596-422d-bc1d-95b85da07605 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:57.181640 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 106/214] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:09:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:57.182768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07755ee1-7596-422d-bc1d-95b85da07605 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:57.210791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fc305-7f40-49f4-bd77-f1fd6dc1b333 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:57.232232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:57.256531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0a48d-b8f7-45c0-b4f9-0b120a97b21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:57.257155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0a48d-b8f7-45c0-b4f9-0b120a97b21c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:57.257447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0a48d-b8f7-45c0-b4f9-0b120a97b21c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:57.257723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0a48d-b8f7-45c0-b4f9-0b120a97b21c None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:57.258547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0a48d-b8f7-45c0-b4f9-0b120a97b21c None admin] RBAC: Adding query filter params (name=member) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:57.258850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0a48d-b8f7-45c0-b4f9-0b120a97b21c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:57.260728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0a48d-b8f7-45c0-b4f9-0b120a97b21c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:57.271478 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 109/215] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:09:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:57.277512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0a48d-b8f7-45c0-b4f9-0b120a97b21c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:57.298653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07755ee1-7596-422d-bc1d-95b85da07605 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:57.311180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:57.336341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c12ac-974a-465b-ae5b-c499870d41b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:57.337331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c12ac-974a-465b-ae5b-c499870d41b1 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:57.337869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c12ac-974a-465b-ae5b-c499870d41b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:57.338340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c12ac-974a-465b-ae5b-c499870d41b1 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:57.339190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c12ac-974a-465b-ae5b-c499870d41b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:57.341664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c12ac-974a-465b-ae5b-c499870d41b1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:57.367670 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 107/216] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:09:57 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:09:57.393679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0a48d-b8f7-45c0-b4f9-0b120a97b21c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:57.437226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f19da7-8d48-4472-afd4-e9d17484af29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:57.437881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19da7-8d48-4472-afd4-e9d17484af29 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:57.438216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19da7-8d48-4472-afd4-e9d17484af29 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:57.438492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19da7-8d48-4472-afd4-e9d17484af29 None admin] PATH_INFO: `/v3/users/f80368cb126b442eab45fb953612dd8a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:57.455682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f19da7-8d48-4472-afd4-e9d17484af29 None admin] RBAC: Authorizing `identity:get_user(user_id=f80368cb126b442eab45fb953612dd8a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:57.457190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f19da7-8d48-4472-afd4-e9d17484af29 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:57.459366 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 110/217] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:57 2022] GET /identity/v3/users/f80368cb126b442eab45fb953612dd8a => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:57.466560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c12ac-974a-465b-ae5b-c499870d41b1 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:57.580745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:57.585285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c12ac-974a-465b-ae5b-c499870d41b1 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:57.626795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69f67e-d115-476a-843b-e7ab4991877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:57.627665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69f67e-d115-476a-843b-e7ab4991877d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:57.628090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69f67e-d115-476a-843b-e7ab4991877d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:57.628503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69f67e-d115-476a-843b-e7ab4991877d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:57.703891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69f67e-d115-476a-843b-e7ab4991877d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:57.705627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69f67e-d115-476a-843b-e7ab4991877d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:57.745328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa304f84-00a0-4b34-985c-e68b41a99deb None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:57.745661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa304f84-00a0-4b34-985c-e68b41a99deb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:57.745947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa304f84-00a0-4b34-985c-e68b41a99deb None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:57.747635 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 111/218] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:09:57.752627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5417-beff-4c37-8e19-a8bec12a9aab None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:57.752915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5417-beff-4c37-8e19-a8bec12a9aab None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:57.753189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5417-beff-4c37-8e19-a8bec12a9aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:57.784432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-59dc5417-beff-4c37-8e19-a8bec12a9aab None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:57.785835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-59dc5417-beff-4c37-8e19-a8bec12a9aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:57.823959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:57.828291 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 108/219] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:09:57.834453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69f67e-d115-476a-843b-e7ab4991877d None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:57.872779 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 112/220] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:09:57.947960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69f67e-d115-476a-843b-e7ab4991877d None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:57.985725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca54b-385e-4e90-a20b-a4a7890d07c0 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:57.986215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca54b-385e-4e90-a20b-a4a7890d07c0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:57.986413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca54b-385e-4e90-a20b-a4a7890d07c0 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:57.988197 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 113/221] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:09:57.993873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d087dd-8fee-4e88-b1fe-c80201fcf4b5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:57.994228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7a736-cd3a-442c-afcc-dcdf6d571455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:57.994361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d087dd-8fee-4e88-b1fe-c80201fcf4b5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:57.994692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d087dd-8fee-4e88-b1fe-c80201fcf4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:57.995338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7a736-cd3a-442c-afcc-dcdf6d571455 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:57.995759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7a736-cd3a-442c-afcc-dcdf6d571455 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:57.996188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7a736-cd3a-442c-afcc-dcdf6d571455 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:58.002375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7a736-cd3a-442c-afcc-dcdf6d571455 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:58.004988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7a736-cd3a-442c-afcc-dcdf6d571455 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:58.006936 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 109/222] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:57 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:58.013749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7a736-cd3a-442c-afcc-dcdf6d571455 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:58.016060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-25d087dd-8fee-4e88-b1fe-c80201fcf4b5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:09:58.017414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-25d087dd-8fee-4e88-b1fe-c80201fcf4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:09:58.047684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:58.126558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:58.131069 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 114/223] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:09:58.169438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d087dd-8fee-4e88-b1fe-c80201fcf4b5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:58.171389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7a736-cd3a-442c-afcc-dcdf6d571455 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:58.210381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70067352-aaba-4023-9ec8-89bebbe62188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:58.211179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70067352-aaba-4023-9ec8-89bebbe62188 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:58.211781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70067352-aaba-4023-9ec8-89bebbe62188 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:58.212127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70067352-aaba-4023-9ec8-89bebbe62188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:58.213113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70067352-aaba-4023-9ec8-89bebbe62188 None admin] RBAC: Adding query filter params (role.id=0aaef5fae9d1491bb3548a12be30bd2d, scope.project.id=04786f98561745b7b9db0c5057cb24fd, user.id=f80368cb126b442eab45fb953612dd8a) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:58.213530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70067352-aaba-4023-9ec8-89bebbe62188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:58.215983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70067352-aaba-4023-9ec8-89bebbe62188 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:58.222956 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 110/224] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:09:58 2022] GET /identity/v3/role_assignments?user.id=f80368cb126b442eab45fb953612dd8a&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:58.316882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d087dd-8fee-4e88-b1fe-c80201fcf4b5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:58.354702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc556530-8423-4cde-a3d3-dc1310ffcf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:58.355361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc556530-8423-4cde-a3d3-dc1310ffcf3d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:58.355636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc556530-8423-4cde-a3d3-dc1310ffcf3d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:58.355908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc556530-8423-4cde-a3d3-dc1310ffcf3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:58.368136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc556530-8423-4cde-a3d3-dc1310ffcf3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-bc556530-8423-4cde-a3d3-dc1310ffcf3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:58.373266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:58.374224 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:58.375047 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 115/225] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:09:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:09:58.380449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70067352-aaba-4023-9ec8-89bebbe62188 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:58.469692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc556530-8423-4cde-a3d3-dc1310ffcf3d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:58.489092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:58.600202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc556530-8423-4cde-a3d3-dc1310ffcf3d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:58.642020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b055ae5-972c-43bd-933f-e5b5c13b8e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:58.643359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70067352-aaba-4023-9ec8-89bebbe62188 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:58.644085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b055ae5-972c-43bd-933f-e5b5c13b8e30 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:58.644698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b055ae5-972c-43bd-933f-e5b5c13b8e30 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:58.645652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b055ae5-972c-43bd-933f-e5b5c13b8e30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:58.665769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b055ae5-972c-43bd-933f-e5b5c13b8e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-3b055ae5-972c-43bd-933f-e5b5c13b8e30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:09:58.675407 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:09:58.676546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:09:58.677660 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:09:58.680484 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 116/226] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:09:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:09:58.690690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b055ae5-972c-43bd-933f-e5b5c13b8e30 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:58.702705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:58.706761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa559031-1eb6-4622-81a8-7f1384c7cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:58.707383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa559031-1eb6-4622-81a8-7f1384c7cee4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:58.707665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa559031-1eb6-4622-81a8-7f1384c7cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:58.707941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa559031-1eb6-4622-81a8-7f1384c7cee4 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:58.708620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa559031-1eb6-4622-81a8-7f1384c7cee4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:58.708924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa559031-1eb6-4622-81a8-7f1384c7cee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:58.717422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa559031-1eb6-4622-81a8-7f1384c7cee4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:58.720560 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 111/227] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:09:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:58.725992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa559031-1eb6-4622-81a8-7f1384c7cee4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:58.853414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:58.901427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa559031-1eb6-4622-81a8-7f1384c7cee4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:58.920118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b055ae5-972c-43bd-933f-e5b5c13b8e30 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:58.963027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0e7f0-168c-4728-abb1-4c59421febb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:58.963670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0e7f0-168c-4728-abb1-4c59421febb6 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:58.963953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0e7f0-168c-4728-abb1-4c59421febb6 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:58.964228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0e7f0-168c-4728-abb1-4c59421febb6 None admin] PATH_INFO: `/v3/users/a64877decf83416f8bf0286bf1666e89` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:58.966767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0e7f0-168c-4728-abb1-4c59421febb6 None admin] RBAC: Authorizing `identity:get_user(user_id=a64877decf83416f8bf0286bf1666e89)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:58.968227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0e7f0-168c-4728-abb1-4c59421febb6 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:58.973037 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 112/228] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:58 2022] GET /identity/v3/users/a64877decf83416f8bf0286bf1666e89 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:58.981973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0e7f0-168c-4728-abb1-4c59421febb6 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:59.005726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ba81d-4ed6-4be3-9f3b-32ffd0cfda1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:59.006380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ba81d-4ed6-4be3-9f3b-32ffd0cfda1b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:59.006715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ba81d-4ed6-4be3-9f3b-32ffd0cfda1b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:59.006860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ba81d-4ed6-4be3-9f3b-32ffd0cfda1b None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:59.007645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ba81d-4ed6-4be3-9f3b-32ffd0cfda1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:09:59.007955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ba81d-4ed6-4be3-9f3b-32ffd0cfda1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:59.009500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ba81d-4ed6-4be3-9f3b-32ffd0cfda1b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:59.022668 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 117/229] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:09:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:09:59.028768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ba81d-4ed6-4be3-9f3b-32ffd0cfda1b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:59.096434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:59.160541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0e7f0-168c-4728-abb1-4c59421febb6 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:59.237425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb881e8-e6b0-4506-b778-f9206ebc4077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:59.238069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb881e8-e6b0-4506-b778-f9206ebc4077 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:59.238346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb881e8-e6b0-4506-b778-f9206ebc4077 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:59.238617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb881e8-e6b0-4506-b778-f9206ebc4077 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:59.242126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb881e8-e6b0-4506-b778-f9206ebc4077 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:59.243606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb881e8-e6b0-4506-b778-f9206ebc4077 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:59.245486 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 113/230] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:58 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:59.251132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ba81d-4ed6-4be3-9f3b-32ffd0cfda1b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:59.253451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb881e8-e6b0-4506-b778-f9206ebc4077 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:59.303650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:59.315272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e5d8-e5de-4da6-9a66-d973d33118a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:59.315913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e5d8-e5de-4da6-9a66-d973d33118a0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:59.316394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e5d8-e5de-4da6-9a66-d973d33118a0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:59.316669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e5d8-e5de-4da6-9a66-d973d33118a0 None admin] PATH_INFO: `/v3/users/a64877decf83416f8bf0286bf1666e89` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:59.318418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506e5d8-e5de-4da6-9a66-d973d33118a0 None admin] RBAC: Authorizing `identity:get_user(user_id=a64877decf83416f8bf0286bf1666e89)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:59.319877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506e5d8-e5de-4da6-9a66-d973d33118a0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:59.323958 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 118/231] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:09:59 2022] GET /identity/v3/users/a64877decf83416f8bf0286bf1666e89 => generated 283 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:59.330832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e5d8-e5de-4da6-9a66-d973d33118a0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:59.430379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb881e8-e6b0-4506-b778-f9206ebc4077 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:59.485417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:09:59.490657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7405b34-5462-4ffe-8807-7295df139793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:59.493482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405b34-5462-4ffe-8807-7295df139793 None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:59.493482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405b34-5462-4ffe-8807-7295df139793 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:59.493482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405b34-5462-4ffe-8807-7295df139793 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd/users/a64877decf83416f8bf0286bf1666e89/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:59.494932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7405b34-5462-4ffe-8807-7295df139793 None admin] RBAC: Authorizing `identity:create_grant(project_id=04786f98561745b7b9db0c5057cb24fd, user_id=a64877decf83416f8bf0286bf1666e89, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:59.501412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7405b34-5462-4ffe-8807-7295df139793 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:59.514853 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 114/232] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:09:59 2022] PUT /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd/users/a64877decf83416f8bf0286bf1666e89/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:09:59.570272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e5d8-e5de-4da6-9a66-d973d33118a0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:59.640212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b18fa7-7d97-4cae-ae1f-dfc77ce25422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:59.640875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18fa7-7d97-4cae-ae1f-dfc77ce25422 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:59.641159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18fa7-7d97-4cae-ae1f-dfc77ce25422 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:59.641458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b18fa7-7d97-4cae-ae1f-dfc77ce25422 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:59.642729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b18fa7-7d97-4cae-ae1f-dfc77ce25422 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:59.644226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b18fa7-7d97-4cae-ae1f-dfc77ce25422 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:59.646355 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 119/233] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:09:59 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:09:59.652407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7405b34-5462-4ffe-8807-7295df139793 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:09:59.769231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7405b34-5462-4ffe-8807-7295df139793 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:09:59.812741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddd8f1-fe06-4de2-b017-d181b2b65a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:09:59.813455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddd8f1-fe06-4de2-b017-d181b2b65a7e None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:09:59.813742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddd8f1-fe06-4de2-b017-d181b2b65a7e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:09:59.814030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddd8f1-fe06-4de2-b017-d181b2b65a7e None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd/users/a64877decf83416f8bf0286bf1666e89/roles/066bc2c3c4ad43baaa2e35afdba859e5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:09:59.816319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddd8f1-fe06-4de2-b017-d181b2b65a7e None admin] RBAC: Authorizing `identity:create_grant(project_id=04786f98561745b7b9db0c5057cb24fd, user_id=a64877decf83416f8bf0286bf1666e89, role_id=066bc2c3c4ad43baaa2e35afdba859e5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:09:59.817829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddd8f1-fe06-4de2-b017-d181b2b65a7e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:09:59.834313 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 115/234] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:09:59 2022] PUT /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd/users/a64877decf83416f8bf0286bf1666e89/roles/066bc2c3c4ad43baaa2e35afdba859e5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:00.070169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5664d4-f356-416d-b82a-f27ff3a7bbbe None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:00.070671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5664d4-f356-416d-b82a-f27ff3a7bbbe None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:00.070671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5664d4-f356-416d-b82a-f27ff3a7bbbe None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:00.072264 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 120/235] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:00.079710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3886-097e-4cca-9fb6-fee87d1dd160 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:00.080001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3886-097e-4cca-9fb6-fee87d1dd160 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:00.080266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3886-097e-4cca-9fb6-fee87d1dd160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:00.102017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0d2c3886-097e-4cca-9fb6-fee87d1dd160 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:00.103293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0d2c3886-097e-4cca-9fb6-fee87d1dd160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:00.156257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:00.191237 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 116/236] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:00.222616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c761815-9296-45fd-829c-84e4fd80523a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:00.222924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c761815-9296-45fd-829c-84e4fd80523a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:00.223170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c761815-9296-45fd-829c-84e4fd80523a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:00.224563 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 121/237] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:00.230361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012369e-a610-47a1-b794-6aa2d053a345 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:00.230656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012369e-a610-47a1-b794-6aa2d053a345 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:00.230914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012369e-a610-47a1-b794-6aa2d053a345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:00.258571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9012369e-a610-47a1-b794-6aa2d053a345 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:00.259830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9012369e-a610-47a1-b794-6aa2d053a345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:00.354959 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 117/238] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:00.541964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2fe08-8a43-4256-b21f-686222cf4cd0 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:00.542250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2fe08-8a43-4256-b21f-686222cf4cd0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:00.542530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2fe08-8a43-4256-b21f-686222cf4cd0 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:00.544205 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 122/239] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:00.549880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b5d0-a631-4a2c-b63d-49cc071a3a84 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:00.550173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b5d0-a631-4a2c-b63d-49cc071a3a84 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:00.550455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b5d0-a631-4a2c-b63d-49cc071a3a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:00.564775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2fe08-8a43-4256-b21f-686222cf4cd0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:00.580096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dc97b5d0-a631-4a2c-b63d-49cc071a3a84 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:00.581300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc97b5d0-a631-4a2c-b63d-49cc071a3a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:00.685106 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 118/240] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:00.690531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:00.710181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b5d0-a631-4a2c-b63d-49cc071a3a84 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:00.757562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:00.771200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2fe08-8a43-4256-b21f-686222cf4cd0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:00.807901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c956eab-1940-4da5-bd61-2b19ed874c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:00.808932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956eab-1940-4da5-bd61-2b19ed874c9e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:00.809985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956eab-1940-4da5-bd61-2b19ed874c9e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:00.810461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956eab-1940-4da5-bd61-2b19ed874c9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:00.821490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c956eab-1940-4da5-bd61-2b19ed874c9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-9c956eab-1940-4da5-bd61-2b19ed874c9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:00.827248 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:00.828164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:00.828967 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:00.829612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b5d0-a631-4a2c-b63d-49cc071a3a84 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:00.831403 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 123/241] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:00.839368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c956eab-1940-4da5-bd61-2b19ed874c9e None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:00.871872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f936b-94c5-42e3-a984-c0d6b68aa3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:00.872542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f936b-94c5-42e3-a984-c0d6b68aa3ff None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:00.872823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f936b-94c5-42e3-a984-c0d6b68aa3ff None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:00.873141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f936b-94c5-42e3-a984-c0d6b68aa3ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:00.874300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f936b-94c5-42e3-a984-c0d6b68aa3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:00.875861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f936b-94c5-42e3-a984-c0d6b68aa3ff None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:00.877505 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 119/242] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:00.889278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f936b-94c5-42e3-a984-c0d6b68aa3ff None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:01.010552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f936b-94c5-42e3-a984-c0d6b68aa3ff None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:01.023275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:01.039596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c956eab-1940-4da5-bd61-2b19ed874c9e None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:01.058308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01f824-73b7-4f48-b8cd-ee31d474d74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:01.059043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f824-73b7-4f48-b8cd-ee31d474d74e None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:01.059893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f824-73b7-4f48-b8cd-ee31d474d74e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:01.060203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f824-73b7-4f48-b8cd-ee31d474d74e None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:01.060892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01f824-73b7-4f48-b8cd-ee31d474d74e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:01.062856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01f824-73b7-4f48-b8cd-ee31d474d74e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:01.070137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:01.079835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0f933-ebb0-4bd6-9263-1f85f5f5a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:01.080438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f933-ebb0-4bd6-9263-1f85f5f5a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:01.080718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f933-ebb0-4bd6-9263-1f85f5f5a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:01.081021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f933-ebb0-4bd6-9263-1f85f5f5a1d6 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:01.081739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0f933-ebb0-4bd6-9263-1f85f5f5a1d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:01.082088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0f933-ebb0-4bd6-9263-1f85f5f5a1d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:01.083622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0f933-ebb0-4bd6-9263-1f85f5f5a1d6 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:01.092860 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 120/243] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:10:00 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:10:01.093220 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 124/244] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:01.094436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01f824-73b7-4f48-b8cd-ee31d474d74e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:01.103529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0f933-ebb0-4bd6-9263-1f85f5f5a1d6 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:01.218142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01f824-73b7-4f48-b8cd-ee31d474d74e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:01.244959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0f933-ebb0-4bd6-9263-1f85f5f5a1d6 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:01.260504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a95e-91a4-4e06-b2fe-8798d8318ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:01.261747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a95e-91a4-4e06-b2fe-8798d8318ab3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:01.262372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a95e-91a4-4e06-b2fe-8798d8318ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:01.262842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a95e-91a4-4e06-b2fe-8798d8318ab3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:01.275992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a95e-91a4-4e06-b2fe-8798d8318ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-c287a95e-91a4-4e06-b2fe-8798d8318ab3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:01.282688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:01.283695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:01.284554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:01.286942 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 121/245] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:01.287664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35c13-1942-4f0d-a8fc-c4f3f1f686a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:01.288474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35c13-1942-4f0d-a8fc-c4f3f1f686a4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:01.288820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35c13-1942-4f0d-a8fc-c4f3f1f686a4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:01.289168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35c13-1942-4f0d-a8fc-c4f3f1f686a4 None admin] PATH_INFO: `/v3/users/202a88467be64102b3c1095c530d1138` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:01.298585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a95e-91a4-4e06-b2fe-8798d8318ab3 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:01.306135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35c13-1942-4f0d-a8fc-c4f3f1f686a4 None admin] RBAC: Authorizing `identity:get_user(user_id=202a88467be64102b3c1095c530d1138)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:01.307744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35c13-1942-4f0d-a8fc-c4f3f1f686a4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:01.310469 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 125/246] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:01 2022] GET /identity/v3/users/202a88467be64102b3c1095c530d1138 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:01.316470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35c13-1942-4f0d-a8fc-c4f3f1f686a4 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:01.329281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:01.380082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:01.424767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a95e-91a4-4e06-b2fe-8798d8318ab3 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:01.463666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb38be-cebd-4e5e-a247-62088cc68e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:01.464588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb38be-cebd-4e5e-a247-62088cc68e5e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:01.465103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb38be-cebd-4e5e-a247-62088cc68e5e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:01.465617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb38be-cebd-4e5e-a247-62088cc68e5e None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:01.466595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb38be-cebd-4e5e-a247-62088cc68e5e None admin] RBAC: Adding query filter params (name=member) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:01.467868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb38be-cebd-4e5e-a247-62088cc68e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:01.469597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb38be-cebd-4e5e-a247-62088cc68e5e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:01.479299 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 122/247] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:01.488547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb38be-cebd-4e5e-a247-62088cc68e5e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:01.499919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35c13-1942-4f0d-a8fc-c4f3f1f686a4 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:01.554504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120db18-a876-417a-b93d-8ce76ad880bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:01.555462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120db18-a876-417a-b93d-8ce76ad880bd None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:01.555948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120db18-a876-417a-b93d-8ce76ad880bd None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:01.556440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120db18-a876-417a-b93d-8ce76ad880bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:01.628973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb38be-cebd-4e5e-a247-62088cc68e5e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:01.654222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:01.660053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120db18-a876-417a-b93d-8ce76ad880bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:01.662320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120db18-a876-417a-b93d-8ce76ad880bd None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:01.670545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285677e6-186a-4f97-a085-bcb0cb68deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:01.671185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285677e6-186a-4f97-a085-bcb0cb68deaa None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:01.671464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285677e6-186a-4f97-a085-bcb0cb68deaa None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:01.671775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285677e6-186a-4f97-a085-bcb0cb68deaa None admin] PATH_INFO: `/v3/users/f80368cb126b442eab45fb953612dd8a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:01.672944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285677e6-186a-4f97-a085-bcb0cb68deaa None admin] RBAC: Authorizing `identity:get_user(user_id=f80368cb126b442eab45fb953612dd8a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:01.674649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285677e6-186a-4f97-a085-bcb0cb68deaa None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:01.681092 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 123/248] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:01 2022] GET /identity/v3/users/f80368cb126b442eab45fb953612dd8a => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:01.682574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285677e6-186a-4f97-a085-bcb0cb68deaa None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:01.737082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:01.815434 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 126/249] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:10:01.823435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120db18-a876-417a-b93d-8ce76ad880bd None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:01.831573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285677e6-186a-4f97-a085-bcb0cb68deaa None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:01.897012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7663a-e311-4774-982e-ccf21e73f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:01.898382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7663a-e311-4774-982e-ccf21e73f1a7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:01.898830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7663a-e311-4774-982e-ccf21e73f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:01.899460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7663a-e311-4774-982e-ccf21e73f1a7 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:01.901771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7663a-e311-4774-982e-ccf21e73f1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:01.903652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7663a-e311-4774-982e-ccf21e73f1a7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:01.906545 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 124/250] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:01 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:01.913457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7663a-e311-4774-982e-ccf21e73f1a7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:01.945270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:01.970262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120db18-a876-417a-b93d-8ce76ad880bd None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:02.036178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3fc69-2d1f-4390-b1f9-d23279ce5800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:02.036827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3fc69-2d1f-4390-b1f9-d23279ce5800 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:02.037103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3fc69-2d1f-4390-b1f9-d23279ce5800 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:02.041790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3fc69-2d1f-4390-b1f9-d23279ce5800 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:02.043161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3fc69-2d1f-4390-b1f9-d23279ce5800 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:02.045498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3fc69-2d1f-4390-b1f9-d23279ce5800 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:02.049730 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 127/251] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:01 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:02.053514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3fc69-2d1f-4390-b1f9-d23279ce5800 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:02.088402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:02.100023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7663a-e311-4774-982e-ccf21e73f1a7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:02.166167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e368b-1812-460c-8de0-083b6bf2ce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:02.166844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e368b-1812-460c-8de0-083b6bf2ce1e None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:02.167124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e368b-1812-460c-8de0-083b6bf2ce1e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:02.167396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e368b-1812-460c-8de0-083b6bf2ce1e None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd/users/f80368cb126b442eab45fb953612dd8a/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:02.171329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e368b-1812-460c-8de0-083b6bf2ce1e None admin] RBAC: Authorizing `identity:create_grant(project_id=04786f98561745b7b9db0c5057cb24fd, user_id=f80368cb126b442eab45fb953612dd8a, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:02.172789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e368b-1812-460c-8de0-083b6bf2ce1e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:02.201577 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 125/252] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:10:01 2022] PUT /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd/users/f80368cb126b442eab45fb953612dd8a/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:02.203177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5e72-cfb8-4dc1-a036-a61aa0a0922c None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:02.203476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5e72-cfb8-4dc1-a036-a61aa0a0922c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:02.203727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5e72-cfb8-4dc1-a036-a61aa0a0922c None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:02.205138 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 126/253] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:02.215532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ada3-fd91-42bb-ba80-79f5dae17892 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:02.215913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ada3-fd91-42bb-ba80-79f5dae17892 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:02.216128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ada3-fd91-42bb-ba80-79f5dae17892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:02.237368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8de6ada3-fd91-42bb-ba80-79f5dae17892 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:02.238981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8de6ada3-fd91-42bb-ba80-79f5dae17892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:02.269720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3fc69-2d1f-4390-b1f9-d23279ce5800 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:02.345030 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 127/254] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:02.352258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07778cf3-f6d3-4169-b65b-9794df2f9417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:02.353558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778cf3-f6d3-4169-b65b-9794df2f9417 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:02.354183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778cf3-f6d3-4169-b65b-9794df2f9417 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:02.354796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778cf3-f6d3-4169-b65b-9794df2f9417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:02.356948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07778cf3-f6d3-4169-b65b-9794df2f9417 None admin] RBAC: Adding query filter params (role.id=dcca49656a484f299d30879c98961cd9, scope.project.id=04786f98561745b7b9db0c5057cb24fd, user.id=202a88467be64102b3c1095c530d1138) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:02.357700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07778cf3-f6d3-4169-b65b-9794df2f9417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:02.360589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07778cf3-f6d3-4169-b65b-9794df2f9417 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:02.372354 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 128/255] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:02 2022] GET /identity/v3/role_assignments?user.id=202a88467be64102b3c1095c530d1138&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=dcca49656a484f299d30879c98961cd9 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:02.717706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac09cd-a70b-442d-8f1f-ef6d8e80e20b None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:02.718139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac09cd-a70b-442d-8f1f-ef6d8e80e20b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:02.718638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac09cd-a70b-442d-8f1f-ef6d8e80e20b None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:02.721484 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 128/256] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:02.731348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8b5fb-ece2-4aaf-a48d-8d9daf9f5d21 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:02.731855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8b5fb-ece2-4aaf-a48d-8d9daf9f5d21 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:02.732352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8b5fb-ece2-4aaf-a48d-8d9daf9f5d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:02.735500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac09cd-a70b-442d-8f1f-ef6d8e80e20b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:02.753752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:02.817046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d6c8b5fb-ece2-4aaf-a48d-8d9daf9f5d21 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:02.819138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d6c8b5fb-ece2-4aaf-a48d-8d9daf9f5d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:02.981510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 129/257] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:03.079285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac09cd-a70b-442d-8f1f-ef6d8e80e20b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:03.166991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc93f2c-9fdd-4b80-801b-aa52661a24bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:03.168044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc93f2c-9fdd-4b80-801b-aa52661a24bc None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:03.168598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc93f2c-9fdd-4b80-801b-aa52661a24bc None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:03.169681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc93f2c-9fdd-4b80-801b-aa52661a24bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:03.194087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc93f2c-9fdd-4b80-801b-aa52661a24bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-afc93f2c-9fdd-4b80-801b-aa52661a24bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:03.205361 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:03.206348 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:10:03.207176 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:03.207804 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 129/258] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:10:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:03.214562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8b5fb-ece2-4aaf-a48d-8d9daf9f5d21 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:03.240107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:03.353080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8b5fb-ece2-4aaf-a48d-8d9daf9f5d21 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:03.394503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaaf70-9511-470d-be60-a12180d78857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:03.395129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaaf70-9511-470d-be60-a12180d78857 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:03.395413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaaf70-9511-470d-be60-a12180d78857 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:03.395683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaaf70-9511-470d-be60-a12180d78857 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:03.396366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaaf70-9511-470d-be60-a12180d78857 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:03.396670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaaf70-9511-470d-be60-a12180d78857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:03.398089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaaf70-9511-470d-be60-a12180d78857 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:03.408222 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 130/259] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:03.414523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc93f2c-9fdd-4b80-801b-aa52661a24bc None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:03.585649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaaf70-9511-470d-be60-a12180d78857 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:03.591418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:03.671487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc93f2c-9fdd-4b80-801b-aa52661a24bc None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:03.692122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:03.731669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaaf70-9511-470d-be60-a12180d78857 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:03.752135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cd2f0-34f1-4f94-9ed2-029ba85e4343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:03.753231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cd2f0-34f1-4f94-9ed2-029ba85e4343 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:03.753749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cd2f0-34f1-4f94-9ed2-029ba85e4343 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:03.754223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cd2f0-34f1-4f94-9ed2-029ba85e4343 None admin] PATH_INFO: `/v3/users/a64877decf83416f8bf0286bf1666e89` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:03.756337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cd2f0-34f1-4f94-9ed2-029ba85e4343 None admin] RBAC: Authorizing `identity:get_user(user_id=a64877decf83416f8bf0286bf1666e89)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:03.759035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cd2f0-34f1-4f94-9ed2-029ba85e4343 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:03.762346 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 130/260] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:03 2022] GET /identity/v3/users/a64877decf83416f8bf0286bf1666e89 => generated 283 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:03.770325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cd2f0-34f1-4f94-9ed2-029ba85e4343 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:03.778872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cedf78-53ed-41fe-b296-dff4d82cf5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:03.780125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cedf78-53ed-41fe-b296-dff4d82cf5b7 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:03.780748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cedf78-53ed-41fe-b296-dff4d82cf5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:03.781805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cedf78-53ed-41fe-b296-dff4d82cf5b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:03.814396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cedf78-53ed-41fe-b296-dff4d82cf5b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-31cedf78-53ed-41fe-b296-dff4d82cf5b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:03.826997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:03.828667 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:03.831221 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 131/261] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:10:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:03.835301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cedf78-53ed-41fe-b296-dff4d82cf5b7 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:03.962543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cd2f0-34f1-4f94-9ed2-029ba85e4343 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:04.103478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576664d-74cd-4244-9387-a9cccf7a593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:04.104404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576664d-74cd-4244-9387-a9cccf7a593d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:04.104821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576664d-74cd-4244-9387-a9cccf7a593d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:04.105291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576664d-74cd-4244-9387-a9cccf7a593d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:04.125887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cedf78-53ed-41fe-b296-dff4d82cf5b7 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:04.131422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:04.242477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:04.279111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bedff-84a3-42d4-88c5-df3271735c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:04.280160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bedff-84a3-42d4-88c5-df3271735c2e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:04.280687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bedff-84a3-42d4-88c5-df3271735c2e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:04.281170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bedff-84a3-42d4-88c5-df3271735c2e None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:04.282134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bedff-84a3-42d4-88c5-df3271735c2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:04.282655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bedff-84a3-42d4-88c5-df3271735c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:04.284306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bedff-84a3-42d4-88c5-df3271735c2e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:04.292003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576664d-74cd-4244-9387-a9cccf7a593d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:04.304310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576664d-74cd-4244-9387-a9cccf7a593d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:04.306776 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 132/262] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:04.313153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bedff-84a3-42d4-88c5-df3271735c2e None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:04.527075 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 131/263] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:04.534106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576664d-74cd-4244-9387-a9cccf7a593d None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:04.599151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bedff-84a3-42d4-88c5-df3271735c2e None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:04.619963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:04.692542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58db04b-e8bc-44ca-9bb7-45983518c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:04.693479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58db04b-e8bc-44ca-9bb7-45983518c491 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:04.693764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58db04b-e8bc-44ca-9bb7-45983518c491 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:04.694038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58db04b-e8bc-44ca-9bb7-45983518c491 None admin] PATH_INFO: `/v3/users/a64877decf83416f8bf0286bf1666e89` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:04.699639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58db04b-e8bc-44ca-9bb7-45983518c491 None admin] RBAC: Authorizing `identity:get_user(user_id=a64877decf83416f8bf0286bf1666e89)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:04.701844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58db04b-e8bc-44ca-9bb7-45983518c491 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:04.709832 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 133/264] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:04 2022] GET /identity/v3/users/a64877decf83416f8bf0286bf1666e89 => generated 283 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:04.719902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58db04b-e8bc-44ca-9bb7-45983518c491 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:04.790846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576664d-74cd-4244-9387-a9cccf7a593d None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:04.877275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:04.878268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9fbcd-0262-4310-8443-90d84a54dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:04.879162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9fbcd-0262-4310-8443-90d84a54dd48 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:04.879465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9fbcd-0262-4310-8443-90d84a54dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:04.879739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9fbcd-0262-4310-8443-90d84a54dd48 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:04.880982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9fbcd-0262-4310-8443-90d84a54dd48 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:04.882615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9fbcd-0262-4310-8443-90d84a54dd48 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:04.890973 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 132/265] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:04 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:04.892530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960479b4-5bfc-4154-a7d4-3a3a8e5a5fad None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:04.892838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960479b4-5bfc-4154-a7d4-3a3a8e5a5fad None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:04.893155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960479b4-5bfc-4154-a7d4-3a3a8e5a5fad None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:04.900170 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 133/266] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:04.902577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363c2b0-e874-43aa-b657-6bc6aedd939c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:04.902908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363c2b0-e874-43aa-b657-6bc6aedd939c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:04.903388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363c2b0-e874-43aa-b657-6bc6aedd939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:04.922775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58db04b-e8bc-44ca-9bb7-45983518c491 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:04.936550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9363c2b0-e874-43aa-b657-6bc6aedd939c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:04.938057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9363c2b0-e874-43aa-b657-6bc6aedd939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:04.974177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc99cf-b827-4db1-a977-c3683985cc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:04.974819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc99cf-b827-4db1-a977-c3683985cc02 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:04.975105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc99cf-b827-4db1-a977-c3683985cc02 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:04.975386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc99cf-b827-4db1-a977-c3683985cc02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:05.029564 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 134/267] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:05.030417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363c2b0-e874-43aa-b657-6bc6aedd939c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:05.052144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc99cf-b827-4db1-a977-c3683985cc02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:05.055017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc99cf-b827-4db1-a977-c3683985cc02 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:05.083198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:05.122920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:05.159590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363c2b0-e874-43aa-b657-6bc6aedd939c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:05.169529 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 134/268] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:05.175784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc99cf-b827-4db1-a977-c3683985cc02 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:05.211132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad84c99-92d0-4134-815c-58603e94ab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:05.211543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84c99-92d0-4134-815c-58603e94ab4d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:05.211887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84c99-92d0-4134-815c-58603e94ab4d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:05.212229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84c99-92d0-4134-815c-58603e94ab4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:05.212993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad84c99-92d0-4134-815c-58603e94ab4d None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=04786f98561745b7b9db0c5057cb24fd, user.id=a64877decf83416f8bf0286bf1666e89) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:05.213366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad84c99-92d0-4134-815c-58603e94ab4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:05.214914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad84c99-92d0-4134-815c-58603e94ab4d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:05.225265 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 135/269] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:05 2022] GET /identity/v3/role_assignments?user.id=a64877decf83416f8bf0286bf1666e89&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=be89abac608f45a6921181bcc574f721 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:05.237432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad068c7-d512-4874-a4d0-11a94a1c1f5c None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:05.238121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad068c7-d512-4874-a4d0-11a94a1c1f5c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:05.240202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad068c7-d512-4874-a4d0-11a94a1c1f5c None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:05.242736 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 136/270] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:05.253908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016b343-6ce8-4801-8c29-6ec7c1bd556c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:05.254492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016b343-6ce8-4801-8c29-6ec7c1bd556c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:05.254910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016b343-6ce8-4801-8c29-6ec7c1bd556c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:05.295351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2016b343-6ce8-4801-8c29-6ec7c1bd556c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:05.298207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2016b343-6ce8-4801-8c29-6ec7c1bd556c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:05.397879 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 137/271] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:05.418470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc99cf-b827-4db1-a977-c3683985cc02 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:05.507256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6be146-5d44-49be-8300-0465d8ac8951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:05.508226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6be146-5d44-49be-8300-0465d8ac8951 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:05.508549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6be146-5d44-49be-8300-0465d8ac8951 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:05.509001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6be146-5d44-49be-8300-0465d8ac8951 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:05.514632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6be146-5d44-49be-8300-0465d8ac8951 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:05.517473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6be146-5d44-49be-8300-0465d8ac8951 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:05.521227 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 135/272] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:05 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:05.527257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016b343-6ce8-4801-8c29-6ec7c1bd556c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:05.591054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:05.597332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6be146-5d44-49be-8300-0465d8ac8951 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:05.662049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:05.703849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016b343-6ce8-4801-8c29-6ec7c1bd556c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:05.744926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04142225-44f2-4f4b-989f-d0049ca11727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:05.745876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142225-44f2-4f4b-989f-d0049ca11727 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:05.746349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142225-44f2-4f4b-989f-d0049ca11727 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:05.746893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142225-44f2-4f4b-989f-d0049ca11727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:05.748336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04142225-44f2-4f4b-989f-d0049ca11727 None admin] RBAC: Adding query filter params (role.id=066bc2c3c4ad43baaa2e35afdba859e5, scope.project.id=04786f98561745b7b9db0c5057cb24fd, user.id=a64877decf83416f8bf0286bf1666e89) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:05.748872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04142225-44f2-4f4b-989f-d0049ca11727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:05.751323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04142225-44f2-4f4b-989f-d0049ca11727 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:05.761082 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 138/273] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:05 2022] GET /identity/v3/role_assignments?user.id=a64877decf83416f8bf0286bf1666e89&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=066bc2c3c4ad43baaa2e35afdba859e5 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:05.798050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04142225-44f2-4f4b-989f-d0049ca11727 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:05.865443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6be146-5d44-49be-8300-0465d8ac8951 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:05.914362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16fb91-d4c3-49be-86e7-f445f25951fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:05.914939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16fb91-d4c3-49be-86e7-f445f25951fd None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:05.915224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16fb91-d4c3-49be-86e7-f445f25951fd None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:05.915502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16fb91-d4c3-49be-86e7-f445f25951fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:05.930937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16fb91-d4c3-49be-86e7-f445f25951fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-4d16fb91-d4c3-49be-86e7-f445f25951fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:05.938234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:05.939209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:05.940009 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 136/274] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:05.941172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d108e3-2fac-4051-82b7-c9c714928cd0 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:05.945715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d108e3-2fac-4051-82b7-c9c714928cd0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:05.945715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d108e3-2fac-4051-82b7-c9c714928cd0 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:05.945715 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 137/275] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:05.945715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8f22-d195-41c6-bceb-3baf099e6ecc None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:05.945715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8f22-d195-41c6-bceb-3baf099e6ecc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:05.945715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8f22-d195-41c6-bceb-3baf099e6ecc None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:05.953277 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 138/276] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:05.955444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c8f22-d195-41c6-bceb-3baf099e6ecc None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:05.989677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:06.001659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04142225-44f2-4f4b-989f-d0049ca11727 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:06.051650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa38888-a9b4-48fa-9294-fe0e0e6f1f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:06.052486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa38888-a9b4-48fa-9294-fe0e0e6f1f9f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:06.052902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa38888-a9b4-48fa-9294-fe0e0e6f1f9f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:06.053249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa38888-a9b4-48fa-9294-fe0e0e6f1f9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:06.054639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa38888-a9b4-48fa-9294-fe0e0e6f1f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:06.056326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa38888-a9b4-48fa-9294-fe0e0e6f1f9f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:06.058547 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 139/277] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:06.060920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bbfab-00b5-448c-91c5-95cb97f0477c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:06.060920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bbfab-00b5-448c-91c5-95cb97f0477c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:06.060920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bbfab-00b5-448c-91c5-95cb97f0477c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:06.081312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:06.082329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-da8bbfab-00b5-448c-91c5-95cb97f0477c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:06.083736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-da8bbfab-00b5-448c-91c5-95cb97f0477c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:06.102257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c8f22-d195-41c6-bceb-3baf099e6ecc None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:06.142317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3faf-4644-4947-8886-95b083009819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:06.143199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3faf-4644-4947-8886-95b083009819 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:06.143668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3faf-4644-4947-8886-95b083009819 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:06.143956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3faf-4644-4947-8886-95b083009819 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:06.144928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3faf-4644-4947-8886-95b083009819 None admin] RBAC: Adding query filter params (name=member) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:06.145446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3faf-4644-4947-8886-95b083009819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:06.147271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3faf-4644-4947-8886-95b083009819 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:06.159987 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 139/278] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:06.162154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0cf9-4919-4112-8f38-dfae46581701 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:06.162577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0cf9-4919-4112-8f38-dfae46581701 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:06.162917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0cf9-4919-4112-8f38-dfae46581701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:06.189498 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 140/279] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:06.189498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bbfab-00b5-448c-91c5-95cb97f0477c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:06.190094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-32ab0cf9-4919-4112-8f38-dfae46581701 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:06.190094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-32ab0cf9-4919-4112-8f38-dfae46581701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:06.303349 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 140/280] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:06.305375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab0cf9-4919-4112-8f38-dfae46581701 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:06.344350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:06.362183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bbfab-00b5-448c-91c5-95cb97f0477c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:06.427944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cd257-db00-432a-9feb-f94a0787db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:06.429141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cd257-db00-432a-9feb-f94a0787db9c None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:06.430519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cd257-db00-432a-9feb-f94a0787db9c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:06.431149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cd257-db00-432a-9feb-f94a0787db9c None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:06.432131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cd257-db00-432a-9feb-f94a0787db9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:06.434908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cd257-db00-432a-9feb-f94a0787db9c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:06.439097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:06.467762 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 141/281] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:10:06 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:10:06.468326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab0cf9-4919-4112-8f38-dfae46581701 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:06.469919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cd257-db00-432a-9feb-f94a0787db9c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:06.538395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe9d97-f49f-4b1f-8059-d8a09ff69542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:06.539303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe9d97-f49f-4b1f-8059-d8a09ff69542 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:06.539626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe9d97-f49f-4b1f-8059-d8a09ff69542 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:06.540031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe9d97-f49f-4b1f-8059-d8a09ff69542 None admin] PATH_INFO: `/v3/users/916627c18f5040dfbb5870025b3a1290` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:06.563228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe9d97-f49f-4b1f-8059-d8a09ff69542 None admin] RBAC: Authorizing `identity:get_user(user_id=916627c18f5040dfbb5870025b3a1290)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:06.566021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe9d97-f49f-4b1f-8059-d8a09ff69542 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:06.568989 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 141/282] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:06 2022] GET /identity/v3/users/916627c18f5040dfbb5870025b3a1290 => generated 293 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:06.579108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe9d97-f49f-4b1f-8059-d8a09ff69542 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:06.650427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cd257-db00-432a-9feb-f94a0787db9c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:06.702946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906f758-147f-46e8-bef5-01878ee9677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:06.704735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906f758-147f-46e8-bef5-01878ee9677b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:06.704855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906f758-147f-46e8-bef5-01878ee9677b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:06.708097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906f758-147f-46e8-bef5-01878ee9677b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:06.720233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906f758-147f-46e8-bef5-01878ee9677b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-2906f758-147f-46e8-bef5-01878ee9677b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:06.726197 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:06.727289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:06.728126 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 142/283] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:06.728797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906f758-147f-46e8-bef5-01878ee9677b None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:06.743154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:06.746637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe9d97-f49f-4b1f-8059-d8a09ff69542 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:06.795633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de3ceb-191c-4a1d-8a6a-e552c09ac401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:06.796833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de3ceb-191c-4a1d-8a6a-e552c09ac401 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:06.797706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de3ceb-191c-4a1d-8a6a-e552c09ac401 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:06.797706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de3ceb-191c-4a1d-8a6a-e552c09ac401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:06.798867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de3ceb-191c-4a1d-8a6a-e552c09ac401 None admin] RBAC: Adding query filter params (role.id=0aaef5fae9d1491bb3548a12be30bd2d, user.id=916627c18f5040dfbb5870025b3a1290, scope.system=all) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:06.799426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de3ceb-191c-4a1d-8a6a-e552c09ac401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:06.801586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de3ceb-191c-4a1d-8a6a-e552c09ac401 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:06.810897 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 142/284] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Aug 29 15:10:06 2022] GET /identity/v3/role_assignments?user.id=916627c18f5040dfbb5870025b3a1290&scope.system=all&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:06.812113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de3ceb-191c-4a1d-8a6a-e552c09ac401 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:06.816271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:06.905887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906f758-147f-46e8-bef5-01878ee9677b None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:06.966585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64574c-bac4-461b-8fd1-eabe8e6710b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:06.967697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64574c-bac4-461b-8fd1-eabe8e6710b3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:06.968498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64574c-bac4-461b-8fd1-eabe8e6710b3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:06.968762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64574c-bac4-461b-8fd1-eabe8e6710b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:06.972624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de3ceb-191c-4a1d-8a6a-e552c09ac401 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:07.000727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64574c-bac4-461b-8fd1-eabe8e6710b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-9d64574c-bac4-461b-8fd1-eabe8e6710b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:07.011545 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:07.013153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:07.013996 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:07.014932 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 143/285] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:07.020499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64574c-bac4-461b-8fd1-eabe8e6710b3 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:07.027249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015e67c-e30f-4923-8894-d4ed90615021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:07.028215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e67c-e30f-4923-8894-d4ed90615021 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:07.028733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e67c-e30f-4923-8894-d4ed90615021 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:07.030565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e67c-e30f-4923-8894-d4ed90615021 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:07.031658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015e67c-e30f-4923-8894-d4ed90615021 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:07.032155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015e67c-e30f-4923-8894-d4ed90615021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:07.034434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015e67c-e30f-4923-8894-d4ed90615021 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:07.049796 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 143/286] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:07.052268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015e67c-e30f-4923-8894-d4ed90615021 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:07.133873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:07.152246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:07.213513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64574c-bac4-461b-8fd1-eabe8e6710b3 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:07.228679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015e67c-e30f-4923-8894-d4ed90615021 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:07.289153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c45ce-8a78-44d8-8c6e-761fdd71fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:07.290396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c45ce-8a78-44d8-8c6e-761fdd71fdab None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:07.291301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c45ce-8a78-44d8-8c6e-761fdd71fdab None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:07.292504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c45ce-8a78-44d8-8c6e-761fdd71fdab None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:07.294539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c45ce-8a78-44d8-8c6e-761fdd71fdab None admin] RBAC: Adding query filter params (name=member) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:07.295595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c45ce-8a78-44d8-8c6e-761fdd71fdab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:07.297812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c45ce-8a78-44d8-8c6e-761fdd71fdab None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:07.304556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5e5e7-b988-4c1c-bdf1-abae6128ffa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:07.305851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e5e7-b988-4c1c-bdf1-abae6128ffa4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:07.306357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e5e7-b988-4c1c-bdf1-abae6128ffa4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:07.306893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e5e7-b988-4c1c-bdf1-abae6128ffa4 None admin] PATH_INFO: `/v3/users/202a88467be64102b3c1095c530d1138` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:07.312876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5e5e7-b988-4c1c-bdf1-abae6128ffa4 None admin] RBAC: Authorizing `identity:get_user(user_id=202a88467be64102b3c1095c530d1138)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:07.315072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5e5e7-b988-4c1c-bdf1-abae6128ffa4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:07.317304 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 144/288] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:07.317449 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 144/288] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:07 2022] GET /identity/v3/users/202a88467be64102b3c1095c530d1138 => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:07.326783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5e5e7-b988-4c1c-bdf1-abae6128ffa4 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:07.328159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c45ce-8a78-44d8-8c6e-761fdd71fdab None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:07.504487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c45ce-8a78-44d8-8c6e-761fdd71fdab None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:07.545003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:07.555934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c780-3be3-41f1-9cbd-d214a658614c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:07.556887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c780-3be3-41f1-9cbd-d214a658614c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:07.557999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c780-3be3-41f1-9cbd-d214a658614c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:07.558283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c780-3be3-41f1-9cbd-d214a658614c None admin] PATH_INFO: `/v3/users/f80368cb126b442eab45fb953612dd8a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:07.560267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c780-3be3-41f1-9cbd-d214a658614c None admin] RBAC: Authorizing `identity:get_user(user_id=f80368cb126b442eab45fb953612dd8a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:07.561850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c780-3be3-41f1-9cbd-d214a658614c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:07.563862 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 145/289] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:07 2022] GET /identity/v3/users/f80368cb126b442eab45fb953612dd8a => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:07.569599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c780-3be3-41f1-9cbd-d214a658614c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:07.588164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5e5e7-b988-4c1c-bdf1-abae6128ffa4 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:07.664386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1957-9263-4cb0-addc-3343199b9fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:07.665170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1957-9263-4cb0-addc-3343199b9fe8 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:07.665564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1957-9263-4cb0-addc-3343199b9fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:07.665864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1957-9263-4cb0-addc-3343199b9fe8 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:07.669825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd1957-9263-4cb0-addc-3343199b9fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:07.671283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd1957-9263-4cb0-addc-3343199b9fe8 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:07.675752 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 145/290] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:07 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:07.682503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1957-9263-4cb0-addc-3343199b9fe8 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:07.686354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:07.752696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c780-3be3-41f1-9cbd-d214a658614c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:07.826049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251b0f7-1af4-4792-9f3f-ae7e34a14db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:07.826658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251b0f7-1af4-4792-9f3f-ae7e34a14db8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:07.826944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251b0f7-1af4-4792-9f3f-ae7e34a14db8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:07.827261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251b0f7-1af4-4792-9f3f-ae7e34a14db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:07.868721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1957-9263-4cb0-addc-3343199b9fe8 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:07.942702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251b0f7-1af4-4792-9f3f-ae7e34a14db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:07.944200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251b0f7-1af4-4792-9f3f-ae7e34a14db8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:07.948277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf6f8c-c3ce-4375-9b7c-f495ce0ead08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:07.948882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:07.948989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6f8c-c3ce-4375-9b7c-f495ce0ead08 None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:07.949239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6f8c-c3ce-4375-9b7c-f495ce0ead08 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:07.949541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6f8c-c3ce-4375-9b7c-f495ce0ead08 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd/users/202a88467be64102b3c1095c530d1138/roles/dcca49656a484f299d30879c98961cd9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:07.953157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf6f8c-c3ce-4375-9b7c-f495ce0ead08 None admin] RBAC: Authorizing `identity:create_grant(project_id=04786f98561745b7b9db0c5057cb24fd, user_id=202a88467be64102b3c1095c530d1138, role_id=dcca49656a484f299d30879c98961cd9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:07.954658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf6f8c-c3ce-4375-9b7c-f495ce0ead08 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:07.978546 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 146/291] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:10:07 2022] PUT /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd/users/202a88467be64102b3c1095c530d1138/roles/dcca49656a484f299d30879c98961cd9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:10:08.125121 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 146/292] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:10:08.131108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf6f8c-c3ce-4375-9b7c-f495ce0ead08 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:08.232540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:08.288172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf6f8c-c3ce-4375-9b7c-f495ce0ead08 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:08.348385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b92e24-88b3-485e-a56f-8dda241752bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:08.349364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b92e24-88b3-485e-a56f-8dda241752bb None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:08.349736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b92e24-88b3-485e-a56f-8dda241752bb None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:08.350020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b92e24-88b3-485e-a56f-8dda241752bb None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:08.351530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b92e24-88b3-485e-a56f-8dda241752bb None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:08.353699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b92e24-88b3-485e-a56f-8dda241752bb None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:08.356033 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 147/293] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:08 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:08.364735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251b0f7-1af4-4792-9f3f-ae7e34a14db8 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:08.581599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:08.587923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251b0f7-1af4-4792-9f3f-ae7e34a14db8 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:08.648379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac2e56-62f0-43d7-a531-4fae13f8c33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:08.649440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac2e56-62f0-43d7-a531-4fae13f8c33d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:08.649917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac2e56-62f0-43d7-a531-4fae13f8c33d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:08.650405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac2e56-62f0-43d7-a531-4fae13f8c33d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:08.651613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac2e56-62f0-43d7-a531-4fae13f8c33d None admin] RBAC: Adding query filter params (role.id=0aaef5fae9d1491bb3548a12be30bd2d, scope.project.id=04786f98561745b7b9db0c5057cb24fd, user.id=f80368cb126b442eab45fb953612dd8a) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:08.652158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac2e56-62f0-43d7-a531-4fae13f8c33d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:08.653950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac2e56-62f0-43d7-a531-4fae13f8c33d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:08.661555 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 147/294] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:08 2022] GET /identity/v3/role_assignments?user.id=f80368cb126b442eab45fb953612dd8a&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:09.257175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bfc62-a90b-4c8b-87af-5ad52e9c840f None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:09.257723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bfc62-a90b-4c8b-87af-5ad52e9c840f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:09.257800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bfc62-a90b-4c8b-87af-5ad52e9c840f None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:09.259376 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 148/295] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:09.265500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036e80-da00-4d7f-9012-c14d1e94dc08 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:09.265817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036e80-da00-4d7f-9012-c14d1e94dc08 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:09.266065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036e80-da00-4d7f-9012-c14d1e94dc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:09.292003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e8036e80-da00-4d7f-9012-c14d1e94dc08 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:09.293263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e8036e80-da00-4d7f-9012-c14d1e94dc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:09.312576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcb7df-0e18-45f1-be2f-4100b0715c71 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:09.313262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcb7df-0e18-45f1-be2f-4100b0715c71 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:09.313854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcb7df-0e18-45f1-be2f-4100b0715c71 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:09.315637 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 149/296] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:10:09.321984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d9ba7-eb58-453d-b689-90f16d682cfc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:09.322586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d9ba7-eb58-453d-b689-90f16d682cfc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:09.323212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d9ba7-eb58-453d-b689-90f16d682cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:09.360633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2b6d9ba7-eb58-453d-b689-90f16d682cfc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:09.362213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2b6d9ba7-eb58-453d-b689-90f16d682cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:09.387302 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 148/297] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:09.461619 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 150/298] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:09.461823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05310c-52fc-42f6-bdb4-83647463013e None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:09.462061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05310c-52fc-42f6-bdb4-83647463013e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:09.469522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05310c-52fc-42f6-bdb4-83647463013e None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:09.469522 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 149/299] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:10:09.470058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219b19-37dc-43d9-9ffc-45b0161304d9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:09.470346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219b19-37dc-43d9-9ffc-45b0161304d9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:09.470624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219b19-37dc-43d9-9ffc-45b0161304d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:09.494109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-41219b19-37dc-43d9-9ffc-45b0161304d9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:09.496166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-41219b19-37dc-43d9-9ffc-45b0161304d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:09.601876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:09.608176 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 151/300] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:09.708760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05310c-52fc-42f6-bdb4-83647463013e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:09.769220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41219b19-37dc-43d9-9ffc-45b0161304d9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:09.822682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:09.837227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05310c-52fc-42f6-bdb4-83647463013e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:09.879865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370268c-ccb1-48ca-b82b-4115c3230b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:09.880850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370268c-ccb1-48ca-b82b-4115c3230b45 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:09.881314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370268c-ccb1-48ca-b82b-4115c3230b45 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:09.881833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370268c-ccb1-48ca-b82b-4115c3230b45 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:09.896001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370268c-ccb1-48ca-b82b-4115c3230b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-c370268c-ccb1-48ca-b82b-4115c3230b45 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:09.902441 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:09.903554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:09.904484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:09.907234 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 150/301] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:09.913627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370268c-ccb1-48ca-b82b-4115c3230b45 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:09.915334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41219b19-37dc-43d9-9ffc-45b0161304d9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:09.962180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d30e86-f04b-46e0-83d5-c9f200e2518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:09.963026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d30e86-f04b-46e0-83d5-c9f200e2518b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:09.963448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d30e86-f04b-46e0-83d5-c9f200e2518b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:09.963859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d30e86-f04b-46e0-83d5-c9f200e2518b None admin] PATH_INFO: `/v3/domains/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:09.966610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d30e86-f04b-46e0-83d5-c9f200e2518b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:09.968860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d30e86-f04b-46e0-83d5-c9f200e2518b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:09.973558 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 152/302] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:09.978193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d30e86-f04b-46e0-83d5-c9f200e2518b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:10.066722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:10.088135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370268c-ccb1-48ca-b82b-4115c3230b45 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:10.133597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa38215-10a7-4589-ae77-17d4145d3ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:10.135126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa38215-10a7-4589-ae77-17d4145d3ef4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:10.135126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa38215-10a7-4589-ae77-17d4145d3ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:10.135381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa38215-10a7-4589-ae77-17d4145d3ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:10.136502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa38215-10a7-4589-ae77-17d4145d3ef4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:10.137006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa38215-10a7-4589-ae77-17d4145d3ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:10.140061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa38215-10a7-4589-ae77-17d4145d3ef4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:10.155997 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 151/303] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:10.157510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa38215-10a7-4589-ae77-17d4145d3ef4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:10.158010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d30e86-f04b-46e0-83d5-c9f200e2518b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:10.189973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:10.220760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e49d4-2665-4b05-b5e1-fa70c4d4cb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:10.222447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e49d4-2665-4b05-b5e1-fa70c4d4cb50 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:10.222860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e49d4-2665-4b05-b5e1-fa70c4d4cb50 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:10.223174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e49d4-2665-4b05-b5e1-fa70c4d4cb50 None admin] PATH_INFO: `/v3/groups` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:10.224590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e49d4-2665-4b05-b5e1-fa70c4d4cb50 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:10.226481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e49d4-2665-4b05-b5e1-fa70c4d4cb50 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:10.250559 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 153/304] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Aug 29 15:10:09 2022] POST /identity/v3/groups => generated 229 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:10:10.251480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e49d4-2665-4b05-b5e1-fa70c4d4cb50 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:10.335290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa38215-10a7-4589-ae77-17d4145d3ef4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:10.390034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dc8a1-fadb-468f-975b-f552ff1257bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:10.390668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dc8a1-fadb-468f-975b-f552ff1257bd None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:10.390876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dc8a1-fadb-468f-975b-f552ff1257bd None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:10.391318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dc8a1-fadb-468f-975b-f552ff1257bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:10.410718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677dc8a1-fadb-468f-975b-f552ff1257bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-677dc8a1-fadb-468f-975b-f552ff1257bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:10.419642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:10.420961 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:10.421979 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:10.424120 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 152/305] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:10.427260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e49d4-2665-4b05-b5e1-fa70c4d4cb50 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:10.431968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dc8a1-fadb-468f-975b-f552ff1257bd None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:10.466288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:10.498085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5e87-e3fb-46f5-91ae-fddebb11d5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:10.498833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5e87-e3fb-46f5-91ae-fddebb11d5c6 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:10.499114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5e87-e3fb-46f5-91ae-fddebb11d5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:10.499846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5e87-e3fb-46f5-91ae-fddebb11d5c6 None admin] PATH_INFO: `/v3/users/ea5d682499324ca7bf94fa5444b24464` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:10.523058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5e87-e3fb-46f5-91ae-fddebb11d5c6 None admin] RBAC: Authorizing `identity:get_user(user_id=ea5d682499324ca7bf94fa5444b24464)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:10.524683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5e87-e3fb-46f5-91ae-fddebb11d5c6 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:10.527087 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 154/306] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:10 2022] GET /identity/v3/users/ea5d682499324ca7bf94fa5444b24464 => generated 293 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:10.528612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b40490-6879-444e-8f34-635f0a591301 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:10.529058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b40490-6879-444e-8f34-635f0a591301 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:10.529335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b40490-6879-444e-8f34-635f0a591301 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:10.530650 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 155/307] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:10.536192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b40490-6879-444e-8f34-635f0a591301 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:10.542570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:10.571575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dc8a1-fadb-468f-975b-f552ff1257bd None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:10.611440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fc983-8268-4b08-a666-3f15e694487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:10.612050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc983-8268-4b08-a666-3f15e694487d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:10.612322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc983-8268-4b08-a666-3f15e694487d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:10.612585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc983-8268-4b08-a666-3f15e694487d None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:10.613443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fc983-8268-4b08-a666-3f15e694487d None admin] RBAC: Adding query filter params (name=member) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:10.613890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fc983-8268-4b08-a666-3f15e694487d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:10.615422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fc983-8268-4b08-a666-3f15e694487d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:10.625154 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 153/308] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:10.626831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c9e23-c8c8-4818-a242-ad8f7a27315b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:10.627117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c9e23-c8c8-4818-a242-ad8f7a27315b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:10.627387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c9e23-c8c8-4818-a242-ad8f7a27315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:10.648108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-877c9e23-c8c8-4818-a242-ad8f7a27315b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:10.649201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-877c9e23-c8c8-4818-a242-ad8f7a27315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:10.674969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b40490-6879-444e-8f34-635f0a591301 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:10.723734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638dbe5-9594-472a-82f4-c99332f0f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:10.724433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638dbe5-9594-472a-82f4-c99332f0f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:10.724770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638dbe5-9594-472a-82f4-c99332f0f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:10.725180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638dbe5-9594-472a-82f4-c99332f0f3a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:10.726129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638dbe5-9594-472a-82f4-c99332f0f3a2 None admin] RBAC: Adding query filter params (role.id=dcca49656a484f299d30879c98961cd9, user.id=ea5d682499324ca7bf94fa5444b24464, scope.system=all) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:10.726647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638dbe5-9594-472a-82f4-c99332f0f3a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:10.729310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638dbe5-9594-472a-82f4-c99332f0f3a2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:10.731727 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 154/309] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:10.732902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c9e23-c8c8-4818-a242-ad8f7a27315b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:10.753418 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 156/310] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Aug 29 15:10:10 2022] GET /identity/v3/role_assignments?user.id=ea5d682499324ca7bf94fa5444b24464&scope.system=all&role.id=dcca49656a484f299d30879c98961cd9 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:10.834229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:10.876137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c9e23-c8c8-4818-a242-ad8f7a27315b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:10.915828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13589ea1-587d-48d7-933f-b69f6a4d7296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:10.916388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13589ea1-587d-48d7-933f-b69f6a4d7296 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:10.916663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13589ea1-587d-48d7-933f-b69f6a4d7296 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:10.916927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13589ea1-587d-48d7-933f-b69f6a4d7296 None admin] PATH_INFO: `/v3/users/916627c18f5040dfbb5870025b3a1290` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:10.918147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13589ea1-587d-48d7-933f-b69f6a4d7296 None admin] RBAC: Authorizing `identity:get_user(user_id=916627c18f5040dfbb5870025b3a1290)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:10.919630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13589ea1-587d-48d7-933f-b69f6a4d7296 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:10.921438 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 155/311] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:10 2022] GET /identity/v3/users/916627c18f5040dfbb5870025b3a1290 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:10.927198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638dbe5-9594-472a-82f4-c99332f0f3a2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:10.986942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:11.082246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13589ea1-587d-48d7-933f-b69f6a4d7296 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:11.088703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638dbe5-9594-472a-82f4-c99332f0f3a2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:11.130893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88f903-d27d-4329-b6ba-663834a577f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:11.131553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f903-d27d-4329-b6ba-663834a577f8 None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:11.132102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f903-d27d-4329-b6ba-663834a577f8 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:11.132102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f903-d27d-4329-b6ba-663834a577f8 None admin] PATH_INFO: `/v3/system/users/916627c18f5040dfbb5870025b3a1290/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:11.133732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88f903-d27d-4329-b6ba-663834a577f8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=916627c18f5040dfbb5870025b3a1290, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:11.135131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88f903-d27d-4329-b6ba-663834a577f8 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:11.146702 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 157/312] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Aug 29 15:10:10 2022] PUT /identity/v3/system/users/916627c18f5040dfbb5870025b3a1290/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:11.227726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13589ea1-587d-48d7-933f-b69f6a4d7296 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:11.287077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d29a13-08af-45d7-8275-15b3a2c95b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:11.287812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d29a13-08af-45d7-8275-15b3a2c95b8d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:11.288288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d29a13-08af-45d7-8275-15b3a2c95b8d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:11.288627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d29a13-08af-45d7-8275-15b3a2c95b8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:11.291379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:11.307326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d29a13-08af-45d7-8275-15b3a2c95b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-21d29a13-08af-45d7-8275-15b3a2c95b8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:11.313429 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:11.314573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:11.315461 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 156/313] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:11.323453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88f903-d27d-4329-b6ba-663834a577f8 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:11.465027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88f903-d27d-4329-b6ba-663834a577f8 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:11.469978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:11.523018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a7c74-2e39-4448-8cdd-257c0533408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:11.524004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a7c74-2e39-4448-8cdd-257c0533408d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:11.524346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a7c74-2e39-4448-8cdd-257c0533408d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:11.524714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a7c74-2e39-4448-8cdd-257c0533408d None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:11.526121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a7c74-2e39-4448-8cdd-257c0533408d None admin] RBAC: Adding query filter params (name=reader) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:11.526671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a7c74-2e39-4448-8cdd-257c0533408d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:11.529180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a7c74-2e39-4448-8cdd-257c0533408d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:11.549084 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 158/314] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:11.556525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d29a13-08af-45d7-8275-15b3a2c95b8d None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:11.720528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d29a13-08af-45d7-8275-15b3a2c95b8d None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:11.780312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304858f5-c811-4212-9ef3-2989a1d0b332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:11.781264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304858f5-c811-4212-9ef3-2989a1d0b332 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:11.781716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304858f5-c811-4212-9ef3-2989a1d0b332 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:11.782090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304858f5-c811-4212-9ef3-2989a1d0b332 None admin] PATH_INFO: `/v3/users/202a88467be64102b3c1095c530d1138` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:11.783919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304858f5-c811-4212-9ef3-2989a1d0b332 None admin] RBAC: Authorizing `identity:get_user(user_id=202a88467be64102b3c1095c530d1138)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:11.786444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304858f5-c811-4212-9ef3-2989a1d0b332 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:11.788893 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 157/315] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:11 2022] GET /identity/v3/users/202a88467be64102b3c1095c530d1138 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:11.798676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a7c74-2e39-4448-8cdd-257c0533408d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:11.941338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a7c74-2e39-4448-8cdd-257c0533408d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:11.991522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f57d26-2416-4ebc-9e7e-c3abff864628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:11.992171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57d26-2416-4ebc-9e7e-c3abff864628 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:11.992451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57d26-2416-4ebc-9e7e-c3abff864628 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:11.992721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57d26-2416-4ebc-9e7e-c3abff864628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:12.037294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:12.079077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f57d26-2416-4ebc-9e7e-c3abff864628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:12.080667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f57d26-2416-4ebc-9e7e-c3abff864628 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:12.188911 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 159/316] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:12.194753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304858f5-c811-4212-9ef3-2989a1d0b332 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:12.285587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:12.344620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304858f5-c811-4212-9ef3-2989a1d0b332 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:12.382142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1fe89-65ca-4fa6-acce-091d69927ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:12.382776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1fe89-65ca-4fa6-acce-091d69927ab1 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:12.383048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1fe89-65ca-4fa6-acce-091d69927ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:12.383319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1fe89-65ca-4fa6-acce-091d69927ab1 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:12.384452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1fe89-65ca-4fa6-acce-091d69927ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:12.385922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1fe89-65ca-4fa6-acce-091d69927ab1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:12.387772 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 158/317] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:12 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:12.394173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f57d26-2416-4ebc-9e7e-c3abff864628 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:12.505761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:12.564827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f57d26-2416-4ebc-9e7e-c3abff864628 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:12.609532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1037c0-e75a-4426-9d00-88e675ce029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:12.610094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1037c0-e75a-4426-9d00-88e675ce029d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:12.610382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1037c0-e75a-4426-9d00-88e675ce029d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:12.610680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1037c0-e75a-4426-9d00-88e675ce029d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:12.611547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1037c0-e75a-4426-9d00-88e675ce029d None admin] RBAC: Adding query filter params (role.id=dcca49656a484f299d30879c98961cd9, scope.project.id=04786f98561745b7b9db0c5057cb24fd, user.id=202a88467be64102b3c1095c530d1138) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:12.611890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1037c0-e75a-4426-9d00-88e675ce029d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:12.613632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1037c0-e75a-4426-9d00-88e675ce029d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:12.621457 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 160/318] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:12 2022] GET /identity/v3/role_assignments?user.id=202a88467be64102b3c1095c530d1138&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=dcca49656a484f299d30879c98961cd9 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:12.705515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7e90-e5f0-455f-b028-10a5d6dcb30d None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:12.706640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7e90-e5f0-455f-b028-10a5d6dcb30d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:12.707240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7e90-e5f0-455f-b028-10a5d6dcb30d None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:12.709711 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 159/319] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:12.716351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42358f5a-96a7-41b9-ba2f-ac270c8f6c75 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:12.716997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42358f5a-96a7-41b9-ba2f-ac270c8f6c75 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:12.717633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42358f5a-96a7-41b9-ba2f-ac270c8f6c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:12.740623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-42358f5a-96a7-41b9-ba2f-ac270c8f6c75 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:12.742363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42358f5a-96a7-41b9-ba2f-ac270c8f6c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:12.832063 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 161/320] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:12.927245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8366852-9c97-4a2d-9e6d-3e334114b070 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:12.927538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8366852-9c97-4a2d-9e6d-3e334114b070 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:12.927707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8366852-9c97-4a2d-9e6d-3e334114b070 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:12.929217 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 160/321] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:12.934996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf228-54f2-4fd6-a7b2-2af4eba1f098 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:12.935564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf228-54f2-4fd6-a7b2-2af4eba1f098 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:12.935846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf228-54f2-4fd6-a7b2-2af4eba1f098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:12.963473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-382bf228-54f2-4fd6-a7b2-2af4eba1f098 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:12.964930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-382bf228-54f2-4fd6-a7b2-2af4eba1f098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:13.040623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:13.056176 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 162/322] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:13.125520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8366852-9c97-4a2d-9e6d-3e334114b070 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:13.321235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8366852-9c97-4a2d-9e6d-3e334114b070 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:13.345805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bf228-54f2-4fd6-a7b2-2af4eba1f098 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:13.374556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:13.386141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a368-cce0-482d-98ec-5326c6f2c964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:13.386890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a368-cce0-482d-98ec-5326c6f2c964 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:13.387269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a368-cce0-482d-98ec-5326c6f2c964 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:13.388181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a368-cce0-482d-98ec-5326c6f2c964 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:13.389873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4a368-cce0-482d-98ec-5326c6f2c964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:13.391722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4a368-cce0-482d-98ec-5326c6f2c964 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:13.395261 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 161/323] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:13.400094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a368-cce0-482d-98ec-5326c6f2c964 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:13.510515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bf228-54f2-4fd6-a7b2-2af4eba1f098 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:13.532838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a368-cce0-482d-98ec-5326c6f2c964 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:13.567558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c059f-d1d2-4dbe-9613-f00805988d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:13.568208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c059f-d1d2-4dbe-9613-f00805988d25 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:13.568486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c059f-d1d2-4dbe-9613-f00805988d25 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:13.568751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c059f-d1d2-4dbe-9613-f00805988d25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:13.580863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c059f-d1d2-4dbe-9613-f00805988d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:13.584957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0a840-8eb1-4755-a9d2-307c70a68fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:13.585736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a840-8eb1-4755-a9d2-307c70a68fbc None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-870c059f-d1d2-4dbe-9613-f00805988d25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:13.585870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:13.589333 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:13.590243 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:13.593793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a840-8eb1-4755-a9d2-307c70a68fbc None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:13.593793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a840-8eb1-4755-a9d2-307c70a68fbc None admin] PATH_INFO: `/v3/groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:13.593926 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 163/324] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:13.593993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0a840-8eb1-4755-a9d2-307c70a68fbc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:13.593993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0a840-8eb1-4755-a9d2-307c70a68fbc None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:13.594138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e387c-48b8-4b6e-9ed4-3c5ae75eebbb None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:13.594138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e387c-48b8-4b6e-9ed4-3c5ae75eebbb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:13.594138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e387c-48b8-4b6e-9ed4-3c5ae75eebbb None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:13.594138 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 164/325] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:13.596986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81305e0b-4c66-49c2-8c12-fc8ded2edd59 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:13.597268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81305e0b-4c66-49c2-8c12-fc8ded2edd59 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:13.597597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81305e0b-4c66-49c2-8c12-fc8ded2edd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:13.611467 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 162/326] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Aug 29 15:10:13 2022] POST /identity/v3/groups => generated 226 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:10:13.620707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0a840-8eb1-4755-a9d2-307c70a68fbc None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:13.620831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-81305e0b-4c66-49c2-8c12-fc8ded2edd59 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:13.620831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-81305e0b-4c66-49c2-8c12-fc8ded2edd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:13.687261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:13.713191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:13.721189 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 165/327] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:13.782576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0a840-8eb1-4755-a9d2-307c70a68fbc None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:13.838579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493e71e-79d3-4576-b52a-63a19b3c54ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:13.839096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493e71e-79d3-4576-b52a-63a19b3c54ef None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:13.839374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493e71e-79d3-4576-b52a-63a19b3c54ef None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:13.839836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493e71e-79d3-4576-b52a-63a19b3c54ef None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:13.840337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493e71e-79d3-4576-b52a-63a19b3c54ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:13.841141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493e71e-79d3-4576-b52a-63a19b3c54ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:13.842601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493e71e-79d3-4576-b52a-63a19b3c54ef None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:13.852881 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 163/328] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:13.858592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81305e0b-4c66-49c2-8c12-fc8ded2edd59 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:13.993551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493e71e-79d3-4576-b52a-63a19b3c54ef None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:14.000292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81305e0b-4c66-49c2-8c12-fc8ded2edd59 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:14.062909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0b41c-f2c1-4c30-9446-ca0c1ea7263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:14.063867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0b41c-f2c1-4c30-9446-ca0c1ea7263a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:14.064297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0b41c-f2c1-4c30-9446-ca0c1ea7263a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:14.064717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0b41c-f2c1-4c30-9446-ca0c1ea7263a None admin] PATH_INFO: `/v3/users/ea5d682499324ca7bf94fa5444b24464` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:14.066287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0b41c-f2c1-4c30-9446-ca0c1ea7263a None admin] RBAC: Authorizing `identity:get_user(user_id=ea5d682499324ca7bf94fa5444b24464)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:14.068237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0b41c-f2c1-4c30-9446-ca0c1ea7263a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:14.071626 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 166/329] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:13 2022] GET /identity/v3/users/ea5d682499324ca7bf94fa5444b24464 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:14.078655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0b41c-f2c1-4c30-9446-ca0c1ea7263a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:14.149108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493e71e-79d3-4576-b52a-63a19b3c54ef None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:14.152169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:14.183908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:14.212223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e03c-254c-4dee-9845-670db566610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:14.213843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e03c-254c-4dee-9845-670db566610a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:14.214350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e03c-254c-4dee-9845-670db566610a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:14.214787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e03c-254c-4dee-9845-670db566610a None admin] PATH_INFO: `/v3/roles/member` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:14.234578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0b41c-f2c1-4c30-9446-ca0c1ea7263a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:14.234808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585e03c-254c-4dee-9845-670db566610a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-9585e03c-254c-4dee-9845-670db566610a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:14.242866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:14.244039 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:14.245091 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:14.249050 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 164/330] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:14.254019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e03c-254c-4dee-9845-670db566610a None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:14.286792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2929c0-37bd-4527-9bdf-f2462fcb2821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:14.288244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2929c0-37bd-4527-9bdf-f2462fcb2821 None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:14.288987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2929c0-37bd-4527-9bdf-f2462fcb2821 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:14.289886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2929c0-37bd-4527-9bdf-f2462fcb2821 None admin] PATH_INFO: `/v3/system/users/ea5d682499324ca7bf94fa5444b24464/roles/dcca49656a484f299d30879c98961cd9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:14.292311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2929c0-37bd-4527-9bdf-f2462fcb2821 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ea5d682499324ca7bf94fa5444b24464, role_id=dcca49656a484f299d30879c98961cd9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:14.295208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2929c0-37bd-4527-9bdf-f2462fcb2821 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:14.306370 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 167/331] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Aug 29 15:10:14 2022] PUT /identity/v3/system/users/ea5d682499324ca7bf94fa5444b24464/roles/dcca49656a484f299d30879c98961cd9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:10:14.420513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e03c-254c-4dee-9845-670db566610a None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:14.472384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d0316-cd79-481a-b961-c4798363e873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:14.473424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d0316-cd79-481a-b961-c4798363e873 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:14.473882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d0316-cd79-481a-b961-c4798363e873 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:14.474356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d0316-cd79-481a-b961-c4798363e873 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:14.475230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d0316-cd79-481a-b961-c4798363e873 None admin] RBAC: Adding query filter params (name=member) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:14.475789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d0316-cd79-481a-b961-c4798363e873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:14.477749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d0316-cd79-481a-b961-c4798363e873 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:14.493672 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 165/332] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:14.501925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2929c0-37bd-4527-9bdf-f2462fcb2821 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:14.660757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2929c0-37bd-4527-9bdf-f2462fcb2821 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:14.678516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:14.715837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc77e1-c769-4be9-9550-2d456d703040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:14.716965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc77e1-c769-4be9-9550-2d456d703040 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:14.717507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc77e1-c769-4be9-9550-2d456d703040 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:14.718035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc77e1-c769-4be9-9550-2d456d703040 None admin] PATH_INFO: `/v3/users/916627c18f5040dfbb5870025b3a1290` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:14.719728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc77e1-c769-4be9-9550-2d456d703040 None admin] RBAC: Authorizing `identity:get_user(user_id=916627c18f5040dfbb5870025b3a1290)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:14.721653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc77e1-c769-4be9-9550-2d456d703040 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:14.723762 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 168/333] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:14 2022] GET /identity/v3/users/916627c18f5040dfbb5870025b3a1290 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:14.732410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d0316-cd79-481a-b961-c4798363e873 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:14.831398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:14.914900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d0316-cd79-481a-b961-c4798363e873 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:14.965456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39694a51-1b1c-4b01-bb34-4b92c41a96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:14.966305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39694a51-1b1c-4b01-bb34-4b92c41a96c9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:14.966658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39694a51-1b1c-4b01-bb34-4b92c41a96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:14.967009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39694a51-1b1c-4b01-bb34-4b92c41a96c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:14.967976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39694a51-1b1c-4b01-bb34-4b92c41a96c9 None admin] RBAC: Adding query filter params (role.id=0aaef5fae9d1491bb3548a12be30bd2d, user.id=916627c18f5040dfbb5870025b3a1290, scope.system=all) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:14.968282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39694a51-1b1c-4b01-bb34-4b92c41a96c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:14.969954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39694a51-1b1c-4b01-bb34-4b92c41a96c9 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:14.993661 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 166/334] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Aug 29 15:10:14 2022] GET /identity/v3/role_assignments?user.id=916627c18f5040dfbb5870025b3a1290&scope.system=all&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 510 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:16.268679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0c1f-2906-411b-adec-2bba3a90e44f None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:16.269222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0c1f-2906-411b-adec-2bba3a90e44f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:16.269222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0c1f-2906-411b-adec-2bba3a90e44f None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:16.270603 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 169/335] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:16.276776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe809d-e009-40e8-a241-a3ffdfdf5c61 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:16.277220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe809d-e009-40e8-a241-a3ffdfdf5c61 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:16.277318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe809d-e009-40e8-a241-a3ffdfdf5c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:16.303998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b7fe809d-e009-40e8-a241-a3ffdfdf5c61 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:16.305220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b7fe809d-e009-40e8-a241-a3ffdfdf5c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:16.387362 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 167/336] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:16.712671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2f0f1-f34f-46d1-b0c2-6bcce67cb658 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:16.713036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2f0f1-f34f-46d1-b0c2-6bcce67cb658 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:16.713233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2f0f1-f34f-46d1-b0c2-6bcce67cb658 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:16.714594 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 170/337] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:16.730005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc8ef-c62b-43cc-bd93-4a9275972c74 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:16.730332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc8ef-c62b-43cc-bd93-4a9275972c74 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:16.730619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc8ef-c62b-43cc-bd93-4a9275972c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:16.758650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-821bc8ef-c62b-43cc-bd93-4a9275972c74 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:16.759966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-821bc8ef-c62b-43cc-bd93-4a9275972c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:16.792487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:16.864036 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 168/338] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:16.965924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2f0f1-f34f-46d1-b0c2-6bcce67cb658 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:17.107992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2f0f1-f34f-46d1-b0c2-6bcce67cb658 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:17.153247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb17cd-5acf-424f-b8a1-7dc7f066e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:17.154408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb17cd-5acf-424f-b8a1-7dc7f066e046 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:17.154686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb17cd-5acf-424f-b8a1-7dc7f066e046 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:17.154960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb17cd-5acf-424f-b8a1-7dc7f066e046 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:17.171112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb17cd-5acf-424f-b8a1-7dc7f066e046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-06cb17cd-5acf-424f-b8a1-7dc7f066e046 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:17.176061 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:17.176956 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:17.177780 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:17.180432 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 171/339] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:17.183000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bc8ef-c62b-43cc-bd93-4a9275972c74 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:17.303761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bc8ef-c62b-43cc-bd93-4a9275972c74 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:17.310119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ebc19-5cc1-46ba-b4fe-35624fd3c467 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:17.310703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ebc19-5cc1-46ba-b4fe-35624fd3c467 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:17.310703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ebc19-5cc1-46ba-b4fe-35624fd3c467 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:17.312083 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 172/340] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:17.317446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8a8a7-0b79-40a4-9660-c80921a13d09 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:17.317731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8a8a7-0b79-40a4-9660-c80921a13d09 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:17.318009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8a8a7-0b79-40a4-9660-c80921a13d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:17.353956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-adb8a8a7-0b79-40a4-9660-c80921a13d09 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:17.355172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-adb8a8a7-0b79-40a4-9660-c80921a13d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:17.370945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110ff58-180e-44bf-8e6f-3e8b398cb2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:17.371504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ff58-180e-44bf-8e6f-3e8b398cb2e0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:17.371783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ff58-180e-44bf-8e6f-3e8b398cb2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:17.372602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ff58-180e-44bf-8e6f-3e8b398cb2e0 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:17.373288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ff58-180e-44bf-8e6f-3e8b398cb2e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:17.373625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ff58-180e-44bf-8e6f-3e8b398cb2e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:17.375010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ff58-180e-44bf-8e6f-3e8b398cb2e0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:17.389665 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 169/341] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:17.394967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110ff58-180e-44bf-8e6f-3e8b398cb2e0 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:17.412206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:17.427900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:17.463872 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 173/342] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:17.536409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110ff58-180e-44bf-8e6f-3e8b398cb2e0 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:17.580235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37ffd6-2007-4a6f-93d1-3fa7af3fc367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:17.580899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37ffd6-2007-4a6f-93d1-3fa7af3fc367 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:17.581181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37ffd6-2007-4a6f-93d1-3fa7af3fc367 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:17.581473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37ffd6-2007-4a6f-93d1-3fa7af3fc367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:17.596866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8a8a7-0b79-40a4-9660-c80921a13d09 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:17.708639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37ffd6-2007-4a6f-93d1-3fa7af3fc367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:17.710386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37ffd6-2007-4a6f-93d1-3fa7af3fc367 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:17.737954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:17.739470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8a8a7-0b79-40a4-9660-c80921a13d09 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:17.778709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a83fd-5313-4acc-ae62-dfa3f70c73cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:17.779594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a83fd-5313-4acc-ae62-dfa3f70c73cc None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:17.780044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a83fd-5313-4acc-ae62-dfa3f70c73cc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:17.780454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a83fd-5313-4acc-ae62-dfa3f70c73cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:17.793138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a83fd-5313-4acc-ae62-dfa3f70c73cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-264a83fd-5313-4acc-ae62-dfa3f70c73cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:17.799398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:17.800539 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:17.801707 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:17.803822 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 174/343] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:10:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:17.808835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3376-8e04-4832-a8fe-033400d172de None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:17.809471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3376-8e04-4832-a8fe-033400d172de None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:17.810010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3376-8e04-4832-a8fe-033400d172de None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:17.811746 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 175/344] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:17.815266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a3376-8e04-4832-a8fe-033400d172de None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:17.842715 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 170/345] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:10:17.844236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3089846-9295-4744-bc92-fcc08e2053e0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:17.844576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3089846-9295-4744-bc92-fcc08e2053e0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:17.844946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3089846-9295-4744-bc92-fcc08e2053e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:17.858232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:17.872502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b3089846-9295-4744-bc92-fcc08e2053e0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:17.874516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b3089846-9295-4744-bc92-fcc08e2053e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:17.948218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a3376-8e04-4832-a8fe-033400d172de None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:17.969093 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 171/346] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:17.971655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3089846-9295-4744-bc92-fcc08e2053e0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:18.017601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64346c4-639f-486e-905c-6a783e893691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:18.018554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64346c4-639f-486e-905c-6a783e893691 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:18.018978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64346c4-639f-486e-905c-6a783e893691 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:18.019445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64346c4-639f-486e-905c-6a783e893691 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:18.020273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64346c4-639f-486e-905c-6a783e893691 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:18.020792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64346c4-639f-486e-905c-6a783e893691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:18.023496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64346c4-639f-486e-905c-6a783e893691 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:18.038640 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 176/347] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:18.039797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64346c4-639f-486e-905c-6a783e893691 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:18.118128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:18.179818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3089846-9295-4744-bc92-fcc08e2053e0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:18.219428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b1c5e-ca54-478a-a2e8-132274abd036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:18.220353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b1c5e-ca54-478a-a2e8-132274abd036 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:18.220766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:18.221269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b1c5e-ca54-478a-a2e8-132274abd036 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:18.222517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b1c5e-ca54-478a-a2e8-132274abd036 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:18.226082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b1c5e-ca54-478a-a2e8-132274abd036 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:18.227739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b1c5e-ca54-478a-a2e8-132274abd036 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:18.229625 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 172/348] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:17 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:18.230539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b1c5e-ca54-478a-a2e8-132274abd036 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:18.231459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64346c4-639f-486e-905c-6a783e893691 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:18.280658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa926a-b31f-4eb1-9b4f-7e1cabe4976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:18.281242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa926a-b31f-4eb1-9b4f-7e1cabe4976d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:18.281557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa926a-b31f-4eb1-9b4f-7e1cabe4976d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:18.281904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa926a-b31f-4eb1-9b4f-7e1cabe4976d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:18.294951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa926a-b31f-4eb1-9b4f-7e1cabe4976d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-57aa926a-b31f-4eb1-9b4f-7e1cabe4976d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:18.302675 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:18.303625 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 15:10:18.304456 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:18.307668 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 177/349] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:18.310467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59d908-5ced-492d-b9bd-a52e40af7b67 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:18.311361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59d908-5ced-492d-b9bd-a52e40af7b67 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:18.311770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59d908-5ced-492d-b9bd-a52e40af7b67 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:18.314694 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 178/350] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:18.317212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59d908-5ced-492d-b9bd-a52e40af7b67 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:18.371459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b1c5e-ca54-478a-a2e8-132274abd036 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:18.397723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:18.416805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fa812-bacb-43b5-8c41-2a49826d232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:18.417463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fa812-bacb-43b5-8c41-2a49826d232c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:18.417914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fa812-bacb-43b5-8c41-2a49826d232c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:18.418415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fa812-bacb-43b5-8c41-2a49826d232c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:18.476367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59d908-5ced-492d-b9bd-a52e40af7b67 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:18.504388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fa812-bacb-43b5-8c41-2a49826d232c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:18.505938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fa812-bacb-43b5-8c41-2a49826d232c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:18.519889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e232056-a28d-458e-bf5d-54f8c62b2aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:18.520555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e232056-a28d-458e-bf5d-54f8c62b2aba None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:18.520830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e232056-a28d-458e-bf5d-54f8c62b2aba None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:18.521098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e232056-a28d-458e-bf5d-54f8c62b2aba None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:18.531281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e232056-a28d-458e-bf5d-54f8c62b2aba None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:18.533293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e232056-a28d-458e-bf5d-54f8c62b2aba None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:18.535608 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 179/351] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:18 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:18.536399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e232056-a28d-458e-bf5d-54f8c62b2aba None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:18.558932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:18.627346 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 173/352] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:18.629965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198bba-b6fb-4c9c-97bd-a3567d5f9678 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:18.630500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198bba-b6fb-4c9c-97bd-a3567d5f9678 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:18.630974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198bba-b6fb-4c9c-97bd-a3567d5f9678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:18.651133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a3198bba-b6fb-4c9c-97bd-a3567d5f9678 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:18.652637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a3198bba-b6fb-4c9c-97bd-a3567d5f9678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:18.667151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e232056-a28d-458e-bf5d-54f8c62b2aba None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:18.669605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:18.710068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4f965-5820-4e2f-a620-0431acc7cf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:18.711062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f965-5820-4e2f-a620-0431acc7cf07 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:18.711338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f965-5820-4e2f-a620-0431acc7cf07 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:18.711601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f965-5820-4e2f-a620-0431acc7cf07 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:18.712906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4f965-5820-4e2f-a620-0431acc7cf07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:18.713214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4f965-5820-4e2f-a620-0431acc7cf07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:18.714795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4f965-5820-4e2f-a620-0431acc7cf07 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:18.725172 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 180/353] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:18.727906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4f965-5820-4e2f-a620-0431acc7cf07 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:18.744932 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 174/354] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:18.746332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a8cc-e113-482c-a3eb-5a4e426a7310 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:18.746617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a8cc-e113-482c-a3eb-5a4e426a7310 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:18.746892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a8cc-e113-482c-a3eb-5a4e426a7310 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:18.748329 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 175/355] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:18.748893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a8cc-e113-482c-a3eb-5a4e426a7310 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:18.841894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:18.879478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4f965-5820-4e2f-a620-0431acc7cf07 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:18.888263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a8cc-e113-482c-a3eb-5a4e426a7310 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:18.935998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368579b0-6b2a-4fd1-bfd1-fa78b56c93c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:18.936204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bda6a-6263-443e-adef-449121f76691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:18.936745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368579b0-6b2a-4fd1-bfd1-fa78b56c93c6 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:18.936874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bda6a-6263-443e-adef-449121f76691 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:18.937074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bda6a-6263-443e-adef-449121f76691 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:18.937213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368579b0-6b2a-4fd1-bfd1-fa78b56c93c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:18.937341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bda6a-6263-443e-adef-449121f76691 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:18.937624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368579b0-6b2a-4fd1-bfd1-fa78b56c93c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:18.938867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368579b0-6b2a-4fd1-bfd1-fa78b56c93c6 None admin] RBAC: Adding query filter params (group.id=86af3d48297045b4ba73f2c75aa4fcc6, role.id=0aaef5fae9d1491bb3548a12be30bd2d, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:18.938867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368579b0-6b2a-4fd1-bfd1-fa78b56c93c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:18.942097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368579b0-6b2a-4fd1-bfd1-fa78b56c93c6 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:18.947760 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 176/356] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Aug 29 15:10:18 2022] GET /identity/v3/role_assignments?group.id=86af3d48297045b4ba73f2c75aa4fcc6&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:18.948507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368579b0-6b2a-4fd1-bfd1-fa78b56c93c6 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:18.955504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bda6a-6263-443e-adef-449121f76691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-7b5bda6a-6263-443e-adef-449121f76691 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:18.961366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:18.962382 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:18.963202 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:18.965780 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 181/357] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:18.969750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:18.970996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bda6a-6263-443e-adef-449121f76691 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:19.072947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368579b0-6b2a-4fd1-bfd1-fa78b56c93c6 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:19.098903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bda6a-6263-443e-adef-449121f76691 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:19.120024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5a5f9-b1a4-492c-840d-831d96790586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:19.121072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5a5f9-b1a4-492c-840d-831d96790586 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:19.121592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5a5f9-b1a4-492c-840d-831d96790586 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:19.122575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5a5f9-b1a4-492c-840d-831d96790586 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:19.124541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5a5f9-b1a4-492c-840d-831d96790586 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:19.125636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5a5f9-b1a4-492c-840d-831d96790586 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:19.127377 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 177/358] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:18 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:19.128591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84048a-a553-468d-aac8-c5c8f505af1f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:19.129015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84048a-a553-468d-aac8-c5c8f505af1f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:19.129292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84048a-a553-468d-aac8-c5c8f505af1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:19.150049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e745581-a8fa-452c-b85d-5f8a386465ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:19.150715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e745581-a8fa-452c-b85d-5f8a386465ce None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:19.150995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e745581-a8fa-452c-b85d-5f8a386465ce None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:19.151526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e745581-a8fa-452c-b85d-5f8a386465ce None admin] PATH_INFO: `/v3/users/ea5d682499324ca7bf94fa5444b24464` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:19.152028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ac84048a-a553-468d-aac8-c5c8f505af1f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:19.152943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e745581-a8fa-452c-b85d-5f8a386465ce None admin] RBAC: Authorizing `identity:get_user(user_id=ea5d682499324ca7bf94fa5444b24464)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:19.154360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ac84048a-a553-468d-aac8-c5c8f505af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:19.155208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e745581-a8fa-452c-b85d-5f8a386465ce None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:19.157232 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 182/359] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:10:18 2022] GET /identity/v3/users/ea5d682499324ca7bf94fa5444b24464 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:19.162554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e745581-a8fa-452c-b85d-5f8a386465ce None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:19.172545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:19.255612 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 178/360] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:19.256838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84048a-a553-468d-aac8-c5c8f505af1f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:19.281766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:19.304822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e745581-a8fa-452c-b85d-5f8a386465ce None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:19.343602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd03e69-7710-4787-8a47-c2e2a2ece7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:19.344290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03e69-7710-4787-8a47-c2e2a2ece7ee None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:19.344871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03e69-7710-4787-8a47-c2e2a2ece7ee None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:19.345346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd03e69-7710-4787-8a47-c2e2a2ece7ee None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:19.346242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd03e69-7710-4787-8a47-c2e2a2ece7ee None admin] RBAC: Adding query filter params (name=member) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:19.346743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd03e69-7710-4787-8a47-c2e2a2ece7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:19.348519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd03e69-7710-4787-8a47-c2e2a2ece7ee None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:19.359120 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 183/361] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:19.360366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd03e69-7710-4787-8a47-c2e2a2ece7ee None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:19.381670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84048a-a553-468d-aac8-c5c8f505af1f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:19.419641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c688bc-e4cd-4f51-86b5-686ed7c68bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:19.420562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c688bc-e4cd-4f51-86b5-686ed7c68bbc None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:19.421007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c688bc-e4cd-4f51-86b5-686ed7c68bbc None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:19.421471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c688bc-e4cd-4f51-86b5-686ed7c68bbc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:19.437704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c688bc-e4cd-4f51-86b5-686ed7c68bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:19.439839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-f6c688bc-e4cd-4f51-86b5-686ed7c68bbc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:19.445718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:19.446711 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 179/362] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:10:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:19.448010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c688bc-e4cd-4f51-86b5-686ed7c68bbc None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:19.493522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd03e69-7710-4787-8a47-c2e2a2ece7ee None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:19.533464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c685ba-553d-47e5-8c4f-f1e6e4a54b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:19.536759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c685ba-553d-47e5-8c4f-f1e6e4a54b0d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:19.536759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c685ba-553d-47e5-8c4f-f1e6e4a54b0d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:19.536759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c685ba-553d-47e5-8c4f-f1e6e4a54b0d None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:19.536759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c685ba-553d-47e5-8c4f-f1e6e4a54b0d None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:19.537223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c685ba-553d-47e5-8c4f-f1e6e4a54b0d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:19.539178 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 184/363] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:19 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:19.540018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c685ba-553d-47e5-8c4f-f1e6e4a54b0d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:19.550989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:19.589060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c688bc-e4cd-4f51-86b5-686ed7c68bbc None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:19.637486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d5748-42fb-4018-9bb2-3770fbb56ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:19.638150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d5748-42fb-4018-9bb2-3770fbb56ac8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:19.638424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d5748-42fb-4018-9bb2-3770fbb56ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:19.638691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d5748-42fb-4018-9bb2-3770fbb56ac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:19.640066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d5748-42fb-4018-9bb2-3770fbb56ac8 None admin] RBAC: Adding query filter params (role.id=dcca49656a484f299d30879c98961cd9, user.id=ea5d682499324ca7bf94fa5444b24464, scope.system=all) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:19.640066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d5748-42fb-4018-9bb2-3770fbb56ac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:19.641307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d5748-42fb-4018-9bb2-3770fbb56ac8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:19.658920 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 180/364] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Aug 29 15:10:19 2022] GET /identity/v3/role_assignments?user.id=ea5d682499324ca7bf94fa5444b24464&scope.system=all&role.id=dcca49656a484f299d30879c98961cd9 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:19.659756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d5748-42fb-4018-9bb2-3770fbb56ac8 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:19.669996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c685ba-553d-47e5-8c4f-f1e6e4a54b0d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:19.717087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813558a-e98a-4109-b9ad-0f22ef9b492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:19.718392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813558a-e98a-4109-b9ad-0f22ef9b492d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:19.719297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813558a-e98a-4109-b9ad-0f22ef9b492d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:19.720057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813558a-e98a-4109-b9ad-0f22ef9b492d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:19.727147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:19.841902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d5748-42fb-4018-9bb2-3770fbb56ac8 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:19.842517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813558a-e98a-4109-b9ad-0f22ef9b492d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:19.845992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813558a-e98a-4109-b9ad-0f22ef9b492d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:19.894771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:19.906912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698be97-6c71-40b2-82eb-81c7571b36d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:19.907614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698be97-6c71-40b2-82eb-81c7571b36d0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:19.907903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698be97-6c71-40b2-82eb-81c7571b36d0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:19.908240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698be97-6c71-40b2-82eb-81c7571b36d0 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:19.909066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698be97-6c71-40b2-82eb-81c7571b36d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:19.909520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698be97-6c71-40b2-82eb-81c7571b36d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:19.910926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698be97-6c71-40b2-82eb-81c7571b36d0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:19.925711 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 181/365] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:19.926698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698be97-6c71-40b2-82eb-81c7571b36d0 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:20.019190 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 185/366] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:20.020526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813558a-e98a-4109-b9ad-0f22ef9b492d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:20.069177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:20.089377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698be97-6c71-40b2-82eb-81c7571b36d0 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:20.136529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cad82-aed4-4a30-b1e3-a78c495255c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:20.137160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cad82-aed4-4a30-b1e3-a78c495255c7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:20.137500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cad82-aed4-4a30-b1e3-a78c495255c7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:20.138752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cad82-aed4-4a30-b1e3-a78c495255c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:20.139355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cad82-aed4-4a30-b1e3-a78c495255c7 None admin] RBAC: Adding query filter params (group.id=86af3d48297045b4ba73f2c75aa4fcc6, role.id=066bc2c3c4ad43baaa2e35afdba859e5, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:20.139665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cad82-aed4-4a30-b1e3-a78c495255c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:20.141885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cad82-aed4-4a30-b1e3-a78c495255c7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:20.149288 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 182/367] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Aug 29 15:10:19 2022] GET /identity/v3/role_assignments?group.id=86af3d48297045b4ba73f2c75aa4fcc6&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=066bc2c3c4ad43baaa2e35afdba859e5 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:20.150514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cad82-aed4-4a30-b1e3-a78c495255c7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:20.164239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813558a-e98a-4109-b9ad-0f22ef9b492d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:20.212985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec25ae-cc99-4765-9849-6486f889c7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:20.214219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec25ae-cc99-4765-9849-6486f889c7d4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:20.214571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec25ae-cc99-4765-9849-6486f889c7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:20.215071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec25ae-cc99-4765-9849-6486f889c7d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:20.229462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec25ae-cc99-4765-9849-6486f889c7d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:20.234005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-32ec25ae-cc99-4765-9849-6486f889c7d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:20.236989 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:20.238148 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:20.238954 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 186/368] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:10:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:20.239642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec25ae-cc99-4765-9849-6486f889c7d4 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:20.305243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cad82-aed4-4a30-b1e3-a78c495255c7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:20.358909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ddf20-c6ea-4d34-b5b0-6a10e80a3b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:20.359535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ddf20-c6ea-4d34-b5b0-6a10e80a3b0f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:20.359815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ddf20-c6ea-4d34-b5b0-6a10e80a3b0f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:20.361373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ddf20-c6ea-4d34-b5b0-6a10e80a3b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:20.370314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:20.384449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec25ae-cc99-4765-9849-6486f889c7d4 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:20.440804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf53419-a010-4c3a-97de-b33ea0d458a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:20.441373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf53419-a010-4c3a-97de-b33ea0d458a4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:20.441673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf53419-a010-4c3a-97de-b33ea0d458a4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:20.442000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf53419-a010-4c3a-97de-b33ea0d458a4 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:20.443393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf53419-a010-4c3a-97de-b33ea0d458a4 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:20.444755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf53419-a010-4c3a-97de-b33ea0d458a4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:20.446779 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 187/369] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:20 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:20.447581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf53419-a010-4c3a-97de-b33ea0d458a4 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:20.466635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ddf20-c6ea-4d34-b5b0-6a10e80a3b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:20.469359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ddf20-c6ea-4d34-b5b0-6a10e80a3b0f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:20.564497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:20.590612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf53419-a010-4c3a-97de-b33ea0d458a4 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:20.631983 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 183/370] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:20.633109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ddf20-c6ea-4d34-b5b0-6a10e80a3b0f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:20.646693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d358a-92d3-4ea8-b3be-3219d8ebefcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:20.647331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d358a-92d3-4ea8-b3be-3219d8ebefcc None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:20.647708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d358a-92d3-4ea8-b3be-3219d8ebefcc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:20.648082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d358a-92d3-4ea8-b3be-3219d8ebefcc None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:20.648965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d358a-92d3-4ea8-b3be-3219d8ebefcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:20.649368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d358a-92d3-4ea8-b3be-3219d8ebefcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:20.650929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d358a-92d3-4ea8-b3be-3219d8ebefcc None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:20.661374 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 188/371] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:20.662352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d358a-92d3-4ea8-b3be-3219d8ebefcc None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:20.696707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:20.761204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ddf20-c6ea-4d34-b5b0-6a10e80a3b0f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:20.800299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d358a-92d3-4ea8-b3be-3219d8ebefcc None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:20.805868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765310f4-007e-4484-8131-8162e7ff855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:20.806514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765310f4-007e-4484-8131-8162e7ff855f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:20.806817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765310f4-007e-4484-8131-8162e7ff855f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:20.807050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765310f4-007e-4484-8131-8162e7ff855f None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:20.808242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765310f4-007e-4484-8131-8162e7ff855f None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:20.809804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765310f4-007e-4484-8131-8162e7ff855f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:20.811453 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 184/372] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:20 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:20.812233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765310f4-007e-4484-8131-8162e7ff855f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:20.847995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:20.854207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298eea0-0955-46c0-be72-84e5da611161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:20.854850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298eea0-0955-46c0-be72-84e5da611161 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:20.855133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298eea0-0955-46c0-be72-84e5da611161 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:20.855412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298eea0-0955-46c0-be72-84e5da611161 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:20.856618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298eea0-0955-46c0-be72-84e5da611161 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:20.858149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298eea0-0955-46c0-be72-84e5da611161 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:20.860170 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 189/373] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:20 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:20.861089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298eea0-0955-46c0-be72-84e5da611161 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:20.948339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765310f4-007e-4484-8131-8162e7ff855f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:20.975488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:20.986428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298eea0-0955-46c0-be72-84e5da611161 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:20.995966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822857c1-8c5b-45a7-b128-fe3eb54a4c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:20.996928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822857c1-8c5b-45a7-b128-fe3eb54a4c85 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:20.998350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822857c1-8c5b-45a7-b128-fe3eb54a4c85 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:20.998836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822857c1-8c5b-45a7-b128-fe3eb54a4c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:21.032964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e690b0-d7d1-4d5d-b39b-47338c90d017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:21.033671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e690b0-d7d1-4d5d-b39b-47338c90d017 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:21.033953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e690b0-d7d1-4d5d-b39b-47338c90d017 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:21.034224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e690b0-d7d1-4d5d-b39b-47338c90d017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:21.035031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e690b0-d7d1-4d5d-b39b-47338c90d017 None admin] RBAC: Adding query filter params (group.id=86af3d48297045b4ba73f2c75aa4fcc6, role.id=0aaef5fae9d1491bb3548a12be30bd2d, scope.project.id=04786f98561745b7b9db0c5057cb24fd) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:21.035481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e690b0-d7d1-4d5d-b39b-47338c90d017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:21.036775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e690b0-d7d1-4d5d-b39b-47338c90d017 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:21.049725 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 190/374] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Aug 29 15:10:20 2022] GET /identity/v3/role_assignments?group.id=86af3d48297045b4ba73f2c75aa4fcc6&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:21.050590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e690b0-d7d1-4d5d-b39b-47338c90d017 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:21.086031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822857c1-8c5b-45a7-b128-fe3eb54a4c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:21.088049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822857c1-8c5b-45a7-b128-fe3eb54a4c85 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:21.128335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:21.252833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e690b0-d7d1-4d5d-b39b-47338c90d017 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:21.263328 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 185/375] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:21.263541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cf1fe-7402-4730-b7de-0bd353055921 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:21.263966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cf1fe-7402-4730-b7de-0bd353055921 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:21.263966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cf1fe-7402-4730-b7de-0bd353055921 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:21.265795 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 186/376] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:21.271933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc216-5123-4640-b21e-0f7159b465ee None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:21.272346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc216-5123-4640-b21e-0f7159b465ee None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:21.272768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc216-5123-4640-b21e-0f7159b465ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:21.297011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-946fc216-5123-4640-b21e-0f7159b465ee None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:21.298616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-946fc216-5123-4640-b21e-0f7159b465ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:21.314445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe440-7b3f-4ea2-a180-7b15a5422dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:21.315115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe440-7b3f-4ea2-a180-7b15a5422dde None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:21.315399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe440-7b3f-4ea2-a180-7b15a5422dde None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:21.315678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe440-7b3f-4ea2-a180-7b15a5422dde None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:21.317145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fe440-7b3f-4ea2-a180-7b15a5422dde None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:21.318834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fe440-7b3f-4ea2-a180-7b15a5422dde None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:21.321227 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 191/377] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:21 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:21.322047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe440-7b3f-4ea2-a180-7b15a5422dde None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:21.365699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:21.391810 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 187/378] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:21.393008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc216-5123-4640-b21e-0f7159b465ee None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:21.509545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe440-7b3f-4ea2-a180-7b15a5422dde None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:21.510449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:21.588795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ac80c-1648-4d86-a634-650ab80fcd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:21.589850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ac80c-1648-4d86-a634-650ab80fcd48 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:21.590353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ac80c-1648-4d86-a634-650ab80fcd48 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:21.590893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ac80c-1648-4d86-a634-650ab80fcd48 None admin] PATH_INFO: `/v3/projects/981474d13fc1406aa4961a388692a3c0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:21.592956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ac80c-1648-4d86-a634-650ab80fcd48 None admin] RBAC: Authorizing `identity:get_project(project_id=981474d13fc1406aa4961a388692a3c0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:21.594456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ac80c-1648-4d86-a634-650ab80fcd48 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:21.600566 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 192/379] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:21 2022] GET /identity/v3/projects/981474d13fc1406aa4961a388692a3c0 => generated 344 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:21.602867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc216-5123-4640-b21e-0f7159b465ee None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:21.606050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ac80c-1648-4d86-a634-650ab80fcd48 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:21.671529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1732a-f662-4143-93f1-93ad1d5c11d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:21.672763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1732a-f662-4143-93f1-93ad1d5c11d3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:21.673954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1732a-f662-4143-93f1-93ad1d5c11d3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:21.674661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1732a-f662-4143-93f1-93ad1d5c11d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:21.676298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1732a-f662-4143-93f1-93ad1d5c11d3 None admin] RBAC: Adding query filter params (group.id=86af3d48297045b4ba73f2c75aa4fcc6, role.id=066bc2c3c4ad43baaa2e35afdba859e5, scope.project.id=04786f98561745b7b9db0c5057cb24fd) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:21.677010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1732a-f662-4143-93f1-93ad1d5c11d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:21.679778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1732a-f662-4143-93f1-93ad1d5c11d3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:21.691643 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 188/380] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Aug 29 15:10:21 2022] GET /identity/v3/role_assignments?group.id=86af3d48297045b4ba73f2c75aa4fcc6&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=066bc2c3c4ad43baaa2e35afdba859e5 => generated 260 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:21.793563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:21.801080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ac80c-1648-4d86-a634-650ab80fcd48 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:21.851987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad75a2-7a48-4832-9f9d-e7bfedb30030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:21.852648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad75a2-7a48-4832-9f9d-e7bfedb30030 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:21.852928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad75a2-7a48-4832-9f9d-e7bfedb30030 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:21.853208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad75a2-7a48-4832-9f9d-e7bfedb30030 None admin] PATH_INFO: `/v3/groups/f3d4f15c049842fca4443a11429b5aa4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:21.865508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad75a2-7a48-4832-9f9d-e7bfedb30030 None admin] RBAC: Authorizing `identity:get_group(group_id=f3d4f15c049842fca4443a11429b5aa4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:21.867486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad75a2-7a48-4832-9f9d-e7bfedb30030 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:21.869514 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 193/381] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:21 2022] GET /identity/v3/groups/f3d4f15c049842fca4443a11429b5aa4 => generated 229 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:21.876651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1732a-f662-4143-93f1-93ad1d5c11d3 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:21.888202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad75a2-7a48-4832-9f9d-e7bfedb30030 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:22.045897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad75a2-7a48-4832-9f9d-e7bfedb30030 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:22.077501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1732a-f662-4143-93f1-93ad1d5c11d3 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:22.093342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36efbe-2d78-4c8e-9d61-fab0c1a4ec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:22.094434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36efbe-2d78-4c8e-9d61-fab0c1a4ec21 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:22.094937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36efbe-2d78-4c8e-9d61-fab0c1a4ec21 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:22.095411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36efbe-2d78-4c8e-9d61-fab0c1a4ec21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:22.109035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:22.122426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36efbe-2d78-4c8e-9d61-fab0c1a4ec21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-0c36efbe-2d78-4c8e-9d61-fab0c1a4ec21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:22.129446 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:22.130392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:22.131194 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 194/382] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:22.133139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67c937-c081-4208-9e5f-ca264c696a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:22.133944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67c937-c081-4208-9e5f-ca264c696a4f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:22.134645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67c937-c081-4208-9e5f-ca264c696a4f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:22.135080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67c937-c081-4208-9e5f-ca264c696a4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:22.136009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67c937-c081-4208-9e5f-ca264c696a4f None admin] RBAC: Adding query filter params (group.id=f3d4f15c049842fca4443a11429b5aa4, role.id=be89abac608f45a6921181bcc574f721, scope.project.id=981474d13fc1406aa4961a388692a3c0) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:22.136479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36efbe-2d78-4c8e-9d61-fab0c1a4ec21 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:22.136593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67c937-c081-4208-9e5f-ca264c696a4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:22.138342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67c937-c081-4208-9e5f-ca264c696a4f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:22.146041 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 189/383] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Aug 29 15:10:21 2022] GET /identity/v3/role_assignments?group.id=f3d4f15c049842fca4443a11429b5aa4&scope.project.id=981474d13fc1406aa4961a388692a3c0&role.id=be89abac608f45a6921181bcc574f721 => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:22.175312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:22.291387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36efbe-2d78-4c8e-9d61-fab0c1a4ec21 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:22.346363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04f223-a9c4-4ca0-8f9a-af564b6bae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:22.346977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04f223-a9c4-4ca0-8f9a-af564b6bae48 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:22.347263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04f223-a9c4-4ca0-8f9a-af564b6bae48 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:22.347538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04f223-a9c4-4ca0-8f9a-af564b6bae48 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:22.348224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04f223-a9c4-4ca0-8f9a-af564b6bae48 None admin] RBAC: Adding query filter params (name=member) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:22.348527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04f223-a9c4-4ca0-8f9a-af564b6bae48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:22.349942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04f223-a9c4-4ca0-8f9a-af564b6bae48 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:22.359752 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 195/384] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:22.365612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67c937-c081-4208-9e5f-ca264c696a4f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:22.500394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67c937-c081-4208-9e5f-ca264c696a4f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:22.524237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa13662-63e7-41e1-a17a-f20c4222fad5 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:22.524734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa13662-63e7-41e1-a17a-f20c4222fad5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:22.524933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa13662-63e7-41e1-a17a-f20c4222fad5 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:22.526655 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 196/385] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:10:22.532672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea44191-eed1-4b51-b5ae-ba02f612b425 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:22.533250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea44191-eed1-4b51-b5ae-ba02f612b425 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:22.533711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767a00-d892-4ae9-94eb-93c7cd66de6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:22.534322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea44191-eed1-4b51-b5ae-ba02f612b425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:22.534437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767a00-d892-4ae9-94eb-93c7cd66de6a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:22.534609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767a00-d892-4ae9-94eb-93c7cd66de6a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:22.534865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767a00-d892-4ae9-94eb-93c7cd66de6a None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:22.538444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62767a00-d892-4ae9-94eb-93c7cd66de6a None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:22.538444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62767a00-d892-4ae9-94eb-93c7cd66de6a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:22.539791 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 190/386] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:22 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:22.545613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767a00-d892-4ae9-94eb-93c7cd66de6a None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:22.560740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-aea44191-eed1-4b51-b5ae-ba02f612b425 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:22.562297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aea44191-eed1-4b51-b5ae-ba02f612b425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:22.634030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:22.642587 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 197/387] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:22.701997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767a00-d892-4ae9-94eb-93c7cd66de6a None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:22.738055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24316589-70ef-420c-9ee0-88c891fefe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:22.739034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24316589-70ef-420c-9ee0-88c891fefe10 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:22.739536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24316589-70ef-420c-9ee0-88c891fefe10 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:22.740001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24316589-70ef-420c-9ee0-88c891fefe10 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:22.741350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24316589-70ef-420c-9ee0-88c891fefe10 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:22.743325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24316589-70ef-420c-9ee0-88c891fefe10 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:22.745512 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 191/388] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:22 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:22.754215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea44191-eed1-4b51-b5ae-ba02f612b425 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:22.774016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:22.926338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea44191-eed1-4b51-b5ae-ba02f612b425 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:22.965765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24316589-70ef-420c-9ee0-88c891fefe10 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:22.977529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17437ca-82e5-4350-8112-93acdad1d63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:22.979075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17437ca-82e5-4350-8112-93acdad1d63d None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:22.979575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17437ca-82e5-4350-8112-93acdad1d63d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:22.980457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17437ca-82e5-4350-8112-93acdad1d63d None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/groups/86af3d48297045b4ba73f2c75aa4fcc6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:22.987797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17437ca-82e5-4350-8112-93acdad1d63d None admin] RBAC: Authorizing `identity:create_grant(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9, group_id=86af3d48297045b4ba73f2c75aa4fcc6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:22.989280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17437ca-82e5-4350-8112-93acdad1d63d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:23.014157 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 198/389] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Aug 29 15:10:22 2022] PUT /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/groups/86af3d48297045b4ba73f2c75aa4fcc6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:23.102229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24316589-70ef-420c-9ee0-88c891fefe10 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:23.121930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:23.142772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bac08c-ab07-4965-b11a-9f0d2a1a83a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:23.143525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bac08c-ab07-4965-b11a-9f0d2a1a83a4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:23.143812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bac08c-ab07-4965-b11a-9f0d2a1a83a4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:23.144087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bac08c-ab07-4965-b11a-9f0d2a1a83a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:23.155842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bac08c-ab07-4965-b11a-9f0d2a1a83a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-c6bac08c-ab07-4965-b11a-9f0d2a1a83a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:23.161581 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:23.162553 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:23.163362 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 192/390] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:10:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:23.169365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17437ca-82e5-4350-8112-93acdad1d63d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:23.256683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:23.290038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17437ca-82e5-4350-8112-93acdad1d63d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:23.327336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d5cd-1d94-4b39-9a03-fb5adb6f9efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:23.327958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d5cd-1d94-4b39-9a03-fb5adb6f9efb None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:23.328238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d5cd-1d94-4b39-9a03-fb5adb6f9efb None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:23.328512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d5cd-1d94-4b39-9a03-fb5adb6f9efb None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:23.329178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d5cd-1d94-4b39-9a03-fb5adb6f9efb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:23.329564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d5cd-1d94-4b39-9a03-fb5adb6f9efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:23.330938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d5cd-1d94-4b39-9a03-fb5adb6f9efb None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:23.339258 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 199/391] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:23.344852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bac08c-ab07-4965-b11a-9f0d2a1a83a4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:23.452813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bac08c-ab07-4965-b11a-9f0d2a1a83a4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:23.491839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496914b-83b7-4b97-a719-554b0d40ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:23.492504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496914b-83b7-4b97-a719-554b0d40ec1a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:23.492788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496914b-83b7-4b97-a719-554b0d40ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:23.493062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496914b-83b7-4b97-a719-554b0d40ec1a None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:23.494322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496914b-83b7-4b97-a719-554b0d40ec1a None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:23.495879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496914b-83b7-4b97-a719-554b0d40ec1a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:23.500788 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 193/392] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:23 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:23.505230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d5cd-1d94-4b39-9a03-fb5adb6f9efb None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:23.536499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7ae71-8c87-4411-8097-f98d575f3eed None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:23.536499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7ae71-8c87-4411-8097-f98d575f3eed None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:23.536499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7ae71-8c87-4411-8097-f98d575f3eed None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:23.537111 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 194/393] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:10:23.542641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0f1f-c8e6-4226-991b-6ff83199254f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:23.543232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0f1f-c8e6-4226-991b-6ff83199254f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:23.543700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0f1f-c8e6-4226-991b-6ff83199254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:23.573717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8d6e0f1f-c8e6-4226-991b-6ff83199254f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:23.577521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8d6e0f1f-c8e6-4226-991b-6ff83199254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:23.668132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:23.707987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d5cd-1d94-4b39-9a03-fb5adb6f9efb None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:23.719661 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 195/394] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:23.765796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:23.769835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cdb2a-49f2-47bc-b533-0d11486251ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:23.770520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cdb2a-49f2-47bc-b533-0d11486251ef None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:23.770809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cdb2a-49f2-47bc-b533-0d11486251ef None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:23.771094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cdb2a-49f2-47bc-b533-0d11486251ef None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:23.778372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cdb2a-49f2-47bc-b533-0d11486251ef None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:23.780354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cdb2a-49f2-47bc-b533-0d11486251ef None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:23.782536 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 200/395] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:23 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:23.788487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e0f1f-c8e6-4226-991b-6ff83199254f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:23.927350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e0f1f-c8e6-4226-991b-6ff83199254f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:23.973236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88b77b-a0ef-4e38-8a9c-f3b63ec5f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:23.974411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88b77b-a0ef-4e38-8a9c-f3b63ec5f6c3 None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:23.974892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88b77b-a0ef-4e38-8a9c-f3b63ec5f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:23.975378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88b77b-a0ef-4e38-8a9c-f3b63ec5f6c3 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/groups/86af3d48297045b4ba73f2c75aa4fcc6/roles/066bc2c3c4ad43baaa2e35afdba859e5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:23.983581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88b77b-a0ef-4e38-8a9c-f3b63ec5f6c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9, group_id=86af3d48297045b4ba73f2c75aa4fcc6, role_id=066bc2c3c4ad43baaa2e35afdba859e5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:23.985456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88b77b-a0ef-4e38-8a9c-f3b63ec5f6c3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:24.006074 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 196/396] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Aug 29 15:10:23 2022] PUT /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9/groups/86af3d48297045b4ba73f2c75aa4fcc6/roles/066bc2c3c4ad43baaa2e35afdba859e5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:24.058774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cdb2a-49f2-47bc-b533-0d11486251ef None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:24.211398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cdb2a-49f2-47bc-b533-0d11486251ef None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:24.220052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9de288-0e5b-49ea-940f-c7e0947402c3 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:24.220673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9de288-0e5b-49ea-940f-c7e0947402c3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:24.221146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9de288-0e5b-49ea-940f-c7e0947402c3 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:24.223103 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 197/397] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:24.229263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276ccee-c05a-4517-9af7-9717377beb88 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:24.229939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276ccee-c05a-4517-9af7-9717377beb88 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:24.230427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276ccee-c05a-4517-9af7-9717377beb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:24.265600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4276ccee-c05a-4517-9af7-9717377beb88 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:24.266935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4276ccee-c05a-4517-9af7-9717377beb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:24.275796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae0230-8463-415d-8d86-002927027a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:24.276713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0230-8463-415d-8d86-002927027a9b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:24.276995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0230-8463-415d-8d86-002927027a9b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:24.277271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0230-8463-415d-8d86-002927027a9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae0230-8463-415d-8d86-002927027a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-f2ae0230-8463-415d-8d86-002927027a9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:24.303424 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:24.304358 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:24.305304 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 201/398] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:24.316790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae0230-8463-415d-8d86-002927027a9b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:24.327951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:24.377825 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 198/399] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:24.406741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:24.471605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae0230-8463-415d-8d86-002927027a9b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:24.509529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73552d-b636-4b40-89e7-6bd3e8dd5dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:24.510450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73552d-b636-4b40-89e7-6bd3e8dd5dda None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:24.510936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73552d-b636-4b40-89e7-6bd3e8dd5dda None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:24.511389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73552d-b636-4b40-89e7-6bd3e8dd5dda None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:24.512260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73552d-b636-4b40-89e7-6bd3e8dd5dda None admin] RBAC: Adding query filter params (name=member) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:24.513282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73552d-b636-4b40-89e7-6bd3e8dd5dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:24.514947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73552d-b636-4b40-89e7-6bd3e8dd5dda None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:24.524750 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 202/400] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:24.530947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276ccee-c05a-4517-9af7-9717377beb88 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:24.674106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73552d-b636-4b40-89e7-6bd3e8dd5dda None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:24.693181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276ccee-c05a-4517-9af7-9717377beb88 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:24.751265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80751c-893a-428f-94dd-5e03e5a57e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:24.751975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80751c-893a-428f-94dd-5e03e5a57e0d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:24.752256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80751c-893a-428f-94dd-5e03e5a57e0d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:24.752540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80751c-893a-428f-94dd-5e03e5a57e0d None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:24.753841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80751c-893a-428f-94dd-5e03e5a57e0d None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:24.755413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80751c-893a-428f-94dd-5e03e5a57e0d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:24.757331 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 199/401] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:24 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:24.763676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80751c-893a-428f-94dd-5e03e5a57e0d None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:24.819159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:24.847421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73552d-b636-4b40-89e7-6bd3e8dd5dda None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:24.886575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:24.907335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb86d6-0e56-42de-b433-ca9760798d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:24.907971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb86d6-0e56-42de-b433-ca9760798d1f None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:24.908247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb86d6-0e56-42de-b433-ca9760798d1f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:24.908518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb86d6-0e56-42de-b433-ca9760798d1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:24.921979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb86d6-0e56-42de-b433-ca9760798d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-d6cb86d6-0e56-42de-b433-ca9760798d1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:24.928119 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:24.929035 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:24.930185 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 203/402] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:10:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:24.930862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d9a91-6901-47cd-97a0-849e3596d852 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:24.931109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d9a91-6901-47cd-97a0-849e3596d852 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:24.932189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d9a91-6901-47cd-97a0-849e3596d852 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:24.933775 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 204/403] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:24.942526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a09e-b800-48d6-89f6-ecdb86091c25 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:24.943106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a09e-b800-48d6-89f6-ecdb86091c25 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:24.943626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a09e-b800-48d6-89f6-ecdb86091c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:24.957085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80751c-893a-428f-94dd-5e03e5a57e0d None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:24.966324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c3c5a09e-b800-48d6-89f6-ecdb86091c25 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:24.968109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c3c5a09e-b800-48d6-89f6-ecdb86091c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:25.003485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e1117-b602-4afb-a62d-61018aa733e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:25.004192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e1117-b602-4afb-a62d-61018aa733e5 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:25.004488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e1117-b602-4afb-a62d-61018aa733e5 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:25.004894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e1117-b602-4afb-a62d-61018aa733e5 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:25.006210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e1117-b602-4afb-a62d-61018aa733e5 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:25.007955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e1117-b602-4afb-a62d-61018aa733e5 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:25.013483 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 200/404] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:24 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:25.014756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e1117-b602-4afb-a62d-61018aa733e5 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:25.085538 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 205/405] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:25.085538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5a09e-b800-48d6-89f6-ecdb86091c25 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:25.208852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5a09e-b800-48d6-89f6-ecdb86091c25 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:25.225204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:25.254354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a29322-e0f2-4298-ad67-d44cec76099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:25.255422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a29322-e0f2-4298-ad67-d44cec76099f None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:25.255904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a29322-e0f2-4298-ad67-d44cec76099f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:25.256398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a29322-e0f2-4298-ad67-d44cec76099f None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd/groups/86af3d48297045b4ba73f2c75aa4fcc6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:25.259641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a29322-e0f2-4298-ad67-d44cec76099f None admin] RBAC: Authorizing `identity:create_grant(project_id=04786f98561745b7b9db0c5057cb24fd, group_id=86af3d48297045b4ba73f2c75aa4fcc6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:25.262065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a29322-e0f2-4298-ad67-d44cec76099f None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:25.268853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e1117-b602-4afb-a62d-61018aa733e5 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:25.271097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:25.290596 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 206/406] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Aug 29 15:10:25 2022] PUT /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd/groups/86af3d48297045b4ba73f2c75aa4fcc6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:25.329737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20ac4c-c4c5-4326-9915-83c0dad56e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:25.330777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20ac4c-c4c5-4326-9915-83c0dad56e24 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:25.331262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20ac4c-c4c5-4326-9915-83c0dad56e24 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:25.331760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20ac4c-c4c5-4326-9915-83c0dad56e24 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:25.332836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20ac4c-c4c5-4326-9915-83c0dad56e24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:25.333414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20ac4c-c4c5-4326-9915-83c0dad56e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:25.335086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20ac4c-c4c5-4326-9915-83c0dad56e24 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:25.345772 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 201/407] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:25.354793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a29322-e0f2-4298-ad67-d44cec76099f None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:25.500911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20ac4c-c4c5-4326-9915-83c0dad56e24 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:25.562298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a29322-e0f2-4298-ad67-d44cec76099f None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:25.624796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17c86d-171d-450a-8b04-3a99f24e2121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:25.625854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17c86d-171d-450a-8b04-3a99f24e2121 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:25.626339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17c86d-171d-450a-8b04-3a99f24e2121 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:25.626834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17c86d-171d-450a-8b04-3a99f24e2121 None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:25.628177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17c86d-171d-450a-8b04-3a99f24e2121 None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:25.629881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17c86d-171d-450a-8b04-3a99f24e2121 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:25.631977 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 207/408] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:25 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:25.638469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17c86d-171d-450a-8b04-3a99f24e2121 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:25.695093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20ac4c-c4c5-4326-9915-83c0dad56e24 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:25.722375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:25.770878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd191b-1f19-4228-926c-8e1444e26529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:25.771413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd191b-1f19-4228-926c-8e1444e26529 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:25.771687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd191b-1f19-4228-926c-8e1444e26529 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:25.771958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd191b-1f19-4228-926c-8e1444e26529 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:25.790510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd191b-1f19-4228-926c-8e1444e26529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-24bd191b-1f19-4228-926c-8e1444e26529 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:25.796137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:25.797085 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:25.797922 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 202/409] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:10:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:25.799123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa571-d0da-413c-aa60-4e068752fd52 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:25.799203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa571-d0da-413c-aa60-4e068752fd52 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:25.800868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa571-d0da-413c-aa60-4e068752fd52 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:25.800868 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 203/410] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:25.805900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffa571-d0da-413c-aa60-4e068752fd52 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:25.823702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17c86d-171d-450a-8b04-3a99f24e2121 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:25.834598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:25.865641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af993648-18c8-4826-97bd-49f700b45bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:25.866419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af993648-18c8-4826-97bd-49f700b45bde None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:25.866700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af993648-18c8-4826-97bd-49f700b45bde None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:25.869706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af993648-18c8-4826-97bd-49f700b45bde None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:25.871024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af993648-18c8-4826-97bd-49f700b45bde None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:25.873220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af993648-18c8-4826-97bd-49f700b45bde None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:25.875200 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 208/411] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:25 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:25.876374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76849673-9d2c-40aa-a181-b21a49fe2679 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:25.876653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76849673-9d2c-40aa-a181-b21a49fe2679 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:25.876921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76849673-9d2c-40aa-a181-b21a49fe2679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:25.898220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-76849673-9d2c-40aa-a181-b21a49fe2679 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:25.899120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76849673-9d2c-40aa-a181-b21a49fe2679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:25.942466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffa571-d0da-413c-aa60-4e068752fd52 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:25.981417 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 209/412] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:25.981417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76849673-9d2c-40aa-a181-b21a49fe2679 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:25.988926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd2162-452b-46c5-8299-37ebfb32019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:25.989908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2162-452b-46c5-8299-37ebfb32019e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:25.997435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2162-452b-46c5-8299-37ebfb32019e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:25.998114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2162-452b-46c5-8299-37ebfb32019e None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:25.999143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd2162-452b-46c5-8299-37ebfb32019e None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:25.999776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd2162-452b-46c5-8299-37ebfb32019e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:26.001428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd2162-452b-46c5-8299-37ebfb32019e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:26.016569 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 204/413] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:26.022138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd2162-452b-46c5-8299-37ebfb32019e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:26.024815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:26.091614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76849673-9d2c-40aa-a181-b21a49fe2679 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:26.141960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7687d-6119-4a82-b65d-5fde1839b63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:26.142647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7687d-6119-4a82-b65d-5fde1839b63d None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:26.142933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7687d-6119-4a82-b65d-5fde1839b63d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:26.143208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7687d-6119-4a82-b65d-5fde1839b63d None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd/groups/86af3d48297045b4ba73f2c75aa4fcc6/roles/066bc2c3c4ad43baaa2e35afdba859e5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:26.147875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7687d-6119-4a82-b65d-5fde1839b63d None admin] RBAC: Authorizing `identity:create_grant(project_id=04786f98561745b7b9db0c5057cb24fd, group_id=86af3d48297045b4ba73f2c75aa4fcc6, role_id=066bc2c3c4ad43baaa2e35afdba859e5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:26.150271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7687d-6119-4a82-b65d-5fde1839b63d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:26.174980 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 210/414] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Aug 29 15:10:25 2022] PUT /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd/groups/86af3d48297045b4ba73f2c75aa4fcc6/roles/066bc2c3c4ad43baaa2e35afdba859e5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:26.194279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:26.214831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd2162-452b-46c5-8299-37ebfb32019e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:26.267357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f4f54-56a6-4202-b049-a8c3cfb1422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:26.268015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4f54-56a6-4202-b049-a8c3cfb1422f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:26.268299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4f54-56a6-4202-b049-a8c3cfb1422f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:26.268579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4f54-56a6-4202-b049-a8c3cfb1422f None admin] PATH_INFO: `/v3/groups/f3d4f15c049842fca4443a11429b5aa4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:26.274407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f4f54-56a6-4202-b049-a8c3cfb1422f None admin] RBAC: Authorizing `identity:get_group(group_id=f3d4f15c049842fca4443a11429b5aa4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:26.275843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f4f54-56a6-4202-b049-a8c3cfb1422f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:26.277878 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 205/415] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:26 2022] GET /identity/v3/groups/f3d4f15c049842fca4443a11429b5aa4 => generated 229 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:26.284015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7687d-6119-4a82-b65d-5fde1839b63d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:26.382217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f4f54-56a6-4202-b049-a8c3cfb1422f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:26.429661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7687d-6119-4a82-b65d-5fde1839b63d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:26.444464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:26.474795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053b608-e431-4df7-93b4-16f78be68bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:26.475554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b608-e431-4df7-93b4-16f78be68bd3 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:26.475830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b608-e431-4df7-93b4-16f78be68bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:26.476100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b608-e431-4df7-93b4-16f78be68bd3 None admin] PATH_INFO: `/v3/projects/981474d13fc1406aa4961a388692a3c0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:26.477280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053b608-e431-4df7-93b4-16f78be68bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=981474d13fc1406aa4961a388692a3c0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:26.479013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053b608-e431-4df7-93b4-16f78be68bd3 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:26.485618 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 211/416] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:26 2022] GET /identity/v3/projects/981474d13fc1406aa4961a388692a3c0 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:26.485618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2498b01-2e66-41dc-a306-add0ef68d128 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:26.485618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2498b01-2e66-41dc-a306-add0ef68d128 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:26.485618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2498b01-2e66-41dc-a306-add0ef68d128 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:26.485618 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 212/417] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:26.489173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2498b01-2e66-41dc-a306-add0ef68d128 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:26.539797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f4f54-56a6-4202-b049-a8c3cfb1422f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:26.581111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffa24c-53c7-42dd-adaf-b0d9f65a4d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:26.581955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffa24c-53c7-42dd-adaf-b0d9f65a4d4e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:26.582236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffa24c-53c7-42dd-adaf-b0d9f65a4d4e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:26.582508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffa24c-53c7-42dd-adaf-b0d9f65a4d4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:26.598187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffa24c-53c7-42dd-adaf-b0d9f65a4d4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-c0ffa24c-53c7-42dd-adaf-b0d9f65a4d4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:26.604364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:26.605543 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:26.606593 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 206/418] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:26.607845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71686952-454f-43b4-9ee9-c799fce0589b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:26.608126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71686952-454f-43b4-9ee9-c799fce0589b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:26.608395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71686952-454f-43b4-9ee9-c799fce0589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:26.632747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-71686952-454f-43b4-9ee9-c799fce0589b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:26.635193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-71686952-454f-43b4-9ee9-c799fce0589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:26.652273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:26.654346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2498b01-2e66-41dc-a306-add0ef68d128 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:26.693742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b36d-7f6e-4e38-98bc-52b183ca96c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:26.694667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b36d-7f6e-4e38-98bc-52b183ca96c0 None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:26.695006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b36d-7f6e-4e38-98bc-52b183ca96c0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:26.695341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b36d-7f6e-4e38-98bc-52b183ca96c0 None admin] PATH_INFO: `/v3/projects/981474d13fc1406aa4961a388692a3c0/groups/f3d4f15c049842fca4443a11429b5aa4/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:26.697666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7b36d-7f6e-4e38-98bc-52b183ca96c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=981474d13fc1406aa4961a388692a3c0, group_id=f3d4f15c049842fca4443a11429b5aa4, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:26.699398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7b36d-7f6e-4e38-98bc-52b183ca96c0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:26.720821 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 213/419] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Aug 29 15:10:26 2022] PUT /identity/v3/projects/981474d13fc1406aa4961a388692a3c0/groups/f3d4f15c049842fca4443a11429b5aa4/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:26.721809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b36d-7f6e-4e38-98bc-52b183ca96c0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:26.730410 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 207/420] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:26.777227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:26.843606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b36d-7f6e-4e38-98bc-52b183ca96c0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:26.884175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353decc3-d059-4579-87bf-db57bfeb5da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:26.884919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353decc3-d059-4579-87bf-db57bfeb5da3 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:26.885119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353decc3-d059-4579-87bf-db57bfeb5da3 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:26.885458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353decc3-d059-4579-87bf-db57bfeb5da3 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:26.886139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353decc3-d059-4579-87bf-db57bfeb5da3 None admin] RBAC: Adding query filter params (name=member) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:26.886440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353decc3-d059-4579-87bf-db57bfeb5da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:26.888332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353decc3-d059-4579-87bf-db57bfeb5da3 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:26.900182 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 214/421] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:26.906250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71686952-454f-43b4-9ee9-c799fce0589b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:27.031818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71686952-454f-43b4-9ee9-c799fce0589b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:27.051147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353decc3-d059-4579-87bf-db57bfeb5da3 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:27.071592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bec15f-8040-47c9-b00a-c7f4f4224344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:27.072544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bec15f-8040-47c9-b00a-c7f4f4224344 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:27.073019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bec15f-8040-47c9-b00a-c7f4f4224344 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:27.073578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bec15f-8040-47c9-b00a-c7f4f4224344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:27.092882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:27.189565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bec15f-8040-47c9-b00a-c7f4f4224344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:27.192999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bec15f-8040-47c9-b00a-c7f4f4224344 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:27.219396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:27.239197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353decc3-d059-4579-87bf-db57bfeb5da3 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:27.305748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c182b6-546b-4211-917a-cf5d66c4d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:27.306396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c182b6-546b-4211-917a-cf5d66c4d24f None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:27.306675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c182b6-546b-4211-917a-cf5d66c4d24f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:27.306950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c182b6-546b-4211-917a-cf5d66c4d24f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:27.331010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c182b6-546b-4211-917a-cf5d66c4d24f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-91c182b6-546b-4211-917a-cf5d66c4d24f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:27.336506 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:27.337422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:27.338249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:27.339329 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 215/422] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:10:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:27.345775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c182b6-546b-4211-917a-cf5d66c4d24f None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:27.371684 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 208/423] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:10:27.377652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bec15f-8040-47c9-b00a-c7f4f4224344 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:27.472561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:27.546350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bec15f-8040-47c9-b00a-c7f4f4224344 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:27.552470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c182b6-546b-4211-917a-cf5d66c4d24f None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:27.583152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71983b4-261c-48f1-b13c-8f57904a34c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:27.584361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71983b4-261c-48f1-b13c-8f57904a34c1 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:27.584846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71983b4-261c-48f1-b13c-8f57904a34c1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:27.585323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71983b4-261c-48f1-b13c-8f57904a34c1 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:27.587188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71983b4-261c-48f1-b13c-8f57904a34c1 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:27.588827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71983b4-261c-48f1-b13c-8f57904a34c1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:27.590779 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 209/424] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:27 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:27.596246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71983b4-261c-48f1-b13c-8f57904a34c1 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:27.629184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6d5f9-a754-44d6-98b1-dcb47f73eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:27.629948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d5f9-a754-44d6-98b1-dcb47f73eb58 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:27.630233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d5f9-a754-44d6-98b1-dcb47f73eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:27.630503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d5f9-a754-44d6-98b1-dcb47f73eb58 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:27.631208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6d5f9-a754-44d6-98b1-dcb47f73eb58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:27.631493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6d5f9-a754-44d6-98b1-dcb47f73eb58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:27.632866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6d5f9-a754-44d6-98b1-dcb47f73eb58 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:27.653804 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 216/425] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:27.658895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6d5f9-a754-44d6-98b1-dcb47f73eb58 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:27.687433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:27.717853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71983b4-261c-48f1-b13c-8f57904a34c1 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:27.735317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:27.814297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb5e7f-f66c-48e8-94d0-f56448aeb51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:27.815066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb5e7f-f66c-48e8-94d0-f56448aeb51a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:27.815357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb5e7f-f66c-48e8-94d0-f56448aeb51a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:27.815643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb5e7f-f66c-48e8-94d0-f56448aeb51a None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:27.816978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb5e7f-f66c-48e8-94d0-f56448aeb51a None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:27.818649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb5e7f-f66c-48e8-94d0-f56448aeb51a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:27.820859 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 210/426] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:27 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:27.826515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb5e7f-f66c-48e8-94d0-f56448aeb51a None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:27.826997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6d5f9-a754-44d6-98b1-dcb47f73eb58 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:27.879891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be52d9-85ea-4035-a810-a25cde93af6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:27.881461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be52d9-85ea-4035-a810-a25cde93af6a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:27.881766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be52d9-85ea-4035-a810-a25cde93af6a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:27.882154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be52d9-85ea-4035-a810-a25cde93af6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:27.959289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb5e7f-f66c-48e8-94d0-f56448aeb51a None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:27.987697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be52d9-85ea-4035-a810-a25cde93af6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:27.989796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be52d9-85ea-4035-a810-a25cde93af6a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:27.997272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35cc56-6184-4799-8724-6ff179f51db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:27.998168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35cc56-6184-4799-8724-6ff179f51db9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:27.998544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35cc56-6184-4799-8724-6ff179f51db9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:27.998983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35cc56-6184-4799-8724-6ff179f51db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:27.999827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35cc56-6184-4799-8724-6ff179f51db9 None admin] RBAC: Adding query filter params (group.id=86af3d48297045b4ba73f2c75aa4fcc6, role.id=0aaef5fae9d1491bb3548a12be30bd2d, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:28.000240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35cc56-6184-4799-8724-6ff179f51db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:28.001922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35cc56-6184-4799-8724-6ff179f51db9 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:28.003097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:28.009916 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 211/427] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Aug 29 15:10:27 2022] GET /identity/v3/role_assignments?group.id=86af3d48297045b4ba73f2c75aa4fcc6&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:28.011444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed2f4-b6f2-405c-a048-f76588bd711f None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:28.011848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed2f4-b6f2-405c-a048-f76588bd711f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:28.012290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed2f4-b6f2-405c-a048-f76588bd711f None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:28.013918 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 212/428] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:28.020085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a558-7d25-4936-84e3-311dc095c921 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:28.020509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a558-7d25-4936-84e3-311dc095c921 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:28.020874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a558-7d25-4936-84e3-311dc095c921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:28.047012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5956a558-7d25-4936-84e3-311dc095c921 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:28.048632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5956a558-7d25-4936-84e3-311dc095c921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:28.139755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:28.182515 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 217/429] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:28.189144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be52d9-85ea-4035-a810-a25cde93af6a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:28.212019 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 213/430] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:28.312994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be52d9-85ea-4035-a810-a25cde93af6a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:28.326517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:28.353453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139b4e-cbca-40e2-80eb-2e063bcc3916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:28.354078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139b4e-cbca-40e2-80eb-2e063bcc3916 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:28.354361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139b4e-cbca-40e2-80eb-2e063bcc3916 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:28.354626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139b4e-cbca-40e2-80eb-2e063bcc3916 None admin] PATH_INFO: `/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:28.355778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84139b4e-cbca-40e2-80eb-2e063bcc3916 None admin] RBAC: Authorizing `identity:get_project(project_id=e4485e8b5ef042cd959e4b6f13cd3ea9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:28.357956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84139b4e-cbca-40e2-80eb-2e063bcc3916 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:28.359939 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 218/431] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:28 2022] GET /identity/v3/projects/e4485e8b5ef042cd959e4b6f13cd3ea9 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:28.365828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a558-7d25-4936-84e3-311dc095c921 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:28.465425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b80e9-51ee-411a-8939-a8a9a09ae816 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:28.467382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b80e9-51ee-411a-8939-a8a9a09ae816 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:28.467382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b80e9-51ee-411a-8939-a8a9a09ae816 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:28.470142 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 219/432] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:28.475090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f764-68b8-46e4-b333-1cc881777b36 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:28.475538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f764-68b8-46e4-b333-1cc881777b36 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:28.475913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f764-68b8-46e4-b333-1cc881777b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:28.507697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2896f764-68b8-46e4-b333-1cc881777b36 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:28.508928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2896f764-68b8-46e4-b333-1cc881777b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:28.548266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a558-7d25-4936-84e3-311dc095c921 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:28.587837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d57d2-ccdb-4776-abee-21784a800438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:28.588611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d57d2-ccdb-4776-abee-21784a800438 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:28.588723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d57d2-ccdb-4776-abee-21784a800438 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:28.588909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d57d2-ccdb-4776-abee-21784a800438 None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:28.590088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d57d2-ccdb-4776-abee-21784a800438 None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:28.592096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d57d2-ccdb-4776-abee-21784a800438 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:28.598095 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 214/433] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:28 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:28.598095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d57d2-ccdb-4776-abee-21784a800438 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:28.601324 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 220/434] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:28.603275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f764-68b8-46e4-b333-1cc881777b36 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:28.674673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:28.754112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f764-68b8-46e4-b333-1cc881777b36 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:28.755065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d57d2-ccdb-4776-abee-21784a800438 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:28.771315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:28.807412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daab8a4-4414-4d1b-bc01-e3e4ca0c0943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:28.808114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daab8a4-4414-4d1b-bc01-e3e4ca0c0943 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:28.808425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daab8a4-4414-4d1b-bc01-e3e4ca0c0943 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:28.808762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daab8a4-4414-4d1b-bc01-e3e4ca0c0943 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:28.818186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf20f0-7e8d-4e3c-a227-efda5b0e993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:28.819453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf20f0-7e8d-4e3c-a227-efda5b0e993c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:28.820159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf20f0-7e8d-4e3c-a227-efda5b0e993c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:28.820713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf20f0-7e8d-4e3c-a227-efda5b0e993c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:28.822161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf20f0-7e8d-4e3c-a227-efda5b0e993c None admin] RBAC: Adding query filter params (group.id=86af3d48297045b4ba73f2c75aa4fcc6, role.id=066bc2c3c4ad43baaa2e35afdba859e5, scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:28.822909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf20f0-7e8d-4e3c-a227-efda5b0e993c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:28.823574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daab8a4-4414-4d1b-bc01-e3e4ca0c0943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:28.825708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf20f0-7e8d-4e3c-a227-efda5b0e993c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-8daab8a4-4414-4d1b-bc01-e3e4ca0c0943 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:28.830172 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:28.831549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:28.832345 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 215/435] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:28.839205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daab8a4-4414-4d1b-bc01-e3e4ca0c0943 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:28.847251 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 221/436] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Aug 29 15:10:28 2022] GET /identity/v3/role_assignments?group.id=86af3d48297045b4ba73f2c75aa4fcc6&scope.project.id=e4485e8b5ef042cd959e4b6f13cd3ea9&role.id=066bc2c3c4ad43baaa2e35afdba859e5 => generated 611 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:28.973337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf20f0-7e8d-4e3c-a227-efda5b0e993c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:28.994530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daab8a4-4414-4d1b-bc01-e3e4ca0c0943 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:28.998997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:29.057322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca320223-54c9-4d0e-ba31-90e4360af748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:29.060830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca320223-54c9-4d0e-ba31-90e4360af748 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:29.060830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca320223-54c9-4d0e-ba31-90e4360af748 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:29.060830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca320223-54c9-4d0e-ba31-90e4360af748 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:29.060830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca320223-54c9-4d0e-ba31-90e4360af748 None admin] RBAC: Adding query filter params (name=member) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:29.060830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca320223-54c9-4d0e-ba31-90e4360af748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:29.061667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca320223-54c9-4d0e-ba31-90e4360af748 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:29.076657 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 216/437] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:10:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:29.083218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca320223-54c9-4d0e-ba31-90e4360af748 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:29.177661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf20f0-7e8d-4e3c-a227-efda5b0e993c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:29.230208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32809e87-1f6c-435d-bb8d-b6a845c4f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:29.231133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809e87-1f6c-435d-bb8d-b6a845c4f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:29.231420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809e87-1f6c-435d-bb8d-b6a845c4f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:29.232390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809e87-1f6c-435d-bb8d-b6a845c4f5c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:29.242441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca320223-54c9-4d0e-ba31-90e4360af748 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:29.248960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32809e87-1f6c-435d-bb8d-b6a845c4f5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-32809e87-1f6c-435d-bb8d-b6a845c4f5c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:29.254500 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:29.255450 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:29.256278 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 222/438] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:10:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:29.257222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a580-62c0-437c-bd78-f0acdae28c4f None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:29.257824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a580-62c0-437c-bd78-f0acdae28c4f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:29.257824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a580-62c0-437c-bd78-f0acdae28c4f None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:29.260321 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 223/439] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:29.266515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06398eb5-4ee5-49c9-8691-0da68f6e1a7a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:29.266819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06398eb5-4ee5-49c9-8691-0da68f6e1a7a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:29.267086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06398eb5-4ee5-49c9-8691-0da68f6e1a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:29.290992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824c2ca-b8a3-4d27-a061-756be0f2e855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:29.291340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-06398eb5-4ee5-49c9-8691-0da68f6e1a7a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:29.292176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c2ca-b8a3-4d27-a061-756be0f2e855 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:29.292492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-06398eb5-4ee5-49c9-8691-0da68f6e1a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:29.292873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c2ca-b8a3-4d27-a061-756be0f2e855 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:29.293359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c2ca-b8a3-4d27-a061-756be0f2e855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:29.332285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:29.336392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:29.384477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824c2ca-b8a3-4d27-a061-756be0f2e855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:29.385012 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 224/440] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:29.385789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06398eb5-4ee5-49c9-8691-0da68f6e1a7a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:29.386188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824c2ca-b8a3-4d27-a061-756be0f2e855 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:29.521277 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 217/441] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:10:29.521691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06398eb5-4ee5-49c9-8691-0da68f6e1a7a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:29.531124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824c2ca-b8a3-4d27-a061-756be0f2e855 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:29.566332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d3a02-f60c-48c7-ba06-24d94081ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:29.567598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3a02-f60c-48c7-ba06-24d94081ac88 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:29.567875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3a02-f60c-48c7-ba06-24d94081ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:29.568145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d3a02-f60c-48c7-ba06-24d94081ac88 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:29.568829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d3a02-f60c-48c7-ba06-24d94081ac88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:29.569127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d3a02-f60c-48c7-ba06-24d94081ac88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:29.570560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d3a02-f60c-48c7-ba06-24d94081ac88 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:29.580261 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 225/442] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:29.586106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d3a02-f60c-48c7-ba06-24d94081ac88 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:29.616375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:29.631670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:29.672244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824c2ca-b8a3-4d27-a061-756be0f2e855 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:29.702091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d3a02-f60c-48c7-ba06-24d94081ac88 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:29.705297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c7ebe-8889-4851-9de4-5bec97c0234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:29.706015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7ebe-8889-4851-9de4-5bec97c0234c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:29.706289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7ebe-8889-4851-9de4-5bec97c0234c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:29.706601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7ebe-8889-4851-9de4-5bec97c0234c None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:29.707706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c7ebe-8889-4851-9de4-5bec97c0234c None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:29.709132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c7ebe-8889-4851-9de4-5bec97c0234c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:29.715249 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 218/443] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:29 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:29.715249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c7ebe-8889-4851-9de4-5bec97c0234c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:29.737073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3abb76-c84c-42ce-bcd9-c61f0a6ce1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:29.737711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3abb76-c84c-42ce-bcd9-c61f0a6ce1d0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:29.737989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3abb76-c84c-42ce-bcd9-c61f0a6ce1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:29.738262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3abb76-c84c-42ce-bcd9-c61f0a6ce1d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:29.806334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3abb76-c84c-42ce-bcd9-c61f0a6ce1d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:29.807869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3abb76-c84c-42ce-bcd9-c61f0a6ce1d0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:29.816396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c7ebe-8889-4851-9de4-5bec97c0234c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:29.836480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:29.853515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:29.860327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3680ef6-7f2a-4f1f-80aa-db740fc7ed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:29.860998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680ef6-7f2a-4f1f-80aa-db740fc7ed5a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:29.861310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680ef6-7f2a-4f1f-80aa-db740fc7ed5a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:29.861663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680ef6-7f2a-4f1f-80aa-db740fc7ed5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:29.873123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3680ef6-7f2a-4f1f-80aa-db740fc7ed5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-f3680ef6-7f2a-4f1f-80aa-db740fc7ed5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:29.878770 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:29.879748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:29.880573 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 219/444] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:10:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:29.881333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3680ef6-7f2a-4f1f-80aa-db740fc7ed5a None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:29.928788 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 226/445] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:10:29.929699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3abb76-c84c-42ce-bcd9-c61f0a6ce1d0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:29.996014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3680ef6-7f2a-4f1f-80aa-db740fc7ed5a None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:30.034226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f0b77-a4f2-40ca-9f54-7cea1c26f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:30.034848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0b77-a4f2-40ca-9f54-7cea1c26f119 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:30.035132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0b77-a4f2-40ca-9f54-7cea1c26f119 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:30.036108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0b77-a4f2-40ca-9f54-7cea1c26f119 None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:30.036555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f0b77-a4f2-40ca-9f54-7cea1c26f119 None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:30.038036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f0b77-a4f2-40ca-9f54-7cea1c26f119 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:30.039612 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 220/446] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:29 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:30.040375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f0b77-a4f2-40ca-9f54-7cea1c26f119 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:30.041401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3abb76-c84c-42ce-bcd9-c61f0a6ce1d0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:30.076432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:30.088276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a6af2-e70e-42df-a607-1e5b71de77fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:30.088915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a6af2-e70e-42df-a607-1e5b71de77fc None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:30.089186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a6af2-e70e-42df-a607-1e5b71de77fc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:30.089488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a6af2-e70e-42df-a607-1e5b71de77fc None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:30.090154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a6af2-e70e-42df-a607-1e5b71de77fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:30.090450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a6af2-e70e-42df-a607-1e5b71de77fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:30.091853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a6af2-e70e-42df-a607-1e5b71de77fc None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:30.101949 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 227/447] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:30.102949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a6af2-e70e-42df-a607-1e5b71de77fc None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:30.110418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:30.154777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f0b77-a4f2-40ca-9f54-7cea1c26f119 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:30.192425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551869a2-0e9d-410b-ad8b-98c02aea6942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:30.193050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551869a2-0e9d-410b-ad8b-98c02aea6942 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:30.193325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551869a2-0e9d-410b-ad8b-98c02aea6942 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:30.193632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551869a2-0e9d-410b-ad8b-98c02aea6942 None admin] PATH_INFO: `/v3/projects/04786f98561745b7b9db0c5057cb24fd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:30.194761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551869a2-0e9d-410b-ad8b-98c02aea6942 None admin] RBAC: Authorizing `identity:get_project(project_id=04786f98561745b7b9db0c5057cb24fd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:30.196213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551869a2-0e9d-410b-ad8b-98c02aea6942 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:30.197892 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 221/448] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:30 2022] GET /identity/v3/projects/04786f98561745b7b9db0c5057cb24fd => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:30.198669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551869a2-0e9d-410b-ad8b-98c02aea6942 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:30.220900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a6af2-e70e-42df-a607-1e5b71de77fc None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:30.262429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2aa20-e55d-4322-b79c-7f58d73dfa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:30.263618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2aa20-e55d-4322-b79c-7f58d73dfa54 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:30.263900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2aa20-e55d-4322-b79c-7f58d73dfa54 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:30.264175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2aa20-e55d-4322-b79c-7f58d73dfa54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:30.264911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2aa20-e55d-4322-b79c-7f58d73dfa54 None admin] RBAC: Adding query filter params (group.id=86af3d48297045b4ba73f2c75aa4fcc6, role.id=0aaef5fae9d1491bb3548a12be30bd2d, scope.project.id=04786f98561745b7b9db0c5057cb24fd) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:30.265222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2aa20-e55d-4322-b79c-7f58d73dfa54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:30.266710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2aa20-e55d-4322-b79c-7f58d73dfa54 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:30.273062 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 228/449] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Aug 29 15:10:30 2022] GET /identity/v3/role_assignments?group.id=86af3d48297045b4ba73f2c75aa4fcc6&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=0aaef5fae9d1491bb3548a12be30bd2d => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:30.273651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2aa20-e55d-4322-b79c-7f58d73dfa54 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:30.342558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551869a2-0e9d-410b-ad8b-98c02aea6942 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:30.351306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:30.376980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:30.392556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae011ec-06a5-4b9b-ac1a-dbb051125e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:30.393955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae011ec-06a5-4b9b-ac1a-dbb051125e50 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:30.394673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae011ec-06a5-4b9b-ac1a-dbb051125e50 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:30.395111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae011ec-06a5-4b9b-ac1a-dbb051125e50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:30.423404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2aa20-e55d-4322-b79c-7f58d73dfa54 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:30.472864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ee355-0b75-4d62-b9a2-b5b89e3b625e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:30.473721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ee355-0b75-4d62-b9a2-b5b89e3b625e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:30.474187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ee355-0b75-4d62-b9a2-b5b89e3b625e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:30.474617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ee355-0b75-4d62-b9a2-b5b89e3b625e None admin] PATH_INFO: `/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:30.476535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ee355-0b75-4d62-b9a2-b5b89e3b625e None admin] RBAC: Authorizing `identity:get_group(group_id=86af3d48297045b4ba73f2c75aa4fcc6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:30.478662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ee355-0b75-4d62-b9a2-b5b89e3b625e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:30.480942 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 229/450] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:30 2022] GET /identity/v3/groups/86af3d48297045b4ba73f2c75aa4fcc6 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:30.487866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ee355-0b75-4d62-b9a2-b5b89e3b625e None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:30.498445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae011ec-06a5-4b9b-ac1a-dbb051125e50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:30.499936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae011ec-06a5-4b9b-ac1a-dbb051125e50 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:30.641534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ee355-0b75-4d62-b9a2-b5b89e3b625e None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:30.645960 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 222/451] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:30.656452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae011ec-06a5-4b9b-ac1a-dbb051125e50 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:30.684806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:30.692819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:30.715454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38c4cc-31f9-469a-8cc6-428bac64e369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:30.716731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38c4cc-31f9-469a-8cc6-428bac64e369 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:30.717012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38c4cc-31f9-469a-8cc6-428bac64e369 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:30.717292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38c4cc-31f9-469a-8cc6-428bac64e369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:30.718080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38c4cc-31f9-469a-8cc6-428bac64e369 None admin] RBAC: Adding query filter params (group.id=86af3d48297045b4ba73f2c75aa4fcc6, role.id=066bc2c3c4ad43baaa2e35afdba859e5, scope.project.id=04786f98561745b7b9db0c5057cb24fd) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:30.718394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38c4cc-31f9-469a-8cc6-428bac64e369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:30.719870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38c4cc-31f9-469a-8cc6-428bac64e369 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:30.726457 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 230/452] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Aug 29 15:10:30 2022] GET /identity/v3/role_assignments?group.id=86af3d48297045b4ba73f2c75aa4fcc6&scope.project.id=04786f98561745b7b9db0c5057cb24fd&role.id=066bc2c3c4ad43baaa2e35afdba859e5 => generated 611 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:30.783731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae011ec-06a5-4b9b-ac1a-dbb051125e50 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:30.822445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b4412-da46-4901-8144-09946f5ec56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:30.823364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b4412-da46-4901-8144-09946f5ec56f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:30.823364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b4412-da46-4901-8144-09946f5ec56f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:30.823613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b4412-da46-4901-8144-09946f5ec56f None admin] PATH_INFO: `/v3/projects/981474d13fc1406aa4961a388692a3c0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:30.824804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b4412-da46-4901-8144-09946f5ec56f None admin] RBAC: Authorizing `identity:get_project(project_id=981474d13fc1406aa4961a388692a3c0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:30.826862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b4412-da46-4901-8144-09946f5ec56f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:30.828538 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 223/453] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:10:30 2022] GET /identity/v3/projects/981474d13fc1406aa4961a388692a3c0 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:30.834363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38c4cc-31f9-469a-8cc6-428bac64e369 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:30.940557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38c4cc-31f9-469a-8cc6-428bac64e369 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:30.978899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33cc40-18a0-4a67-aa99-235eef1f6dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:30.979549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33cc40-18a0-4a67-aa99-235eef1f6dc2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:30.979828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33cc40-18a0-4a67-aa99-235eef1f6dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:30.980106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33cc40-18a0-4a67-aa99-235eef1f6dc2 None admin] PATH_INFO: `/v3/groups/f3d4f15c049842fca4443a11429b5aa4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:30.981263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33cc40-18a0-4a67-aa99-235eef1f6dc2 None admin] RBAC: Authorizing `identity:get_group(group_id=f3d4f15c049842fca4443a11429b5aa4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:30.982841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33cc40-18a0-4a67-aa99-235eef1f6dc2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:30.984860 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 231/454] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Aug 29 15:10:30 2022] GET /identity/v3/groups/f3d4f15c049842fca4443a11429b5aa4 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:30.993573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b4412-da46-4901-8144-09946f5ec56f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:31.130954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:31.139080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b4412-da46-4901-8144-09946f5ec56f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:31.174377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645b80-8bce-47ba-999c-41bb4813c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:31.174984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645b80-8bce-47ba-999c-41bb4813c23e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:31.175265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645b80-8bce-47ba-999c-41bb4813c23e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:31.175540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645b80-8bce-47ba-999c-41bb4813c23e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:31.176277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645b80-8bce-47ba-999c-41bb4813c23e None admin] RBAC: Adding query filter params (group.id=f3d4f15c049842fca4443a11429b5aa4, role.id=be89abac608f45a6921181bcc574f721, scope.project.id=981474d13fc1406aa4961a388692a3c0) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:31.176592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645b80-8bce-47ba-999c-41bb4813c23e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:31.178066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645b80-8bce-47ba-999c-41bb4813c23e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:31.184411 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 224/455] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Aug 29 15:10:30 2022] GET /identity/v3/role_assignments?group.id=f3d4f15c049842fca4443a11429b5aa4&scope.project.id=981474d13fc1406aa4961a388692a3c0&role.id=be89abac608f45a6921181bcc574f721 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:33.871144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7900e-6a7b-43ed-be25-0950e28caa39 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:33.871636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7900e-6a7b-43ed-be25-0950e28caa39 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:33.871636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7900e-6a7b-43ed-be25-0950e28caa39 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:33.873807 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 232/456] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:33.879788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862d2a-dfd3-4bf5-a09e-42b30402b055 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:33.880704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862d2a-dfd3-4bf5-a09e-42b30402b055 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:33.881180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862d2a-dfd3-4bf5-a09e-42b30402b055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:33.910994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-91862d2a-dfd3-4bf5-a09e-42b30402b055 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:33.912570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-91862d2a-dfd3-4bf5-a09e-42b30402b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:34.013654 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 225/457] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:34.112194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa24874-7f3c-4b4c-a9db-4927724da085 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:34.112822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa24874-7f3c-4b4c-a9db-4927724da085 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:34.113322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa24874-7f3c-4b4c-a9db-4927724da085 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:34.115157 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 233/458] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:34.120227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7770-122e-435b-8921-dfd8a9cce7a2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:34.120514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7770-122e-435b-8921-dfd8a9cce7a2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:34.120789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7770-122e-435b-8921-dfd8a9cce7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:34.146551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e40b7770-122e-435b-8921-dfd8a9cce7a2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:34.147671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e40b7770-122e-435b-8921-dfd8a9cce7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:34.243473 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 226/459] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:34.302139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e979f88-96f2-485b-bc8b-fa27014be33f None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:34.302774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e979f88-96f2-485b-bc8b-fa27014be33f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:34.303254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e979f88-96f2-485b-bc8b-fa27014be33f None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:34.305029 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 234/460] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:34.310922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103e24b-8161-487d-baa3-b3a3f8cd8150 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:34.311199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103e24b-8161-487d-baa3-b3a3f8cd8150 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:34.311476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103e24b-8161-487d-baa3-b3a3f8cd8150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:34.342577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7103e24b-8161-487d-baa3-b3a3f8cd8150 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:34.343808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7103e24b-8161-487d-baa3-b3a3f8cd8150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:34.363341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:34.430970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e979f88-96f2-485b-bc8b-fa27014be33f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:34.458856 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 227/461] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:34.531226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:34.611052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e979f88-96f2-485b-bc8b-fa27014be33f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:34.615956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103e24b-8161-487d-baa3-b3a3f8cd8150 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:34.653109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa6256-e7df-4aeb-94b7-9bcb1eb40903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:34.654608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa6256-e7df-4aeb-94b7-9bcb1eb40903 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:34.655069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa6256-e7df-4aeb-94b7-9bcb1eb40903 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:34.655530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa6256-e7df-4aeb-94b7-9bcb1eb40903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:34.666839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa6256-e7df-4aeb-94b7-9bcb1eb40903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:34.668302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa6256-e7df-4aeb-94b7-9bcb1eb40903 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-6ffa6256-e7df-4aeb-94b7-9bcb1eb40903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:34.684355 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:34.685877 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:34.687429 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:34.687429 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:34.687429 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:34.687429 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 235/462] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:34.694434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa6256-e7df-4aeb-94b7-9bcb1eb40903 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:34.778924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103e24b-8161-487d-baa3-b3a3f8cd8150 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:34.820227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb28763-5f60-432e-a957-94128db8c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:34.820864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28763-5f60-432e-a957-94128db8c3bc None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:34.821562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28763-5f60-432e-a957-94128db8c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:34.821562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28763-5f60-432e-a957-94128db8c3bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:34.833367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb28763-5f60-432e-a957-94128db8c3bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:34.835335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb28763-5f60-432e-a957-94128db8c3bc None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:34.837786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa6256-e7df-4aeb-94b7-9bcb1eb40903 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:34.839782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-7eb28763-5f60-432e-a957-94128db8c3bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:34.853819 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:34.854845 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:34.856241 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:34.856241 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:34.856241 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:34.856241 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 228/463] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:34.857125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7341ca1-1096-4a48-9283-ed4da5be6ed4 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:34.857513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7341ca1-1096-4a48-9283-ed4da5be6ed4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:34.858672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7341ca1-1096-4a48-9283-ed4da5be6ed4 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:34.860428 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 229/464] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:34.860428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7341ca1-1096-4a48-9283-ed4da5be6ed4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:34.863466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:34.887085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4880-a87d-400e-acfd-09a775a070ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:34.887766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4880-a87d-400e-acfd-09a775a070ce None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:34.888117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4880-a87d-400e-acfd-09a775a070ce None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:34.888497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4880-a87d-400e-acfd-09a775a070ce None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:34.889220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d4880-a87d-400e-acfd-09a775a070ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:34.889561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d4880-a87d-400e-acfd-09a775a070ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:34.891047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d4880-a87d-400e-acfd-09a775a070ce None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:34.907670 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 236/465] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:34.908483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4880-a87d-400e-acfd-09a775a070ce None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:34.980722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7341ca1-1096-4a48-9283-ed4da5be6ed4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:35.016343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe5747-cd09-428e-9f92-5caa34bdbf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:35.016968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe5747-cd09-428e-9f92-5caa34bdbf65 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:35.017255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe5747-cd09-428e-9f92-5caa34bdbf65 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:35.017549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe5747-cd09-428e-9f92-5caa34bdbf65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:35.023956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4880-a87d-400e-acfd-09a775a070ce None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:35.029185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe5747-cd09-428e-9f92-5caa34bdbf65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:35.030702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe5747-cd09-428e-9f92-5caa34bdbf65 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-aafe5747-cd09-428e-9f92-5caa34bdbf65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:35.045684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:35.046719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:35.047952 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:35.047952 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:35.047952 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:35.047952 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 230/466] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:35.048262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5077cb1-c352-49c8-8442-9c1500e14aca None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:35.048546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5077cb1-c352-49c8-8442-9c1500e14aca None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:35.048822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5077cb1-c352-49c8-8442-9c1500e14aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:35.059878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fff250-aba3-4e12-b335-db1ede1de88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:35.060487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fff250-aba3-4e12-b335-db1ede1de88c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:35.060761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fff250-aba3-4e12-b335-db1ede1de88c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:35.061035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fff250-aba3-4e12-b335-db1ede1de88c None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:35.061715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fff250-aba3-4e12-b335-db1ede1de88c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:35.062014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fff250-aba3-4e12-b335-db1ede1de88c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:35.063384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fff250-aba3-4e12-b335-db1ede1de88c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:35.067041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c5077cb1-c352-49c8-8442-9c1500e14aca None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:35.068217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c5077cb1-c352-49c8-8442-9c1500e14aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:35.074707 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 237/467] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:35.076808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fff250-aba3-4e12-b335-db1ede1de88c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:35.104063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:35.119913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:35.140827 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 231/468] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:35.142122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272c022-43e4-4d78-9165-8234f123a3c5 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:35.142408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272c022-43e4-4d78-9165-8234f123a3c5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:35.142684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272c022-43e4-4d78-9165-8234f123a3c5 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:35.143918 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 232/469] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:35.144695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272c022-43e4-4d78-9165-8234f123a3c5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:35.183579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fff250-aba3-4e12-b335-db1ede1de88c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:35.228082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ad9fa-3349-4370-b9d8-d7dddd01aaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:35.229082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ad9fa-3349-4370-b9d8-d7dddd01aaa1 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:35.229600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ad9fa-3349-4370-b9d8-d7dddd01aaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:35.230050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ad9fa-3349-4370-b9d8-d7dddd01aaa1 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:35.230917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ad9fa-3349-4370-b9d8-d7dddd01aaa1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:35.232721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ad9fa-3349-4370-b9d8-d7dddd01aaa1 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:35.263639 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 238/470] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:10:35 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:10:35.264633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ad9fa-3349-4370-b9d8-d7dddd01aaa1 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:35.295901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272c022-43e4-4d78-9165-8234f123a3c5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:35.350332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac0f88-25bf-4e96-b3ca-109cb110851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:35.351744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac0f88-25bf-4e96-b3ca-109cb110851b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:35.352086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac0f88-25bf-4e96-b3ca-109cb110851b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:35.352417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac0f88-25bf-4e96-b3ca-109cb110851b None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:35.353090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac0f88-25bf-4e96-b3ca-109cb110851b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:35.353422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac0f88-25bf-4e96-b3ca-109cb110851b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:35.355309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac0f88-25bf-4e96-b3ca-109cb110851b None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:35.368213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:35.377573 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 233/471] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:35.379438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387484-e21a-475b-9416-77f210df011a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:35.379963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387484-e21a-475b-9416-77f210df011a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:35.380885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387484-e21a-475b-9416-77f210df011a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:35.406267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ad9fa-3349-4370-b9d8-d7dddd01aaa1 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:35.406592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a6387484-e21a-475b-9416-77f210df011a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:35.407741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a6387484-e21a-475b-9416-77f210df011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:35.451814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80b842-dc82-4873-9920-a33e44d14c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:35.452432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80b842-dc82-4873-9920-a33e44d14c26 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:35.452716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80b842-dc82-4873-9920-a33e44d14c26 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:35.452990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80b842-dc82-4873-9920-a33e44d14c26 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:35.453684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80b842-dc82-4873-9920-a33e44d14c26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:35.455129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80b842-dc82-4873-9920-a33e44d14c26 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:35.458891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:35.482641 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 239/472] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:10:35 2022] POST /identity/v3/users => generated 246 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:10:35.483417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80b842-dc82-4873-9920-a33e44d14c26 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:35.504078 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 234/473] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:35.506890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6387484-e21a-475b-9416-77f210df011a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:35.672013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80b842-dc82-4873-9920-a33e44d14c26 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:35.687713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6387484-e21a-475b-9416-77f210df011a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:35.711898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a1815-adbc-4f15-bcc4-04b5e6d29d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:35.712560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a1815-adbc-4f15-bcc4-04b5e6d29d8b None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:35.712842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a1815-adbc-4f15-bcc4-04b5e6d29d8b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:35.713116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a1815-adbc-4f15-bcc4-04b5e6d29d8b None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:35.713925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a1815-adbc-4f15-bcc4-04b5e6d29d8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:35.715397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a1815-adbc-4f15-bcc4-04b5e6d29d8b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:35.724677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:35.734520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df7384-bae3-402e-a335-b6b62099e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:35.735232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7384-bae3-402e-a335-b6b62099e860 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:35.735507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7384-bae3-402e-a335-b6b62099e860 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:35.735788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7384-bae3-402e-a335-b6b62099e860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:35.744322 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 240/474] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:10:35 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:10:35.749627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df7384-bae3-402e-a335-b6b62099e860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:35.751576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df7384-bae3-402e-a335-b6b62099e860 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-f0df7384-bae3-402e-a335-b6b62099e860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:35.770699 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:35.771719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:35.772704 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:35.772704 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:35.772704 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:35.772704 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 235/475] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:35.780447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a1815-adbc-4f15-bcc4-04b5e6d29d8b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:35.888795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df7384-bae3-402e-a335-b6b62099e860 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:35.913937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a1815-adbc-4f15-bcc4-04b5e6d29d8b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:35.931445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:35.963375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87893bd6-e3f3-4b98-b036-3dd83e0c6700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:35.964315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87893bd6-e3f3-4b98-b036-3dd83e0c6700 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:35.965233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87893bd6-e3f3-4b98-b036-3dd83e0c6700 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:35.965778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87893bd6-e3f3-4b98-b036-3dd83e0c6700 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:35.966889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87893bd6-e3f3-4b98-b036-3dd83e0c6700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:35.967507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87893bd6-e3f3-4b98-b036-3dd83e0c6700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:35.969644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87893bd6-e3f3-4b98-b036-3dd83e0c6700 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:35.985136 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 241/476] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:35.994019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87893bd6-e3f3-4b98-b036-3dd83e0c6700 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:36.037983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df7384-bae3-402e-a335-b6b62099e860 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:36.095673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:36.095863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e403a2-200b-4c26-8f6c-3b12b0dbea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:36.096265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e403a2-200b-4c26-8f6c-3b12b0dbea71 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:36.096599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e403a2-200b-4c26-8f6c-3b12b0dbea71 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:36.097167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e403a2-200b-4c26-8f6c-3b12b0dbea71 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:36.100244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e403a2-200b-4c26-8f6c-3b12b0dbea71 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:36.101955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e403a2-200b-4c26-8f6c-3b12b0dbea71 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:36.114070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.sql.core [None req-82e403a2-200b-4c26-8f6c-3b12b0dbea71 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 15:10:36.114070 n-d-854882-3 devstack@keystone.service[89681]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 15:10:36.114070 n-d-854882-3 devstack@keystone.service[89681]: [parameters: {'id': 'e7abe53cb9b64a3a896badfcc1055d4f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 15:10:36.114070 n-d-854882-3 devstack@keystone.service[89681]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89681) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-82e403a2-200b-4c26-8f6c-3b12b0dbea71 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application result.read() Aug 29 15:10:36.137133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:10:36.138189 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application yield resource Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise self.value Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application session.commit() Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 15:10:36.139137 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.session.flush() Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application compat.raise_( Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:10:36.140004 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:10:36.140887 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application result.read() Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:10:36.143190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [parameters: {'id': 'e7abe53cb9b64a3a896badfcc1055d4f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:36.144989 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 15:10:36.146903 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:36.148626 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 236/477] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Aug 29 15:10:35 2022] POST /identity/v3/roles => generated 144 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:36.148626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e403a2-200b-4c26-8f6c-3b12b0dbea71 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:36.160043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87893bd6-e3f3-4b98-b036-3dd83e0c6700 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:36.209382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de97f5-184b-45aa-a59d-49ccda3bf1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:36.210883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de97f5-184b-45aa-a59d-49ccda3bf1d2 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:36.211494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de97f5-184b-45aa-a59d-49ccda3bf1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:36.212066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de97f5-184b-45aa-a59d-49ccda3bf1d2 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:36.213172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de97f5-184b-45aa-a59d-49ccda3bf1d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:36.215254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de97f5-184b-45aa-a59d-49ccda3bf1d2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:36.244935 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 242/478] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:10:35 2022] POST /identity/v3/users => generated 249 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:10:36.288862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:36.304524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e403a2-200b-4c26-8f6c-3b12b0dbea71 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:36.357680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1379d-2464-4022-8b12-922efe590399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:36.358330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1379d-2464-4022-8b12-922efe590399 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:36.358626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1379d-2464-4022-8b12-922efe590399 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:36.358875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1379d-2464-4022-8b12-922efe590399 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:36.382169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1379d-2464-4022-8b12-922efe590399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-69a1379d-2464-4022-8b12-922efe590399 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:36.387775 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:36.388844 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 15:10:36.389720 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:36.393601 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 237/479] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:10:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:36.395285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de97f5-184b-45aa-a59d-49ccda3bf1d2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:36.582684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de97f5-184b-45aa-a59d-49ccda3bf1d2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:36.590469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:36.621855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed313f-2e68-453f-8ca2-b9cc99c5dd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:36.622587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed313f-2e68-453f-8ca2-b9cc99c5dd10 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:36.622868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed313f-2e68-453f-8ca2-b9cc99c5dd10 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:36.623197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed313f-2e68-453f-8ca2-b9cc99c5dd10 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:36.623937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed313f-2e68-453f-8ca2-b9cc99c5dd10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:36.624242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed313f-2e68-453f-8ca2-b9cc99c5dd10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:36.625632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed313f-2e68-453f-8ca2-b9cc99c5dd10 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:36.634665 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 243/480] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:37.572467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce28707-e6bc-432e-9892-0db45b71250a None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:37.573491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce28707-e6bc-432e-9892-0db45b71250a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:37.574017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce28707-e6bc-432e-9892-0db45b71250a None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:37.576044 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 238/481] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:37.581101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddeda8-ffe7-45dc-91d8-6b3cff8e901d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:37.581555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddeda8-ffe7-45dc-91d8-6b3cff8e901d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:37.581730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddeda8-ffe7-45dc-91d8-6b3cff8e901d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:37.610480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-bcddeda8-ffe7-45dc-91d8-6b3cff8e901d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:37.612164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bcddeda8-ffe7-45dc-91d8-6b3cff8e901d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:37.701169 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 244/482] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:38.061785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce28707-e6bc-432e-9892-0db45b71250a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:38.100160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72aa1c-412b-4524-87ae-2f1dbf99393e None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:38.100477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72aa1c-412b-4524-87ae-2f1dbf99393e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:38.100713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72aa1c-412b-4524-87ae-2f1dbf99393e None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:38.104974 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 245/483] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:38.116363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f83a5-e39c-481c-ae84-7e7ecd3f69b4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:38.116685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f83a5-e39c-481c-ae84-7e7ecd3f69b4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:38.116920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f83a5-e39c-481c-ae84-7e7ecd3f69b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:38.152510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6e3f83a5-e39c-481c-ae84-7e7ecd3f69b4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:38.155076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6e3f83a5-e39c-481c-ae84-7e7ecd3f69b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:38.244692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce28707-e6bc-432e-9892-0db45b71250a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:38.258574 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 246/484] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:38.260254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c1e7-dbab-4fc3-a432-d025c57508e4 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:38.260833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c1e7-dbab-4fc3-a432-d025c57508e4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:38.261304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c1e7-dbab-4fc3-a432-d025c57508e4 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:38.262973 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 247/485] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:38.269547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76d75-5176-4633-8d57-e98b8bd9b3b4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:38.270141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76d75-5176-4633-8d57-e98b8bd9b3b4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:38.270676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76d75-5176-4633-8d57-e98b8bd9b3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:38.285898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5871e-14f9-48ca-bd20-f89af494e039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:38.286548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5871e-14f9-48ca-bd20-f89af494e039 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:38.286826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5871e-14f9-48ca-bd20-f89af494e039 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:38.287098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5871e-14f9-48ca-bd20-f89af494e039 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:38.297000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4ae76d75-5176-4633-8d57-e98b8bd9b3b4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:38.298639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4ae76d75-5176-4633-8d57-e98b8bd9b3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:38.304144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5871e-14f9-48ca-bd20-f89af494e039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-73e5871e-14f9-48ca-bd20-f89af494e039 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:38.310424 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:38.311454 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:38.312360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:38.317554 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 239/486] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:38.320132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5871e-14f9-48ca-bd20-f89af494e039 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:38.337589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:38.341650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:38.394804 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 248/487] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:38.477282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5871e-14f9-48ca-bd20-f89af494e039 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:38.514899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b6c2f-d54c-4859-94b0-2095d6ca8c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:38.515875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b6c2f-d54c-4859-94b0-2095d6ca8c9b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:38.516426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b6c2f-d54c-4859-94b0-2095d6ca8c9b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:38.516899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b6c2f-d54c-4859-94b0-2095d6ca8c9b None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:38.517807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b6c2f-d54c-4859-94b0-2095d6ca8c9b None admin] RBAC: Adding query filter params (name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:38.518349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b6c2f-d54c-4859-94b0-2095d6ca8c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:38.519991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b6c2f-d54c-4859-94b0-2095d6ca8c9b None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:38.530541 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 240/488] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:38.538581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76d75-5176-4633-8d57-e98b8bd9b3b4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:38.653319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b6c2f-d54c-4859-94b0-2095d6ca8c9b None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:38.689606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76d75-5176-4633-8d57-e98b8bd9b3b4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:38.751385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258a632-743e-49e7-a4e3-e9010f31ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:38.752189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a632-743e-49e7-a4e3-e9010f31ed0c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:38.752865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a632-743e-49e7-a4e3-e9010f31ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:38.753170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a632-743e-49e7-a4e3-e9010f31ed0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:38.765960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258a632-743e-49e7-a4e3-e9010f31ed0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:38.767929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258a632-743e-49e7-a4e3-e9010f31ed0c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-d258a632-743e-49e7-a4e3-e9010f31ed0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:38.785957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:38.787908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:38.789582 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:38.789582 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:38.789582 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:38.789582 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 249/489] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:38.789582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258a632-743e-49e7-a4e3-e9010f31ed0c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:38.797884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:38.804424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:38.835725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b6c2f-d54c-4859-94b0-2095d6ca8c9b None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:38.877125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce2dba-fc98-4716-b581-75d0bf9d9a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:38.878206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce2dba-fc98-4716-b581-75d0bf9d9a73 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:38.878728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce2dba-fc98-4716-b581-75d0bf9d9a73 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:38.879244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce2dba-fc98-4716-b581-75d0bf9d9a73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:38.892234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce2dba-fc98-4716-b581-75d0bf9d9a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-b2ce2dba-fc98-4716-b581-75d0bf9d9a73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:38.898611 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:38.899549 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:38.900357 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:38.903115 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 241/490] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:38.904936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce2dba-fc98-4716-b581-75d0bf9d9a73 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:38.919675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258a632-743e-49e7-a4e3-e9010f31ed0c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:38.977001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34bad0-b484-4f1b-a04a-7cf361f0dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:38.978149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34bad0-b484-4f1b-a04a-7cf361f0dd59 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:38.978635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34bad0-b484-4f1b-a04a-7cf361f0dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:38.979106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34bad0-b484-4f1b-a04a-7cf361f0dd59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:38.992894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34bad0-b484-4f1b-a04a-7cf361f0dd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-0e34bad0-b484-4f1b-a04a-7cf361f0dd59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:38.999060 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:39.000017 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:39.000881 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:39.008170 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 250/491] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:39.009608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34bad0-b484-4f1b-a04a-7cf361f0dd59 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:39.026116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce2dba-fc98-4716-b581-75d0bf9d9a73 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:39.063250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:39.070351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b351d67-632c-487e-b5c1-8c3f8e3976d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:39.070959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351d67-632c-487e-b5c1-8c3f8e3976d0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.071300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351d67-632c-487e-b5c1-8c3f8e3976d0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.071904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351d67-632c-487e-b5c1-8c3f8e3976d0 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.072561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b351d67-632c-487e-b5c1-8c3f8e3976d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:39.072874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b351d67-632c-487e-b5c1-8c3f8e3976d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:39.074283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b351d67-632c-487e-b5c1-8c3f8e3976d0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:39.089586 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 242/492] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:39.091394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b351d67-632c-487e-b5c1-8c3f8e3976d0 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:39.114709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:39.168103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34bad0-b484-4f1b-a04a-7cf361f0dd59 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:39.206534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a4b05-204b-491b-adfa-6605a16b1183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:39.207157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4b05-204b-491b-adfa-6605a16b1183 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.207442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4b05-204b-491b-adfa-6605a16b1183 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.207722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4b05-204b-491b-adfa-6605a16b1183 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.208402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a4b05-204b-491b-adfa-6605a16b1183 None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:39.208711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a4b05-204b-491b-adfa-6605a16b1183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:39.210178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a4b05-204b-491b-adfa-6605a16b1183 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:39.230697 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 251/493] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:39.230697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724d7ec-ce3b-4794-8406-e895805486d0 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.230697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724d7ec-ce3b-4794-8406-e895805486d0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.230697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724d7ec-ce3b-4794-8406-e895805486d0 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.230697 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 252/494] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:39.230697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724d7ec-ce3b-4794-8406-e895805486d0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:39.247049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b351d67-632c-487e-b5c1-8c3f8e3976d0 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:39.288474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd6b72-9711-4d54-a7bf-b485414f0823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:39.289083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6b72-9711-4d54-a7bf-b485414f0823 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.289365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6b72-9711-4d54-a7bf-b485414f0823 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.289657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6b72-9711-4d54-a7bf-b485414f0823 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.290316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd6b72-9711-4d54-a7bf-b485414f0823 None admin] RBAC: Adding query filter params (name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:39.290618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd6b72-9711-4d54-a7bf-b485414f0823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:39.292007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd6b72-9711-4d54-a7bf-b485414f0823 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:39.306829 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 243/495] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:39.312320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd6b72-9711-4d54-a7bf-b485414f0823 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:39.365776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724d7ec-ce3b-4794-8406-e895805486d0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:39.373917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:39.401194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:39.408587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065e710-1a6f-4ef0-9ddd-7f8b9239cc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:39.409635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065e710-1a6f-4ef0-9ddd-7f8b9239cc57 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.409916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065e710-1a6f-4ef0-9ddd-7f8b9239cc57 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.410335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065e710-1a6f-4ef0-9ddd-7f8b9239cc57 None admin] PATH_INFO: `/v3/users/glance` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.418395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065e710-1a6f-4ef0-9ddd-7f8b9239cc57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:39.420320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065e710-1a6f-4ef0-9ddd-7f8b9239cc57 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:39.430445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd6b72-9711-4d54-a7bf-b485414f0823 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-d065e710-1a6f-4ef0-9ddd-7f8b9239cc57 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:39.437075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:39.438217 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:39.439349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:39.439349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:39.439349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:39.439349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:39.439349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:39.439349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:39.439349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:39.439349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:39.439349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:10:39.439349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:39.446054 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 253/496] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:39.446054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d593c-0894-4c20-985d-247ce6da28ab None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.446054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d593c-0894-4c20-985d-247ce6da28ab None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.446054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d593c-0894-4c20-985d-247ce6da28ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.461025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9e0d593c-0894-4c20-985d-247ce6da28ab None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:39.462425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9e0d593c-0894-4c20-985d-247ce6da28ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:39.473632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef79d7-cbba-4ddb-abeb-93a1213f38d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:39.474254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef79d7-cbba-4ddb-abeb-93a1213f38d9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.474529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef79d7-cbba-4ddb-abeb-93a1213f38d9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.474795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef79d7-cbba-4ddb-abeb-93a1213f38d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.486669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef79d7-cbba-4ddb-abeb-93a1213f38d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:39.488203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef79d7-cbba-4ddb-abeb-93a1213f38d9 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-7bef79d7-cbba-4ddb-abeb-93a1213f38d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:39.504132 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:39.505090 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:39.505990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:39.505990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:39.505990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:39.505990 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 244/497] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:39.506205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef79d7-cbba-4ddb-abeb-93a1213f38d9 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:39.548756 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 254/498] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:39.549685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d593c-0894-4c20-985d-247ce6da28ab None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:39.623597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef79d7-cbba-4ddb-abeb-93a1213f38d9 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:39.631600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:39.653430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d593c-0894-4c20-985d-247ce6da28ab None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:39.661175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e7982-25e7-4f38-825b-013bbf83d4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:39.662041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7982-25e7-4f38-825b-013bbf83d4e3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.662374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7982-25e7-4f38-825b-013bbf83d4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.662649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7982-25e7-4f38-825b-013bbf83d4e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.674892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e7982-25e7-4f38-825b-013bbf83d4e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:39.676255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e7982-25e7-4f38-825b-013bbf83d4e3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:39.680693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-a50e7982-25e7-4f38-825b-013bbf83d4e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:39.697722 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:39.698739 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:39.704768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:39.704768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:39.704768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:39.704934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b90c6-477d-49f9-bbca-1705bfc0940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:39.704934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b90c6-477d-49f9-bbca-1705bfc0940a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.704934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b90c6-477d-49f9-bbca-1705bfc0940a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.705609 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 245/499] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:39.705678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b90c6-477d-49f9-bbca-1705bfc0940a None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.705745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e7982-25e7-4f38-825b-013bbf83d4e3 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:39.705821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b90c6-477d-49f9-bbca-1705bfc0940a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:39.705821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b90c6-477d-49f9-bbca-1705bfc0940a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:39.705821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b90c6-477d-49f9-bbca-1705bfc0940a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:39.748665 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 255/500] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Aug 29 15:10:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:39.751007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1f14-d9a5-4e03-afa3-7105cd578aff None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.751473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1f14-d9a5-4e03-afa3-7105cd578aff None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.751941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1f14-d9a5-4e03-afa3-7105cd578aff None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.754928 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 256/501] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:39.756469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc1f14-d9a5-4e03-afa3-7105cd578aff None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:39.819464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e7982-25e7-4f38-825b-013bbf83d4e3 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:39.855680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8216fb7-1efa-4c7f-b043-479e14c072a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:39.856281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8216fb7-1efa-4c7f-b043-479e14c072a0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.856558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8216fb7-1efa-4c7f-b043-479e14c072a0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.857521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8216fb7-1efa-4c7f-b043-479e14c072a0 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.858194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8216fb7-1efa-4c7f-b043-479e14c072a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:39.858466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8216fb7-1efa-4c7f-b043-479e14c072a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:39.859829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8216fb7-1efa-4c7f-b043-479e14c072a0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:39.871314 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 246/502] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:39.872110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8216fb7-1efa-4c7f-b043-479e14c072a0 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:39.880202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc1f14-d9a5-4e03-afa3-7105cd578aff None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:39.892971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:39.915738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b655a-d5e3-4027-9a09-2006c29b538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:39.916338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b655a-d5e3-4027-9a09-2006c29b538c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.916618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b655a-d5e3-4027-9a09-2006c29b538c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.916891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b655a-d5e3-4027-9a09-2006c29b538c None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.917559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b655a-d5e3-4027-9a09-2006c29b538c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:39.917862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b655a-d5e3-4027-9a09-2006c29b538c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:39.919241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b655a-d5e3-4027-9a09-2006c29b538c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:39.930921 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 257/503] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:39.932009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d195cad-3371-4317-8eb2-b5b881e8fc30 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:39.932288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d195cad-3371-4317-8eb2-b5b881e8fc30 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:39.932558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d195cad-3371-4317-8eb2-b5b881e8fc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:39.949508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9d195cad-3371-4317-8eb2-b5b881e8fc30 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:39.950685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9d195cad-3371-4317-8eb2-b5b881e8fc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:39.973762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8216fb7-1efa-4c7f-b043-479e14c072a0 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:39.985060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:40.007503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf5656-ecc1-4451-9507-a4dded67c0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:40.008103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf5656-ecc1-4451-9507-a4dded67c0e6 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:40.008381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf5656-ecc1-4451-9507-a4dded67c0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:40.008658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf5656-ecc1-4451-9507-a4dded67c0e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:40.018558 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 258/504] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:40.019405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d195cad-3371-4317-8eb2-b5b881e8fc30 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:40.096308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf5656-ecc1-4451-9507-a4dded67c0e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:40.096728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf5656-ecc1-4451-9507-a4dded67c0e6 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:40.119346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:40.150197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d195cad-3371-4317-8eb2-b5b881e8fc30 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:40.205753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c641f3-fd8c-4611-b727-4a32877f6932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:40.206681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c641f3-fd8c-4611-b727-4a32877f6932 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:40.207127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c641f3-fd8c-4611-b727-4a32877f6932 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:40.207588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c641f3-fd8c-4611-b727-4a32877f6932 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:40.225089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c641f3-fd8c-4611-b727-4a32877f6932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-73c641f3-fd8c-4611-b727-4a32877f6932 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:40.233985 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:40.234924 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:40.235727 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 259/505] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:40.236917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c641f3-fd8c-4611-b727-4a32877f6932 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:40.254186 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 247/506] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:40.254186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf5656-ecc1-4451-9507-a4dded67c0e6 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:40.285892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:40.359401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c641f3-fd8c-4611-b727-4a32877f6932 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:40.368336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf5656-ecc1-4451-9507-a4dded67c0e6 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:40.386525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:40.395885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ae052-2429-4bce-bcdd-fb246b5173cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:40.396529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae052-2429-4bce-bcdd-fb246b5173cf None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:40.396813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae052-2429-4bce-bcdd-fb246b5173cf None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:40.397085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae052-2429-4bce-bcdd-fb246b5173cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:40.404368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b08b06-842b-491d-b1dc-6b64be60bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:40.404645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ae052-2429-4bce-bcdd-fb246b5173cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:40.404992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08b06-842b-491d-b1dc-6b64be60bc63 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:40.405270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08b06-842b-491d-b1dc-6b64be60bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:40.405585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08b06-842b-491d-b1dc-6b64be60bc63 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:40.406127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ae052-2429-4bce-bcdd-fb246b5173cf None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:40.412737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b08b06-842b-491d-b1dc-6b64be60bc63 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:40.414205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b08b06-842b-491d-b1dc-6b64be60bc63 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-555ae052-2429-4bce-bcdd-fb246b5173cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:40.417834 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:40.418828 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 260/507] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Aug 29 15:10:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:40.425040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ae052-2429-4bce-bcdd-fb246b5173cf None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-29b08b06-842b-491d-b1dc-6b64be60bc63 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:40.433276 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:40.434769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 248/508] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:40.436829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b08b06-842b-491d-b1dc-6b64be60bc63 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:40.518310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:40.529107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ae052-2429-4bce-bcdd-fb246b5173cf None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:40.542490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b08b06-842b-491d-b1dc-6b64be60bc63 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:40.565327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7f56e-e9cd-4c38-8b1a-a74c27968541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:40.566036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7f56e-e9cd-4c38-8b1a-a74c27968541 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:40.566312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7f56e-e9cd-4c38-8b1a-a74c27968541 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:40.566582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7f56e-e9cd-4c38-8b1a-a74c27968541 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:40.567239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7f56e-e9cd-4c38-8b1a-a74c27968541 None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:40.567532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7f56e-e9cd-4c38-8b1a-a74c27968541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:40.569225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7f56e-e9cd-4c38-8b1a-a74c27968541 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:40.577413 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 261/509] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:40.577557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f1f4e-a51f-48bf-bf66-76a7a4fbf571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:40.578097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f1f4e-a51f-48bf-bf66-76a7a4fbf571 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:40.578249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7f56e-e9cd-4c38-8b1a-a74c27968541 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:40.578419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f1f4e-a51f-48bf-bf66-76a7a4fbf571 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:40.578647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f1f4e-a51f-48bf-bf66-76a7a4fbf571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:40.595236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f1f4e-a51f-48bf-bf66-76a7a4fbf571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:40.596723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f1f4e-a51f-48bf-bf66-76a7a4fbf571 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-fc4f1f4e-a51f-48bf-bf66-76a7a4fbf571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:40.614423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:40.615456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:40.616364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:40.616364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:40.616364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:40.616364 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 249/510] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:40.617078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f1f4e-a51f-48bf-bf66-76a7a4fbf571 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:40.655924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:40.684265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7f56e-e9cd-4c38-8b1a-a74c27968541 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:40.719080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed880d-ed1a-4e75-ae6e-a125d7186de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:40.719723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed880d-ed1a-4e75-ae6e-a125d7186de9 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:40.719965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed880d-ed1a-4e75-ae6e-a125d7186de9 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:40.720236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed880d-ed1a-4e75-ae6e-a125d7186de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:40.726895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f1f4e-a51f-48bf-bf66-76a7a4fbf571 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:40.731133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed880d-ed1a-4e75-ae6e-a125d7186de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:40.732639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed880d-ed1a-4e75-ae6e-a125d7186de9 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-4eed880d-ed1a-4e75-ae6e-a125d7186de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:40.747223 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:40.748937 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:40.749976 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:40.749976 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:40.749976 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:40.749976 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 262/511] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:40.750234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed880d-ed1a-4e75-ae6e-a125d7186de9 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:40.754086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:40.767351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226708e9-1f79-4652-8660-a846374bf2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:40.767962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226708e9-1f79-4652-8660-a846374bf2eb None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:40.768240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226708e9-1f79-4652-8660-a846374bf2eb None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:40.768561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226708e9-1f79-4652-8660-a846374bf2eb None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:40.769248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226708e9-1f79-4652-8660-a846374bf2eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:40.769581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226708e9-1f79-4652-8660-a846374bf2eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:40.771014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226708e9-1f79-4652-8660-a846374bf2eb None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:40.808300 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 250/512] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Aug 29 15:10:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:40.809161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226708e9-1f79-4652-8660-a846374bf2eb None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:40.862443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed880d-ed1a-4e75-ae6e-a125d7186de9 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:40.896855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ce6c1-39c5-41ef-bdfe-ed63a2bbf7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:40.897488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ce6c1-39c5-41ef-bdfe-ed63a2bbf7d2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:40.897765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ce6c1-39c5-41ef-bdfe-ed63a2bbf7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:40.898034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ce6c1-39c5-41ef-bdfe-ed63a2bbf7d2 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:40.898752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ce6c1-39c5-41ef-bdfe-ed63a2bbf7d2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:40.899050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ce6c1-39c5-41ef-bdfe-ed63a2bbf7d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:40.900473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ce6c1-39c5-41ef-bdfe-ed63a2bbf7d2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:40.910929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:40.921940 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 263/513] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Aug 29 15:10:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:40.923063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ce6c1-39c5-41ef-bdfe-ed63a2bbf7d2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:40.926813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226708e9-1f79-4652-8660-a846374bf2eb None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:40.986406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03394b-073c-4710-ac81-ac5ecf8e12e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:40.987209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03394b-073c-4710-ac81-ac5ecf8e12e2 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:40.987641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03394b-073c-4710-ac81-ac5ecf8e12e2 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:40.988086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03394b-073c-4710-ac81-ac5ecf8e12e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:41.002372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03394b-073c-4710-ac81-ac5ecf8e12e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:41.003893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03394b-073c-4710-ac81-ac5ecf8e12e2 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:41.012618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-ae03394b-073c-4710-ac81-ac5ecf8e12e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:41.019623 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:41.020642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:41.021574 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:41.021574 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:41.021574 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:41.021574 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 251/514] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:41.021574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03394b-073c-4710-ac81-ac5ecf8e12e2 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:41.058279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ce6c1-39c5-41ef-bdfe-ed63a2bbf7d2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:41.093681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c706b-bfa4-4022-8a68-e87df0de9efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:41.094288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c706b-bfa4-4022-8a68-e87df0de9efa None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:41.094564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c706b-bfa4-4022-8a68-e87df0de9efa None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:41.094830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c706b-bfa4-4022-8a68-e87df0de9efa None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:41.095462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c706b-bfa4-4022-8a68-e87df0de9efa None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:41.095759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c706b-bfa4-4022-8a68-e87df0de9efa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:41.097134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c706b-bfa4-4022-8a68-e87df0de9efa None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:41.108822 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 264/515] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:41.109735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c706b-bfa4-4022-8a68-e87df0de9efa None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:41.132346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03394b-073c-4710-ac81-ac5ecf8e12e2 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:41.169149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa61205-c31a-400c-99eb-8e40b3f14525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:41.170121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa61205-c31a-400c-99eb-8e40b3f14525 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:41.170501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa61205-c31a-400c-99eb-8e40b3f14525 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:41.170943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa61205-c31a-400c-99eb-8e40b3f14525 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:41.171778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa61205-c31a-400c-99eb-8e40b3f14525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:41.172173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa61205-c31a-400c-99eb-8e40b3f14525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:41.174098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa61205-c31a-400c-99eb-8e40b3f14525 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:41.183967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:41.188097 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 252/516] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:41.188906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa61205-c31a-400c-99eb-8e40b3f14525 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:41.216068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c706b-bfa4-4022-8a68-e87df0de9efa None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:41.254354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:41.283058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3652cd-42c2-4860-80aa-a7b0c4b95f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:41.284288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3652cd-42c2-4860-80aa-a7b0c4b95f30 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:41.284975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3652cd-42c2-4860-80aa-a7b0c4b95f30 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:41.285421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3652cd-42c2-4860-80aa-a7b0c4b95f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:41.308460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa61205-c31a-400c-99eb-8e40b3f14525 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:41.345604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74d0f7-0f80-4803-8977-836c9d6a99ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:41.346292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d0f7-0f80-4803-8977-836c9d6a99ac None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:41.346953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d0f7-0f80-4803-8977-836c9d6a99ac None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:41.346953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d0f7-0f80-4803-8977-836c9d6a99ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:41.373522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3652cd-42c2-4860-80aa-a7b0c4b95f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:41.375110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3652cd-42c2-4860-80aa-a7b0c4b95f30 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:41.422210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:41.423462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74d0f7-0f80-4803-8977-836c9d6a99ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:41.425207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74d0f7-0f80-4803-8977-836c9d6a99ac None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:41.484032 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 265/517] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:41.484893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3652cd-42c2-4860-80aa-a7b0c4b95f30 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:41.510955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:41.549566 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 253/518] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:41.550511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74d0f7-0f80-4803-8977-836c9d6a99ac None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:41.621821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3652cd-42c2-4860-80aa-a7b0c4b95f30 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:41.662101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:41.665428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1283ffe-16c1-45e7-bc84-20706b3adaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:41.665956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74d0f7-0f80-4803-8977-836c9d6a99ac None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:41.666358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283ffe-16c1-45e7-bc84-20706b3adaba None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:41.666773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283ffe-16c1-45e7-bc84-20706b3adaba None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:41.667188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283ffe-16c1-45e7-bc84-20706b3adaba None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:41.668175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1283ffe-16c1-45e7-bc84-20706b3adaba None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:41.668639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1283ffe-16c1-45e7-bc84-20706b3adaba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:41.671404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1283ffe-16c1-45e7-bc84-20706b3adaba None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:41.687988 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 266/519] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:41.688829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1283ffe-16c1-45e7-bc84-20706b3adaba None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:41.712092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999cd40-2c5c-4d6a-8172-8d950a8736b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:41.713008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999cd40-2c5c-4d6a-8172-8d950a8736b4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:41.713461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999cd40-2c5c-4d6a-8172-8d950a8736b4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:41.713868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999cd40-2c5c-4d6a-8172-8d950a8736b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:41.723925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999cd40-2c5c-4d6a-8172-8d950a8736b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:41.725411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999cd40-2c5c-4d6a-8172-8d950a8736b4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-b999cd40-2c5c-4d6a-8172-8d950a8736b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:41.739075 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:41.740395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:41.741289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:41.741289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:41.741289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:41.741289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:41.741289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:41.741289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:41.741289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:41.741289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:41.741289 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 254/520] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:41.741289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999cd40-2c5c-4d6a-8172-8d950a8736b4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:41.780439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:41.800094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1283ffe-16c1-45e7-bc84-20706b3adaba None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:41.835209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7037496-1ee7-44b2-9dd0-7e320586e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:41.835821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037496-1ee7-44b2-9dd0-7e320586e81e None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:41.836101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037496-1ee7-44b2-9dd0-7e320586e81e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:41.836375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037496-1ee7-44b2-9dd0-7e320586e81e None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:41.837023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7037496-1ee7-44b2-9dd0-7e320586e81e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:41.838490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7037496-1ee7-44b2-9dd0-7e320586e81e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:41.856251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999cd40-2c5c-4d6a-8172-8d950a8736b4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:41.862725 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 267/521] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:10:41 2022] POST /identity/v3/users => generated 247 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:10:41.863566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7037496-1ee7-44b2-9dd0-7e320586e81e None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:41.898626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480be574-60ce-4194-9c69-59833cd86959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:41.899271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be574-60ce-4194-9c69-59833cd86959 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:41.899547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be574-60ce-4194-9c69-59833cd86959 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:41.899816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be574-60ce-4194-9c69-59833cd86959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:41.911568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480be574-60ce-4194-9c69-59833cd86959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:41.913074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480be574-60ce-4194-9c69-59833cd86959 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-480be574-60ce-4194-9c69-59833cd86959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:41.930791 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:41.932041 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:41.933218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:41.933218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:41.933218 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:41.933218 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 255/522] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:41.933218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480be574-60ce-4194-9c69-59833cd86959 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:41.951755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:41.992818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7037496-1ee7-44b2-9dd0-7e320586e81e None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:42.039678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08473fc4-bb5d-4c99-b551-e0e7fb13651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:42.040331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08473fc4-bb5d-4c99-b551-e0e7fb13651a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:42.040668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08473fc4-bb5d-4c99-b551-e0e7fb13651a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:42.040947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08473fc4-bb5d-4c99-b551-e0e7fb13651a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:42.049493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:42.053665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08473fc4-bb5d-4c99-b551-e0e7fb13651a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:42.055549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08473fc4-bb5d-4c99-b551-e0e7fb13651a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:42.068550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480be574-60ce-4194-9c69-59833cd86959 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-08473fc4-bb5d-4c99-b551-e0e7fb13651a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:42.074817 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:42.076028 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:42.077064 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:42.077064 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:42.077064 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:42.077064 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 268/523] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:42.077941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08473fc4-bb5d-4c99-b551-e0e7fb13651a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:42.110608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579932-9266-44d3-ba66-6cd0230c9d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:42.111240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579932-9266-44d3-ba66-6cd0230c9d42 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:42.111520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579932-9266-44d3-ba66-6cd0230c9d42 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:42.111801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579932-9266-44d3-ba66-6cd0230c9d42 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:42.120017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58579932-9266-44d3-ba66-6cd0230c9d42 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:42.121541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58579932-9266-44d3-ba66-6cd0230c9d42 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-58579932-9266-44d3-ba66-6cd0230c9d42 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:42.133997 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:42.135042 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 256/524] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:42.135946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579932-9266-44d3-ba66-6cd0230c9d42 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:42.195368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08473fc4-bb5d-4c99-b551-e0e7fb13651a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:42.216010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:42.233691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13871317-62ea-468e-8680-ecd91c6a4427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:42.234337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13871317-62ea-468e-8680-ecd91c6a4427 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:42.234625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13871317-62ea-468e-8680-ecd91c6a4427 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:42.234903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13871317-62ea-468e-8680-ecd91c6a4427 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:42.235637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13871317-62ea-468e-8680-ecd91c6a4427 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:42.235945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13871317-62ea-468e-8680-ecd91c6a4427 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:42.237520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13871317-62ea-468e-8680-ecd91c6a4427 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:42.255979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579932-9266-44d3-ba66-6cd0230c9d42 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:42.257749 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 269/525] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:42.258953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13871317-62ea-468e-8680-ecd91c6a4427 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:42.299608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d22435-fd0c-4703-9f65-0ef2ca988906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:42.300352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22435-fd0c-4703-9f65-0ef2ca988906 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:42.300642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22435-fd0c-4703-9f65-0ef2ca988906 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:42.300905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22435-fd0c-4703-9f65-0ef2ca988906 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:42.301605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d22435-fd0c-4703-9f65-0ef2ca988906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:42.301906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d22435-fd0c-4703-9f65-0ef2ca988906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:42.303295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d22435-fd0c-4703-9f65-0ef2ca988906 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:42.317517 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 257/526] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:42.318121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d22435-fd0c-4703-9f65-0ef2ca988906 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:42.327093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:42.384161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13871317-62ea-468e-8680-ecd91c6a4427 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:42.422163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c2fc7-d6b9-400a-868b-44460f07a01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:42.422781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c2fc7-d6b9-400a-868b-44460f07a01d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:42.423061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c2fc7-d6b9-400a-868b-44460f07a01d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:42.423336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c2fc7-d6b9-400a-868b-44460f07a01d None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:42.423988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c2fc7-d6b9-400a-868b-44460f07a01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:42.424295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c2fc7-d6b9-400a-868b-44460f07a01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:42.425723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c2fc7-d6b9-400a-868b-44460f07a01d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:42.432533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d22435-fd0c-4703-9f65-0ef2ca988906 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:42.438608 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 270/527] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:42.439689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c2fc7-d6b9-400a-868b-44460f07a01d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:42.468980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:42.475903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc616039-fa75-4d08-9924-73e00cda5f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:42.477149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc616039-fa75-4d08-9924-73e00cda5f59 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:42.477890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc616039-fa75-4d08-9924-73e00cda5f59 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:42.478371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc616039-fa75-4d08-9924-73e00cda5f59 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:42.479830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc616039-fa75-4d08-9924-73e00cda5f59 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:42.480622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc616039-fa75-4d08-9924-73e00cda5f59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:42.482327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc616039-fa75-4d08-9924-73e00cda5f59 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:42.511810 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 258/528] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Aug 29 15:10:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:42.511810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc616039-fa75-4d08-9924-73e00cda5f59 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:42.564234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c2fc7-d6b9-400a-868b-44460f07a01d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:42.577240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:42.605643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e614a90-5761-4afc-bc23-cd95ce02dd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:42.606364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e614a90-5761-4afc-bc23-cd95ce02dd62 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:42.606653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e614a90-5761-4afc-bc23-cd95ce02dd62 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:42.606966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e614a90-5761-4afc-bc23-cd95ce02dd62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:42.607690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e614a90-5761-4afc-bc23-cd95ce02dd62 None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=3f161a87f6fe42aa84e61b33160924ed) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:42.608040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e614a90-5761-4afc-bc23-cd95ce02dd62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:42.609454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e614a90-5761-4afc-bc23-cd95ce02dd62 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:42.625480 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 271/529] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:42 2022] GET /identity/v3/role_assignments?user.id=3f161a87f6fe42aa84e61b33160924ed&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:42.625480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e614a90-5761-4afc-bc23-cd95ce02dd62 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:42.630588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc616039-fa75-4d08-9924-73e00cda5f59 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:42.670465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ee7e0-8489-49f8-85de-5d197e3dff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:42.671227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ee7e0-8489-49f8-85de-5d197e3dff42 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:42.671576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ee7e0-8489-49f8-85de-5d197e3dff42 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:42.671919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ee7e0-8489-49f8-85de-5d197e3dff42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:42.679622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ee7e0-8489-49f8-85de-5d197e3dff42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:42.681226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ee7e0-8489-49f8-85de-5d197e3dff42 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-0f4ee7e0-8489-49f8-85de-5d197e3dff42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:42.694354 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:42.695337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:42.696234 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:42.696234 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:42.696234 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:42.696234 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:42.696234 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:42.696234 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:42.696234 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:42.696234 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:42.701238 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 259/530] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:42.702312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ee7e0-8489-49f8-85de-5d197e3dff42 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:42.761251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:42.761980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e614a90-5761-4afc-bc23-cd95ce02dd62 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:42.815645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25ddcd-5ab0-4aaa-a0e1-74fe4b34e828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:42.817821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25ddcd-5ab0-4aaa-a0e1-74fe4b34e828 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:42.818468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25ddcd-5ab0-4aaa-a0e1-74fe4b34e828 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:42.818751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25ddcd-5ab0-4aaa-a0e1-74fe4b34e828 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:42.830585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25ddcd-5ab0-4aaa-a0e1-74fe4b34e828 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:42.833037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25ddcd-5ab0-4aaa-a0e1-74fe4b34e828 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:42.838716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ee7e0-8489-49f8-85de-5d197e3dff42 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-ea25ddcd-5ab0-4aaa-a0e1-74fe4b34e828 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:42.853710 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:42.854654 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:42.855572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:42.855572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:42.855572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:42.855572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:42.855572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:42.855572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:42.855572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:42.855572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:42.863367 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 272/531] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:42.863367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25ddcd-5ab0-4aaa-a0e1-74fe4b34e828 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:42.887478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de966f-3d2f-443b-9c37-6c5d8e2afcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:42.888216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de966f-3d2f-443b-9c37-6c5d8e2afcff None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:42.888503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de966f-3d2f-443b-9c37-6c5d8e2afcff None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:42.888777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de966f-3d2f-443b-9c37-6c5d8e2afcff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:42.918480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:42.984772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de966f-3d2f-443b-9c37-6c5d8e2afcff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:42.986637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de966f-3d2f-443b-9c37-6c5d8e2afcff None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:43.008571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25ddcd-5ab0-4aaa-a0e1-74fe4b34e828 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:43.043019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:43.046446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d11d-b15d-4de2-9bcb-d3d7c2f9fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:43.047095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d11d-b15d-4de2-9bcb-d3d7c2f9fa4a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:43.047372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d11d-b15d-4de2-9bcb-d3d7c2f9fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:43.047640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d11d-b15d-4de2-9bcb-d3d7c2f9fa4a None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:43.048339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d11d-b15d-4de2-9bcb-d3d7c2f9fa4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:43.048636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d11d-b15d-4de2-9bcb-d3d7c2f9fa4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:43.050274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d11d-b15d-4de2-9bcb-d3d7c2f9fa4a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:43.069306 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 273/532] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:43.069306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d11d-b15d-4de2-9bcb-d3d7c2f9fa4a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:43.125187 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 260/533] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:43.127569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de966f-3d2f-443b-9c37-6c5d8e2afcff None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:43.182104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:43.190394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d11d-b15d-4de2-9bcb-d3d7c2f9fa4a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:43.226468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c770f7-daa6-4346-bb0c-1e9bb7a797a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:43.227080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c770f7-daa6-4346-bb0c-1e9bb7a797a5 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:43.227358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c770f7-daa6-4346-bb0c-1e9bb7a797a5 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:43.227632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c770f7-daa6-4346-bb0c-1e9bb7a797a5 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:43.228316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c770f7-daa6-4346-bb0c-1e9bb7a797a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:43.228615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c770f7-daa6-4346-bb0c-1e9bb7a797a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:43.230077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c770f7-daa6-4346-bb0c-1e9bb7a797a5 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:43.247937 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 274/534] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:43.247937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c770f7-daa6-4346-bb0c-1e9bb7a797a5 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:43.268940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de966f-3d2f-443b-9c37-6c5d8e2afcff None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:43.313791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8777bbc-e1a3-4208-9ae7-5a7b743f95bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:43.314535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8777bbc-e1a3-4208-9ae7-5a7b743f95bf None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:43.314739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8777bbc-e1a3-4208-9ae7-5a7b743f95bf None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:43.314963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8777bbc-e1a3-4208-9ae7-5a7b743f95bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:43.315741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8777bbc-e1a3-4208-9ae7-5a7b743f95bf None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=c235251bc54848279759ba3e71a38306) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:43.316078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8777bbc-e1a3-4208-9ae7-5a7b743f95bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:43.317573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8777bbc-e1a3-4208-9ae7-5a7b743f95bf None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:43.333419 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 261/535] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:43 2022] GET /identity/v3/role_assignments?user.id=c235251bc54848279759ba3e71a38306&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:43.333419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8777bbc-e1a3-4208-9ae7-5a7b743f95bf None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:43.359608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:43.447757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c770f7-daa6-4346-bb0c-1e9bb7a797a5 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:43.518782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fd6d1-7c2b-4e3f-94da-eb60561a6d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:43.519419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fd6d1-7c2b-4e3f-94da-eb60561a6d67 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:43.519691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fd6d1-7c2b-4e3f-94da-eb60561a6d67 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:43.519959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fd6d1-7c2b-4e3f-94da-eb60561a6d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:43.531839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8777bbc-e1a3-4208-9ae7-5a7b743f95bf None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:43.536583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fd6d1-7c2b-4e3f-94da-eb60561a6d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:43.538107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fd6d1-7c2b-4e3f-94da-eb60561a6d67 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-951fd6d1-7c2b-4e3f-94da-eb60561a6d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:43.558904 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:43.559892 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:43.561365 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:43.561365 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:43.561365 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:43.561365 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 275/536] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:43.566291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fd6d1-7c2b-4e3f-94da-eb60561a6d67 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:43.577988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:43.610755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d6fad-8b97-42c8-b424-4c149ac788d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:43.610755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6fad-8b97-42c8-b424-4c149ac788d4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:43.611023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6fad-8b97-42c8-b424-4c149ac788d4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:43.611271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6fad-8b97-42c8-b424-4c149ac788d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:43.611957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d6fad-8b97-42c8-b424-4c149ac788d4 None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=e1ed0648d3b74de89966c6d2e2b8f30a) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:43.612266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d6fad-8b97-42c8-b424-4c149ac788d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:43.613762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d6fad-8b97-42c8-b424-4c149ac788d4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:43.619722 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 262/537] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:43 2022] GET /identity/v3/role_assignments?user.id=e1ed0648d3b74de89966c6d2e2b8f30a&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:43.691657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fd6d1-7c2b-4e3f-94da-eb60561a6d67 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:43.734324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ab2af-e8b4-4c5e-874e-bdbed718e77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:43.735274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ab2af-e8b4-4c5e-874e-bdbed718e77e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:43.735756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ab2af-e8b4-4c5e-874e-bdbed718e77e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:43.736250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ab2af-e8b4-4c5e-874e-bdbed718e77e None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:43.737108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ab2af-e8b4-4c5e-874e-bdbed718e77e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:43.737675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ab2af-e8b4-4c5e-874e-bdbed718e77e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:43.739700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ab2af-e8b4-4c5e-874e-bdbed718e77e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:43.755910 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 276/538] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:43.761363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d6fad-8b97-42c8-b424-4c149ac788d4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:43.887039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:43.910484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d6fad-8b97-42c8-b424-4c149ac788d4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:43.945899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccee371-908d-45ad-b8a3-f910a55d3b18 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:43.946431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccee371-908d-45ad-b8a3-f910a55d3b18 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:43.946431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccee371-908d-45ad-b8a3-f910a55d3b18 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:43.947430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b3190-5ac7-4692-b0fd-afc8c622625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:43.948057 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 277/539] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:10:43.948172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b3190-5ac7-4692-b0fd-afc8c622625a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:43.948384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b3190-5ac7-4692-b0fd-afc8c622625a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:43.948656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b3190-5ac7-4692-b0fd-afc8c622625a None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:43.954203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352feeec-a0a3-49b0-86a8-e886a6148104 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:43.954541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352feeec-a0a3-49b0-86a8-e886a6148104 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:43.954752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352feeec-a0a3-49b0-86a8-e886a6148104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:43.957346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b3190-5ac7-4692-b0fd-afc8c622625a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:43.958838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b3190-5ac7-4692-b0fd-afc8c622625a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-290b3190-5ac7-4692-b0fd-afc8c622625a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:43.971139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:43.972046 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:43.973034 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:43.973034 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:43.973034 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:43.973034 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:43.973034 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:43.973034 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:43.973034 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:43.973034 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:43.973034 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 263/540] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:43.978503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b3190-5ac7-4692-b0fd-afc8c622625a None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:43.983126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-352feeec-a0a3-49b0-86a8-e886a6148104 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:43.984743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-352feeec-a0a3-49b0-86a8-e886a6148104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:44.061932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:44.071485 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 278/541] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:44.086345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b3190-5ac7-4692-b0fd-afc8c622625a None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:44.121955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf40313-9351-4ba0-b9c3-44075a47fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:44.122600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf40313-9351-4ba0-b9c3-44075a47fbbf None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:44.122881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf40313-9351-4ba0-b9c3-44075a47fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:44.123152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf40313-9351-4ba0-b9c3-44075a47fbbf None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:44.123856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf40313-9351-4ba0-b9c3-44075a47fbbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:44.124157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf40313-9351-4ba0-b9c3-44075a47fbbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:44.125791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf40313-9351-4ba0-b9c3-44075a47fbbf None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:44.137858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:44.145970 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 264/542] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:44.152144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352feeec-a0a3-49b0-86a8-e886a6148104 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:44.314013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352feeec-a0a3-49b0-86a8-e886a6148104 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:44.352298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f802eaf-ad99-4b20-9375-e1d65be89d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:44.352914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f802eaf-ad99-4b20-9375-e1d65be89d1e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:44.353191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f802eaf-ad99-4b20-9375-e1d65be89d1e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:44.353489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f802eaf-ad99-4b20-9375-e1d65be89d1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:44.354277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f802eaf-ad99-4b20-9375-e1d65be89d1e None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=d9d3bea88ab145a4b737bc88339f285c) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:44.354587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f802eaf-ad99-4b20-9375-e1d65be89d1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:44.356031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f802eaf-ad99-4b20-9375-e1d65be89d1e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:44.363230 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 279/543] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:44 2022] GET /identity/v3/role_assignments?user.id=d9d3bea88ab145a4b737bc88339f285c&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:44.384289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf40313-9351-4ba0-b9c3-44075a47fbbf None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:44.517758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf40313-9351-4ba0-b9c3-44075a47fbbf None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:44.557316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe487d93-e0bb-4305-a6e4-b5ddce7473b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:44.557974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe487d93-e0bb-4305-a6e4-b5ddce7473b1 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:44.558248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe487d93-e0bb-4305-a6e4-b5ddce7473b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:44.558514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe487d93-e0bb-4305-a6e4-b5ddce7473b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:44.570173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe487d93-e0bb-4305-a6e4-b5ddce7473b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-fe487d93-e0bb-4305-a6e4-b5ddce7473b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:44.575093 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:44.576589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:44.577423 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 265/544] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:44.587235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f802eaf-ad99-4b20-9375-e1d65be89d1e None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:44.727962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:44.789214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f802eaf-ad99-4b20-9375-e1d65be89d1e None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:44.839874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53531b-dcdf-402f-9fec-7ad1b84cc15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:44.840433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53531b-dcdf-402f-9fec-7ad1b84cc15e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:44.840713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53531b-dcdf-402f-9fec-7ad1b84cc15e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:44.840992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53531b-dcdf-402f-9fec-7ad1b84cc15e None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:44.842364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53531b-dcdf-402f-9fec-7ad1b84cc15e None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:44.842672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53531b-dcdf-402f-9fec-7ad1b84cc15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:44.844099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53531b-dcdf-402f-9fec-7ad1b84cc15e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:44.854661 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 280/545] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:44.860635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe487d93-e0bb-4305-a6e4-b5ddce7473b1 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:44.938898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:44.988362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe487d93-e0bb-4305-a6e4-b5ddce7473b1 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:45.030010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac130b98-2863-499c-8763-fa35c4ba940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:45.030657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130b98-2863-499c-8763-fa35c4ba940b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:45.030935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130b98-2863-499c-8763-fa35c4ba940b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:45.031202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac130b98-2863-499c-8763-fa35c4ba940b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:45.043957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac130b98-2863-499c-8763-fa35c4ba940b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:45.045858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac130b98-2863-499c-8763-fa35c4ba940b None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-ac130b98-2863-499c-8763-fa35c4ba940b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:45.067620 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:45.068600 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:45.069494 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:45.069494 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:45.069494 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:45.070081 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 266/546] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:45.072161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ac341-c959-4536-87b8-a47ac8a006a6 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:45.072714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ac341-c959-4536-87b8-a47ac8a006a6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:45.072714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ac341-c959-4536-87b8-a47ac8a006a6 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:45.077616 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 281/547] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:45.079421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac130b98-2863-499c-8763-fa35c4ba940b None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:45.079832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17622cd-a683-4c39-81ad-74a2310fdef1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:45.080192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17622cd-a683-4c39-81ad-74a2310fdef1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:45.080474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17622cd-a683-4c39-81ad-74a2310fdef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:45.116924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e17622cd-a683-4c39-81ad-74a2310fdef1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:45.119877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e17622cd-a683-4c39-81ad-74a2310fdef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:45.225209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac130b98-2863-499c-8763-fa35c4ba940b None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:45.242085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:45.291301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e15063-0554-492f-83cc-c3df168bbd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:45.292301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15063-0554-492f-83cc-c3df168bbd80 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:45.292768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15063-0554-492f-83cc-c3df168bbd80 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:45.293273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15063-0554-492f-83cc-c3df168bbd80 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:45.295762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e15063-0554-492f-83cc-c3df168bbd80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:45.296253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e15063-0554-492f-83cc-c3df168bbd80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:45.297839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e15063-0554-492f-83cc-c3df168bbd80 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:45.303690 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 282/548] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:45.319370 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 267/549] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:45.322444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17622cd-a683-4c39-81ad-74a2310fdef1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:45.400526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:45.479862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17622cd-a683-4c39-81ad-74a2310fdef1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:45.544179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0ae98-00e3-4eaa-81c6-e8af1f2852a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:45.544855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0ae98-00e3-4eaa-81c6-e8af1f2852a8 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:45.545131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0ae98-00e3-4eaa-81c6-e8af1f2852a8 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:45.545414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0ae98-00e3-4eaa-81c6-e8af1f2852a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:45.557208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0ae98-00e3-4eaa-81c6-e8af1f2852a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:45.558733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0ae98-00e3-4eaa-81c6-e8af1f2852a8 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-faf0ae98-00e3-4eaa-81c6-e8af1f2852a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:45.578556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:45.579697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:45.582125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:45.582125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:45.582125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:45.582125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:45.582125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:45.582125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:45.582125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:45.582125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:45.582125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:10:45.582125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:45.582125 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 283/550] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:10:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:45.589357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e15063-0554-492f-83cc-c3df168bbd80 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:45.698813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0ae98-00e3-4eaa-81c6-e8af1f2852a8 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:45.758335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e15063-0554-492f-83cc-c3df168bbd80 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:45.817777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584ca24-36da-4dae-ba91-7b9a9c8d3ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:45.818479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ca24-36da-4dae-ba91-7b9a9c8d3ac0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:45.818791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ca24-36da-4dae-ba91-7b9a9c8d3ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:45.819147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ca24-36da-4dae-ba91-7b9a9c8d3ac0 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:45.819952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ca24-36da-4dae-ba91-7b9a9c8d3ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:45.820296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ca24-36da-4dae-ba91-7b9a9c8d3ac0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:45.821819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ca24-36da-4dae-ba91-7b9a9c8d3ac0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:45.853920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0ae98-00e3-4eaa-81c6-e8af1f2852a8 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:45.868237 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 268/551] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Aug 29 15:10:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:45.874698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584ca24-36da-4dae-ba91-7b9a9c8d3ac0 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:45.891492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:45.912853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61608cf3-17fa-477f-b911-78d04b8befde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:45.913546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61608cf3-17fa-477f-b911-78d04b8befde None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:45.913928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61608cf3-17fa-477f-b911-78d04b8befde None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:45.914272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61608cf3-17fa-477f-b911-78d04b8befde None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:45.929205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61608cf3-17fa-477f-b911-78d04b8befde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:45.931972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-61608cf3-17fa-477f-b911-78d04b8befde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:45.936694 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:45.937964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:45.938792 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:45.940039 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 284/552] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:45.941257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717a5a9-a26d-4c48-8316-654e50107b2b None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:45.941257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717a5a9-a26d-4c48-8316-654e50107b2b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:45.941257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717a5a9-a26d-4c48-8316-654e50107b2b None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:45.942714 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 285/553] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:45.947825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717a5a9-a26d-4c48-8316-654e50107b2b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:46.050972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584ca24-36da-4dae-ba91-7b9a9c8d3ac0 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:46.096972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209be440-f8d0-401e-bceb-3efadd94616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:46.098127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209be440-f8d0-401e-bceb-3efadd94616b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:46.098545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209be440-f8d0-401e-bceb-3efadd94616b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:46.098945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209be440-f8d0-401e-bceb-3efadd94616b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:46.102621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717a5a9-a26d-4c48-8316-654e50107b2b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:46.145094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e74c0-1ef1-4f6b-b2f5-690a6cc8238a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:46.145854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e74c0-1ef1-4f6b-b2f5-690a6cc8238a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:46.146203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e74c0-1ef1-4f6b-b2f5-690a6cc8238a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:46.146562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e74c0-1ef1-4f6b-b2f5-690a6cc8238a None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:46.147305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e74c0-1ef1-4f6b-b2f5-690a6cc8238a None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:46.147678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e74c0-1ef1-4f6b-b2f5-690a6cc8238a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:46.149119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e74c0-1ef1-4f6b-b2f5-690a6cc8238a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:46.160593 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 286/554] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:46.162130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba84f5-a19f-43b1-ba56-b95a37efb5ad None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:46.162534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba84f5-a19f-43b1-ba56-b95a37efb5ad None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:46.162880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba84f5-a19f-43b1-ba56-b95a37efb5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:46.182691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-72ba84f5-a19f-43b1-ba56-b95a37efb5ad None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:46.184060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72ba84f5-a19f-43b1-ba56-b95a37efb5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:46.194472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209be440-f8d0-401e-bceb-3efadd94616b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:46.196471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209be440-f8d0-401e-bceb-3efadd94616b None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:46.224534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:46.231318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:46.279019 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 287/555] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:46.280173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba84f5-a19f-43b1-ba56-b95a37efb5ad None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:46.327374 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 269/556] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:10:46.333590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209be440-f8d0-401e-bceb-3efadd94616b None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:46.426097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba84f5-a19f-43b1-ba56-b95a37efb5ad None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:46.461572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209be440-f8d0-401e-bceb-3efadd94616b None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:46.473309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71196dc3-eb4c-4a27-b5e2-c00119154249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:46.474370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71196dc3-eb4c-4a27-b5e2-c00119154249 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:46.474913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71196dc3-eb4c-4a27-b5e2-c00119154249 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:46.475362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71196dc3-eb4c-4a27-b5e2-c00119154249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:46.490146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71196dc3-eb4c-4a27-b5e2-c00119154249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:46.492351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71196dc3-eb4c-4a27-b5e2-c00119154249 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:46.494771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:46.510367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc453d-6ad1-4b19-8627-6151a3b89f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:46.511342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc453d-6ad1-4b19-8627-6151a3b89f17 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:46.511798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc453d-6ad1-4b19-8627-6151a3b89f17 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-71196dc3-eb4c-4a27-b5e2-c00119154249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:46.512304 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:46.513781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:46.514797 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:46.514797 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:46.514797 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:46.514977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc453d-6ad1-4b19-8627-6151a3b89f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:46.515047 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 288/557] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:46.516217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abcff-478d-4a05-afb8-e8a86e05d158 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:46.516496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abcff-478d-4a05-afb8-e8a86e05d158 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:46.516768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abcff-478d-4a05-afb8-e8a86e05d158 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:46.518233 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 289/558] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:46.524758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546abcff-478d-4a05-afb8-e8a86e05d158 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:46.533604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc453d-6ad1-4b19-8627-6151a3b89f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:46.537861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc453d-6ad1-4b19-8627-6151a3b89f17 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:46.547729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-67bc453d-6ad1-4b19-8627-6151a3b89f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:46.555838 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:46.557153 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:46.559073 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:46.559073 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:46.559073 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:46.559073 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 270/559] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:46.559073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be205c18-5a87-4384-aadb-3bf24cbda181 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:46.559073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be205c18-5a87-4384-aadb-3bf24cbda181 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:46.559073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be205c18-5a87-4384-aadb-3bf24cbda181 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:46.564923 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 271/560] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:46.564923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aad878-b2c4-4fd5-9ca8-6190e947ccfe None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:46.564923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aad878-b2c4-4fd5-9ca8-6190e947ccfe None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:46.564923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aad878-b2c4-4fd5-9ca8-6190e947ccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:46.583969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a2aad878-b2c4-4fd5-9ca8-6190e947ccfe None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:46.585510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a2aad878-b2c4-4fd5-9ca8-6190e947ccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:46.649500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546abcff-478d-4a05-afb8-e8a86e05d158 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:46.663494 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 272/561] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:46.664189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aad878-b2c4-4fd5-9ca8-6190e947ccfe None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:46.694705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62221f4-513a-4717-907b-9594043c3046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:46.695323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62221f4-513a-4717-907b-9594043c3046 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:46.695602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62221f4-513a-4717-907b-9594043c3046 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:46.695876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62221f4-513a-4717-907b-9594043c3046 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:46.696696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62221f4-513a-4717-907b-9594043c3046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:46.697112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62221f4-513a-4717-907b-9594043c3046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:46.698550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62221f4-513a-4717-907b-9594043c3046 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:46.719132 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 290/562] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:46.720308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05df81-ee7d-4ecd-abd2-4fe925b7125e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:46.720595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05df81-ee7d-4ecd-abd2-4fe925b7125e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:46.720875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05df81-ee7d-4ecd-abd2-4fe925b7125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:46.741031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fb05df81-ee7d-4ecd-abd2-4fe925b7125e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:46.742262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fb05df81-ee7d-4ecd-abd2-4fe925b7125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:46.785177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aad878-b2c4-4fd5-9ca8-6190e947ccfe None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:46.800129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:46.821403 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 291/563] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:46.822179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05df81-ee7d-4ecd-abd2-4fe925b7125e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:46.831647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:46.842681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee19c63-5e3d-4af9-8ca1-b5e25c56f429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:46.843912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee19c63-5e3d-4af9-8ca1-b5e25c56f429 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:46.844811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee19c63-5e3d-4af9-8ca1-b5e25c56f429 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:46.845296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee19c63-5e3d-4af9-8ca1-b5e25c56f429 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:46.846190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee19c63-5e3d-4af9-8ca1-b5e25c56f429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:46.846716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee19c63-5e3d-4af9-8ca1-b5e25c56f429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:46.848930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee19c63-5e3d-4af9-8ca1-b5e25c56f429 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:46.870981 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 273/564] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:46.872050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee19c63-5e3d-4af9-8ca1-b5e25c56f429 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:46.963276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05df81-ee7d-4ecd-abd2-4fe925b7125e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.001100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee19c63-5e3d-4af9-8ca1-b5e25c56f429 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.002181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc086c-f088-4089-bb96-beaa6d31133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.002817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc086c-f088-4089-bb96-beaa6d31133f None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.003215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc086c-f088-4089-bb96-beaa6d31133f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.005668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc086c-f088-4089-bb96-beaa6d31133f None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.015723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc086c-f088-4089-bb96-beaa6d31133f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-b7dc086c-f088-4089-bb96-beaa6d31133f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:47.020616 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:47.021575 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 292/565] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:47.022592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc086c-f088-4089-bb96-beaa6d31133f None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.047656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987aa0f-99d0-4598-9fdc-629f013ef975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.048274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987aa0f-99d0-4598-9fdc-629f013ef975 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.048638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987aa0f-99d0-4598-9fdc-629f013ef975 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.048911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987aa0f-99d0-4598-9fdc-629f013ef975 None admin] PATH_INFO: `/v3/users/glance` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.058164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987aa0f-99d0-4598-9fdc-629f013ef975 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:47.059787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987aa0f-99d0-4598-9fdc-629f013ef975 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-a987aa0f-99d0-4598-9fdc-629f013ef975 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:47.072909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:47.073954 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:47.074946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:47.074946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:47.074946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:47.074946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:47.074946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:47.074946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:47.074946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:47.074946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:47.074946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:10:47.074946 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:47.074946 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 274/566] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:47.076103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987aa0f-99d0-4598-9fdc-629f013ef975 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.105024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:47.113763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:47.141884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc086c-f088-4089-bb96-beaa6d31133f None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.176151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504296b-14b2-4f90-8813-0c616a818eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.176787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504296b-14b2-4f90-8813-0c616a818eb6 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.177062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504296b-14b2-4f90-8813-0c616a818eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.177338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504296b-14b2-4f90-8813-0c616a818eb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.183975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504296b-14b2-4f90-8813-0c616a818eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:47.184985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987aa0f-99d0-4598-9fdc-629f013ef975 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.186064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504296b-14b2-4f90-8813-0c616a818eb6 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-f504296b-14b2-4f90-8813-0c616a818eb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:47.198009 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:47.198950 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:47.200032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:47.200032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:47.200032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:47.200032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:47.200032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:47.200032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:47.200032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:47.200032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:47.200032 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 293/567] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:47.200032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504296b-14b2-4f90-8813-0c616a818eb6 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.223280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe1821-6b39-49dd-8155-5b63649a028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.223908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1821-6b39-49dd-8155-5b63649a028a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.224187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1821-6b39-49dd-8155-5b63649a028a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.224460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe1821-6b39-49dd-8155-5b63649a028a None admin] PATH_INFO: `/v3/roles/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.234874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe1821-6b39-49dd-8155-5b63649a028a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-d2fe1821-6b39-49dd-8155-5b63649a028a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:47.240718 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:47.241868 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 275/568] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:47.242833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe1821-6b39-49dd-8155-5b63649a028a None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.302083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504296b-14b2-4f90-8813-0c616a818eb6 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.332695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:47.334823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:47.342422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d14fb6-59c8-4e34-9c60-cb9d046491bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.343030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d14fb6-59c8-4e34-9c60-cb9d046491bc None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.343307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d14fb6-59c8-4e34-9c60-cb9d046491bc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.343580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d14fb6-59c8-4e34-9c60-cb9d046491bc None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.344238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d14fb6-59c8-4e34-9c60-cb9d046491bc None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:47.344543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d14fb6-59c8-4e34-9c60-cb9d046491bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:47.345609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe1821-6b39-49dd-8155-5b63649a028a None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.345951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d14fb6-59c8-4e34-9c60-cb9d046491bc None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:47.353927 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 294/569] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:47.354711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d14fb6-59c8-4e34-9c60-cb9d046491bc None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.383548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329b56c-3b10-49c5-9ab3-42692432f370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.384076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329b56c-3b10-49c5-9ab3-42692432f370 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.384351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329b56c-3b10-49c5-9ab3-42692432f370 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.384623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329b56c-3b10-49c5-9ab3-42692432f370 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.385346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329b56c-3b10-49c5-9ab3-42692432f370 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:47.385691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329b56c-3b10-49c5-9ab3-42692432f370 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:47.387115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329b56c-3b10-49c5-9ab3-42692432f370 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:47.404945 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 276/570] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:47.405838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329b56c-3b10-49c5-9ab3-42692432f370 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.472721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d14fb6-59c8-4e34-9c60-cb9d046491bc None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.515444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc1b56-b05b-4791-87e5-3a11527f62a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.516125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc1b56-b05b-4791-87e5-3a11527f62a9 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.516438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc1b56-b05b-4791-87e5-3a11527f62a9 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.516874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc1b56-b05b-4791-87e5-3a11527f62a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.523847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329b56c-3b10-49c5-9ab3-42692432f370 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.528258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc1b56-b05b-4791-87e5-3a11527f62a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-94bc1b56-b05b-4791-87e5-3a11527f62a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:47.534080 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:47.535046 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:47.535903 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 295/571] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:47.536600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc1b56-b05b-4791-87e5-3a11527f62a9 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.563014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416371e2-05c2-4151-8fbf-89f1ef06441e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.563618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416371e2-05c2-4151-8fbf-89f1ef06441e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.563894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416371e2-05c2-4151-8fbf-89f1ef06441e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.564193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416371e2-05c2-4151-8fbf-89f1ef06441e None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.564878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416371e2-05c2-4151-8fbf-89f1ef06441e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:47.565177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416371e2-05c2-4151-8fbf-89f1ef06441e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:47.566635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416371e2-05c2-4151-8fbf-89f1ef06441e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:47.578136 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 277/572] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:47.578933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416371e2-05c2-4151-8fbf-89f1ef06441e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.589134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:47.591852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:47.642314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc1b56-b05b-4791-87e5-3a11527f62a9 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.676060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23dfcb-6339-4bad-9ba2-07b71093e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.676665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23dfcb-6339-4bad-9ba2-07b71093e922 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.676951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23dfcb-6339-4bad-9ba2-07b71093e922 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.677224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23dfcb-6339-4bad-9ba2-07b71093e922 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.677346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416371e2-05c2-4151-8fbf-89f1ef06441e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.677918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23dfcb-6339-4bad-9ba2-07b71093e922 None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:47.678217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23dfcb-6339-4bad-9ba2-07b71093e922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:47.679582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23dfcb-6339-4bad-9ba2-07b71093e922 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:47.688259 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 296/573] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:47.688417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23dfcb-6339-4bad-9ba2-07b71093e922 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.713965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fca11a-19f7-49bc-a600-fa9b8f2e2f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.714593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fca11a-19f7-49bc-a600-fa9b8f2e2f84 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.714872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fca11a-19f7-49bc-a600-fa9b8f2e2f84 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.715154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fca11a-19f7-49bc-a600-fa9b8f2e2f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.727171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fca11a-19f7-49bc-a600-fa9b8f2e2f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:47.728598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fca11a-19f7-49bc-a600-fa9b8f2e2f84 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-a7fca11a-19f7-49bc-a600-fa9b8f2e2f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:47.750914 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:47.752098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:47.753024 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:47.753024 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:47.753024 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:47.753024 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 278/574] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:47.753322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fca11a-19f7-49bc-a600-fa9b8f2e2f84 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.793644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23dfcb-6339-4bad-9ba2-07b71093e922 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.807122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:47.820696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:47.840591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8c9bd-6191-46ba-8e36-ee19c19f96db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.841376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8c9bd-6191-46ba-8e36-ee19c19f96db None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.841885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8c9bd-6191-46ba-8e36-ee19c19f96db None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.842239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8c9bd-6191-46ba-8e36-ee19c19f96db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.854221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8c9bd-6191-46ba-8e36-ee19c19f96db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:47.855690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8c9bd-6191-46ba-8e36-ee19c19f96db None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-d3f8c9bd-6191-46ba-8e36-ee19c19f96db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:47.871121 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:47.872338 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:47.874566 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:47.874566 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:47.874566 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:47.875018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fca11a-19f7-49bc-a600-fa9b8f2e2f84 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:47.875622 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 297/575] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:47.875622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8c9bd-6191-46ba-8e36-ee19c19f96db None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.913819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0741df-6688-4586-8eda-6750807dd975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:47.914352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0741df-6688-4586-8eda-6750807dd975 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:47.914634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0741df-6688-4586-8eda-6750807dd975 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:47.914907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0741df-6688-4586-8eda-6750807dd975 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:47.915611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0741df-6688-4586-8eda-6750807dd975 None admin] RBAC: Adding query filter params (name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:47.915910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0741df-6688-4586-8eda-6750807dd975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:47.918268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0741df-6688-4586-8eda-6750807dd975 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:47.936035 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 279/576] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:47.936035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0741df-6688-4586-8eda-6750807dd975 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:47.991422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8c9bd-6191-46ba-8e36-ee19c19f96db None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.025378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3576b-bbb5-40b2-ad92-2232b8564df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:48.025999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3576b-bbb5-40b2-ad92-2232b8564df5 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:48.026276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3576b-bbb5-40b2-ad92-2232b8564df5 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:48.026550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3576b-bbb5-40b2-ad92-2232b8564df5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:48.027275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3576b-bbb5-40b2-ad92-2232b8564df5 None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=8fad5b29e028436ca5596434a0cce086) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:48.027584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3576b-bbb5-40b2-ad92-2232b8564df5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:48.029305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3576b-bbb5-40b2-ad92-2232b8564df5 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:48.035146 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 298/577] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/role_assignments?user.id=8fad5b29e028436ca5596434a0cce086&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:48.035738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0741df-6688-4586-8eda-6750807dd975 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.035859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3576b-bbb5-40b2-ad92-2232b8564df5 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:48.071365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:48.072785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:48.084716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8cf56-c7ea-4250-8fe6-4f89e5cb4779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:48.085370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8cf56-c7ea-4250-8fe6-4f89e5cb4779 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:48.085693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8cf56-c7ea-4250-8fe6-4f89e5cb4779 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:48.085967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8cf56-c7ea-4250-8fe6-4f89e5cb4779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:48.098883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8cf56-c7ea-4250-8fe6-4f89e5cb4779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:48.100418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8cf56-c7ea-4250-8fe6-4f89e5cb4779 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-20f8cf56-c7ea-4250-8fe6-4f89e5cb4779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:48.116618 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:48.117776 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:48.118740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:48.118740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:48.118740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:48.118740 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 280/578] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:48.118740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8cf56-c7ea-4250-8fe6-4f89e5cb4779 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:48.162486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3576b-bbb5-40b2-ad92-2232b8564df5 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.214401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a6ae6-ff44-4f3d-b61c-bcec8031c636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:48.215321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a6ae6-ff44-4f3d-b61c-bcec8031c636 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:48.215794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a6ae6-ff44-4f3d-b61c-bcec8031c636 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:48.216757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a6ae6-ff44-4f3d-b61c-bcec8031c636 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:48.217464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a6ae6-ff44-4f3d-b61c-bcec8031c636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:48.217770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a6ae6-ff44-4f3d-b61c-bcec8031c636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:48.219141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a6ae6-ff44-4f3d-b61c-bcec8031c636 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:48.234072 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 299/579] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:48.235464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a6ae6-ff44-4f3d-b61c-bcec8031c636 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:48.252838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8cf56-c7ea-4250-8fe6-4f89e5cb4779 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.301422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a003d1-41d4-47a9-b17c-5ff2bba22491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:48.302048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a003d1-41d4-47a9-b17c-5ff2bba22491 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:48.302326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a003d1-41d4-47a9-b17c-5ff2bba22491 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:48.302597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a003d1-41d4-47a9-b17c-5ff2bba22491 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:48.303246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a003d1-41d4-47a9-b17c-5ff2bba22491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:48.303925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a003d1-41d4-47a9-b17c-5ff2bba22491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:48.305011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a003d1-41d4-47a9-b17c-5ff2bba22491 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:48.324539 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 281/580] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:48.324539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a003d1-41d4-47a9-b17c-5ff2bba22491 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:48.344887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:48.360103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:48.361721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a6ae6-ff44-4f3d-b61c-bcec8031c636 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.400648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b1f81-db8b-4019-87aa-c0a3c9258589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:48.401280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1f81-db8b-4019-87aa-c0a3c9258589 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:48.401588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1f81-db8b-4019-87aa-c0a3c9258589 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:48.401857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1f81-db8b-4019-87aa-c0a3c9258589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:48.413434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b1f81-db8b-4019-87aa-c0a3c9258589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:48.414921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b1f81-db8b-4019-87aa-c0a3c9258589 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-8a9b1f81-db8b-4019-87aa-c0a3c9258589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:48.430557 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:48.431739 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:48.432865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:48.432865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:48.432865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:48.432865 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 300/581] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:48.432865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b1f81-db8b-4019-87aa-c0a3c9258589 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:48.446924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a003d1-41d4-47a9-b17c-5ff2bba22491 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.490205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe39e0-381e-4176-becd-bb4dba79dd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:48.490738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe39e0-381e-4176-becd-bb4dba79dd77 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:48.491016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe39e0-381e-4176-becd-bb4dba79dd77 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:48.491313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe39e0-381e-4176-becd-bb4dba79dd77 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:48.491963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe39e0-381e-4176-becd-bb4dba79dd77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:48.492262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe39e0-381e-4176-becd-bb4dba79dd77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:48.494322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe39e0-381e-4176-becd-bb4dba79dd77 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:48.507208 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 282/582] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:48.508085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe39e0-381e-4176-becd-bb4dba79dd77 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:48.562516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b1f81-db8b-4019-87aa-c0a3c9258589 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.600350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380e4fa-56fc-42e2-bd2f-06b47504c3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:48.600976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380e4fa-56fc-42e2-bd2f-06b47504c3d0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:48.601254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380e4fa-56fc-42e2-bd2f-06b47504c3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:48.601546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380e4fa-56fc-42e2-bd2f-06b47504c3d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:48.610026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380e4fa-56fc-42e2-bd2f-06b47504c3d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:48.611500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380e4fa-56fc-42e2-bd2f-06b47504c3d0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:48.613621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:48.618193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-1380e4fa-56fc-42e2-bd2f-06b47504c3d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:48.624584 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:48.625961 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 301/583] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Aug 29 15:10:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:48.627023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380e4fa-56fc-42e2-bd2f-06b47504c3d0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:48.632496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe39e0-381e-4176-becd-bb4dba79dd77 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.672086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c66890-8542-4e8b-9fc0-c4ce8917ffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:48.672716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66890-8542-4e8b-9fc0-c4ce8917ffbf None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:48.672993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66890-8542-4e8b-9fc0-c4ce8917ffbf None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:48.673261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c66890-8542-4e8b-9fc0-c4ce8917ffbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:48.681319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c66890-8542-4e8b-9fc0-c4ce8917ffbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:48.682803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c66890-8542-4e8b-9fc0-c4ce8917ffbf None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-35c66890-8542-4e8b-9fc0-c4ce8917ffbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:48.694664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:48.695619 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:48.696537 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:48.696537 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:48.696537 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:48.696537 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:48.696537 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:48.696537 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:48.696537 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:48.696537 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:48.696537 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 283/584] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:48.696537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c66890-8542-4e8b-9fc0-c4ce8917ffbf None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:48.740870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380e4fa-56fc-42e2-bd2f-06b47504c3d0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.779830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6aa4c-e67c-4167-80fc-6b61bea08525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:48.780528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6aa4c-e67c-4167-80fc-6b61bea08525 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:48.780905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6aa4c-e67c-4167-80fc-6b61bea08525 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:48.781241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6aa4c-e67c-4167-80fc-6b61bea08525 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:48.781973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6aa4c-e67c-4167-80fc-6b61bea08525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:48.782342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6aa4c-e67c-4167-80fc-6b61bea08525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:48.783762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6aa4c-e67c-4167-80fc-6b61bea08525 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:48.797013 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 302/585] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:48.798095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6aa4c-e67c-4167-80fc-6b61bea08525 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:48.811305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c66890-8542-4e8b-9fc0-c4ce8917ffbf None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.844781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42dffc-ecc0-47d9-a6ef-ed3d3f76b8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:48.845429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42dffc-ecc0-47d9-a6ef-ed3d3f76b8b4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:48.845695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42dffc-ecc0-47d9-a6ef-ed3d3f76b8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:48.845962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42dffc-ecc0-47d9-a6ef-ed3d3f76b8b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:48.854258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42dffc-ecc0-47d9-a6ef-ed3d3f76b8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:48.855709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42dffc-ecc0-47d9-a6ef-ed3d3f76b8b4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:48.861663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-9b42dffc-ecc0-47d9-a6ef-ed3d3f76b8b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:48.868087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:48.869059 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 284/586] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:48.875595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42dffc-ecc0-47d9-a6ef-ed3d3f76b8b4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:48.889883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:48.919219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6aa4c-e67c-4167-80fc-6b61bea08525 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.956845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210a3cf-a965-427e-ad0a-f5c93e4e2e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:48.957744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210a3cf-a965-427e-ad0a-f5c93e4e2e57 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:48.958199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210a3cf-a965-427e-ad0a-f5c93e4e2e57 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:48.958666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210a3cf-a965-427e-ad0a-f5c93e4e2e57 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:48.959650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210a3cf-a965-427e-ad0a-f5c93e4e2e57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:48.960114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210a3cf-a965-427e-ad0a-f5c93e4e2e57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:48.961829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210a3cf-a965-427e-ad0a-f5c93e4e2e57 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:48.979030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42dffc-ecc0-47d9-a6ef-ed3d3f76b8b4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:48.981559 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 303/587] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Aug 29 15:10:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:48.982733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210a3cf-a965-427e-ad0a-f5c93e4e2e57 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:49.025103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ba76f-9e6a-4bb5-99ba-fbf1d2b14ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:49.025738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ba76f-9e6a-4bb5-99ba-fbf1d2b14ea7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:49.026015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ba76f-9e6a-4bb5-99ba-fbf1d2b14ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:49.026282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ba76f-9e6a-4bb5-99ba-fbf1d2b14ea7 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:49.026978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ba76f-9e6a-4bb5-99ba-fbf1d2b14ea7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:49.027278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ba76f-9e6a-4bb5-99ba-fbf1d2b14ea7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:49.028992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ba76f-9e6a-4bb5-99ba-fbf1d2b14ea7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:49.042179 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 285/588] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:49.043230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ba76f-9e6a-4bb5-99ba-fbf1d2b14ea7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:49.100846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210a3cf-a965-427e-ad0a-f5c93e4e2e57 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:49.119989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:49.128374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:49.142344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4f02c-9749-4387-915c-ac0db61b7aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:49.143001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4f02c-9749-4387-915c-ac0db61b7aaa None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:49.143275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4f02c-9749-4387-915c-ac0db61b7aaa None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:49.143540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4f02c-9749-4387-915c-ac0db61b7aaa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:49.152372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4f02c-9749-4387-915c-ac0db61b7aaa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:49.154176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4f02c-9749-4387-915c-ac0db61b7aaa None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:49.159299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ba76f-9e6a-4bb5-99ba-fbf1d2b14ea7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-d1c4f02c-9749-4387-915c-ac0db61b7aaa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:49.167154 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:49.168666 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:49.170474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:49.170474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:49.170474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:49.170474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:49.170474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:49.170474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:49.170474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:49.170474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:49.170474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:10:49.170474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:49.173501 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 304/589] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:49.174172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4f02c-9749-4387-915c-ac0db61b7aaa None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:49.204794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3bcc9-6ef5-453f-9551-79c4d6d2810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:49.205411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3bcc9-6ef5-453f-9551-79c4d6d2810f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:49.205707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3bcc9-6ef5-453f-9551-79c4d6d2810f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:49.205982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3bcc9-6ef5-453f-9551-79c4d6d2810f None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:49.206705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3bcc9-6ef5-453f-9551-79c4d6d2810f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:49.207235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3bcc9-6ef5-453f-9551-79c4d6d2810f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:49.208424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3bcc9-6ef5-453f-9551-79c4d6d2810f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:49.227808 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 286/590] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Aug 29 15:10:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:49.228709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3bcc9-6ef5-453f-9551-79c4d6d2810f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:49.285666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4f02c-9749-4387-915c-ac0db61b7aaa None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:49.320952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0947a52-bcb0-4680-b687-07b7c2168f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:49.321617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0947a52-bcb0-4680-b687-07b7c2168f7d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:49.321903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0947a52-bcb0-4680-b687-07b7c2168f7d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:49.322174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0947a52-bcb0-4680-b687-07b7c2168f7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:49.333774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0947a52-bcb0-4680-b687-07b7c2168f7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:49.335244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0947a52-bcb0-4680-b687-07b7c2168f7d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:49.342139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3bcc9-6ef5-453f-9551-79c4d6d2810f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-b0947a52-bcb0-4680-b687-07b7c2168f7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:49.350677 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:49.351770 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:49.352658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:49.352658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:49.352658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:49.352658 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 305/591] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:49.352658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0947a52-bcb0-4680-b687-07b7c2168f7d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:49.380798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:49.383544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:49.387691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453202-d6b8-42af-aedd-628bbac30ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:49.389114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453202-d6b8-42af-aedd-628bbac30ffa None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:49.389412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453202-d6b8-42af-aedd-628bbac30ffa None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:49.389719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453202-d6b8-42af-aedd-628bbac30ffa None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/3f161a87f6fe42aa84e61b33160924ed/roles/1471575d20cd435ca6fb71c29c92fb64` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:49.409007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad453202-d6b8-42af-aedd-628bbac30ffa None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=3f161a87f6fe42aa84e61b33160924ed, role_id=1471575d20cd435ca6fb71c29c92fb64)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:49.410485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad453202-d6b8-42af-aedd-628bbac30ffa None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:49.424673 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 287/592] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:10:49 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/3f161a87f6fe42aa84e61b33160924ed/roles/1471575d20cd435ca6fb71c29c92fb64 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:49.425853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453202-d6b8-42af-aedd-628bbac30ffa None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:49.491779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0947a52-bcb0-4680-b687-07b7c2168f7d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:49.544825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699ce11-84af-4825-bb91-d78216deeab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:49.545892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699ce11-84af-4825-bb91-d78216deeab1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:49.546322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699ce11-84af-4825-bb91-d78216deeab1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:49.546875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699ce11-84af-4825-bb91-d78216deeab1 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:49.547837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699ce11-84af-4825-bb91-d78216deeab1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:49.548389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699ce11-84af-4825-bb91-d78216deeab1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:49.550241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699ce11-84af-4825-bb91-d78216deeab1 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:49.571470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453202-d6b8-42af-aedd-628bbac30ffa None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:49.574695 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 306/593] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Aug 29 15:10:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:49.576410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699ce11-84af-4825-bb91-d78216deeab1 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:49.614508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4259a-2dbe-40de-a695-4a6e2f44e7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:49.615471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4259a-2dbe-40de-a695-4a6e2f44e7f7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:49.615943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4259a-2dbe-40de-a695-4a6e2f44e7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:49.616443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4259a-2dbe-40de-a695-4a6e2f44e7f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:49.627904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4259a-2dbe-40de-a695-4a6e2f44e7f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:49.629685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4259a-2dbe-40de-a695-4a6e2f44e7f7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-dbf4259a-2dbe-40de-a695-4a6e2f44e7f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:49.646925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:49.647949 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:49.648877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:49.648877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:49.648877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:49.651130 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 288/594] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:49.652206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4259a-2dbe-40de-a695-4a6e2f44e7f7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:49.685852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:49.708769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699ce11-84af-4825-bb91-d78216deeab1 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:49.717752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:49.754664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c950d-c859-45c1-9caf-a5f541efdb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:49.754881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c950d-c859-45c1-9caf-a5f541efdb62 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:49.755117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c950d-c859-45c1-9caf-a5f541efdb62 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:49.755342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c950d-c859-45c1-9caf-a5f541efdb62 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:49.755985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c950d-c859-45c1-9caf-a5f541efdb62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:49.756283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c950d-c859-45c1-9caf-a5f541efdb62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:49.758190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c950d-c859-45c1-9caf-a5f541efdb62 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:49.768304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4259a-2dbe-40de-a695-4a6e2f44e7f7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:49.778699 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 307/595] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:49.778699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c950d-c859-45c1-9caf-a5f541efdb62 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:49.823300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7aaecc-87d3-4f19-84de-561f6a274ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:49.824596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aaecc-87d3-4f19-84de-561f6a274ac0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:49.825307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aaecc-87d3-4f19-84de-561f6a274ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:49.826397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aaecc-87d3-4f19-84de-561f6a274ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:49.841581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7aaecc-87d3-4f19-84de-561f6a274ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:49.843665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7aaecc-87d3-4f19-84de-561f6a274ac0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-cc7aaecc-87d3-4f19-84de-561f6a274ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:49.864190 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:49.865433 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:49.866536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:49.866536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:49.866536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:49.868621 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 289/596] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:49.869677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7aaecc-87d3-4f19-84de-561f6a274ac0 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:49.913703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c950d-c859-45c1-9caf-a5f541efdb62 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:49.952411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d939e-a7eb-4ac8-ae99-6e9a6ab95a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:49.953049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d939e-a7eb-4ac8-ae99-6e9a6ab95a92 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:49.953328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d939e-a7eb-4ac8-ae99-6e9a6ab95a92 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:49.954927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d939e-a7eb-4ac8-ae99-6e9a6ab95a92 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:49.955578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d939e-a7eb-4ac8-ae99-6e9a6ab95a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:49.955880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d939e-a7eb-4ac8-ae99-6e9a6ab95a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:49.957239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d939e-a7eb-4ac8-ae99-6e9a6ab95a92 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:49.976125 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 308/597] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:49.976125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d939e-a7eb-4ac8-ae99-6e9a6ab95a92 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:49.982483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:49.991534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:50.002175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7aaecc-87d3-4f19-84de-561f6a274ac0 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:50.038441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fba65-7b83-46e4-8704-da6796d23b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:50.039061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fba65-7b83-46e4-8704-da6796d23b4e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:50.039338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fba65-7b83-46e4-8704-da6796d23b4e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:50.039607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fba65-7b83-46e4-8704-da6796d23b4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:50.047780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fba65-7b83-46e4-8704-da6796d23b4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:50.049904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fba65-7b83-46e4-8704-da6796d23b4e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-a83fba65-7b83-46e4-8704-da6796d23b4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:50.063080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:50.064135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:50.065083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:50.065083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:50.065083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:50.065083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:50.065083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:50.065083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:50.065083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:50.065083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:50.065083 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 290/598] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:50.066099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872ef89-290b-4cee-a98b-52280761a6cc None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:50.066099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872ef89-290b-4cee-a98b-52280761a6cc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:50.066264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872ef89-290b-4cee-a98b-52280761a6cc None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:50.068874 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 291/599] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:50.070421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872ef89-290b-4cee-a98b-52280761a6cc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:50.096674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d939e-a7eb-4ac8-ae99-6e9a6ab95a92 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:50.134740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750cd70-3e2d-4cc8-9fa8-024b72896c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:50.135363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750cd70-3e2d-4cc8-9fa8-024b72896c85 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:50.135612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750cd70-3e2d-4cc8-9fa8-024b72896c85 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:50.135877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750cd70-3e2d-4cc8-9fa8-024b72896c85 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:50.136708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750cd70-3e2d-4cc8-9fa8-024b72896c85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:50.136823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750cd70-3e2d-4cc8-9fa8-024b72896c85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:50.138191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750cd70-3e2d-4cc8-9fa8-024b72896c85 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:50.157201 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 309/600] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:50.157201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750cd70-3e2d-4cc8-9fa8-024b72896c85 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:50.177605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872ef89-290b-4cee-a98b-52280761a6cc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:50.213153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f7d63-0aca-4be1-9020-b6121b799b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:50.213908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f7d63-0aca-4be1-9020-b6121b799b3d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:50.214188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f7d63-0aca-4be1-9020-b6121b799b3d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:50.214456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f7d63-0aca-4be1-9020-b6121b799b3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:50.221354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f7d63-0aca-4be1-9020-b6121b799b3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:50.222812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f7d63-0aca-4be1-9020-b6121b799b3d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:50.226437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-318f7d63-0aca-4be1-9020-b6121b799b3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:50.235184 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:50.236112 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:50.237005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:50.237005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:50.237005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:50.237005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:50.237005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:50.237005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:50.237005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:50.237005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:50.240997 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 292/601] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:50.242345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adcf8c-2a2d-42d1-859c-c5cc8032d3c0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:50.242630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adcf8c-2a2d-42d1-859c-c5cc8032d3c0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:50.242907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adcf8c-2a2d-42d1-859c-c5cc8032d3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:50.256595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:50.262270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a0adcf8c-2a2d-42d1-859c-c5cc8032d3c0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:50.263955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a0adcf8c-2a2d-42d1-859c-c5cc8032d3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:50.266236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750cd70-3e2d-4cc8-9fa8-024b72896c85 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:50.302873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb71ed-aaec-405d-9db4-ff2288af9131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:50.303484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb71ed-aaec-405d-9db4-ff2288af9131 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:50.303762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb71ed-aaec-405d-9db4-ff2288af9131 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:50.304034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb71ed-aaec-405d-9db4-ff2288af9131 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:50.304723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb71ed-aaec-405d-9db4-ff2288af9131 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:50.305024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb71ed-aaec-405d-9db4-ff2288af9131 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:50.306851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb71ed-aaec-405d-9db4-ff2288af9131 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:50.324681 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 310/602] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:50.324681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb71ed-aaec-405d-9db4-ff2288af9131 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:50.340615 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 293/603] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:50.345833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adcf8c-2a2d-42d1-859c-c5cc8032d3c0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:50.456291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adcf8c-2a2d-42d1-859c-c5cc8032d3c0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:50.462510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb71ed-aaec-405d-9db4-ff2288af9131 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:50.494831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775902-f8c1-420a-a810-203762f24737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:50.495511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775902-f8c1-420a-a810-203762f24737 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:50.495851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775902-f8c1-420a-a810-203762f24737 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:50.496126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775902-f8c1-420a-a810-203762f24737 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:50.496875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4775902-f8c1-420a-a810-203762f24737 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:50.497185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4775902-f8c1-420a-a810-203762f24737 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:50.500551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4775902-f8c1-420a-a810-203762f24737 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:50.504692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:50.506289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:50.517293 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 294/604] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:50.518224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775902-f8c1-420a-a810-203762f24737 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:50.518582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f1f14-2b36-40f6-b793-b80017986321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:50.519444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f1f14-2b36-40f6-b793-b80017986321 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:50.519926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f1f14-2b36-40f6-b793-b80017986321 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:50.520402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f1f14-2b36-40f6-b793-b80017986321 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:50.530639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f1f14-2b36-40f6-b793-b80017986321 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:50.533281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f1f14-2b36-40f6-b793-b80017986321 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-c26f1f14-2b36-40f6-b793-b80017986321 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:50.552635 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:50.553726 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:50.554649 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:50.554649 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:50.554649 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:50.554649 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:50.554649 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:50.554649 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:50.554649 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:50.554649 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:50.554649 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 311/605] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:50.556155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f1f14-2b36-40f6-b793-b80017986321 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:50.646599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775902-f8c1-420a-a810-203762f24737 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:50.677991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f1f14-2b36-40f6-b793-b80017986321 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:50.683228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be088f8-34c3-4415-912e-2717b86259f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:50.683886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be088f8-34c3-4415-912e-2717b86259f7 None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:50.684163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be088f8-34c3-4415-912e-2717b86259f7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:50.684434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be088f8-34c3-4415-912e-2717b86259f7 None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/c235251bc54848279759ba3e71a38306/roles/1471575d20cd435ca6fb71c29c92fb64` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:50.699637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be088f8-34c3-4415-912e-2717b86259f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=c235251bc54848279759ba3e71a38306, role_id=1471575d20cd435ca6fb71c29c92fb64)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:50.701693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be088f8-34c3-4415-912e-2717b86259f7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:50.725523 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 295/606] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:10:50 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/c235251bc54848279759ba3e71a38306/roles/1471575d20cd435ca6fb71c29c92fb64 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:50.725749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69b710-82dd-4d11-ad31-e5c78ad03d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:50.725749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69b710-82dd-4d11-ad31-e5c78ad03d21 None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:50.725958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be088f8-34c3-4415-912e-2717b86259f7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:50.726053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69b710-82dd-4d11-ad31-e5c78ad03d21 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:50.726053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69b710-82dd-4d11-ad31-e5c78ad03d21 None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/e1ed0648d3b74de89966c6d2e2b8f30a/roles/1471575d20cd435ca6fb71c29c92fb64` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:50.744149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69b710-82dd-4d11-ad31-e5c78ad03d21 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=e1ed0648d3b74de89966c6d2e2b8f30a, role_id=1471575d20cd435ca6fb71c29c92fb64)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:50.745782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69b710-82dd-4d11-ad31-e5c78ad03d21 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:50.773688 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 312/607] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:10:50 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/e1ed0648d3b74de89966c6d2e2b8f30a/roles/1471575d20cd435ca6fb71c29c92fb64 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:50.775274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69b710-82dd-4d11-ad31-e5c78ad03d21 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:50.792767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:50.872368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be088f8-34c3-4415-912e-2717b86259f7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:50.883900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:50.931418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689959df-23ae-4852-af12-e733e99707d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:50.932632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689959df-23ae-4852-af12-e733e99707d8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:50.933061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689959df-23ae-4852-af12-e733e99707d8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:50.933795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689959df-23ae-4852-af12-e733e99707d8 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:50.935857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689959df-23ae-4852-af12-e733e99707d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:50.936384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689959df-23ae-4852-af12-e733e99707d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:50.938055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689959df-23ae-4852-af12-e733e99707d8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:50.956484 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 296/608] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:50.962459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689959df-23ae-4852-af12-e733e99707d8 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:50.972262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69b710-82dd-4d11-ad31-e5c78ad03d21 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:51.021378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd52818-1fa6-4d24-b86e-b7ad325f16f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:51.022440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd52818-1fa6-4d24-b86e-b7ad325f16f3 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:51.022923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd52818-1fa6-4d24-b86e-b7ad325f16f3 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:51.023397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd52818-1fa6-4d24-b86e-b7ad325f16f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:51.039005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd52818-1fa6-4d24-b86e-b7ad325f16f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-5dd52818-1fa6-4d24-b86e-b7ad325f16f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:51.046908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:51.048001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:51.048875 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:51.050852 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 313/609] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:51.058686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd52818-1fa6-4d24-b86e-b7ad325f16f3 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:51.126525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689959df-23ae-4852-af12-e733e99707d8 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:51.137989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:51.191683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b44bb0-cc25-488c-81a9-5bc8b02fb527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:51.192356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b44bb0-cc25-488c-81a9-5bc8b02fb527 None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:51.192632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b44bb0-cc25-488c-81a9-5bc8b02fb527 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:51.192968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b44bb0-cc25-488c-81a9-5bc8b02fb527 None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/d9d3bea88ab145a4b737bc88339f285c/roles/1471575d20cd435ca6fb71c29c92fb64` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:51.209475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b44bb0-cc25-488c-81a9-5bc8b02fb527 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=d9d3bea88ab145a4b737bc88339f285c, role_id=1471575d20cd435ca6fb71c29c92fb64)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:51.210966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b44bb0-cc25-488c-81a9-5bc8b02fb527 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:51.232113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:51.237568 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 297/610] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:10:50 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/d9d3bea88ab145a4b737bc88339f285c/roles/1471575d20cd435ca6fb71c29c92fb64 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:51.244605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd52818-1fa6-4d24-b86e-b7ad325f16f3 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:51.298046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec67663-5b5d-4767-8a9a-115baa498633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:51.298608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec67663-5b5d-4767-8a9a-115baa498633 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:51.298943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec67663-5b5d-4767-8a9a-115baa498633 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:51.299221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec67663-5b5d-4767-8a9a-115baa498633 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:51.299923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec67663-5b5d-4767-8a9a-115baa498633 None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:51.300229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec67663-5b5d-4767-8a9a-115baa498633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:51.301744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec67663-5b5d-4767-8a9a-115baa498633 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:51.312250 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 314/611] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:51.318066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b44bb0-cc25-488c-81a9-5bc8b02fb527 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:51.503508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b44bb0-cc25-488c-81a9-5bc8b02fb527 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:51.506666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc288-33ff-42d7-b83c-ab10f61321da None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:51.506951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc288-33ff-42d7-b83c-ab10f61321da None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:51.507263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc288-33ff-42d7-b83c-ab10f61321da None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:51.509064 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 315/612] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:10:51.514921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9552c-1127-4a3a-b02c-ace24cddf53a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:51.515239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9552c-1127-4a3a-b02c-ace24cddf53a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:51.515541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9552c-1127-4a3a-b02c-ace24cddf53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:51.539547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2db9552c-1127-4a3a-b02c-ace24cddf53a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:51.540946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2db9552c-1127-4a3a-b02c-ace24cddf53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:51.590817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132665e-b39e-4eb9-9fdd-8bf3d598cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:51.591451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132665e-b39e-4eb9-9fdd-8bf3d598cd6a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:51.591741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132665e-b39e-4eb9-9fdd-8bf3d598cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:51.592257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132665e-b39e-4eb9-9fdd-8bf3d598cd6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:51.617054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132665e-b39e-4eb9-9fdd-8bf3d598cd6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:51.618586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132665e-b39e-4eb9-9fdd-8bf3d598cd6a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:51.618778 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 316/613] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-a132665e-b39e-4eb9-9fdd-8bf3d598cd6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:51.655050 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:51.656266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:51.657364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:51.657364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:51.657364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:51.657364 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 298/614] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:51.662181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9552c-1127-4a3a-b02c-ace24cddf53a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:51.769844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:51.782106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9552c-1127-4a3a-b02c-ace24cddf53a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:51.820126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788267a-70ce-4d64-b1e3-0b2ff387eaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:51.820739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788267a-70ce-4d64-b1e3-0b2ff387eaee None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:51.821016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788267a-70ce-4d64-b1e3-0b2ff387eaee None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:51.821287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788267a-70ce-4d64-b1e3-0b2ff387eaee None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:51.821966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788267a-70ce-4d64-b1e3-0b2ff387eaee None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:51.822265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788267a-70ce-4d64-b1e3-0b2ff387eaee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:51.823707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788267a-70ce-4d64-b1e3-0b2ff387eaee None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:51.837199 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 317/615] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:51.846544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132665e-b39e-4eb9-9fdd-8bf3d598cd6a None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:51.867577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:52.019543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132665e-b39e-4eb9-9fdd-8bf3d598cd6a None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:52.040802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788267a-70ce-4d64-b1e3-0b2ff387eaee None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:52.065429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110eb85-d5d3-4b05-b108-db1562aaadb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:52.066071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110eb85-d5d3-4b05-b108-db1562aaadb4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:52.066352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110eb85-d5d3-4b05-b108-db1562aaadb4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:52.066629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110eb85-d5d3-4b05-b108-db1562aaadb4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:52.082394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110eb85-d5d3-4b05-b108-db1562aaadb4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:52.083844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110eb85-d5d3-4b05-b108-db1562aaadb4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-4110eb85-d5d3-4b05-b108-db1562aaadb4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:52.112284 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:52.113277 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:52.114279 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:52.114279 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:52.114279 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:52.114279 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:52.114279 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:52.114279 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:52.114279 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:52.114279 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:52.114279 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:10:52.114279 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:52.114279 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 299/616] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:10:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:52.119517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110eb85-d5d3-4b05-b108-db1562aaadb4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:52.168436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788267a-70ce-4d64-b1e3-0b2ff387eaee None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:52.204905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76357-46f5-4bc4-88a1-12a0a327cc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:52.205572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76357-46f5-4bc4-88a1-12a0a327cc10 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:52.205853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76357-46f5-4bc4-88a1-12a0a327cc10 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:52.206127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76357-46f5-4bc4-88a1-12a0a327cc10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:52.218030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a76357-46f5-4bc4-88a1-12a0a327cc10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-37a76357-46f5-4bc4-88a1-12a0a327cc10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:52.224209 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:52.225161 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:52.226072 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 318/617] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:52.231817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76357-46f5-4bc4-88a1-12a0a327cc10 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:52.253775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:52.275286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:52.351056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76357-46f5-4bc4-88a1-12a0a327cc10 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:52.393717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57746924-8cc8-4943-9162-86902d68ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:52.395319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57746924-8cc8-4943-9162-86902d68ab02 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:52.395754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57746924-8cc8-4943-9162-86902d68ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:52.396179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57746924-8cc8-4943-9162-86902d68ab02 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:52.397054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57746924-8cc8-4943-9162-86902d68ab02 None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:52.397568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57746924-8cc8-4943-9162-86902d68ab02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:52.399493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57746924-8cc8-4943-9162-86902d68ab02 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:52.403714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110eb85-d5d3-4b05-b108-db1562aaadb4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:52.410666 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 319/618] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:52.416115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57746924-8cc8-4943-9162-86902d68ab02 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:52.488015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec6dee-4c8f-4c9c-a8fa-10d411936ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:52.488657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec6dee-4c8f-4c9c-a8fa-10d411936ec7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:52.488936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec6dee-4c8f-4c9c-a8fa-10d411936ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:52.489208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec6dee-4c8f-4c9c-a8fa-10d411936ec7 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:52.490055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec6dee-4c8f-4c9c-a8fa-10d411936ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:52.490363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec6dee-4c8f-4c9c-a8fa-10d411936ec7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:52.491877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec6dee-4c8f-4c9c-a8fa-10d411936ec7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:52.533521 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 300/619] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Aug 29 15:10:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:52.536762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec6dee-4c8f-4c9c-a8fa-10d411936ec7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:52.545805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:52.554645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57746924-8cc8-4943-9162-86902d68ab02 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:52.632249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93206da8-c45b-4867-a520-e825880d666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:52.632887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206da8-c45b-4867-a520-e825880d666c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:52.633165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206da8-c45b-4867-a520-e825880d666c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:52.633454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93206da8-c45b-4867-a520-e825880d666c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:52.660644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93206da8-c45b-4867-a520-e825880d666c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:52.662079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93206da8-c45b-4867-a520-e825880d666c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-93206da8-c45b-4867-a520-e825880d666c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:52.692335 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:52.693427 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:52.694405 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:52.694405 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:52.694405 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:52.702081 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 320/620] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:52.707842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93206da8-c45b-4867-a520-e825880d666c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:52.720313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec6dee-4c8f-4c9c-a8fa-10d411936ec7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:52.750921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:52.782215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a08f14-f685-4e9a-9198-bd5b5fd0df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:52.783033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a08f14-f685-4e9a-9198-bd5b5fd0df7e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:52.783487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a08f14-f685-4e9a-9198-bd5b5fd0df7e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:52.783811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a08f14-f685-4e9a-9198-bd5b5fd0df7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:52.815612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a08f14-f685-4e9a-9198-bd5b5fd0df7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:52.817165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a08f14-f685-4e9a-9198-bd5b5fd0df7e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-60a08f14-f685-4e9a-9198-bd5b5fd0df7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:52.842564 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:52.843580 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:52.844505 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:52.844505 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:52.844505 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:52.849030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93206da8-c45b-4867-a520-e825880d666c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:52.853978 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 301/621] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:52.860088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a08f14-f685-4e9a-9198-bd5b5fd0df7e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:52.877812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:52.894179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112aee2-c7a7-45dc-9913-74fb1f7df06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:52.894864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112aee2-c7a7-45dc-9913-74fb1f7df06e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:52.895210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112aee2-c7a7-45dc-9913-74fb1f7df06e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:52.896751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112aee2-c7a7-45dc-9913-74fb1f7df06e None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:52.897461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112aee2-c7a7-45dc-9913-74fb1f7df06e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:52.897783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112aee2-c7a7-45dc-9913-74fb1f7df06e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:52.899415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112aee2-c7a7-45dc-9913-74fb1f7df06e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:52.915246 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 321/622] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:52.923832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112aee2-c7a7-45dc-9913-74fb1f7df06e None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:53.043843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112aee2-c7a7-45dc-9913-74fb1f7df06e None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:53.108666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd88fa4-42dc-4685-979c-4f01735806dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:53.109857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd88fa4-42dc-4685-979c-4f01735806dc None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.110142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd88fa4-42dc-4685-979c-4f01735806dc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.110417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd88fa4-42dc-4685-979c-4f01735806dc None admin] PATH_INFO: `/v3/users/glance` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.122221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd88fa4-42dc-4685-979c-4f01735806dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:53.124961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd88fa4-42dc-4685-979c-4f01735806dc None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:53.126379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a08f14-f685-4e9a-9198-bd5b5fd0df7e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-0bd88fa4-42dc-4685-979c-4f01735806dc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:53.143259 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:53.144281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:53.145288 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:53.145288 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:53.145288 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:53.145288 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:53.145288 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:53.145288 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:53.145288 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:53.145288 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:53.145288 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 15:10:53.145288 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:53.145874 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 322/623] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:53.147534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647c65e-cf0c-47a0-9e92-a288534f865b None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.147534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647c65e-cf0c-47a0-9e92-a288534f865b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.147710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647c65e-cf0c-47a0-9e92-a288534f865b None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.149350 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 323/624] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:53.151091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647c65e-cf0c-47a0-9e92-a288534f865b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:53.177188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f13fb-ccfc-44a7-a991-da0daa26ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:53.177935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f13fb-ccfc-44a7-a991-da0daa26ebce None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.178428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f13fb-ccfc-44a7-a991-da0daa26ebce None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.178862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f13fb-ccfc-44a7-a991-da0daa26ebce None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.180282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f13fb-ccfc-44a7-a991-da0daa26ebce None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:53.180764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f13fb-ccfc-44a7-a991-da0daa26ebce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:53.182728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f13fb-ccfc-44a7-a991-da0daa26ebce None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:53.198866 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 302/625] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:10:53.200246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c8c3a-5b6d-4ebb-b82a-2fb2e473a116 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.200534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c8c3a-5b6d-4ebb-b82a-2fb2e473a116 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.200848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c8c3a-5b6d-4ebb-b82a-2fb2e473a116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.201839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:53.222201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-524c8c3a-5b6d-4ebb-b82a-2fb2e473a116 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:53.223937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-524c8c3a-5b6d-4ebb-b82a-2fb2e473a116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:53.257548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:53.267951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647c65e-cf0c-47a0-9e92-a288534f865b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:53.301908 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 303/626] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:53.302686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c8c3a-5b6d-4ebb-b82a-2fb2e473a116 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:53.315591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81ba19-9fdf-4eb8-9daf-3845877b84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:53.315591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81ba19-9fdf-4eb8-9daf-3845877b84a8 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.315591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81ba19-9fdf-4eb8-9daf-3845877b84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.315591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81ba19-9fdf-4eb8-9daf-3845877b84a8 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.316045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81ba19-9fdf-4eb8-9daf-3845877b84a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:53.316045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81ba19-9fdf-4eb8-9daf-3845877b84a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:53.316699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81ba19-9fdf-4eb8-9daf-3845877b84a8 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:53.337094 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 324/627] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Aug 29 15:10:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:53.338486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05743a-7875-43f1-bc65-a677c9f2db2e None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.338780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05743a-7875-43f1-bc65-a677c9f2db2e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.339059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05743a-7875-43f1-bc65-a677c9f2db2e None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.344680 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 325/628] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:53.344680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05743a-7875-43f1-bc65-a677c9f2db2e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:53.424577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c8c3a-5b6d-4ebb-b82a-2fb2e473a116 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:53.465309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb57464-5570-469c-8e18-42479ecd62e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:53.466539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb57464-5570-469c-8e18-42479ecd62e3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.467263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb57464-5570-469c-8e18-42479ecd62e3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.467747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb57464-5570-469c-8e18-42479ecd62e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.474715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:53.477959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb57464-5570-469c-8e18-42479ecd62e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:53.479887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb57464-5570-469c-8e18-42479ecd62e3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:53.483554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05743a-7875-43f1-bc65-a677c9f2db2e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-8cb57464-5570-469c-8e18-42479ecd62e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:53.494768 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:53.495763 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:53.496829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:53.496829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:53.496829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:53.496829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:53.496829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:53.496829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:53.496829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:53.496829 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:53.505610 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 304/629] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:53.507535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712c7d-b32d-4ab4-a5a5-9b9649644c08 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.508561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712c7d-b32d-4ab4-a5a5-9b9649644c08 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.509064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712c7d-b32d-4ab4-a5a5-9b9649644c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.532339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9a712c7d-b32d-4ab4-a5a5-9b9649644c08 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:53.534341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9a712c7d-b32d-4ab4-a5a5-9b9649644c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:53.556653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686589ea-4f35-4396-8f86-aff237f47eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:53.557976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686589ea-4f35-4396-8f86-aff237f47eda None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.558481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686589ea-4f35-4396-8f86-aff237f47eda None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.559050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686589ea-4f35-4396-8f86-aff237f47eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.565715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:53.617661 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 305/630] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:53.618527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712c7d-b32d-4ab4-a5a5-9b9649644c08 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:53.655320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686589ea-4f35-4396-8f86-aff237f47eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:53.656824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686589ea-4f35-4396-8f86-aff237f47eda None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:53.771218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712c7d-b32d-4ab4-a5a5-9b9649644c08 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:53.798001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:53.806879 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 326/631] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:53.807978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686589ea-4f35-4396-8f86-aff237f47eda None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:53.809680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26116a35-c1e9-4783-ba09-196bafe6af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:53.810856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116a35-c1e9-4783-ba09-196bafe6af4b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.811143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116a35-c1e9-4783-ba09-196bafe6af4b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.811416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116a35-c1e9-4783-ba09-196bafe6af4b None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.812125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26116a35-c1e9-4783-ba09-196bafe6af4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:53.812457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26116a35-c1e9-4783-ba09-196bafe6af4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:53.813936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26116a35-c1e9-4783-ba09-196bafe6af4b None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:53.834537 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 306/632] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:53.834537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039d37-aaaa-49e6-b792-a2e48e47c4da None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.834537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039d37-aaaa-49e6-b792-a2e48e47c4da None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.834537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039d37-aaaa-49e6-b792-a2e48e47c4da None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.837641 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 307/633] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:53.838706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039d37-aaaa-49e6-b792-a2e48e47c4da None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:53.861071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:53.944074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686589ea-4f35-4396-8f86-aff237f47eda None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:53.963823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039d37-aaaa-49e6-b792-a2e48e47c4da None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:53.980082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e38cc-5ef4-4591-9a88-b4254c6d027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:53.980729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e38cc-5ef4-4591-9a88-b4254c6d027b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:53.981011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e38cc-5ef4-4591-9a88-b4254c6d027b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:53.981285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e38cc-5ef4-4591-9a88-b4254c6d027b None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:53.992567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e38cc-5ef4-4591-9a88-b4254c6d027b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-508e38cc-5ef4-4591-9a88-b4254c6d027b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:53.997482 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:53.999050 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:53.999910 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 327/634] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:54.000622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e38cc-5ef4-4591-9a88-b4254c6d027b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:54.007085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f333aec-2f2d-45d6-9047-c28be10bb2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:54.007732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f333aec-2f2d-45d6-9047-c28be10bb2d8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:54.007998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f333aec-2f2d-45d6-9047-c28be10bb2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:54.008271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f333aec-2f2d-45d6-9047-c28be10bb2d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:54.020946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f333aec-2f2d-45d6-9047-c28be10bb2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:54.022505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f333aec-2f2d-45d6-9047-c28be10bb2d8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-1f333aec-2f2d-45d6-9047-c28be10bb2d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:54.037588 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:54.038678 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:54.039593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:54.039593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:54.039593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:54.039593 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 308/635] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:54.040039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e6661-3b13-4151-b914-813a81768db9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:54.040141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e6661-3b13-4151-b914-813a81768db9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:54.040397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e6661-3b13-4151-b914-813a81768db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:54.061158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-604e6661-3b13-4151-b914-813a81768db9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:54.062382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-604e6661-3b13-4151-b914-813a81768db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:54.079736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:54.123940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e38cc-5ef4-4591-9a88-b4254c6d027b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:54.131669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:54.137469 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 309/636] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:54.138632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e6661-3b13-4151-b914-813a81768db9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:54.167835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c9af-528d-4e96-a294-948e2474186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:54.168907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c9af-528d-4e96-a294-948e2474186e None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:54.169379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c9af-528d-4e96-a294-948e2474186e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:54.170482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c9af-528d-4e96-a294-948e2474186e None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/8fad5b29e028436ca5596434a0cce086/roles/1471575d20cd435ca6fb71c29c92fb64` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:54.187884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3c9af-528d-4e96-a294-948e2474186e None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=8fad5b29e028436ca5596434a0cce086, role_id=1471575d20cd435ca6fb71c29c92fb64)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:54.189356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3c9af-528d-4e96-a294-948e2474186e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:54.213611 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 328/637] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:10:53 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/8fad5b29e028436ca5596434a0cce086/roles/1471575d20cd435ca6fb71c29c92fb64 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:10:54.214226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c9af-528d-4e96-a294-948e2474186e None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:54.288626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e6661-3b13-4151-b914-813a81768db9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:54.329571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816963e-760f-404c-8866-b1f7e623cda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:54.330218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816963e-760f-404c-8866-b1f7e623cda9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:54.330486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816963e-760f-404c-8866-b1f7e623cda9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:54.330742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816963e-760f-404c-8866-b1f7e623cda9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:54.347127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816963e-760f-404c-8866-b1f7e623cda9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-f816963e-760f-404c-8866-b1f7e623cda9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:54.352642 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:54.353728 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:54.354616 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 310/638] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:54.355330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816963e-760f-404c-8866-b1f7e623cda9 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:54.362774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c9af-528d-4e96-a294-948e2474186e None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:54.378225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:54.414700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acf435-08bc-4e0a-8658-b4b8d0607b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:54.415818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acf435-08bc-4e0a-8658-b4b8d0607b4b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:54.416377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acf435-08bc-4e0a-8658-b4b8d0607b4b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:54.416855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acf435-08bc-4e0a-8658-b4b8d0607b4b None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:54.418519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acf435-08bc-4e0a-8658-b4b8d0607b4b None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:54.419430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acf435-08bc-4e0a-8658-b4b8d0607b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:54.422670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acf435-08bc-4e0a-8658-b4b8d0607b4b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:54.432698 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 329/639] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:54.433642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:54.434909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acf435-08bc-4e0a-8658-b4b8d0607b4b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:54.485298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816963e-760f-404c-8866-b1f7e623cda9 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:54.539493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2091173-10a8-4976-986c-a51dab3762fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:54.540070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2091173-10a8-4976-986c-a51dab3762fe None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:54.540356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2091173-10a8-4976-986c-a51dab3762fe None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:54.540653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2091173-10a8-4976-986c-a51dab3762fe None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:54.541312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2091173-10a8-4976-986c-a51dab3762fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:54.541638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2091173-10a8-4976-986c-a51dab3762fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:54.543008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2091173-10a8-4976-986c-a51dab3762fe None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:54.558359 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 311/640] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:54.559140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2091173-10a8-4976-986c-a51dab3762fe None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:54.569828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acf435-08bc-4e0a-8658-b4b8d0607b4b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:54.620015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a2285-6f42-4952-ad88-34d9c84313f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:54.620623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2285-6f42-4952-ad88-34d9c84313f7 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:54.620914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2285-6f42-4952-ad88-34d9c84313f7 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:54.621175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2285-6f42-4952-ad88-34d9c84313f7 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:54.621870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a2285-6f42-4952-ad88-34d9c84313f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:54.622170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a2285-6f42-4952-ad88-34d9c84313f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:54.624079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a2285-6f42-4952-ad88-34d9c84313f7 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:54.648058 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 330/641] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:54.648058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a2285-6f42-4952-ad88-34d9c84313f7 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:54.689659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:54.690266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2091173-10a8-4976-986c-a51dab3762fe None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:54.719018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:54.734768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109662-c8d8-493a-a8dd-99a0c48a83d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:54.735399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109662-c8d8-493a-a8dd-99a0c48a83d5 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:54.735677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109662-c8d8-493a-a8dd-99a0c48a83d5 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:54.735943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109662-c8d8-493a-a8dd-99a0c48a83d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:54.746759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93109662-c8d8-493a-a8dd-99a0c48a83d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-93109662-c8d8-493a-a8dd-99a0c48a83d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:54.752664 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:54.753670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:54.754520 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 312/642] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:54.755231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109662-c8d8-493a-a8dd-99a0c48a83d5 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:54.771916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a2285-6f42-4952-ad88-34d9c84313f7 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:54.808100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5f18e-35fb-459b-82fd-87fdd7e32e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:54.808991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5f18e-35fb-459b-82fd-87fdd7e32e99 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:54.809358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5f18e-35fb-459b-82fd-87fdd7e32e99 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:54.809558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5f18e-35fb-459b-82fd-87fdd7e32e99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:54.822478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5f18e-35fb-459b-82fd-87fdd7e32e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:54.824038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5f18e-35fb-459b-82fd-87fdd7e32e99 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-b0d5f18e-35fb-459b-82fd-87fdd7e32e99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:54.838815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:54.839858 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:54.845993 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:54.845993 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:54.845993 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:54.845993 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 331/643] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:54.845993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5f18e-35fb-459b-82fd-87fdd7e32e99 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:54.872514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109662-c8d8-493a-a8dd-99a0c48a83d5 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:54.909459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b61e6b-e290-47c9-ac44-e72d32eb8231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:54.910177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61e6b-e290-47c9-ac44-e72d32eb8231 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:54.910527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61e6b-e290-47c9-ac44-e72d32eb8231 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:54.910801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61e6b-e290-47c9-ac44-e72d32eb8231 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:54.917626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b61e6b-e290-47c9-ac44-e72d32eb8231 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:54.919082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b61e6b-e290-47c9-ac44-e72d32eb8231 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-d8b61e6b-e290-47c9-ac44-e72d32eb8231 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:54.930654 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:54.931561 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:54.932631 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:54.932631 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:54.932631 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:54.932631 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:54.932631 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:54.932631 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:54.932631 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:54.932631 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:54.932631 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 313/644] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:54.932631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b61e6b-e290-47c9-ac44-e72d32eb8231 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:54.939937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:54.961047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5f18e-35fb-459b-82fd-87fdd7e32e99 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:54.978587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:54.996620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89bd0b-fbf0-4086-8d8b-2d458add1b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:54.997252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89bd0b-fbf0-4086-8d8b-2d458add1b1c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:54.997567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89bd0b-fbf0-4086-8d8b-2d458add1b1c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:54.998355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89bd0b-fbf0-4086-8d8b-2d458add1b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:55.009081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89bd0b-fbf0-4086-8d8b-2d458add1b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:55.010603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89bd0b-fbf0-4086-8d8b-2d458add1b1c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-3c89bd0b-fbf0-4086-8d8b-2d458add1b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:55.029774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:55.030803 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:55.031736 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:55.031736 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:55.031736 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:55.031736 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 332/645] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:55.031965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89bd0b-fbf0-4086-8d8b-2d458add1b1c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:55.047935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b61e6b-e290-47c9-ac44-e72d32eb8231 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:55.082675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac044643-5256-4f01-b24d-9981f2a0638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:55.083197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044643-5256-4f01-b24d-9981f2a0638f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:55.083480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044643-5256-4f01-b24d-9981f2a0638f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:55.083740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044643-5256-4f01-b24d-9981f2a0638f None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:55.084404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac044643-5256-4f01-b24d-9981f2a0638f None admin] RBAC: Adding query filter params (name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:55.084702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac044643-5256-4f01-b24d-9981f2a0638f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:55.086116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac044643-5256-4f01-b24d-9981f2a0638f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:55.094498 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 314/646] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:55.095323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac044643-5256-4f01-b24d-9981f2a0638f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:55.155732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89bd0b-fbf0-4086-8d8b-2d458add1b1c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:55.192806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5747f4-5a1c-4209-b4cc-8d625625d790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:55.193788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5747f4-5a1c-4209-b4cc-8d625625d790 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:55.194138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5747f4-5a1c-4209-b4cc-8d625625d790 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:55.194411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5747f4-5a1c-4209-b4cc-8d625625d790 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:55.195063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5747f4-5a1c-4209-b4cc-8d625625d790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:55.195364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5747f4-5a1c-4209-b4cc-8d625625d790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:55.196812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5747f4-5a1c-4209-b4cc-8d625625d790 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:55.204440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:55.209638 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 333/647] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:55.210605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5747f4-5a1c-4209-b4cc-8d625625d790 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:55.225487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac044643-5256-4f01-b24d-9981f2a0638f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:55.227839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:55.260843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0722b-ebee-4808-bf41-da75f1c731a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:55.261559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0722b-ebee-4808-bf41-da75f1c731a5 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:55.261893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0722b-ebee-4808-bf41-da75f1c731a5 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:55.262179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0722b-ebee-4808-bf41-da75f1c731a5 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:55.262860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0722b-ebee-4808-bf41-da75f1c731a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:55.263165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0722b-ebee-4808-bf41-da75f1c731a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:55.265336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0722b-ebee-4808-bf41-da75f1c731a5 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:55.281297 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 315/648] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:55.282516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0722b-ebee-4808-bf41-da75f1c731a5 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:55.321223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5747f4-5a1c-4209-b4cc-8d625625d790 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:55.364561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3764b10-ecaa-4a42-ae12-32fe957bdad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:55.365187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3764b10-ecaa-4a42-ae12-32fe957bdad3 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:55.365405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3764b10-ecaa-4a42-ae12-32fe957bdad3 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:55.365683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3764b10-ecaa-4a42-ae12-32fe957bdad3 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:55.366327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3764b10-ecaa-4a42-ae12-32fe957bdad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:55.366628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3764b10-ecaa-4a42-ae12-32fe957bdad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:55.368091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3764b10-ecaa-4a42-ae12-32fe957bdad3 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:55.385062 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 334/649] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:55.385062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3764b10-ecaa-4a42-ae12-32fe957bdad3 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:55.400584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0722b-ebee-4808-bf41-da75f1c731a5 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:55.444969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760651df-7109-484f-ad73-abbfde4be4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:55.445603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:55.446290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760651df-7109-484f-ad73-abbfde4be4ef None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:55.446472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760651df-7109-484f-ad73-abbfde4be4ef None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:55.446888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760651df-7109-484f-ad73-abbfde4be4ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:55.458852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760651df-7109-484f-ad73-abbfde4be4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:55.460304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760651df-7109-484f-ad73-abbfde4be4ef None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-760651df-7109-484f-ad73-abbfde4be4ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:55.482515 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:55.483572 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:55.484474 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:55.484474 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:55.484474 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:55.484474 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 316/650] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:55.485523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760651df-7109-484f-ad73-abbfde4be4ef None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:55.505154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:55.527696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3764b10-ecaa-4a42-ae12-32fe957bdad3 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:55.575540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092ee8f-ea04-4f27-a0ff-8753e3ae0a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:55.577407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ee8f-ea04-4f27-a0ff-8753e3ae0a7d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:55.588465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ee8f-ea04-4f27-a0ff-8753e3ae0a7d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:55.588885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ee8f-ea04-4f27-a0ff-8753e3ae0a7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:55.600935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092ee8f-ea04-4f27-a0ff-8753e3ae0a7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:55.602501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092ee8f-ea04-4f27-a0ff-8753e3ae0a7d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-d092ee8f-ea04-4f27-a0ff-8753e3ae0a7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:55.617659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:55.619454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 335/651] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:10:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:55.622392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092ee8f-ea04-4f27-a0ff-8753e3ae0a7d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:55.638014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760651df-7109-484f-ad73-abbfde4be4ef None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:55.677329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff231547-2abf-4053-b8cd-d78a25814067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:55.677971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff231547-2abf-4053-b8cd-d78a25814067 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:55.678254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff231547-2abf-4053-b8cd-d78a25814067 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:55.678525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff231547-2abf-4053-b8cd-d78a25814067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:55.679249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff231547-2abf-4053-b8cd-d78a25814067 None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=3f161a87f6fe42aa84e61b33160924ed) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:55.679557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff231547-2abf-4053-b8cd-d78a25814067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:55.680980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff231547-2abf-4053-b8cd-d78a25814067 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:55.697442 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 317/652] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:55 2022] GET /identity/v3/role_assignments?user.id=3f161a87f6fe42aa84e61b33160924ed&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:55.697442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff231547-2abf-4053-b8cd-d78a25814067 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:55.751183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092ee8f-ea04-4f27-a0ff-8753e3ae0a7d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:55.775392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:55.802196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380541a4-a011-4812-81de-08ea90043641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:55.802905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380541a4-a011-4812-81de-08ea90043641 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:55.803180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380541a4-a011-4812-81de-08ea90043641 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:55.803504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380541a4-a011-4812-81de-08ea90043641 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:55.806753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:55.815405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380541a4-a011-4812-81de-08ea90043641 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:55.817566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380541a4-a011-4812-81de-08ea90043641 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-380541a4-a011-4812-81de-08ea90043641 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:55.832059 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:55.833180 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:55.834189 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:55.834189 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:55.834189 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:55.834189 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:55.834189 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:55.834189 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:55.834189 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:55.834189 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:55.834189 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:10:55.834189 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:55.838488 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 336/653] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Aug 29 15:10:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:55.839666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380541a4-a011-4812-81de-08ea90043641 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:55.843542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff231547-2abf-4053-b8cd-d78a25814067 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:55.892928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0776c-0625-4c40-9b99-4bcfe893f7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:55.893971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0776c-0625-4c40-9b99-4bcfe893f7f4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:55.894465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0776c-0625-4c40-9b99-4bcfe893f7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:55.894963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0776c-0625-4c40-9b99-4bcfe893f7f4 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:55.895785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0776c-0625-4c40-9b99-4bcfe893f7f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:55.896340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0776c-0625-4c40-9b99-4bcfe893f7f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:55.897762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0776c-0625-4c40-9b99-4bcfe893f7f4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:55.914940 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 318/654] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:55.915696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0776c-0625-4c40-9b99-4bcfe893f7f4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:55.975969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380541a4-a011-4812-81de-08ea90043641 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:56.023323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f3caa-25aa-45b2-8a6b-4e6cc56c6efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:56.024375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3caa-25aa-45b2-8a6b-4e6cc56c6efe None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:56.024660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3caa-25aa-45b2-8a6b-4e6cc56c6efe None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:56.024933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3caa-25aa-45b2-8a6b-4e6cc56c6efe None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:56.025967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f3caa-25aa-45b2-8a6b-4e6cc56c6efe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:56.026270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f3caa-25aa-45b2-8a6b-4e6cc56c6efe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:56.028441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f3caa-25aa-45b2-8a6b-4e6cc56c6efe None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:56.045783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0776c-0625-4c40-9b99-4bcfe893f7f4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:56.052593 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 337/655] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Aug 29 15:10:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:56.060081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f3caa-25aa-45b2-8a6b-4e6cc56c6efe None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:56.092307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c4f94-0efa-464b-be99-a9e74bd119dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:56.093316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c4f94-0efa-464b-be99-a9e74bd119dc None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:56.093647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c4f94-0efa-464b-be99-a9e74bd119dc None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:56.093925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c4f94-0efa-464b-be99-a9e74bd119dc None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:56.094725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c4f94-0efa-464b-be99-a9e74bd119dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:56.095032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c4f94-0efa-464b-be99-a9e74bd119dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:56.097401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c4f94-0efa-464b-be99-a9e74bd119dc None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:56.109210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:56.121851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:56.122284 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 319/656] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Aug 29 15:10:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:56.125540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c4f94-0efa-464b-be99-a9e74bd119dc None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:56.197255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f3caa-25aa-45b2-8a6b-4e6cc56c6efe None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:56.234836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c4f94-0efa-464b-be99-a9e74bd119dc None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:56.236480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff833b5-4577-4a84-b69b-bd49d9799332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:56.237254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff833b5-4577-4a84-b69b-bd49d9799332 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:56.237562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff833b5-4577-4a84-b69b-bd49d9799332 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:56.237837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff833b5-4577-4a84-b69b-bd49d9799332 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:56.245975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff833b5-4577-4a84-b69b-bd49d9799332 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:56.247759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff833b5-4577-4a84-b69b-bd49d9799332 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-fff833b5-4577-4a84-b69b-bd49d9799332 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:56.261068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:56.262318 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 338/657] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:56.263867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff833b5-4577-4a84-b69b-bd49d9799332 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:56.281034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3ffef-9604-430d-8c16-1f643fa956de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:56.281766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3ffef-9604-430d-8c16-1f643fa956de None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:56.282048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3ffef-9604-430d-8c16-1f643fa956de None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:56.282327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3ffef-9604-430d-8c16-1f643fa956de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:56.351284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:56.359566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3ffef-9604-430d-8c16-1f643fa956de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:56.361033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3ffef-9604-430d-8c16-1f643fa956de None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:56.373211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:56.380304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff833b5-4577-4a84-b69b-bd49d9799332 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:56.418647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769e9c7-fbcf-489c-b3d1-9729c8a50499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:56.419264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e9c7-fbcf-489c-b3d1-9729c8a50499 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:56.419578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e9c7-fbcf-489c-b3d1-9729c8a50499 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:56.419844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e9c7-fbcf-489c-b3d1-9729c8a50499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:56.481880 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 320/658] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:56.483994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887523bc-3f68-43a0-861b-e2f8011b371d None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:56.484514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887523bc-3f68-43a0-861b-e2f8011b371d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:56.484991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887523bc-3f68-43a0-861b-e2f8011b371d None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:56.490992 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 321/659] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:56.491996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887523bc-3f68-43a0-861b-e2f8011b371d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:56.508054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769e9c7-fbcf-489c-b3d1-9729c8a50499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:56.509750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769e9c7-fbcf-489c-b3d1-9729c8a50499 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:56.613012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:56.615161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:56.621666 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 339/660] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:56.625907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887523bc-3f68-43a0-861b-e2f8011b371d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:56.627430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769e9c7-fbcf-489c-b3d1-9729c8a50499 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:56.667000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5cdb9-9af2-4919-a323-8f44e6ad7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:56.667605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5cdb9-9af2-4919-a323-8f44e6ad7b64 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:56.667976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5cdb9-9af2-4919-a323-8f44e6ad7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:56.672049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5cdb9-9af2-4919-a323-8f44e6ad7b64 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:56.672049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5cdb9-9af2-4919-a323-8f44e6ad7b64 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:56.672049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5cdb9-9af2-4919-a323-8f44e6ad7b64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:56.672049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5cdb9-9af2-4919-a323-8f44e6ad7b64 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:56.698923 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 322/661] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Aug 29 15:10:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:56.700390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559c2b3-0006-4afc-9120-ae2f6b936eee None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:56.700733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559c2b3-0006-4afc-9120-ae2f6b936eee None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:56.701585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559c2b3-0006-4afc-9120-ae2f6b936eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:56.720828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b559c2b3-0006-4afc-9120-ae2f6b936eee None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:56.722126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b559c2b3-0006-4afc-9120-ae2f6b936eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:56.769221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769e9c7-fbcf-489c-b3d1-9729c8a50499 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:56.797306 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 323/662] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:56.798529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559c2b3-0006-4afc-9120-ae2f6b936eee None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:56.820778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d4d2-aabc-42c6-ae9b-6f691a64c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:56.821865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d4d2-aabc-42c6-ae9b-6f691a64c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:56.822402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d4d2-aabc-42c6-ae9b-6f691a64c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:56.823461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d4d2-aabc-42c6-ae9b-6f691a64c3b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:56.839616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5d4d2-aabc-42c6-ae9b-6f691a64c3b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:56.841519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5d4d2-aabc-42c6-ae9b-6f691a64c3b9 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-73d5d4d2-aabc-42c6-ae9b-6f691a64c3b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:56.863659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:56.864693 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:56.865659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:56.865659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:56.865659 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:56.872104 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 340/663] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:56.872104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d4d2-aabc-42c6-ae9b-6f691a64c3b9 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:56.908879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:56.928648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:56.935790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559c2b3-0006-4afc-9120-ae2f6b936eee None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:57.002382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b93b6-7b85-40d7-9952-1b2397adadb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:57.003076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d4d2-aabc-42c6-ae9b-6f691a64c3b9 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:57.003816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b93b6-7b85-40d7-9952-1b2397adadb7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:57.004301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b93b6-7b85-40d7-9952-1b2397adadb7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:57.004825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b93b6-7b85-40d7-9952-1b2397adadb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:57.017566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b93b6-7b85-40d7-9952-1b2397adadb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:57.020687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b93b6-7b85-40d7-9952-1b2397adadb7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:57.040956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08892d61-cadf-43c5-ae2d-0533e0689b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:57.041680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08892d61-cadf-43c5-ae2d-0533e0689b04 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:57.041960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08892d61-cadf-43c5-ae2d-0533e0689b04 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:57.042232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08892d61-cadf-43c5-ae2d-0533e0689b04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-305b93b6-7b85-40d7-9952-1b2397adadb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:57.049239 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:57.050820 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:57.051876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:57.051876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:57.051876 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:57.054987 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 324/664] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:57.056743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b93b6-7b85-40d7-9952-1b2397adadb7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:57.120774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08892d61-cadf-43c5-ae2d-0533e0689b04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:57.122269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08892d61-cadf-43c5-ae2d-0533e0689b04 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:57.174582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b93b6-7b85-40d7-9952-1b2397adadb7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:57.177150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:57.214034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cfd7a-d096-414f-b08e-a3071b31e9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:57.214497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cfd7a-d096-414f-b08e-a3071b31e9c4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:57.214771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cfd7a-d096-414f-b08e-a3071b31e9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:57.215037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cfd7a-d096-414f-b08e-a3071b31e9c4 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:57.215672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cfd7a-d096-414f-b08e-a3071b31e9c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:57.215968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cfd7a-d096-414f-b08e-a3071b31e9c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:57.217935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cfd7a-d096-414f-b08e-a3071b31e9c4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:57.220747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:57.232371 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 325/665] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:57.233219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cfd7a-d096-414f-b08e-a3071b31e9c4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:57.240880 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 341/666] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:57.241761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08892d61-cadf-43c5-ae2d-0533e0689b04 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:57.342962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cfd7a-d096-414f-b08e-a3071b31e9c4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:57.356586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08892d61-cadf-43c5-ae2d-0533e0689b04 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:57.381652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487740-6866-45b1-88e6-c886eccf383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:57.382284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487740-6866-45b1-88e6-c886eccf383d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:57.382568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487740-6866-45b1-88e6-c886eccf383d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:57.382892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487740-6866-45b1-88e6-c886eccf383d None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:57.383556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e487740-6866-45b1-88e6-c886eccf383d None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:57.383861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e487740-6866-45b1-88e6-c886eccf383d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:57.385301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e487740-6866-45b1-88e6-c886eccf383d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:57.398266 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 326/667] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:57.399480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487740-6866-45b1-88e6-c886eccf383d None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:57.403895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9942204-b238-4860-a877-0660547f82e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:57.404617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942204-b238-4860-a877-0660547f82e9 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:57.404890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942204-b238-4860-a877-0660547f82e9 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:57.405156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942204-b238-4860-a877-0660547f82e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:57.416972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9942204-b238-4860-a877-0660547f82e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-d9942204-b238-4860-a877-0660547f82e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:10:57.423118 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:57.424903 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 342/668] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:10:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:57.426103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9942204-b238-4860-a877-0660547f82e9 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:57.441269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:57.487388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:57.542631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487740-6866-45b1-88e6-c886eccf383d None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:57.551871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9942204-b238-4860-a877-0660547f82e9 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:57.581278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73f31b-1a03-4be5-a4c4-476b3c80f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:57.581966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73f31b-1a03-4be5-a4c4-476b3c80f4f8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:57.582279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73f31b-1a03-4be5-a4c4-476b3c80f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:57.582526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73f31b-1a03-4be5-a4c4-476b3c80f4f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:57.589832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cff130-4458-4298-b7c8-ed2c8ed551b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:57.590453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73f31b-1a03-4be5-a4c4-476b3c80f4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:57.590582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff130-4458-4298-b7c8-ed2c8ed551b1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:57.590847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff130-4458-4298-b7c8-ed2c8ed551b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:57.591131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff130-4458-4298-b7c8-ed2c8ed551b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:57.592146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73f31b-1a03-4be5-a4c4-476b3c80f4f8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:57.604477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cff130-4458-4298-b7c8-ed2c8ed551b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-6b73f31b-1a03-4be5-a4c4-476b3c80f4f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:57.605536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:57.606420 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:57.607888 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:57.607888 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:57.607888 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:57.607888 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:57.607888 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:57.607888 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:57.607888 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:57.607888 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:57.608352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cff130-4458-4298-b7c8-ed2c8ed551b1 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:57.608447 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 327/669] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:57.608447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73f31b-1a03-4be5-a4c4-476b3c80f4f8 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-13cff130-4458-4298-b7c8-ed2c8ed551b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:57.627437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:57.628474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:57.629373 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:57.629373 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:57.629373 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:57.629373 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 343/670] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:57.629654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cff130-4458-4298-b7c8-ed2c8ed551b1 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:57.696500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:57.748983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73f31b-1a03-4be5-a4c4-476b3c80f4f8 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:57.769202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cff130-4458-4298-b7c8-ed2c8ed551b1 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:57.777565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:57.807911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e6dba-9069-485a-a2df-49852df40ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:57.808696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e6dba-9069-485a-a2df-49852df40ef9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:57.809112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e6dba-9069-485a-a2df-49852df40ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:57.809656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e6dba-9069-485a-a2df-49852df40ef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:57.818906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e6dba-9069-485a-a2df-49852df40ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:57.819993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e63ec-e9a9-435a-9ff0-13aa004ad2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:57.820604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e63ec-e9a9-435a-9ff0-13aa004ad2d0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:57.820766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e6dba-9069-485a-a2df-49852df40ef9 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:57.820902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e63ec-e9a9-435a-9ff0-13aa004ad2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:57.821143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e63ec-e9a9-435a-9ff0-13aa004ad2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:57.821839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e63ec-e9a9-435a-9ff0-13aa004ad2d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:57.822139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e63ec-e9a9-435a-9ff0-13aa004ad2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:57.823564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e63ec-e9a9-435a-9ff0-13aa004ad2d0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:57.833610 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 344/671] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:10:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:57.834608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e63ec-e9a9-435a-9ff0-13aa004ad2d0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-893e6dba-9069-485a-a2df-49852df40ef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:57.834901 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:57.836074 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:57.838648 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:57.838648 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:57.838648 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:57.838648 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:57.838648 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:57.838648 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:57.838648 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:57.838648 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:57.838648 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 328/672] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:57.838648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e6dba-9069-485a-a2df-49852df40ef9 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:57.941923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e63ec-e9a9-435a-9ff0-13aa004ad2d0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:57.942578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e6dba-9069-485a-a2df-49852df40ef9 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:57.964236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:57.977610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654946a-26d4-47a2-b688-3190a73a72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:57.978053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b6370-e8e3-41c6-bfdf-49443e41b225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:57.978227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654946a-26d4-47a2-b688-3190a73a72a0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:57.978595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654946a-26d4-47a2-b688-3190a73a72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:57.978800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b6370-e8e3-41c6-bfdf-49443e41b225 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:57.979022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654946a-26d4-47a2-b688-3190a73a72a0 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:57.979120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b6370-e8e3-41c6-bfdf-49443e41b225 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:57.979204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b6370-e8e3-41c6-bfdf-49443e41b225 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:57.979468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654946a-26d4-47a2-b688-3190a73a72a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:57.979775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654946a-26d4-47a2-b688-3190a73a72a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:57.979874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b6370-e8e3-41c6-bfdf-49443e41b225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:57.980077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b6370-e8e3-41c6-bfdf-49443e41b225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:57.981209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654946a-26d4-47a2-b688-3190a73a72a0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:57.981448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b6370-e8e3-41c6-bfdf-49443e41b225 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:57.994346 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 345/673] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:57.999865 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 329/674] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:58.000026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233edd66-cde1-4edb-8c8f-0f8a2e939274 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:58.000026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233edd66-cde1-4edb-8c8f-0f8a2e939274 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:58.000026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233edd66-cde1-4edb-8c8f-0f8a2e939274 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:58.000270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b6370-e8e3-41c6-bfdf-49443e41b225 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:58.000345 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 346/675] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:10:58.000345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233edd66-cde1-4edb-8c8f-0f8a2e939274 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:58.039067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:58.109841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233edd66-cde1-4edb-8c8f-0f8a2e939274 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:58.117350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b6370-e8e3-41c6-bfdf-49443e41b225 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:58.148795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce590176-d93e-44f0-bb84-2aae22d639e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:58.149440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce590176-d93e-44f0-bb84-2aae22d639e5 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:58.149723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce590176-d93e-44f0-bb84-2aae22d639e5 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:58.149996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce590176-d93e-44f0-bb84-2aae22d639e5 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:58.150688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce590176-d93e-44f0-bb84-2aae22d639e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:58.150991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce590176-d93e-44f0-bb84-2aae22d639e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:58.152419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce590176-d93e-44f0-bb84-2aae22d639e5 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:58.154430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933d22a-9485-4f1d-bf69-9757174041f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:58.155063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933d22a-9485-4f1d-bf69-9757174041f6 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:58.155342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933d22a-9485-4f1d-bf69-9757174041f6 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:58.155613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933d22a-9485-4f1d-bf69-9757174041f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:58.164573 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 347/676] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:58.165428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce590176-d93e-44f0-bb84-2aae22d639e5 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:58.166110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933d22a-9485-4f1d-bf69-9757174041f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:58.167574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933d22a-9485-4f1d-bf69-9757174041f6 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-4933d22a-9485-4f1d-bf69-9757174041f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:58.183544 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:58.185377 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:58.187603 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:58.187603 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:58.187603 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:58.187603 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 330/677] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:58.187603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933d22a-9485-4f1d-bf69-9757174041f6 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:58.219616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:58.280490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce590176-d93e-44f0-bb84-2aae22d639e5 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:58.295411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:58.308350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933d22a-9485-4f1d-bf69-9757174041f6 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:58.320331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648c22c-92af-4ddc-9efc-39fb8645988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:58.320939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648c22c-92af-4ddc-9efc-39fb8645988a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:58.321219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648c22c-92af-4ddc-9efc-39fb8645988a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:58.321531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648c22c-92af-4ddc-9efc-39fb8645988a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:58.322259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648c22c-92af-4ddc-9efc-39fb8645988a None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=e1ed0648d3b74de89966c6d2e2b8f30a) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:58.322567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648c22c-92af-4ddc-9efc-39fb8645988a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:58.323998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648c22c-92af-4ddc-9efc-39fb8645988a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:58.329892 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 348/678] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:58 2022] GET /identity/v3/role_assignments?user.id=e1ed0648d3b74de89966c6d2e2b8f30a&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:58.331079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7ae8a-2391-41c0-b289-624d5e15c60c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:58.331438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7ae8a-2391-41c0-b289-624d5e15c60c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:58.331718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7ae8a-2391-41c0-b289-624d5e15c60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:58.343312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f6fbb-a0fb-4e3e-b7b6-99ff4d445865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:58.343965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f6fbb-a0fb-4e3e-b7b6-99ff4d445865 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:58.344250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f6fbb-a0fb-4e3e-b7b6-99ff4d445865 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:58.344516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f6fbb-a0fb-4e3e-b7b6-99ff4d445865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:58.352283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f6fbb-a0fb-4e3e-b7b6-99ff4d445865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:58.352857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cde7ae8a-2391-41c0-b289-624d5e15c60c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:10:58.353813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f6fbb-a0fb-4e3e-b7b6-99ff4d445865 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:58.354144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cde7ae8a-2391-41c0-b289-624d5e15c60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-5f6f6fbb-a0fb-4e3e-b7b6-99ff4d445865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:10:58.367267 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:58.368312 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:58.369232 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:10:58.369232 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:10:58.369232 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:10:58.369232 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:10:58.369232 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:10:58.369232 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:10:58.369232 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:10:58.369232 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:58.369232 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 331/679] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:10:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:58.369232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f6fbb-a0fb-4e3e-b7b6-99ff4d445865 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:58.453498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 349/680] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:10:58.453498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7ae8a-2391-41c0-b289-624d5e15c60c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:58.504184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:58.526134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f6fbb-a0fb-4e3e-b7b6-99ff4d445865 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:58.586780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df926c88-eb3a-44a6-a9d7-8187e08f5057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:58.587717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df926c88-eb3a-44a6-a9d7-8187e08f5057 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:58.587997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df926c88-eb3a-44a6-a9d7-8187e08f5057 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:58.588264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df926c88-eb3a-44a6-a9d7-8187e08f5057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:58.589129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df926c88-eb3a-44a6-a9d7-8187e08f5057 None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=c235251bc54848279759ba3e71a38306) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:58.589603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df926c88-eb3a-44a6-a9d7-8187e08f5057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:58.591084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df926c88-eb3a-44a6-a9d7-8187e08f5057 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:58.593169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7ae8a-2391-41c0-b289-624d5e15c60c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:58.598161 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 332/681] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:58 2022] GET /identity/v3/role_assignments?user.id=c235251bc54848279759ba3e71a38306&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:58.602048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df926c88-eb3a-44a6-a9d7-8187e08f5057 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:58.626005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:58.636778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8178529-1148-4932-9764-bd134a3a9e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:58.637428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178529-1148-4932-9764-bd134a3a9e9b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:58.637796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178529-1148-4932-9764-bd134a3a9e9b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:58.638072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178529-1148-4932-9764-bd134a3a9e9b None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:58.638817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8178529-1148-4932-9764-bd134a3a9e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:58.639128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8178529-1148-4932-9764-bd134a3a9e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:58.640549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8178529-1148-4932-9764-bd134a3a9e9b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:58.656378 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 350/682] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:58.661645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8178529-1148-4932-9764-bd134a3a9e9b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:58.771136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df926c88-eb3a-44a6-a9d7-8187e08f5057 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:58.808212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:58.815867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8178529-1148-4932-9764-bd134a3a9e9b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:58.823463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbed101-f334-479e-b956-85b0c875b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:58.824242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed101-f334-479e-b956-85b0c875b31e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:58.824588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed101-f334-479e-b956-85b0c875b31e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:58.824936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed101-f334-479e-b956-85b0c875b31e None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:58.827454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbed101-f334-479e-b956-85b0c875b31e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:58.827454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbed101-f334-479e-b956-85b0c875b31e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:58.828324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbed101-f334-479e-b956-85b0c875b31e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:58.843282 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 333/683] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:58.844343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbed101-f334-479e-b956-85b0c875b31e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:58.867656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee5d7-c50c-4d83-8ecf-70dbd318a471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:58.869185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee5d7-c50c-4d83-8ecf-70dbd318a471 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:58.869711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee5d7-c50c-4d83-8ecf-70dbd318a471 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:58.870444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee5d7-c50c-4d83-8ecf-70dbd318a471 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:58.881079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ee5d7-c50c-4d83-8ecf-70dbd318a471 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:58.882854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ee5d7-c50c-4d83-8ecf-70dbd318a471 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-e38ee5d7-c50c-4d83-8ecf-70dbd318a471 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:10:58.903477 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:58.905018 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 351/684] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:10:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:10:58.906737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee5d7-c50c-4d83-8ecf-70dbd318a471 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:58.939940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:58.992743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbed101-f334-479e-b956-85b0c875b31e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:59.035928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831459d-eff9-4625-99bf-a8270f7be376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:59.036869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831459d-eff9-4625-99bf-a8270f7be376 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:59.037343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831459d-eff9-4625-99bf-a8270f7be376 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:59.037898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831459d-eff9-4625-99bf-a8270f7be376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:59.047734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee5d7-c50c-4d83-8ecf-70dbd318a471 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:59.056412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831459d-eff9-4625-99bf-a8270f7be376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:59.058855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831459d-eff9-4625-99bf-a8270f7be376 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-c831459d-eff9-4625-99bf-a8270f7be376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:59.086785 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:59.087835 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:59.089360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:59.089360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:59.089360 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:10:59.089360 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 334/685] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:59.089360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831459d-eff9-4625-99bf-a8270f7be376 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:59.094561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e43e7-5184-491b-93b2-ddcfa3b6f475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:59.095461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e43e7-5184-491b-93b2-ddcfa3b6f475 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:59.095976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e43e7-5184-491b-93b2-ddcfa3b6f475 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:59.096459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e43e7-5184-491b-93b2-ddcfa3b6f475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:59.097448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e43e7-5184-491b-93b2-ddcfa3b6f475 None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=d9d3bea88ab145a4b737bc88339f285c) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:59.097967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e43e7-5184-491b-93b2-ddcfa3b6f475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:59.100084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e43e7-5184-491b-93b2-ddcfa3b6f475 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:59.113704 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 352/686] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:10:58 2022] GET /identity/v3/role_assignments?user.id=d9d3bea88ab145a4b737bc88339f285c&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:59.113704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e43e7-5184-491b-93b2-ddcfa3b6f475 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:59.162474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:59.291357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e43e7-5184-491b-93b2-ddcfa3b6f475 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:59.309705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831459d-eff9-4625-99bf-a8270f7be376 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:59.343520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b84456-c56d-4e58-a47a-4c4f6f388507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:59.344416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b84456-c56d-4e58-a47a-4c4f6f388507 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:59.344691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b84456-c56d-4e58-a47a-4c4f6f388507 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:59.344961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b84456-c56d-4e58-a47a-4c4f6f388507 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:59.345942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:59.346660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b84456-c56d-4e58-a47a-4c4f6f388507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:59.346998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b84456-c56d-4e58-a47a-4c4f6f388507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:59.349292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b84456-c56d-4e58-a47a-4c4f6f388507 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:59.359832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef06c23-5388-4b6e-8938-09c82e8e13d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:59.360588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef06c23-5388-4b6e-8938-09c82e8e13d1 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:59.360866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef06c23-5388-4b6e-8938-09c82e8e13d1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:59.361134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef06c23-5388-4b6e-8938-09c82e8e13d1 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:59.362302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef06c23-5388-4b6e-8938-09c82e8e13d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:10:59.362302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef06c23-5388-4b6e-8938-09c82e8e13d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:59.363698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef06c23-5388-4b6e-8938-09c82e8e13d1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:59.366330 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 353/687] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:59.372144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b84456-c56d-4e58-a47a-4c4f6f388507 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:59.387791 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 335/688] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Aug 29 15:10:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:10:59.395084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef06c23-5388-4b6e-8938-09c82e8e13d1 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:59.497839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:59.524396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef06c23-5388-4b6e-8938-09c82e8e13d1 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:59.547358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b84456-c56d-4e58-a47a-4c4f6f388507 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:59.567296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049b9dc-d11e-4a42-ac95-152bf82f5dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:59.568527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b9dc-d11e-4a42-ac95-152bf82f5dba None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:59.568979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b9dc-d11e-4a42-ac95-152bf82f5dba None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:59.569446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b9dc-d11e-4a42-ac95-152bf82f5dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:59.624485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:59.646435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049b9dc-d11e-4a42-ac95-152bf82f5dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:59.648477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049b9dc-d11e-4a42-ac95-152bf82f5dba None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:59.691797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd8f32-426b-437b-92f0-82b620894e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:59.692420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8f32-426b-437b-92f0-82b620894e24 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:59.692698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8f32-426b-437b-92f0-82b620894e24 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:59.692967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8f32-426b-437b-92f0-82b620894e24 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:59.693870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd8f32-426b-437b-92f0-82b620894e24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:59.695400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd8f32-426b-437b-92f0-82b620894e24 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:59.749567 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 354/689] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:10:59 2022] POST /identity/v3/users => generated 254 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:10:59.760425 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 336/690] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:10:59.767036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd8f32-426b-437b-92f0-82b620894e24 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:10:59.885257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd8f32-426b-437b-92f0-82b620894e24 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:10:59.926486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421a578-608f-47c1-9b6b-c63621f72b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:10:59.927470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421a578-608f-47c1-9b6b-c63621f72b62 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:10:59.927922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421a578-608f-47c1-9b6b-c63621f72b62 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:10:59.928383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421a578-608f-47c1-9b6b-c63621f72b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:10:59.931917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:10:59.941883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421a578-608f-47c1-9b6b-c63621f72b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:10:59.943810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421a578-608f-47c1-9b6b-c63621f72b62 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-8421a578-608f-47c1-9b6b-c63621f72b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:10:59.962075 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:10:59.963139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:10:59.964073 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:10:59.964073 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:10:59.964073 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:10:59.966065 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 355/691] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:10:59.972799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049b9dc-d11e-4a42-ac95-152bf82f5dba None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:00.114661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:00.141947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049b9dc-d11e-4a42-ac95-152bf82f5dba None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:00.188141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4c4f8-08a8-4835-b27c-76acf4c080d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:00.188803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c4f8-08a8-4835-b27c-76acf4c080d6 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:00.189109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c4f8-08a8-4835-b27c-76acf4c080d6 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:00.189348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c4f8-08a8-4835-b27c-76acf4c080d6 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:00.190073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4c4f8-08a8-4835-b27c-76acf4c080d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:00.190373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4c4f8-08a8-4835-b27c-76acf4c080d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:00.191742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4c4f8-08a8-4835-b27c-76acf4c080d6 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:00.206269 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 337/692] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:00.212081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421a578-608f-47c1-9b6b-c63621f72b62 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:00.347600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421a578-608f-47c1-9b6b-c63621f72b62 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:00.392851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdcea8-f382-4678-beb2-9382fdebc52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:00.393859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdcea8-f382-4678-beb2-9382fdebc52b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:00.394530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdcea8-f382-4678-beb2-9382fdebc52b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:00.395207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdcea8-f382-4678-beb2-9382fdebc52b None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:00.407226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdcea8-f382-4678-beb2-9382fdebc52b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:00.409659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdcea8-f382-4678-beb2-9382fdebc52b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-b6fdcea8-f382-4678-beb2-9382fdebc52b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:00.425354 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:00.427076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:00.428784 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:00.428784 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:00.428784 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:00.428784 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:00.428784 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:00.428784 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:00.428784 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:00.428784 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:00.432013 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 356/693] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:00.438774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4c4f8-08a8-4835-b27c-76acf4c080d6 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:00.598345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4c4f8-08a8-4835-b27c-76acf4c080d6 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:00.644243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e1cf0-d566-4703-9988-14ed68f7d03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:00.645158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e1cf0-d566-4703-9988-14ed68f7d03e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:00.645605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e1cf0-d566-4703-9988-14ed68f7d03e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:00.646016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e1cf0-d566-4703-9988-14ed68f7d03e None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:00.646864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e1cf0-d566-4703-9988-14ed68f7d03e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:00.647326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e1cf0-d566-4703-9988-14ed68f7d03e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:00.648909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e1cf0-d566-4703-9988-14ed68f7d03e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:00.663232 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 338/694] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:00.671204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdcea8-f382-4678-beb2-9382fdebc52b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:00.738295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:00.807395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdcea8-f382-4678-beb2-9382fdebc52b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:00.855788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec61787-3f1c-4901-9b63-6c84ff26068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:00.856454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec61787-3f1c-4901-9b63-6c84ff26068e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:00.856735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec61787-3f1c-4901-9b63-6c84ff26068e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:00.857003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec61787-3f1c-4901-9b63-6c84ff26068e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:00.858381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec61787-3f1c-4901-9b63-6c84ff26068e None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=8fad5b29e028436ca5596434a0cce086) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:00.858690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec61787-3f1c-4901-9b63-6c84ff26068e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:00.860114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec61787-3f1c-4901-9b63-6c84ff26068e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:00.869338 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 357/695] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:00 2022] GET /identity/v3/role_assignments?user.id=8fad5b29e028436ca5596434a0cce086&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:00.910586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbf256-a529-4796-981c-536bf2e4bed4 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:00.910764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbf256-a529-4796-981c-536bf2e4bed4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:00.911037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbf256-a529-4796-981c-536bf2e4bed4 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:00.912602 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 339/696] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:00.918157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e90c-0031-4f1c-a8fc-59cd359a86e7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:00.918464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e90c-0031-4f1c-a8fc-59cd359a86e7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:00.918737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e90c-0031-4f1c-a8fc-59cd359a86e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:00.941686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6147e90c-0031-4f1c-a8fc-59cd359a86e7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:00.942890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6147e90c-0031-4f1c-a8fc-59cd359a86e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:01.041103 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 358/697] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:11:01.246536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee6bd-dec7-47aa-815c-97e8bdd44bc6 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:01.246714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee6bd-dec7-47aa-815c-97e8bdd44bc6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:01.246988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee6bd-dec7-47aa-815c-97e8bdd44bc6 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:01.248421 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 340/698] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:01.257956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7adbe3-5495-4ec6-911e-e5787dfa4df9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:01.258546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7adbe3-5495-4ec6-911e-e5787dfa4df9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:01.259038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7adbe3-5495-4ec6-911e-e5787dfa4df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:01.287588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ab7adbe3-5495-4ec6-911e-e5787dfa4df9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:01.289350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ab7adbe3-5495-4ec6-911e-e5787dfa4df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:01.349263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:01.376669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ee6bd-dec7-47aa-815c-97e8bdd44bc6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:01.379702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:01.394585 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 359/699] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:11:01.505427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ee6bd-dec7-47aa-815c-97e8bdd44bc6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:01.550091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6f170-1a7a-4b38-9d76-7053550002a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:01.551107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6f170-1a7a-4b38-9d76-7053550002a3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:01.551641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6f170-1a7a-4b38-9d76-7053550002a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:01.552118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6f170-1a7a-4b38-9d76-7053550002a3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:01.552901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6f170-1a7a-4b38-9d76-7053550002a3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:01.554514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6f170-1a7a-4b38-9d76-7053550002a3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-b9b6f170-1a7a-4b38-9d76-7053550002a3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:01.566478 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:01.567528 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:11:01.568382 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:01.571138 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 341/700] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Aug 29 15:11:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:01.577793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7adbe3-5495-4ec6-911e-e5787dfa4df9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:01.695994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7adbe3-5495-4ec6-911e-e5787dfa4df9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:01.714601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f9b5-c509-4be8-abc0-7f1ab1e1de06 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:01.715116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f9b5-c509-4be8-abc0-7f1ab1e1de06 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:01.715116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f9b5-c509-4be8-abc0-7f1ab1e1de06 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:01.717490 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 342/701] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:01.722530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec93dbc-0468-42cd-b46e-646250a86fd9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:01.722804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec93dbc-0468-42cd-b46e-646250a86fd9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:01.723107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec93dbc-0468-42cd-b46e-646250a86fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:01.743770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd9fa-f417-45e5-a7bd-3ca0bc181841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:01.744742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd9fa-f417-45e5-a7bd-3ca0bc181841 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:01.744923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fec93dbc-0468-42cd-b46e-646250a86fd9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:01.745201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd9fa-f417-45e5-a7bd-3ca0bc181841 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:01.745758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd9fa-f417-45e5-a7bd-3ca0bc181841 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:01.746818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fd9fa-f417-45e5-a7bd-3ca0bc181841 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:01.746944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fec93dbc-0468-42cd-b46e-646250a86fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:01.747320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fd9fa-f417-45e5-a7bd-3ca0bc181841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:01.750314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fd9fa-f417-45e5-a7bd-3ca0bc181841 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:01.756570 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 360/702] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Aug 29 15:11:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:01.757410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd9fa-f417-45e5-a7bd-3ca0bc181841 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:01.795435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:01.866445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:01.881523 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 343/703] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:11:01.882640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec93dbc-0468-42cd-b46e-646250a86fd9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:01.921956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd9fa-f417-45e5-a7bd-3ca0bc181841 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:01.990836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5ce05-f021-40b5-ac97-bf88942510b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:01.991911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ce05-f021-40b5-ac97-bf88942510b1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:01.992422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ce05-f021-40b5-ac97-bf88942510b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:01.993054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ce05-f021-40b5-ac97-bf88942510b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:02.015627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5ce05-f021-40b5-ac97-bf88942510b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-2cc5ce05-f021-40b5-ac97-bf88942510b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:02.025915 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:02.026940 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:02.027804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:02.029305 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 361/704] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:02.041507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5ce05-f021-40b5-ac97-bf88942510b1 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:02.112457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec93dbc-0468-42cd-b46e-646250a86fd9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:02.178681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e38433-c613-424c-b63d-0fde44a75d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:02.179608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e38433-c613-424c-b63d-0fde44a75d92 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:02.180036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e38433-c613-424c-b63d-0fde44a75d92 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:02.180528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e38433-c613-424c-b63d-0fde44a75d92 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:02.181324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e38433-c613-424c-b63d-0fde44a75d92 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:02.181802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e38433-c613-424c-b63d-0fde44a75d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:02.183531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e38433-c613-424c-b63d-0fde44a75d92 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:02.193820 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 344/705] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Aug 29 15:11:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:02.269209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:02.282431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5ce05-f021-40b5-ac97-bf88942510b1 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:02.338954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f9b4d-23d1-4b38-aada-76376368e8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:02.339590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9b4d-23d1-4b38-aada-76376368e8b4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:02.339873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9b4d-23d1-4b38-aada-76376368e8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:02.340150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9b4d-23d1-4b38-aada-76376368e8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:02.340844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f9b4d-23d1-4b38-aada-76376368e8b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:02.341148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f9b4d-23d1-4b38-aada-76376368e8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:02.343205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f9b4d-23d1-4b38-aada-76376368e8b4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:02.358215 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 362/706] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:11:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:02.359850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e38433-c613-424c-b63d-0fde44a75d92 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:02.364141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f9b4d-23d1-4b38-aada-76376368e8b4 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:02.454852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:02.503725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e38433-c613-424c-b63d-0fde44a75d92 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:02.542342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f9b4d-23d1-4b38-aada-76376368e8b4 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:02.549424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48df6d6-50f9-4360-9413-5d5c5d80de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:02.549424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48df6d6-50f9-4360-9413-5d5c5d80de83 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:02.549424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48df6d6-50f9-4360-9413-5d5c5d80de83 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:02.549424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48df6d6-50f9-4360-9413-5d5c5d80de83 None admin] PATH_INFO: `/v3/services/network` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:02.550061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48df6d6-50f9-4360-9413-5d5c5d80de83 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:02.550061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48df6d6-50f9-4360-9413-5d5c5d80de83 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-f48df6d6-50f9-4360-9413-5d5c5d80de83 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:02.558909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:02.561121 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:02.562805 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 345/707] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:02 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:02.564355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c0313-ab1a-49c2-9359-f7f7593d5c6c None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:02.564355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c0313-ab1a-49c2-9359-f7f7593d5c6c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:02.564355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c0313-ab1a-49c2-9359-f7f7593d5c6c None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:02.564355 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 346/708] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:02.569647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c371dd-8f6f-4860-8d45-aa30078c9ca4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:02.569895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c371dd-8f6f-4860-8d45-aa30078c9ca4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:02.570142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c371dd-8f6f-4860-8d45-aa30078c9ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:02.589791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-97c371dd-8f6f-4860-8d45-aa30078c9ca4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:02.590990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-97c371dd-8f6f-4860-8d45-aa30078c9ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:02.593030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b9b31-8bc8-4ecf-8b7a-a74716134227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:02.593850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9b31-8bc8-4ecf-8b7a-a74716134227 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:02.594230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9b31-8bc8-4ecf-8b7a-a74716134227 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:02.594601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9b31-8bc8-4ecf-8b7a-a74716134227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:02.607188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b9b31-8bc8-4ecf-8b7a-a74716134227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:02.608797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b9b31-8bc8-4ecf-8b7a-a74716134227 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-168b9b31-8bc8-4ecf-8b7a-a74716134227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:02.625286 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:02.628776 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:02.632272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:02.632272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:02.632272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:02.632272 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 363/709] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:02.632272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b9b31-8bc8-4ecf-8b7a-a74716134227 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:02.643270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:02.677505 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 347/710] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:11:02.678855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c371dd-8f6f-4860-8d45-aa30078c9ca4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:02.745064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b9b31-8bc8-4ecf-8b7a-a74716134227 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:02.785554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d482-87d8-4d77-8067-8780baae946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:02.785554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d482-87d8-4d77-8067-8780baae946f None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:02.785554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d482-87d8-4d77-8067-8780baae946f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:02.785554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d482-87d8-4d77-8067-8780baae946f None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:02.786030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66d482-87d8-4d77-8067-8780baae946f None admin] RBAC: Adding query filter params (name=network) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:02.786030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66d482-87d8-4d77-8067-8780baae946f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:02.786030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66d482-87d8-4d77-8067-8780baae946f None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:02.791131 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 364/711] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:02.797446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d482-87d8-4d77-8067-8780baae946f None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:02.813964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:02.878277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:02.895438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c371dd-8f6f-4860-8d45-aa30078c9ca4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:02.905830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d482-87d8-4d77-8067-8780baae946f None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:02.942177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e50b5f-98ff-4d50-b6c2-f38bc5d2b1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:02.942848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e50b5f-98ff-4d50-b6c2-f38bc5d2b1ff None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:02.943125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e50b5f-98ff-4d50-b6c2-f38bc5d2b1ff None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:02.943395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e50b5f-98ff-4d50-b6c2-f38bc5d2b1ff None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:02.944061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e50b5f-98ff-4d50-b6c2-f38bc5d2b1ff None admin] RBAC: Adding query filter params (type=network) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:02.944364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e50b5f-98ff-4d50-b6c2-f38bc5d2b1ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:02.945774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e50b5f-98ff-4d50-b6c2-f38bc5d2b1ff None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:02.952580 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 365/712] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:02.992300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb2c88-006d-482a-8cd2-b6e812d74d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:02.992921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb2c88-006d-482a-8cd2-b6e812d74d43 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:02.993191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb2c88-006d-482a-8cd2-b6e812d74d43 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:02.993504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb2c88-006d-482a-8cd2-b6e812d74d43 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:02.994150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb2c88-006d-482a-8cd2-b6e812d74d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:02.994449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb2c88-006d-482a-8cd2-b6e812d74d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:02.995841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb2c88-006d-482a-8cd2-b6e812d74d43 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:03.016243 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 348/713] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:03.023377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e50b5f-98ff-4d50-b6c2-f38bc5d2b1ff None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:03.135970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb2c88-006d-482a-8cd2-b6e812d74d43 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:03.251053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb2c88-006d-482a-8cd2-b6e812d74d43 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:03.261900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e50b5f-98ff-4d50-b6c2-f38bc5d2b1ff None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:03.273823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:03.300495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f7c84-a320-466a-a22b-c0131872f270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:03.301606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f7c84-a320-466a-a22b-c0131872f270 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:03.302084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f7c84-a320-466a-a22b-c0131872f270 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:03.302545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f7c84-a320-466a-a22b-c0131872f270 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:03.335324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f7c84-a320-466a-a22b-c0131872f270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-ca4f7c84-a320-466a-a22b-c0131872f270 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:03.352289 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:03.354128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:03.356636 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 349/714] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:11:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:03.366927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f7c84-a320-466a-a22b-c0131872f270 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:03.384626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487ccf7-21ae-4b3a-99ce-5b8348b816dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:03.386109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487ccf7-21ae-4b3a-99ce-5b8348b816dd None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:03.386808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487ccf7-21ae-4b3a-99ce-5b8348b816dd None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:03.387474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487ccf7-21ae-4b3a-99ce-5b8348b816dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:03.403850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487ccf7-21ae-4b3a-99ce-5b8348b816dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:03.407271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487ccf7-21ae-4b3a-99ce-5b8348b816dd None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:03.411125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-8487ccf7-21ae-4b3a-99ce-5b8348b816dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:03.432278 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:03.434368 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:03.436277 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:03.436277 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:03.436277 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:03.436277 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:03.436277 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:03.436277 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:03.436277 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:03.436277 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:03.436277 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:03.436277 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:03.439908 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 366/715] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Aug 29 15:11:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:03.445116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487ccf7-21ae-4b3a-99ce-5b8348b816dd None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:03.580662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487ccf7-21ae-4b3a-99ce-5b8348b816dd None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:03.687623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08aac2-2baa-4bd8-9229-a9b3a75fe1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:03.691779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f7c84-a320-466a-a22b-c0131872f270 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:03.693305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08aac2-2baa-4bd8-9229-a9b3a75fe1f2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:03.694020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08aac2-2baa-4bd8-9229-a9b3a75fe1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:03.694812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08aac2-2baa-4bd8-9229-a9b3a75fe1f2 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:03.696326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08aac2-2baa-4bd8-9229-a9b3a75fe1f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:03.702700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08aac2-2baa-4bd8-9229-a9b3a75fe1f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:03.703557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08aac2-2baa-4bd8-9229-a9b3a75fe1f2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:03.759981 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 367/716] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Aug 29 15:11:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:03.769449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08aac2-2baa-4bd8-9229-a9b3a75fe1f2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:03.773301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb5b3-6f70-4eb6-82e5-90eb554a6f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:03.774978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb5b3-6f70-4eb6-82e5-90eb554a6f01 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:03.775742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb5b3-6f70-4eb6-82e5-90eb554a6f01 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:03.777785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb5b3-6f70-4eb6-82e5-90eb554a6f01 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:03.779666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eb5b3-6f70-4eb6-82e5-90eb554a6f01 None admin] RBAC: Adding query filter params (name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:03.780574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eb5b3-6f70-4eb6-82e5-90eb554a6f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:03.784111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eb5b3-6f70-4eb6-82e5-90eb554a6f01 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:03.803042 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 350/717] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:11:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:03.813943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb5b3-6f70-4eb6-82e5-90eb554a6f01 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:03.895765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:03.988914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:04.032417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb5b3-6f70-4eb6-82e5-90eb554a6f01 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:04.085759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08aac2-2baa-4bd8-9229-a9b3a75fe1f2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:04.114873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86bc63-c9a9-46b4-a39f-8c6232afedcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:04.115524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86bc63-c9a9-46b4-a39f-8c6232afedcc None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:04.115805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86bc63-c9a9-46b4-a39f-8c6232afedcc None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:04.116080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86bc63-c9a9-46b4-a39f-8c6232afedcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:04.134073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86bc63-c9a9-46b4-a39f-8c6232afedcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:04.138724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86bc63-c9a9-46b4-a39f-8c6232afedcc None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:04.146673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cf2c8-b3d0-47c2-a909-28ae77350aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:04.147369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cf2c8-b3d0-47c2-a909-28ae77350aa0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:04.147653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cf2c8-b3d0-47c2-a909-28ae77350aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:04.147928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cf2c8-b3d0-47c2-a909-28ae77350aa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-7c86bc63-c9a9-46b4-a39f-8c6232afedcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:04.175638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:04.176677 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:04.177631 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:04.177631 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:04.177631 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:04.186043 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 351/718] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:04.195211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86bc63-c9a9-46b4-a39f-8c6232afedcc None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:04.236815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cf2c8-b3d0-47c2-a909-28ae77350aa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:04.238333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cf2c8-b3d0-47c2-a909-28ae77350aa0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:04.300888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:04.353786 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 368/719] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:11:04.362205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cf2c8-b3d0-47c2-a909-28ae77350aa0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:04.428845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:04.454320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86bc63-c9a9-46b4-a39f-8c6232afedcc None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:04.485210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cf2c8-b3d0-47c2-a909-28ae77350aa0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:04.530538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb4e0-8bf6-40d4-afc7-affda9ede707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:04.531401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb4e0-8bf6-40d4-afc7-affda9ede707 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:04.531515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb4e0-8bf6-40d4-afc7-affda9ede707 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:04.531734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb4e0-8bf6-40d4-afc7-affda9ede707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:04.543742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fb4e0-8bf6-40d4-afc7-affda9ede707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:04.545309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fb4e0-8bf6-40d4-afc7-affda9ede707 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-4a0fb4e0-8bf6-40d4-afc7-affda9ede707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:04.562772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:04.563893 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:04.564811 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:04.564811 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:04.564811 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:04.564811 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 369/720] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:04.570509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863d14-4045-4721-a329-fbda7e522936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:04.572078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb4e0-8bf6-40d4-afc7-affda9ede707 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:04.577978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863d14-4045-4721-a329-fbda7e522936 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:04.578407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863d14-4045-4721-a329-fbda7e522936 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:04.578689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863d14-4045-4721-a329-fbda7e522936 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:04.579403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863d14-4045-4721-a329-fbda7e522936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:04.579708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863d14-4045-4721-a329-fbda7e522936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:04.581130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863d14-4045-4721-a329-fbda7e522936 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:04.594462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:04.605706 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 352/721] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:04.614282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863d14-4045-4721-a329-fbda7e522936 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:04.714003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb4e0-8bf6-40d4-afc7-affda9ede707 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:04.750291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863d14-4045-4721-a329-fbda7e522936 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:04.756281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c75635-1aed-4051-b9e6-948b9bd577f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:04.756933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c75635-1aed-4051-b9e6-948b9bd577f5 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:04.757216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c75635-1aed-4051-b9e6-948b9bd577f5 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:04.757524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c75635-1aed-4051-b9e6-948b9bd577f5 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:04.758187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c75635-1aed-4051-b9e6-948b9bd577f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:04.758491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c75635-1aed-4051-b9e6-948b9bd577f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:04.759878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c75635-1aed-4051-b9e6-948b9bd577f5 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:04.773819 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 370/722] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:04.775163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29de3d-9426-42b8-a788-bc357290bdb9 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:04.775455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29de3d-9426-42b8-a788-bc357290bdb9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:04.775734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29de3d-9426-42b8-a788-bc357290bdb9 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:04.777224 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 371/723] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:04.778844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048061d-d0de-461c-a9f6-62992a62b716 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:04.778844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048061d-d0de-461c-a9f6-62992a62b716 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:04.779166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048061d-d0de-461c-a9f6-62992a62b716 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:04.780553 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 372/724] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:04.781325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048061d-d0de-461c-a9f6-62992a62b716 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:04.794713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af788556-48f1-45c7-899d-5a758b06ead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:04.795397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788556-48f1-45c7-899d-5a758b06ead8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:04.795616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788556-48f1-45c7-899d-5a758b06ead8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:04.795886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788556-48f1-45c7-899d-5a758b06ead8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:04.803838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af788556-48f1-45c7-899d-5a758b06ead8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:04.805314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af788556-48f1-45c7-899d-5a758b06ead8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-af788556-48f1-45c7-899d-5a758b06ead8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:04.819398 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:04.820383 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:04.821897 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:04.821897 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:04.821897 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:04.821897 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:04.821897 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:04.821897 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:04.821897 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:04.821897 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:04.821897 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:04.821897 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:04.821897 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 353/725] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Aug 29 15:11:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:04.822524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868831d3-8f0c-4c18-96e2-a98a4e69d1a6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:04.822524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868831d3-8f0c-4c18-96e2-a98a4e69d1a6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:04.822660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868831d3-8f0c-4c18-96e2-a98a4e69d1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:04.842063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-868831d3-8f0c-4c18-96e2-a98a4e69d1a6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:04.843279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-868831d3-8f0c-4c18-96e2-a98a4e69d1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:04.845721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:04.864363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:04.907058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048061d-d0de-461c-a9f6-62992a62b716 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:04.921068 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 354/726] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:11:04.922206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049ea4-9dc7-4e3a-8169-e019cac674d6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:04.922517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049ea4-9dc7-4e3a-8169-e019cac674d6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:04.922765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049ea4-9dc7-4e3a-8169-e019cac674d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:04.947271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-88049ea4-9dc7-4e3a-8169-e019cac674d6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:04.948518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-88049ea4-9dc7-4e3a-8169-e019cac674d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:04.949811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fd3f8-0a53-4718-b923-d31682bf1511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:04.950587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd3f8-0a53-4718-b923-d31682bf1511 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:04.951002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd3f8-0a53-4718-b923-d31682bf1511 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:04.951383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fd3f8-0a53-4718-b923-d31682bf1511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:04.958916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fd3f8-0a53-4718-b923-d31682bf1511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:04.960582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fd3f8-0a53-4718-b923-d31682bf1511 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-a43fd3f8-0a53-4718-b923-d31682bf1511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:04.972975 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:04.975052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:04.977167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:04.977167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:04.977167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:04.977167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:04.977167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:04.977167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:04.977167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:04.977167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:04.977167 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 373/727] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:04.978298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fd3f8-0a53-4718-b923-d31682bf1511 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:05.037435 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 355/728] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:11:05.037435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88049ea4-9dc7-4e3a-8169-e019cac674d6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:05.149026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fd3f8-0a53-4718-b923-d31682bf1511 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:05.180381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:05.190505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837593b4-ebd8-437c-9713-ab7bc40a4183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:05.191125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837593b4-ebd8-437c-9713-ab7bc40a4183 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:05.191454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837593b4-ebd8-437c-9713-ab7bc40a4183 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:05.191736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837593b4-ebd8-437c-9713-ab7bc40a4183 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:05.192545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837593b4-ebd8-437c-9713-ab7bc40a4183 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:05.192856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837593b4-ebd8-437c-9713-ab7bc40a4183 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:05.194600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837593b4-ebd8-437c-9713-ab7bc40a4183 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:05.209935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:05.220057 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 374/729] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Aug 29 15:11:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:05.221112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837593b4-ebd8-437c-9713-ab7bc40a4183 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:05.333073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88049ea4-9dc7-4e3a-8169-e019cac674d6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:05.334125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837593b4-ebd8-437c-9713-ab7bc40a4183 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:05.374678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa2d5d-8a99-4056-99b7-2ad0316e56e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:05.375300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2d5d-8a99-4056-99b7-2ad0316e56e2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:05.375583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2d5d-8a99-4056-99b7-2ad0316e56e2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:05.375857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2d5d-8a99-4056-99b7-2ad0316e56e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:05.413306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c5a5-8657-486e-a3dd-b6aec44791f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:05.414312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c5a5-8657-486e-a3dd-b6aec44791f8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:05.414794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c5a5-8657-486e-a3dd-b6aec44791f8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:05.415266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c5a5-8657-486e-a3dd-b6aec44791f8 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:05.416170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c5a5-8657-486e-a3dd-b6aec44791f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:05.416764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c5a5-8657-486e-a3dd-b6aec44791f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:05.418556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c5a5-8657-486e-a3dd-b6aec44791f8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:05.434316 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 356/730] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:05.440626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c5a5-8657-486e-a3dd-b6aec44791f8 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:05.446026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:05.463114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa2d5d-8a99-4056-99b7-2ad0316e56e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:05.464755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa2d5d-8a99-4056-99b7-2ad0316e56e2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:05.575336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c5a5-8657-486e-a3dd-b6aec44791f8 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:05.593156 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 375/731] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:11:05.594064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa2d5d-8a99-4056-99b7-2ad0316e56e2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:05.603075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:05.612025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635a9bc-3efc-4d85-aa34-54f48a6f2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:05.612646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635a9bc-3efc-4d85-aa34-54f48a6f2421 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:05.612934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635a9bc-3efc-4d85-aa34-54f48a6f2421 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:05.613207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635a9bc-3efc-4d85-aa34-54f48a6f2421 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:05.613920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635a9bc-3efc-4d85-aa34-54f48a6f2421 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:05.615356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635a9bc-3efc-4d85-aa34-54f48a6f2421 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:05.634791 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 357/732] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:11:05 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:11:05.635684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635a9bc-3efc-4d85-aa34-54f48a6f2421 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:05.696188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:05.715958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa2d5d-8a99-4056-99b7-2ad0316e56e2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:05.771277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd16afa-8023-47be-9622-cfcc06307f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:05.771917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd16afa-8023-47be-9622-cfcc06307f0d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:05.772202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd16afa-8023-47be-9622-cfcc06307f0d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:05.772478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd16afa-8023-47be-9622-cfcc06307f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:05.773308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd16afa-8023-47be-9622-cfcc06307f0d None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=c235251bc54848279759ba3e71a38306) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:05.773674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd16afa-8023-47be-9622-cfcc06307f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:05.774587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635a9bc-3efc-4d85-aa34-54f48a6f2421 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:05.775130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd16afa-8023-47be-9622-cfcc06307f0d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:05.785954 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 376/733] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:05 2022] GET /identity/v3/role_assignments?user.id=c235251bc54848279759ba3e71a38306&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=be89abac608f45a6921181bcc574f721 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:05.785954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ee4a9-aea0-463c-96c4-03ef14bcaf68 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:05.785954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ee4a9-aea0-463c-96c4-03ef14bcaf68 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:05.785954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ee4a9-aea0-463c-96c4-03ef14bcaf68 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:05.789677 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 377/734] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:05.791038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ee4a9-aea0-463c-96c4-03ef14bcaf68 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:05.824616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bbac2-263a-43a7-92ef-ed8f5a7af0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:05.825266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bbac2-263a-43a7-92ef-ed8f5a7af0f2 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:05.825587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bbac2-263a-43a7-92ef-ed8f5a7af0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:05.825859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bbac2-263a-43a7-92ef-ed8f5a7af0f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:05.839684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bbac2-263a-43a7-92ef-ed8f5a7af0f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-0d9bbac2-263a-43a7-92ef-ed8f5a7af0f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:05.846716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:05.847759 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:05.849083 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 358/735] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:05.850115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae481162-f665-4fa5-a58b-82c5e33a48be None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:05.850115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae481162-f665-4fa5-a58b-82c5e33a48be None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:05.850115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae481162-f665-4fa5-a58b-82c5e33a48be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:05.873146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ae481162-f665-4fa5-a58b-82c5e33a48be None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:05.875098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ae481162-f665-4fa5-a58b-82c5e33a48be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:05.926077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:05.965295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ee4a9-aea0-463c-96c4-03ef14bcaf68 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:05.983388 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 359/736] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:11:05.985254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae481162-f665-4fa5-a58b-82c5e33a48be None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:06.094845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dcd6a-d8a2-427a-9cd5-422652992e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:06.095515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dcd6a-d8a2-427a-9cd5-422652992e45 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:06.095798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dcd6a-d8a2-427a-9cd5-422652992e45 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:06.096158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dcd6a-d8a2-427a-9cd5-422652992e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:06.138212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dcd6a-d8a2-427a-9cd5-422652992e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:06.141498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dcd6a-d8a2-427a-9cd5-422652992e45 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:06.186322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-209dcd6a-d8a2-427a-9cd5-422652992e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:06.202964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:06.205283 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:06.207443 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:06.207443 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:06.207443 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:06.207443 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 378/737] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:06.218177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dcd6a-d8a2-427a-9cd5-422652992e45 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:06.265875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae481162-f665-4fa5-a58b-82c5e33a48be None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:06.335240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfb0c4-1bca-4c66-b9ef-edd5d5029b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:06.336710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb0c4-1bca-4c66-b9ef-edd5d5029b6c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:06.336996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb0c4-1bca-4c66-b9ef-edd5d5029b6c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:06.337276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb0c4-1bca-4c66-b9ef-edd5d5029b6c None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:06.338008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfb0c4-1bca-4c66-b9ef-edd5d5029b6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:06.338318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfb0c4-1bca-4c66-b9ef-edd5d5029b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:06.339723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfb0c4-1bca-4c66-b9ef-edd5d5029b6c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:06.359120 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 360/738] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:06.367541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfb0c4-1bca-4c66-b9ef-edd5d5029b6c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:06.419536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dcd6a-d8a2-427a-9cd5-422652992e45 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:06.453225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:06.511783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1bcf-2ed2-4616-9bb7-fd9ec346050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:06.513106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1bcf-2ed2-4616-9bb7-fd9ec346050f None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:06.514231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1bcf-2ed2-4616-9bb7-fd9ec346050f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:06.514809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1bcf-2ed2-4616-9bb7-fd9ec346050f None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:06.516079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1bcf-2ed2-4616-9bb7-fd9ec346050f None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:06.516730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1bcf-2ed2-4616-9bb7-fd9ec346050f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:06.519490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1bcf-2ed2-4616-9bb7-fd9ec346050f None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:06.564809 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 379/739] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:06.571168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1bcf-2ed2-4616-9bb7-fd9ec346050f None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:06.605157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfb0c4-1bca-4c66-b9ef-edd5d5029b6c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:06.674677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87e01b-f864-41e8-9455-8202a94451e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:06.676352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87e01b-f864-41e8-9455-8202a94451e0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:06.677148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87e01b-f864-41e8-9455-8202a94451e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:06.677944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87e01b-f864-41e8-9455-8202a94451e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:06.693863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:06.698420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87e01b-f864-41e8-9455-8202a94451e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:06.700054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87e01b-f864-41e8-9455-8202a94451e0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-4a87e01b-f864-41e8-9455-8202a94451e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:06.718057 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:06.720007 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:06.722138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:06.722138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:06.722138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:06.722138 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 361/740] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:06.722138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87e01b-f864-41e8-9455-8202a94451e0 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:06.799299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1bcf-2ed2-4616-9bb7-fd9ec346050f None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:06.844280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b41b2-7a29-4923-8dac-27b89bdd0f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:06.844958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b41b2-7a29-4923-8dac-27b89bdd0f9c None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:06.845244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b41b2-7a29-4923-8dac-27b89bdd0f9c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:06.845567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b41b2-7a29-4923-8dac-27b89bdd0f9c None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:06.846379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b41b2-7a29-4923-8dac-27b89bdd0f9c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:06.847630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b41b2-7a29-4923-8dac-27b89bdd0f9c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:06.867919 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 380/741] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:11:06 2022] POST /identity/v3/services => generated 240 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:11:06.868925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b41b2-7a29-4923-8dac-27b89bdd0f9c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:06.886625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:06.931322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87e01b-f864-41e8-9455-8202a94451e0 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:07.063682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a4500-05d9-4349-a971-f95a7847364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:07.064683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a4500-05d9-4349-a971-f95a7847364e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:07.065168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a4500-05d9-4349-a971-f95a7847364e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:07.065569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b41b2-7a29-4923-8dac-27b89bdd0f9c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:07.065702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a4500-05d9-4349-a971-f95a7847364e None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:07.079241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a4500-05d9-4349-a971-f95a7847364e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:07.082400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a4500-05d9-4349-a971-f95a7847364e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:07.089660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-e84a4500-05d9-4349-a971-f95a7847364e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:07.110476 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:07.111538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:07.112501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:07.112501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:07.112501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:07.112501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:07.112501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:07.112501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:07.112501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:07.112501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:07.112501 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 362/742] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:07.122553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a4500-05d9-4349-a971-f95a7847364e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:07.136653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaafd3d-7284-4072-a3f6-3842df12f35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:07.137561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafd3d-7284-4072-a3f6-3842df12f35b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:07.137981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafd3d-7284-4072-a3f6-3842df12f35b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:07.138422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafd3d-7284-4072-a3f6-3842df12f35b None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:07.139239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaafd3d-7284-4072-a3f6-3842df12f35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:07.139684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaafd3d-7284-4072-a3f6-3842df12f35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:07.141210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaafd3d-7284-4072-a3f6-3842df12f35b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:07.157577 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 381/743] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:07.167122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaafd3d-7284-4072-a3f6-3842df12f35b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:07.285797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a4500-05d9-4349-a971-f95a7847364e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:07.375872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c0762-ca2d-4694-a47d-d97938b89f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:07.376836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0762-ca2d-4694-a47d-d97938b89f45 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:07.379583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0762-ca2d-4694-a47d-d97938b89f45 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:07.380105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0762-ca2d-4694-a47d-d97938b89f45 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:07.381440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c0762-ca2d-4694-a47d-d97938b89f45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:07.381984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c0762-ca2d-4694-a47d-d97938b89f45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:07.384605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c0762-ca2d-4694-a47d-d97938b89f45 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:07.390981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaafd3d-7284-4072-a3f6-3842df12f35b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:07.445874 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 363/744] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:07.457559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c0762-ca2d-4694-a47d-d97938b89f45 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:07.463871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:07.523643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d912ab3-ed4b-4de7-9926-8c595d0e3501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:07.524302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d912ab3-ed4b-4de7-9926-8c595d0e3501 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:07.524582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d912ab3-ed4b-4de7-9926-8c595d0e3501 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:07.524858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d912ab3-ed4b-4de7-9926-8c595d0e3501 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:07.546799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d912ab3-ed4b-4de7-9926-8c595d0e3501 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:07.548302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d912ab3-ed4b-4de7-9926-8c595d0e3501 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-0d912ab3-ed4b-4de7-9926-8c595d0e3501 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:07.578870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:07.579884 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:07.580845 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:07.580845 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:07.580845 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:07.580845 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:07.580845 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:07.580845 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:07.580845 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:07.580845 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:07.580845 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:11:07.580845 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:07.580845 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 382/745] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:07.602514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d912ab3-ed4b-4de7-9926-8c595d0e3501 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:07.680950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c0762-ca2d-4694-a47d-d97938b89f45 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:07.700124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:07.755510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f82742-5adf-40f0-ad38-22c268da8491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:07.756534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82742-5adf-40f0-ad38-22c268da8491 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:07.757709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82742-5adf-40f0-ad38-22c268da8491 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:07.758192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82742-5adf-40f0-ad38-22c268da8491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:07.759737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f82742-5adf-40f0-ad38-22c268da8491 None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=f70236f89ced4a209b0451062d3d39f5) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:07.760462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f82742-5adf-40f0-ad38-22c268da8491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:07.764159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f82742-5adf-40f0-ad38-22c268da8491 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:07.776626 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 364/746] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:07 2022] GET /identity/v3/role_assignments?user.id=f70236f89ced4a209b0451062d3d39f5&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:07.859551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d912ab3-ed4b-4de7-9926-8c595d0e3501 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:07.919178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2416e-a252-425c-be91-d105ae925262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:07.920777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2416e-a252-425c-be91-d105ae925262 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:07.921277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2416e-a252-425c-be91-d105ae925262 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:07.921766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2416e-a252-425c-be91-d105ae925262 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:07.922723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2416e-a252-425c-be91-d105ae925262 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:07.923221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2416e-a252-425c-be91-d105ae925262 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:07.924878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2416e-a252-425c-be91-d105ae925262 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:07.957578 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 383/747] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Aug 29 15:11:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:07.957910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2ea6e-7ff3-4dd6-9238-c96cc6540c79 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:07.958356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2ea6e-7ff3-4dd6-9238-c96cc6540c79 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:07.958516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2ea6e-7ff3-4dd6-9238-c96cc6540c79 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:07.961133 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 365/748] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:07.966257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2416e-a252-425c-be91-d105ae925262 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:07.971195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da91d2-13dc-4621-94b0-c61252e04757 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:07.971513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da91d2-13dc-4621-94b0-c61252e04757 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:07.971769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da91d2-13dc-4621-94b0-c61252e04757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:08.010015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e0da91d2-13dc-4621-94b0-c61252e04757 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:08.012487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e0da91d2-13dc-4621-94b0-c61252e04757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:08.134350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:08.155020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2416e-a252-425c-be91-d105ae925262 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:08.171341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:08.178567 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 366/749] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:08.179973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54b02d-85a6-49e6-b97d-015b386f49ae None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:08.180262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54b02d-85a6-49e6-b97d-015b386f49ae None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:08.180538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54b02d-85a6-49e6-b97d-015b386f49ae None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:08.186560 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 367/750] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:08.188491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c426ae-e452-4ecb-aea0-a3b24d6b59db None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:08.188768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c426ae-e452-4ecb-aea0-a3b24d6b59db None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:08.189038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c426ae-e452-4ecb-aea0-a3b24d6b59db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:08.210587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-88c426ae-e452-4ecb-aea0-a3b24d6b59db None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:08.211890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-88c426ae-e452-4ecb-aea0-a3b24d6b59db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:08.216765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce44b1d-b91f-47a1-8c01-c125bd0335b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:08.217833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44b1d-b91f-47a1-8c01-c125bd0335b5 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:08.218340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44b1d-b91f-47a1-8c01-c125bd0335b5 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:08.218814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44b1d-b91f-47a1-8c01-c125bd0335b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:08.293045 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 368/751] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:08.331652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce44b1d-b91f-47a1-8c01-c125bd0335b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:08.333115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce44b1d-b91f-47a1-8c01-c125bd0335b5 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:08.458981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:08.471904 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 384/752] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:11:08.491701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c426ae-e452-4ecb-aea0-a3b24d6b59db None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:08.641652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce44b1d-b91f-47a1-8c01-c125bd0335b5 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:08.688174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c426ae-e452-4ecb-aea0-a3b24d6b59db None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:08.726966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:08.740197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e3515-3d50-459f-a448-b85df89dfacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:08.741195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e3515-3d50-459f-a448-b85df89dfacc None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:08.742044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e3515-3d50-459f-a448-b85df89dfacc None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:08.742044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e3515-3d50-459f-a448-b85df89dfacc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:08.758417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e3515-3d50-459f-a448-b85df89dfacc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:08.761084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e3515-3d50-459f-a448-b85df89dfacc None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:08.766055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce44b1d-b91f-47a1-8c01-c125bd0335b5 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-9d9e3515-3d50-459f-a448-b85df89dfacc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:08.784531 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:08.787103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:08.788366 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:08.788366 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:08.788366 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:08.788366 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 369/753] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:08.788366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e3515-3d50-459f-a448-b85df89dfacc None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:08.810119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278da13-bbdd-4c01-9649-22361aa3aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:08.811795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278da13-bbdd-4c01-9649-22361aa3aead None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:08.812128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278da13-bbdd-4c01-9649-22361aa3aead None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:08.812402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278da13-bbdd-4c01-9649-22361aa3aead None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:08.828407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278da13-bbdd-4c01-9649-22361aa3aead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-8278da13-bbdd-4c01-9649-22361aa3aead None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:08.835662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:08.836668 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:08.838190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:08.841475 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 385/754] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:08.842854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278da13-bbdd-4c01-9649-22361aa3aead None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:08.908373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:08.922844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e3515-3d50-459f-a448-b85df89dfacc None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:08.964740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278da13-bbdd-4c01-9649-22361aa3aead None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:08.983860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d8b77-bc86-411f-9424-b4c180c66933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:08.989416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d8b77-bc86-411f-9424-b4c180c66933 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:08.989416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d8b77-bc86-411f-9424-b4c180c66933 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:08.989416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d8b77-bc86-411f-9424-b4c180c66933 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:08.989416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d8b77-bc86-411f-9424-b4c180c66933 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:08.991652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d8b77-bc86-411f-9424-b4c180c66933 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:09.006299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f0c8-5030-40fc-b9db-dbb6ec384de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:09.006897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f0c8-5030-40fc-b9db-dbb6ec384de5 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:09.007244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f0c8-5030-40fc-b9db-dbb6ec384de5 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:09.007603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f0c8-5030-40fc-b9db-dbb6ec384de5 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:09.008334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0f0c8-5030-40fc-b9db-dbb6ec384de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:09.009048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0f0c8-5030-40fc-b9db-dbb6ec384de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:09.010195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0f0c8-5030-40fc-b9db-dbb6ec384de5 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-139d8b77-bc86-411f-9424-b4c180c66933 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:09.021679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:09.022857 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:11:09.023726 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:09.024632 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 370/755] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Aug 29 15:11:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:09.025450 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 386/756] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:09.025870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d8b77-bc86-411f-9424-b4c180c66933 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:09.030701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f0c8-5030-40fc-b9db-dbb6ec384de5 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:09.138266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:09.156251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f0c8-5030-40fc-b9db-dbb6ec384de5 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:09.173684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:09.218922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb743f9-0421-4e73-a08f-5e2291744537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:09.219194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d8b77-bc86-411f-9424-b4c180c66933 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:09.220840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb743f9-0421-4e73-a08f-5e2291744537 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:09.221838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb743f9-0421-4e73-a08f-5e2291744537 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:09.222615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb743f9-0421-4e73-a08f-5e2291744537 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:09.237166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb743f9-0421-4e73-a08f-5e2291744537 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:09.240347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb743f9-0421-4e73-a08f-5e2291744537 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:09.256063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7352f-fcad-442c-b4d9-21e60b27e945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:09.256826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7352f-fcad-442c-b4d9-21e60b27e945 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:09.257203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7352f-fcad-442c-b4d9-21e60b27e945 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:09.257613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7352f-fcad-442c-b4d9-21e60b27e945 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:09.258521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7352f-fcad-442c-b4d9-21e60b27e945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:09.258917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7352f-fcad-442c-b4d9-21e60b27e945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:09.260406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7352f-fcad-442c-b4d9-21e60b27e945 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-4fb743f9-0421-4e73-a08f-5e2291744537 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:09.266719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:09.268722 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:09.270750 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:09.270750 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:09.270750 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:09.270750 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:09.270750 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:09.270750 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:09.270750 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:09.270750 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:09.272805 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 371/757] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:09.273901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7352f-fcad-442c-b4d9-21e60b27e945 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:09.274916 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 387/758] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:09.281429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb743f9-0421-4e73-a08f-5e2291744537 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:09.400145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb743f9-0421-4e73-a08f-5e2291744537 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:09.418161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7352f-fcad-442c-b4d9-21e60b27e945 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:09.428448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:09.444316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125b310-c565-4ad8-9689-fb555f1877e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:09.445206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125b310-c565-4ad8-9689-fb555f1877e5 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:09.445611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125b310-c565-4ad8-9689-fb555f1877e5 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:09.445979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125b310-c565-4ad8-9689-fb555f1877e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:09.459144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125b310-c565-4ad8-9689-fb555f1877e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:09.460917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125b310-c565-4ad8-9689-fb555f1877e5 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:09.467451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057c75-f8b8-4002-835c-4f91109aff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:09.468317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057c75-f8b8-4002-835c-4f91109aff3f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:09.468750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057c75-f8b8-4002-835c-4f91109aff3f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:09.469858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057c75-f8b8-4002-835c-4f91109aff3f None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:09.470666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d057c75-f8b8-4002-835c-4f91109aff3f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:09.471157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d057c75-f8b8-4002-835c-4f91109aff3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:09.473559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d057c75-f8b8-4002-835c-4f91109aff3f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-2125b310-c565-4ad8-9689-fb555f1877e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:09.478872 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:09.480136 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:09.481275 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:09.481275 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:09.481275 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:09.481869 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 372/759] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Aug 29 15:11:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:09.483449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057c75-f8b8-4002-835c-4f91109aff3f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:09.487635 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 388/760] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:09.488927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125b310-c565-4ad8-9689-fb555f1877e5 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:09.523826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:09.617335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057c75-f8b8-4002-835c-4f91109aff3f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:09.636398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125b310-c565-4ad8-9689-fb555f1877e5 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:09.660398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fd50f-763c-4733-9729-47708c70dc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:09.661184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fd50f-763c-4733-9729-47708c70dc45 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:09.661621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fd50f-763c-4733-9729-47708c70dc45 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:09.661997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fd50f-763c-4733-9729-47708c70dc45 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:09.662830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fd50f-763c-4733-9729-47708c70dc45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:09.663263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fd50f-763c-4733-9729-47708c70dc45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:09.664833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fd50f-763c-4733-9729-47708c70dc45 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:09.680540 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 373/761] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:09.682111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fd50f-763c-4733-9729-47708c70dc45 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:09.697754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1108e3b-4175-4e6b-a8ae-e5ac2e9cabee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:09.699016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1108e3b-4175-4e6b-a8ae-e5ac2e9cabee None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:09.699649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1108e3b-4175-4e6b-a8ae-e5ac2e9cabee None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:09.700260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1108e3b-4175-4e6b-a8ae-e5ac2e9cabee None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:09.702059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1108e3b-4175-4e6b-a8ae-e5ac2e9cabee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:09.702727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1108e3b-4175-4e6b-a8ae-e5ac2e9cabee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:09.705230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1108e3b-4175-4e6b-a8ae-e5ac2e9cabee None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:09.711953 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 389/762] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Aug 29 15:11:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:09.713776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1108e3b-4175-4e6b-a8ae-e5ac2e9cabee None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:09.723367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:09.806406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fd50f-763c-4733-9729-47708c70dc45 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:09.828591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:09.848704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1108e3b-4175-4e6b-a8ae-e5ac2e9cabee None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:09.849268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb42115-d23b-4009-bcb1-23814d09181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:09.850943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb42115-d23b-4009-bcb1-23814d09181f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:09.851297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb42115-d23b-4009-bcb1-23814d09181f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:09.852004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb42115-d23b-4009-bcb1-23814d09181f None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:09.854630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb42115-d23b-4009-bcb1-23814d09181f None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:09.854761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb42115-d23b-4009-bcb1-23814d09181f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:09.858151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb42115-d23b-4009-bcb1-23814d09181f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:09.885585 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 374/763] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:09.886569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb42115-d23b-4009-bcb1-23814d09181f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:09.895472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da89c49-533b-4266-a720-99bb04308751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:09.896093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89c49-533b-4266-a720-99bb04308751 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:09.896375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89c49-533b-4266-a720-99bb04308751 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:09.897307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89c49-533b-4266-a720-99bb04308751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:09.897495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da89c49-533b-4266-a720-99bb04308751 None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=8fad5b29e028436ca5596434a0cce086) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:09.897768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da89c49-533b-4266-a720-99bb04308751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:09.899163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da89c49-533b-4266-a720-99bb04308751 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:09.906288 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 390/764] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:09 2022] GET /identity/v3/role_assignments?user.id=8fad5b29e028436ca5596434a0cce086&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=be89abac608f45a6921181bcc574f721 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:09.914985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d5c6e-6744-4f52-bf72-aa6d4ab4befe None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:09.915947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d5c6e-6744-4f52-bf72-aa6d4ab4befe None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:09.915947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d5c6e-6744-4f52-bf72-aa6d4ab4befe None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:09.916872 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 391/765] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:09.917620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d5c6e-6744-4f52-bf72-aa6d4ab4befe None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:10.067331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:10.085173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb42115-d23b-4009-bcb1-23814d09181f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:10.105004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d5c6e-6744-4f52-bf72-aa6d4ab4befe None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:10.128571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18daf52-eace-4cf9-aa65-8976e7447c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:10.129595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18daf52-eace-4cf9-aa65-8976e7447c9e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:10.129971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18daf52-eace-4cf9-aa65-8976e7447c9e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:10.130518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18daf52-eace-4cf9-aa65-8976e7447c9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:10.131344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18daf52-eace-4cf9-aa65-8976e7447c9e None admin] RBAC: Adding query filter params (interface=public, service_id=ea82ffbbd29948259aa206a799611c32, region_id=RegionOne) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:10.131750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18daf52-eace-4cf9-aa65-8976e7447c9e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:10.133241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18daf52-eace-4cf9-aa65-8976e7447c9e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:10.146394 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 375/766] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Aug 29 15:11:09 2022] GET /identity/v3/endpoints?service_id=ea82ffbbd29948259aa206a799611c32&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:10.146394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e65c-a328-464b-9f1b-8d51a6c9e386 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:10.146394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e65c-a328-464b-9f1b-8d51a6c9e386 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:10.146394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e65c-a328-464b-9f1b-8d51a6c9e386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:10.165967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bc81e65c-a328-464b-9f1b-8d51a6c9e386 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:10.167361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bc81e65c-a328-464b-9f1b-8d51a6c9e386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:10.184637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9b81b-61e7-45b2-a0b2-91ab713abe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:10.186368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9b81b-61e7-45b2-a0b2-91ab713abe63 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:10.187128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9b81b-61e7-45b2-a0b2-91ab713abe63 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:10.187939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9b81b-61e7-45b2-a0b2-91ab713abe63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:10.207642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9b81b-61e7-45b2-a0b2-91ab713abe63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:10.211152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9b81b-61e7-45b2-a0b2-91ab713abe63 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-5af9b81b-61e7-45b2-a0b2-91ab713abe63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:10.248412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:10.250572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:10.252723 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:10.252723 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:10.252723 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:10.252723 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:10.252723 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:10.252723 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:10.252723 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:10.252723 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:10.252723 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:10.252723 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:10.257266 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 392/767] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Aug 29 15:11:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:10.259132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9b81b-61e7-45b2-a0b2-91ab713abe63 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:10.269088 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 376/768] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:10.269088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81e65c-a328-464b-9f1b-8d51a6c9e386 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:10.285964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:10.365758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:10.385842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81e65c-a328-464b-9f1b-8d51a6c9e386 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:10.402390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9b81b-61e7-45b2-a0b2-91ab713abe63 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:10.426663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a7bf0-d265-4448-95e4-f78c69508751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:10.427284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7bf0-d265-4448-95e4-f78c69508751 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:10.427564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7bf0-d265-4448-95e4-f78c69508751 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:10.427836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7bf0-d265-4448-95e4-f78c69508751 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:10.428726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a7bf0-d265-4448-95e4-f78c69508751 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:10.429024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a7bf0-d265-4448-95e4-f78c69508751 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:10.430753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a7bf0-d265-4448-95e4-f78c69508751 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:10.454191 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 377/769] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Aug 29 15:11:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:10.455489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63057e2-d160-4950-918a-80ffda2717ca None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:10.455777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63057e2-d160-4950-918a-80ffda2717ca None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:10.456048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63057e2-d160-4950-918a-80ffda2717ca None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:10.457180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b3d4d-25bb-4c81-ad7e-ab38e38037b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:10.458316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b3d4d-25bb-4c81-ad7e-ab38e38037b4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:10.458803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b3d4d-25bb-4c81-ad7e-ab38e38037b4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:10.459295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b3d4d-25bb-4c81-ad7e-ab38e38037b4 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:10.460802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b3d4d-25bb-4c81-ad7e-ab38e38037b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:10.461555 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 378/770] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:10.462531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63057e2-d160-4950-918a-80ffda2717ca None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:10.463739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b3d4d-25bb-4c81-ad7e-ab38e38037b4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:10.481572 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 393/771] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Aug 29 15:11:10 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:10.484540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62bc5-e8c1-4232-bd6e-688e21b3ac46 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:10.485016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62bc5-e8c1-4232-bd6e-688e21b3ac46 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:10.485508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62bc5-e8c1-4232-bd6e-688e21b3ac46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:10.538334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-11f62bc5-e8c1-4232-bd6e-688e21b3ac46 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:10.539596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-11f62bc5-e8c1-4232-bd6e-688e21b3ac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:10.658258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63057e2-d160-4950-918a-80ffda2717ca None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:10.680712 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 394/772] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:10.686357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f62bc5-e8c1-4232-bd6e-688e21b3ac46 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:10.698695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:10.712611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440b349-d7f0-4de3-9aca-2eb26cc29cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:10.713252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440b349-d7f0-4de3-9aca-2eb26cc29cf4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:10.713577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440b349-d7f0-4de3-9aca-2eb26cc29cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:10.713849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440b349-d7f0-4de3-9aca-2eb26cc29cf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:10.726970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440b349-d7f0-4de3-9aca-2eb26cc29cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:10.726970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440b349-d7f0-4de3-9aca-2eb26cc29cf4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-c440b349-d7f0-4de3-9aca-2eb26cc29cf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:10.742761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:10.744514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:10.746310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:10.746310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:10.746310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:10.746310 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 379/773] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:10.746310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:10.752993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440b349-d7f0-4de3-9aca-2eb26cc29cf4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:10.896544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440b349-d7f0-4de3-9aca-2eb26cc29cf4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:10.914477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f62bc5-e8c1-4232-bd6e-688e21b3ac46 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:10.944354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5b844-04d5-4a43-8e27-aed2b7d27bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:10.945139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5b844-04d5-4a43-8e27-aed2b7d27bb4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:10.945573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5b844-04d5-4a43-8e27-aed2b7d27bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:10.945972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5b844-04d5-4a43-8e27-aed2b7d27bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:10.947345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5b844-04d5-4a43-8e27-aed2b7d27bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:10.947766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5b844-04d5-4a43-8e27-aed2b7d27bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:10.949588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5b844-04d5-4a43-8e27-aed2b7d27bb4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:10.965311 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 380/774] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:10.971197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5b844-04d5-4a43-8e27-aed2b7d27bb4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:10.987058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ef0a9-86bf-43c3-b877-39b0b01082b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:10.988941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ef0a9-86bf-43c3-b877-39b0b01082b7 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:10.989825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ef0a9-86bf-43c3-b877-39b0b01082b7 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:10.990543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ef0a9-86bf-43c3-b877-39b0b01082b7 None admin] PATH_INFO: `/v3/services/network` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:10.991895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ef0a9-86bf-43c3-b877-39b0b01082b7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:10.994757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ef0a9-86bf-43c3-b877-39b0b01082b7 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-605ef0a9-86bf-43c3-b877-39b0b01082b7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:11.030416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:11.032617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:11:11.034544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:11.037208 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 395/775] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:10 2022] GET /identity/v3/services/network => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:11.046479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ef0a9-86bf-43c3-b877-39b0b01082b7 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:11.080946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:11.142901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:11.177087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5b844-04d5-4a43-8e27-aed2b7d27bb4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:11.184461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ef0a9-86bf-43c3-b877-39b0b01082b7 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:11.227932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d01444-5b37-41a0-bada-9aa092084d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:11.229591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d01444-5b37-41a0-bada-9aa092084d6e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:11.230256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d01444-5b37-41a0-bada-9aa092084d6e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:11.230948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d01444-5b37-41a0-bada-9aa092084d6e None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:11.232465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d01444-5b37-41a0-bada-9aa092084d6e None admin] RBAC: Adding query filter params (name=network) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:11.233243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d01444-5b37-41a0-bada-9aa092084d6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:11.236402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d01444-5b37-41a0-bada-9aa092084d6e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:11.246232 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 396/776] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:11.248056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d01444-5b37-41a0-bada-9aa092084d6e None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:11.254613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb1343-75a0-4175-b943-4bc51cdab1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:11.256116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb1343-75a0-4175-b943-4bc51cdab1f1 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:11.256837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb1343-75a0-4175-b943-4bc51cdab1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:11.257521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb1343-75a0-4175-b943-4bc51cdab1f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:11.271708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb1343-75a0-4175-b943-4bc51cdab1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:11.275060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb1343-75a0-4175-b943-4bc51cdab1f1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-4ddb1343-75a0-4175-b943-4bc51cdab1f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:11.300305 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:11.302297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:11.304320 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:11.304320 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:11.304320 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:11.304320 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:11.304320 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:11.304320 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:11.304320 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:11.304320 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:11.313168 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 381/777] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:11.315141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb1343-75a0-4175-b943-4bc51cdab1f1 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:11.371065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d01444-5b37-41a0-bada-9aa092084d6e None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:11.414837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c904519-faac-4fc7-a7ab-55f6800701df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:11.415675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c904519-faac-4fc7-a7ab-55f6800701df None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:11.416152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c904519-faac-4fc7-a7ab-55f6800701df None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:11.416540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c904519-faac-4fc7-a7ab-55f6800701df None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:11.424193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:11.431695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c904519-faac-4fc7-a7ab-55f6800701df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-2c904519-faac-4fc7-a7ab-55f6800701df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:11.438329 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:11.440416 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:11.442488 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 397/778] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:11:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:11.449422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c904519-faac-4fc7-a7ab-55f6800701df None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:11.474634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb1343-75a0-4175-b943-4bc51cdab1f1 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:11.490704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:11.515889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff70c3-5321-4a0f-992b-b526c159f3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:11.516689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff70c3-5321-4a0f-992b-b526c159f3b4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:11.517477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff70c3-5321-4a0f-992b-b526c159f3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:11.517881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff70c3-5321-4a0f-992b-b526c159f3b4 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:11.518696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff70c3-5321-4a0f-992b-b526c159f3b4 None admin] RBAC: Adding query filter params (type=network) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:11.519157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff70c3-5321-4a0f-992b-b526c159f3b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:11.520593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff70c3-5321-4a0f-992b-b526c159f3b4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:11.532232 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 382/779] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:11.532232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff70c3-5321-4a0f-992b-b526c159f3b4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:11.592319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c904519-faac-4fc7-a7ab-55f6800701df None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:11.636197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718228a-e439-433b-ace0-053f97b15b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:11.637378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718228a-e439-433b-ace0-053f97b15b5b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:11.637898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718228a-e439-433b-ace0-053f97b15b5b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:11.638413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718228a-e439-433b-ace0-053f97b15b5b None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:11.639909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718228a-e439-433b-ace0-053f97b15b5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:11.640507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718228a-e439-433b-ace0-053f97b15b5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:11.642378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718228a-e439-433b-ace0-053f97b15b5b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:11.658586 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 398/780] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:11.658812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff70c3-5321-4a0f-992b-b526c159f3b4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:11.660005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718228a-e439-433b-ace0-053f97b15b5b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:11.701305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cf4de-792b-4c32-995b-27b6d445a187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:11.701948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cf4de-792b-4c32-995b-27b6d445a187 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:11.702239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cf4de-792b-4c32-995b-27b6d445a187 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:11.702500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cf4de-792b-4c32-995b-27b6d445a187 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:11.703294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cf4de-792b-4c32-995b-27b6d445a187 None admin] RBAC: Adding query filter params (name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:11.703519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cf4de-792b-4c32-995b-27b6d445a187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:11.705137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cf4de-792b-4c32-995b-27b6d445a187 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:11.715376 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 383/781] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:11:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:11.716259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cf4de-792b-4c32-995b-27b6d445a187 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:11.734793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:11.763277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:11.792201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718228a-e439-433b-ace0-053f97b15b5b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:11.829890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cf4de-792b-4c32-995b-27b6d445a187 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:11.837917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dbe23-413d-4952-b7b8-49ed29747af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:11.838933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dbe23-413d-4952-b7b8-49ed29747af7 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:11.839454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dbe23-413d-4952-b7b8-49ed29747af7 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:11.840068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dbe23-413d-4952-b7b8-49ed29747af7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:11.841036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dbe23-413d-4952-b7b8-49ed29747af7 None admin] RBAC: Adding query filter params (interface=public, service_id=422124f49e314d0ba5b97f5136665990, region_id=RegionOne) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:11.841643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dbe23-413d-4952-b7b8-49ed29747af7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:11.843277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dbe23-413d-4952-b7b8-49ed29747af7 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:11.859014 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 399/782] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Aug 29 15:11:11 2022] GET /identity/v3/endpoints?service_id=422124f49e314d0ba5b97f5136665990&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:11.861163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dbe23-413d-4952-b7b8-49ed29747af7 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:11.872613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dcec4-34d7-4b75-a2c3-ce4ba76f392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:11.873919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dcec4-34d7-4b75-a2c3-ce4ba76f392c None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:11.874250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dcec4-34d7-4b75-a2c3-ce4ba76f392c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:11.874532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dcec4-34d7-4b75-a2c3-ce4ba76f392c None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/c235251bc54848279759ba3e71a38306/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:11.877104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dcec4-34d7-4b75-a2c3-ce4ba76f392c None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=c235251bc54848279759ba3e71a38306, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:11.878722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dcec4-34d7-4b75-a2c3-ce4ba76f392c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:11.898434 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 384/783] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:11:11 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/c235251bc54848279759ba3e71a38306/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:11:11.899557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dcec4-34d7-4b75-a2c3-ce4ba76f392c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:11.998119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dbe23-413d-4952-b7b8-49ed29747af7 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:12.020666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:12.044592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33324d31-38f9-4a76-8efa-d608048b405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:12.045814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33324d31-38f9-4a76-8efa-d608048b405c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:12.046335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33324d31-38f9-4a76-8efa-d608048b405c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:12.046822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33324d31-38f9-4a76-8efa-d608048b405c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:12.054675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:12.060111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dcec4-34d7-4b75-a2c3-ce4ba76f392c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:12.062299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33324d31-38f9-4a76-8efa-d608048b405c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:12.066072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33324d31-38f9-4a76-8efa-d608048b405c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-33324d31-38f9-4a76-8efa-d608048b405c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:12.086964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:12.088001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:12.088921 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:12.088921 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:12.088921 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:12.093106 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 400/784] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:12.094944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26390283-78ed-47b0-963c-4c7f580e9809 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:12.095579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26390283-78ed-47b0-963c-4c7f580e9809 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:12.096174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26390283-78ed-47b0-963c-4c7f580e9809 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:12.098117 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 401/785] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:12.101314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26390283-78ed-47b0-963c-4c7f580e9809 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:12.104842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aa328-8115-46ae-96e3-0062080689c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:12.105667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aa328-8115-46ae-96e3-0062080689c0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:12.105765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aa328-8115-46ae-96e3-0062080689c0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:12.106005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aa328-8115-46ae-96e3-0062080689c0 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:12.106650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aa328-8115-46ae-96e3-0062080689c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:12.109145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aa328-8115-46ae-96e3-0062080689c0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:12.121456 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 385/786] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Aug 29 15:11:11 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:12.121456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b963-c828-476d-9483-c23a6ed77929 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:12.121456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b963-c828-476d-9483-c23a6ed77929 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:12.121456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b963-c828-476d-9483-c23a6ed77929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:12.162641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-42b9b963-c828-476d-9483-c23a6ed77929 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:12.164461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-42b9b963-c828-476d-9483-c23a6ed77929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:12.278400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26390283-78ed-47b0-963c-4c7f580e9809 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:12.318129 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 386/787] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:12.332963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aea76-c5db-4af2-8857-a3d8713b116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:12.334654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aea76-c5db-4af2-8857-a3d8713b116b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:12.334654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aea76-c5db-4af2-8857-a3d8713b116b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:12.334654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aea76-c5db-4af2-8857-a3d8713b116b None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:12.335077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aea76-c5db-4af2-8857-a3d8713b116b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:12.335206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aea76-c5db-4af2-8857-a3d8713b116b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:12.336605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aea76-c5db-4af2-8857-a3d8713b116b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:12.361090 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 402/788] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:12.370632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9b963-c828-476d-9483-c23a6ed77929 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:12.493186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9b963-c828-476d-9483-c23a6ed77929 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:12.502459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:12.542769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7c9eb-09cf-4a31-9d7a-f8146f5ae427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:12.543824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7c9eb-09cf-4a31-9d7a-f8146f5ae427 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:12.544314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7c9eb-09cf-4a31-9d7a-f8146f5ae427 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:12.544768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7c9eb-09cf-4a31-9d7a-f8146f5ae427 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:12.563320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7c9eb-09cf-4a31-9d7a-f8146f5ae427 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:12.566145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7c9eb-09cf-4a31-9d7a-f8146f5ae427 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-cda7c9eb-09cf-4a31-9d7a-f8146f5ae427 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:12.596087 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:12.597128 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:12.598154 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:12.598154 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:12.598154 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:12.598154 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:12.598154 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:12.598154 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:12.598154 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:12.598154 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:12.598154 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:12.598154 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:12.598700 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 387/789] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Aug 29 15:11:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:12.610563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aea76-c5db-4af2-8857-a3d8713b116b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:12.670423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:12.779998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aea76-c5db-4af2-8857-a3d8713b116b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:12.816920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7c9eb-09cf-4a31-9d7a-f8146f5ae427 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:12.832665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dff4d-547f-49f0-9584-7ba971759eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:12.833908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dff4d-547f-49f0-9584-7ba971759eba None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:12.834429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dff4d-547f-49f0-9584-7ba971759eba None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:12.834990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dff4d-547f-49f0-9584-7ba971759eba None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:12.836058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dff4d-547f-49f0-9584-7ba971759eba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:12.836581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dff4d-547f-49f0-9584-7ba971759eba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:12.838437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dff4d-547f-49f0-9584-7ba971759eba None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:12.859484 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 403/790] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Aug 29 15:11:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:12.867504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dff4d-547f-49f0-9584-7ba971759eba None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:12.977194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:12.993702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dff4d-547f-49f0-9584-7ba971759eba None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:13.038070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8cd5-befd-4899-b56b-5a1930af08c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:13.040005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8cd5-befd-4899-b56b-5a1930af08c8 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:13.040388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8cd5-befd-4899-b56b-5a1930af08c8 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:13.040764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8cd5-befd-4899-b56b-5a1930af08c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:13.056711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef8cd5-befd-4899-b56b-5a1930af08c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:13.056711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef8cd5-befd-4899-b56b-5a1930af08c8 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-91ef8cd5-befd-4899-b56b-5a1930af08c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:13.075942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:13.078014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:13.080044 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:13.080044 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:13.080044 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:13.080387 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 404/791] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:13.086218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8cd5-befd-4899-b56b-5a1930af08c8 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:13.145235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7c9eb-09cf-4a31-9d7a-f8146f5ae427 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:13.231180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed099e00-a256-4570-b2f4-1511a097acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:13.232240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed099e00-a256-4570-b2f4-1511a097acaf None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:13.233168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed099e00-a256-4570-b2f4-1511a097acaf None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:13.233586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed099e00-a256-4570-b2f4-1511a097acaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:13.247672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed099e00-a256-4570-b2f4-1511a097acaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-ed099e00-a256-4570-b2f4-1511a097acaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:13.254109 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:13.256293 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:13.258182 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 388/792] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:13.263658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed099e00-a256-4570-b2f4-1511a097acaf None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:13.267814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8cd5-befd-4899-b56b-5a1930af08c8 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:13.287352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:13.340388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b0526-15c7-47b0-8748-4ab8ca5d7a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:13.341980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b0526-15c7-47b0-8748-4ab8ca5d7a69 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:13.342782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b0526-15c7-47b0-8748-4ab8ca5d7a69 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:13.343557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b0526-15c7-47b0-8748-4ab8ca5d7a69 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:13.345029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b0526-15c7-47b0-8748-4ab8ca5d7a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:13.345902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b0526-15c7-47b0-8748-4ab8ca5d7a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:13.348728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b0526-15c7-47b0-8748-4ab8ca5d7a69 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:13.372280 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 405/793] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:13.375498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1e8cf-ab9b-4e59-9ea9-d73c751f7700 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:13.376312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1e8cf-ab9b-4e59-9ea9-d73c751f7700 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:13.377055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1e8cf-ab9b-4e59-9ea9-d73c751f7700 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:13.379841 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 406/794] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:13.381506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1e8cf-ab9b-4e59-9ea9-d73c751f7700 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:13.397765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed099e00-a256-4570-b2f4-1511a097acaf None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:13.405822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:13.439159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e1e1-2507-499c-91d3-6a6ac0e00bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:13.439803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e1e1-2507-499c-91d3-6a6ac0e00bd1 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:13.440133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e1e1-2507-499c-91d3-6a6ac0e00bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:13.440413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e1e1-2507-499c-91d3-6a6ac0e00bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:13.441093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e1e1-2507-499c-91d3-6a6ac0e00bd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:13.441417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e1e1-2507-499c-91d3-6a6ac0e00bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:13.442915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e1e1-2507-499c-91d3-6a6ac0e00bd1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:13.453531 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 389/795] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:11:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:13.454950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a46b8-af0a-44b5-bfe6-db520a23fef4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:13.455261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a46b8-af0a-44b5-bfe6-db520a23fef4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:13.455558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a46b8-af0a-44b5-bfe6-db520a23fef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:13.475416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-722a46b8-af0a-44b5-bfe6-db520a23fef4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:13.477009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-722a46b8-af0a-44b5-bfe6-db520a23fef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:13.570603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1e8cf-ab9b-4e59-9ea9-d73c751f7700 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:13.606010 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 390/796] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:13.610575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a46b8-af0a-44b5-bfe6-db520a23fef4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:13.622165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e462b6b-52bc-47e4-becb-612ec2e8a910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:13.622975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e462b6b-52bc-47e4-becb-612ec2e8a910 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:13.623396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e462b6b-52bc-47e4-becb-612ec2e8a910 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:13.623763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e462b6b-52bc-47e4-becb-612ec2e8a910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:13.633272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:13.634577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e462b6b-52bc-47e4-becb-612ec2e8a910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:13.637048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e462b6b-52bc-47e4-becb-612ec2e8a910 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-8e462b6b-52bc-47e4-becb-612ec2e8a910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:13.660052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:13.661236 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:13.662433 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:13.662433 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:13.662433 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:13.662433 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:13.662433 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:13.662433 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:13.662433 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:13.662433 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:13.664403 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 407/797] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:13.670504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e462b6b-52bc-47e4-becb-612ec2e8a910 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:13.742361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:13.773031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a46b8-af0a-44b5-bfe6-db520a23fef4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:13.822926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ead29-90fc-4b52-a06f-60cd6d9da029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:13.824217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ead29-90fc-4b52-a06f-60cd6d9da029 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:13.824873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ead29-90fc-4b52-a06f-60cd6d9da029 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:13.825360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ead29-90fc-4b52-a06f-60cd6d9da029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:13.840368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ead29-90fc-4b52-a06f-60cd6d9da029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:13.843211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ead29-90fc-4b52-a06f-60cd6d9da029 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:13.852704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e462b6b-52bc-47e4-becb-612ec2e8a910 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-588ead29-90fc-4b52-a06f-60cd6d9da029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:13.865212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:13.866253 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:13.867170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:13.867170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:13.867170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:13.871149 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 391/798] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:13.877158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ead29-90fc-4b52-a06f-60cd6d9da029 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:13.958415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e751d-1a8e-44c6-a6ee-878693fd1418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:13.959119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e751d-1a8e-44c6-a6ee-878693fd1418 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:13.959403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e751d-1a8e-44c6-a6ee-878693fd1418 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:13.959685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e751d-1a8e-44c6-a6ee-878693fd1418 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:13.960482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e751d-1a8e-44c6-a6ee-878693fd1418 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:13.960789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e751d-1a8e-44c6-a6ee-878693fd1418 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:13.962501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e751d-1a8e-44c6-a6ee-878693fd1418 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:13.993644 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 408/799] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:13.999816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e751d-1a8e-44c6-a6ee-878693fd1418 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:14.104123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:14.151692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ead29-90fc-4b52-a06f-60cd6d9da029 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:14.188992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaa3aa-46e7-4bad-8f14-a74bdac55af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:14.189673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaa3aa-46e7-4bad-8f14-a74bdac55af6 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:14.190107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaa3aa-46e7-4bad-8f14-a74bdac55af6 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:14.190387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaa3aa-46e7-4bad-8f14-a74bdac55af6 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:14.191043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aaa3aa-46e7-4bad-8f14-a74bdac55af6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:14.191348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aaa3aa-46e7-4bad-8f14-a74bdac55af6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:14.192732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aaa3aa-46e7-4bad-8f14-a74bdac55af6 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:14.200467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e751d-1a8e-44c6-a6ee-878693fd1418 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:14.205818 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 392/800] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:14.206701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaa3aa-46e7-4bad-8f14-a74bdac55af6 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:14.226979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:14.249347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5da71-16d4-4736-90ac-f84304faf647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:14.250141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5da71-16d4-4736-90ac-f84304faf647 None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:14.250423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5da71-16d4-4736-90ac-f84304faf647 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:14.250878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5da71-16d4-4736-90ac-f84304faf647 None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/f70236f89ced4a209b0451062d3d39f5/roles/1471575d20cd435ca6fb71c29c92fb64` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:14.270957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5da71-16d4-4736-90ac-f84304faf647 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=f70236f89ced4a209b0451062d3d39f5, role_id=1471575d20cd435ca6fb71c29c92fb64)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:14.273258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5da71-16d4-4736-90ac-f84304faf647 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:14.293480 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 409/801] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:11:13 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/f70236f89ced4a209b0451062d3d39f5/roles/1471575d20cd435ca6fb71c29c92fb64 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:11:14.294481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5da71-16d4-4736-90ac-f84304faf647 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:14.377600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaa3aa-46e7-4bad-8f14-a74bdac55af6 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:14.420705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:14.448787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcc896-b10e-4bb4-9765-c7ffd67a10cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:14.450661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc896-b10e-4bb4-9765-c7ffd67a10cf None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:14.452130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc896-b10e-4bb4-9765-c7ffd67a10cf None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:14.452634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc896-b10e-4bb4-9765-c7ffd67a10cf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:14.453866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcc896-b10e-4bb4-9765-c7ffd67a10cf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:14.455351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcc896-b10e-4bb4-9765-c7ffd67a10cf None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-45fcc896-b10e-4bb4-9765-c7ffd67a10cf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:14.480695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:14.483721 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:14.485212 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 393/802] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Aug 29 15:11:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:14.486778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666325b-d144-415b-9d07-bbd8b27b188f None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:14.486778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666325b-d144-415b-9d07-bbd8b27b188f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:14.487026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666325b-d144-415b-9d07-bbd8b27b188f None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:14.490730 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 394/803] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:14.490730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666325b-d144-415b-9d07-bbd8b27b188f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:14.514501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5da71-16d4-4736-90ac-f84304faf647 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:14.566618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd8fc9-ae12-43d3-9fcc-700870cb9de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:14.567276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd8fc9-ae12-43d3-9fcc-700870cb9de0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:14.567556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd8fc9-ae12-43d3-9fcc-700870cb9de0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:14.567831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd8fc9-ae12-43d3-9fcc-700870cb9de0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:14.577019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd8fc9-ae12-43d3-9fcc-700870cb9de0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:14.578584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd8fc9-ae12-43d3-9fcc-700870cb9de0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-adbd8fc9-ae12-43d3-9fcc-700870cb9de0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:14.592048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:14.593069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:14.594079 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:14.594079 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:14.594079 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:14.594079 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:14.594079 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:14.594079 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:14.594079 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:14.594079 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:14.594079 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:11:14.594079 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:14.594079 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 410/804] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:14.596335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37038ddb-30ad-477f-adb9-15c872ba69e7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:14.596335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37038ddb-30ad-477f-adb9-15c872ba69e7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:14.596335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37038ddb-30ad-477f-adb9-15c872ba69e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:14.619388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-37038ddb-30ad-477f-adb9-15c872ba69e7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:14.620701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-37038ddb-30ad-477f-adb9-15c872ba69e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:14.645106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666325b-d144-415b-9d07-bbd8b27b188f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:14.647588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:14.687629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4eeb8-726b-41cf-89db-2915ed0c86d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:14.688162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4eeb8-726b-41cf-89db-2915ed0c86d5 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:14.688488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4eeb8-726b-41cf-89db-2915ed0c86d5 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:14.688765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4eeb8-726b-41cf-89db-2915ed0c86d5 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:14.689434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4eeb8-726b-41cf-89db-2915ed0c86d5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:14.689755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4eeb8-726b-41cf-89db-2915ed0c86d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:14.691313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4eeb8-726b-41cf-89db-2915ed0c86d5 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:14.698111 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 395/805] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Aug 29 15:11:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:14.699175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4eeb8-726b-41cf-89db-2915ed0c86d5 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:14.707434 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 411/806] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:14.708612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37038ddb-30ad-477f-adb9-15c872ba69e7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:14.752696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:14.847775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37038ddb-30ad-477f-adb9-15c872ba69e7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:14.871138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4eeb8-726b-41cf-89db-2915ed0c86d5 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:14.897714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f49b3-e411-4faf-b88d-ac1d6dba3e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:14.898968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f49b3-e411-4faf-b88d-ac1d6dba3e04 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:14.899481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f49b3-e411-4faf-b88d-ac1d6dba3e04 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:14.900369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f49b3-e411-4faf-b88d-ac1d6dba3e04 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:14.901538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f49b3-e411-4faf-b88d-ac1d6dba3e04 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:14.902109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f49b3-e411-4faf-b88d-ac1d6dba3e04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:14.904915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f49b3-e411-4faf-b88d-ac1d6dba3e04 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:14.912285 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 412/807] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Aug 29 15:11:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:14.912606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd5de0-9fad-4dc6-b896-1f70d1f5d729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:14.913368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd5de0-9fad-4dc6-b896-1f70d1f5d729 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:14.913678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd5de0-9fad-4dc6-b896-1f70d1f5d729 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:14.913952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd5de0-9fad-4dc6-b896-1f70d1f5d729 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:14.914698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd5de0-9fad-4dc6-b896-1f70d1f5d729 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:14.915005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd5de0-9fad-4dc6-b896-1f70d1f5d729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:14.915310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b0f8-2b5c-4460-8bc5-4e5a53573999 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:14.915832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b0f8-2b5c-4460-8bc5-4e5a53573999 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:14.916298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b0f8-2b5c-4460-8bc5-4e5a53573999 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:14.916952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd5de0-9fad-4dc6-b896-1f70d1f5d729 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:14.918094 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 413/808] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:14.919067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710b0f8-2b5c-4460-8bc5-4e5a53573999 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:14.949945 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 396/809] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Aug 29 15:11:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:14.951750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:14.952265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17721-0e8f-49f9-8654-98f99e89325d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:14.956193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17721-0e8f-49f9-8654-98f99e89325d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:14.957069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17721-0e8f-49f9-8654-98f99e89325d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:14.980674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f7d17721-0e8f-49f9-8654-98f99e89325d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:14.982146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f7d17721-0e8f-49f9-8654-98f99e89325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:15.049034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710b0f8-2b5c-4460-8bc5-4e5a53573999 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:15.069583 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 397/810] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:15.069583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d17721-0e8f-49f9-8654-98f99e89325d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:15.096716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548ccfe-1e09-424a-bc81-7d1208f77b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:15.097627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548ccfe-1e09-424a-bc81-7d1208f77b24 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:15.097986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548ccfe-1e09-424a-bc81-7d1208f77b24 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:15.098263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548ccfe-1e09-424a-bc81-7d1208f77b24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:15.098985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548ccfe-1e09-424a-bc81-7d1208f77b24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:15.101121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548ccfe-1e09-424a-bc81-7d1208f77b24 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:15.111335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:15.136616 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 414/811] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:11:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:11:15.137619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548ccfe-1e09-424a-bc81-7d1208f77b24 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:15.198979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d17721-0e8f-49f9-8654-98f99e89325d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:15.250444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6424a8-44c4-4dad-a69a-b312327dabb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:15.251510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6424a8-44c4-4dad-a69a-b312327dabb7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:15.252041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6424a8-44c4-4dad-a69a-b312327dabb7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:15.252543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6424a8-44c4-4dad-a69a-b312327dabb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:15.258085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:15.274137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6424a8-44c4-4dad-a69a-b312327dabb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:15.277204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6424a8-44c4-4dad-a69a-b312327dabb7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-2a6424a8-44c4-4dad-a69a-b312327dabb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:15.309092 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:15.310338 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:15.311924 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:15.311924 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:15.311924 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:15.315209 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 398/812] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:15.318294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548ccfe-1e09-424a-bc81-7d1208f77b24 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:15.321335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6424a8-44c4-4dad-a69a-b312327dabb7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:15.379838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5fb6a-8ff6-4f1e-9ec4-878d3f04baf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:15.380909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5fb6a-8ff6-4f1e-9ec4-878d3f04baf9 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:15.381444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5fb6a-8ff6-4f1e-9ec4-878d3f04baf9 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:15.381963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5fb6a-8ff6-4f1e-9ec4-878d3f04baf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:15.394974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5fb6a-8ff6-4f1e-9ec4-878d3f04baf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-4af5fb6a-8ff6-4f1e-9ec4-878d3f04baf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:15.400948 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:15.402048 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:15.402918 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:15.407425 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 415/813] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:15.413175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5fb6a-8ff6-4f1e-9ec4-878d3f04baf9 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:15.445790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:15.484611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6424a8-44c4-4dad-a69a-b312327dabb7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:15.550107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1ad99-ce9a-4772-b6ab-ae99265a24fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:15.551824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ad99-ce9a-4772-b6ab-ae99265a24fd None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:15.552753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ad99-ce9a-4772-b6ab-ae99265a24fd None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:15.553304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ad99-ce9a-4772-b6ab-ae99265a24fd None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:15.554287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1ad99-ce9a-4772-b6ab-ae99265a24fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:15.555108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1ad99-ce9a-4772-b6ab-ae99265a24fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:15.557699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1ad99-ce9a-4772-b6ab-ae99265a24fd None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:15.577457 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 399/814] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:15.579319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1ad99-ce9a-4772-b6ab-ae99265a24fd None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:15.593717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5fb6a-8ff6-4f1e-9ec4-878d3f04baf9 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:15.648433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d4973-c41e-4a79-a67d-8aeb9e5ba553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:15.649525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d4973-c41e-4a79-a67d-8aeb9e5ba553 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:15.649989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d4973-c41e-4a79-a67d-8aeb9e5ba553 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:15.650491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d4973-c41e-4a79-a67d-8aeb9e5ba553 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:15.651596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d4973-c41e-4a79-a67d-8aeb9e5ba553 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:15.652091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d4973-c41e-4a79-a67d-8aeb9e5ba553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:15.653819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d4973-c41e-4a79-a67d-8aeb9e5ba553 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:15.669528 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 416/815] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:15.671366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d4973-c41e-4a79-a67d-8aeb9e5ba553 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:15.675710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:15.703251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1ad99-ce9a-4772-b6ab-ae99265a24fd None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:15.738581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524d51-f6b5-4625-b050-ee5f10b357f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:15.739337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524d51-f6b5-4625-b050-ee5f10b357f6 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:15.739679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524d51-f6b5-4625-b050-ee5f10b357f6 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:15.740020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524d51-f6b5-4625-b050-ee5f10b357f6 None admin] PATH_INFO: `/v3/services/network` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:15.740675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef524d51-f6b5-4625-b050-ee5f10b357f6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:15.742394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef524d51-f6b5-4625-b050-ee5f10b357f6 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-ef524d51-f6b5-4625-b050-ee5f10b357f6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:15.751772 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:15.752831 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:15.753734 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 400/816] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:15 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:15.754549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524d51-f6b5-4625-b050-ee5f10b357f6 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:15.763958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:15.802469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d4973-c41e-4a79-a67d-8aeb9e5ba553 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:15.848901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed7898-cdb1-46be-b790-5100f147d7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:15.849821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed7898-cdb1-46be-b790-5100f147d7c0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:15.850502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed7898-cdb1-46be-b790-5100f147d7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:15.850950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed7898-cdb1-46be-b790-5100f147d7c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:15.861229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed7898-cdb1-46be-b790-5100f147d7c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:15.863577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed7898-cdb1-46be-b790-5100f147d7c0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:15.867198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524d51-f6b5-4625-b050-ee5f10b357f6 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-38ed7898-cdb1-46be-b790-5100f147d7c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:15.880848 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:15.882040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:15.883182 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:15.883182 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:15.883182 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:15.883182 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:15.883182 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:15.883182 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:15.883182 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:15.883182 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:15.885759 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 417/817] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:15.887718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed7898-cdb1-46be-b790-5100f147d7c0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:15.910320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2713f7-8d6d-4ef4-97b3-dab8c3bc0157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:15.911106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2713f7-8d6d-4ef4-97b3-dab8c3bc0157 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:15.911517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2713f7-8d6d-4ef4-97b3-dab8c3bc0157 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:15.911967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2713f7-8d6d-4ef4-97b3-dab8c3bc0157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:15.923881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2713f7-8d6d-4ef4-97b3-dab8c3bc0157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:15.925743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2713f7-8d6d-4ef4-97b3-dab8c3bc0157 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-7f2713f7-8d6d-4ef4-97b3-dab8c3bc0157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:15.942177 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:15.943353 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:15.944496 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:15.944496 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:15.944496 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:15.950656 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 401/818] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:15.952333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2713f7-8d6d-4ef4-97b3-dab8c3bc0157 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:15.977637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:16.061802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:16.113944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2713f7-8d6d-4ef4-97b3-dab8c3bc0157 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:16.157780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729e9b3-670f-4a3f-b018-41fa1fae0233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:16.159445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729e9b3-670f-4a3f-b018-41fa1fae0233 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:16.159951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729e9b3-670f-4a3f-b018-41fa1fae0233 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:16.160678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729e9b3-670f-4a3f-b018-41fa1fae0233 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:16.161708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729e9b3-670f-4a3f-b018-41fa1fae0233 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:16.162473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729e9b3-670f-4a3f-b018-41fa1fae0233 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:16.164868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729e9b3-670f-4a3f-b018-41fa1fae0233 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:16.173647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed7898-cdb1-46be-b790-5100f147d7c0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:16.182582 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 402/819] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:16.183764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729e9b3-670f-4a3f-b018-41fa1fae0233 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:16.222051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07439398-7396-4e21-b4f2-a230a77b2092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:16.222922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07439398-7396-4e21-b4f2-a230a77b2092 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:16.223503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07439398-7396-4e21-b4f2-a230a77b2092 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:16.223855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07439398-7396-4e21-b4f2-a230a77b2092 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:16.225060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07439398-7396-4e21-b4f2-a230a77b2092 None admin] RBAC: Adding query filter params (name=network) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:16.225523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07439398-7396-4e21-b4f2-a230a77b2092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:16.227659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07439398-7396-4e21-b4f2-a230a77b2092 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:16.234868 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 418/820] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:16.235780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07439398-7396-4e21-b4f2-a230a77b2092 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:16.306648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729e9b3-670f-4a3f-b018-41fa1fae0233 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:16.325754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:16.347869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23314be-86cd-4e22-b81f-9b6b39b475c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:16.348727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23314be-86cd-4e22-b81f-9b6b39b475c9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:16.349333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23314be-86cd-4e22-b81f-9b6b39b475c9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:16.349769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23314be-86cd-4e22-b81f-9b6b39b475c9 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:16.350561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23314be-86cd-4e22-b81f-9b6b39b475c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:16.351021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23314be-86cd-4e22-b81f-9b6b39b475c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:16.352645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23314be-86cd-4e22-b81f-9b6b39b475c9 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:16.363497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07439398-7396-4e21-b4f2-a230a77b2092 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:16.367673 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 403/821] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:16.368778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23314be-86cd-4e22-b81f-9b6b39b475c9 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:16.402886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:16.415479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a12bd3-bcb9-4a9c-9c6c-9607c5e02d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:16.416416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a12bd3-bcb9-4a9c-9c6c-9607c5e02d57 None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:16.416803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a12bd3-bcb9-4a9c-9c6c-9607c5e02d57 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:16.417177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a12bd3-bcb9-4a9c-9c6c-9607c5e02d57 None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/8fad5b29e028436ca5596434a0cce086/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:16.419459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a12bd3-bcb9-4a9c-9c6c-9607c5e02d57 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=8fad5b29e028436ca5596434a0cce086, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:16.421618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a12bd3-bcb9-4a9c-9c6c-9607c5e02d57 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:16.438662 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 419/822] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:11:16 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/8fad5b29e028436ca5596434a0cce086/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:11:16.440033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a12bd3-bcb9-4a9c-9c6c-9607c5e02d57 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:16.518814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23314be-86cd-4e22-b81f-9b6b39b475c9 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:16.581409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a12bd3-bcb9-4a9c-9c6c-9607c5e02d57 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:16.589760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012706f2-4e77-44c5-ab84-db86ecbc2dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:16.590697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012706f2-4e77-44c5-ab84-db86ecbc2dfa None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:16.591127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012706f2-4e77-44c5-ab84-db86ecbc2dfa None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:16.591543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012706f2-4e77-44c5-ab84-db86ecbc2dfa None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:16.592388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012706f2-4e77-44c5-ab84-db86ecbc2dfa None admin] RBAC: Adding query filter params (type=network) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:16.597621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012706f2-4e77-44c5-ab84-db86ecbc2dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:16.599644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012706f2-4e77-44c5-ab84-db86ecbc2dfa None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:16.613184 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 404/823] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:16.614674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012706f2-4e77-44c5-ab84-db86ecbc2dfa None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:16.627301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c49dc-73ef-4f80-b3b3-539d084da155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:16.627950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c49dc-73ef-4f80-b3b3-539d084da155 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:16.629077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c49dc-73ef-4f80-b3b3-539d084da155 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:16.629077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c49dc-73ef-4f80-b3b3-539d084da155 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:16.638077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c49dc-73ef-4f80-b3b3-539d084da155 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:16.639730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c49dc-73ef-4f80-b3b3-539d084da155 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-7d0c49dc-73ef-4f80-b3b3-539d084da155 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:16.652133 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:16.653128 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:16.654969 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:16.654969 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:16.654969 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:16.654969 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:16.654969 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:16.654969 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:16.654969 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:16.654969 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:16.654969 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:16.654969 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:16.655544 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 420/824] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Aug 29 15:11:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:16.656777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871904ea-53a4-4a52-a850-a06860677c97 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:16.657060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871904ea-53a4-4a52-a850-a06860677c97 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:16.657379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871904ea-53a4-4a52-a850-a06860677c97 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:16.658798 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 421/825] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:16.663656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871904ea-53a4-4a52-a850-a06860677c97 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:16.681819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:16.723453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:16.758849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012706f2-4e77-44c5-ab84-db86ecbc2dfa None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:16.791860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871904ea-53a4-4a52-a850-a06860677c97 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:16.799483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476044d3-2777-4c67-88fd-324a1d9f9872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:16.800094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476044d3-2777-4c67-88fd-324a1d9f9872 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:16.800372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476044d3-2777-4c67-88fd-324a1d9f9872 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:16.800646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476044d3-2777-4c67-88fd-324a1d9f9872 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:16.801319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476044d3-2777-4c67-88fd-324a1d9f9872 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:16.802773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476044d3-2777-4c67-88fd-324a1d9f9872 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:16.833457 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 405/826] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:11:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:11:16.834836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1651e53-974b-47cf-a4fa-44c88cad6f61 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:16.835127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1651e53-974b-47cf-a4fa-44c88cad6f61 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:16.835490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1651e53-974b-47cf-a4fa-44c88cad6f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:16.852102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bde962-69a8-453d-a195-7585b29110c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:16.852757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bde962-69a8-453d-a195-7585b29110c2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:16.853095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bde962-69a8-453d-a195-7585b29110c2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:16.853376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bde962-69a8-453d-a195-7585b29110c2 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:16.854170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bde962-69a8-453d-a195-7585b29110c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:16.854538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bde962-69a8-453d-a195-7585b29110c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:16.856047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bde962-69a8-453d-a195-7585b29110c2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:16.876333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c1651e53-974b-47cf-a4fa-44c88cad6f61 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:16.878874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c1651e53-974b-47cf-a4fa-44c88cad6f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:16.910335 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 422/827] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Aug 29 15:11:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:16.912295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bde962-69a8-453d-a195-7585b29110c2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:17.038581 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 406/828] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:17.064805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bde962-69a8-453d-a195-7585b29110c2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:17.069739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:17.109988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d37eae-dce4-4bfa-a884-06d2325d667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:17.110658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d37eae-dce4-4bfa-a884-06d2325d667a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:17.110944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d37eae-dce4-4bfa-a884-06d2325d667a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:17.111223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d37eae-dce4-4bfa-a884-06d2325d667a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:17.237189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d37eae-dce4-4bfa-a884-06d2325d667a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:17.238688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d37eae-dce4-4bfa-a884-06d2325d667a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:17.347658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1651e53-974b-47cf-a4fa-44c88cad6f61 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:17.349443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:17.354883 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 423/829] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:16 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:11:17.361283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d37eae-dce4-4bfa-a884-06d2325d667a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:17.382832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:17.487750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1651e53-974b-47cf-a4fa-44c88cad6f61 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:17.492966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d37eae-dce4-4bfa-a884-06d2325d667a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:17.536739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a898dc3-a8c9-4a9f-9a09-1f33dfde09bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:17.537477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a898dc3-a8c9-4a9f-9a09-1f33dfde09bb None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:17.537759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a898dc3-a8c9-4a9f-9a09-1f33dfde09bb None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:17.538035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a898dc3-a8c9-4a9f-9a09-1f33dfde09bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:17.547269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904d86e-8104-45a3-bcf8-5d9d36f3179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:17.548920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904d86e-8104-45a3-bcf8-5d9d36f3179b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:17.549431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904d86e-8104-45a3-bcf8-5d9d36f3179b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:17.550417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904d86e-8104-45a3-bcf8-5d9d36f3179b None admin] PATH_INFO: `/v3/roles/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:17.552319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a898dc3-a8c9-4a9f-9a09-1f33dfde09bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:17.554264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a898dc3-a8c9-4a9f-9a09-1f33dfde09bb None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:17.566270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904d86e-8104-45a3-bcf8-5d9d36f3179b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-9904d86e-8104-45a3-bcf8-5d9d36f3179b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:17.572390 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:17.573434 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:11:17.574337 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-1a898dc3-a8c9-4a9f-9a09-1f33dfde09bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:17.574991 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:17.576719 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:17.578094 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:17.578094 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:17.578094 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:17.579546 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 424/830] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:17.580001 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 407/831] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:11:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:17.580864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904d86e-8104-45a3-bcf8-5d9d36f3179b None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:17.581020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37a38-cc75-4a41-ab03-cf70cff5b15c None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:17.581226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37a38-cc75-4a41-ab03-cf70cff5b15c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:17.589442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37a38-cc75-4a41-ab03-cf70cff5b15c None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:17.589442 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 425/832] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:17.589442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e37a38-cc75-4a41-ab03-cf70cff5b15c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:17.655337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:17.695355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:17.711462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904d86e-8104-45a3-bcf8-5d9d36f3179b None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:17.724606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e37a38-cc75-4a41-ab03-cf70cff5b15c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:17.756972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925236ab-67e2-4ef4-b61c-64154ff9fb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:17.757602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925236ab-67e2-4ef4-b61c-64154ff9fb7a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:17.757876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925236ab-67e2-4ef4-b61c-64154ff9fb7a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:17.758146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925236ab-67e2-4ef4-b61c-64154ff9fb7a None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:17.758832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925236ab-67e2-4ef4-b61c-64154ff9fb7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:17.759092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925236ab-67e2-4ef4-b61c-64154ff9fb7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:17.760505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925236ab-67e2-4ef4-b61c-64154ff9fb7a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:17.767162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cadd0-3f2d-4ef8-81ce-4a52d31b968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:17.767790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cadd0-3f2d-4ef8-81ce-4a52d31b968b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:17.768117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cadd0-3f2d-4ef8-81ce-4a52d31b968b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:17.768395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cadd0-3f2d-4ef8-81ce-4a52d31b968b None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:17.769070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cadd0-3f2d-4ef8-81ce-4a52d31b968b None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:17.769376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cadd0-3f2d-4ef8-81ce-4a52d31b968b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:17.770779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cadd0-3f2d-4ef8-81ce-4a52d31b968b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:17.778272 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 408/833] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:17.778272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dc66e-1a51-4322-b906-904638254eea None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:17.778272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dc66e-1a51-4322-b906-904638254eea None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:17.778272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dc66e-1a51-4322-b906-904638254eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:17.783621 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 426/834] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:17.784462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cadd0-3f2d-4ef8-81ce-4a52d31b968b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:17.801654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3f9dc66e-1a51-4322-b906-904638254eea None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:17.802932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3f9dc66e-1a51-4322-b906-904638254eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:17.889433 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 409/835] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:17.889433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dc66e-1a51-4322-b906-904638254eea None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:17.902014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cadd0-3f2d-4ef8-81ce-4a52d31b968b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:17.921798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:17.945235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b529794-c0b8-4f88-a9c8-e6e22f27fb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:17.945923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b529794-c0b8-4f88-a9c8-e6e22f27fb25 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:17.946201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b529794-c0b8-4f88-a9c8-e6e22f27fb25 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:17.946473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b529794-c0b8-4f88-a9c8-e6e22f27fb25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:17.955058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b529794-c0b8-4f88-a9c8-e6e22f27fb25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:17.956507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b529794-c0b8-4f88-a9c8-e6e22f27fb25 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-9b529794-c0b8-4f88-a9c8-e6e22f27fb25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:17.968942 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:17.970102 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:17.971216 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:17.971216 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:17.971216 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:17.971216 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:17.971216 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:17.971216 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:17.971216 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:17.971216 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:17.971216 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 427/836] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:17.976045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b529794-c0b8-4f88-a9c8-e6e22f27fb25 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:18.003666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:18.028022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dc66e-1a51-4322-b906-904638254eea None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:18.068431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf0937-f980-4ecc-bbac-2873a213f548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:18.069494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf0937-f980-4ecc-bbac-2873a213f548 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.069976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf0937-f980-4ecc-bbac-2873a213f548 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.070445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf0937-f980-4ecc-bbac-2873a213f548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.081996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf0937-f980-4ecc-bbac-2873a213f548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:18.083871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf0937-f980-4ecc-bbac-2873a213f548 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-46cf0937-f980-4ecc-bbac-2873a213f548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:18.100833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:18.101889 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:18.102799 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:18.102799 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:18.102799 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:18.105113 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 410/837] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:18.111671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf0937-f980-4ecc-bbac-2873a213f548 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:18.117526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b529794-c0b8-4f88-a9c8-e6e22f27fb25 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:18.155172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490041b-5ccb-42c4-849c-209f638d7959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:18.155822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490041b-5ccb-42c4-849c-209f638d7959 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.156223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490041b-5ccb-42c4-849c-209f638d7959 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.156365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490041b-5ccb-42c4-849c-209f638d7959 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.157064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490041b-5ccb-42c4-849c-209f638d7959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:18.157366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490041b-5ccb-42c4-849c-209f638d7959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:18.158826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490041b-5ccb-42c4-849c-209f638d7959 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:18.172687 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 428/838] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:18.178272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490041b-5ccb-42c4-849c-209f638d7959 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:18.211591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:18.233557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf0937-f980-4ecc-bbac-2873a213f548 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:18.263910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:18.271242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb1761-4e51-4277-a156-ad57ed9f362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:18.271852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb1761-4e51-4277-a156-ad57ed9f362c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.272127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb1761-4e51-4277-a156-ad57ed9f362c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.272394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb1761-4e51-4277-a156-ad57ed9f362c None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.273063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb1761-4e51-4277-a156-ad57ed9f362c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:18.273360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb1761-4e51-4277-a156-ad57ed9f362c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:18.274739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb1761-4e51-4277-a156-ad57ed9f362c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:18.287263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490041b-5ccb-42c4-849c-209f638d7959 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:18.292455 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 411/839] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:18.292455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb1761-4e51-4277-a156-ad57ed9f362c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:18.323769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb46cb1-3879-4281-9ac1-0527493c30a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:18.324390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb46cb1-3879-4281-9ac1-0527493c30a1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.324664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb46cb1-3879-4281-9ac1-0527493c30a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.324933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb46cb1-3879-4281-9ac1-0527493c30a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.325539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb46cb1-3879-4281-9ac1-0527493c30a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:18.326914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb46cb1-3879-4281-9ac1-0527493c30a1 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-1cb46cb1-3879-4281-9ac1-0527493c30a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:18.335907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:18.336964 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:18.337854 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 429/840] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:11:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:18.338667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb46cb1-3879-4281-9ac1-0527493c30a1 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:18.403030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb1761-4e51-4277-a156-ad57ed9f362c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:18.438778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:18.439719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01689b46-3a70-4aaa-bee1-1ec204ef4448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:18.440326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689b46-3a70-4aaa-bee1-1ec204ef4448 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.440604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689b46-3a70-4aaa-bee1-1ec204ef4448 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.441090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689b46-3a70-4aaa-bee1-1ec204ef4448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.441954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01689b46-3a70-4aaa-bee1-1ec204ef4448 None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=c235251bc54848279759ba3e71a38306) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:18.442264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01689b46-3a70-4aaa-bee1-1ec204ef4448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:18.443471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb46cb1-3879-4281-9ac1-0527493c30a1 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:18.443794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01689b46-3a70-4aaa-bee1-1ec204ef4448 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:18.450191 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 412/841] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:18 2022] GET /identity/v3/role_assignments?user.id=c235251bc54848279759ba3e71a38306&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=be89abac608f45a6921181bcc574f721 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:18.451002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01689b46-3a70-4aaa-bee1-1ec204ef4448 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:18.498789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71e481-8649-4721-9ccc-156cbdbe64ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:18.499446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e481-8649-4721-9ccc-156cbdbe64ef None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.499806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e481-8649-4721-9ccc-156cbdbe64ef None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.499983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e481-8649-4721-9ccc-156cbdbe64ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.509345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71e481-8649-4721-9ccc-156cbdbe64ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:18.510991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71e481-8649-4721-9ccc-156cbdbe64ef None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-1d71e481-8649-4721-9ccc-156cbdbe64ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:18.525273 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:18.526529 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:18.527801 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:18.527801 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:18.527801 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:18.527801 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:18.527801 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:18.527801 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:18.527801 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:18.527801 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:18.527801 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:18.527801 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:18.531452 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 430/842] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Aug 29 15:11:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:18.533084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34654ce-9032-44a2-aa08-42a5a02da979 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.533362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34654ce-9032-44a2-aa08-42a5a02da979 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.533668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34654ce-9032-44a2-aa08-42a5a02da979 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.535057 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 431/843] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:18.535835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34654ce-9032-44a2-aa08-42a5a02da979 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:18.550350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:18.606182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01689b46-3a70-4aaa-bee1-1ec204ef4448 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:18.649003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35720f-c28d-401f-805e-783cdd81a604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:18.650992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35720f-c28d-401f-805e-783cdd81a604 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.650992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35720f-c28d-401f-805e-783cdd81a604 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.650992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35720f-c28d-401f-805e-783cdd81a604 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.651498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35720f-c28d-401f-805e-783cdd81a604 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:18.651794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35720f-c28d-401f-805e-783cdd81a604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:18.653168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35720f-c28d-401f-805e-783cdd81a604 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:18.662825 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 413/844] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:11:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:18.662825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab7808-e1f4-4683-a850-94716f888430 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.662825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab7808-e1f4-4683-a850-94716f888430 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.662825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab7808-e1f4-4683-a850-94716f888430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.672363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34654ce-9032-44a2-aa08-42a5a02da979 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:18.679692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8dab7808-e1f4-4683-a850-94716f888430 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:18.680882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8dab7808-e1f4-4683-a850-94716f888430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:18.710861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65c816-0f0c-4e27-b80d-7e4934da9f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:18.711403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65c816-0f0c-4e27-b80d-7e4934da9f35 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.711667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65c816-0f0c-4e27-b80d-7e4934da9f35 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.711936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65c816-0f0c-4e27-b80d-7e4934da9f35 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.712663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65c816-0f0c-4e27-b80d-7e4934da9f35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:18.712966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65c816-0f0c-4e27-b80d-7e4934da9f35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:18.714408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65c816-0f0c-4e27-b80d-7e4934da9f35 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:18.737894 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 432/845] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Aug 29 15:11:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:18.739889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65c816-0f0c-4e27-b80d-7e4934da9f35 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:18.758108 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 414/846] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:18.758108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab7808-e1f4-4683-a850-94716f888430 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:18.762018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:18.820161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:18.869139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65c816-0f0c-4e27-b80d-7e4934da9f35 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:18.878870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab7808-e1f4-4683-a850-94716f888430 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:18.906028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9012ba-aa1f-4dde-98f6-6910a795e54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:18.906554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9012ba-aa1f-4dde-98f6-6910a795e54d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.906859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9012ba-aa1f-4dde-98f6-6910a795e54d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.907091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9012ba-aa1f-4dde-98f6-6910a795e54d None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.907772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9012ba-aa1f-4dde-98f6-6910a795e54d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:18.908066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9012ba-aa1f-4dde-98f6-6910a795e54d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:18.910340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9012ba-aa1f-4dde-98f6-6910a795e54d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:18.922054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d976244-bc9b-4590-bdc9-831a71a1befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:18.923052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d976244-bc9b-4590-bdc9-831a71a1befe None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:18.923535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d976244-bc9b-4590-bdc9-831a71a1befe None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:18.923991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d976244-bc9b-4590-bdc9-831a71a1befe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:18.925528 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 433/847] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:11:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:19.006839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d976244-bc9b-4590-bdc9-831a71a1befe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:19.008661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d976244-bc9b-4590-bdc9-831a71a1befe None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:19.054210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9012ba-aa1f-4dde-98f6-6910a795e54d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:19.070065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:19.134425 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 415/848] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:11:19.141324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d976244-bc9b-4590-bdc9-831a71a1befe None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:19.165199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:19.186991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9012ba-aa1f-4dde-98f6-6910a795e54d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:19.235132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6398e-bc51-449c-a5e5-c9d47430a583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:19.236192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6398e-bc51-449c-a5e5-c9d47430a583 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:19.236673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6398e-bc51-449c-a5e5-c9d47430a583 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:19.237141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6398e-bc51-449c-a5e5-c9d47430a583 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:19.251391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6398e-bc51-449c-a5e5-c9d47430a583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-93c6398e-bc51-449c-a5e5-c9d47430a583 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:19.256907 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:19.257888 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:19.258774 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 434/849] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:19.269441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6398e-bc51-449c-a5e5-c9d47430a583 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:19.277549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d976244-bc9b-4590-bdc9-831a71a1befe None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:19.316516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f30f49-ced6-4449-ac4c-6c0a11759bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:19.317295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f30f49-ced6-4449-ac4c-6c0a11759bc9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:19.317668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f30f49-ced6-4449-ac4c-6c0a11759bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:19.318095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f30f49-ced6-4449-ac4c-6c0a11759bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:19.329282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f30f49-ced6-4449-ac4c-6c0a11759bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:19.330843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f30f49-ced6-4449-ac4c-6c0a11759bc9 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:19.340392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-61f30f49-ced6-4449-ac4c-6c0a11759bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:19.347364 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:19.348576 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:19.349755 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:19.349755 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:19.349755 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:19.350499 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 416/850] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:19.355933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f30f49-ced6-4449-ac4c-6c0a11759bc9 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:19.406679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6398e-bc51-449c-a5e5-c9d47430a583 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:19.454115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a25576-404a-4c19-aac2-5f48128220d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:19.454734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a25576-404a-4c19-aac2-5f48128220d0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:19.457872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a25576-404a-4c19-aac2-5f48128220d0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:19.458392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a25576-404a-4c19-aac2-5f48128220d0 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:19.460044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a25576-404a-4c19-aac2-5f48128220d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:19.460589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a25576-404a-4c19-aac2-5f48128220d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:19.462698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a25576-404a-4c19-aac2-5f48128220d0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:19.480219 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 435/851] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:19.481836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a25576-404a-4c19-aac2-5f48128220d0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:19.484812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:19.495206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f30f49-ced6-4449-ac4c-6c0a11759bc9 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:19.554975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bb840-5937-4e9b-a257-dc9529e3867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:19.555625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bb840-5937-4e9b-a257-dc9529e3867e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:19.557724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bb840-5937-4e9b-a257-dc9529e3867e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:19.558463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bb840-5937-4e9b-a257-dc9529e3867e None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:19.559981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bb840-5937-4e9b-a257-dc9529e3867e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:19.560519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bb840-5937-4e9b-a257-dc9529e3867e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:19.563202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bb840-5937-4e9b-a257-dc9529e3867e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:19.580573 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 417/852] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:19.585691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bb840-5937-4e9b-a257-dc9529e3867e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:19.603327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a25576-404a-4c19-aac2-5f48128220d0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:19.643326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55f99-0361-40bb-bb77-eaf48a573917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:19.644259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55f99-0361-40bb-bb77-eaf48a573917 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:19.644748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55f99-0361-40bb-bb77-eaf48a573917 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:19.645166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55f99-0361-40bb-bb77-eaf48a573917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:19.650070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:19.660706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a55f99-0361-40bb-bb77-eaf48a573917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:19.662440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a55f99-0361-40bb-bb77-eaf48a573917 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-f9a55f99-0361-40bb-bb77-eaf48a573917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:19.678853 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:19.680051 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:19.681143 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:19.681143 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:19.681143 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:19.682940 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 436/853] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:19.688544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55f99-0361-40bb-bb77-eaf48a573917 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:19.701421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bb840-5937-4e9b-a257-dc9529e3867e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:19.736825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f75cd-25ce-4e6c-8b77-be5c6bf85c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:19.737490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f75cd-25ce-4e6c-8b77-be5c6bf85c62 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:19.737777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f75cd-25ce-4e6c-8b77-be5c6bf85c62 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:19.738050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f75cd-25ce-4e6c-8b77-be5c6bf85c62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:19.745483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f75cd-25ce-4e6c-8b77-be5c6bf85c62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:19.747049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f75cd-25ce-4e6c-8b77-be5c6bf85c62 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:19.757803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-d79f75cd-25ce-4e6c-8b77-be5c6bf85c62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:19.758974 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:19.759879 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:19.760792 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:19.760792 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:19.760792 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:19.760792 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:19.760792 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:19.760792 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:19.760792 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:19.760792 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:19.764937 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 418/854] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:19.765911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f75cd-25ce-4e6c-8b77-be5c6bf85c62 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:19.806249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55f99-0361-40bb-bb77-eaf48a573917 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:19.846021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e556-7f23-40cd-9eaa-ab23166b27e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:19.846640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e556-7f23-40cd-9eaa-ab23166b27e7 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:19.847007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e556-7f23-40cd-9eaa-ab23166b27e7 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:19.847538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e556-7f23-40cd-9eaa-ab23166b27e7 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:19.848646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01e556-7f23-40cd-9eaa-ab23166b27e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:19.849148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01e556-7f23-40cd-9eaa-ab23166b27e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:19.851696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01e556-7f23-40cd-9eaa-ab23166b27e7 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:19.873508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f75cd-25ce-4e6c-8b77-be5c6bf85c62 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:19.877565 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 437/855] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:19.881037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e556-7f23-40cd-9eaa-ab23166b27e7 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:19.894556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:19.910376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf8765-427d-46a0-b7ef-36b0a5ce9839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:19.910991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8765-427d-46a0-b7ef-36b0a5ce9839 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:19.911272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8765-427d-46a0-b7ef-36b0a5ce9839 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:19.911609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8765-427d-46a0-b7ef-36b0a5ce9839 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:19.912360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf8765-427d-46a0-b7ef-36b0a5ce9839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:19.912669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf8765-427d-46a0-b7ef-36b0a5ce9839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:19.914182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf8765-427d-46a0-b7ef-36b0a5ce9839 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:19.932403 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 419/856] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:19.933443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf8765-427d-46a0-b7ef-36b0a5ce9839 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:20.006310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e556-7f23-40cd-9eaa-ab23166b27e7 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:20.033847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:20.039072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf8765-427d-46a0-b7ef-36b0a5ce9839 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:20.045823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b40bc1-e03b-4744-a062-6554336737f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:20.046479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40bc1-e03b-4744-a062-6554336737f4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:20.046766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40bc1-e03b-4744-a062-6554336737f4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:20.047049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40bc1-e03b-4744-a062-6554336737f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:20.056047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b40bc1-e03b-4744-a062-6554336737f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:20.057757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b40bc1-e03b-4744-a062-6554336737f4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-b4b40bc1-e03b-4744-a062-6554336737f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:20.072268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:20.073410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:20.074403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:20.074403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:20.074403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:20.074403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:20.074403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:20.074403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:20.074403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:20.074403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:20.074403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 15:11:20.074403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:20.077508 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 438/857] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:20.081122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b40bc1-e03b-4744-a062-6554336737f4 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:20.084609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f5feb-fb68-431e-8f65-d308b52fe621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:20.086148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f5feb-fb68-431e-8f65-d308b52fe621 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:20.086427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f5feb-fb68-431e-8f65-d308b52fe621 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:20.086698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f5feb-fb68-431e-8f65-d308b52fe621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:20.087464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f5feb-fb68-431e-8f65-d308b52fe621 None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=f70236f89ced4a209b0451062d3d39f5) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:20.087773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f5feb-fb68-431e-8f65-d308b52fe621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:20.089347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f5feb-fb68-431e-8f65-d308b52fe621 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:20.102731 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 420/858] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:19 2022] GET /identity/v3/role_assignments?user.id=f70236f89ced4a209b0451062d3d39f5&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:20.211250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b40bc1-e03b-4744-a062-6554336737f4 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:20.254260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28bd3d-d568-4390-a7f2-2addb7112f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:20.255282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28bd3d-d568-4390-a7f2-2addb7112f30 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:20.255828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28bd3d-d568-4390-a7f2-2addb7112f30 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:20.256293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28bd3d-d568-4390-a7f2-2addb7112f30 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:20.257434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28bd3d-d568-4390-a7f2-2addb7112f30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:20.258018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28bd3d-d568-4390-a7f2-2addb7112f30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:20.259870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28bd3d-d568-4390-a7f2-2addb7112f30 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:20.282013 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 439/859] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Aug 29 15:11:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:20.288338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f5feb-fb68-431e-8f65-d308b52fe621 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:20.341639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:20.409123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f5feb-fb68-431e-8f65-d308b52fe621 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:20.447979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c4cb4-7b4f-45b4-82dc-25bab70cb725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:20.448994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c4cb4-7b4f-45b4-82dc-25bab70cb725 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:20.449564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c4cb4-7b4f-45b4-82dc-25bab70cb725 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:20.450030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c4cb4-7b4f-45b4-82dc-25bab70cb725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:20.476938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f055521-5849-48e2-b8dc-4de33cb0c588 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:20.477287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f055521-5849-48e2-b8dc-4de33cb0c588 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:20.477712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f055521-5849-48e2-b8dc-4de33cb0c588 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:20.479008 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 440/860] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:20.484801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc178538-598d-4d56-a60c-97a6570b1753 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:20.485371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc178538-598d-4d56-a60c-97a6570b1753 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:20.485875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc178538-598d-4d56-a60c-97a6570b1753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:20.509844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-bc178538-598d-4d56-a60c-97a6570b1753 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:20.511235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bc178538-598d-4d56-a60c-97a6570b1753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:20.541851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c4cb4-7b4f-45b4-82dc-25bab70cb725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:20.544325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c4cb4-7b4f-45b4-82dc-25bab70cb725 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:20.549762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:20.605524 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 441/861] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:20.612329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:20.685590 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 421/862] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:11:20.692549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc178538-598d-4d56-a60c-97a6570b1753 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:20.802701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc178538-598d-4d56-a60c-97a6570b1753 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:20.838792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5bbc7-2f9e-4a1f-ae04-49b1c39621a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:20.839417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5bbc7-2f9e-4a1f-ae04-49b1c39621a2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:20.839691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5bbc7-2f9e-4a1f-ae04-49b1c39621a2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:20.839959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5bbc7-2f9e-4a1f-ae04-49b1c39621a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:20.850465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5bbc7-2f9e-4a1f-ae04-49b1c39621a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:20.851899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5bbc7-2f9e-4a1f-ae04-49b1c39621a2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-a6e5bbc7-2f9e-4a1f-ae04-49b1c39621a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:20.867612 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:20.868655 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:20.869688 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:20.869688 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:20.869688 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:20.869688 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 442/863] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:20.876580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c4cb4-7b4f-45b4-82dc-25bab70cb725 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:20.907738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5bbc7-2f9e-4a1f-ae04-49b1c39621a2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:20.926654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:21.001292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c4cb4-7b4f-45b4-82dc-25bab70cb725 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:21.025976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5bbc7-2f9e-4a1f-ae04-49b1c39621a2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:21.037209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571df134-1a9c-4343-b2d0-d4fb662f199c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:21.037840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571df134-1a9c-4343-b2d0-d4fb662f199c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:21.038121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571df134-1a9c-4343-b2d0-d4fb662f199c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:21.038393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571df134-1a9c-4343-b2d0-d4fb662f199c None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:21.039034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571df134-1a9c-4343-b2d0-d4fb662f199c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:21.039333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571df134-1a9c-4343-b2d0-d4fb662f199c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:21.040734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571df134-1a9c-4343-b2d0-d4fb662f199c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:21.057829 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 422/864] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:21.057829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e8441-ae9a-416c-b7f2-01dadf3d70a1 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:21.057829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e8441-ae9a-416c-b7f2-01dadf3d70a1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:21.057829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e8441-ae9a-416c-b7f2-01dadf3d70a1 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:21.061480 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 423/865] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:21.062675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e8441-ae9a-416c-b7f2-01dadf3d70a1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:21.067409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:21.070767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053781f3-4b58-49e7-b2af-504a0f83a41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:21.071498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053781f3-4b58-49e7-b2af-504a0f83a41e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:21.071773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053781f3-4b58-49e7-b2af-504a0f83a41e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:21.072040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053781f3-4b58-49e7-b2af-504a0f83a41e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:21.072619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053781f3-4b58-49e7-b2af-504a0f83a41e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:21.074539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053781f3-4b58-49e7-b2af-504a0f83a41e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-053781f3-4b58-49e7-b2af-504a0f83a41e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:21.084583 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:21.085815 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:21.086713 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 443/866] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Aug 29 15:11:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:21.087531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785b43e-027d-49f8-aa32-04e7734a3654 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:21.087531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785b43e-027d-49f8-aa32-04e7734a3654 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:21.087531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785b43e-027d-49f8-aa32-04e7734a3654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:21.106786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6785b43e-027d-49f8-aa32-04e7734a3654 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:21.108056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6785b43e-027d-49f8-aa32-04e7734a3654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:21.190013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e8441-ae9a-416c-b7f2-01dadf3d70a1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:21.191875 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 444/867] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:21.194287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785b43e-027d-49f8-aa32-04e7734a3654 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:21.209318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:21.233330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f9d35-d88d-4cd9-8ab2-946ba702cc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:21.234183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9d35-d88d-4cd9-8ab2-946ba702cc9e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:21.234554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9d35-d88d-4cd9-8ab2-946ba702cc9e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:21.235293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9d35-d88d-4cd9-8ab2-946ba702cc9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:21.243479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f9d35-d88d-4cd9-8ab2-946ba702cc9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:21.245759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f9d35-d88d-4cd9-8ab2-946ba702cc9e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-800f9d35-d88d-4cd9-8ab2-946ba702cc9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:21.259043 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:21.260195 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:21.261302 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:21.261302 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:21.261302 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:21.261302 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:21.261302 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:21.261302 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:21.261302 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:21.261302 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:21.268504 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 424/868] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:21.269627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f9d35-d88d-4cd9-8ab2-946ba702cc9e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:21.332075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785b43e-027d-49f8-aa32-04e7734a3654 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:21.350107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:21.372619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879e5c0-db2c-4f2b-a904-04879e754de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:21.373971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879e5c0-db2c-4f2b-a904-04879e754de9 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:21.374345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879e5c0-db2c-4f2b-a904-04879e754de9 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:21.374719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879e5c0-db2c-4f2b-a904-04879e754de9 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:21.375456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879e5c0-db2c-4f2b-a904-04879e754de9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:21.375882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879e5c0-db2c-4f2b-a904-04879e754de9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:21.377401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879e5c0-db2c-4f2b-a904-04879e754de9 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:21.382990 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 445/869] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Aug 29 15:11:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:21.389371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879e5c0-db2c-4f2b-a904-04879e754de9 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:21.409106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f9d35-d88d-4cd9-8ab2-946ba702cc9e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:21.454130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bd445-8b0e-4cfe-984a-8770145bf217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:21.455824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bd445-8b0e-4cfe-984a-8770145bf217 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:21.456259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bd445-8b0e-4cfe-984a-8770145bf217 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:21.456679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bd445-8b0e-4cfe-984a-8770145bf217 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:21.457554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bd445-8b0e-4cfe-984a-8770145bf217 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:21.458031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bd445-8b0e-4cfe-984a-8770145bf217 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:21.459623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bd445-8b0e-4cfe-984a-8770145bf217 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:21.475066 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 425/870] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:21.476140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bd445-8b0e-4cfe-984a-8770145bf217 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:21.505620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:21.544807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879e5c0-db2c-4f2b-a904-04879e754de9 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:21.585577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714c112-4423-49bc-850c-88d72704ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:21.586291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714c112-4423-49bc-850c-88d72704ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:21.586576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714c112-4423-49bc-850c-88d72704ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:21.586851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714c112-4423-49bc-850c-88d72704ecb5 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:21.587652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714c112-4423-49bc-850c-88d72704ecb5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:21.588079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714c112-4423-49bc-850c-88d72704ecb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:21.589699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714c112-4423-49bc-850c-88d72704ecb5 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:21.593649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bd445-8b0e-4cfe-984a-8770145bf217 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:21.605850 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 446/871] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Aug 29 15:11:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:21.606727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714c112-4423-49bc-850c-88d72704ecb5 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:21.628318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:21.645535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99eb26-f4ea-4e0f-af82-a5c431e5a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:21.646180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99eb26-f4ea-4e0f-af82-a5c431e5a385 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:21.646464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99eb26-f4ea-4e0f-af82-a5c431e5a385 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:21.646738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99eb26-f4ea-4e0f-af82-a5c431e5a385 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:21.647532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99eb26-f4ea-4e0f-af82-a5c431e5a385 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:21.649023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99eb26-f4ea-4e0f-af82-a5c431e5a385 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:21.677475 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 426/872] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:11:21 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:11:21.780997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714c112-4423-49bc-850c-88d72704ecb5 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:21.829251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:21.836354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f46552-77ad-49a7-a5ab-1bb6ef9bb4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:21.837040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f46552-77ad-49a7-a5ab-1bb6ef9bb4d9 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:21.837545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f46552-77ad-49a7-a5ab-1bb6ef9bb4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:21.837825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f46552-77ad-49a7-a5ab-1bb6ef9bb4d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:21.839967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f46552-77ad-49a7-a5ab-1bb6ef9bb4d9 None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=8fad5b29e028436ca5596434a0cce086) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:21.839967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f46552-77ad-49a7-a5ab-1bb6ef9bb4d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:21.842402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f46552-77ad-49a7-a5ab-1bb6ef9bb4d9 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:21.848542 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 447/873] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:21 2022] GET /identity/v3/role_assignments?user.id=8fad5b29e028436ca5596434a0cce086&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=be89abac608f45a6921181bcc574f721 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:22.222034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5054-f7a8-40e8-8862-0f1cb2c9bed6 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:22.222231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5054-f7a8-40e8-8862-0f1cb2c9bed6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:22.222496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5054-f7a8-40e8-8862-0f1cb2c9bed6 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:22.224090 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 427/874] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:22.229457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c33b9-8d32-445f-b36d-8365e07c3e3e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:22.229745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c33b9-8d32-445f-b36d-8365e07c3e3e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:22.230017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c33b9-8d32-445f-b36d-8365e07c3e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:22.248593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b86c33b9-8d32-445f-b36d-8365e07c3e3e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:22.249816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b86c33b9-8d32-445f-b36d-8365e07c3e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:22.321814 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 448/875] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:22.598145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f5054-f7a8-40e8-8862-0f1cb2c9bed6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:22.713818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f5054-f7a8-40e8-8862-0f1cb2c9bed6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:22.750572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47617ec4-472f-47e6-ae51-95ba9074be28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:22.751200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47617ec4-472f-47e6-ae51-95ba9074be28 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:22.751478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47617ec4-472f-47e6-ae51-95ba9074be28 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:22.751749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47617ec4-472f-47e6-ae51-95ba9074be28 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:22.763653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47617ec4-472f-47e6-ae51-95ba9074be28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-47617ec4-472f-47e6-ae51-95ba9074be28 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:22.769310 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:22.771702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:22.773568 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 428/876] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Aug 29 15:11:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:22.776704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c33b9-8d32-445f-b36d-8365e07c3e3e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:22.901857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c33b9-8d32-445f-b36d-8365e07c3e3e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:22.930165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:22.939735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5766b-ab6c-4010-8ad8-a1e455c5c1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:22.940345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5766b-ab6c-4010-8ad8-a1e455c5c1d2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:22.940622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5766b-ab6c-4010-8ad8-a1e455c5c1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:22.940950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5766b-ab6c-4010-8ad8-a1e455c5c1d2 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:22.941639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5766b-ab6c-4010-8ad8-a1e455c5c1d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:22.941938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5766b-ab6c-4010-8ad8-a1e455c5c1d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:22.943295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5766b-ab6c-4010-8ad8-a1e455c5c1d2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:22.952626 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 449/877] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Aug 29 15:11:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:22.958186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47617ec4-472f-47e6-ae51-95ba9074be28 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:23.007716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:23.067472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47617ec4-472f-47e6-ae51-95ba9074be28 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:23.103615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72e008-3055-40b3-8efc-b4766dea7812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:23.104238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72e008-3055-40b3-8efc-b4766dea7812 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:23.104515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72e008-3055-40b3-8efc-b4766dea7812 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:23.104785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72e008-3055-40b3-8efc-b4766dea7812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:23.115968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72e008-3055-40b3-8efc-b4766dea7812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:23.117448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72e008-3055-40b3-8efc-b4766dea7812 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-fe72e008-3055-40b3-8efc-b4766dea7812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:23.135056 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:23.137334 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:23.140113 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:23.140113 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:23.140113 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:23.140113 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 429/878] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:23.146710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5766b-ab6c-4010-8ad8-a1e455c5c1d2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:23.263046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5766b-ab6c-4010-8ad8-a1e455c5c1d2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:23.300466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6920c5c-d28e-4b86-95e7-cc7d9a735935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:23.301077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920c5c-d28e-4b86-95e7-cc7d9a735935 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:23.301354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920c5c-d28e-4b86-95e7-cc7d9a735935 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:23.301656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920c5c-d28e-4b86-95e7-cc7d9a735935 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:23.302298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6920c5c-d28e-4b86-95e7-cc7d9a735935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:23.302596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6920c5c-d28e-4b86-95e7-cc7d9a735935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:23.303957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6920c5c-d28e-4b86-95e7-cc7d9a735935 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:23.318003 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 450/879] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:23.323619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72e008-3055-40b3-8efc-b4766dea7812 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:23.425304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:23.432412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72e008-3055-40b3-8efc-b4766dea7812 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:23.469600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8dd0e-08a8-4840-ab85-057d08575f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:23.470233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8dd0e-08a8-4840-ab85-057d08575f46 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:23.470510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8dd0e-08a8-4840-ab85-057d08575f46 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:23.470783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8dd0e-08a8-4840-ab85-057d08575f46 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:23.480067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8dd0e-08a8-4840-ab85-057d08575f46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:23.481560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8dd0e-08a8-4840-ab85-057d08575f46 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-82e8dd0e-08a8-4840-ab85-057d08575f46 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:23.493869 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:23.496219 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:23.498942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:23.498942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:23.498942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:23.498942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:23.498942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:23.498942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:23.498942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:23.498942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:23.498942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:23.498942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:23.498942 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 430/880] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Aug 29 15:11:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:23.505904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6920c5c-d28e-4b86-95e7-cc7d9a735935 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:23.565235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:23.621630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6920c5c-d28e-4b86-95e7-cc7d9a735935 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:23.659756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa604355-c9e5-438d-917b-6be22489b258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:23.660375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa604355-c9e5-438d-917b-6be22489b258 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:23.660719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa604355-c9e5-438d-917b-6be22489b258 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:23.660994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa604355-c9e5-438d-917b-6be22489b258 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:23.661760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa604355-c9e5-438d-917b-6be22489b258 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:23.662063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa604355-c9e5-438d-917b-6be22489b258 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:23.663485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa604355-c9e5-438d-917b-6be22489b258 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:23.683495 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 451/881] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Aug 29 15:11:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:23.689475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8dd0e-08a8-4840-ab85-057d08575f46 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:23.703547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87786a5-30d6-411a-87b0-b3ee7365aa90 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:23.703547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87786a5-30d6-411a-87b0-b3ee7365aa90 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:23.703547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87786a5-30d6-411a-87b0-b3ee7365aa90 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:23.703547 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 452/882] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:23.713432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a68765-d5d0-4439-bc69-325aacb2211a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:23.713432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a68765-d5d0-4439-bc69-325aacb2211a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:23.713432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a68765-d5d0-4439-bc69-325aacb2211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:23.731338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-42a68765-d5d0-4439-bc69-325aacb2211a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:23.733477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42a68765-d5d0-4439-bc69-325aacb2211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:23.805579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8dd0e-08a8-4840-ab85-057d08575f46 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:23.838668 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 453/883] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:23.844840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118525-e971-429f-bddf-03bf5d283481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:23.849162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118525-e971-429f-bddf-03bf5d283481 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:23.849162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118525-e971-429f-bddf-03bf5d283481 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:23.849162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118525-e971-429f-bddf-03bf5d283481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:23.849492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c0af5-a380-4000-a3f1-e798e269a35e None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:23.849492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c0af5-a380-4000-a3f1-e798e269a35e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:23.849492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c0af5-a380-4000-a3f1-e798e269a35e None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:23.849492 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 454/884] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:23.851595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eabffe-3cfb-4296-82af-8b3d8229bf06 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:23.851884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eabffe-3cfb-4296-82af-8b3d8229bf06 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:23.852160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eabffe-3cfb-4296-82af-8b3d8229bf06 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:23.853645 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 455/885] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:23.854695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df8a4-f86d-4767-8ec0-9a0e88920e20 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:23.855006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df8a4-f86d-4767-8ec0-9a0e88920e20 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:23.855285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df8a4-f86d-4767-8ec0-9a0e88920e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:23.874399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b74df8a4-f86d-4767-8ec0-9a0e88920e20 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:23.875591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b74df8a4-f86d-4767-8ec0-9a0e88920e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:23.883823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:23.909925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:23.930873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc118525-e971-429f-bddf-03bf5d283481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:23.932321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc118525-e971-429f-bddf-03bf5d283481 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:23.950836 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 456/886] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:23.952135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d7eb-484f-44bd-9a98-1a6894de0084 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:23.952424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d7eb-484f-44bd-9a98-1a6894de0084 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:23.952699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d7eb-484f-44bd-9a98-1a6894de0084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:23.980974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4680d7eb-484f-44bd-9a98-1a6894de0084 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:23.983298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4680d7eb-484f-44bd-9a98-1a6894de0084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:24.064970 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 431/887] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:23 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:11:24.070010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118525-e971-429f-bddf-03bf5d283481 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:24.074141 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 457/888] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:24.124389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680d7eb-484f-44bd-9a98-1a6894de0084 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:24.135401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:24.195380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118525-e971-429f-bddf-03bf5d283481 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:24.246416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb417e24-e548-4cd9-952c-b59f7d47c046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:24.247154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb417e24-e548-4cd9-952c-b59f7d47c046 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:24.247518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb417e24-e548-4cd9-952c-b59f7d47c046 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:24.247757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb417e24-e548-4cd9-952c-b59f7d47c046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:24.256640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:24.260104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb417e24-e548-4cd9-952c-b59f7d47c046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:24.261691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb417e24-e548-4cd9-952c-b59f7d47c046 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:24.268957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680d7eb-484f-44bd-9a98-1a6894de0084 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-fb417e24-e548-4cd9-952c-b59f7d47c046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:24.283554 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:24.284575 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:24.286076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:24.286076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:24.286076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:24.286076 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 432/889] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:24.286679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb417e24-e548-4cd9-952c-b59f7d47c046 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:24.319331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d5ad2-9a82-40a0-b1cf-7297bf39e1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:24.320300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d5ad2-9a82-40a0-b1cf-7297bf39e1e2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:24.320745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d5ad2-9a82-40a0-b1cf-7297bf39e1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:24.321232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d5ad2-9a82-40a0-b1cf-7297bf39e1e2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:24.322249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d5ad2-9a82-40a0-b1cf-7297bf39e1e2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:24.324768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d5ad2-9a82-40a0-b1cf-7297bf39e1e2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-ea4d5ad2-9a82-40a0-b1cf-7297bf39e1e2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:24.343361 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:24.344479 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:24.345336 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 458/890] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:11:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:24.347201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d5ad2-9a82-40a0-b1cf-7297bf39e1e2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:24.410154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb417e24-e548-4cd9-952c-b59f7d47c046 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:24.419237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:24.450981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed13db-b350-4d3f-be29-e798e84d3b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:24.452109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed13db-b350-4d3f-be29-e798e84d3b44 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:24.452387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed13db-b350-4d3f-be29-e798e84d3b44 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:24.452691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed13db-b350-4d3f-be29-e798e84d3b44 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:24.453352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed13db-b350-4d3f-be29-e798e84d3b44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:24.454752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed13db-b350-4d3f-be29-e798e84d3b44 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:24.461881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d5ad2-9a82-40a0-b1cf-7297bf39e1e2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:24.473194 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 433/891] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:11:24 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:11:24.474059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed13db-b350-4d3f-be29-e798e84d3b44 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:24.509487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c413dd-4d80-47c8-8c62-1406d267b146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:24.510166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c413dd-4d80-47c8-8c62-1406d267b146 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:24.510447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c413dd-4d80-47c8-8c62-1406d267b146 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:24.510707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c413dd-4d80-47c8-8c62-1406d267b146 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:24.511360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c413dd-4d80-47c8-8c62-1406d267b146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:24.511657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c413dd-4d80-47c8-8c62-1406d267b146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:24.513044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c413dd-4d80-47c8-8c62-1406d267b146 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:24.528307 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 459/892] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:24.529023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c413dd-4d80-47c8-8c62-1406d267b146 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:24.556221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:24.614222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed13db-b350-4d3f-be29-e798e84d3b44 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:24.654336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c413dd-4d80-47c8-8c62-1406d267b146 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:24.662150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292239b2-2d17-44ca-8fe3-5070a28e456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:24.663266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292239b2-2d17-44ca-8fe3-5070a28e456f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:24.663543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292239b2-2d17-44ca-8fe3-5070a28e456f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:24.663816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292239b2-2d17-44ca-8fe3-5070a28e456f None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:24.664472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292239b2-2d17-44ca-8fe3-5070a28e456f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:24.665146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292239b2-2d17-44ca-8fe3-5070a28e456f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:24.666906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292239b2-2d17-44ca-8fe3-5070a28e456f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:24.673025 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 434/893] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:11:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:24.673880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292239b2-2d17-44ca-8fe3-5070a28e456f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:24.695432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb662a-a520-44b9-928f-94b0227eb808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:24.696073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb662a-a520-44b9-928f-94b0227eb808 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:24.696530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb662a-a520-44b9-928f-94b0227eb808 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:24.696640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb662a-a520-44b9-928f-94b0227eb808 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:24.697184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb662a-a520-44b9-928f-94b0227eb808 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:24.698596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb662a-a520-44b9-928f-94b0227eb808 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-b0fb662a-a520-44b9-928f-94b0227eb808 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:24.708589 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:24.709727 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:24.710588 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 460/894] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Aug 29 15:11:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:24.711416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb662a-a520-44b9-928f-94b0227eb808 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:24.717699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:24.801662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292239b2-2d17-44ca-8fe3-5070a28e456f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:24.804887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:24.834105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb662a-a520-44b9-928f-94b0227eb808 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:24.842939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7c47d-fbb1-4e37-b738-563df40bdd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:24.843580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7c47d-fbb1-4e37-b738-563df40bdd8b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:24.843858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7c47d-fbb1-4e37-b738-563df40bdd8b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:24.844130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7c47d-fbb1-4e37-b738-563df40bdd8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:24.851376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7c47d-fbb1-4e37-b738-563df40bdd8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:24.852837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7c47d-fbb1-4e37-b738-563df40bdd8b None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-2db7c47d-fbb1-4e37-b738-563df40bdd8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:24.865435 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:24.866436 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:24.867477 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:24.867477 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:24.867477 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:24.867477 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:24.867477 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:24.867477 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:24.867477 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:24.867477 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:24.867477 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 435/895] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:24.867477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7c47d-fbb1-4e37-b738-563df40bdd8b None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:24.881588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e4f6-610c-49a8-9c7f-23c19a0fa806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:24.882960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e4f6-610c-49a8-9c7f-23c19a0fa806 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:24.883407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e4f6-610c-49a8-9c7f-23c19a0fa806 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:24.883835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e4f6-610c-49a8-9c7f-23c19a0fa806 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:24.884725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309e4f6-610c-49a8-9c7f-23c19a0fa806 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:24.885176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309e4f6-610c-49a8-9c7f-23c19a0fa806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:24.886830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309e4f6-610c-49a8-9c7f-23c19a0fa806 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:24.892900 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 461/896] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:11:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:24.894171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e4f6-610c-49a8-9c7f-23c19a0fa806 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:24.976871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:24.987800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7c47d-fbb1-4e37-b738-563df40bdd8b None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:25.011619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e4f6-610c-49a8-9c7f-23c19a0fa806 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:25.028501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bf258-850e-4ded-a5d6-623b92756994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:25.029431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bf258-850e-4ded-a5d6-623b92756994 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:25.029431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bf258-850e-4ded-a5d6-623b92756994 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:25.030167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bf258-850e-4ded-a5d6-623b92756994 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:25.030770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bf258-850e-4ded-a5d6-623b92756994 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:25.031114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bf258-850e-4ded-a5d6-623b92756994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:25.032503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bf258-850e-4ded-a5d6-623b92756994 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:25.038185 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 436/897] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Aug 29 15:11:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:25.039201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bf258-850e-4ded-a5d6-623b92756994 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:25.058259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b929-2bae-4216-a23e-c8d50b84e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:25.058910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b929-2bae-4216-a23e-c8d50b84e69f None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:25.059194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b929-2bae-4216-a23e-c8d50b84e69f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:25.059471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b929-2bae-4216-a23e-c8d50b84e69f None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:25.060202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72b929-2bae-4216-a23e-c8d50b84e69f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:25.060513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72b929-2bae-4216-a23e-c8d50b84e69f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:25.062039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72b929-2bae-4216-a23e-c8d50b84e69f None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:25.075524 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 462/898] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:25.076434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b929-2bae-4216-a23e-c8d50b84e69f None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:25.082026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:25.162275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bf258-850e-4ded-a5d6-623b92756994 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:25.206302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b929-2bae-4216-a23e-c8d50b84e69f None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:25.216762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997553d1-a227-4cd6-b003-73e73ff0b31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:25.218370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997553d1-a227-4cd6-b003-73e73ff0b31f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:25.218931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997553d1-a227-4cd6-b003-73e73ff0b31f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:25.219388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997553d1-a227-4cd6-b003-73e73ff0b31f None admin] PATH_INFO: `/v3/endpoints` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:25.220578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997553d1-a227-4cd6-b003-73e73ff0b31f None admin] RBAC: Adding query filter params (interface=public, service_id=0e7b49be794143af8bdaaab5534b7322, region_id=RegionOne) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:25.221078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997553d1-a227-4cd6-b003-73e73ff0b31f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:25.223509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997553d1-a227-4cd6-b003-73e73ff0b31f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:25.237626 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 437/899] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Aug 29 15:11:25 2022] GET /identity/v3/endpoints?service_id=0e7b49be794143af8bdaaab5534b7322&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:25.237626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997553d1-a227-4cd6-b003-73e73ff0b31f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:25.272588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:25.276822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95a45d-6633-4352-b932-93d7cd8a3f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:25.277497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a45d-6633-4352-b932-93d7cd8a3f82 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:25.277779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a45d-6633-4352-b932-93d7cd8a3f82 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:25.278050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a45d-6633-4352-b932-93d7cd8a3f82 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:25.278709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95a45d-6633-4352-b932-93d7cd8a3f82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:25.279254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95a45d-6633-4352-b932-93d7cd8a3f82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:25.281540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95a45d-6633-4352-b932-93d7cd8a3f82 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:25.287895 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 463/900] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Aug 29 15:11:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:25.289364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95a45d-6633-4352-b932-93d7cd8a3f82 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:25.394663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997553d1-a227-4cd6-b003-73e73ff0b31f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:25.396156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:25.446299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95a45d-6633-4352-b932-93d7cd8a3f82 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:25.450609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730282a2-fa67-4348-9efc-181b428febbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:25.450827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730282a2-fa67-4348-9efc-181b428febbc None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:25.451107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730282a2-fa67-4348-9efc-181b428febbc None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:25.451566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730282a2-fa67-4348-9efc-181b428febbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:25.452468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730282a2-fa67-4348-9efc-181b428febbc None admin] RBAC: Adding query filter params (role.id=d41744ed4fd249de89a4caad1588843f, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=f70236f89ced4a209b0451062d3d39f5) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:25.452854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730282a2-fa67-4348-9efc-181b428febbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:25.454528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730282a2-fa67-4348-9efc-181b428febbc None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:25.461915 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 438/901] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:25 2022] GET /identity/v3/role_assignments?user.id=f70236f89ced4a209b0451062d3d39f5&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=d41744ed4fd249de89a4caad1588843f => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:25.496746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91506e62-f0d2-4ffd-a7da-43fb25eb0db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:25.497408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91506e62-f0d2-4ffd-a7da-43fb25eb0db4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:25.501518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91506e62-f0d2-4ffd-a7da-43fb25eb0db4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:25.501518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91506e62-f0d2-4ffd-a7da-43fb25eb0db4 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:25.501518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91506e62-f0d2-4ffd-a7da-43fb25eb0db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:25.501518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91506e62-f0d2-4ffd-a7da-43fb25eb0db4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:25.509180 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 464/902] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Aug 29 15:11:25 2022] GET /identity/v3/services => generated 1268 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:11:26.471251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb231c-25cc-4e29-870c-76b940a8d0f5 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:26.471822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb231c-25cc-4e29-870c-76b940a8d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:26.471822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb231c-25cc-4e29-870c-76b940a8d0f5 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:26.473354 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 439/903] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:26.478848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b651e5-fefe-4333-9c53-7c3d899d4b02 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:26.479308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b651e5-fefe-4333-9c53-7c3d899d4b02 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:26.479393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b651e5-fefe-4333-9c53-7c3d899d4b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:26.501293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-21b651e5-fefe-4333-9c53-7c3d899d4b02 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:26.501293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-21b651e5-fefe-4333-9c53-7c3d899d4b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:26.584079 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 465/904] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:26.851138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb231c-25cc-4e29-870c-76b940a8d0f5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:26.946457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:26.966451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb231c-25cc-4e29-870c-76b940a8d0f5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:27.003650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821f410-ad2d-4d3b-b10d-6466922e68df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:27.004279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821f410-ad2d-4d3b-b10d-6466922e68df None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:27.004554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821f410-ad2d-4d3b-b10d-6466922e68df None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:27.004818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821f410-ad2d-4d3b-b10d-6466922e68df None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:27.005419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821f410-ad2d-4d3b-b10d-6466922e68df None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:27.006876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821f410-ad2d-4d3b-b10d-6466922e68df None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-d821f410-ad2d-4d3b-b10d-6466922e68df None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:27.017214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:27.018285 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:27.019186 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 440/905] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Aug 29 15:11:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:27.024740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b651e5-fefe-4333-9c53-7c3d899d4b02 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:27.096150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:27.139815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b651e5-fefe-4333-9c53-7c3d899d4b02 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:27.187523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654b161-59a3-44ad-adcc-09b8b537502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:27.188554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654b161-59a3-44ad-adcc-09b8b537502c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:27.189036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654b161-59a3-44ad-adcc-09b8b537502c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:27.189572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654b161-59a3-44ad-adcc-09b8b537502c None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:27.190834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654b161-59a3-44ad-adcc-09b8b537502c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:27.191349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654b161-59a3-44ad-adcc-09b8b537502c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:27.193936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654b161-59a3-44ad-adcc-09b8b537502c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:27.203491 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 466/906] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Aug 29 15:11:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:27.208721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821f410-ad2d-4d3b-b10d-6466922e68df None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:27.320609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821f410-ad2d-4d3b-b10d-6466922e68df None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:27.361897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dd631-7e89-49e9-b598-31897fe7c3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:27.362902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dd631-7e89-49e9-b598-31897fe7c3d7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:27.363404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dd631-7e89-49e9-b598-31897fe7c3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:27.363876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dd631-7e89-49e9-b598-31897fe7c3d7 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:27.364709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dd631-7e89-49e9-b598-31897fe7c3d7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:27.365209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dd631-7e89-49e9-b598-31897fe7c3d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:27.366838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dd631-7e89-49e9-b598-31897fe7c3d7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:27.373052 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 441/907] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Aug 29 15:11:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:27.379785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654b161-59a3-44ad-adcc-09b8b537502c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:27.476773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c152dc-2e1b-47db-a53f-d296b8a40347 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:27.477927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c152dc-2e1b-47db-a53f-d296b8a40347 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:27.478454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c152dc-2e1b-47db-a53f-d296b8a40347 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:27.480334 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 442/908] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:27.486639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c177da-e779-4ada-bf40-66626d552ddc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:27.487233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c177da-e779-4ada-bf40-66626d552ddc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:27.487586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c177da-e779-4ada-bf40-66626d552ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:27.494162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654b161-59a3-44ad-adcc-09b8b537502c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:27.512077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-18c177da-e779-4ada-bf40-66626d552ddc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:27.513374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-18c177da-e779-4ada-bf40-66626d552ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:27.522756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:27.531441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:27.556838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ff68b-7eb2-4426-8803-555278933d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:27.557946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff68b-7eb2-4426-8803-555278933d3a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:27.558460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff68b-7eb2-4426-8803-555278933d3a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:27.558961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff68b-7eb2-4426-8803-555278933d3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:27.560011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ff68b-7eb2-4426-8803-555278933d3a None admin] RBAC: Adding query filter params (interface=public, service_id=2e4de5bc8f234085853e0361e6aa5e3c, region_id=RegionOne) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:27.560564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ff68b-7eb2-4426-8803-555278933d3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:27.562450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ff68b-7eb2-4426-8803-555278933d3a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:27.571745 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 467/909] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Aug 29 15:11:27 2022] GET /identity/v3/endpoints?service_id=2e4de5bc8f234085853e0361e6aa5e3c&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:27.574394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5168-9966-4b1d-abe3-b08ff54abee2 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:27.575081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5168-9966-4b1d-abe3-b08ff54abee2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:27.575774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5168-9966-4b1d-abe3-b08ff54abee2 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:27.579708 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 468/910] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:27.581629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed5168-9966-4b1d-abe3-b08ff54abee2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:27.599180 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 443/911] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:27.600874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58b84-2f8e-4130-a6a8-aefc810f8e76 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:27.601345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58b84-2f8e-4130-a6a8-aefc810f8e76 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:27.601670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58b84-2f8e-4130-a6a8-aefc810f8e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:27.621306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a0d58b84-2f8e-4130-a6a8-aefc810f8e76 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:27.622536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a0d58b84-2f8e-4130-a6a8-aefc810f8e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:27.708332 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 444/912] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:27.710819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8eb51-f7fa-4ff7-bce6-8f64a1db7538 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:27.711643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8eb51-f7fa-4ff7-bce6-8f64a1db7538 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:27.712408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8eb51-f7fa-4ff7-bce6-8f64a1db7538 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:27.715545 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 445/913] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:27.721519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e813477-a218-4f16-9b8b-876f834f0c23 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:27.722394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e813477-a218-4f16-9b8b-876f834f0c23 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:27.723164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e813477-a218-4f16-9b8b-876f834f0c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:27.729959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed5168-9966-4b1d-abe3-b08ff54abee2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:27.747111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7e813477-a218-4f16-9b8b-876f834f0c23 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:27.749011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7e813477-a218-4f16-9b8b-876f834f0c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:27.770509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee8733-5ea0-48f9-988c-341939a8671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:27.771133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee8733-5ea0-48f9-988c-341939a8671c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:27.771509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee8733-5ea0-48f9-988c-341939a8671c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:27.771856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee8733-5ea0-48f9-988c-341939a8671c None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:27.772474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee8733-5ea0-48f9-988c-341939a8671c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:27.773917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee8733-5ea0-48f9-988c-341939a8671c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:27.781999 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 469/914] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Aug 29 15:11:27 2022] GET /identity/v3/services => generated 1268 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:11:27.845937 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 446/915] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:27.917318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee8733-5ea0-48f9-988c-341939a8671c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:27.993034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:27.993656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e813477-a218-4f16-9b8b-876f834f0c23 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:27.997311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:28.052210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee8733-5ea0-48f9-988c-341939a8671c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:28.106808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676026b2-9469-44fd-a433-9eacb7eca183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:28.108154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676026b2-9469-44fd-a433-9eacb7eca183 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:28.108599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676026b2-9469-44fd-a433-9eacb7eca183 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:28.109683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676026b2-9469-44fd-a433-9eacb7eca183 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:28.110433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676026b2-9469-44fd-a433-9eacb7eca183 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:28.114126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676026b2-9469-44fd-a433-9eacb7eca183 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:28.140421 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 470/916] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:11:27 2022] POST /identity/v3/services => generated 241 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:11:28.146586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e813477-a218-4f16-9b8b-876f834f0c23 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:28.203923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d89db-5fd6-4467-9555-3f45e69b8cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:28.205040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d89db-5fd6-4467-9555-3f45e69b8cf9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:28.205553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d89db-5fd6-4467-9555-3f45e69b8cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:28.206027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d89db-5fd6-4467-9555-3f45e69b8cf9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:28.211410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676026b2-9469-44fd-a433-9eacb7eca183 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:28.220315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d89db-5fd6-4467-9555-3f45e69b8cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-695d89db-5fd6-4467-9555-3f45e69b8cf9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:28.226103 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:28.227119 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:28.227981 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:28.231087 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 447/917] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Aug 29 15:11:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:28.238019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d89db-5fd6-4467-9555-3f45e69b8cf9 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:28.335236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:28.397753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d89db-5fd6-4467-9555-3f45e69b8cf9 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:28.403240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676026b2-9469-44fd-a433-9eacb7eca183 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:28.439157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:28.441212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d97df1-c696-4dc2-be52-bffbd5451491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:28.442305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97df1-c696-4dc2-be52-bffbd5451491 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:28.442891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97df1-c696-4dc2-be52-bffbd5451491 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:28.443472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97df1-c696-4dc2-be52-bffbd5451491 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:28.444426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d97df1-c696-4dc2-be52-bffbd5451491 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:28.445177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d97df1-c696-4dc2-be52-bffbd5451491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:28.447813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d97df1-c696-4dc2-be52-bffbd5451491 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:28.461212 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 448/918] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Aug 29 15:11:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:28.466596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d97df1-c696-4dc2-be52-bffbd5451491 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:28.487002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fa463-8c1d-4316-a39e-d19e3ece2dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:28.488355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa463-8c1d-4316-a39e-d19e3ece2dad None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:28.488789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa463-8c1d-4316-a39e-d19e3ece2dad None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:28.489347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa463-8c1d-4316-a39e-d19e3ece2dad None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:28.491187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fa463-8c1d-4316-a39e-d19e3ece2dad None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:28.494639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fa463-8c1d-4316-a39e-d19e3ece2dad None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-fd5fa463-8c1d-4316-a39e-d19e3ece2dad None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:28.516519 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:28.517643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 15:11:28.518568 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:28.521474 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 471/919] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:11:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:28.530209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fa463-8c1d-4316-a39e-d19e3ece2dad None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:28.627543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d97df1-c696-4dc2-be52-bffbd5451491 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:28.656571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:28.678481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27af4e-6783-46eb-aff1-59bc94d54833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:28.679434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27af4e-6783-46eb-aff1-59bc94d54833 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:28.679894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27af4e-6783-46eb-aff1-59bc94d54833 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:28.680175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27af4e-6783-46eb-aff1-59bc94d54833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:28.692523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27af4e-6783-46eb-aff1-59bc94d54833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:28.694030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27af4e-6783-46eb-aff1-59bc94d54833 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:28.704006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fa463-8c1d-4316-a39e-d19e3ece2dad None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-9b27af4e-6783-46eb-aff1-59bc94d54833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:28.708773 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:28.710319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:28.716161 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:28.716161 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:28.716161 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:28.716161 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 449/920] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:28.719529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27af4e-6783-46eb-aff1-59bc94d54833 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:28.751096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae5a39-e623-484f-b1ea-a9d5c8d9b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:28.751733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5a39-e623-484f-b1ea-a9d5c8d9b523 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:28.752011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5a39-e623-484f-b1ea-a9d5c8d9b523 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:28.752284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5a39-e623-484f-b1ea-a9d5c8d9b523 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:28.752933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae5a39-e623-484f-b1ea-a9d5c8d9b523 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:28.753238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae5a39-e623-484f-b1ea-a9d5c8d9b523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:28.755678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae5a39-e623-484f-b1ea-a9d5c8d9b523 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:28.761580 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 472/921] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:11:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:28.767592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae5a39-e623-484f-b1ea-a9d5c8d9b523 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:28.847125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:28.869685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27af4e-6783-46eb-aff1-59bc94d54833 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:28.917549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7db0a5-9397-49af-8875-0324fabf5b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:28.918522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db0a5-9397-49af-8875-0324fabf5b2d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:28.919008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db0a5-9397-49af-8875-0324fabf5b2d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:28.919500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7db0a5-9397-49af-8875-0324fabf5b2d None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:28.920927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7db0a5-9397-49af-8875-0324fabf5b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:28.921548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7db0a5-9397-49af-8875-0324fabf5b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:28.923297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7db0a5-9397-49af-8875-0324fabf5b2d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:28.942172 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 450/922] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:28.947259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7db0a5-9397-49af-8875-0324fabf5b2d None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:28.955597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae5a39-e623-484f-b1ea-a9d5c8d9b523 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:28.989948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:28.994270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e6b92-471c-4879-a7f3-55fcbbda6ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:28.994888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e6b92-471c-4879-a7f3-55fcbbda6ee1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:28.995163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e6b92-471c-4879-a7f3-55fcbbda6ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:28.995435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e6b92-471c-4879-a7f3-55fcbbda6ee1 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:28.996968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e6b92-471c-4879-a7f3-55fcbbda6ee1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:28.997093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e6b92-471c-4879-a7f3-55fcbbda6ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:28.999064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e6b92-471c-4879-a7f3-55fcbbda6ee1 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:29.009417 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 473/923] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Aug 29 15:11:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:29.011974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e6b92-471c-4879-a7f3-55fcbbda6ee1 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:29.089093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7db0a5-9397-49af-8875-0324fabf5b2d None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:29.134748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e6b92-471c-4879-a7f3-55fcbbda6ee1 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:29.142976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab2d84-9d0d-4670-8278-ec41ebc13977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:29.144381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab2d84-9d0d-4670-8278-ec41ebc13977 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:29.145251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:29.145873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab2d84-9d0d-4670-8278-ec41ebc13977 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:29.146547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab2d84-9d0d-4670-8278-ec41ebc13977 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:29.161889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab2d84-9d0d-4670-8278-ec41ebc13977 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:29.164377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab2d84-9d0d-4670-8278-ec41ebc13977 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:29.179117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c2f31-37d5-47f9-99b4-0b8cf93c4df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:29.179650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2f31-37d5-47f9-99b4-0b8cf93c4df9 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:29.180009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2f31-37d5-47f9-99b4-0b8cf93c4df9 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:29.180291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2f31-37d5-47f9-99b4-0b8cf93c4df9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:29.181059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c2f31-37d5-47f9-99b4-0b8cf93c4df9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:29.182507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c2f31-37d5-47f9-99b4-0b8cf93c4df9 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-4aab2d84-9d0d-4670-8278-ec41ebc13977 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:29.183754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:29.184724 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:29.185716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:29.185716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:29.185716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:29.185716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:29.185716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:29.185716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:29.185716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:29.185716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:29.185716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:29.185716 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:29.191601 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 451/924] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Aug 29 15:11:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:29.194246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab2d84-9d0d-4670-8278-ec41ebc13977 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:29.221798 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 474/925] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:11:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:11:29.313205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:29.325665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab2d84-9d0d-4670-8278-ec41ebc13977 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:29.379715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013bfde-4b44-43d6-838e-153f0bc65349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:29.380314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013bfde-4b44-43d6-838e-153f0bc65349 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:29.380589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013bfde-4b44-43d6-838e-153f0bc65349 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:29.380884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013bfde-4b44-43d6-838e-153f0bc65349 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:29.381638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013bfde-4b44-43d6-838e-153f0bc65349 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:29.381930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013bfde-4b44-43d6-838e-153f0bc65349 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:29.383353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013bfde-4b44-43d6-838e-153f0bc65349 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:29.405956 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 452/926] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Aug 29 15:11:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:29.411521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c2f31-37d5-47f9-99b4-0b8cf93c4df9 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:29.557655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c2f31-37d5-47f9-99b4-0b8cf93c4df9 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:29.596068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220dee0-18a7-4bf8-b762-4a98e7ee52fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:29.596707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220dee0-18a7-4bf8-b762-4a98e7ee52fd None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:29.596983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220dee0-18a7-4bf8-b762-4a98e7ee52fd None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:29.597255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220dee0-18a7-4bf8-b762-4a98e7ee52fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:29.608840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220dee0-18a7-4bf8-b762-4a98e7ee52fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:29.610332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220dee0-18a7-4bf8-b762-4a98e7ee52fd None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-4220dee0-18a7-4bf8-b762-4a98e7ee52fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:29.626165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:29.627195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:29.628301 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:29.628301 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:29.628301 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:29.628301 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 475/927] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:29.634950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013bfde-4b44-43d6-838e-153f0bc65349 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:29.744368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013bfde-4b44-43d6-838e-153f0bc65349 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:29.781430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9061b2-eaf7-489a-9003-f459adf18992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:29.782160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9061b2-eaf7-489a-9003-f459adf18992 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:29.782443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9061b2-eaf7-489a-9003-f459adf18992 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:29.782721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9061b2-eaf7-489a-9003-f459adf18992 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:29.783371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9061b2-eaf7-489a-9003-f459adf18992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:29.783668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9061b2-eaf7-489a-9003-f459adf18992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:29.785041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9061b2-eaf7-489a-9003-f459adf18992 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:29.804473 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 453/928] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:29.806468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220dee0-18a7-4bf8-b762-4a98e7ee52fd None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:29.827437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:29.923016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220dee0-18a7-4bf8-b762-4a98e7ee52fd None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:29.959584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5fc14-6828-4f35-977f-d64fe39c3467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:29.960252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5fc14-6828-4f35-977f-d64fe39c3467 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:29.960501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5fc14-6828-4f35-977f-d64fe39c3467 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:29.960775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5fc14-6828-4f35-977f-d64fe39c3467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:29.968625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5fc14-6828-4f35-977f-d64fe39c3467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:29.970115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5fc14-6828-4f35-977f-d64fe39c3467 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:29.979636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d208a5-b993-4ef8-ad64-8f606fa42aa6 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:29.979939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d208a5-b993-4ef8-ad64-8f606fa42aa6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:29.980217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d208a5-b993-4ef8-ad64-8f606fa42aa6 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:29.981806 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 454/929] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-fcd5fc14-6828-4f35-977f-d64fe39c3467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:29.982164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:29.983855 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:29.985139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:29.985139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:29.985139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:29.985139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:29.985139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:29.985139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:29.985139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:29.985139 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:29.985139 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 476/930] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:29.987489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c344-c2b1-47f8-9206-b51583d186b2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:29.987773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c344-c2b1-47f8-9206-b51583d186b2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:29.988043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c344-c2b1-47f8-9206-b51583d186b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:29.994420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5fc14-6828-4f35-977f-d64fe39c3467 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:30.001187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:30.007991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-be25c344-c2b1-47f8-9206-b51583d186b2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:30.009297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-be25c344-c2b1-47f8-9206-b51583d186b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:30.097832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:30.103821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5fc14-6828-4f35-977f-d64fe39c3467 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:30.109773 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 455/931] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:30.141626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97b3f1-0147-4053-ba0e-852b35c2ba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:30.142542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97b3f1-0147-4053-ba0e-852b35c2ba5b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:30.142972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97b3f1-0147-4053-ba0e-852b35c2ba5b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:30.143431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97b3f1-0147-4053-ba0e-852b35c2ba5b None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:30.144293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97b3f1-0147-4053-ba0e-852b35c2ba5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:30.144747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97b3f1-0147-4053-ba0e-852b35c2ba5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:30.146392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97b3f1-0147-4053-ba0e-852b35c2ba5b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:30.164958 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 477/932] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:30.166579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25c344-c2b1-47f8-9206-b51583d186b2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:30.278103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25c344-c2b1-47f8-9206-b51583d186b2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:30.316932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe8d5a-acb1-4a9e-a091-053ec35c7da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:30.317876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe8d5a-acb1-4a9e-a091-053ec35c7da7 None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:30.318304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe8d5a-acb1-4a9e-a091-053ec35c7da7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:30.318751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe8d5a-acb1-4a9e-a091-053ec35c7da7 None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/f70236f89ced4a209b0451062d3d39f5/roles/d41744ed4fd249de89a4caad1588843f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:30.321112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe8d5a-acb1-4a9e-a091-053ec35c7da7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=f70236f89ced4a209b0451062d3d39f5, role_id=d41744ed4fd249de89a4caad1588843f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:30.322837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe8d5a-acb1-4a9e-a091-053ec35c7da7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:30.326547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:30.353741 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 456/933] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:11:30 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/f70236f89ced4a209b0451062d3d39f5/roles/d41744ed4fd249de89a4caad1588843f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:11:30.362875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35d60b-755a-4cda-b3e0-fc66df55dbb5 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:30.363529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35d60b-755a-4cda-b3e0-fc66df55dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:30.364017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35d60b-755a-4cda-b3e0-fc66df55dbb5 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:30.366084 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 478/934] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:30.371418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ae235-5738-45c9-a1e9-c8a8fe891983 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:30.371703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ae235-5738-45c9-a1e9-c8a8fe891983 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:30.371967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ae235-5738-45c9-a1e9-c8a8fe891983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:30.388231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35d60b-755a-4cda-b3e0-fc66df55dbb5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:30.395220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b05ae235-5738-45c9-a1e9-c8a8fe891983 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:30.396450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b05ae235-5738-45c9-a1e9-c8a8fe891983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:30.493531 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 457/935] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:30.593844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35d60b-755a-4cda-b3e0-fc66df55dbb5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:30.642294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48d0bc-0ab9-4aa1-abdd-e27c8f2c3ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:30.643186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48d0bc-0ab9-4aa1-abdd-e27c8f2c3ed2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:30.643609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48d0bc-0ab9-4aa1-abdd-e27c8f2c3ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:30.644056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48d0bc-0ab9-4aa1-abdd-e27c8f2c3ed2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:30.644800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48d0bc-0ab9-4aa1-abdd-e27c8f2c3ed2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:30.646375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48d0bc-0ab9-4aa1-abdd-e27c8f2c3ed2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:30.648865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-6b48d0bc-0ab9-4aa1-abdd-e27c8f2c3ed2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:30.657862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:30.659652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:30.662093 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 479/936] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Aug 29 15:11:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:30.671030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ae235-5738-45c9-a1e9-c8a8fe891983 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:30.778775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ae235-5738-45c9-a1e9-c8a8fe891983 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:30.789455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48d0bc-0ab9-4aa1-abdd-e27c8f2c3ed2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:30.811997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:30.824315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c09b3-64f7-485f-9d65-beffa948d3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:30.824938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c09b3-64f7-485f-9d65-beffa948d3b1 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:30.825215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c09b3-64f7-485f-9d65-beffa948d3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:30.825513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c09b3-64f7-485f-9d65-beffa948d3b1 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:30.826153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c09b3-64f7-485f-9d65-beffa948d3b1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:30.826476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c09b3-64f7-485f-9d65-beffa948d3b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:30.828918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c09b3-64f7-485f-9d65-beffa948d3b1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:30.841003 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 458/937] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Aug 29 15:11:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:30.842977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c09b3-64f7-485f-9d65-beffa948d3b1 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:30.926544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48d0bc-0ab9-4aa1-abdd-e27c8f2c3ed2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:30.950927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c09b3-64f7-485f-9d65-beffa948d3b1 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:30.965817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825545ef-5ff9-4152-bc3b-994f16a05781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:30.966514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825545ef-5ff9-4152-bc3b-994f16a05781 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:30.966795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825545ef-5ff9-4152-bc3b-994f16a05781 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:30.967064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825545ef-5ff9-4152-bc3b-994f16a05781 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:30.968344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825545ef-5ff9-4152-bc3b-994f16a05781 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:30.969857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825545ef-5ff9-4152-bc3b-994f16a05781 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-825545ef-5ff9-4152-bc3b-994f16a05781 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:30.981638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:30.982835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:30.983725 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:30.987950 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 480/938] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Aug 29 15:11:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:30.989418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825545ef-5ff9-4152-bc3b-994f16a05781 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:30.995138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d40f76-06a7-47fc-b119-c578495fdc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:30.996070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d40f76-06a7-47fc-b119-c578495fdc89 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:30.996542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d40f76-06a7-47fc-b119-c578495fdc89 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:30.997015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d40f76-06a7-47fc-b119-c578495fdc89 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:30.997866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d40f76-06a7-47fc-b119-c578495fdc89 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:30.998884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d40f76-06a7-47fc-b119-c578495fdc89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:31.000458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d40f76-06a7-47fc-b119-c578495fdc89 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:31.011125 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 459/939] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Aug 29 15:11:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:31.012328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d40f76-06a7-47fc-b119-c578495fdc89 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:31.059883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:31.073236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:31.108518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825545ef-5ff9-4152-bc3b-994f16a05781 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:31.121197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d40f76-06a7-47fc-b119-c578495fdc89 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:31.147720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e97e5-37be-44b1-9884-a8557f9905cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:31.148623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e97e5-37be-44b1-9884-a8557f9905cc None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:31.149044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e97e5-37be-44b1-9884-a8557f9905cc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:31.149481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e97e5-37be-44b1-9884-a8557f9905cc None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:31.150358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e97e5-37be-44b1-9884-a8557f9905cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:31.150878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e97e5-37be-44b1-9884-a8557f9905cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:31.152524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e97e5-37be-44b1-9884-a8557f9905cc None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:31.164570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d62f10-d3b3-4d84-986e-8e768b49d226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:31.164570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62f10-d3b3-4d84-986e-8e768b49d226 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:31.164570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62f10-d3b3-4d84-986e-8e768b49d226 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:31.164570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62f10-d3b3-4d84-986e-8e768b49d226 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:31.165026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d62f10-d3b3-4d84-986e-8e768b49d226 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:31.165026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d62f10-d3b3-4d84-986e-8e768b49d226 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:31.165636 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 481/940] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Aug 29 15:11:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:31.167249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e97e5-37be-44b1-9884-a8557f9905cc None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:31.196453 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 460/941] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:11:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:11:31.292677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e97e5-37be-44b1-9884-a8557f9905cc None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:31.324299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:31.342760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291f96f-a5c2-4551-9d89-b60224710af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:31.343366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291f96f-a5c2-4551-9d89-b60224710af9 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:31.343574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daea2b1-07e1-4e4d-b871-70701eecbbcc None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:31.343697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291f96f-a5c2-4551-9d89-b60224710af9 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:31.343926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291f96f-a5c2-4551-9d89-b60224710af9 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:31.344129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daea2b1-07e1-4e4d-b871-70701eecbbcc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:31.344499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daea2b1-07e1-4e4d-b871-70701eecbbcc None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:31.344589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291f96f-a5c2-4551-9d89-b60224710af9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:31.344832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291f96f-a5c2-4551-9d89-b60224710af9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:31.346275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291f96f-a5c2-4551-9d89-b60224710af9 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:31.346461 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 461/942] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:31.351928 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 482/943] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Aug 29 15:11:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:31.354407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796af1f-9c46-4b6d-aa4c-d5d34db844ce None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:31.354759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796af1f-9c46-4b6d-aa4c-d5d34db844ce None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:31.355107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796af1f-9c46-4b6d-aa4c-d5d34db844ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:31.358251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291f96f-a5c2-4551-9d89-b60224710af9 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:31.380037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f796af1f-9c46-4b6d-aa4c-d5d34db844ce None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:31.381359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f796af1f-9c46-4b6d-aa4c-d5d34db844ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:31.466707 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 462/944] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:31.482541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291f96f-a5c2-4551-9d89-b60224710af9 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:31.519729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf12a1-0625-4191-9b8a-9ee5bff25847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:31.520486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf12a1-0625-4191-9b8a-9ee5bff25847 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:31.520829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf12a1-0625-4191-9b8a-9ee5bff25847 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:31.521161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf12a1-0625-4191-9b8a-9ee5bff25847 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:31.521991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf12a1-0625-4191-9b8a-9ee5bff25847 None admin] RBAC: Adding query filter params (interface=public, service_id=b0e438b607a64cadbb007ea56eb40243, region_id=RegionOne) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:31.522361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf12a1-0625-4191-9b8a-9ee5bff25847 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:31.523771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf12a1-0625-4191-9b8a-9ee5bff25847 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:31.529801 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 483/945] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Aug 29 15:11:31 2022] GET /identity/v3/endpoints?service_id=b0e438b607a64cadbb007ea56eb40243&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:31.539651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796af1f-9c46-4b6d-aa4c-d5d34db844ce None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:31.589739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:31.647233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796af1f-9c46-4b6d-aa4c-d5d34db844ce None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:31.683768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01e252-7721-43fe-bcf7-b24bf9ea12db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:31.684389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01e252-7721-43fe-bcf7-b24bf9ea12db None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:31.684645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01e252-7721-43fe-bcf7-b24bf9ea12db None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:31.684904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01e252-7721-43fe-bcf7-b24bf9ea12db None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:31.685554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01e252-7721-43fe-bcf7-b24bf9ea12db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:31.687488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01e252-7721-43fe-bcf7-b24bf9ea12db None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:31.694502 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 463/946] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Aug 29 15:11:31 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:11:31.756017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf12a1-0625-4191-9b8a-9ee5bff25847 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:31.820954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:31.884044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf12a1-0625-4191-9b8a-9ee5bff25847 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:31.928378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34a1b-7006-4276-aa44-a7a31774daba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:31.929001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34a1b-7006-4276-aa44-a7a31774daba None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:31.929283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34a1b-7006-4276-aa44-a7a31774daba None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:31.929603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34a1b-7006-4276-aa44-a7a31774daba None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:31.930400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da34a1b-7006-4276-aa44-a7a31774daba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:31.931942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da34a1b-7006-4276-aa44-a7a31774daba None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:31.934681 n-d-854882-3 devstack@keystone.service[89680]: WARNING keystone.server.flask.common [None req-1da34a1b-7006-4276-aa44-a7a31774daba None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 15:11:31.965416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.sql.core [None req-1da34a1b-7006-4276-aa44-a7a31774daba None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 15:11:31.965416 n-d-854882-3 devstack@keystone.service[89680]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 15:11:31.965416 n-d-854882-3 devstack@keystone.service[89680]: [parameters: {'id': 'efa7d9852b914c9cb086adebd125b680', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 15:11:31.965416 n-d-854882-3 devstack@keystone.service[89680]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89680) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-1da34a1b-7006-4276-aa44-a7a31774daba None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id efa7d9852b914c9cb086adebd125b680.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id efa7d9852b914c9cb086adebd125b680. Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:11:31.989421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result.read() Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 15:11:31.990345 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application yield resource Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise self.value Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application session.commit() Aug 29 15:11:31.991323 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.session.flush() Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application compat.raise_( Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:11:31.992731 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 15:11:31.993696 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result.read() Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:11:31.994521 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [parameters: {'id': 'efa7d9852b914c9cb086adebd125b680', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:31.995417 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:31.997526 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:31.999932 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:31.999932 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 15:11:31.999932 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 15:11:31.999932 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:31.999932 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:31.999932 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 15:11:31.999932 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 15:11:31.999932 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id efa7d9852b914c9cb086adebd125b680. Aug 29 15:11:31.999932 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:31.999932 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 484/947] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Aug 29 15:11:31 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:32.006271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01e252-7721-43fe-bcf7-b24bf9ea12db None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:32.108830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01e252-7721-43fe-bcf7-b24bf9ea12db None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:32.111339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:32.148035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382e1ef-87dd-475c-b41c-623f51fb0d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:32.148695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382e1ef-87dd-475c-b41c-623f51fb0d1d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:32.148978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382e1ef-87dd-475c-b41c-623f51fb0d1d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:32.149254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382e1ef-87dd-475c-b41c-623f51fb0d1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:32.157788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382e1ef-87dd-475c-b41c-623f51fb0d1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:32.159305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382e1ef-87dd-475c-b41c-623f51fb0d1d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-3382e1ef-87dd-475c-b41c-623f51fb0d1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:32.172702 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:32.173748 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:32.174672 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:32.174672 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:32.174672 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:32.174672 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:32.174672 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:32.174672 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:32.174672 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:32.174672 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:32.177548 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 464/948] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:32.180935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34a1b-7006-4276-aa44-a7a31774daba None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:32.306754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34a1b-7006-4276-aa44-a7a31774daba None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:32.318123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:32.346894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9f20a-e6c7-46c5-b4a8-aea161e203e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:32.347521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f20a-e6c7-46c5-b4a8-aea161e203e1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:32.347800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f20a-e6c7-46c5-b4a8-aea161e203e1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:32.348076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f20a-e6c7-46c5-b4a8-aea161e203e1 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:32.348749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9f20a-e6c7-46c5-b4a8-aea161e203e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:32.349054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9f20a-e6c7-46c5-b4a8-aea161e203e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:32.350800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9f20a-e6c7-46c5-b4a8-aea161e203e1 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:32.379388 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 485/949] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:32.892526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d97e6-2141-4834-aaa6-6f2efeb6d92f None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:32.893592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d97e6-2141-4834-aaa6-6f2efeb6d92f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:32.894089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d97e6-2141-4834-aaa6-6f2efeb6d92f None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:32.895934 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 465/950] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:32.901708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c8803-2a05-49ac-bf22-a4b4c6dfba17 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:32.902604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c8803-2a05-49ac-bf22-a4b4c6dfba17 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:32.903098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c8803-2a05-49ac-bf22-a4b4c6dfba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:32.923059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-348c8803-2a05-49ac-bf22-a4b4c6dfba17 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:32.924918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-348c8803-2a05-49ac-bf22-a4b4c6dfba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:32.995710 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 486/951] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:33.267781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d97e6-2141-4834-aaa6-6f2efeb6d92f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:33.402590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d97e6-2141-4834-aaa6-6f2efeb6d92f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:33.443800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8b3d-3b46-4bb2-90b9-8dffe801a7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:33.444457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8b3d-3b46-4bb2-90b9-8dffe801a7c8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:33.444741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8b3d-3b46-4bb2-90b9-8dffe801a7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:33.445017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8b3d-3b46-4bb2-90b9-8dffe801a7c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:33.457281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd8b3d-3b46-4bb2-90b9-8dffe801a7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-1afd8b3d-3b46-4bb2-90b9-8dffe801a7c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:33.462395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:33.463538 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:33.464460 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 466/952] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Aug 29 15:11:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:33.470755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c8803-2a05-49ac-bf22-a4b4c6dfba17 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:33.582242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:33.587980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c8803-2a05-49ac-bf22-a4b4c6dfba17 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:33.627574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876666c-26a0-4080-9049-3b0d5a68e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:33.628216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876666c-26a0-4080-9049-3b0d5a68e84f None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:33.628497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876666c-26a0-4080-9049-3b0d5a68e84f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:33.628773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876666c-26a0-4080-9049-3b0d5a68e84f None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:33.629535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876666c-26a0-4080-9049-3b0d5a68e84f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:33.629845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876666c-26a0-4080-9049-3b0d5a68e84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:33.631292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876666c-26a0-4080-9049-3b0d5a68e84f None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:33.645537 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 487/953] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Aug 29 15:11:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:33.647352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8b3d-3b46-4bb2-90b9-8dffe801a7c8 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:33.681966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:33.726946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c611-3661-4c62-81d4-78f39d0efeca None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:33.727586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c611-3661-4c62-81d4-78f39d0efeca None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:33.728105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c611-3661-4c62-81d4-78f39d0efeca None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:33.729992 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 488/954] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:33.735960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca8e3-66f4-4b79-85a3-4a22736b7b80 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:33.736530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca8e3-66f4-4b79-85a3-4a22736b7b80 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:33.737008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca8e3-66f4-4b79-85a3-4a22736b7b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:33.755741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-69aca8e3-66f4-4b79-85a3-4a22736b7b80 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:33.757282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-69aca8e3-66f4-4b79-85a3-4a22736b7b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:33.767240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8b3d-3b46-4bb2-90b9-8dffe801a7c8 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:33.814877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68f84-16df-4ca1-b53c-ac034efd8c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:33.815911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68f84-16df-4ca1-b53c-ac034efd8c9f None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:33.816621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68f84-16df-4ca1-b53c-ac034efd8c9f None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:33.817161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68f84-16df-4ca1-b53c-ac034efd8c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:33.829060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e68f84-16df-4ca1-b53c-ac034efd8c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:33.830920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e68f84-16df-4ca1-b53c-ac034efd8c9f None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:33.845421 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 489/955] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-51e68f84-16df-4ca1-b53c-ac034efd8c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:33.848925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:33.849957 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:33.850909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:33.850909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:33.850909 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:33.854913 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 467/956] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:33.856326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aca8e3-66f4-4b79-85a3-4a22736b7b80 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:33.962981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aca8e3-66f4-4b79-85a3-4a22736b7b80 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:33.967716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:34.003509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69431c0-9a37-4b39-9e83-cec7286ee782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:34.004244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69431c0-9a37-4b39-9e83-cec7286ee782 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:34.004553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69431c0-9a37-4b39-9e83-cec7286ee782 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:34.004831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69431c0-9a37-4b39-9e83-cec7286ee782 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:34.005535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69431c0-9a37-4b39-9e83-cec7286ee782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:34.005845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69431c0-9a37-4b39-9e83-cec7286ee782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:34.007271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69431c0-9a37-4b39-9e83-cec7286ee782 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:34.025676 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 490/957] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:34.027377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68f84-16df-4ca1-b53c-ac034efd8c9f None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:34.112105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:34.130252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69431c0-9a37-4b39-9e83-cec7286ee782 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:34.140028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68f84-16df-4ca1-b53c-ac034efd8c9f None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:34.182999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dbaff-4b54-49d2-b9a1-13dc94f13efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:34.183645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dbaff-4b54-49d2-b9a1-13dc94f13efd None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:34.183921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dbaff-4b54-49d2-b9a1-13dc94f13efd None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:34.184190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dbaff-4b54-49d2-b9a1-13dc94f13efd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:34.195398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dbaff-4b54-49d2-b9a1-13dc94f13efd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:34.197077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dbaff-4b54-49d2-b9a1-13dc94f13efd None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-b13dbaff-4b54-49d2-b9a1-13dc94f13efd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:34.213485 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:34.214532 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:34.215518 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:34.215518 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:34.215518 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:34.215518 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:34.215518 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:34.215518 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:34.215518 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:34.215518 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:34.215518 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 15:11:34.215518 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:34.217470 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 468/958] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Aug 29 15:11:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:34.221685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dbaff-4b54-49d2-b9a1-13dc94f13efd None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:34.277477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69431c0-9a37-4b39-9e83-cec7286ee782 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:34.319623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e61fad-c385-47d1-987f-896676347f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:34.320406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61fad-c385-47d1-987f-896676347f5e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:34.320687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61fad-c385-47d1-987f-896676347f5e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:34.320960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61fad-c385-47d1-987f-896676347f5e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:34.321587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e61fad-c385-47d1-987f-896676347f5e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:34.323021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e61fad-c385-47d1-987f-896676347f5e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-68e61fad-c385-47d1-987f-896676347f5e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:34.333096 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:34.334603 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:34.335643 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 491/959] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Aug 29 15:11:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:34.336501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee193304-24b6-4d10-856a-9ef9c930c7eb None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:34.336501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee193304-24b6-4d10-856a-9ef9c930c7eb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:34.336501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee193304-24b6-4d10-856a-9ef9c930c7eb None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:34.337793 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 492/960] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:34.342789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8495ad-c9f0-4b47-8aff-c2ec44353cc9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:34.343279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8495ad-c9f0-4b47-8aff-c2ec44353cc9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:34.343564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8495ad-c9f0-4b47-8aff-c2ec44353cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:34.349572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dbaff-4b54-49d2-b9a1-13dc94f13efd None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:34.364779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9c8495ad-c9f0-4b47-8aff-c2ec44353cc9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:34.366402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9c8495ad-c9f0-4b47-8aff-c2ec44353cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:34.375419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:34.393245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0b9f7-a596-475d-8013-12c06a8218d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:34.393892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0b9f7-a596-475d-8013-12c06a8218d7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:34.394169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0b9f7-a596-475d-8013-12c06a8218d7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:34.394442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0b9f7-a596-475d-8013-12c06a8218d7 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:34.395179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0b9f7-a596-475d-8013-12c06a8218d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:34.395481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0b9f7-a596-475d-8013-12c06a8218d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:34.396910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0b9f7-a596-475d-8013-12c06a8218d7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:34.399939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:34.416548 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 469/961] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Aug 29 15:11:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:34.417581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0b9f7-a596-475d-8013-12c06a8218d7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:34.455785 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 493/962] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:34.457023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8495ad-c9f0-4b47-8aff-c2ec44353cc9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:34.568447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0b9f7-a596-475d-8013-12c06a8218d7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:34.586759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8495ad-c9f0-4b47-8aff-c2ec44353cc9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:34.614873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7998f-ac8a-4aee-bed8-4c14d0c44bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:34.615394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7998f-ac8a-4aee-bed8-4c14d0c44bff None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:34.615668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7998f-ac8a-4aee-bed8-4c14d0c44bff None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:34.616399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7998f-ac8a-4aee-bed8-4c14d0c44bff None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:34.617064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7998f-ac8a-4aee-bed8-4c14d0c44bff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:34.617347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7998f-ac8a-4aee-bed8-4c14d0c44bff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:34.618761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7998f-ac8a-4aee-bed8-4c14d0c44bff None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:34.629209 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 470/963] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Aug 29 15:11:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:34.630423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67eb9-372a-43ff-96d3-b62de3fdca76 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:34.630707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67eb9-372a-43ff-96d3-b62de3fdca76 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:34.630981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67eb9-372a-43ff-96d3-b62de3fdca76 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:34.632402 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 471/964] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:34.632967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc67eb9-372a-43ff-96d3-b62de3fdca76 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:34.641188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d25a-3db7-46fc-9c36-1007ad30cc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:34.641889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d25a-3db7-46fc-9c36-1007ad30cc1d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:34.642179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d25a-3db7-46fc-9c36-1007ad30cc1d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:34.642879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d25a-3db7-46fc-9c36-1007ad30cc1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:34.656736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:34.702663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:34.721033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4d25a-3db7-46fc-9c36-1007ad30cc1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:34.723124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4d25a-3db7-46fc-9c36-1007ad30cc1d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:34.750911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc67eb9-372a-43ff-96d3-b62de3fdca76 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:34.789274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54da6bc-921e-47b2-ae36-12e90a9e2f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:34.789898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54da6bc-921e-47b2-ae36-12e90a9e2f64 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:34.790172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54da6bc-921e-47b2-ae36-12e90a9e2f64 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:34.790440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54da6bc-921e-47b2-ae36-12e90a9e2f64 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:34.791067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54da6bc-921e-47b2-ae36-12e90a9e2f64 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:34.791369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54da6bc-921e-47b2-ae36-12e90a9e2f64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:34.792714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54da6bc-921e-47b2-ae36-12e90a9e2f64 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:34.798534 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 472/965] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Aug 29 15:11:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:34.799565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ddcec-036c-48da-b541-33ed19a976dd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:34.799896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ddcec-036c-48da-b541-33ed19a976dd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:34.800160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ddcec-036c-48da-b541-33ed19a976dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:34.818645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-478ddcec-036c-48da-b541-33ed19a976dd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:34.819853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-478ddcec-036c-48da-b541-33ed19a976dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:34.853688 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 494/966] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:34 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:11:34.854912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d25a-3db7-46fc-9c36-1007ad30cc1d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:34.894261 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 473/967] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:34.894839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ddcec-036c-48da-b541-33ed19a976dd None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:34.904242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:34.956075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:34.969906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d25a-3db7-46fc-9c36-1007ad30cc1d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:35.016065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b8274-f75d-4d4e-8046-18905b6dbbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:35.017069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8274-f75d-4d4e-8046-18905b6dbbaf None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:35.017591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8274-f75d-4d4e-8046-18905b6dbbaf None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:35.018025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8274-f75d-4d4e-8046-18905b6dbbaf None admin] PATH_INFO: `/v3/services/compute` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:35.018258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ddcec-036c-48da-b541-33ed19a976dd None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:35.018973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b8274-f75d-4d4e-8046-18905b6dbbaf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:35.021253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b8274-f75d-4d4e-8046-18905b6dbbaf None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-a37b8274-f75d-4d4e-8046-18905b6dbbaf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:35.037887 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:35.039195 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:35.040374 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 495/968] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:35.041288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b8274-f75d-4d4e-8046-18905b6dbbaf None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:35.077053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b81f61-d633-4e8e-a971-deb48c8d7257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:35.077756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b81f61-d633-4e8e-a971-deb48c8d7257 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:35.078163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b81f61-d633-4e8e-a971-deb48c8d7257 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:35.078269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b81f61-d633-4e8e-a971-deb48c8d7257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:35.078935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b81f61-d633-4e8e-a971-deb48c8d7257 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:35.080324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b81f61-d633-4e8e-a971-deb48c8d7257 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:35.109427 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 474/969] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:11:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:11:35.109427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b81f61-d633-4e8e-a971-deb48c8d7257 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:35.188485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b8274-f75d-4d4e-8046-18905b6dbbaf None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:35.196638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:35.241991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2b98-f1d0-4c8d-be7f-43ff4daf1f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:35.242639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2b98-f1d0-4c8d-be7f-43ff4daf1f64 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:35.242919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2b98-f1d0-4c8d-be7f-43ff4daf1f64 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:35.243199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2b98-f1d0-4c8d-be7f-43ff4daf1f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:35.255691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b2b98-f1d0-4c8d-be7f-43ff4daf1f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:35.257159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b2b98-f1d0-4c8d-be7f-43ff4daf1f64 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:35.262052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b81f61-d633-4e8e-a971-deb48c8d7257 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:35.273627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-857b2b98-f1d0-4c8d-be7f-43ff4daf1f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:35.274155 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:35.275069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:35.275994 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:35.275994 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:35.275994 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:35.275994 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 496/970] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:35.276222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2b98-f1d0-4c8d-be7f-43ff4daf1f64 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:35.310162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a355df-f15e-4f0b-98a6-7dfcb51e3db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:35.311719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a355df-f15e-4f0b-98a6-7dfcb51e3db8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:35.312010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a355df-f15e-4f0b-98a6-7dfcb51e3db8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:35.312473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a355df-f15e-4f0b-98a6-7dfcb51e3db8 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:35.313517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a355df-f15e-4f0b-98a6-7dfcb51e3db8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:35.313973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a355df-f15e-4f0b-98a6-7dfcb51e3db8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:35.315656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a355df-f15e-4f0b-98a6-7dfcb51e3db8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:35.326520 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 475/971] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:35.326520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a355df-f15e-4f0b-98a6-7dfcb51e3db8 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:35.400904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2b98-f1d0-4c8d-be7f-43ff4daf1f64 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:35.444878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52412f51-e333-491a-a07e-7918cd365977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:35.445826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52412f51-e333-491a-a07e-7918cd365977 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:35.446339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52412f51-e333-491a-a07e-7918cd365977 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:35.446873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52412f51-e333-491a-a07e-7918cd365977 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:35.448022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52412f51-e333-491a-a07e-7918cd365977 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:35.449959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52412f51-e333-491a-a07e-7918cd365977 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:35.454753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a355df-f15e-4f0b-98a6-7dfcb51e3db8 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:35.470684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.sql.core [None req-52412f51-e333-491a-a07e-7918cd365977 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 15:11:35.470684 n-d-854882-3 devstack@keystone.service[89680]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 15:11:35.470684 n-d-854882-3 devstack@keystone.service[89680]: [parameters: {'user_id': '4dad65e22c4048a2907c0821d2e58329', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 15:11:35.470684 n-d-854882-3 devstack@keystone.service[89680]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89680) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-52412f51-e333-491a-a07e-7918cd365977 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result.read() Aug 29 15:11:35.483869 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:11:35.484871 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application yield resource Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise self.value Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application session.commit() Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 15:11:35.485923 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.session.flush() Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application compat.raise_( Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:11:35.486870 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:11:35.487957 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result.read() Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:11:35.489052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [parameters: {'user_id': '4dad65e22c4048a2907c0821d2e58329', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:35.490187 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 15:11:35.491222 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 15:11:35.492398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 15:11:35.492398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 15:11:35.492398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 15:11:35.492398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 15:11:35.492398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 15:11:35.492398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:35.494394 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 497/972] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Aug 29 15:11:35 2022] POST /identity/v3/users => generated 160 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:35.496426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52412f51-e333-491a-a07e-7918cd365977 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:35.517291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c775-82be-429f-9411-9d5e8d1adb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:35.517939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c775-82be-429f-9411-9d5e8d1adb1d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:35.518218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c775-82be-429f-9411-9d5e8d1adb1d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:35.518520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c775-82be-429f-9411-9d5e8d1adb1d None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:35.519185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c775-82be-429f-9411-9d5e8d1adb1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:35.519485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c775-82be-429f-9411-9d5e8d1adb1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:35.520976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c775-82be-429f-9411-9d5e8d1adb1d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:35.527494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:35.538014 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 476/973] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:35.539317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c775-82be-429f-9411-9d5e8d1adb1d None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:35.587103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:35.656712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52412f51-e333-491a-a07e-7918cd365977 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:35.694853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c775-82be-429f-9411-9d5e8d1adb1d None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:35.698114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5464e-215c-416c-a017-59438aa1f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:35.698114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5464e-215c-416c-a017-59438aa1f3c6 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:35.698114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5464e-215c-416c-a017-59438aa1f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:35.698646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5464e-215c-416c-a017-59438aa1f3c6 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:35.699430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5464e-215c-416c-a017-59438aa1f3c6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:35.699824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5464e-215c-416c-a017-59438aa1f3c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:35.702173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5464e-215c-416c-a017-59438aa1f3c6 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:35.717827 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 498/974] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:35.717827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5464e-215c-416c-a017-59438aa1f3c6 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:35.761821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628422e-2c09-4e95-8862-daa20a2ddc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:35.762909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628422e-2c09-4e95-8862-daa20a2ddc56 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:35.763392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628422e-2c09-4e95-8862-daa20a2ddc56 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:35.763893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628422e-2c09-4e95-8862-daa20a2ddc56 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:35.791575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628422e-2c09-4e95-8862-daa20a2ddc56 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:35.794174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628422e-2c09-4e95-8862-daa20a2ddc56 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-4628422e-2c09-4e95-8862-daa20a2ddc56 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:35.810475 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:35.811962 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:35.813096 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:35.813096 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:35.813096 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:35.813096 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:35.813096 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:35.813096 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:35.813096 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:35.813096 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:35.813096 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 15:11:35.813096 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:35.817659 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 477/975] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:11:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:35.819180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628422e-2c09-4e95-8862-daa20a2ddc56 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:35.845084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:35.870420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5464e-215c-416c-a017-59438aa1f3c6 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:35.916968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad0adf-c8a6-4262-8b2f-361444e72233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:35.918759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad0adf-c8a6-4262-8b2f-361444e72233 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:35.918759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad0adf-c8a6-4262-8b2f-361444e72233 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:35.918759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad0adf-c8a6-4262-8b2f-361444e72233 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:35.928891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad0adf-c8a6-4262-8b2f-361444e72233 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:35.930442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad0adf-c8a6-4262-8b2f-361444e72233 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-84ad0adf-c8a6-4262-8b2f-361444e72233 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:35.944241 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:35.945231 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:35.946697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:35.946697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:35.946697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:35.946697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:35.946697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:35.946697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:35.946697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:35.946697 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:35.950412 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 499/976] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:35.952378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad0adf-c8a6-4262-8b2f-361444e72233 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:35.952942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:35.969623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628422e-2c09-4e95-8862-daa20a2ddc56 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:36.013939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc57a0-cd0f-45ea-99c6-87a3afcb5427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:36.015156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc57a0-cd0f-45ea-99c6-87a3afcb5427 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:36.015434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc57a0-cd0f-45ea-99c6-87a3afcb5427 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:36.015705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc57a0-cd0f-45ea-99c6-87a3afcb5427 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:36.016412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc57a0-cd0f-45ea-99c6-87a3afcb5427 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:36.016712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc57a0-cd0f-45ea-99c6-87a3afcb5427 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:36.018778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc57a0-cd0f-45ea-99c6-87a3afcb5427 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:36.073517 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 478/977] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Aug 29 15:11:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:36.085637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad0adf-c8a6-4262-8b2f-361444e72233 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:36.132137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9ff8-3b84-47d3-b8ac-1b60e63bf1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:36.132865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9ff8-3b84-47d3-b8ac-1b60e63bf1f3 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:36.133151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9ff8-3b84-47d3-b8ac-1b60e63bf1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:36.133465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9ff8-3b84-47d3-b8ac-1b60e63bf1f3 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:36.134308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9ff8-3b84-47d3-b8ac-1b60e63bf1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:36.134620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9ff8-3b84-47d3-b8ac-1b60e63bf1f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:36.136245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9ff8-3b84-47d3-b8ac-1b60e63bf1f3 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:36.148582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:36.157604 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 500/978] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:36.160904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc57a0-cd0f-45ea-99c6-87a3afcb5427 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:36.293904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc57a0-cd0f-45ea-99c6-87a3afcb5427 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:36.333762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff368c-473b-4c88-a962-a0d2fe7a99a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:36.334388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff368c-473b-4c88-a962-a0d2fe7a99a3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:36.334666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff368c-473b-4c88-a962-a0d2fe7a99a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:36.334945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff368c-473b-4c88-a962-a0d2fe7a99a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:36.335695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff368c-473b-4c88-a962-a0d2fe7a99a3 None admin] RBAC: Adding query filter params (role.id=d41744ed4fd249de89a4caad1588843f, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=f70236f89ced4a209b0451062d3d39f5) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:36.336002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff368c-473b-4c88-a962-a0d2fe7a99a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:36.337510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff368c-473b-4c88-a962-a0d2fe7a99a3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:36.344688 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 479/979] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:36 2022] GET /identity/v3/role_assignments?user.id=f70236f89ced4a209b0451062d3d39f5&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=d41744ed4fd249de89a4caad1588843f => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:37.213038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270af7b-3f78-4cb1-99ac-5fb7511e628b None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:37.213591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270af7b-3f78-4cb1-99ac-5fb7511e628b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:37.213591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270af7b-3f78-4cb1-99ac-5fb7511e628b None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:37.215086 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 501/980] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:37.220285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73866-150b-4cf3-a59f-6485d62ec352 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:37.220734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73866-150b-4cf3-a59f-6485d62ec352 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:37.220816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73866-150b-4cf3-a59f-6485d62ec352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:37.239615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c9f73866-150b-4cf3-a59f-6485d62ec352 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:37.240804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c9f73866-150b-4cf3-a59f-6485d62ec352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:37.252895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:37.317425 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 480/981] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:37.586214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270af7b-3f78-4cb1-99ac-5fb7511e628b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:37.691594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270af7b-3f78-4cb1-99ac-5fb7511e628b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:37.726592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705bd5f-bce5-41cc-ab1c-c9ec77170227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:37.727230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705bd5f-bce5-41cc-ab1c-c9ec77170227 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:37.727508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705bd5f-bce5-41cc-ab1c-c9ec77170227 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:37.727787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705bd5f-bce5-41cc-ab1c-c9ec77170227 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:37.728370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705bd5f-bce5-41cc-ab1c-c9ec77170227 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:37.729765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705bd5f-bce5-41cc-ab1c-c9ec77170227 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-2705bd5f-bce5-41cc-ab1c-c9ec77170227 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:37.738934 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:37.739990 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:37.740846 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 502/982] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Aug 29 15:11:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:37.747504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f73866-150b-4cf3-a59f-6485d62ec352 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:37.855807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f73866-150b-4cf3-a59f-6485d62ec352 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:37.892405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69bbf6-a2dc-443b-b10e-1300ff5ec46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:37.893007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69bbf6-a2dc-443b-b10e-1300ff5ec46b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:37.893288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69bbf6-a2dc-443b-b10e-1300ff5ec46b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:37.893591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69bbf6-a2dc-443b-b10e-1300ff5ec46b None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:37.894227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69bbf6-a2dc-443b-b10e-1300ff5ec46b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:37.894528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69bbf6-a2dc-443b-b10e-1300ff5ec46b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:37.895893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69bbf6-a2dc-443b-b10e-1300ff5ec46b None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:37.905516 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 481/983] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Aug 29 15:11:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:37.905695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554325-1e6d-4369-bcde-467c2476010d None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:37.905695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554325-1e6d-4369-bcde-467c2476010d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:37.905695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99554325-1e6d-4369-bcde-467c2476010d None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:37.905695 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 503/984] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:37.910287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69bbf6-a2dc-443b-b10e-1300ff5ec46b None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:37.910807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b90b-03af-4637-a95f-a4d109e42eb6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:37.911097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b90b-03af-4637-a95f-a4d109e42eb6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:37.911374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b90b-03af-4637-a95f-a4d109e42eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:37.922172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:37.931972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d1a1b90b-03af-4637-a95f-a4d109e42eb6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:37.933546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d1a1b90b-03af-4637-a95f-a4d109e42eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:37.997256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:38.008159 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 504/985] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:38.021603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69bbf6-a2dc-443b-b10e-1300ff5ec46b None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:38.056982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6962d84-a49b-415c-b1de-262846d2ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:38.057603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6962d84-a49b-415c-b1de-262846d2ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:38.057880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6962d84-a49b-415c-b1de-262846d2ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:38.058145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6962d84-a49b-415c-b1de-262846d2ecd4 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:38.058763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6962d84-a49b-415c-b1de-262846d2ecd4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:38.059055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6962d84-a49b-415c-b1de-262846d2ecd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:38.060401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6962d84-a49b-415c-b1de-262846d2ecd4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:38.065486 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 482/986] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Aug 29 15:11:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:38.071112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1b90b-03af-4637-a95f-a4d109e42eb6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:38.186585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1b90b-03af-4637-a95f-a4d109e42eb6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:38.240478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b9d10-7d20-4c78-b996-a5ff19fc2c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:38.242017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b9d10-7d20-4c78-b996-a5ff19fc2c07 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:38.242017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b9d10-7d20-4c78-b996-a5ff19fc2c07 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:38.242017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b9d10-7d20-4c78-b996-a5ff19fc2c07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:38.242393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b9d10-7d20-4c78-b996-a5ff19fc2c07 None admin] RBAC: Adding query filter params (interface=admin, service_id=b0e438b607a64cadbb007ea56eb40243, region_id=RegionOne) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:38.242710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b9d10-7d20-4c78-b996-a5ff19fc2c07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:38.244194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b9d10-7d20-4c78-b996-a5ff19fc2c07 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:38.250262 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 505/987] 10.222.0.16 () {56 vars in 1249 bytes} [Mon Aug 29 15:11:38 2022] GET /identity/v3/endpoints?service_id=b0e438b607a64cadbb007ea56eb40243&interface=admin®ion_id=RegionOne => generated 193 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:38.256517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6962d84-a49b-415c-b1de-262846d2ecd4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:38.276680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b9d10-7d20-4c78-b996-a5ff19fc2c07 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:38.345126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:38.361188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:38.388340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b9d10-7d20-4c78-b996-a5ff19fc2c07 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:38.393678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6962d84-a49b-415c-b1de-262846d2ecd4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:38.423779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86251bf0-c349-42de-a4da-7cd74dc6744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:38.424391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86251bf0-c349-42de-a4da-7cd74dc6744f None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:38.424669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86251bf0-c349-42de-a4da-7cd74dc6744f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:38.424947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86251bf0-c349-42de-a4da-7cd74dc6744f None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:38.425643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86251bf0-c349-42de-a4da-7cd74dc6744f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:38.427013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86251bf0-c349-42de-a4da-7cd74dc6744f None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:38.429248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16f784-2144-482d-9a3c-61e681e287a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:38.429887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16f784-2144-482d-9a3c-61e681e287a3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:38.430166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16f784-2144-482d-9a3c-61e681e287a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:38.430631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16f784-2144-482d-9a3c-61e681e287a3 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:38.431617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16f784-2144-482d-9a3c-61e681e287a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:38.433004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16f784-2144-482d-9a3c-61e681e287a3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:38.439962 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 483/988] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Aug 29 15:11:38 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:11:38.441114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695e567-2d9b-4f1a-9b2d-c19a7653e6e6 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:38.441411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695e567-2d9b-4f1a-9b2d-c19a7653e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:38.441687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695e567-2d9b-4f1a-9b2d-c19a7653e6e6 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:38.449576 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 506/989] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:11:38 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:11:38.449835 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 484/990] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:38.449918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189fef6-fe19-4275-8af8-2cdeb4ab0fd9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:38.449918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189fef6-fe19-4275-8af8-2cdeb4ab0fd9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:38.449918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189fef6-fe19-4275-8af8-2cdeb4ab0fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:38.476069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9189fef6-fe19-4275-8af8-2cdeb4ab0fd9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:38.477348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9189fef6-fe19-4275-8af8-2cdeb4ab0fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:38.576079 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 507/991] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:38.849655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695e567-2d9b-4f1a-9b2d-c19a7653e6e6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:38.964148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695e567-2d9b-4f1a-9b2d-c19a7653e6e6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:38.999487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897eb0e-129b-4f97-80e0-b71979a9b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:39.000206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897eb0e-129b-4f97-80e0-b71979a9b5ed None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:39.000483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897eb0e-129b-4f97-80e0-b71979a9b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:39.000750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897eb0e-129b-4f97-80e0-b71979a9b5ed None admin] PATH_INFO: `/v3/services/image` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:39.001355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897eb0e-129b-4f97-80e0-b71979a9b5ed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:39.002817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897eb0e-129b-4f97-80e0-b71979a9b5ed None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:39.006181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-2897eb0e-129b-4f97-80e0-b71979a9b5ed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:39.015297 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:39.016404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:39.017275 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 485/992] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Aug 29 15:11:38 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:39.022979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189fef6-fe19-4275-8af8-2cdeb4ab0fd9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:39.078220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:39.148141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189fef6-fe19-4275-8af8-2cdeb4ab0fd9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:39.187939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17891a1a-6982-41d0-a88c-1a8b198e6949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:39.188506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17891a1a-6982-41d0-a88c-1a8b198e6949 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:39.188786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17891a1a-6982-41d0-a88c-1a8b198e6949 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:39.189063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17891a1a-6982-41d0-a88c-1a8b198e6949 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:39.189921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17891a1a-6982-41d0-a88c-1a8b198e6949 None admin] RBAC: Adding query filter params (name=image) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:39.190245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17891a1a-6982-41d0-a88c-1a8b198e6949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:39.191611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17891a1a-6982-41d0-a88c-1a8b198e6949 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:39.196734 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 508/993] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:39.202802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897eb0e-129b-4f97-80e0-b71979a9b5ed None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:39.309539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897eb0e-129b-4f97-80e0-b71979a9b5ed None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:39.346327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe5444-89c7-4d81-9992-04daabca81f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:39.346935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe5444-89c7-4d81-9992-04daabca81f2 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:39.347215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe5444-89c7-4d81-9992-04daabca81f2 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:39.347488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe5444-89c7-4d81-9992-04daabca81f2 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:39.348127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe5444-89c7-4d81-9992-04daabca81f2 None admin] RBAC: Adding query filter params (type=image) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:39.348430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe5444-89c7-4d81-9992-04daabca81f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:39.349827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe5444-89c7-4d81-9992-04daabca81f2 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:39.355760 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 486/994] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:40.364826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335e69-60c9-4c23-8bc3-c2957b221bf5 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:40.365547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335e69-60c9-4c23-8bc3-c2957b221bf5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:40.365547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335e69-60c9-4c23-8bc3-c2957b221bf5 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:40.366904 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 509/995] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:40.371972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b218a7-15b2-4fc8-bcaa-42f5492b5a4b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:40.372398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b218a7-15b2-4fc8-bcaa-42f5492b5a4b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:40.372540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b218a7-15b2-4fc8-bcaa-42f5492b5a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:40.391817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-43b218a7-15b2-4fc8-bcaa-42f5492b5a4b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:40.393011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-43b218a7-15b2-4fc8-bcaa-42f5492b5a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:40.396064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350ad4d-e745-4494-a2bf-3ba0760cd3d3 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:40.396344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350ad4d-e745-4494-a2bf-3ba0760cd3d3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:40.396614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350ad4d-e745-4494-a2bf-3ba0760cd3d3 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:40.397985 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 510/996] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:40.403771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859d23-bf5b-4f7a-bee5-fe1cb837a096 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:40.404517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859d23-bf5b-4f7a-bee5-fe1cb837a096 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:40.404799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859d23-bf5b-4f7a-bee5-fe1cb837a096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:40.426194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f9859d23-bf5b-4f7a-bee5-fe1cb837a096 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:40.427637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f9859d23-bf5b-4f7a-bee5-fe1cb837a096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:40.474782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:40.485081 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 487/997] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:40.525427 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 511/998] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:40.797791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b218a7-15b2-4fc8-bcaa-42f5492b5a4b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:40.901051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b218a7-15b2-4fc8-bcaa-42f5492b5a4b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:40.936310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859d23-bf5b-4f7a-bee5-fe1cb837a096 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:40.936508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5f28b-aefb-47ff-a1a0-64aa151858c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:40.936937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5f28b-aefb-47ff-a1a0-64aa151858c7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:40.937214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5f28b-aefb-47ff-a1a0-64aa151858c7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:40.937514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5f28b-aefb-47ff-a1a0-64aa151858c7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:40.938106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5f28b-aefb-47ff-a1a0-64aa151858c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:40.939476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5f28b-aefb-47ff-a1a0-64aa151858c7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-1df5f28b-aefb-47ff-a1a0-64aa151858c7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:40.948679 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:40.949866 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:11:40.950841 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:40.952855 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 488/999] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:40.956270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5f28b-aefb-47ff-a1a0-64aa151858c7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:40.984090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:41.018505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:41.055035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859d23-bf5b-4f7a-bee5-fe1cb837a096 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:41.067786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5f28b-aefb-47ff-a1a0-64aa151858c7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:41.092409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014ba3f-51cd-4769-a70e-694ea945b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:41.093569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ba3f-51cd-4769-a70e-694ea945b0bb None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:41.093848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ba3f-51cd-4769-a70e-694ea945b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:41.094119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ba3f-51cd-4769-a70e-694ea945b0bb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:41.094712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014ba3f-51cd-4769-a70e-694ea945b0bb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:41.096076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014ba3f-51cd-4769-a70e-694ea945b0bb None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-6014ba3f-51cd-4769-a70e-694ea945b0bb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:41.105108 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:41.106200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 15:11:41.107713 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:41.108546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289449eb-408f-49be-96ff-78a485190957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:41.108639 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 512/1000] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Aug 29 15:11:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:41.111341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289449eb-408f-49be-96ff-78a485190957 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:41.111656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289449eb-408f-49be-96ff-78a485190957 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:41.111939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289449eb-408f-49be-96ff-78a485190957 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:41.117798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289449eb-408f-49be-96ff-78a485190957 None admin] RBAC: Adding query filter params (name=compute) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:41.117951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014ba3f-51cd-4769-a70e-694ea945b0bb None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:41.118033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289449eb-408f-49be-96ff-78a485190957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:41.118033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289449eb-408f-49be-96ff-78a485190957 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:41.122257 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 489/1001] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:41.127886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289449eb-408f-49be-96ff-78a485190957 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:41.243607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014ba3f-51cd-4769-a70e-694ea945b0bb None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:41.245371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:41.249916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289449eb-408f-49be-96ff-78a485190957 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:41.275755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:41.288630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bcca6-db4f-4fbf-ab4a-dad47534f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:41.289238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bcca6-db4f-4fbf-ab4a-dad47534f398 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:41.289544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bcca6-db4f-4fbf-ab4a-dad47534f398 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:41.289642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134cc87-0389-4a49-9e36-f7b347e58621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:41.289915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bcca6-db4f-4fbf-ab4a-dad47534f398 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:41.290152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134cc87-0389-4a49-9e36-f7b347e58621 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:41.290436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134cc87-0389-4a49-9e36-f7b347e58621 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:41.290534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bcca6-db4f-4fbf-ab4a-dad47534f398 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:41.290706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134cc87-0389-4a49-9e36-f7b347e58621 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:41.290829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bcca6-db4f-4fbf-ab4a-dad47534f398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:41.291335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134cc87-0389-4a49-9e36-f7b347e58621 None admin] RBAC: Adding query filter params (type=compute) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:41.291635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134cc87-0389-4a49-9e36-f7b347e58621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:41.292189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bcca6-db4f-4fbf-ab4a-dad47534f398 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:41.292980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134cc87-0389-4a49-9e36-f7b347e58621 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:41.297994 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 513/1002] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Aug 29 15:11:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:41.298920 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 490/1003] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:41.303860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0afbac-cbbc-4dc2-aa0b-a5f9c060b4e3 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:41.303860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0afbac-cbbc-4dc2-aa0b-a5f9c060b4e3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:41.303860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0afbac-cbbc-4dc2-aa0b-a5f9c060b4e3 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:41.303860 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 514/1004] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:41.306296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0afbac-cbbc-4dc2-aa0b-a5f9c060b4e3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:41.306408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134cc87-0389-4a49-9e36-f7b347e58621 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:41.407543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134cc87-0389-4a49-9e36-f7b347e58621 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:41.409852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0afbac-cbbc-4dc2-aa0b-a5f9c060b4e3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:41.441262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72797a6b-034f-491b-816f-292605afbd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:41.441901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797a6b-034f-491b-816f-292605afbd47 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:41.442183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797a6b-034f-491b-816f-292605afbd47 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:41.442452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797a6b-034f-491b-816f-292605afbd47 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:41.443081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72797a6b-034f-491b-816f-292605afbd47 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:41.443306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5db16d-911b-4174-97e3-b5797fe76ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:41.443425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72797a6b-034f-491b-816f-292605afbd47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:41.443908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5db16d-911b-4174-97e3-b5797fe76ef2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:41.444181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5db16d-911b-4174-97e3-b5797fe76ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:41.444448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5db16d-911b-4174-97e3-b5797fe76ef2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:41.444728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72797a6b-034f-491b-816f-292605afbd47 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:41.445136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5db16d-911b-4174-97e3-b5797fe76ef2 None admin] RBAC: Adding query filter params (interface=public, service_id=dd39929e50b24a4c91b1de208c517ae9, region_id=RegionOne) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:41.445464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5db16d-911b-4174-97e3-b5797fe76ef2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:41.446795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5db16d-911b-4174-97e3-b5797fe76ef2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:41.449722 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 491/1005] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Aug 29 15:11:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:41.451486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3e520-d60f-4f2d-9874-47ed1f3e2c8c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:41.451486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3e520-d60f-4f2d-9874-47ed1f3e2c8c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:41.451486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3e520-d60f-4f2d-9874-47ed1f3e2c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:41.456881 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 515/1006] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Aug 29 15:11:41 2022] GET /identity/v3/endpoints?service_id=dd39929e50b24a4c91b1de208c517ae9&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:41.456881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5db16d-911b-4174-97e3-b5797fe76ef2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:41.470191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1fe3e520-d60f-4f2d-9874-47ed1f3e2c8c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:41.471383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1fe3e520-d60f-4f2d-9874-47ed1f3e2c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:41.486871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:41.518284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:41.540757 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 492/1007] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:41.541409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3e520-d60f-4f2d-9874-47ed1f3e2c8c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:41.561853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5db16d-911b-4174-97e3-b5797fe76ef2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:41.598769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6eea-678e-4826-a140-913b0ecb47de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:41.599396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6eea-678e-4826-a140-913b0ecb47de None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:41.599673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6eea-678e-4826-a140-913b0ecb47de None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:41.599950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6eea-678e-4826-a140-913b0ecb47de None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:41.600628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de6eea-678e-4826-a140-913b0ecb47de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:41.602078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de6eea-678e-4826-a140-913b0ecb47de None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:41.625545 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 516/1008] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:11:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:11:41.685520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3e520-d60f-4f2d-9874-47ed1f3e2c8c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:41.735626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beadf48-d2a6-4573-b044-f910d82670e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:41.736336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beadf48-d2a6-4573-b044-f910d82670e4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:41.736624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beadf48-d2a6-4573-b044-f910d82670e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:41.736895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beadf48-d2a6-4573-b044-f910d82670e4 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:41.737571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beadf48-d2a6-4573-b044-f910d82670e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:41.738976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beadf48-d2a6-4573-b044-f910d82670e4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:41.746554 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 493/1009] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Aug 29 15:11:41 2022] GET /identity/v3/services => generated 1727 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:11:41.826448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6eea-678e-4826-a140-913b0ecb47de None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:41.945810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:41.959664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6eea-678e-4826-a140-913b0ecb47de None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:41.999289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e924c0-ec41-4089-8972-795392d68745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:41.999921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e924c0-ec41-4089-8972-795392d68745 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:42.000198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e924c0-ec41-4089-8972-795392d68745 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:42.000470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e924c0-ec41-4089-8972-795392d68745 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:42.001132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e924c0-ec41-4089-8972-795392d68745 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:42.002562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e924c0-ec41-4089-8972-795392d68745 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:42.029068 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 517/1010] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:11:41 2022] POST /identity/v3/services => generated 242 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:11:43.660750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499f9fd-d8e1-4fab-97ac-57b7d674a935 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:43.661325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499f9fd-d8e1-4fab-97ac-57b7d674a935 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:43.661458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499f9fd-d8e1-4fab-97ac-57b7d674a935 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:43.662956 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 494/1011] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:43.668389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71362934-b306-4d57-95a2-18e200bb4442 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:43.668831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71362934-b306-4d57-95a2-18e200bb4442 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:43.669019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71362934-b306-4d57-95a2-18e200bb4442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:43.688367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-71362934-b306-4d57-95a2-18e200bb4442 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:43.689591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-71362934-b306-4d57-95a2-18e200bb4442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:43.763995 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 518/1012] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:43.775274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b08065-01d2-4789-9b37-bbedac930408 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:43.775558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b08065-01d2-4789-9b37-bbedac930408 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:43.775838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b08065-01d2-4789-9b37-bbedac930408 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:43.777175 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 495/1013] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:43.782981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23fac-35ad-48cb-a94f-e2e483cd1a2c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:43.783263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23fac-35ad-48cb-a94f-e2e483cd1a2c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:43.783534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23fac-35ad-48cb-a94f-e2e483cd1a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:43.802501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7da23fac-35ad-48cb-a94f-e2e483cd1a2c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:43.803604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7da23fac-35ad-48cb-a94f-e2e483cd1a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:43.877938 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 519/1014] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:44.019488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbc190-88b1-407f-9b2f-88490471d9f3 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:44.019835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbc190-88b1-407f-9b2f-88490471d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:44.020036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbc190-88b1-407f-9b2f-88490471d9f3 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:44.021568 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 496/1015] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:44.026556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e9cf6-77d6-453c-8ac3-65e1d25e01f2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:44.026842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e9cf6-77d6-453c-8ac3-65e1d25e01f2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:44.027113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e9cf6-77d6-453c-8ac3-65e1d25e01f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:44.040734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:44.040990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbc190-88b1-407f-9b2f-88490471d9f3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:44.047549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-277e9cf6-77d6-453c-8ac3-65e1d25e01f2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:44.048776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-277e9cf6-77d6-453c-8ac3-65e1d25e01f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:44.087886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:44.126616 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 520/1016] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:44 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:44.152294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e9cf6-77d6-453c-8ac3-65e1d25e01f2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:44.157990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbc190-88b1-407f-9b2f-88490471d9f3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:44.194857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1bbc9-9229-4a78-b741-833e19650ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:44.195486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1bbc9-9229-4a78-b741-833e19650ba4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:44.195766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1bbc9-9229-4a78-b741-833e19650ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:44.196044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1bbc9-9229-4a78-b741-833e19650ba4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:44.197164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1bbc9-9229-4a78-b741-833e19650ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:44.198631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1bbc9-9229-4a78-b741-833e19650ba4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:44.200197 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 497/1017] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:44.206306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1bbc9-9229-4a78-b741-833e19650ba4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:44.259452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e9cf6-77d6-453c-8ac3-65e1d25e01f2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:44.297739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c442b4-4278-4486-9092-c3b80d2ccea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:44.298658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c442b4-4278-4486-9092-c3b80d2ccea1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:44.298939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c442b4-4278-4486-9092-c3b80d2ccea1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:44.299375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c442b4-4278-4486-9092-c3b80d2ccea1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:44.300287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c442b4-4278-4486-9092-c3b80d2ccea1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:44.301687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c442b4-4278-4486-9092-c3b80d2ccea1 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:44.304657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:44.309845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1bbc9-9229-4a78-b741-833e19650ba4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-46c442b4-4278-4486-9092-c3b80d2ccea1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:44.313651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:44.314945 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 15:11:44.316041 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:44.319768 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 521/1018] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:44.320709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c442b4-4278-4486-9092-c3b80d2ccea1 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:44.324590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:44.353703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f112d1-4520-4f36-b449-a86658e21c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:44.354223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f112d1-4520-4f36-b449-a86658e21c4c None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:44.354511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f112d1-4520-4f36-b449-a86658e21c4c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:44.354763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f112d1-4520-4f36-b449-a86658e21c4c None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:44.355406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f112d1-4520-4f36-b449-a86658e21c4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:44.356819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f112d1-4520-4f36-b449-a86658e21c4c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:44.387519 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 498/1019] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:11:44 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:11:44.398803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f112d1-4520-4f36-b449-a86658e21c4c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:44.444118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c442b4-4278-4486-9092-c3b80d2ccea1 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:44.490760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1f3f2-8de4-46e9-8f10-8d5fd6d610db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:44.491389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1f3f2-8de4-46e9-8f10-8d5fd6d610db None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:44.491669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1f3f2-8de4-46e9-8f10-8d5fd6d610db None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:44.491943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1f3f2-8de4-46e9-8f10-8d5fd6d610db None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:44.492669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1f3f2-8de4-46e9-8f10-8d5fd6d610db None admin] RBAC: Adding query filter params (name=compute) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:44.492900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1f3f2-8de4-46e9-8f10-8d5fd6d610db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:44.494568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1f3f2-8de4-46e9-8f10-8d5fd6d610db None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:44.501761 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 522/1020] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:44.507771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1f3f2-8de4-46e9-8f10-8d5fd6d610db None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:44.547378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f112d1-4520-4f36-b449-a86658e21c4c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:44.593258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff9205-0f3a-48b2-af2e-1fcf98e13a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:44.593617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:44.593995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9205-0f3a-48b2-af2e-1fcf98e13a41 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:44.594273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9205-0f3a-48b2-af2e-1fcf98e13a41 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:44.594608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9205-0f3a-48b2-af2e-1fcf98e13a41 None admin] PATH_INFO: `/v3/services/image` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:44.595145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff9205-0f3a-48b2-af2e-1fcf98e13a41 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:44.596529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff9205-0f3a-48b2-af2e-1fcf98e13a41 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-3eff9205-0f3a-48b2-af2e-1fcf98e13a41 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:44.607031 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:44.608737 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:44.610196 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 499/1021] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Aug 29 15:11:44 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:44.614285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff9205-0f3a-48b2-af2e-1fcf98e13a41 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:44.643286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1f3f2-8de4-46e9-8f10-8d5fd6d610db None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:44.643526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:44.680349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd305c-7c15-4c9c-9efa-267b619b0e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:44.680958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd305c-7c15-4c9c-9efa-267b619b0e04 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:44.681247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd305c-7c15-4c9c-9efa-267b619b0e04 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:44.681558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd305c-7c15-4c9c-9efa-267b619b0e04 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:44.682191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd305c-7c15-4c9c-9efa-267b619b0e04 None admin] RBAC: Adding query filter params (type=compute) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:44.682497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd305c-7c15-4c9c-9efa-267b619b0e04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:44.683899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd305c-7c15-4c9c-9efa-267b619b0e04 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:44.689919 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 523/1022] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Aug 29 15:11:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:44.695193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd305c-7c15-4c9c-9efa-267b619b0e04 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:44.742141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff9205-0f3a-48b2-af2e-1fcf98e13a41 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:44.780143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89afe5-22bf-4fa4-a3fe-84e39bfbc4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:44.781102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89afe5-22bf-4fa4-a3fe-84e39bfbc4f0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:44.781490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89afe5-22bf-4fa4-a3fe-84e39bfbc4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:44.781825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89afe5-22bf-4fa4-a3fe-84e39bfbc4f0 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:44.782462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89afe5-22bf-4fa4-a3fe-84e39bfbc4f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:44.782762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89afe5-22bf-4fa4-a3fe-84e39bfbc4f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:44.784198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89afe5-22bf-4fa4-a3fe-84e39bfbc4f0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:44.789486 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 500/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:44.795305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89afe5-22bf-4fa4-a3fe-84e39bfbc4f0 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:44.810922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd305c-7c15-4c9c-9efa-267b619b0e04 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:44.841488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:44.852828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97423ee0-9b74-4190-8f23-420399504557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:44.853478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423ee0-9b74-4190-8f23-420399504557 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:44.853763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423ee0-9b74-4190-8f23-420399504557 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:44.854040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423ee0-9b74-4190-8f23-420399504557 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:44.854803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97423ee0-9b74-4190-8f23-420399504557 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:44.857152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97423ee0-9b74-4190-8f23-420399504557 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:44.885699 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 524/1024] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:11:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:11:44.904693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:44.926769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89afe5-22bf-4fa4-a3fe-84e39bfbc4f0 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:44.990055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34202fb3-0004-4189-acfe-e362049d5726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:44.991058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202fb3-0004-4189-acfe-e362049d5726 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:44.991520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202fb3-0004-4189-acfe-e362049d5726 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:44.991987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202fb3-0004-4189-acfe-e362049d5726 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:44.993179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34202fb3-0004-4189-acfe-e362049d5726 None admin] RBAC: Adding query filter params (type=image) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:44.993753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34202fb3-0004-4189-acfe-e362049d5726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:44.996393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34202fb3-0004-4189-acfe-e362049d5726 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:45.011184 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 501/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:45.012469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97423ee0-9b74-4190-8f23-420399504557 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:45.137082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97423ee0-9b74-4190-8f23-420399504557 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:45.176880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af2935-340a-4a23-a3c2-758cb87dbedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:45.177557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2935-340a-4a23-a3c2-758cb87dbedb None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:45.177834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2935-340a-4a23-a3c2-758cb87dbedb None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:45.178101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2935-340a-4a23-a3c2-758cb87dbedb None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:45.178802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af2935-340a-4a23-a3c2-758cb87dbedb None admin] RBAC: Adding query filter params (interface=public, service_id=7336bbb1d29a487e9e77e31e0928b4fe, region_id=RegionOne) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:45.179102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af2935-340a-4a23-a3c2-758cb87dbedb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:45.180460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af2935-340a-4a23-a3c2-758cb87dbedb None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:45.185970 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 525/1026] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Aug 29 15:11:45 2022] GET /identity/v3/endpoints?service_id=7336bbb1d29a487e9e77e31e0928b4fe&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:45.191984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34202fb3-0004-4189-acfe-e362049d5726 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:45.319264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34202fb3-0004-4189-acfe-e362049d5726 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:45.356838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc13c2b-dd90-49e1-ad18-c50b4a1fe9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:45.357315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc13c2b-dd90-49e1-ad18-c50b4a1fe9d8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:45.357627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc13c2b-dd90-49e1-ad18-c50b4a1fe9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:45.357898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc13c2b-dd90-49e1-ad18-c50b4a1fe9d8 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:45.358691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc13c2b-dd90-49e1-ad18-c50b4a1fe9d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:45.360126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc13c2b-dd90-49e1-ad18-c50b4a1fe9d8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:45.373465 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 502/1027] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Aug 29 15:11:45 2022] GET /identity/v3/services => generated 1957 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:11:46.386793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617cb2d-e94f-4645-9ba8-cd048362bd82 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:46.387400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617cb2d-e94f-4645-9ba8-cd048362bd82 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:46.387400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617cb2d-e94f-4645-9ba8-cd048362bd82 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:46.388840 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 526/1028] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:46.394939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8659f-61ea-46d8-a4dd-10d69bf89ae0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:46.395467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8659f-61ea-46d8-a4dd-10d69bf89ae0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:46.395467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8659f-61ea-46d8-a4dd-10d69bf89ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:46.415951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-66f8659f-61ea-46d8-a4dd-10d69bf89ae0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:46.417144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66f8659f-61ea-46d8-a4dd-10d69bf89ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:46.426906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:46.539895 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 503/1029] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:46.805899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617cb2d-e94f-4645-9ba8-cd048362bd82 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:46.863864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:46.927458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617cb2d-e94f-4645-9ba8-cd048362bd82 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:46.965709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1fa72-3d42-4be1-a7a7-c81187f3a8f9 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:46.965973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1fa72-3d42-4be1-a7a7-c81187f3a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:46.966255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1fa72-3d42-4be1-a7a7-c81187f3a8f9 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:46.967716 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 504/1030] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:46.971771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb25b7-34c3-41b0-aa35-ff5dcf691e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:46.973078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb25b7-34c3-41b0-aa35-ff5dcf691e77 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:46.973200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db111f-3c73-4ba4-9f6c-c8a1bae0f2c3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:46.973453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db111f-3c73-4ba4-9f6c-c8a1bae0f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:46.973572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb25b7-34c3-41b0-aa35-ff5dcf691e77 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:46.973734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db111f-3c73-4ba4-9f6c-c8a1bae0f2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:46.974004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb25b7-34c3-41b0-aa35-ff5dcf691e77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:46.975952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb25b7-34c3-41b0-aa35-ff5dcf691e77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:46.978417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb25b7-34c3-41b0-aa35-ff5dcf691e77 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:46.980302 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 527/1031] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:46.986574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb25b7-34c3-41b0-aa35-ff5dcf691e77 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:46.993421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-98db111f-3c73-4ba4-9f6c-c8a1bae0f2c3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:46.994616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-98db111f-3c73-4ba4-9f6c-c8a1bae0f2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:47.071028 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 505/1032] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:47.116661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb25b7-34c3-41b0-aa35-ff5dcf691e77 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:47.135235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:47.154858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6709c-5e3e-4b13-adc3-45c63f9d89fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:47.155482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6709c-5e3e-4b13-adc3-45c63f9d89fb None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:47.156010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6709c-5e3e-4b13-adc3-45c63f9d89fb None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:47.156284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6709c-5e3e-4b13-adc3-45c63f9d89fb None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:47.156946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6709c-5e3e-4b13-adc3-45c63f9d89fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:47.158421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6709c-5e3e-4b13-adc3-45c63f9d89fb None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:47.183717 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 528/1033] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:11:46 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:11:47.313677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116af0f-9fb5-4b20-a4dd-fbbb883faa99 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:47.314164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116af0f-9fb5-4b20-a4dd-fbbb883faa99 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:47.314620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116af0f-9fb5-4b20-a4dd-fbbb883faa99 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:47.317327 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 506/1034] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:47.324892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435201-3f87-4961-bfee-4ea2b4669f1b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:47.325417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435201-3f87-4961-bfee-4ea2b4669f1b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:47.326022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435201-3f87-4961-bfee-4ea2b4669f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:47.346553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116af0f-9fb5-4b20-a4dd-fbbb883faa99 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:47.358501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ce435201-3f87-4961-bfee-4ea2b4669f1b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:47.360852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ce435201-3f87-4961-bfee-4ea2b4669f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:47.449685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:47.462412 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 529/1035] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:47.489582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116af0f-9fb5-4b20-a4dd-fbbb883faa99 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:47.532906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3843b59-6c8e-4fa4-b171-be3bb7feb1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:47.533626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843b59-6c8e-4fa4-b171-be3bb7feb1b5 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:47.533908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843b59-6c8e-4fa4-b171-be3bb7feb1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:47.537127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843b59-6c8e-4fa4-b171-be3bb7feb1b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:47.549573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3843b59-6c8e-4fa4-b171-be3bb7feb1b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-e3843b59-6c8e-4fa4-b171-be3bb7feb1b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:47.554530 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:47.555701 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:47.556685 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 507/1036] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Aug 29 15:11:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:47.562415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce435201-3f87-4961-bfee-4ea2b4669f1b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:47.682568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce435201-3f87-4961-bfee-4ea2b4669f1b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:47.684095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:47.721905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb0472-2e33-4588-97f0-954de94af43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:47.722526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb0472-2e33-4588-97f0-954de94af43b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:47.722807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb0472-2e33-4588-97f0-954de94af43b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:47.723082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb0472-2e33-4588-97f0-954de94af43b None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:47.723756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb0472-2e33-4588-97f0-954de94af43b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:47.724060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb0472-2e33-4588-97f0-954de94af43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:47.725471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb0472-2e33-4588-97f0-954de94af43b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:47.739527 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 530/1037] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Aug 29 15:11:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:47.740937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3843b59-6c8e-4fa4-b171-be3bb7feb1b5 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:47.748318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb0472-2e33-4588-97f0-954de94af43b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:47.863479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb0472-2e33-4588-97f0-954de94af43b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:47.871918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3843b59-6c8e-4fa4-b171-be3bb7feb1b5 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:47.904958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33b6e5-f3c5-4100-8e6f-230398ec872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:47.906191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:47.906682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33b6e5-f3c5-4100-8e6f-230398ec872a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:47.906974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33b6e5-f3c5-4100-8e6f-230398ec872a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:47.907246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33b6e5-f3c5-4100-8e6f-230398ec872a None admin] PATH_INFO: `/v3/services/image` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:47.907850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33b6e5-f3c5-4100-8e6f-230398ec872a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:47.909212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33b6e5-f3c5-4100-8e6f-230398ec872a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:47.912112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0266-3da8-45de-98e9-301f0b8dcae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:47.912766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0266-3da8-45de-98e9-301f0b8dcae8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:47.913433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0266-3da8-45de-98e9-301f0b8dcae8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:47.913834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0266-3da8-45de-98e9-301f0b8dcae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-4b33b6e5-f3c5-4100-8e6f-230398ec872a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:47.919679 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:47.921352 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 15:11:47.922504 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:47.923289 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 531/1038] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Aug 29 15:11:47 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:47.926130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db0266-3da8-45de-98e9-301f0b8dcae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:47.927689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db0266-3da8-45de-98e9-301f0b8dcae8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:47.928517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33b6e5-f3c5-4100-8e6f-230398ec872a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-11db0266-3da8-45de-98e9-301f0b8dcae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:47.944597 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:47.945747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:47.946684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:47.946684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:47.946684 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:47.949949 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 508/1039] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:47.957550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0266-3da8-45de-98e9-301f0b8dcae8 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:47.964086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:48.054911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33b6e5-f3c5-4100-8e6f-230398ec872a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:48.070034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0266-3da8-45de-98e9-301f0b8dcae8 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:48.095909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dbebe-f86f-484d-8988-35e58e1729d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:48.096521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dbebe-f86f-484d-8988-35e58e1729d4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:48.096806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dbebe-f86f-484d-8988-35e58e1729d4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:48.097072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dbebe-f86f-484d-8988-35e58e1729d4 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:48.097741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dbebe-f86f-484d-8988-35e58e1729d4 None admin] RBAC: Adding query filter params (name=image) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:48.098041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dbebe-f86f-484d-8988-35e58e1729d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:48.099414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dbebe-f86f-484d-8988-35e58e1729d4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:48.105031 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 532/1040] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:48.110811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dbebe-f86f-484d-8988-35e58e1729d4 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:48.117146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b77f92-5efb-495e-9392-5fac6e47e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:48.117817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77f92-5efb-495e-9392-5fac6e47e71a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:48.118096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77f92-5efb-495e-9392-5fac6e47e71a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:48.118367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77f92-5efb-495e-9392-5fac6e47e71a None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:48.119022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b77f92-5efb-495e-9392-5fac6e47e71a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:48.119321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b77f92-5efb-495e-9392-5fac6e47e71a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:48.120693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b77f92-5efb-495e-9392-5fac6e47e71a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:48.134689 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 509/1041] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:48.140366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b77f92-5efb-495e-9392-5fac6e47e71a None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:48.191924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:48.224978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:48.237939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dbebe-f86f-484d-8988-35e58e1729d4 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:48.256723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b77f92-5efb-495e-9392-5fac6e47e71a None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:48.277056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7338e9-5e08-4aa9-8c0f-5bdd4828d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:48.277707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7338e9-5e08-4aa9-8c0f-5bdd4828d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:48.277983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7338e9-5e08-4aa9-8c0f-5bdd4828d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:48.278255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7338e9-5e08-4aa9-8c0f-5bdd4828d3a2 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:48.278885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7338e9-5e08-4aa9-8c0f-5bdd4828d3a2 None admin] RBAC: Adding query filter params (type=image) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:48.279616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7338e9-5e08-4aa9-8c0f-5bdd4828d3a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:48.281301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7338e9-5e08-4aa9-8c0f-5bdd4828d3a2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:48.292376 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 533/1042] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:48.293223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7338e9-5e08-4aa9-8c0f-5bdd4828d3a2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:48.296129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86258ecd-5a76-4a1e-a61f-f2d21ba60fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:48.296911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86258ecd-5a76-4a1e-a61f-f2d21ba60fe0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:48.297033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86258ecd-5a76-4a1e-a61f-f2d21ba60fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:48.297303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86258ecd-5a76-4a1e-a61f-f2d21ba60fe0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:48.305202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86258ecd-5a76-4a1e-a61f-f2d21ba60fe0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:48.306695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86258ecd-5a76-4a1e-a61f-f2d21ba60fe0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-86258ecd-5a76-4a1e-a61f-f2d21ba60fe0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:48.319944 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:48.320995 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:48.322026 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:48.322026 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:48.322026 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:48.322026 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:48.322026 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:48.322026 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:48.322026 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:48.322026 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:48.322026 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:48.322026 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:48.322026 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 510/1043] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Aug 29 15:11:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:48.326837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86258ecd-5a76-4a1e-a61f-f2d21ba60fe0 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:48.407616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7338e9-5e08-4aa9-8c0f-5bdd4828d3a2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:48.445205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e2562-4d97-4f60-83ba-17bc1e52a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:48.445869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2562-4d97-4f60-83ba-17bc1e52a295 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:48.446155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2562-4d97-4f60-83ba-17bc1e52a295 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:48.446428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2562-4d97-4f60-83ba-17bc1e52a295 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:48.447143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e2562-4d97-4f60-83ba-17bc1e52a295 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:48.448603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e2562-4d97-4f60-83ba-17bc1e52a295 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:48.457909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86258ecd-5a76-4a1e-a61f-f2d21ba60fe0 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:48.461985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:48.485505 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 534/1044] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:11:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:11:48.528818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0faeb7-b243-45fd-b20d-4c332dd8d642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:48.529541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0faeb7-b243-45fd-b20d-4c332dd8d642 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:48.529880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0faeb7-b243-45fd-b20d-4c332dd8d642 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:48.530213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0faeb7-b243-45fd-b20d-4c332dd8d642 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:48.531268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0faeb7-b243-45fd-b20d-4c332dd8d642 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:48.531579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0faeb7-b243-45fd-b20d-4c332dd8d642 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:48.533115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0faeb7-b243-45fd-b20d-4c332dd8d642 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:48.560667 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 511/1045] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Aug 29 15:11:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:48.567897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e2562-4d97-4f60-83ba-17bc1e52a295 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:48.587000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:48.695843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e2562-4d97-4f60-83ba-17bc1e52a295 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:48.732404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ced0e-f95c-4707-8118-5473333f0020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:48.733570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ced0e-f95c-4707-8118-5473333f0020 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:48.733862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ced0e-f95c-4707-8118-5473333f0020 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:48.734134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ced0e-f95c-4707-8118-5473333f0020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:48.815541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ced0e-f95c-4707-8118-5473333f0020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:48.817141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ced0e-f95c-4707-8118-5473333f0020 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:48.837607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:48.949350 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 535/1046] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 15:11:48.956373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0faeb7-b243-45fd-b20d-4c332dd8d642 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:49.086373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0faeb7-b243-45fd-b20d-4c332dd8d642 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:49.143415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b3781-4507-420b-ba51-8898dea2e610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:49.144313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b3781-4507-420b-ba51-8898dea2e610 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:49.144745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b3781-4507-420b-ba51-8898dea2e610 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:49.145167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b3781-4507-420b-ba51-8898dea2e610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:49.163561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b3781-4507-420b-ba51-8898dea2e610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:49.166173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b3781-4507-420b-ba51-8898dea2e610 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-c67b3781-4507-420b-ba51-8898dea2e610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:49.193966 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:49.195919 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:49.197076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:49.197076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:49.197076 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:49.197076 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 512/1047] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:49.204382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ced0e-f95c-4707-8118-5473333f0020 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:49.308363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2f74f-1b93-4123-97f8-649a19d12080 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:49.308640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2f74f-1b93-4123-97f8-649a19d12080 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:49.308916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2f74f-1b93-4123-97f8-649a19d12080 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:49.310459 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 513/1048] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:49.315718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20029-ba3c-4436-aa26-23a1f5c24daf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:49.315994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20029-ba3c-4436-aa26-23a1f5c24daf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:49.316276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20029-ba3c-4436-aa26-23a1f5c24daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:49.321419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ced0e-f95c-4707-8118-5473333f0020 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:49.336035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4ea20029-ba3c-4436-aa26-23a1f5c24daf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:49.337301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4ea20029-ba3c-4436-aa26-23a1f5c24daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:49.339571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:49.340404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:49.373585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834653-82a8-42c4-b622-a45dacf2bfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:49.375138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834653-82a8-42c4-b622-a45dacf2bfac None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:49.375543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834653-82a8-42c4-b622-a45dacf2bfac None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:49.375983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834653-82a8-42c4-b622-a45dacf2bfac None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:49.377189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59834653-82a8-42c4-b622-a45dacf2bfac None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:49.377767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59834653-82a8-42c4-b622-a45dacf2bfac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:49.380276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59834653-82a8-42c4-b622-a45dacf2bfac None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:49.396753 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 536/1049] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:49.402368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834653-82a8-42c4-b622-a45dacf2bfac None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:49.429868 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 514/1050] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:49.543674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834653-82a8-42c4-b622-a45dacf2bfac None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:49.586489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c057d45-eba5-45c5-b6c8-1305197a088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:49.587127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c057d45-eba5-45c5-b6c8-1305197a088c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:49.587459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c057d45-eba5-45c5-b6c8-1305197a088c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:49.587680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c057d45-eba5-45c5-b6c8-1305197a088c None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:49.595388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c057d45-eba5-45c5-b6c8-1305197a088c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:49.596833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c057d45-eba5-45c5-b6c8-1305197a088c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-2c057d45-eba5-45c5-b6c8-1305197a088c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:49.610029 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:49.611175 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:49.612266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:49.612266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:49.612266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:49.612266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:49.612266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:49.612266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:49.612266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:49.612266 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:49.612266 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 537/1051] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:49.617091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea20029-ba3c-4436-aa26-23a1f5c24daf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:49.706532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c057d45-eba5-45c5-b6c8-1305197a088c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:49.728659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea20029-ba3c-4436-aa26-23a1f5c24daf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:49.744398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:49.770990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b76df-d8aa-4c8b-8c84-1e3a5adbfedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:49.771608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b76df-d8aa-4c8b-8c84-1e3a5adbfedc None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:49.771953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b76df-d8aa-4c8b-8c84-1e3a5adbfedc None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:49.772250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b76df-d8aa-4c8b-8c84-1e3a5adbfedc None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:49.773163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b76df-d8aa-4c8b-8c84-1e3a5adbfedc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:49.773680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b76df-d8aa-4c8b-8c84-1e3a5adbfedc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:49.775300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b76df-d8aa-4c8b-8c84-1e3a5adbfedc None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:49.787017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:49.797958 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 515/1052] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:49.799078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b76df-d8aa-4c8b-8c84-1e3a5adbfedc None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:49.827070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c057d45-eba5-45c5-b6c8-1305197a088c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:49.869364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c18eec-50c3-4909-9d42-18a35d7b2f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:49.870102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c18eec-50c3-4909-9d42-18a35d7b2f7e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:49.870856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c18eec-50c3-4909-9d42-18a35d7b2f7e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:49.871155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c18eec-50c3-4909-9d42-18a35d7b2f7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:49.886477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c18eec-50c3-4909-9d42-18a35d7b2f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-d9c18eec-50c3-4909-9d42-18a35d7b2f7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:49.892800 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:49.893826 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:49.894717 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 538/1053] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:49.901505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c18eec-50c3-4909-9d42-18a35d7b2f7e None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:49.909827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b76df-d8aa-4c8b-8c84-1e3a5adbfedc None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:49.948894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd27364-f33c-4cd7-911e-8592619b4fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:49.949912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd27364-f33c-4cd7-911e-8592619b4fce None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:49.950270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd27364-f33c-4cd7-911e-8592619b4fce None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:49.950547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd27364-f33c-4cd7-911e-8592619b4fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:49.951289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd27364-f33c-4cd7-911e-8592619b4fce None admin] RBAC: Adding query filter params (role.id=d41744ed4fd249de89a4caad1588843f, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=c235251bc54848279759ba3e71a38306) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:49.951597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd27364-f33c-4cd7-911e-8592619b4fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:49.953639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd27364-f33c-4cd7-911e-8592619b4fce None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:49.969418 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 516/1054] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:49 2022] GET /identity/v3/role_assignments?user.id=c235251bc54848279759ba3e71a38306&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=d41744ed4fd249de89a4caad1588843f => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:50.047654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:50.065617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c18eec-50c3-4909-9d42-18a35d7b2f7e None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:50.128394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff800ee5-4cbe-493a-b219-c6b7cc0db8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:50.128394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff800ee5-4cbe-493a-b219-c6b7cc0db8a8 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:50.128394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff800ee5-4cbe-493a-b219-c6b7cc0db8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:50.128394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff800ee5-4cbe-493a-b219-c6b7cc0db8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:50.128817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff800ee5-4cbe-493a-b219-c6b7cc0db8a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:50.128817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff800ee5-4cbe-493a-b219-c6b7cc0db8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:50.128817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff800ee5-4cbe-493a-b219-c6b7cc0db8a8 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:50.137514 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 539/1055] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:50.144159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd27364-f33c-4cd7-911e-8592619b4fce None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:50.217502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:50.262632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd27364-f33c-4cd7-911e-8592619b4fce None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:50.303687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b017b48-5b53-49c7-8d7a-65f4c456673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:50.304762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b017b48-5b53-49c7-8d7a-65f4c456673a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:50.305249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b017b48-5b53-49c7-8d7a-65f4c456673a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:50.305759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b017b48-5b53-49c7-8d7a-65f4c456673a None admin] PATH_INFO: `/v3/users/b6f963e886224a648cccd66f4e50d0c0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:50.331539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b017b48-5b53-49c7-8d7a-65f4c456673a None admin] RBAC: Authorizing `identity:get_user(user_id=b6f963e886224a648cccd66f4e50d0c0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:50.333421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b017b48-5b53-49c7-8d7a-65f4c456673a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:50.335475 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 517/1056] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:11:50 2022] GET /identity/v3/users/b6f963e886224a648cccd66f4e50d0c0 => generated 285 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:50.341997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff800ee5-4cbe-493a-b219-c6b7cc0db8a8 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:50.491207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff800ee5-4cbe-493a-b219-c6b7cc0db8a8 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:50.545476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9ccb4-b4c8-4739-89fb-4105b49aac28 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:50.545957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9ccb4-b4c8-4739-89fb-4105b49aac28 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:50.546298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9ccb4-b4c8-4739-89fb-4105b49aac28 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:50.548106 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 518/1057] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:50.549714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f9ab-fb5e-477f-aa83-c10d1bc96d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:50.550350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f9ab-fb5e-477f-aa83-c10d1bc96d07 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:50.550625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f9ab-fb5e-477f-aa83-c10d1bc96d07 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:50.550895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f9ab-fb5e-477f-aa83-c10d1bc96d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:50.553366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952421ad-1de7-41f0-8828-3c7fb0a4367c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:50.553670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952421ad-1de7-41f0-8828-3c7fb0a4367c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:50.553942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952421ad-1de7-41f0-8828-3c7fb0a4367c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:50.573150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-952421ad-1de7-41f0-8828-3c7fb0a4367c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:50.574384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-952421ad-1de7-41f0-8828-3c7fb0a4367c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:50.582312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:50.650715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f9ab-fb5e-477f-aa83-c10d1bc96d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:50.652163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f9ab-fb5e-477f-aa83-c10d1bc96d07 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:50.676021 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 519/1058] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:50.785849 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 540/1059] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:11:50.789152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952421ad-1de7-41f0-8828-3c7fb0a4367c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:50.876412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:50.969706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952421ad-1de7-41f0-8828-3c7fb0a4367c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:51.034717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114f25-e24e-4230-a399-5f25afe44d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:51.035783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114f25-e24e-4230-a399-5f25afe44d07 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:51.036348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114f25-e24e-4230-a399-5f25afe44d07 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:51.036732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114f25-e24e-4230-a399-5f25afe44d07 None admin] PATH_INFO: `/v3/projects/c4140b35dcc94a70b9139b6d33751c02` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:51.037483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f9ab-fb5e-477f-aa83-c10d1bc96d07 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:51.038415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db114f25-e24e-4230-a399-5f25afe44d07 None admin] RBAC: Authorizing `identity:get_project(project_id=c4140b35dcc94a70b9139b6d33751c02)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:51.040059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db114f25-e24e-4230-a399-5f25afe44d07 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:51.042249 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 520/1060] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:11:50 2022] GET /identity/v3/projects/c4140b35dcc94a70b9139b6d33751c02 => generated 311 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:51.048805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114f25-e24e-4230-a399-5f25afe44d07 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:51.133675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:51.171430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114f25-e24e-4230-a399-5f25afe44d07 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:51.193405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:51.203047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f9ab-fb5e-477f-aa83-c10d1bc96d07 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:51.212669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3a43-2c40-4393-9e55-e07051631ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:51.213686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3a43-2c40-4393-9e55-e07051631ed0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:51.213970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3a43-2c40-4393-9e55-e07051631ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:51.214245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3a43-2c40-4393-9e55-e07051631ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:51.215399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3a43-2c40-4393-9e55-e07051631ed0 None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=c4140b35dcc94a70b9139b6d33751c02, user.id=b6f963e886224a648cccd66f4e50d0c0) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:51.215694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3a43-2c40-4393-9e55-e07051631ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:51.217086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3a43-2c40-4393-9e55-e07051631ed0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:51.223493 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 521/1061] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:51 2022] GET /identity/v3/role_assignments?user.id=b6f963e886224a648cccd66f4e50d0c0&scope.project.id=c4140b35dcc94a70b9139b6d33751c02&role.id=be89abac608f45a6921181bcc574f721 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:51.241245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c1446-8f37-4b2f-9138-f80b31b6b511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:51.241910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c1446-8f37-4b2f-9138-f80b31b6b511 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:51.242190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c1446-8f37-4b2f-9138-f80b31b6b511 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:51.242462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c1446-8f37-4b2f-9138-f80b31b6b511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:51.325306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c1446-8f37-4b2f-9138-f80b31b6b511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:51.326648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c1446-8f37-4b2f-9138-f80b31b6b511 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:51.389596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:51.445446 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 541/1062] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:11:51.449318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3a43-2c40-4393-9e55-e07051631ed0 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:51.565233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3a43-2c40-4393-9e55-e07051631ed0 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:51.600654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e990c8-0a84-46af-940c-fc1e1dc0e0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:51.601200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e990c8-0a84-46af-940c-fc1e1dc0e0a8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:51.601506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e990c8-0a84-46af-940c-fc1e1dc0e0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:51.601777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e990c8-0a84-46af-940c-fc1e1dc0e0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:51.613182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e990c8-0a84-46af-940c-fc1e1dc0e0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:51.614759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e990c8-0a84-46af-940c-fc1e1dc0e0a8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-99e990c8-0a84-46af-940c-fc1e1dc0e0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:51.630192 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:51.631400 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:51.632542 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:51.632542 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:51.632542 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:51.632542 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 522/1063] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:51.638861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c1446-8f37-4b2f-9138-f80b31b6b511 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:51.746298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c1446-8f37-4b2f-9138-f80b31b6b511 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:51.785945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd65cd-03df-4c89-a8f3-366aa5d8d86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:51.786564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd65cd-03df-4c89-a8f3-366aa5d8d86c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:51.786842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd65cd-03df-4c89-a8f3-366aa5d8d86c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:51.787118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd65cd-03df-4c89-a8f3-366aa5d8d86c None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:51.787761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd65cd-03df-4c89-a8f3-366aa5d8d86c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:51.788063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd65cd-03df-4c89-a8f3-366aa5d8d86c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:51.789450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd65cd-03df-4c89-a8f3-366aa5d8d86c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:51.809449 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 542/1064] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:51.926133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4184e2-624b-4159-a174-2eed24850039 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:51.926663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4184e2-624b-4159-a174-2eed24850039 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:51.926663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4184e2-624b-4159-a174-2eed24850039 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:51.928297 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 523/1065] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:51.934222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842e63f-fdc9-4cc0-b2ec-ad4048ca4645 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:51.934589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842e63f-fdc9-4cc0-b2ec-ad4048ca4645 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:51.934842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842e63f-fdc9-4cc0-b2ec-ad4048ca4645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:51.955351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6842e63f-fdc9-4cc0-b2ec-ad4048ca4645 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:51.956509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6842e63f-fdc9-4cc0-b2ec-ad4048ca4645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:51.967271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:52.036587 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 543/1066] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:52.300756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4184e2-624b-4159-a174-2eed24850039 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:52.337599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:52.408211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4184e2-624b-4159-a174-2eed24850039 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:52.442931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7cb83-121a-41b0-be8c-be9484597bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:52.443560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7cb83-121a-41b0-be8c-be9484597bfa None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:52.443833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7cb83-121a-41b0-be8c-be9484597bfa None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:52.444100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7cb83-121a-41b0-be8c-be9484597bfa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:52.455513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7cb83-121a-41b0-be8c-be9484597bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-17b7cb83-121a-41b0-be8c-be9484597bfa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:52.460255 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:52.462625 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:52.463714 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 524/1067] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Aug 29 15:11:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:52.467272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842e63f-fdc9-4cc0-b2ec-ad4048ca4645 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:52.586540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842e63f-fdc9-4cc0-b2ec-ad4048ca4645 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:52.621826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3c969-ca04-4f62-a7e1-12660dbff578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:52.622436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c969-ca04-4f62-a7e1-12660dbff578 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:52.622751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c969-ca04-4f62-a7e1-12660dbff578 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:52.622978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3c969-ca04-4f62-a7e1-12660dbff578 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:52.623645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3c969-ca04-4f62-a7e1-12660dbff578 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:52.623976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3c969-ca04-4f62-a7e1-12660dbff578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:52.625329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3c969-ca04-4f62-a7e1-12660dbff578 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:52.633800 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 544/1068] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Aug 29 15:11:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:52.639704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7cb83-121a-41b0-be8c-be9484597bfa None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:52.735803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:52.741962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7cb83-121a-41b0-be8c-be9484597bfa None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:52.775334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e5c6e-999e-42ec-964d-74a77d217bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:52.775953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e5c6e-999e-42ec-964d-74a77d217bee None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:52.776228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e5c6e-999e-42ec-964d-74a77d217bee None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:52.776495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e5c6e-999e-42ec-964d-74a77d217bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:52.788358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e5c6e-999e-42ec-964d-74a77d217bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:52.789847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e5c6e-999e-42ec-964d-74a77d217bee None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-fb5e5c6e-999e-42ec-964d-74a77d217bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:52.804593 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:52.805659 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:52.806670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:52.806670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:52.806670 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:52.806670 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 525/1069] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:52.812056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3c969-ca04-4f62-a7e1-12660dbff578 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:52.822122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:52.922374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3c969-ca04-4f62-a7e1-12660dbff578 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:52.961064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00cdbd-099f-411e-8405-c51268d2ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:52.961718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00cdbd-099f-411e-8405-c51268d2ce47 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:52.961995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00cdbd-099f-411e-8405-c51268d2ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:52.962266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00cdbd-099f-411e-8405-c51268d2ce47 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:52.962947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00cdbd-099f-411e-8405-c51268d2ce47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:52.963245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00cdbd-099f-411e-8405-c51268d2ce47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:52.964661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00cdbd-099f-411e-8405-c51268d2ce47 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:52.978715 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 545/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:52.984542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e5c6e-999e-42ec-964d-74a77d217bee None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:53.106767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e5c6e-999e-42ec-964d-74a77d217bee None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:53.143451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706df105-a984-4779-9bba-cbcef44ed1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:53.144087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df105-a984-4779-9bba-cbcef44ed1c4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:53.144364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df105-a984-4779-9bba-cbcef44ed1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:53.144630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df105-a984-4779-9bba-cbcef44ed1c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:53.152811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706df105-a984-4779-9bba-cbcef44ed1c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:53.154299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706df105-a984-4779-9bba-cbcef44ed1c4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-706df105-a984-4779-9bba-cbcef44ed1c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:53.166688 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:53.168138 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:53.169344 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:53.169344 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:53.169344 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:53.169344 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:53.169344 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:53.169344 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:53.169344 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:53.169344 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:53.169344 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:53.169344 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:53.173296 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 526/1071] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Aug 29 15:11:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:53.174546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00cdbd-099f-411e-8405-c51268d2ce47 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:53.223149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899f7b0-9e2b-4e13-99b3-8c9bc7d28fec None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:53.223426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899f7b0-9e2b-4e13-99b3-8c9bc7d28fec None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:53.223700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899f7b0-9e2b-4e13-99b3-8c9bc7d28fec None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:53.225041 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 527/1072] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:11:53.230283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df5e2-bd0c-438d-9ba2-31d631cbfc67 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:53.230562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df5e2-bd0c-438d-9ba2-31d631cbfc67 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:53.230833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df5e2-bd0c-438d-9ba2-31d631cbfc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:53.246015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:53.251002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2c8df5e2-bd0c-438d-9ba2-31d631cbfc67 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:53.252202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2c8df5e2-bd0c-438d-9ba2-31d631cbfc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:53.254419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:53.285031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00cdbd-099f-411e-8405-c51268d2ce47 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:53.320868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cce3e2-0b10-40ac-b883-4728b5b9c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:53.321509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce3e2-0b10-40ac-b883-4728b5b9c424 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:53.321796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce3e2-0b10-40ac-b883-4728b5b9c424 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:53.322071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce3e2-0b10-40ac-b883-4728b5b9c424 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:53.322902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cce3e2-0b10-40ac-b883-4728b5b9c424 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:53.323102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cce3e2-0b10-40ac-b883-4728b5b9c424 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:53.324529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cce3e2-0b10-40ac-b883-4728b5b9c424 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:53.330854 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 528/1073] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:11:53.347799 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 546/1074] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Aug 29 15:11:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:53.348939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8df5e2-bd0c-438d-9ba2-31d631cbfc67 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:53.448573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8df5e2-bd0c-438d-9ba2-31d631cbfc67 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:53.482270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab6600-d1fa-4983-9683-ed8fe0d30284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:53.482891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab6600-d1fa-4983-9683-ed8fe0d30284 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:53.483195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab6600-d1fa-4983-9683-ed8fe0d30284 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:53.483980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab6600-d1fa-4983-9683-ed8fe0d30284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:53.490585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:53.495586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab6600-d1fa-4983-9683-ed8fe0d30284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:53.497053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab6600-d1fa-4983-9683-ed8fe0d30284 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-0fab6600-d1fa-4983-9683-ed8fe0d30284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:53.515222 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:53.516501 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:53.517481 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:53.517481 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:53.517481 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:53.517481 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 529/1075] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:53.522480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cce3e2-0b10-40ac-b883-4728b5b9c424 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:53.601669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab6600-d1fa-4983-9683-ed8fe0d30284 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:53.635399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cce3e2-0b10-40ac-b883-4728b5b9c424 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:53.663406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:53.680064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e2ca9-5678-46d3-9a38-a7206bb67fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:53.680698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e2ca9-5678-46d3-9a38-a7206bb67fc4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:53.680977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e2ca9-5678-46d3-9a38-a7206bb67fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:53.681255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e2ca9-5678-46d3-9a38-a7206bb67fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:53.681955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e2ca9-5678-46d3-9a38-a7206bb67fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:53.682260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e2ca9-5678-46d3-9a38-a7206bb67fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:53.683723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e2ca9-5678-46d3-9a38-a7206bb67fc4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:53.696360 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 547/1076] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:53.702322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e2ca9-5678-46d3-9a38-a7206bb67fc4 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:53.720270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab6600-d1fa-4983-9683-ed8fe0d30284 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:53.759313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd7871-a3e4-41ba-bce3-bf53943a6c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:53.759962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd7871-a3e4-41ba-bce3-bf53943a6c26 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:53.760240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd7871-a3e4-41ba-bce3-bf53943a6c26 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:53.760506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd7871-a3e4-41ba-bce3-bf53943a6c26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:53.773793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd7871-a3e4-41ba-bce3-bf53943a6c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-59fd7871-a3e4-41ba-bce3-bf53943a6c26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:53.782213 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:53.783423 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:53.784669 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 530/1077] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:53.790262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd7871-a3e4-41ba-bce3-bf53943a6c26 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:53.822795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e2ca9-5678-46d3-9a38-a7206bb67fc4 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:53.845683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:53.865937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596326bc-ad16-4686-92c0-d503f8af4fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:53.866577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596326bc-ad16-4686-92c0-d503f8af4fe3 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:53.867339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596326bc-ad16-4686-92c0-d503f8af4fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:53.867339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596326bc-ad16-4686-92c0-d503f8af4fe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:53.875167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596326bc-ad16-4686-92c0-d503f8af4fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:53.876627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596326bc-ad16-4686-92c0-d503f8af4fe3 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-596326bc-ad16-4686-92c0-d503f8af4fe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:53.889502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:53.890899 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:53.892590 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:53.892590 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:53.892590 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:53.892590 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:53.892590 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:53.892590 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:53.892590 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:53.892590 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:53.892590 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 548/1078] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:53.896513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596326bc-ad16-4686-92c0-d503f8af4fe3 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:53.908494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd7871-a3e4-41ba-bce3-bf53943a6c26 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:53.949697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac5d9d-b962-4fd1-9cfc-fdb4cde8ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:53.949968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:53.950589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5d9d-b962-4fd1-9cfc-fdb4cde8ec6e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:53.950589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5d9d-b962-4fd1-9cfc-fdb4cde8ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:53.950891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5d9d-b962-4fd1-9cfc-fdb4cde8ec6e None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:53.951534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac5d9d-b962-4fd1-9cfc-fdb4cde8ec6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:53.952311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac5d9d-b962-4fd1-9cfc-fdb4cde8ec6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:53.953316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac5d9d-b962-4fd1-9cfc-fdb4cde8ec6e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:53.963769 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 531/1079] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:11:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:53.972634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac5d9d-b962-4fd1-9cfc-fdb4cde8ec6e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:54.022702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596326bc-ad16-4686-92c0-d503f8af4fe3 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:54.067985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884098de-8885-4cde-8358-18841ea6548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:54.068731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884098de-8885-4cde-8358-18841ea6548a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:54.069014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884098de-8885-4cde-8358-18841ea6548a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:54.069289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884098de-8885-4cde-8358-18841ea6548a None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:54.070044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884098de-8885-4cde-8358-18841ea6548a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:54.070421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884098de-8885-4cde-8358-18841ea6548a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:54.071865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884098de-8885-4cde-8358-18841ea6548a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:54.084666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac5d9d-b962-4fd1-9cfc-fdb4cde8ec6e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:54.086221 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 549/1080] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:54.093675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884098de-8885-4cde-8358-18841ea6548a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:54.101347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:54.124605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd60139-6e54-4dc1-b3f6-e187c53ba6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:54.125242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd60139-6e54-4dc1-b3f6-e187c53ba6b9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:54.125551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd60139-6e54-4dc1-b3f6-e187c53ba6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:54.125834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd60139-6e54-4dc1-b3f6-e187c53ba6b9 None admin] PATH_INFO: `/v3/users/b6f963e886224a648cccd66f4e50d0c0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:54.127041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd60139-6e54-4dc1-b3f6-e187c53ba6b9 None admin] RBAC: Authorizing `identity:get_user(user_id=b6f963e886224a648cccd66f4e50d0c0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:54.128476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd60139-6e54-4dc1-b3f6-e187c53ba6b9 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:54.130101 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 532/1081] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:11:53 2022] GET /identity/v3/users/b6f963e886224a648cccd66f4e50d0c0 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:54.136143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd60139-6e54-4dc1-b3f6-e187c53ba6b9 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:54.205491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884098de-8885-4cde-8358-18841ea6548a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:54.207807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:54.240485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd60139-6e54-4dc1-b3f6-e187c53ba6b9 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:54.245198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23442-a716-4411-8a8a-e4e4992aa6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:54.245897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23442-a716-4411-8a8a-e4e4992aa6e8 None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:54.246174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23442-a716-4411-8a8a-e4e4992aa6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:54.246470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23442-a716-4411-8a8a-e4e4992aa6e8 None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/c235251bc54848279759ba3e71a38306/roles/d41744ed4fd249de89a4caad1588843f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:54.248676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c23442-a716-4411-8a8a-e4e4992aa6e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=c235251bc54848279759ba3e71a38306, role_id=d41744ed4fd249de89a4caad1588843f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:54.250178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c23442-a716-4411-8a8a-e4e4992aa6e8 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:54.265594 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 550/1082] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:11:54 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/c235251bc54848279759ba3e71a38306/roles/d41744ed4fd249de89a4caad1588843f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:11:54.277519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c5953-86bb-45c4-9f54-75825c5d32b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:54.278179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c5953-86bb-45c4-9f54-75825c5d32b4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:54.278461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c5953-86bb-45c4-9f54-75825c5d32b4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:54.278730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c5953-86bb-45c4-9f54-75825c5d32b4 None admin] PATH_INFO: `/v3/projects/c4140b35dcc94a70b9139b6d33751c02` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:54.280522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c5953-86bb-45c4-9f54-75825c5d32b4 None admin] RBAC: Authorizing `identity:get_project(project_id=c4140b35dcc94a70b9139b6d33751c02)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:54.282345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c5953-86bb-45c4-9f54-75825c5d32b4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:54.284197 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 533/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:11:54 2022] GET /identity/v3/projects/c4140b35dcc94a70b9139b6d33751c02 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:54.291564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23442-a716-4411-8a8a-e4e4992aa6e8 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:54.449147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23442-a716-4411-8a8a-e4e4992aa6e8 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:54.485599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c9216-306d-4a0d-ae09-2e7740fa3ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:54.486179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9216-306d-4a0d-ae09-2e7740fa3ece None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:54.486456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9216-306d-4a0d-ae09-2e7740fa3ece None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:54.486732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9216-306d-4a0d-ae09-2e7740fa3ece None admin] PATH_INFO: `/v3/projects/c4140b35dcc94a70b9139b6d33751c02/users/b6f963e886224a648cccd66f4e50d0c0/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:54.488629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c9216-306d-4a0d-ae09-2e7740fa3ece None admin] RBAC: Authorizing `identity:create_grant(project_id=c4140b35dcc94a70b9139b6d33751c02, user_id=b6f963e886224a648cccd66f4e50d0c0, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:54.490092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c9216-306d-4a0d-ae09-2e7740fa3ece None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:54.507866 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 551/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:11:54 2022] PUT /identity/v3/projects/c4140b35dcc94a70b9139b6d33751c02/users/b6f963e886224a648cccd66f4e50d0c0/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:11:56.220180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb132b-1a87-40fe-9517-f78d58ccfb3c None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:56.220740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb132b-1a87-40fe-9517-f78d58ccfb3c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:56.220740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb132b-1a87-40fe-9517-f78d58ccfb3c None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:56.222292 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 534/1085] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:56.227860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cd49-4571-4862-8502-d2415cd810eb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:56.228389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cd49-4571-4862-8502-d2415cd810eb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:56.228389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cd49-4571-4862-8502-d2415cd810eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:56.247534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b464cd49-4571-4862-8502-d2415cd810eb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:56.248736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b464cd49-4571-4862-8502-d2415cd810eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:56.267917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:56.325920 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 552/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:56.437113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26053-4fc6-40e1-a827-7c6f3036bb38 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:56.437410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26053-4fc6-40e1-a827-7c6f3036bb38 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:56.437685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26053-4fc6-40e1-a827-7c6f3036bb38 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:56.439156 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 535/1087] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:11:56.444532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d4e18-cb18-434e-bd9e-1515b55b6575 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:56.444820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d4e18-cb18-434e-bd9e-1515b55b6575 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:56.445094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d4e18-cb18-434e-bd9e-1515b55b6575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:56.463672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-012d4e18-cb18-434e-bd9e-1515b55b6575 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:11:56.464861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-012d4e18-cb18-434e-bd9e-1515b55b6575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:11:56.537539 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 553/1088] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:11:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:11:56.595188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d26053-4fc6-40e1-a827-7c6f3036bb38 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:56.653923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:56.711080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d26053-4fc6-40e1-a827-7c6f3036bb38 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:56.746569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f25c-2418-489f-9343-354130f77bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:56.747196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f25c-2418-489f-9343-354130f77bcb None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:56.747474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f25c-2418-489f-9343-354130f77bcb None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:56.747744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f25c-2418-489f-9343-354130f77bcb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:56.758381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7f25c-2418-489f-9343-354130f77bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-41c7f25c-2418-489f-9343-354130f77bcb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:56.763395 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:56.765067 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:56.766071 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 536/1089] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Aug 29 15:11:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:56.771613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d4e18-cb18-434e-bd9e-1515b55b6575 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:56.809304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f25c-2418-489f-9343-354130f77bcb None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:56.867357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:56.885406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d4e18-cb18-434e-bd9e-1515b55b6575 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:56.939942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f25c-2418-489f-9343-354130f77bcb None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:56.940202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75440f-b597-41fc-bbf9-c151761ba527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:56.940937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75440f-b597-41fc-bbf9-c151761ba527 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:56.941372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75440f-b597-41fc-bbf9-c151761ba527 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:56.941849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75440f-b597-41fc-bbf9-c151761ba527 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:56.942939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75440f-b597-41fc-bbf9-c151761ba527 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:56.943443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75440f-b597-41fc-bbf9-c151761ba527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:56.945307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75440f-b597-41fc-bbf9-c151761ba527 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:56.956506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:56.958852 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 554/1090] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Aug 29 15:11:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:56.964803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75440f-b597-41fc-bbf9-c151761ba527 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:56.988074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e415bf8-124b-4128-b402-64af8e8b4c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:56.988709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e415bf8-124b-4128-b402-64af8e8b4c67 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:56.988986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e415bf8-124b-4128-b402-64af8e8b4c67 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:56.989255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e415bf8-124b-4128-b402-64af8e8b4c67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:57.001576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e415bf8-124b-4128-b402-64af8e8b4c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-8e415bf8-124b-4128-b402-64af8e8b4c67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:11:57.006459 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:57.007693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:11:57.009069 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 537/1091] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:11:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:57.013916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e415bf8-124b-4128-b402-64af8e8b4c67 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:57.073786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75440f-b597-41fc-bbf9-c151761ba527 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:57.110757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43b7b-8ea4-4c81-9694-44023e447997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:57.111402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43b7b-8ea4-4c81-9694-44023e447997 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:57.111683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43b7b-8ea4-4c81-9694-44023e447997 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:57.111960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43b7b-8ea4-4c81-9694-44023e447997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:57.122052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e415bf8-124b-4128-b402-64af8e8b4c67 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:57.123424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f43b7b-8ea4-4c81-9694-44023e447997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:57.124888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f43b7b-8ea4-4c81-9694-44023e447997 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:57.131810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-53f43b7b-8ea4-4c81-9694-44023e447997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:57.140071 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:57.141302 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:57.142572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:57.142572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:57.142572 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:57.142572 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 555/1092] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:57.148364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43b7b-8ea4-4c81-9694-44023e447997 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:57.161925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43627cf-ee5d-48d2-9e0a-df832540aa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:57.162528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43627cf-ee5d-48d2-9e0a-df832540aa67 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:57.162810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43627cf-ee5d-48d2-9e0a-df832540aa67 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:57.163110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43627cf-ee5d-48d2-9e0a-df832540aa67 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:57.163891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43627cf-ee5d-48d2-9e0a-df832540aa67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:57.164055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43627cf-ee5d-48d2-9e0a-df832540aa67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:57.165453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43627cf-ee5d-48d2-9e0a-df832540aa67 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:57.176817 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 538/1093] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:11:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:57.182886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43627cf-ee5d-48d2-9e0a-df832540aa67 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:57.216385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:57.254484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43b7b-8ea4-4c81-9694-44023e447997 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:57.287947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43627cf-ee5d-48d2-9e0a-df832540aa67 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:57.291872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f2041-8cad-401d-bf8d-538ddd629d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:57.292611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f2041-8cad-401d-bf8d-538ddd629d38 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:57.292989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f2041-8cad-401d-bf8d-538ddd629d38 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:57.293377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f2041-8cad-401d-bf8d-538ddd629d38 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:57.294178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f2041-8cad-401d-bf8d-538ddd629d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:57.294572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f2041-8cad-401d-bf8d-538ddd629d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:57.296655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f2041-8cad-401d-bf8d-538ddd629d38 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:57.309068 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 556/1094] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:57.314970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f2041-8cad-401d-bf8d-538ddd629d38 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:57.330506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c80f55-a318-4327-90b8-e3fddf1566ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:57.331068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c80f55-a318-4327-90b8-e3fddf1566ad None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:57.331343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c80f55-a318-4327-90b8-e3fddf1566ad None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:57.331618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c80f55-a318-4327-90b8-e3fddf1566ad None admin] PATH_INFO: `/v3/users/b6f963e886224a648cccd66f4e50d0c0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:57.332821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c80f55-a318-4327-90b8-e3fddf1566ad None admin] RBAC: Authorizing `identity:get_user(user_id=b6f963e886224a648cccd66f4e50d0c0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:57.334427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c80f55-a318-4327-90b8-e3fddf1566ad None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:57.336142 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 539/1095] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:11:57 2022] GET /identity/v3/users/b6f963e886224a648cccd66f4e50d0c0 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:57.342109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c80f55-a318-4327-90b8-e3fddf1566ad None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:57.382655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:57.429837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f2041-8cad-401d-bf8d-538ddd629d38 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:57.454233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:57.459103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c80f55-a318-4327-90b8-e3fddf1566ad None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:57.467274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560e5f5-c996-4b9c-8e52-a5d8eb213159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:57.468491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560e5f5-c996-4b9c-8e52-a5d8eb213159 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:57.468773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560e5f5-c996-4b9c-8e52-a5d8eb213159 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:57.469050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560e5f5-c996-4b9c-8e52-a5d8eb213159 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:57.476767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560e5f5-c996-4b9c-8e52-a5d8eb213159 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:57.478265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560e5f5-c996-4b9c-8e52-a5d8eb213159 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-b560e5f5-c996-4b9c-8e52-a5d8eb213159 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:11:57.490658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:57.491998 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:57.492972 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:57.492972 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:57.492972 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:11:57.492972 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:11:57.492972 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:11:57.492972 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:11:57.492972 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:11:57.492972 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:11:57.492972 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 15:11:57.492972 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:57.492972 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 557/1096] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Aug 29 15:11:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:57.498218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560e5f5-c996-4b9c-8e52-a5d8eb213159 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:57.503529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ae61c-0446-4b65-b720-9afc9914f054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:57.504142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ae61c-0446-4b65-b720-9afc9914f054 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:57.505348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ae61c-0446-4b65-b720-9afc9914f054 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:57.505653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ae61c-0446-4b65-b720-9afc9914f054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:57.611780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ae61c-0446-4b65-b720-9afc9914f054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:57.613184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ae61c-0446-4b65-b720-9afc9914f054 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:57.620403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560e5f5-c996-4b9c-8e52-a5d8eb213159 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:57.643448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:57.662200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8aa61-9999-4e57-a259-f0fee7d55983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:57.662820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8aa61-9999-4e57-a259-f0fee7d55983 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:57.663088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8aa61-9999-4e57-a259-f0fee7d55983 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:57.663358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8aa61-9999-4e57-a259-f0fee7d55983 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:57.664099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8aa61-9999-4e57-a259-f0fee7d55983 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:57.664411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8aa61-9999-4e57-a259-f0fee7d55983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:57.665899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8aa61-9999-4e57-a259-f0fee7d55983 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:57.688414 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 558/1097] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Aug 29 15:11:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:57.694147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8aa61-9999-4e57-a259-f0fee7d55983 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:57.722935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:57.729580 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 540/1098] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 15:11:57.734147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ae61c-0446-4b65-b720-9afc9914f054 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:57.800089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8aa61-9999-4e57-a259-f0fee7d55983 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:57.839377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557ac23-b5c9-4703-8fa8-06cc5874eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:57.839993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ac23-b5c9-4703-8fa8-06cc5874eba9 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:57.840209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ae61c-0446-4b65-b720-9afc9914f054 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:57.840325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ac23-b5c9-4703-8fa8-06cc5874eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:57.840537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ac23-b5c9-4703-8fa8-06cc5874eba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:57.889753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69d52a-2c2a-4f10-b65a-0935f3e1a5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:57.890289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69d52a-2c2a-4f10-b65a-0935f3e1a5fa None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:57.890569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69d52a-2c2a-4f10-b65a-0935f3e1a5fa None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:57.890843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69d52a-2c2a-4f10-b65a-0935f3e1a5fa None admin] PATH_INFO: `/v3/projects/c4140b35dcc94a70b9139b6d33751c02` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:57.891415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:57.896867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69d52a-2c2a-4f10-b65a-0935f3e1a5fa None admin] RBAC: Authorizing `identity:get_project(project_id=c4140b35dcc94a70b9139b6d33751c02)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:57.898448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69d52a-2c2a-4f10-b65a-0935f3e1a5fa None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:57.901609 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 541/1099] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:11:57 2022] GET /identity/v3/projects/c4140b35dcc94a70b9139b6d33751c02 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:57.908052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69d52a-2c2a-4f10-b65a-0935f3e1a5fa None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:57.929864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557ac23-b5c9-4703-8fa8-06cc5874eba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:57.931315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557ac23-b5c9-4703-8fa8-06cc5874eba9 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:58.002953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:58.044514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69d52a-2c2a-4f10-b65a-0935f3e1a5fa None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:58.053574 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 559/1100] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:11:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 15:11:58.056313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557ac23-b5c9-4703-8fa8-06cc5874eba9 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:58.082696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8ee76-407e-4b1e-95ab-7f53f25c540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:58.083307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8ee76-407e-4b1e-95ab-7f53f25c540e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:58.083584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8ee76-407e-4b1e-95ab-7f53f25c540e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:58.083851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8ee76-407e-4b1e-95ab-7f53f25c540e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:58.084592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8ee76-407e-4b1e-95ab-7f53f25c540e None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=c4140b35dcc94a70b9139b6d33751c02, user.id=b6f963e886224a648cccd66f4e50d0c0) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:58.084896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8ee76-407e-4b1e-95ab-7f53f25c540e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:58.086389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8ee76-407e-4b1e-95ab-7f53f25c540e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:58.092808 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 542/1101] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:57 2022] GET /identity/v3/role_assignments?user.id=b6f963e886224a648cccd66f4e50d0c0&scope.project.id=c4140b35dcc94a70b9139b6d33751c02&role.id=be89abac608f45a6921181bcc574f721 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:58.159612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:58.202603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557ac23-b5c9-4703-8fa8-06cc5874eba9 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:58.242998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367f198-b106-4d96-b851-f37aa6575d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:58.243632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f198-b106-4d96-b851-f37aa6575d44 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:58.243908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f198-b106-4d96-b851-f37aa6575d44 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:58.244176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f198-b106-4d96-b851-f37aa6575d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:58.256845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367f198-b106-4d96-b851-f37aa6575d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:58.259043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367f198-b106-4d96-b851-f37aa6575d44 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-d367f198-b106-4d96-b851-f37aa6575d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:11:58.278865 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:58.281651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:11:58.283142 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:11:58.283142 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:11:58.283142 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:58.283142 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 560/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:11:58.286857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8ee76-407e-4b1e-95ab-7f53f25c540e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:58.433766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8ee76-407e-4b1e-95ab-7f53f25c540e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:58.467245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:58.475001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35dcad-6284-429f-9c20-3983b6dbd7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:58.475630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35dcad-6284-429f-9c20-3983b6dbd7d9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:58.475926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35dcad-6284-429f-9c20-3983b6dbd7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:58.476195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35dcad-6284-429f-9c20-3983b6dbd7d9 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:58.476853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35dcad-6284-429f-9c20-3983b6dbd7d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:58.477150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35dcad-6284-429f-9c20-3983b6dbd7d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:58.478599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35dcad-6284-429f-9c20-3983b6dbd7d9 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:58.492978 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 543/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:11:58.499732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367f198-b106-4d96-b851-f37aa6575d44 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:58.626236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367f198-b106-4d96-b851-f37aa6575d44 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:58.660951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:11:58.670882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacae5d-28f1-4e8e-8279-272a46591dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:58.671525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacae5d-28f1-4e8e-8279-272a46591dcc None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:58.671803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacae5d-28f1-4e8e-8279-272a46591dcc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:58.672072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacae5d-28f1-4e8e-8279-272a46591dcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:58.679580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacae5d-28f1-4e8e-8279-272a46591dcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:58.681106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacae5d-28f1-4e8e-8279-272a46591dcc None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-adacae5d-28f1-4e8e-8279-272a46591dcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:11:58.695247 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:11:58.696219 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:11:58.697804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:11:58.697804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:11:58.697804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:11:58.697804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:11:58.697804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:11:58.697804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:11:58.697804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:11:58.697804 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:11:58.697804 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 561/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:11:58.702700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35dcad-6284-429f-9c20-3983b6dbd7d9 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:58.812189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35dcad-6284-429f-9c20-3983b6dbd7d9 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:58.861676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6a9c4-ff59-4904-b2ac-fb00191d9818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:58.862294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a9c4-ff59-4904-b2ac-fb00191d9818 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:58.862572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a9c4-ff59-4904-b2ac-fb00191d9818 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:58.862842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a9c4-ff59-4904-b2ac-fb00191d9818 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:58.863542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6a9c4-ff59-4904-b2ac-fb00191d9818 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:58.863845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6a9c4-ff59-4904-b2ac-fb00191d9818 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:58.865283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6a9c4-ff59-4904-b2ac-fb00191d9818 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:58.878157 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 544/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:11:58.884322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacae5d-28f1-4e8e-8279-272a46591dcc None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:11:58.999618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacae5d-28f1-4e8e-8279-272a46591dcc None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:11:59.036149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa117d-d05e-4752-8213-d6e47e182aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:11:59.036762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa117d-d05e-4752-8213-d6e47e182aff None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:11:59.037036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa117d-d05e-4752-8213-d6e47e182aff None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:11:59.037306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa117d-d05e-4752-8213-d6e47e182aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:11:59.038068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa117d-d05e-4752-8213-d6e47e182aff None admin] RBAC: Adding query filter params (role.id=d41744ed4fd249de89a4caad1588843f, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=c235251bc54848279759ba3e71a38306) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:11:59.038372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa117d-d05e-4752-8213-d6e47e182aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:11:59.039803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa117d-d05e-4752-8213-d6e47e182aff None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:11:59.046447 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 562/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:11:58 2022] GET /identity/v3/role_assignments?user.id=c235251bc54848279759ba3e71a38306&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=d41744ed4fd249de89a4caad1588843f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:00.102418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cdf2c-d580-4a98-8fa1-44c210759cec None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:00.102979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cdf2c-d580-4a98-8fa1-44c210759cec None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:00.102979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cdf2c-d580-4a98-8fa1-44c210759cec None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:00.104313 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 545/1107] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:12:00.111693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fcd23-bdad-4a1a-a93e-64f8189836b5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:00.112144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fcd23-bdad-4a1a-a93e-64f8189836b5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:00.112239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fcd23-bdad-4a1a-a93e-64f8189836b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:00.130857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b51fcd23-bdad-4a1a-a93e-64f8189836b5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:00.132054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b51fcd23-bdad-4a1a-a93e-64f8189836b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:00.181632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:00.203394 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 563/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:00.475409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cdf2c-d580-4a98-8fa1-44c210759cec None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:00.526796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:00.578885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cdf2c-d580-4a98-8fa1-44c210759cec None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:00.612357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823117-4562-4d4e-88d9-ca42f9e44484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:00.612997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823117-4562-4d4e-88d9-ca42f9e44484 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:00.613278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823117-4562-4d4e-88d9-ca42f9e44484 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:00.613578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823117-4562-4d4e-88d9-ca42f9e44484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:00.614715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823117-4562-4d4e-88d9-ca42f9e44484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:00.616191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823117-4562-4d4e-88d9-ca42f9e44484 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:00.617800 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 546/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:12:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:12:00.624464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fcd23-bdad-4a1a-a93e-64f8189836b5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:00.746596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fcd23-bdad-4a1a-a93e-64f8189836b5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:00.782562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff1bff-e25d-495f-ac30-c52107690f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:00.783178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff1bff-e25d-495f-ac30-c52107690f01 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:00.783457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff1bff-e25d-495f-ac30-c52107690f01 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:00.783728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff1bff-e25d-495f-ac30-c52107690f01 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:00.784407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff1bff-e25d-495f-ac30-c52107690f01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:00.785888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff1bff-e25d-495f-ac30-c52107690f01 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:00.807785 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 564/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:12:00 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:12:02.797736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6304a-420f-4c95-ad8f-c044c08a6e57 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:02.798270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6304a-420f-4c95-ad8f-c044c08a6e57 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:02.798270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6304a-420f-4c95-ad8f-c044c08a6e57 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:02.799546 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 547/1111] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:12:02.805684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc58e4a-8a0c-4e93-9a47-ac1fc5fe9671 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:02.806479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc58e4a-8a0c-4e93-9a47-ac1fc5fe9671 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:02.806635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc58e4a-8a0c-4e93-9a47-ac1fc5fe9671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:02.829283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-bfc58e4a-8a0c-4e93-9a47-ac1fc5fe9671 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:02.830699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bfc58e4a-8a0c-4e93-9a47-ac1fc5fe9671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:02.862919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:02.904105 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 565/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:03.174409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6304a-420f-4c95-ad8f-c044c08a6e57 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:03.289523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6304a-420f-4c95-ad8f-c044c08a6e57 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:03.312422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:03.336052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def27ac-0cd1-47d6-b7a7-016a2ab1f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:03.336694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def27ac-0cd1-47d6-b7a7-016a2ab1f723 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:03.336976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def27ac-0cd1-47d6-b7a7-016a2ab1f723 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:03.337253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def27ac-0cd1-47d6-b7a7-016a2ab1f723 None admin] PATH_INFO: `/v3/roles/066bc2c3c4ad43baaa2e35afdba859e5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:03.338772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def27ac-0cd1-47d6-b7a7-016a2ab1f723 None admin] RBAC: Authorizing `identity:get_role(role_id=066bc2c3c4ad43baaa2e35afdba859e5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:03.340161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def27ac-0cd1-47d6-b7a7-016a2ab1f723 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:03.341536 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 548/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:03 2022] GET /identity/v3/roles/066bc2c3c4ad43baaa2e35afdba859e5 => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:03.351025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc58e4a-8a0c-4e93-9a47-ac1fc5fe9671 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:03.508983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc58e4a-8a0c-4e93-9a47-ac1fc5fe9671 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:03.548060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249a9e-296f-4f92-a409-5ee40261924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:03.548759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249a9e-296f-4f92-a409-5ee40261924b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:03.549077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249a9e-296f-4f92-a409-5ee40261924b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:03.549425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249a9e-296f-4f92-a409-5ee40261924b None admin] PATH_INFO: `/v3/users/78c58273797e42ab99c9e9dc952ba030` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:03.564541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38249a9e-296f-4f92-a409-5ee40261924b None admin] RBAC: Authorizing `identity:get_user(user_id=78c58273797e42ab99c9e9dc952ba030)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:03.566117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38249a9e-296f-4f92-a409-5ee40261924b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:03.567905 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 566/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:03 2022] GET /identity/v3/users/78c58273797e42ab99c9e9dc952ba030 => generated 286 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:03.573939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def27ac-0cd1-47d6-b7a7-016a2ab1f723 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:03.697497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def27ac-0cd1-47d6-b7a7-016a2ab1f723 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:03.739336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97911d-8af3-4906-9b6a-195ccc9febab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:03.740035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97911d-8af3-4906-9b6a-195ccc9febab None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:03.740370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97911d-8af3-4906-9b6a-195ccc9febab None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:03.740698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97911d-8af3-4906-9b6a-195ccc9febab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:03.804708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:03.826200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97911d-8af3-4906-9b6a-195ccc9febab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:03.829490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97911d-8af3-4906-9b6a-195ccc9febab None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:03.999488 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 549/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:12:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:12:04.006025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249a9e-296f-4f92-a409-5ee40261924b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:04.040494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:04.132800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249a9e-296f-4f92-a409-5ee40261924b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:04.174498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081bb63-4a26-4917-bb27-0b3a561b5a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:04.175212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081bb63-4a26-4917-bb27-0b3a561b5a3a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:04.175560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081bb63-4a26-4917-bb27-0b3a561b5a3a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:04.175868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081bb63-4a26-4917-bb27-0b3a561b5a3a None admin] PATH_INFO: `/v3/projects/c4140b35dcc94a70b9139b6d33751c02` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:04.177273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081bb63-4a26-4917-bb27-0b3a561b5a3a None admin] RBAC: Authorizing `identity:get_project(project_id=c4140b35dcc94a70b9139b6d33751c02)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:04.179044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081bb63-4a26-4917-bb27-0b3a561b5a3a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:04.181169 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 567/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:12:04 2022] GET /identity/v3/projects/c4140b35dcc94a70b9139b6d33751c02 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:12:04.187830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97911d-8af3-4906-9b6a-195ccc9febab None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:04.280661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:04.300244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97911d-8af3-4906-9b6a-195ccc9febab None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:04.342010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19f07a-e2dc-42ea-9ab8-c73d134cbca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:04.342710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19f07a-e2dc-42ea-9ab8-c73d134cbca1 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:04.343564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19f07a-e2dc-42ea-9ab8-c73d134cbca1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:04.343838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19f07a-e2dc-42ea-9ab8-c73d134cbca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:04.344711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19f07a-e2dc-42ea-9ab8-c73d134cbca1 None admin] RBAC: Adding query filter params (role.id=066bc2c3c4ad43baaa2e35afdba859e5, scope.project.id=c4140b35dcc94a70b9139b6d33751c02, user.id=78c58273797e42ab99c9e9dc952ba030) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:04.345044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19f07a-e2dc-42ea-9ab8-c73d134cbca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:04.346786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19f07a-e2dc-42ea-9ab8-c73d134cbca1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:04.354150 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 550/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:12:04 2022] GET /identity/v3/role_assignments?user.id=78c58273797e42ab99c9e9dc952ba030&scope.project.id=c4140b35dcc94a70b9139b6d33751c02&role.id=066bc2c3c4ad43baaa2e35afdba859e5 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:06.274476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777eea02-c75b-446c-bd06-9b5645fc9377 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:06.275034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777eea02-c75b-446c-bd06-9b5645fc9377 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:06.275034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777eea02-c75b-446c-bd06-9b5645fc9377 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:06.276484 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 568/1118] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:12:06.283054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d9e32-ecc7-421e-9091-fd25bcdf1485 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:06.283550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d9e32-ecc7-421e-9091-fd25bcdf1485 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:06.283708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d9e32-ecc7-421e-9091-fd25bcdf1485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:06.303271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5d4d9e32-ecc7-421e-9091-fd25bcdf1485 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:06.304480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5d4d9e32-ecc7-421e-9091-fd25bcdf1485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:06.399929 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 551/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:12:06.680462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777eea02-c75b-446c-bd06-9b5645fc9377 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:06.780154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:06.788781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777eea02-c75b-446c-bd06-9b5645fc9377 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:06.823057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852a726-4da0-45b3-8b63-e0c6c250fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:06.823662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a726-4da0-45b3-8b63-e0c6c250fc1a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:06.824026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a726-4da0-45b3-8b63-e0c6c250fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:06.824340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a726-4da0-45b3-8b63-e0c6c250fc1a None admin] PATH_INFO: `/v3/roles/066bc2c3c4ad43baaa2e35afdba859e5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:06.826029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852a726-4da0-45b3-8b63-e0c6c250fc1a None admin] RBAC: Authorizing `identity:get_role(role_id=066bc2c3c4ad43baaa2e35afdba859e5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:06.827789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852a726-4da0-45b3-8b63-e0c6c250fc1a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:06.829435 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 569/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:06 2022] GET /identity/v3/roles/066bc2c3c4ad43baaa2e35afdba859e5 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:06.835523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d9e32-ecc7-421e-9091-fd25bcdf1485 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:06.958664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:06.991361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d9e32-ecc7-421e-9091-fd25bcdf1485 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:07.050005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65774215-c964-4bfc-99b4-afd6d1917ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:07.051046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65774215-c964-4bfc-99b4-afd6d1917ab8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:07.051521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65774215-c964-4bfc-99b4-afd6d1917ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:07.051993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65774215-c964-4bfc-99b4-afd6d1917ab8 None admin] PATH_INFO: `/v3/users/78c58273797e42ab99c9e9dc952ba030` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:07.053926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65774215-c964-4bfc-99b4-afd6d1917ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=78c58273797e42ab99c9e9dc952ba030)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:07.056558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65774215-c964-4bfc-99b4-afd6d1917ab8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:07.059629 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 552/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:06 2022] GET /identity/v3/users/78c58273797e42ab99c9e9dc952ba030 => generated 286 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:07.065429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852a726-4da0-45b3-8b63-e0c6c250fc1a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:07.173426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852a726-4da0-45b3-8b63-e0c6c250fc1a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:07.224685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908fcda-4262-4edd-bbcb-94a232e606b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:07.225846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908fcda-4262-4edd-bbcb-94a232e606b1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:07.226352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908fcda-4262-4edd-bbcb-94a232e606b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:07.226858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908fcda-4262-4edd-bbcb-94a232e606b1 None admin] PATH_INFO: `/v3/projects/c4140b35dcc94a70b9139b6d33751c02` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:07.228975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908fcda-4262-4edd-bbcb-94a232e606b1 None admin] RBAC: Authorizing `identity:get_project(project_id=c4140b35dcc94a70b9139b6d33751c02)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:07.231798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908fcda-4262-4edd-bbcb-94a232e606b1 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:07.235038 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 570/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:12:07 2022] GET /identity/v3/projects/c4140b35dcc94a70b9139b6d33751c02 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:07.241334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65774215-c964-4bfc-99b4-afd6d1917ab8 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:07.352549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65774215-c964-4bfc-99b4-afd6d1917ab8 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:07.390190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b7637-d77a-480f-9a9b-632d6e40ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:07.390998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b7637-d77a-480f-9a9b-632d6e40ac2a None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:07.391393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b7637-d77a-480f-9a9b-632d6e40ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:07.391753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b7637-d77a-480f-9a9b-632d6e40ac2a None admin] PATH_INFO: `/v3/projects/c4140b35dcc94a70b9139b6d33751c02/users/78c58273797e42ab99c9e9dc952ba030/roles/066bc2c3c4ad43baaa2e35afdba859e5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:07.394436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b7637-d77a-480f-9a9b-632d6e40ac2a None admin] RBAC: Authorizing `identity:create_grant(project_id=c4140b35dcc94a70b9139b6d33751c02, user_id=78c58273797e42ab99c9e9dc952ba030, role_id=066bc2c3c4ad43baaa2e35afdba859e5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:07.396051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b7637-d77a-480f-9a9b-632d6e40ac2a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:07.412878 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 553/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:12:07 2022] PUT /identity/v3/projects/c4140b35dcc94a70b9139b6d33751c02/users/78c58273797e42ab99c9e9dc952ba030/roles/066bc2c3c4ad43baaa2e35afdba859e5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:12:09.356020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d176f4-2abd-4c1b-be97-e1f5dea0c477 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:09.356586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d176f4-2abd-4c1b-be97-e1f5dea0c477 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:09.356586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d176f4-2abd-4c1b-be97-e1f5dea0c477 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:09.358053 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 571/1124] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:12:09.364790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bb5a8-c93c-47d0-a4f0-e2bd1fd6d205 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:09.365307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bb5a8-c93c-47d0-a4f0-e2bd1fd6d205 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:09.365670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bb5a8-c93c-47d0-a4f0-e2bd1fd6d205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:09.395137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c42bb5a8-c93c-47d0-a4f0-e2bd1fd6d205 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:09.397080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c42bb5a8-c93c-47d0-a4f0-e2bd1fd6d205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:09.400591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:09.514252 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 554/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:09.790822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d176f4-2abd-4c1b-be97-e1f5dea0c477 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:09.821694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:09.900630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d176f4-2abd-4c1b-be97-e1f5dea0c477 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:09.934879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e921f7-6632-45b1-b95b-ce5d08f1b262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:09.935505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e921f7-6632-45b1-b95b-ce5d08f1b262 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:09.935788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e921f7-6632-45b1-b95b-ce5d08f1b262 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:09.936063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e921f7-6632-45b1-b95b-ce5d08f1b262 None admin] PATH_INFO: `/v3/roles/066bc2c3c4ad43baaa2e35afdba859e5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:09.938005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e921f7-6632-45b1-b95b-ce5d08f1b262 None admin] RBAC: Authorizing `identity:get_role(role_id=066bc2c3c4ad43baaa2e35afdba859e5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:09.939370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e921f7-6632-45b1-b95b-ce5d08f1b262 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:09.940701 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 572/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:09 2022] GET /identity/v3/roles/066bc2c3c4ad43baaa2e35afdba859e5 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:09.946654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bb5a8-c93c-47d0-a4f0-e2bd1fd6d205 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:10.103389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bb5a8-c93c-47d0-a4f0-e2bd1fd6d205 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:10.137816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fca07-043d-48a5-87f5-27f1aa8ea80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:10.138443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fca07-043d-48a5-87f5-27f1aa8ea80b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:10.138725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fca07-043d-48a5-87f5-27f1aa8ea80b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:10.139003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fca07-043d-48a5-87f5-27f1aa8ea80b None admin] PATH_INFO: `/v3/users/78c58273797e42ab99c9e9dc952ba030` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:10.140704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fca07-043d-48a5-87f5-27f1aa8ea80b None admin] RBAC: Authorizing `identity:get_user(user_id=78c58273797e42ab99c9e9dc952ba030)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:10.142199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fca07-043d-48a5-87f5-27f1aa8ea80b None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:10.143782 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 555/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:09 2022] GET /identity/v3/users/78c58273797e42ab99c9e9dc952ba030 => generated 286 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:10.149703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e921f7-6632-45b1-b95b-ce5d08f1b262 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:10.246779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:10.251403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e921f7-6632-45b1-b95b-ce5d08f1b262 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:10.286913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bb7a3-68d6-4240-87a2-033b24f8838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:10.287531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bb7a3-68d6-4240-87a2-033b24f8838c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:10.287812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bb7a3-68d6-4240-87a2-033b24f8838c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:10.288086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bb7a3-68d6-4240-87a2-033b24f8838c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:10.357755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bb7a3-68d6-4240-87a2-033b24f8838c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:10.359700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bb7a3-68d6-4240-87a2-033b24f8838c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:10.469968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:10.474783 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 573/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:12:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:12:10.480758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fca07-043d-48a5-87f5-27f1aa8ea80b None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:10.490821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:10.584384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fca07-043d-48a5-87f5-27f1aa8ea80b None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:10.618334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c666ea-6d0b-45f5-8438-e7e1f66531b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:10.618879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c666ea-6d0b-45f5-8438-e7e1f66531b3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:10.619157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c666ea-6d0b-45f5-8438-e7e1f66531b3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:10.619428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c666ea-6d0b-45f5-8438-e7e1f66531b3 None admin] PATH_INFO: `/v3/projects/c4140b35dcc94a70b9139b6d33751c02` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:10.620540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c666ea-6d0b-45f5-8438-e7e1f66531b3 None admin] RBAC: Authorizing `identity:get_project(project_id=c4140b35dcc94a70b9139b6d33751c02)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:10.622005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c666ea-6d0b-45f5-8438-e7e1f66531b3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:10.623636 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 556/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:12:10 2022] GET /identity/v3/projects/c4140b35dcc94a70b9139b6d33751c02 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:10.629849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bb7a3-68d6-4240-87a2-033b24f8838c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:10.739502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bb7a3-68d6-4240-87a2-033b24f8838c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:10.774592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e75b1e-dd05-4060-b788-120e376e5e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:10.775204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75b1e-dd05-4060-b788-120e376e5e0d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:10.775484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75b1e-dd05-4060-b788-120e376e5e0d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:10.775758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75b1e-dd05-4060-b788-120e376e5e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:10.776484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e75b1e-dd05-4060-b788-120e376e5e0d None admin] RBAC: Adding query filter params (role.id=066bc2c3c4ad43baaa2e35afdba859e5, scope.project.id=c4140b35dcc94a70b9139b6d33751c02, user.id=78c58273797e42ab99c9e9dc952ba030) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:10.776790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e75b1e-dd05-4060-b788-120e376e5e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:10.778245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e75b1e-dd05-4060-b788-120e376e5e0d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:10.785369 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 574/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:12:10 2022] GET /identity/v3/role_assignments?user.id=78c58273797e42ab99c9e9dc952ba030&scope.project.id=c4140b35dcc94a70b9139b6d33751c02&role.id=066bc2c3c4ad43baaa2e35afdba859e5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:12.761676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fba15-0d66-4788-b5d8-5f2206525b7e None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:12.762213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fba15-0d66-4788-b5d8-5f2206525b7e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:12.762213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fba15-0d66-4788-b5d8-5f2206525b7e None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:12.763567 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 557/1131] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:12:12.769025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230988-08a0-4410-8ce4-4fe7fe154ea5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:12.769475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230988-08a0-4410-8ce4-4fe7fe154ea5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:12.769737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230988-08a0-4410-8ce4-4fe7fe154ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:12.789421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1f230988-08a0-4410-8ce4-4fe7fe154ea5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:12.790559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1f230988-08a0-4410-8ce4-4fe7fe154ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:12.856714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:12.869059 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 575/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:13.144526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fba15-0d66-4788-b5d8-5f2206525b7e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:13.224077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:13.251168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fba15-0d66-4788-b5d8-5f2206525b7e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:13.286636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515db18-4377-4b99-a86f-d6a5dbe490dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:13.287257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515db18-4377-4b99-a86f-d6a5dbe490dd None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:13.287538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515db18-4377-4b99-a86f-d6a5dbe490dd None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:13.287814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515db18-4377-4b99-a86f-d6a5dbe490dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:13.288939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515db18-4377-4b99-a86f-d6a5dbe490dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:13.290406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515db18-4377-4b99-a86f-d6a5dbe490dd None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:13.291994 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 558/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:12:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:13.298401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f230988-08a0-4410-8ce4-4fe7fe154ea5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:13.402838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f230988-08a0-4410-8ce4-4fe7fe154ea5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:13.440501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9013c-aa68-4b93-9ae6-9f30bc6e71da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:13.441108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9013c-aa68-4b93-9ae6-9f30bc6e71da None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:13.441412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9013c-aa68-4b93-9ae6-9f30bc6e71da None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:13.441695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9013c-aa68-4b93-9ae6-9f30bc6e71da None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:13.442360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9013c-aa68-4b93-9ae6-9f30bc6e71da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:13.443780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9013c-aa68-4b93-9ae6-9f30bc6e71da None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:13.472173 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 576/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:12:13 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:12:15.446158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0a992-c612-4396-8a4d-edd05991786a None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:15.446726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0a992-c612-4396-8a4d-edd05991786a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:15.446726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0a992-c612-4396-8a4d-edd05991786a None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:15.448015 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 559/1135] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:12:15.454034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6717e1-6ca3-4b8e-a801-ec05bf9adca7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:15.454500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6717e1-6ca3-4b8e-a801-ec05bf9adca7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:15.454635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6717e1-6ca3-4b8e-a801-ec05bf9adca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:15.473658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5a6717e1-6ca3-4b8e-a801-ec05bf9adca7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:15.474872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5a6717e1-6ca3-4b8e-a801-ec05bf9adca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:15.516545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:15.547325 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 577/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:15.819744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0a992-c612-4396-8a4d-edd05991786a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:15.926009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0a992-c612-4396-8a4d-edd05991786a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:15.964460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c052fe-fb9a-4a0d-ad21-f820d29608b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:15.965097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c052fe-fb9a-4a0d-ad21-f820d29608b7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:15.965380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c052fe-fb9a-4a0d-ad21-f820d29608b7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:15.965692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c052fe-fb9a-4a0d-ad21-f820d29608b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:15.966825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c052fe-fb9a-4a0d-ad21-f820d29608b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:15.968744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c052fe-fb9a-4a0d-ad21-f820d29608b7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:15.970361 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 560/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:12:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:15.976108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6717e1-6ca3-4b8e-a801-ec05bf9adca7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:16.078771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6717e1-6ca3-4b8e-a801-ec05bf9adca7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:16.114164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479516f-fa9a-4183-b3d1-053036245244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:16.114776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479516f-fa9a-4183-b3d1-053036245244 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:16.115054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479516f-fa9a-4183-b3d1-053036245244 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:16.115326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479516f-fa9a-4183-b3d1-053036245244 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:16.115997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479516f-fa9a-4183-b3d1-053036245244 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:16.117469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479516f-fa9a-4183-b3d1-053036245244 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:16.140727 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 578/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:12:15 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:12:18.128952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a462d-ed24-4747-bfa8-65b10c8f5121 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:18.129561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a462d-ed24-4747-bfa8-65b10c8f5121 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:18.129561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a462d-ed24-4747-bfa8-65b10c8f5121 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:18.131009 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 561/1139] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:12:18.137134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1ea8-a251-4f19-bc7d-9f80d99ac7e3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:18.137785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1ea8-a251-4f19-bc7d-9f80d99ac7e3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:18.137785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1ea8-a251-4f19-bc7d-9f80d99ac7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:18.158047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9d6f1ea8-a251-4f19-bc7d-9f80d99ac7e3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:18.159276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9d6f1ea8-a251-4f19-bc7d-9f80d99ac7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:18.184031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:18.234332 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 579/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:18.506053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a462d-ed24-4747-bfa8-65b10c8f5121 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:18.520832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:18.618667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a462d-ed24-4747-bfa8-65b10c8f5121 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:18.656783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bb717-fe2e-4b5b-a02a-e59d7c98e776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:18.657692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb717-fe2e-4b5b-a02a-e59d7c98e776 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:18.657971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb717-fe2e-4b5b-a02a-e59d7c98e776 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:18.658241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb717-fe2e-4b5b-a02a-e59d7c98e776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:18.669439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bb717-fe2e-4b5b-a02a-e59d7c98e776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-e23bb717-fe2e-4b5b-a02a-e59d7c98e776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:12:18.674872 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:12:18.676487 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:12:18.677559 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 562/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:12:18.682257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1ea8-a251-4f19-bc7d-9f80d99ac7e3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:18.797847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1ea8-a251-4f19-bc7d-9f80d99ac7e3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:18.834816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3254-3fad-4b4f-9e20-f3e21580a70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:18.835424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3254-3fad-4b4f-9e20-f3e21580a70c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:18.835709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3254-3fad-4b4f-9e20-f3e21580a70c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:18.835968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3254-3fad-4b4f-9e20-f3e21580a70c None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:18.836659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f3254-3fad-4b4f-9e20-f3e21580a70c None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:18.836951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f3254-3fad-4b4f-9e20-f3e21580a70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:18.838332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f3254-3fad-4b4f-9e20-f3e21580a70c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:18.847501 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 580/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:12:18.853458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bb717-fe2e-4b5b-a02a-e59d7c98e776 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:18.935085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:18.968847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bb717-fe2e-4b5b-a02a-e59d7c98e776 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:19.002184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82841cc3-e422-4c5e-82a6-d4ef8e3bc395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:19.002824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82841cc3-e422-4c5e-82a6-d4ef8e3bc395 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:19.003105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82841cc3-e422-4c5e-82a6-d4ef8e3bc395 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:19.003381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82841cc3-e422-4c5e-82a6-d4ef8e3bc395 None admin] PATH_INFO: `/v3/users/5c310db10f8d4124bc90a26d73061ae6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:19.018386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82841cc3-e422-4c5e-82a6-d4ef8e3bc395 None admin] RBAC: Authorizing `identity:get_user(user_id=5c310db10f8d4124bc90a26d73061ae6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:19.019902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82841cc3-e422-4c5e-82a6-d4ef8e3bc395 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:19.021671 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 563/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:18 2022] GET /identity/v3/users/5c310db10f8d4124bc90a26d73061ae6 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:19.027918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3254-3fad-4b4f-9e20-f3e21580a70c None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:19.055577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:19.134395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3254-3fad-4b4f-9e20-f3e21580a70c None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:19.167505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a0b54-3989-4eae-aa39-66037a63dd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:19.168164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0b54-3989-4eae-aa39-66037a63dd29 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:19.168369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0b54-3989-4eae-aa39-66037a63dd29 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:19.168648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0b54-3989-4eae-aa39-66037a63dd29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:19.235760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a0b54-3989-4eae-aa39-66037a63dd29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:19.237221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a0b54-3989-4eae-aa39-66037a63dd29 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:19.260133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:19.337456 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 581/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:12:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:12:19.344656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82841cc3-e422-4c5e-82a6-d4ef8e3bc395 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:19.467610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82841cc3-e422-4c5e-82a6-d4ef8e3bc395 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:19.502551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:19.510498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1bf15-039e-4fba-87a3-b971a2cf279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:19.511125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1bf15-039e-4fba-87a3-b971a2cf279c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:19.511397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1bf15-039e-4fba-87a3-b971a2cf279c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:19.511664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1bf15-039e-4fba-87a3-b971a2cf279c None admin] PATH_INFO: `/v3/projects/2c2a0c3b4f294ce98ba10cbb35d8ff17` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:19.512761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1bf15-039e-4fba-87a3-b971a2cf279c None admin] RBAC: Authorizing `identity:get_project(project_id=2c2a0c3b4f294ce98ba10cbb35d8ff17)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:19.514220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1bf15-039e-4fba-87a3-b971a2cf279c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:19.516374 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 564/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:12:19 2022] GET /identity/v3/projects/2c2a0c3b4f294ce98ba10cbb35d8ff17 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:19.522581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a0b54-3989-4eae-aa39-66037a63dd29 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:19.620552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a0b54-3989-4eae-aa39-66037a63dd29 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:19.643171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:19.656529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de3883-d2c5-4fd2-9e5c-527f097b2842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:19.657207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de3883-d2c5-4fd2-9e5c-527f097b2842 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:19.657693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de3883-d2c5-4fd2-9e5c-527f097b2842 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:19.658032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de3883-d2c5-4fd2-9e5c-527f097b2842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:19.658686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de3883-d2c5-4fd2-9e5c-527f097b2842 None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=2c2a0c3b4f294ce98ba10cbb35d8ff17, user.id=5c310db10f8d4124bc90a26d73061ae6) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:19.658994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de3883-d2c5-4fd2-9e5c-527f097b2842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:19.660416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de3883-d2c5-4fd2-9e5c-527f097b2842 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:19.665941 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 582/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:12:19 2022] GET /identity/v3/role_assignments?user.id=5c310db10f8d4124bc90a26d73061ae6&scope.project.id=2c2a0c3b4f294ce98ba10cbb35d8ff17&role.id=be89abac608f45a6921181bcc574f721 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:21.592557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be943-cb2b-4b79-a0d6-c80f8649c2b2 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:21.593419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be943-cb2b-4b79-a0d6-c80f8649c2b2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:21.593580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be943-cb2b-4b79-a0d6-c80f8649c2b2 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:21.594987 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 565/1147] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:12:21.600573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac16e0b-6328-4b20-9c82-ee7c37070c1c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:21.601047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac16e0b-6328-4b20-9c82-ee7c37070c1c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:21.601208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac16e0b-6328-4b20-9c82-ee7c37070c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:21.619565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8ac16e0b-6328-4b20-9c82-ee7c37070c1c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:21.620758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8ac16e0b-6328-4b20-9c82-ee7c37070c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:21.689275 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 583/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:21.954912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503be943-cb2b-4b79-a0d6-c80f8649c2b2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:22.060991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503be943-cb2b-4b79-a0d6-c80f8649c2b2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:22.096231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad672cc-1ff1-457c-9815-1599aaeda3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:22.096860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad672cc-1ff1-457c-9815-1599aaeda3b7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:22.097139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad672cc-1ff1-457c-9815-1599aaeda3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:22.097431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad672cc-1ff1-457c-9815-1599aaeda3b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:22.108265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad672cc-1ff1-457c-9815-1599aaeda3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-dad672cc-1ff1-457c-9815-1599aaeda3b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:12:22.113740 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:12:22.115579 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:12:22.117318 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 566/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:12:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:12:22.121119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac16e0b-6328-4b20-9c82-ee7c37070c1c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:22.223527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac16e0b-6328-4b20-9c82-ee7c37070c1c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:22.240207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:22.258621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62e2bc-c630-4936-9130-c93e7612c068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:22.259232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62e2bc-c630-4936-9130-c93e7612c068 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:22.259508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62e2bc-c630-4936-9130-c93e7612c068 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:22.259778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62e2bc-c630-4936-9130-c93e7612c068 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:22.260446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62e2bc-c630-4936-9130-c93e7612c068 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:22.260747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62e2bc-c630-4936-9130-c93e7612c068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:22.262147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62e2bc-c630-4936-9130-c93e7612c068 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:22.271052 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 584/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:22.277013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad672cc-1ff1-457c-9815-1599aaeda3b7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:22.337851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:22.391099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad672cc-1ff1-457c-9815-1599aaeda3b7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:22.427184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb997-ac92-469d-a171-6f3ff21091f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:22.427819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb997-ac92-469d-a171-6f3ff21091f6 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:22.428099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb997-ac92-469d-a171-6f3ff21091f6 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:22.428374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb997-ac92-469d-a171-6f3ff21091f6 None admin] PATH_INFO: `/v3/users/5c310db10f8d4124bc90a26d73061ae6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:22.429613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecb997-ac92-469d-a171-6f3ff21091f6 None admin] RBAC: Authorizing `identity:get_user(user_id=5c310db10f8d4124bc90a26d73061ae6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:22.431107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecb997-ac92-469d-a171-6f3ff21091f6 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:22.432865 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 567/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:22 2022] GET /identity/v3/users/5c310db10f8d4124bc90a26d73061ae6 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:22.441113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62e2bc-c630-4936-9130-c93e7612c068 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:22.550628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62e2bc-c630-4936-9130-c93e7612c068 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:22.586508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3348d3-204f-45db-8e38-bf94c34afe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:22.587143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3348d3-204f-45db-8e38-bf94c34afe52 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:22.587419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3348d3-204f-45db-8e38-bf94c34afe52 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:22.587694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3348d3-204f-45db-8e38-bf94c34afe52 None admin] PATH_INFO: `/v3/projects/2c2a0c3b4f294ce98ba10cbb35d8ff17` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:22.588817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3348d3-204f-45db-8e38-bf94c34afe52 None admin] RBAC: Authorizing `identity:get_project(project_id=2c2a0c3b4f294ce98ba10cbb35d8ff17)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:22.590279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3348d3-204f-45db-8e38-bf94c34afe52 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:22.591963 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 585/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:12:22 2022] GET /identity/v3/projects/2c2a0c3b4f294ce98ba10cbb35d8ff17 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:22.598299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb997-ac92-469d-a171-6f3ff21091f6 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:22.699461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb997-ac92-469d-a171-6f3ff21091f6 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:22.724870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:22.738331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1281a-9cea-45da-9e38-848371d18bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:22.739036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1281a-9cea-45da-9e38-848371d18bee None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:22.739315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1281a-9cea-45da-9e38-848371d18bee None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:22.739593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1281a-9cea-45da-9e38-848371d18bee None admin] PATH_INFO: `/v3/projects/2c2a0c3b4f294ce98ba10cbb35d8ff17/users/5c310db10f8d4124bc90a26d73061ae6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:22.741687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1281a-9cea-45da-9e38-848371d18bee None admin] RBAC: Authorizing `identity:create_grant(project_id=2c2a0c3b4f294ce98ba10cbb35d8ff17, user_id=5c310db10f8d4124bc90a26d73061ae6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:22.743137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1281a-9cea-45da-9e38-848371d18bee None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:22.759304 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 568/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:12:22 2022] PUT /identity/v3/projects/2c2a0c3b4f294ce98ba10cbb35d8ff17/users/5c310db10f8d4124bc90a26d73061ae6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:12:24.719014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0df343-3c5c-4f6c-a9e9-e0e067a99e3a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:24.719568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0df343-3c5c-4f6c-a9e9-e0e067a99e3a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:24.719568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0df343-3c5c-4f6c-a9e9-e0e067a99e3a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:24.721073 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 586/1154] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:12:24.726613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a80b-469c-4900-b6f1-827c517990b1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:24.727091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a80b-469c-4900-b6f1-827c517990b1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:24.727194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a80b-469c-4900-b6f1-827c517990b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:24.746390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0007a80b-469c-4900-b6f1-827c517990b1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:24.747587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0007a80b-469c-4900-b6f1-827c517990b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:24.824512 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 569/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:12:25.100395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0df343-3c5c-4f6c-a9e9-e0e067a99e3a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:25.149379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:25.205836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0df343-3c5c-4f6c-a9e9-e0e067a99e3a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:25.240455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee46618-5b51-4212-b120-b25241084185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:25.241087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46618-5b51-4212-b120-b25241084185 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:25.241365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46618-5b51-4212-b120-b25241084185 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:25.241666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46618-5b51-4212-b120-b25241084185 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:25.252908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee46618-5b51-4212-b120-b25241084185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-9ee46618-5b51-4212-b120-b25241084185 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:12:25.257835 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:12:25.259695 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:12:25.261378 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 587/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:12:25.265831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007a80b-469c-4900-b6f1-827c517990b1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:25.374925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007a80b-469c-4900-b6f1-827c517990b1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:25.390287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:25.413309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94686e78-7f81-44ed-ba6b-de825531aaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:25.413951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94686e78-7f81-44ed-ba6b-de825531aaf3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:25.414229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94686e78-7f81-44ed-ba6b-de825531aaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:25.414498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94686e78-7f81-44ed-ba6b-de825531aaf3 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:25.415163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94686e78-7f81-44ed-ba6b-de825531aaf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:25.415461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94686e78-7f81-44ed-ba6b-de825531aaf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:25.416836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94686e78-7f81-44ed-ba6b-de825531aaf3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:25.425502 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 570/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:12:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:25.431737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee46618-5b51-4212-b120-b25241084185 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:25.552385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee46618-5b51-4212-b120-b25241084185 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:25.559917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:25.589380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb574bfe-dc81-4dad-a09b-1cceebcec51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:25.590076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574bfe-dc81-4dad-a09b-1cceebcec51a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:25.590359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574bfe-dc81-4dad-a09b-1cceebcec51a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:25.590634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574bfe-dc81-4dad-a09b-1cceebcec51a None admin] PATH_INFO: `/v3/users/5c310db10f8d4124bc90a26d73061ae6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:25.591779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb574bfe-dc81-4dad-a09b-1cceebcec51a None admin] RBAC: Authorizing `identity:get_user(user_id=5c310db10f8d4124bc90a26d73061ae6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:25.593274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb574bfe-dc81-4dad-a09b-1cceebcec51a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:25.594933 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 588/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:25 2022] GET /identity/v3/users/5c310db10f8d4124bc90a26d73061ae6 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:12:25.601066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94686e78-7f81-44ed-ba6b-de825531aaf3 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:25.706284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94686e78-7f81-44ed-ba6b-de825531aaf3 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:25.739942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cb444-cc69-4afa-b4f4-4b815209a4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:25.740630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cb444-cc69-4afa-b4f4-4b815209a4ba None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:25.740812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cb444-cc69-4afa-b4f4-4b815209a4ba None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:25.741081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cb444-cc69-4afa-b4f4-4b815209a4ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:25.787612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:25.812415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cb444-cc69-4afa-b4f4-4b815209a4ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:25.813914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cb444-cc69-4afa-b4f4-4b815209a4ba None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:25.917672 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 571/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:12:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:12:25.927344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb574bfe-dc81-4dad-a09b-1cceebcec51a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:26.030987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb574bfe-dc81-4dad-a09b-1cceebcec51a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:26.065603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe9f49-7ea7-4eff-8d53-aa515f5d7476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:26.066235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe9f49-7ea7-4eff-8d53-aa515f5d7476 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:26.066517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe9f49-7ea7-4eff-8d53-aa515f5d7476 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:26.066793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe9f49-7ea7-4eff-8d53-aa515f5d7476 None admin] PATH_INFO: `/v3/projects/2c2a0c3b4f294ce98ba10cbb35d8ff17` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:26.067915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe9f49-7ea7-4eff-8d53-aa515f5d7476 None admin] RBAC: Authorizing `identity:get_project(project_id=2c2a0c3b4f294ce98ba10cbb35d8ff17)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:26.069348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe9f49-7ea7-4eff-8d53-aa515f5d7476 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:26.071016 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 589/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:12:25 2022] GET /identity/v3/projects/2c2a0c3b4f294ce98ba10cbb35d8ff17 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:26.077264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cb444-cc69-4afa-b4f4-4b815209a4ba None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:26.153237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:26.177461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cb444-cc69-4afa-b4f4-4b815209a4ba None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:26.214959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18018e77-0dd1-4ea7-a2c9-a7d9efd5e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:26.215559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018e77-0dd1-4ea7-a2c9-a7d9efd5e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:26.215838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018e77-0dd1-4ea7-a2c9-a7d9efd5e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:26.216109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018e77-0dd1-4ea7-a2c9-a7d9efd5e7d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:26.216835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18018e77-0dd1-4ea7-a2c9-a7d9efd5e7d4 None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=2c2a0c3b4f294ce98ba10cbb35d8ff17, user.id=5c310db10f8d4124bc90a26d73061ae6) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:26.217139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18018e77-0dd1-4ea7-a2c9-a7d9efd5e7d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:26.218797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18018e77-0dd1-4ea7-a2c9-a7d9efd5e7d4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:26.225307 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 572/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:12:26 2022] GET /identity/v3/role_assignments?user.id=5c310db10f8d4124bc90a26d73061ae6&scope.project.id=2c2a0c3b4f294ce98ba10cbb35d8ff17&role.id=be89abac608f45a6921181bcc574f721 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:28.198063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c1bd-e3bd-444a-b4a1-c36e33236936 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:28.198616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c1bd-e3bd-444a-b4a1-c36e33236936 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:28.198616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c1bd-e3bd-444a-b4a1-c36e33236936 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:28.199959 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 590/1162] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:12:28.205787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611d7bd-785f-4167-bb42-7823f1c14920 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:28.206229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611d7bd-785f-4167-bb42-7823f1c14920 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:28.206329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611d7bd-785f-4167-bb42-7823f1c14920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:28.224458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1611d7bd-785f-4167-bb42-7823f1c14920 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:28.225681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1611d7bd-785f-4167-bb42-7823f1c14920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:28.292769 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 573/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:28.565088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92c1bd-e3bd-444a-b4a1-c36e33236936 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:28.612607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:28.678140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92c1bd-e3bd-444a-b4a1-c36e33236936 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:28.714734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67203b1-566a-46bc-9bdd-67114c8b6c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:28.715357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67203b1-566a-46bc-9bdd-67114c8b6c02 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:28.715637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67203b1-566a-46bc-9bdd-67114c8b6c02 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:28.715911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67203b1-566a-46bc-9bdd-67114c8b6c02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:28.790902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67203b1-566a-46bc-9bdd-67114c8b6c02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:28.792273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67203b1-566a-46bc-9bdd-67114c8b6c02 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:28.837400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:28.901091 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 591/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:12:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 15:12:28.908149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611d7bd-785f-4167-bb42-7823f1c14920 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:28.991656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:29.033751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611d7bd-785f-4167-bb42-7823f1c14920 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:29.068814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe51bf-564a-4779-8b6c-fa619a5a60a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:29.069358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe51bf-564a-4779-8b6c-fa619a5a60a7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:29.069669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe51bf-564a-4779-8b6c-fa619a5a60a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:29.069939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe51bf-564a-4779-8b6c-fa619a5a60a7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:29.077540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe51bf-564a-4779-8b6c-fa619a5a60a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:29.078983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe51bf-564a-4779-8b6c-fa619a5a60a7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-c6fe51bf-564a-4779-8b6c-fa619a5a60a7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:12:29.090638 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:12:29.092639 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:12:29.093614 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 574/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Aug 29 15:12:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:12:29.101314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67203b1-566a-46bc-9bdd-67114c8b6c02 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:29.268491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67203b1-566a-46bc-9bdd-67114c8b6c02 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:29.326179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67904a34-73d1-4c21-91e7-676d38040f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:29.327242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904a34-73d1-4c21-91e7-676d38040f5c None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:29.327523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904a34-73d1-4c21-91e7-676d38040f5c None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:29.327796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904a34-73d1-4c21-91e7-676d38040f5c None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:29.328448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67904a34-73d1-4c21-91e7-676d38040f5c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:29.328749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67904a34-73d1-4c21-91e7-676d38040f5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:29.330144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67904a34-73d1-4c21-91e7-676d38040f5c None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:29.338702 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 592/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Aug 29 15:12:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:31.289906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a4020-16c2-4998-a610-465f9328043b None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:31.290453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a4020-16c2-4998-a610-465f9328043b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:31.290453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a4020-16c2-4998-a610-465f9328043b None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:31.291774 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 575/1167] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:12:31.297998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981732bd-4dde-4aad-b175-1687efbc59c6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:31.298923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981732bd-4dde-4aad-b175-1687efbc59c6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:31.298923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981732bd-4dde-4aad-b175-1687efbc59c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:31.311914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:31.320196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-981732bd-4dde-4aad-b175-1687efbc59c6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:31.321418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-981732bd-4dde-4aad-b175-1687efbc59c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:31.391952 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 593/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:31.661711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a4020-16c2-4998-a610-465f9328043b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:31.766423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a4020-16c2-4998-a610-465f9328043b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:31.795478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:31.802202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6e360-b6ee-4346-8b54-5d5b7afd0766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:31.802808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6e360-b6ee-4346-8b54-5d5b7afd0766 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:31.803089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6e360-b6ee-4346-8b54-5d5b7afd0766 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:31.803362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6e360-b6ee-4346-8b54-5d5b7afd0766 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:31.804030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6e360-b6ee-4346-8b54-5d5b7afd0766 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:31.805447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6e360-b6ee-4346-8b54-5d5b7afd0766 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:31.822973 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 576/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Mon Aug 29 15:12:31 2022] POST /identity/v3/domains => generated 267 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:12:33.816649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943bb55-3161-43eb-9cdf-1d2fed2f180e None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:33.817297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943bb55-3161-43eb-9cdf-1d2fed2f180e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:33.817297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943bb55-3161-43eb-9cdf-1d2fed2f180e None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:33.818583 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 594/1170] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:12:33.823847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811378-6781-429b-8504-28e0dc500589 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:33.824276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811378-6781-429b-8504-28e0dc500589 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:33.824368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811378-6781-429b-8504-28e0dc500589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:33.843028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-52811378-6781-429b-8504-28e0dc500589 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:33.844222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-52811378-6781-429b-8504-28e0dc500589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:33.921748 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 577/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:34.189804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943bb55-3161-43eb-9cdf-1d2fed2f180e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:34.292224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943bb55-3161-43eb-9cdf-1d2fed2f180e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:34.327627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d87ccd-7514-4b26-9db7-b411c898366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:34.328364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d87ccd-7514-4b26-9db7-b411c898366b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:34.328696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d87ccd-7514-4b26-9db7-b411c898366b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:34.329028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d87ccd-7514-4b26-9db7-b411c898366b None admin] PATH_INFO: `/v3/domains/d44c4efe749a4c2d8e35c1845595267d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:34.332505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:34.343548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d87ccd-7514-4b26-9db7-b411c898366b None admin] RBAC: Authorizing `identity:get_domain(domain_id=d44c4efe749a4c2d8e35c1845595267d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:34.346073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d87ccd-7514-4b26-9db7-b411c898366b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:34.349065 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 595/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Aug 29 15:12:34 2022] GET /identity/v3/domains/d44c4efe749a4c2d8e35c1845595267d => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:34.354989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52811378-6781-429b-8504-28e0dc500589 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:34.468790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52811378-6781-429b-8504-28e0dc500589 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:34.489596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:34.506053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744086b-28e1-4664-b110-13aa596be82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:34.506661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744086b-28e1-4664-b110-13aa596be82b None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:34.506930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744086b-28e1-4664-b110-13aa596be82b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:34.507196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744086b-28e1-4664-b110-13aa596be82b None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:34.507856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744086b-28e1-4664-b110-13aa596be82b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:34.509293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744086b-28e1-4664-b110-13aa596be82b None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:34.538433 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 578/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:12:34 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:12:36.507023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69daf9-90dc-45aa-995c-d077e77be30a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:36.507571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69daf9-90dc-45aa-995c-d077e77be30a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:36.507571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69daf9-90dc-45aa-995c-d077e77be30a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:36.508882 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 596/1174] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:12:36.514189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72499bf8-8a25-4226-9358-84a6b1791a99 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:36.514632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72499bf8-8a25-4226-9358-84a6b1791a99 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:36.514735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72499bf8-8a25-4226-9358-84a6b1791a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:36.533966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-72499bf8-8a25-4226-9358-84a6b1791a99 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:36.535796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-72499bf8-8a25-4226-9358-84a6b1791a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:36.615258 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 579/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:36.883200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69daf9-90dc-45aa-995c-d077e77be30a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:36.987097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69daf9-90dc-45aa-995c-d077e77be30a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:37.021910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299ad82-3a8e-43ab-b69a-4dd046b6603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:37.022553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ad82-3a8e-43ab-b69a-4dd046b6603e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:37.022828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ad82-3a8e-43ab-b69a-4dd046b6603e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:37.023099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ad82-3a8e-43ab-b69a-4dd046b6603e None admin] PATH_INFO: `/v3/domains/d44c4efe749a4c2d8e35c1845595267d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:37.024219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299ad82-3a8e-43ab-b69a-4dd046b6603e None admin] RBAC: Authorizing `identity:get_domain(domain_id=d44c4efe749a4c2d8e35c1845595267d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:37.025677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299ad82-3a8e-43ab-b69a-4dd046b6603e None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:37.027267 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 597/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Aug 29 15:12:36 2022] GET /identity/v3/domains/d44c4efe749a4c2d8e35c1845595267d => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:37.033265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72499bf8-8a25-4226-9358-84a6b1791a99 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:37.134477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72499bf8-8a25-4226-9358-84a6b1791a99 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:37.135969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:37.173348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec47d-5b9b-4d6e-8d70-f2bb667b3be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:37.173972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec47d-5b9b-4d6e-8d70-f2bb667b3be9 None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:37.174252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec47d-5b9b-4d6e-8d70-f2bb667b3be9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:37.174527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec47d-5b9b-4d6e-8d70-f2bb667b3be9 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:37.175181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ec47d-5b9b-4d6e-8d70-f2bb667b3be9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:37.176617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ec47d-5b9b-4d6e-8d70-f2bb667b3be9 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:37.198337 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 580/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:12:37 2022] POST /identity/v3/users => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:12:39.187308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910051b-fa18-4951-9024-9bfdd2be4e6b None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:39.187864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910051b-fa18-4951-9024-9bfdd2be4e6b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:39.187864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910051b-fa18-4951-9024-9bfdd2be4e6b None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:39.189202 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 598/1178] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:12:39.194854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861494b-1769-48ac-9e11-15d628d51ae7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:39.195331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861494b-1769-48ac-9e11-15d628d51ae7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:39.195442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861494b-1769-48ac-9e11-15d628d51ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:39.213453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f861494b-1769-48ac-9e11-15d628d51ae7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:39.214647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f861494b-1769-48ac-9e11-15d628d51ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:39.283412 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 581/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:39.556993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910051b-fa18-4951-9024-9bfdd2be4e6b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:39.623347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:39.669361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910051b-fa18-4951-9024-9bfdd2be4e6b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:39.706616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276834-d89c-4cf3-8507-e82af5a905e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:39.707271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276834-d89c-4cf3-8507-e82af5a905e0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:39.707551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276834-d89c-4cf3-8507-e82af5a905e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:39.707828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276834-d89c-4cf3-8507-e82af5a905e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:39.721496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1276834-d89c-4cf3-8507-e82af5a905e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-f1276834-d89c-4cf3-8507-e82af5a905e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:12:39.726588 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:12:39.727799 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:12:39.728664 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 599/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:12:39.734348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861494b-1769-48ac-9e11-15d628d51ae7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:39.828230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:39.840907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861494b-1769-48ac-9e11-15d628d51ae7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:39.876316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c8f7-79b7-4f09-835c-876e037cfe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:39.876917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c8f7-79b7-4f09-835c-876e037cfe11 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:39.877196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c8f7-79b7-4f09-835c-876e037cfe11 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:39.877500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c8f7-79b7-4f09-835c-876e037cfe11 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:39.878175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7c8f7-79b7-4f09-835c-876e037cfe11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:39.878477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7c8f7-79b7-4f09-835c-876e037cfe11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:39.879846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7c8f7-79b7-4f09-835c-876e037cfe11 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:39.889718 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 582/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:39.895713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276834-d89c-4cf3-8507-e82af5a905e0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:40.005944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276834-d89c-4cf3-8507-e82af5a905e0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:40.030538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:40.041781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc35700-9eec-49b9-b9f8-184563d7abb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:40.042412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc35700-9eec-49b9-b9f8-184563d7abb4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:40.042691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc35700-9eec-49b9-b9f8-184563d7abb4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:40.042994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc35700-9eec-49b9-b9f8-184563d7abb4 None admin] PATH_INFO: `/v3/users/bbcd38dae6414264be0181a894bd54dc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:40.056351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc35700-9eec-49b9-b9f8-184563d7abb4 None admin] RBAC: Authorizing `identity:get_user(user_id=bbcd38dae6414264be0181a894bd54dc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:40.057837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc35700-9eec-49b9-b9f8-184563d7abb4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:40.060019 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 600/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:39 2022] GET /identity/v3/users/bbcd38dae6414264be0181a894bd54dc => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:40.066250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c8f7-79b7-4f09-835c-876e037cfe11 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:40.174854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c8f7-79b7-4f09-835c-876e037cfe11 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:40.225713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b35ca2-8760-4018-bfb9-8bf5f9ed73fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:40.226368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35ca2-8760-4018-bfb9-8bf5f9ed73fb None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:40.226577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35ca2-8760-4018-bfb9-8bf5f9ed73fb None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:40.226842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35ca2-8760-4018-bfb9-8bf5f9ed73fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:40.250362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:40.299666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b35ca2-8760-4018-bfb9-8bf5f9ed73fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:40.301124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b35ca2-8760-4018-bfb9-8bf5f9ed73fb None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:40.401127 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 583/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:12:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:12:40.407557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc35700-9eec-49b9-b9f8-184563d7abb4 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:40.512698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc35700-9eec-49b9-b9f8-184563d7abb4 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:40.549241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8ceea-951b-4a33-ba07-94135047d6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:40.549910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8ceea-951b-4a33-ba07-94135047d6fd None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:40.550187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8ceea-951b-4a33-ba07-94135047d6fd None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:40.550460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8ceea-951b-4a33-ba07-94135047d6fd None admin] PATH_INFO: `/v3/projects/a70d89f513df4f9aa77bd63a8ff95c37` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:40.551603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8ceea-951b-4a33-ba07-94135047d6fd None admin] RBAC: Authorizing `identity:get_project(project_id=a70d89f513df4f9aa77bd63a8ff95c37)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:40.553058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8ceea-951b-4a33-ba07-94135047d6fd None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:40.554735 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 601/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:12:40 2022] GET /identity/v3/projects/a70d89f513df4f9aa77bd63a8ff95c37 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:40.561735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b35ca2-8760-4018-bfb9-8bf5f9ed73fb None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:40.613025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:40.664072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b35ca2-8760-4018-bfb9-8bf5f9ed73fb None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:40.698873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e004954-e5b5-421f-b693-82314746f1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:40.699525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e004954-e5b5-421f-b693-82314746f1df None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:40.699804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e004954-e5b5-421f-b693-82314746f1df None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:40.700211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e004954-e5b5-421f-b693-82314746f1df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:40.701067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e004954-e5b5-421f-b693-82314746f1df None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=a70d89f513df4f9aa77bd63a8ff95c37, user.id=bbcd38dae6414264be0181a894bd54dc) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:40.701376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e004954-e5b5-421f-b693-82314746f1df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:40.702859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e004954-e5b5-421f-b693-82314746f1df None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:40.708827 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 584/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:12:40 2022] GET /identity/v3/role_assignments?user.id=bbcd38dae6414264be0181a894bd54dc&scope.project.id=a70d89f513df4f9aa77bd63a8ff95c37&role.id=be89abac608f45a6921181bcc574f721 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:42.663357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57237-cc34-4f44-8f83-8f22c48c4c54 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:42.663913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57237-cc34-4f44-8f83-8f22c48c4c54 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:42.663913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57237-cc34-4f44-8f83-8f22c48c4c54 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:42.665242 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 602/1186] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:12:42.671240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a66f8b-8fbf-43b4-acd1-245297815b18 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:42.671656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a66f8b-8fbf-43b4-acd1-245297815b18 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:42.671782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a66f8b-8fbf-43b4-acd1-245297815b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:42.691817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-73a66f8b-8fbf-43b4-acd1-245297815b18 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:42.692995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-73a66f8b-8fbf-43b4-acd1-245297815b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:42.761816 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 585/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:43.032531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b57237-cc34-4f44-8f83-8f22c48c4c54 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:43.085118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:43.138106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b57237-cc34-4f44-8f83-8f22c48c4c54 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:43.181303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010144ee-d395-4edc-a68b-90f24ecd5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:43.181964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010144ee-d395-4edc-a68b-90f24ecd5990 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:43.182243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010144ee-d395-4edc-a68b-90f24ecd5990 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:43.182517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010144ee-d395-4edc-a68b-90f24ecd5990 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:43.196248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010144ee-d395-4edc-a68b-90f24ecd5990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-010144ee-d395-4edc-a68b-90f24ecd5990 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:12:43.202930 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:12:43.204037 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:12:43.205203 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 603/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:12:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:12:43.211068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a66f8b-8fbf-43b4-acd1-245297815b18 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:43.258232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:43.319379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a66f8b-8fbf-43b4-acd1-245297815b18 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:43.355910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd17c-c1f6-4d14-9c42-79d274215dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:43.356518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd17c-c1f6-4d14-9c42-79d274215dee None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:43.356793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd17c-c1f6-4d14-9c42-79d274215dee None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:43.357059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd17c-c1f6-4d14-9c42-79d274215dee None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:43.357770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dd17c-c1f6-4d14-9c42-79d274215dee None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:43.358072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dd17c-c1f6-4d14-9c42-79d274215dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:43.359440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dd17c-c1f6-4d14-9c42-79d274215dee None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:43.368353 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 586/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:12:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:12:43.374931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010144ee-d395-4edc-a68b-90f24ecd5990 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:43.483129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010144ee-d395-4edc-a68b-90f24ecd5990 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:43.495355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:43.521278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a0548-6796-4fcc-9551-256a9f622e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:43.521944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a0548-6796-4fcc-9551-256a9f622e1f None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:43.522230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a0548-6796-4fcc-9551-256a9f622e1f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:43.522505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a0548-6796-4fcc-9551-256a9f622e1f None admin] PATH_INFO: `/v3/users/bbcd38dae6414264be0181a894bd54dc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:43.523686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a0548-6796-4fcc-9551-256a9f622e1f None admin] RBAC: Authorizing `identity:get_user(user_id=bbcd38dae6414264be0181a894bd54dc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:43.525116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a0548-6796-4fcc-9551-256a9f622e1f None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:43.527366 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 604/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:43 2022] GET /identity/v3/users/bbcd38dae6414264be0181a894bd54dc => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:43.533738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd17c-c1f6-4d14-9c42-79d274215dee None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:43.641616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd17c-c1f6-4d14-9c42-79d274215dee None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:43.648981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:43.676925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49053d23-97f9-4b64-a0a3-c70af68d5e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:43.677606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49053d23-97f9-4b64-a0a3-c70af68d5e3c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:43.677855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49053d23-97f9-4b64-a0a3-c70af68d5e3c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:43.678131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49053d23-97f9-4b64-a0a3-c70af68d5e3c None admin] PATH_INFO: `/v3/projects/a70d89f513df4f9aa77bd63a8ff95c37` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:43.679292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49053d23-97f9-4b64-a0a3-c70af68d5e3c None admin] RBAC: Authorizing `identity:get_project(project_id=a70d89f513df4f9aa77bd63a8ff95c37)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:43.680726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49053d23-97f9-4b64-a0a3-c70af68d5e3c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:43.682407 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 587/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:12:43 2022] GET /identity/v3/projects/a70d89f513df4f9aa77bd63a8ff95c37 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:12:43.689102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a0548-6796-4fcc-9551-256a9f622e1f None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:43.796802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a0548-6796-4fcc-9551-256a9f622e1f None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:43.836489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e43d9f-7723-432c-b400-52548777642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:43.837217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43d9f-7723-432c-b400-52548777642f None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:43.837614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43d9f-7723-432c-b400-52548777642f None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:43.837903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43d9f-7723-432c-b400-52548777642f None admin] PATH_INFO: `/v3/projects/a70d89f513df4f9aa77bd63a8ff95c37/users/bbcd38dae6414264be0181a894bd54dc/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:43.840043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e43d9f-7723-432c-b400-52548777642f None admin] RBAC: Authorizing `identity:create_grant(project_id=a70d89f513df4f9aa77bd63a8ff95c37, user_id=bbcd38dae6414264be0181a894bd54dc, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:43.841596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e43d9f-7723-432c-b400-52548777642f None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:43.866164 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 605/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:12:43 2022] PUT /identity/v3/projects/a70d89f513df4f9aa77bd63a8ff95c37/users/bbcd38dae6414264be0181a894bd54dc/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:12:45.800450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60cc3-f5d9-497b-a651-6296dcae9e41 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:45.800985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60cc3-f5d9-497b-a651-6296dcae9e41 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:45.800985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60cc3-f5d9-497b-a651-6296dcae9e41 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:45.802351 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 588/1193] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:12:45.808713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710be94-854d-4db6-9d88-b369334eea63 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:45.809220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710be94-854d-4db6-9d88-b369334eea63 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:45.809309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710be94-854d-4db6-9d88-b369334eea63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:45.832853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1710be94-854d-4db6-9d88-b369334eea63 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:12:45.834096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1710be94-854d-4db6-9d88-b369334eea63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:12:45.867193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:45.909299 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 606/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:12:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:12:46.189430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d60cc3-f5d9-497b-a651-6296dcae9e41 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:46.314854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d60cc3-f5d9-497b-a651-6296dcae9e41 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:46.350686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c23ccd-9586-4989-83d4-fb83d2d8187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:46.351360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c23ccd-9586-4989-83d4-fb83d2d8187d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:46.351679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c23ccd-9586-4989-83d4-fb83d2d8187d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:46.351992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c23ccd-9586-4989-83d4-fb83d2d8187d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:46.363230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c23ccd-9586-4989-83d4-fb83d2d8187d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-f8c23ccd-9586-4989-83d4-fb83d2d8187d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:12:46.368005 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:12:46.369142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:12:46.370271 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 589/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:12:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:12:46.375267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710be94-854d-4db6-9d88-b369334eea63 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:46.501662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710be94-854d-4db6-9d88-b369334eea63 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:46.541703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12f54b-e137-4b6a-8e51-882792770ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:46.542685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f54b-e137-4b6a-8e51-882792770ffc None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:46.542967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f54b-e137-4b6a-8e51-882792770ffc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:46.543236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f54b-e137-4b6a-8e51-882792770ffc None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:46.543910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12f54b-e137-4b6a-8e51-882792770ffc None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:46.544211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12f54b-e137-4b6a-8e51-882792770ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:46.545633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12f54b-e137-4b6a-8e51-882792770ffc None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:46.555126 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 607/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:12:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:46.561623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c23ccd-9586-4989-83d4-fb83d2d8187d None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:46.605531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:46.681712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c23ccd-9586-4989-83d4-fb83d2d8187d None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:46.718079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb159c36-88be-4b22-973b-8ec74945be6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:46.718710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159c36-88be-4b22-973b-8ec74945be6c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:46.718993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159c36-88be-4b22-973b-8ec74945be6c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:46.719269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159c36-88be-4b22-973b-8ec74945be6c None admin] PATH_INFO: `/v3/users/bbcd38dae6414264be0181a894bd54dc` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:46.720426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb159c36-88be-4b22-973b-8ec74945be6c None admin] RBAC: Authorizing `identity:get_user(user_id=bbcd38dae6414264be0181a894bd54dc)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:46.721910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb159c36-88be-4b22-973b-8ec74945be6c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:46.723573 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 590/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Aug 29 15:12:46 2022] GET /identity/v3/users/bbcd38dae6414264be0181a894bd54dc => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:46.730384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12f54b-e137-4b6a-8e51-882792770ffc None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:46.766843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:46.840172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12f54b-e137-4b6a-8e51-882792770ffc None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:46.874951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8e990-c877-40e5-8d7d-faad3f092408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:46.875561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8e990-c877-40e5-8d7d-faad3f092408 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:46.875842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8e990-c877-40e5-8d7d-faad3f092408 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:46.876118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8e990-c877-40e5-8d7d-faad3f092408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:46.946757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8e990-c877-40e5-8d7d-faad3f092408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:46.948743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8e990-c877-40e5-8d7d-faad3f092408 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:46.979327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:47.061155 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 608/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:12:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:12:47.070910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb159c36-88be-4b22-973b-8ec74945be6c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:47.193263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb159c36-88be-4b22-973b-8ec74945be6c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:47.196190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:47.247054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647301d8-05ca-46de-b39c-acc8786efc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:47.247761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647301d8-05ca-46de-b39c-acc8786efc14 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:47.248119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647301d8-05ca-46de-b39c-acc8786efc14 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:47.248435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647301d8-05ca-46de-b39c-acc8786efc14 None admin] PATH_INFO: `/v3/projects/a70d89f513df4f9aa77bd63a8ff95c37` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:47.249790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647301d8-05ca-46de-b39c-acc8786efc14 None admin] RBAC: Authorizing `identity:get_project(project_id=a70d89f513df4f9aa77bd63a8ff95c37)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:47.251317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647301d8-05ca-46de-b39c-acc8786efc14 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:47.253080 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 591/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Aug 29 15:12:47 2022] GET /identity/v3/projects/a70d89f513df4f9aa77bd63a8ff95c37 => generated 361 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:47.259622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8e990-c877-40e5-8d7d-faad3f092408 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:12:47.365886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8e990-c877-40e5-8d7d-faad3f092408 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:12:47.396853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:47.405047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d12650-8389-4b6a-9313-92c5d8d238a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:12:47.405698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d12650-8389-4b6a-9313-92c5d8d238a0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:12:47.405970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d12650-8389-4b6a-9313-92c5d8d238a0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:12:47.406236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d12650-8389-4b6a-9313-92c5d8d238a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:12:47.406961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d12650-8389-4b6a-9313-92c5d8d238a0 None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=a70d89f513df4f9aa77bd63a8ff95c37, user.id=bbcd38dae6414264be0181a894bd54dc) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:12:47.407262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d12650-8389-4b6a-9313-92c5d8d238a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:12:47.408686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d12650-8389-4b6a-9313-92c5d8d238a0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:12:47.415122 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 609/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:12:47 2022] GET /identity/v3/role_assignments?user.id=bbcd38dae6414264be0181a894bd54dc&scope.project.id=a70d89f513df4f9aa77bd63a8ff95c37&role.id=be89abac608f45a6921181bcc574f721 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:12:57.239978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=15 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:12:57.416049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:44.382259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723872f-0b17-44b4-8c9c-212a61f0cf0b None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:44.382918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723872f-0b17-44b4-8c9c-212a61f0cf0b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:44.382918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723872f-0b17-44b4-8c9c-212a61f0cf0b None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:44.384454 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 592/1201] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:13:44.390518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637c83-fec8-4841-8048-ad98e957cce0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:44.391064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637c83-fec8-4841-8048-ad98e957cce0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:44.391064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637c83-fec8-4841-8048-ad98e957cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:44.421428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d4637c83-fec8-4841-8048-ad98e957cce0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:13:44.421428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d4637c83-fec8-4841-8048-ad98e957cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:13:44.513444 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 610/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:13:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:13:44.814892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723872f-0b17-44b4-8c9c-212a61f0cf0b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:44.975853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723872f-0b17-44b4-8c9c-212a61f0cf0b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:45.029933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791d00a-4add-4e62-8e41-a9d70853bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:45.030574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791d00a-4add-4e62-8e41-a9d70853bff4 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:45.030850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791d00a-4add-4e62-8e41-a9d70853bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:45.031123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791d00a-4add-4e62-8e41-a9d70853bff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:45.043792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791d00a-4add-4e62-8e41-a9d70853bff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:45.045334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791d00a-4add-4e62-8e41-a9d70853bff4 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-a791d00a-4add-4e62-8e41-a9d70853bff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:13:45.062972 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:45.064288 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:13:45.065988 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:13:45.065988 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:45.065988 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:13:45.065988 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 593/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:13:45.071132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637c83-fec8-4841-8048-ad98e957cce0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:45.191035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637c83-fec8-4841-8048-ad98e957cce0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:45.226551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:45.233989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f9670-6c97-4e72-a20a-80a2540b93fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:45.234794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9670-6c97-4e72-a20a-80a2540b93fc None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:45.235080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9670-6c97-4e72-a20a-80a2540b93fc None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:45.235552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9670-6c97-4e72-a20a-80a2540b93fc None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:45.236227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f9670-6c97-4e72-a20a-80a2540b93fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:45.236554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f9670-6c97-4e72-a20a-80a2540b93fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:45.237990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f9670-6c97-4e72-a20a-80a2540b93fc None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:45.253560 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 611/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:45.260527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791d00a-4add-4e62-8e41-a9d70853bff4 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:45.335630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:45.407915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791d00a-4add-4e62-8e41-a9d70853bff4 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:45.450268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5fb25-0d19-4887-bb13-9d684642485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:45.450904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5fb25-0d19-4887-bb13-9d684642485e None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:45.451179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5fb25-0d19-4887-bb13-9d684642485e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:45.451450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5fb25-0d19-4887-bb13-9d684642485e None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:45.452105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5fb25-0d19-4887-bb13-9d684642485e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:45.453583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5fb25-0d19-4887-bb13-9d684642485e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:45.481434 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 594/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Aug 29 15:13:45 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:13:47.615810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ae5a4-8601-4883-8301-98f3355f4119 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:47.616344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ae5a4-8601-4883-8301-98f3355f4119 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:47.616344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ae5a4-8601-4883-8301-98f3355f4119 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:47.618013 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 612/1206] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:13:47.627033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837f505-686d-4abb-aaa2-3bb491627581 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:47.627629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837f505-686d-4abb-aaa2-3bb491627581 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:47.627629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837f505-686d-4abb-aaa2-3bb491627581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:47.663612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7837f505-686d-4abb-aaa2-3bb491627581 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:13:47.665300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7837f505-686d-4abb-aaa2-3bb491627581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:13:47.777379 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 595/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:13:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:13:48.079324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ae5a4-8601-4883-8301-98f3355f4119 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:48.301226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ae5a4-8601-4883-8301-98f3355f4119 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:48.353718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfcba2-9f19-4b31-be25-7a4f92bc01d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:48.354276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfcba2-9f19-4b31-be25-7a4f92bc01d4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:48.354559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfcba2-9f19-4b31-be25-7a4f92bc01d4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:48.354836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfcba2-9f19-4b31-be25-7a4f92bc01d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:48.369054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfcba2-9f19-4b31-be25-7a4f92bc01d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-05bfcba2-9f19-4b31-be25-7a4f92bc01d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:13:48.377709 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:48.378981 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:13:48.380550 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:13:48.389617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837f505-686d-4abb-aaa2-3bb491627581 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:48.393793 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 613/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:13:48.442711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:48.549221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837f505-686d-4abb-aaa2-3bb491627581 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:48.606379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b5780-71d7-4db7-a3b4-76781726cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:48.606931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5780-71d7-4db7-a3b4-76781726cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:48.607257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5780-71d7-4db7-a3b4-76781726cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:48.607623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5780-71d7-4db7-a3b4-76781726cfc3 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:48.608305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b5780-71d7-4db7-a3b4-76781726cfc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:48.608639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b5780-71d7-4db7-a3b4-76781726cfc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:48.610044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b5780-71d7-4db7-a3b4-76781726cfc3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:48.620763 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 596/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:48.630422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfcba2-9f19-4b31-be25-7a4f92bc01d4 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:48.699456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:48.762738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfcba2-9f19-4b31-be25-7a4f92bc01d4 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:48.804826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21c490-06a1-4ff3-9b3d-e1a01ad937b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:48.805345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21c490-06a1-4ff3-9b3d-e1a01ad937b4 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:48.805716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21c490-06a1-4ff3-9b3d-e1a01ad937b4 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:48.805993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21c490-06a1-4ff3-9b3d-e1a01ad937b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:48.818640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21c490-06a1-4ff3-9b3d-e1a01ad937b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:48.820305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21c490-06a1-4ff3-9b3d-e1a01ad937b4 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-af21c490-06a1-4ff3-9b3d-e1a01ad937b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:13:48.837936 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:48.840122 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:13:48.841299 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:13:48.841299 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:48.841299 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:13:48.841299 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 614/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:13:48.845687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b5780-71d7-4db7-a3b4-76781726cfc3 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:48.967072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:48.970700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b5780-71d7-4db7-a3b4-76781726cfc3 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:49.021582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f734d8a-b6ef-4d08-b38b-8624baa0a97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:49.021582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f734d8a-b6ef-4d08-b38b-8624baa0a97b None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:49.021928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f734d8a-b6ef-4d08-b38b-8624baa0a97b None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:49.022135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f734d8a-b6ef-4d08-b38b-8624baa0a97b None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:49.022821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f734d8a-b6ef-4d08-b38b-8624baa0a97b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:49.023224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f734d8a-b6ef-4d08-b38b-8624baa0a97b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:49.024920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f734d8a-b6ef-4d08-b38b-8624baa0a97b None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:49.042442 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 597/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:49.051143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21c490-06a1-4ff3-9b3d-e1a01ad937b4 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:49.205753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21c490-06a1-4ff3-9b3d-e1a01ad937b4 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:49.207679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:49.254435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d3dd9-2d6e-4a6f-8114-27930eb372ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:49.255323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d3dd9-2d6e-4a6f-8114-27930eb372ad None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:49.255797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d3dd9-2d6e-4a6f-8114-27930eb372ad None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:49.256192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d3dd9-2d6e-4a6f-8114-27930eb372ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:49.266132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d3dd9-2d6e-4a6f-8114-27930eb372ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:49.267974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d3dd9-2d6e-4a6f-8114-27930eb372ad None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-c71d3dd9-2d6e-4a6f-8114-27930eb372ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:13:49.283276 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:49.284394 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:49.286052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:49.286052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:49.286052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:13:49.286052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:13:49.286052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:13:49.286052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:13:49.286052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:13:49.286052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:13:49.286052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:13:49.286052 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:13:49.286052 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 615/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:13:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:13:49.291293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f734d8a-b6ef-4d08-b38b-8624baa0a97b None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:49.412528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f734d8a-b6ef-4d08-b38b-8624baa0a97b None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:49.453281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6882ea-38eb-4693-a4c9-3f6d61a68ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:49.453941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6882ea-38eb-4693-a4c9-3f6d61a68ce7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:49.454226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6882ea-38eb-4693-a4c9-3f6d61a68ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:49.454502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6882ea-38eb-4693-a4c9-3f6d61a68ce7 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:49.455334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6882ea-38eb-4693-a4c9-3f6d61a68ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:49.455587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6882ea-38eb-4693-a4c9-3f6d61a68ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:49.456959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6882ea-38eb-4693-a4c9-3f6d61a68ce7 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:49.477560 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 598/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Aug 29 15:13:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:49.483786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d3dd9-2d6e-4a6f-8114-27930eb372ad None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:49.635155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d3dd9-2d6e-4a6f-8114-27930eb372ad None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:49.679997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec869271-674f-4a0c-a319-c0e0b87bdde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:49.680627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec869271-674f-4a0c-a319-c0e0b87bdde7 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:49.680908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec869271-674f-4a0c-a319-c0e0b87bdde7 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:49.681180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec869271-674f-4a0c-a319-c0e0b87bdde7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:49.724494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:49.772842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec869271-674f-4a0c-a319-c0e0b87bdde7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:49.775092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec869271-674f-4a0c-a319-c0e0b87bdde7 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:49.902322 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 616/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:13:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 15:13:49.903892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6882ea-38eb-4693-a4c9-3f6d61a68ce7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:49.927179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:50.061988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6882ea-38eb-4693-a4c9-3f6d61a68ce7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:50.102198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993f71c-4b33-4425-aa73-3e1f4a5c69f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:50.102909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993f71c-4b33-4425-aa73-3e1f4a5c69f3 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:50.103143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993f71c-4b33-4425-aa73-3e1f4a5c69f3 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:50.103467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993f71c-4b33-4425-aa73-3e1f4a5c69f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:50.115224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993f71c-4b33-4425-aa73-3e1f4a5c69f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:50.116737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993f71c-4b33-4425-aa73-3e1f4a5c69f3 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-7993f71c-4b33-4425-aa73-3e1f4a5c69f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:13:50.133771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:50.134998 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:13:50.136098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:13:50.136098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:50.136098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:13:50.136098 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 599/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:13:50.140719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec869271-674f-4a0c-a319-c0e0b87bdde7 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:50.209484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:50.257844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec869271-674f-4a0c-a319-c0e0b87bdde7 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:50.299494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83da8c9-3143-4c47-aafa-d749fc1e2131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:50.300121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da8c9-3143-4c47-aafa-d749fc1e2131 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:50.300402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da8c9-3143-4c47-aafa-d749fc1e2131 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:50.300843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da8c9-3143-4c47-aafa-d749fc1e2131 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:50.301595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83da8c9-3143-4c47-aafa-d749fc1e2131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:50.301931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83da8c9-3143-4c47-aafa-d749fc1e2131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:50.303776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83da8c9-3143-4c47-aafa-d749fc1e2131 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:50.321300 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 617/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:50.327176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993f71c-4b33-4425-aa73-3e1f4a5c69f3 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:50.416503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:50.452359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993f71c-4b33-4425-aa73-3e1f4a5c69f3 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:50.491343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2026bc8-01b4-4426-af82-f737461bede1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:50.491920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2026bc8-01b4-4426-af82-f737461bede1 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:50.492239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2026bc8-01b4-4426-af82-f737461bede1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:50.492557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2026bc8-01b4-4426-af82-f737461bede1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:50.500985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2026bc8-01b4-4426-af82-f737461bede1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:50.501511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2026bc8-01b4-4426-af82-f737461bede1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-b2026bc8-01b4-4426-af82-f737461bede1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:13:50.516263 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:50.517375 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:50.518886 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:13:50.518886 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:13:50.518886 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:13:50.518886 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:13:50.518886 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:13:50.518886 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:13:50.518886 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:13:50.518886 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:13:50.518886 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 600/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:13:50.524522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83da8c9-3143-4c47-aafa-d749fc1e2131 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:50.647760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83da8c9-3143-4c47-aafa-d749fc1e2131 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:50.673829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:50.686009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d0b68-c885-4323-8aac-44407667cf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:50.686627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d0b68-c885-4323-8aac-44407667cf81 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:50.686962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d0b68-c885-4323-8aac-44407667cf81 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:50.687241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d0b68-c885-4323-8aac-44407667cf81 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:50.687944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d0b68-c885-4323-8aac-44407667cf81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:50.688251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d0b68-c885-4323-8aac-44407667cf81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:50.690029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d0b68-c885-4323-8aac-44407667cf81 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:50.711906 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 618/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:13:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:50.715282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2026bc8-01b4-4426-af82-f737461bede1 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:50.844427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2026bc8-01b4-4426-af82-f737461bede1 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:50.876471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:50.883775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd853d-27e1-4e8f-b816-591a82e8ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:50.884389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd853d-27e1-4e8f-b816-591a82e8ba79 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:50.884669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd853d-27e1-4e8f-b816-591a82e8ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:50.884940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd853d-27e1-4e8f-b816-591a82e8ba79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:50.885707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd853d-27e1-4e8f-b816-591a82e8ba79 None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=a0fc274aa6064fda9fab30fbd16df5aa) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:50.886016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd853d-27e1-4e8f-b816-591a82e8ba79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:50.887462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd853d-27e1-4e8f-b816-591a82e8ba79 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:50.894101 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 601/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:13:50 2022] GET /identity/v3/role_assignments?user.id=a0fc274aa6064fda9fab30fbd16df5aa&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:13:52.992447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a5bce-492a-45c0-9b9e-1c0a4a976fb0 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:52.993233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a5bce-492a-45c0-9b9e-1c0a4a976fb0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:52.993233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a5bce-492a-45c0-9b9e-1c0a4a976fb0 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:52.995055 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 619/1220] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:13:53.000552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e118feb-04ee-4973-a748-9d542cdc1510 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:53.001025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e118feb-04ee-4973-a748-9d542cdc1510 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:53.001119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e118feb-04ee-4973-a748-9d542cdc1510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:53.022171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8e118feb-04ee-4973-a748-9d542cdc1510 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:13:53.023379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8e118feb-04ee-4973-a748-9d542cdc1510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:13:53.098331 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 602/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:13:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:13:53.407086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a5bce-492a-45c0-9b9e-1c0a4a976fb0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:53.531175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a5bce-492a-45c0-9b9e-1c0a4a976fb0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:53.573812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d848ad2-b7da-41c7-a26e-f59e986cbfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:53.574623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d848ad2-b7da-41c7-a26e-f59e986cbfef None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:53.574936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d848ad2-b7da-41c7-a26e-f59e986cbfef None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:53.575263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d848ad2-b7da-41c7-a26e-f59e986cbfef None admin] PATH_INFO: `/v3/roles/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:53.589023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d848ad2-b7da-41c7-a26e-f59e986cbfef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-1d848ad2-b7da-41c7-a26e-f59e986cbfef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:13:53.595032 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:53.596317 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:13:53.597412 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 620/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:13:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:13:53.604848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e118feb-04ee-4973-a748-9d542cdc1510 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:53.725922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e118feb-04ee-4973-a748-9d542cdc1510 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:53.755179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:53.766860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed59783-3c4f-4522-8331-93a74c71312d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:53.767477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed59783-3c4f-4522-8331-93a74c71312d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:53.767749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed59783-3c4f-4522-8331-93a74c71312d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:53.768018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed59783-3c4f-4522-8331-93a74c71312d None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:53.768697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed59783-3c4f-4522-8331-93a74c71312d None admin] RBAC: Adding query filter params (name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:53.768998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed59783-3c4f-4522-8331-93a74c71312d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:53.770618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed59783-3c4f-4522-8331-93a74c71312d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:53.781127 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 603/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:13:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:53.788012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d848ad2-b7da-41c7-a26e-f59e986cbfef None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:53.843379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:53.910420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d848ad2-b7da-41c7-a26e-f59e986cbfef None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:53.950663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de99e6-62c5-4bee-8d8f-1c241ce16e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:53.951292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de99e6-62c5-4bee-8d8f-1c241ce16e81 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:53.951573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de99e6-62c5-4bee-8d8f-1c241ce16e81 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:53.951846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de99e6-62c5-4bee-8d8f-1c241ce16e81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:53.963311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de99e6-62c5-4bee-8d8f-1c241ce16e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:53.964996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de99e6-62c5-4bee-8d8f-1c241ce16e81 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-13de99e6-62c5-4bee-8d8f-1c241ce16e81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:13:53.982909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:53.984166 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:13:53.985518 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:13:53.985518 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:53.985518 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:13:53.986454 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 621/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:13:53.994052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed59783-3c4f-4522-8331-93a74c71312d None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:54.109808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed59783-3c4f-4522-8331-93a74c71312d None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:54.149696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed9f62-499b-4394-a018-89f46753dc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:54.150303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed9f62-499b-4394-a018-89f46753dc4e None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:54.150582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed9f62-499b-4394-a018-89f46753dc4e None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:54.150853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed9f62-499b-4394-a018-89f46753dc4e None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:54.151495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed9f62-499b-4394-a018-89f46753dc4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:54.151794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed9f62-499b-4394-a018-89f46753dc4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:54.153205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed9f62-499b-4394-a018-89f46753dc4e None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:54.166950 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 604/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:54.172820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de99e6-62c5-4bee-8d8f-1c241ce16e81 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:54.274899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:54.283262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de99e6-62c5-4bee-8d8f-1c241ce16e81 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:54.324123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c869b-6a45-45bb-8af4-f01abb8d6fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:54.324886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c869b-6a45-45bb-8af4-f01abb8d6fed None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:54.325235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c869b-6a45-45bb-8af4-f01abb8d6fed None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:54.325601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c869b-6a45-45bb-8af4-f01abb8d6fed None admin] PATH_INFO: `/v3/users/placement` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:54.335285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c869b-6a45-45bb-8af4-f01abb8d6fed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:54.336739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c869b-6a45-45bb-8af4-f01abb8d6fed None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-a90c869b-6a45-45bb-8af4-f01abb8d6fed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:13:54.348366 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:54.349638 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:54.351019 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:54.351019 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:54.351019 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:13:54.351019 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:13:54.351019 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:13:54.351019 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:13:54.351019 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:13:54.351019 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:13:54.351019 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:13:54.351019 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:13:54.351019 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 622/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:13:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:13:54.355693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed9f62-499b-4394-a018-89f46753dc4e None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:54.417851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:54.481049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed9f62-499b-4394-a018-89f46753dc4e None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:54.520752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3cd4-a849-4f25-aa1b-8f4766b87376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:54.521407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3cd4-a849-4f25-aa1b-8f4766b87376 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:54.521820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3cd4-a849-4f25-aa1b-8f4766b87376 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:54.522101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3cd4-a849-4f25-aa1b-8f4766b87376 None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:54.523099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe3cd4-a849-4f25-aa1b-8f4766b87376 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:54.523409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe3cd4-a849-4f25-aa1b-8f4766b87376 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:54.525233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe3cd4-a849-4f25-aa1b-8f4766b87376 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:54.544063 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 605/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Aug 29 15:13:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:54.549888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c869b-6a45-45bb-8af4-f01abb8d6fed None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:54.660330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c869b-6a45-45bb-8af4-f01abb8d6fed None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:54.701208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79164557-ec2f-4def-94c6-79950736e212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:54.701976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79164557-ec2f-4def-94c6-79950736e212 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:54.702289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79164557-ec2f-4def-94c6-79950736e212 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:54.702566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79164557-ec2f-4def-94c6-79950736e212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:54.714664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79164557-ec2f-4def-94c6-79950736e212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:54.716120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79164557-ec2f-4def-94c6-79950736e212 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-79164557-ec2f-4def-94c6-79950736e212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:13:54.731179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:54.732652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:13:54.733657 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:13:54.733657 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:54.733657 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:13:54.733657 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 623/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:13:54.738750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3cd4-a849-4f25-aa1b-8f4766b87376 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:54.854428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3cd4-a849-4f25-aa1b-8f4766b87376 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:54.858292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:54.906928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a946528-7dd6-41e6-a291-66d65214ba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:54.907654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a946528-7dd6-41e6-a291-66d65214ba96 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:54.907971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a946528-7dd6-41e6-a291-66d65214ba96 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:54.908293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a946528-7dd6-41e6-a291-66d65214ba96 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:54.909050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a946528-7dd6-41e6-a291-66d65214ba96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:54.909362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a946528-7dd6-41e6-a291-66d65214ba96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:54.911256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a946528-7dd6-41e6-a291-66d65214ba96 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:54.924797 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 606/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:54.932026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79164557-ec2f-4def-94c6-79950736e212 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:54.946797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:55.085589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79164557-ec2f-4def-94c6-79950736e212 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:55.125426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d169a-7775-476e-8594-7d33eb31c564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:55.126005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d169a-7775-476e-8594-7d33eb31c564 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:55.126282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d169a-7775-476e-8594-7d33eb31c564 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:55.126552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d169a-7775-476e-8594-7d33eb31c564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:55.134919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d169a-7775-476e-8594-7d33eb31c564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:55.136783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d169a-7775-476e-8594-7d33eb31c564 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-199d169a-7775-476e-8594-7d33eb31c564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:13:55.149485 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:55.150651 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:55.152167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:13:55.152167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:13:55.152167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:13:55.152167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:13:55.152167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:13:55.152167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:13:55.152167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:13:55.152167 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:13:55.152167 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 624/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:13:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:13:55.156597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a946528-7dd6-41e6-a291-66d65214ba96 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:55.277695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a946528-7dd6-41e6-a291-66d65214ba96 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:55.316700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cf481-a22f-42b1-8128-bcba5cfd88ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:55.317527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cf481-a22f-42b1-8128-bcba5cfd88ee None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:55.317927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cf481-a22f-42b1-8128-bcba5cfd88ee None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:55.318227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cf481-a22f-42b1-8128-bcba5cfd88ee None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:55.320613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cf481-a22f-42b1-8128-bcba5cfd88ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:55.321080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cf481-a22f-42b1-8128-bcba5cfd88ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:55.323099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cf481-a22f-42b1-8128-bcba5cfd88ee None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:55.337689 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 607/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:13:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:55.344146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d169a-7775-476e-8594-7d33eb31c564 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:55.427874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:55.468926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d169a-7775-476e-8594-7d33eb31c564 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:55.510484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c1c1b-a1e1-472f-a039-c71447594c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:55.511225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c1c1b-a1e1-472f-a039-c71447594c2b None admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:55.511497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c1c1b-a1e1-472f-a039-c71447594c2b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:55.511776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c1c1b-a1e1-472f-a039-c71447594c2b None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/a0fc274aa6064fda9fab30fbd16df5aa/roles/1471575d20cd435ca6fb71c29c92fb64` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:55.530196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c1c1b-a1e1-472f-a039-c71447594c2b None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=a0fc274aa6064fda9fab30fbd16df5aa, role_id=1471575d20cd435ca6fb71c29c92fb64)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:55.532121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c1c1b-a1e1-472f-a039-c71447594c2b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:55.548313 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 625/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:13:55 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/a0fc274aa6064fda9fab30fbd16df5aa/roles/1471575d20cd435ca6fb71c29c92fb64 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:13:57.606560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31580646-db28-47b6-86ad-af233e403daf None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:57.607192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31580646-db28-47b6-86ad-af233e403daf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:57.607192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31580646-db28-47b6-86ad-af233e403daf None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:57.608480 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 608/1233] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:13:57.614124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bf406-5ee3-4b56-b08d-199ba3343ded None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:57.614606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bf406-5ee3-4b56-b08d-199ba3343ded None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:57.614751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bf406-5ee3-4b56-b08d-199ba3343ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:57.633736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-002bf406-5ee3-4b56-b08d-199ba3343ded None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:13:57.635022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-002bf406-5ee3-4b56-b08d-199ba3343ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:13:57.725465 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 626/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:13:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:13:58.018180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31580646-db28-47b6-86ad-af233e403daf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:58.051676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:58.159426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31580646-db28-47b6-86ad-af233e403daf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:58.197814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74f333-9bd3-49b8-a069-b90f9dced7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:58.198445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74f333-9bd3-49b8-a069-b90f9dced7b7 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:58.198728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74f333-9bd3-49b8-a069-b90f9dced7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:58.199003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74f333-9bd3-49b8-a069-b90f9dced7b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:58.209948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74f333-9bd3-49b8-a069-b90f9dced7b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-ba74f333-9bd3-49b8-a069-b90f9dced7b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:13:58.214808 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:58.215945 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:13:58.216991 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 609/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Aug 29 15:13:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:13:58.223862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bf406-5ee3-4b56-b08d-199ba3343ded None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:58.271101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:58.328293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bf406-5ee3-4b56-b08d-199ba3343ded None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:58.364191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68170a17-6290-4995-8537-168422101ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:58.364798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68170a17-6290-4995-8537-168422101ef0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:58.365073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68170a17-6290-4995-8537-168422101ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:58.365347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68170a17-6290-4995-8537-168422101ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:58.366039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68170a17-6290-4995-8537-168422101ef0 None admin] RBAC: Adding query filter params (name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:58.366336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68170a17-6290-4995-8537-168422101ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:58.367696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68170a17-6290-4995-8537-168422101ef0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:58.376174 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 627/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Aug 29 15:13:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:58.382692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74f333-9bd3-49b8-a069-b90f9dced7b7 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:58.479467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:58.503350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74f333-9bd3-49b8-a069-b90f9dced7b7 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:58.548589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb369c9-ef15-46a4-abfb-8198e7e00db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:58.549216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb369c9-ef15-46a4-abfb-8198e7e00db0 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:58.549525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb369c9-ef15-46a4-abfb-8198e7e00db0 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:58.549797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb369c9-ef15-46a4-abfb-8198e7e00db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:58.561250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb369c9-ef15-46a4-abfb-8198e7e00db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:58.562824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb369c9-ef15-46a4-abfb-8198e7e00db0 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-aeb369c9-ef15-46a4-abfb-8198e7e00db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:13:58.579668 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:58.581012 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:13:58.581994 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:13:58.581994 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:58.581994 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:13:58.581994 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 610/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:13:58.587380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68170a17-6290-4995-8537-168422101ef0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:58.703866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68170a17-6290-4995-8537-168422101ef0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:58.715411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:58.746096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd60e3-7997-45ef-aa2a-7fb11850c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:58.746748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd60e3-7997-45ef-aa2a-7fb11850c3ae None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:58.747004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd60e3-7997-45ef-aa2a-7fb11850c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:58.747320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd60e3-7997-45ef-aa2a-7fb11850c3ae None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:58.747878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd60e3-7997-45ef-aa2a-7fb11850c3ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:58.748173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd60e3-7997-45ef-aa2a-7fb11850c3ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:58.749563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd60e3-7997-45ef-aa2a-7fb11850c3ae None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:58.762393 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 628/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:58.768398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb369c9-ef15-46a4-abfb-8198e7e00db0 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:58.885495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb369c9-ef15-46a4-abfb-8198e7e00db0 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:58.921342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535794b7-2e37-4b04-96d5-c100d644e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:58.922129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535794b7-2e37-4b04-96d5-c100d644e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:58.922493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535794b7-2e37-4b04-96d5-c100d644e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:58.922819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535794b7-2e37-4b04-96d5-c100d644e5f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:58.926654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:58.932553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535794b7-2e37-4b04-96d5-c100d644e5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:58.934226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535794b7-2e37-4b04-96d5-c100d644e5f1 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-535794b7-2e37-4b04-96d5-c100d644e5f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:13:58.946469 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:58.947693 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:58.949029 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:58.949029 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:58.949029 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:13:58.949029 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:13:58.949029 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:13:58.949029 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:13:58.949029 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:13:58.949029 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:13:58.949029 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:13:58.949029 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:13:58.949029 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 611/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:13:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:13:58.953670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd60e3-7997-45ef-aa2a-7fb11850c3ae None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:59.062178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd60e3-7997-45ef-aa2a-7fb11850c3ae None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:59.100830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c99b6a-42cb-4c2f-b056-49d2540352be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:59.101478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c99b6a-42cb-4c2f-b056-49d2540352be None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:59.101782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c99b6a-42cb-4c2f-b056-49d2540352be None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:59.102026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c99b6a-42cb-4c2f-b056-49d2540352be None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:59.102810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c99b6a-42cb-4c2f-b056-49d2540352be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:59.103133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c99b6a-42cb-4c2f-b056-49d2540352be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:59.104614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c99b6a-42cb-4c2f-b056-49d2540352be None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:59.124017 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 629/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Aug 29 15:13:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:13:59.129704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535794b7-2e37-4b04-96d5-c100d644e5f1 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:59.239918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535794b7-2e37-4b04-96d5-c100d644e5f1 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:59.284288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcf6a4-2b5b-4bbd-9437-8c1abb4fcfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:59.284992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcf6a4-2b5b-4bbd-9437-8c1abb4fcfb8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:59.285276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcf6a4-2b5b-4bbd-9437-8c1abb4fcfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:59.285738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcf6a4-2b5b-4bbd-9437-8c1abb4fcfb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:59.387285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:59.394783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcf6a4-2b5b-4bbd-9437-8c1abb4fcfb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:59.396256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcf6a4-2b5b-4bbd-9437-8c1abb4fcfb8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:59.511007 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 612/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:13:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:13:59.517870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c99b6a-42cb-4c2f-b056-49d2540352be None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:59.551483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:59.642626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c99b6a-42cb-4c2f-b056-49d2540352be None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:59.694828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6854e4-6215-479f-94a3-a576191efacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:59.695778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6854e4-6215-479f-94a3-a576191efacb None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:59.696184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6854e4-6215-479f-94a3-a576191efacb None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:59.696601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6854e4-6215-479f-94a3-a576191efacb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:59.710798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6854e4-6215-479f-94a3-a576191efacb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:59.714367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6854e4-6215-479f-94a3-a576191efacb None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-7c6854e4-6215-479f-94a3-a576191efacb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:13:59.732281 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:13:59.734268 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:13:59.735471 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:13:59.735471 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:13:59.735471 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:13:59.735471 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 630/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:13:59.740221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcf6a4-2b5b-4bbd-9437-8c1abb4fcfb8 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:13:59.845799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:13:59.853815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcf6a4-2b5b-4bbd-9437-8c1abb4fcfb8 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:13:59.897688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff2dde-645c-4b3d-837d-490ff5f5af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:13:59.898318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff2dde-645c-4b3d-837d-490ff5f5af6c None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:13:59.898576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff2dde-645c-4b3d-837d-490ff5f5af6c None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:13:59.898890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff2dde-645c-4b3d-837d-490ff5f5af6c None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:13:59.899748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff2dde-645c-4b3d-837d-490ff5f5af6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:13:59.900043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff2dde-645c-4b3d-837d-490ff5f5af6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:13:59.901459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff2dde-645c-4b3d-837d-490ff5f5af6c None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:13:59.913839 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 613/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:13:59.919676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6854e4-6215-479f-94a3-a576191efacb None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:00.011307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:00.036803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6854e4-6215-479f-94a3-a576191efacb None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:00.072940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcca81-00bb-4c8e-a630-433a300d7966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:00.073742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcca81-00bb-4c8e-a630-433a300d7966 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:00.073918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcca81-00bb-4c8e-a630-433a300d7966 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:00.074192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcca81-00bb-4c8e-a630-433a300d7966 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:00.081285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcca81-00bb-4c8e-a630-433a300d7966 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:00.083236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcca81-00bb-4c8e-a630-433a300d7966 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-03bcca81-00bb-4c8e-a630-433a300d7966 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:14:00.096001 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:00.097063 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:00.098617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:14:00.098617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:14:00.098617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:14:00.098617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:14:00.098617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:14:00.098617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:14:00.098617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:14:00.098617 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:00.098617 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 631/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:00.104154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff2dde-645c-4b3d-837d-490ff5f5af6c None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:00.215607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff2dde-645c-4b3d-837d-490ff5f5af6c None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:00.258169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc8be4-97c1-4ade-ba99-44b2d29a2f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:00.258887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc8be4-97c1-4ade-ba99-44b2d29a2f8d None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:00.259148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc8be4-97c1-4ade-ba99-44b2d29a2f8d None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:00.259423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc8be4-97c1-4ade-ba99-44b2d29a2f8d None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:00.260138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc8be4-97c1-4ade-ba99-44b2d29a2f8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:00.260453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc8be4-97c1-4ade-ba99-44b2d29a2f8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:00.261924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc8be4-97c1-4ade-ba99-44b2d29a2f8d None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:00.275474 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 614/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:14:00.281882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcca81-00bb-4c8e-a630-433a300d7966 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:00.395755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcca81-00bb-4c8e-a630-433a300d7966 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:00.430936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db119263-33ef-4bc7-ac2d-1d4c49550bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:00.431601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db119263-33ef-4bc7-ac2d-1d4c49550bc7 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:00.431883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db119263-33ef-4bc7-ac2d-1d4c49550bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:00.432204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db119263-33ef-4bc7-ac2d-1d4c49550bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:00.432992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db119263-33ef-4bc7-ac2d-1d4c49550bc7 None admin] RBAC: Adding query filter params (role.id=1471575d20cd435ca6fb71c29c92fb64, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=a0fc274aa6064fda9fab30fbd16df5aa) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:00.433299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db119263-33ef-4bc7-ac2d-1d4c49550bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:00.434899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db119263-33ef-4bc7-ac2d-1d4c49550bc7 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:00.441835 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 632/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:14:00 2022] GET /identity/v3/role_assignments?user.id=a0fc274aa6064fda9fab30fbd16df5aa&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=1471575d20cd435ca6fb71c29c92fb64 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:02.653183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cc7f5-704b-441c-a817-e42c6ce3a513 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:02.653770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cc7f5-704b-441c-a817-e42c6ce3a513 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:02.653854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cc7f5-704b-441c-a817-e42c6ce3a513 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:02.655515 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 615/1247] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:14:02.662379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7688-93a9-46e1-9973-d2b28e82fbb8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:02.662884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7688-93a9-46e1-9973-d2b28e82fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:02.662991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7688-93a9-46e1-9973-d2b28e82fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:02.670104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:02.685102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7e6e7688-93a9-46e1-9973-d2b28e82fbb8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:14:02.686640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7e6e7688-93a9-46e1-9973-d2b28e82fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:14:02.762607 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 633/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:14:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 15:14:03.093177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cc7f5-704b-441c-a817-e42c6ce3a513 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:03.115565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:03.210145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cc7f5-704b-441c-a817-e42c6ce3a513 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:03.246576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48856ed8-cfd1-4d59-b573-1bd201b6dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:03.247207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856ed8-cfd1-4d59-b573-1bd201b6dcc9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:03.247486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856ed8-cfd1-4d59-b573-1bd201b6dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:03.247757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856ed8-cfd1-4d59-b573-1bd201b6dcc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:03.261402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48856ed8-cfd1-4d59-b573-1bd201b6dcc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-48856ed8-cfd1-4d59-b573-1bd201b6dcc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:14:03.266696 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:03.267746 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:14:03.268630 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 616/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:14:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:03.274539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e7688-93a9-46e1-9973-d2b28e82fbb8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:03.391946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e7688-93a9-46e1-9973-d2b28e82fbb8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:03.429265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:03.435555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357698-a551-4257-be74-a6f5ebd78222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:03.436234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357698-a551-4257-be74-a6f5ebd78222 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:03.436512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357698-a551-4257-be74-a6f5ebd78222 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:03.436835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357698-a551-4257-be74-a6f5ebd78222 None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:03.437635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e357698-a551-4257-be74-a6f5ebd78222 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:03.437939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e357698-a551-4257-be74-a6f5ebd78222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:03.439425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e357698-a551-4257-be74-a6f5ebd78222 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:03.449015 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 634/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:14:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:03.455509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48856ed8-cfd1-4d59-b573-1bd201b6dcc9 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:03.552231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:03.580125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48856ed8-cfd1-4d59-b573-1bd201b6dcc9 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:03.619980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dd48c-d741-48b3-b0d6-dbf97c4dbe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:03.620685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dd48c-d741-48b3-b0d6-dbf97c4dbe41 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:03.620995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dd48c-d741-48b3-b0d6-dbf97c4dbe41 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:03.621238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dd48c-d741-48b3-b0d6-dbf97c4dbe41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:03.633021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dd48c-d741-48b3-b0d6-dbf97c4dbe41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:03.634502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dd48c-d741-48b3-b0d6-dbf97c4dbe41 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-935dd48c-d741-48b3-b0d6-dbf97c4dbe41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:14:03.652157 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:03.654210 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:14:03.656417 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:14:03.656417 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:03.656417 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:14:03.656417 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 617/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:03.664649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357698-a551-4257-be74-a6f5ebd78222 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:03.801096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357698-a551-4257-be74-a6f5ebd78222 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:03.843110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784e684-a243-48ab-82be-a5f4c4d2acc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:03.844030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784e684-a243-48ab-82be-a5f4c4d2acc7 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:03.844453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784e684-a243-48ab-82be-a5f4c4d2acc7 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:03.844851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784e684-a243-48ab-82be-a5f4c4d2acc7 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:03.845862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784e684-a243-48ab-82be-a5f4c4d2acc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:03.846338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784e684-a243-48ab-82be-a5f4c4d2acc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:03.849110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784e684-a243-48ab-82be-a5f4c4d2acc7 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:03.865422 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 635/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:03.871505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dd48c-d741-48b3-b0d6-dbf97c4dbe41 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:03.991292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dd48c-d741-48b3-b0d6-dbf97c4dbe41 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:04.025721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:04.038117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefb8ad-d8ee-4cb5-9160-b8b542b6a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:04.038796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefb8ad-d8ee-4cb5-9160-b8b542b6a6aa None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:04.039137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefb8ad-d8ee-4cb5-9160-b8b542b6a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:04.039446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefb8ad-d8ee-4cb5-9160-b8b542b6a6aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:04.048663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefb8ad-d8ee-4cb5-9160-b8b542b6a6aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:04.050300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefb8ad-d8ee-4cb5-9160-b8b542b6a6aa None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-bcefb8ad-d8ee-4cb5-9160-b8b542b6a6aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:14:04.063170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:04.064456 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:04.065629 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:04.065629 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:04.065629 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:14:04.065629 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:14:04.065629 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:14:04.065629 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:14:04.065629 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:14:04.065629 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:14:04.065629 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:14:04.065629 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:14:04.065629 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 618/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:14:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:04.070960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784e684-a243-48ab-82be-a5f4c4d2acc7 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:04.132136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:04.188062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784e684-a243-48ab-82be-a5f4c4d2acc7 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:04.229529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5179809-6714-4aab-8ae1-72fc71ed5376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:04.230217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5179809-6714-4aab-8ae1-72fc71ed5376 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:04.230560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5179809-6714-4aab-8ae1-72fc71ed5376 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:04.230894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5179809-6714-4aab-8ae1-72fc71ed5376 None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:04.231914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5179809-6714-4aab-8ae1-72fc71ed5376 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:04.232397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5179809-6714-4aab-8ae1-72fc71ed5376 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:04.234093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5179809-6714-4aab-8ae1-72fc71ed5376 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:04.256995 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 636/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Aug 29 15:14:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:04.263114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefb8ad-d8ee-4cb5-9160-b8b542b6a6aa None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:04.379088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefb8ad-d8ee-4cb5-9160-b8b542b6a6aa None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:04.423701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7536a-9a2c-45a8-834f-6aa97a499655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:04.424312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7536a-9a2c-45a8-834f-6aa97a499655 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:04.424592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7536a-9a2c-45a8-834f-6aa97a499655 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:04.424950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7536a-9a2c-45a8-834f-6aa97a499655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:04.485680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:04.500193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7536a-9a2c-45a8-834f-6aa97a499655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:04.501968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7536a-9a2c-45a8-834f-6aa97a499655 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:04.623134 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 619/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:14:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:14:04.630372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5179809-6714-4aab-8ae1-72fc71ed5376 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:04.747996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5179809-6714-4aab-8ae1-72fc71ed5376 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:04.762316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:04.787099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755606-43ea-4f49-991e-4a6738ff5f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:04.787770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755606-43ea-4f49-991e-4a6738ff5f92 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:04.788077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755606-43ea-4f49-991e-4a6738ff5f92 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:04.788375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755606-43ea-4f49-991e-4a6738ff5f92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:04.801649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9755606-43ea-4f49-991e-4a6738ff5f92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:04.803069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9755606-43ea-4f49-991e-4a6738ff5f92 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-a9755606-43ea-4f49-991e-4a6738ff5f92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:14:04.818953 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:04.820150 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:14:04.821234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:14:04.821234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:04.821234 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:04.821234 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 637/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:14:04.826718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7536a-9a2c-45a8-834f-6aa97a499655 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:04.930253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:04.944782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7536a-9a2c-45a8-834f-6aa97a499655 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:04.985475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f309-2eba-4a45-8314-0dccf0de0d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:04.986082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f309-2eba-4a45-8314-0dccf0de0d7a None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:04.986425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f309-2eba-4a45-8314-0dccf0de0d7a None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:04.986854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f309-2eba-4a45-8314-0dccf0de0d7a None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:04.988190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617f309-2eba-4a45-8314-0dccf0de0d7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:04.988713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617f309-2eba-4a45-8314-0dccf0de0d7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:04.990705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617f309-2eba-4a45-8314-0dccf0de0d7a None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:05.003674 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 620/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:05.009914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755606-43ea-4f49-991e-4a6738ff5f92 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:05.127011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755606-43ea-4f49-991e-4a6738ff5f92 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:05.167544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063db6-e069-4508-8008-4b870af9fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:05.168236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063db6-e069-4508-8008-4b870af9fb3d None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:05.168538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063db6-e069-4508-8008-4b870af9fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:05.168809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063db6-e069-4508-8008-4b870af9fb3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:05.176719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75063db6-e069-4508-8008-4b870af9fb3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:05.178277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75063db6-e069-4508-8008-4b870af9fb3d None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-75063db6-e069-4508-8008-4b870af9fb3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:14:05.190745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:05.191900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:05.193237 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:14:05.193237 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:14:05.193237 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:14:05.193237 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:14:05.193237 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:14:05.193237 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:14:05.193237 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:14:05.193237 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:05.193237 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 638/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:05.198340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f309-2eba-4a45-8314-0dccf0de0d7a None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:05.305958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f309-2eba-4a45-8314-0dccf0de0d7a None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:05.345632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d3f38-0bfa-4b3e-9d33-6559e740d4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:05.346334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d3f38-0bfa-4b3e-9d33-6559e740d4a8 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:05.346686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d3f38-0bfa-4b3e-9d33-6559e740d4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:05.346940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d3f38-0bfa-4b3e-9d33-6559e740d4a8 None admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:05.348130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d3f38-0bfa-4b3e-9d33-6559e740d4a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:05.348433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d3f38-0bfa-4b3e-9d33-6559e740d4a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:05.349890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d3f38-0bfa-4b3e-9d33-6559e740d4a8 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:05.363075 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 621/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:05.369740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063db6-e069-4508-8008-4b870af9fb3d None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:05.401973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:05.488194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063db6-e069-4508-8008-4b870af9fb3d None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:05.525888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856deda-08ac-4984-a12c-e3c58a966f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:05.526728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856deda-08ac-4984-a12c-e3c58a966f67 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:05.527036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856deda-08ac-4984-a12c-e3c58a966f67 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:05.527293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856deda-08ac-4984-a12c-e3c58a966f67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:05.528391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856deda-08ac-4984-a12c-e3c58a966f67 None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=a0fc274aa6064fda9fab30fbd16df5aa) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:05.528845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856deda-08ac-4984-a12c-e3c58a966f67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:05.530773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856deda-08ac-4984-a12c-e3c58a966f67 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:05.539076 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 639/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:14:05 2022] GET /identity/v3/role_assignments?user.id=a0fc274aa6064fda9fab30fbd16df5aa&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=be89abac608f45a6921181bcc574f721 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:07.583173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55107-4d78-4ffc-9577-7ea3374dc4b4 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:07.583688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55107-4d78-4ffc-9577-7ea3374dc4b4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:07.583688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55107-4d78-4ffc-9577-7ea3374dc4b4 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:07.585034 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 622/1261] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:14:07.590438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46a550-f896-4120-8ee6-91506a15861a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:07.590866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46a550-f896-4120-8ee6-91506a15861a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:07.590993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46a550-f896-4120-8ee6-91506a15861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:07.609816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3f46a550-f896-4120-8ee6-91506a15861a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:14:07.611023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3f46a550-f896-4120-8ee6-91506a15861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:14:07.682364 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 640/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:14:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:14:07.955803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a55107-4d78-4ffc-9577-7ea3374dc4b4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:07.967175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:08.058769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a55107-4d78-4ffc-9577-7ea3374dc4b4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:08.092141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ca1f-1741-4bb8-b669-7136037481fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:08.092764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ca1f-1741-4bb8-b669-7136037481fa None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:08.093043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ca1f-1741-4bb8-b669-7136037481fa None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:08.093317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ca1f-1741-4bb8-b669-7136037481fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:08.103598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031ca1f-1741-4bb8-b669-7136037481fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-5031ca1f-1741-4bb8-b669-7136037481fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:14:08.108412 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:08.109627 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:14:08.110802 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 623/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:14:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:08.116292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46a550-f896-4120-8ee6-91506a15861a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:08.135077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:08.216499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46a550-f896-4120-8ee6-91506a15861a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:08.249886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9712f-06a5-40d5-8e97-58671d9fb4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:08.250544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9712f-06a5-40d5-8e97-58671d9fb4ca None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:08.250858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9712f-06a5-40d5-8e97-58671d9fb4ca None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:08.251137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9712f-06a5-40d5-8e97-58671d9fb4ca None admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:08.251800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9712f-06a5-40d5-8e97-58671d9fb4ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:08.252104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9712f-06a5-40d5-8e97-58671d9fb4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:08.253518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9712f-06a5-40d5-8e97-58671d9fb4ca None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:08.261345 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 641/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:14:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:08.267236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ca1f-1741-4bb8-b669-7136037481fa None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:08.333228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:08.366419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ca1f-1741-4bb8-b669-7136037481fa None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:08.400875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a659073-c6c5-4e08-9582-9502a9654bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:08.401528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a659073-c6c5-4e08-9582-9502a9654bcb None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:08.401806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a659073-c6c5-4e08-9582-9502a9654bcb None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:08.402074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a659073-c6c5-4e08-9582-9502a9654bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:08.412051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a659073-c6c5-4e08-9582-9502a9654bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:08.413518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a659073-c6c5-4e08-9582-9502a9654bcb None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-4a659073-c6c5-4e08-9582-9502a9654bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:14:08.427719 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:08.428861 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:14:08.430136 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:14:08.430136 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:08.430136 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:14:08.430136 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 624/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:08.434681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9712f-06a5-40d5-8e97-58671d9fb4ca None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:08.528580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:08.550933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9712f-06a5-40d5-8e97-58671d9fb4ca None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:08.587345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d1dc4-a132-4cc4-a662-457dee7a1ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:08.587949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d1dc4-a132-4cc4-a662-457dee7a1ed0 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:08.588228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d1dc4-a132-4cc4-a662-457dee7a1ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:08.588497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d1dc4-a132-4cc4-a662-457dee7a1ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:08.589138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d1dc4-a132-4cc4-a662-457dee7a1ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:08.589495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d1dc4-a132-4cc4-a662-457dee7a1ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:08.590929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d1dc4-a132-4cc4-a662-457dee7a1ed0 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:08.603114 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 642/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:08.608848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a659073-c6c5-4e08-9582-9502a9654bcb None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:08.705897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a659073-c6c5-4e08-9582-9502a9654bcb None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:08.724983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:08.739248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014a7ed-347b-441f-9637-eb85bae581c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:08.739854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014a7ed-347b-441f-9637-eb85bae581c9 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:08.740130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014a7ed-347b-441f-9637-eb85bae581c9 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:08.740399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014a7ed-347b-441f-9637-eb85bae581c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:08.748428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014a7ed-347b-441f-9637-eb85bae581c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:08.749893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014a7ed-347b-441f-9637-eb85bae581c9 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-c014a7ed-347b-441f-9637-eb85bae581c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:14:08.761319 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:08.762489 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:08.763495 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:08.763495 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:08.763495 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:14:08.763495 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:14:08.763495 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:14:08.763495 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:14:08.763495 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:14:08.763495 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:14:08.763495 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:14:08.763495 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:14:08.763495 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 625/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:14:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:08.768713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d1dc4-a132-4cc4-a662-457dee7a1ed0 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:08.888230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d1dc4-a132-4cc4-a662-457dee7a1ed0 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:08.922441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36878626-f6ad-4a12-b587-863600c1792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:08.923035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36878626-f6ad-4a12-b587-863600c1792a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:08.923309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36878626-f6ad-4a12-b587-863600c1792a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:08.923579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36878626-f6ad-4a12-b587-863600c1792a None admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:08.924292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36878626-f6ad-4a12-b587-863600c1792a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:08.924598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36878626-f6ad-4a12-b587-863600c1792a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:08.926565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36878626-f6ad-4a12-b587-863600c1792a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:08.935264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:08.944438 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 643/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Aug 29 15:14:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:08.950308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014a7ed-347b-441f-9637-eb85bae581c9 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:09.050726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014a7ed-347b-441f-9637-eb85bae581c9 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:09.084709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63b59d-599d-4e79-a859-a724c03a4a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:09.085330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63b59d-599d-4e79-a859-a724c03a4a21 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:09.085643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63b59d-599d-4e79-a859-a724c03a4a21 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:09.085919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63b59d-599d-4e79-a859-a724c03a4a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:09.096386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63b59d-599d-4e79-a859-a724c03a4a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:09.098388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63b59d-599d-4e79-a859-a724c03a4a21 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-fc63b59d-599d-4e79-a859-a724c03a4a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:14:09.113044 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:09.114237 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:14:09.115231 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:14:09.115231 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:09.115231 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:14:09.115231 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 626/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:09.120140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36878626-f6ad-4a12-b587-863600c1792a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:09.226225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36878626-f6ad-4a12-b587-863600c1792a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:09.266827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006adf6-4b05-45c9-b2cd-4269ff97c167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:09.267434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006adf6-4b05-45c9-b2cd-4269ff97c167 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:09.267712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006adf6-4b05-45c9-b2cd-4269ff97c167 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:09.267984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006adf6-4b05-45c9-b2cd-4269ff97c167 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:09.268626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006adf6-4b05-45c9-b2cd-4269ff97c167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:09.268928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006adf6-4b05-45c9-b2cd-4269ff97c167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:09.270468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006adf6-4b05-45c9-b2cd-4269ff97c167 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:09.281786 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 644/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:09.288086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63b59d-599d-4e79-a859-a724c03a4a21 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:09.319432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:09.387654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63b59d-599d-4e79-a859-a724c03a4a21 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:09.421356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d9f3-d2f4-4d4a-aa8a-36b7f4b5cb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:09.421998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d9f3-d2f4-4d4a-aa8a-36b7f4b5cb14 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:09.422278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d9f3-d2f4-4d4a-aa8a-36b7f4b5cb14 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:09.422553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d9f3-d2f4-4d4a-aa8a-36b7f4b5cb14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:09.429855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d9f3-d2f4-4d4a-aa8a-36b7f4b5cb14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:09.431301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d9f3-d2f4-4d4a-aa8a-36b7f4b5cb14 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-f904d9f3-d2f4-4d4a-aa8a-36b7f4b5cb14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:14:09.442404 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:09.443522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:09.444999 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:14:09.444999 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:14:09.444999 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:14:09.444999 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:14:09.444999 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:14:09.444999 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:14:09.444999 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:14:09.444999 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:14:09.444999 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 627/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:09.449352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006adf6-4b05-45c9-b2cd-4269ff97c167 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:09.508772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:09.553894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006adf6-4b05-45c9-b2cd-4269ff97c167 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:09.587559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21986f5e-4a46-4c97-bb17-03fcbd31cd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:09.588154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21986f5e-4a46-4c97-bb17-03fcbd31cd75 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:09.588433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21986f5e-4a46-4c97-bb17-03fcbd31cd75 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:09.588704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21986f5e-4a46-4c97-bb17-03fcbd31cd75 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:09.589417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21986f5e-4a46-4c97-bb17-03fcbd31cd75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:09.589757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21986f5e-4a46-4c97-bb17-03fcbd31cd75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:09.591157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21986f5e-4a46-4c97-bb17-03fcbd31cd75 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:09.603936 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 645/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:09.609975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d9f3-d2f4-4d4a-aa8a-36b7f4b5cb14 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:09.702659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:09.712128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d9f3-d2f4-4d4a-aa8a-36b7f4b5cb14 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:09.745484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c4007-80a8-46e2-8ba8-ee2f77226f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:09.746071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c4007-80a8-46e2-8ba8-ee2f77226f51 None admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:09.746349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c4007-80a8-46e2-8ba8-ee2f77226f51 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:09.746623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c4007-80a8-46e2-8ba8-ee2f77226f51 None admin] PATH_INFO: `/v3/projects/1c799b729bef4ed483416a87034fceb8/users/a0fc274aa6064fda9fab30fbd16df5aa/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:09.748486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c4007-80a8-46e2-8ba8-ee2f77226f51 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c799b729bef4ed483416a87034fceb8, user_id=a0fc274aa6064fda9fab30fbd16df5aa, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:09.749943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c4007-80a8-46e2-8ba8-ee2f77226f51 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:09.762786 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 628/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Aug 29 15:14:09 2022] PUT /identity/v3/projects/1c799b729bef4ed483416a87034fceb8/users/a0fc274aa6064fda9fab30fbd16df5aa/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:14:11.715846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003dc6d-f92c-4d98-8082-4f965ca90599 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:11.716457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003dc6d-f92c-4d98-8082-4f965ca90599 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:11.716457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003dc6d-f92c-4d98-8082-4f965ca90599 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:11.717790 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 646/1274] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:14:11.723343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27d15a-4e7c-492f-b5a9-768b95783e99 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:11.723792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27d15a-4e7c-492f-b5a9-768b95783e99 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:11.723880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27d15a-4e7c-492f-b5a9-768b95783e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:11.742509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7a27d15a-4e7c-492f-b5a9-768b95783e99 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:14:11.743684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7a27d15a-4e7c-492f-b5a9-768b95783e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:14:11.809259 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 629/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:14:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:14:12.079631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003dc6d-f92c-4d98-8082-4f965ca90599 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:12.181277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003dc6d-f92c-4d98-8082-4f965ca90599 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:12.198995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:12.216815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8e268-5adb-4713-8cd0-c2bdef87561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:12.217471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8e268-5adb-4713-8cd0-c2bdef87561e None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:12.217751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8e268-5adb-4713-8cd0-c2bdef87561e None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:12.218026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8e268-5adb-4713-8cd0-c2bdef87561e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:12.228911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8e268-5adb-4713-8cd0-c2bdef87561e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-31a8e268-5adb-4713-8cd0-c2bdef87561e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 15:14:12.233841 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:12.234938 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:12.235995 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 647/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Aug 29 15:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:12.242538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27d15a-4e7c-492f-b5a9-768b95783e99 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:12.323631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:12.343775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27d15a-4e7c-492f-b5a9-768b95783e99 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:12.381741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0662a-e39a-4b64-99f3-4deec224f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:12.382335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0662a-e39a-4b64-99f3-4deec224f562 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:12.382617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0662a-e39a-4b64-99f3-4deec224f562 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:12.382885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0662a-e39a-4b64-99f3-4deec224f562 None admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:12.383560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0662a-e39a-4b64-99f3-4deec224f562 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:12.383858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0662a-e39a-4b64-99f3-4deec224f562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:12.385217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0662a-e39a-4b64-99f3-4deec224f562 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:12.395391 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 630/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Aug 29 15:14:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:12.401398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8e268-5adb-4713-8cd0-c2bdef87561e None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:12.502532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8e268-5adb-4713-8cd0-c2bdef87561e None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:12.539915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c199d8-8272-4186-849b-0404884bd79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:12.540560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c199d8-8272-4186-849b-0404884bd79b None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:12.540841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c199d8-8272-4186-849b-0404884bd79b None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:12.541115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c199d8-8272-4186-849b-0404884bd79b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:12.552061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c199d8-8272-4186-849b-0404884bd79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:12.553540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c199d8-8272-4186-849b-0404884bd79b None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-92c199d8-8272-4186-849b-0404884bd79b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:14:12.568114 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:12.569449 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:14:12.570567 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:14:12.570567 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:12.570567 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:12.570567 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 648/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:12.575226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0662a-e39a-4b64-99f3-4deec224f562 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:12.675637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0662a-e39a-4b64-99f3-4deec224f562 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:12.708900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a94a64-18d7-44c3-a66e-251fb287e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:12.709525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a94a64-18d7-44c3-a66e-251fb287e5c6 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:12.709807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a94a64-18d7-44c3-a66e-251fb287e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:12.710078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a94a64-18d7-44c3-a66e-251fb287e5c6 None admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:12.710718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a94a64-18d7-44c3-a66e-251fb287e5c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:12.711020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a94a64-18d7-44c3-a66e-251fb287e5c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:12.712487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a94a64-18d7-44c3-a66e-251fb287e5c6 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:12.725007 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 631/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:12.730991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c199d8-8272-4186-849b-0404884bd79b None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:12.762015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:12.833995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c199d8-8272-4186-849b-0404884bd79b None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:12.874366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cecd6d-7089-4616-a9fc-bce5cf9aefd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:12.874990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cecd6d-7089-4616-a9fc-bce5cf9aefd6 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:12.875264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cecd6d-7089-4616-a9fc-bce5cf9aefd6 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:12.875974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cecd6d-7089-4616-a9fc-bce5cf9aefd6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:12.884265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cecd6d-7089-4616-a9fc-bce5cf9aefd6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:12.885722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cecd6d-7089-4616-a9fc-bce5cf9aefd6 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-b2cecd6d-7089-4616-a9fc-bce5cf9aefd6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:14:12.897381 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:12.898527 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:12.900176 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:12.900176 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:12.900176 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:14:12.900176 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:14:12.900176 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:14:12.900176 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:14:12.900176 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:14:12.900176 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:14:12.900176 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 15:14:12.900176 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:12.900176 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 649/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:14:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:12.905210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a94a64-18d7-44c3-a66e-251fb287e5c6 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:12.909103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:13.003812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a94a64-18d7-44c3-a66e-251fb287e5c6 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:13.038922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98a4f4-0ae2-4ed6-b7ff-84622da3c0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:13.039524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98a4f4-0ae2-4ed6-b7ff-84622da3c0ac None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:13.039807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98a4f4-0ae2-4ed6-b7ff-84622da3c0ac None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:13.040081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98a4f4-0ae2-4ed6-b7ff-84622da3c0ac None admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:13.040803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98a4f4-0ae2-4ed6-b7ff-84622da3c0ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:13.041107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98a4f4-0ae2-4ed6-b7ff-84622da3c0ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:13.042557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98a4f4-0ae2-4ed6-b7ff-84622da3c0ac None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:13.059610 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 632/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Aug 29 15:14:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:13.066083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cecd6d-7089-4616-a9fc-bce5cf9aefd6 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:13.155835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:13.165354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cecd6d-7089-4616-a9fc-bce5cf9aefd6 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:13.199019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f49a2-4a6a-4682-a869-30b2e8712979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:13.199626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f49a2-4a6a-4682-a869-30b2e8712979 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:13.199901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f49a2-4a6a-4682-a869-30b2e8712979 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:13.200172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f49a2-4a6a-4682-a869-30b2e8712979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:13.268828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f49a2-4a6a-4682-a869-30b2e8712979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:13.270253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f49a2-4a6a-4682-a869-30b2e8712979 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:13.365508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:13.376383 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 650/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Aug 29 15:14:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 15:14:13.383059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98a4f4-0ae2-4ed6-b7ff-84622da3c0ac None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:13.454357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:13.512629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98a4f4-0ae2-4ed6-b7ff-84622da3c0ac None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:13.547202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d9cdc-49c0-46ee-9310-7631ad01db01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:13.547692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9cdc-49c0-46ee-9310-7631ad01db01 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:13.547976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9cdc-49c0-46ee-9310-7631ad01db01 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:13.548248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9cdc-49c0-46ee-9310-7631ad01db01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:13.559287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d9cdc-49c0-46ee-9310-7631ad01db01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:13.560741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d9cdc-49c0-46ee-9310-7631ad01db01 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-872d9cdc-49c0-46ee-9310-7631ad01db01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:14:13.576335 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:13.581630 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 15:14:13.583589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:14:13.583589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 15:14:13.583589 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:14:13.583589 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 633/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:13.584058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f49a2-4a6a-4682-a869-30b2e8712979 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:13.686512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f49a2-4a6a-4682-a869-30b2e8712979 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:13.721008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075f9d1-7559-48b5-ab58-f3658eca70a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:13.722152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075f9d1-7559-48b5-ab58-f3658eca70a1 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:13.722430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075f9d1-7559-48b5-ab58-f3658eca70a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:13.722701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075f9d1-7559-48b5-ab58-f3658eca70a1 None admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:13.723338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075f9d1-7559-48b5-ab58-f3658eca70a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:13.723706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075f9d1-7559-48b5-ab58-f3658eca70a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:13.725459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075f9d1-7559-48b5-ab58-f3658eca70a1 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:13.737001 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 651/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Aug 29 15:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:13.743304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d9cdc-49c0-46ee-9310-7631ad01db01 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:13.845778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d9cdc-49c0-46ee-9310-7631ad01db01 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:13.860592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:13.881234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ea7b-b40d-496c-979e-60afc56bce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:13.881892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ea7b-b40d-496c-979e-60afc56bce28 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:13.882179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ea7b-b40d-496c-979e-60afc56bce28 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:13.882471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ea7b-b40d-496c-979e-60afc56bce28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:13.889076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4ea7b-b40d-496c-979e-60afc56bce28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:13.890552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4ea7b-b40d-496c-979e-60afc56bce28 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-58c4ea7b-b40d-496c-979e-60afc56bce28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 15:14:13.902942 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:13.904022 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:13.905264 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 15:14:13.905264 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 15:14:13.905264 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:14:13.905264 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:14:13.905264 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:14:13.905264 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:14:13.905264 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 15:14:13.905264 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:14:13.905264 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 634/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Aug 29 15:14:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:13.910467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075f9d1-7559-48b5-ab58-f3658eca70a1 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:13.959141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:14.008933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075f9d1-7559-48b5-ab58-f3658eca70a1 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:14.042857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c575f59-99b8-4c7e-8fe8-9b4d6d10f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:14.043462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575f59-99b8-4c7e-8fe8-9b4d6d10f863 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:14.043745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575f59-99b8-4c7e-8fe8-9b4d6d10f863 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:14.044019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575f59-99b8-4c7e-8fe8-9b4d6d10f863 None admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:14.044705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c575f59-99b8-4c7e-8fe8-9b4d6d10f863 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:14.045008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c575f59-99b8-4c7e-8fe8-9b4d6d10f863 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:14.046463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c575f59-99b8-4c7e-8fe8-9b4d6d10f863 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:14.058202 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 652/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Aug 29 15:14:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:14.064269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ea7b-b40d-496c-979e-60afc56bce28 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:14.166218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ea7b-b40d-496c-979e-60afc56bce28 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:14.198316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7d31d-724e-49a6-a5b5-6980dcd27956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:14.198911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7d31d-724e-49a6-a5b5-6980dcd27956 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:14.199187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7d31d-724e-49a6-a5b5-6980dcd27956 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:14.199457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7d31d-724e-49a6-a5b5-6980dcd27956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:14.200178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7d31d-724e-49a6-a5b5-6980dcd27956 None admin] RBAC: Adding query filter params (role.id=be89abac608f45a6921181bcc574f721, scope.project.id=1c799b729bef4ed483416a87034fceb8, user.id=a0fc274aa6064fda9fab30fbd16df5aa) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:14.200483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7d31d-724e-49a6-a5b5-6980dcd27956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:14.201937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7d31d-724e-49a6-a5b5-6980dcd27956 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:14.208038 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 635/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Aug 29 15:14:14 2022] GET /identity/v3/role_assignments?user.id=a0fc274aa6064fda9fab30fbd16df5aa&scope.project.id=1c799b729bef4ed483416a87034fceb8&role.id=be89abac608f45a6921181bcc574f721 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:16.192544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741a4f-07dd-480f-8a62-2b866a0a2c1a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:16.193114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741a4f-07dd-480f-8a62-2b866a0a2c1a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:16.193114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741a4f-07dd-480f-8a62-2b866a0a2c1a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:16.194516 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 653/1288] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:14:16.200393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1947a7d-da49-44c6-992d-cc750c4495f8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:16.200954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1947a7d-da49-44c6-992d-cc750c4495f8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:16.200954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1947a7d-da49-44c6-992d-cc750c4495f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:16.220897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e1947a7d-da49-44c6-992d-cc750c4495f8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:14:16.222189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e1947a7d-da49-44c6-992d-cc750c4495f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:14:16.254957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:16.301452 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 636/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:14:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:14:16.568121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f741a4f-07dd-480f-8a62-2b866a0a2c1a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:16.671129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f741a4f-07dd-480f-8a62-2b866a0a2c1a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:16.682390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:16.706590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083a4df-6338-456b-8d2e-9e2acba356c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:16.707258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083a4df-6338-456b-8d2e-9e2acba356c2 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:16.707538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083a4df-6338-456b-8d2e-9e2acba356c2 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:16.707815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083a4df-6338-456b-8d2e-9e2acba356c2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:16.708401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083a4df-6338-456b-8d2e-9e2acba356c2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:16.709794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083a4df-6338-456b-8d2e-9e2acba356c2 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-e083a4df-6338-456b-8d2e-9e2acba356c2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:16.718542 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:16.719844 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:16.721014 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 654/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Aug 29 15:14:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:16.726190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1947a7d-da49-44c6-992d-cc750c4495f8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:16.826480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1947a7d-da49-44c6-992d-cc750c4495f8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:16.874577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73bba2-f796-4618-a330-72f23bb01584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:16.875221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73bba2-f796-4618-a330-72f23bb01584 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:16.875534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73bba2-f796-4618-a330-72f23bb01584 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:16.875756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73bba2-f796-4618-a330-72f23bb01584 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:16.876491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73bba2-f796-4618-a330-72f23bb01584 None admin] RBAC: Adding query filter params (name=placement) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:16.876790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73bba2-f796-4618-a330-72f23bb01584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:16.878397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73bba2-f796-4618-a330-72f23bb01584 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:16.884169 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 637/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Aug 29 15:14:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:16.891108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083a4df-6338-456b-8d2e-9e2acba356c2 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:16.992452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083a4df-6338-456b-8d2e-9e2acba356c2 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:17.025481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bb09a-d34d-4a59-b174-c919831f9628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:17.026084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb09a-d34d-4a59-b174-c919831f9628 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:17.026365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb09a-d34d-4a59-b174-c919831f9628 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:17.026639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb09a-d34d-4a59-b174-c919831f9628 None admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:17.027265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bb09a-d34d-4a59-b174-c919831f9628 None admin] RBAC: Adding query filter params (type=placement) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:17.027566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bb09a-d34d-4a59-b174-c919831f9628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:17.028924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bb09a-d34d-4a59-b174-c919831f9628 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:17.033308 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 655/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Aug 29 15:14:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:18.926718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3e78-a489-4d58-9e16-b940fd5fc270 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:18.927237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3e78-a489-4d58-9e16-b940fd5fc270 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:18.927237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3e78-a489-4d58-9e16-b940fd5fc270 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:18.928514 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 638/1293] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:14:18.934108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8c51-506d-4694-b324-a90b6926ee4d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:18.934546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8c51-506d-4694-b324-a90b6926ee4d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:18.934647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8c51-506d-4694-b324-a90b6926ee4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:18.954432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-97ff8c51-506d-4694-b324-a90b6926ee4d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:14:18.955753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-97ff8c51-506d-4694-b324-a90b6926ee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:14:18.986707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:19.027503 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 656/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:14:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:14:19.295966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be3e78-a489-4d58-9e16-b940fd5fc270 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:19.328034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:19.399752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be3e78-a489-4d58-9e16-b940fd5fc270 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:19.433612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda40396-7f57-45a9-b153-4e2edd027ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:19.434210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40396-7f57-45a9-b153-4e2edd027ddf None admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:19.434490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40396-7f57-45a9-b153-4e2edd027ddf None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:19.434762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40396-7f57-45a9-b153-4e2edd027ddf None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:19.435412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda40396-7f57-45a9-b153-4e2edd027ddf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:19.436769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda40396-7f57-45a9-b153-4e2edd027ddf None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:19.451849 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 639/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Aug 29 15:14:19 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:14:21.373754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9f12-99f8-4e9e-ba80-e364f66abf9f None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:21.374306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9f12-99f8-4e9e-ba80-e364f66abf9f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:21.374306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9f12-99f8-4e9e-ba80-e364f66abf9f None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:21.375673 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 657/1296] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:14:21.382271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2264e7-8650-42dc-a9d2-f19473662faf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:21.382764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2264e7-8650-42dc-a9d2-f19473662faf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:21.382913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2264e7-8650-42dc-a9d2-f19473662faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:21.402097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4c2264e7-8650-42dc-a9d2-f19473662faf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:14:21.403304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4c2264e7-8650-42dc-a9d2-f19473662faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:14:21.477215 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 640/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:14:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:14:21.748470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e9f12-99f8-4e9e-ba80-e364f66abf9f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:21.861131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e9f12-99f8-4e9e-ba80-e364f66abf9f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:21.902341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5f867-4009-44f8-bc18-73c45556886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:21.902851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5f867-4009-44f8-bc18-73c45556886a None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:21.903133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5f867-4009-44f8-bc18-73c45556886a None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:21.903405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5f867-4009-44f8-bc18-73c45556886a None admin] PATH_INFO: `/v3/services/placement` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:21.903996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5f867-4009-44f8-bc18-73c45556886a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:21.905373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5f867-4009-44f8-bc18-73c45556886a None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-cad5f867-4009-44f8-bc18-73c45556886a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:21.915300 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:21.916553 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:21.917605 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 658/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Aug 29 15:14:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:21.922871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2264e7-8650-42dc-a9d2-f19473662faf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:21.941974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:22.021971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2264e7-8650-42dc-a9d2-f19473662faf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:22.055662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec086b-b586-4c01-ac71-1b8ecc435168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:22.056253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec086b-b586-4c01-ac71-1b8ecc435168 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:22.056529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec086b-b586-4c01-ac71-1b8ecc435168 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:22.056796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec086b-b586-4c01-ac71-1b8ecc435168 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:22.057433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec086b-b586-4c01-ac71-1b8ecc435168 None admin] RBAC: Adding query filter params (name=placement) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:22.057734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec086b-b586-4c01-ac71-1b8ecc435168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:22.059078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec086b-b586-4c01-ac71-1b8ecc435168 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:22.064075 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 641/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Aug 29 15:14:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:22.070679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5f867-4009-44f8-bc18-73c45556886a None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:22.103252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:22.171573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5f867-4009-44f8-bc18-73c45556886a None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:22.204877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f820f-4bc6-49d7-9582-a8fbaab16226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:22.206087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f820f-4bc6-49d7-9582-a8fbaab16226 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:22.206440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f820f-4bc6-49d7-9582-a8fbaab16226 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:22.206724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f820f-4bc6-49d7-9582-a8fbaab16226 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:22.207426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f820f-4bc6-49d7-9582-a8fbaab16226 None admin] RBAC: Adding query filter params (interface=public, service_id=16015285e22144efbabeeb8583c70291, region_id=RegionOne) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:22.207735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f820f-4bc6-49d7-9582-a8fbaab16226 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:22.209098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f820f-4bc6-49d7-9582-a8fbaab16226 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:22.214293 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 659/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Aug 29 15:14:22 2022] GET /identity/v3/endpoints?service_id=16015285e22144efbabeeb8583c70291&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:22.220057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec086b-b586-4c01-ac71-1b8ecc435168 None admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:22.299975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:22.318232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec086b-b586-4c01-ac71-1b8ecc435168 None admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:22.352837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f510a35-b44e-4919-9d04-5c7fa3508561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:22.353457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510a35-b44e-4919-9d04-5c7fa3508561 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:22.353739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510a35-b44e-4919-9d04-5c7fa3508561 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:22.354009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510a35-b44e-4919-9d04-5c7fa3508561 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:22.354608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f510a35-b44e-4919-9d04-5c7fa3508561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:22.355962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f510a35-b44e-4919-9d04-5c7fa3508561 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:22.363206 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 642/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Aug 29 15:14:22 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:14:24.317458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570542c-aba4-4d04-b512-c0d9aa99c722 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:24.317990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570542c-aba4-4d04-b512-c0d9aa99c722 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:24.317990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570542c-aba4-4d04-b512-c0d9aa99c722 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:24.319356 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 660/1302] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:14:24.324777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b76c3-33b4-4154-a293-991dcbb7fdec None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:24.325174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b76c3-33b4-4154-a293-991dcbb7fdec None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:24.325329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b76c3-33b4-4154-a293-991dcbb7fdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:24.343687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-258b76c3-33b4-4154-a293-991dcbb7fdec None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:14:24.344882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-258b76c3-33b4-4154-a293-991dcbb7fdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:14:24.421469 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 643/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:14:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 15:14:24.705614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570542c-aba4-4d04-b512-c0d9aa99c722 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:24.834109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:24.842915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570542c-aba4-4d04-b512-c0d9aa99c722 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:24.884118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868e6c-129b-432f-97a2-9151ec328545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:24.884747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868e6c-129b-432f-97a2-9151ec328545 None admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:24.885028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868e6c-129b-432f-97a2-9151ec328545 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:24.885304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868e6c-129b-432f-97a2-9151ec328545 None admin] PATH_INFO: `/v3/services/placement` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:24.885912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82868e6c-129b-432f-97a2-9151ec328545 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:24.887262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82868e6c-129b-432f-97a2-9151ec328545 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-82868e6c-129b-432f-97a2-9151ec328545 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:14:24.896078 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:14:24.897272 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:14:24.898531 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 661/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Aug 29 15:14:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:14:24.903553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b76c3-33b4-4154-a293-991dcbb7fdec None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:24.979738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:25.004093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b76c3-33b4-4154-a293-991dcbb7fdec None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:25.039702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2213a7f-a165-47d2-90c1-f0266e2b53e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:25.040300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2213a7f-a165-47d2-90c1-f0266e2b53e6 None admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:25.040574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2213a7f-a165-47d2-90c1-f0266e2b53e6 None admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:25.040840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2213a7f-a165-47d2-90c1-f0266e2b53e6 None admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:25.041495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2213a7f-a165-47d2-90c1-f0266e2b53e6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:14:25.041794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2213a7f-a165-47d2-90c1-f0266e2b53e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:25.043147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2213a7f-a165-47d2-90c1-f0266e2b53e6 None admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:25.048449 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 644/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Aug 29 15:14:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:14:25.055630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868e6c-129b-432f-97a2-9151ec328545 None admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:14:25.157757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868e6c-129b-432f-97a2-9151ec328545 None admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:14:25.191672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d69444-602d-421e-9d01-1a9473c92e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:14:25.192272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d69444-602d-421e-9d01-1a9473c92e41 None admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:14:25.192551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d69444-602d-421e-9d01-1a9473c92e41 None admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:14:25.192825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d69444-602d-421e-9d01-1a9473c92e41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:14:25.193507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d69444-602d-421e-9d01-1a9473c92e41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:14:25.194866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d69444-602d-421e-9d01-1a9473c92e41 None admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:14:25.222681 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 662/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:14:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:14:35.045553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=30 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:14:35.217258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:30.920094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3afc48-f665-4977-9c62-b42d22965e8b None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:30.920641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3afc48-f665-4977-9c62-b42d22965e8b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:30.920641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3afc48-f665-4977-9c62-b42d22965e8b None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:30.921918 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 645/1307] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:15:30.927590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d56cd-2262-4172-a656-7f0b0bc429bc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:30.928224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d56cd-2262-4172-a656-7f0b0bc429bc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:30.928224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d56cd-2262-4172-a656-7f0b0bc429bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:31.093169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6c3d56cd-2262-4172-a656-7f0b0bc429bc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:15:31.094759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6c3d56cd-2262-4172-a656-7f0b0bc429bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:31.286142 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 663/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:15:31.700499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae8a57-9650-438f-9835-cf7c547804fb None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:31.700877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae8a57-9650-438f-9835-cf7c547804fb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:31.701057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae8a57-9650-438f-9835-cf7c547804fb None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:31.703209 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 646/1309] 10.222.0.16 () {54 vars in 965 bytes} [Mon Aug 29 15:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:15:31.710730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ceb5-7708-4b2a-8351-3b7aad671d7e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:31.711170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ceb5-7708-4b2a-8351-3b7aad671d7e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:31.711560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ceb5-7708-4b2a-8351-3b7aad671d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:31.812703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7d88ceb5-7708-4b2a-8351-3b7aad671d7e None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:15:31.812703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7d88ceb5-7708-4b2a-8351-3b7aad671d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:31.848156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:31.935035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae8a57-9650-438f-9835-cf7c547804fb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:15:31.937477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-24ae8a57-9650-438f-9835-cf7c547804fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:31.942392 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 664/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Mon Aug 29 15:15:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:15:32.053653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae8a57-9650-438f-9835-cf7c547804fb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:15:32.130606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced33dd6-2a1c-4aa6-8dfd-8cee3106e95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:15:32.131133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced33dd6-2a1c-4aa6-8dfd-8cee3106e95f service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:32.131407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced33dd6-2a1c-4aa6-8dfd-8cee3106e95f service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:32.131674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced33dd6-2a1c-4aa6-8dfd-8cee3106e95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:32.133267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ced33dd6-2a1c-4aa6-8dfd-8cee3106e95f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:32.192675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:32.251799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced33dd6-2a1c-4aa6-8dfd-8cee3106e95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:15:32.253238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced33dd6-2a1c-4aa6-8dfd-8cee3106e95f service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:15:32.272814 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 647/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:15:34.671968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9396-e304-4764-b376-3e707eb2ab31 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:34.672557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9396-e304-4764-b376-3e707eb2ab31 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:34.672557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9396-e304-4764-b376-3e707eb2ab31 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:34.673917 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 665/1312] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:15:34.679237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43b6a3-bbd9-4385-8d7e-87e3877c660e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:34.679720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43b6a3-bbd9-4385-8d7e-87e3877c660e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:34.679889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43b6a3-bbd9-4385-8d7e-87e3877c660e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:34.757264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4a43b6a3-bbd9-4385-8d7e-87e3877c660e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:15:34.758514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a43b6a3-bbd9-4385-8d7e-87e3877c660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:34.872764 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 648/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:15:35.155975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b9396-e304-4764-b376-3e707eb2ab31 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:15:35.157595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fd8b9396-e304-4764-b376-3e707eb2ab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:35.263535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b9396-e304-4764-b376-3e707eb2ab31 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:15:35.337726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:35.340986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df1068-32f8-4bb2-bb45-978384ffece2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:15:35.341897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df1068-32f8-4bb2-bb45-978384ffece2 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:35.342191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df1068-32f8-4bb2-bb45-978384ffece2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:35.342669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df1068-32f8-4bb2-bb45-978384ffece2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:35.345070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-02df1068-32f8-4bb2-bb45-978384ffece2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:35.458122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df1068-32f8-4bb2-bb45-978384ffece2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:15:35.459483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df1068-32f8-4bb2-bb45-978384ffece2 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:15:35.478467 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 666/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:15:37.737039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df8cc5-0619-4c98-80a7-ff25c9928a91 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:37.737595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df8cc5-0619-4c98-80a7-ff25c9928a91 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:37.737595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df8cc5-0619-4c98-80a7-ff25c9928a91 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:37.738956 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 649/1315] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:15:37.743979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d723a-c241-446f-941b-5734cc3ce3cc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:37.744409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d723a-c241-446f-941b-5734cc3ce3cc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:37.744516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d723a-c241-446f-941b-5734cc3ce3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:37.813481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-da4d723a-c241-446f-941b-5734cc3ce3cc None None] MFA Rules not processed for user `dc4f177107dd484bb54b563adc03c2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:15:37.814649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-da4d723a-c241-446f-941b-5734cc3ce3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:37.877399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:37.927046 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 667/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:15:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:15:38.221982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df8cc5-0619-4c98-80a7-ff25c9928a91 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:15:38.223532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-93df8cc5-0619-4c98-80a7-ff25c9928a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:38.233294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:38.328336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df8cc5-0619-4c98-80a7-ff25c9928a91 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:15:38.402187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741a0f9-e500-4034-89dc-47c12057fbd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:15:38.402789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741a0f9-e500-4034-89dc-47c12057fbd7 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:38.403075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741a0f9-e500-4034-89dc-47c12057fbd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:38.403347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741a0f9-e500-4034-89dc-47c12057fbd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:38.404952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1741a0f9-e500-4034-89dc-47c12057fbd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:38.467675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:38.515509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741a0f9-e500-4034-89dc-47c12057fbd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:15:38.516976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741a0f9-e500-4034-89dc-47c12057fbd7 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:15:38.538986 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 650/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:15:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:15:41.088442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4c732-bd31-45b7-af61-83afa403cb02 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:41.088941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4c732-bd31-45b7-af61-83afa403cb02 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:41.088941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4c732-bd31-45b7-af61-83afa403cb02 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:41.090310 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 668/1318] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:15:41.096084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495123c1-8f86-418b-a00f-5d17f430d698 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:41.096473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495123c1-8f86-418b-a00f-5d17f430d698 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:41.096629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495123c1-8f86-418b-a00f-5d17f430d698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:41.162031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-495123c1-8f86-418b-a00f-5d17f430d698 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:15:41.163231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-495123c1-8f86-418b-a00f-5d17f430d698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:41.257076 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 651/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:15:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:15:41.554748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cde14-5fcc-4280-b5a0-293c5f7e31dd None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:41.555039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cde14-5fcc-4280-b5a0-293c5f7e31dd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:41.555321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cde14-5fcc-4280-b5a0-293c5f7e31dd None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:41.556732 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 669/1320] 10.222.0.16 () {54 vars in 965 bytes} [Mon Aug 29 15:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:15:41.563365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3e37f-33b1-4450-924a-cee63a851594 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:41.563650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3e37f-33b1-4450-924a-cee63a851594 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:41.563979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3e37f-33b1-4450-924a-cee63a851594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:41.586136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:41.640611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a5c3e37f-33b1-4450-924a-cee63a851594 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:15:41.642477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a5c3e37f-33b1-4450-924a-cee63a851594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:41.718735 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 652/1321] 10.222.0.16 () {58 vars in 1062 bytes} [Mon Aug 29 15:15:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:15:41.727805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cde14-5fcc-4280-b5a0-293c5f7e31dd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:15:41.729377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0e1cde14-5fcc-4280-b5a0-293c5f7e31dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:41.838731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cde14-5fcc-4280-b5a0-293c5f7e31dd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:15:41.915310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72f038-b4cc-40d6-9937-616681bf7be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:15:41.915915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f038-b4cc-40d6-9937-616681bf7be5 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:41.916193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f038-b4cc-40d6-9937-616681bf7be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:41.916465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f038-b4cc-40d6-9937-616681bf7be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:41.918098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2f72f038-b4cc-40d6-9937-616681bf7be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:41.926029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:42.037827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72f038-b4cc-40d6-9937-616681bf7be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:15:42.039227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72f038-b4cc-40d6-9937-616681bf7be5 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:15:42.059149 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 670/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:15:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:15:45.104426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1160-f995-4e8b-bab0-f8d685e88746 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:45.104930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1160-f995-4e8b-bab0-f8d685e88746 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:45.104930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1160-f995-4e8b-bab0-f8d685e88746 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:45.106281 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 653/1323] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:15:45.112229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a4540-cbdd-423d-ab3c-11a072e6de13 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:45.112755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a4540-cbdd-423d-ab3c-11a072e6de13 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:45.112755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a4540-cbdd-423d-ab3c-11a072e6de13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:45.179380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0b7a4540-cbdd-423d-ab3c-11a072e6de13 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:15:45.180580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0b7a4540-cbdd-423d-ab3c-11a072e6de13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:45.239185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:45.279199 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 671/1324] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:15:45.564211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1160-f995-4e8b-bab0-f8d685e88746 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:15:45.565794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cc9e1160-f995-4e8b-bab0-f8d685e88746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:45.677535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1160-f995-4e8b-bab0-f8d685e88746 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:15:45.690088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:45.752685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa7e06-e75a-40c5-b1cc-05b972a06541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:15:45.753276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa7e06-e75a-40c5-b1cc-05b972a06541 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:45.753577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa7e06-e75a-40c5-b1cc-05b972a06541 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:45.753852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa7e06-e75a-40c5-b1cc-05b972a06541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:45.755423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-53aa7e06-e75a-40c5-b1cc-05b972a06541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:45.878989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa7e06-e75a-40c5-b1cc-05b972a06541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:15:45.880346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa7e06-e75a-40c5-b1cc-05b972a06541 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:15:45.901078 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 654/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:15:47.929461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9977f-9129-454d-8d38-f3c4ca0fb084 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:47.929975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9977f-9129-454d-8d38-f3c4ca0fb084 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:47.929975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9977f-9129-454d-8d38-f3c4ca0fb084 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:47.931272 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 672/1326] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:15:47.936862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9bb9-e71d-4e7f-abea-2d9ea713a907 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:47.937321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9bb9-e71d-4e7f-abea-2d9ea713a907 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:47.937560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9bb9-e71d-4e7f-abea-2d9ea713a907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:47.991211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:48.012595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-988b9bb9-e71d-4e7f-abea-2d9ea713a907 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:15:48.014016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-988b9bb9-e71d-4e7f-abea-2d9ea713a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:48.114787 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 655/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:15:48.392781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9977f-9129-454d-8d38-f3c4ca0fb084 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:15:48.394381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1bb9977f-9129-454d-8d38-f3c4ca0fb084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:48.501275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9977f-9129-454d-8d38-f3c4ca0fb084 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:15:48.593110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459d86e-8f2f-4cbb-86d3-e5f92307d8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:15:48.593743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459d86e-8f2f-4cbb-86d3-e5f92307d8be service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:48.594085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459d86e-8f2f-4cbb-86d3-e5f92307d8be service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:48.594844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459d86e-8f2f-4cbb-86d3-e5f92307d8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:48.596451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8459d86e-8f2f-4cbb-86d3-e5f92307d8be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:48.613369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:48.708083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459d86e-8f2f-4cbb-86d3-e5f92307d8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:15:48.709566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459d86e-8f2f-4cbb-86d3-e5f92307d8be service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:15:48.728554 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 673/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:15:50.749689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba414-82d8-48ef-88fc-3f33f5ddbf4b None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:50.750805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba414-82d8-48ef-88fc-3f33f5ddbf4b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:50.750953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba414-82d8-48ef-88fc-3f33f5ddbf4b None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:50.752359 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 656/1329] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:15:50.758222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d5f4-0ca3-4519-8b53-937164ae488c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:50.758768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d5f4-0ca3-4519-8b53-937164ae488c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:50.758768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d5f4-0ca3-4519-8b53-937164ae488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:50.834562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6830d5f4-0ca3-4519-8b53-937164ae488c None None] MFA Rules not processed for user `dc4f177107dd484bb54b563adc03c2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:15:50.835772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6830d5f4-0ca3-4519-8b53-937164ae488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:50.905490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:50.941449 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 674/1330] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:15:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:15:51.224998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ba414-82d8-48ef-88fc-3f33f5ddbf4b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:15:51.226575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c02ba414-82d8-48ef-88fc-3f33f5ddbf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:51.344601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ba414-82d8-48ef-88fc-3f33f5ddbf4b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:15:51.374179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:51.441182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daf18f-0f99-4fa8-a41d-ee69998f324f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:15:51.442208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf18f-0f99-4fa8-a41d-ee69998f324f service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:51.443136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf18f-0f99-4fa8-a41d-ee69998f324f service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:51.443410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf18f-0f99-4fa8-a41d-ee69998f324f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:51.445074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f8daf18f-0f99-4fa8-a41d-ee69998f324f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:51.568072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daf18f-0f99-4fa8-a41d-ee69998f324f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:15:51.569542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daf18f-0f99-4fa8-a41d-ee69998f324f service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:15:51.588924 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 657/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:15:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:15:53.899653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429cb12-524d-49ce-8880-b200620019ab None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:53.900159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429cb12-524d-49ce-8880-b200620019ab None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:53.900159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429cb12-524d-49ce-8880-b200620019ab None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:53.901508 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 675/1332] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:15:53.907651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf486-9d2d-4a76-a5dc-28becf1bfae2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:53.908086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf486-9d2d-4a76-a5dc-28becf1bfae2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:53.908179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf486-9d2d-4a76-a5dc-28becf1bfae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:53.972157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:53.975148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-14cbf486-9d2d-4a76-a5dc-28becf1bfae2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:15:53.976840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-14cbf486-9d2d-4a76-a5dc-28becf1bfae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:54.106832 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 658/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:15:54.395284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429cb12-524d-49ce-8880-b200620019ab None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:15:54.396930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b429cb12-524d-49ce-8880-b200620019ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:54.502575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429cb12-524d-49ce-8880-b200620019ab None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:15:54.576224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1d906-6db7-4653-b22a-7f4c15d8f5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:15:54.576825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1d906-6db7-4653-b22a-7f4c15d8f5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:54.577139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1d906-6db7-4653-b22a-7f4c15d8f5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:54.577429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1d906-6db7-4653-b22a-7f4c15d8f5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:54.579109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8cc1d906-6db7-4653-b22a-7f4c15d8f5d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:54.606390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:54.690993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1d906-6db7-4653-b22a-7f4c15d8f5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:15:54.692435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1d906-6db7-4653-b22a-7f4c15d8f5d6 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:15:54.710457 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 676/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:15:56.771314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a3bcf-91d0-440e-b3b7-16a46e320003 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:56.771881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a3bcf-91d0-440e-b3b7-16a46e320003 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:56.771881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a3bcf-91d0-440e-b3b7-16a46e320003 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:56.773198 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 659/1335] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:15:56.778769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845267-d752-4384-a745-fe77e336b230 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:56.779246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845267-d752-4384-a745-fe77e336b230 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:56.779355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845267-d752-4384-a745-fe77e336b230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:56.886686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-89845267-d752-4384-a745-fe77e336b230 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:15:56.887897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-89845267-d752-4384-a745-fe77e336b230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:56.967113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:56.992571 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 677/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:15:57.332101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a3bcf-91d0-440e-b3b7-16a46e320003 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:15:57.333931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f20a3bcf-91d0-440e-b3b7-16a46e320003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:57.447732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a3bcf-91d0-440e-b3b7-16a46e320003 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:15:57.475856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:57.530601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c8ea-614d-48c9-a8fa-b9bf638719d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:15:57.532155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c8ea-614d-48c9-a8fa-b9bf638719d5 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:15:57.532618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c8ea-614d-48c9-a8fa-b9bf638719d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:15:57.533085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c8ea-614d-48c9-a8fa-b9bf638719d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:15:57.536067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc88c8ea-614d-48c9-a8fa-b9bf638719d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:15:57.661548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88c8ea-614d-48c9-a8fa-b9bf638719d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:15:57.662928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88c8ea-614d-48c9-a8fa-b9bf638719d5 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:15:57.685089 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 660/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:00.096018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c02ad-6da6-4502-8406-1956bf286fa0 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:00.096587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c02ad-6da6-4502-8406-1956bf286fa0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:00.096587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c02ad-6da6-4502-8406-1956bf286fa0 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:00.097933 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 678/1338] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:00.103249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac505b-41f5-434e-bbd1-13d3ca5af902 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:00.103660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac505b-41f5-434e-bbd1-13d3ca5af902 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:00.103806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac505b-41f5-434e-bbd1-13d3ca5af902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:00.171422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c0ac505b-41f5-434e-bbd1-13d3ca5af902 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:00.173183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c0ac505b-41f5-434e-bbd1-13d3ca5af902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:00.181647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:00.268996 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 661/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:00.549451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c02ad-6da6-4502-8406-1956bf286fa0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:00.551558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-375c02ad-6da6-4502-8406-1956bf286fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:00.665582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c02ad-6da6-4502-8406-1956bf286fa0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:00.741186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91d08c-592e-4b43-9b9f-4de259f63710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:00.741831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91d08c-592e-4b43-9b9f-4de259f63710 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:00.742110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91d08c-592e-4b43-9b9f-4de259f63710 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:00.742380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91d08c-592e-4b43-9b9f-4de259f63710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:00.743999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7e91d08c-592e-4b43-9b9f-4de259f63710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:00.780958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:00.856398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91d08c-592e-4b43-9b9f-4de259f63710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:00.857887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91d08c-592e-4b43-9b9f-4de259f63710 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:00.876428 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 679/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:04.811259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f88203-d413-4287-858d-96ca5fbaf398 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:04.811832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f88203-d413-4287-858d-96ca5fbaf398 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:04.811832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f88203-d413-4287-858d-96ca5fbaf398 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:04.813206 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 662/1341] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:04.818638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74239e77-c584-42d1-8eaf-34125dd8a33c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:04.819099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74239e77-c584-42d1-8eaf-34125dd8a33c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:04.819194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74239e77-c584-42d1-8eaf-34125dd8a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:04.898729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-74239e77-c584-42d1-8eaf-34125dd8a33c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:04.900350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-74239e77-c584-42d1-8eaf-34125dd8a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:04.991994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:05.004248 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 680/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:05.290978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f88203-d413-4287-858d-96ca5fbaf398 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:05.292498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75f88203-d413-4287-858d-96ca5fbaf398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:05.398666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f88203-d413-4287-858d-96ca5fbaf398 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:05.436969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:05.474121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240c463-ac16-4f60-bf73-578b2dbf4cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:05.474730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240c463-ac16-4f60-bf73-578b2dbf4cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:05.475029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240c463-ac16-4f60-bf73-578b2dbf4cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:05.475273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240c463-ac16-4f60-bf73-578b2dbf4cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:05.476842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6240c463-ac16-4f60-bf73-578b2dbf4cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:05.594430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240c463-ac16-4f60-bf73-578b2dbf4cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:05.595875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240c463-ac16-4f60-bf73-578b2dbf4cf8 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:05.615619 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 663/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:08.116544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a0801-9137-4d19-97a3-9b53da6c48fd None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:08.117100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a0801-9137-4d19-97a3-9b53da6c48fd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:08.117195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a0801-9137-4d19-97a3-9b53da6c48fd None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:08.118601 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 681/1344] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:08.124500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4aeb-8e24-4bba-9881-bf09c80956bd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:08.125078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4aeb-8e24-4bba-9881-bf09c80956bd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:08.125078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4aeb-8e24-4bba-9881-bf09c80956bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:08.197940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a61a4aeb-8e24-4bba-9881-bf09c80956bd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:08.199157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a61a4aeb-8e24-4bba-9881-bf09c80956bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:08.219897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:08.306870 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 664/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:16:08.594478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a0801-9137-4d19-97a3-9b53da6c48fd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:08.596102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e28a0801-9137-4d19-97a3-9b53da6c48fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:08.704368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a0801-9137-4d19-97a3-9b53da6c48fd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:08.777827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933d9f8-4f5b-44ee-b9c6-da9fcc6586ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:08.778442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d9f8-4f5b-44ee-b9c6-da9fcc6586ac service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:08.778721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d9f8-4f5b-44ee-b9c6-da9fcc6586ac service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:08.778998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d9f8-4f5b-44ee-b9c6-da9fcc6586ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:08.780594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3933d9f8-4f5b-44ee-b9c6-da9fcc6586ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:08.823616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:08.905527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933d9f8-4f5b-44ee-b9c6-da9fcc6586ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:08.907515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933d9f8-4f5b-44ee-b9c6-da9fcc6586ac service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:08.926851 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 682/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:13.004929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e84d-185e-4cb5-a4a2-c8a56541a8ee None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:13.005877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e84d-185e-4cb5-a4a2-c8a56541a8ee None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:13.006368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e84d-185e-4cb5-a4a2-c8a56541a8ee None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:13.008407 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 665/1347] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:13.013714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457a30-a420-49a3-b171-f65e5fcbef94 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:13.014195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457a30-a420-49a3-b171-f65e5fcbef94 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:13.014195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457a30-a420-49a3-b171-f65e5fcbef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:13.105929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8f457a30-a420-49a3-b171-f65e5fcbef94 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:13.107249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8f457a30-a420-49a3-b171-f65e5fcbef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:13.216242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:13.219395 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 683/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:13.524548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2e84d-185e-4cb5-a4a2-c8a56541a8ee None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:13.526457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5fc2e84d-185e-4cb5-a4a2-c8a56541a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:13.639180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2e84d-185e-4cb5-a4a2-c8a56541a8ee None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:13.688941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:13.715660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc976a87-79e3-4353-9ebe-e353cb4f58a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:13.716258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976a87-79e3-4353-9ebe-e353cb4f58a3 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:13.716535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976a87-79e3-4353-9ebe-e353cb4f58a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:13.716805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976a87-79e3-4353-9ebe-e353cb4f58a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:13.718437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bc976a87-79e3-4353-9ebe-e353cb4f58a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:13.829061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc976a87-79e3-4353-9ebe-e353cb4f58a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:13.830476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc976a87-79e3-4353-9ebe-e353cb4f58a3 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:13.848920 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 666/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:18.787649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fde196-c331-478c-b802-dd4063e7d14b None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:18.788160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fde196-c331-478c-b802-dd4063e7d14b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:18.788160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fde196-c331-478c-b802-dd4063e7d14b None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:18.789813 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 684/1350] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:18.795023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858536d5-383d-47ca-9359-a50f84cdf661 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:18.795472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858536d5-383d-47ca-9359-a50f84cdf661 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:18.795557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858536d5-383d-47ca-9359-a50f84cdf661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:18.891512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-858536d5-383d-47ca-9359-a50f84cdf661 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:18.897805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-858536d5-383d-47ca-9359-a50f84cdf661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:18.911060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:19.047905 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 667/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:16:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:16:23.195044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ee78-8ed2-431c-be11-64fa691fac4a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:23.195533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ee78-8ed2-431c-be11-64fa691fac4a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:23.195533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ee78-8ed2-431c-be11-64fa691fac4a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:23.197064 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 685/1352] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:23.201767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5f0e3-8f5d-43f9-b58e-a64a5346ee9c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:23.202539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5f0e3-8f5d-43f9-b58e-a64a5346ee9c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:23.203386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5f0e3-8f5d-43f9-b58e-a64a5346ee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:23.286696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-05d5f0e3-8f5d-43f9-b58e-a64a5346ee9c None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:23.287912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-05d5f0e3-8f5d-43f9-b58e-a64a5346ee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:23.362098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:23.404907 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 668/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:16:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:24.902039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12099-d45a-47b8-a995-ba0fc0919918 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:24.902533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12099-d45a-47b8-a995-ba0fc0919918 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:24.902720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12099-d45a-47b8-a995-ba0fc0919918 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:24.904141 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 686/1354] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:24.909668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef0db-e4ee-4cc4-87b0-02aaadaed43d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:24.910134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef0db-e4ee-4cc4-87b0-02aaadaed43d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:24.910357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef0db-e4ee-4cc4-87b0-02aaadaed43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:24.986899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3b5ef0db-e4ee-4cc4-87b0-02aaadaed43d None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:24.988111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3b5ef0db-e4ee-4cc4-87b0-02aaadaed43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:25.100891 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 669/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:16:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:28.316802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f1b7-bcbd-4014-aa11-a55a885d342f None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:28.317458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f1b7-bcbd-4014-aa11-a55a885d342f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:28.317458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f1b7-bcbd-4014-aa11-a55a885d342f None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:28.318753 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 687/1356] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:28.324050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4386-57fe-4199-9c05-3c2a2cdee67c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:28.324494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4386-57fe-4199-9c05-3c2a2cdee67c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:28.324593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4386-57fe-4199-9c05-3c2a2cdee67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:28.365524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:28.407012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-393f4386-57fe-4199-9c05-3c2a2cdee67c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:28.408529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-393f4386-57fe-4199-9c05-3c2a2cdee67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:28.549415 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 670/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:28.848311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643125-c885-4e8f-98d9-82739b7ccca9 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:28.849222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643125-c885-4e8f-98d9-82739b7ccca9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:28.850365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643125-c885-4e8f-98d9-82739b7ccca9 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:28.853828 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 688/1358] 10.222.0.16 () {54 vars in 962 bytes} [Mon Aug 29 15:16:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:28.864787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10dc05-78d9-43c1-9b81-097077ca4a8f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:28.865855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10dc05-78d9-43c1-9b81-097077ca4a8f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:28.867185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10dc05-78d9-43c1-9b81-097077ca4a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:28.963738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8d10dc05-78d9-43c1-9b81-097077ca4a8f None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:28.964926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8d10dc05-78d9-43c1-9b81-097077ca4a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:29.017750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:29.094006 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 671/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Aug 29 15:16:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:29.101659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643125-c885-4e8f-98d9-82739b7ccca9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:29.103185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e2643125-c885-4e8f-98d9-82739b7ccca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:29.264823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643125-c885-4e8f-98d9-82739b7ccca9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:29.348551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:29.392774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637365ff-2ed9-48f0-97ee-66eda1c67c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:29.393396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637365ff-2ed9-48f0-97ee-66eda1c67c5d service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:29.393762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637365ff-2ed9-48f0-97ee-66eda1c67c5d service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:29.394038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637365ff-2ed9-48f0-97ee-66eda1c67c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:29.395678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-637365ff-2ed9-48f0-97ee-66eda1c67c5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:29.495662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637365ff-2ed9-48f0-97ee-66eda1c67c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:29.497257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637365ff-2ed9-48f0-97ee-66eda1c67c5d service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:29.517267 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 689/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:31.667288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6779b-d91e-449a-8b39-f419af00ebc0 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:31.667829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6779b-d91e-449a-8b39-f419af00ebc0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:31.667829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6779b-d91e-449a-8b39-f419af00ebc0 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:31.669336 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 672/1361] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:31.675417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74806a-d864-4c5d-8625-2b3210f93132 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:31.675953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74806a-d864-4c5d-8625-2b3210f93132 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:31.675953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74806a-d864-4c5d-8625-2b3210f93132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:31.746128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ca74806a-d864-4c5d-8625-2b3210f93132 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:31.747328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ca74806a-d864-4c5d-8625-2b3210f93132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:31.787404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:31.862010 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 690/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:16:32.166118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6779b-d91e-449a-8b39-f419af00ebc0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:32.167733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ede6779b-d91e-449a-8b39-f419af00ebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:32.324874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6779b-d91e-449a-8b39-f419af00ebc0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:32.335380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:32.455257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca9a0e-5561-4770-83ac-ade1c713c4e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:32.456440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca9a0e-5561-4770-83ac-ade1c713c4e7 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:32.456621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca9a0e-5561-4770-83ac-ade1c713c4e7 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:32.457100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca9a0e-5561-4770-83ac-ade1c713c4e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:32.458769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5cca9a0e-5561-4770-83ac-ade1c713c4e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:32.576387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca9a0e-5561-4770-83ac-ade1c713c4e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:32.576728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca9a0e-5561-4770-83ac-ade1c713c4e7 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:32.599025 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 673/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:34.890353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11184958-1c67-40f1-adde-3d9c5b1a4c0c None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:34.891322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11184958-1c67-40f1-adde-3d9c5b1a4c0c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:34.891413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11184958-1c67-40f1-adde-3d9c5b1a4c0c None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:34.892724 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 691/1364] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:34.898481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c53dc-913a-463b-b3c1-642cfe96b4ef None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:34.898935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c53dc-913a-463b-b3c1-642cfe96b4ef None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:34.899040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c53dc-913a-463b-b3c1-642cfe96b4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:34.917076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:34.985517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dd4c53dc-913a-463b-b3c1-642cfe96b4ef None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:34.987745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dd4c53dc-913a-463b-b3c1-642cfe96b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:35.101786 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 674/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:35.404000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936aaae-10c6-4043-8e7a-e904386911a2 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:35.404284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936aaae-10c6-4043-8e7a-e904386911a2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:35.404565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936aaae-10c6-4043-8e7a-e904386911a2 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:35.407001 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 692/1366] 10.222.0.16 () {54 vars in 962 bytes} [Mon Aug 29 15:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:35.415052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9870-aad9-4dea-8787-d41f7bf1c4e8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:35.415333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9870-aad9-4dea-8787-d41f7bf1c4e8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:35.415603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9870-aad9-4dea-8787-d41f7bf1c4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:35.510356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b6ed9870-aad9-4dea-8787-d41f7bf1c4e8 None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:35.511566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b6ed9870-aad9-4dea-8787-d41f7bf1c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:35.552444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:35.641745 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 675/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Aug 29 15:16:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:35.649756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936aaae-10c6-4043-8e7a-e904386911a2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:35.651817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b936aaae-10c6-4043-8e7a-e904386911a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:35.852914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936aaae-10c6-4043-8e7a-e904386911a2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:35.882162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:35.991598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a74689-d7b2-4aa2-9dcc-81cdf9f0f743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:35.992214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a74689-d7b2-4aa2-9dcc-81cdf9f0f743 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:35.992450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a74689-d7b2-4aa2-9dcc-81cdf9f0f743 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:35.992619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a74689-d7b2-4aa2-9dcc-81cdf9f0f743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:35.994227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-00a74689-d7b2-4aa2-9dcc-81cdf9f0f743 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:36.097812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a74689-d7b2-4aa2-9dcc-81cdf9f0f743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:36.099666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a74689-d7b2-4aa2-9dcc-81cdf9f0f743 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:36.120961 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 693/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:38.198009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a585-e053-4118-84c5-2809d5539482 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:38.198009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a585-e053-4118-84c5-2809d5539482 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:38.198769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a585-e053-4118-84c5-2809d5539482 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:38.201312 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 676/1369] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:38.208111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7b4e6-df46-4232-81b3-669ae92eeb8f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:38.208841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7b4e6-df46-4232-81b3-669ae92eeb8f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:38.209205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7b4e6-df46-4232-81b3-669ae92eeb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:38.291397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:38.373861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-dee7b4e6-df46-4232-81b3-669ae92eeb8f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:38.376156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dee7b4e6-df46-4232-81b3-669ae92eeb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:38.594896 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 694/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:38.906235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3a585-e053-4118-84c5-2809d5539482 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:38.908117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0ed3a585-e053-4118-84c5-2809d5539482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:39.075631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:39.082434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3a585-e053-4118-84c5-2809d5539482 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:39.209697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dbb93-ca7d-49d2-95a9-6bbc48fb04c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:39.211143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dbb93-ca7d-49d2-95a9-6bbc48fb04c5 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:39.211651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dbb93-ca7d-49d2-95a9-6bbc48fb04c5 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:39.212156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dbb93-ca7d-49d2-95a9-6bbc48fb04c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:39.214005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b64dbb93-ca7d-49d2-95a9-6bbc48fb04c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:39.315235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dbb93-ca7d-49d2-95a9-6bbc48fb04c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:39.317296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dbb93-ca7d-49d2-95a9-6bbc48fb04c5 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:39.336110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:39.354443 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 677/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:40.407165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102a8d8-1d9c-4341-97ee-566c57a10793 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:40.407680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102a8d8-1d9c-4341-97ee-566c57a10793 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:40.407762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102a8d8-1d9c-4341-97ee-566c57a10793 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:40.409208 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 695/1372] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:40.414911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0813c-0d42-4641-8c6c-f51bac16d38f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:40.415675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0813c-0d42-4641-8c6c-f51bac16d38f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:40.416180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0813c-0d42-4641-8c6c-f51bac16d38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:40.496540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d7c0813c-0d42-4641-8c6c-f51bac16d38f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:40.497923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d7c0813c-0d42-4641-8c6c-f51bac16d38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:40.613976 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 678/1373] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:41.306934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2a94e-520f-48ab-9d61-9cddd33f6044 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:41.307290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2a94e-520f-48ab-9d61-9cddd33f6044 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:41.307628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2a94e-520f-48ab-9d61-9cddd33f6044 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:41.309261 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 696/1374] 10.222.0.16 () {54 vars in 964 bytes} [Mon Aug 29 15:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:41.315066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8a3cc-1cf1-4bfa-9ff8-b7bd773ef056 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:41.315441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8a3cc-1cf1-4bfa-9ff8-b7bd773ef056 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:41.315781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8a3cc-1cf1-4bfa-9ff8-b7bd773ef056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:41.402709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-48c8a3cc-1cf1-4bfa-9ff8-b7bd773ef056 None None] MFA Rules not processed for user `e1ed0648d3b74de89966c6d2e2b8f30a`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:41.404350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-48c8a3cc-1cf1-4bfa-9ff8-b7bd773ef056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:41.428917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:41.489192 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 679/1375] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Aug 29 15:16:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:41.496874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2a94e-520f-48ab-9d61-9cddd33f6044 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:41.499187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-01c2a94e-520f-48ab-9d61-9cddd33f6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:41.617371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2a94e-520f-48ab-9d61-9cddd33f6044 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:41.621668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:41.632696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61b846-1eeb-4277-a22e-365d2f3d57b4 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:41.632993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61b846-1eeb-4277-a22e-365d2f3d57b4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:41.633378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61b846-1eeb-4277-a22e-365d2f3d57b4 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:41.634970 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 680/1376] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:16:41.639640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0cc4a-f42b-40df-8a03-4bb475d8c812 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:41.639932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0cc4a-f42b-40df-8a03-4bb475d8c812 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:41.640785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0cc4a-f42b-40df-8a03-4bb475d8c812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:41.703610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361883a3-887f-4900-b248-b9b1b7814162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:41.704531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361883a3-887f-4900-b248-b9b1b7814162 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:41.704809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361883a3-887f-4900-b248-b9b1b7814162 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:41.705085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361883a3-887f-4900-b248-b9b1b7814162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:41.706744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-361883a3-887f-4900-b248-b9b1b7814162 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:41.711686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d0f0cc4a-f42b-40df-8a03-4bb475d8c812 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:41.712981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d0f0cc4a-f42b-40df-8a03-4bb475d8c812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:41.819684 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 681/1377] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:16:41.837109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361883a3-887f-4900-b248-b9b1b7814162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:41.838715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361883a3-887f-4900-b248-b9b1b7814162 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:41.860540 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 697/1378] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:42.118860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0cc4a-f42b-40df-8a03-4bb475d8c812 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:42.120204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d0f0cc4a-f42b-40df-8a03-4bb475d8c812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:42.151732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:42.246000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0cc4a-f42b-40df-8a03-4bb475d8c812 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:42.445951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dcdb9-cc90-43e4-87db-9075a6372806 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:42.446597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dcdb9-cc90-43e4-87db-9075a6372806 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:42.447050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dcdb9-cc90-43e4-87db-9075a6372806 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:42.447577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dcdb9-cc90-43e4-87db-9075a6372806 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:42.450930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-026dcdb9-cc90-43e4-87db-9075a6372806 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:42.482715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:42.587852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dcdb9-cc90-43e4-87db-9075a6372806 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:42.590539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dcdb9-cc90-43e4-87db-9075a6372806 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:42.628338 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 682/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:44.764429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeef292-5869-4376-918c-9594527b666c None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:44.764429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeef292-5869-4376-918c-9594527b666c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:44.765932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeef292-5869-4376-918c-9594527b666c None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:44.767194 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 698/1380] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:44.774147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1974a94-39ff-42e7-9a81-1658d0b4272b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:44.774147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1974a94-39ff-42e7-9a81-1658d0b4272b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:44.774147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1974a94-39ff-42e7-9a81-1658d0b4272b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:44.900834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e1974a94-39ff-42e7-9a81-1658d0b4272b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:44.902588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e1974a94-39ff-42e7-9a81-1658d0b4272b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:45.039471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:45.046849 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 683/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:45.364098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeef292-5869-4376-918c-9594527b666c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:45.369733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ceeef292-5869-4376-918c-9594527b666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:45.419326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:45.550404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeef292-5869-4376-918c-9594527b666c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:45.677497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:45.685046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcd89d-4cc3-4d28-8c09-b143a54a2746 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:45.685812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcd89d-4cc3-4d28-8c09-b143a54a2746 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:45.686162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcd89d-4cc3-4d28-8c09-b143a54a2746 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:45.686504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcd89d-4cc3-4d28-8c09-b143a54a2746 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:45.688717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fdbcd89d-4cc3-4d28-8c09-b143a54a2746 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:45.799584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcd89d-4cc3-4d28-8c09-b143a54a2746 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:45.802165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcd89d-4cc3-4d28-8c09-b143a54a2746 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:45.827614 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 699/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:47.879051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c9c5-b5de-47ec-9118-02cc87caf1af None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:47.879556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c9c5-b5de-47ec-9118-02cc87caf1af None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:47.879662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c9c5-b5de-47ec-9118-02cc87caf1af None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:47.884864 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 684/1383] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:47.886555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e2325-35a5-4275-b291-c1109bd0bc12 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:47.887442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e2325-35a5-4275-b291-c1109bd0bc12 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:47.887894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e2325-35a5-4275-b291-c1109bd0bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:47.975433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-059e2325-35a5-4275-b291-c1109bd0bc12 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:47.976904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-059e2325-35a5-4275-b291-c1109bd0bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:48.065523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:48.113430 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 700/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:16:48.421851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01c9c5-b5de-47ec-9118-02cc87caf1af None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:48.423341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bf01c9c5-b5de-47ec-9118-02cc87caf1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:48.601363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01c9c5-b5de-47ec-9118-02cc87caf1af None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:48.679229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:48.735781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8b070-7d92-42df-a0b2-ec412a53dfcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:48.736761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8b070-7d92-42df-a0b2-ec412a53dfcc service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:48.737244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8b070-7d92-42df-a0b2-ec412a53dfcc service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:48.737724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8b070-7d92-42df-a0b2-ec412a53dfcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:48.739540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1fa8b070-7d92-42df-a0b2-ec412a53dfcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:48.835977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8b070-7d92-42df-a0b2-ec412a53dfcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:48.837594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8b070-7d92-42df-a0b2-ec412a53dfcc service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:48.860979 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 685/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:51.018342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c59eda-9319-4b13-82e9-a3b63f576a18 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:51.018847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c59eda-9319-4b13-82e9-a3b63f576a18 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:51.019032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c59eda-9319-4b13-82e9-a3b63f576a18 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:51.020777 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 701/1386] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:51.027294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad36fba-a3ca-47a9-8b2f-c2a8dccf3abd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:51.027760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad36fba-a3ca-47a9-8b2f-c2a8dccf3abd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:51.027858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad36fba-a3ca-47a9-8b2f-c2a8dccf3abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:51.096516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cad36fba-a3ca-47a9-8b2f-c2a8dccf3abd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:51.097761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cad36fba-a3ca-47a9-8b2f-c2a8dccf3abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:51.132944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:51.211878 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 686/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:51.497824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c59eda-9319-4b13-82e9-a3b63f576a18 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:51.500082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e0c59eda-9319-4b13-82e9-a3b63f576a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:51.672512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c59eda-9319-4b13-82e9-a3b63f576a18 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:51.727909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:51.793100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5e404-8093-4181-b008-ed0e64f29f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:51.793766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5e404-8093-4181-b008-ed0e64f29f0f service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:51.794040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5e404-8093-4181-b008-ed0e64f29f0f service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:51.794311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5e404-8093-4181-b008-ed0e64f29f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:51.796490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7aa5e404-8093-4181-b008-ed0e64f29f0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:51.888668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5e404-8093-4181-b008-ed0e64f29f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:51.890330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5e404-8093-4181-b008-ed0e64f29f0f service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:51.909114 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 702/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:54.183084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66674-6a78-4d65-a596-8f65fe2ddcaf None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:54.183623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66674-6a78-4d65-a596-8f65fe2ddcaf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:54.183746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66674-6a78-4d65-a596-8f65fe2ddcaf None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:54.185046 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 687/1389] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:16:54.190852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f0533-8850-4341-a067-e2c4c8466dae None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:54.191305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f0533-8850-4341-a067-e2c4c8466dae None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:54.191472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f0533-8850-4341-a067-e2c4c8466dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:54.260410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ab4f0533-8850-4341-a067-e2c4c8466dae None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:54.261717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ab4f0533-8850-4341-a067-e2c4c8466dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:54.270923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:54.367986 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 703/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:54.677835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a66674-6a78-4d65-a596-8f65fe2ddcaf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:54.679608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-89a66674-6a78-4d65-a596-8f65fe2ddcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:54.830924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a66674-6a78-4d65-a596-8f65fe2ddcaf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:54.849507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:54.949267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e66d0d-96ff-4aee-b567-7c0d5507b049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:54.949900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e66d0d-96ff-4aee-b567-7c0d5507b049 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:54.950172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e66d0d-96ff-4aee-b567-7c0d5507b049 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:54.950435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e66d0d-96ff-4aee-b567-7c0d5507b049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:54.952621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-68e66d0d-96ff-4aee-b567-7c0d5507b049 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:55.043580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e66d0d-96ff-4aee-b567-7c0d5507b049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:55.045858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e66d0d-96ff-4aee-b567-7c0d5507b049 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:55.069585 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 688/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:57.038087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9ff3-2ce9-4c41-9080-4ccac65c2028 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:57.038677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9ff3-2ce9-4c41-9080-4ccac65c2028 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:57.038677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9ff3-2ce9-4c41-9080-4ccac65c2028 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:57.040003 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 704/1392] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:57.046093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b2dc-ea33-4dff-af37-e062521ccdf0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:57.046554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b2dc-ea33-4dff-af37-e062521ccdf0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:57.046905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b2dc-ea33-4dff-af37-e062521ccdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:57.075670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:57.119941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-52f3b2dc-ea33-4dff-af37-e062521ccdf0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:57.121142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-52f3b2dc-ea33-4dff-af37-e062521ccdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:57.223037 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 689/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:57.517299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9ff3-2ce9-4c41-9080-4ccac65c2028 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:57.518852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-203a9ff3-2ce9-4c41-9080-4ccac65c2028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:57.618816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367379a-d673-4805-a7aa-6e1fc8303135 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:57.619386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367379a-d673-4805-a7aa-6e1fc8303135 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:57.619850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367379a-d673-4805-a7aa-6e1fc8303135 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:57.622885 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 690/1394] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:57.628355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7a67d-e364-493d-a003-acf5b673b439 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:57.628639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7a67d-e364-493d-a003-acf5b673b439 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:57.628994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7a67d-e364-493d-a003-acf5b673b439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:57.699373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:57.700650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e3d7a67d-e364-493d-a003-acf5b673b439 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:57.701964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e3d7a67d-e364-493d-a003-acf5b673b439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:57.707582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9ff3-2ce9-4c41-9080-4ccac65c2028 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:57.762305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:57.818045 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 691/1395] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:16:57.846934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c0907-45d9-4e43-9c57-2eb12770ac23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:57.847694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c0907-45d9-4e43-9c57-2eb12770ac23 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:57.848072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c0907-45d9-4e43-9c57-2eb12770ac23 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:57.848442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c0907-45d9-4e43-9c57-2eb12770ac23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:57.850249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3a4c0907-45d9-4e43-9c57-2eb12770ac23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:57.954045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c0907-45d9-4e43-9c57-2eb12770ac23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:57.955652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c0907-45d9-4e43-9c57-2eb12770ac23 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:57.969443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:57.974591 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 705/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:58.122301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f2972-0d31-436c-922e-e8805318c72e None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:58.122861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f2972-0d31-436c-922e-e8805318c72e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:58.122861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f2972-0d31-436c-922e-e8805318c72e None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:58.124212 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 692/1397] 10.222.0.16 () {54 vars in 967 bytes} [Mon Aug 29 15:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:58.129757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a39c-8e21-4d04-be48-1875c4a881d9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:58.130312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a39c-8e21-4d04-be48-1875c4a881d9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:58.130312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a39c-8e21-4d04-be48-1875c4a881d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:58.211222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-19b0a39c-8e21-4d04-be48-1875c4a881d9 None None] MFA Rules not processed for user `3f161a87f6fe42aa84e61b33160924ed`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:58.212443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-19b0a39c-8e21-4d04-be48-1875c4a881d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:58.290760 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 706/1398] 10.222.0.16 () {58 vars in 1064 bytes} [Mon Aug 29 15:16:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:58.298338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f2972-0d31-436c-922e-e8805318c72e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:58.299843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-414f2972-0d31-436c-922e-e8805318c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:58.414233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f2972-0d31-436c-922e-e8805318c72e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:16:58.487747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc40693-6168-420a-808b-1dce48c90096 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:16:58.488422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40693-6168-420a-808b-1dce48c90096 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:58.488632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40693-6168-420a-808b-1dce48c90096 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:58.488904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40693-6168-420a-808b-1dce48c90096 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:58.490535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fbc40693-6168-420a-808b-1dce48c90096 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:58.498503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:58.608758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc40693-6168-420a-808b-1dce48c90096 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:16:58.610137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc40693-6168-420a-808b-1dce48c90096 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:16:58.628780 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 693/1399] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:16:59.392393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395863-9592-4b5c-9dd5-f1380f090e4b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:59.392868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395863-9592-4b5c-9dd5-f1380f090e4b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:59.392976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395863-9592-4b5c-9dd5-f1380f090e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:59.462361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5c395863-9592-4b5c-9dd5-f1380f090e4b None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:59.463871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5c395863-9592-4b5c-9dd5-f1380f090e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:59.510348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:59.559121 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 707/1400] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:16:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:59.607730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b92c4c-25dd-486b-99c3-4515af9a6d0b None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:59.608782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b92c4c-25dd-486b-99c3-4515af9a6d0b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:59.608948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b92c4c-25dd-486b-99c3-4515af9a6d0b None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:59.610479 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 694/1401] 10.222.0.16 () {54 vars in 943 bytes} [Mon Aug 29 15:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:16:59.621632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bbeb3-5bd1-4a51-a047-b6c25fc4ba63 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:59.621911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bbeb3-5bd1-4a51-a047-b6c25fc4ba63 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:59.622213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bbeb3-5bd1-4a51-a047-b6c25fc4ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:59.700199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-199bbeb3-5bd1-4a51-a047-b6c25fc4ba63 None None] MFA Rules not processed for user `8fad5b29e028436ca5596434a0cce086`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:16:59.701297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-199bbeb3-5bd1-4a51-a047-b6c25fc4ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:59.822205 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 708/1402] 10.222.0.16 () {58 vars in 1040 bytes} [Mon Aug 29 15:16:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:16:59.831997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b92c4c-25dd-486b-99c3-4515af9a6d0b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:16:59.833521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-14b92c4c-25dd-486b-99c3-4515af9a6d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:16:59.946063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:59.950476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc79c2-4e6e-43b9-8a76-eef65c7cce27 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:59.950688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc79c2-4e6e-43b9-8a76-eef65c7cce27 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:59.950960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc79c2-4e6e-43b9-8a76-eef65c7cce27 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:59.952980 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 709/1403] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:16:59.958205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150139-ab68-4f15-93ce-6e82a9f5b45a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:16:59.958492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150139-ab68-4f15-93ce-6e82a9f5b45a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:16:59.958774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150139-ab68-4f15-93ce-6e82a9f5b45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:16:59.974683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:59.988180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b92c4c-25dd-486b-99c3-4515af9a6d0b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:00.029579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7b150139-ab68-4f15-93ce-6e82a9f5b45a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:00.031426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7b150139-ab68-4f15-93ce-6e82a9f5b45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:00.093376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537ca6e-c954-4c72-a5e4-2db8d7346993 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:00.094051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537ca6e-c954-4c72-a5e4-2db8d7346993 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:00.094330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537ca6e-c954-4c72-a5e4-2db8d7346993 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:00.094605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537ca6e-c954-4c72-a5e4-2db8d7346993 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:00.096300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9537ca6e-c954-4c72-a5e4-2db8d7346993 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:00.130362 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 710/1404] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:17:00.180671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537ca6e-c954-4c72-a5e4-2db8d7346993 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:00.182297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537ca6e-c954-4c72-a5e4-2db8d7346993 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:00.191174 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 695/1405] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:16:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:17:00.449519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b150139-ab68-4f15-93ce-6e82a9f5b45a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:00.450763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7b150139-ab68-4f15-93ce-6e82a9f5b45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:00.562253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:00.591880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b150139-ab68-4f15-93ce-6e82a9f5b45a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:00.724351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475987c-62b5-449f-9ad2-1fa8fe1ab83b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:00.724886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475987c-62b5-449f-9ad2-1fa8fe1ab83b service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:00.727211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475987c-62b5-449f-9ad2-1fa8fe1ab83b service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:00.727211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475987c-62b5-449f-9ad2-1fa8fe1ab83b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:00.727211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9475987c-62b5-449f-9ad2-1fa8fe1ab83b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:00.825434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:00.827966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475987c-62b5-449f-9ad2-1fa8fe1ab83b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:00.829923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475987c-62b5-449f-9ad2-1fa8fe1ab83b service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:00.854124 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 711/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:02.954876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdead3a-301d-4139-b0b8-597d97613d73 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:02.955434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdead3a-301d-4139-b0b8-597d97613d73 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:02.955434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdead3a-301d-4139-b0b8-597d97613d73 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:02.956785 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 696/1407] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:02.962944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c3c3-b99f-41ec-a84a-24741043b57e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:02.963387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c3c3-b99f-41ec-a84a-24741043b57e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:02.963495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c3c3-b99f-41ec-a84a-24741043b57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:03.044720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fa30c3c3-b99f-41ec-a84a-24741043b57e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:03.046078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fa30c3c3-b99f-41ec-a84a-24741043b57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:03.158616 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 712/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:03.450433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdead3a-301d-4139-b0b8-597d97613d73 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:03.452563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ffdead3a-301d-4139-b0b8-597d97613d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:03.464299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:03.623139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdead3a-301d-4139-b0b8-597d97613d73 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:03.715511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:03.753847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdf368-82a4-4c49-9317-a621b10fc6f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:03.754467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf368-82a4-4c49-9317-a621b10fc6f0 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:03.754748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf368-82a4-4c49-9317-a621b10fc6f0 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:03.755026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf368-82a4-4c49-9317-a621b10fc6f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:03.756623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-63cdf368-82a4-4c49-9317-a621b10fc6f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:03.856790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdf368-82a4-4c49-9317-a621b10fc6f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:03.859462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdf368-82a4-4c49-9317-a621b10fc6f0 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:03.881093 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 697/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:13.159248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=71 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:13.877991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=58 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:23.426113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f414-321e-437c-9f42-bb84182c2150 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:23.426750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f414-321e-437c-9f42-bb84182c2150 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:23.426750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f414-321e-437c-9f42-bb84182c2150 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:23.428017 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 713/1410] 10.222.0.16 () {54 vars in 918 bytes} [Mon Aug 29 15:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:17:23.433062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c37b6-331a-4531-9b80-cfda3de21244 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:23.433540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c37b6-331a-4531-9b80-cfda3de21244 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:23.433650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c37b6-331a-4531-9b80-cfda3de21244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:23.509998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b79c37b6-331a-4531-9b80-cfda3de21244 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:23.511206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b79c37b6-331a-4531-9b80-cfda3de21244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:23.617011 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 698/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Aug 29 15:17:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:17:23.631258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd580dd9-39d3-4001-9dbc-f051ac4458bf None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:23.631547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd580dd9-39d3-4001-9dbc-f051ac4458bf None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:23.631827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd580dd9-39d3-4001-9dbc-f051ac4458bf None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:23.633183 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 714/1412] 10.222.0.16 () {54 vars in 918 bytes} [Mon Aug 29 15:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:23.637933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69830fda-6316-4f26-a0ed-fc964f8488de None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:23.638247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69830fda-6316-4f26-a0ed-fc964f8488de None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:23.638526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69830fda-6316-4f26-a0ed-fc964f8488de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:23.711824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:23.714917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-69830fda-6316-4f26-a0ed-fc964f8488de None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:23.717275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-69830fda-6316-4f26-a0ed-fc964f8488de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:23.832468 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 699/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Aug 29 15:17:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:17:26.220352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba0dd-13a7-41f6-8614-204f6acdbe4a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:26.220920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba0dd-13a7-41f6-8614-204f6acdbe4a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:26.220920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba0dd-13a7-41f6-8614-204f6acdbe4a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:26.222266 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:26.227630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0701d-063f-492e-89eb-7f315c4fb147 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:26.228087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0701d-063f-492e-89eb-7f315c4fb147 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:26.228234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0701d-063f-492e-89eb-7f315c4fb147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:26.293591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c6b0701d-063f-492e-89eb-7f315c4fb147 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:26.295234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c6b0701d-063f-492e-89eb-7f315c4fb147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:26.350112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:26.393927 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:26.686058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dba0dd-13a7-41f6-8614-204f6acdbe4a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:26.687612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-16dba0dd-13a7-41f6-8614-204f6acdbe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:26.839338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dba0dd-13a7-41f6-8614-204f6acdbe4a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:26.911809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:26.952562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889b939-2dfb-49cc-aa43-0eb443dd5c9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:26.953167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b939-2dfb-49cc-aa43-0eb443dd5c9c service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:26.953477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b939-2dfb-49cc-aa43-0eb443dd5c9c service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:26.953750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b939-2dfb-49cc-aa43-0eb443dd5c9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:26.955357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3889b939-2dfb-49cc-aa43-0eb443dd5c9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:27.046177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889b939-2dfb-49cc-aa43-0eb443dd5c9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:27.047785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889b939-2dfb-49cc-aa43-0eb443dd5c9c service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:27.065575 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 716/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:27.953996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f272e-7798-4c17-835b-e61bc0890590 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:27.954544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f272e-7798-4c17-835b-e61bc0890590 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:27.954544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f272e-7798-4c17-835b-e61bc0890590 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:27.955807 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:27.960780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565af3d2-bc66-4a20-9544-c2d991368000 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:27.961208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565af3d2-bc66-4a20-9544-c2d991368000 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:27.961324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565af3d2-bc66-4a20-9544-c2d991368000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:28.040427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-565af3d2-bc66-4a20-9544-c2d991368000 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:28.041679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-565af3d2-bc66-4a20-9544-c2d991368000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:28.068665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:28.139781 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:28.314426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f272e-7798-4c17-835b-e61bc0890590 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:28.315995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-505f272e-7798-4c17-835b-e61bc0890590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:28.462645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f272e-7798-4c17-835b-e61bc0890590 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:28.506855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:28.582277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d113ae7-e2e7-4ac0-b98b-a9b7b17b1a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:28.582798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d113ae7-e2e7-4ac0-b98b-a9b7b17b1a3c service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:28.583076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d113ae7-e2e7-4ac0-b98b-a9b7b17b1a3c service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:28.583349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d113ae7-e2e7-4ac0-b98b-a9b7b17b1a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:28.584953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1d113ae7-e2e7-4ac0-b98b-a9b7b17b1a3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:28.678042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d113ae7-e2e7-4ac0-b98b-a9b7b17b1a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:28.679649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d113ae7-e2e7-4ac0-b98b-a9b7b17b1a3c service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:28.698222 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 702/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:29.599715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57692827-19d2-4e5b-ac8a-1994d63b45e8 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:29.600262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57692827-19d2-4e5b-ac8a-1994d63b45e8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:29.600262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57692827-19d2-4e5b-ac8a-1994d63b45e8 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:29.601652 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:29.606599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941690b-dbce-44af-abba-106996904c78 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:29.607595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941690b-dbce-44af-abba-106996904c78 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:29.607714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941690b-dbce-44af-abba-106996904c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:29.663747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:29.686913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4941690b-dbce-44af-abba-106996904c78 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:29.688131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4941690b-dbce-44af-abba-106996904c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:29.787826 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:29.939362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57692827-19d2-4e5b-ac8a-1994d63b45e8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:29.940945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-57692827-19d2-4e5b-ac8a-1994d63b45e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:30.086204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57692827-19d2-4e5b-ac8a-1994d63b45e8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:30.099509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:30.207590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe3e21-b734-4af4-8b80-d4a33c1d360f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:30.208193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3e21-b734-4af4-8b80-d4a33c1d360f service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:30.208466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3e21-b734-4af4-8b80-d4a33c1d360f service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:30.208734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3e21-b734-4af4-8b80-d4a33c1d360f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:30.210377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fafe3e21-b734-4af4-8b80-d4a33c1d360f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:30.302686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe3e21-b734-4af4-8b80-d4a33c1d360f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:30.304325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe3e21-b734-4af4-8b80-d4a33c1d360f service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:30.322983 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 719/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:31.208061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274ae0c-376e-4324-bbe6-55ab78e8fc7c None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:31.208863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274ae0c-376e-4324-bbe6-55ab78e8fc7c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:31.208863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274ae0c-376e-4324-bbe6-55ab78e8fc7c None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:31.210453 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:31.215471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648532ea-a0ee-4904-9948-f4b6e27151ad None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:31.215891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648532ea-a0ee-4904-9948-f4b6e27151ad None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:31.216020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648532ea-a0ee-4904-9948-f4b6e27151ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:31.237125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:31.296403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-648532ea-a0ee-4904-9948-f4b6e27151ad None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:31.297645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-648532ea-a0ee-4904-9948-f4b6e27151ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:31.421296 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:31.579588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274ae0c-376e-4324-bbe6-55ab78e8fc7c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:31.581201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a274ae0c-376e-4324-bbe6-55ab78e8fc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:31.694119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:31.731482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274ae0c-376e-4324-bbe6-55ab78e8fc7c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:31.851338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc139dc-4f4c-4274-a124-15e2bd9063d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:31.851853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc139dc-4f4c-4274-a124-15e2bd9063d8 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:31.852131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc139dc-4f4c-4274-a124-15e2bd9063d8 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:31.852399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc139dc-4f4c-4274-a124-15e2bd9063d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:31.854010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1cc139dc-4f4c-4274-a124-15e2bd9063d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:31.932018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:31.946265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc139dc-4f4c-4274-a124-15e2bd9063d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:31.947861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc139dc-4f4c-4274-a124-15e2bd9063d8 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:31.965671 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 705/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:32.846261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972626c-d4b5-45bb-aef7-b1da224e3a35 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:32.846686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972626c-d4b5-45bb-aef7-b1da224e3a35 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:32.846797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972626c-d4b5-45bb-aef7-b1da224e3a35 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:32.848155 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:32.853114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100b9d-7ed7-4fa5-8d15-db134605480e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:32.853617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100b9d-7ed7-4fa5-8d15-db134605480e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:32.853727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100b9d-7ed7-4fa5-8d15-db134605480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:32.934297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-85100b9d-7ed7-4fa5-8d15-db134605480e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:32.936157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-85100b9d-7ed7-4fa5-8d15-db134605480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:33.036927 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:33.188575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972626c-d4b5-45bb-aef7-b1da224e3a35 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:33.190093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0972626c-d4b5-45bb-aef7-b1da224e3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:33.274609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:33.338210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972626c-d4b5-45bb-aef7-b1da224e3a35 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:33.456053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28663bfe-05e0-4bb3-a32e-5398060f0a32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:33.456583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28663bfe-05e0-4bb3-a32e-5398060f0a32 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:33.456863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28663bfe-05e0-4bb3-a32e-5398060f0a32 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:33.457136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28663bfe-05e0-4bb3-a32e-5398060f0a32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:33.460027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-28663bfe-05e0-4bb3-a32e-5398060f0a32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:33.513209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:33.557193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28663bfe-05e0-4bb3-a32e-5398060f0a32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:33.558852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28663bfe-05e0-4bb3-a32e-5398060f0a32 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:33.578851 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 722/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:34.412312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d171c-acaa-484a-971a-3fce5fb828dc None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:34.412855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d171c-acaa-484a-971a-3fce5fb828dc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:34.412855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d171c-acaa-484a-971a-3fce5fb828dc None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:34.414322 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:34.419559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f9459-8486-41fe-b9eb-d2093282475a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:34.419993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f9459-8486-41fe-b9eb-d2093282475a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:34.420131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f9459-8486-41fe-b9eb-d2093282475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:34.496350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8e4f9459-8486-41fe-b9eb-d2093282475a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:34.497638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8e4f9459-8486-41fe-b9eb-d2093282475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:34.596142 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:17:34.749063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d171c-acaa-484a-971a-3fce5fb828dc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:34.750624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ba1d171c-acaa-484a-971a-3fce5fb828dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:34.806746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:34.905023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d171c-acaa-484a-971a-3fce5fb828dc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:35.018320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4ec24-c4e5-46ef-98c1-518a14044b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:35.018928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4ec24-c4e5-46ef-98c1-518a14044b59 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:35.019207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4ec24-c4e5-46ef-98c1-518a14044b59 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:35.019479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4ec24-c4e5-46ef-98c1-518a14044b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:35.021072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1bf4ec24-c4e5-46ef-98c1-518a14044b59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:35.028288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:35.113147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4ec24-c4e5-46ef-98c1-518a14044b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:35.114769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4ec24-c4e5-46ef-98c1-518a14044b59 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:35.133788 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 708/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:35.958385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78d8ce-0a37-4351-b365-089de6d0bb9f None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:35.958893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78d8ce-0a37-4351-b365-089de6d0bb9f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:35.958893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78d8ce-0a37-4351-b365-089de6d0bb9f None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:35.960173 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:35.965008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3030129-88f3-42cd-8d80-a475fc05d21b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:35.965466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3030129-88f3-42cd-8d80-a475fc05d21b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:35.965628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3030129-88f3-42cd-8d80-a475fc05d21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:36.042678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f3030129-88f3-42cd-8d80-a475fc05d21b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:36.043889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f3030129-88f3-42cd-8d80-a475fc05d21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:36.124058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:36.154288 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:36.303275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78d8ce-0a37-4351-b365-089de6d0bb9f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:36.304797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9d78d8ce-0a37-4351-b365-089de6d0bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:36.322129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:36.458253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78d8ce-0a37-4351-b365-089de6d0bb9f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:36.544939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:36.570924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b146e-2c2b-4677-9f89-77d75d318353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:36.571466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b146e-2c2b-4677-9f89-77d75d318353 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:36.571748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b146e-2c2b-4677-9f89-77d75d318353 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:36.572026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b146e-2c2b-4677-9f89-77d75d318353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:36.573657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-511b146e-2c2b-4677-9f89-77d75d318353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:36.661655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b146e-2c2b-4677-9f89-77d75d318353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:36.663249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b146e-2c2b-4677-9f89-77d75d318353 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:36.680778 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 725/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:37.491556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c425f9-5a54-46c8-8838-bbea142cd965 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:37.492128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c425f9-5a54-46c8-8838-bbea142cd965 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:37.492128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c425f9-5a54-46c8-8838-bbea142cd965 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:37.493464 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:37.498351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69a593-e3e2-4414-8a2c-7f9154cedceb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:37.498779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69a593-e3e2-4414-8a2c-7f9154cedceb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:37.498903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69a593-e3e2-4414-8a2c-7f9154cedceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:37.577327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5a69a593-e3e2-4414-8a2c-7f9154cedceb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:37.578585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5a69a593-e3e2-4414-8a2c-7f9154cedceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:37.619743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:37.677044 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:37.830056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c425f9-5a54-46c8-8838-bbea142cd965 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:37.831599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b1c425f9-5a54-46c8-8838-bbea142cd965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:37.982541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c425f9-5a54-46c8-8838-bbea142cd965 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:38.036768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:38.097945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6edd54-d4ce-46bd-b26e-63f72f7a5f30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:38.098523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6edd54-d4ce-46bd-b26e-63f72f7a5f30 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:38.098804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6edd54-d4ce-46bd-b26e-63f72f7a5f30 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:38.099076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6edd54-d4ce-46bd-b26e-63f72f7a5f30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:38.100714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1b6edd54-d4ce-46bd-b26e-63f72f7a5f30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:38.190344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6edd54-d4ce-46bd-b26e-63f72f7a5f30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:38.191933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6edd54-d4ce-46bd-b26e-63f72f7a5f30 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:38.209518 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 711/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:39.018957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a565ded-c9ac-4531-854b-c82de02d5c7a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:39.019508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a565ded-c9ac-4531-854b-c82de02d5c7a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:39.019508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a565ded-c9ac-4531-854b-c82de02d5c7a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:39.020895 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:39.026781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c32e-6be2-47bb-a879-550a503eb631 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:39.027211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c32e-6be2-47bb-a879-550a503eb631 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:39.027324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c32e-6be2-47bb-a879-550a503eb631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:39.101772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e6e5c32e-6be2-47bb-a879-550a503eb631 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:39.102970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e6e5c32e-6be2-47bb-a879-550a503eb631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:39.104967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:39.201333 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:39.349868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a565ded-c9ac-4531-854b-c82de02d5c7a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:39.351378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9a565ded-c9ac-4531-854b-c82de02d5c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:39.499504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a565ded-c9ac-4531-854b-c82de02d5c7a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:39.527666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:39.615324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20dd56-150a-4c66-8a96-a6f11ff2fc3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:39.615934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20dd56-150a-4c66-8a96-a6f11ff2fc3f service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:39.616214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20dd56-150a-4c66-8a96-a6f11ff2fc3f service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:39.616490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20dd56-150a-4c66-8a96-a6f11ff2fc3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:39.618137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3b20dd56-150a-4c66-8a96-a6f11ff2fc3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:39.710126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20dd56-150a-4c66-8a96-a6f11ff2fc3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:39.711750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20dd56-150a-4c66-8a96-a6f11ff2fc3f service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:39.730820 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 728/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:41.552425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc4cc-f112-4962-8e84-073a23047a7c None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:41.552899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc4cc-f112-4962-8e84-073a23047a7c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:41.553021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc4cc-f112-4962-8e84-073a23047a7c None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:41.554486 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:41.560357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02931863-e963-4862-a0f9-49647579518a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:41.560788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02931863-e963-4862-a0f9-49647579518a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:41.560895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02931863-e963-4862-a0f9-49647579518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:41.601438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:41.626835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-02931863-e963-4862-a0f9-49647579518a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:41.628038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-02931863-e963-4862-a0f9-49647579518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:41.724411 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:42.007682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbc4cc-f112-4962-8e84-073a23047a7c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:42.009214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-63cbc4cc-f112-4962-8e84-073a23047a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:42.112597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbc4cc-f112-4962-8e84-073a23047a7c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:42.145044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:42.187270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f5bbd-eb92-40c4-a6d4-546fd0ffd914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:42.187876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f5bbd-eb92-40c4-a6d4-546fd0ffd914 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:42.188154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f5bbd-eb92-40c4-a6d4-546fd0ffd914 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:42.188429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f5bbd-eb92-40c4-a6d4-546fd0ffd914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:42.190093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9f6f5bbd-eb92-40c4-a6d4-546fd0ffd914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:42.298811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f5bbd-eb92-40c4-a6d4-546fd0ffd914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:42.300161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f5bbd-eb92-40c4-a6d4-546fd0ffd914 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:42.318952 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 714/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:44.432393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76a542-8f32-4a25-9086-9a6a7174a0ca None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:44.433014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76a542-8f32-4a25-9086-9a6a7174a0ca None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:44.433014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76a542-8f32-4a25-9086-9a6a7174a0ca None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:44.434917 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:44.440664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4186e-3f94-4578-89e9-9d23b606805e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:44.441162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4186e-3f94-4578-89e9-9d23b606805e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:44.441268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4186e-3f94-4578-89e9-9d23b606805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:44.509237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bcc4186e-3f94-4578-89e9-9d23b606805e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:44.510479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bcc4186e-3f94-4578-89e9-9d23b606805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:44.524813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:44.611548 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:44.902096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76a542-8f32-4a25-9086-9a6a7174a0ca None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:44.904275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cd76a542-8f32-4a25-9086-9a6a7174a0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:45.011485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76a542-8f32-4a25-9086-9a6a7174a0ca None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:45.024647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:45.089268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e812e-0bf3-413d-a18d-3d31df7caa16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:45.089909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e812e-0bf3-413d-a18d-3d31df7caa16 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:45.090190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e812e-0bf3-413d-a18d-3d31df7caa16 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:45.090464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e812e-0bf3-413d-a18d-3d31df7caa16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:45.092663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-039e812e-0bf3-413d-a18d-3d31df7caa16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:45.209356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e812e-0bf3-413d-a18d-3d31df7caa16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:45.210760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e812e-0bf3-413d-a18d-3d31df7caa16 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:45.229680 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 731/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:47.590626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71233b-c6dc-418a-9859-bc489cebfbfc None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:47.591176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71233b-c6dc-418a-9859-bc489cebfbfc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:47.591176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71233b-c6dc-418a-9859-bc489cebfbfc None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:47.592522 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:47.597922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28c63c-7c9c-423d-b01d-dfd76f139eea None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:47.598321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28c63c-7c9c-423d-b01d-dfd76f139eea None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:47.598487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28c63c-7c9c-423d-b01d-dfd76f139eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:47.646755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:47.665122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9b28c63c-7c9c-423d-b01d-dfd76f139eea None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:47.666370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9b28c63c-7c9c-423d-b01d-dfd76f139eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:47.764327 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:48.050081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71233b-c6dc-418a-9859-bc489cebfbfc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:48.051618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7c71233b-c6dc-418a-9859-bc489cebfbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:48.157080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71233b-c6dc-418a-9859-bc489cebfbfc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:48.198435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:48.233263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8bf13-2abe-4f6f-90cf-1baffedc5701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:48.233892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8bf13-2abe-4f6f-90cf-1baffedc5701 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:48.234171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8bf13-2abe-4f6f-90cf-1baffedc5701 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:48.234445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8bf13-2abe-4f6f-90cf-1baffedc5701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:48.236049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5cc8bf13-2abe-4f6f-90cf-1baffedc5701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:48.347585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8bf13-2abe-4f6f-90cf-1baffedc5701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:48.348929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8bf13-2abe-4f6f-90cf-1baffedc5701 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:48.366629 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 717/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:50.423643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27c40b-4701-4f07-bf1a-824b1b1fa836 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:50.424214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27c40b-4701-4f07-bf1a-824b1b1fa836 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:50.424214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27c40b-4701-4f07-bf1a-824b1b1fa836 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:50.425665 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:50.430969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4523ca-a863-48f3-a0b1-274c9a04110d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:50.431429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4523ca-a863-48f3-a0b1-274c9a04110d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:50.431692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4523ca-a863-48f3-a0b1-274c9a04110d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:50.509373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1c4523ca-a863-48f3-a0b1-274c9a04110d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:50.510629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1c4523ca-a863-48f3-a0b1-274c9a04110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:50.533157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:50.616005 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:50.899966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27c40b-4701-4f07-bf1a-824b1b1fa836 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:50.901568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ce27c40b-4701-4f07-bf1a-824b1b1fa836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:51.017335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27c40b-4701-4f07-bf1a-824b1b1fa836 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:51.037605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:51.094109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070385e-d804-45fc-b770-6eff1f9196b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:51.094827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070385e-d804-45fc-b770-6eff1f9196b0 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:51.095239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070385e-d804-45fc-b770-6eff1f9196b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:51.095508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070385e-d804-45fc-b770-6eff1f9196b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:51.097127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b070385e-d804-45fc-b770-6eff1f9196b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:51.208086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070385e-d804-45fc-b770-6eff1f9196b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:51.209469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070385e-d804-45fc-b770-6eff1f9196b0 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:51.232222 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 734/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:53.190875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ea4d3-31e1-437f-9502-6b427d3e6352 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:53.191393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ea4d3-31e1-437f-9502-6b427d3e6352 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:53.191393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ea4d3-31e1-437f-9502-6b427d3e6352 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:53.192740 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:53.198119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd533e3-8f90-4b81-8d3c-cbc5b5d94038 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:53.198501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd533e3-8f90-4b81-8d3c-cbc5b5d94038 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:53.198680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd533e3-8f90-4b81-8d3c-cbc5b5d94038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:53.261882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:53.265202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fdd533e3-8f90-4b81-8d3c-cbc5b5d94038 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:53.267130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fdd533e3-8f90-4b81-8d3c-cbc5b5d94038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:53.362002 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:53.641376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ea4d3-31e1-437f-9502-6b427d3e6352 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:53.642915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6e1ea4d3-31e1-437f-9502-6b427d3e6352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:53.747560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ea4d3-31e1-437f-9502-6b427d3e6352 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:53.796643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:53.822052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0580a-9bfd-4dca-ac7f-930d8bc60913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:53.822730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0580a-9bfd-4dca-ac7f-930d8bc60913 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:53.823009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0580a-9bfd-4dca-ac7f-930d8bc60913 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:53.823274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0580a-9bfd-4dca-ac7f-930d8bc60913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:53.825400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cab0580a-9bfd-4dca-ac7f-930d8bc60913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:53.935006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0580a-9bfd-4dca-ac7f-930d8bc60913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:53.936429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0580a-9bfd-4dca-ac7f-930d8bc60913 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:53.954562 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 720/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:55.926371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca6fb5-d1aa-4edb-ac71-f1d542fd1a77 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:55.926906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca6fb5-d1aa-4edb-ac71-f1d542fd1a77 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:55.926906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca6fb5-d1aa-4edb-ac71-f1d542fd1a77 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:55.928220 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:55.933848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9ea9d-f28c-46b7-8962-98f8e43d92d7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:55.934324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9ea9d-f28c-46b7-8962-98f8e43d92d7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:55.934425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9ea9d-f28c-46b7-8962-98f8e43d92d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:56.000541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f2f9ea9d-f28c-46b7-8962-98f8e43d92d7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:56.001787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f2f9ea9d-f28c-46b7-8962-98f8e43d92d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:56.034522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:56.104947 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:17:56.389501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca6fb5-d1aa-4edb-ac71-f1d542fd1a77 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:56.391053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b0ca6fb5-d1aa-4edb-ac71-f1d542fd1a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:56.497095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca6fb5-d1aa-4edb-ac71-f1d542fd1a77 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:56.527555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:56.573882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b97984-135a-485f-b68d-29bfab87931a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:56.575254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b97984-135a-485f-b68d-29bfab87931a service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:56.575419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b97984-135a-485f-b68d-29bfab87931a service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:56.575626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b97984-135a-485f-b68d-29bfab87931a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:56.577226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a9b97984-135a-485f-b68d-29bfab87931a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:56.686469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b97984-135a-485f-b68d-29bfab87931a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:56.687827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b97984-135a-485f-b68d-29bfab87931a service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:56.706371 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 737/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:17:58.667816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6133-2260-4d59-b9ff-fe0b1459ffe8 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:58.668987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6133-2260-4d59-b9ff-fe0b1459ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:58.669088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6133-2260-4d59-b9ff-fe0b1459ffe8 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:58.670394 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:17:58.675685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849c91-6d9b-433b-9225-4e9facbd49af None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:58.676111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849c91-6d9b-433b-9225-4e9facbd49af None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:58.676218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849c91-6d9b-433b-9225-4e9facbd49af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:58.743749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2b849c91-6d9b-433b-9225-4e9facbd49af None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:17:58.744959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2b849c91-6d9b-433b-9225-4e9facbd49af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:58.753397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:58.842748 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:17:59.138013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa6133-2260-4d59-b9ff-fe0b1459ffe8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:17:59.139556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bfaa6133-2260-4d59-b9ff-fe0b1459ffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:59.243457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa6133-2260-4d59-b9ff-fe0b1459ffe8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:17:59.298420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:59.316649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420d267-b44c-4a6c-bf02-e01ef71542df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:17:59.317253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d267-b44c-4a6c-bf02-e01ef71542df service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:17:59.317571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d267-b44c-4a6c-bf02-e01ef71542df service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:17:59.317847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d267-b44c-4a6c-bf02-e01ef71542df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:17:59.319443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1420d267-b44c-4a6c-bf02-e01ef71542df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:17:59.432036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420d267-b44c-4a6c-bf02-e01ef71542df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:17:59.433524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420d267-b44c-4a6c-bf02-e01ef71542df service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:17:59.452412 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 723/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:18:01.439109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979e39-2e83-4a83-8bab-7817a32ebd9f None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:01.439720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979e39-2e83-4a83-8bab-7817a32ebd9f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:01.439720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979e39-2e83-4a83-8bab-7817a32ebd9f None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:01.441020 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:18:01.446270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f6319-17ec-4751-9c99-99d6c228b210 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:01.446682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f6319-17ec-4751-9c99-99d6c228b210 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:01.446796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f6319-17ec-4751-9c99-99d6c228b210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:01.512788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6d3f6319-17ec-4751-9c99-99d6c228b210 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:18:01.514013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6d3f6319-17ec-4751-9c99-99d6c228b210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:01.552705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:01.611583 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:18:01.891793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979e39-2e83-4a83-8bab-7817a32ebd9f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:18:01.893376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c2979e39-2e83-4a83-8bab-7817a32ebd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:01.997406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979e39-2e83-4a83-8bab-7817a32ebd9f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:18:02.035846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:02.073986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2895959-6700-4038-9cb5-a1f3a507dfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:18:02.075096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2895959-6700-4038-9cb5-a1f3a507dfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:02.075372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2895959-6700-4038-9cb5-a1f3a507dfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:02.075644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2895959-6700-4038-9cb5-a1f3a507dfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:02.077256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c2895959-6700-4038-9cb5-a1f3a507dfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:02.186941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2895959-6700-4038-9cb5-a1f3a507dfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:18:02.188299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2895959-6700-4038-9cb5-a1f3a507dfd7 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:18:02.206543 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 740/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:18:04.189692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cc52c-6a48-46e8-ae90-5d271a99f1f7 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:04.190250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cc52c-6a48-46e8-ae90-5d271a99f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:04.190250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cc52c-6a48-46e8-ae90-5d271a99f1f7 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:04.191565 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:18:04.197035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38f748-73c7-4a54-8b3b-dc3afc3209f6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:04.197486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38f748-73c7-4a54-8b3b-dc3afc3209f6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:04.197629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38f748-73c7-4a54-8b3b-dc3afc3209f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:04.269282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ee38f748-73c7-4a54-8b3b-dc3afc3209f6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:18:04.270509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ee38f748-73c7-4a54-8b3b-dc3afc3209f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:04.289240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:04.369997 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:18:04.657142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cc52c-6a48-46e8-ae90-5d271a99f1f7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:18:04.658859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-715cc52c-6a48-46e8-ae90-5d271a99f1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:04.768654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cc52c-6a48-46e8-ae90-5d271a99f1f7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:18:04.838366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:04.845612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f0f63-f97f-4eee-9bee-84e17c891057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:18:04.846221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0f63-f97f-4eee-9bee-84e17c891057 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:04.846500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0f63-f97f-4eee-9bee-84e17c891057 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:04.846773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0f63-f97f-4eee-9bee-84e17c891057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:04.848392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-996f0f63-f97f-4eee-9bee-84e17c891057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:04.962190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f0f63-f97f-4eee-9bee-84e17c891057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:18:04.963629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f0f63-f97f-4eee-9bee-84e17c891057 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:18:04.982736 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 726/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:18:06.900925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b63d5-d4d6-4d83-8c7a-b12783da96be None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:06.901551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b63d5-d4d6-4d83-8c7a-b12783da96be None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:06.901551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b63d5-d4d6-4d83-8c7a-b12783da96be None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:06.903302 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:18:06.908547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03e892-c6e3-43ed-a8e7-471ffbcb7e4b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:06.908968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03e892-c6e3-43ed-a8e7-471ffbcb7e4b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:06.909083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03e892-c6e3-43ed-a8e7-471ffbcb7e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:06.975187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-eb03e892-c6e3-43ed-a8e7-471ffbcb7e4b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:18:06.976384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-eb03e892-c6e3-43ed-a8e7-471ffbcb7e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:07.023971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:07.076865 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:18:07.365604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b63d5-d4d6-4d83-8c7a-b12783da96be None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:18:07.367187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db6b63d5-d4d6-4d83-8c7a-b12783da96be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:07.484498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b63d5-d4d6-4d83-8c7a-b12783da96be None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:18:07.533881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:07.561515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700cf63-04e8-408b-bdb2-7848a271d5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:18:07.562125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cf63-04e8-408b-bdb2-7848a271d5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:07.562400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cf63-04e8-408b-bdb2-7848a271d5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:07.562671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cf63-04e8-408b-bdb2-7848a271d5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:07.564291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a700cf63-04e8-408b-bdb2-7848a271d5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:07.672286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700cf63-04e8-408b-bdb2-7848a271d5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:18:07.673652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700cf63-04e8-408b-bdb2-7848a271d5f9 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:18:07.691144 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 743/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:18:17.074826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=22 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:17.688873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=66 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:27.411254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c07dc3-00ad-4be3-8625-277ef24c0cba None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:27.411814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c07dc3-00ad-4be3-8625-277ef24c0cba None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:27.411814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c07dc3-00ad-4be3-8625-277ef24c0cba None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:27.413186 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 728/1471] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:18:27.418998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f975c-117a-4371-a43d-cdbd9c7c8926 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:27.419431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f975c-117a-4371-a43d-cdbd9c7c8926 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:27.419528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f975c-117a-4371-a43d-cdbd9c7c8926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:27.494578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cd9f975c-117a-4371-a43d-cdbd9c7c8926 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:18:27.495849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cd9f975c-117a-4371-a43d-cdbd9c7c8926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:27.594850 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 744/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:18:27.895132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf6a9f-37bc-4692-adb3-9f086aefbe85 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:27.895425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf6a9f-37bc-4692-adb3-9f086aefbe85 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:27.895775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf6a9f-37bc-4692-adb3-9f086aefbe85 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:27.897166 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 729/1473] 10.222.0.16 () {54 vars in 967 bytes} [Mon Aug 29 15:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:18:27.902911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261a903-1e64-42c6-bf98-bc89fcc59a47 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:27.903201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261a903-1e64-42c6-bf98-bc89fcc59a47 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:27.903484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261a903-1e64-42c6-bf98-bc89fcc59a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:27.978091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c261a903-1e64-42c6-bf98-bc89fcc59a47 None None] MFA Rules not processed for user `3f161a87f6fe42aa84e61b33160924ed`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:18:27.979216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c261a903-1e64-42c6-bf98-bc89fcc59a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:27.999858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:28.054858 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 745/1474] 10.222.0.16 () {58 vars in 1064 bytes} [Mon Aug 29 15:18:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:18:28.063014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf6a9f-37bc-4692-adb3-9f086aefbe85 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:18:28.064534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1cbf6a9f-37bc-4692-adb3-9f086aefbe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:28.166811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf6a9f-37bc-4692-adb3-9f086aefbe85 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:18:28.239451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c28292-0e61-4fb1-bcda-09bd6763eaa5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:18:28.239964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c28292-0e61-4fb1-bcda-09bd6763eaa5 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:28.240236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c28292-0e61-4fb1-bcda-09bd6763eaa5 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:28.240498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c28292-0e61-4fb1-bcda-09bd6763eaa5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:28.242103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75c28292-0e61-4fb1-bcda-09bd6763eaa5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:28.296733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:28.352147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c28292-0e61-4fb1-bcda-09bd6763eaa5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:18:28.353617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c28292-0e61-4fb1-bcda-09bd6763eaa5 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:18:28.372563 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 730/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:18:30.394424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475ec79-1fc1-47bd-8994-a475aacec703 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:30.395250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475ec79-1fc1-47bd-8994-a475aacec703 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:30.395475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475ec79-1fc1-47bd-8994-a475aacec703 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:30.396862 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 746/1476] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:18:30.403020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82400285-eb43-4066-a299-21b9934a0c4b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:30.403480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82400285-eb43-4066-a299-21b9934a0c4b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:30.403584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82400285-eb43-4066-a299-21b9934a0c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:30.500109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-82400285-eb43-4066-a299-21b9934a0c4b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:18:30.501579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-82400285-eb43-4066-a299-21b9934a0c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:30.608541 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 731/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:18:30.881230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475ec79-1fc1-47bd-8994-a475aacec703 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:18:30.882808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0475ec79-1fc1-47bd-8994-a475aacec703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:31.007213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475ec79-1fc1-47bd-8994-a475aacec703 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:18:31.055364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:31.100316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bb2ee-d1d9-43f1-b589-9e869e737f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:18:31.100922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bb2ee-d1d9-43f1-b589-9e869e737f97 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:31.101202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bb2ee-d1d9-43f1-b589-9e869e737f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:31.101508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bb2ee-d1d9-43f1-b589-9e869e737f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:31.102148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bb2ee-d1d9-43f1-b589-9e869e737f97 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:18:31.103920 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-d98bb2ee-d1d9-43f1-b589-9e869e737f97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:18:31.103920 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:18:31.103920 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:18:31.105108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bb2ee-d1d9-43f1-b589-9e869e737f97 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:18:31.124665 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 747/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Aug 29 15:18:30 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:18:33.041728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e02c-8215-44e0-8019-b36685ed1ae9 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:33.042854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e02c-8215-44e0-8019-b36685ed1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:33.042854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e02c-8215-44e0-8019-b36685ed1ae9 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:33.044107 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 732/1479] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:18:33.049350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd60e71-57bc-44e0-8014-901ac4d39c32 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:33.049810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd60e71-57bc-44e0-8014-901ac4d39c32 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:33.049973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd60e71-57bc-44e0-8014-901ac4d39c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:33.122215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0cd60e71-57bc-44e0-8014-901ac4d39c32 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:18:33.123356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0cd60e71-57bc-44e0-8014-901ac4d39c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:33.225805 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 748/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:18:33.519407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e02c-8215-44e0-8019-b36685ed1ae9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:18:33.521008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e768e02c-8215-44e0-8019-b36685ed1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:33.535661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:33.688701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e02c-8215-44e0-8019-b36685ed1ae9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:18:33.774515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:33.931854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceef2cd-0d7e-47a1-8cee-797b271c8c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:18:33.932475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceef2cd-0d7e-47a1-8cee-797b271c8c78 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:33.932749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceef2cd-0d7e-47a1-8cee-797b271c8c78 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:33.933014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceef2cd-0d7e-47a1-8cee-797b271c8c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:33.934640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bceef2cd-0d7e-47a1-8cee-797b271c8c78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:34.024099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceef2cd-0d7e-47a1-8cee-797b271c8c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:18:34.025771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceef2cd-0d7e-47a1-8cee-797b271c8c78 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:18:34.044774 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 733/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:18:36.172125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e87b-3099-48bd-bb15-55206dbeeb3b None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:36.172703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e87b-3099-48bd-bb15-55206dbeeb3b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:36.172703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e87b-3099-48bd-bb15-55206dbeeb3b None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:36.174067 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 749/1482] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:18:36.179353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb1446-639f-4937-9329-71f3889b564b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:36.179762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb1446-639f-4937-9329-71f3889b564b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:36.179977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb1446-639f-4937-9329-71f3889b564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:36.245523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-38cb1446-639f-4937-9329-71f3889b564b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:18:36.246777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-38cb1446-639f-4937-9329-71f3889b564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:36.293377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:36.344722 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 734/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:18:36.635817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420e87b-3099-48bd-bb15-55206dbeeb3b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:18:36.637369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f420e87b-3099-48bd-bb15-55206dbeeb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:36.661253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:36.740818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420e87b-3099-48bd-bb15-55206dbeeb3b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:18:36.815785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988945ea-4c76-485c-8272-3aaf86275d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:18:36.816301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988945ea-4c76-485c-8272-3aaf86275d5d service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:36.816562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988945ea-4c76-485c-8272-3aaf86275d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:36.816834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988945ea-4c76-485c-8272-3aaf86275d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:36.818504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-988945ea-4c76-485c-8272-3aaf86275d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:36.893460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:36.929306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988945ea-4c76-485c-8272-3aaf86275d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:18:36.930774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988945ea-4c76-485c-8272-3aaf86275d5d service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:18:36.948900 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 750/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:18:38.955805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554b0f6-626c-444f-847c-46f636f9ccf6 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:38.956227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554b0f6-626c-444f-847c-46f636f9ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:38.956471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554b0f6-626c-444f-847c-46f636f9ccf6 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:38.957934 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 735/1485] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:18:38.963201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4486e5-8b3c-46c5-a9f0-67b6cd6588a8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:38.964289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4486e5-8b3c-46c5-a9f0-67b6cd6588a8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:38.964403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4486e5-8b3c-46c5-a9f0-67b6cd6588a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:39.035180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2b4486e5-8b3c-46c5-a9f0-67b6cd6588a8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:18:39.036413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2b4486e5-8b3c-46c5-a9f0-67b6cd6588a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:39.133332 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 751/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:18:39.421128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554b0f6-626c-444f-847c-46f636f9ccf6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:18:39.422720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1554b0f6-626c-444f-847c-46f636f9ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:39.538172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554b0f6-626c-444f-847c-46f636f9ccf6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:18:39.613882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:39.615832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88a387-d5a4-4727-b122-f25477e1dab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:18:39.616549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88a387-d5a4-4727-b122-f25477e1dab9 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:39.617054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88a387-d5a4-4727-b122-f25477e1dab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:39.617548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88a387-d5a4-4727-b122-f25477e1dab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:39.619300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2f88a387-d5a4-4727-b122-f25477e1dab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:39.732195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88a387-d5a4-4727-b122-f25477e1dab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:18:39.733565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88a387-d5a4-4727-b122-f25477e1dab9 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:18:39.751971 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 736/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:18:41.839225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f55c3-8483-45de-b5f1-73fdf9164d35 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:41.839750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f55c3-8483-45de-b5f1-73fdf9164d35 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:41.839750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f55c3-8483-45de-b5f1-73fdf9164d35 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:41.841180 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 752/1488] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:18:41.846538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c9c2-db2c-49d9-81ce-cbe843fb8e5e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:41.846962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c9c2-db2c-49d9-81ce-cbe843fb8e5e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:41.847109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c9c2-db2c-49d9-81ce-cbe843fb8e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:41.913866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-66a3c9c2-db2c-49d9-81ce-cbe843fb8e5e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:18:41.915054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66a3c9c2-db2c-49d9-81ce-cbe843fb8e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:41.967046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:42.011468 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 737/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:18:42.303741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f55c3-8483-45de-b5f1-73fdf9164d35 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:18:42.305295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a57f55c3-8483-45de-b5f1-73fdf9164d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:42.341682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:42.412563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f55c3-8483-45de-b5f1-73fdf9164d35 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:18:42.485606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814233c-368d-4c10-b616-85533fb1c072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:18:42.486221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814233c-368d-4c10-b616-85533fb1c072 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:42.486501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814233c-368d-4c10-b616-85533fb1c072 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:42.486776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814233c-368d-4c10-b616-85533fb1c072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:42.488387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2814233c-368d-4c10-b616-85533fb1c072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:42.570990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:42.601722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814233c-368d-4c10-b616-85533fb1c072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:18:42.603170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814233c-368d-4c10-b616-85533fb1c072 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:18:42.621229 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 753/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:18:44.766385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9e48-6b54-4859-84f6-a3418d3c5d90 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:44.767029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9e48-6b54-4859-84f6-a3418d3c5d90 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:44.767029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9e48-6b54-4859-84f6-a3418d3c5d90 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:44.768322 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 738/1491] 10.222.0.16 () {54 vars in 927 bytes} [Mon Aug 29 15:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:18:44.774046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba2005-ebec-496a-af28-6b4de4d14cd2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:44.774489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba2005-ebec-496a-af28-6b4de4d14cd2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:44.774594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba2005-ebec-496a-af28-6b4de4d14cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:44.840816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0eba2005-ebec-496a-af28-6b4de4d14cd2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:18:44.841941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0eba2005-ebec-496a-af28-6b4de4d14cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:44.940769 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 754/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Aug 29 15:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:18:45.226495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c9e48-6b54-4859-84f6-a3418d3c5d90 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:18:45.228019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ab9c9e48-6b54-4859-84f6-a3418d3c5d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:45.331608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c9e48-6b54-4859-84f6-a3418d3c5d90 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:18:45.407857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6b743-f1c2-4f64-8682-dd8b7e84dec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:18:45.408456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6b743-f1c2-4f64-8682-dd8b7e84dec1 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:18:45.408738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6b743-f1c2-4f64-8682-dd8b7e84dec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:18:45.409009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6b743-f1c2-4f64-8682-dd8b7e84dec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:18:45.410644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c5d6b743-f1c2-4f64-8682-dd8b7e84dec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:18:45.419966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:45.519924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6b743-f1c2-4f64-8682-dd8b7e84dec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:18:45.521340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6b743-f1c2-4f64-8682-dd8b7e84dec1 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:18:45.540388 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 739/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:18:54.939035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=82 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:18:55.537566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=50 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:02.417587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76741ec-d2ba-4288-a92b-0a0962e9ea7a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:02.418520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76741ec-d2ba-4288-a92b-0a0962e9ea7a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:02.418520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76741ec-d2ba-4288-a92b-0a0962e9ea7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:02.567327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f76741ec-d2ba-4288-a92b-0a0962e9ea7a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:20:02.569558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f76741ec-d2ba-4288-a92b-0a0962e9ea7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:02.717471 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 755/1494] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:20:02.726576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db065-847b-4923-aa0a-0f94bef0d675 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:02.727728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db065-847b-4923-aa0a-0f94bef0d675 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:02.728095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db065-847b-4923-aa0a-0f94bef0d675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:02.823982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ad2db065-847b-4923-aa0a-0f94bef0d675 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:20:02.826679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ad2db065-847b-4923-aa0a-0f94bef0d675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:03.003806 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 740/1495] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:20:03.009633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76741ec-d2ba-4288-a92b-0a0962e9ea7a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:20:03.011182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f76741ec-d2ba-4288-a92b-0a0962e9ea7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:03.024244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76741ec-d2ba-4288-a92b-0a0962e9ea7a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:20:03.110868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:03.152854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390e1c3-e5ee-428e-8583-3d2c2a06bb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:20:03.153630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390e1c3-e5ee-428e-8583-3d2c2a06bb7c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:03.153953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390e1c3-e5ee-428e-8583-3d2c2a06bb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:03.154268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390e1c3-e5ee-428e-8583-3d2c2a06bb7c admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:03.155019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390e1c3-e5ee-428e-8583-3d2c2a06bb7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:20:03.155409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390e1c3-e5ee-428e-8583-3d2c2a06bb7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:20:03.156900 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-c390e1c3-e5ee-428e-8583-3d2c2a06bb7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:20:03.156900 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:20:03.156900 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:20:03.158102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390e1c3-e5ee-428e-8583-3d2c2a06bb7c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:20:03.171625 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 756/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:20:03.186194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db065-847b-4923-aa0a-0f94bef0d675 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:20:03.199508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db065-847b-4923-aa0a-0f94bef0d675 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:20:03.275043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:03.336402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0a38-4b19-40b9-a1c4-71053c894bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:20:03.337020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0a38-4b19-40b9-a1c4-71053c894bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:03.337299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0a38-4b19-40b9-a1c4-71053c894bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:03.337619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0a38-4b19-40b9-a1c4-71053c894bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:03.338267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b0a38-4b19-40b9-a1c4-71053c894bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:20:03.340087 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-f45b0a38-4b19-40b9-a1c4-71053c894bc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:20:03.340087 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:20:03.340087 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:20:03.341326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b0a38-4b19-40b9-a1c4-71053c894bc9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:20:03.409264 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 741/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:20:03 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:20:03.413881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390e1c3-e5ee-428e-8583-3d2c2a06bb7c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:20:03.416012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c390e1c3-e5ee-428e-8583-3d2c2a06bb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:03.456287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390e1c3-e5ee-428e-8583-3d2c2a06bb7c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:20:03.583624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433962d0-1e69-4a31-ab4e-50b243e45261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:20:03.584247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433962d0-1e69-4a31-ab4e-50b243e45261 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:03.584524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433962d0-1e69-4a31-ab4e-50b243e45261 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:03.584811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433962d0-1e69-4a31-ab4e-50b243e45261 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:03.585509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433962d0-1e69-4a31-ab4e-50b243e45261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:20:03.586634 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-433962d0-1e69-4a31-ab4e-50b243e45261 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:20:03.586634 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:20:03.586634 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:20:03.587923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433962d0-1e69-4a31-ab4e-50b243e45261 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:20:03.638673 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 757/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:20:03 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:20:03.644850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0a38-4b19-40b9-a1c4-71053c894bc9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:20:03.646496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f45b0a38-4b19-40b9-a1c4-71053c894bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:03.722940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0a38-4b19-40b9-a1c4-71053c894bc9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:20:03.825711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:03.842952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d494923-4cc4-4bf9-8c12-12492bbc6028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:20:03.843616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d494923-4cc4-4bf9-8c12-12492bbc6028 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:03.843933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d494923-4cc4-4bf9-8c12-12492bbc6028 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:03.844249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d494923-4cc4-4bf9-8c12-12492bbc6028 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:03.845041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d494923-4cc4-4bf9-8c12-12492bbc6028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:20:03.846218 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-3d494923-4cc4-4bf9-8c12-12492bbc6028 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:20:03.846218 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:20:03.846218 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:20:03.847257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d494923-4cc4-4bf9-8c12-12492bbc6028 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:20:03.861624 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 742/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:20:03.868329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433962d0-1e69-4a31-ab4e-50b243e45261 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:20:03.870098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-433962d0-1e69-4a31-ab4e-50b243e45261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:03.883394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433962d0-1e69-4a31-ab4e-50b243e45261 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:20:03.915464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:04.179429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142d7a4-95fa-40e5-acc9-2a3b9e7635d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:20:04.180722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d7a4-95fa-40e5-acc9-2a3b9e7635d5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:04.181111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d7a4-95fa-40e5-acc9-2a3b9e7635d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:04.181519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d7a4-95fa-40e5-acc9-2a3b9e7635d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:04.182387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142d7a4-95fa-40e5-acc9-2a3b9e7635d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:20:04.183586 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-7142d7a4-95fa-40e5-acc9-2a3b9e7635d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:20:04.183586 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:20:04.183586 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:20:04.184769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142d7a4-95fa-40e5-acc9-2a3b9e7635d5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:20:04.202650 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 758/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:20:04.207949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d494923-4cc4-4bf9-8c12-12492bbc6028 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:20:04.210883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3d494923-4cc4-4bf9-8c12-12492bbc6028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:04.257408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d494923-4cc4-4bf9-8c12-12492bbc6028 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:20:04.401135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587b826-ea17-4c74-aad5-8417be0802c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:20:04.401915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587b826-ea17-4c74-aad5-8417be0802c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:04.402297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587b826-ea17-4c74-aad5-8417be0802c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:04.402692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587b826-ea17-4c74-aad5-8417be0802c5 admin admin] PATH_INFO: `/v3/projects/21e3b3d938e14a47871ef22a488760ad/users/e8f11717e0f9413e8241590d12a21502/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:04.447040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587b826-ea17-4c74-aad5-8417be0802c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e3b3d938e14a47871ef22a488760ad, user_id=e8f11717e0f9413e8241590d12a21502, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:20:04.448858 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-8587b826-ea17-4c74-aad5-8417be0802c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:20:04.448858 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:20:04.448858 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:20:04.453016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587b826-ea17-4c74-aad5-8417be0802c5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:20:04.502202 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 743/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:20:04 2022] PUT /identity/v3/projects/21e3b3d938e14a47871ef22a488760ad/users/e8f11717e0f9413e8241590d12a21502/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:20:04.522942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff778-3baa-4156-a8f0-1913e8b1a223 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:04.523572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff778-3baa-4156-a8f0-1913e8b1a223 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:04.524131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff778-3baa-4156-a8f0-1913e8b1a223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:04.598482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-67eff778-3baa-4156-a8f0-1913e8b1a223 None None] MFA Rules not processed for user `e8f11717e0f9413e8241590d12a21502`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:20:04.599740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-67eff778-3baa-4156-a8f0-1913e8b1a223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:04.731168 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 759/1502] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:20:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:20:04.752581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3d85-dd5f-4cf9-b10b-c0d9f32fabe5 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:04.753061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3d85-dd5f-4cf9-b10b-c0d9f32fabe5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:04.753559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3d85-dd5f-4cf9-b10b-c0d9f32fabe5 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:04.756178 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 744/1503] 10.222.0.16 () {54 vars in 964 bytes} [Mon Aug 29 15:20:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:20:04.764773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8e7e-86e3-4a34-a525-accd15ab0d25 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:04.765314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8e7e-86e3-4a34-a525-accd15ab0d25 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:04.765859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8e7e-86e3-4a34-a525-accd15ab0d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:04.811320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:04.868701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-392b8e7e-86e3-4a34-a525-accd15ab0d25 None None] MFA Rules not processed for user `e1ed0648d3b74de89966c6d2e2b8f30a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:20:04.870005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-392b8e7e-86e3-4a34-a525-accd15ab0d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:04.966863 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 760/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Aug 29 15:20:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:20:04.974765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb3d85-dd5f-4cf9-b10b-c0d9f32fabe5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:20:04.976330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-84cb3d85-dd5f-4cf9-b10b-c0d9f32fabe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:05.039010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:05.109696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb3d85-dd5f-4cf9-b10b-c0d9f32fabe5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:20:05.199326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfac10-1d09-4652-9ef5-1ca44b13f761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:20:05.199939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfac10-1d09-4652-9ef5-1ca44b13f761 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:05.200220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfac10-1d09-4652-9ef5-1ca44b13f761 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:05.200493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfac10-1d09-4652-9ef5-1ca44b13f761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:05.202234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-92bfac10-1d09-4652-9ef5-1ca44b13f761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:05.331271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfac10-1d09-4652-9ef5-1ca44b13f761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:20:05.333001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfac10-1d09-4652-9ef5-1ca44b13f761 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:20:05.338138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:05.357739 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 745/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:20:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:20:05.421736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597944c0-616e-4d0b-bba9-bc411828335b None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:05.422222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597944c0-616e-4d0b-bba9-bc411828335b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:05.422658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597944c0-616e-4d0b-bba9-bc411828335b None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:05.424961 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 761/1506] 10.222.0.16 () {52 vars in 830 bytes} [Mon Aug 29 15:20:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:20:05.430887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfac10-1d09-4652-9ef5-1ca44b13f761 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:20:05.432808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-92bfac10-1d09-4652-9ef5-1ca44b13f761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:05.573496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfac10-1d09-4652-9ef5-1ca44b13f761 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:20:05.710801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:20:05.711531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:05.711854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:05.712186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] PATH_INFO: `/v3/users/e8f11717e0f9413e8241590d12a21502` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:05.728432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f11717e0f9413e8241590d12a21502)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:20:05.729588 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:20:05.729588 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:20:05.729588 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:20:05.730843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:20:05.742980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:05.814536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f11717e0f9413e8241590d12a21502'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:20:05.815052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f11717e0f9413e8241590d12a21502'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:20:05.846781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f11717e0f9413e8241590d12a21502'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:20:05.847433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f11717e0f9413e8241590d12a21502'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:20:05.867086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f11717e0f9413e8241590d12a21502'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:20:05.892055 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 746/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:20:05 2022] DELETE /identity/v3/users/e8f11717e0f9413e8241590d12a21502 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:20:05.898154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85def05-1a9f-4845-a59f-f38dd0f9824f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:05.899097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85def05-1a9f-4845-a59f-f38dd0f9824f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:05.899097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85def05-1a9f-4845-a59f-f38dd0f9824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:05.977508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c85def05-1a9f-4845-a59f-f38dd0f9824f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:20:05.979052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c85def05-1a9f-4845-a59f-f38dd0f9824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:06.086132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:06.102968 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 762/1508] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:20:06.114007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:20:06.116253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:06.243578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d90a33-7d56-4fb0-943e-55a2739b204d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:20:06.316068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:06.346498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d8b11-9791-4bfb-8d3b-91b8e8131b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:20:06.347454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d8b11-9791-4bfb-8d3b-91b8e8131b42 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:06.347830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d8b11-9791-4bfb-8d3b-91b8e8131b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:06.348205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d8b11-9791-4bfb-8d3b-91b8e8131b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:06.350141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-788d8b11-9791-4bfb-8d3b-91b8e8131b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:06.518868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d8b11-9791-4bfb-8d3b-91b8e8131b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:20:06.520447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d8b11-9791-4bfb-8d3b-91b8e8131b42 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:20:06.543300 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 747/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:20:06.967428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85def05-1a9f-4845-a59f-f38dd0f9824f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:20:06.968726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c85def05-1a9f-4845-a59f-f38dd0f9824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:20:06.982556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85def05-1a9f-4845-a59f-f38dd0f9824f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:20:07.102460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:20:07.103182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:20:07.103501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:20:07.103813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] PATH_INFO: `/v3/projects/21e3b3d938e14a47871ef22a488760ad` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:20:07.117211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e3b3d938e14a47871ef22a488760ad)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:20:07.118478 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:20:07.118478 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:20:07.118478 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:20:07.119856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:20:07.191334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e3b3d938e14a47871ef22a488760ad', 'request_id': 'req-e8e7577b-8355-4c0c-82a6-bee3183a92cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:20:07.200041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e3b3d938e14a47871ef22a488760ad', 'request_id': 'req-e8e7577b-8355-4c0c-82a6-bee3183a92cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:20:07.212421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e3b3d938e14a47871ef22a488760ad', 'request_id': 'req-e8e7577b-8355-4c0c-82a6-bee3183a92cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:20:07.249019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] The token cache is being invalidate because project 21e3b3d938e14a47871ef22a488760ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:20:07.249305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:20:07.249785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8e7577b-8355-4c0c-82a6-bee3183a92cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:20:07.251272 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 763/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:20:06 2022] DELETE /identity/v3/projects/21e3b3d938e14a47871ef22a488760ad => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:20:16.541548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=62 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:20:17.246495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:30.161660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886deeb0-6468-4f51-9cd0-b9e052afe467 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.162233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886deeb0-6468-4f51-9cd0-b9e052afe467 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.162233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886deeb0-6468-4f51-9cd0-b9e052afe467 None None] PATH_INFO: `/v3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.163389 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 748/1511] 10.222.0.69 () {54 vars in 925 bytes} [Mon Aug 29 15:23:30 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:30.170029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70fc67-73c6-47c2-96dc-a1170c0ecd5b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:30.170497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70fc67-73c6-47c2-96dc-a1170c0ecd5b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:30.170605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70fc67-73c6-47c2-96dc-a1170c0ecd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:30.263686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4f70fc67-73c6-47c2-96dc-a1170c0ecd5b None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:30.264892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4f70fc67-73c6-47c2-96dc-a1170c0ecd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:30.390834 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 764/1512] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Aug 29 15:23:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:23:34.098957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2421-de30-45fe-b336-1a730d08f796 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:34.099493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2421-de30-45fe-b336-1a730d08f796 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:34.099493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2421-de30-45fe-b336-1a730d08f796 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:34.100806 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 749/1513] 10.222.0.16 () {54 vars in 961 bytes} [Mon Aug 29 15:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:23:34.106674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1f034-e41c-41a6-a0d2-533b8ac27655 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:34.107105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1f034-e41c-41a6-a0d2-533b8ac27655 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:34.107225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1f034-e41c-41a6-a0d2-533b8ac27655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:34.132136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b9a1f034-e41c-41a6-a0d2-533b8ac27655 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:34.133355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b9a1f034-e41c-41a6-a0d2-533b8ac27655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:34.142134 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 765/1514] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Aug 29 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:23:34.150415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad2421-de30-45fe-b336-1a730d08f796 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:34.166534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad2421-de30-45fe-b336-1a730d08f796 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:34.171497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e262f1-b4bc-450c-a4a0-1e4fcd6fbf5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:34.172182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e262f1-b4bc-450c-a4a0-1e4fcd6fbf5c service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:34.172469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e262f1-b4bc-450c-a4a0-1e4fcd6fbf5c service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:34.172741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e262f1-b4bc-450c-a4a0-1e4fcd6fbf5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:34.181510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e262f1-b4bc-450c-a4a0-1e4fcd6fbf5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:34.183129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e262f1-b4bc-450c-a4a0-1e4fcd6fbf5c service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:34.193807 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 750/1515] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:23:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:23:34.405012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec843-110e-4856-97bd-d878aefd87d1 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:34.405226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec843-110e-4856-97bd-d878aefd87d1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:34.405507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec843-110e-4856-97bd-d878aefd87d1 None None] PATH_INFO: `/v3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:34.406793 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 766/1516] 10.222.0.52 () {54 vars in 925 bytes} [Mon Aug 29 15:23:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:23:34.414035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fd57d-8bea-4cce-b9c3-b3ba4c2708ba None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:34.414352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fd57d-8bea-4cce-b9c3-b3ba4c2708ba None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:34.414628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fd57d-8bea-4cce-b9c3-b3ba4c2708ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:34.435151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4d8fd57d-8bea-4cce-b9c3-b3ba4c2708ba None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:23:34.436615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4d8fd57d-8bea-4cce-b9c3-b3ba4c2708ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:23:34.446755 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 751/1517] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Aug 29 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:23:38.155897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ec843-110e-4856-97bd-d878aefd87d1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:23:38.170694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ec843-110e-4856-97bd-d878aefd87d1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:23:38.177164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf4e67-2c90-4d49-8c32-c868c41de54a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:23:38.177831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf4e67-2c90-4d49-8c32-c868c41de54a service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:23:38.178110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf4e67-2c90-4d49-8c32-c868c41de54a service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:23:38.178387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf4e67-2c90-4d49-8c32-c868c41de54a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:23:38.187661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf4e67-2c90-4d49-8c32-c868c41de54a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:23:38.189313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf4e67-2c90-4d49-8c32-c868c41de54a service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:23:38.200439 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 767/1518] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:23:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:23:44.429265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:48.195577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=83 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:11.592456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2d4ba-4dec-47ae-8bb8-b35c8e538082 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:11.593053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2d4ba-4dec-47ae-8bb8-b35c8e538082 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:11.593575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2d4ba-4dec-47ae-8bb8-b35c8e538082 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:11.594926 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 752/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:11.600576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99d72e-f16e-465a-8ba1-af4acd9c0741 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:11.601031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99d72e-f16e-465a-8ba1-af4acd9c0741 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:11.601133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99d72e-f16e-465a-8ba1-af4acd9c0741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:11.662741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2e99d72e-f16e-465a-8ba1-af4acd9c0741 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:11.663961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2e99d72e-f16e-465a-8ba1-af4acd9c0741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:11.743013 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 768/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:24:11.897949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2d4ba-4dec-47ae-8bb8-b35c8e538082 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:11.900166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ffe2d4ba-4dec-47ae-8bb8-b35c8e538082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:12.004555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2d4ba-4dec-47ae-8bb8-b35c8e538082 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:12.010410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cf2f7-e193-4503-b941-c157a7e23d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:12.011014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf2f7-e193-4503-b941-c157a7e23d9f service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:12.011293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf2f7-e193-4503-b941-c157a7e23d9f service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:12.011565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf2f7-e193-4503-b941-c157a7e23d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:12.019668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cf2f7-e193-4503-b941-c157a7e23d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:12.021253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cf2f7-e193-4503-b941-c157a7e23d9f service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:12.031196 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 753/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:24:12.876367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d486d2d-f94b-4165-bdb9-5a2f3611d5a6 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:12.876947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d486d2d-f94b-4165-bdb9-5a2f3611d5a6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:12.876947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d486d2d-f94b-4165-bdb9-5a2f3611d5a6 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:12.878219 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 15:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:12.883129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cc41a-c675-43b0-9a62-59daadb8fd92 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:12.883614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cc41a-c675-43b0-9a62-59daadb8fd92 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:12.883736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cc41a-c675-43b0-9a62-59daadb8fd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:12.904542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ee9cc41a-c675-43b0-9a62-59daadb8fd92 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:12.905829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ee9cc41a-c675-43b0-9a62-59daadb8fd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:12.915986 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 15:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:24:13.069943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d486d2d-f94b-4165-bdb9-5a2f3611d5a6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:13.086556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d486d2d-f94b-4165-bdb9-5a2f3611d5a6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:13.092542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab05acb-d83c-4f3c-95fa-98090730529e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:13.093563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05acb-d83c-4f3c-95fa-98090730529e service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:13.093884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05acb-d83c-4f3c-95fa-98090730529e service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:13.094188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05acb-d83c-4f3c-95fa-98090730529e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:13.103939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab05acb-d83c-4f3c-95fa-98090730529e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:13.105572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab05acb-d83c-4f3c-95fa-98090730529e service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:13.115263 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 770/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:24:16.766412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38e23-48b4-45bf-886a-81acfac9d227 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:16.766968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38e23-48b4-45bf-886a-81acfac9d227 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:16.766968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38e23-48b4-45bf-886a-81acfac9d227 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:16.768271 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:16.774561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad070328-8ed7-4e20-9124-2ca46b201899 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:16.775072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad070328-8ed7-4e20-9124-2ca46b201899 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:16.775193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad070328-8ed7-4e20-9124-2ca46b201899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:16.797524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ad070328-8ed7-4e20-9124-2ca46b201899 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:16.798651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ad070328-8ed7-4e20-9124-2ca46b201899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:16.806811 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:24:17.105254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f38e23-48b4-45bf-886a-81acfac9d227 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:17.107143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c4f38e23-48b4-45bf-886a-81acfac9d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:17.188436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f38e23-48b4-45bf-886a-81acfac9d227 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:17.192671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d560351-c615-4197-95df-894b0bd527bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:17.193322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d560351-c615-4197-95df-894b0bd527bc service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:17.193632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d560351-c615-4197-95df-894b0bd527bc service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:17.193934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d560351-c615-4197-95df-894b0bd527bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:17.204052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d560351-c615-4197-95df-894b0bd527bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:17.205567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d560351-c615-4197-95df-894b0bd527bc service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:17.215605 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 756/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:24:19.111391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68b6dd-0aff-4c11-9ce6-c8b3af5c7de8 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:19.111966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68b6dd-0aff-4c11-9ce6-c8b3af5c7de8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:19.111966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68b6dd-0aff-4c11-9ce6-c8b3af5c7de8 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:19.113944 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 15:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:24:19.119171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4b28-5433-4847-a31f-610352f6729a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:19.119640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4b28-5433-4847-a31f-610352f6729a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:19.119792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4b28-5433-4847-a31f-610352f6729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:19.140898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-52ca4b28-5433-4847-a31f-610352f6729a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:24:19.142234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-52ca4b28-5433-4847-a31f-610352f6729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:24:19.150791 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 15:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:24:19.467367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68b6dd-0aff-4c11-9ce6-c8b3af5c7de8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:24:19.478625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68b6dd-0aff-4c11-9ce6-c8b3af5c7de8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:24:19.482417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a222b-fb39-4172-ab45-eb546f58252e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:24:19.483096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a222b-fb39-4172-ab45-eb546f58252e service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:24:19.483448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a222b-fb39-4172-ab45-eb546f58252e service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:24:19.483756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a222b-fb39-4172-ab45-eb546f58252e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:24:19.493572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a222b-fb39-4172-ab45-eb546f58252e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:24:19.495096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a222b-fb39-4172-ab45-eb546f58252e service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:24:19.506940 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 773/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:24:29.135439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:29.500785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=65 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:09.100225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe100c-dc12-4f32-a28b-b2de4c28b788 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:09.100727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe100c-dc12-4f32-a28b-b2de4c28b788 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:09.100811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe100c-dc12-4f32-a28b-b2de4c28b788 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:09.102158 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 758/1531] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:25:09.107600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03089cbb-883f-4af9-b390-36dcafdc9b92 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:09.108007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03089cbb-883f-4af9-b390-36dcafdc9b92 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:09.108270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03089cbb-883f-4af9-b390-36dcafdc9b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:09.128827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-03089cbb-883f-4af9-b390-36dcafdc9b92 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:09.130136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-03089cbb-883f-4af9-b390-36dcafdc9b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:09.138921 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 774/1532] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:25:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:25:19.123263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:41.237758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7de5e3-d888-45e8-9737-30e350e3e7ad None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.238322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7de5e3-d888-45e8-9737-30e350e3e7ad None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.238322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7de5e3-d888-45e8-9737-30e350e3e7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.265380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dd7de5e3-d888-45e8-9737-30e350e3e7ad None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:41.267333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dd7de5e3-d888-45e8-9737-30e350e3e7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:41.279792 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 759/1533] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:25:41.294035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d071f47-a6c8-4698-900c-42ef67d14b85 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.294596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d071f47-a6c8-4698-900c-42ef67d14b85 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.294596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d071f47-a6c8-4698-900c-42ef67d14b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.318829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8d071f47-a6c8-4698-900c-42ef67d14b85 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:41.320050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8d071f47-a6c8-4698-900c-42ef67d14b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:41.332690 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 775/1534] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:41.337864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7de5e3-d888-45e8-9737-30e350e3e7ad None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:41.353334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7de5e3-d888-45e8-9737-30e350e3e7ad None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:41.365912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580c39e-96bc-4a06-b29a-38ec9fca6424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:41.366885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c39e-96bc-4a06-b29a-38ec9fca6424 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.367378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c39e-96bc-4a06-b29a-38ec9fca6424 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.367892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c39e-96bc-4a06-b29a-38ec9fca6424 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.368984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580c39e-96bc-4a06-b29a-38ec9fca6424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:41.369597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580c39e-96bc-4a06-b29a-38ec9fca6424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:41.370836 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-1580c39e-96bc-4a06-b29a-38ec9fca6424 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:25:41.370836 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:25:41.370836 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:25:41.372083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580c39e-96bc-4a06-b29a-38ec9fca6424 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:41.396285 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 760/1535] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:41.405843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d071f47-a6c8-4698-900c-42ef67d14b85 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:41.421867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d071f47-a6c8-4698-900c-42ef67d14b85 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:41.429644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6755d-a6e9-409f-be7f-9d76035f2f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:41.430657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6755d-a6e9-409f-be7f-9d76035f2f34 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.431191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6755d-a6e9-409f-be7f-9d76035f2f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.431667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6755d-a6e9-409f-be7f-9d76035f2f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.432512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6755d-a6e9-409f-be7f-9d76035f2f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:41.433802 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-b5c6755d-a6e9-409f-be7f-9d76035f2f34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:25:41.433802 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:25:41.433802 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:25:41.435415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6755d-a6e9-409f-be7f-9d76035f2f34 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:41.481999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f8dde-a773-4653-944e-330d66aae7dc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.482353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f8dde-a773-4653-944e-330d66aae7dc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.483085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f8dde-a773-4653-944e-330d66aae7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.501877 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 776/1536] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:41 2022] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:41.504419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859feac-4e9f-40c3-8113-a7a8fb610068 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.504924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859feac-4e9f-40c3-8113-a7a8fb610068 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.505434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859feac-4e9f-40c3-8113-a7a8fb610068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.555532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-009f8dde-a773-4653-944e-330d66aae7dc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:41.557892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-009f8dde-a773-4653-944e-330d66aae7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:41.572673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a859feac-4e9f-40c3-8113-a7a8fb610068 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:41.578886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a859feac-4e9f-40c3-8113-a7a8fb610068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:41.677994 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 761/1537] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:41.679213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f8dde-a773-4653-944e-330d66aae7dc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:41.697696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f8dde-a773-4653-944e-330d66aae7dc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:41.706644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57d29f-2275-4ac7-b150-c4f0e90561cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:41.707729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57d29f-2275-4ac7-b150-c4f0e90561cc admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.708229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57d29f-2275-4ac7-b150-c4f0e90561cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.708705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57d29f-2275-4ac7-b150-c4f0e90561cc admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.709652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57d29f-2275-4ac7-b150-c4f0e90561cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:41.711014 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-6d57d29f-2275-4ac7-b150-c4f0e90561cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:25:41.711014 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:25:41.711014 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:25:41.712621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57d29f-2275-4ac7-b150-c4f0e90561cc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:41.721424 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 777/1538] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:41.721424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1ed47-eb70-4ef8-8685-7ce05df6cf1d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.721424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1ed47-eb70-4ef8-8685-7ce05df6cf1d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.721424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1ed47-eb70-4ef8-8685-7ce05df6cf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.747978 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 762/1539] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:41 2022] POST /identity/v3/users => generated 296 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:41.749617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17778019-de33-4ee2-9cee-f5b07ae9c6b8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.750114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17778019-de33-4ee2-9cee-f5b07ae9c6b8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.750589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17778019-de33-4ee2-9cee-f5b07ae9c6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.766537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c0a1ed47-eb70-4ef8-8685-7ce05df6cf1d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:41.769076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c0a1ed47-eb70-4ef8-8685-7ce05df6cf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:41.795708 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 778/1540] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:41.795708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1ed47-eb70-4ef8-8685-7ce05df6cf1d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:41.798019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-17778019-de33-4ee2-9cee-f5b07ae9c6b8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:41.799533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-17778019-de33-4ee2-9cee-f5b07ae9c6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:41.812287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1ed47-eb70-4ef8-8685-7ce05df6cf1d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:41.817947 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 763/1541] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:41.819213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17778019-de33-4ee2-9cee-f5b07ae9c6b8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:41.831347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaaae7-ee92-41d0-a069-50d090ac80a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:41.831793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaaae7-ee92-41d0-a069-50d090ac80a6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.831961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaaae7-ee92-41d0-a069-50d090ac80a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.832208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaaae7-ee92-41d0-a069-50d090ac80a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.832864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaaae7-ee92-41d0-a069-50d090ac80a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:41.834520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaaae7-ee92-41d0-a069-50d090ac80a6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:41.836431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17778019-de33-4ee2-9cee-f5b07ae9c6b8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:41.847053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e0593-a3e0-4847-8392-b1b88d01dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:41.848062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0593-a3e0-4847-8392-b1b88d01dc12 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.848550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0593-a3e0-4847-8392-b1b88d01dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.849022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0593-a3e0-4847-8392-b1b88d01dc12 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.849916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e0593-a3e0-4847-8392-b1b88d01dc12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:41.851129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e0593-a3e0-4847-8392-b1b88d01dc12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:41.853719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e0593-a3e0-4847-8392-b1b88d01dc12 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:41.865570 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 779/1542] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:41.866554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaaae7-ee92-41d0-a069-50d090ac80a6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:41.878596 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 764/1543] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:41.879814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e0593-a3e0-4847-8392-b1b88d01dc12 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:41.884850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaaae7-ee92-41d0-a069-50d090ac80a6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:41.891717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e0593-a3e0-4847-8392-b1b88d01dc12 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:41.898407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276354b4-0f3d-4ccd-b12a-99b7edb7d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:41.899047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276354b4-0f3d-4ccd-b12a-99b7edb7d630 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.899328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276354b4-0f3d-4ccd-b12a-99b7edb7d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.899603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276354b4-0f3d-4ccd-b12a-99b7edb7d630 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.900257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276354b4-0f3d-4ccd-b12a-99b7edb7d630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:41.900558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276354b4-0f3d-4ccd-b12a-99b7edb7d630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:41.902196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276354b4-0f3d-4ccd-b12a-99b7edb7d630 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:41.905503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd890f61-7d1e-4f27-892b-02cac1cf29f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:41.906534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd890f61-7d1e-4f27-892b-02cac1cf29f1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.907106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd890f61-7d1e-4f27-892b-02cac1cf29f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.907841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd890f61-7d1e-4f27-892b-02cac1cf29f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.909028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd890f61-7d1e-4f27-892b-02cac1cf29f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:41.910958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd890f61-7d1e-4f27-892b-02cac1cf29f1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:41.929074 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 765/1544] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:41.930297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd890f61-7d1e-4f27-892b-02cac1cf29f1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:41.934818 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 780/1545] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:41.936281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c1d49-4506-411b-a1a5-afc89675e706 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.936563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c1d49-4506-411b-a1a5-afc89675e706 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.936846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c1d49-4506-411b-a1a5-afc89675e706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.949469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd890f61-7d1e-4f27-892b-02cac1cf29f1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:41.967564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a21c1d49-4506-411b-a1a5-afc89675e706 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:41.968780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a21c1d49-4506-411b-a1a5-afc89675e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:41.970120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc3e1-f9f0-44a9-b0bb-2fe3fbee56cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:41.971241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc3e1-f9f0-44a9-b0bb-2fe3fbee56cb admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.971729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc3e1-f9f0-44a9-b0bb-2fe3fbee56cb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.972487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc3e1-f9f0-44a9-b0bb-2fe3fbee56cb admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:41.974105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fc3e1-f9f0-44a9-b0bb-2fe3fbee56cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:41.976485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fc3e1-f9f0-44a9-b0bb-2fe3fbee56cb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:41.993034 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 781/1546] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:41.995745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d833ec3-fd80-4c87-bf7f-2cd5e40da335 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:41.995997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d833ec3-fd80-4c87-bf7f-2cd5e40da335 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:41.996197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d833ec3-fd80-4c87-bf7f-2cd5e40da335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.024642 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 766/1547] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:41 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:42.025927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc3e1-f9f0-44a9-b0bb-2fe3fbee56cb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.026381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1d833ec3-fd80-4c87-bf7f-2cd5e40da335 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:42.031595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1d833ec3-fd80-4c87-bf7f-2cd5e40da335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:42.107207 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 782/1548] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:42.108734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d833ec3-fd80-4c87-bf7f-2cd5e40da335 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.116425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc3e1-f9f0-44a9-b0bb-2fe3fbee56cb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.122560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d833ec3-fd80-4c87-bf7f-2cd5e40da335 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.123564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245a2dc-3aa3-4e1c-ae6e-4c25b82c31d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.124529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245a2dc-3aa3-4e1c-ae6e-4c25b82c31d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.124820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245a2dc-3aa3-4e1c-ae6e-4c25b82c31d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.125120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245a2dc-3aa3-4e1c-ae6e-4c25b82c31d0 admin admin] PATH_INFO: `/v3/projects/4ab0b710c01b4f81b519e8312dd7f02e/users/fb5e28baccfb4667ad4b68de07de190e/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.130881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82954c9-30cc-44c5-acf4-5e4d144d9023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.131508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82954c9-30cc-44c5-acf4-5e4d144d9023 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.131845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82954c9-30cc-44c5-acf4-5e4d144d9023 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.132141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82954c9-30cc-44c5-acf4-5e4d144d9023 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.132774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82954c9-30cc-44c5-acf4-5e4d144d9023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.134820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82954c9-30cc-44c5-acf4-5e4d144d9023 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.142877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245a2dc-3aa3-4e1c-ae6e-4c25b82c31d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab0b710c01b4f81b519e8312dd7f02e, user_id=fb5e28baccfb4667ad4b68de07de190e, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.145691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245a2dc-3aa3-4e1c-ae6e-4c25b82c31d0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.148067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:42.165245 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 767/1549] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:42 2022] PUT /identity/v3/projects/4ab0b710c01b4f81b519e8312dd7f02e/users/fb5e28baccfb4667ad4b68de07de190e/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:42.166604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d634-ee59-4f4f-a33b-4656283a4e49 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.166889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d634-ee59-4f4f-a33b-4656283a4e49 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.167163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d634-ee59-4f4f-a33b-4656283a4e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.178148 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 783/1550] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/projects => generated 397 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:42.179792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de9c1c-470f-45f1-8f20-11f39cd6e3ba None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.179792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de9c1c-470f-45f1-8f20-11f39cd6e3ba None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.179988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de9c1c-470f-45f1-8f20-11f39cd6e3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.189115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:42.191882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7a71d634-ee59-4f4f-a33b-4656283a4e49 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:42.193169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7a71d634-ee59-4f4f-a33b-4656283a4e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:42.203793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-26de9c1c-470f-45f1-8f20-11f39cd6e3ba None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:42.205030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-26de9c1c-470f-45f1-8f20-11f39cd6e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:42.254435 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 768/1551] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:42.255790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954766d-39fc-4b99-ba21-77d210702bcd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.256115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954766d-39fc-4b99-ba21-77d210702bcd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.256391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954766d-39fc-4b99-ba21-77d210702bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.274784 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 784/1552] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:42.275949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de9c1c-470f-45f1-8f20-11f39cd6e3ba None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.277109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4954766d-39fc-4b99-ba21-77d210702bcd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:42.278812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4954766d-39fc-4b99-ba21-77d210702bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:42.287863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de9c1c-470f-45f1-8f20-11f39cd6e3ba None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.288033 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 769/1553] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:42.288654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84424675-3ebc-419b-8ab1-c2b702a02206 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.289102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84424675-3ebc-419b-8ab1-c2b702a02206 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.289373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84424675-3ebc-419b-8ab1-c2b702a02206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.293919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb0080-c2e7-4bd1-be54-aada2a647da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.294533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb0080-c2e7-4bd1-be54-aada2a647da8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.295128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb0080-c2e7-4bd1-be54-aada2a647da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.295224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb0080-c2e7-4bd1-be54-aada2a647da8 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.295848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb0080-c2e7-4bd1-be54-aada2a647da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.297862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb0080-c2e7-4bd1-be54-aada2a647da8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.311163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-84424675-3ebc-419b-8ab1-c2b702a02206 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:42.312648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-84424675-3ebc-419b-8ab1-c2b702a02206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:42.321346 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 785/1555] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:42.325572 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 770/1555] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:42.325572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16613-1b8e-4dac-b405-e051cd877656 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.325572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16613-1b8e-4dac-b405-e051cd877656 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.325572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea16613-1b8e-4dac-b405-e051cd877656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.330647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff52f-acc3-40e0-8a9f-11160d76f90b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.330942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff52f-acc3-40e0-8a9f-11160d76f90b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.331229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff52f-acc3-40e0-8a9f-11160d76f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.342924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2ea16613-1b8e-4dac-b405-e051cd877656 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:42.344114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2ea16613-1b8e-4dac-b405-e051cd877656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:42.353819 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 771/1556] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:42.353819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea16613-1b8e-4dac-b405-e051cd877656 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.361102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-90cff52f-acc3-40e0-8a9f-11160d76f90b None None] MFA Rules not processed for user `fb5e28baccfb4667ad4b68de07de190e`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:42.362898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-90cff52f-acc3-40e0-8a9f-11160d76f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:42.364702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea16613-1b8e-4dac-b405-e051cd877656 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.369474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a15c5-7624-4e69-a297-98b1b4cd7bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.370085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a15c5-7624-4e69-a297-98b1b4cd7bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.370382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a15c5-7624-4e69-a297-98b1b4cd7bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.370645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a15c5-7624-4e69-a297-98b1b4cd7bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.371278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a15c5-7624-4e69-a297-98b1b4cd7bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.373324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a15c5-7624-4e69-a297-98b1b4cd7bc6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.399915 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 772/1557] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/users => generated 299 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:42.399915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261f14-7c46-4b37-962b-cacc022c188a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.399915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261f14-7c46-4b37-962b-cacc022c188a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.399915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261f14-7c46-4b37-962b-cacc022c188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.419394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6a261f14-7c46-4b37-962b-cacc022c188a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:42.420596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6a261f14-7c46-4b37-962b-cacc022c188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:42.432987 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 773/1558] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:42.432987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a261f14-7c46-4b37-962b-cacc022c188a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.438933 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 786/1559] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:42.442467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd28a-6534-4f8e-8161-ee1692d0b08d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.442574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a261f14-7c46-4b37-962b-cacc022c188a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.442664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd28a-6534-4f8e-8161-ee1692d0b08d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.442664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd28a-6534-4f8e-8161-ee1692d0b08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.445677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ace32a-20b6-46cd-a9ef-add97ef29c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.446273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ace32a-20b6-46cd-a9ef-add97ef29c97 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.446552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ace32a-20b6-46cd-a9ef-add97ef29c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.446842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ace32a-20b6-46cd-a9ef-add97ef29c97 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.447469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ace32a-20b6-46cd-a9ef-add97ef29c97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:42.447768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ace32a-20b6-46cd-a9ef-add97ef29c97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.449359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ace32a-20b6-46cd-a9ef-add97ef29c97 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.461884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-99edd28a-6534-4f8e-8161-ee1692d0b08d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:42.469599 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 774/1560] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:42.469765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-99edd28a-6534-4f8e-8161-ee1692d0b08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:42.469860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ace32a-20b6-46cd-a9ef-add97ef29c97 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.472530 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 787/1561] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:42.473912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb7c3-1655-4465-a42c-a5d276d930d9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.474197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb7c3-1655-4465-a42c-a5d276d930d9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.474470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb7c3-1655-4465-a42c-a5d276d930d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.474559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ace32a-20b6-46cd-a9ef-add97ef29c97 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.479471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397520-8fde-4fed-affc-433faa5e4fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.480062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397520-8fde-4fed-affc-433faa5e4fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.480339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397520-8fde-4fed-affc-433faa5e4fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.480611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397520-8fde-4fed-affc-433faa5e4fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.481238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94397520-8fde-4fed-affc-433faa5e4fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.482946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94397520-8fde-4fed-affc-433faa5e4fb0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.494519 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 775/1562] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:42.495347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397520-8fde-4fed-affc-433faa5e4fb0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.499015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3bbeb7c3-1655-4465-a42c-a5d276d930d9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:42.500223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3bbeb7c3-1655-4465-a42c-a5d276d930d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:42.505703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397520-8fde-4fed-affc-433faa5e4fb0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.508557 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 788/1563] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:42.509365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeb7c3-1655-4465-a42c-a5d276d930d9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.510840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69062c-85e1-431a-bf3a-b32745e8c3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.511615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69062c-85e1-431a-bf3a-b32745e8c3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.512034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69062c-85e1-431a-bf3a-b32745e8c3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.512583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69062c-85e1-431a-bf3a-b32745e8c3b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.513265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69062c-85e1-431a-bf3a-b32745e8c3b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:42.513599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69062c-85e1-431a-bf3a-b32745e8c3b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.515420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69062c-85e1-431a-bf3a-b32745e8c3b7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.519668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeb7c3-1655-4465-a42c-a5d276d930d9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.524330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aed60-7918-4c42-a2a4-9a6f5b34e978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.524928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aed60-7918-4c42-a2a4-9a6f5b34e978 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.525206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aed60-7918-4c42-a2a4-9a6f5b34e978 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.525506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aed60-7918-4c42-a2a4-9a6f5b34e978 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.526151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aed60-7918-4c42-a2a4-9a6f5b34e978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.527738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aed60-7918-4c42-a2a4-9a6f5b34e978 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.527889 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 776/1564] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:42.528956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69062c-85e1-431a-bf3a-b32745e8c3b7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.539109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69062c-85e1-431a-bf3a-b32745e8c3b7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.542348 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 789/1565] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:42.543161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aed60-7918-4c42-a2a4-9a6f5b34e978 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.546817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e2b4f-89a0-402e-a320-72dd1851efd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.547434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2b4f-89a0-402e-a320-72dd1851efd0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.547716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2b4f-89a0-402e-a320-72dd1851efd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.547995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2b4f-89a0-402e-a320-72dd1851efd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.548646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e2b4f-89a0-402e-a320-72dd1851efd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:42.548986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e2b4f-89a0-402e-a320-72dd1851efd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.550647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e2b4f-89a0-402e-a320-72dd1851efd0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.553043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aed60-7918-4c42-a2a4-9a6f5b34e978 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.557960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4581e7-0759-47b9-adce-1d916e89a2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.558552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4581e7-0759-47b9-adce-1d916e89a2db admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.558825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4581e7-0759-47b9-adce-1d916e89a2db admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.559155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4581e7-0759-47b9-adce-1d916e89a2db admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.559710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4581e7-0759-47b9-adce-1d916e89a2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.561627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4581e7-0759-47b9-adce-1d916e89a2db admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.569521 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 777/1566] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:42.569521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e2b4f-89a0-402e-a320-72dd1851efd0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.579267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e2b4f-89a0-402e-a320-72dd1851efd0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.584929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d449859-1d17-4665-9dc1-95f82b14b0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.585796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d449859-1d17-4665-9dc1-95f82b14b0bf admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.586232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d449859-1d17-4665-9dc1-95f82b14b0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.586741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d449859-1d17-4665-9dc1-95f82b14b0bf admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.587651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d449859-1d17-4665-9dc1-95f82b14b0bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.590024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d449859-1d17-4665-9dc1-95f82b14b0bf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.596460 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 790/1567] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:42.597531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4581e7-0759-47b9-adce-1d916e89a2db admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.624942 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 778/1568] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:42.624942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d449859-1d17-4665-9dc1-95f82b14b0bf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.632899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:42.665571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4581e7-0759-47b9-adce-1d916e89a2db admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.671065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:42.705064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d449859-1d17-4665-9dc1-95f82b14b0bf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.710344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b2970-693c-4299-bcb6-af5d7fe20d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.710954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b2970-693c-4299-bcb6-af5d7fe20d8e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.711234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b2970-693c-4299-bcb6-af5d7fe20d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.711502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b2970-693c-4299-bcb6-af5d7fe20d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.712147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b2970-693c-4299-bcb6-af5d7fe20d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.713778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b2970-693c-4299-bcb6-af5d7fe20d8e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.731216 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 779/1569] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:42.731427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9b533-94dc-4c40-bd0e-18e63c6d6a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.731537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b2970-693c-4299-bcb6-af5d7fe20d8e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.731616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b533-94dc-4c40-bd0e-18e63c6d6a8a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.731616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b533-94dc-4c40-bd0e-18e63c6d6a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.731616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b533-94dc-4c40-bd0e-18e63c6d6a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.731616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9b533-94dc-4c40-bd0e-18e63c6d6a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:42.731616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9b533-94dc-4c40-bd0e-18e63c6d6a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.732244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9b533-94dc-4c40-bd0e-18e63c6d6a8a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.738755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b2970-693c-4299-bcb6-af5d7fe20d8e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.745670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894bd0d-bfb8-495d-9146-9027fdc3a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.753694 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 791/1570] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:42.753840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894bd0d-bfb8-495d-9146-9027fdc3a8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.753840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894bd0d-bfb8-495d-9146-9027fdc3a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.754013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9b533-94dc-4c40-bd0e-18e63c6d6a8a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.754105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894bd0d-bfb8-495d-9146-9027fdc3a8a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.754105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894bd0d-bfb8-495d-9146-9027fdc3a8a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:42.754105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894bd0d-bfb8-495d-9146-9027fdc3a8a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.754105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894bd0d-bfb8-495d-9146-9027fdc3a8a2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.757115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9b533-94dc-4c40-bd0e-18e63c6d6a8a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.762094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b9984-b210-49c5-b169-a11be0cb42d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.762767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b9984-b210-49c5-b169-a11be0cb42d6 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.763081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b9984-b210-49c5-b169-a11be0cb42d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.763367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b9984-b210-49c5-b169-a11be0cb42d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.764006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b9984-b210-49c5-b169-a11be0cb42d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.765337 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 780/1571] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:42.766103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b9984-b210-49c5-b169-a11be0cb42d6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.766251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894bd0d-bfb8-495d-9146-9027fdc3a8a2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.781714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894bd0d-bfb8-495d-9146-9027fdc3a8a2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.787373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a04dc-811b-47f7-a8cf-bb82da3d0075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.788229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a04dc-811b-47f7-a8cf-bb82da3d0075 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.788510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a04dc-811b-47f7-a8cf-bb82da3d0075 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.788798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a04dc-811b-47f7-a8cf-bb82da3d0075 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.789495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a04dc-811b-47f7-a8cf-bb82da3d0075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.791219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a04dc-811b-47f7-a8cf-bb82da3d0075 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.807752 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 781/1572] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:42.807752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a04dc-811b-47f7-a8cf-bb82da3d0075 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.816482 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 792/1573] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:42.816482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b9984-b210-49c5-b169-a11be0cb42d6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.816900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a04dc-811b-47f7-a8cf-bb82da3d0075 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.879222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955535f-7cd2-417b-aa49-b899fa182e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.880156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955535f-7cd2-417b-aa49-b899fa182e1e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.880156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955535f-7cd2-417b-aa49-b899fa182e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.880377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955535f-7cd2-417b-aa49-b899fa182e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.881016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955535f-7cd2-417b-aa49-b899fa182e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.883015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955535f-7cd2-417b-aa49-b899fa182e1e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.883726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b9984-b210-49c5-b169-a11be0cb42d6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.888977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b178-0b10-4b5a-b9f0-2c5d9b2de8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.890293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b178-0b10-4b5a-b9f0-2c5d9b2de8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.890810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b178-0b10-4b5a-b9f0-2c5d9b2de8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.891309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b178-0b10-4b5a-b9f0-2c5d9b2de8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.892441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1b178-0b10-4b5a-b9f0-2c5d9b2de8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.896247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1b178-0b10-4b5a-b9f0-2c5d9b2de8b8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:42.913257 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 782/1574] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:42.914465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955535f-7cd2-417b-aa49-b899fa182e1e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.938459 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 793/1575] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/users => generated 302 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:42.940152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b178-0b10-4b5a-b9f0-2c5d9b2de8b8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:42.958085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b178-0b10-4b5a-b9f0-2c5d9b2de8b8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.985315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955535f-7cd2-417b-aa49-b899fa182e1e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:42.990893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125bc84-5856-46e7-9469-cabaecddd1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:42.991992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bc84-5856-46e7-9469-cabaecddd1ca admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:42.992353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bc84-5856-46e7-9469-cabaecddd1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:42.992886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bc84-5856-46e7-9469-cabaecddd1ca admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:42.993643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125bc84-5856-46e7-9469-cabaecddd1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:42.995631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125bc84-5856-46e7-9469-cabaecddd1ca admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.004623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:43.019495 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 783/1576] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:42 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:43.022734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125bc84-5856-46e7-9469-cabaecddd1ca admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.029253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265605b-1843-4773-a647-c607d110b218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.030033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265605b-1843-4773-a647-c607d110b218 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.030315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265605b-1843-4773-a647-c607d110b218 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.030593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265605b-1843-4773-a647-c607d110b218 admin admin] PATH_INFO: `/v3/projects/3765718bbd5742a09719e57d52b51991/users/7f061ae161984a3d94a83fc55fa36ffa/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.033906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125bc84-5856-46e7-9469-cabaecddd1ca admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.038587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da3020-1fb8-490c-9f98-f70f2fca08a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.039655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3020-1fb8-490c-9f98-f70f2fca08a7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.039655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3020-1fb8-490c-9f98-f70f2fca08a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.039914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3020-1fb8-490c-9f98-f70f2fca08a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.040544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da3020-1fb8-490c-9f98-f70f2fca08a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.042521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da3020-1fb8-490c-9f98-f70f2fca08a7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.046435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265605b-1843-4773-a647-c607d110b218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3765718bbd5742a09719e57d52b51991, user_id=7f061ae161984a3d94a83fc55fa36ffa, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.047401 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-4265605b-1843-4773-a647-c607d110b218 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:25:43.047401 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:25:43.047401 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:25:43.050039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265605b-1843-4773-a647-c607d110b218 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.075707 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 794/1577] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:42 2022] PUT /identity/v3/projects/3765718bbd5742a09719e57d52b51991/users/7f061ae161984a3d94a83fc55fa36ffa/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:43.075707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265605b-1843-4773-a647-c607d110b218 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.087149 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 784/1578] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:43 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:43.087149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da3020-1fb8-490c-9f98-f70f2fca08a7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.089142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:43.146093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265605b-1843-4773-a647-c607d110b218 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.167720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da3020-1fb8-490c-9f98-f70f2fca08a7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.173650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be62cfa-b84a-4009-9894-972a58e5bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.175025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be62cfa-b84a-4009-9894-972a58e5bda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.175435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be62cfa-b84a-4009-9894-972a58e5bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.175711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be62cfa-b84a-4009-9894-972a58e5bda3 admin admin] PATH_INFO: `/v3/projects/3022eb88dd4547738f95767a2bff60c8/users/6b0f2619a2234473bda588435455014e/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.192401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be62cfa-b84a-4009-9894-972a58e5bda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3022eb88dd4547738f95767a2bff60c8, user_id=6b0f2619a2234473bda588435455014e, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.195441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be62cfa-b84a-4009-9894-972a58e5bda3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.210271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c48ace-eda5-4ccd-be0c-ad48559ccedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.210888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c48ace-eda5-4ccd-be0c-ad48559ccedb admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.211053 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 785/1579] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:43 2022] PUT /identity/v3/projects/3022eb88dd4547738f95767a2bff60c8/users/6b0f2619a2234473bda588435455014e/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:43.211198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c48ace-eda5-4ccd-be0c-ad48559ccedb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.220234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c48ace-eda5-4ccd-be0c-ad48559ccedb admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.220373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be62cfa-b84a-4009-9894-972a58e5bda3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.220557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c48ace-eda5-4ccd-be0c-ad48559ccedb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.220557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c48ace-eda5-4ccd-be0c-ad48559ccedb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.248314 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 795/1580] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:43 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:43.250075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c48ace-eda5-4ccd-be0c-ad48559ccedb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.289336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be62cfa-b84a-4009-9894-972a58e5bda3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.326315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:43.335444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c48ace-eda5-4ccd-be0c-ad48559ccedb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.345070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ebf59-534d-457c-b971-a76688d0dad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.346629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ebf59-534d-457c-b971-a76688d0dad5 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.347056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ebf59-534d-457c-b971-a76688d0dad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.347427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ebf59-534d-457c-b971-a76688d0dad5 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.348416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ebf59-534d-457c-b971-a76688d0dad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.350882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ebf59-534d-457c-b971-a76688d0dad5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.368720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12f329-d1f3-4a98-b827-9b39dc9b05d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.369564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f329-d1f3-4a98-b827-9b39dc9b05d4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.370018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f329-d1f3-4a98-b827-9b39dc9b05d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.370463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f329-d1f3-4a98-b827-9b39dc9b05d4 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.371513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12f329-d1f3-4a98-b827-9b39dc9b05d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.374753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12f329-d1f3-4a98-b827-9b39dc9b05d4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.386473 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 796/1581] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:43 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:43.386473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ebf59-534d-457c-b971-a76688d0dad5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.401471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ebf59-534d-457c-b971-a76688d0dad5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.407163 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 786/1582] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:43 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:43.407163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12f329-d1f3-4a98-b827-9b39dc9b05d4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.412955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9bc9a-54c8-4b10-8968-cb0fc314dd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.414573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9bc9a-54c8-4b10-8968-cb0fc314dd2d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.414918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9bc9a-54c8-4b10-8968-cb0fc314dd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.415247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9bc9a-54c8-4b10-8968-cb0fc314dd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.416364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9bc9a-54c8-4b10-8968-cb0fc314dd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.418506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9bc9a-54c8-4b10-8968-cb0fc314dd2d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.419547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12f329-d1f3-4a98-b827-9b39dc9b05d4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.426704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e65ec9-0c53-44fb-a665-46e61689250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.427571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65ec9-0c53-44fb-a665-46e61689250f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.428030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65ec9-0c53-44fb-a665-46e61689250f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.428468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65ec9-0c53-44fb-a665-46e61689250f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.429546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e65ec9-0c53-44fb-a665-46e61689250f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.432274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e65ec9-0c53-44fb-a665-46e61689250f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.433355 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 797/1583] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:43.434674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc37d-e09f-4661-8e5a-102a13932313 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.434951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc37d-e09f-4661-8e5a-102a13932313 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.435222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc37d-e09f-4661-8e5a-102a13932313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.448053 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 787/1584] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:43.449677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e65ec9-0c53-44fb-a665-46e61689250f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.462634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e65ec9-0c53-44fb-a665-46e61689250f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.465979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ac9bc37d-e09f-4661-8e5a-102a13932313 None None] MFA Rules not processed for user `7f061ae161984a3d94a83fc55fa36ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:43.467215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ac9bc37d-e09f-4661-8e5a-102a13932313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:43.467929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7410-6c17-4885-949b-3907562025c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.468643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7410-6c17-4885-949b-3907562025c1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.468998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7410-6c17-4885-949b-3907562025c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.469342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7410-6c17-4885-949b-3907562025c1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.470064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec7410-6c17-4885-949b-3907562025c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.472605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec7410-6c17-4885-949b-3907562025c1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.483253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:43.497946 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 788/1585] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:43 2022] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:43.502842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7add0aa-b2ff-4f37-8262-41fdf399ef97 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.502842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7add0aa-b2ff-4f37-8262-41fdf399ef97 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.502842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7add0aa-b2ff-4f37-8262-41fdf399ef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.530643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a7add0aa-b2ff-4f37-8262-41fdf399ef97 None None] MFA Rules not processed for user `6b0f2619a2234473bda588435455014e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:43.531863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a7add0aa-b2ff-4f37-8262-41fdf399ef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:43.548056 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 798/1586] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:43.548939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bc37d-e09f-4661-8e5a-102a13932313 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.560478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bc37d-e09f-4661-8e5a-102a13932313 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.566293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403827-af05-4c07-b799-ba48f972f66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.566895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403827-af05-4c07-b799-ba48f972f66d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.567174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403827-af05-4c07-b799-ba48f972f66d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.567441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403827-af05-4c07-b799-ba48f972f66d admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.568439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31403827-af05-4c07-b799-ba48f972f66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.570111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31403827-af05-4c07-b799-ba48f972f66d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.593657 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 799/1587] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:43 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:43.594711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403827-af05-4c07-b799-ba48f972f66d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.616411 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 789/1588] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:43.617686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7add0aa-b2ff-4f37-8262-41fdf399ef97 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.619526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403827-af05-4c07-b799-ba48f972f66d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.624931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd66c81-82d1-446a-b019-5ec6738279c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.625606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd66c81-82d1-446a-b019-5ec6738279c9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.625881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd66c81-82d1-446a-b019-5ec6738279c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.626153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd66c81-82d1-446a-b019-5ec6738279c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.626794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd66c81-82d1-446a-b019-5ec6738279c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.628974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd66c81-82d1-446a-b019-5ec6738279c9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.630084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7add0aa-b2ff-4f37-8262-41fdf399ef97 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.636082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e30ee0-8582-47e7-b083-1e6e9f45b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.636704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30ee0-8582-47e7-b083-1e6e9f45b61b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.636983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30ee0-8582-47e7-b083-1e6e9f45b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.637253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30ee0-8582-47e7-b083-1e6e9f45b61b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.637951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e30ee0-8582-47e7-b083-1e6e9f45b61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.639734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e30ee0-8582-47e7-b083-1e6e9f45b61b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.641419 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 800/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:43.642342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd66c81-82d1-446a-b019-5ec6738279c9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.653816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd66c81-82d1-446a-b019-5ec6738279c9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.655890 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 790/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:43.656753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e30ee0-8582-47e7-b083-1e6e9f45b61b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.662902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe389-1fd2-4153-a076-4572de6e8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.663586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe389-1fd2-4153-a076-4572de6e8dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.663862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe389-1fd2-4153-a076-4572de6e8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.664144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe389-1fd2-4153-a076-4572de6e8dcb admin admin] PATH_INFO: `/v3/projects/f755d76557664a26a2fe5eb0a06e5650/users/67ba2ae1d7c7447f9358f787ba30e646/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.667785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e30ee0-8582-47e7-b083-1e6e9f45b61b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.672803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f12a7-c240-4083-bca3-1ea78ed61562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.673439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f12a7-c240-4083-bca3-1ea78ed61562 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.673722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f12a7-c240-4083-bca3-1ea78ed61562 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.674012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f12a7-c240-4083-bca3-1ea78ed61562 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.674658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f12a7-c240-4083-bca3-1ea78ed61562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.676267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f12a7-c240-4083-bca3-1ea78ed61562 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.682316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe389-1fd2-4153-a076-4572de6e8dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f755d76557664a26a2fe5eb0a06e5650, user_id=67ba2ae1d7c7447f9358f787ba30e646, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.685754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe389-1fd2-4153-a076-4572de6e8dcb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.690810 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 791/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:43.690810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f12a7-c240-4083-bca3-1ea78ed61562 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.701116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f12a7-c240-4083-bca3-1ea78ed61562 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.703835 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 801/1592] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:43 2022] PUT /identity/v3/projects/f755d76557664a26a2fe5eb0a06e5650/users/67ba2ae1d7c7447f9358f787ba30e646/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:43.707565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe389-1fd2-4153-a076-4572de6e8dcb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.782864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe389-1fd2-4153-a076-4572de6e8dcb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.791190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f6590-c349-4c47-ba58-5087a5d36a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.791974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6590-c349-4c47-ba58-5087a5d36a8b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.792262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6590-c349-4c47-ba58-5087a5d36a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.792464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d5413-e7cd-4d90-88f3-f22160e63070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.792571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6590-c349-4c47-ba58-5087a5d36a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.793185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f6590-c349-4c47-ba58-5087a5d36a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.793310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d5413-e7cd-4d90-88f3-f22160e63070 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.793627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d5413-e7cd-4d90-88f3-f22160e63070 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.793933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d5413-e7cd-4d90-88f3-f22160e63070 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.794554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d5413-e7cd-4d90-88f3-f22160e63070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.795796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f6590-c349-4c47-ba58-5087a5d36a8b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.796166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d5413-e7cd-4d90-88f3-f22160e63070 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.818439 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 792/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:43.818439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d5413-e7cd-4d90-88f3-f22160e63070 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.818881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:43.829764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d5413-e7cd-4d90-88f3-f22160e63070 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.833769 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 802/1594] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:43 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:43.834628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f6590-c349-4c47-ba58-5087a5d36a8b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.837016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcdf3e-f240-4630-800b-0c4be8e29df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.837824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcdf3e-f240-4630-800b-0c4be8e29df5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.838247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcdf3e-f240-4630-800b-0c4be8e29df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.838894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcdf3e-f240-4630-800b-0c4be8e29df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.839634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcdf3e-f240-4630-800b-0c4be8e29df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.841340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcdf3e-f240-4630-800b-0c4be8e29df5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.853193 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 793/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:43.854111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcdf3e-f240-4630-800b-0c4be8e29df5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.864165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcdf3e-f240-4630-800b-0c4be8e29df5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.912025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f6590-c349-4c47-ba58-5087a5d36a8b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.918335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5d531-8d60-45b0-9a59-c53b31f09812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.919608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5d531-8d60-45b0-9a59-c53b31f09812 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.919784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:43.919940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5d531-8d60-45b0-9a59-c53b31f09812 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.920156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5d531-8d60-45b0-9a59-c53b31f09812 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.921131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5d531-8d60-45b0-9a59-c53b31f09812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.923372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5d531-8d60-45b0-9a59-c53b31f09812 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.936796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaee95b-fa4e-4d3d-bcfa-944c77e26c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:43.937550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee95b-fa4e-4d3d-bcfa-944c77e26c86 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:43.937831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee95b-fa4e-4d3d-bcfa-944c77e26c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:43.938103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee95b-fa4e-4d3d-bcfa-944c77e26c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:43.938797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaee95b-fa4e-4d3d-bcfa-944c77e26c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:43.940977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaee95b-fa4e-4d3d-bcfa-944c77e26c86 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:43.954322 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 794/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:43.956079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaee95b-fa4e-4d3d-bcfa-944c77e26c86 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:43.972436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaee95b-fa4e-4d3d-bcfa-944c77e26c86 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:43.974696 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 803/1597] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:43 2022] POST /identity/v3/projects => generated 399 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:43.975672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5d531-8d60-45b0-9a59-c53b31f09812 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.043881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57297e9-3f37-48af-adb6-4bbafee2155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.044386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57297e9-3f37-48af-adb6-4bbafee2155d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.044665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57297e9-3f37-48af-adb6-4bbafee2155d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.044923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57297e9-3f37-48af-adb6-4bbafee2155d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.045614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57297e9-3f37-48af-adb6-4bbafee2155d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.047223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57297e9-3f37-48af-adb6-4bbafee2155d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.050485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5d531-8d60-45b0-9a59-c53b31f09812 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.058825 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 795/1598] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:44.059047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0b32-b5d0-4314-badb-3a4afd94c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.059923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57297e9-3f37-48af-adb6-4bbafee2155d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.060044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0b32-b5d0-4314-badb-3a4afd94c34d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.060436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0b32-b5d0-4314-badb-3a4afd94c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.060936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0b32-b5d0-4314-badb-3a4afd94c34d admin admin] PATH_INFO: `/v3/projects/c278523c2a634e27ae0459b06e7f391f/users/9220801efd9747099ada3e01b376ff10/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.074491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57297e9-3f37-48af-adb6-4bbafee2155d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.079477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3e543-d165-4ec2-92e4-ab61514af588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.080131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3e543-d165-4ec2-92e4-ab61514af588 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.080408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3e543-d165-4ec2-92e4-ab61514af588 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.080679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3e543-d165-4ec2-92e4-ab61514af588 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.081336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3e543-d165-4ec2-92e4-ab61514af588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.082966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3e543-d165-4ec2-92e4-ab61514af588 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.087049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b0b32-b5d0-4314-badb-3a4afd94c34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c278523c2a634e27ae0459b06e7f391f, user_id=9220801efd9747099ada3e01b376ff10, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.091528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b0b32-b5d0-4314-badb-3a4afd94c34d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.094459 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 796/1599] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:44.098601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3e543-d165-4ec2-92e4-ab61514af588 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.107776 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 804/1600] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:43 2022] PUT /identity/v3/projects/c278523c2a634e27ae0459b06e7f391f/users/9220801efd9747099ada3e01b376ff10/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:44.110747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0b32-b5d0-4314-badb-3a4afd94c34d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.111179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3e543-d165-4ec2-92e4-ab61514af588 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.191909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0b32-b5d0-4314-badb-3a4afd94c34d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.199329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e06969-0a5e-4b9e-be13-fdc9b35372bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.199329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e06969-0a5e-4b9e-be13-fdc9b35372bf admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.199329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e06969-0a5e-4b9e-be13-fdc9b35372bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.199329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e06969-0a5e-4b9e-be13-fdc9b35372bf admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.199952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e06969-0a5e-4b9e-be13-fdc9b35372bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.201483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e06969-0a5e-4b9e-be13-fdc9b35372bf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.204357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a9a71-dd32-433c-879e-dec116f1e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.205334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a9a71-dd32-433c-879e-dec116f1e073 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.205722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a9a71-dd32-433c-879e-dec116f1e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.206114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a9a71-dd32-433c-879e-dec116f1e073 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.206871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a9a71-dd32-433c-879e-dec116f1e073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.209335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a9a71-dd32-433c-879e-dec116f1e073 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.212615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:44.225969 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 797/1601] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:44.227620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a9a71-dd32-433c-879e-dec116f1e073 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.232990 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 805/1602] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:44 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:44.234277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e06969-0a5e-4b9e-be13-fdc9b35372bf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.244792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a9a71-dd32-433c-879e-dec116f1e073 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.250611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e06969-0a5e-4b9e-be13-fdc9b35372bf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.252770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708bf03-22e1-4edd-a9fe-a59e3dfb76e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.253778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708bf03-22e1-4edd-a9fe-a59e3dfb76e5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.254259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708bf03-22e1-4edd-a9fe-a59e3dfb76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.254720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708bf03-22e1-4edd-a9fe-a59e3dfb76e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.255823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708bf03-22e1-4edd-a9fe-a59e3dfb76e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.258689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2958975-ef2b-4160-a3b1-2e6f53ddcd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.258935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708bf03-22e1-4edd-a9fe-a59e3dfb76e5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.259718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2958975-ef2b-4160-a3b1-2e6f53ddcd93 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.260163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2958975-ef2b-4160-a3b1-2e6f53ddcd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.260607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2958975-ef2b-4160-a3b1-2e6f53ddcd93 admin admin] PATH_INFO: `/v3/projects/9860f0c7ea5c4559a6f3cb65e302096d/users/312fc9ed31be4887aace67186e509e8b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.279349 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 798/1603] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:44.279349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708bf03-22e1-4edd-a9fe-a59e3dfb76e5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.283273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2958975-ef2b-4160-a3b1-2e6f53ddcd93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9860f0c7ea5c4559a6f3cb65e302096d, user_id=312fc9ed31be4887aace67186e509e8b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.286013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2958975-ef2b-4160-a3b1-2e6f53ddcd93 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.291119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708bf03-22e1-4edd-a9fe-a59e3dfb76e5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.297522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed582a3a-e528-40d7-98c6-2523e06a64cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.298044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed582a3a-e528-40d7-98c6-2523e06a64cd admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.298368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed582a3a-e528-40d7-98c6-2523e06a64cd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.298709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed582a3a-e528-40d7-98c6-2523e06a64cd admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.299923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed582a3a-e528-40d7-98c6-2523e06a64cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.302005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed582a3a-e528-40d7-98c6-2523e06a64cd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.302183 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 806/1604] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:44 2022] PUT /identity/v3/projects/9860f0c7ea5c4559a6f3cb65e302096d/users/312fc9ed31be4887aace67186e509e8b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:44.302911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2958975-ef2b-4160-a3b1-2e6f53ddcd93 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.326118 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 799/1605] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:44 2022] POST /identity/v3/users => generated 306 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:44.326953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed582a3a-e528-40d7-98c6-2523e06a64cd admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.337768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed582a3a-e528-40d7-98c6-2523e06a64cd admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.375628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:44.379341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2958975-ef2b-4160-a3b1-2e6f53ddcd93 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.391456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c90ced-3ba1-49f9-b77e-41f3a28316ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.392186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c90ced-3ba1-49f9-b77e-41f3a28316ae admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.392470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c90ced-3ba1-49f9-b77e-41f3a28316ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.393299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c90ced-3ba1-49f9-b77e-41f3a28316ae admin admin] PATH_INFO: `/v3/projects/ebba5db9c29a4e3f9886bcf67f676922/users/99004756e4fe4720b121bd4b03949f35/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.408925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393eb9e-1807-4fea-81b6-1cd045524b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.409651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393eb9e-1807-4fea-81b6-1cd045524b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.409933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393eb9e-1807-4fea-81b6-1cd045524b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.410368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393eb9e-1807-4fea-81b6-1cd045524b08 admin admin] PATH_INFO: `/v3/projects/f755d76557664a26a2fe5eb0a06e5650/users/67ba2ae1d7c7447f9358f787ba30e646/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.410565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c90ced-3ba1-49f9-b77e-41f3a28316ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebba5db9c29a4e3f9886bcf67f676922, user_id=99004756e4fe4720b121bd4b03949f35, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.412451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393eb9e-1807-4fea-81b6-1cd045524b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f755d76557664a26a2fe5eb0a06e5650, user_id=67ba2ae1d7c7447f9358f787ba30e646, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.413268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c90ced-3ba1-49f9-b77e-41f3a28316ae admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.415224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393eb9e-1807-4fea-81b6-1cd045524b08 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.427287 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 800/1606] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:44 2022] PUT /identity/v3/projects/f755d76557664a26a2fe5eb0a06e5650/users/67ba2ae1d7c7447f9358f787ba30e646/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:44.428671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b118f94-4add-441c-86a1-493a7a4ea497 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.428965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b118f94-4add-441c-86a1-493a7a4ea497 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.429235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b118f94-4add-441c-86a1-493a7a4ea497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.430773 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 807/1607] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:44 2022] PUT /identity/v3/projects/ebba5db9c29a4e3f9886bcf67f676922/users/99004756e4fe4720b121bd4b03949f35/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:44.431865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c90ced-3ba1-49f9-b77e-41f3a28316ae admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.466828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9b118f94-4add-441c-86a1-493a7a4ea497 None None] MFA Rules not processed for user `9220801efd9747099ada3e01b376ff10`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:44.468060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9b118f94-4add-441c-86a1-493a7a4ea497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:44.548039 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 801/1608] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:44.548039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b118f94-4add-441c-86a1-493a7a4ea497 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.563742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c90ced-3ba1-49f9-b77e-41f3a28316ae admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.568767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfbdd6-9539-46d3-97d1-3c1fa43d8cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.569487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfbdd6-9539-46d3-97d1-3c1fa43d8cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.569832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfbdd6-9539-46d3-97d1-3c1fa43d8cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.570140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfbdd6-9539-46d3-97d1-3c1fa43d8cd2 admin admin] PATH_INFO: `/v3/projects/f98027558a934dc787751a124c825bdd/users/8f08c11a4b41435b8f8d773e78dbcb47/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.598251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfbdd6-9539-46d3-97d1-3c1fa43d8cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98027558a934dc787751a124c825bdd, user_id=8f08c11a4b41435b8f8d773e78dbcb47, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.601076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfbdd6-9539-46d3-97d1-3c1fa43d8cd2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.616995 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 808/1609] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:44 2022] PUT /identity/v3/projects/f98027558a934dc787751a124c825bdd/users/8f08c11a4b41435b8f8d773e78dbcb47/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:44.617993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfbdd6-9539-46d3-97d1-3c1fa43d8cd2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.635409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b118f94-4add-441c-86a1-493a7a4ea497 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.666534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:44.704645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfbdd6-9539-46d3-97d1-3c1fa43d8cd2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.710686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd3a62-fd58-453e-95ed-970e2fabb6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.711372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd3a62-fd58-453e-95ed-970e2fabb6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.711660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd3a62-fd58-453e-95ed-970e2fabb6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.711934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd3a62-fd58-453e-95ed-970e2fabb6ac admin admin] PATH_INFO: `/v3/projects/cbba879822dc45248651e86cd13b3098/users/7d78200d53a3404bab17960100fe4ea2/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.726879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cec922-c031-4f37-960c-dfb612e618ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.727522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cec922-c031-4f37-960c-dfb612e618ad admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.727801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cec922-c031-4f37-960c-dfb612e618ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.728104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cec922-c031-4f37-960c-dfb612e618ad admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.728783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cec922-c031-4f37-960c-dfb612e618ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.730451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cec922-c031-4f37-960c-dfb612e618ad admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.736695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd3a62-fd58-453e-95ed-970e2fabb6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbba879822dc45248651e86cd13b3098, user_id=7d78200d53a3404bab17960100fe4ea2, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.742326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd3a62-fd58-453e-95ed-970e2fabb6ac admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.742525 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 802/1610] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:44.743609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d962330-114d-4635-9995-eaf61611a5bb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.743893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d962330-114d-4635-9995-eaf61611a5bb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.744179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d962330-114d-4635-9995-eaf61611a5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.752724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:44.764383 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 809/1611] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:44 2022] PUT /identity/v3/projects/cbba879822dc45248651e86cd13b3098/users/7d78200d53a3404bab17960100fe4ea2/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:44.766052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd3a62-fd58-453e-95ed-970e2fabb6ac admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:44.781098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4d962330-114d-4635-9995-eaf61611a5bb None None] MFA Rules not processed for user `312fc9ed31be4887aace67186e509e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:44.782615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4d962330-114d-4635-9995-eaf61611a5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:44.855437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd3a62-fd58-453e-95ed-970e2fabb6ac admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:44.860665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860d26d-d78c-496c-9576-5cf66c60046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:44.861289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d26d-d78c-496c-9576-5cf66c60046f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.862113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d26d-d78c-496c-9576-5cf66c60046f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.862385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d26d-d78c-496c-9576-5cf66c60046f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.863034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860d26d-d78c-496c-9576-5cf66c60046f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:44.864646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860d26d-d78c-496c-9576-5cf66c60046f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:44.875804 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 810/1612] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:44.877830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef0d36-7964-4648-913b-ea3f60fbb6e2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.878168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef0d36-7964-4648-913b-ea3f60fbb6e2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.878460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef0d36-7964-4648-913b-ea3f60fbb6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.882962 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 803/1613] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:44.885033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaeae7-13e3-4b7d-a33d-e647e79fff34 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:44.885529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaeae7-13e3-4b7d-a33d-e647e79fff34 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:44.885828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaeae7-13e3-4b7d-a33d-e647e79fff34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:44.913546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c6ef0d36-7964-4648-913b-ea3f60fbb6e2 None None] MFA Rules not processed for user `67ba2ae1d7c7447f9358f787ba30e646`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:44.915039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c6ef0d36-7964-4648-913b-ea3f60fbb6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:44.935650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-43eaeae7-13e3-4b7d-a33d-e647e79fff34 None None] MFA Rules not processed for user `99004756e4fe4720b121bd4b03949f35`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:44.937876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-43eaeae7-13e3-4b7d-a33d-e647e79fff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:45.002713 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 811/1614] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:44 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:45.003599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef0d36-7964-4648-913b-ea3f60fbb6e2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.014489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef0d36-7964-4648-913b-ea3f60fbb6e2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.020163 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 804/1615] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:45.021636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51a502-8ac6-4676-be34-2ad319c028a3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.021927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51a502-8ac6-4676-be34-2ad319c028a3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.022219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51a502-8ac6-4676-be34-2ad319c028a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.024700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1c58-84b2-4ea2-9f03-d7283ba78b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.025689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1c58-84b2-4ea2-9f03-d7283ba78b6b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.025966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1c58-84b2-4ea2-9f03-d7283ba78b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.026406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1c58-84b2-4ea2-9f03-d7283ba78b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.027095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e1c58-84b2-4ea2-9f03-d7283ba78b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.029377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e1c58-84b2-4ea2-9f03-d7283ba78b6b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.056485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2f51a502-8ac6-4676-be34-2ad319c028a3 None None] MFA Rules not processed for user `8f08c11a4b41435b8f8d773e78dbcb47`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:45.057753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2f51a502-8ac6-4676-be34-2ad319c028a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:45.063498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 812/1616] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:45 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:45.066874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1c58-84b2-4ea2-9f03-d7283ba78b6b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.086334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:45.135923 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 805/1617] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:45.138686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1c58-84b2-4ea2-9f03-d7283ba78b6b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.139128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a569-dd87-4427-a48d-3fc53377c0eb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.140293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a569-dd87-4427-a48d-3fc53377c0eb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.141259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a569-dd87-4427-a48d-3fc53377c0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.144529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33188996-e881-463f-845a-e99bdda0d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.145216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33188996-e881-463f-845a-e99bdda0d843 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.145531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33188996-e881-463f-845a-e99bdda0d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.145811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33188996-e881-463f-845a-e99bdda0d843 admin admin] PATH_INFO: `/v3/projects/654ab98aa56a4cdfaabecf590a0ac49b/users/433207cce2e443bd914ffc00e1cf71bb/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.163430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33188996-e881-463f-845a-e99bdda0d843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654ab98aa56a4cdfaabecf590a0ac49b, user_id=433207cce2e443bd914ffc00e1cf71bb, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.169238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33188996-e881-463f-845a-e99bdda0d843 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.171786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:45.181291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-63a4a569-dd87-4427-a48d-3fc53377c0eb None None] MFA Rules not processed for user `7d78200d53a3404bab17960100fe4ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:45.182558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-63a4a569-dd87-4427-a48d-3fc53377c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:45.192539 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 813/1618] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:45 2022] PUT /identity/v3/projects/654ab98aa56a4cdfaabecf590a0ac49b/users/433207cce2e443bd914ffc00e1cf71bb/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:45.194252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33188996-e881-463f-845a-e99bdda0d843 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.260310 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 806/1619] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:45.261589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4a569-dd87-4427-a48d-3fc53377c0eb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.273699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4a569-dd87-4427-a48d-3fc53377c0eb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.273979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33188996-e881-463f-845a-e99bdda0d843 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.279045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a82f4-cba5-4960-94b4-f331dcc4cd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.279743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a82f4-cba5-4960-94b4-f331dcc4cd32 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.280045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a82f4-cba5-4960-94b4-f331dcc4cd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.280395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a82f4-cba5-4960-94b4-f331dcc4cd32 admin admin] PATH_INFO: `/v3/projects/cee3fc2e109248a6877f53eb1dd50efb/users/8a914afbd07f466bba39dd15caeabf7e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.282024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3191c-7529-4356-b0ff-06b5d46584c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.283107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3191c-7529-4356-b0ff-06b5d46584c8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.283537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3191c-7529-4356-b0ff-06b5d46584c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.284027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3191c-7529-4356-b0ff-06b5d46584c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.285234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3191c-7529-4356-b0ff-06b5d46584c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.289067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3191c-7529-4356-b0ff-06b5d46584c8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.297147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a82f4-cba5-4960-94b4-f331dcc4cd32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee3fc2e109248a6877f53eb1dd50efb, user_id=8a914afbd07f466bba39dd15caeabf7e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.300172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a82f4-cba5-4960-94b4-f331dcc4cd32 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.316573 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 814/1620] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:45 2022] PUT /identity/v3/projects/cee3fc2e109248a6877f53eb1dd50efb/users/8a914afbd07f466bba39dd15caeabf7e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:45.317495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a82f4-cba5-4960-94b4-f331dcc4cd32 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.333438 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 807/1621] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:45 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:45.333985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8fa4-102e-4d8a-a37d-40241aef9f9a None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.334550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8fa4-102e-4d8a-a37d-40241aef9f9a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.334884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8fa4-102e-4d8a-a37d-40241aef9f9a None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.336720 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 808/1622] 10.222.0.16 () {54 vars in 962 bytes} [Mon Aug 29 15:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:25:45.337541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d8fa4-102e-4d8a-a37d-40241aef9f9a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.403133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a82f4-cba5-4960-94b4-f331dcc4cd32 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.414893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d8fa4-102e-4d8a-a37d-40241aef9f9a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.420101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500e6d6-29e1-47cc-850a-9ffc5cc271b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.420737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e6d6-29e1-47cc-850a-9ffc5cc271b1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.421018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e6d6-29e1-47cc-850a-9ffc5cc271b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.421293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e6d6-29e1-47cc-850a-9ffc5cc271b1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.422004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500e6d6-29e1-47cc-850a-9ffc5cc271b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.423996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500e6d6-29e1-47cc-850a-9ffc5cc271b1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.441436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:45.450693 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 809/1623] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:45 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:45.450693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500e6d6-29e1-47cc-850a-9ffc5cc271b1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.474327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3c03b-c752-4c2a-b9f5-2a01ca77839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.474959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c03b-c752-4c2a-b9f5-2a01ca77839d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.475240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c03b-c752-4c2a-b9f5-2a01ca77839d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.475516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c03b-c752-4c2a-b9f5-2a01ca77839d admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.476160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3c03b-c752-4c2a-b9f5-2a01ca77839d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.478167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3c03b-c752-4c2a-b9f5-2a01ca77839d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.508338 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 815/1624] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:45 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:45.509286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3c03b-c752-4c2a-b9f5-2a01ca77839d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.511004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500e6d6-29e1-47cc-850a-9ffc5cc271b1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.532186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:45.569123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ff195-1412-4309-82d9-f71ef2b6e24a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.569906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ff195-1412-4309-82d9-f71ef2b6e24a service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.570191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ff195-1412-4309-82d9-f71ef2b6e24a service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.570465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ff195-1412-4309-82d9-f71ef2b6e24a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.578375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3c03b-c752-4c2a-b9f5-2a01ca77839d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.583981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d95c8-d413-42ea-97c2-cb368b8d2548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.584612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d95c8-d413-42ea-97c2-cb368b8d2548 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.584926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d95c8-d413-42ea-97c2-cb368b8d2548 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.585161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d95c8-d413-42ea-97c2-cb368b8d2548 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.585866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d95c8-d413-42ea-97c2-cb368b8d2548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.587488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d95c8-d413-42ea-97c2-cb368b8d2548 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.598475 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 816/1625] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:45.599408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d95c8-d413-42ea-97c2-cb368b8d2548 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.613725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d95c8-d413-42ea-97c2-cb368b8d2548 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.618594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e8521-da55-4f67-9f1e-272392564cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.619241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e8521-da55-4f67-9f1e-272392564cca admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.619523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e8521-da55-4f67-9f1e-272392564cca admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.619802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e8521-da55-4f67-9f1e-272392564cca admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.620453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e8521-da55-4f67-9f1e-272392564cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.622581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e8521-da55-4f67-9f1e-272392564cca admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.640142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ff195-1412-4309-82d9-f71ef2b6e24a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.641906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ff195-1412-4309-82d9-f71ef2b6e24a service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.652848 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 810/1626] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:45.654090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ff195-1412-4309-82d9-f71ef2b6e24a service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.660586 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 817/1627] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:45 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:45.661671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e8521-da55-4f67-9f1e-272392564cca admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.670136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ff195-1412-4309-82d9-f71ef2b6e24a service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.755251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fdc06-364b-498d-aee1-1207da2f16db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.756127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fdc06-364b-498d-aee1-1207da2f16db admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.756409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fdc06-364b-498d-aee1-1207da2f16db admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.756682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fdc06-364b-498d-aee1-1207da2f16db admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.757335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fdc06-364b-498d-aee1-1207da2f16db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.758695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e8521-da55-4f67-9f1e-272392564cca admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.759001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fdc06-364b-498d-aee1-1207da2f16db admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.764644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4c329-a949-452f-a599-e0834470a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.765754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c329-a949-452f-a599-e0834470a311 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.765754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c329-a949-452f-a599-e0834470a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.766086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c329-a949-452f-a599-e0834470a311 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.766772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4c329-a949-452f-a599-e0834470a311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.769541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4c329-a949-452f-a599-e0834470a311 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.776514 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 811/1628] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:45.776514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86684fb-a4fc-47f4-82b3-78a939f9e93e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.776514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86684fb-a4fc-47f4-82b3-78a939f9e93e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.776514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86684fb-a4fc-47f4-82b3-78a939f9e93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.801241 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 818/1629] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:45 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:45.801872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4c329-a949-452f-a599-e0834470a311 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.814122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4c329-a949-452f-a599-e0834470a311 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.819543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da09f99-38fc-41a4-8333-7d605bad6a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.820345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da09f99-38fc-41a4-8333-7d605bad6a11 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.820631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da09f99-38fc-41a4-8333-7d605bad6a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.820926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da09f99-38fc-41a4-8333-7d605bad6a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.821626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da09f99-38fc-41a4-8333-7d605bad6a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.824510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da09f99-38fc-41a4-8333-7d605bad6a11 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.827516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b86684fb-a4fc-47f4-82b3-78a939f9e93e None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:45.828785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b86684fb-a4fc-47f4-82b3-78a939f9e93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:45.840477 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 819/1630] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:45.844302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da09f99-38fc-41a4-8333-7d605bad6a11 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.856511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da09f99-38fc-41a4-8333-7d605bad6a11 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.862157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1250665-1b97-4c2d-967a-d8b739ecfe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.862921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1250665-1b97-4c2d-967a-d8b739ecfe2e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.863231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1250665-1b97-4c2d-967a-d8b739ecfe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.863544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1250665-1b97-4c2d-967a-d8b739ecfe2e admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.864230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1250665-1b97-4c2d-967a-d8b739ecfe2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.866271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1250665-1b97-4c2d-967a-d8b739ecfe2e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.876107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:45.899236 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 820/1631] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:45 2022] POST /identity/v3/users => generated 298 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:45.900442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1250665-1b97-4c2d-967a-d8b739ecfe2e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.913809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1250665-1b97-4c2d-967a-d8b739ecfe2e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:45.918943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9af2d2-5bfc-4e68-9bf4-6e899acc2c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:45.919827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af2d2-5bfc-4e68-9bf4-6e899acc2c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:45.920104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af2d2-5bfc-4e68-9bf4-6e899acc2c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:45.920375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9af2d2-5bfc-4e68-9bf4-6e899acc2c73 admin admin] PATH_INFO: `/v3/projects/654ab98aa56a4cdfaabecf590a0ac49b/users/433207cce2e443bd914ffc00e1cf71bb/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:45.920476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:45.923775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9af2d2-5bfc-4e68-9bf4-6e899acc2c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654ab98aa56a4cdfaabecf590a0ac49b, user_id=433207cce2e443bd914ffc00e1cf71bb, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:45.927562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9af2d2-5bfc-4e68-9bf4-6e899acc2c73 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:45.940828 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 821/1632] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:45 2022] PUT /identity/v3/projects/654ab98aa56a4cdfaabecf590a0ac49b/users/433207cce2e443bd914ffc00e1cf71bb/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:45.941930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9af2d2-5bfc-4e68-9bf4-6e899acc2c73 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.944754 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 812/1633] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Aug 29 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:45.945853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86684fb-a4fc-47f4-82b3-78a939f9e93e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:45.961630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86684fb-a4fc-47f4-82b3-78a939f9e93e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.040421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007979cd-86ec-40d4-8b9c-f80aa1433065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.041333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007979cd-86ec-40d4-8b9c-f80aa1433065 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.042374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007979cd-86ec-40d4-8b9c-f80aa1433065 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.042673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007979cd-86ec-40d4-8b9c-f80aa1433065 admin admin] PATH_INFO: `/v3/projects/cee3fc2e109248a6877f53eb1dd50efb/users/8a914afbd07f466bba39dd15caeabf7e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.045135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007979cd-86ec-40d4-8b9c-f80aa1433065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee3fc2e109248a6877f53eb1dd50efb, user_id=8a914afbd07f466bba39dd15caeabf7e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.049694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007979cd-86ec-40d4-8b9c-f80aa1433065 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:46.066426 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 813/1634] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:45 2022] PUT /identity/v3/projects/cee3fc2e109248a6877f53eb1dd50efb/users/8a914afbd07f466bba39dd15caeabf7e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:46.066632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9af2d2-5bfc-4e68-9bf4-6e899acc2c73 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.066714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007979cd-86ec-40d4-8b9c-f80aa1433065 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:46.147359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007979cd-86ec-40d4-8b9c-f80aa1433065 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.154846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b02f-a320-45d1-90cd-cd74d6a0bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.156018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b02f-a320-45d1-90cd-cd74d6a0bacd admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.156607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b02f-a320-45d1-90cd-cd74d6a0bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.157350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b02f-a320-45d1-90cd-cd74d6a0bacd admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.159665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864b02f-a320-45d1-90cd-cd74d6a0bacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.163290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864b02f-a320-45d1-90cd-cd74d6a0bacd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:46.177862 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 814/1635] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:46.179055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b02f-a320-45d1-90cd-cd74d6a0bacd admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:46.183642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29179-e250-4759-88e6-30b2c9aebf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.184691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29179-e250-4759-88e6-30b2c9aebf8a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.185031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29179-e250-4759-88e6-30b2c9aebf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.185371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29179-e250-4759-88e6-30b2c9aebf8a admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.186129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d29179-e250-4759-88e6-30b2c9aebf8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.188345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d29179-e250-4759-88e6-30b2c9aebf8a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:46.191945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b02f-a320-45d1-90cd-cd74d6a0bacd admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.197022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2ab2-7dcb-46f8-bd51-5bf287a5cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.197756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2ab2-7dcb-46f8-bd51-5bf287a5cb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.198091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2ab2-7dcb-46f8-bd51-5bf287a5cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.198321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2ab2-7dcb-46f8-bd51-5bf287a5cb8b admin admin] PATH_INFO: `/v3/projects/f94f5e1f77554fab82090bde2789ee20/users/6f8caa545331476aa9c70ca67ab41123/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.217439 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 822/1636] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:45 2022] POST /identity/v3/users => generated 295 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:46.217751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29179-e250-4759-88e6-30b2c9aebf8a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:46.218306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac2ab2-7dcb-46f8-bd51-5bf287a5cb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94f5e1f77554fab82090bde2789ee20, user_id=6f8caa545331476aa9c70ca67ab41123, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.222735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac2ab2-7dcb-46f8-bd51-5bf287a5cb8b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:46.232579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29179-e250-4759-88e6-30b2c9aebf8a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.243851 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 815/1637] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:46 2022] PUT /identity/v3/projects/f94f5e1f77554fab82090bde2789ee20/users/6f8caa545331476aa9c70ca67ab41123/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:46.246069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98db48-6771-4427-8edf-03ce1086be01 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.246562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98db48-6771-4427-8edf-03ce1086be01 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.247038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98db48-6771-4427-8edf-03ce1086be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.291700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3f98db48-6771-4427-8edf-03ce1086be01 None None] MFA Rules not processed for user `433207cce2e443bd914ffc00e1cf71bb`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:46.294211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3f98db48-6771-4427-8edf-03ce1086be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:46.349677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039f136-dcbc-464f-bc20-cc864e73a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.350664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039f136-dcbc-464f-bc20-cc864e73a52a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.351487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039f136-dcbc-464f-bc20-cc864e73a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.351898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039f136-dcbc-464f-bc20-cc864e73a52a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.353196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039f136-dcbc-464f-bc20-cc864e73a52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.355800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039f136-dcbc-464f-bc20-cc864e73a52a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:46.371948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:46.372594 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 823/1638] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:46.373856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039f136-dcbc-464f-bc20-cc864e73a52a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:46.394561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:46.416476 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 816/1639] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:46.418000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7263ca-2ed8-40da-8a9e-523f08b41c4b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.418351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7263ca-2ed8-40da-8a9e-523f08b41c4b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.418686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7263ca-2ed8-40da-8a9e-523f08b41c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.454371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3a7263ca-2ed8-40da-8a9e-523f08b41c4b None None] MFA Rules not processed for user `8a914afbd07f466bba39dd15caeabf7e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:46.457375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3a7263ca-2ed8-40da-8a9e-523f08b41c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:46.487799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039f136-dcbc-464f-bc20-cc864e73a52a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.495033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc080928-6957-4b52-8a3c-c6525da57c0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.496085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc080928-6957-4b52-8a3c-c6525da57c0a service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.496427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc080928-6957-4b52-8a3c-c6525da57c0a service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.496852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc080928-6957-4b52-8a3c-c6525da57c0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.557380 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 817/1640] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:46.558767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7263ca-2ed8-40da-8a9e-523f08b41c4b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:46.575305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7263ca-2ed8-40da-8a9e-523f08b41c4b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.583833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.584815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.585188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.585685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] PATH_INFO: `/v3/users/8f08c11a4b41435b8f8d773e78dbcb47` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.587463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f08c11a4b41435b8f8d773e78dbcb47)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.591003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:46.606351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc080928-6957-4b52-8a3c-c6525da57c0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.609616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc080928-6957-4b52-8a3c-c6525da57c0a service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:46.627869 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 824/1641] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:46.628792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc080928-6957-4b52-8a3c-c6525da57c0a service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:46.643499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc080928-6957-4b52-8a3c-c6525da57c0a service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.650175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f08c11a4b41435b8f8d773e78dbcb47'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:46.651480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f08c11a4b41435b8f8d773e78dbcb47'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:46.652056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1c976-fbf6-4ec6-baff-db4a31cb3d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.653158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c976-fbf6-4ec6-baff-db4a31cb3d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.653946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c976-fbf6-4ec6-baff-db4a31cb3d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.654448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1c976-fbf6-4ec6-baff-db4a31cb3d4c admin admin] PATH_INFO: `/v3/projects/468642093df54da786b144ad54230998/users/a6ae298f903f422ab6fc0595460bbdf1/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.670195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f08c11a4b41435b8f8d773e78dbcb47'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:46.671107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f08c11a4b41435b8f8d773e78dbcb47'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:46.680723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1c976-fbf6-4ec6-baff-db4a31cb3d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=468642093df54da786b144ad54230998, user_id=a6ae298f903f422ab6fc0595460bbdf1, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.683812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1c976-fbf6-4ec6-baff-db4a31cb3d4c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:46.684097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f08c11a4b41435b8f8d773e78dbcb47'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:46.700825 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 825/1642] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:46 2022] PUT /identity/v3/projects/468642093df54da786b144ad54230998/users/a6ae298f903f422ab6fc0595460bbdf1/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:46.704594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1c976-fbf6-4ec6-baff-db4a31cb3d4c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:46.706578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bce1c976-fbf6-4ec6-baff-db4a31cb3d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:46.708597 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 818/1643] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:46 2022] DELETE /identity/v3/users/8f08c11a4b41435b8f8d773e78dbcb47 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:46.710527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:46.713027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:46.780869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:46.787165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1c976-fbf6-4ec6-baff-db4a31cb3d4c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.809040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757667-5f6d-4cca-abcc-4969effe2463 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.815518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:46.815735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceafc24-7bec-4fe1-a2cc-dfce0d018f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.816870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceafc24-7bec-4fe1-a2cc-dfce0d018f82 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.817230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceafc24-7bec-4fe1-a2cc-dfce0d018f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.817531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceafc24-7bec-4fe1-a2cc-dfce0d018f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.818322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceafc24-7bec-4fe1-a2cc-dfce0d018f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.821186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceafc24-7bec-4fe1-a2cc-dfce0d018f82 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:46.837954 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 819/1644] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:46.837954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceafc24-7bec-4fe1-a2cc-dfce0d018f82 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:46.837954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2ceafc24-7bec-4fe1-a2cc-dfce0d018f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:46.852386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceafc24-7bec-4fe1-a2cc-dfce0d018f82 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.858186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a739e6-96ab-4253-ab8b-ca83b2afbfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.858907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a739e6-96ab-4253-ab8b-ca83b2afbfb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.859314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a739e6-96ab-4253-ab8b-ca83b2afbfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.859540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a739e6-96ab-4253-ab8b-ca83b2afbfb8 admin admin] PATH_INFO: `/v3/projects/560b137dccba444286393c266e4ac846/users/cd94d3ec96c74b309f3801527d7455ef/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.860837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b51a5-b80b-408e-acac-5d5699df1e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.862145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b51a5-b80b-408e-acac-5d5699df1e21 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.862523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b51a5-b80b-408e-acac-5d5699df1e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.862810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b51a5-b80b-408e-acac-5d5699df1e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.863558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b51a5-b80b-408e-acac-5d5699df1e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.865347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b51a5-b80b-408e-acac-5d5699df1e21 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:46.877978 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 826/1645] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:46.879371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367edbd-000f-456e-bb1e-8baa3d4289e7 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.879663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367edbd-000f-456e-bb1e-8baa3d4289e7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.879942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367edbd-000f-456e-bb1e-8baa3d4289e7 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.881581 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 827/1646] 10.222.0.16 () {54 vars in 962 bytes} [Mon Aug 29 15:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:25:46.884995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a739e6-96ab-4253-ab8b-ca83b2afbfb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560b137dccba444286393c266e4ac846, user_id=cd94d3ec96c74b309f3801527d7455ef, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.887144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367edbd-000f-456e-bb1e-8baa3d4289e7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:46.888309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a739e6-96ab-4253-ab8b-ca83b2afbfb8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:46.888981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0367edbd-000f-456e-bb1e-8baa3d4289e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:46.907071 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 820/1647] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:46 2022] PUT /identity/v3/projects/560b137dccba444286393c266e4ac846/users/cd94d3ec96c74b309f3801527d7455ef/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:46.907217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367edbd-000f-456e-bb1e-8baa3d4289e7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:46.908778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b47e-1c87-4e20-b270-30264bfc0a04 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.909063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b47e-1c87-4e20-b270-30264bfc0a04 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.909426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b47e-1c87-4e20-b270-30264bfc0a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.937571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-36d8b47e-1c87-4e20-b270-30264bfc0a04 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:46.939592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-36d8b47e-1c87-4e20-b270-30264bfc0a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:46.992887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac014e34-b3da-4a8d-a198-e0b1252ef05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:46.993604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac014e34-b3da-4a8d-a198-e0b1252ef05a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:46.993890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac014e34-b3da-4a8d-a198-e0b1252ef05a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:46.994184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac014e34-b3da-4a8d-a198-e0b1252ef05a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:46.994919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac014e34-b3da-4a8d-a198-e0b1252ef05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:46.996822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac014e34-b3da-4a8d-a198-e0b1252ef05a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:47.008088 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 828/1648] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:47.010440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac014e34-b3da-4a8d-a198-e0b1252ef05a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.012359 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 821/1649] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:47.013364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8b47e-1c87-4e20-b270-30264bfc0a04 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.025813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac014e34-b3da-4a8d-a198-e0b1252ef05a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:47.028241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8b47e-1c87-4e20-b270-30264bfc0a04 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:47.032152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dca71-4565-4373-8dbc-b0f196ab36a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:47.032807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dca71-4565-4373-8dbc-b0f196ab36a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.033141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dca71-4565-4373-8dbc-b0f196ab36a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.034018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dca71-4565-4373-8dbc-b0f196ab36a2 admin admin] PATH_INFO: `/v3/projects/f94f5e1f77554fab82090bde2789ee20/users/6f8caa545331476aa9c70ca67ab41123/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.036402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dca71-4565-4373-8dbc-b0f196ab36a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94f5e1f77554fab82090bde2789ee20, user_id=6f8caa545331476aa9c70ca67ab41123, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:47.037249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d822068-b35a-41f8-9e66-a03a87cf959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:47.038180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822068-b35a-41f8-9e66-a03a87cf959b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.038373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822068-b35a-41f8-9e66-a03a87cf959b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.038662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822068-b35a-41f8-9e66-a03a87cf959b admin admin] PATH_INFO: `/v3/projects/2aab5fe07c7f42b29724121b6ba805d0/users/0f9714332bd4429bbc98fac1b1ea077e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.039887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dca71-4565-4373-8dbc-b0f196ab36a2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:47.052657 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 829/1650] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:47 2022] PUT /identity/v3/projects/f94f5e1f77554fab82090bde2789ee20/users/6f8caa545331476aa9c70ca67ab41123/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:47.054227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d7f99-056b-41aa-b72b-384010aa4609 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.054343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d7f99-056b-41aa-b72b-384010aa4609 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.054962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d7f99-056b-41aa-b72b-384010aa4609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.063061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d822068-b35a-41f8-9e66-a03a87cf959b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aab5fe07c7f42b29724121b6ba805d0, user_id=0f9714332bd4429bbc98fac1b1ea077e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:47.066845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d822068-b35a-41f8-9e66-a03a87cf959b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:47.083217 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 822/1651] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:47 2022] PUT /identity/v3/projects/2aab5fe07c7f42b29724121b6ba805d0/users/0f9714332bd4429bbc98fac1b1ea077e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:47.084343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d822068-b35a-41f8-9e66-a03a87cf959b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.090871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0b3d7f99-056b-41aa-b72b-384010aa4609 None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:47.092058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0b3d7f99-056b-41aa-b72b-384010aa4609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:47.167749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d822068-b35a-41f8-9e66-a03a87cf959b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:47.176300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e412-0cbb-46db-9750-985a61131cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:47.176924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e412-0cbb-46db-9750-985a61131cca admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.177204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e412-0cbb-46db-9750-985a61131cca admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.177550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e412-0cbb-46db-9750-985a61131cca admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.178169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077e412-0cbb-46db-9750-985a61131cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:47.179812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077e412-0cbb-46db-9750-985a61131cca admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:47.187021 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 830/1652] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Aug 29 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:47.188016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d7f99-056b-41aa-b72b-384010aa4609 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.190407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0b3d7f99-056b-41aa-b72b-384010aa4609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:47.196420 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 823/1653] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:47.196420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e412-0cbb-46db-9750-985a61131cca admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.206922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e412-0cbb-46db-9750-985a61131cca admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:47.207498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d7f99-056b-41aa-b72b-384010aa4609 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:47.211956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e3fdd-02cf-4746-8bf1-53b797c2a6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:47.212631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e3fdd-02cf-4746-8bf1-53b797c2a6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.212906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e3fdd-02cf-4746-8bf1-53b797c2a6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.213205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e3fdd-02cf-4746-8bf1-53b797c2a6cc admin admin] PATH_INFO: `/v3/projects/468642093df54da786b144ad54230998/users/a6ae298f903f422ab6fc0595460bbdf1/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.215857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e3fdd-02cf-4746-8bf1-53b797c2a6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=468642093df54da786b144ad54230998, user_id=a6ae298f903f422ab6fc0595460bbdf1, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:47.216709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285b521-52f0-4472-8049-6f1cd44f7306 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:47.217350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285b521-52f0-4472-8049-6f1cd44f7306 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.217662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285b521-52f0-4472-8049-6f1cd44f7306 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.217937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285b521-52f0-4472-8049-6f1cd44f7306 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.219783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3285b521-52f0-4472-8049-6f1cd44f7306 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:47.221605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e3fdd-02cf-4746-8bf1-53b797c2a6cc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:47.233841 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 824/1654] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:47 2022] PUT /identity/v3/projects/468642093df54da786b144ad54230998/users/a6ae298f903f422ab6fc0595460bbdf1/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:47.234682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e3fdd-02cf-4746-8bf1-53b797c2a6cc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.236879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2c8e3fdd-02cf-4746-8bf1-53b797c2a6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:47.252787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:47.261307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:47.291858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285b521-52f0-4472-8049-6f1cd44f7306 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:47.293559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285b521-52f0-4472-8049-6f1cd44f7306 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:47.301519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e3fdd-02cf-4746-8bf1-53b797c2a6cc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:47.304130 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 831/1655] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:47 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:47.305205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fa953-379f-4b50-b1ff-86bf6ae4a3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:47.305638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044227a-c155-40ae-8992-813ecc5fd3ee None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.305744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044227a-c155-40ae-8992-813ecc5fd3ee None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.305909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa953-379f-4b50-b1ff-86bf6ae4a3ab service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.306000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044227a-c155-40ae-8992-813ecc5fd3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.306181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa953-379f-4b50-b1ff-86bf6ae4a3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.306401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa953-379f-4b50-b1ff-86bf6ae4a3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.335451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5044227a-c155-40ae-8992-813ecc5fd3ee None None] MFA Rules not processed for user `6f8caa545331476aa9c70ca67ab41123`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:47.336674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5044227a-c155-40ae-8992-813ecc5fd3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:47.394061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fa953-379f-4b50-b1ff-86bf6ae4a3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:47.395508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fa953-379f-4b50-b1ff-86bf6ae4a3ab service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:47.406072 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 825/1656] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:47.414739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fa953-379f-4b50-b1ff-86bf6ae4a3ab service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.431518 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 832/1657] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:47.433186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044227a-c155-40ae-8992-813ecc5fd3ee None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.433314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fa953-379f-4b50-b1ff-86bf6ae4a3ab service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:47.441733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2992-2b47-4025-b23b-d907fbda7f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:47.442702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2992-2b47-4025-b23b-d907fbda7f79 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.442997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2992-2b47-4025-b23b-d907fbda7f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.443270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2992-2b47-4025-b23b-d907fbda7f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.444029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c2992-2b47-4025-b23b-d907fbda7f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:47.446007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c2992-2b47-4025-b23b-d907fbda7f79 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:47.463825 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 826/1658] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:47.468138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2992-2b47-4025-b23b-d907fbda7f79 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.478068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2992-2b47-4025-b23b-d907fbda7f79 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:47.486419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937404b-d9d5-4549-a33b-bcd22540e97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:47.488185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937404b-d9d5-4549-a33b-bcd22540e97f admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.488692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937404b-d9d5-4549-a33b-bcd22540e97f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.489281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937404b-d9d5-4549-a33b-bcd22540e97f admin admin] PATH_INFO: `/v3/projects/560b137dccba444286393c266e4ac846/users/cd94d3ec96c74b309f3801527d7455ef/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.491992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937404b-d9d5-4549-a33b-bcd22540e97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=560b137dccba444286393c266e4ac846, user_id=cd94d3ec96c74b309f3801527d7455ef, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:47.498883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937404b-d9d5-4549-a33b-bcd22540e97f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:47.527556 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 827/1659] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:47 2022] PUT /identity/v3/projects/560b137dccba444286393c266e4ac846/users/cd94d3ec96c74b309f3801527d7455ef/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:47.529727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30c59e-73ef-49ea-9643-f10ad7895ead None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.530072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30c59e-73ef-49ea-9643-f10ad7895ead None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.530445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30c59e-73ef-49ea-9643-f10ad7895ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.579740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fe30c59e-73ef-49ea-9643-f10ad7895ead None None] MFA Rules not processed for user `a6ae298f903f422ab6fc0595460bbdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:47.581006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fe30c59e-73ef-49ea-9643-f10ad7895ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:47.593059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044227a-c155-40ae-8992-813ecc5fd3ee None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:47.659355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:47.677890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b4e23-d9f1-42ac-9379-1e2713ddfbd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:47.679182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4e23-d9f1-42ac-9379-1e2713ddfbd6 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.679182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4e23-d9f1-42ac-9379-1e2713ddfbd6 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.679182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4e23-d9f1-42ac-9379-1e2713ddfbd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.681606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db9b4e23-d9f1-42ac-9379-1e2713ddfbd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:47.693752 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 828/1660] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:47.695465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30c59e-73ef-49ea-9643-f10ad7895ead None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.731304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:47.768548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b4e23-d9f1-42ac-9379-1e2713ddfbd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:47.770210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b4e23-d9f1-42ac-9379-1e2713ddfbd6 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:47.777891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30c59e-73ef-49ea-9643-f10ad7895ead None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:47.784826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806854-ab1b-48f8-ad90-edd4e0cb1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:47.785562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806854-ab1b-48f8-ad90-edd4e0cb1c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.785730 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 833/1661] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:47.785833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806854-ab1b-48f8-ad90-edd4e0cb1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.786065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806854-ab1b-48f8-ad90-edd4e0cb1c7f admin admin] PATH_INFO: `/v3/projects/2aab5fe07c7f42b29724121b6ba805d0/users/0f9714332bd4429bbc98fac1b1ea077e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.788055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb3121-d01e-4fe3-a972-2875798ac65d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.788176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52806854-ab1b-48f8-ad90-edd4e0cb1c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aab5fe07c7f42b29724121b6ba805d0, user_id=0f9714332bd4429bbc98fac1b1ea077e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:47.788521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb3121-d01e-4fe3-a972-2875798ac65d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.788897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb3121-d01e-4fe3-a972-2875798ac65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:47.791529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52806854-ab1b-48f8-ad90-edd4e0cb1c7f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:47.821668 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 829/1662] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:47 2022] PUT /identity/v3/projects/2aab5fe07c7f42b29724121b6ba805d0/users/0f9714332bd4429bbc98fac1b1ea077e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:47.823626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806854-ab1b-48f8-ad90-edd4e0cb1c7f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.832143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-86bb3121-d01e-4fe3-a972-2875798ac65d None None] MFA Rules not processed for user `cd94d3ec96c74b309f3801527d7455ef`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:47.834084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-86bb3121-d01e-4fe3-a972-2875798ac65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:47.933572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806854-ab1b-48f8-ad90-edd4e0cb1c7f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:47.935549 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 834/1663] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:47.936338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb3121-d01e-4fe3-a972-2875798ac65d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:47.937838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-86bb3121-d01e-4fe3-a972-2875798ac65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:47.945237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7907d03-c6e9-4568-bf39-ffa23b5e3c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:47.947662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7907d03-c6e9-4568-bf39-ffa23b5e3c7e service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:47.947662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7907d03-c6e9-4568-bf39-ffa23b5e3c7e service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:47.947662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7907d03-c6e9-4568-bf39-ffa23b5e3c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.015724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb3121-d01e-4fe3-a972-2875798ac65d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.020814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.021575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.021953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.022494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] PATH_INFO: `/v3/projects/f98027558a934dc787751a124c825bdd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.024157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98027558a934dc787751a124c825bdd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.026400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.045651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:48.059971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7907d03-c6e9-4568-bf39-ffa23b5e3c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.061981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7907d03-c6e9-4568-bf39-ffa23b5e3c7e service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.073705 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 830/1664] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:48.074869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda5208-ddb5-4d4d-aa2f-5f27e10da0b8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.075218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda5208-ddb5-4d4d-aa2f-5f27e10da0b8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.075546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda5208-ddb5-4d4d-aa2f-5f27e10da0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.096380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98027558a934dc787751a124c825bdd', 'request_id': 'req-b87ea06b-6570-4c77-97f5-2e1af9097a2a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:48.103446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98027558a934dc787751a124c825bdd', 'request_id': 'req-b87ea06b-6570-4c77-97f5-2e1af9097a2a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:48.113606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1fda5208-ddb5-4d4d-aa2f-5f27e10da0b8 None None] MFA Rules not processed for user `0f9714332bd4429bbc98fac1b1ea077e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:48.114373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98027558a934dc787751a124c825bdd', 'request_id': 'req-b87ea06b-6570-4c77-97f5-2e1af9097a2a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:48.115074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1fda5208-ddb5-4d4d-aa2f-5f27e10da0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:48.137564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] The token cache is being invalidate because project f98027558a934dc787751a124c825bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:48.137870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:48.138624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b87ea06b-6570-4c77-97f5-2e1af9097a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:48.141192 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 835/1665] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:47 2022] DELETE /identity/v3/projects/f98027558a934dc787751a124c825bdd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:48.159166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ce9ca-2171-43f4-b2d5-a0c0924dea57 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.160170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ce9ca-2171-43f4-b2d5-a0c0924dea57 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.160652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ce9ca-2171-43f4-b2d5-a0c0924dea57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.182915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:48.186202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-127ce9ca-2171-43f4-b2d5-a0c0924dea57 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:48.188157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-127ce9ca-2171-43f4-b2d5-a0c0924dea57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:48.225833 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 831/1666] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:48.226653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda5208-ddb5-4d4d-aa2f-5f27e10da0b8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.228100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1fda5208-ddb5-4d4d-aa2f-5f27e10da0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:48.266541 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 836/1667] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:25:48.268102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e6686-f151-462d-afb9-a02109622abb None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.268393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e6686-f151-462d-afb9-a02109622abb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.268662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e6686-f151-462d-afb9-a02109622abb None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.270447 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 837/1668] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:25:48.276703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064e2fa-5c5b-4ed4-ad41-714093c94cde None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.276993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064e2fa-5c5b-4ed4-ad41-714093c94cde None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.277289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064e2fa-5c5b-4ed4-ad41-714093c94cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.298223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f064e2fa-5c5b-4ed4-ad41-714093c94cde None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:48.300029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f064e2fa-5c5b-4ed4-ad41-714093c94cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:48.311731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda5208-ddb5-4d4d-aa2f-5f27e10da0b8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.317628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee904-d4bd-456e-b559-245d573c0877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.318341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee904-d4bd-456e-b559-245d573c0877 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.318615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee904-d4bd-456e-b559-245d573c0877 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.318893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee904-d4bd-456e-b559-245d573c0877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.320709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8efee904-d4bd-456e-b559-245d573c0877 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:48.370853 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 838/1669] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:48.372141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb7cf0-763a-4f01-8bfd-c0bb10d3ad82 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.372429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb7cf0-763a-4f01-8bfd-c0bb10d3ad82 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.372725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb7cf0-763a-4f01-8bfd-c0bb10d3ad82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.393015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efee904-d4bd-456e-b559-245d573c0877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.393890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-05cb7cf0-763a-4f01-8bfd-c0bb10d3ad82 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:48.394698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efee904-d4bd-456e-b559-245d573c0877 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.395595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-05cb7cf0-763a-4f01-8bfd-c0bb10d3ad82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:48.404306 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 839/1670] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:48.406678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb7cf0-763a-4f01-8bfd-c0bb10d3ad82 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.409041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-05cb7cf0-763a-4f01-8bfd-c0bb10d3ad82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:48.409565 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 832/1671] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:48.410677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee904-d4bd-456e-b559-245d573c0877 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.426239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee904-d4bd-456e-b559-245d573c0877 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.426629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb7cf0-763a-4f01-8bfd-c0bb10d3ad82 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.432353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f705b-268a-43b6-885f-929d11a2faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.432549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586bea9-c2d8-4b03-b73a-30b753ff488c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.433329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586bea9-c2d8-4b03-b73a-30b753ff488c service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.433602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f705b-268a-43b6-885f-929d11a2faf0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.433711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586bea9-c2d8-4b03-b73a-30b753ff488c service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.433911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586bea9-c2d8-4b03-b73a-30b753ff488c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.434231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f705b-268a-43b6-885f-929d11a2faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.435179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f705b-268a-43b6-885f-929d11a2faf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.435954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f705b-268a-43b6-885f-929d11a2faf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:48.436302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f705b-268a-43b6-885f-929d11a2faf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.437929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f705b-268a-43b6-885f-929d11a2faf0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.450332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586bea9-c2d8-4b03-b73a-30b753ff488c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.452048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586bea9-c2d8-4b03-b73a-30b753ff488c service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.452656 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 833/1672] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:48.456722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f705b-268a-43b6-885f-929d11a2faf0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.472408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f705b-268a-43b6-885f-929d11a2faf0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.474548 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 840/1673] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:25:48.475407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586bea9-c2d8-4b03-b73a-30b753ff488c service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.478502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8af3af-8457-4af7-a62d-0f9d63a10033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.479066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af3af-8457-4af7-a62d-0f9d63a10033 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.479351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af3af-8457-4af7-a62d-0f9d63a10033 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.479630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af3af-8457-4af7-a62d-0f9d63a10033 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.480285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8af3af-8457-4af7-a62d-0f9d63a10033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.482337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8af3af-8457-4af7-a62d-0f9d63a10033 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.488795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586bea9-c2d8-4b03-b73a-30b753ff488c service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.496685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e93b-3690-434f-890c-e8eabe931874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.497318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e93b-3690-434f-890c-e8eabe931874 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.497627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e93b-3690-434f-890c-e8eabe931874 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.497932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e93b-3690-434f-890c-e8eabe931874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.504689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6250e93b-3690-434f-890c-e8eabe931874 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:48.523456 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 834/1674] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:48 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:25:48.528067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8af3af-8457-4af7-a62d-0f9d63a10033 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.528407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:48.577766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:48.590248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250e93b-3690-434f-890c-e8eabe931874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.591866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250e93b-3690-434f-890c-e8eabe931874 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.603293 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 841/1675] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:48.612454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8af3af-8457-4af7-a62d-0f9d63a10033 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.617211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05f287-eae3-4757-accc-b70e05ac3c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.617873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05f287-eae3-4757-accc-b70e05ac3c13 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.618149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05f287-eae3-4757-accc-b70e05ac3c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.618413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05f287-eae3-4757-accc-b70e05ac3c13 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.619046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05f287-eae3-4757-accc-b70e05ac3c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.621623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05f287-eae3-4757-accc-b70e05ac3c13 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.645084 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 835/1676] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:48 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:48.649106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e93b-3690-434f-890c-e8eabe931874 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.665527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05f287-eae3-4757-accc-b70e05ac3c13 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.677765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e93b-3690-434f-890c-e8eabe931874 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.683215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68caf9-8a5a-458f-bdad-138e4547673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.689768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68caf9-8a5a-458f-bdad-138e4547673b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.689768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68caf9-8a5a-458f-bdad-138e4547673b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.689768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68caf9-8a5a-458f-bdad-138e4547673b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.689768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68caf9-8a5a-458f-bdad-138e4547673b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.689768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68caf9-8a5a-458f-bdad-138e4547673b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.701212 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 842/1677] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:48.702424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68caf9-8a5a-458f-bdad-138e4547673b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.704678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5e68caf9-8a5a-458f-bdad-138e4547673b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:48.721349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68caf9-8a5a-458f-bdad-138e4547673b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.736981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.737856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.738247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.738482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] PATH_INFO: `/v3/users/fb5e28baccfb4667ad4b68de07de190e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.739776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5e28baccfb4667ad4b68de07de190e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.740915 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:25:48.740915 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:25:48.740915 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:25:48.742306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.760102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05f287-eae3-4757-accc-b70e05ac3c13 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.766364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12d5ce-ad9c-4663-9ba5-c36de8df3ac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.766975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12d5ce-ad9c-4663-9ba5-c36de8df3ac4 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.768075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12d5ce-ad9c-4663-9ba5-c36de8df3ac4 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.768358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12d5ce-ad9c-4663-9ba5-c36de8df3ac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.832569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5e28baccfb4667ad4b68de07de190e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:48.833280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5e28baccfb4667ad4b68de07de190e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:48.844929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12d5ce-ad9c-4663-9ba5-c36de8df3ac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.847195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12d5ce-ad9c-4663-9ba5-c36de8df3ac4 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.854449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5e28baccfb4667ad4b68de07de190e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:48.858784 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 836/1678] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:25:48.859942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12d5ce-ad9c-4663-9ba5-c36de8df3ac4 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.865107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5e28baccfb4667ad4b68de07de190e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:48.872613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12d5ce-ad9c-4663-9ba5-c36de8df3ac4 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.878073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbc7a9-b5b3-4259-bd29-582a4739246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.878336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5e28baccfb4667ad4b68de07de190e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:48.878872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbc7a9-b5b3-4259-bd29-582a4739246f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.879265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbc7a9-b5b3-4259-bd29-582a4739246f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.879858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbc7a9-b5b3-4259-bd29-582a4739246f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.880707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbc7a9-b5b3-4259-bd29-582a4739246f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.883572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbc7a9-b5b3-4259-bd29-582a4739246f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.886784 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 843/1679] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:48 2022] DELETE /identity/v3/users/fb5e28baccfb4667ad4b68de07de190e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:48.887489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.888888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:48.905019 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 837/1680] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:48.909907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbc7a9-b5b3-4259-bd29-582a4739246f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:48.912212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9cbbc7a9-b5b3-4259-bd29-582a4739246f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:48.929660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbc7a9-b5b3-4259-bd29-582a4739246f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.969866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80862e5b-ae02-4ba3-a36c-ac8147304f63 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:48.974664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1b780-c3ee-4489-b6e6-27bdfeceafbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:48.975315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1b780-c3ee-4489-b6e6-27bdfeceafbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:48.975645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1b780-c3ee-4489-b6e6-27bdfeceafbc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:48.975957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1b780-c3ee-4489-b6e6-27bdfeceafbc admin admin] PATH_INFO: `/v3/users/312fc9ed31be4887aace67186e509e8b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:48.977113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1b780-c3ee-4489-b6e6-27bdfeceafbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=312fc9ed31be4887aace67186e509e8b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:48.979557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1b780-c3ee-4489-b6e6-27bdfeceafbc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:48.987778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:49.001160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:49.016176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab9912-6063-4bd7-8bc0-8d469503b594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.016875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab9912-6063-4bd7-8bc0-8d469503b594 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.017184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab9912-6063-4bd7-8bc0-8d469503b594 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.018107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab9912-6063-4bd7-8bc0-8d469503b594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.020217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-32ab9912-6063-4bd7-8bc0-8d469503b594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.040984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39c1b780-c3ee-4489-b6e6-27bdfeceafbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312fc9ed31be4887aace67186e509e8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:49.041692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39c1b780-c3ee-4489-b6e6-27bdfeceafbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312fc9ed31be4887aace67186e509e8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:49.055873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39c1b780-c3ee-4489-b6e6-27bdfeceafbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312fc9ed31be4887aace67186e509e8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:49.066905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39c1b780-c3ee-4489-b6e6-27bdfeceafbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312fc9ed31be4887aace67186e509e8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:49.075792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39c1b780-c3ee-4489-b6e6-27bdfeceafbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312fc9ed31be4887aace67186e509e8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:49.083456 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 844/1681] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:48 2022] DELETE /identity/v3/users/312fc9ed31be4887aace67186e509e8b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:49.084887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9db132-affc-4e6c-9c64-39fb5c516b64 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.085175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9db132-affc-4e6c-9c64-39fb5c516b64 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.085863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9db132-affc-4e6c-9c64-39fb5c516b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.094545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab9912-6063-4bd7-8bc0-8d469503b594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:49.096558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab9912-6063-4bd7-8bc0-8d469503b594 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:49.107680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ee9db132-affc-4e6c-9c64-39fb5c516b64 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:49.108262 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 838/1682] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:49.108989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ee9db132-affc-4e6c-9c64-39fb5c516b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.119054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab9912-6063-4bd7-8bc0-8d469503b594 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:49.120828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-32ab9912-6063-4bd7-8bc0-8d469503b594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.136998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab9912-6063-4bd7-8bc0-8d469503b594 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:49.199119 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 845/1683] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:49.200571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9fd17-7e96-4df8-a260-145681876b30 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.200877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9fd17-7e96-4df8-a260-145681876b30 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.201942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9fd17-7e96-4df8-a260-145681876b30 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.203909 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 846/1684] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:25:49.205027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149354-f4f2-4098-9c31-59397c8f8182 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.205859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149354-f4f2-4098-9c31-59397c8f8182 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.206138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149354-f4f2-4098-9c31-59397c8f8182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.218102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75f0e3-daef-4e49-ae44-ba2cdc8c4218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.218784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75f0e3-daef-4e49-ae44-ba2cdc8c4218 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.219054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75f0e3-daef-4e49-ae44-ba2cdc8c4218 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.219332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75f0e3-daef-4e49-ae44-ba2cdc8c4218 admin admin] PATH_INFO: `/v3/projects/16ed7e54ce43428a8b9cb71e5b008b6c/users/20a33df43c714c87b8722ef567d17ced/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.227540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-00149354-f4f2-4098-9c31-59397c8f8182 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:49.228757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-00149354-f4f2-4098-9c31-59397c8f8182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.235013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75f0e3-daef-4e49-ae44-ba2cdc8c4218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ed7e54ce43428a8b9cb71e5b008b6c, user_id=20a33df43c714c87b8722ef567d17ced, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:49.237641 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 847/1685] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:49.237841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75f0e3-daef-4e49-ae44-ba2cdc8c4218 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:49.238983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2e40b-8740-4bd4-99af-31adbbe6a5ae None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.239277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2e40b-8740-4bd4-99af-31adbbe6a5ae None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.239558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2e40b-8740-4bd4-99af-31adbbe6a5ae None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.241378 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 848/1686] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:25:49.242661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc553c-c638-4f22-a096-56aeb0cae8d9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.242947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc553c-c638-4f22-a096-56aeb0cae8d9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.243225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc553c-c638-4f22-a096-56aeb0cae8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.261171 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 839/1687] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:49 2022] PUT /identity/v3/projects/16ed7e54ce43428a8b9cb71e5b008b6c/users/20a33df43c714c87b8722ef567d17ced/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:49.262560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75f0e3-daef-4e49-ae44-ba2cdc8c4218 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:49.264430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1c75f0e3-daef-4e49-ae44-ba2cdc8c4218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.275057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-61bc553c-c638-4f22-a096-56aeb0cae8d9 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:49.276334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-61bc553c-c638-4f22-a096-56aeb0cae8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.332053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75f0e3-daef-4e49-ae44-ba2cdc8c4218 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:49.335748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450b212-11bd-4262-b554-b9052846fd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.336361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b212-11bd-4262-b554-b9052846fd23 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.336623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b212-11bd-4262-b554-b9052846fd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.336899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b212-11bd-4262-b554-b9052846fd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.342853 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 849/1688] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:25:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:49.343792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc553c-c638-4f22-a096-56aeb0cae8d9 None None] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:25:49.345181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-61bc553c-c638-4f22-a096-56aeb0cae8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.355171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:49.378232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:49.404792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450b212-11bd-4262-b554-b9052846fd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:49.406286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450b212-11bd-4262-b554-b9052846fd23 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:49.416922 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 840/1689] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:49.417790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450b212-11bd-4262-b554-b9052846fd23 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:49.426966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450b212-11bd-4262-b554-b9052846fd23 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:49.431329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1f3f2-5a05-4178-b3ec-8903ff2bcf3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.431951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1f3f2-5a05-4178-b3ec-8903ff2bcf3c service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.432232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1f3f2-5a05-4178-b3ec-8903ff2bcf3c service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.432540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1f3f2-5a05-4178-b3ec-8903ff2bcf3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.443335 n-d-854882-3 devstack@keystone.service[89680]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-61bc553c-c638-4f22-a096-56aeb0cae8d9 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 29 15:25:49.443696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc553c-c638-4f22-a096-56aeb0cae8d9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:49.445252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-61bc553c-c638-4f22-a096-56aeb0cae8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.445377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1f3f2-5a05-4178-b3ec-8903ff2bcf3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:49.447911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1f3f2-5a05-4178-b3ec-8903ff2bcf3c service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:49.461083 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 841/1690] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:49.462532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670c0f6-b628-474f-8505-61a2f8da98e2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.462832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670c0f6-b628-474f-8505-61a2f8da98e2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.463135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670c0f6-b628-474f-8505-61a2f8da98e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.506031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b670c0f6-b628-474f-8505-61a2f8da98e2 None None] MFA Rules not processed for user `20a33df43c714c87b8722ef567d17ced`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:49.507284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b670c0f6-b628-474f-8505-61a2f8da98e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.542511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc553c-c638-4f22-a096-56aeb0cae8d9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:49.551163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e772cb-0cd6-44d7-9037-02a47ee1ec88 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9714332bd4429bbc98fac1b1ea077e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2aab5fe07c7f42b29724121b6ba805d0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.551889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e772cb-0cd6-44d7-9037-02a47ee1ec88 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.552574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e772cb-0cd6-44d7-9037-02a47ee1ec88 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.552859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e772cb-0cd6-44d7-9037-02a47ee1ec88 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] PATH_INFO: `/v3/projects/cbba879822dc45248651e86cd13b3098` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.554449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e772cb-0cd6-44d7-9037-02a47ee1ec88 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] RBAC: Authorizing `identity:get_project(project_id=cbba879822dc45248651e86cd13b3098)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:49.557254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e772cb-0cd6-44d7-9037-02a47ee1ec88 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:49.560665 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 850/1691] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:25:49 2022] GET /identity/v3/projects/cbba879822dc45248651e86cd13b3098 => generated 377 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:49.567301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e772cb-0cd6-44d7-9037-02a47ee1ec88 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:49.571211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a6e772cb-0cd6-44d7-9037-02a47ee1ec88 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.587485 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 842/1692] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:49.592062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670c0f6-b628-474f-8505-61a2f8da98e2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:49.594376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b670c0f6-b628-474f-8505-61a2f8da98e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.597584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e772cb-0cd6-44d7-9037-02a47ee1ec88 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:49.606871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479cd0d-2d2f-45ed-ae35-ecd34b781844 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.607536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479cd0d-2d2f-45ed-ae35-ecd34b781844 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.607772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479cd0d-2d2f-45ed-ae35-ecd34b781844 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.608047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479cd0d-2d2f-45ed-ae35-ecd34b781844 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.611846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670c0f6-b628-474f-8505-61a2f8da98e2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:49.618448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338f21e-a6bc-45c6-ab74-639125da362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.619128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338f21e-a6bc-45c6-ab74-639125da362d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.619553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338f21e-a6bc-45c6-ab74-639125da362d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.619839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338f21e-a6bc-45c6-ab74-639125da362d admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.620480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338f21e-a6bc-45c6-ab74-639125da362d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:49.622731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338f21e-a6bc-45c6-ab74-639125da362d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:49.630188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479cd0d-2d2f-45ed-ae35-ecd34b781844 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:49.633372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479cd0d-2d2f-45ed-ae35-ecd34b781844 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:49.650363 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 851/1693] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:49.653986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479cd0d-2d2f-45ed-ae35-ecd34b781844 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:49.662864 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 843/1694] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:49 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:25:49.667215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338f21e-a6bc-45c6-ab74-639125da362d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:49.673031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479cd0d-2d2f-45ed-ae35-ecd34b781844 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:49.764715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338f21e-a6bc-45c6-ab74-639125da362d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:49.772163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d95865-0fd6-4325-831a-b394d53a6fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.772886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d95865-0fd6-4325-831a-b394d53a6fa2 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.773249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d95865-0fd6-4325-831a-b394d53a6fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.773489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d95865-0fd6-4325-831a-b394d53a6fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.775605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-87d95865-0fd6-4325-831a-b394d53a6fa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.777306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2577a3-db39-4948-87c6-4c8a585ee504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.778921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2577a3-db39-4948-87c6-4c8a585ee504 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.779316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2577a3-db39-4948-87c6-4c8a585ee504 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.779784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2577a3-db39-4948-87c6-4c8a585ee504 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.781717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2577a3-db39-4948-87c6-4c8a585ee504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:49.787339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2577a3-db39-4948-87c6-4c8a585ee504 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:49.818283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:49.826655 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 844/1695] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:49 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:49.829795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2577a3-db39-4948-87c6-4c8a585ee504 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:49.843938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2577a3-db39-4948-87c6-4c8a585ee504 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:49.850506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442c460-bacf-4a42-be92-cc66828d9d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.851022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:49.851199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c460-bacf-4a42-be92-cc66828d9d22 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.851500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c460-bacf-4a42-be92-cc66828d9d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.851770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c460-bacf-4a42-be92-cc66828d9d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.852497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442c460-bacf-4a42-be92-cc66828d9d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:49.854450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442c460-bacf-4a42-be92-cc66828d9d22 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:49.869074 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 845/1696] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:49.877249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d95865-0fd6-4325-831a-b394d53a6fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:49.878505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442c460-bacf-4a42-be92-cc66828d9d22 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:49.880684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d95865-0fd6-4325-831a-b394d53a6fa2 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:49.898116 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 852/1697] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:49.909982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442c460-bacf-4a42-be92-cc66828d9d22 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:49.921953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742a062-527d-495e-b25d-c3861469d1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.922674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742a062-527d-495e-b25d-c3861469d1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.923035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742a062-527d-495e-b25d-c3861469d1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.924355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742a062-527d-495e-b25d-c3861469d1f0 admin admin] PATH_INFO: `/v3/projects/a3571b439c6c482f9cac62cda8b8733e/users/e221ec043ced4adc8a199c44abc4b8ee/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:49.954556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d95865-0fd6-4325-831a-b394d53a6fa2 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:49.956523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-87d95865-0fd6-4325-831a-b394d53a6fa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:49.984049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742a062-527d-495e-b25d-c3861469d1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3571b439c6c482f9cac62cda8b8733e, user_id=e221ec043ced4adc8a199c44abc4b8ee, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:49.989165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742a062-527d-495e-b25d-c3861469d1f0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:49.990735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d95865-0fd6-4325-831a-b394d53a6fa2 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:49.998519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:49.999325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:49.999530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:49.999807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] PATH_INFO: `/v3/projects/4ab0b710c01b4f81b519e8312dd7f02e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:50.003190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab0b710c01b4f81b519e8312dd7f02e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:50.005451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:50.010006 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 846/1698] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:49 2022] PUT /identity/v3/projects/a3571b439c6c482f9cac62cda8b8733e/users/e221ec043ced4adc8a199c44abc4b8ee/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:50.016494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742a062-527d-495e-b25d-c3861469d1f0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:50.097908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab0b710c01b4f81b519e8312dd7f02e', 'request_id': 'req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.099376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab0b710c01b4f81b519e8312dd7f02e', 'request_id': 'req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.108752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab0b710c01b4f81b519e8312dd7f02e', 'request_id': 'req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.125630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742a062-527d-495e-b25d-c3861469d1f0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:50.139697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] The token cache is being invalidate because project 4ab0b710c01b4f81b519e8312dd7f02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:50.140143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.140820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70fcc4ab-2df8-49ee-9cff-1029ebdde86e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.143140 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 853/1699] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:49 2022] DELETE /identity/v3/projects/4ab0b710c01b4f81b519e8312dd7f02e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:50.147120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fc1ed-5aed-467c-be40-3e2f26d6f692 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:50.147399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fc1ed-5aed-467c-be40-3e2f26d6f692 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:50.147682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fc1ed-5aed-467c-be40-3e2f26d6f692 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:50.149523 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 854/1700] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:25:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:25:50.149811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fc1ed-5aed-467c-be40-3e2f26d6f692 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:50.151612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-482fc1ed-5aed-467c-be40-3e2f26d6f692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:50.204299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf07ae-56d5-4e79-832a-2a92c2e8c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:50.205441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf07ae-56d5-4e79-832a-2a92c2e8c872 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:50.205766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf07ae-56d5-4e79-832a-2a92c2e8c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:50.206038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf07ae-56d5-4e79-832a-2a92c2e8c872 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:50.206679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf07ae-56d5-4e79-832a-2a92c2e8c872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:50.208309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf07ae-56d5-4e79-832a-2a92c2e8c872 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:50.221751 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 847/1701] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:50.222808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf07ae-56d5-4e79-832a-2a92c2e8c872 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:50.224594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3abf07ae-56d5-4e79-832a-2a92c2e8c872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:50.237644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fc1ed-5aed-467c-be40-3e2f26d6f692 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:50.242259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:50.242903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:50.243185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:50.243469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] PATH_INFO: `/v3/projects/9860f0c7ea5c4559a6f3cb65e302096d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:50.244621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9860f0c7ea5c4559a6f3cb65e302096d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:50.246596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:50.296695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9860f0c7ea5c4559a6f3cb65e302096d', 'request_id': 'req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.300045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:50.302877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9860f0c7ea5c4559a6f3cb65e302096d', 'request_id': 'req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.305050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf07ae-56d5-4e79-832a-2a92c2e8c872 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:50.311758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9860f0c7ea5c4559a6f3cb65e302096d', 'request_id': 'req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.319096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:50.324349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] The token cache is being invalidate because project 9860f0c7ea5c4559a6f3cb65e302096d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:50.325195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.326320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.327940 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 855/1702] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:50 2022] DELETE /identity/v3/projects/9860f0c7ea5c4559a6f3cb65e302096d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:50.330919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:50.332523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:50.374258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:50.374897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:50.375179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:50.375449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:50.378213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:50.406468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cbf10-a0ec-4efb-83b5-9a0e4cc5c6c1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:50.412371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:50.413695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:50.413981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:50.414266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] PATH_INFO: `/v3/users/67ba2ae1d7c7447f9358f787ba30e646` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:50.415437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ba2ae1d7c7447f9358f787ba30e646)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:50.417622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:50.446223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:50.448277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:50.461470 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 848/1703] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:50.462732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:25:50.464235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:50.484957 n-d-854882-3 devstack@keystone.service[89681]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 29 15:25:50.484957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:50.484957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:50.486872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ba2ae1d7c7447f9358f787ba30e646'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.487249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ba2ae1d7c7447f9358f787ba30e646'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.512097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ba2ae1d7c7447f9358f787ba30e646'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.532103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ba2ae1d7c7447f9358f787ba30e646'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.544924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ba2ae1d7c7447f9358f787ba30e646'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:50.556248 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 856/1704] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:50 2022] DELETE /identity/v3/users/67ba2ae1d7c7447f9358f787ba30e646 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:50.557713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:50.559160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:50.596741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1f081-d8a3-439d-9ab0-dff71e8297cd service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:50.665955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad11a64-88d1-4f37-9b91-f732ebbf52cf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:50.667040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:50.678645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032890b-7c2b-4bf9-be06-b4180e829747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:50.679797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032890b-7c2b-4bf9-be06-b4180e829747 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:50.680297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032890b-7c2b-4bf9-be06-b4180e829747 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:50.680785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032890b-7c2b-4bf9-be06-b4180e829747 admin admin] PATH_INFO: `/v3/projects/a3571b439c6c482f9cac62cda8b8733e/users/e221ec043ced4adc8a199c44abc4b8ee/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:50.693453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829225-e125-4cf4-a92e-7886da303c06 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f9714332bd4429bbc98fac1b1ea077e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2aab5fe07c7f42b29724121b6ba805d0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:50.694171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032890b-7c2b-4bf9-be06-b4180e829747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3571b439c6c482f9cac62cda8b8733e, user_id=e221ec043ced4adc8a199c44abc4b8ee, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:50.694710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829225-e125-4cf4-a92e-7886da303c06 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:50.694862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829225-e125-4cf4-a92e-7886da303c06 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:50.695260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829225-e125-4cf4-a92e-7886da303c06 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] PATH_INFO: `/v3/projects/cbba879822dc45248651e86cd13b3098` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:50.700205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032890b-7c2b-4bf9-be06-b4180e829747 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:50.703195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4829225-e125-4cf4-a92e-7886da303c06 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] RBAC: Authorizing `identity:get_project(project_id=cbba879822dc45248651e86cd13b3098)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:50.705735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4829225-e125-4cf4-a92e-7886da303c06 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:50.707612 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 849/1705] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:25:50 2022] GET /identity/v3/projects/cbba879822dc45248651e86cd13b3098 => generated 377 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:50.708686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829225-e125-4cf4-a92e-7886da303c06 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:50.711077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e4829225-e125-4cf4-a92e-7886da303c06 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:50.727808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829225-e125-4cf4-a92e-7886da303c06 tempest-FlavorsAccessTestJSON-482413836 tempest-FlavorsAccessTestJSON-482413836-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:50.756110 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 857/1706] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:50 2022] PUT /identity/v3/projects/a3571b439c6c482f9cac62cda8b8733e/users/e221ec043ced4adc8a199c44abc4b8ee/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:50.770768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643859c8-24ab-4f45-a4b2-c849cec58a8d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:50.771246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643859c8-24ab-4f45-a4b2-c849cec58a8d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:50.771735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643859c8-24ab-4f45-a4b2-c849cec58a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:50.868851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:50.884917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:50.890287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:50.893253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:50.893923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-643859c8-24ab-4f45-a4b2-c849cec58a8d None None] MFA Rules not processed for user `e221ec043ced4adc8a199c44abc4b8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:50.894909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] PATH_INFO: `/v3/users/a6ae298f903f422ab6fc0595460bbdf1` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:50.898161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ae298f903f422ab6fc0595460bbdf1)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:50.898329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-643859c8-24ab-4f45-a4b2-c849cec58a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:50.902875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:51.036401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ae298f903f422ab6fc0595460bbdf1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.037226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ae298f903f422ab6fc0595460bbdf1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.076660 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 858/1707] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:25:51.077559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ae298f903f422ab6fc0595460bbdf1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.079458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ae298f903f422ab6fc0595460bbdf1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.093774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ae298f903f422ab6fc0595460bbdf1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.124442 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 850/1708] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:50 2022] DELETE /identity/v3/users/a6ae298f903f422ab6fc0595460bbdf1 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:51.178900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643859c8-24ab-4f45-a4b2-c849cec58a8d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:51.182333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-643859c8-24ab-4f45-a4b2-c849cec58a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:51.211530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:51.220131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:51.328965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643859c8-24ab-4f45-a4b2-c849cec58a8d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:51.395429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1b7f1-ae90-4596-a0c4-868e68240269 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:51.405162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:51.405707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:51.406242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:51.406713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] PATH_INFO: `/v3/projects/f755d76557664a26a2fe5eb0a06e5650` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:51.409800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f755d76557664a26a2fe5eb0a06e5650)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:51.411591 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:25:51.411591 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:25:51.411591 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:25:51.413805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:51.431414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:51.454786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a7b37-cc76-45ce-977d-d8d099914e61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:51.456052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a7b37-cc76-45ce-977d-d8d099914e61 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:51.456663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a7b37-cc76-45ce-977d-d8d099914e61 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:51.457445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a7b37-cc76-45ce-977d-d8d099914e61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:51.497156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f755d76557664a26a2fe5eb0a06e5650', 'request_id': 'req-f7f83917-a375-42bd-9bd5-85e94e282155'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.520666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:51.532822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f755d76557664a26a2fe5eb0a06e5650', 'request_id': 'req-f7f83917-a375-42bd-9bd5-85e94e282155'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.546576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f755d76557664a26a2fe5eb0a06e5650', 'request_id': 'req-f7f83917-a375-42bd-9bd5-85e94e282155'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.565257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a7b37-cc76-45ce-977d-d8d099914e61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:51.567632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a7b37-cc76-45ce-977d-d8d099914e61 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:51.581503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] The token cache is being invalidate because project f755d76557664a26a2fe5eb0a06e5650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:51.581801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.583769 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 859/1709] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:51.585898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.587906 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 851/1710] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:51 2022] DELETE /identity/v3/projects/f755d76557664a26a2fe5eb0a06e5650 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:51.592999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdb793-4dc3-4ca5-b985-fad6a3ceb0ab None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:51.593288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdb793-4dc3-4ca5-b985-fad6a3ceb0ab None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:51.593593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdb793-4dc3-4ca5-b985-fad6a3ceb0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:51.649965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f8bdb793-4dc3-4ca5-b985-fad6a3ceb0ab None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:51.652632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f8bdb793-4dc3-4ca5-b985-fad6a3ceb0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:51.657026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:51.659915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:51.742781 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 860/1711] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:51.742781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdb793-4dc3-4ca5-b985-fad6a3ceb0ab None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:51.742781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f8bdb793-4dc3-4ca5-b985-fad6a3ceb0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:51.750689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdb793-4dc3-4ca5-b985-fad6a3ceb0ab None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:51.756019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f4f9d-4af2-47cd-a69f-1b45c8e0f166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:51.756663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f4f9d-4af2-47cd-a69f-1b45c8e0f166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:51.756939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f4f9d-4af2-47cd-a69f-1b45c8e0f166 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:51.757209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f4f9d-4af2-47cd-a69f-1b45c8e0f166 admin admin] PATH_INFO: `/v3/users/9220801efd9747099ada3e01b376ff10` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:51.758456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f4f9d-4af2-47cd-a69f-1b45c8e0f166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9220801efd9747099ada3e01b376ff10)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:51.760686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f4f9d-4af2-47cd-a69f-1b45c8e0f166 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:51.793950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83917-a375-42bd-9bd5-85e94e282155 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:51.799564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:51.800574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:51.800872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:51.801133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] PATH_INFO: `/v3/projects/468642093df54da786b144ad54230998` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:51.804709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=468642093df54da786b144ad54230998)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:51.808145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:51.848501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-645f4f9d-4af2-47cd-a69f-1b45c8e0f166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9220801efd9747099ada3e01b376ff10'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.849871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-645f4f9d-4af2-47cd-a69f-1b45c8e0f166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9220801efd9747099ada3e01b376ff10'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.873236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-645f4f9d-4af2-47cd-a69f-1b45c8e0f166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9220801efd9747099ada3e01b376ff10'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.884193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-645f4f9d-4af2-47cd-a69f-1b45c8e0f166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9220801efd9747099ada3e01b376ff10'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.901978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-645f4f9d-4af2-47cd-a69f-1b45c8e0f166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9220801efd9747099ada3e01b376ff10'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.903901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468642093df54da786b144ad54230998', 'request_id': 'req-5f183ea7-6cdd-461d-98dd-70416faf0b6e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.912261 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 861/1712] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:51 2022] DELETE /identity/v3/users/9220801efd9747099ada3e01b376ff10 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:51.913930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb968c30-3f9a-4739-ac32-88c58d7aa64d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:51.914640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb968c30-3f9a-4739-ac32-88c58d7aa64d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:51.915482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb968c30-3f9a-4739-ac32-88c58d7aa64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:51.916003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468642093df54da786b144ad54230998', 'request_id': 'req-5f183ea7-6cdd-461d-98dd-70416faf0b6e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.930920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468642093df54da786b144ad54230998', 'request_id': 'req-5f183ea7-6cdd-461d-98dd-70416faf0b6e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.968173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-bb968c30-3f9a-4739-ac32-88c58d7aa64d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:51.972113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bb968c30-3f9a-4739-ac32-88c58d7aa64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:51.974823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] The token cache is being invalidate because project 468642093df54da786b144ad54230998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:51.975082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.976013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:51.978568 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 852/1713] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:51 2022] DELETE /identity/v3/projects/468642093df54da786b144ad54230998 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:51.983982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:51.986128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.046915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:52.049048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:52.102087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f183ea7-6cdd-461d-98dd-70416faf0b6e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:52.108265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5133f2-5f40-4cfd-99e5-d63ce6b27da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:52.108803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5133f2-5f40-4cfd-99e5-d63ce6b27da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.109084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5133f2-5f40-4cfd-99e5-d63ce6b27da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.109354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5133f2-5f40-4cfd-99e5-d63ce6b27da7 admin admin] PATH_INFO: `/v3/users/7f061ae161984a3d94a83fc55fa36ffa` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.110750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5133f2-5f40-4cfd-99e5-d63ce6b27da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f061ae161984a3d94a83fc55fa36ffa)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:52.112993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5133f2-5f40-4cfd-99e5-d63ce6b27da7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:52.114198 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 862/1714] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:52.115800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039ff9-97a2-45dc-befc-db38607bf2f1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.116102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039ff9-97a2-45dc-befc-db38607bf2f1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.116384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039ff9-97a2-45dc-befc-db38607bf2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.150771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d9039ff9-97a2-45dc-befc-db38607bf2f1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:52.152052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d9039ff9-97a2-45dc-befc-db38607bf2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.164873 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 863/1715] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:52.169555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039ff9-97a2-45dc-befc-db38607bf2f1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:52.171000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d9039ff9-97a2-45dc-befc-db38607bf2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.184570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039ff9-97a2-45dc-befc-db38607bf2f1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:52.190956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:52.192369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.192637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.192973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] PATH_INFO: `/v3/users/7d78200d53a3404bab17960100fe4ea2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.197262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d78200d53a3404bab17960100fe4ea2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:52.200815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:52.201598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1f5133f2-5f40-4cfd-99e5-d63ce6b27da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f061ae161984a3d94a83fc55fa36ffa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.202843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1f5133f2-5f40-4cfd-99e5-d63ce6b27da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f061ae161984a3d94a83fc55fa36ffa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.239957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1f5133f2-5f40-4cfd-99e5-d63ce6b27da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f061ae161984a3d94a83fc55fa36ffa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.240833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1f5133f2-5f40-4cfd-99e5-d63ce6b27da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f061ae161984a3d94a83fc55fa36ffa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.264977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1f5133f2-5f40-4cfd-99e5-d63ce6b27da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f061ae161984a3d94a83fc55fa36ffa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.285352 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 853/1716] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:51 2022] DELETE /identity/v3/users/7f061ae161984a3d94a83fc55fa36ffa => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:52.286577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda410df-f393-4dee-8ad8-e074329ad08c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.286944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda410df-f393-4dee-8ad8-e074329ad08c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.287386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda410df-f393-4dee-8ad8-e074329ad08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.297094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d78200d53a3404bab17960100fe4ea2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.297794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d78200d53a3404bab17960100fe4ea2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.316603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cda410df-f393-4dee-8ad8-e074329ad08c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:52.318044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cda410df-f393-4dee-8ad8-e074329ad08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.320433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d78200d53a3404bab17960100fe4ea2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.336949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d78200d53a3404bab17960100fe4ea2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.346462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d78200d53a3404bab17960100fe4ea2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.357886 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 864/1717] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:52 2022] DELETE /identity/v3/users/7d78200d53a3404bab17960100fe4ea2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:52.357886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:52.357886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.401871 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 854/1718] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:52.402842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda410df-f393-4dee-8ad8-e074329ad08c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:52.405680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cda410df-f393-4dee-8ad8-e074329ad08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.418367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda410df-f393-4dee-8ad8-e074329ad08c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:52.431918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc819e3d-d6a1-4a3d-bf11-71229927ff80 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:52.436946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ceff6-14b2-45e7-8986-183bea402ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:52.437842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ceff6-14b2-45e7-8986-183bea402ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.438005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ceff6-14b2-45e7-8986-183bea402ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.438279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ceff6-14b2-45e7-8986-183bea402ea6 admin admin] PATH_INFO: `/v3/users/20a33df43c714c87b8722ef567d17ced` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.439514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ceff6-14b2-45e7-8986-183bea402ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a33df43c714c87b8722ef567d17ced)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:52.441413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ceff6-14b2-45e7-8986-183bea402ea6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:52.466056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:52.483726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8150a-8c02-467a-834d-d476d1f55575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:52.484357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8150a-8c02-467a-834d-d476d1f55575 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.484650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8150a-8c02-467a-834d-d476d1f55575 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.484902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8150a-8c02-467a-834d-d476d1f55575 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.485585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8150a-8c02-467a-834d-d476d1f55575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:52.485888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8150a-8c02-467a-834d-d476d1f55575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:52.487637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8150a-8c02-467a-834d-d476d1f55575 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:52.495063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-763ceff6-14b2-45e7-8986-183bea402ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a33df43c714c87b8722ef567d17ced'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.495753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-763ceff6-14b2-45e7-8986-183bea402ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a33df43c714c87b8722ef567d17ced'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.496963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:52.504844 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 855/1719] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:52.506259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8150a-8c02-467a-834d-d476d1f55575 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:52.508045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5ad8150a-8c02-467a-834d-d476d1f55575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.513622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-763ceff6-14b2-45e7-8986-183bea402ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a33df43c714c87b8722ef567d17ced'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.522915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-763ceff6-14b2-45e7-8986-183bea402ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a33df43c714c87b8722ef567d17ced'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.535252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-763ceff6-14b2-45e7-8986-183bea402ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a33df43c714c87b8722ef567d17ced'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:52.544362 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 865/1720] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:52 2022] DELETE /identity/v3/users/20a33df43c714c87b8722ef567d17ced => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:52.546003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec035-e4bc-46a3-8fdf-8f6916aa5a68 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.546354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec035-e4bc-46a3-8fdf-8f6916aa5a68 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.546689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec035-e4bc-46a3-8fdf-8f6916aa5a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.568580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-77bec035-e4bc-46a3-8fdf-8f6916aa5a68 None None] MFA Rules not processed for user `99004756e4fe4720b121bd4b03949f35`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:52.569861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-77bec035-e4bc-46a3-8fdf-8f6916aa5a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.574636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8150a-8c02-467a-834d-d476d1f55575 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:52.632337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803614b-412c-4a5b-827b-f5dd2b47b4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:52.633044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803614b-412c-4a5b-827b-f5dd2b47b4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.633491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803614b-412c-4a5b-827b-f5dd2b47b4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.633825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803614b-412c-4a5b-827b-f5dd2b47b4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.634087 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 866/1721] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:52.635456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77520151-5325-49c2-b133-85f3707c1cee None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.635747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77520151-5325-49c2-b133-85f3707c1cee None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.636027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77520151-5325-49c2-b133-85f3707c1cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.640281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5803614b-412c-4a5b-827b-f5dd2b47b4e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.659668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-77520151-5325-49c2-b133-85f3707c1cee None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:52.660917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-77520151-5325-49c2-b133-85f3707c1cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.711942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803614b-412c-4a5b-827b-f5dd2b47b4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:52.713381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803614b-412c-4a5b-827b-f5dd2b47b4e0 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:52.723784 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 856/1722] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:52.725040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572454-18c2-4f6f-80ca-4f48fcdc382f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.725370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572454-18c2-4f6f-80ca-4f48fcdc382f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.725624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572454-18c2-4f6f-80ca-4f48fcdc382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.728925 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 867/1723] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:52.733586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495d11c-d1d4-4bad-a49a-66563209c479 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.734094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495d11c-d1d4-4bad-a49a-66563209c479 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.734218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495d11c-d1d4-4bad-a49a-66563209c479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.754135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-83572454-18c2-4f6f-80ca-4f48fcdc382f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:52.755072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-83572454-18c2-4f6f-80ca-4f48fcdc382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.755693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0495d11c-d1d4-4bad-a49a-66563209c479 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:52.757056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0495d11c-d1d4-4bad-a49a-66563209c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.763403 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 857/1724] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:52.764028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572454-18c2-4f6f-80ca-4f48fcdc382f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:52.765295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-83572454-18c2-4f6f-80ca-4f48fcdc382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.769174 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 868/1725] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:52.770559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc97846-7e15-4633-b5c8-851a3b2a0bc7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.770851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc97846-7e15-4633-b5c8-851a3b2a0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.771130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc97846-7e15-4633-b5c8-851a3b2a0bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.779025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572454-18c2-4f6f-80ca-4f48fcdc382f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:52.784692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f65e1-17b2-4c33-bd7a-af6798966ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:52.785309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f65e1-17b2-4c33-bd7a-af6798966ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.786120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f65e1-17b2-4c33-bd7a-af6798966ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.786402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f65e1-17b2-4c33-bd7a-af6798966ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.787041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f65e1-17b2-4c33-bd7a-af6798966ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:52.789306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f65e1-17b2-4c33-bd7a-af6798966ce7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:52.795042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-bdc97846-7e15-4633-b5c8-851a3b2a0bc7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:52.797367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bdc97846-7e15-4633-b5c8-851a3b2a0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.809150 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 869/1726] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:52.817417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc97846-7e15-4633-b5c8-851a3b2a0bc7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:52.817417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bdc97846-7e15-4633-b5c8-851a3b2a0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.834285 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 858/1727] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:52 2022] POST /identity/v3/projects => generated 409 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:52.835355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f65e1-17b2-4c33-bd7a-af6798966ce7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:52.837044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2a8f65e1-17b2-4c33-bd7a-af6798966ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:52.860284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:52.887276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:52.909208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f65e1-17b2-4c33-bd7a-af6798966ce7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:52.913799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f293424-b0ae-4f8c-a162-97cb39fdc201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:52.914461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f293424-b0ae-4f8c-a162-97cb39fdc201 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:52.914746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f293424-b0ae-4f8c-a162-97cb39fdc201 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:52.915020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f293424-b0ae-4f8c-a162-97cb39fdc201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:52.923498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc97846-7e15-4633-b5c8-851a3b2a0bc7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:52.984056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f293424-b0ae-4f8c-a162-97cb39fdc201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:52.985580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f293424-b0ae-4f8c-a162-97cb39fdc201 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:52.996193 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 859/1728] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:52.996933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f293424-b0ae-4f8c-a162-97cb39fdc201 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.008015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f293424-b0ae-4f8c-a162-97cb39fdc201 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.010984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c83faf-4261-4ab1-90f9-c868d90efd65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.011793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c83faf-4261-4ab1-90f9-c868d90efd65 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.012072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c83faf-4261-4ab1-90f9-c868d90efd65 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.012924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c83faf-4261-4ab1-90f9-c868d90efd65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.013865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf0fce-6a83-4540-bfc0-84068fd0cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.014950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0fce-6a83-4540-bfc0-84068fd0cc0f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.015213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0fce-6a83-4540-bfc0-84068fd0cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.015564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0fce-6a83-4540-bfc0-84068fd0cc0f admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.016228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf0fce-6a83-4540-bfc0-84068fd0cc0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:53.016534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf0fce-6a83-4540-bfc0-84068fd0cc0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.018954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf0fce-6a83-4540-bfc0-84068fd0cc0f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.020018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d0c83faf-4261-4ab1-90f9-c868d90efd65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:53.039747 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 860/1729] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:53.039747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf0fce-6a83-4540-bfc0-84068fd0cc0f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.050120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf0fce-6a83-4540-bfc0-84068fd0cc0f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.054664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7a642-736a-4add-8a74-cdee0896f851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.055339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7a642-736a-4add-8a74-cdee0896f851 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.055659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7a642-736a-4add-8a74-cdee0896f851 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.055942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7a642-736a-4add-8a74-cdee0896f851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.067669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7a642-736a-4add-8a74-cdee0896f851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.069475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7a642-736a-4add-8a74-cdee0896f851 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.081195 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 861/1730] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:53.082090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7a642-736a-4add-8a74-cdee0896f851 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.092530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7a642-736a-4add-8a74-cdee0896f851 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.096752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b94f8-47dd-4021-b921-e2d64a74e885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.097353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b94f8-47dd-4021-b921-e2d64a74e885 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.097712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b94f8-47dd-4021-b921-e2d64a74e885 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.097959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b94f8-47dd-4021-b921-e2d64a74e885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.106439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c83faf-4261-4ab1-90f9-c868d90efd65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.107898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b94f8-47dd-4021-b921-e2d64a74e885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.108956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c83faf-4261-4ab1-90f9-c868d90efd65 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.109551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b94f8-47dd-4021-b921-e2d64a74e885 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.121125 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 870/1731] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:53.121854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c83faf-4261-4ab1-90f9-c868d90efd65 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.126098 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 862/1732] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:53.128360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b94f8-47dd-4021-b921-e2d64a74e885 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.133942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c00b94f8-47dd-4021-b921-e2d64a74e885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:53.138659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c83faf-4261-4ab1-90f9-c868d90efd65 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.145714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66947465-af09-476e-a49c-0754e598daa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.147111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66947465-af09-476e-a49c-0754e598daa7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.147404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66947465-af09-476e-a49c-0754e598daa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.147686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66947465-af09-476e-a49c-0754e598daa7 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.148886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66947465-af09-476e-a49c-0754e598daa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.151177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b94f8-47dd-4021-b921-e2d64a74e885 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.152242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66947465-af09-476e-a49c-0754e598daa7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.157551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.159228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.159596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.160216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] PATH_INFO: `/v3/projects/c278523c2a634e27ae0459b06e7f391f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.162024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c278523c2a634e27ae0459b06e7f391f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.164142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.190501 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 871/1733] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:53 2022] POST /identity/v3/users => generated 305 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:53.190501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66947465-af09-476e-a49c-0754e598daa7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.204673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66947465-af09-476e-a49c-0754e598daa7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.210855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5d51b-1ff6-4988-8183-7f3bb4a90e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.211068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5d51b-1ff6-4988-8183-7f3bb4a90e26 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.211701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5d51b-1ff6-4988-8183-7f3bb4a90e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.211701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5d51b-1ff6-4988-8183-7f3bb4a90e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.212977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5d51b-1ff6-4988-8183-7f3bb4a90e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.215036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5d51b-1ff6-4988-8183-7f3bb4a90e26 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.242857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c278523c2a634e27ae0459b06e7f391f', 'request_id': 'req-254375f5-ee40-42ce-8c9a-e7436f50809d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.248090 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 872/1734] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:53 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:53.249251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5d51b-1ff6-4988-8183-7f3bb4a90e26 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.257119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c278523c2a634e27ae0459b06e7f391f', 'request_id': 'req-254375f5-ee40-42ce-8c9a-e7436f50809d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.273736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c278523c2a634e27ae0459b06e7f391f', 'request_id': 'req-254375f5-ee40-42ce-8c9a-e7436f50809d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.290020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] The token cache is being invalidate because project c278523c2a634e27ae0459b06e7f391f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:53.290352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.291115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-254375f5-ee40-42ce-8c9a-e7436f50809d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.294632 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 863/1735] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:53 2022] DELETE /identity/v3/projects/c278523c2a634e27ae0459b06e7f391f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:53.301579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8ac5e-fef6-4721-9460-1a09b42bceb0 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.302086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8ac5e-fef6-4721-9460-1a09b42bceb0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.302673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8ac5e-fef6-4721-9460-1a09b42bceb0 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.306286 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 864/1736] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:25:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:25:53.308201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8ac5e-fef6-4721-9460-1a09b42bceb0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.310859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a7b8ac5e-fef6-4721-9460-1a09b42bceb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:53.334659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:53.347538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:53.366812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5d51b-1ff6-4988-8183-7f3bb4a90e26 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.373071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f836917-d830-4413-9e87-4cebea3569c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.374118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f836917-d830-4413-9e87-4cebea3569c9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.374701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f836917-d830-4413-9e87-4cebea3569c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.375158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f836917-d830-4413-9e87-4cebea3569c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.376152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f836917-d830-4413-9e87-4cebea3569c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.378624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f836917-d830-4413-9e87-4cebea3569c9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.395432 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 873/1737] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:53.396762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f836917-d830-4413-9e87-4cebea3569c9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.402030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3f836917-d830-4413-9e87-4cebea3569c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:53.419218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f836917-d830-4413-9e87-4cebea3569c9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.424038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8ac5e-fef6-4721-9460-1a09b42bceb0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.427435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.428683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.429148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.429926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333926a-d03c-41fe-b963-5abd17ef300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.430461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] PATH_INFO: `/v3/users/6f8caa545331476aa9c70ca67ab41123` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.431677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333926a-d03c-41fe-b963-5abd17ef300b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.432394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333926a-d03c-41fe-b963-5abd17ef300b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.432503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333926a-d03c-41fe-b963-5abd17ef300b admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.433116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8caa545331476aa9c70ca67ab41123)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.433539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333926a-d03c-41fe-b963-5abd17ef300b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.435612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333926a-d03c-41fe-b963-5abd17ef300b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.436312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.477707 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 865/1738] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:53 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:53.477707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b7b8-4ad5-42b5-910a-390b46c62905 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.480353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b7b8-4ad5-42b5-910a-390b46c62905 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.480651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b7b8-4ad5-42b5-910a-390b46c62905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.511685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-31c7b7b8-4ad5-42b5-910a-390b46c62905 None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:53.514375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-31c7b7b8-4ad5-42b5-910a-390b46c62905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:53.523670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8caa545331476aa9c70ca67ab41123'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.525914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8caa545331476aa9c70ca67ab41123'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.554967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8caa545331476aa9c70ca67ab41123'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.573965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8caa545331476aa9c70ca67ab41123'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.584709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8caa545331476aa9c70ca67ab41123'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.592567 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 874/1739] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:53 2022] DELETE /identity/v3/users/6f8caa545331476aa9c70ca67ab41123 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:53.593511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.596440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:53.609268 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 866/1740] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:53.610257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7b7b8-4ad5-42b5-910a-390b46c62905 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.611691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-31c7b7b8-4ad5-42b5-910a-390b46c62905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:53.628120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7b7b8-4ad5-42b5-910a-390b46c62905 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.696003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35547eee-0963-4c83-a387-331c4fcc6374 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.706555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff8a5f-1db7-497f-a1b8-7567f0279897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.707188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff8a5f-1db7-497f-a1b8-7567f0279897 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.709675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff8a5f-1db7-497f-a1b8-7567f0279897 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.710682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff8a5f-1db7-497f-a1b8-7567f0279897 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.712445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff8a5f-1db7-497f-a1b8-7567f0279897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.716012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff8a5f-1db7-497f-a1b8-7567f0279897 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.732550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.739209 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 875/1741] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:53.740625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff8a5f-1db7-497f-a1b8-7567f0279897 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.742722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bdff8a5f-1db7-497f-a1b8-7567f0279897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:53.753724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.754103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.754405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] PATH_INFO: `/v3/projects/3765718bbd5742a09719e57d52b51991` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.759563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff8a5f-1db7-497f-a1b8-7567f0279897 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.761586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3765718bbd5742a09719e57d52b51991)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.766254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e794-123f-44a5-bbd3-72b64dcec314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.767027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e794-123f-44a5-bbd3-72b64dcec314 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.767901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e794-123f-44a5-bbd3-72b64dcec314 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.768243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e794-123f-44a5-bbd3-72b64dcec314 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.768961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194e794-123f-44a5-bbd3-72b64dcec314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.769607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.770980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194e794-123f-44a5-bbd3-72b64dcec314 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:53.789128 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 876/1742] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:53.789128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e794-123f-44a5-bbd3-72b64dcec314 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.789819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0194e794-123f-44a5-bbd3-72b64dcec314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:53.847990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:53.857209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:53.867974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3765718bbd5742a09719e57d52b51991', 'request_id': 'req-5cc831bb-0920-4636-98ac-2081902376ac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.875910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3765718bbd5742a09719e57d52b51991', 'request_id': 'req-5cc831bb-0920-4636-98ac-2081902376ac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.886819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3765718bbd5742a09719e57d52b51991', 'request_id': 'req-5cc831bb-0920-4636-98ac-2081902376ac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.902882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] The token cache is being invalidate because project 3765718bbd5742a09719e57d52b51991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:53.903243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.904729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:53.906798 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 867/1743] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:53 2022] DELETE /identity/v3/projects/3765718bbd5742a09719e57d52b51991 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:53.907260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e794-123f-44a5-bbd3-72b64dcec314 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.907591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:53.909773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:53.978341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc831bb-0920-4636-98ac-2081902376ac admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:53.981953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb44fe-a498-42fb-b458-6bdf9281557b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.982847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb44fe-a498-42fb-b458-6bdf9281557b service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.983272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb44fe-a498-42fb-b458-6bdf9281557b service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.983689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb44fe-a498-42fb-b458-6bdf9281557b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.983830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:53.984498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:53.984749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:53.985023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] PATH_INFO: `/v3/projects/cbba879822dc45248651e86cd13b3098` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:53.986221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbba879822dc45248651e86cd13b3098)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:53.986966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f1eb44fe-a498-42fb-b458-6bdf9281557b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:53.988135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:54.058887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbba879822dc45248651e86cd13b3098', 'request_id': 'req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.065090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbba879822dc45248651e86cd13b3098', 'request_id': 'req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.072909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbba879822dc45248651e86cd13b3098', 'request_id': 'req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.078708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb44fe-a498-42fb-b458-6bdf9281557b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:54.080697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb44fe-a498-42fb-b458-6bdf9281557b service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:54.084436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] The token cache is being invalidate because project cbba879822dc45248651e86cd13b3098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:54.084731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.085416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.086938 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 868/1744] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:53 2022] DELETE /identity/v3/projects/cbba879822dc45248651e86cd13b3098 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:54.087691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:54.090757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:54.092286 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 877/1745] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:54.093049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb44fe-a498-42fb-b458-6bdf9281557b service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:54.094454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f1eb44fe-a498-42fb-b458-6bdf9281557b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:54.107572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb44fe-a498-42fb-b458-6bdf9281557b service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:54.155418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:54.170956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:54.171518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:54.171848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:54.172128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] PATH_INFO: `/v3/projects/16ed7e54ce43428a8b9cb71e5b008b6c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:54.173280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ed7e54ce43428a8b9cb71e5b008b6c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:54.173424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39cb72-03f5-4dce-bc54-87efbb1e98b3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:54.175389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:54.178986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f7f8b-e394-4587-9997-0a83ec912e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:54.179848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f7f8b-e394-4587-9997-0a83ec912e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:54.180148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f7f8b-e394-4587-9997-0a83ec912e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:54.180488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f7f8b-e394-4587-9997-0a83ec912e8e admin admin] PATH_INFO: `/v3/projects/d86a4df4999c46ca9ec190e5c4336bca/users/d70255def58b4d4c8650db525a7b477e/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:54.199784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f7f8b-e394-4587-9997-0a83ec912e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86a4df4999c46ca9ec190e5c4336bca, user_id=d70255def58b4d4c8650db525a7b477e, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:54.202654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f7f8b-e394-4587-9997-0a83ec912e8e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:54.210763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:54.218199 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 869/1746] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:54 2022] PUT /identity/v3/projects/d86a4df4999c46ca9ec190e5c4336bca/users/d70255def58b4d4c8650db525a7b477e/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:54.219321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f7f8b-e394-4587-9997-0a83ec912e8e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:54.225611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-710f7f8b-e394-4587-9997-0a83ec912e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:54.235734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ed7e54ce43428a8b9cb71e5b008b6c', 'request_id': 'req-69350f6d-8958-480d-a832-0c57089bbcb4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.242638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ed7e54ce43428a8b9cb71e5b008b6c', 'request_id': 'req-69350f6d-8958-480d-a832-0c57089bbcb4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.255808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ed7e54ce43428a8b9cb71e5b008b6c', 'request_id': 'req-69350f6d-8958-480d-a832-0c57089bbcb4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.270517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] The token cache is being invalidate because project 16ed7e54ce43428a8b9cb71e5b008b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:54.271012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.272088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.274240 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 878/1747] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:54 2022] DELETE /identity/v3/projects/16ed7e54ce43428a8b9cb71e5b008b6c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:54.275212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:54.278870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:54.322728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f7f8b-e394-4587-9997-0a83ec912e8e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:54.382678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69350f6d-8958-480d-a832-0c57089bbcb4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:54.390190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:54.391271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:54.391779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:54.392226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] PATH_INFO: `/v3/users/433207cce2e443bd914ffc00e1cf71bb` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:54.393971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=433207cce2e443bd914ffc00e1cf71bb)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:54.397346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:54.416846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba4b66-4200-4a11-aec4-2e1ee62aad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:54.417813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba4b66-4200-4a11-aec4-2e1ee62aad8c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:54.418267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba4b66-4200-4a11-aec4-2e1ee62aad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:54.418720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba4b66-4200-4a11-aec4-2e1ee62aad8c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:54.419794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba4b66-4200-4a11-aec4-2e1ee62aad8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:54.422667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba4b66-4200-4a11-aec4-2e1ee62aad8c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:54.442536 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 870/1748] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:54.442536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba4b66-4200-4a11-aec4-2e1ee62aad8c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:54.442536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-beba4b66-4200-4a11-aec4-2e1ee62aad8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:54.462931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba4b66-4200-4a11-aec4-2e1ee62aad8c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:54.470056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '433207cce2e443bd914ffc00e1cf71bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.470324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:54.471555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '433207cce2e443bd914ffc00e1cf71bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.471829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:54.472276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:54.472725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] PATH_INFO: `/v3/projects/f94f5e1f77554fab82090bde2789ee20` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:54.474487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f94f5e1f77554fab82090bde2789ee20)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:54.477807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:54.489471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '433207cce2e443bd914ffc00e1cf71bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.504372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '433207cce2e443bd914ffc00e1cf71bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.513944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '433207cce2e443bd914ffc00e1cf71bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.525465 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 879/1749] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:54 2022] DELETE /identity/v3/users/433207cce2e443bd914ffc00e1cf71bb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:54.525465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:54.525465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:54.562943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f94f5e1f77554fab82090bde2789ee20', 'request_id': 'req-8751ae94-3e60-49e5-b403-b533e5d85f9b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.575281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:54.587846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f94f5e1f77554fab82090bde2789ee20', 'request_id': 'req-8751ae94-3e60-49e5-b403-b533e5d85f9b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.608906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f94f5e1f77554fab82090bde2789ee20', 'request_id': 'req-8751ae94-3e60-49e5-b403-b533e5d85f9b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.617634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1970e-b082-4944-8dfc-f031ffbb5db9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:54.636571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] The token cache is being invalidate because project f94f5e1f77554fab82090bde2789ee20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:54.639889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.641409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8751ae94-3e60-49e5-b403-b533e5d85f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.645453 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 871/1750] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:54 2022] DELETE /identity/v3/projects/f94f5e1f77554fab82090bde2789ee20 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:54.646774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b7a5-1bfb-4899-a2f6-fa6b7a85cbb5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:54.647057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b7a5-1bfb-4899-a2f6-fa6b7a85cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:54.647327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b7a5-1bfb-4899-a2f6-fa6b7a85cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:54.656077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:54.699923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8605b7a5-1bfb-4899-a2f6-fa6b7a85cbb5 None None] MFA Rules not processed for user `d70255def58b4d4c8650db525a7b477e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:54.702244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8605b7a5-1bfb-4899-a2f6-fa6b7a85cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:54.707107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:54.708042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:54.708331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:54.708640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] PATH_INFO: `/v3/users/0f9714332bd4429bbc98fac1b1ea077e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:54.710131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9714332bd4429bbc98fac1b1ea077e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:54.712446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:54.781417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9714332bd4429bbc98fac1b1ea077e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.782380 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 872/1751] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:54 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:54.783143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605b7a5-1bfb-4899-a2f6-fa6b7a85cbb5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:54.784537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8605b7a5-1bfb-4899-a2f6-fa6b7a85cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:54.785608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9714332bd4429bbc98fac1b1ea077e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.799468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605b7a5-1bfb-4899-a2f6-fa6b7a85cbb5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:54.800648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9714332bd4429bbc98fac1b1ea077e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.805022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe1fa-225e-425b-9b2a-c9a368ffc35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:54.805674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe1fa-225e-425b-9b2a-c9a368ffc35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:54.805958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe1fa-225e-425b-9b2a-c9a368ffc35b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:54.806307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe1fa-225e-425b-9b2a-c9a368ffc35b admin admin] PATH_INFO: `/v3/users/e221ec043ced4adc8a199c44abc4b8ee` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:54.807497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abe1fa-225e-425b-9b2a-c9a368ffc35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e221ec043ced4adc8a199c44abc4b8ee)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:54.809545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abe1fa-225e-425b-9b2a-c9a368ffc35b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:54.810069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9714332bd4429bbc98fac1b1ea077e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.819276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9714332bd4429bbc98fac1b1ea077e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.827175 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 880/1752] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:54 2022] DELETE /identity/v3/users/0f9714332bd4429bbc98fac1b1ea077e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:54.828349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:54.831640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:54.869663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a0abe1fa-225e-425b-9b2a-c9a368ffc35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e221ec043ced4adc8a199c44abc4b8ee'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.870445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a0abe1fa-225e-425b-9b2a-c9a368ffc35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e221ec043ced4adc8a199c44abc4b8ee'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.886671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a0abe1fa-225e-425b-9b2a-c9a368ffc35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e221ec043ced4adc8a199c44abc4b8ee'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.887413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a0abe1fa-225e-425b-9b2a-c9a368ffc35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e221ec043ced4adc8a199c44abc4b8ee'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.895599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a0abe1fa-225e-425b-9b2a-c9a368ffc35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e221ec043ced4adc8a199c44abc4b8ee'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:54.911252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e65894-187c-4dff-b05c-4b69d4b059be admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:54.913651 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 873/1753] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:54 2022] DELETE /identity/v3/users/e221ec043ced4adc8a199c44abc4b8ee => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:54.915844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c12593-38c6-405f-bba1-ea3011d7441a None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:54.916286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c12593-38c6-405f-bba1-ea3011d7441a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:54.917925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c12593-38c6-405f-bba1-ea3011d7441a None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:54.920131 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 874/1754] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:25:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:25:54.920750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:54.922580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a732b0-cae5-4574-b1e2-25e098bb1131 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:54.922976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a732b0-cae5-4574-b1e2-25e098bb1131 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:54.925201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a732b0-cae5-4574-b1e2-25e098bb1131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:54.953276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-42a732b0-cae5-4574-b1e2-25e098bb1131 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:54.954833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-42a732b0-cae5-4574-b1e2-25e098bb1131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.020405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a90219-65d1-4d7a-af2c-363296d248e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:55.021265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a90219-65d1-4d7a-af2c-363296d248e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.022219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a90219-65d1-4d7a-af2c-363296d248e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.022503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a90219-65d1-4d7a-af2c-363296d248e8 admin admin] PATH_INFO: `/v3/projects/e9f7e323b1b0435fb2bc62f5263ecba4/users/f9a8c677a5634e82b0b1907787bad4c4/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.047086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a90219-65d1-4d7a-af2c-363296d248e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f7e323b1b0435fb2bc62f5263ecba4, user_id=f9a8c677a5634e82b0b1907787bad4c4, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:55.051067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a90219-65d1-4d7a-af2c-363296d248e8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:55.054413 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 875/1755] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:55.055539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a732b0-cae5-4574-b1e2-25e098bb1131 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:55.057020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-42a732b0-cae5-4574-b1e2-25e098bb1131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.073942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:55.082264 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 881/1756] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:54 2022] PUT /identity/v3/projects/e9f7e323b1b0435fb2bc62f5263ecba4/users/f9a8c677a5634e82b0b1907787bad4c4/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:55.090825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a90219-65d1-4d7a-af2c-363296d248e8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:55.092630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e4a90219-65d1-4d7a-af2c-363296d248e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.189545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a732b0-cae5-4574-b1e2-25e098bb1131 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:55.210289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a90219-65d1-4d7a-af2c-363296d248e8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:55.217652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f052f-43ca-4fda-91b2-cf31bf16aaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:55.219917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f052f-43ca-4fda-91b2-cf31bf16aaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.220926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f052f-43ca-4fda-91b2-cf31bf16aaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.221537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f052f-43ca-4fda-91b2-cf31bf16aaf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.222892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f052f-43ca-4fda-91b2-cf31bf16aaf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:55.226479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f052f-43ca-4fda-91b2-cf31bf16aaf2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:55.272295 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 882/1757] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:55 2022] POST /identity/v3/projects => generated 409 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:55.279859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8e225-fc32-4609-bbf1-3cb9ac59e369 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.280158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8e225-fc32-4609-bbf1-3cb9ac59e369 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.280441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8e225-fc32-4609-bbf1-3cb9ac59e369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.297719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6d5bc-cfe8-410f-8f99-2d0d62c12fb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:55.298345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6d5bc-cfe8-410f-8f99-2d0d62c12fb8 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.298862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6d5bc-cfe8-410f-8f99-2d0d62c12fb8 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.299135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6d5bc-cfe8-410f-8f99-2d0d62c12fb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.301420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1be6d5bc-cfe8-410f-8f99-2d0d62c12fb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.314294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6d5bc-cfe8-410f-8f99-2d0d62c12fb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:55.315961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6d5bc-cfe8-410f-8f99-2d0d62c12fb8 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:55.316862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-70a8e225-fc32-4609-bbf1-3cb9ac59e369 None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:55.319519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-70a8e225-fc32-4609-bbf1-3cb9ac59e369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.326749 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 876/1758] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:55.327587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6d5bc-cfe8-410f-8f99-2d0d62c12fb8 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:55.329004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1be6d5bc-cfe8-410f-8f99-2d0d62c12fb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.346704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6d5bc-cfe8-410f-8f99-2d0d62c12fb8 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:55.409080 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 883/1759] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:25:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:55.410494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3810ea-bf0d-43b3-872e-b96ee0c4f11b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.410778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3810ea-bf0d-43b3-872e-b96ee0c4f11b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.411055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3810ea-bf0d-43b3-872e-b96ee0c4f11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.424306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:55.425206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.425555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.425830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] PATH_INFO: `/v3/projects/654ab98aa56a4cdfaabecf590a0ac49b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.426673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:55.427007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=654ab98aa56a4cdfaabecf590a0ac49b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:55.428993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:55.434411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6b3810ea-bf0d-43b3-872e-b96ee0c4f11b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:55.436569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6b3810ea-bf0d-43b3-872e-b96ee0c4f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.445421 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 884/1760] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:55.446766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6abc1-e579-44eb-b2eb-b371c79d8fb5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.447160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6abc1-e579-44eb-b2eb-b371c79d8fb5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.447533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6abc1-e579-44eb-b2eb-b371c79d8fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.479918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b1d6abc1-e579-44eb-b2eb-b371c79d8fb5 None None] MFA Rules not processed for user `f9a8c677a5634e82b0b1907787bad4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:55.480969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:55.481191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b1d6abc1-e579-44eb-b2eb-b371c79d8fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.491974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654ab98aa56a4cdfaabecf590a0ac49b', 'request_id': 'req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.505895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654ab98aa56a4cdfaabecf590a0ac49b', 'request_id': 'req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.519331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654ab98aa56a4cdfaabecf590a0ac49b', 'request_id': 'req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.538298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] The token cache is being invalidate because project 654ab98aa56a4cdfaabecf590a0ac49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:55.538298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.538298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.538298 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 877/1761] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:55 2022] DELETE /identity/v3/projects/654ab98aa56a4cdfaabecf590a0ac49b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:55.538844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:55.540331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.565019 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 885/1762] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:55.566165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6abc1-e579-44eb-b2eb-b371c79d8fb5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:55.567548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b1d6abc1-e579-44eb-b2eb-b371c79d8fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.623370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a7b3c-0187-4972-b470-7dec4eeb3d7c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:55.629961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87488b-1838-46a2-bed9-97468b006452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:55.630643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87488b-1838-46a2-bed9-97468b006452 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.630961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87488b-1838-46a2-bed9-97468b006452 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.631281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87488b-1838-46a2-bed9-97468b006452 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.632024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87488b-1838-46a2-bed9-97468b006452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:55.634416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87488b-1838-46a2-bed9-97468b006452 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:55.638593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6abc1-e579-44eb-b2eb-b371c79d8fb5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:55.644165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:55.644843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.645124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.645418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] PATH_INFO: `/v3/projects/2aab5fe07c7f42b29724121b6ba805d0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.646764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aab5fe07c7f42b29724121b6ba805d0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:55.648745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:55.663346 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 878/1763] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:55 2022] POST /identity/v3/users => generated 311 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:55.663346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87488b-1838-46a2-bed9-97468b006452 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:55.665096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7b87488b-1838-46a2-bed9-97468b006452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.682124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87488b-1838-46a2-bed9-97468b006452 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:55.687330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:55.687861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.688142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.688426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] PATH_INFO: `/v3/projects/a3571b439c6c482f9cac62cda8b8733e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.690213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3571b439c6c482f9cac62cda8b8733e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:55.692147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:55.718602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aab5fe07c7f42b29724121b6ba805d0', 'request_id': 'req-1981f974-faeb-481f-9ffb-7dc44137dd34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.725030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aab5fe07c7f42b29724121b6ba805d0', 'request_id': 'req-1981f974-faeb-481f-9ffb-7dc44137dd34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.735565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aab5fe07c7f42b29724121b6ba805d0', 'request_id': 'req-1981f974-faeb-481f-9ffb-7dc44137dd34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.750155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] The token cache is being invalidate because project 2aab5fe07c7f42b29724121b6ba805d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:55.750675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.751528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.755445 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 886/1764] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:55 2022] DELETE /identity/v3/projects/2aab5fe07c7f42b29724121b6ba805d0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:55.756673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:55.760730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3571b439c6c482f9cac62cda8b8733e', 'request_id': 'req-ac510f89-7625-43ce-b515-61d78dac17e4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.764353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.769076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3571b439c6c482f9cac62cda8b8733e', 'request_id': 'req-ac510f89-7625-43ce-b515-61d78dac17e4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.780723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3571b439c6c482f9cac62cda8b8733e', 'request_id': 'req-ac510f89-7625-43ce-b515-61d78dac17e4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.792883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] The token cache is being invalidate because project a3571b439c6c482f9cac62cda8b8733e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:25:55.793224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.794093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:55.795729 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 879/1765] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:25:55 2022] DELETE /identity/v3/projects/a3571b439c6c482f9cac62cda8b8733e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:55.795863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:55.796383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:55.798738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.847458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981f974-faeb-481f-9ffb-7dc44137dd34 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:55.854036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:55.886911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac510f89-7625-43ce-b515-61d78dac17e4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:55.893142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620ca88-9c49-4f78-8697-df730bf5cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:55.894142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620ca88-9c49-4f78-8697-df730bf5cc72 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.894617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620ca88-9c49-4f78-8697-df730bf5cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.895122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620ca88-9c49-4f78-8697-df730bf5cc72 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.897953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620ca88-9c49-4f78-8697-df730bf5cc72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:55.898337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620ca88-9c49-4f78-8697-df730bf5cc72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:55.902140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620ca88-9c49-4f78-8697-df730bf5cc72 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:55.910742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df3430-f4d3-4af8-8f45-83041e279ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:55.911302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3430-f4d3-4af8-8f45-83041e279ccf service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.911612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3430-f4d3-4af8-8f45-83041e279ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.911860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3430-f4d3-4af8-8f45-83041e279ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.915894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-73df3430-f4d3-4af8-8f45-83041e279ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.924301 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 880/1766] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:55.924301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6996d75-005d-4652-b2f4-f3aced91a934 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.924301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6996d75-005d-4652-b2f4-f3aced91a934 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.924301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6996d75-005d-4652-b2f4-f3aced91a934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.946101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b6996d75-005d-4652-b2f4-f3aced91a934 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:55.947308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b6996d75-005d-4652-b2f4-f3aced91a934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.957484 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 881/1767] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:55.958930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6996d75-005d-4652-b2f4-f3aced91a934 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:55.961115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b6996d75-005d-4652-b2f4-f3aced91a934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:55.982230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6996d75-005d-4652-b2f4-f3aced91a934 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:55.990929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a008-e7ed-475f-906d-63b688176861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:55.991934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a008-e7ed-475f-906d-63b688176861 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:55.992420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a008-e7ed-475f-906d-63b688176861 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:55.992909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a008-e7ed-475f-906d-63b688176861 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:55.993922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64a008-e7ed-475f-906d-63b688176861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:55.997800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64a008-e7ed-475f-906d-63b688176861 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.021761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df3430-f4d3-4af8-8f45-83041e279ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.023436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df3430-f4d3-4af8-8f45-83041e279ccf service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.037875 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 887/1768] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:56.038858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df3430-f4d3-4af8-8f45-83041e279ccf service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.040192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-73df3430-f4d3-4af8-8f45-83041e279ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:56.049608 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 882/1769] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:55 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:56.049608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818838ce-0603-4b4f-9954-31f4ff236348 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.049608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818838ce-0603-4b4f-9954-31f4ff236348 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.049608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818838ce-0603-4b4f-9954-31f4ff236348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.062503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df3430-f4d3-4af8-8f45-83041e279ccf service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.073010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-818838ce-0603-4b4f-9954-31f4ff236348 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:56.074192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-818838ce-0603-4b4f-9954-31f4ff236348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:56.159123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be468ae-a8b0-492c-8e25-0fbc9e249dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.159123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be468ae-a8b0-492c-8e25-0fbc9e249dff admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.159123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be468ae-a8b0-492c-8e25-0fbc9e249dff admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.159825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be468ae-a8b0-492c-8e25-0fbc9e249dff admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.160291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be468ae-a8b0-492c-8e25-0fbc9e249dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.161977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be468ae-a8b0-492c-8e25-0fbc9e249dff admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.176112 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 888/1770] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:56.184054 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 883/1771] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:56.184911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818838ce-0603-4b4f-9954-31f4ff236348 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.192172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e536-15ba-4ffd-a5b0-7037b0435a31 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.192792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e536-15ba-4ffd-a5b0-7037b0435a31 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.193304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e536-15ba-4ffd-a5b0-7037b0435a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.199479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818838ce-0603-4b4f-9954-31f4ff236348 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.207136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fd9e0-84ea-4d8b-b42a-fca2b5dd6179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.207936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fd9e0-84ea-4d8b-b42a-fca2b5dd6179 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.209498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fd9e0-84ea-4d8b-b42a-fca2b5dd6179 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.209791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fd9e0-84ea-4d8b-b42a-fca2b5dd6179 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.210452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fd9e0-84ea-4d8b-b42a-fca2b5dd6179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.212462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fd9e0-84ea-4d8b-b42a-fca2b5dd6179 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.227403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-24e0e536-15ba-4ffd-a5b0-7037b0435a31 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:56.229631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-24e0e536-15ba-4ffd-a5b0-7037b0435a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:56.244232 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 889/1772] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:56.246625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbbeff-ff81-4547-824b-3b44079f4dd7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.247129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbbeff-ff81-4547-824b-3b44079f4dd7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.247649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbbeff-ff81-4547-824b-3b44079f4dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.262838 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 884/1773] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/projects => generated 395 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:56.264282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fd9e0-84ea-4d8b-b42a-fca2b5dd6179 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.280549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:56.298647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b7cbbeff-ff81-4547-824b-3b44079f4dd7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:56.300845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b7cbbeff-ff81-4547-824b-3b44079f4dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:56.351863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fd9e0-84ea-4d8b-b42a-fca2b5dd6179 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.356942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc8aeb-de25-476f-95c1-09df3183b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.357588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc8aeb-de25-476f-95c1-09df3183b104 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.357869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc8aeb-de25-476f-95c1-09df3183b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.358141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc8aeb-de25-476f-95c1-09df3183b104 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.358797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc8aeb-de25-476f-95c1-09df3183b104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.360718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc8aeb-de25-476f-95c1-09df3183b104 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.386531 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 890/1774] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:56.386531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbbeff-ff81-4547-824b-3b44079f4dd7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.386881 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 885/1775] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:56.386881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e619-66a8-4b99-9f30-6ef226cf8d10 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.386881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e619-66a8-4b99-9f30-6ef226cf8d10 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.386881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e619-66a8-4b99-9f30-6ef226cf8d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.398257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbbeff-ff81-4547-824b-3b44079f4dd7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.403292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cf808-b1ce-462a-98d8-cc8b26c5e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.404265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cf808-b1ce-462a-98d8-cc8b26c5e9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.404502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cf808-b1ce-462a-98d8-cc8b26c5e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.404776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cf808-b1ce-462a-98d8-cc8b26c5e9ef admin admin] PATH_INFO: `/v3/projects/e604744efbae4cfc907f31721303edf4/users/586d62c680f1413989b5de1f48fb220c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.408158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a0f9e619-66a8-4b99-9f30-6ef226cf8d10 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:56.409398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a0f9e619-66a8-4b99-9f30-6ef226cf8d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:56.417729 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 886/1776] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:56.418947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ab5c1-4074-45ed-a550-01a64fbc875c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.419231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ab5c1-4074-45ed-a550-01a64fbc875c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.419510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ab5c1-4074-45ed-a550-01a64fbc875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.423758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cf808-b1ce-462a-98d8-cc8b26c5e9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e604744efbae4cfc907f31721303edf4, user_id=586d62c680f1413989b5de1f48fb220c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.426469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cf808-b1ce-462a-98d8-cc8b26c5e9ef admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.435547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:56.443465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-013ab5c1-4074-45ed-a550-01a64fbc875c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:56.445445 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 891/1777] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:56 2022] PUT /identity/v3/projects/e604744efbae4cfc907f31721303edf4/users/586d62c680f1413989b5de1f48fb220c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:56.446333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cf808-b1ce-462a-98d8-cc8b26c5e9ef admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.446492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-013ab5c1-4074-45ed-a550-01a64fbc875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:56.519556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cf808-b1ce-462a-98d8-cc8b26c5e9ef admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.522173 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 887/1778] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:56.522854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ab5c1-4074-45ed-a550-01a64fbc875c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.526118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b5b34-afe7-4089-b6a8-22ba5dca369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.526739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5b34-afe7-4089-b6a8-22ba5dca369d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.527022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5b34-afe7-4089-b6a8-22ba5dca369d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.527410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5b34-afe7-4089-b6a8-22ba5dca369d admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.527934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b5b34-afe7-4089-b6a8-22ba5dca369d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.530190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b5b34-afe7-4089-b6a8-22ba5dca369d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.532874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ab5c1-4074-45ed-a550-01a64fbc875c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.538350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6673e7-bb94-4098-a762-9867afca7ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.538530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6673e7-bb94-4098-a762-9867afca7ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.539067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6673e7-bb94-4098-a762-9867afca7ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.539500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6673e7-bb94-4098-a762-9867afca7ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.540656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6673e7-bb94-4098-a762-9867afca7ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.542460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6673e7-bb94-4098-a762-9867afca7ed2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.554121 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 888/1779] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:56.554974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6673e7-bb94-4098-a762-9867afca7ed2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.559687 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 892/1780] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:56.559687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b5b34-afe7-4089-b6a8-22ba5dca369d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.570592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6673e7-bb94-4098-a762-9867afca7ed2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.571112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b5b34-afe7-4089-b6a8-22ba5dca369d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.575462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ea67-7b1e-48c2-a6aa-ca3186b63d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.576179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ea67-7b1e-48c2-a6aa-ca3186b63d74 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.576294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7fdd5-0dc8-4def-aab7-316ee093208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.576634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ea67-7b1e-48c2-a6aa-ca3186b63d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.576834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7fdd5-0dc8-4def-aab7-316ee093208d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.577085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ea67-7b1e-48c2-a6aa-ca3186b63d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.577181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7fdd5-0dc8-4def-aab7-316ee093208d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.577379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7fdd5-0dc8-4def-aab7-316ee093208d admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.578030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ea67-7b1e-48c2-a6aa-ca3186b63d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:56.578136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7fdd5-0dc8-4def-aab7-316ee093208d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:56.578351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7fdd5-0dc8-4def-aab7-316ee093208d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.578568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ea67-7b1e-48c2-a6aa-ca3186b63d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.581029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7fdd5-0dc8-4def-aab7-316ee093208d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.581259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ea67-7b1e-48c2-a6aa-ca3186b63d74 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.595975 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 889/1781] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:56.596299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ea67-7b1e-48c2-a6aa-ca3186b63d74 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.596823 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 893/1782] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:56.597836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7fdd5-0dc8-4def-aab7-316ee093208d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.609703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7fdd5-0dc8-4def-aab7-316ee093208d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.610331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ea67-7b1e-48c2-a6aa-ca3186b63d74 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.614516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3924d-8bd8-4bc6-adb5-78cfc2ca02ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.615374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad8d5f-deab-4124-9264-7daad7545cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.615895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3924d-8bd8-4bc6-adb5-78cfc2ca02ea admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.615996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad8d5f-deab-4124-9264-7daad7545cdc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.616189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3924d-8bd8-4bc6-adb5-78cfc2ca02ea admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.616283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad8d5f-deab-4124-9264-7daad7545cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.616474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3924d-8bd8-4bc6-adb5-78cfc2ca02ea admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.616652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad8d5f-deab-4124-9264-7daad7545cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.617132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3924d-8bd8-4bc6-adb5-78cfc2ca02ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:25:56.617225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad8d5f-deab-4124-9264-7daad7545cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.617470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3924d-8bd8-4bc6-adb5-78cfc2ca02ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.618997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad8d5f-deab-4124-9264-7daad7545cdc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.619111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3924d-8bd8-4bc6-adb5-78cfc2ca02ea admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.630232 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 890/1783] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:56.631036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad8d5f-deab-4124-9264-7daad7545cdc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.635039 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 894/1784] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:25:56.635039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3924d-8bd8-4bc6-adb5-78cfc2ca02ea admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.641162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad8d5f-deab-4124-9264-7daad7545cdc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.644717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3924d-8bd8-4bc6-adb5-78cfc2ca02ea admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.646467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7530b76-8823-4b31-8cdb-3d1e60c76f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.647116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530b76-8823-4b31-8cdb-3d1e60c76f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.647391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530b76-8823-4b31-8cdb-3d1e60c76f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.647662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530b76-8823-4b31-8cdb-3d1e60c76f00 admin admin] PATH_INFO: `/v3/projects/685766f5a0e14feabd67f3628cc59b0c/users/a3228dc648134e32ad1f2f142c95ca26/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.649524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12166af-7d17-4256-b2f4-dc5a7cb44758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.650128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12166af-7d17-4256-b2f4-dc5a7cb44758 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.650409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12166af-7d17-4256-b2f4-dc5a7cb44758 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.650688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12166af-7d17-4256-b2f4-dc5a7cb44758 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.651326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12166af-7d17-4256-b2f4-dc5a7cb44758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.652953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12166af-7d17-4256-b2f4-dc5a7cb44758 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.663253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7530b76-8823-4b31-8cdb-3d1e60c76f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=685766f5a0e14feabd67f3628cc59b0c, user_id=a3228dc648134e32ad1f2f142c95ca26, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.664594 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 895/1785] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:56.665479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12166af-7d17-4256-b2f4-dc5a7cb44758 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.665963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7530b76-8823-4b31-8cdb-3d1e60c76f00 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.675787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12166af-7d17-4256-b2f4-dc5a7cb44758 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.681117 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 891/1786] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:56 2022] PUT /identity/v3/projects/685766f5a0e14feabd67f3628cc59b0c/users/a3228dc648134e32ad1f2f142c95ca26/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:56.682020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7530b76-8823-4b31-8cdb-3d1e60c76f00 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.710449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:56.737259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea657e-d9a2-42e6-baab-d51675eeab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.737907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea657e-d9a2-42e6-baab-d51675eeab23 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.738191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea657e-d9a2-42e6-baab-d51675eeab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.738475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea657e-d9a2-42e6-baab-d51675eeab23 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.739111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea657e-d9a2-42e6-baab-d51675eeab23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.741008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea657e-d9a2-42e6-baab-d51675eeab23 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.750314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7530b76-8823-4b31-8cdb-3d1e60c76f00 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.756234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac740b44-7b86-446a-9d8f-8fa46c0fbb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.756850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac740b44-7b86-446a-9d8f-8fa46c0fbb43 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.757126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac740b44-7b86-446a-9d8f-8fa46c0fbb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.757426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac740b44-7b86-446a-9d8f-8fa46c0fbb43 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.758083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac740b44-7b86-446a-9d8f-8fa46c0fbb43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.760041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac740b44-7b86-446a-9d8f-8fa46c0fbb43 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.772121 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 896/1787] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:56.772871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea657e-d9a2-42e6-baab-d51675eeab23 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.793454 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 892/1788] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:56.793454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac740b44-7b86-446a-9d8f-8fa46c0fbb43 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.829581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:56.850944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea657e-d9a2-42e6-baab-d51675eeab23 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.865121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac740b44-7b86-446a-9d8f-8fa46c0fbb43 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:56.871293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a824738-bd11-40f1-ac19-d206de286514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.871927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a824738-bd11-40f1-ac19-d206de286514 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.872203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a824738-bd11-40f1-ac19-d206de286514 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.872477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a824738-bd11-40f1-ac19-d206de286514 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.873127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a824738-bd11-40f1-ac19-d206de286514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.875135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a824738-bd11-40f1-ac19-d206de286514 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.907407 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 893/1789] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:56 2022] POST /identity/v3/projects => generated 401 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:56.908470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a824738-bd11-40f1-ac19-d206de286514 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.925691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cdea7-85f0-4928-8b05-0b86b4dfe209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:56.926431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cdea7-85f0-4928-8b05-0b86b4dfe209 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:56.927653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cdea7-85f0-4928-8b05-0b86b4dfe209 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:56.927653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cdea7-85f0-4928-8b05-0b86b4dfe209 admin admin] PATH_INFO: `/v3/projects/e604744efbae4cfc907f31721303edf4/users/586d62c680f1413989b5de1f48fb220c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:56.929830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cdea7-85f0-4928-8b05-0b86b4dfe209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e604744efbae4cfc907f31721303edf4, user_id=586d62c680f1413989b5de1f48fb220c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:56.933087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cdea7-85f0-4928-8b05-0b86b4dfe209 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:56.955935 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 897/1790] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:56 2022] PUT /identity/v3/projects/e604744efbae4cfc907f31721303edf4/users/586d62c680f1413989b5de1f48fb220c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:56.956984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cdea7-85f0-4928-8b05-0b86b4dfe209 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:56.990489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a824738-bd11-40f1-ac19-d206de286514 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.029042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cdea7-85f0-4928-8b05-0b86b4dfe209 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.034599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848abd4f-7eb8-4761-a07f-0d559a394b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.035475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848abd4f-7eb8-4761-a07f-0d559a394b09 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.035757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848abd4f-7eb8-4761-a07f-0d559a394b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.036032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848abd4f-7eb8-4761-a07f-0d559a394b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.036836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848abd4f-7eb8-4761-a07f-0d559a394b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.039069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848abd4f-7eb8-4761-a07f-0d559a394b09 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.041553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:57.068669 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 898/1791] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:57.069004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c57a7f-bf40-4eef-a95c-d7c5c1ddbd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.069749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848abd4f-7eb8-4761-a07f-0d559a394b09 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.070125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57a7f-bf40-4eef-a95c-d7c5c1ddbd17 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.070700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57a7f-bf40-4eef-a95c-d7c5c1ddbd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.071111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57a7f-bf40-4eef-a95c-d7c5c1ddbd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.072891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c57a7f-bf40-4eef-a95c-d7c5c1ddbd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.075681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c57a7f-bf40-4eef-a95c-d7c5c1ddbd17 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.084044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848abd4f-7eb8-4761-a07f-0d559a394b09 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.088722 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 894/1792] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:57.089590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c57a7f-bf40-4eef-a95c-d7c5c1ddbd17 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.092427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b69e9-2947-4e8c-bcd3-8027808e49ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.093112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b69e9-2947-4e8c-bcd3-8027808e49ee admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.093416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b69e9-2947-4e8c-bcd3-8027808e49ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.093695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b69e9-2947-4e8c-bcd3-8027808e49ee admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.094363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b69e9-2947-4e8c-bcd3-8027808e49ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.096405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b69e9-2947-4e8c-bcd3-8027808e49ee admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.100561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c57a7f-bf40-4eef-a95c-d7c5c1ddbd17 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.106108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d82e9e-f9e5-497e-8a13-091943d1e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.107090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d82e9e-f9e5-497e-8a13-091943d1e0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.107367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d82e9e-f9e5-497e-8a13-091943d1e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.107971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d82e9e-f9e5-497e-8a13-091943d1e0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.108601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d82e9e-f9e5-497e-8a13-091943d1e0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.110805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d82e9e-f9e5-497e-8a13-091943d1e0b6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.124292 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 899/1793] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:57 2022] POST /identity/v3/users => generated 287 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:57.125205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b69e9-2947-4e8c-bcd3-8027808e49ee admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.136202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b69e9-2947-4e8c-bcd3-8027808e49ee admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.141789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae1a24-d641-48a8-b1cd-ff4ccb1fbfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.142573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1a24-d641-48a8-b1cd-ff4ccb1fbfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.142925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1a24-d641-48a8-b1cd-ff4ccb1fbfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.143138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1a24-d641-48a8-b1cd-ff4ccb1fbfd4 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.143761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae1a24-d641-48a8-b1cd-ff4ccb1fbfd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.144743 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 895/1794] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:57 2022] POST /identity/v3/users => generated 295 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:57.145534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922db60b-6373-4e6c-8689-c5fab5f88994 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.145748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae1a24-d641-48a8-b1cd-ff4ccb1fbfd4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.146020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922db60b-6373-4e6c-8689-c5fab5f88994 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.146390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922db60b-6373-4e6c-8689-c5fab5f88994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.181540 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 900/1795] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:57 2022] POST /identity/v3/users => generated 301 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:57.181540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae1a24-d641-48a8-b1cd-ff4ccb1fbfd4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.196569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae1a24-d641-48a8-b1cd-ff4ccb1fbfd4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.201901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be44891-64ff-4878-a2e7-b793e384b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.202575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44891-64ff-4878-a2e7-b793e384b38c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.203000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44891-64ff-4878-a2e7-b793e384b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.203278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44891-64ff-4878-a2e7-b793e384b38c admin admin] PATH_INFO: `/v3/projects/685766f5a0e14feabd67f3628cc59b0c/users/a3228dc648134e32ad1f2f142c95ca26/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.207041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be44891-64ff-4878-a2e7-b793e384b38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=685766f5a0e14feabd67f3628cc59b0c, user_id=a3228dc648134e32ad1f2f142c95ca26, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.209842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be44891-64ff-4878-a2e7-b793e384b38c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.216453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-922db60b-6373-4e6c-8689-c5fab5f88994 None None] MFA Rules not processed for user `586d62c680f1413989b5de1f48fb220c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:57.217660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-922db60b-6373-4e6c-8689-c5fab5f88994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:57.222557 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 901/1796] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:57 2022] PUT /identity/v3/projects/685766f5a0e14feabd67f3628cc59b0c/users/a3228dc648134e32ad1f2f142c95ca26/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:57.223517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be44891-64ff-4878-a2e7-b793e384b38c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.259613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:57.297055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be44891-64ff-4878-a2e7-b793e384b38c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.301917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793268ed-8bf7-41c4-99a4-836c3b3f5246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.302597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793268ed-8bf7-41c4-99a4-836c3b3f5246 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.302923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793268ed-8bf7-41c4-99a4-836c3b3f5246 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.303155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793268ed-8bf7-41c4-99a4-836c3b3f5246 admin admin] PATH_INFO: `/v3/projects/031d3a19bd9b4f288395ce8732981dd5/users/4e0b4768f010461b8a0417f90e14b01b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.304677 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 896/1797] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:57 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:57.305798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922db60b-6373-4e6c-8689-c5fab5f88994 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.320606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793268ed-8bf7-41c4-99a4-836c3b3f5246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031d3a19bd9b4f288395ce8732981dd5, user_id=4e0b4768f010461b8a0417f90e14b01b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.323349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793268ed-8bf7-41c4-99a4-836c3b3f5246 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.323690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922db60b-6373-4e6c-8689-c5fab5f88994 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.335636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60aae92-2dd9-4a11-8623-471b87ae5243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.336287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aae92-2dd9-4a11-8623-471b87ae5243 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.336597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aae92-2dd9-4a11-8623-471b87ae5243 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.336927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aae92-2dd9-4a11-8623-471b87ae5243 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.337665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60aae92-2dd9-4a11-8623-471b87ae5243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.339264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60aae92-2dd9-4a11-8623-471b87ae5243 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.350711 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 897/1798] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:57.351578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60aae92-2dd9-4a11-8623-471b87ae5243 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.363536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60aae92-2dd9-4a11-8623-471b87ae5243 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.364203 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 902/1799] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:57 2022] PUT /identity/v3/projects/031d3a19bd9b4f288395ce8732981dd5/users/4e0b4768f010461b8a0417f90e14b01b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:57.365455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793268ed-8bf7-41c4-99a4-836c3b3f5246 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.428040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df4f2e-43ca-407f-a9b0-af7819b1060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.428758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4f2e-43ca-407f-a9b0-af7819b1060f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.429108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4f2e-43ca-407f-a9b0-af7819b1060f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.429416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4f2e-43ca-407f-a9b0-af7819b1060f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.430316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df4f2e-43ca-407f-a9b0-af7819b1060f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.431687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df4f2e-43ca-407f-a9b0-af7819b1060f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.433236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793268ed-8bf7-41c4-99a4-836c3b3f5246 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.438186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5914d42-9112-4542-9873-2747fcca1683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.440168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5914d42-9112-4542-9873-2747fcca1683 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.440168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5914d42-9112-4542-9873-2747fcca1683 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.440168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5914d42-9112-4542-9873-2747fcca1683 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.440791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5914d42-9112-4542-9873-2747fcca1683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.442521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5914d42-9112-4542-9873-2747fcca1683 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.445743 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 898/1800] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:57.445743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff386-0f3b-40ad-ad00-fab2eeb899cf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.445743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff386-0f3b-40ad-ad00-fab2eeb899cf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.445743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff386-0f3b-40ad-ad00-fab2eeb899cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.457435 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 903/1801] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:57.457435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414498c5-1f46-4817-b412-318c2af9f963 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.457435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414498c5-1f46-4817-b412-318c2af9f963 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.457435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414498c5-1f46-4817-b412-318c2af9f963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.477087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-995ff386-0f3b-40ad-ad00-fab2eeb899cf None None] MFA Rules not processed for user `a3228dc648134e32ad1f2f142c95ca26`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:57.480703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-995ff386-0f3b-40ad-ad00-fab2eeb899cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:57.506664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:57.518940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-414498c5-1f46-4817-b412-318c2af9f963 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:57.520122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-414498c5-1f46-4817-b412-318c2af9f963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:57.572961 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 899/1802] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:57.574153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff386-0f3b-40ad-ad00-fab2eeb899cf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.575643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-995ff386-0f3b-40ad-ad00-fab2eeb899cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:57.614177 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 904/1803] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:25:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:57.615063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414498c5-1f46-4817-b412-318c2af9f963 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.632452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414498c5-1f46-4817-b412-318c2af9f963 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.632630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:57.643629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75919bb-5e2f-440e-b6fe-ce5438aa5ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.644697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75919bb-5e2f-440e-b6fe-ce5438aa5ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.644988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75919bb-5e2f-440e-b6fe-ce5438aa5ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.645271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75919bb-5e2f-440e-b6fe-ce5438aa5ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.646332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75919bb-5e2f-440e-b6fe-ce5438aa5ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.649195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75919bb-5e2f-440e-b6fe-ce5438aa5ad7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.662793 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 905/1804] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:57.664768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d62b8-9088-45e0-96f8-00b47f3ab4fa None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.665068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d62b8-9088-45e0-96f8-00b47f3ab4fa None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.666518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d62b8-9088-45e0-96f8-00b47f3ab4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.671332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff386-0f3b-40ad-ad00-fab2eeb899cf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.679094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe064-1931-4db6-a60c-86de7fe223be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.680551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe064-1931-4db6-a60c-86de7fe223be service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.681502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe064-1931-4db6-a60c-86de7fe223be service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.681934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe064-1931-4db6-a60c-86de7fe223be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.701603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-648d62b8-9088-45e0-96f8-00b47f3ab4fa None None] MFA Rules not processed for user `4e0b4768f010461b8a0417f90e14b01b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:57.703373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-648d62b8-9088-45e0-96f8-00b47f3ab4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:57.768245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fe064-1931-4db6-a60c-86de7fe223be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.769895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fe064-1931-4db6-a60c-86de7fe223be service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.781906 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 906/1805] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:57.783640 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 900/1806] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:57 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:57.784101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d62b8-9088-45e0-96f8-00b47f3ab4fa None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.785417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe064-1931-4db6-a60c-86de7fe223be service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.796504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe064-1931-4db6-a60c-86de7fe223be service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.799553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d62b8-9088-45e0-96f8-00b47f3ab4fa None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.803010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cf6a5-7516-4fc4-a73b-d1ec4804a2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.803902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf6a5-7516-4fc4-a73b-d1ec4804a2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.805976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf6a5-7516-4fc4-a73b-d1ec4804a2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.806862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026720b-a7dc-4131-8552-149514a7ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.806862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026720b-a7dc-4131-8552-149514a7ff8f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.806862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026720b-a7dc-4131-8552-149514a7ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.806862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026720b-a7dc-4131-8552-149514a7ff8f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.808350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026720b-a7dc-4131-8552-149514a7ff8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.809357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cf6a5-7516-4fc4-a73b-d1ec4804a2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.809457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026720b-a7dc-4131-8552-149514a7ff8f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.810278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cf6a5-7516-4fc4-a73b-d1ec4804a2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.812695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cf6a5-7516-4fc4-a73b-d1ec4804a2b2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.824589 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 907/1807] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:57.825455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026720b-a7dc-4131-8552-149514a7ff8f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.830129 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 901/1808] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:57.830321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f026720b-a7dc-4131-8552-149514a7ff8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:57.830434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cf6a5-7516-4fc4-a73b-d1ec4804a2b2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.838816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cf6a5-7516-4fc4-a73b-d1ec4804a2b2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.844517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d0986-2744-474a-84ab-81f0b2d5e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.845535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0986-2744-474a-84ab-81f0b2d5e0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.845838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0986-2744-474a-84ab-81f0b2d5e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.846153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0986-2744-474a-84ab-81f0b2d5e0a1 admin admin] PATH_INFO: `/v3/projects/ace96a45a2344919b9835774836180a6/users/e942e9d4535b4fcca9bed0231785b85d/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.853426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026720b-a7dc-4131-8552-149514a7ff8f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.866328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6cc05-dfea-4eb4-bffc-16aa3547d2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.866965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6cc05-dfea-4eb4-bffc-16aa3547d2e2 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.867250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6cc05-dfea-4eb4-bffc-16aa3547d2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.869286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6cc05-dfea-4eb4-bffc-16aa3547d2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.869874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d0986-2744-474a-84ab-81f0b2d5e0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace96a45a2344919b9835774836180a6, user_id=e942e9d4535b4fcca9bed0231785b85d, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.872940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d0986-2744-474a-84ab-81f0b2d5e0a1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.883593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6cc05-dfea-4eb4-bffc-16aa3547d2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:57.885305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6cc05-dfea-4eb4-bffc-16aa3547d2e2 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:57.888586 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 902/1809] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:57 2022] PUT /identity/v3/projects/ace96a45a2344919b9835774836180a6/users/e942e9d4535b4fcca9bed0231785b85d/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:57.889604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d0986-2744-474a-84ab-81f0b2d5e0a1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.891190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e74d0986-2744-474a-84ab-81f0b2d5e0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:57.901751 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 908/1810] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:57.902546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6cc05-dfea-4eb4-bffc-16aa3547d2e2 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:57.914539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6cc05-dfea-4eb4-bffc-16aa3547d2e2 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:57.989147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:57.997723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e81cb2-5ae6-4b87-86b6-16ec7bc1086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:57.998438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e81cb2-5ae6-4b87-86b6-16ec7bc1086b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:57.998722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e81cb2-5ae6-4b87-86b6-16ec7bc1086b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:57.999000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e81cb2-5ae6-4b87-86b6-16ec7bc1086b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:57.999644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e81cb2-5ae6-4b87-86b6-16ec7bc1086b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:58.001651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e81cb2-5ae6-4b87-86b6-16ec7bc1086b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:58.017097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d0986-2744-474a-84ab-81f0b2d5e0a1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:58.024633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f4d2e-c662-4a4e-b46e-45645d7fae40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:58.025471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4d2e-c662-4a4e-b46e-45645d7fae40 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:58.025936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4d2e-c662-4a4e-b46e-45645d7fae40 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:58.026533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4d2e-c662-4a4e-b46e-45645d7fae40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:58.032753 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 909/1811] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:57 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:58.035414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e81cb2-5ae6-4b87-86b6-16ec7bc1086b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:58.050164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:58.106390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f4d2e-c662-4a4e-b46e-45645d7fae40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:58.108361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f4d2e-c662-4a4e-b46e-45645d7fae40 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:58.122835 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 903/1812] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:25:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:58.123699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f4d2e-c662-4a4e-b46e-45645d7fae40 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:58.137610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f4d2e-c662-4a4e-b46e-45645d7fae40 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:58.176078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e81cb2-5ae6-4b87-86b6-16ec7bc1086b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:58.188824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63c34b-ecf4-439c-be34-6792ffb23da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:58.190442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63c34b-ecf4-439c-be34-6792ffb23da5 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:58.190927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63c34b-ecf4-439c-be34-6792ffb23da5 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:58.191510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63c34b-ecf4-439c-be34-6792ffb23da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:58.195699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2e63c34b-ecf4-439c-be34-6792ffb23da5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:58.244233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb465e-a156-44c9-acb6-6b006e3c441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:58.245422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb465e-a156-44c9-acb6-6b006e3c441d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:58.246072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb465e-a156-44c9-acb6-6b006e3c441d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:58.246503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb465e-a156-44c9-acb6-6b006e3c441d admin admin] PATH_INFO: `/v3/projects/da383a1aef9044a8b37301ccd31b701d/users/2c8f3ebdd91c4402a2351878bb4d442f/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:58.315805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb465e-a156-44c9-acb6-6b006e3c441d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da383a1aef9044a8b37301ccd31b701d, user_id=2c8f3ebdd91c4402a2351878bb4d442f, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:58.320361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb465e-a156-44c9-acb6-6b006e3c441d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:58.353550 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 904/1813] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:58 2022] PUT /identity/v3/projects/da383a1aef9044a8b37301ccd31b701d/users/2c8f3ebdd91c4402a2351878bb4d442f/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:58.354760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb465e-a156-44c9-acb6-6b006e3c441d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:58.383367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63c34b-ecf4-439c-be34-6792ffb23da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:58.386559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63c34b-ecf4-439c-be34-6792ffb23da5 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:58.412359 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 910/1814] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:58 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:58.418218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df2b32-4904-4fa5-9db3-5a005f78849f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:58.426589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df2b32-4904-4fa5-9db3-5a005f78849f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:58.428714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df2b32-4904-4fa5-9db3-5a005f78849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:58.487042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb465e-a156-44c9-acb6-6b006e3c441d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:58.493371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc8daf-451e-4eb6-9102-e80d8d796e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:58.494144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc8daf-451e-4eb6-9102-e80d8d796e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:58.494819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc8daf-451e-4eb6-9102-e80d8d796e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:58.495102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc8daf-451e-4eb6-9102-e80d8d796e29 admin admin] PATH_INFO: `/v3/projects/812b3c0fb2fc44e59b62655e692efb6f/users/5c30f1197b2842b4898124fb3c6947a2/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:58.525465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-77df2b32-4904-4fa5-9db3-5a005f78849f None None] MFA Rules not processed for user `e942e9d4535b4fcca9bed0231785b85d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:58.529734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-77df2b32-4904-4fa5-9db3-5a005f78849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:58.540672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc8daf-451e-4eb6-9102-e80d8d796e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=812b3c0fb2fc44e59b62655e692efb6f, user_id=5c30f1197b2842b4898124fb3c6947a2, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:58.544229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc8daf-451e-4eb6-9102-e80d8d796e29 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:58.596488 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 905/1815] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:58 2022] PUT /identity/v3/projects/812b3c0fb2fc44e59b62655e692efb6f/users/5c30f1197b2842b4898124fb3c6947a2/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:58.598747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc8daf-451e-4eb6-9102-e80d8d796e29 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:58.690254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:58.760370 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 911/1816] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:58.761297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df2b32-4904-4fa5-9db3-5a005f78849f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:58.795404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df2b32-4904-4fa5-9db3-5a005f78849f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:58.816728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:58.844589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc8daf-451e-4eb6-9102-e80d8d796e29 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:58.851848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebc4cd-176f-4775-bd2b-0b0079fb54ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:58.852585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc4cd-176f-4775-bd2b-0b0079fb54ce service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:58.852895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc4cd-176f-4775-bd2b-0b0079fb54ce service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:58.853166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc4cd-176f-4775-bd2b-0b0079fb54ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:58.855725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a6ebc4cd-176f-4775-bd2b-0b0079fb54ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:58.959479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88a069-3965-48d4-94fd-a5875275b0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:58.960222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88a069-3965-48d4-94fd-a5875275b0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:58.960579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88a069-3965-48d4-94fd-a5875275b0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:58.960927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88a069-3965-48d4-94fd-a5875275b0f1 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:58.961754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88a069-3965-48d4-94fd-a5875275b0f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:58.974489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88a069-3965-48d4-94fd-a5875275b0f1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:59.023131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebc4cd-176f-4775-bd2b-0b0079fb54ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:59.025811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebc4cd-176f-4775-bd2b-0b0079fb54ce service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:59.031842 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 912/1817] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:58 2022] POST /identity/v3/users => generated 303 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:59.040853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b183a6-9fd3-44cd-84db-af178fbbf4b7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:59.040853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b183a6-9fd3-44cd-84db-af178fbbf4b7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:59.040853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b183a6-9fd3-44cd-84db-af178fbbf4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.054165 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 906/1818] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:25:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:59.058038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d2a2b-cc9e-4865-8aaa-400e06f9d8f1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:59.059655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d2a2b-cc9e-4865-8aaa-400e06f9d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:59.060227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d2a2b-cc9e-4865-8aaa-400e06f9d8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.100445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-99b183a6-9fd3-44cd-84db-af178fbbf4b7 None None] MFA Rules not processed for user `2c8f3ebdd91c4402a2351878bb4d442f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:59.101900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-99b183a6-9fd3-44cd-84db-af178fbbf4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:59.128552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-210d2a2b-cc9e-4865-8aaa-400e06f9d8f1 None None] MFA Rules not processed for user `5c30f1197b2842b4898124fb3c6947a2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:59.137196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-210d2a2b-cc9e-4865-8aaa-400e06f9d8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:59.291334 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 907/1819] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:59 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:59.292429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d2a2b-cc9e-4865-8aaa-400e06f9d8f1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:59.310272 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 913/1820] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:25:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:59.312120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81b9e-a12d-45b2-bcdb-d0b451b878b7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:59.312699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81b9e-a12d-45b2-bcdb-d0b451b878b7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:59.313155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81b9e-a12d-45b2-bcdb-d0b451b878b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.324554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d2a2b-cc9e-4865-8aaa-400e06f9d8f1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:59.331761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793916a-e2b5-4428-b708-9e5baa83b745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:59.332407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793916a-e2b5-4428-b708-9e5baa83b745 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:59.332691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793916a-e2b5-4428-b708-9e5baa83b745 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:59.332966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793916a-e2b5-4428-b708-9e5baa83b745 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.333639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793916a-e2b5-4428-b708-9e5baa83b745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:59.335558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793916a-e2b5-4428-b708-9e5baa83b745 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:59.382319 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 908/1821] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:59 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:59.396048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793916a-e2b5-4428-b708-9e5baa83b745 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:59.435286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-96f81b9e-a12d-45b2-bcdb-d0b451b878b7 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:25:59.436823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-96f81b9e-a12d-45b2-bcdb-d0b451b878b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:59.470717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:59.520860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793916a-e2b5-4428-b708-9e5baa83b745 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:59.527138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7f507-5c2b-4dd6-9235-51a380b9f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:59.527910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7f507-5c2b-4dd6-9235-51a380b9f2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:59.528368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7f507-5c2b-4dd6-9235-51a380b9f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:59.528830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7f507-5c2b-4dd6-9235-51a380b9f2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.529729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7f507-5c2b-4dd6-9235-51a380b9f2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:59.531823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7f507-5c2b-4dd6-9235-51a380b9f2c8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:59.555297 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 909/1822] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:25:59.556866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7f507-5c2b-4dd6-9235-51a380b9f2c8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:59.571625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7f507-5c2b-4dd6-9235-51a380b9f2c8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:59.581912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:59.582701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:59.583118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:59.583529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] PATH_INFO: `/v3/users/d70255def58b4d4c8650db525a7b477e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.584473 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 914/1823] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Aug 29 15:25:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:25:59.585508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70255def58b4d4c8650db525a7b477e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:59.585948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f81b9e-a12d-45b2-bcdb-d0b451b878b7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:59.590779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:59.600888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f81b9e-a12d-45b2-bcdb-d0b451b878b7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:59.607112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90d515-ac48-4946-a281-3251a406bcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:59.608130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d515-ac48-4946-a281-3251a406bcc1 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:59.608571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d515-ac48-4946-a281-3251a406bcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:59.609010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d515-ac48-4946-a281-3251a406bcc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.609891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90d515-ac48-4946-a281-3251a406bcc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:59.612462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90d515-ac48-4946-a281-3251a406bcc1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:59.652235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:59.667353 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 915/1824] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:59 2022] POST /identity/v3/projects => generated 401 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:59.667353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90d515-ac48-4946-a281-3251a406bcc1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:59.687470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70255def58b4d4c8650db525a7b477e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:59.688392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70255def58b4d4c8650db525a7b477e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:59.708812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70255def58b4d4c8650db525a7b477e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:59.711775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70255def58b4d4c8650db525a7b477e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:59.723848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70255def58b4d4c8650db525a7b477e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:25:59.745064 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 910/1825] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:59 2022] DELETE /identity/v3/users/d70255def58b4d4c8650db525a7b477e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:25:59.745064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:59.749077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:59.783912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90d515-ac48-4946-a281-3251a406bcc1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:59.848701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd6f20-153c-4d87-9f65-2663aafe1571 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:59.862178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f09463-a592-4299-a403-66a5962ad6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:59.863789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09463-a592-4299-a403-66a5962ad6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:59.864455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09463-a592-4299-a403-66a5962ad6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:59.864984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09463-a592-4299-a403-66a5962ad6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.865926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f09463-a592-4299-a403-66a5962ad6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:59.868872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f09463-a592-4299-a403-66a5962ad6d8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:59.872041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010094f4-3b90-4e3e-9828-ea3ed2ec34d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:25:59.873011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010094f4-3b90-4e3e-9828-ea3ed2ec34d0 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:25:59.873348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010094f4-3b90-4e3e-9828-ea3ed2ec34d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:25:59.873739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010094f4-3b90-4e3e-9828-ea3ed2ec34d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:25:59.874462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010094f4-3b90-4e3e-9828-ea3ed2ec34d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:25:59.879350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010094f4-3b90-4e3e-9828-ea3ed2ec34d0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:25:59.908069 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 911/1826] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:25:59 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:59.911791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f09463-a592-4299-a403-66a5962ad6d8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:59.913822 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 916/1827] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:25:59 2022] POST /identity/v3/projects => generated 389 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:25:59.914262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-87f09463-a592-4299-a403-66a5962ad6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:59.914859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010094f4-3b90-4e3e-9828-ea3ed2ec34d0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:25:59.917815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-010094f4-3b90-4e3e-9828-ea3ed2ec34d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:25:59.932739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f09463-a592-4299-a403-66a5962ad6d8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:25:59.964534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:00.009355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec7de5-0e02-461e-a183-dd4ceb2c4500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.010068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7de5-0e02-461e-a183-dd4ceb2c4500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.010361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7de5-0e02-461e-a183-dd4ceb2c4500 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.010614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7de5-0e02-461e-a183-dd4ceb2c4500 admin admin] PATH_INFO: `/v3/users/f9a8c677a5634e82b0b1907787bad4c4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.012465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec7de5-0e02-461e-a183-dd4ceb2c4500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a8c677a5634e82b0b1907787bad4c4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.014415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec7de5-0e02-461e-a183-dd4ceb2c4500 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.032563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010094f4-3b90-4e3e-9828-ea3ed2ec34d0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.045579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730df42-94d0-4c24-90f8-2f733b62598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.046468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730df42-94d0-4c24-90f8-2f733b62598b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.046878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730df42-94d0-4c24-90f8-2f733b62598b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.047254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730df42-94d0-4c24-90f8-2f733b62598b admin admin] PATH_INFO: `/v3/projects/b6992920f4374a21b6b54fa8a8dd3b05/users/aa085de9b1f44b9397e0a3f37a688567/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.067816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730df42-94d0-4c24-90f8-2f733b62598b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6992920f4374a21b6b54fa8a8dd3b05, user_id=aa085de9b1f44b9397e0a3f37a688567, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.070715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730df42-94d0-4c24-90f8-2f733b62598b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.072597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3ec7de5-0e02-461e-a183-dd4ceb2c4500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a8c677a5634e82b0b1907787bad4c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:00.073708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3ec7de5-0e02-461e-a183-dd4ceb2c4500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a8c677a5634e82b0b1907787bad4c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:00.093502 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 917/1828] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:25:59 2022] PUT /identity/v3/projects/b6992920f4374a21b6b54fa8a8dd3b05/users/aa085de9b1f44b9397e0a3f37a688567/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:00.094738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3ec7de5-0e02-461e-a183-dd4ceb2c4500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a8c677a5634e82b0b1907787bad4c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:00.094876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730df42-94d0-4c24-90f8-2f733b62598b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.096116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3ec7de5-0e02-461e-a183-dd4ceb2c4500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a8c677a5634e82b0b1907787bad4c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:00.097535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f730df42-94d0-4c24-90f8-2f733b62598b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:00.104084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3ec7de5-0e02-461e-a183-dd4ceb2c4500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a8c677a5634e82b0b1907787bad4c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:00.121594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:00.122488 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 912/1829] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:59 2022] DELETE /identity/v3/users/f9a8c677a5634e82b0b1907787bad4c4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:00.125540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a541765-d7e9-40ed-a571-baa1960a5268 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.125844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a541765-d7e9-40ed-a571-baa1960a5268 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.126108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a541765-d7e9-40ed-a571-baa1960a5268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.151624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5a541765-d7e9-40ed-a571-baa1960a5268 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:00.154205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5a541765-d7e9-40ed-a571-baa1960a5268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:00.183609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730df42-94d0-4c24-90f8-2f733b62598b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.264591 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 913/1830] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:00.265720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a541765-d7e9-40ed-a571-baa1960a5268 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.267367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5a541765-d7e9-40ed-a571-baa1960a5268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:00.280318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9733c16-126d-4bf9-97f7-0d735bf5c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.281015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733c16-126d-4bf9-97f7-0d735bf5c329 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.281364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733c16-126d-4bf9-97f7-0d735bf5c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.281574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a541765-d7e9-40ed-a571-baa1960a5268 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.281682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733c16-126d-4bf9-97f7-0d735bf5c329 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.283939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9733c16-126d-4bf9-97f7-0d735bf5c329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.286303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9733c16-126d-4bf9-97f7-0d735bf5c329 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.287356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe0e2c-0b32-470f-90e7-014d54c5625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.288027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0e2c-0b32-470f-90e7-014d54c5625d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.288356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0e2c-0b32-470f-90e7-014d54c5625d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.288570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0e2c-0b32-470f-90e7-014d54c5625d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.296448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe0e2c-0b32-470f-90e7-014d54c5625d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.296448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe0e2c-0b32-470f-90e7-014d54c5625d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.309989 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 914/1831] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:00.310933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe0e2c-0b32-470f-90e7-014d54c5625d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.313618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-33fe0e2c-0b32-470f-90e7-014d54c5625d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:00.330655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe0e2c-0b32-470f-90e7-014d54c5625d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.336494 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 918/1832] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:00 2022] POST /identity/v3/users => generated 307 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:00.337826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca50b5-5f90-410f-a202-97d4769224a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.338407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca50b5-5f90-410f-a202-97d4769224a3 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.338886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca50b5-5f90-410f-a202-97d4769224a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.344438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca50b5-5f90-410f-a202-97d4769224a3 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.344438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca50b5-5f90-410f-a202-97d4769224a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.344859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9733c16-126d-4bf9-97f7-0d735bf5c329 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.344859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f9733c16-126d-4bf9-97f7-0d735bf5c329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:00.345181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca50b5-5f90-410f-a202-97d4769224a3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.370231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9733c16-126d-4bf9-97f7-0d735bf5c329 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.387965 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 915/1833] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:00 2022] POST /identity/v3/users => generated 301 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:00.389665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b445a40-aaac-4af7-9009-1be3c6bc9b07 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.390070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b445a40-aaac-4af7-9009-1be3c6bc9b07 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.390354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b445a40-aaac-4af7-9009-1be3c6bc9b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.395369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc96ea8-018b-433c-8f59-bec082f244ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.396327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc96ea8-018b-433c-8f59-bec082f244ae admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.404390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc96ea8-018b-433c-8f59-bec082f244ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.410054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc96ea8-018b-433c-8f59-bec082f244ae admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.411141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc96ea8-018b-433c-8f59-bec082f244ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.413356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc96ea8-018b-433c-8f59-bec082f244ae admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.414856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2b445a40-aaac-4af7-9009-1be3c6bc9b07 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:00.416306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2b445a40-aaac-4af7-9009-1be3c6bc9b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:00.425569 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 916/1834] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:00.426585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b445a40-aaac-4af7-9009-1be3c6bc9b07 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.426779 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 919/1835] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:00.427846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc96ea8-018b-433c-8f59-bec082f244ae admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.436199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2b445a40-aaac-4af7-9009-1be3c6bc9b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:00.452078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:00.463498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc96ea8-018b-433c-8f59-bec082f244ae admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.469021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9e31-46ce-4a56-bfe6-699a7e0ec1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.470037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9e31-46ce-4a56-bfe6-699a7e0ec1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.470439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9e31-46ce-4a56-bfe6-699a7e0ec1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.470845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9e31-46ce-4a56-bfe6-699a7e0ec1f0 admin admin] PATH_INFO: `/v3/projects/a49179a5bfaf498992ecd4e84c381022/users/83f405bef06d470d9d54f418468533e1/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.489830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa9e31-46ce-4a56-bfe6-699a7e0ec1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49179a5bfaf498992ecd4e84c381022, user_id=83f405bef06d470d9d54f418468533e1, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.492603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa9e31-46ce-4a56-bfe6-699a7e0ec1f0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.508424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b445a40-aaac-4af7-9009-1be3c6bc9b07 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.509626 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 920/1836] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:00 2022] PUT /identity/v3/projects/a49179a5bfaf498992ecd4e84c381022/users/83f405bef06d470d9d54f418468533e1/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:00.510482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9e31-46ce-4a56-bfe6-699a7e0ec1f0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.584272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa427ef-a2cc-43e2-8ed4-2f7e14daf5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.584983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa427ef-a2cc-43e2-8ed4-2f7e14daf5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.585414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa427ef-a2cc-43e2-8ed4-2f7e14daf5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.585887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa427ef-a2cc-43e2-8ed4-2f7e14daf5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.597443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa427ef-a2cc-43e2-8ed4-2f7e14daf5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.598891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa427ef-a2cc-43e2-8ed4-2f7e14daf5f6 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.599061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9e31-46ce-4a56-bfe6-699a7e0ec1f0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.604713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0215778-909e-46bb-8ba7-358bff14de4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.604893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0215778-909e-46bb-8ba7-358bff14de4f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.605233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0215778-909e-46bb-8ba7-358bff14de4f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.605609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0215778-909e-46bb-8ba7-358bff14de4f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.606349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0215778-909e-46bb-8ba7-358bff14de4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.608029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0215778-909e-46bb-8ba7-358bff14de4f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.609876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 917/1837] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:00.610822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa427ef-a2cc-43e2-8ed4-2f7e14daf5f6 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.624382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa427ef-a2cc-43e2-8ed4-2f7e14daf5f6 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.636008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ada63-b411-4c07-96e2-84b799895bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.636624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ada63-b411-4c07-96e2-84b799895bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.636906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ada63-b411-4c07-96e2-84b799895bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.637180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ada63-b411-4c07-96e2-84b799895bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.637859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ada63-b411-4c07-96e2-84b799895bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.638451 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 921/1838] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:00.639508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0215778-909e-46bb-8ba7-358bff14de4f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.641442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ada63-b411-4c07-96e2-84b799895bc0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.662177 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 918/1839] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:00.663157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ada63-b411-4c07-96e2-84b799895bc0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.666783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0215778-909e-46bb-8ba7-358bff14de4f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.674738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ada63-b411-4c07-96e2-84b799895bc0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.674952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bc411-c40a-4836-a112-07db407a31e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.675714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bc411-c40a-4836-a112-07db407a31e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.676000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bc411-c40a-4836-a112-07db407a31e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.676287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bc411-c40a-4836-a112-07db407a31e0 admin admin] PATH_INFO: `/v3/projects/b6992920f4374a21b6b54fa8a8dd3b05/users/aa085de9b1f44b9397e0a3f37a688567/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.679341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83a34d-23bd-453a-aa03-904584446376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.680159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83a34d-23bd-453a-aa03-904584446376 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.680444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83a34d-23bd-453a-aa03-904584446376 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.680719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83a34d-23bd-453a-aa03-904584446376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.685446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bc411-c40a-4836-a112-07db407a31e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6992920f4374a21b6b54fa8a8dd3b05, user_id=aa085de9b1f44b9397e0a3f37a688567, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.688321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bc411-c40a-4836-a112-07db407a31e0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.693347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83a34d-23bd-453a-aa03-904584446376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.694983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83a34d-23bd-453a-aa03-904584446376 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.696982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:00.710765 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 922/1840] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:00 2022] PUT /identity/v3/projects/b6992920f4374a21b6b54fa8a8dd3b05/users/aa085de9b1f44b9397e0a3f37a688567/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:00.710765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bc411-c40a-4836-a112-07db407a31e0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.722552 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 919/1841] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:00.724151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83a34d-23bd-453a-aa03-904584446376 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.757949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83a34d-23bd-453a-aa03-904584446376 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.837875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bc411-c40a-4836-a112-07db407a31e0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.843533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c47aad-7b9c-4f4c-8824-34210e305793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.844237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c47aad-7b9c-4f4c-8824-34210e305793 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.844513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c47aad-7b9c-4f4c-8824-34210e305793 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.844892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c47aad-7b9c-4f4c-8824-34210e305793 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.845734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c47aad-7b9c-4f4c-8824-34210e305793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.847962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c47aad-7b9c-4f4c-8824-34210e305793 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.865863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603122a-eca6-4979-bbac-057c9a38886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.867900 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 923/1842] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:00.868846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c47aad-7b9c-4f4c-8824-34210e305793 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:00.884877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603122a-eca6-4979-bbac-057c9a38886c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.885412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603122a-eca6-4979-bbac-057c9a38886c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.885880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603122a-eca6-4979-bbac-057c9a38886c admin admin] PATH_INFO: `/v3/projects/1b76bd5f4e04427aa0bc741cfc53670d/users/2cdc4712f93b4fa59f7f8e6a2e193a1b/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.908975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c47aad-7b9c-4f4c-8824-34210e305793 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:00.919251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de419ea7-ba0f-4c5b-aed3-8e1eac3c29be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:00.919959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de419ea7-ba0f-4c5b-aed3-8e1eac3c29be admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:00.920292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de419ea7-ba0f-4c5b-aed3-8e1eac3c29be admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:00.920464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de419ea7-ba0f-4c5b-aed3-8e1eac3c29be admin admin] PATH_INFO: `/v3/projects/e558b79ebc314347b07a7dae4f1720d2/users/197418e111a043eb89a19030f483a559/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:00.969660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de419ea7-ba0f-4c5b-aed3-8e1eac3c29be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e558b79ebc314347b07a7dae4f1720d2, user_id=197418e111a043eb89a19030f483a559, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.970881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603122a-eca6-4979-bbac-057c9a38886c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b76bd5f4e04427aa0bc741cfc53670d, user_id=2cdc4712f93b4fa59f7f8e6a2e193a1b, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:00.972886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de419ea7-ba0f-4c5b-aed3-8e1eac3c29be admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:00.980396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603122a-eca6-4979-bbac-057c9a38886c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.004206 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 924/1843] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:00 2022] PUT /identity/v3/projects/e558b79ebc314347b07a7dae4f1720d2/users/197418e111a043eb89a19030f483a559/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:01.007537 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 920/1844] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:00 2022] PUT /identity/v3/projects/1b76bd5f4e04427aa0bc741cfc53670d/users/2cdc4712f93b4fa59f7f8e6a2e193a1b/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:01.007537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603122a-eca6-4979-bbac-057c9a38886c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.007755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8cd04-badf-4222-a1ad-f524b9731d90 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.007755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8cd04-badf-4222-a1ad-f524b9731d90 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.007755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8cd04-badf-4222-a1ad-f524b9731d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.083440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e8e8cd04-badf-4222-a1ad-f524b9731d90 None None] MFA Rules not processed for user `aa085de9b1f44b9397e0a3f37a688567`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:01.084778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e8e8cd04-badf-4222-a1ad-f524b9731d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:01.096656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:01.193000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603122a-eca6-4979-bbac-057c9a38886c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.206551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb763bf-5e78-479c-a739-2eec76b2e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.207277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb763bf-5e78-479c-a739-2eec76b2e271 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.207561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb763bf-5e78-479c-a739-2eec76b2e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.207840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb763bf-5e78-479c-a739-2eec76b2e271 admin admin] PATH_INFO: `/v3/projects/a49179a5bfaf498992ecd4e84c381022/users/83f405bef06d470d9d54f418468533e1/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.210728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb763bf-5e78-479c-a739-2eec76b2e271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49179a5bfaf498992ecd4e84c381022, user_id=83f405bef06d470d9d54f418468533e1, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.222866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb763bf-5e78-479c-a739-2eec76b2e271 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.233302 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 925/1845] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:01.234649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8cd04-badf-4222-a1ad-f524b9731d90 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.247480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8cd04-badf-4222-a1ad-f524b9731d90 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.255598 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 921/1846] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:01 2022] PUT /identity/v3/projects/a49179a5bfaf498992ecd4e84c381022/users/83f405bef06d470d9d54f418468533e1/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:01.256694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb763bf-5e78-479c-a739-2eec76b2e271 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.361539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb763bf-5e78-479c-a739-2eec76b2e271 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.374782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc338e-6e9a-4000-8330-fb8291a5485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.375458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc338e-6e9a-4000-8330-fb8291a5485b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.375744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc338e-6e9a-4000-8330-fb8291a5485b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.376006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc338e-6e9a-4000-8330-fb8291a5485b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.376793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc338e-6e9a-4000-8330-fb8291a5485b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.378857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc338e-6e9a-4000-8330-fb8291a5485b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.396304 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 922/1847] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:01.397332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc338e-6e9a-4000-8330-fb8291a5485b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.400774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:01.402622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4efc338e-6e9a-4000-8330-fb8291a5485b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:01.413627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a881-46e9-44e8-94c6-6e50ca329acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.414274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a881-46e9-44e8-94c6-6e50ca329acf admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.414669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a881-46e9-44e8-94c6-6e50ca329acf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.415202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a881-46e9-44e8-94c6-6e50ca329acf admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.415907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006a881-46e9-44e8-94c6-6e50ca329acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.417533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006a881-46e9-44e8-94c6-6e50ca329acf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.422575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc338e-6e9a-4000-8330-fb8291a5485b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.429175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.429869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.430157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.430422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] PATH_INFO: `/v3/projects/d86a4df4999c46ca9ec190e5c4336bca` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.432391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86a4df4999c46ca9ec190e5c4336bca)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.434592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.435855 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 926/1848] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:01.437039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a881-46e9-44e8-94c6-6e50ca329acf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.449573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a881-46e9-44e8-94c6-6e50ca329acf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.456037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807127-efff-495f-9f36-dc6e80818f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.456665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807127-efff-495f-9f36-dc6e80818f4c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.456945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807127-efff-495f-9f36-dc6e80818f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.457221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807127-efff-495f-9f36-dc6e80818f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.457919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807127-efff-495f-9f36-dc6e80818f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.459908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807127-efff-495f-9f36-dc6e80818f4c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.519472 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 927/1849] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:01 2022] POST /identity/v3/projects => generated 393 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:01.519472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807127-efff-495f-9f36-dc6e80818f4c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.522877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-49807127-efff-495f-9f36-dc6e80818f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:01.549352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86a4df4999c46ca9ec190e5c4336bca', 'request_id': 'req-4f10e158-f0e7-4900-93ce-ea490f917aab'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:01.558841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86a4df4999c46ca9ec190e5c4336bca', 'request_id': 'req-4f10e158-f0e7-4900-93ce-ea490f917aab'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:01.569593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86a4df4999c46ca9ec190e5c4336bca', 'request_id': 'req-4f10e158-f0e7-4900-93ce-ea490f917aab'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:01.593449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] The token cache is being invalidate because project d86a4df4999c46ca9ec190e5c4336bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:01.593750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:01.594734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4f10e158-f0e7-4900-93ce-ea490f917aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:01.597303 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 923/1850] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:01 2022] DELETE /identity/v3/projects/d86a4df4999c46ca9ec190e5c4336bca => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:01.598522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d747d9-aa1c-49a0-b031-ed02cf704ea6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.598803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d747d9-aa1c-49a0-b031-ed02cf704ea6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.599074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d747d9-aa1c-49a0-b031-ed02cf704ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.634135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-52d747d9-aa1c-49a0-b031-ed02cf704ea6 None None] MFA Rules not processed for user `83f405bef06d470d9d54f418468533e1`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:01.635914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-52d747d9-aa1c-49a0-b031-ed02cf704ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:01.673543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807127-efff-495f-9f36-dc6e80818f4c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.674257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:01.753774 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 924/1851] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:01.754924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.755137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d747d9-aa1c-49a0-b031-ed02cf704ea6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.755586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.756078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.756476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] PATH_INFO: `/v3/projects/e9f7e323b1b0435fb2bc62f5263ecba4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.756963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-52d747d9-aa1c-49a0-b031-ed02cf704ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:01.757747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f7e323b1b0435fb2bc62f5263ecba4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.761087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.775097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d747d9-aa1c-49a0-b031-ed02cf704ea6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.782167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05144188-5881-4120-9d90-c7d1bb2ff84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.783211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05144188-5881-4120-9d90-c7d1bb2ff84b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.783580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05144188-5881-4120-9d90-c7d1bb2ff84b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.783914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05144188-5881-4120-9d90-c7d1bb2ff84b admin admin] PATH_INFO: `/v3/projects/1b76bd5f4e04427aa0bc741cfc53670d/users/2cdc4712f93b4fa59f7f8e6a2e193a1b/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.786047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05144188-5881-4120-9d90-c7d1bb2ff84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b76bd5f4e04427aa0bc741cfc53670d, user_id=2cdc4712f93b4fa59f7f8e6a2e193a1b, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.788826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05144188-5881-4120-9d90-c7d1bb2ff84b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.802399 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 925/1852] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:01 2022] PUT /identity/v3/projects/1b76bd5f4e04427aa0bc741cfc53670d/users/2cdc4712f93b4fa59f7f8e6a2e193a1b/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:01.809641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05144188-5881-4120-9d90-c7d1bb2ff84b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.809641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-05144188-5881-4120-9d90-c7d1bb2ff84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:01.817302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f7e323b1b0435fb2bc62f5263ecba4', 'request_id': 'req-c70f6a5f-8377-4546-9283-88dda2c626b5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:01.826308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f7e323b1b0435fb2bc62f5263ecba4', 'request_id': 'req-c70f6a5f-8377-4546-9283-88dda2c626b5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:01.836385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f7e323b1b0435fb2bc62f5263ecba4', 'request_id': 'req-c70f6a5f-8377-4546-9283-88dda2c626b5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:01.852222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] The token cache is being invalidate because project e9f7e323b1b0435fb2bc62f5263ecba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:01.852515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:01.853196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:01.855341 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 928/1853] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:01 2022] DELETE /identity/v3/projects/e9f7e323b1b0435fb2bc62f5263ecba4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:01.855897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:01.857256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:01.869311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:01.916662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05144188-5881-4120-9d90-c7d1bb2ff84b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.959589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6a5f-8377-4546-9283-88dda2c626b5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:01.966929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fc933-7d79-4abe-8fb0-9ddf248d9749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.967668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fc933-7d79-4abe-8fb0-9ddf248d9749 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.968033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fc933-7d79-4abe-8fb0-9ddf248d9749 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.968367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fc933-7d79-4abe-8fb0-9ddf248d9749 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.969085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fc933-7d79-4abe-8fb0-9ddf248d9749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.971056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fc933-7d79-4abe-8fb0-9ddf248d9749 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:01.988735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efd739-a5ad-41b6-8fcc-a4235e42d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:01.989664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd739-a5ad-41b6-8fcc-a4235e42d24c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:01.990582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd739-a5ad-41b6-8fcc-a4235e42d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:01.990582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd739-a5ad-41b6-8fcc-a4235e42d24c admin admin] PATH_INFO: `/v3/projects/e558b79ebc314347b07a7dae4f1720d2/users/197418e111a043eb89a19030f483a559/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:01.992526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efd739-a5ad-41b6-8fcc-a4235e42d24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e558b79ebc314347b07a7dae4f1720d2, user_id=197418e111a043eb89a19030f483a559, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:01.995878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efd739-a5ad-41b6-8fcc-a4235e42d24c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:02.004274 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 929/1854] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:01 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:02.005376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fc933-7d79-4abe-8fb0-9ddf248d9749 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:02.011358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e95fc933-7d79-4abe-8fb0-9ddf248d9749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:02.019387 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 926/1855] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:01 2022] PUT /identity/v3/projects/e558b79ebc314347b07a7dae4f1720d2/users/197418e111a043eb89a19030f483a559/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:02.020623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efd739-a5ad-41b6-8fcc-a4235e42d24c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:02.023997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-21efd739-a5ad-41b6-8fcc-a4235e42d24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:02.026942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fc933-7d79-4abe-8fb0-9ddf248d9749 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:02.108779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:02.127420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:02.128180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:02.128337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:02.128607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] PATH_INFO: `/v3/users/586d62c680f1413989b5de1f48fb220c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:02.134441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=586d62c680f1413989b5de1f48fb220c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:02.136398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:02.153886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efd739-a5ad-41b6-8fcc-a4235e42d24c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:02.159651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655fe86-2ce2-43f2-a551-d4e4fa8e2224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:02.160777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655fe86-2ce2-43f2-a551-d4e4fa8e2224 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:02.161054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655fe86-2ce2-43f2-a551-d4e4fa8e2224 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:02.161328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655fe86-2ce2-43f2-a551-d4e4fa8e2224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:02.163171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c655fe86-2ce2-43f2-a551-d4e4fa8e2224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:02.208087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586d62c680f1413989b5de1f48fb220c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:02.208748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586d62c680f1413989b5de1f48fb220c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:02.226290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586d62c680f1413989b5de1f48fb220c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:02.236935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586d62c680f1413989b5de1f48fb220c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:02.253752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655fe86-2ce2-43f2-a551-d4e4fa8e2224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:02.255589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655fe86-2ce2-43f2-a551-d4e4fa8e2224 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:02.258245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586d62c680f1413989b5de1f48fb220c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:02.271000 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 927/1856] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:02.272511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c9f5-9343-4e34-8029-890c2170fe58 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:02.272792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c9f5-9343-4e34-8029-890c2170fe58 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:02.273065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c9f5-9343-4e34-8029-890c2170fe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:02.273870 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 930/1857] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:02 2022] DELETE /identity/v3/users/586d62c680f1413989b5de1f48fb220c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:02.280740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:02.282594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:02.315487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:02.334357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-23d3c9f5-9343-4e34-8029-890c2170fe58 None None] MFA Rules not processed for user `2cdc4712f93b4fa59f7f8e6a2e193a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:02.336116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-23d3c9f5-9343-4e34-8029-890c2170fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:02.399093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4877f-c2e7-4fdb-86e8-fe7e6d359376 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:02.406542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:02.407275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:02.407648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:02.408071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] PATH_INFO: `/v3/users/a3228dc648134e32ad1f2f142c95ca26` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:02.409588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3228dc648134e32ad1f2f142c95ca26)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:02.412108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:02.445153 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 928/1858] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:02 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:02.446182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3c9f5-9343-4e34-8029-890c2170fe58 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:02.448037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-23d3c9f5-9343-4e34-8029-890c2170fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:02.467397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3c9f5-9343-4e34-8029-890c2170fe58 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:02.474176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdde0c0-353a-42f4-9fc6-c22d29e961b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:02.475243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdde0c0-353a-42f4-9fc6-c22d29e961b9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:02.475640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdde0c0-353a-42f4-9fc6-c22d29e961b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:02.475915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdde0c0-353a-42f4-9fc6-c22d29e961b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:02.476601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdde0c0-353a-42f4-9fc6-c22d29e961b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:02.478364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdde0c0-353a-42f4-9fc6-c22d29e961b9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:02.495806 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 929/1859] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:02.497368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6302f45-d097-49fc-ac2b-a8015507b744 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:02.498305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6302f45-d097-49fc-ac2b-a8015507b744 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:02.499035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6302f45-d097-49fc-ac2b-a8015507b744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:02.527247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3228dc648134e32ad1f2f142c95ca26'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:02.528355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3228dc648134e32ad1f2f142c95ca26'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:02.579621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c6302f45-d097-49fc-ac2b-a8015507b744 None None] MFA Rules not processed for user `197418e111a043eb89a19030f483a559`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:02.581468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c6302f45-d097-49fc-ac2b-a8015507b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:02.598321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3228dc648134e32ad1f2f142c95ca26'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:02.612608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3228dc648134e32ad1f2f142c95ca26'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:02.624417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3228dc648134e32ad1f2f142c95ca26'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:02.637510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 931/1860] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:02 2022] DELETE /identity/v3/users/a3228dc648134e32ad1f2f142c95ca26 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:02.638458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:02.646252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:02.683478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:02.749823 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 930/1861] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:02.750849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6302f45-d097-49fc-ac2b-a8015507b744 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:02.759580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c6302f45-d097-49fc-ac2b-a8015507b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:02.790609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6302f45-d097-49fc-ac2b-a8015507b744 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:02.916510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90d40-2f2c-40a1-bd66-80d6eb1c0f74 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:02.933806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d2df9-b6df-4fab-b201-4eb0cfc86dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:02.935702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d2df9-b6df-4fab-b201-4eb0cfc86dce service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:02.936214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d2df9-b6df-4fab-b201-4eb0cfc86dce service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:02.937057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d2df9-b6df-4fab-b201-4eb0cfc86dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:02.943631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-089d2df9-b6df-4fab-b201-4eb0cfc86dce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:02.995513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9417-54f6-46ee-b466-9d7ac849993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:02.997973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9417-54f6-46ee-b466-9d7ac849993a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:02.998422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9417-54f6-46ee-b466-9d7ac849993a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:02.999523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9417-54f6-46ee-b466-9d7ac849993a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:03.001500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd9417-54f6-46ee-b466-9d7ac849993a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:03.010536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd9417-54f6-46ee-b466-9d7ac849993a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:03.043820 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 931/1862] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:03.047184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9417-54f6-46ee-b466-9d7ac849993a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:03.051404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-73fd9417-54f6-46ee-b466-9d7ac849993a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:03.059627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:03.089125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9417-54f6-46ee-b466-9d7ac849993a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:03.098904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:03.100990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:03.100990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:03.100990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] PATH_INFO: `/v3/projects/e604744efbae4cfc907f31721303edf4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:03.102906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e604744efbae4cfc907f31721303edf4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:03.106543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:03.113005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d2df9-b6df-4fab-b201-4eb0cfc86dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:03.114888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d2df9-b6df-4fab-b201-4eb0cfc86dce service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:03.126987 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 932/1863] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:02 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:03.127948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d2df9-b6df-4fab-b201-4eb0cfc86dce service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:03.142557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d2df9-b6df-4fab-b201-4eb0cfc86dce service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:03.149714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b289964-fb11-41cc-ab3f-a88aef8835a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:03.150892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b289964-fb11-41cc-ab3f-a88aef8835a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:03.151247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b289964-fb11-41cc-ab3f-a88aef8835a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:03.151636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b289964-fb11-41cc-ab3f-a88aef8835a3 admin admin] PATH_INFO: `/v3/projects/bc33c983f35c400ca58e6d981f26f924/users/e34bc3961d4c46c987d4ead5accbfee9/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:03.178478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b289964-fb11-41cc-ab3f-a88aef8835a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc33c983f35c400ca58e6d981f26f924, user_id=e34bc3961d4c46c987d4ead5accbfee9, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:03.196124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b289964-fb11-41cc-ab3f-a88aef8835a3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:03.234951 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 933/1864] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:03 2022] PUT /identity/v3/projects/bc33c983f35c400ca58e6d981f26f924/users/e34bc3961d4c46c987d4ead5accbfee9/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:03.236808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b289964-fb11-41cc-ab3f-a88aef8835a3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:03.240642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2b289964-fb11-41cc-ab3f-a88aef8835a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:03.310626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e604744efbae4cfc907f31721303edf4', 'request_id': 'req-e25c070d-d254-4c06-80a7-4261f3f1b418'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:03.335989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e604744efbae4cfc907f31721303edf4', 'request_id': 'req-e25c070d-d254-4c06-80a7-4261f3f1b418'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:03.357829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e604744efbae4cfc907f31721303edf4', 'request_id': 'req-e25c070d-d254-4c06-80a7-4261f3f1b418'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:03.373142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] The token cache is being invalidate because project e604744efbae4cfc907f31721303edf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:03.373451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:03.381626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e25c070d-d254-4c06-80a7-4261f3f1b418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:03.385189 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 932/1865] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:03 2022] DELETE /identity/v3/projects/e604744efbae4cfc907f31721303edf4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:03.386653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21f813-512e-4cd1-a4a4-3211cab6d1d1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:03.386938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21f813-512e-4cd1-a4a4-3211cab6d1d1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:03.387210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21f813-512e-4cd1-a4a4-3211cab6d1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:03.400579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b289964-fb11-41cc-ab3f-a88aef8835a3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:03.479319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ea21f813-512e-4cd1-a4a4-3211cab6d1d1 None None] MFA Rules not processed for user `e34bc3961d4c46c987d4ead5accbfee9`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:03.480703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ea21f813-512e-4cd1-a4a4-3211cab6d1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:03.563165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c95c2-4986-4545-a90b-f5b9ee893136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:03.564419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c95c2-4986-4545-a90b-f5b9ee893136 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:03.564884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c95c2-4986-4545-a90b-f5b9ee893136 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:03.565194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c95c2-4986-4545-a90b-f5b9ee893136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:03.572968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-988c95c2-4986-4545-a90b-f5b9ee893136 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:03.632994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:03.633783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:03.665699 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 933/1866] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:03.666804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21f813-512e-4cd1-a4a4-3211cab6d1d1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:03.668336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ea21f813-512e-4cd1-a4a4-3211cab6d1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:03.675287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c95c2-4986-4545-a90b-f5b9ee893136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:03.678296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c95c2-4986-4545-a90b-f5b9ee893136 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:03.691214 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 934/1867] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:03.694610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4327437-a738-4f71-9bdc-9642a6bf3858 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:03.695499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4327437-a738-4f71-9bdc-9642a6bf3858 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:03.696122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4327437-a738-4f71-9bdc-9642a6bf3858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:03.713546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21f813-512e-4cd1-a4a4-3211cab6d1d1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:03.722963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d4327437-a738-4f71-9bdc-9642a6bf3858 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:03.732367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b360b-d3b5-4831-9ce9-8c3c8783fde9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:03.732942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d4327437-a738-4f71-9bdc-9642a6bf3858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:03.742353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b360b-d3b5-4831-9ce9-8c3c8783fde9 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:03.743060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b360b-d3b5-4831-9ce9-8c3c8783fde9 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:03.744513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b360b-d3b5-4831-9ce9-8c3c8783fde9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:03.747743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-554b360b-d3b5-4831-9ce9-8c3c8783fde9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:03.864391 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 935/1868] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:03.865810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4327437-a738-4f71-9bdc-9642a6bf3858 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:03.867613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d4327437-a738-4f71-9bdc-9642a6bf3858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:03.886653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4327437-a738-4f71-9bdc-9642a6bf3858 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:03.893775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:03.895128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b360b-d3b5-4831-9ce9-8c3c8783fde9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:03.895875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:03.896460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:03.897116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] PATH_INFO: `/v3/projects/685766f5a0e14feabd67f3628cc59b0c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:03.897372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b360b-d3b5-4831-9ce9-8c3c8783fde9 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:03.902014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=685766f5a0e14feabd67f3628cc59b0c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:03.905276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:03.918395 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 934/1869] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:03 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:03.919590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b360b-d3b5-4831-9ce9-8c3c8783fde9 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:03.921101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-554b360b-d3b5-4831-9ce9-8c3c8783fde9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:03.946552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b360b-d3b5-4831-9ce9-8c3c8783fde9 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:03.958287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a13db4-1ab4-423c-985a-5cb01ef5f1d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:03.962174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a13db4-1ab4-423c-985a-5cb01ef5f1d2 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:03.962174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a13db4-1ab4-423c-985a-5cb01ef5f1d2 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:03.962174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a13db4-1ab4-423c-985a-5cb01ef5f1d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:03.965735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-81a13db4-1ab4-423c-985a-5cb01ef5f1d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:04.037341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '685766f5a0e14feabd67f3628cc59b0c', 'request_id': 'req-fd397f78-b610-4eb0-a3c6-77a93ad09671'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:04.050350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '685766f5a0e14feabd67f3628cc59b0c', 'request_id': 'req-fd397f78-b610-4eb0-a3c6-77a93ad09671'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:04.064759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '685766f5a0e14feabd67f3628cc59b0c', 'request_id': 'req-fd397f78-b610-4eb0-a3c6-77a93ad09671'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:04.067813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a13db4-1ab4-423c-985a-5cb01ef5f1d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:04.069364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a13db4-1ab4-423c-985a-5cb01ef5f1d2 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:04.091532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] The token cache is being invalidate because project 685766f5a0e14feabd67f3628cc59b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:04.091532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:04.092936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd397f78-b610-4eb0-a3c6-77a93ad09671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:04.094561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 936/1870] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:03 2022] DELETE /identity/v3/projects/685766f5a0e14feabd67f3628cc59b0c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:04.096425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c0a89-f5f1-4465-b5b9-58c6903d6e9d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.096712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c0a89-f5f1-4465-b5b9-58c6903d6e9d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.096991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c0a89-f5f1-4465-b5b9-58c6903d6e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.124555 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 935/1871] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:03 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:04.125163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b6a0-2b60-43c4-86ee-84e76e548921 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.130880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b6a0-2b60-43c4-86ee-84e76e548921 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.131267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b6a0-2b60-43c4-86ee-84e76e548921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.148406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-138c0a89-f5f1-4465-b5b9-58c6903d6e9d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:04.153933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-138c0a89-f5f1-4465-b5b9-58c6903d6e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:04.167193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0ee4b6a0-2b60-43c4-86ee-84e76e548921 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:04.168575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0ee4b6a0-2b60-43c4-86ee-84e76e548921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:04.294424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:04.318536 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 937/1872] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:04.320011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5d15-8f99-46e0-ab75-7d6e95de6365 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.320297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5d15-8f99-46e0-ab75-7d6e95de6365 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.320582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5d15-8f99-46e0-ab75-7d6e95de6365 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.327311 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 938/1873] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:04.328269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a5d15-8f99-46e0-ab75-7d6e95de6365 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:04.382372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a5d15-8f99-46e0-ab75-7d6e95de6365 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:04.389225 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 936/1874] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:04.389225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4b6a0-2b60-43c4-86ee-84e76e548921 None None] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:04.391456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0ee4b6a0-2b60-43c4-86ee-84e76e548921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:04.411030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b024ef-d33a-4b68-bb20-dc7d4b688a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:04.412009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b024ef-d33a-4b68-bb20-dc7d4b688a05 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.412365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b024ef-d33a-4b68-bb20-dc7d4b688a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.412716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b024ef-d33a-4b68-bb20-dc7d4b688a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.413518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b024ef-d33a-4b68-bb20-dc7d4b688a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:04.413913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b024ef-d33a-4b68-bb20-dc7d4b688a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:04.415857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b024ef-d33a-4b68-bb20-dc7d4b688a05 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:04.451346 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 939/1875] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:04.454196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7b2d8-26f2-41c9-97ca-14c1977fcf8a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.455098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7b2d8-26f2-41c9-97ca-14c1977fcf8a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.455460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7b2d8-26f2-41c9-97ca-14c1977fcf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.485896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c5b7b2d8-26f2-41c9-97ca-14c1977fcf8a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:04.487581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c5b7b2d8-26f2-41c9-97ca-14c1977fcf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:04.492354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:04.503746 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 940/1876] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:04.504218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7b2d8-26f2-41c9-97ca-14c1977fcf8a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:04.515879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7b2d8-26f2-41c9-97ca-14c1977fcf8a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:04.527529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40b727-1b9f-4800-a050-95f4b7d960c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:04.528260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b727-1b9f-4800-a050-95f4b7d960c8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.528869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b727-1b9f-4800-a050-95f4b7d960c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.529211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b727-1b9f-4800-a050-95f4b7d960c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.530273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40b727-1b9f-4800-a050-95f4b7d960c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:04.532513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40b727-1b9f-4800-a050-95f4b7d960c8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:04.588081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4b6a0-2b60-43c4-86ee-84e76e548921 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:04.589642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0ee4b6a0-2b60-43c4-86ee-84e76e548921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:04.597558 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 941/1877] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:04 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:04.598697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40b727-1b9f-4800-a050-95f4b7d960c8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:04.725312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4b6a0-2b60-43c4-86ee-84e76e548921 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:04.871110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40b727-1b9f-4800-a050-95f4b7d960c8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:04.878957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb47d7-3bbf-4f95-8daf-29acec5dd981 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa085de9b1f44b9397e0a3f37a688567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6992920f4374a21b6b54fa8a8dd3b05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:04.880010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb47d7-3bbf-4f95-8daf-29acec5dd981 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.882607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb47d7-3bbf-4f95-8daf-29acec5dd981 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.883177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb47d7-3bbf-4f95-8daf-29acec5dd981 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] PATH_INFO: `/v3/projects/031d3a19bd9b4f288395ce8732981dd5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.886177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb47d7-3bbf-4f95-8daf-29acec5dd981 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorizing `identity:get_project(project_id=031d3a19bd9b4f288395ce8732981dd5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:04.889814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1908a-9ec9-49c1-b9ad-2fb10283e108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:04.893378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1908a-9ec9-49c1-b9ad-2fb10283e108 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:04.893378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1908a-9ec9-49c1-b9ad-2fb10283e108 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:04.893378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1908a-9ec9-49c1-b9ad-2fb10283e108 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:04.896497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1908a-9ec9-49c1-b9ad-2fb10283e108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:04.896910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1908a-9ec9-49c1-b9ad-2fb10283e108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:04.900107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1908a-9ec9-49c1-b9ad-2fb10283e108 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:04.906097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb47d7-3bbf-4f95-8daf-29acec5dd981 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:04.927857 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 937/1878] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:04 2022] GET /identity/v3/projects/031d3a19bd9b4f288395ce8732981dd5 => generated 395 bytes in 539 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:04.930433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb47d7-3bbf-4f95-8daf-29acec5dd981 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:04.961569 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 942/1879] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:04.966135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1908a-9ec9-49c1-b9ad-2fb10283e108 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:04.975917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-78d1908a-9ec9-49c1-b9ad-2fb10283e108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:04.997984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb47d7-3bbf-4f95-8daf-29acec5dd981 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.026259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1908a-9ec9-49c1-b9ad-2fb10283e108 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.028426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fda424-37e8-4519-8c11-fb70b0e4eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.029325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda424-37e8-4519-8c11-fb70b0e4eeba admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.029618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda424-37e8-4519-8c11-fb70b0e4eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.029973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda424-37e8-4519-8c11-fb70b0e4eeba admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.030528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fda424-37e8-4519-8c11-fb70b0e4eeba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.032732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fda424-37e8-4519-8c11-fb70b0e4eeba admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.050366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.052023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.052313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.053167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] PATH_INFO: `/v3/users/2c8f3ebdd91c4402a2351878bb4d442f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.054593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c8f3ebdd91c4402a2351878bb4d442f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.058025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.087738 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 938/1880] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:04 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:05.088398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fda424-37e8-4519-8c11-fb70b0e4eeba admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.113620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fda424-37e8-4519-8c11-fb70b0e4eeba admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.131341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a9f5b-90ff-42db-9f2d-e25b48d53541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.132956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a9f5b-90ff-42db-9f2d-e25b48d53541 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.133288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a9f5b-90ff-42db-9f2d-e25b48d53541 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.133668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a9f5b-90ff-42db-9f2d-e25b48d53541 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.134349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a9f5b-90ff-42db-9f2d-e25b48d53541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.141698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a9f5b-90ff-42db-9f2d-e25b48d53541 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.170672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c8f3ebdd91c4402a2351878bb4d442f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:05.173836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c8f3ebdd91c4402a2351878bb4d442f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:05.208297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c8f3ebdd91c4402a2351878bb4d442f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:05.212161 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 939/1881] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:05 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:05.213309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d6c66-f75e-417f-be36-84d95a5161cf None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.213624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d6c66-f75e-417f-be36-84d95a5161cf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.213897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d6c66-f75e-417f-be36-84d95a5161cf None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.215527 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 940/1882] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:05.219781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d6c66-f75e-417f-be36-84d95a5161cf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.233242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c8f3ebdd91c4402a2351878bb4d442f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:05.250901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c8f3ebdd91c4402a2351878bb4d442f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:05.267903 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 943/1883] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:04 2022] DELETE /identity/v3/users/2c8f3ebdd91c4402a2351878bb4d442f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:05.273841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.277514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:05.330252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:05.349218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:05.375042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d6c66-f75e-417f-be36-84d95a5161cf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.436630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce57432-aa43-4180-a255-be93ea5554a2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.451167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.453428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.455675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.456186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] PATH_INFO: `/v3/users/5c30f1197b2842b4898124fb3c6947a2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.459845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c30f1197b2842b4898124fb3c6947a2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.461872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.486755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8d212-d9ce-48e9-b901-1670e55bc134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.487719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8d212-d9ce-48e9-b901-1670e55bc134 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.488110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8d212-d9ce-48e9-b901-1670e55bc134 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.490517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8d212-d9ce-48e9-b901-1670e55bc134 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.490517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8d212-d9ce-48e9-b901-1670e55bc134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.492444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8d212-d9ce-48e9-b901-1670e55bc134 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.526505 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 941/1884] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:05.531145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8d212-d9ce-48e9-b901-1670e55bc134 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.539521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ffc8d212-d9ce-48e9-b901-1670e55bc134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:05.541205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c30f1197b2842b4898124fb3c6947a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:05.542998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c30f1197b2842b4898124fb3c6947a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:05.574347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c30f1197b2842b4898124fb3c6947a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:05.589796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8d212-d9ce-48e9-b901-1670e55bc134 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.591306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c30f1197b2842b4898124fb3c6947a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:05.596063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0e8bd-b1af-4f24-8be1-99fb7b9a882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.597012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e8bd-b1af-4f24-8be1-99fb7b9a882a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.597322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e8bd-b1af-4f24-8be1-99fb7b9a882a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.597651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e8bd-b1af-4f24-8be1-99fb7b9a882a admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.598301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0e8bd-b1af-4f24-8be1-99fb7b9a882a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.600412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0e8bd-b1af-4f24-8be1-99fb7b9a882a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.608118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c30f1197b2842b4898124fb3c6947a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:05.625638 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 944/1885] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:05 2022] DELETE /identity/v3/users/5c30f1197b2842b4898124fb3c6947a2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:05.627785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:05.631205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:05.640062 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 942/1886] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:05 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:05.641812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d01aaf-faee-4f6e-9f9b-c96a43d719f5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.642863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d01aaf-faee-4f6e-9f9b-c96a43d719f5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.643164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d01aaf-faee-4f6e-9f9b-c96a43d719f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.666738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-60d01aaf-faee-4f6e-9f9b-c96a43d719f5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:05.668250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-60d01aaf-faee-4f6e-9f9b-c96a43d719f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:05.756415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.758297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:05.804038 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 943/1887] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:05.804038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d01aaf-faee-4f6e-9f9b-c96a43d719f5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.804038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-60d01aaf-faee-4f6e-9f9b-c96a43d719f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:05.875261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:05.888622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d01aaf-faee-4f6e-9f9b-c96a43d719f5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.894302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a61d8-6860-4c3e-aa94-90bb7791b88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.895587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a61d8-6860-4c3e-aa94-90bb7791b88b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.895999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a61d8-6860-4c3e-aa94-90bb7791b88b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.896537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a61d8-6860-4c3e-aa94-90bb7791b88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.898859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c93a61d8-6860-4c3e-aa94-90bb7791b88b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:05.921334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050241f-1eb9-4404-beb3-6b366fc3a90f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.926625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a61d8-6860-4c3e-aa94-90bb7791b88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.927197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8687f-c222-47b9-bc38-268d856851ea tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa085de9b1f44b9397e0a3f37a688567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6992920f4374a21b6b54fa8a8dd3b05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:05.927447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8687f-c222-47b9-bc38-268d856851ea tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.927732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8687f-c222-47b9-bc38-268d856851ea tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.928014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8687f-c222-47b9-bc38-268d856851ea tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] PATH_INFO: `/v3/projects/031d3a19bd9b4f288395ce8732981dd5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.929333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8687f-c222-47b9-bc38-268d856851ea tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorizing `identity:get_project(project_id=031d3a19bd9b4f288395ce8732981dd5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:05.931532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8687f-c222-47b9-bc38-268d856851ea tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.932411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a61d8-6860-4c3e-aa94-90bb7791b88b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:05.933773 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 945/1888] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:05 2022] GET /identity/v3/projects/031d3a19bd9b4f288395ce8732981dd5 => generated 395 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:05.934565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8687f-c222-47b9-bc38-268d856851ea tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:05.936437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b6f8687f-c222-47b9-bc38-268d856851ea tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:05.952307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8687f-c222-47b9-bc38-268d856851ea tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:05.953162 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 944/1889] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:05.956985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7bddd-333c-4e32-a0c4-051f6742c89f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:05.957936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7bddd-333c-4e32-a0c4-051f6742c89f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:05.958595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7bddd-333c-4e32-a0c4-051f6742c89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:05.992058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:05.999573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa6855-66d8-4c03-a640-9f486c147b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:06.001335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6855-66d8-4c03-a640-9f486c147b5a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.002217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6855-66d8-4c03-a640-9f486c147b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.004151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6855-66d8-4c03-a640-9f486c147b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.004855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa6855-66d8-4c03-a640-9f486c147b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:06.011835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa6855-66d8-4c03-a640-9f486c147b5a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:06.028330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9fa7bddd-333c-4e32-a0c4-051f6742c89f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:06.030252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9fa7bddd-333c-4e32-a0c4-051f6742c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:06.040913 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 946/1890] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:06.041949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa6855-66d8-4c03-a640-9f486c147b5a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:06.050485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-00aa6855-66d8-4c03-a640-9f486c147b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:06.059179 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 945/1891] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:06.072714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7bddd-333c-4e32-a0c4-051f6742c89f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:06.079178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9fa7bddd-333c-4e32-a0c4-051f6742c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:06.081474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa6855-66d8-4c03-a640-9f486c147b5a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:06.103532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108eaa5-7197-479d-9d72-7f4fc0ca7e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:06.104224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108eaa5-7197-479d-9d72-7f4fc0ca7e75 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.104508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108eaa5-7197-479d-9d72-7f4fc0ca7e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.104794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108eaa5-7197-479d-9d72-7f4fc0ca7e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.107871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108eaa5-7197-479d-9d72-7f4fc0ca7e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:06.111059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108eaa5-7197-479d-9d72-7f4fc0ca7e75 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:06.123293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7bddd-333c-4e32-a0c4-051f6742c89f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:06.128095 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 947/1892] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:06.129280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529889-f566-4a37-b376-314820c21f1a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.129620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529889-f566-4a37-b376-314820c21f1a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.129913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529889-f566-4a37-b376-314820c21f1a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.131807 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 948/1893] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:06.132312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7529889-f566-4a37-b376-314820c21f1a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:06.148274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7529889-f566-4a37-b376-314820c21f1a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:06.154716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d48ef-ae70-4464-b813-86d33c37cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:06.155403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d48ef-ae70-4464-b813-86d33c37cf59 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.155687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d48ef-ae70-4464-b813-86d33c37cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.155965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d48ef-ae70-4464-b813-86d33c37cf59 admin admin] PATH_INFO: `/v3/projects/cacd3a8ccc674a0ab775b2aa20ec08ec/users/0e05f5de07aa4189bc933dd2a5fb0205/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.157130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6965769-8eb7-4be7-9e56-2a4a46727ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:06.162339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6965769-8eb7-4be7-9e56-2a4a46727ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.165161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6965769-8eb7-4be7-9e56-2a4a46727ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.166200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6965769-8eb7-4be7-9e56-2a4a46727ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.230366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6965769-8eb7-4be7-9e56-2a4a46727ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:06.239960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d48ef-ae70-4464-b813-86d33c37cf59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacd3a8ccc674a0ab775b2aa20ec08ec, user_id=0e05f5de07aa4189bc933dd2a5fb0205, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:06.240755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6965769-8eb7-4be7-9e56-2a4a46727ad4 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:06.249604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d48ef-ae70-4464-b813-86d33c37cf59 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:06.269314 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 946/1894] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:06.271275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6965769-8eb7-4be7-9e56-2a4a46727ad4 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:06.308837 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 949/1895] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:06 2022] PUT /identity/v3/projects/cacd3a8ccc674a0ab775b2aa20ec08ec/users/0e05f5de07aa4189bc933dd2a5fb0205/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:06.309931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d48ef-ae70-4464-b813-86d33c37cf59 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:06.312911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6965769-8eb7-4be7-9e56-2a4a46727ad4 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:06.401939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b01d28-883b-4fa3-a59b-74d48089769d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:06.405972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b01d28-883b-4fa3-a59b-74d48089769d service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.406657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b01d28-883b-4fa3-a59b-74d48089769d service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.407328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b01d28-883b-4fa3-a59b-74d48089769d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.476081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d48ef-ae70-4464-b813-86d33c37cf59 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:06.493065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b01d28-883b-4fa3-a59b-74d48089769d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:06.494024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c10f79-e4ab-4bbd-ab4c-62d0b512acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:06.494756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c10f79-e4ab-4bbd-ab4c-62d0b512acf8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.494891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b01d28-883b-4fa3-a59b-74d48089769d service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:06.495207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c10f79-e4ab-4bbd-ab4c-62d0b512acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.495570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c10f79-e4ab-4bbd-ab4c-62d0b512acf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.496350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c10f79-e4ab-4bbd-ab4c-62d0b512acf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:06.501244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c10f79-e4ab-4bbd-ab4c-62d0b512acf8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:06.515143 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 947/1896] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:06.515143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b01d28-883b-4fa3-a59b-74d48089769d service neutron] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:06.518173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-14b01d28-883b-4fa3-a59b-74d48089769d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:06.526831 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 950/1897] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:06.528307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1670577-71d9-4fd2-aa8d-7b10432caf92 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.528995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1670577-71d9-4fd2-aa8d-7b10432caf92 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.529276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1670577-71d9-4fd2-aa8d-7b10432caf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.594061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c1670577-71d9-4fd2-aa8d-7b10432caf92 None None] MFA Rules not processed for user `0e05f5de07aa4189bc933dd2a5fb0205`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:06.597167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c1670577-71d9-4fd2-aa8d-7b10432caf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:06.748890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b01d28-883b-4fa3-a59b-74d48089769d service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:06.808350 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 951/1898] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:06.811626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1670577-71d9-4fd2-aa8d-7b10432caf92 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:06.835470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:06.861738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1670577-71d9-4fd2-aa8d-7b10432caf92 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:06.874464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385fb0c-c555-4a45-abe7-96f2ff37458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:06.875438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385fb0c-c555-4a45-abe7-96f2ff37458c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:06.875965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385fb0c-c555-4a45-abe7-96f2ff37458c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:06.877204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385fb0c-c555-4a45-abe7-96f2ff37458c admin admin] PATH_INFO: `/v3/projects/de99d61e6050468184f41b2cb0b30a40/users/23a8aed73a054066a3b56584536e0881/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:06.904599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385fb0c-c555-4a45-abe7-96f2ff37458c admin admin] RBAC: Authorizing `identity:create_grant(project_id=de99d61e6050468184f41b2cb0b30a40, user_id=23a8aed73a054066a3b56584536e0881, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:06.911251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385fb0c-c555-4a45-abe7-96f2ff37458c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:06.918649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:06.927232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b01d28-883b-4fa3-a59b-74d48089769d service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:06.948939 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 952/1899] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:06 2022] PUT /identity/v3/projects/de99d61e6050468184f41b2cb0b30a40/users/23a8aed73a054066a3b56584536e0881/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:06.950555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385fb0c-c555-4a45-abe7-96f2ff37458c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:07.087843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5dc14-0690-4832-ae39-3c3771b694d6 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa085de9b1f44b9397e0a3f37a688567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6992920f4374a21b6b54fa8a8dd3b05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:07.089255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5dc14-0690-4832-ae39-3c3771b694d6 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:07.089836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5dc14-0690-4832-ae39-3c3771b694d6 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:07.090466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5dc14-0690-4832-ae39-3c3771b694d6 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] PATH_INFO: `/v3/projects/031d3a19bd9b4f288395ce8732981dd5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:07.093120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5dc14-0690-4832-ae39-3c3771b694d6 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorizing `identity:get_project(project_id=031d3a19bd9b4f288395ce8732981dd5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:07.100701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5dc14-0690-4832-ae39-3c3771b694d6 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:07.103202 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 948/1900] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:06 2022] GET /identity/v3/projects/031d3a19bd9b4f288395ce8732981dd5 => generated 395 bytes in 588 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:07.106310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7be524-2bcd-4d63-8cf4-96a6bb2305ec None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:07.108494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7be524-2bcd-4d63-8cf4-96a6bb2305ec None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:07.109028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7be524-2bcd-4d63-8cf4-96a6bb2305ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:07.111519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385fb0c-c555-4a45-abe7-96f2ff37458c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:07.139236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef698-eac9-47ca-826e-ad3098598bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:07.141166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef698-eac9-47ca-826e-ad3098598bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:07.141523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef698-eac9-47ca-826e-ad3098598bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:07.141845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef698-eac9-47ca-826e-ad3098598bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:07.145033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ef698-eac9-47ca-826e-ad3098598bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:07.155393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ef698-eac9-47ca-826e-ad3098598bb3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:07.211444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bf7be524-2bcd-4d63-8cf4-96a6bb2305ec None None] MFA Rules not processed for user `23a8aed73a054066a3b56584536e0881`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:07.217370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bf7be524-2bcd-4d63-8cf4-96a6bb2305ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:07.229725 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 953/1901] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:06 2022] POST /identity/v3/projects => generated 387 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:07.231066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef698-eac9-47ca-826e-ad3098598bb3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:07.237500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ef4ef698-eac9-47ca-826e-ad3098598bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:07.460682 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 949/1902] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:07.462055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7be524-2bcd-4d63-8cf4-96a6bb2305ec None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:07.485773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef698-eac9-47ca-826e-ad3098598bb3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:07.502310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:07.502454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7be524-2bcd-4d63-8cf4-96a6bb2305ec None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:07.502553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:07.502553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:07.502553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] PATH_INFO: `/v3/projects/da383a1aef9044a8b37301ccd31b701d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:07.505014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da383a1aef9044a8b37301ccd31b701d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:07.509719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c50b4-348c-4f59-9ae2-a7cab507b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:07.510676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c50b4-348c-4f59-9ae2-a7cab507b0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:07.511175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c50b4-348c-4f59-9ae2-a7cab507b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:07.511662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c50b4-348c-4f59-9ae2-a7cab507b0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:07.512533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c50b4-348c-4f59-9ae2-a7cab507b0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:07.512650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:07.515142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c50b4-348c-4f59-9ae2-a7cab507b0d6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:07.561899 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 950/1903] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:07 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:07.564209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c50b4-348c-4f59-9ae2-a7cab507b0d6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:07.585474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c50b4-348c-4f59-9ae2-a7cab507b0d6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:07.594065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e752ee-ed7d-404a-a9cb-397bd66e3d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:07.595034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e752ee-ed7d-404a-a9cb-397bd66e3d41 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:07.595563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e752ee-ed7d-404a-a9cb-397bd66e3d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:07.596002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e752ee-ed7d-404a-a9cb-397bd66e3d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:07.597044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e752ee-ed7d-404a-a9cb-397bd66e3d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:07.600289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e752ee-ed7d-404a-a9cb-397bd66e3d41 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:07.649471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da383a1aef9044a8b37301ccd31b701d', 'request_id': 'req-9125c00f-54c5-4198-88db-358d7a803e9e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:07.653458 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 951/1904] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:07 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:07.655426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e752ee-ed7d-404a-a9cb-397bd66e3d41 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:07.672707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da383a1aef9044a8b37301ccd31b701d', 'request_id': 'req-9125c00f-54c5-4198-88db-358d7a803e9e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:07.692724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da383a1aef9044a8b37301ccd31b701d', 'request_id': 'req-9125c00f-54c5-4198-88db-358d7a803e9e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:07.712714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:07.722706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] The token cache is being invalidate because project da383a1aef9044a8b37301ccd31b701d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:07.723291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:07.726259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:07.732302 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 954/1905] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:07 2022] DELETE /identity/v3/projects/da383a1aef9044a8b37301ccd31b701d => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:07.733888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:07.735548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:07.756861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:07.779168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e752ee-ed7d-404a-a9cb-397bd66e3d41 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:07.790142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992d4d0-8e58-43b6-9a47-df55350867df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:07.791145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992d4d0-8e58-43b6-9a47-df55350867df admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:07.791885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992d4d0-8e58-43b6-9a47-df55350867df admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:07.792004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992d4d0-8e58-43b6-9a47-df55350867df admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:07.792990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992d4d0-8e58-43b6-9a47-df55350867df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:07.794984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992d4d0-8e58-43b6-9a47-df55350867df admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:07.810793 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 952/1906] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:07.811663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992d4d0-8e58-43b6-9a47-df55350867df admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:07.813532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7992d4d0-8e58-43b6-9a47-df55350867df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:07.826860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992d4d0-8e58-43b6-9a47-df55350867df admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:07.837516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125c00f-54c5-4198-88db-358d7a803e9e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:07.838007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76241fcb-51da-4dc9-abe2-6f6123ed264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:07.838983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76241fcb-51da-4dc9-abe2-6f6123ed264a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:07.839463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76241fcb-51da-4dc9-abe2-6f6123ed264a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:07.840020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76241fcb-51da-4dc9-abe2-6f6123ed264a admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:07.841357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76241fcb-51da-4dc9-abe2-6f6123ed264a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:07.846596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76241fcb-51da-4dc9-abe2-6f6123ed264a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:07.873890 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 953/1907] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:07 2022] POST /identity/v3/users => generated 297 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:07.875653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2bddc-48cc-4360-8de2-72f100b5990c None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:07.875653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2bddc-48cc-4360-8de2-72f100b5990c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:07.876899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2bddc-48cc-4360-8de2-72f100b5990c None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:07.878237 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 954/1908] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:07.879084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2bddc-48cc-4360-8de2-72f100b5990c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:07.881266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-74c2bddc-48cc-4360-8de2-72f100b5990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:07.913819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2bddc-48cc-4360-8de2-72f100b5990c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:07.919674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:07.920453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:07.920678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:07.920970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] PATH_INFO: `/v3/users/197418e111a043eb89a19030f483a559` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:07.922241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=197418e111a043eb89a19030f483a559)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:07.924187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:07.938242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e591a-19aa-4e2f-b9c4-d23d05735476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:07.939620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e591a-19aa-4e2f-b9c4-d23d05735476 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:07.939959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e591a-19aa-4e2f-b9c4-d23d05735476 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:07.940251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e591a-19aa-4e2f-b9c4-d23d05735476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:07.942201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-947e591a-19aa-4e2f-b9c4-d23d05735476 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:07.986523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197418e111a043eb89a19030f483a559'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:07.987644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197418e111a043eb89a19030f483a559'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.001144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197418e111a043eb89a19030f483a559'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.002514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197418e111a043eb89a19030f483a559'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.010686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e591a-19aa-4e2f-b9c4-d23d05735476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:08.011606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197418e111a043eb89a19030f483a559'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.012313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e591a-19aa-4e2f-b9c4-d23d05735476 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:08.025074 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 955/1909] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:07 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:08.025781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e591a-19aa-4e2f-b9c4-d23d05735476 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:08.027202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-947e591a-19aa-4e2f-b9c4-d23d05735476 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.031801 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 955/1910] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:07 2022] DELETE /identity/v3/users/197418e111a043eb89a19030f483a559 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:08.033176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:08.042508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e591a-19aa-4e2f-b9c4-d23d05735476 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:08.045190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.118375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:08.149446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c507f-5d00-4c9b-b3bb-2ed530236ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:08.151245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c507f-5d00-4c9b-b3bb-2ed530236ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.151245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c507f-5d00-4c9b-b3bb-2ed530236ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.153466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c507f-5d00-4c9b-b3bb-2ed530236ac5 admin admin] PATH_INFO: `/v3/projects/31f2208094e3493690a0cf3e6f17bf9c/users/926654a9e5524c8299925b6a648409a9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.192268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c507f-5d00-4c9b-b3bb-2ed530236ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f2208094e3493690a0cf3e6f17bf9c, user_id=926654a9e5524c8299925b6a648409a9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:08.195411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c507f-5d00-4c9b-b3bb-2ed530236ac5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:08.197648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe29db-4784-4cb6-ba31-a53ae1385062 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:08.206130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:08.206130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.206130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.206130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] PATH_INFO: `/v3/projects/812b3c0fb2fc44e59b62655e692efb6f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.207277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=812b3c0fb2fc44e59b62655e692efb6f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:08.209376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:08.221751 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 956/1911] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:08 2022] PUT /identity/v3/projects/31f2208094e3493690a0cf3e6f17bf9c/users/926654a9e5524c8299925b6a648409a9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:08.223080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c507f-5d00-4c9b-b3bb-2ed530236ac5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:08.225814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-767c507f-5d00-4c9b-b3bb-2ed530236ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.237922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:08.272555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812b3c0fb2fc44e59b62655e692efb6f', 'request_id': 'req-3ab04a55-0668-4432-905c-8b19cb38ad04'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.280269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812b3c0fb2fc44e59b62655e692efb6f', 'request_id': 'req-3ab04a55-0668-4432-905c-8b19cb38ad04'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.288807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812b3c0fb2fc44e59b62655e692efb6f', 'request_id': 'req-3ab04a55-0668-4432-905c-8b19cb38ad04'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.300820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] The token cache is being invalidate because project 812b3c0fb2fc44e59b62655e692efb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:08.301367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.302141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ab04a55-0668-4432-905c-8b19cb38ad04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.303870 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 956/1912] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:08 2022] DELETE /identity/v3/projects/812b3c0fb2fc44e59b62655e692efb6f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:08.305008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2512e-671e-42a9-89c4-6f7fbc74d26a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.305289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2512e-671e-42a9-89c4-6f7fbc74d26a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.305588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2512e-671e-42a9-89c4-6f7fbc74d26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.327453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c507f-5d00-4c9b-b3bb-2ed530236ac5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:08.328374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a4f2512e-671e-42a9-89c4-6f7fbc74d26a None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:08.329631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a4f2512e-671e-42a9-89c4-6f7fbc74d26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.394704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c89141-5afd-48d2-889f-952b96221984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:08.396119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89141-5afd-48d2-889f-952b96221984 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.396595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89141-5afd-48d2-889f-952b96221984 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.397053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89141-5afd-48d2-889f-952b96221984 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.397873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c89141-5afd-48d2-889f-952b96221984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:08.399624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c89141-5afd-48d2-889f-952b96221984 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:08.408494 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 957/1913] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:26:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:08.409590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74416342-dec5-4959-8606-036bf6c2b91c None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.409906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74416342-dec5-4959-8606-036bf6c2b91c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.410252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74416342-dec5-4959-8606-036bf6c2b91c None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.419155 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 957/1914] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:08.419358 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 958/1915] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:08.419358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74416342-dec5-4959-8606-036bf6c2b91c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:08.420665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-74416342-dec5-4959-8606-036bf6c2b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.421647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c89141-5afd-48d2-889f-952b96221984 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:08.433322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c5c89141-5afd-48d2-889f-952b96221984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.443803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74416342-dec5-4959-8606-036bf6c2b91c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:08.451437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256c5dc-948a-494e-8558-2bcdce005104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:08.451982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c89141-5afd-48d2-889f-952b96221984 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:08.452288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c5dc-948a-494e-8558-2bcdce005104 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.453033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c5dc-948a-494e-8558-2bcdce005104 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.453033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c5dc-948a-494e-8558-2bcdce005104 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.453707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256c5dc-948a-494e-8558-2bcdce005104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:08.455544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256c5dc-948a-494e-8558-2bcdce005104 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:08.461351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:08.462038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.462326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.462600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] PATH_INFO: `/v3/users/2cdc4712f93b4fa59f7f8e6a2e193a1b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.464335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cdc4712f93b4fa59f7f8e6a2e193a1b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:08.466308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:08.470766 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 959/1916] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:08.471848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256c5dc-948a-494e-8558-2bcdce005104 admin admin] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:08.474140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3256c5dc-948a-494e-8558-2bcdce005104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.491702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256c5dc-948a-494e-8558-2bcdce005104 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:08.492973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3256c5dc-948a-494e-8558-2bcdce005104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.538550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cdc4712f93b4fa59f7f8e6a2e193a1b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.538550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cdc4712f93b4fa59f7f8e6a2e193a1b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.549087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cdc4712f93b4fa59f7f8e6a2e193a1b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.551645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:08.557631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cdc4712f93b4fa59f7f8e6a2e193a1b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.566270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cdc4712f93b4fa59f7f8e6a2e193a1b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.567240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256c5dc-948a-494e-8558-2bcdce005104 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:08.571968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc598a-519a-46af-b1c2-d008752bc0e1 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa085de9b1f44b9397e0a3f37a688567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6992920f4374a21b6b54fa8a8dd3b05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:08.572441 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 958/1917] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:08 2022] DELETE /identity/v3/users/2cdc4712f93b4fa59f7f8e6a2e193a1b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:08.572602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc598a-519a-46af-b1c2-d008752bc0e1 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.572890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc598a-519a-46af-b1c2-d008752bc0e1 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.573172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc598a-519a-46af-b1c2-d008752bc0e1 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] PATH_INFO: `/v3/projects/031d3a19bd9b4f288395ce8732981dd5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.573424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:08.574337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc598a-519a-46af-b1c2-d008752bc0e1 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorizing `identity:get_project(project_id=031d3a19bd9b4f288395ce8732981dd5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:08.575025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.576461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc598a-519a-46af-b1c2-d008752bc0e1 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:08.578806 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 960/1918] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:08 2022] GET /identity/v3/projects/031d3a19bd9b4f288395ce8732981dd5 => generated 395 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:08.580319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc598a-519a-46af-b1c2-d008752bc0e1 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:08.582164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-98fc598a-519a-46af-b1c2-d008752bc0e1 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.605307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc598a-519a-46af-b1c2-d008752bc0e1 tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:08.651254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:08.669096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17300781-3d8a-429d-8f26-be6b28a54187 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:08.675875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466fc35-42a4-4221-be13-52d55ac0e7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:08.676549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466fc35-42a4-4221-be13-52d55ac0e7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.676822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466fc35-42a4-4221-be13-52d55ac0e7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.677907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466fc35-42a4-4221-be13-52d55ac0e7b5 admin admin] PATH_INFO: `/v3/projects/a0bba74a3f0645dead058641f89206d3/users/0fcfa0ffb4d24d9993c61ea78e7c9937/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.701106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466fc35-42a4-4221-be13-52d55ac0e7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bba74a3f0645dead058641f89206d3, user_id=0fcfa0ffb4d24d9993c61ea78e7c9937, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:08.704461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466fc35-42a4-4221-be13-52d55ac0e7b5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:08.729413 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 959/1919] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:08 2022] PUT /identity/v3/projects/a0bba74a3f0645dead058641f89206d3/users/0fcfa0ffb4d24d9993c61ea78e7c9937/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:08.730278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466fc35-42a4-4221-be13-52d55ac0e7b5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:08.733549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5466fc35-42a4-4221-be13-52d55ac0e7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.737102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a8165-d630-4094-bd12-511adce27293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:08.737719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a8165-d630-4094-bd12-511adce27293 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.737994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a8165-d630-4094-bd12-511adce27293 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.738259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a8165-d630-4094-bd12-511adce27293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.740157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c59a8165-d630-4094-bd12-511adce27293 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.754866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a8165-d630-4094-bd12-511adce27293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:08.756524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a8165-d630-4094-bd12-511adce27293 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:08.773826 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 961/1920] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:08.775831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a8165-d630-4094-bd12-511adce27293 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:08.779209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c59a8165-d630-4094-bd12-511adce27293 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:08.803363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a8165-d630-4094-bd12-511adce27293 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:08.827670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466fc35-42a4-4221-be13-52d55ac0e7b5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:08.836826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fc45d-fa47-4c69-b046-1a51273dd453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:08.837546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc45d-fa47-4c69-b046-1a51273dd453 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.838057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc45d-fa47-4c69-b046-1a51273dd453 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.838304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc45d-fa47-4c69-b046-1a51273dd453 admin admin] PATH_INFO: `/v3/projects/31f2208094e3493690a0cf3e6f17bf9c/users/926654a9e5524c8299925b6a648409a9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.840884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fc45d-fa47-4c69-b046-1a51273dd453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f2208094e3493690a0cf3e6f17bf9c, user_id=926654a9e5524c8299925b6a648409a9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:08.844657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fc45d-fa47-4c69-b046-1a51273dd453 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:08.848639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:08.850553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.853150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.853623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] PATH_INFO: `/v3/projects/e558b79ebc314347b07a7dae4f1720d2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:08.855006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e558b79ebc314347b07a7dae4f1720d2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:08.858489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:08.875182 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 960/1921] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:08 2022] PUT /identity/v3/projects/31f2208094e3493690a0cf3e6f17bf9c/users/926654a9e5524c8299925b6a648409a9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:08.876233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fc45d-fa47-4c69-b046-1a51273dd453 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:08.946065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e558b79ebc314347b07a7dae4f1720d2', 'request_id': 'req-be9c4e31-397e-4abd-a49b-cbf21fe06838'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.954046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e558b79ebc314347b07a7dae4f1720d2', 'request_id': 'req-be9c4e31-397e-4abd-a49b-cbf21fe06838'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.967226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e558b79ebc314347b07a7dae4f1720d2', 'request_id': 'req-be9c4e31-397e-4abd-a49b-cbf21fe06838'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.973794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fc45d-fa47-4c69-b046-1a51273dd453 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:08.981775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] The token cache is being invalidate because project e558b79ebc314347b07a7dae4f1720d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:08.982109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.982908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be9c4e31-397e-4abd-a49b-cbf21fe06838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:08.983699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:08.984722 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 962/1922] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:08 2022] DELETE /identity/v3/projects/e558b79ebc314347b07a7dae4f1720d2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:08.988603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7331349-c2fb-4e89-8280-3327d632c944 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:08.988603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7331349-c2fb-4e89-8280-3327d632c944 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:08.988603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7331349-c2fb-4e89-8280-3327d632c944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.035149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e7331349-c2fb-4e89-8280-3327d632c944 None None] MFA Rules not processed for user `926654a9e5524c8299925b6a648409a9`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:09.036980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e7331349-c2fb-4e89-8280-3327d632c944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.060751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c06c2-6539-4854-b19e-259a31b517c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.061380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c06c2-6539-4854-b19e-259a31b517c8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.061688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c06c2-6539-4854-b19e-259a31b517c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.061967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c06c2-6539-4854-b19e-259a31b517c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.062628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c06c2-6539-4854-b19e-259a31b517c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.064253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c06c2-6539-4854-b19e-259a31b517c8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.075433 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 961/1923] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:09.076902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dc194-ea12-4453-b42d-7dfab6f4e860 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.077193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dc194-ea12-4453-b42d-7dfab6f4e860 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.077498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dc194-ea12-4453-b42d-7dfab6f4e860 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.079283 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 962/1924] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:09.080508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34c97e-c73d-4dcb-9819-2a2892ae8df7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.080941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34c97e-c73d-4dcb-9819-2a2892ae8df7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.081226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34c97e-c73d-4dcb-9819-2a2892ae8df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.104019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6f34c97e-c73d-4dcb-9819-2a2892ae8df7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:09.105488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6f34c97e-c73d-4dcb-9819-2a2892ae8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.115032 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 963/1925] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:09.122482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34c97e-c73d-4dcb-9819-2a2892ae8df7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.124487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6f34c97e-c73d-4dcb-9819-2a2892ae8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.129767 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 963/1926] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:09.131310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7331349-c2fb-4e89-8280-3327d632c944 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.133178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e7331349-c2fb-4e89-8280-3327d632c944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.138292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34c97e-c73d-4dcb-9819-2a2892ae8df7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.143346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.144154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.144465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.144739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] PATH_INFO: `/v3/projects/1b76bd5f4e04427aa0bc741cfc53670d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.146007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b76bd5f4e04427aa0bc741cfc53670d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.147881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.149073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7331349-c2fb-4e89-8280-3327d632c944 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.154573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9bd21-32b6-45ab-ac35-ccff2a6848b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.155225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9bd21-32b6-45ab-ac35-ccff2a6848b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.155528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9bd21-32b6-45ab-ac35-ccff2a6848b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.155797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9bd21-32b6-45ab-ac35-ccff2a6848b5 admin admin] PATH_INFO: `/v3/projects/a0bba74a3f0645dead058641f89206d3/users/0fcfa0ffb4d24d9993c61ea78e7c9937/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.157818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9bd21-32b6-45ab-ac35-ccff2a6848b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bba74a3f0645dead058641f89206d3, user_id=0fcfa0ffb4d24d9993c61ea78e7c9937, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.160491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9bd21-32b6-45ab-ac35-ccff2a6848b5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.171040 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 964/1927] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:09 2022] PUT /identity/v3/projects/a0bba74a3f0645dead058641f89206d3/users/0fcfa0ffb4d24d9993c61ea78e7c9937/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:09.171913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9bd21-32b6-45ab-ac35-ccff2a6848b5 admin admin] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:09.173505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1ac9bd21-32b6-45ab-ac35-ccff2a6848b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.191957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:09.209975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b76bd5f4e04427aa0bc741cfc53670d', 'request_id': 'req-11649f9c-2d83-4a48-9416-3a017873977a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:09.215845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b76bd5f4e04427aa0bc741cfc53670d', 'request_id': 'req-11649f9c-2d83-4a48-9416-3a017873977a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:09.224267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b76bd5f4e04427aa0bc741cfc53670d', 'request_id': 'req-11649f9c-2d83-4a48-9416-3a017873977a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:09.235537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] The token cache is being invalidate because project 1b76bd5f4e04427aa0bc741cfc53670d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:09.235856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:09.236517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-11649f9c-2d83-4a48-9416-3a017873977a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:09.238074 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 964/1928] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:09 2022] DELETE /identity/v3/projects/1b76bd5f4e04427aa0bc741cfc53670d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:09.239259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122f26-d3a2-472f-972c-5e8548b965d1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.239546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122f26-d3a2-472f-972c-5e8548b965d1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.239825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122f26-d3a2-472f-972c-5e8548b965d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.259471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-99122f26-d3a2-472f-972c-5e8548b965d1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:09.260093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9bd21-32b6-45ab-ac35-ccff2a6848b5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.260674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-99122f26-d3a2-472f-972c-5e8548b965d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.261314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1ac9bd21-32b6-45ab-ac35-ccff2a6848b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.323199 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 965/1929] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:09.324457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168f945-e95b-4872-87de-f5a7640d60bd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.324741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168f945-e95b-4872-87de-f5a7640d60bd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.325015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168f945-e95b-4872-87de-f5a7640d60bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.327387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9bd21-32b6-45ab-ac35-ccff2a6848b5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.343317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7168f945-e95b-4872-87de-f5a7640d60bd None None] MFA Rules not processed for user `0e05f5de07aa4189bc933dd2a5fb0205`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:09.344502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7168f945-e95b-4872-87de-f5a7640d60bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.362017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:09.388070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d942b4-04fb-44a0-ba9e-1ceaa1db173f tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa085de9b1f44b9397e0a3f37a688567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6992920f4374a21b6b54fa8a8dd3b05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.388614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d942b4-04fb-44a0-ba9e-1ceaa1db173f tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.388896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d942b4-04fb-44a0-ba9e-1ceaa1db173f tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.389183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d942b4-04fb-44a0-ba9e-1ceaa1db173f tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] PATH_INFO: `/v3/projects/031d3a19bd9b4f288395ce8732981dd5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.390622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d942b4-04fb-44a0-ba9e-1ceaa1db173f tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorizing `identity:get_project(project_id=031d3a19bd9b4f288395ce8732981dd5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.392776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d942b4-04fb-44a0-ba9e-1ceaa1db173f tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.394472 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 965/1930] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/projects/031d3a19bd9b4f288395ce8732981dd5 => generated 395 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:09.395728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5ef5-2742-4152-82bd-a73a38d97fe4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.396072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5ef5-2742-4152-82bd-a73a38d97fe4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.396348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5ef5-2742-4152-82bd-a73a38d97fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.405189 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 966/1931] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:09.406419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af586d4c-1d8d-4a96-afdc-ad1a5106f7f5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.406760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af586d4c-1d8d-4a96-afdc-ad1a5106f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.407118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af586d4c-1d8d-4a96-afdc-ad1a5106f7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.430125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-115a5ef5-2742-4152-82bd-a73a38d97fe4 None None] MFA Rules not processed for user `0fcfa0ffb4d24d9993c61ea78e7c9937`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:09.431383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-115a5ef5-2742-4152-82bd-a73a38d97fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.432820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-af586d4c-1d8d-4a96-afdc-ad1a5106f7f5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:09.434181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-af586d4c-1d8d-4a96-afdc-ad1a5106f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.445554 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 967/1932] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:09.446733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af586d4c-1d8d-4a96-afdc-ad1a5106f7f5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.457497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af586d4c-1d8d-4a96-afdc-ad1a5106f7f5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.462798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf211f-b252-4507-8025-79e51e398a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.463490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf211f-b252-4507-8025-79e51e398a53 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.463830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf211f-b252-4507-8025-79e51e398a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.464163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf211f-b252-4507-8025-79e51e398a53 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.464879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf211f-b252-4507-8025-79e51e398a53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:09.465244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf211f-b252-4507-8025-79e51e398a53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.467059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf211f-b252-4507-8025-79e51e398a53 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.479947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:09.486682 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 968/1933] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:09.486682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf211f-b252-4507-8025-79e51e398a53 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.486682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9caf211f-b252-4507-8025-79e51e398a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.522790 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 966/1934] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:09.524614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c8e5a-7ed0-4cea-b102-401e90a0bbeb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.527261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c8e5a-7ed0-4cea-b102-401e90a0bbeb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.527261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c8e5a-7ed0-4cea-b102-401e90a0bbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.548318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fc2c8e5a-7ed0-4cea-b102-401e90a0bbeb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:09.549673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc2c8e5a-7ed0-4cea-b102-401e90a0bbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.557767 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 967/1935] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:09.558609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c8e5a-7ed0-4cea-b102-401e90a0bbeb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.569968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c8e5a-7ed0-4cea-b102-401e90a0bbeb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.574608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb70ff-f4f6-4ede-b4da-a62b4a71d7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.575261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb70ff-f4f6-4ede-b4da-a62b4a71d7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.575607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb70ff-f4f6-4ede-b4da-a62b4a71d7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.576025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb70ff-f4f6-4ede-b4da-a62b4a71d7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.576748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb70ff-f4f6-4ede-b4da-a62b4a71d7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.578765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb70ff-f4f6-4ede-b4da-a62b4a71d7a2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.584344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf211f-b252-4507-8025-79e51e398a53 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.590007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ed50b-488d-4a7b-b64d-fedc0eaefac3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.590681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed50b-488d-4a7b-b64d-fedc0eaefac3 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.590902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed50b-488d-4a7b-b64d-fedc0eaefac3 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.591178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed50b-488d-4a7b-b64d-fedc0eaefac3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.592947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5b7ed50b-488d-4a7b-b64d-fedc0eaefac3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.604792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ed50b-488d-4a7b-b64d-fedc0eaefac3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.606450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ed50b-488d-4a7b-b64d-fedc0eaefac3 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.608690 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 968/1936] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:09 2022] POST /identity/v3/projects => generated 395 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:09.609499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb70ff-f4f6-4ede-b4da-a62b4a71d7a2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.611102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4ceb70ff-f4f6-4ede-b4da-a62b4a71d7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:09.616792 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 969/1937] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:09.617659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ed50b-488d-4a7b-b64d-fedc0eaefac3 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.628040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ed50b-488d-4a7b-b64d-fedc0eaefac3 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.700343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff7f8c-fd36-4642-b8b6-2149970a4ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.701029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff7f8c-fd36-4642-b8b6-2149970a4ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.701312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff7f8c-fd36-4642-b8b6-2149970a4ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.701611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff7f8c-fd36-4642-b8b6-2149970a4ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.702376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff7f8c-fd36-4642-b8b6-2149970a4ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:09.702682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff7f8c-fd36-4642-b8b6-2149970a4ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.705630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff7f8c-fd36-4642-b8b6-2149970a4ae5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.711570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb70ff-f4f6-4ede-b4da-a62b4a71d7a2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.717846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42440707-8965-4e07-a24b-4fda9e4ccb34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.718537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42440707-8965-4e07-a24b-4fda9e4ccb34 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.718885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42440707-8965-4e07-a24b-4fda9e4ccb34 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.719225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42440707-8965-4e07-a24b-4fda9e4ccb34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.721550 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 970/1938] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:09.721550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff7f8c-fd36-4642-b8b6-2149970a4ae5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.732781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff7f8c-fd36-4642-b8b6-2149970a4ae5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.738278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd594c-401e-49ad-9b93-6a2f04489844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.738961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd594c-401e-49ad-9b93-6a2f04489844 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.739334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd594c-401e-49ad-9b93-6a2f04489844 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.739814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd594c-401e-49ad-9b93-6a2f04489844 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.740391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd594c-401e-49ad-9b93-6a2f04489844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.742901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd594c-401e-49ad-9b93-6a2f04489844 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.772954 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 971/1939] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:09 2022] POST /identity/v3/users => generated 298 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:09.772954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd594c-401e-49ad-9b93-6a2f04489844 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.788667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd594c-401e-49ad-9b93-6a2f04489844 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.790827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42440707-8965-4e07-a24b-4fda9e4ccb34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.792456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42440707-8965-4e07-a24b-4fda9e4ccb34 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.795308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fa2c7-23b1-4d4c-8f38-a03c278e4299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.796146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fa2c7-23b1-4d4c-8f38-a03c278e4299 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.796579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fa2c7-23b1-4d4c-8f38-a03c278e4299 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.797006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fa2c7-23b1-4d4c-8f38-a03c278e4299 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.798435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fa2c7-23b1-4d4c-8f38-a03c278e4299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.801546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fa2c7-23b1-4d4c-8f38-a03c278e4299 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.805210 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 969/1940] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:09.806165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42440707-8965-4e07-a24b-4fda9e4ccb34 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.810208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:09.816926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42440707-8965-4e07-a24b-4fda9e4ccb34 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.823373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5335e0-8b1f-4df3-9f51-765ea4b691ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.823986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5335e0-8b1f-4df3-9f51-765ea4b691ab admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.824268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5335e0-8b1f-4df3-9f51-765ea4b691ab admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.824539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5335e0-8b1f-4df3-9f51-765ea4b691ab admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.825191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5335e0-8b1f-4df3-9f51-765ea4b691ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.827111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5335e0-8b1f-4df3-9f51-765ea4b691ab admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.838878 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 970/1941] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:09.842477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5335e0-8b1f-4df3-9f51-765ea4b691ab admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.853451 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 972/1942] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:09 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:09.855390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5335e0-8b1f-4df3-9f51-765ea4b691ab admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.857222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fa2c7-23b1-4d4c-8f38-a03c278e4299 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:09.893149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:09.936165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b791-9254-4a88-9bab-5a10c32666b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.936698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b791-9254-4a88-9bab-5a10c32666b7 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.937106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b791-9254-4a88-9bab-5a10c32666b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.937402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b791-9254-4a88-9bab-5a10c32666b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.938057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88b791-9254-4a88-9bab-5a10c32666b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.940255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88b791-9254-4a88-9bab-5a10c32666b7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.944354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fa2c7-23b1-4d4c-8f38-a03c278e4299 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:09.950572 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 971/1943] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:26:09.951788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe922-1aaf-47b2-80e0-bda4bdeeac9d None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.952077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe922-1aaf-47b2-80e0-bda4bdeeac9d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.952351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe922-1aaf-47b2-80e0-bda4bdeeac9d None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.953914 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 972/1944] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:09.959644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe922-1aaf-47b2-80e0-bda4bdeeac9d None None] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:09.963806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ec733-bd86-41ba-ab93-2eafdf13da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:09.965246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ec733-bd86-41ba-ab93-2eafdf13da41 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:09.965246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ec733-bd86-41ba-ab93-2eafdf13da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:09.965482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ec733-bd86-41ba-ab93-2eafdf13da41 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:09.966393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ec733-bd86-41ba-ab93-2eafdf13da41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:09.969670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ec733-bd86-41ba-ab93-2eafdf13da41 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:09.997607 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 973/1945] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:09 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:26:09.998511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ec733-bd86-41ba-ab93-2eafdf13da41 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.015483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ec733-bd86-41ba-ab93-2eafdf13da41 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.021188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e92c0a-0bb7-415d-9571-9733f2448370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.021971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e92c0a-0bb7-415d-9571-9733f2448370 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.022330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e92c0a-0bb7-415d-9571-9733f2448370 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.022679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e92c0a-0bb7-415d-9571-9733f2448370 admin admin] PATH_INFO: `/v3/projects/b2b95295251249f69a2ab76c833b29dc/users/a2658a14b6924c73a12447f5e54f5101/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.040596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e92c0a-0bb7-415d-9571-9733f2448370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b95295251249f69a2ab76c833b29dc, user_id=a2658a14b6924c73a12447f5e54f5101, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.043644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e92c0a-0bb7-415d-9571-9733f2448370 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.044469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe922-1aaf-47b2-80e0-bda4bdeeac9d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.046098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d12fe922-1aaf-47b2-80e0-bda4bdeeac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:10.061756 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 974/1946] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:09 2022] PUT /identity/v3/projects/b2b95295251249f69a2ab76c833b29dc/users/a2658a14b6924c73a12447f5e54f5101/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:10.062911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e92c0a-0bb7-415d-9571-9733f2448370 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.130151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe922-1aaf-47b2-80e0-bda4bdeeac9d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.168326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e92c0a-0bb7-415d-9571-9733f2448370 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.174416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf98bb-85b9-4ac0-8eae-ae015195fce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.175194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf98bb-85b9-4ac0-8eae-ae015195fce7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.175464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf98bb-85b9-4ac0-8eae-ae015195fce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.175826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf98bb-85b9-4ac0-8eae-ae015195fce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.176736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf98bb-85b9-4ac0-8eae-ae015195fce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.180968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf98bb-85b9-4ac0-8eae-ae015195fce7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.197075 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 975/1947] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:10.197075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7f435-eeea-4eac-84de-e435175e4716 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.197075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7f435-eeea-4eac-84de-e435175e4716 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.197075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7f435-eeea-4eac-84de-e435175e4716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.235917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d9b7f435-eeea-4eac-84de-e435175e4716 None None] MFA Rules not processed for user `a2658a14b6924c73a12447f5e54f5101`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:10.238172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d9b7f435-eeea-4eac-84de-e435175e4716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:10.244458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3328df-cab9-4b36-be8b-1bcbdebff11c tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa085de9b1f44b9397e0a3f37a688567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6992920f4374a21b6b54fa8a8dd3b05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.246161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3328df-cab9-4b36-be8b-1bcbdebff11c tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.246757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3328df-cab9-4b36-be8b-1bcbdebff11c tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.247040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3328df-cab9-4b36-be8b-1bcbdebff11c tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] PATH_INFO: `/v3/projects/bc33c983f35c400ca58e6d981f26f924` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.248718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3328df-cab9-4b36-be8b-1bcbdebff11c tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc33c983f35c400ca58e6d981f26f924)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.255933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3328df-cab9-4b36-be8b-1bcbdebff11c tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.269567 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 973/1948] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:09 2022] GET /identity/v3/projects/bc33c983f35c400ca58e6d981f26f924 => generated 393 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:26:10.272438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3328df-cab9-4b36-be8b-1bcbdebff11c tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.305778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3328df-cab9-4b36-be8b-1bcbdebff11c tempest-FlavorsAccessNegativeTestJSON-947743849 tempest-FlavorsAccessNegativeTestJSON-947743849-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.308291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:10.320978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6a33-3e4d-47ce-b5d3-7ccb78e50c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.321528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6a33-3e4d-47ce-b5d3-7ccb78e50c65 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.321801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6a33-3e4d-47ce-b5d3-7ccb78e50c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.322077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6a33-3e4d-47ce-b5d3-7ccb78e50c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.322736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c6a33-3e4d-47ce-b5d3-7ccb78e50c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.324456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c6a33-3e4d-47ce-b5d3-7ccb78e50c65 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.335478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:10.351973 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 974/1949] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:10.352924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6a33-3e4d-47ce-b5d3-7ccb78e50c65 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.368391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6a33-3e4d-47ce-b5d3-7ccb78e50c65 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.387352 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 976/1950] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:10.388108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e5c1d-943b-49d7-b477-222c85540ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.388876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e5c1d-943b-49d7-b477-222c85540ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.389239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e5c1d-943b-49d7-b477-222c85540ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.390000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7f435-eeea-4eac-84de-e435175e4716 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.390270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e5c1d-943b-49d7-b477-222c85540ad5 admin admin] PATH_INFO: `/v3/projects/28f844a42ca44cc18a536711a7ff89a9/users/c4a46f5fb3e74f1f8c03e0bbe0adbb34/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.418270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7f435-eeea-4eac-84de-e435175e4716 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.433132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e5c1d-943b-49d7-b477-222c85540ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f844a42ca44cc18a536711a7ff89a9, user_id=c4a46f5fb3e74f1f8c03e0bbe0adbb34, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.437365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e5c1d-943b-49d7-b477-222c85540ad5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.450555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b33e7-dba2-4dbf-b8aa-3b501ecdb6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.452483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b33e7-dba2-4dbf-b8aa-3b501ecdb6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.452786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b33e7-dba2-4dbf-b8aa-3b501ecdb6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.453061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b33e7-dba2-4dbf-b8aa-3b501ecdb6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.454966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b33e7-dba2-4dbf-b8aa-3b501ecdb6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.461487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b33e7-dba2-4dbf-b8aa-3b501ecdb6f9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.483354 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 975/1951] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:10 2022] PUT /identity/v3/projects/28f844a42ca44cc18a536711a7ff89a9/users/c4a46f5fb3e74f1f8c03e0bbe0adbb34/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:10.485406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e5c1d-943b-49d7-b477-222c85540ad5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.491057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a35e5c1d-943b-49d7-b477-222c85540ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:10.510979 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 977/1952] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:10 2022] POST /identity/v3/projects => generated 393 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:10.515831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21dbf6-7da6-4138-b88e-3db720bf1ac4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.516139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21dbf6-7da6-4138-b88e-3db720bf1ac4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.516452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21dbf6-7da6-4138-b88e-3db720bf1ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.585380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fa21dbf6-7da6-4138-b88e-3db720bf1ac4 None None] MFA Rules not processed for user `c4a46f5fb3e74f1f8c03e0bbe0adbb34`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:10.586791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fa21dbf6-7da6-4138-b88e-3db720bf1ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:10.591980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e5c1d-943b-49d7-b477-222c85540ad5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.677714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.678566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.678980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.679400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] PATH_INFO: `/v3/users/23a8aed73a054066a3b56584536e0881` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.681200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a8aed73a054066a3b56584536e0881)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.683337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.723660 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 978/1953] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:10.725133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21dbf6-7da6-4138-b88e-3db720bf1ac4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.746945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21dbf6-7da6-4138-b88e-3db720bf1ac4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.755111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef926-9191-46b9-835a-b55bc7d15242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.755744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef926-9191-46b9-835a-b55bc7d15242 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.756029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef926-9191-46b9-835a-b55bc7d15242 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.756305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef926-9191-46b9-835a-b55bc7d15242 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.756946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef926-9191-46b9-835a-b55bc7d15242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.757424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a8aed73a054066a3b56584536e0881'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:10.758736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a8aed73a054066a3b56584536e0881'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:10.759772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef926-9191-46b9-835a-b55bc7d15242 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.789947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a8aed73a054066a3b56584536e0881'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:10.790756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a8aed73a054066a3b56584536e0881'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:10.791473 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 979/1954] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:10 2022] POST /identity/v3/users => generated 303 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:10.792615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef926-9191-46b9-835a-b55bc7d15242 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.794896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-028ef926-9191-46b9-835a-b55bc7d15242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:10.803176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a8aed73a054066a3b56584536e0881'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:10.808505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef926-9191-46b9-835a-b55bc7d15242 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.815304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.816085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.816370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.816663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] PATH_INFO: `/v3/users/4e0b4768f010461b8a0417f90e14b01b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.817189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:10.818020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0b4768f010461b8a0417f90e14b01b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.820331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.822304 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 976/1955] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:10 2022] DELETE /identity/v3/users/23a8aed73a054066a3b56584536e0881 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:10.826412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.828889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:10.881562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0b4768f010461b8a0417f90e14b01b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:10.885172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0b4768f010461b8a0417f90e14b01b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:10.904263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0b4768f010461b8a0417f90e14b01b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:10.911641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04871188-f15a-4383-b5e4-77d833b63ac9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:10.914903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0b4768f010461b8a0417f90e14b01b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:10.918027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c67d3-6a4d-496e-8215-c19b0983100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:10.918698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c67d3-6a4d-496e-8215-c19b0983100b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.918996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c67d3-6a4d-496e-8215-c19b0983100b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.919270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c67d3-6a4d-496e-8215-c19b0983100b admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.919812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c67d3-6a4d-496e-8215-c19b0983100b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:10.921748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c67d3-6a4d-496e-8215-c19b0983100b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:10.923797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0b4768f010461b8a0417f90e14b01b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:10.927264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:10.933988 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 980/1956] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:10 2022] DELETE /identity/v3/users/4e0b4768f010461b8a0417f90e14b01b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:10.933988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:10.935447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:10.955046 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 977/1957] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:10 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:10.959294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff7162-4dfc-4b81-959d-ab4cdd2ad9c7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:10.959584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff7162-4dfc-4b81-959d-ab4cdd2ad9c7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:10.959879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff7162-4dfc-4b81-959d-ab4cdd2ad9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:10.980391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f2ff7162-4dfc-4b81-959d-ab4cdd2ad9c7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:10.981642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f2ff7162-4dfc-4b81-959d-ab4cdd2ad9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:11.015376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b2339-ec13-4d4b-a5e1-f948dda66e86 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.054778 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 978/1958] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:11.056066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773709-8d07-47bf-8c4c-c84c6fcaaf0a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.056353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773709-8d07-47bf-8c4c-c84c6fcaaf0a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.056627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773709-8d07-47bf-8c4c-c84c6fcaaf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.077866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ff773709-8d07-47bf-8c4c-c84c6fcaaf0a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:11.079217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ff773709-8d07-47bf-8c4c-c84c6fcaaf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:11.084300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999761e-b55e-47d3-aceb-e1e91cb18c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.084999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999761e-b55e-47d3-aceb-e1e91cb18c1f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.085343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999761e-b55e-47d3-aceb-e1e91cb18c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.085717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999761e-b55e-47d3-aceb-e1e91cb18c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.086422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999761e-b55e-47d3-aceb-e1e91cb18c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.087887 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 979/1959] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:11.088121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999761e-b55e-47d3-aceb-e1e91cb18c1f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.091781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff773709-8d07-47bf-8c4c-c84c6fcaaf0a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.093163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ff773709-8d07-47bf-8c4c-c84c6fcaaf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:11.102695 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 981/1960] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:11.102695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999761e-b55e-47d3-aceb-e1e91cb18c1f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.104145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9999761e-b55e-47d3-aceb-e1e91cb18c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:11.106801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff773709-8d07-47bf-8c4c-c84c6fcaaf0a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.113233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d7a39-9e09-44ea-86e3-5810979c5231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.113887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d7a39-9e09-44ea-86e3-5810979c5231 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.114166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d7a39-9e09-44ea-86e3-5810979c5231 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.114445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d7a39-9e09-44ea-86e3-5810979c5231 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.115203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d7a39-9e09-44ea-86e3-5810979c5231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.117154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d7a39-9e09-44ea-86e3-5810979c5231 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.148331 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 980/1961] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:11 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:11.149641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d7a39-9e09-44ea-86e3-5810979c5231 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.152036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7b3d7a39-9e09-44ea-86e3-5810979c5231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:11.174217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999761e-b55e-47d3-aceb-e1e91cb18c1f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.178482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5a012-d213-4872-a9df-7e08713cb5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.179098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5a012-d213-4872-a9df-7e08713cb5fa service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.179373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5a012-d213-4872-a9df-7e08713cb5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.179644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5a012-d213-4872-a9df-7e08713cb5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.194053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5a012-d213-4872-a9df-7e08713cb5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.195798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5a012-d213-4872-a9df-7e08713cb5fa service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.208125 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 982/1962] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:11.208663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5a012-d213-4872-a9df-7e08713cb5fa service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.220385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5a012-d213-4872-a9df-7e08713cb5fa service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.226112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c8019-a5e5-45ee-9b70-adae286086f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.226968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c8019-a5e5-45ee-9b70-adae286086f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.227265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c8019-a5e5-45ee-9b70-adae286086f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.227710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c8019-a5e5-45ee-9b70-adae286086f0 admin admin] PATH_INFO: `/v3/projects/6387eb3dfce5438fa83dc62631124095/users/ba7b9617bc13478a87a7056d7b130291/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.233340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d7a39-9e09-44ea-86e3-5810979c5231 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.238825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0eafe-cfcd-4e20-81d4-cc29d0e57413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.239894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0eafe-cfcd-4e20-81d4-cc29d0e57413 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.240321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0eafe-cfcd-4e20-81d4-cc29d0e57413 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.240791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0eafe-cfcd-4e20-81d4-cc29d0e57413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.246662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c8019-a5e5-45ee-9b70-adae286086f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6387eb3dfce5438fa83dc62631124095, user_id=ba7b9617bc13478a87a7056d7b130291, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.250679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c8019-a5e5-45ee-9b70-adae286086f0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.253613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0eafe-cfcd-4e20-81d4-cc29d0e57413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.255813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0eafe-cfcd-4e20-81d4-cc29d0e57413 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.271876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 981/1963] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:11.272352 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 983/1964] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:11 2022] PUT /identity/v3/projects/6387eb3dfce5438fa83dc62631124095/users/ba7b9617bc13478a87a7056d7b130291/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:11.273586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c8019-a5e5-45ee-9b70-adae286086f0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.276564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0eafe-cfcd-4e20-81d4-cc29d0e57413 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.285132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:11.291404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0eafe-cfcd-4e20-81d4-cc29d0e57413 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.311572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:11.359396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c8019-a5e5-45ee-9b70-adae286086f0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.370239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e3770-295a-44a2-9898-1657628eb7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.371524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3770-295a-44a2-9898-1657628eb7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.372377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3770-295a-44a2-9898-1657628eb7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.373007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3770-295a-44a2-9898-1657628eb7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.374821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e3770-295a-44a2-9898-1657628eb7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.379134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e3770-295a-44a2-9898-1657628eb7b6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.400486 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 984/1965] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:11.404125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151285-4f60-4a37-bd84-a5f8594c3730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.404759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151285-4f60-4a37-bd84-a5f8594c3730 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.405039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151285-4f60-4a37-bd84-a5f8594c3730 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.405313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151285-4f60-4a37-bd84-a5f8594c3730 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.405795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e3770-295a-44a2-9898-1657628eb7b6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.406019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72151285-4f60-4a37-bd84-a5f8594c3730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.408370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72151285-4f60-4a37-bd84-a5f8594c3730 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.422252 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 982/1966] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:26:11.426861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e3770-295a-44a2-9898-1657628eb7b6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.427884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151285-4f60-4a37-bd84-a5f8594c3730 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.432703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d539a1-7708-491e-b7b7-519df30049da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.433454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d539a1-7708-491e-b7b7-519df30049da admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.433740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d539a1-7708-491e-b7b7-519df30049da admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.434016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d539a1-7708-491e-b7b7-519df30049da admin admin] PATH_INFO: `/v3/projects/e069378a68de4143a171e8ec38b8e8a4/users/e486e5ea72a7411e8f638e604ee10810/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.446326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151285-4f60-4a37-bd84-a5f8594c3730 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.454609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e90bd-038d-4ebd-ad20-39d7f22e213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.455310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e90bd-038d-4ebd-ad20-39d7f22e213b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.455638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e90bd-038d-4ebd-ad20-39d7f22e213b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.456010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e90bd-038d-4ebd-ad20-39d7f22e213b admin admin] PATH_INFO: `/v3/projects/6387eb3dfce5438fa83dc62631124095/users/ba7b9617bc13478a87a7056d7b130291/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.456118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d539a1-7708-491e-b7b7-519df30049da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e069378a68de4143a171e8ec38b8e8a4, user_id=e486e5ea72a7411e8f638e604ee10810, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.461425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d539a1-7708-491e-b7b7-519df30049da admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.469868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e90bd-038d-4ebd-ad20-39d7f22e213b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6387eb3dfce5438fa83dc62631124095, user_id=ba7b9617bc13478a87a7056d7b130291, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.474325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e90bd-038d-4ebd-ad20-39d7f22e213b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.499873 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 985/1967] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:11 2022] PUT /identity/v3/projects/e069378a68de4143a171e8ec38b8e8a4/users/e486e5ea72a7411e8f638e604ee10810/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:26:11.502787 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 983/1968] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:11 2022] PUT /identity/v3/projects/6387eb3dfce5438fa83dc62631124095/users/ba7b9617bc13478a87a7056d7b130291/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:11.504991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d539a1-7708-491e-b7b7-519df30049da admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.514677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb004eb-6a4a-4ad3-9a8c-9ef56dbfdbd0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.515298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb004eb-6a4a-4ad3-9a8c-9ef56dbfdbd0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.515746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb004eb-6a4a-4ad3-9a8c-9ef56dbfdbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.558332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fdb004eb-6a4a-4ad3-9a8c-9ef56dbfdbd0 None None] MFA Rules not processed for user `ba7b9617bc13478a87a7056d7b130291`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:11.560430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fdb004eb-6a4a-4ad3-9a8c-9ef56dbfdbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:11.663845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d539a1-7708-491e-b7b7-519df30049da admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.753938 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 984/1969] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:11.758695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb004eb-6a4a-4ad3-9a8c-9ef56dbfdbd0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.760295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fdb004eb-6a4a-4ad3-9a8c-9ef56dbfdbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:11.819565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094cd55-98d5-4cc7-9a7e-835423165eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.820215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094cd55-98d5-4cc7-9a7e-835423165eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.820615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094cd55-98d5-4cc7-9a7e-835423165eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.820899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094cd55-98d5-4cc7-9a7e-835423165eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.821878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094cd55-98d5-4cc7-9a7e-835423165eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.823369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094cd55-98d5-4cc7-9a7e-835423165eb0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.836882 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 986/1970] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:11.839985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094cd55-98d5-4cc7-9a7e-835423165eb0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.852428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb004eb-6a4a-4ad3-9a8c-9ef56dbfdbd0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.854036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094cd55-98d5-4cc7-9a7e-835423165eb0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:11.859288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.859706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd0d12-f8de-4a8b-9434-2624f1adf953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:11.860497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd0d12-f8de-4a8b-9434-2624f1adf953 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.861370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd0d12-f8de-4a8b-9434-2624f1adf953 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.861626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.862069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.862227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd0d12-f8de-4a8b-9434-2624f1adf953 admin admin] PATH_INFO: `/v3/projects/e069378a68de4143a171e8ec38b8e8a4/users/e486e5ea72a7411e8f638e604ee10810/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.862633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] PATH_INFO: `/v3/projects/de99d61e6050468184f41b2cb0b30a40` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.864009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de99d61e6050468184f41b2cb0b30a40)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.864412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd0d12-f8de-4a8b-9434-2624f1adf953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e069378a68de4143a171e8ec38b8e8a4, user_id=e486e5ea72a7411e8f638e604ee10810, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:11.866679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.867415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd0d12-f8de-4a8b-9434-2624f1adf953 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:11.883389 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 987/1971] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:11 2022] PUT /identity/v3/projects/e069378a68de4143a171e8ec38b8e8a4/users/e486e5ea72a7411e8f638e604ee10810/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:11.888508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:11.897086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90848-8799-4cc6-a886-a75e9933b1b6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:11.897531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90848-8799-4cc6-a886-a75e9933b1b6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:11.898002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90848-8799-4cc6-a886-a75e9933b1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:11.933966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de99d61e6050468184f41b2cb0b30a40', 'request_id': 'req-17236817-610c-4f91-a842-8bb180303d47'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:11.944094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de99d61e6050468184f41b2cb0b30a40', 'request_id': 'req-17236817-610c-4f91-a842-8bb180303d47'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:11.954783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-edd90848-8799-4cc6-a886-a75e9933b1b6 None None] MFA Rules not processed for user `e486e5ea72a7411e8f638e604ee10810`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:11.956437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-edd90848-8799-4cc6-a886-a75e9933b1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:11.958719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de99d61e6050468184f41b2cb0b30a40', 'request_id': 'req-17236817-610c-4f91-a842-8bb180303d47'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:11.971186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:11.973076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] The token cache is being invalidate because project de99d61e6050468184f41b2cb0b30a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:11.973514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:11.974448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:11.976192 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 985/1972] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:11 2022] DELETE /identity/v3/projects/de99d61e6050468184f41b2cb0b30a40 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:11.977123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:11.980880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:12.053027 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 988/1973] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:12.054235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd90848-8799-4cc6-a886-a75e9933b1b6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:12.055755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-edd90848-8799-4cc6-a886-a75e9933b1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:12.076555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236817-610c-4f91-a842-8bb180303d47 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:12.082005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:12.082650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:12.082924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:12.083195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] PATH_INFO: `/v3/projects/031d3a19bd9b4f288395ce8732981dd5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:12.084344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] RBAC: Authorizing `identity:delete_project(project_id=031d3a19bd9b4f288395ce8732981dd5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:12.086294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:12.159317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd90848-8799-4cc6-a886-a75e9933b1b6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:12.194742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031d3a19bd9b4f288395ce8732981dd5', 'request_id': 'req-7310d4a5-84e1-4206-ba32-9165cecad95f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.221912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031d3a19bd9b4f288395ce8732981dd5', 'request_id': 'req-7310d4a5-84e1-4206-ba32-9165cecad95f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.237911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031d3a19bd9b4f288395ce8732981dd5', 'request_id': 'req-7310d4a5-84e1-4206-ba32-9165cecad95f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.256806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] The token cache is being invalidate because project 031d3a19bd9b4f288395ce8732981dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:12.257219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.258811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.264491 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 986/1974] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:11 2022] DELETE /identity/v3/projects/031d3a19bd9b4f288395ce8732981dd5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:12.265817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:12.267196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:12.289244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def589e7-2342-4ce8-8c0d-c420ca70b2f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:12.289942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def589e7-2342-4ce8-8c0d-c420ca70b2f7 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:12.290300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def589e7-2342-4ce8-8c0d-c420ca70b2f7 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:12.290503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def589e7-2342-4ce8-8c0d-c420ca70b2f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:12.292437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-def589e7-2342-4ce8-8c0d-c420ca70b2f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:12.317733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:12.343600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:12.354041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310d4a5-84e1-4206-ba32-9165cecad95f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:12.358844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:12.359468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:12.359742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:12.360010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] PATH_INFO: `/v3/users/0fcfa0ffb4d24d9993c61ea78e7c9937` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:12.361236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fcfa0ffb4d24d9993c61ea78e7c9937)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:12.363100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def589e7-2342-4ce8-8c0d-c420ca70b2f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:12.363341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:12.364724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def589e7-2342-4ce8-8c0d-c420ca70b2f7 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:12.375799 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 989/1975] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:12.377198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def589e7-2342-4ce8-8c0d-c420ca70b2f7 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:12.378877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-def589e7-2342-4ce8-8c0d-c420ca70b2f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:12.436910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fcfa0ffb4d24d9993c61ea78e7c9937'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.438463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fcfa0ffb4d24d9993c61ea78e7c9937'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.468125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fcfa0ffb4d24d9993c61ea78e7c9937'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.469207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fcfa0ffb4d24d9993c61ea78e7c9937'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.476141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def589e7-2342-4ce8-8c0d-c420ca70b2f7 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:12.480180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fcfa0ffb4d24d9993c61ea78e7c9937'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.482531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0727b7-8a21-43ff-abdd-fa6fa3744e69 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:12.483248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0727b7-8a21-43ff-abdd-fa6fa3744e69 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:12.483628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0727b7-8a21-43ff-abdd-fa6fa3744e69 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:12.483872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0727b7-8a21-43ff-abdd-fa6fa3744e69 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:12.484678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0727b7-8a21-43ff-abdd-fa6fa3744e69 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:12.485010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0727b7-8a21-43ff-abdd-fa6fa3744e69 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:12.486910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0727b7-8a21-43ff-abdd-fa6fa3744e69 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:12.512631 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 987/1976] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:12 2022] DELETE /identity/v3/users/0fcfa0ffb4d24d9993c61ea78e7c9937 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:12.513938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:12.530317 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 990/1977] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:12.530317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0727b7-8a21-43ff-abdd-fa6fa3744e69 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:12.533494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:12.538366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ed0727b7-8a21-43ff-abdd-fa6fa3744e69 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:12.569224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0727b7-8a21-43ff-abdd-fa6fa3744e69 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:12.717724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:12.718455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:12.718690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:12.718968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] PATH_INFO: `/v3/users/a2658a14b6924c73a12447f5e54f5101` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:12.720577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2658a14b6924c73a12447f5e54f5101)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:12.722824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:12.724357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd25e2-fd35-477a-90b7-44c278fd5180 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:12.731770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb88dda-e967-4e31-ae99-582e33d0195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:12.732881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb88dda-e967-4e31-ae99-582e33d0195e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:12.733315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb88dda-e967-4e31-ae99-582e33d0195e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:12.733626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb88dda-e967-4e31-ae99-582e33d0195e admin admin] PATH_INFO: `/v3/users/aa085de9b1f44b9397e0a3f37a688567` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:12.734791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb88dda-e967-4e31-ae99-582e33d0195e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa085de9b1f44b9397e0a3f37a688567)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:12.737458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb88dda-e967-4e31-ae99-582e33d0195e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:12.828495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2658a14b6924c73a12447f5e54f5101'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.829247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2658a14b6924c73a12447f5e54f5101'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.849973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-adb88dda-e967-4e31-ae99-582e33d0195e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa085de9b1f44b9397e0a3f37a688567'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.850598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2658a14b6924c73a12447f5e54f5101'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.850986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-adb88dda-e967-4e31-ae99-582e33d0195e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa085de9b1f44b9397e0a3f37a688567'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.868842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:12.873117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2658a14b6924c73a12447f5e54f5101'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.881860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-adb88dda-e967-4e31-ae99-582e33d0195e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa085de9b1f44b9397e0a3f37a688567'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.883110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-adb88dda-e967-4e31-ae99-582e33d0195e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa085de9b1f44b9397e0a3f37a688567'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.884518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:12.889450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2658a14b6924c73a12447f5e54f5101'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.894746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-adb88dda-e967-4e31-ae99-582e33d0195e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa085de9b1f44b9397e0a3f37a688567'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:12.911663 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 991/1978] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:12 2022] DELETE /identity/v3/users/a2658a14b6924c73a12447f5e54f5101 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:12.912819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:12.929948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:12.930160 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 988/1979] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:12 2022] DELETE /identity/v3/users/aa085de9b1f44b9397e0a3f37a688567 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:12.932322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3383e7-c206-4d49-bc4d-883b80933241 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:12.932714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3383e7-c206-4d49-bc4d-883b80933241 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:12.936395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3383e7-c206-4d49-bc4d-883b80933241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:12.994712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6d3383e7-c206-4d49-bc4d-883b80933241 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:12.998050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6d3383e7-c206-4d49-bc4d-883b80933241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:13.146915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c0c2-262c-4a93-9275-64315612f0e3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:13.180730 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 989/1980] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:13.239255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3383e7-c206-4d49-bc4d-883b80933241 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:13.241046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6d3383e7-c206-4d49-bc4d-883b80933241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:13.324746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3babc2-3818-4e17-b632-25b7883df9c4 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:13.325643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3babc2-3818-4e17-b632-25b7883df9c4 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:13.326002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3babc2-3818-4e17-b632-25b7883df9c4 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:13.326356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3babc2-3818-4e17-b632-25b7883df9c4 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:13.327116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3babc2-3818-4e17-b632-25b7883df9c4 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:13.329198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3babc2-3818-4e17-b632-25b7883df9c4 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:13.371567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3383e7-c206-4d49-bc4d-883b80933241 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:13.377803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4927d-a805-4497-9478-774b29d93c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:13.378950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4927d-a805-4497-9478-774b29d93c10 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:13.379500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4927d-a805-4497-9478-774b29d93c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:13.380103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4927d-a805-4497-9478-774b29d93c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:13.382172 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 992/1981] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:12 2022] POST /identity/v3/projects => generated 369 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:13.386467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3babc2-3818-4e17-b632-25b7883df9c4 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:13.396001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4927d-a805-4497-9478-774b29d93c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:13.401580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4927d-a805-4497-9478-774b29d93c10 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:13.437621 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 990/1982] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:26:13.482981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4927d-a805-4497-9478-774b29d93c10 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:13.484664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a1a4927d-a805-4497-9478-774b29d93c10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:13.509965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4927d-a805-4497-9478-774b29d93c10 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:13.524120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3babc2-3818-4e17-b632-25b7883df9c4 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:13.533852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b2de3-443c-4afd-95a9-fe52cc1e10cc tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:13.534868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b2de3-443c-4afd-95a9-fe52cc1e10cc tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:13.535382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b2de3-443c-4afd-95a9-fe52cc1e10cc tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:13.535864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b2de3-443c-4afd-95a9-fe52cc1e10cc tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:13.536751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b2de3-443c-4afd-95a9-fe52cc1e10cc tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:13.537265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b2de3-443c-4afd-95a9-fe52cc1e10cc tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:13.539159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b2de3-443c-4afd-95a9-fe52cc1e10cc tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:13.555758 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 993/1983] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:13.580345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b2de3-443c-4afd-95a9-fe52cc1e10cc tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:13.590184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ef8b2de3-443c-4afd-95a9-fe52cc1e10cc tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:13.638067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:13.639071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:13.639360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:13.641909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] PATH_INFO: `/v3/projects/a0bba74a3f0645dead058641f89206d3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:13.645025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bba74a3f0645dead058641f89206d3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:13.652152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:13.653978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:13.697291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:13.770127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b2de3-443c-4afd-95a9-fe52cc1e10cc tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:13.785912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bba74a3f0645dead058641f89206d3', 'request_id': 'req-3e075fff-fc81-447a-a2cc-33abea3db315'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:13.808069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bba74a3f0645dead058641f89206d3', 'request_id': 'req-3e075fff-fc81-447a-a2cc-33abea3db315'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:13.825825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bba74a3f0645dead058641f89206d3', 'request_id': 'req-3e075fff-fc81-447a-a2cc-33abea3db315'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:13.846158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] The token cache is being invalidate because project a0bba74a3f0645dead058641f89206d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:13.846726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:13.847914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:13.854520 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 991/1984] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:13 2022] DELETE /identity/v3/projects/a0bba74a3f0645dead058641f89206d3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:26:13.856477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:13.858268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:13.888014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bd3a1-3699-4071-b2b1-7cdaa00645fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:13.888014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bd3a1-3699-4071-b2b1-7cdaa00645fe service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:13.888352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bd3a1-3699-4071-b2b1-7cdaa00645fe service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:13.888840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bd3a1-3699-4071-b2b1-7cdaa00645fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:13.909788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-239bd3a1-3699-4071-b2b1-7cdaa00645fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:13.964099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e075fff-fc81-447a-a2cc-33abea3db315 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:13.971445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:13.972148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:13.972441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:13.972704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] PATH_INFO: `/v3/projects/b6992920f4374a21b6b54fa8a8dd3b05` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:13.974031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6992920f4374a21b6b54fa8a8dd3b05)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:13.976902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:14.066618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bd3a1-3699-4071-b2b1-7cdaa00645fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:14.068279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bd3a1-3699-4071-b2b1-7cdaa00645fe service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:14.092551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6992920f4374a21b6b54fa8a8dd3b05', 'request_id': 'req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.094099 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 994/1985] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:14.097846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bc4cb-b287-431d-8b31-4cd2fe622a19 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.099072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bc4cb-b287-431d-8b31-4cd2fe622a19 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.100829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6992920f4374a21b6b54fa8a8dd3b05', 'request_id': 'req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.101131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bc4cb-b287-431d-8b31-4cd2fe622a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.110563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6992920f4374a21b6b54fa8a8dd3b05', 'request_id': 'req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.142380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6d0bc4cb-b287-431d-8b31-4cd2fe622a19 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:14.144183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6d0bc4cb-b287-431d-8b31-4cd2fe622a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:14.152996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] The token cache is being invalidate because project b6992920f4374a21b6b54fa8a8dd3b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:14.153292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.154432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.155813 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 992/1986] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:13 2022] DELETE /identity/v3/projects/b6992920f4374a21b6b54fa8a8dd3b05 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:14.158516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.161118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:14.218531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:14.220698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:14.254058 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 995/1987] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:14.256415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7924caa-5bd5-4862-9187-d4d811514c07 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.257070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7924caa-5bd5-4862-9187-d4d811514c07 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.257571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7924caa-5bd5-4862-9187-d4d811514c07 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.260035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6f8a6-8a88-4602-a3fd-322b73a7cc1b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:14.260247 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 996/1988] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:14.261238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7924caa-5bd5-4862-9187-d4d811514c07 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.263491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a7924caa-5bd5-4862-9187-d4d811514c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:14.266631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:14.267423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.267707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.267983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] PATH_INFO: `/v3/projects/b2b95295251249f69a2ab76c833b29dc` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.269511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b95295251249f69a2ab76c833b29dc)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:14.272604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:14.291971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7924caa-5bd5-4862-9187-d4d811514c07 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:14.297665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:14.298855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.299465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.299766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] PATH_INFO: `/v3/users/e34bc3961d4c46c987d4ead5accbfee9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.300931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34bc3961d4c46c987d4ead5accbfee9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:14.302912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:14.355769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b95295251249f69a2ab76c833b29dc', 'request_id': 'req-25d95d02-3ea0-4670-999e-12b41c05971a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.366470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b95295251249f69a2ab76c833b29dc', 'request_id': 'req-25d95d02-3ea0-4670-999e-12b41c05971a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.375119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b95295251249f69a2ab76c833b29dc', 'request_id': 'req-25d95d02-3ea0-4670-999e-12b41c05971a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.377680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34bc3961d4c46c987d4ead5accbfee9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.378401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34bc3961d4c46c987d4ead5accbfee9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.395075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34bc3961d4c46c987d4ead5accbfee9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.399519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] The token cache is being invalidate because project b2b95295251249f69a2ab76c833b29dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:14.399764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.400492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-25d95d02-3ea0-4670-999e-12b41c05971a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.402751 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 993/1989] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:14 2022] DELETE /identity/v3/projects/b2b95295251249f69a2ab76c833b29dc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:14.404954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6c339-4aa5-4233-a5d2-afb133ed73c8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.405593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6c339-4aa5-4233-a5d2-afb133ed73c8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.405593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6c339-4aa5-4233-a5d2-afb133ed73c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.407258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34bc3961d4c46c987d4ead5accbfee9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.416821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34bc3961d4c46c987d4ead5accbfee9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.429272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c4e6c339-4aa5-4233-a5d2-afb133ed73c8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:14.430551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c4e6c339-4aa5-4233-a5d2-afb133ed73c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:14.437446 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 997/1990] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:14 2022] DELETE /identity/v3/users/e34bc3961d4c46c987d4ead5accbfee9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:14.437446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:14.437446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:14.547380 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 994/1991] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:14.549521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6c339-4aa5-4233-a5d2-afb133ed73c8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.550860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c4e6c339-4aa5-4233-a5d2-afb133ed73c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:14.570502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6c339-4aa5-4233-a5d2-afb133ed73c8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:14.571493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.572831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:14.667614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:14.681581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0cad3-1af1-47f4-aa0e-8d2decdcfa6d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:14.688755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d5f2b-9b6d-4b0d-b2ac-e7f12d2c452a tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:14.690520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5f2b-9b6d-4b0d-b2ac-e7f12d2c452a tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.691067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5f2b-9b6d-4b0d-b2ac-e7f12d2c452a tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.691591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5f2b-9b6d-4b0d-b2ac-e7f12d2c452a tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/projects/05ad3b8b719c425998c6b118a1087573` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.693213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d5f2b-9b6d-4b0d-b2ac-e7f12d2c452a tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:get_project(project_id=05ad3b8b719c425998c6b118a1087573)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:14.695955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d5f2b-9b6d-4b0d-b2ac-e7f12d2c452a tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:14.700183 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 998/1992] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:14 2022] GET /identity/v3/projects/05ad3b8b719c425998c6b118a1087573 => generated 369 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:14.702030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d5f2b-9b6d-4b0d-b2ac-e7f12d2c452a tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.750528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:14.751217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.751499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.751776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] PATH_INFO: `/v3/users/ba7b9617bc13478a87a7056d7b130291` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.752939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba7b9617bc13478a87a7056d7b130291)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:14.754906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:14.781115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:14.814117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d5f2b-9b6d-4b0d-b2ac-e7f12d2c452a tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:14.832995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd61b5-6d71-4161-ac27-001710ad6fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:14.833821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd61b5-6d71-4161-ac27-001710ad6fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.834091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd61b5-6d71-4161-ac27-001710ad6fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.834365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd61b5-6d71-4161-ac27-001710ad6fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.836278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd61b5-6d71-4161-ac27-001710ad6fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:14.836566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd61b5-6d71-4161-ac27-001710ad6fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:14.839243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd61b5-6d71-4161-ac27-001710ad6fb3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:14.866439 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 999/1993] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:14.868763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba7b9617bc13478a87a7056d7b130291'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.869878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba7b9617bc13478a87a7056d7b130291'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.870060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd61b5-6d71-4161-ac27-001710ad6fb3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.875898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-abdd61b5-6d71-4161-ac27-001710ad6fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:14.897779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd61b5-6d71-4161-ac27-001710ad6fb3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:14.908162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143d866-dc57-4973-9bfe-6a58cd7ab841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:14.908828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143d866-dc57-4973-9bfe-6a58cd7ab841 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.909112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143d866-dc57-4973-9bfe-6a58cd7ab841 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.909668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143d866-dc57-4973-9bfe-6a58cd7ab841 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.910378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143d866-dc57-4973-9bfe-6a58cd7ab841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:14.912369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143d866-dc57-4973-9bfe-6a58cd7ab841 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:14.922548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba7b9617bc13478a87a7056d7b130291'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.923903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba7b9617bc13478a87a7056d7b130291'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.934250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba7b9617bc13478a87a7056d7b130291'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:14.960319 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1000/1995] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:14 2022] POST /identity/v3/projects => generated 407 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:14.961503 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 995/1995] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:14 2022] DELETE /identity/v3/users/ba7b9617bc13478a87a7056d7b130291 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:14.965195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:14.977522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5d57f-e0a8-4af6-957e-28fe7836b6fe None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.977853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5d57f-e0a8-4af6-957e-28fe7836b6fe None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.978786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5d57f-e0a8-4af6-957e-28fe7836b6fe None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.982542 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1001/1996] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:14 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:14.987935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433be9-4a02-4b0a-9550-dd4ea906dc63 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:14.988228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433be9-4a02-4b0a-9550-dd4ea906dc63 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:14.988512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433be9-4a02-4b0a-9550-dd4ea906dc63 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:14.991358 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1002/1997] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:26:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:14.996160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76433be9-4a02-4b0a-9550-dd4ea906dc63 None None] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:15.000524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76433be9-4a02-4b0a-9550-dd4ea906dc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:15.132493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca5dd6-26f9-4319-88a9-6b3970543d22 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.166255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76433be9-4a02-4b0a-9550-dd4ea906dc63 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.169492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76433be9-4a02-4b0a-9550-dd4ea906dc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:15.251715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48740155-4bc4-44c3-b1fd-6f46168b177c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.252383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48740155-4bc4-44c3-b1fd-6f46168b177c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.252660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48740155-4bc4-44c3-b1fd-6f46168b177c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.252951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48740155-4bc4-44c3-b1fd-6f46168b177c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.253786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48740155-4bc4-44c3-b1fd-6f46168b177c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.259631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48740155-4bc4-44c3-b1fd-6f46168b177c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.294165 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 996/1998] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:14 2022] POST /identity/v3/users => generated 304 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:15.294444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76433be9-4a02-4b0a-9550-dd4ea906dc63 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.295734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee3cc7-925a-4308-a900-55bc1249deff None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.296156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee3cc7-925a-4308-a900-55bc1249deff None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.296528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee3cc7-925a-4308-a900-55bc1249deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.305494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255ddc1-01b6-46cc-8d65-178a90cb406b tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.306611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255ddc1-01b6-46cc-8d65-178a90cb406b tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.306611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255ddc1-01b6-46cc-8d65-178a90cb406b tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.306611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255ddc1-01b6-46cc-8d65-178a90cb406b tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/projects/05ad3b8b719c425998c6b118a1087573` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.307770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255ddc1-01b6-46cc-8d65-178a90cb406b tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:get_project(project_id=05ad3b8b719c425998c6b118a1087573)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.310041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255ddc1-01b6-46cc-8d65-178a90cb406b tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.311630 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1003/1999] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:14 2022] GET /identity/v3/projects/05ad3b8b719c425998c6b118a1087573 => generated 369 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:15.312417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255ddc1-01b6-46cc-8d65-178a90cb406b tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.314334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0255ddc1-01b6-46cc-8d65-178a90cb406b tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:15.323889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-66ee3cc7-925a-4308-a900-55bc1249deff None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:15.326102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66ee3cc7-925a-4308-a900-55bc1249deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:15.333977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255ddc1-01b6-46cc-8d65-178a90cb406b tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.339745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.340768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.341056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.341330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] PATH_INFO: `/v3/projects/bc33c983f35c400ca58e6d981f26f924` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.342557 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 997/2000] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:26:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:15.343992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee3cc7-925a-4308-a900-55bc1249deff None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.354873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc33c983f35c400ca58e6d981f26f924)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.357218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee3cc7-925a-4308-a900-55bc1249deff None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.357474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.360346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:15.363825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dac6e-b854-4b3b-a7a8-4fe19475cd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.364725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dac6e-b854-4b3b-a7a8-4fe19475cd77 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.365376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dac6e-b854-4b3b-a7a8-4fe19475cd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.365883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dac6e-b854-4b3b-a7a8-4fe19475cd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.367300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dac6e-b854-4b3b-a7a8-4fe19475cd77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.370118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dac6e-b854-4b3b-a7a8-4fe19475cd77 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.387624 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 998/2001] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:15.388626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dac6e-b854-4b3b-a7a8-4fe19475cd77 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.393887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a69dac6e-b854-4b3b-a7a8-4fe19475cd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:15.407256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:15.412900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dac6e-b854-4b3b-a7a8-4fe19475cd77 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.422123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf71fdc-955d-42aa-a1e8-71cb97d411a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.422771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf71fdc-955d-42aa-a1e8-71cb97d411a4 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.424315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf71fdc-955d-42aa-a1e8-71cb97d411a4 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.424540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf71fdc-955d-42aa-a1e8-71cb97d411a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.443254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf71fdc-955d-42aa-a1e8-71cb97d411a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.446194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf71fdc-955d-42aa-a1e8-71cb97d411a4 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.460559 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 999/2002] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:15.460559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf71fdc-955d-42aa-a1e8-71cb97d411a4 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.470718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc33c983f35c400ca58e6d981f26f924', 'request_id': 'req-014de297-55e3-4f47-9d93-ce52652dfa09'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:15.475444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf71fdc-955d-42aa-a1e8-71cb97d411a4 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.487877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc33c983f35c400ca58e6d981f26f924', 'request_id': 'req-014de297-55e3-4f47-9d93-ce52652dfa09'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:15.507584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc33c983f35c400ca58e6d981f26f924', 'request_id': 'req-014de297-55e3-4f47-9d93-ce52652dfa09'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:15.522653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] The token cache is being invalidate because project bc33c983f35c400ca58e6d981f26f924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:15.522991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:15.523716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:15.525697 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1004/2003] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:15 2022] DELETE /identity/v3/projects/bc33c983f35c400ca58e6d981f26f924 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:15.526479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.528033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:15.592197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebe4c9-8c96-4e62-9b9b-372689f7bd8d tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.593194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebe4c9-8c96-4e62-9b9b-372689f7bd8d tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.593517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebe4c9-8c96-4e62-9b9b-372689f7bd8d tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.600679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebe4c9-8c96-4e62-9b9b-372689f7bd8d tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.601487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebe4c9-8c96-4e62-9b9b-372689f7bd8d tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:15.601806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebe4c9-8c96-4e62-9b9b-372689f7bd8d tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.604829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebe4c9-8c96-4e62-9b9b-372689f7bd8d tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.639675 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1000/2004] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:15.645437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014de297-55e3-4f47-9d93-ce52652dfa09 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.646172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebe4c9-8c96-4e62-9b9b-372689f7bd8d tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.648344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66ebe4c9-8c96-4e62-9b9b-372689f7bd8d tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:15.651831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134bde2-da05-4604-a71f-ba1ea7bcf32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.652546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134bde2-da05-4604-a71f-ba1ea7bcf32c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.653204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134bde2-da05-4604-a71f-ba1ea7bcf32c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.653312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134bde2-da05-4604-a71f-ba1ea7bcf32c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.654226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134bde2-da05-4604-a71f-ba1ea7bcf32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.655851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134bde2-da05-4604-a71f-ba1ea7bcf32c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.666531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebe4c9-8c96-4e62-9b9b-372689f7bd8d tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.671520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.672162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.672441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.673438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] PATH_INFO: `/v3/projects/6387eb3dfce5438fa83dc62631124095` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.673552 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1005/2005] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:15.674389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011a838-0261-4b1b-a958-21825cb69ad6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.674751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011a838-0261-4b1b-a958-21825cb69ad6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.674959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011a838-0261-4b1b-a958-21825cb69ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.681246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6387eb3dfce5438fa83dc62631124095)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.684212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.702254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2011a838-0261-4b1b-a958-21825cb69ad6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:15.703600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2011a838-0261-4b1b-a958-21825cb69ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:15.717477 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1006/2006] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:15.719310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011a838-0261-4b1b-a958-21825cb69ad6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.729848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2011a838-0261-4b1b-a958-21825cb69ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:15.747738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011a838-0261-4b1b-a958-21825cb69ad6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.749811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6387eb3dfce5438fa83dc62631124095', 'request_id': 'req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:15.762700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6387eb3dfce5438fa83dc62631124095', 'request_id': 'req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:15.775861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6387eb3dfce5438fa83dc62631124095', 'request_id': 'req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:15.793570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] The token cache is being invalidate because project 6387eb3dfce5438fa83dc62631124095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:15.793570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:15.793570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:15.796072 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1001/2007] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:15 2022] DELETE /identity/v3/projects/6387eb3dfce5438fa83dc62631124095 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:15.797079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.799783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:15.854179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359a88e-1c96-4aeb-b422-daa309a14b39 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.855023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359a88e-1c96-4aeb-b422-daa309a14b39 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.855197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359a88e-1c96-4aeb-b422-daa309a14b39 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.855528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359a88e-1c96-4aeb-b422-daa309a14b39 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.856452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359a88e-1c96-4aeb-b422-daa309a14b39 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.858945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359a88e-1c96-4aeb-b422-daa309a14b39 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.904996 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1007/2008] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:15 2022] POST /identity/v3/users => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:15.906991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3062-e8c8-4e97-a045-e5c8835d5e2a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.907309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3062-e8c8-4e97-a045-e5c8835d5e2a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.908257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3062-e8c8-4e97-a045-e5c8835d5e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.922990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a7391-8b96-46e5-a90e-2c2c0ccaecb3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:15.929443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f554e0d-0dd0-4651-9e69-7bded38db02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:15.930261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554e0d-0dd0-4651-9e69-7bded38db02b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.930576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554e0d-0dd0-4651-9e69-7bded38db02b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.930943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554e0d-0dd0-4651-9e69-7bded38db02b admin admin] PATH_INFO: `/v3/projects/6f582e6eda664071b9adc2862add206c/users/3033b6e4fef9421f9f353b54ad20f41c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.947220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:15.952253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f554e0d-0dd0-4651-9e69-7bded38db02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f582e6eda664071b9adc2862add206c, user_id=3033b6e4fef9421f9f353b54ad20f41c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:15.953329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3bcc3062-e8c8-4e97-a045-e5c8835d5e2a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:15.955467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f554e0d-0dd0-4651-9e69-7bded38db02b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:15.955636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3bcc3062-e8c8-4e97-a045-e5c8835d5e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:15.973812 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1002/2009] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:15 2022] PUT /identity/v3/projects/6f582e6eda664071b9adc2862add206c/users/3033b6e4fef9421f9f353b54ad20f41c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:15.975263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe7abd-db02-4cbb-834c-2f38d4e256e2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:15.975621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe7abd-db02-4cbb-834c-2f38d4e256e2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:15.976025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe7abd-db02-4cbb-834c-2f38d4e256e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:15.981519 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1008/2010] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:15.986512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc3062-e8c8-4e97-a045-e5c8835d5e2a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:15.989592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3bcc3062-e8c8-4e97-a045-e5c8835d5e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:16.005519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9bfe7abd-db02-4cbb-834c-2f38d4e256e2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:16.006180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc3062-e8c8-4e97-a045-e5c8835d5e2a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.007363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:16.007958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9bfe7abd-db02-4cbb-834c-2f38d4e256e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:16.102603 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1003/2011] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:16.104096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f4fa-96c3-4e89-83b1-6d8dbc97c046 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.104562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f4fa-96c3-4e89-83b1-6d8dbc97c046 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.104987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f4fa-96c3-4e89-83b1-6d8dbc97c046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.130584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de559c-07d6-415c-868f-e2edde578d26 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.131781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de559c-07d6-415c-868f-e2edde578d26 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.131943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de559c-07d6-415c-868f-e2edde578d26 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.136964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de559c-07d6-415c-868f-e2edde578d26 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.137824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de559c-07d6-415c-868f-e2edde578d26 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:16.138146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de559c-07d6-415c-868f-e2edde578d26 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.139849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de559c-07d6-415c-868f-e2edde578d26 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.147900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6079f4fa-96c3-4e89-83b1-6d8dbc97c046 None None] MFA Rules not processed for user `3033b6e4fef9421f9f353b54ad20f41c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:16.150014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6079f4fa-96c3-4e89-83b1-6d8dbc97c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:16.157463 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1009/2012] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:16.157463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de559c-07d6-415c-868f-e2edde578d26 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.172794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de559c-07d6-415c-868f-e2edde578d26 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.178575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fa3d3-aa35-4656-bdeb-7a88c6e5b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.179454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa3d3-aa35-4656-bdeb-7a88c6e5b04b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.180046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa3d3-aa35-4656-bdeb-7a88c6e5b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.180577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa3d3-aa35-4656-bdeb-7a88c6e5b04b admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.181702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fa3d3-aa35-4656-bdeb-7a88c6e5b04b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:16.182300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fa3d3-aa35-4656-bdeb-7a88c6e5b04b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.184291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fa3d3-aa35-4656-bdeb-7a88c6e5b04b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.205682 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1010/2013] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:16.207152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aec5d-295c-4a0d-b33e-b0e37249ac18 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.209440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aec5d-295c-4a0d-b33e-b0e37249ac18 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.209440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aec5d-295c-4a0d-b33e-b0e37249ac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.238082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d48aec5d-295c-4a0d-b33e-b0e37249ac18 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:16.239326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d48aec5d-295c-4a0d-b33e-b0e37249ac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:16.248170 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1011/2014] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:16.249678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34629c91-df46-4417-b5fe-81b6991b0840 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.249843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34629c91-df46-4417-b5fe-81b6991b0840 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.250047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34629c91-df46-4417-b5fe-81b6991b0840 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.251705 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1012/2015] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:16.252099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34629c91-df46-4417-b5fe-81b6991b0840 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.267871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34629c91-df46-4417-b5fe-81b6991b0840 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.274185 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1004/2016] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:16 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:16.274185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f4fa-96c3-4e89-83b1-6d8dbc97c046 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.277268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c6faf-dcfe-4a91-9e8f-83e7681c81d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.278199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c6faf-dcfe-4a91-9e8f-83e7681c81d7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.278485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c6faf-dcfe-4a91-9e8f-83e7681c81d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.279020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c6faf-dcfe-4a91-9e8f-83e7681c81d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.279673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c6faf-dcfe-4a91-9e8f-83e7681c81d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.281686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c6faf-dcfe-4a91-9e8f-83e7681c81d7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.290208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f4fa-96c3-4e89-83b1-6d8dbc97c046 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.295800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27848b74-0c3e-48a9-92af-55e4cb4517eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.296411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27848b74-0c3e-48a9-92af-55e4cb4517eb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.296896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27848b74-0c3e-48a9-92af-55e4cb4517eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.297051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27848b74-0c3e-48a9-92af-55e4cb4517eb admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.297769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27848b74-0c3e-48a9-92af-55e4cb4517eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:16.298159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27848b74-0c3e-48a9-92af-55e4cb4517eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.300155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27848b74-0c3e-48a9-92af-55e4cb4517eb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.315997 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1005/2017] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:16.317144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27848b74-0c3e-48a9-92af-55e4cb4517eb admin admin] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:16.317994 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1013/2018] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:16 2022] POST /identity/v3/projects => generated 391 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:16.319343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c6faf-dcfe-4a91-9e8f-83e7681c81d7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.322012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-27848b74-0c3e-48a9-92af-55e4cb4517eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:16.419377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c6faf-dcfe-4a91-9e8f-83e7681c81d7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.419683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27848b74-0c3e-48a9-92af-55e4cb4517eb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.425013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b28358-914b-4bf7-aaaa-ea2b7369278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.425986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:16.426384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28358-914b-4bf7-aaaa-ea2b7369278c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.426691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28358-914b-4bf7-aaaa-ea2b7369278c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.427024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28358-914b-4bf7-aaaa-ea2b7369278c admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.427976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b28358-914b-4bf7-aaaa-ea2b7369278c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.430108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b28358-914b-4bf7-aaaa-ea2b7369278c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.431057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27848b74-0c3e-48a9-92af-55e4cb4517eb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.464057 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1014/2019] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:16 2022] POST /identity/v3/projects => generated 407 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:16.465167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b28358-914b-4bf7-aaaa-ea2b7369278c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.513197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b2750-aeea-448f-b101-7a587ae9bd8e tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.514034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b2750-aeea-448f-b101-7a587ae9bd8e tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.514311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b2750-aeea-448f-b101-7a587ae9bd8e tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.514612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b2750-aeea-448f-b101-7a587ae9bd8e tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/projects/05ad3b8b719c425998c6b118a1087573` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.515764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b2750-aeea-448f-b101-7a587ae9bd8e tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:get_project(project_id=05ad3b8b719c425998c6b118a1087573)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.518444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b2750-aeea-448f-b101-7a587ae9bd8e tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.520245 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1006/2020] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:16 2022] GET /identity/v3/projects/05ad3b8b719c425998c6b118a1087573 => generated 369 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:16.521211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b2750-aeea-448f-b101-7a587ae9bd8e tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.526885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:16.546492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b2750-aeea-448f-b101-7a587ae9bd8e tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.583825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b28358-914b-4bf7-aaaa-ea2b7369278c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.598907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1622c71-b534-442c-be4c-849202a0f070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.599755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1622c71-b534-442c-be4c-849202a0f070 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.600972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1622c71-b534-442c-be4c-849202a0f070 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.601945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1622c71-b534-442c-be4c-849202a0f070 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.602764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1622c71-b534-442c-be4c-849202a0f070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.607143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1622c71-b534-442c-be4c-849202a0f070 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.644253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41ebc9-a5f3-4540-a931-866fda9c57ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.645058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41ebc9-a5f3-4540-a931-866fda9c57ee admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.645418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41ebc9-a5f3-4540-a931-866fda9c57ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.645774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41ebc9-a5f3-4540-a931-866fda9c57ee admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.646488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41ebc9-a5f3-4540-a931-866fda9c57ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.648513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41ebc9-a5f3-4540-a931-866fda9c57ee admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.650621 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1015/2021] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:16 2022] POST /identity/v3/projects => generated 359 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:16.651360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1622c71-b534-442c-be4c-849202a0f070 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.685879 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1007/2022] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:16 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:16.686859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41ebc9-a5f3-4540-a931-866fda9c57ee admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.698653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41ebc9-a5f3-4540-a931-866fda9c57ee admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.768235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1622c71-b534-442c-be4c-849202a0f070 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.773174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47242d-6d8a-4044-b6e7-727853c3a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.773936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47242d-6d8a-4044-b6e7-727853c3a5df admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.774350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47242d-6d8a-4044-b6e7-727853c3a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.774765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47242d-6d8a-4044-b6e7-727853c3a5df admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.775490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47242d-6d8a-4044-b6e7-727853c3a5df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.777840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47242d-6d8a-4044-b6e7-727853c3a5df admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.800816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5e46d-2bae-4789-bc92-1cf81429ad43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.801760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5e46d-2bae-4789-bc92-1cf81429ad43 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.802292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5e46d-2bae-4789-bc92-1cf81429ad43 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.802815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5e46d-2bae-4789-bc92-1cf81429ad43 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.804159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5e46d-2bae-4789-bc92-1cf81429ad43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.810502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5e46d-2bae-4789-bc92-1cf81429ad43 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.817487 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1016/2023] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:16 2022] POST /identity/v3/users => generated 310 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:16.818596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47242d-6d8a-4044-b6e7-727853c3a5df admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.832101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47242d-6d8a-4044-b6e7-727853c3a5df admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.841575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ac8ad-f2ad-479d-8b80-548bca5d4b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.842208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ac8ad-f2ad-479d-8b80-548bca5d4b2a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.842553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ac8ad-f2ad-479d-8b80-548bca5d4b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.843043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ac8ad-f2ad-479d-8b80-548bca5d4b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.843823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ac8ad-f2ad-479d-8b80-548bca5d4b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.846082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ac8ad-f2ad-479d-8b80-548bca5d4b2a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.850735 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1008/2024] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:16 2022] POST /identity/v3/users => generated 280 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:16.850735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359e84-4c42-49e7-b092-e8b975099aea None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.850735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359e84-4c42-49e7-b092-e8b975099aea None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.850735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359e84-4c42-49e7-b092-e8b975099aea None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.850735 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1009/2025] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:16.857133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81359e84-4c42-49e7-b092-e8b975099aea None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.868263 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1017/2026] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:16.869471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ac8ad-f2ad-479d-8b80-548bca5d4b2a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.873915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81359e84-4c42-49e7-b092-e8b975099aea None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.883176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ac8ad-f2ad-479d-8b80-548bca5d4b2a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.883824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e280d1-8838-4e51-942e-c68c49f9535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.884535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e280d1-8838-4e51-942e-c68c49f9535d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.885012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e280d1-8838-4e51-942e-c68c49f9535d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.885312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e280d1-8838-4e51-942e-c68c49f9535d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.885967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e280d1-8838-4e51-942e-c68c49f9535d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.887765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e280d1-8838-4e51-942e-c68c49f9535d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.888822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0174e4e-1815-4195-aba3-2a9c6197754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.889614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0174e4e-1815-4195-aba3-2a9c6197754c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.890040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0174e4e-1815-4195-aba3-2a9c6197754c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.890390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0174e4e-1815-4195-aba3-2a9c6197754c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.891461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0174e4e-1815-4195-aba3-2a9c6197754c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.893047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0174e4e-1815-4195-aba3-2a9c6197754c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.911524 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1018/2027] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:16.911524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0174e4e-1815-4195-aba3-2a9c6197754c admin admin] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:16.911824 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1010/2028] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:16.911824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e280d1-8838-4e51-942e-c68c49f9535d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.915383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e0174e4e-1815-4195-aba3-2a9c6197754c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:16.923822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e280d1-8838-4e51-942e-c68c49f9535d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.929724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dd821-3782-41c6-bd3a-34ad2eaf8899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.930361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dd821-3782-41c6-bd3a-34ad2eaf8899 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.930950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dd821-3782-41c6-bd3a-34ad2eaf8899 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.931231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dd821-3782-41c6-bd3a-34ad2eaf8899 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.931898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dd821-3782-41c6-bd3a-34ad2eaf8899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.933527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dd821-3782-41c6-bd3a-34ad2eaf8899 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.948817 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1011/2029] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:16.949780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dd821-3782-41c6-bd3a-34ad2eaf8899 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:16.955067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:16.963140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dd821-3782-41c6-bd3a-34ad2eaf8899 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:16.971460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0afdd-e723-438d-917f-0ea1cc3ef652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:16.972176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0afdd-e723-438d-917f-0ea1cc3ef652 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:16.972527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0afdd-e723-438d-917f-0ea1cc3ef652 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:16.972868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0afdd-e723-438d-917f-0ea1cc3ef652 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:16.973637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0afdd-e723-438d-917f-0ea1cc3ef652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:16.975619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0afdd-e723-438d-917f-0ea1cc3ef652 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:16.988559 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1012/2030] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:16.989583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0afdd-e723-438d-917f-0ea1cc3ef652 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:17.005107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0afdd-e723-438d-917f-0ea1cc3ef652 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:17.010604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a84fc-6ab1-41ff-9a1d-72e24eaf41ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:17.011425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a84fc-6ab1-41ff-9a1d-72e24eaf41ea admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.011811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a84fc-6ab1-41ff-9a1d-72e24eaf41ea admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.012195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a84fc-6ab1-41ff-9a1d-72e24eaf41ea admin admin] PATH_INFO: `/v3/projects/cf5a5f0a0a7748b385887b8b3c71dfd4/users/5459e82a5d2049039bbaae9fe08d1397/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.031184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0174e4e-1815-4195-aba3-2a9c6197754c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:17.048321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a84fc-6ab1-41ff-9a1d-72e24eaf41ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5a5f0a0a7748b385887b8b3c71dfd4, user_id=5459e82a5d2049039bbaae9fe08d1397, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:17.055896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a84fc-6ab1-41ff-9a1d-72e24eaf41ea admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:17.068478 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1013/2031] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:16 2022] PUT /identity/v3/projects/cf5a5f0a0a7748b385887b8b3c71dfd4/users/5459e82a5d2049039bbaae9fe08d1397/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:17.072304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a84fc-6ab1-41ff-9a1d-72e24eaf41ea admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:17.078582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:17.127748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0174e4e-1815-4195-aba3-2a9c6197754c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:17.146059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a84fc-6ab1-41ff-9a1d-72e24eaf41ea admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:17.150954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8642f-5b9c-4ed6-8851-28540ea580c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:17.151622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8642f-5b9c-4ed6-8851-28540ea580c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.151899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8642f-5b9c-4ed6-8851-28540ea580c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.152175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8642f-5b9c-4ed6-8851-28540ea580c8 admin admin] PATH_INFO: `/v3/projects/013eac4fbe424fca87e94fedc77301ac/users/2fcd991a8d7245fdabb0e3405d71bc02/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.174711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8642f-5b9c-4ed6-8851-28540ea580c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=013eac4fbe424fca87e94fedc77301ac, user_id=2fcd991a8d7245fdabb0e3405d71bc02, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:17.177548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8642f-5b9c-4ed6-8851-28540ea580c8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:17.193608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ff38d-df3c-4c53-a57d-bedf6e68a197 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:17.194059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff38d-df3c-4c53-a57d-bedf6e68a197 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.194210 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1014/2032] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:17 2022] PUT /identity/v3/projects/013eac4fbe424fca87e94fedc77301ac/users/2fcd991a8d7245fdabb0e3405d71bc02/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:17.194492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff38d-df3c-4c53-a57d-bedf6e68a197 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.194736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff38d-df3c-4c53-a57d-bedf6e68a197 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/projects/05ad3b8b719c425998c6b118a1087573` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.195057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8642f-5b9c-4ed6-8851-28540ea580c8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:17.196010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ff38d-df3c-4c53-a57d-bedf6e68a197 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:get_project(project_id=05ad3b8b719c425998c6b118a1087573)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:17.198115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ff38d-df3c-4c53-a57d-bedf6e68a197 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:17.205271 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1019/2033] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:16 2022] GET /identity/v3/projects/05ad3b8b719c425998c6b118a1087573 => generated 369 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:17.206223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ff38d-df3c-4c53-a57d-bedf6e68a197 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:17.219582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ff38d-df3c-4c53-a57d-bedf6e68a197 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:17.306313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8642f-5b9c-4ed6-8851-28540ea580c8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:17.317243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb651aa1-9989-42cb-b9ab-3e7091b451a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:17.318557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b737fd-4d3e-4421-a0bc-5650e638f179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:17.318688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb651aa1-9989-42cb-b9ab-3e7091b451a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.318688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb651aa1-9989-42cb-b9ab-3e7091b451a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.318688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb651aa1-9989-42cb-b9ab-3e7091b451a1 admin admin] PATH_INFO: `/v3/projects/b36cff04ee694360bc060e0ea7f4ba20/users/2e0ae74aad6e42a8bf64b166603b220f/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.318915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b737fd-4d3e-4421-a0bc-5650e638f179 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.318915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b737fd-4d3e-4421-a0bc-5650e638f179 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.319153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b737fd-4d3e-4421-a0bc-5650e638f179 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.319778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b737fd-4d3e-4421-a0bc-5650e638f179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:17.321449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b737fd-4d3e-4421-a0bc-5650e638f179 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:17.332617 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1020/2034] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:17.336645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917908a3-4690-44d2-bf37-b823693b64c0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.336645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917908a3-4690-44d2-bf37-b823693b64c0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.336645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917908a3-4690-44d2-bf37-b823693b64c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.337876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb651aa1-9989-42cb-b9ab-3e7091b451a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36cff04ee694360bc060e0ea7f4ba20, user_id=2e0ae74aad6e42a8bf64b166603b220f, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:17.341147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb651aa1-9989-42cb-b9ab-3e7091b451a1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:17.358393 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1015/2035] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:17 2022] PUT /identity/v3/projects/b36cff04ee694360bc060e0ea7f4ba20/users/2e0ae74aad6e42a8bf64b166603b220f/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:17.359290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb651aa1-9989-42cb-b9ab-3e7091b451a1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:17.383104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-917908a3-4690-44d2-bf37-b823693b64c0 None None] MFA Rules not processed for user `2fcd991a8d7245fdabb0e3405d71bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:17.384380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-917908a3-4690-44d2-bf37-b823693b64c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:17.403188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:17.445853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb651aa1-9989-42cb-b9ab-3e7091b451a1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:17.453308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:17.454199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.454722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.455222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/users/776c76a74e5b428e81be7cb7ef9c039d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.470655 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1021/2036] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:17.471445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917908a3-4690-44d2-bf37-b823693b64c0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:17.480610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:17.488820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:delete_user(user_id=776c76a74e5b428e81be7cb7ef9c039d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:17.493652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:17.556268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776c76a74e5b428e81be7cb7ef9c039d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:17.556960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776c76a74e5b428e81be7cb7ef9c039d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:17.557879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917908a3-4690-44d2-bf37-b823693b64c0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:17.563727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079524db-8451-463c-9f67-29f35fd3db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:17.564436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079524db-8451-463c-9f67-29f35fd3db72 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.564738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079524db-8451-463c-9f67-29f35fd3db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.565020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079524db-8451-463c-9f67-29f35fd3db72 admin admin] PATH_INFO: `/v3/projects/cf5a5f0a0a7748b385887b8b3c71dfd4/users/5459e82a5d2049039bbaae9fe08d1397/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.567157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079524db-8451-463c-9f67-29f35fd3db72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5a5f0a0a7748b385887b8b3c71dfd4, user_id=5459e82a5d2049039bbaae9fe08d1397, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:17.570335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079524db-8451-463c-9f67-29f35fd3db72 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:17.571388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776c76a74e5b428e81be7cb7ef9c039d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:17.572473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776c76a74e5b428e81be7cb7ef9c039d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:17.581749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776c76a74e5b428e81be7cb7ef9c039d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:17.583660 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1022/2037] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:17 2022] PUT /identity/v3/projects/cf5a5f0a0a7748b385887b8b3c71dfd4/users/5459e82a5d2049039bbaae9fe08d1397/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:17.591121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e0853-acd7-45c3-a591-28aff0db4c84 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.591418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e0853-acd7-45c3-a591-28aff0db4c84 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.591580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e0853-acd7-45c3-a591-28aff0db4c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.604332 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1016/2038] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:17 2022] DELETE /identity/v3/users/776c76a74e5b428e81be7cb7ef9c039d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:17.605497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:17.607314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:17.627798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7d0e0853-acd7-45c3-a591-28aff0db4c84 None None] MFA Rules not processed for user `2e0ae74aad6e42a8bf64b166603b220f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:17.629506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7d0e0853-acd7-45c3-a591-28aff0db4c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:17.688101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df00405-09c8-4cc7-811c-6bb34678f861 tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:17.693803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6980cd-4111-428e-867e-896948b06fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:17.694443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6980cd-4111-428e-867e-896948b06fea admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.694731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6980cd-4111-428e-867e-896948b06fea admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.695021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6980cd-4111-428e-867e-896948b06fea admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.695670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6980cd-4111-428e-867e-896948b06fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:17.697731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6980cd-4111-428e-867e-896948b06fea admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:17.732468 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1017/2039] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:17 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:17.732704 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1023/2040] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:17.733850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6332cce-eab4-4025-9d12-e8d64bcc1578 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.734138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6332cce-eab4-4025-9d12-e8d64bcc1578 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.734401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6332cce-eab4-4025-9d12-e8d64bcc1578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.735108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cb20c-a39f-47b4-9f45-90e9a89c8035 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.735614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cb20c-a39f-47b4-9f45-90e9a89c8035 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.736122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cb20c-a39f-47b4-9f45-90e9a89c8035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.762465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f6332cce-eab4-4025-9d12-e8d64bcc1578 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:17.763740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f6332cce-eab4-4025-9d12-e8d64bcc1578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:17.788111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-495cb20c-a39f-47b4-9f45-90e9a89c8035 None None] MFA Rules not processed for user `5459e82a5d2049039bbaae9fe08d1397`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:17.789838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:17.790332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-495cb20c-a39f-47b4-9f45-90e9a89c8035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:17.830733 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1018/2041] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Aug 29 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:17.831812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6332cce-eab4-4025-9d12-e8d64bcc1578 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:17.833546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f6332cce-eab4-4025-9d12-e8d64bcc1578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:17.923938 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1024/2042] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:17.925225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cb20c-a39f-47b4-9f45-90e9a89c8035 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:17.927262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-495cb20c-a39f-47b4-9f45-90e9a89c8035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:17.941690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6332cce-eab4-4025-9d12-e8d64bcc1578 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:17.948678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e486e5ea72a7411e8f638e604ee10810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e069378a68de4143a171e8ec38b8e8a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:17.949819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:17.950154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:17.950681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] PATH_INFO: `/v3/projects/05ad3b8b719c425998c6b118a1087573` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:17.952135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05ad3b8b719c425998c6b118a1087573)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:17.954291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:17.955659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:18.026188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ad3b8b719c425998c6b118a1087573', 'request_id': 'req-42417874-4bcb-4117-8737-ff780b3ad6ab'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:18.037822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ad3b8b719c425998c6b118a1087573', 'request_id': 'req-42417874-4bcb-4117-8737-ff780b3ad6ab'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:18.050214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ad3b8b719c425998c6b118a1087573', 'request_id': 'req-42417874-4bcb-4117-8737-ff780b3ad6ab'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:18.068846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] The token cache is being invalidate because project 05ad3b8b719c425998c6b118a1087573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:18.069141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:18.069916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:18.075626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cb20c-a39f-47b4-9f45-90e9a89c8035 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:18.077003 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1019/2043] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:17 2022] DELETE /identity/v3/projects/05ad3b8b719c425998c6b118a1087573 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:18.079321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:18.081610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.167132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af99b0-0def-478b-a178-47db46d71552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:18.167896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af99b0-0def-478b-a178-47db46d71552 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.168238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af99b0-0def-478b-a178-47db46d71552 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.168515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af99b0-0def-478b-a178-47db46d71552 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.169502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af99b0-0def-478b-a178-47db46d71552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:18.171383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af99b0-0def-478b-a178-47db46d71552 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:18.195333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42417874-4bcb-4117-8737-ff780b3ad6ab tempest-QuotasAdminTestV257-469734832 tempest-QuotasAdminTestV257-469734832-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:18.205879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a1d6e-0329-4e7a-ae7b-6f13c5bc0fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:18.206839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1d6e-0329-4e7a-ae7b-6f13c5bc0fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.207350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1d6e-0329-4e7a-ae7b-6f13c5bc0fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.207819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1d6e-0329-4e7a-ae7b-6f13c5bc0fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.208646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a1d6e-0329-4e7a-ae7b-6f13c5bc0fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:18.209291 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1025/2044] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:17 2022] POST /identity/v3/projects => generated 361 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:18.212694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a1d6e-0329-4e7a-ae7b-6f13c5bc0fb8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:18.214611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af99b0-0def-478b-a178-47db46d71552 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:18.216969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-27af99b0-0def-478b-a178-47db46d71552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.237053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:18.254453 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1020/2045] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:18 2022] POST /identity/v3/users => generated 302 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:18.256400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a1d6e-0329-4e7a-ae7b-6f13c5bc0fb8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:18.261204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ab9a1d6e-0329-4e7a-ae7b-6f13c5bc0fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.302333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af99b0-0def-478b-a178-47db46d71552 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:18.306298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fdf56-c765-43f4-a032-606910f120fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:18.306924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fdf56-c765-43f4-a032-606910f120fb service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.307214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fdf56-c765-43f4-a032-606910f120fb service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.307482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fdf56-c765-43f4-a032-606910f120fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.309536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de3fdf56-c765-43f4-a032-606910f120fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.320908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fdf56-c765-43f4-a032-606910f120fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:18.322428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fdf56-c765-43f4-a032-606910f120fb service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:18.337019 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1026/2046] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:18.338514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fdf56-c765-43f4-a032-606910f120fb service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:18.340753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de3fdf56-c765-43f4-a032-606910f120fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.359159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a1d6e-0329-4e7a-ae7b-6f13c5bc0fb8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:18.428596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:18.432610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979b81-5d9a-4ccf-aad8-7a75a00cef87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:18.433444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979b81-5d9a-4ccf-aad8-7a75a00cef87 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.433714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979b81-5d9a-4ccf-aad8-7a75a00cef87 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.433990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979b81-5d9a-4ccf-aad8-7a75a00cef87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.436016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9e979b81-5d9a-4ccf-aad8-7a75a00cef87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.453977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fdf56-c765-43f4-a032-606910f120fb service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:18.459744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:18.460397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.460680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.460958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] PATH_INFO: `/v3/users/c4a46f5fb3e74f1f8c03e0bbe0adbb34` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.462247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a46f5fb3e74f1f8c03e0bbe0adbb34)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:18.464329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:18.552690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e979b81-5d9a-4ccf-aad8-7a75a00cef87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:18.554414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e979b81-5d9a-4ccf-aad8-7a75a00cef87 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:18.566970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a46f5fb3e74f1f8c03e0bbe0adbb34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:18.566970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a46f5fb3e74f1f8c03e0bbe0adbb34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:18.567320 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1021/2047] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:18 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:18.568350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979b81-5d9a-4ccf-aad8-7a75a00cef87 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:18.569275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9e979b81-5d9a-4ccf-aad8-7a75a00cef87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.583134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a46f5fb3e74f1f8c03e0bbe0adbb34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:18.584243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979b81-5d9a-4ccf-aad8-7a75a00cef87 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:18.589550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac804bd4-edce-4ca6-b26d-ccfe408dcdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:18.590489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac804bd4-edce-4ca6-b26d-ccfe408dcdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.590985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac804bd4-edce-4ca6-b26d-ccfe408dcdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.591499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac804bd4-edce-4ca6-b26d-ccfe408dcdd8 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.592270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac804bd4-edce-4ca6-b26d-ccfe408dcdd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:18.594602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac804bd4-edce-4ca6-b26d-ccfe408dcdd8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:18.597539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a46f5fb3e74f1f8c03e0bbe0adbb34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:18.608654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a46f5fb3e74f1f8c03e0bbe0adbb34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:18.618779 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1027/2048] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:18 2022] DELETE /identity/v3/users/c4a46f5fb3e74f1f8c03e0bbe0adbb34 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:18.621546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:18.623052 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1022/2049] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:18 2022] POST /identity/v3/users => generated 287 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:18.623553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.624911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7c01d-aaf6-4697-8b34-8fc4f4a2f736 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.625634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7c01d-aaf6-4697-8b34-8fc4f4a2f736 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.626208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7c01d-aaf6-4697-8b34-8fc4f4a2f736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.650466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-93a7c01d-aaf6-4697-8b34-8fc4f4a2f736 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:18.652066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-93a7c01d-aaf6-4697-8b34-8fc4f4a2f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.657013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:18.729906 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1023/2050] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:18.730646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7c01d-aaf6-4697-8b34-8fc4f4a2f736 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:18.734171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-93a7c01d-aaf6-4697-8b34-8fc4f4a2f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.757450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7c01d-aaf6-4697-8b34-8fc4f4a2f736 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:18.764924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ceecd7-2180-41aa-9b23-862cffe7e12b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:18.772509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7f541-0fae-4285-9327-e22556d35823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:18.772798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30249c66-3d77-4a3f-b695-16334d760a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:18.773302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30249c66-3d77-4a3f-b695-16334d760a08 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.773587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7f541-0fae-4285-9327-e22556d35823 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.773686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30249c66-3d77-4a3f-b695-16334d760a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.773771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7f541-0fae-4285-9327-e22556d35823 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.774090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30249c66-3d77-4a3f-b695-16334d760a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.774197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7f541-0fae-4285-9327-e22556d35823 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.774897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30249c66-3d77-4a3f-b695-16334d760a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:18.775004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7f541-0fae-4285-9327-e22556d35823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:18.776644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30249c66-3d77-4a3f-b695-16334d760a08 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:18.776817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7f541-0fae-4285-9327-e22556d35823 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:18.789662 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1028/2051] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:18.791191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7f541-0fae-4285-9327-e22556d35823 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:18.793553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-02d7f541-0fae-4285-9327-e22556d35823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.795909 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1024/2052] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:18.796955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30249c66-3d77-4a3f-b695-16334d760a08 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:18.806882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-30249c66-3d77-4a3f-b695-16334d760a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.908030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:18.922265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30249c66-3d77-4a3f-b695-16334d760a08 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:18.926582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7f541-0fae-4285-9327-e22556d35823 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:18.927088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c60ba-2995-474f-8ff2-592a110f81d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:18.927705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c60ba-2995-474f-8ff2-592a110f81d0 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.928153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c60ba-2995-474f-8ff2-592a110f81d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.928458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c60ba-2995-474f-8ff2-592a110f81d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.935762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b74654-c98f-4cf2-b10e-5bc92f173d19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:18.936840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b74654-c98f-4cf2-b10e-5bc92f173d19 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.937336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b74654-c98f-4cf2-b10e-5bc92f173d19 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.937808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b74654-c98f-4cf2-b10e-5bc92f173d19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:18.940563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-09b74654-c98f-4cf2-b10e-5bc92f173d19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:18.943964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c60ba-2995-474f-8ff2-592a110f81d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:18.946687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c60ba-2995-474f-8ff2-592a110f81d0 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:18.967221 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1025/2053] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:18.969043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c60ba-2995-474f-8ff2-592a110f81d0 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:18.987135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c60ba-2995-474f-8ff2-592a110f81d0 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:18.995277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a618b-be2a-4bc8-8a8b-f909cb66d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:18.996733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a618b-be2a-4bc8-8a8b-f909cb66d067 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:18.998035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a618b-be2a-4bc8-8a8b-f909cb66d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:18.998775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a618b-be2a-4bc8-8a8b-f909cb66d067 admin admin] PATH_INFO: `/v3/projects/e5b3f367eace4b61b8abf0b4bc377e3f/users/1942b1e28d8140cd81226d7cbda4c212/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.027901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a618b-be2a-4bc8-8a8b-f909cb66d067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b3f367eace4b61b8abf0b4bc377e3f, user_id=1942b1e28d8140cd81226d7cbda4c212, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.031603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a618b-be2a-4bc8-8a8b-f909cb66d067 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.056734 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1026/2054] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:18 2022] PUT /identity/v3/projects/e5b3f367eace4b61b8abf0b4bc377e3f/users/1942b1e28d8140cd81226d7cbda4c212/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:19.061128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a618b-be2a-4bc8-8a8b-f909cb66d067 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.061621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b74654-c98f-4cf2-b10e-5bc92f173d19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.066433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b74654-c98f-4cf2-b10e-5bc92f173d19 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.084938 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1029/2055] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:18 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:19.086349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b74654-c98f-4cf2-b10e-5bc92f173d19 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.121201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b74654-c98f-4cf2-b10e-5bc92f173d19 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.190519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a618b-be2a-4bc8-8a8b-f909cb66d067 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.200386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621555b-8307-4fd5-aa7e-5dddbdcaddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.201177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621555b-8307-4fd5-aa7e-5dddbdcaddb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.201591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621555b-8307-4fd5-aa7e-5dddbdcaddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.202125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621555b-8307-4fd5-aa7e-5dddbdcaddb1 admin admin] PATH_INFO: `/v3/projects/45e8b81073454cd6b86b9a76b44d2a59/users/da15b1fa3c964929808f783b89bffe3d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.226579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621555b-8307-4fd5-aa7e-5dddbdcaddb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e8b81073454cd6b86b9a76b44d2a59, user_id=da15b1fa3c964929808f783b89bffe3d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.230551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621555b-8307-4fd5-aa7e-5dddbdcaddb1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.249158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:19.279246 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1027/2056] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:19 2022] PUT /identity/v3/projects/45e8b81073454cd6b86b9a76b44d2a59/users/da15b1fa3c964929808f783b89bffe3d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:19.280841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621555b-8307-4fd5-aa7e-5dddbdcaddb1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.339480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364840-108b-42e3-b3b5-5830ec4a3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.340172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364840-108b-42e3-b3b5-5830ec4a3f5b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.340379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364840-108b-42e3-b3b5-5830ec4a3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.340650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364840-108b-42e3-b3b5-5830ec4a3f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.341373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb364840-108b-42e3-b3b5-5830ec4a3f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.345747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb364840-108b-42e3-b3b5-5830ec4a3f5b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.372117 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1030/2057] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:19.375609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364840-108b-42e3-b3b5-5830ec4a3f5b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.413821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364840-108b-42e3-b3b5-5830ec4a3f5b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.490797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621555b-8307-4fd5-aa7e-5dddbdcaddb1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.504519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8ca87-ede5-4ec8-94c1-6ace6017c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.505147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8ca87-ede5-4ec8-94c1-6ace6017c90e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.505520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8ca87-ede5-4ec8-94c1-6ace6017c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.505802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8ca87-ede5-4ec8-94c1-6ace6017c90e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.506471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8ca87-ede5-4ec8-94c1-6ace6017c90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.508338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8ca87-ede5-4ec8-94c1-6ace6017c90e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.527295 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1028/2058] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:19.529364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8ca87-ede5-4ec8-94c1-6ace6017c90e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.547083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8ca87-ede5-4ec8-94c1-6ace6017c90e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.556057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2e05f-b004-4e48-8d4b-9e168da95f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.557574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e05f-b004-4e48-8d4b-9e168da95f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.557866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e05f-b004-4e48-8d4b-9e168da95f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.558139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e05f-b004-4e48-8d4b-9e168da95f84 admin admin] PATH_INFO: `/v3/projects/45e8b81073454cd6b86b9a76b44d2a59/users/da15b1fa3c964929808f783b89bffe3d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.560369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2e05f-b004-4e48-8d4b-9e168da95f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e8b81073454cd6b86b9a76b44d2a59, user_id=da15b1fa3c964929808f783b89bffe3d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.563155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2e05f-b004-4e48-8d4b-9e168da95f84 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.577646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71c0e6-6a8d-4825-8584-d49e82729bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.580453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71c0e6-6a8d-4825-8584-d49e82729bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.580751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71c0e6-6a8d-4825-8584-d49e82729bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.581107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71c0e6-6a8d-4825-8584-d49e82729bd7 admin admin] PATH_INFO: `/v3/projects/e5b3f367eace4b61b8abf0b4bc377e3f/users/1942b1e28d8140cd81226d7cbda4c212/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.586044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71c0e6-6a8d-4825-8584-d49e82729bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b3f367eace4b61b8abf0b4bc377e3f, user_id=1942b1e28d8140cd81226d7cbda4c212, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.594504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71c0e6-6a8d-4825-8584-d49e82729bd7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.618427 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1029/2059] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:19 2022] PUT /identity/v3/projects/45e8b81073454cd6b86b9a76b44d2a59/users/da15b1fa3c964929808f783b89bffe3d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:19.624178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f791e73-7a83-41cc-b2e9-eac422da5719 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.624462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f791e73-7a83-41cc-b2e9-eac422da5719 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.624742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f791e73-7a83-41cc-b2e9-eac422da5719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.638221 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1031/2060] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:19 2022] PUT /identity/v3/projects/e5b3f367eace4b61b8abf0b4bc377e3f/users/1942b1e28d8140cd81226d7cbda4c212/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:19.649267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd07a1-aa78-4b56-959c-36be95a95f5f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.649603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd07a1-aa78-4b56-959c-36be95a95f5f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.649887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd07a1-aa78-4b56-959c-36be95a95f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.691161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8f791e73-7a83-41cc-b2e9-eac422da5719 None None] MFA Rules not processed for user `da15b1fa3c964929808f783b89bffe3d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:19.694816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5ddd07a1-aa78-4b56-959c-36be95a95f5f None None] MFA Rules not processed for user `1942b1e28d8140cd81226d7cbda4c212`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:19.695006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8f791e73-7a83-41cc-b2e9-eac422da5719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:19.696061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5ddd07a1-aa78-4b56-959c-36be95a95f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:19.738362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:19.826501 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1032/2061] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:19 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:19.827374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd07a1-aa78-4b56-959c-36be95a95f5f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.833213 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1030/2062] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:19.833619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5ddd07a1-aa78-4b56-959c-36be95a95f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:19.868532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f791e73-7a83-41cc-b2e9-eac422da5719 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:19.951708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd07a1-aa78-4b56-959c-36be95a95f5f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.957852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.959067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.959067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.959067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] PATH_INFO: `/v3/projects/28f844a42ca44cc18a536711a7ff89a9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.960153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f844a42ca44cc18a536711a7ff89a9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.962150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:19.976481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f791e73-7a83-41cc-b2e9-eac422da5719 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:19.982731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:19.983375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:19.983651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:19.983918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] PATH_INFO: `/v3/users/2fcd991a8d7245fdabb0e3405d71bc02` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:19.985215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fcd991a8d7245fdabb0e3405d71bc02)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:19.987547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:20.002189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:20.025876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f844a42ca44cc18a536711a7ff89a9', 'request_id': 'req-fdba02ee-00e2-4811-b45d-89b6c50a8744'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.035394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f844a42ca44cc18a536711a7ff89a9', 'request_id': 'req-fdba02ee-00e2-4811-b45d-89b6c50a8744'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.044675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f844a42ca44cc18a536711a7ff89a9', 'request_id': 'req-fdba02ee-00e2-4811-b45d-89b6c50a8744'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.070631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] The token cache is being invalidate because project 28f844a42ca44cc18a536711a7ff89a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:20.070879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fcd991a8d7245fdabb0e3405d71bc02'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.071471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.072624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.073461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fcd991a8d7245fdabb0e3405d71bc02'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.079905 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1033/2063] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:19 2022] DELETE /identity/v3/projects/28f844a42ca44cc18a536711a7ff89a9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:20.081648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:20.084232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:20.095793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fcd991a8d7245fdabb0e3405d71bc02'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.096536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fcd991a8d7245fdabb0e3405d71bc02'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.106916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fcd991a8d7245fdabb0e3405d71bc02'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.130600 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1031/2064] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:19 2022] DELETE /identity/v3/users/2fcd991a8d7245fdabb0e3405d71bc02 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:26:20.131779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:20.134136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:20.169891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:20.199827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba02ee-00e2-4811-b45d-89b6c50a8744 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:20.230352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d4abc-148d-463b-a959-62c6cbbe0cfa admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:20.238566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:20.240025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:20.240510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:20.240999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] PATH_INFO: `/v3/users/3033b6e4fef9421f9f353b54ad20f41c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.243217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3033b6e4fef9421f9f353b54ad20f41c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:20.247033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:20.282939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec862a5-0cee-4cae-9320-ce8df9ddd1d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:20.284059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec862a5-0cee-4cae-9320-ce8df9ddd1d2 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:20.284527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec862a5-0cee-4cae-9320-ce8df9ddd1d2 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:20.285034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec862a5-0cee-4cae-9320-ce8df9ddd1d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.288224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8ec862a5-0cee-4cae-9320-ce8df9ddd1d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:20.302876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3033b6e4fef9421f9f353b54ad20f41c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.303560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3033b6e4fef9421f9f353b54ad20f41c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.319654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3033b6e4fef9421f9f353b54ad20f41c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.320414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3033b6e4fef9421f9f353b54ad20f41c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.327701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3033b6e4fef9421f9f353b54ad20f41c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.341677 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1032/2065] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:20 2022] DELETE /identity/v3/users/3033b6e4fef9421f9f353b54ad20f41c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:20.342522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:20.343845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:20.353851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:20.371034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec862a5-0cee-4cae-9320-ce8df9ddd1d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:20.372682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec862a5-0cee-4cae-9320-ce8df9ddd1d2 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:20.384782 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1034/2066] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:20.386513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e362-5892-41c1-8cb1-0ece9c4f4c3b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:20.386779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e362-5892-41c1-8cb1-0ece9c4f4c3b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:20.387052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e362-5892-41c1-8cb1-0ece9c4f4c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.412410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0343e362-5892-41c1-8cb1-0ece9c4f4c3b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:20.413678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0343e362-5892-41c1-8cb1-0ece9c4f4c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:20.416981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eb3c9-18a9-44cd-8fc7-19a4f9f69624 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:20.422449 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1035/2067] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:20.422673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:20.422785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:20.423067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:20.423848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] PATH_INFO: `/v3/users/e486e5ea72a7411e8f638e604ee10810` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.423966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e65dd-b151-4e49-8546-8601553f6fa8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:20.424246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e65dd-b151-4e49-8546-8601553f6fa8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:20.424575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e65dd-b151-4e49-8546-8601553f6fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.425023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e486e5ea72a7411e8f638e604ee10810)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:20.427006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:20.446675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a96e65dd-b151-4e49-8546-8601553f6fa8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:20.448068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a96e65dd-b151-4e49-8546-8601553f6fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:20.457485 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1036/2068] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:20.458692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e65dd-b151-4e49-8546-8601553f6fa8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:20.460385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a96e65dd-b151-4e49-8546-8601553f6fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:20.485208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e486e5ea72a7411e8f638e604ee10810'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.485978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e486e5ea72a7411e8f638e604ee10810'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.499908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e486e5ea72a7411e8f638e604ee10810'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.500696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e486e5ea72a7411e8f638e604ee10810'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.510267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e486e5ea72a7411e8f638e604ee10810'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:20.526483 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1033/2069] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:20 2022] DELETE /identity/v3/users/e486e5ea72a7411e8f638e604ee10810 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:20.527739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:20.530028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:20.575047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e65dd-b151-4e49-8546-8601553f6fa8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:20.614248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:20.625360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52895f-192d-4bfa-9d76-6ea7c3cf9a61 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:20.637292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877296d4-0758-403e-a26c-7aea7703546e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:20.638202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877296d4-0758-403e-a26c-7aea7703546e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:20.638665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877296d4-0758-403e-a26c-7aea7703546e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:20.638825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877296d4-0758-403e-a26c-7aea7703546e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.641158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-877296d4-0758-403e-a26c-7aea7703546e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:20.695064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20eab9-4d02-45df-9271-957b0f356ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:20.696104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20eab9-4d02-45df-9271-957b0f356ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:20.696609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20eab9-4d02-45df-9271-957b0f356ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:20.697100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20eab9-4d02-45df-9271-957b0f356ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:20.699215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bc20eab9-4d02-45df-9271-957b0f356ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:20.700432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:20.737485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877296d4-0758-403e-a26c-7aea7703546e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:20.739324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877296d4-0758-403e-a26c-7aea7703546e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:20.759335 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1034/2070] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:20.798503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20eab9-4d02-45df-9271-957b0f356ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:20.799962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20eab9-4d02-45df-9271-957b0f356ea4 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:20.810761 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1037/2071] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:21.500413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877296d4-0758-403e-a26c-7aea7703546e service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:21.506841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-877296d4-0758-403e-a26c-7aea7703546e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:21.541191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877296d4-0758-403e-a26c-7aea7703546e service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:21.554913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c88d24-814b-4cff-b54f-6a56c907b188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:21.556080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c88d24-814b-4cff-b54f-6a56c907b188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:21.557422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c88d24-814b-4cff-b54f-6a56c907b188 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:21.557937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c88d24-814b-4cff-b54f-6a56c907b188 admin admin] PATH_INFO: `/v3/users/2e0ae74aad6e42a8bf64b166603b220f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:21.560657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c88d24-814b-4cff-b54f-6a56c907b188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0ae74aad6e42a8bf64b166603b220f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:21.563025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c88d24-814b-4cff-b54f-6a56c907b188 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:21.621550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20eab9-4d02-45df-9271-957b0f356ea4 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:21.624256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bc20eab9-4d02-45df-9271-957b0f356ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:21.642939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20eab9-4d02-45df-9271-957b0f356ea4 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:21.649833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:21.651375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:21.651375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:21.651704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] PATH_INFO: `/v3/projects/e069378a68de4143a171e8ec38b8e8a4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:21.653061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e069378a68de4143a171e8ec38b8e8a4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:21.655769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:21.695123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-91c88d24-814b-4cff-b54f-6a56c907b188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0ae74aad6e42a8bf64b166603b220f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:21.709835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-91c88d24-814b-4cff-b54f-6a56c907b188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0ae74aad6e42a8bf64b166603b220f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:21.753428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e069378a68de4143a171e8ec38b8e8a4', 'request_id': 'req-b403498e-abb0-4fab-8c25-7e50a104afdb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:21.763094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e069378a68de4143a171e8ec38b8e8a4', 'request_id': 'req-b403498e-abb0-4fab-8c25-7e50a104afdb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:21.765001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-91c88d24-814b-4cff-b54f-6a56c907b188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0ae74aad6e42a8bf64b166603b220f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:21.766012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-91c88d24-814b-4cff-b54f-6a56c907b188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0ae74aad6e42a8bf64b166603b220f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:21.781792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e069378a68de4143a171e8ec38b8e8a4', 'request_id': 'req-b403498e-abb0-4fab-8c25-7e50a104afdb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:21.785518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-91c88d24-814b-4cff-b54f-6a56c907b188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0ae74aad6e42a8bf64b166603b220f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:21.799459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] The token cache is being invalidate because project e069378a68de4143a171e8ec38b8e8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:21.800229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:21.801228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b403498e-abb0-4fab-8c25-7e50a104afdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:21.804399 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1038/2072] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:21 2022] DELETE /identity/v3/projects/e069378a68de4143a171e8ec38b8e8a4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:21.815672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b774-f103-4ec2-bda6-14548345276f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:21.816483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b774-f103-4ec2-bda6-14548345276f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:21.818462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b774-f103-4ec2-bda6-14548345276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:21.824075 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1035/2073] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:21 2022] DELETE /identity/v3/users/2e0ae74aad6e42a8bf64b166603b220f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:21.825878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc39f7-ee73-475a-91a6-28d44ba12305 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:21.826381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc39f7-ee73-475a-91a6-28d44ba12305 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:21.826806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc39f7-ee73-475a-91a6-28d44ba12305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:21.865799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7cc3b774-f103-4ec2-bda6-14548345276f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:21.867545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7cc3b774-f103-4ec2-bda6-14548345276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:21.872371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9dcc39f7-ee73-475a-91a6-28d44ba12305 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:21.883992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9dcc39f7-ee73-475a-91a6-28d44ba12305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:21.981936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:22.011510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1039/2074] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:22.011510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3b774-f103-4ec2-bda6-14548345276f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:22.011510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7cc3b774-f103-4ec2-bda6-14548345276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:22.026258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3b774-f103-4ec2-bda6-14548345276f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:22.033486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:22.034147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:22.034430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:22.034709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] PATH_INFO: `/v3/projects/6f582e6eda664071b9adc2862add206c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:22.041567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f582e6eda664071b9adc2862add206c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:22.051787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:22.060604 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1036/2075] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:22.060604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc39f7-ee73-475a-91a6-28d44ba12305 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:22.066325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9dcc39f7-ee73-475a-91a6-28d44ba12305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:22.092070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc39f7-ee73-475a-91a6-28d44ba12305 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:22.107351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:22.108703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:22.110793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:22.111447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] PATH_INFO: `/v3/projects/013eac4fbe424fca87e94fedc77301ac` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:22.113944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=013eac4fbe424fca87e94fedc77301ac)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:22.120394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:22.138900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f582e6eda664071b9adc2862add206c', 'request_id': 'req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.147725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f582e6eda664071b9adc2862add206c', 'request_id': 'req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.160346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f582e6eda664071b9adc2862add206c', 'request_id': 'req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.180437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] The token cache is being invalidate because project 6f582e6eda664071b9adc2862add206c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:22.180910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.181985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c303cd0-3db5-4f01-9e7f-bb13f78080e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.184623 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1040/2076] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:22 2022] DELETE /identity/v3/projects/6f582e6eda664071b9adc2862add206c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:22.187333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9155-9204-4c49-8000-759660a518d9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:22.187812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9155-9204-4c49-8000-759660a518d9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:22.188289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9155-9204-4c49-8000-759660a518d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:22.209480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:22.220429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013eac4fbe424fca87e94fedc77301ac', 'request_id': 'req-4a142498-69d2-45b7-811a-b7b051267e9d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.220933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8f6a9155-9204-4c49-8000-759660a518d9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:22.223136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8f6a9155-9204-4c49-8000-759660a518d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:22.244206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013eac4fbe424fca87e94fedc77301ac', 'request_id': 'req-4a142498-69d2-45b7-811a-b7b051267e9d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.260945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013eac4fbe424fca87e94fedc77301ac', 'request_id': 'req-4a142498-69d2-45b7-811a-b7b051267e9d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.286498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] The token cache is being invalidate because project 013eac4fbe424fca87e94fedc77301ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:22.288017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.289246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.291953 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1037/2077] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:22 2022] DELETE /identity/v3/projects/013eac4fbe424fca87e94fedc77301ac => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:22.299333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:22.302459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:22.343475 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1041/2078] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:22.346440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9155-9204-4c49-8000-759660a518d9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:22.350643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8f6a9155-9204-4c49-8000-759660a518d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:22.370465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9155-9204-4c49-8000-759660a518d9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:22.377407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:22.378473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:22.378969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:22.379378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] PATH_INFO: `/v3/users/5459e82a5d2049039bbaae9fe08d1397` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:22.381283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5459e82a5d2049039bbaae9fe08d1397)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:22.384175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:22.398201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a142498-69d2-45b7-811a-b7b051267e9d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:22.402886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6aab98-68f8-452e-b958-b3bbe39a3dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:22.403986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aab98-68f8-452e-b958-b3bbe39a3dcc service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:22.404997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aab98-68f8-452e-b958-b3bbe39a3dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:22.404997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aab98-68f8-452e-b958-b3bbe39a3dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:22.407164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4c6aab98-68f8-452e-b958-b3bbe39a3dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:22.425322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6aab98-68f8-452e-b958-b3bbe39a3dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:22.427081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6aab98-68f8-452e-b958-b3bbe39a3dcc service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:22.444530 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1038/2079] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:22.447700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6aab98-68f8-452e-b958-b3bbe39a3dcc service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:22.450660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4c6aab98-68f8-452e-b958-b3bbe39a3dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:22.474987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6aab98-68f8-452e-b958-b3bbe39a3dcc service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:22.485282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:22.486441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:22.487050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:22.488871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] PATH_INFO: `/v3/users/1942b1e28d8140cd81226d7cbda4c212` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:22.491273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1942b1e28d8140cd81226d7cbda4c212)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:22.495388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5459e82a5d2049039bbaae9fe08d1397'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.496281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5459e82a5d2049039bbaae9fe08d1397'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.496394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:22.524788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5459e82a5d2049039bbaae9fe08d1397'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.542489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5459e82a5d2049039bbaae9fe08d1397'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.543665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:22.572654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5459e82a5d2049039bbaae9fe08d1397'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.594126 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1042/2080] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:22 2022] DELETE /identity/v3/users/5459e82a5d2049039bbaae9fe08d1397 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:22.596301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:22.598913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:22.623646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1942b1e28d8140cd81226d7cbda4c212'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.625884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1942b1e28d8140cd81226d7cbda4c212'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.655067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1942b1e28d8140cd81226d7cbda4c212'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.658371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1942b1e28d8140cd81226d7cbda4c212'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.670127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1942b1e28d8140cd81226d7cbda4c212'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:22.700336 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1039/2081] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:22 2022] DELETE /identity/v3/users/1942b1e28d8140cd81226d7cbda4c212 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:22.727965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157112b-6b11-46fe-83f3-039bac901499 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:22.827924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d74874-828e-436d-9a3e-04ea16f444dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:22.828633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d74874-828e-436d-9a3e-04ea16f444dc admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:22.828910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d74874-828e-436d-9a3e-04ea16f444dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:22.829250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d74874-828e-436d-9a3e-04ea16f444dc admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:22.831487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d74874-828e-436d-9a3e-04ea16f444dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:22.831487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d74874-828e-436d-9a3e-04ea16f444dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:22.832111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d74874-828e-436d-9a3e-04ea16f444dc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:22.850579 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1043/2082] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:22.851469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:22.852970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:22.880119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034366a9-1788-4808-a68d-4a0aa4cef624 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:22.896046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3002c7-9963-40f9-89e2-a524f225a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:22.896841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3002c7-9963-40f9-89e2-a524f225a030 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:22.897196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3002c7-9963-40f9-89e2-a524f225a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:22.897564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3002c7-9963-40f9-89e2-a524f225a030 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:22.898386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3002c7-9963-40f9-89e2-a524f225a030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:22.900622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3002c7-9963-40f9-89e2-a524f225a030 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:22.966002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d74874-828e-436d-9a3e-04ea16f444dc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:22.989546 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1040/2083] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:22 2022] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:22.998536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d74874-828e-436d-9a3e-04ea16f444dc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.156282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997a45f-42b4-4ca6-987f-f60dd8d81857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.157730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997a45f-42b4-4ca6-987f-f60dd8d81857 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.160120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997a45f-42b4-4ca6-987f-f60dd8d81857 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.160992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997a45f-42b4-4ca6-987f-f60dd8d81857 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.163095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997a45f-42b4-4ca6-987f-f60dd8d81857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.167001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997a45f-42b4-4ca6-987f-f60dd8d81857 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.205031 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1044/2084] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:22 2022] POST /identity/v3/users => generated 302 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:23.209243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3002c7-9963-40f9-89e2-a524f225a030 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.232742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3002c7-9963-40f9-89e2-a524f225a030 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.238662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e99ba5-dbea-45be-875f-40ca1f49c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.239291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e99ba5-dbea-45be-875f-40ca1f49c64d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.240605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e99ba5-dbea-45be-875f-40ca1f49c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.241077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e99ba5-dbea-45be-875f-40ca1f49c64d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.241790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e99ba5-dbea-45be-875f-40ca1f49c64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.243593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e99ba5-dbea-45be-875f-40ca1f49c64d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.257648 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1041/2085] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:23.261604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997a45f-42b4-4ca6-987f-f60dd8d81857 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.273373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997a45f-42b4-4ca6-987f-f60dd8d81857 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.283641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476bc8-204c-4432-ba7e-6eaa597eee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.284334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476bc8-204c-4432-ba7e-6eaa597eee60 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.284640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476bc8-204c-4432-ba7e-6eaa597eee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.284902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476bc8-204c-4432-ba7e-6eaa597eee60 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.285594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95476bc8-204c-4432-ba7e-6eaa597eee60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.287227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95476bc8-204c-4432-ba7e-6eaa597eee60 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.299700 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1045/2086] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:26:23.304015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e99ba5-dbea-45be-875f-40ca1f49c64d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.317151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e99ba5-dbea-45be-875f-40ca1f49c64d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.323918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18738f-ed38-4c42-9e7b-dcaa29c9fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.325077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18738f-ed38-4c42-9e7b-dcaa29c9fd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.325312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18738f-ed38-4c42-9e7b-dcaa29c9fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.325823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18738f-ed38-4c42-9e7b-dcaa29c9fd05 admin admin] PATH_INFO: `/v3/projects/b07d3ed53d944535894036dbfa11dd58/users/adde72d658d7450193ea70258415af7b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.348526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:23.354983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18738f-ed38-4c42-9e7b-dcaa29c9fd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07d3ed53d944535894036dbfa11dd58, user_id=adde72d658d7450193ea70258415af7b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.362101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18738f-ed38-4c42-9e7b-dcaa29c9fd05 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.368628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476bc8-204c-4432-ba7e-6eaa597eee60 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.370564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-95476bc8-204c-4432-ba7e-6eaa597eee60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:23.385650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476bc8-204c-4432-ba7e-6eaa597eee60 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.393089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:23.396979 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1042/2087] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:23 2022] PUT /identity/v3/projects/b07d3ed53d944535894036dbfa11dd58/users/adde72d658d7450193ea70258415af7b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:23.410828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021dd1d-8490-473d-830c-fcfc80f9e151 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.411119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021dd1d-8490-473d-830c-fcfc80f9e151 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.411389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021dd1d-8490-473d-830c-fcfc80f9e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.457347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c021dd1d-8490-473d-830c-fcfc80f9e151 None None] MFA Rules not processed for user `adde72d658d7450193ea70258415af7b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:23.458630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c021dd1d-8490-473d-830c-fcfc80f9e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:23.499629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.500715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.501555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.501941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] PATH_INFO: `/v3/projects/b36cff04ee694360bc060e0ea7f4ba20` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.503504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36cff04ee694360bc060e0ea7f4ba20)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.508606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.552515 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1043/2088] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:23.555577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021dd1d-8490-473d-830c-fcfc80f9e151 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.566668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c021dd1d-8490-473d-830c-fcfc80f9e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:23.587519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021dd1d-8490-473d-830c-fcfc80f9e151 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.614490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36cff04ee694360bc060e0ea7f4ba20', 'request_id': 'req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.635248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36cff04ee694360bc060e0ea7f4ba20', 'request_id': 'req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.650313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36cff04ee694360bc060e0ea7f4ba20', 'request_id': 'req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.668846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] The token cache is being invalidate because project b36cff04ee694360bc060e0ea7f4ba20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:23.669111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.669956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.670067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.670785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.671069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.671343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] PATH_INFO: `/v3/projects/cf5a5f0a0a7748b385887b8b3c71dfd4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.672444 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1046/2089] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:23 2022] DELETE /identity/v3/projects/b36cff04ee694360bc060e0ea7f4ba20 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:23.673620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5a5f0a0a7748b385887b8b3c71dfd4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.673839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.675620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.679109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:23.700082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c501ba4-2d70-4b41-a3e1-f71bcd1f8191 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.707631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca5b91-0f0e-4037-8090-a9d11f3fcb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.708780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca5b91-0f0e-4037-8090-a9d11f3fcb0e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.710416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca5b91-0f0e-4037-8090-a9d11f3fcb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.711215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca5b91-0f0e-4037-8090-a9d11f3fcb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.712285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca5b91-0f0e-4037-8090-a9d11f3fcb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.715304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca5b91-0f0e-4037-8090-a9d11f3fcb0e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.763384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5a5f0a0a7748b385887b8b3c71dfd4', 'request_id': 'req-87180a41-16d1-4995-8c98-7303542e83b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.777875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5a5f0a0a7748b385887b8b3c71dfd4', 'request_id': 'req-87180a41-16d1-4995-8c98-7303542e83b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.785649 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1047/2090] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:23 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:23.787084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca5b91-0f0e-4037-8090-a9d11f3fcb0e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.792051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-eaca5b91-0f0e-4037-8090-a9d11f3fcb0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:23.802089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5a5f0a0a7748b385887b8b3c71dfd4', 'request_id': 'req-87180a41-16d1-4995-8c98-7303542e83b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.830724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] The token cache is being invalidate because project cf5a5f0a0a7748b385887b8b3c71dfd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:23.831397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.832342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.840266 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1044/2091] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:23 2022] DELETE /identity/v3/projects/cf5a5f0a0a7748b385887b8b3c71dfd4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:23.840266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.840266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:23.856577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:23.885688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca5b91-0f0e-4037-8090-a9d11f3fcb0e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.891307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:23.892025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:23.892301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:23.892572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] PATH_INFO: `/v3/projects/e5b3f367eace4b61b8abf0b4bc377e3f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:23.893754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b3f367eace4b61b8abf0b4bc377e3f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:23.895674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:23.924666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:23.946481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87180a41-16d1-4995-8c98-7303542e83b5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:23.953986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b3f367eace4b61b8abf0b4bc377e3f', 'request_id': 'req-317e368a-6beb-4233-8c04-1b57ab060a3f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.960495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b3f367eace4b61b8abf0b4bc377e3f', 'request_id': 'req-317e368a-6beb-4233-8c04-1b57ab060a3f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.968778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b3f367eace4b61b8abf0b4bc377e3f', 'request_id': 'req-317e368a-6beb-4233-8c04-1b57ab060a3f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.981485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] The token cache is being invalidate because project e5b3f367eace4b61b8abf0b4bc377e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:23.981775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.982622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:23.984301 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1048/2092] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:23 2022] DELETE /identity/v3/projects/e5b3f367eace4b61b8abf0b4bc377e3f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:23.985091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:23.986573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:24.010009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd85bce-8dcc-48da-8ff3-e9659893dea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.010772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85bce-8dcc-48da-8ff3-e9659893dea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.011120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85bce-8dcc-48da-8ff3-e9659893dea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.011462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85bce-8dcc-48da-8ff3-e9659893dea5 admin admin] PATH_INFO: `/v3/users/da15b1fa3c964929808f783b89bffe3d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.012727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd85bce-8dcc-48da-8ff3-e9659893dea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da15b1fa3c964929808f783b89bffe3d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.014700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd85bce-8dcc-48da-8ff3-e9659893dea5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.065852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e368a-6beb-4233-8c04-1b57ab060a3f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.071399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea674fa-7fbe-422d-bb94-344b78101c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.071612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea674fa-7fbe-422d-bb94-344b78101c57 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.071807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea674fa-7fbe-422d-bb94-344b78101c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.072103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea674fa-7fbe-422d-bb94-344b78101c57 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.072718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea674fa-7fbe-422d-bb94-344b78101c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.074410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0cd85bce-8dcc-48da-8ff3-e9659893dea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da15b1fa3c964929808f783b89bffe3d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:24.074699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea674fa-7fbe-422d-bb94-344b78101c57 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.075489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0cd85bce-8dcc-48da-8ff3-e9659893dea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da15b1fa3c964929808f783b89bffe3d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:24.093068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0cd85bce-8dcc-48da-8ff3-e9659893dea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da15b1fa3c964929808f783b89bffe3d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:24.093983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0cd85bce-8dcc-48da-8ff3-e9659893dea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da15b1fa3c964929808f783b89bffe3d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:24.103790 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1049/2093] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:23 2022] POST /identity/v3/users => generated 307 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:24.104042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483dadb-1a14-4b17-a5d8-4a3e66b56d7e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.104331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483dadb-1a14-4b17-a5d8-4a3e66b56d7e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.104931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483dadb-1a14-4b17-a5d8-4a3e66b56d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.105431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0cd85bce-8dcc-48da-8ff3-e9659893dea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da15b1fa3c964929808f783b89bffe3d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:24.122543 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1045/2094] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:23 2022] DELETE /identity/v3/users/da15b1fa3c964929808f783b89bffe3d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:24.124061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb059f-7152-4c3a-aa6e-035580e96643 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.124412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb059f-7152-4c3a-aa6e-035580e96643 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.124752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb059f-7152-4c3a-aa6e-035580e96643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.131821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1483dadb-1a14-4b17-a5d8-4a3e66b56d7e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:24.133032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1483dadb-1a14-4b17-a5d8-4a3e66b56d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:24.148850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-08fb059f-7152-4c3a-aa6e-035580e96643 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:24.150231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-08fb059f-7152-4c3a-aa6e-035580e96643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:24.216267 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1050/2095] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:24.217590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483dadb-1a14-4b17-a5d8-4a3e66b56d7e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.219253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1483dadb-1a14-4b17-a5d8-4a3e66b56d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:24.233608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483dadb-1a14-4b17-a5d8-4a3e66b56d7e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.236251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:24.240731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0abf2-bbfb-424f-9337-5ce74b006fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.241012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0abf2-bbfb-424f-9337-5ce74b006fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.241308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0abf2-bbfb-424f-9337-5ce74b006fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.241854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0abf2-bbfb-424f-9337-5ce74b006fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.242803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0abf2-bbfb-424f-9337-5ce74b006fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.245605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0abf2-bbfb-424f-9337-5ce74b006fa0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.265577 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1051/2096] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:24.265577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f53cf-3fad-470a-8c0a-42bba62cd936 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.265577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f53cf-3fad-470a-8c0a-42bba62cd936 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.265577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f53cf-3fad-470a-8c0a-42bba62cd936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.300659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6b5f53cf-3fad-470a-8c0a-42bba62cd936 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:24.302157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6b5f53cf-3fad-470a-8c0a-42bba62cd936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:24.315043 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1052/2097] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:24.316116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f53cf-3fad-470a-8c0a-42bba62cd936 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.331983 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1046/2098] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:24.333305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f53cf-3fad-470a-8c0a-42bba62cd936 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.334695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb059f-7152-4c3a-aa6e-035580e96643 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.350082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb059f-7152-4c3a-aa6e-035580e96643 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.352023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417d661-befe-4689-b50d-7e3d5e40a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.353722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d661-befe-4689-b50d-7e3d5e40a451 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.353981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d661-befe-4689-b50d-7e3d5e40a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.354254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d661-befe-4689-b50d-7e3d5e40a451 admin admin] PATH_INFO: `/v3/projects/855cb3a6b214443aaa998c9b52a225c6/users/ebc22f4d52244ddd89f7a02a67f68a7f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.360294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069658a-1cd9-4264-8786-de959806445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.363428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069658a-1cd9-4264-8786-de959806445d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.365526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069658a-1cd9-4264-8786-de959806445d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.367463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069658a-1cd9-4264-8786-de959806445d admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.371967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069658a-1cd9-4264-8786-de959806445d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:24.372546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069658a-1cd9-4264-8786-de959806445d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.375412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069658a-1cd9-4264-8786-de959806445d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.401607 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1047/2099] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:24.401607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdd3e4-5350-410d-a4e6-88cacc93f983 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.401607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdd3e4-5350-410d-a4e6-88cacc93f983 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.401607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdd3e4-5350-410d-a4e6-88cacc93f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.411263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417d661-befe-4689-b50d-7e3d5e40a451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855cb3a6b214443aaa998c9b52a225c6, user_id=ebc22f4d52244ddd89f7a02a67f68a7f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.414425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417d661-befe-4689-b50d-7e3d5e40a451 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.422378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:24.442845 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1053/2100] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:24 2022] PUT /identity/v3/projects/855cb3a6b214443aaa998c9b52a225c6/users/ebc22f4d52244ddd89f7a02a67f68a7f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:24.448030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417d661-befe-4689-b50d-7e3d5e40a451 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.459359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ffbdd3e4-5350-410d-a4e6-88cacc93f983 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:24.460822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ffbdd3e4-5350-410d-a4e6-88cacc93f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:24.574574 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1048/2101] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:24.576168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdd3e4-5350-410d-a4e6-88cacc93f983 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.590002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdd3e4-5350-410d-a4e6-88cacc93f983 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.595774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c2afe-acb3-46e5-b12e-f400b52e06c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.596411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c2afe-acb3-46e5-b12e-f400b52e06c8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.596697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c2afe-acb3-46e5-b12e-f400b52e06c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.596974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c2afe-acb3-46e5-b12e-f400b52e06c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.598154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c2afe-acb3-46e5-b12e-f400b52e06c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.601825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c2afe-acb3-46e5-b12e-f400b52e06c8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.629602 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1049/2102] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:24.629602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c2afe-acb3-46e5-b12e-f400b52e06c8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.629910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417d661-befe-4689-b50d-7e3d5e40a451 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.641430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f02b5a-f7a5-416a-8565-2a426868b426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.641430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f02b5a-f7a5-416a-8565-2a426868b426 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.644520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f02b5a-f7a5-416a-8565-2a426868b426 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.645379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f02b5a-f7a5-416a-8565-2a426868b426 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.647890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f02b5a-f7a5-416a-8565-2a426868b426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.652032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c2afe-acb3-46e5-b12e-f400b52e06c8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.663623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f02b5a-f7a5-416a-8565-2a426868b426 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.663991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54acd5-dbb1-496d-8cee-497b9121ef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.664992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54acd5-dbb1-496d-8cee-497b9121ef4d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.665555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54acd5-dbb1-496d-8cee-497b9121ef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.666112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54acd5-dbb1-496d-8cee-497b9121ef4d admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.667040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54acd5-dbb1-496d-8cee-497b9121ef4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:24.667572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54acd5-dbb1-496d-8cee-497b9121ef4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.680300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54acd5-dbb1-496d-8cee-497b9121ef4d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.698904 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1050/2103] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:24.700400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54acd5-dbb1-496d-8cee-497b9121ef4d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.712671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54acd5-dbb1-496d-8cee-497b9121ef4d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.719597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd167a-1bfb-40b8-9b43-5c5a58622103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.720988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd167a-1bfb-40b8-9b43-5c5a58622103 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.720988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd167a-1bfb-40b8-9b43-5c5a58622103 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.721601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd167a-1bfb-40b8-9b43-5c5a58622103 admin admin] PATH_INFO: `/v3/projects/855cb3a6b214443aaa998c9b52a225c6/users/ebc22f4d52244ddd89f7a02a67f68a7f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.724342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd167a-1bfb-40b8-9b43-5c5a58622103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855cb3a6b214443aaa998c9b52a225c6, user_id=ebc22f4d52244ddd89f7a02a67f68a7f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.728784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd167a-1bfb-40b8-9b43-5c5a58622103 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.747184 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1054/2104] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:24 2022] POST /identity/v3/projects => generated 373 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:24.747870 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1051/2105] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:24 2022] PUT /identity/v3/projects/855cb3a6b214443aaa998c9b52a225c6/users/ebc22f4d52244ddd89f7a02a67f68a7f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:24.748691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd167a-1bfb-40b8-9b43-5c5a58622103 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.750689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5ccd167a-1bfb-40b8-9b43-5c5a58622103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:24.754931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f02b5a-f7a5-416a-8565-2a426868b426 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:24.869256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd167a-1bfb-40b8-9b43-5c5a58622103 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.896580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f02b5a-f7a5-416a-8565-2a426868b426 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:24.907444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728cbc7-6769-4a2f-8064-c48a1c76bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.909958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728cbc7-6769-4a2f-8064-c48a1c76bbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.910277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728cbc7-6769-4a2f-8064-c48a1c76bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.910590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728cbc7-6769-4a2f-8064-c48a1c76bbb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.912362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728cbc7-6769-4a2f-8064-c48a1c76bbb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:24.922063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728cbc7-6769-4a2f-8064-c48a1c76bbb9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:24.941033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:24.996910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:24.997711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:24.997990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:24.998266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] PATH_INFO: `/v3/projects/45e8b81073454cd6b86b9a76b44d2a59` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:24.999926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e8b81073454cd6b86b9a76b44d2a59)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:25.000406 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1055/2106] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:24 2022] POST /identity/v3/projects => generated 397 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:25.002394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728cbc7-6769-4a2f-8064-c48a1c76bbb9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:25.005120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:25.097187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e8b81073454cd6b86b9a76b44d2a59', 'request_id': 'req-59809e41-b6b7-442f-a980-c557e331c14d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:25.097903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728cbc7-6769-4a2f-8064-c48a1c76bbb9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:25.105474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e8b81073454cd6b86b9a76b44d2a59', 'request_id': 'req-59809e41-b6b7-442f-a980-c557e331c14d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:25.111032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:25.131513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e8b81073454cd6b86b9a76b44d2a59', 'request_id': 'req-59809e41-b6b7-442f-a980-c557e331c14d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:25.145738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] The token cache is being invalidate because project 45e8b81073454cd6b86b9a76b44d2a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:25.146127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:25.146731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-59809e41-b6b7-442f-a980-c557e331c14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:25.151699 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1052/2107] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:24 2022] DELETE /identity/v3/projects/45e8b81073454cd6b86b9a76b44d2a59 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:25.153199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f852-ad9f-49a6-a2e1-c00c4eed1bef None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.153535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f852-ad9f-49a6-a2e1-c00c4eed1bef None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.154142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f852-ad9f-49a6-a2e1-c00c4eed1bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.183278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5ebb7-a95e-4919-952a-35d43dabe17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:25.183912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5ebb7-a95e-4919-952a-35d43dabe17b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.184174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5ebb7-a95e-4919-952a-35d43dabe17b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.184285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9611f852-ad9f-49a6-a2e1-c00c4eed1bef None None] MFA Rules not processed for user `ebc22f4d52244ddd89f7a02a67f68a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:25.184446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5ebb7-a95e-4919-952a-35d43dabe17b admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.185103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5ebb7-a95e-4919-952a-35d43dabe17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:25.185715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9611f852-ad9f-49a6-a2e1-c00c4eed1bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.187077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5ebb7-a95e-4919-952a-35d43dabe17b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:25.214984 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1056/2108] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:25 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:25.218415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5ebb7-a95e-4919-952a-35d43dabe17b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:25.218415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0ed5ebb7-a95e-4919-952a-35d43dabe17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.231619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5ebb7-a95e-4919-952a-35d43dabe17b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:25.247160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:25.247973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.248494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.248758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] PATH_INFO: `/v3/users/e942e9d4535b4fcca9bed0231785b85d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.251336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e942e9d4535b4fcca9bed0231785b85d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:25.254387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:25.316235 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1053/2109] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:25 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:25.318109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611f852-ad9f-49a6-a2e1-c00c4eed1bef None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:25.319842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9611f852-ad9f-49a6-a2e1-c00c4eed1bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.349892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e942e9d4535b4fcca9bed0231785b85d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:25.351347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e942e9d4535b4fcca9bed0231785b85d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:25.360579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611f852-ad9f-49a6-a2e1-c00c4eed1bef None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:25.365994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546578c-01a0-435c-8690-9a877b11c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:25.367423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546578c-01a0-435c-8690-9a877b11c885 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.367423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546578c-01a0-435c-8690-9a877b11c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.367635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546578c-01a0-435c-8690-9a877b11c885 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.368311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546578c-01a0-435c-8690-9a877b11c885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:25.370951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546578c-01a0-435c-8690-9a877b11c885 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:25.379941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e942e9d4535b4fcca9bed0231785b85d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:25.406328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e942e9d4535b4fcca9bed0231785b85d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:25.413768 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1054/2110] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:25 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:25.416070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba0541-092c-49ad-869b-98319eb45ab2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.416488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba0541-092c-49ad-869b-98319eb45ab2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.416858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba0541-092c-49ad-869b-98319eb45ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.417602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e942e9d4535b4fcca9bed0231785b85d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:25.425651 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1057/2111] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:25 2022] DELETE /identity/v3/users/e942e9d4535b4fcca9bed0231785b85d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:25.430581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:25.435090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.472143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-39ba0541-092c-49ad-869b-98319eb45ab2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:25.473615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-39ba0541-092c-49ad-869b-98319eb45ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.507631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:25.543221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2c592-32f2-4bfb-8fbd-6547962847b5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:25.556690 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1055/2112] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:25.556690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba0541-092c-49ad-869b-98319eb45ab2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:25.556690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-39ba0541-092c-49ad-869b-98319eb45ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.559702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf5796-9f35-4c51-a0a3-a204b93878fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:25.560415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf5796-9f35-4c51-a0a3-a204b93878fd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.560785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf5796-9f35-4c51-a0a3-a204b93878fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.561119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf5796-9f35-4c51-a0a3-a204b93878fd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.561921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf5796-9f35-4c51-a0a3-a204b93878fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:25.564426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf5796-9f35-4c51-a0a3-a204b93878fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:25.577150 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1058/2113] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:25.581505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf5796-9f35-4c51-a0a3-a204b93878fd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:25.583396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-94bf5796-9f35-4c51-a0a3-a204b93878fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.600062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf5796-9f35-4c51-a0a3-a204b93878fd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:25.606557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca20a66-eceb-4813-b942-3271c7d43f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:25.607458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20a66-eceb-4813-b942-3271c7d43f35 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.607902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20a66-eceb-4813-b942-3271c7d43f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.608345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20a66-eceb-4813-b942-3271c7d43f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.609034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca20a66-eceb-4813-b942-3271c7d43f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:25.611381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca20a66-eceb-4813-b942-3271c7d43f35 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:25.628385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:25.648480 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1059/2114] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:25.650766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a663b-57c7-45d7-b657-a9d680cb0962 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.650766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a663b-57c7-45d7-b657-a9d680cb0962 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.650766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a663b-57c7-45d7-b657-a9d680cb0962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.674363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d00a663b-57c7-45d7-b657-a9d680cb0962 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:25.675783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d00a663b-57c7-45d7-b657-a9d680cb0962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.687640 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1060/2115] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:25.693831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a927b3-adfc-402e-bc6f-3910ba86540d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.694224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a927b3-adfc-402e-bc6f-3910ba86540d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.694508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a927b3-adfc-402e-bc6f-3910ba86540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.720694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba0541-092c-49ad-869b-98319eb45ab2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:25.722569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-75a927b3-adfc-402e-bc6f-3910ba86540d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:25.723861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-75a927b3-adfc-402e-bc6f-3910ba86540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.727552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec501be1-e3fd-495a-9e6d-1680f766fe5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:25.728368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec501be1-e3fd-495a-9e6d-1680f766fe5a service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.728479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec501be1-e3fd-495a-9e6d-1680f766fe5a service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.728700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec501be1-e3fd-495a-9e6d-1680f766fe5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.730807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ec501be1-e3fd-495a-9e6d-1680f766fe5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.735555 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1061/2116] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:25.736667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a927b3-adfc-402e-bc6f-3910ba86540d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:25.750028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a927b3-adfc-402e-bc6f-3910ba86540d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:25.756899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec4a5d-8393-494e-9b10-3ec0198bd95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:25.758086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec4a5d-8393-494e-9b10-3ec0198bd95e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.758538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec4a5d-8393-494e-9b10-3ec0198bd95e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.759105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec4a5d-8393-494e-9b10-3ec0198bd95e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.759963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec4a5d-8393-494e-9b10-3ec0198bd95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:25.761656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec4a5d-8393-494e-9b10-3ec0198bd95e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:25.780257 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1062/2117] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:25.780257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec4a5d-8393-494e-9b10-3ec0198bd95e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:25.792748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec4a5d-8393-494e-9b10-3ec0198bd95e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:25.798432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56f12b-654c-4a50-978a-4b624783a1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:25.799335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f12b-654c-4a50-978a-4b624783a1bc admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.799672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f12b-654c-4a50-978a-4b624783a1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.800021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f12b-654c-4a50-978a-4b624783a1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.800855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56f12b-654c-4a50-978a-4b624783a1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:25.802501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56f12b-654c-4a50-978a-4b624783a1bc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:25.821452 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1063/2118] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:25.826929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56f12b-654c-4a50-978a-4b624783a1bc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:25.826929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8c56f12b-654c-4a50-978a-4b624783a1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.828863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec501be1-e3fd-495a-9e6d-1680f766fe5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:25.830992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec501be1-e3fd-495a-9e6d-1680f766fe5a service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:25.841837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56f12b-654c-4a50-978a-4b624783a1bc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:25.843194 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1056/2119] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:25 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:25.845173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec501be1-e3fd-495a-9e6d-1680f766fe5a service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:25.846159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ec501be1-e3fd-495a-9e6d-1680f766fe5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:25.850323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:25.851316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.851751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.852220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] PATH_INFO: `/v3/users/6b0f2619a2234473bda588435455014e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:25.854030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0f2619a2234473bda588435455014e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:25.858053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:25.984371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec501be1-e3fd-495a-9e6d-1680f766fe5a service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:25.990254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d020b5-3c9b-4e07-a8bd-b0bbbf9f6011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:25.990887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d020b5-3c9b-4e07-a8bd-b0bbbf9f6011 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:25.993251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d020b5-3c9b-4e07-a8bd-b0bbbf9f6011 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:25.993251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d020b5-3c9b-4e07-a8bd-b0bbbf9f6011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:26.006705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d020b5-3c9b-4e07-a8bd-b0bbbf9f6011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:26.008178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d020b5-3c9b-4e07-a8bd-b0bbbf9f6011 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:26.019745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0f2619a2234473bda588435455014e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:26.022017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0f2619a2234473bda588435455014e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:26.024614 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1057/2120] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:26.025711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d020b5-3c9b-4e07-a8bd-b0bbbf9f6011 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:26.036796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d020b5-3c9b-4e07-a8bd-b0bbbf9f6011 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:26.042765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee1399-ec8c-4320-bb7d-bbcb5bfefba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:26.043399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee1399-ec8c-4320-bb7d-bbcb5bfefba8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:26.043677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee1399-ec8c-4320-bb7d-bbcb5bfefba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:26.043945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee1399-ec8c-4320-bb7d-bbcb5bfefba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:26.044711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee1399-ec8c-4320-bb7d-bbcb5bfefba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:26.045133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee1399-ec8c-4320-bb7d-bbcb5bfefba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:26.047193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee1399-ec8c-4320-bb7d-bbcb5bfefba8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:26.049688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:26.066619 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1058/2121] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:26.066951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee1399-ec8c-4320-bb7d-bbcb5bfefba8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:26.086875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee1399-ec8c-4320-bb7d-bbcb5bfefba8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:26.093408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7909017-9c8c-4777-8903-72d248cdea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:26.094306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7909017-9c8c-4777-8903-72d248cdea12 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:26.094743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7909017-9c8c-4777-8903-72d248cdea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:26.095500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7909017-9c8c-4777-8903-72d248cdea12 admin admin] PATH_INFO: `/v3/projects/9165cdc861b94445bfa9d491e4ebc85c/users/ec17d316bce743b6bff066bd3b3134da/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:26.103975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0f2619a2234473bda588435455014e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:26.115128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7909017-9c8c-4777-8903-72d248cdea12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9165cdc861b94445bfa9d491e4ebc85c, user_id=ec17d316bce743b6bff066bd3b3134da, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:26.117345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0f2619a2234473bda588435455014e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:26.118199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7909017-9c8c-4777-8903-72d248cdea12 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:26.146532 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1059/2122] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:26 2022] PUT /identity/v3/projects/9165cdc861b94445bfa9d491e4ebc85c/users/ec17d316bce743b6bff066bd3b3134da/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:26.147835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7909017-9c8c-4777-8903-72d248cdea12 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:26.172321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0f2619a2234473bda588435455014e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:26.218378 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1064/2123] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:25 2022] DELETE /identity/v3/users/6b0f2619a2234473bda588435455014e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:26.220063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:26.224351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:26.262489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7909017-9c8c-4777-8903-72d248cdea12 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:26.381538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc09dd-2122-44c6-b346-2451a4a3255f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:26.391311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc05bd-fe72-47f9-90ed-02edd139a46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:26.392452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc05bd-fe72-47f9-90ed-02edd139a46e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:26.392885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc05bd-fe72-47f9-90ed-02edd139a46e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:26.393276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc05bd-fe72-47f9-90ed-02edd139a46e admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:26.394093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc05bd-fe72-47f9-90ed-02edd139a46e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:26.398883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc05bd-fe72-47f9-90ed-02edd139a46e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:26.465605 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1065/2124] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:26 2022] POST /identity/v3/projects => generated 395 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:26.467193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743d4ea-8b0c-45c4-adf5-71dea3bbe675 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:26.467587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743d4ea-8b0c-45c4-adf5-71dea3bbe675 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:26.468023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743d4ea-8b0c-45c4-adf5-71dea3bbe675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:26.540968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1743d4ea-8b0c-45c4-adf5-71dea3bbe675 None None] MFA Rules not processed for user `ec17d316bce743b6bff066bd3b3134da`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:26.541366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04f46b-4772-42d0-8e61-825b9954207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:26.542541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04f46b-4772-42d0-8e61-825b9954207b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:26.542921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04f46b-4772-42d0-8e61-825b9954207b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:26.543447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04f46b-4772-42d0-8e61-825b9954207b admin admin] PATH_INFO: `/v3/projects/0cf3b494c9d84687b66c817df0fb173d/users/fb70ae8b6c474cc28d74839927ec72f3/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:26.544559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1743d4ea-8b0c-45c4-adf5-71dea3bbe675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:26.569690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:26.593987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04f46b-4772-42d0-8e61-825b9954207b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf3b494c9d84687b66c817df0fb173d, user_id=fb70ae8b6c474cc28d74839927ec72f3, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:26.600492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04f46b-4772-42d0-8e61-825b9954207b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:26.647385 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1060/2125] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:26 2022] PUT /identity/v3/projects/0cf3b494c9d84687b66c817df0fb173d/users/fb70ae8b6c474cc28d74839927ec72f3/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:26.667394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151b9f-ad34-4e23-90ad-1010c7ae6e1c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:26.668036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151b9f-ad34-4e23-90ad-1010c7ae6e1c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:26.668547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df151b9f-ad34-4e23-90ad-1010c7ae6e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:26.718698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-df151b9f-ad34-4e23-90ad-1010c7ae6e1c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:26.722415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-df151b9f-ad34-4e23-90ad-1010c7ae6e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:26.727397 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1066/2126] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:26.732452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743d4ea-8b0c-45c4-adf5-71dea3bbe675 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:26.853079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743d4ea-8b0c-45c4-adf5-71dea3bbe675 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:26.899177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:26.926876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1061/2127] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:26.933500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fa3c1-8a5a-4124-89dc-fdc3ddf8f5ba None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:26.933971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fa3c1-8a5a-4124-89dc-fdc3ddf8f5ba None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:26.934445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fa3c1-8a5a-4124-89dc-fdc3ddf8f5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:26.956209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ec963-8d91-4b87-ae29-ffa356c0ff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:26.956794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ec963-8d91-4b87-ae29-ffa356c0ff60 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:26.957071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ec963-8d91-4b87-ae29-ffa356c0ff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:26.957348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ec963-8d91-4b87-ae29-ffa356c0ff60 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:26.958393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ec963-8d91-4b87-ae29-ffa356c0ff60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:26.959982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ec963-8d91-4b87-ae29-ffa356c0ff60 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:26.987286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-859fa3c1-8a5a-4124-89dc-fdc3ddf8f5ba None None] MFA Rules not processed for user `fb70ae8b6c474cc28d74839927ec72f3`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:26.988608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-859fa3c1-8a5a-4124-89dc-fdc3ddf8f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:26.993365 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1067/2128] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:26 2022] POST /identity/v3/users => generated 298 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:26.993365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ec963-8d91-4b87-ae29-ffa356c0ff60 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:26.993365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b92ec963-8d91-4b87-ae29-ffa356c0ff60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.008803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ec963-8d91-4b87-ae29-ffa356c0ff60 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.017738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.018494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.018773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.019052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] PATH_INFO: `/v3/projects/ace96a45a2344919b9835774836180a6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.020436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace96a45a2344919b9835774836180a6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.022584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.102527 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1062/2129] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:27.103339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fa3c1-8a5a-4124-89dc-fdc3ddf8f5ba None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.104956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-859fa3c1-8a5a-4124-89dc-fdc3ddf8f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.122435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:27.127746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace96a45a2344919b9835774836180a6', 'request_id': 'req-a1a757ca-1cf7-4bd4-8c88-334393fb429a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.139591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fa3c1-8a5a-4124-89dc-fdc3ddf8f5ba None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.139841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace96a45a2344919b9835774836180a6', 'request_id': 'req-a1a757ca-1cf7-4bd4-8c88-334393fb429a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.154947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace96a45a2344919b9835774836180a6', 'request_id': 'req-a1a757ca-1cf7-4bd4-8c88-334393fb429a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.177327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] The token cache is being invalidate because project ace96a45a2344919b9835774836180a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:27.177790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.179250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.183045 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1068/2130] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:26 2022] DELETE /identity/v3/projects/ace96a45a2344919b9835774836180a6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:27.184194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.189308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.246729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19c985-28d5-455f-9380-c8b3d8aafd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.247367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19c985-28d5-455f-9380-c8b3d8aafd56 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.247649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19c985-28d5-455f-9380-c8b3d8aafd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.247918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19c985-28d5-455f-9380-c8b3d8aafd56 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.248686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19c985-28d5-455f-9380-c8b3d8aafd56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.251378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19c985-28d5-455f-9380-c8b3d8aafd56 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.307816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a757ca-1cf7-4bd4-8c88-334393fb429a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.308108 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1063/2131] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:27 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:27.308823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19c985-28d5-455f-9380-c8b3d8aafd56 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.310876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-aa19c985-28d5-455f-9380-c8b3d8aafd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.386606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19c985-28d5-455f-9380-c8b3d8aafd56 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.390926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b23c-154b-4c06-98f2-ab8b0d8f8b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.391640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b23c-154b-4c06-98f2-ab8b0d8f8b81 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.391930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b23c-154b-4c06-98f2-ab8b0d8f8b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.392209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b23c-154b-4c06-98f2-ab8b0d8f8b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.394290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6304b23c-154b-4c06-98f2-ab8b0d8f8b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.395537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed881509-e102-433b-a20a-a8e017312320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.395877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed881509-e102-433b-a20a-a8e017312320 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.396155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed881509-e102-433b-a20a-a8e017312320 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.396429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed881509-e102-433b-a20a-a8e017312320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.398918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ed881509-e102-433b-a20a-a8e017312320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.445187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:27.481504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed881509-e102-433b-a20a-a8e017312320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.483217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed881509-e102-433b-a20a-a8e017312320 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.497231 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1069/2132] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:27 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:27.501461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed881509-e102-433b-a20a-a8e017312320 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.503169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ed881509-e102-433b-a20a-a8e017312320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.509637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304b23c-154b-4c06-98f2-ab8b0d8f8b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.517168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304b23c-154b-4c06-98f2-ab8b0d8f8b81 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.530285 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1064/2133] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:27.531093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b23c-154b-4c06-98f2-ab8b0d8f8b81 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.532751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6304b23c-154b-4c06-98f2-ab8b0d8f8b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.538842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed881509-e102-433b-a20a-a8e017312320 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.545971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415cb60-5ffc-4865-8f3a-9255d51801de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.546716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415cb60-5ffc-4865-8f3a-9255d51801de admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.547237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415cb60-5ffc-4865-8f3a-9255d51801de admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.547630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415cb60-5ffc-4865-8f3a-9255d51801de admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.549226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415cb60-5ffc-4865-8f3a-9255d51801de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.551823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415cb60-5ffc-4865-8f3a-9255d51801de admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.554032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:27.559770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b23c-154b-4c06-98f2-ab8b0d8f8b81 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.570051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072028aa-f2ab-4a74-a13f-ebbc023eac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.571106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072028aa-f2ab-4a74-a13f-ebbc023eac37 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.571362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072028aa-f2ab-4a74-a13f-ebbc023eac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.571782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072028aa-f2ab-4a74-a13f-ebbc023eac37 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.572257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072028aa-f2ab-4a74-a13f-ebbc023eac37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.574275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072028aa-f2ab-4a74-a13f-ebbc023eac37 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.586078 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1070/2134] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:27.587195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415cb60-5ffc-4865-8f3a-9255d51801de admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.593169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e415cb60-5ffc-4865-8f3a-9255d51801de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.621503 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1065/2135] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:27 2022] POST /identity/v3/projects => generated 395 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:27.623637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072028aa-f2ab-4a74-a13f-ebbc023eac37 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.626571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415cb60-5ffc-4865-8f3a-9255d51801de admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.627817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-072028aa-f2ab-4a74-a13f-ebbc023eac37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.733247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.734220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.734868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.736432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] PATH_INFO: `/v3/users/83f405bef06d470d9d54f418468533e1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.741864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f405bef06d470d9d54f418468533e1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.744837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.761896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072028aa-f2ab-4a74-a13f-ebbc023eac37 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.767196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cf751-d026-438b-8e93-633f5a910538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.767816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cf751-d026-438b-8e93-633f5a910538 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.768094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cf751-d026-438b-8e93-633f5a910538 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.768365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cf751-d026-438b-8e93-633f5a910538 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.769171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cf751-d026-438b-8e93-633f5a910538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.771410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cf751-d026-438b-8e93-633f5a910538 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.805008 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1066/2136] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:27 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:27.806073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cf751-d026-438b-8e93-633f5a910538 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.807751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4f6cf751-d026-438b-8e93-633f5a910538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.831675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cf751-d026-438b-8e93-633f5a910538 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:27.840566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f405bef06d470d9d54f418468533e1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.840808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:27.841237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:27.841561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:27.841839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] PATH_INFO: `/v3/users/adde72d658d7450193ea70258415af7b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:27.842872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f405bef06d470d9d54f418468533e1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.844217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adde72d658d7450193ea70258415af7b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:27.847887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:27.895592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f405bef06d470d9d54f418468533e1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.909940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f405bef06d470d9d54f418468533e1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.925627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f405bef06d470d9d54f418468533e1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.942518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adde72d658d7450193ea70258415af7b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.943354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adde72d658d7450193ea70258415af7b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.959305 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1071/2137] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:27 2022] DELETE /identity/v3/users/83f405bef06d470d9d54f418468533e1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:27.961572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:27.963821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:27.981482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adde72d658d7450193ea70258415af7b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:27.983869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adde72d658d7450193ea70258415af7b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:28.011996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adde72d658d7450193ea70258415af7b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:28.044159 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1067/2138] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:27 2022] DELETE /identity/v3/users/adde72d658d7450193ea70258415af7b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:28.044704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:28.046371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:28.067786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:28.109921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99edcb7-2029-499d-a5ac-6d7b9505d77c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:28.141276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:28.211376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6e23b-ee0f-4ff2-b42f-5b6a6f8d6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:28.211933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e23b-ee0f-4ff2-b42f-5b6a6f8d6661 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.212115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e23b-ee0f-4ff2-b42f-5b6a6f8d6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.212461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e23b-ee0f-4ff2-b42f-5b6a6f8d6661 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.213041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6e23b-ee0f-4ff2-b42f-5b6a6f8d6661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:28.225779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38cfaa-72c0-4ca7-aeb9-7d5f90964359 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:28.235025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6e23b-ee0f-4ff2-b42f-5b6a6f8d6661 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:28.236128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebe2ec-4397-4d2d-8c51-37c1e86d5557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:28.236944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe2ec-4397-4d2d-8c51-37c1e86d5557 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.237535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe2ec-4397-4d2d-8c51-37c1e86d5557 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.237871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe2ec-4397-4d2d-8c51-37c1e86d5557 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.239248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebe2ec-4397-4d2d-8c51-37c1e86d5557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:28.242581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebe2ec-4397-4d2d-8c51-37c1e86d5557 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:28.264741 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1072/2139] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:28.265695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6e23b-ee0f-4ff2-b42f-5b6a6f8d6661 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:28.270268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e7c6e23b-ee0f-4ff2-b42f-5b6a6f8d6661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:28.283720 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1068/2140] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:28 2022] POST /identity/v3/users => generated 304 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:28.286332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e2064-8f37-411d-ad2b-5c73711208b5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.286628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e2064-8f37-411d-ad2b-5c73711208b5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.290023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e2064-8f37-411d-ad2b-5c73711208b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.294964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6e23b-ee0f-4ff2-b42f-5b6a6f8d6661 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:28.310760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a5060-7fe3-44d2-90fd-53725aa7ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:28.311396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a5060-7fe3-44d2-90fd-53725aa7ff3f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.311801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a5060-7fe3-44d2-90fd-53725aa7ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.312099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a5060-7fe3-44d2-90fd-53725aa7ff3f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.312919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a5060-7fe3-44d2-90fd-53725aa7ff3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:28.315260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a5060-7fe3-44d2-90fd-53725aa7ff3f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:28.322629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4c5e2064-8f37-411d-ad2b-5c73711208b5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:28.324050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4c5e2064-8f37-411d-ad2b-5c73711208b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:28.348451 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1069/2141] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:28.349482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e2064-8f37-411d-ad2b-5c73711208b5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:28.353034 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1073/2142] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:28.354258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a5060-7fe3-44d2-90fd-53725aa7ff3f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:28.356270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a19a5060-7fe3-44d2-90fd-53725aa7ff3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:28.357603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4c5e2064-8f37-411d-ad2b-5c73711208b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:28.371826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a5060-7fe3-44d2-90fd-53725aa7ff3f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:28.377153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:28.377947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.378227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.378590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] PATH_INFO: `/v3/projects/3022eb88dd4547738f95767a2bff60c8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.379815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3022eb88dd4547738f95767a2bff60c8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:28.382065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:28.385727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e2064-8f37-411d-ad2b-5c73711208b5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:28.395498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948fc52-af5e-4a45-8c32-575c8e4c6c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:28.396104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948fc52-af5e-4a45-8c32-575c8e4c6c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.396510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948fc52-af5e-4a45-8c32-575c8e4c6c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.396828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948fc52-af5e-4a45-8c32-575c8e4c6c67 admin admin] PATH_INFO: `/v3/projects/8c8b592ba7bb42b0b875db6065b0929c/users/b15e02211d3e4253a2edba6e63425ca7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.424994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948fc52-af5e-4a45-8c32-575c8e4c6c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8b592ba7bb42b0b875db6065b0929c, user_id=b15e02211d3e4253a2edba6e63425ca7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:28.428054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948fc52-af5e-4a45-8c32-575c8e4c6c67 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:28.447682 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1070/2143] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:28 2022] PUT /identity/v3/projects/8c8b592ba7bb42b0b875db6065b0929c/users/b15e02211d3e4253a2edba6e63425ca7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:28.449017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948fc52-af5e-4a45-8c32-575c8e4c6c67 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:28.467657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3022eb88dd4547738f95767a2bff60c8', 'request_id': 'req-83d6e357-4cb8-480c-b998-e063bad42fdc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:28.481203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3022eb88dd4547738f95767a2bff60c8', 'request_id': 'req-83d6e357-4cb8-480c-b998-e063bad42fdc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:28.493094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3022eb88dd4547738f95767a2bff60c8', 'request_id': 'req-83d6e357-4cb8-480c-b998-e063bad42fdc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:28.508267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] The token cache is being invalidate because project 3022eb88dd4547738f95767a2bff60c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:28.508642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:28.509501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:28.511478 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1074/2144] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:28 2022] DELETE /identity/v3/projects/3022eb88dd4547738f95767a2bff60c8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:28.512442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:28.514219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:28.573287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948fc52-af5e-4a45-8c32-575c8e4c6c67 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:28.579566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcfe1d-a573-48b1-afde-616df1a4177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:28.580183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcfe1d-a573-48b1-afde-616df1a4177e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.580456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcfe1d-a573-48b1-afde-616df1a4177e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.580725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcfe1d-a573-48b1-afde-616df1a4177e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.581448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcfe1d-a573-48b1-afde-616df1a4177e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:28.583051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcfe1d-a573-48b1-afde-616df1a4177e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:28.586535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e357-4cb8-480c-b998-e063bad42fdc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:28.597870 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1071/2145] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:28.597870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcfe1d-a573-48b1-afde-616df1a4177e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:28.600867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a5bcfe1d-a573-48b1-afde-616df1a4177e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:28.624195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcfe1d-a573-48b1-afde-616df1a4177e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:28.635746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6f89f-bd7e-465b-809d-04ffcb8b44c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:28.637070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6f89f-bd7e-465b-809d-04ffcb8b44c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.637751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6f89f-bd7e-465b-809d-04ffcb8b44c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.638342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6f89f-bd7e-465b-809d-04ffcb8b44c9 admin admin] PATH_INFO: `/v3/projects/f566e934ade44c1bbdd35f7697692a4e/users/ac53d9f1203a42e6ab38f2ef0816aeb8/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.644958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:28.654737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803d78b-42d6-4728-af0c-0073b9510680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:28.655953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803d78b-42d6-4728-af0c-0073b9510680 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.656733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803d78b-42d6-4728-af0c-0073b9510680 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.657567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803d78b-42d6-4728-af0c-0073b9510680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.662123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8803d78b-42d6-4728-af0c-0073b9510680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:28.663940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6f89f-bd7e-465b-809d-04ffcb8b44c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f566e934ade44c1bbdd35f7697692a4e, user_id=ac53d9f1203a42e6ab38f2ef0816aeb8, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:28.667988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6f89f-bd7e-465b-809d-04ffcb8b44c9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:28.683755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803d78b-42d6-4728-af0c-0073b9510680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:28.686598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803d78b-42d6-4728-af0c-0073b9510680 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:28.702380 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1072/2146] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:28 2022] PUT /identity/v3/projects/f566e934ade44c1bbdd35f7697692a4e/users/ac53d9f1203a42e6ab38f2ef0816aeb8/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:28.704076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff6682-66f5-4778-9456-581d7af45496 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.704892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff6682-66f5-4778-9456-581d7af45496 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.705254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff6682-66f5-4778-9456-581d7af45496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.709645 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1075/2147] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:28.711077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803d78b-42d6-4728-af0c-0073b9510680 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:28.712898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8803d78b-42d6-4728-af0c-0073b9510680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:28.742768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803d78b-42d6-4728-af0c-0073b9510680 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:28.758393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-adff6682-66f5-4778-9456-581d7af45496 None None] MFA Rules not processed for user `b15e02211d3e4253a2edba6e63425ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:28.759613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-adff6682-66f5-4778-9456-581d7af45496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:28.816787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:28.884150 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1073/2148] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:28.885293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff6682-66f5-4778-9456-581d7af45496 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:28.890782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-adff6682-66f5-4778-9456-581d7af45496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:28.896455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:28.897799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.898384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.898668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] PATH_INFO: `/v3/projects/a49179a5bfaf498992ecd4e84c381022` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.899949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49179a5bfaf498992ecd4e84c381022)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:28.902263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:28.913679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff6682-66f5-4778-9456-581d7af45496 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:28.921370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:28.922209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:28.922510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:28.922864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] PATH_INFO: `/v3/users/8a914afbd07f466bba39dd15caeabf7e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:28.924237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a914afbd07f466bba39dd15caeabf7e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:28.926584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:29.020704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a914afbd07f466bba39dd15caeabf7e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.021178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a914afbd07f466bba39dd15caeabf7e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.041175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a914afbd07f466bba39dd15caeabf7e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.041175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a914afbd07f466bba39dd15caeabf7e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.042749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49179a5bfaf498992ecd4e84c381022', 'request_id': 'req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.049787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a914afbd07f466bba39dd15caeabf7e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.056272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49179a5bfaf498992ecd4e84c381022', 'request_id': 'req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.065497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49179a5bfaf498992ecd4e84c381022', 'request_id': 'req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.067378 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1074/2149] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:28 2022] DELETE /identity/v3/users/8a914afbd07f466bba39dd15caeabf7e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:29.072908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:29.073767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.080183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] The token cache is being invalidate because project a49179a5bfaf498992ecd4e84c381022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:29.080473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.081885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.083967 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1076/2150] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:28 2022] DELETE /identity/v3/projects/a49179a5bfaf498992ecd4e84c381022 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:29.084796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:29.086442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.187368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5111c-c0af-425a-822e-7604a8bc0448 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:29.209203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1998d-849a-4806-9823-970ef9359b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:29.209203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1998d-849a-4806-9823-970ef9359b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.209203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1998d-849a-4806-9823-970ef9359b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.209900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1998d-849a-4806-9823-970ef9359b81 admin admin] PATH_INFO: `/v3/projects/130f7d379e424f3c94400d03f12f11f9/users/5fb88976339a4a6b970c404a985817d9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.219549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834d1b5-e41f-4b5a-94c9-6b7ec1276ad4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:29.227616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a28139-da92-4f13-84fc-72072fb4803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:29.228468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a28139-da92-4f13-84fc-72072fb4803d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.228957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a28139-da92-4f13-84fc-72072fb4803d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.229301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a28139-da92-4f13-84fc-72072fb4803d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.230656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a28139-da92-4f13-84fc-72072fb4803d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:29.233172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a28139-da92-4f13-84fc-72072fb4803d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:29.238839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1998d-849a-4806-9823-970ef9359b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130f7d379e424f3c94400d03f12f11f9, user_id=5fb88976339a4a6b970c404a985817d9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:29.241842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1998d-849a-4806-9823-970ef9359b81 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:29.248863 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1077/2151] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:29.250371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a28139-da92-4f13-84fc-72072fb4803d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:29.255568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e1a28139-da92-4f13-84fc-72072fb4803d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.265360 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1075/2152] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:29 2022] PUT /identity/v3/projects/130f7d379e424f3c94400d03f12f11f9/users/5fb88976339a4a6b970c404a985817d9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:29.265360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1998d-849a-4806-9823-970ef9359b81 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:29.266300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-01e1998d-849a-4806-9823-970ef9359b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.282859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a28139-da92-4f13-84fc-72072fb4803d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:29.298364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:29.299463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:29.363030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0979c24-1050-485b-bc2e-19052d60872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:29.363805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0979c24-1050-485b-bc2e-19052d60872f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.364303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0979c24-1050-485b-bc2e-19052d60872f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.364662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0979c24-1050-485b-bc2e-19052d60872f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.365529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0979c24-1050-485b-bc2e-19052d60872f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:29.367861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0979c24-1050-485b-bc2e-19052d60872f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:29.406433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1998d-849a-4806-9823-970ef9359b81 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:29.416634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:29.417977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.418126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.418558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] PATH_INFO: `/v3/users/99004756e4fe4720b121bd4b03949f35` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.421509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99004756e4fe4720b121bd4b03949f35)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:29.426325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:29.430102 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1078/2153] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:29 2022] POST /identity/v3/projects => generated 395 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:29.433658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10294ebe-b346-46ad-acb6-0875d39593d5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.434443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10294ebe-b346-46ad-acb6-0875d39593d5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.434737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10294ebe-b346-46ad-acb6-0875d39593d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.465954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-10294ebe-b346-46ad-acb6-0875d39593d5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:29.467327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-10294ebe-b346-46ad-acb6-0875d39593d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.568662 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1079/2154] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:29.570284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10294ebe-b346-46ad-acb6-0875d39593d5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:29.572619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-10294ebe-b346-46ad-acb6-0875d39593d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.578408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99004756e4fe4720b121bd4b03949f35'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.580350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99004756e4fe4720b121bd4b03949f35'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.596639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99004756e4fe4720b121bd4b03949f35'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.597747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99004756e4fe4720b121bd4b03949f35'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.598623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10294ebe-b346-46ad-acb6-0875d39593d5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:29.605425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:29.606316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.606788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.607189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] PATH_INFO: `/v3/projects/b07d3ed53d944535894036dbfa11dd58` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.608196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99004756e4fe4720b121bd4b03949f35'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.609098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07d3ed53d944535894036dbfa11dd58)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:29.613088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:29.629949 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1076/2155] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:29 2022] DELETE /identity/v3/users/99004756e4fe4720b121bd4b03949f35 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:29.633444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:29.635358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.694025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07d3ed53d944535894036dbfa11dd58', 'request_id': 'req-801f3afc-0fef-498d-9b6b-7e81b7995dde'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.703984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07d3ed53d944535894036dbfa11dd58', 'request_id': 'req-801f3afc-0fef-498d-9b6b-7e81b7995dde'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.714199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e493be-8eac-4892-b0e3-eb7508d97f30 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:29.717482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07d3ed53d944535894036dbfa11dd58', 'request_id': 'req-801f3afc-0fef-498d-9b6b-7e81b7995dde'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.736426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] The token cache is being invalidate because project b07d3ed53d944535894036dbfa11dd58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:29.736905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.737931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:29.740912 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1080/2156] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:29 2022] DELETE /identity/v3/projects/b07d3ed53d944535894036dbfa11dd58 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:29.745923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:29.747691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.785533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:29.788169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:29.807230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab047-efdc-46d3-b558-8431db3e0275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:29.808064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab047-efdc-46d3-b558-8431db3e0275 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.808511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab047-efdc-46d3-b558-8431db3e0275 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.808511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab047-efdc-46d3-b558-8431db3e0275 admin admin] PATH_INFO: `/v3/projects/f566e934ade44c1bbdd35f7697692a4e/users/ac53d9f1203a42e6ab38f2ef0816aeb8/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.810901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dab047-efdc-46d3-b558-8431db3e0275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f566e934ade44c1bbdd35f7697692a4e, user_id=ac53d9f1203a42e6ab38f2ef0816aeb8, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:29.814350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dab047-efdc-46d3-b558-8431db3e0275 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:29.827967 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1077/2157] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:29 2022] PUT /identity/v3/projects/f566e934ade44c1bbdd35f7697692a4e/users/ac53d9f1203a42e6ab38f2ef0816aeb8/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:29.829406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab047-efdc-46d3-b558-8431db3e0275 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:29.831367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-92dab047-efdc-46d3-b558-8431db3e0275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.853037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f3afc-0fef-498d-9b6b-7e81b7995dde admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:29.909674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab047-efdc-46d3-b558-8431db3e0275 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:29.915224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8381aa2-b5ab-44a8-9d66-2c1a1c2cf070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:29.916061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381aa2-b5ab-44a8-9d66-2c1a1c2cf070 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.916423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381aa2-b5ab-44a8-9d66-2c1a1c2cf070 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.916747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381aa2-b5ab-44a8-9d66-2c1a1c2cf070 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.917719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8381aa2-b5ab-44a8-9d66-2c1a1c2cf070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:29.918140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544d418-b3f5-4c65-bebe-5caaac139185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:29.918888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544d418-b3f5-4c65-bebe-5caaac139185 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.919267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544d418-b3f5-4c65-bebe-5caaac139185 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.919551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544d418-b3f5-4c65-bebe-5caaac139185 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.919976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8381aa2-b5ab-44a8-9d66-2c1a1c2cf070 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:29.920312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544d418-b3f5-4c65-bebe-5caaac139185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:29.922144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544d418-b3f5-4c65-bebe-5caaac139185 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:29.933835 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1081/2158] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:29.935440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79656bc1-f824-44fb-8d64-04b83e741d7e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.935804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79656bc1-f824-44fb-8d64-04b83e741d7e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.936161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79656bc1-f824-44fb-8d64-04b83e741d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.948973 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1078/2159] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:29 2022] POST /identity/v3/users => generated 304 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:29.949825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8381aa2-b5ab-44a8-9d66-2c1a1c2cf070 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:29.951648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b8381aa2-b5ab-44a8-9d66-2c1a1c2cf070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.958534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-79656bc1-f824-44fb-8d64-04b83e741d7e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:29.959755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-79656bc1-f824-44fb-8d64-04b83e741d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:29.966123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8381aa2-b5ab-44a8-9d66-2c1a1c2cf070 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:29.968419 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1082/2160] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:29.969290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664805-beb8-4146-ae02-1e9fe637d7f3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.970206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664805-beb8-4146-ae02-1e9fe637d7f3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.970477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664805-beb8-4146-ae02-1e9fe637d7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.974049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:29.974867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:29.975154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:29.975456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] PATH_INFO: `/v3/projects/cee3fc2e109248a6877f53eb1dd50efb` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:29.977050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee3fc2e109248a6877f53eb1dd50efb)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:29.979002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:29.992434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-08664805-beb8-4146-ae02-1e9fe637d7f3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:29.993678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-08664805-beb8-4146-ae02-1e9fe637d7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.002206 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1083/2161] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:30.005819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664805-beb8-4146-ae02-1e9fe637d7f3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:30.005819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-08664805-beb8-4146-ae02-1e9fe637d7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.022913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664805-beb8-4146-ae02-1e9fe637d7f3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:30.033271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee3fc2e109248a6877f53eb1dd50efb', 'request_id': 'req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.039575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee3fc2e109248a6877f53eb1dd50efb', 'request_id': 'req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.049188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee3fc2e109248a6877f53eb1dd50efb', 'request_id': 'req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.063437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] The token cache is being invalidate because project cee3fc2e109248a6877f53eb1dd50efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:30.063730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.064421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-001ede49-a7d7-4f6c-b9ca-3ea59c1bebfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.066908 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1079/2162] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:29 2022] DELETE /identity/v3/projects/cee3fc2e109248a6877f53eb1dd50efb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:30.071527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803fc2-bc86-4951-8842-94d244cff6e7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.071527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803fc2-bc86-4951-8842-94d244cff6e7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.071527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803fc2-bc86-4951-8842-94d244cff6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.085250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:30.085933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.086216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.086492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] PATH_INFO: `/v3/users/ebc22f4d52244ddd89f7a02a67f68a7f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.088040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc22f4d52244ddd89f7a02a67f68a7f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:30.090176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:30.102256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2e803fc2-bc86-4951-8842-94d244cff6e7 None None] MFA Rules not processed for user `ac53d9f1203a42e6ab38f2ef0816aeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:30.103480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2e803fc2-bc86-4951-8842-94d244cff6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.144701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc22f4d52244ddd89f7a02a67f68a7f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.145428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc22f4d52244ddd89f7a02a67f68a7f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.151389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:30.154355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:30.163151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc22f4d52244ddd89f7a02a67f68a7f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.172582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc22f4d52244ddd89f7a02a67f68a7f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.180813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc22f4d52244ddd89f7a02a67f68a7f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.185947 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1080/2163] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:30.186837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e803fc2-bc86-4951-8842-94d244cff6e7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:30.188383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2e803fc2-bc86-4951-8842-94d244cff6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.192960 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1084/2164] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:30 2022] DELETE /identity/v3/users/ebc22f4d52244ddd89f7a02a67f68a7f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:30.194079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:30.195498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.204659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e803fc2-bc86-4951-8842-94d244cff6e7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:30.273780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d6db3-d6c3-4d41-99aa-4268fbad58e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:30.274847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d6db3-d6c3-4d41-99aa-4268fbad58e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.275154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d6db3-d6c3-4d41-99aa-4268fbad58e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.275497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d6db3-d6c3-4d41-99aa-4268fbad58e4 admin admin] PATH_INFO: `/v3/projects/130f7d379e424f3c94400d03f12f11f9/users/5fb88976339a4a6b970c404a985817d9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.277806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d6db3-d6c3-4d41-99aa-4268fbad58e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130f7d379e424f3c94400d03f12f11f9, user_id=5fb88976339a4a6b970c404a985817d9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:30.282961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d6db3-d6c3-4d41-99aa-4268fbad58e4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:30.294296 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1081/2165] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:30 2022] PUT /identity/v3/projects/130f7d379e424f3c94400d03f12f11f9/users/5fb88976339a4a6b970c404a985817d9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:30.295073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d41e7-6fa2-4781-91ba-01f7a0666ce8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:30.295539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d6db3-d6c3-4d41-99aa-4268fbad58e4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:30.296857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-449d6db3-d6c3-4d41-99aa-4268fbad58e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.390150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b833d-088a-4e75-8493-e7f16452706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:30.390778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b833d-088a-4e75-8493-e7f16452706d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.391054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b833d-088a-4e75-8493-e7f16452706d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.391555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b833d-088a-4e75-8493-e7f16452706d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.392730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b833d-088a-4e75-8493-e7f16452706d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:30.393937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d6db3-d6c3-4d41-99aa-4268fbad58e4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:30.394657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b833d-088a-4e75-8493-e7f16452706d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:30.399667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81793a21-d735-48fd-a661-8aa9ae2d17bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:30.400413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81793a21-d735-48fd-a661-8aa9ae2d17bf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.400695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81793a21-d735-48fd-a661-8aa9ae2d17bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.400965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81793a21-d735-48fd-a661-8aa9ae2d17bf admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.401654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81793a21-d735-48fd-a661-8aa9ae2d17bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:30.401961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81793a21-d735-48fd-a661-8aa9ae2d17bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:30.404181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81793a21-d735-48fd-a661-8aa9ae2d17bf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:30.410232 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1085/2166] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:30.411707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b833d-088a-4e75-8493-e7f16452706d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:30.417196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-761b833d-088a-4e75-8493-e7f16452706d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.423064 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1082/2167] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:30.426048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798642f6-1369-4592-b767-17063dc3527f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.426815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798642f6-1369-4592-b767-17063dc3527f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.427184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798642f6-1369-4592-b767-17063dc3527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.453000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-798642f6-1369-4592-b767-17063dc3527f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:30.455433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-798642f6-1369-4592-b767-17063dc3527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.470133 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1083/2168] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:30.471174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798642f6-1369-4592-b767-17063dc3527f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:30.477858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-798642f6-1369-4592-b767-17063dc3527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.519864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b833d-088a-4e75-8493-e7f16452706d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:30.524369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11308c4-7231-4b3c-902f-d7f8bb8b07fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:30.525246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11308c4-7231-4b3c-902f-d7f8bb8b07fc service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.525993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11308c4-7231-4b3c-902f-d7f8bb8b07fc service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.526368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11308c4-7231-4b3c-902f-d7f8bb8b07fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.528696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a11308c4-7231-4b3c-902f-d7f8bb8b07fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.572284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798642f6-1369-4592-b767-17063dc3527f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:30.572531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11308c4-7231-4b3c-902f-d7f8bb8b07fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:30.574277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11308c4-7231-4b3c-902f-d7f8bb8b07fc service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:30.578681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ee2ce-0ac0-4275-b0ee-89b79cd86c7c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:30.580012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee2ce-0ac0-4275-b0ee-89b79cd86c7c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.580361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee2ce-0ac0-4275-b0ee-89b79cd86c7c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.580699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee2ce-0ac0-4275-b0ee-89b79cd86c7c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.581459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ee2ce-0ac0-4275-b0ee-89b79cd86c7c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:30.581833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ee2ce-0ac0-4275-b0ee-89b79cd86c7c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:30.583516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ee2ce-0ac0-4275-b0ee-89b79cd86c7c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:30.585377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:30.593131 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1086/2169] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:30.598327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7bdcc-39e2-4820-8523-56580d123807 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.598644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7bdcc-39e2-4820-8523-56580d123807 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.598928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7bdcc-39e2-4820-8523-56580d123807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.604699 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1084/2170] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:30.605952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ee2ce-0ac0-4275-b0ee-89b79cd86c7c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:30.619475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ee2ce-0ac0-4275-b0ee-89b79cd86c7c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:30.626074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9123d53-3477-4532-bed7-3296f7920392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:30.627041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123d53-3477-4532-bed7-3296f7920392 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.627247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123d53-3477-4532-bed7-3296f7920392 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.627403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123d53-3477-4532-bed7-3296f7920392 admin admin] PATH_INFO: `/v3/projects/ba249d380db04f328158c701e9ec2b47/users/f23cea6c1904468c9b54ee548966dead/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.638175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3fb7bdcc-39e2-4820-8523-56580d123807 None None] MFA Rules not processed for user `5fb88976339a4a6b970c404a985817d9`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:30.639685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3fb7bdcc-39e2-4820-8523-56580d123807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.648641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9123d53-3477-4532-bed7-3296f7920392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba249d380db04f328158c701e9ec2b47, user_id=f23cea6c1904468c9b54ee548966dead, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:30.651379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:30.651548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9123d53-3477-4532-bed7-3296f7920392 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:30.673748 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1085/2171] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:30 2022] PUT /identity/v3/projects/ba249d380db04f328158c701e9ec2b47/users/f23cea6c1904468c9b54ee548966dead/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:30.673748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9123d53-3477-4532-bed7-3296f7920392 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:30.728686 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1087/2172] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:30.730146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ec730-9dcc-4b6a-912e-74003c356ef5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.730504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ec730-9dcc-4b6a-912e-74003c356ef5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.730848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ec730-9dcc-4b6a-912e-74003c356ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.758820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ee9ec730-9dcc-4b6a-912e-74003c356ef5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:30.760028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ee9ec730-9dcc-4b6a-912e-74003c356ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.763256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9123d53-3477-4532-bed7-3296f7920392 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:30.768907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2de03-5165-4c54-838e-ecb9e1c763f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:30.769718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2de03-5165-4c54-838e-ecb9e1c763f0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.770088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2de03-5165-4c54-838e-ecb9e1c763f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.770457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2de03-5165-4c54-838e-ecb9e1c763f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.770790 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1088/2173] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:30.772453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2de03-5165-4c54-838e-ecb9e1c763f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:30.772660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ec730-9dcc-4b6a-912e-74003c356ef5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:30.773072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ee9ec730-9dcc-4b6a-912e-74003c356ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.774144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2de03-5165-4c54-838e-ecb9e1c763f0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:30.811172 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1086/2174] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:30 2022] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:30.811172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2de03-5165-4c54-838e-ecb9e1c763f0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:30.812060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-26e2de03-5165-4c54-838e-ecb9e1c763f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.887977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ec730-9dcc-4b6a-912e-74003c356ef5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:30.911105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2de03-5165-4c54-838e-ecb9e1c763f0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:30.914599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:30.915355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.915729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.915829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] PATH_INFO: `/v3/projects/855cb3a6b214443aaa998c9b52a225c6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.917010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] RBAC: Authorizing `identity:delete_project(project_id=855cb3a6b214443aaa998c9b52a225c6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:30.918871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:30.963346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d186f1e-1fc1-4766-9151-8ab891b08cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:30.965211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d186f1e-1fc1-4766-9151-8ab891b08cd5 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:30.965623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d186f1e-1fc1-4766-9151-8ab891b08cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:30.965993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d186f1e-1fc1-4766-9151-8ab891b08cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:30.968237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8d186f1e-1fc1-4766-9151-8ab891b08cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:30.977275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855cb3a6b214443aaa998c9b52a225c6', 'request_id': 'req-3d0351e3-bd0b-4627-ba45-1645080c593d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.984718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855cb3a6b214443aaa998c9b52a225c6', 'request_id': 'req-3d0351e3-bd0b-4627-ba45-1645080c593d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:30.988088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:30.994788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855cb3a6b214443aaa998c9b52a225c6', 'request_id': 'req-3d0351e3-bd0b-4627-ba45-1645080c593d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:31.008111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:31.010773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] The token cache is being invalidate because project 855cb3a6b214443aaa998c9b52a225c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:31.011304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:31.012524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:31.017820 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1087/2175] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:30 2022] DELETE /identity/v3/projects/855cb3a6b214443aaa998c9b52a225c6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:31.017820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.017820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.041878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d186f1e-1fc1-4766-9151-8ab891b08cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.043728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d186f1e-1fc1-4766-9151-8ab891b08cd5 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.065589 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1089/2176] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:31.067906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d186f1e-1fc1-4766-9151-8ab891b08cd5 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.086058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d186f1e-1fc1-4766-9151-8ab891b08cd5 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.091889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0351e3-bd0b-4627-ba45-1645080c593d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.097754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d8ded-dc57-409b-86c0-0f343c5c8ace tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.098459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d8ded-dc57-409b-86c0-0f343c5c8ace tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.098823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d8ded-dc57-409b-86c0-0f343c5c8ace tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.099859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d8ded-dc57-409b-86c0-0f343c5c8ace tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.099859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d8ded-dc57-409b-86c0-0f343c5c8ace tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.101755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d8ded-dc57-409b-86c0-0f343c5c8ace tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.139996 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1088/2177] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:31 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:31.139996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d8ded-dc57-409b-86c0-0f343c5c8ace tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.142108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-849d8ded-dc57-409b-86c0-0f343c5c8ace tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.160562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28437bd2-3743-4cd3-a40a-1e39ac769da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.161182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437bd2-3743-4cd3-a40a-1e39ac769da9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.161492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437bd2-3743-4cd3-a40a-1e39ac769da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.161831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437bd2-3743-4cd3-a40a-1e39ac769da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.163710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28437bd2-3743-4cd3-a40a-1e39ac769da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.164024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28437bd2-3743-4cd3-a40a-1e39ac769da9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.178574 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1090/2178] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:31.178574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28437bd2-3743-4cd3-a40a-1e39ac769da9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.178574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-28437bd2-3743-4cd3-a40a-1e39ac769da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.190991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28437bd2-3743-4cd3-a40a-1e39ac769da9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.231476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d8ded-dc57-409b-86c0-0f343c5c8ace tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.238161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589c603-5aa9-4d96-a879-e82ff2b3c27a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.238784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589c603-5aa9-4d96-a879-e82ff2b3c27a service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.239212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589c603-5aa9-4d96-a879-e82ff2b3c27a service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.239533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589c603-5aa9-4d96-a879-e82ff2b3c27a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.241436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7589c603-5aa9-4d96-a879-e82ff2b3c27a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.254524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47908ed-1fa7-4e21-a107-e235160e752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.255353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47908ed-1fa7-4e21-a107-e235160e752c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.255780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47908ed-1fa7-4e21-a107-e235160e752c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.256057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47908ed-1fa7-4e21-a107-e235160e752c admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.256720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47908ed-1fa7-4e21-a107-e235160e752c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:31.257031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47908ed-1fa7-4e21-a107-e235160e752c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.258696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47908ed-1fa7-4e21-a107-e235160e752c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.272241 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1091/2179] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:31.273434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47908ed-1fa7-4e21-a107-e235160e752c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.275386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b47908ed-1fa7-4e21-a107-e235160e752c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.289697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47908ed-1fa7-4e21-a107-e235160e752c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.294557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253051d9-e1d3-4635-9306-0c6ba58ef184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.295167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253051d9-e1d3-4635-9306-0c6ba58ef184 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.295702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253051d9-e1d3-4635-9306-0c6ba58ef184 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.295702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253051d9-e1d3-4635-9306-0c6ba58ef184 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.296345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253051d9-e1d3-4635-9306-0c6ba58ef184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.298344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253051d9-e1d3-4635-9306-0c6ba58ef184 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.313236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589c603-5aa9-4d96-a879-e82ff2b3c27a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.315972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589c603-5aa9-4d96-a879-e82ff2b3c27a service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.327211 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1089/2180] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:31.328089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589c603-5aa9-4d96-a879-e82ff2b3c27a service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.329978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7589c603-5aa9-4d96-a879-e82ff2b3c27a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.331601 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1092/2181] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:31 2022] POST /identity/v3/users => generated 295 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:31.332961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c2ab-380d-4aaf-bcaa-502d677b6b99 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.333238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c2ab-380d-4aaf-bcaa-502d677b6b99 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.333544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c2ab-380d-4aaf-bcaa-502d677b6b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.359312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5609c2ab-380d-4aaf-bcaa-502d677b6b99 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:31.359511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589c603-5aa9-4d96-a879-e82ff2b3c27a service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.362588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5609c2ab-380d-4aaf-bcaa-502d677b6b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.365103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.365910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.366391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.366718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] PATH_INFO: `/v3/projects/ebba5db9c29a4e3f9886bcf67f676922` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.367980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebba5db9c29a4e3f9886bcf67f676922)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.376791 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1093/2182] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:31.376791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c2ab-380d-4aaf-bcaa-502d677b6b99 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.393954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.396068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:31.453257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:31.475689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebba5db9c29a4e3f9886bcf67f676922', 'request_id': 'req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:31.484145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebba5db9c29a4e3f9886bcf67f676922', 'request_id': 'req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:31.487980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c2ab-380d-4aaf-bcaa-502d677b6b99 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.494686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebba5db9c29a4e3f9886bcf67f676922', 'request_id': 'req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:31.511881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] The token cache is being invalidate because project ebba5db9c29a4e3f9886bcf67f676922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:31.512318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:31.513187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-38c5b933-1a58-42ed-a8a4-3e07e9d277a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:31.515115 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1090/2183] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:31 2022] DELETE /identity/v3/projects/ebba5db9c29a4e3f9886bcf67f676922 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:31.516874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854676ee-6a0c-4418-a695-6ce4d1d4d26c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.518471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854676ee-6a0c-4418-a695-6ce4d1d4d26c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.518758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854676ee-6a0c-4418-a695-6ce4d1d4d26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.539928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-854676ee-6a0c-4418-a695-6ce4d1d4d26c None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:31.541149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-854676ee-6a0c-4418-a695-6ce4d1d4d26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.558855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837200c-d3d5-45ce-9bec-8c1fa695c3e7 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.559471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837200c-d3d5-45ce-9bec-8c1fa695c3e7 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.559754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837200c-d3d5-45ce-9bec-8c1fa695c3e7 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.560032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837200c-d3d5-45ce-9bec-8c1fa695c3e7 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.560706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837200c-d3d5-45ce-9bec-8c1fa695c3e7 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:31.561013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837200c-d3d5-45ce-9bec-8c1fa695c3e7 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.562661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837200c-d3d5-45ce-9bec-8c1fa695c3e7 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.578388 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1094/2184] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:31.578388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837200c-d3d5-45ce-9bec-8c1fa695c3e7 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.579668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1837200c-d3d5-45ce-9bec-8c1fa695c3e7 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.599133 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1091/2185] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:31.600254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854676ee-6a0c-4418-a695-6ce4d1d4d26c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.601740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-854676ee-6a0c-4418-a695-6ce4d1d4d26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.655722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837200c-d3d5-45ce-9bec-8c1fa695c3e7 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.660651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeba38d-4cf8-45f3-9262-8b2a77c056dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.661320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeba38d-4cf8-45f3-9262-8b2a77c056dd admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.661625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeba38d-4cf8-45f3-9262-8b2a77c056dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.661898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeba38d-4cf8-45f3-9262-8b2a77c056dd admin admin] PATH_INFO: `/v3/projects/ba249d380db04f328158c701e9ec2b47/users/f23cea6c1904468c9b54ee548966dead/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.663800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeba38d-4cf8-45f3-9262-8b2a77c056dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba249d380db04f328158c701e9ec2b47, user_id=f23cea6c1904468c9b54ee548966dead, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.666539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeba38d-4cf8-45f3-9262-8b2a77c056dd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.677324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854676ee-6a0c-4418-a695-6ce4d1d4d26c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.680804 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1095/2186] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:31 2022] PUT /identity/v3/projects/ba249d380db04f328158c701e9ec2b47/users/f23cea6c1904468c9b54ee548966dead/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:31.681775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeba38d-4cf8-45f3-9262-8b2a77c056dd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.686919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aeeba38d-4cf8-45f3-9262-8b2a77c056dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.732215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:31.749943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e4062-982c-4bdc-ae04-33e1682a2bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.751404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4062-982c-4bdc-ae04-33e1682a2bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.751699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4062-982c-4bdc-ae04-33e1682a2bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.751971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4062-982c-4bdc-ae04-33e1682a2bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.752609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e4062-982c-4bdc-ae04-33e1682a2bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.754638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e4062-982c-4bdc-ae04-33e1682a2bf1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.767630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeba38d-4cf8-45f3-9262-8b2a77c056dd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.773533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d643e22-5edf-4251-b7eb-e0929c98ff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.774367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643e22-5edf-4251-b7eb-e0929c98ff8c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.774648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643e22-5edf-4251-b7eb-e0929c98ff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.774927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d643e22-5edf-4251-b7eb-e0929c98ff8c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.775621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d643e22-5edf-4251-b7eb-e0929c98ff8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.777305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d643e22-5edf-4251-b7eb-e0929c98ff8c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.790575 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1096/2187] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:31.791876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3c242-43cb-4265-a31f-4c0b90f311b9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.792167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3c242-43cb-4265-a31f-4c0b90f311b9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.797893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3c242-43cb-4265-a31f-4c0b90f311b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.803169 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1092/2188] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:31 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:31.803169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e4062-982c-4bdc-ae04-33e1682a2bf1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.803169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-877e4062-982c-4bdc-ae04-33e1682a2bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.816771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:31.827267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8ec3c242-43cb-4265-a31f-4c0b90f311b9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:31.828718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8ec3c242-43cb-4265-a31f-4c0b90f311b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.887942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e4062-982c-4bdc-ae04-33e1682a2bf1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.894103 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1097/2189] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:31.894536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c75006-bef2-4308-9f50-20ca75912b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.895147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c75006-bef2-4308-9f50-20ca75912b43 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.895426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c75006-bef2-4308-9f50-20ca75912b43 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.895693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c75006-bef2-4308-9f50-20ca75912b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.897491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-37c75006-bef2-4308-9f50-20ca75912b43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.898395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3c242-43cb-4265-a31f-4c0b90f311b9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.899716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8ec3c242-43cb-4265-a31f-4c0b90f311b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:31.912439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3c242-43cb-4265-a31f-4c0b90f311b9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:31.917889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3cccd-e15e-4cdd-b09f-452b242c664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:31.918529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cccd-e15e-4cdd-b09f-452b242c664a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:31.918807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cccd-e15e-4cdd-b09f-452b242c664a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:31.919074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cccd-e15e-4cdd-b09f-452b242c664a admin admin] PATH_INFO: `/v3/users/cd94d3ec96c74b309f3801527d7455ef` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:31.920247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3cccd-e15e-4cdd-b09f-452b242c664a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd94d3ec96c74b309f3801527d7455ef)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.922191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3cccd-e15e-4cdd-b09f-452b242c664a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.979517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-67d3cccd-e15e-4cdd-b09f-452b242c664a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd94d3ec96c74b309f3801527d7455ef'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:31.980168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c75006-bef2-4308-9f50-20ca75912b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:31.980709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-67d3cccd-e15e-4cdd-b09f-452b242c664a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd94d3ec96c74b309f3801527d7455ef'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:31.981861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c75006-bef2-4308-9f50-20ca75912b43 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:31.994010 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1093/2190] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:31 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:31.994893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c75006-bef2-4308-9f50-20ca75912b43 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:31.995800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-67d3cccd-e15e-4cdd-b09f-452b242c664a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd94d3ec96c74b309f3801527d7455ef'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:31.996243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-37c75006-bef2-4308-9f50-20ca75912b43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.006096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-67d3cccd-e15e-4cdd-b09f-452b242c664a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd94d3ec96c74b309f3801527d7455ef'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:32.019140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-67d3cccd-e15e-4cdd-b09f-452b242c664a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd94d3ec96c74b309f3801527d7455ef'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:32.029254 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1098/2191] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:31 2022] DELETE /identity/v3/users/cd94d3ec96c74b309f3801527d7455ef => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:32.031819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24db33-a291-4a22-85c4-f6c6a5ee5f9b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.033751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24db33-a291-4a22-85c4-f6c6a5ee5f9b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.034239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24db33-a291-4a22-85c4-f6c6a5ee5f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.073406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c75006-bef2-4308-9f50-20ca75912b43 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.076913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-db24db33-a291-4a22-85c4-f6c6a5ee5f9b None None] MFA Rules not processed for user `f23cea6c1904468c9b54ee548966dead`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:32.078476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db24db33-a291-4a22-85c4-f6c6a5ee5f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.093164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:32.133007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bed51-991e-4715-8924-716d243a959b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.133760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bed51-991e-4715-8924-716d243a959b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.134105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bed51-991e-4715-8924-716d243a959b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.134434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bed51-991e-4715-8924-716d243a959b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.136863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-040bed51-991e-4715-8924-716d243a959b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.146539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bed51-991e-4715-8924-716d243a959b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.148026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bed51-991e-4715-8924-716d243a959b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.157105 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1094/2192] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:32.157971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bed51-991e-4715-8924-716d243a959b service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.160686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-040bed51-991e-4715-8924-716d243a959b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.177510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1099/2193] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:32.177510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24db33-a291-4a22-85c4-f6c6a5ee5f9b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.180617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db24db33-a291-4a22-85c4-f6c6a5ee5f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.189816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:32.273693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bed51-991e-4715-8924-716d243a959b service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.284651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10824039-ff92-4878-a9c5-83998dc28ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.285374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10824039-ff92-4878-a9c5-83998dc28ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.286016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10824039-ff92-4878-a9c5-83998dc28ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.286413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10824039-ff92-4878-a9c5-83998dc28ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.296745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10824039-ff92-4878-a9c5-83998dc28ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.299044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10824039-ff92-4878-a9c5-83998dc28ee6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.300533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24db33-a291-4a22-85c4-f6c6a5ee5f9b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.306235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110e5f7-d18b-4234-8cdd-98bb8232d6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.307559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e5f7-d18b-4234-8cdd-98bb8232d6ff admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.307559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e5f7-d18b-4234-8cdd-98bb8232d6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.307559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e5f7-d18b-4234-8cdd-98bb8232d6ff admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.308468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110e5f7-d18b-4234-8cdd-98bb8232d6ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.310574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110e5f7-d18b-4234-8cdd-98bb8232d6ff admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.330488 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1095/2194] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:32.331524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10824039-ff92-4878-a9c5-83998dc28ee6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.333433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-10824039-ff92-4878-a9c5-83998dc28ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.344332 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1100/2195] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:32 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:32.344332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110e5f7-d18b-4234-8cdd-98bb8232d6ff admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.344589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b110e5f7-d18b-4234-8cdd-98bb8232d6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.353572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10824039-ff92-4878-a9c5-83998dc28ee6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.359053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3200878-892a-424a-9582-4fa95e8ac204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.359774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3200878-892a-424a-9582-4fa95e8ac204 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.361437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3200878-892a-424a-9582-4fa95e8ac204 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.361437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3200878-892a-424a-9582-4fa95e8ac204 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.361831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3200878-892a-424a-9582-4fa95e8ac204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:32.362201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3200878-892a-424a-9582-4fa95e8ac204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.368036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3200878-892a-424a-9582-4fa95e8ac204 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.382398 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1096/2196] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:32.383807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831f2d9-c5e5-4dad-a567-391c3be42f44 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.384159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831f2d9-c5e5-4dad-a567-391c3be42f44 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.384494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831f2d9-c5e5-4dad-a567-391c3be42f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.409790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5831f2d9-c5e5-4dad-a567-391c3be42f44 None None] MFA Rules not processed for user `b15e02211d3e4253a2edba6e63425ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:32.411462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5831f2d9-c5e5-4dad-a567-391c3be42f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.448071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110e5f7-d18b-4234-8cdd-98bb8232d6ff admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.480004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308b035-0dbb-4091-b690-80d1f9885d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.480817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b035-0dbb-4091-b690-80d1f9885d10 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.481340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b035-0dbb-4091-b690-80d1f9885d10 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.481771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b035-0dbb-4091-b690-80d1f9885d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.483767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a308b035-0dbb-4091-b690-80d1f9885d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.485894 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1097/2197] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:32.485894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831f2d9-c5e5-4dad-a567-391c3be42f44 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.490763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5831f2d9-c5e5-4dad-a567-391c3be42f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.508669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831f2d9-c5e5-4dad-a567-391c3be42f44 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.514990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.515653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.515932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.516219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] PATH_INFO: `/v3/projects/560b137dccba444286393c266e4ac846` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.518219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=560b137dccba444286393c266e4ac846)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.520425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.561319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308b035-0dbb-4091-b690-80d1f9885d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.563022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308b035-0dbb-4091-b690-80d1f9885d10 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.571284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:32.574502 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1101/2198] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:32.574636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560b137dccba444286393c266e4ac846', 'request_id': 'req-0e0f4218-5775-4273-a18e-3a982daf15e7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:32.575532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308b035-0dbb-4091-b690-80d1f9885d10 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.583483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560b137dccba444286393c266e4ac846', 'request_id': 'req-0e0f4218-5775-4273-a18e-3a982daf15e7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:32.587531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308b035-0dbb-4091-b690-80d1f9885d10 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.593129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560b137dccba444286393c266e4ac846', 'request_id': 'req-0e0f4218-5775-4273-a18e-3a982daf15e7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:32.604562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] The token cache is being invalidate because project 560b137dccba444286393c266e4ac846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:32.604850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:32.605535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:32.607092 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1098/2199] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:32 2022] DELETE /identity/v3/projects/560b137dccba444286393c266e4ac846 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:32.610426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.610426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.615905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:32.652821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05c3cc-4715-441c-9205-abbd749402a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.653530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05c3cc-4715-441c-9205-abbd749402a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.654290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05c3cc-4715-441c-9205-abbd749402a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.654573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05c3cc-4715-441c-9205-abbd749402a9 admin admin] PATH_INFO: `/v3/projects/ce262e4887af455d9ad4c2a366e4d2e3/users/2b8e1aa0f9034c38a5d99fd3aa70a758/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.671708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05c3cc-4715-441c-9205-abbd749402a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce262e4887af455d9ad4c2a366e4d2e3, user_id=2b8e1aa0f9034c38a5d99fd3aa70a758, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.674480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05c3cc-4715-441c-9205-abbd749402a9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.675367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f4218-5775-4273-a18e-3a982daf15e7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.680581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fea5a2-edaa-4854-9f76-e26031aa34d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.681281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fea5a2-edaa-4854-9f76-e26031aa34d2 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.681587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fea5a2-edaa-4854-9f76-e26031aa34d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.681893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fea5a2-edaa-4854-9f76-e26031aa34d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.682658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fea5a2-edaa-4854-9f76-e26031aa34d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.684267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fea5a2-edaa-4854-9f76-e26031aa34d2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.689033 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1102/2200] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:32 2022] PUT /identity/v3/projects/ce262e4887af455d9ad4c2a366e4d2e3/users/2b8e1aa0f9034c38a5d99fd3aa70a758/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:32.690424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05c3cc-4715-441c-9205-abbd749402a9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.692078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de05c3cc-4715-441c-9205-abbd749402a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.699353 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1099/2201] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:32.699353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeda0c-7935-40e7-9146-a3d902d478ec None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.699353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeda0c-7935-40e7-9146-a3d902d478ec None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.699353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeda0c-7935-40e7-9146-a3d902d478ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.720325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5cdeda0c-7935-40e7-9146-a3d902d478ec None None] MFA Rules not processed for user `0e05f5de07aa4189bc933dd2a5fb0205`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:32.722488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5cdeda0c-7935-40e7-9146-a3d902d478ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.776362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05c3cc-4715-441c-9205-abbd749402a9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.784871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d551fd-cb40-478f-b14c-149f9faf6c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.785551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d551fd-cb40-478f-b14c-149f9faf6c36 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.785826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d551fd-cb40-478f-b14c-149f9faf6c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.786113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d551fd-cb40-478f-b14c-149f9faf6c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.786596 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1100/2202] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:32.786819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d551fd-cb40-478f-b14c-149f9faf6c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:32.787275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdeda0c-7935-40e7-9146-a3d902d478ec None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:32.788844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d551fd-cb40-478f-b14c-149f9faf6c36 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:32.791738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5cdeda0c-7935-40e7-9146-a3d902d478ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.820418 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1103/2203] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:32 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:32.821812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bb222-922d-45b4-b2bd-b113c618fd8a None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.822101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bb222-922d-45b4-b2bd-b113c618fd8a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.822378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bb222-922d-45b4-b2bd-b113c618fd8a None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.823878 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1104/2204] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:32.824777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c6c55-2ade-46dd-bd79-c2054a046549 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.825067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c6c55-2ade-46dd-bd79-c2054a046549 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.825341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c6c55-2ade-46dd-bd79-c2054a046549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.845594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c08c6c55-2ade-46dd-bd79-c2054a046549 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:32.846818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c08c6c55-2ade-46dd-bd79-c2054a046549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.873303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdeda0c-7935-40e7-9146-a3d902d478ec None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:32.885283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:32.913224 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1105/2205] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:32.914530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfc892-105f-4704-be2f-32e17a627429 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.914819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfc892-105f-4704-be2f-32e17a627429 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.915236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfc892-105f-4704-be2f-32e17a627429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.949287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a2dfc892-105f-4704-be2f-32e17a627429 None None] MFA Rules not processed for user `2b8e1aa0f9034c38a5d99fd3aa70a758`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:32.950593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a2dfc892-105f-4704-be2f-32e17a627429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.952330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cb443-df34-4ad8-9326-1d42ca3a1634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:32.952941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cb443-df34-4ad8-9326-1d42ca3a1634 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:32.953213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cb443-df34-4ad8-9326-1d42ca3a1634 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:32.953511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cb443-df34-4ad8-9326-1d42ca3a1634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:32.955365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bb9cb443-df34-4ad8-9326-1d42ca3a1634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:32.989740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:33.052585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cb443-df34-4ad8-9326-1d42ca3a1634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.055079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cb443-df34-4ad8-9326-1d42ca3a1634 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.064460 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1106/2206] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:33.065994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfc892-105f-4704-be2f-32e17a627429 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.072015 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1101/2207] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:33.073069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cb443-df34-4ad8-9326-1d42ca3a1634 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.088028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfc892-105f-4704-be2f-32e17a627429 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.088395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cb443-df34-4ad8-9326-1d42ca3a1634 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.094889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f72d4-e19f-491f-a909-518bd63b6075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.095614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f72d4-e19f-491f-a909-518bd63b6075 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.096068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f72d4-e19f-491f-a909-518bd63b6075 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.096475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f72d4-e19f-491f-a909-518bd63b6075 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.097275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f72d4-e19f-491f-a909-518bd63b6075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.097789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a013a35-1b0d-489d-a9e9-fec577c796d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.098947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013a35-1b0d-489d-a9e9-fec577c796d5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.099528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f72d4-e19f-491f-a909-518bd63b6075 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.099718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013a35-1b0d-489d-a9e9-fec577c796d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.100158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013a35-1b0d-489d-a9e9-fec577c796d5 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.101456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a013a35-1b0d-489d-a9e9-fec577c796d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.105039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a013a35-1b0d-489d-a9e9-fec577c796d5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.113502 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1107/2208] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:33.114517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f72d4-e19f-491f-a909-518bd63b6075 admin admin] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:33.116417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ad8f72d4-e19f-491f-a909-518bd63b6075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:33.135363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f72d4-e19f-491f-a909-518bd63b6075 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.136652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ad8f72d4-e19f-491f-a909-518bd63b6075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:33.143329 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1102/2209] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:33 2022] POST /identity/v3/users => generated 296 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:33.143329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5a654-c30e-4052-84cb-6354fbe245fe None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.144157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5a654-c30e-4052-84cb-6354fbe245fe None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.144157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5a654-c30e-4052-84cb-6354fbe245fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.182247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6db5a654-c30e-4052-84cb-6354fbe245fe None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:33.184419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6db5a654-c30e-4052-84cb-6354fbe245fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:33.200457 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1103/2210] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:33.200457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5a654-c30e-4052-84cb-6354fbe245fe None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.205968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6db5a654-c30e-4052-84cb-6354fbe245fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:33.227728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5a654-c30e-4052-84cb-6354fbe245fe None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.233305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa669eb7-337e-43d7-b5e9-be05a82d2ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.234128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa669eb7-337e-43d7-b5e9-be05a82d2ccd admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.234497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa669eb7-337e-43d7-b5e9-be05a82d2ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.234867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa669eb7-337e-43d7-b5e9-be05a82d2ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.236328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa669eb7-337e-43d7-b5e9-be05a82d2ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.237426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f72d4-e19f-491f-a909-518bd63b6075 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.238994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa669eb7-337e-43d7-b5e9-be05a82d2ccd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.244204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c307a7c-f57e-4f08-a23c-33f8b3bfe8e1 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.244947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c307a7c-f57e-4f08-a23c-33f8b3bfe8e1 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.245306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c307a7c-f57e-4f08-a23c-33f8b3bfe8e1 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.245695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c307a7c-f57e-4f08-a23c-33f8b3bfe8e1 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/projects/53220f0bab9e40e9961eb1e1bd8ea024` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.247133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c307a7c-f57e-4f08-a23c-33f8b3bfe8e1 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:get_project(project_id=53220f0bab9e40e9961eb1e1bd8ea024)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.254158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c307a7c-f57e-4f08-a23c-33f8b3bfe8e1 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.257966 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1108/2211] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:33 2022] GET /identity/v3/projects/53220f0bab9e40e9961eb1e1bd8ea024 => generated 371 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:33.259357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c307a7c-f57e-4f08-a23c-33f8b3bfe8e1 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.278525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c307a7c-f57e-4f08-a23c-33f8b3bfe8e1 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.285155 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1104/2212] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:33 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:33.285751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa669eb7-337e-43d7-b5e9-be05a82d2ccd admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.293172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ba30c-390d-4120-b42c-5b57c71c946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.294005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ba30c-390d-4120-b42c-5b57c71c946b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.294173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ba30c-390d-4120-b42c-5b57c71c946b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.294431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ba30c-390d-4120-b42c-5b57c71c946b admin admin] PATH_INFO: `/v3/projects/ed82cd2c42b44f94a84f0c56a0aa66cb/users/d932721340b9432a80b70b361dc1b644/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.319389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ba30c-390d-4120-b42c-5b57c71c946b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed82cd2c42b44f94a84f0c56a0aa66cb, user_id=d932721340b9432a80b70b361dc1b644, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.323146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ba30c-390d-4120-b42c-5b57c71c946b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.353447 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1109/2213] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:33 2022] PUT /identity/v3/projects/ed82cd2c42b44f94a84f0c56a0aa66cb/users/d932721340b9432a80b70b361dc1b644/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:33.353447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ba30c-390d-4120-b42c-5b57c71c946b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.402797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa669eb7-337e-43d7-b5e9-be05a82d2ccd admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.417944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:33.443018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ba30c-390d-4120-b42c-5b57c71c946b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.449168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1856db-0a9e-4350-b29b-8c50873ae9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.450108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1856db-0a9e-4350-b29b-8c50873ae9ff admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.450547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1856db-0a9e-4350-b29b-8c50873ae9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.451226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1856db-0a9e-4350-b29b-8c50873ae9ff admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.452106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1856db-0a9e-4350-b29b-8c50873ae9ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:33.452664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1856db-0a9e-4350-b29b-8c50873ae9ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.454697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1856db-0a9e-4350-b29b-8c50873ae9ff admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.479301 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1110/2214] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:33.480629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1856db-0a9e-4350-b29b-8c50873ae9ff admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.490807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7cd4c-8a69-4824-8f86-c83998c30ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.492154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7cd4c-8a69-4824-8f86-c83998c30ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.492776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7cd4c-8a69-4824-8f86-c83998c30ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.493429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7cd4c-8a69-4824-8f86-c83998c30ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.495303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7cd4c-8a69-4824-8f86-c83998c30ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.496384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1856db-0a9e-4350-b29b-8c50873ae9ff admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.498865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7cd4c-8a69-4824-8f86-c83998c30ee5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.512970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69899551-38bd-4366-87d4-36237e33f388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.513663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69899551-38bd-4366-87d4-36237e33f388 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.513951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69899551-38bd-4366-87d4-36237e33f388 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.514235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69899551-38bd-4366-87d4-36237e33f388 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.515435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69899551-38bd-4366-87d4-36237e33f388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.518402 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1105/2215] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:33.520856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12015d54-8153-4fba-8bbd-9a84e890898f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.521551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12015d54-8153-4fba-8bbd-9a84e890898f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.522164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12015d54-8153-4fba-8bbd-9a84e890898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.522540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69899551-38bd-4366-87d4-36237e33f388 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.557010 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1111/2216] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:33 2022] POST /identity/v3/users => generated 300 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:33.558394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69899551-38bd-4366-87d4-36237e33f388 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.566660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:33.572424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69899551-38bd-4366-87d4-36237e33f388 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.578518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-12015d54-8153-4fba-8bbd-9a84e890898f None None] MFA Rules not processed for user `d932721340b9432a80b70b361dc1b644`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:33.580190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a246a5-a770-4f28-bc85-72d0dddded80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.580887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-12015d54-8153-4fba-8bbd-9a84e890898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:33.581051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a246a5-a770-4f28-bc85-72d0dddded80 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.581472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a246a5-a770-4f28-bc85-72d0dddded80 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.581887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a246a5-a770-4f28-bc85-72d0dddded80 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.584790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a246a5-a770-4f28-bc85-72d0dddded80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.586934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a246a5-a770-4f28-bc85-72d0dddded80 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.631898 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1112/2217] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:33 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:33.632910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a246a5-a770-4f28-bc85-72d0dddded80 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.669529 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1106/2218] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:33.670523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12015d54-8153-4fba-8bbd-9a84e890898f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.688655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12015d54-8153-4fba-8bbd-9a84e890898f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.722187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a246a5-a770-4f28-bc85-72d0dddded80 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.729275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e3615-c140-40c3-b459-608504d6180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.730269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3615-c140-40c3-b459-608504d6180d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.730745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3615-c140-40c3-b459-608504d6180d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.732078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3615-c140-40c3-b459-608504d6180d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.732948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e3615-c140-40c3-b459-608504d6180d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.734829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e3615-c140-40c3-b459-608504d6180d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.747685 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1113/2219] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:33.749475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885aaa1-99fc-4371-b597-d52cea720272 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.749738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885aaa1-99fc-4371-b597-d52cea720272 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.750121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885aaa1-99fc-4371-b597-d52cea720272 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.751757 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1114/2220] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:33.752478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885aaa1-99fc-4371-b597-d52cea720272 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.773596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885aaa1-99fc-4371-b597-d52cea720272 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.777366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644708db-f426-4be5-a8b3-498b249f7dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.778025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644708db-f426-4be5-a8b3-498b249f7dbf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.778361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644708db-f426-4be5-a8b3-498b249f7dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.778633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644708db-f426-4be5-a8b3-498b249f7dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.779580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6454a-e697-4ba2-9986-f743233a8fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.779709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644708db-f426-4be5-a8b3-498b249f7dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.780481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6454a-e697-4ba2-9986-f743233a8fdd admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.780946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6454a-e697-4ba2-9986-f743233a8fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.781210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644708db-f426-4be5-a8b3-498b249f7dbf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.781452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6454a-e697-4ba2-9986-f743233a8fdd admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.783407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6454a-e697-4ba2-9986-f743233a8fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.786385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6454a-e697-4ba2-9986-f743233a8fdd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.798218 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1107/2221] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:33.802479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644708db-f426-4be5-a8b3-498b249f7dbf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.816440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644708db-f426-4be5-a8b3-498b249f7dbf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.819542 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1115/2222] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:33 2022] POST /identity/v3/users => generated 292 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:33.820448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6454a-e697-4ba2-9986-f743233a8fdd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.827622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7b0ba-4521-4084-966e-74f65c7582b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.830001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7b0ba-4521-4084-966e-74f65c7582b6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.830001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7b0ba-4521-4084-966e-74f65c7582b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.830436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7b0ba-4521-4084-966e-74f65c7582b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.832919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7b0ba-4521-4084-966e-74f65c7582b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.836121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7b0ba-4521-4084-966e-74f65c7582b6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.840044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6454a-e697-4ba2-9986-f743233a8fdd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:33.845021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa00847-cfbb-4e60-8e87-58a38c710235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:33.845731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa00847-cfbb-4e60-8e87-58a38c710235 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:33.846009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa00847-cfbb-4e60-8e87-58a38c710235 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:33.846284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa00847-cfbb-4e60-8e87-58a38c710235 admin admin] PATH_INFO: `/v3/projects/44ce50453878420baa186ecda9e20aa7/users/32ae3b30b8274ef183d20f1631ab3322/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:33.866200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa00847-cfbb-4e60-8e87-58a38c710235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ce50453878420baa186ecda9e20aa7, user_id=32ae3b30b8274ef183d20f1631ab3322, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:33.870107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa00847-cfbb-4e60-8e87-58a38c710235 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:33.901542 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1116/2223] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:33 2022] PUT /identity/v3/projects/44ce50453878420baa186ecda9e20aa7/users/32ae3b30b8274ef183d20f1631ab3322/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:33.901542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa00847-cfbb-4e60-8e87-58a38c710235 admin admin] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:33.908049 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1108/2224] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:33 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:33.909778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7b0ba-4521-4084-966e-74f65c7582b6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:33.936774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:34.013717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa00847-cfbb-4e60-8e87-58a38c710235 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:34.054103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7b0ba-4521-4084-966e-74f65c7582b6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:34.064949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a3ce-62ee-4c45-8096-72bfac30e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:34.066402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a3ce-62ee-4c45-8096-72bfac30e77e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:34.066904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a3ce-62ee-4c45-8096-72bfac30e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:34.067413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a3ce-62ee-4c45-8096-72bfac30e77e admin admin] PATH_INFO: `/v3/projects/fec309eded5a45209c21b015f17118ba/users/7224d95ff4c249a5bee937c2e805b5d2/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:34.084533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:34.107133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81a3ce-62ee-4c45-8096-72bfac30e77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec309eded5a45209c21b015f17118ba, user_id=7224d95ff4c249a5bee937c2e805b5d2, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:34.112777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81a3ce-62ee-4c45-8096-72bfac30e77e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:34.134525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa00847-cfbb-4e60-8e87-58a38c710235 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:34.160057 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1109/2225] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:33 2022] PUT /identity/v3/projects/fec309eded5a45209c21b015f17118ba/users/7224d95ff4c249a5bee937c2e805b5d2/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:34.166336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a3ce-62ee-4c45-8096-72bfac30e77e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:34.294160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d77da8-a38b-4d74-b434-3a2108cf4b2c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:34.294995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d77da8-a38b-4d74-b434-3a2108cf4b2c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:34.295515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d77da8-a38b-4d74-b434-3a2108cf4b2c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:34.295983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d77da8-a38b-4d74-b434-3a2108cf4b2c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/projects/53220f0bab9e40e9961eb1e1bd8ea024` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:34.299551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d77da8-a38b-4d74-b434-3a2108cf4b2c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:get_project(project_id=53220f0bab9e40e9961eb1e1bd8ea024)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:34.304491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d77da8-a38b-4d74-b434-3a2108cf4b2c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:34.311185 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1117/2226] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:33 2022] GET /identity/v3/projects/53220f0bab9e40e9961eb1e1bd8ea024 => generated 371 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:34.313529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfff6d-c1d1-45ae-9c64-12c1ad42c4f6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:34.315279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfff6d-c1d1-45ae-9c64-12c1ad42c4f6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:34.318044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfff6d-c1d1-45ae-9c64-12c1ad42c4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:34.321689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a3ce-62ee-4c45-8096-72bfac30e77e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:34.343576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd21e7c-d3ab-481b-bbd0-a741f14416dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:34.350433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd21e7c-d3ab-481b-bbd0-a741f14416dc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:34.351080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd21e7c-d3ab-481b-bbd0-a741f14416dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:34.351545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd21e7c-d3ab-481b-bbd0-a741f14416dc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:34.352718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd21e7c-d3ab-481b-bbd0-a741f14416dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:34.358594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f7dfff6d-c1d1-45ae-9c64-12c1ad42c4f6 None None] MFA Rules not processed for user `32ae3b30b8274ef183d20f1631ab3322`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:34.360201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f7dfff6d-c1d1-45ae-9c64-12c1ad42c4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:34.361481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd21e7c-d3ab-481b-bbd0-a741f14416dc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:34.393931 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1110/2227] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:34.394762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd21e7c-d3ab-481b-bbd0-a741f14416dc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:34.431215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd21e7c-d3ab-481b-bbd0-a741f14416dc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:34.445611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b952b47-707d-4924-849a-d427701794e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:34.458316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952b47-707d-4924-849a-d427701794e0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:34.459893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952b47-707d-4924-849a-d427701794e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:34.462576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952b47-707d-4924-849a-d427701794e0 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:34.463559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b952b47-707d-4924-849a-d427701794e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:34.471148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b952b47-707d-4924-849a-d427701794e0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:34.492134 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1118/2228] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:34.493296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfff6d-c1d1-45ae-9c64-12c1ad42c4f6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:34.521663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfff6d-c1d1-45ae-9c64-12c1ad42c4f6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:34.530782 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1111/2229] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:34 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:34.532821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b952b47-707d-4924-849a-d427701794e0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:34.535522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20018d-7713-4b92-af33-3ec8aec8a8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:34.536133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6b952b47-707d-4924-849a-d427701794e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:34.538081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20018d-7713-4b92-af33-3ec8aec8a8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:34.538493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20018d-7713-4b92-af33-3ec8aec8a8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:34.540882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20018d-7713-4b92-af33-3ec8aec8a8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:34.541335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20018d-7713-4b92-af33-3ec8aec8a8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:34.545662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20018d-7713-4b92-af33-3ec8aec8a8b9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:34.564978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b952b47-707d-4924-849a-d427701794e0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:34.570042 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1119/2230] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:34.571322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20018d-7713-4b92-af33-3ec8aec8a8b9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:34.574326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:34.574326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:34.574768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:34.575217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] PATH_INFO: `/v3/users/fb70ae8b6c474cc28d74839927ec72f3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:34.577282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb70ae8b6c474cc28d74839927ec72f3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:34.580859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:34.588923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20018d-7713-4b92-af33-3ec8aec8a8b9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:34.595061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d3fe3-569c-4707-89ee-15d5e2603f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:34.596303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d3fe3-569c-4707-89ee-15d5e2603f7a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:34.596727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d3fe3-569c-4707-89ee-15d5e2603f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:34.597142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d3fe3-569c-4707-89ee-15d5e2603f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:34.598324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d3fe3-569c-4707-89ee-15d5e2603f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:34.600094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d3fe3-569c-4707-89ee-15d5e2603f7a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:34.623868 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1120/2231] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:34.623868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d3fe3-569c-4707-89ee-15d5e2603f7a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:34.692316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb70ae8b6c474cc28d74839927ec72f3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:34.694858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb70ae8b6c474cc28d74839927ec72f3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:34.723682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb70ae8b6c474cc28d74839927ec72f3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:34.725522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb70ae8b6c474cc28d74839927ec72f3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:34.731170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:34.731484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:34.748948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb70ae8b6c474cc28d74839927ec72f3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:34.769350 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1112/2232] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:34 2022] DELETE /identity/v3/users/fb70ae8b6c474cc28d74839927ec72f3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:34.773614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:34.775694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d3fe3-569c-4707-89ee-15d5e2603f7a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:34.776111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:34.888850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5276c2b-43da-41da-83a9-f8ae04514bb3 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:34.889687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5276c2b-43da-41da-83a9-f8ae04514bb3 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:34.890277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5276c2b-43da-41da-83a9-f8ae04514bb3 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:34.890470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796541-6265-47a4-acdf-6ebbee17ce4c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:34.890654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5276c2b-43da-41da-83a9-f8ae04514bb3 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:34.891694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5276c2b-43da-41da-83a9-f8ae04514bb3 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:34.892158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5276c2b-43da-41da-83a9-f8ae04514bb3 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:34.894965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5276c2b-43da-41da-83a9-f8ae04514bb3 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:34.896571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baf651-95c5-4543-8118-091bead7d857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:34.899312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baf651-95c5-4543-8118-091bead7d857 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:34.899312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baf651-95c5-4543-8118-091bead7d857 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:34.899312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baf651-95c5-4543-8118-091bead7d857 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:34.899312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baf651-95c5-4543-8118-091bead7d857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:34.904199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baf651-95c5-4543-8118-091bead7d857 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:34.913121 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1121/2233] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:34.914092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5276c2b-43da-41da-83a9-f8ae04514bb3 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:34.921497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a5276c2b-43da-41da-83a9-f8ae04514bb3 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:34.945291 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1113/2234] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:34 2022] POST /identity/v3/projects => generated 393 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:34.945291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baf651-95c5-4543-8118-091bead7d857 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:34.945291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c1baf651-95c5-4543-8118-091bead7d857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:34.947699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5276c2b-43da-41da-83a9-f8ae04514bb3 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.025005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa6ca2-be00-44d6-8958-8f1fa39ed52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.025676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa6ca2-be00-44d6-8958-8f1fa39ed52d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.025962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa6ca2-be00-44d6-8958-8f1fa39ed52d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.026240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa6ca2-be00-44d6-8958-8f1fa39ed52d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.026902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa6ca2-be00-44d6-8958-8f1fa39ed52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.029045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa6ca2-be00-44d6-8958-8f1fa39ed52d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.040536 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1122/2235] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:35.040855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baf651-95c5-4543-8118-091bead7d857 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.042911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa6ca2-be00-44d6-8958-8f1fa39ed52d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.044976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-01aa6ca2-be00-44d6-8958-8f1fa39ed52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:35.046435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eed32-912e-4939-873c-75a256ff039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.047319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eed32-912e-4939-873c-75a256ff039c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.047954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eed32-912e-4939-873c-75a256ff039c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.048327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eed32-912e-4939-873c-75a256ff039c admin admin] PATH_INFO: `/v3/projects/fec309eded5a45209c21b015f17118ba/users/7224d95ff4c249a5bee937c2e805b5d2/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.051118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57eed32-912e-4939-873c-75a256ff039c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec309eded5a45209c21b015f17118ba, user_id=7224d95ff4c249a5bee937c2e805b5d2, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.054222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57eed32-912e-4939-873c-75a256ff039c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.058675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa6ca2-be00-44d6-8958-8f1fa39ed52d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.064197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47148b-033a-45db-850c-8c99a55b2fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.064968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47148b-033a-45db-850c-8c99a55b2fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.065258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47148b-033a-45db-850c-8c99a55b2fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.065609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47148b-033a-45db-850c-8c99a55b2fb4 admin admin] PATH_INFO: `/v3/projects/f3ee15fab1284e2c90c55aad176c6604/users/3005cb51a7934df4aaa46614d89b248e/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.067084 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1114/2236] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:34 2022] PUT /identity/v3/projects/fec309eded5a45209c21b015f17118ba/users/7224d95ff4c249a5bee937c2e805b5d2/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:35.070824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470c80d-af82-4393-a317-f9dbd7c3c644 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.070824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470c80d-af82-4393-a317-f9dbd7c3c644 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.070824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470c80d-af82-4393-a317-f9dbd7c3c644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.085714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47148b-033a-45db-850c-8c99a55b2fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ee15fab1284e2c90c55aad176c6604, user_id=3005cb51a7934df4aaa46614d89b248e, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.088406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47148b-033a-45db-850c-8c99a55b2fb4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.095804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6470c80d-af82-4393-a317-f9dbd7c3c644 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:35.097162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6470c80d-af82-4393-a317-f9dbd7c3c644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:35.102359 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1123/2237] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:35 2022] PUT /identity/v3/projects/f3ee15fab1284e2c90c55aad176c6604/users/3005cb51a7934df4aaa46614d89b248e/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:35.103249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47148b-033a-45db-850c-8c99a55b2fb4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.106222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fc47148b-033a-45db-850c-8c99a55b2fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:35.168197 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1115/2238] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:35.169005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470c80d-af82-4393-a317-f9dbd7c3c644 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.178546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:35.183991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470c80d-af82-4393-a317-f9dbd7c3c644 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.192884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7998e1-83e2-4caf-b55e-3c276d4d0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.194137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7998e1-83e2-4caf-b55e-3c276d4d0454 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.194529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7998e1-83e2-4caf-b55e-3c276d4d0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.194895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7998e1-83e2-4caf-b55e-3c276d4d0454 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.195793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7998e1-83e2-4caf-b55e-3c276d4d0454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.199308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7998e1-83e2-4caf-b55e-3c276d4d0454 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.209818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47148b-033a-45db-850c-8c99a55b2fb4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.217204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c7378-625a-4d67-811b-7048ee8db952 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.218090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c7378-625a-4d67-811b-7048ee8db952 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.218493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c7378-625a-4d67-811b-7048ee8db952 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.218876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c7378-625a-4d67-811b-7048ee8db952 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.220236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c7378-625a-4d67-811b-7048ee8db952 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.224719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c7378-625a-4d67-811b-7048ee8db952 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.230047 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1116/2239] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:35 2022] POST /identity/v3/users => generated 303 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:35.231753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7998e1-83e2-4caf-b55e-3c276d4d0454 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.236370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:35.248008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7998e1-83e2-4caf-b55e-3c276d4d0454 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.254873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e52e31-d1e0-45e6-8d54-088c4d6792d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.255761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52e31-d1e0-45e6-8d54-088c4d6792d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.256371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52e31-d1e0-45e6-8d54-088c4d6792d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.256539 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1124/2240] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:35 2022] POST /identity/v3/users => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:35.257222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52e31-d1e0-45e6-8d54-088c4d6792d9 admin admin] PATH_INFO: `/v3/projects/7f83c0c32c354d19ae1aa4b2af640f5c/users/f3b5f23e54f94c3db5599cdf95c98bcd/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.258322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89495233-894d-4944-b93e-cf47c375f5c2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.258614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89495233-894d-4944-b93e-cf47c375f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.258913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89495233-894d-4944-b93e-cf47c375f5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.281212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e52e31-d1e0-45e6-8d54-088c4d6792d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f83c0c32c354d19ae1aa4b2af640f5c, user_id=f3b5f23e54f94c3db5599cdf95c98bcd, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.285243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e52e31-d1e0-45e6-8d54-088c4d6792d9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.311669 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1117/2241] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:35 2022] PUT /identity/v3/projects/7f83c0c32c354d19ae1aa4b2af640f5c/users/f3b5f23e54f94c3db5599cdf95c98bcd/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:35.313263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9f479-ac30-4f56-8d18-e8b9d9945812 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.313611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9f479-ac30-4f56-8d18-e8b9d9945812 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.313989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9f479-ac30-4f56-8d18-e8b9d9945812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.316570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-89495233-894d-4944-b93e-cf47c375f5c2 None None] MFA Rules not processed for user `7224d95ff4c249a5bee937c2e805b5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:35.317987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-89495233-894d-4944-b93e-cf47c375f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:35.369803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-63a9f479-ac30-4f56-8d18-e8b9d9945812 None None] MFA Rules not processed for user `3005cb51a7934df4aaa46614d89b248e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:35.372092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-63a9f479-ac30-4f56-8d18-e8b9d9945812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:35.449530 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1125/2242] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:35.449530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89495233-894d-4944-b93e-cf47c375f5c2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.451781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-89495233-894d-4944-b93e-cf47c375f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:35.488454 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1118/2243] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:35.489558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9f479-ac30-4f56-8d18-e8b9d9945812 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.610012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9f479-ac30-4f56-8d18-e8b9d9945812 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.614413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89495233-894d-4944-b93e-cf47c375f5c2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.616327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e86e15-02ac-481a-94a0-95945a6bf370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.616961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e86e15-02ac-481a-94a0-95945a6bf370 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.617232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e86e15-02ac-481a-94a0-95945a6bf370 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.617553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e86e15-02ac-481a-94a0-95945a6bf370 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.618222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e86e15-02ac-481a-94a0-95945a6bf370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.619875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e86e15-02ac-481a-94a0-95945a6bf370 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.620202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792b8db-dad4-4301-a9ff-929ce42f3f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.620994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792b8db-dad4-4301-a9ff-929ce42f3f12 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.621456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792b8db-dad4-4301-a9ff-929ce42f3f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.621880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792b8db-dad4-4301-a9ff-929ce42f3f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.632638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792b8db-dad4-4301-a9ff-929ce42f3f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.633899 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1119/2244] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:35.634791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e86e15-02ac-481a-94a0-95945a6bf370 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.634993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792b8db-dad4-4301-a9ff-929ce42f3f12 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.647294 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1126/2245] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:35.657636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792b8db-dad4-4301-a9ff-929ce42f3f12 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.691274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792b8db-dad4-4301-a9ff-929ce42f3f12 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.691911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:35.699792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f2a7e-564d-423f-a068-30f8d498fdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.700419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f2a7e-564d-423f-a068-30f8d498fdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.700703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f2a7e-564d-423f-a068-30f8d498fdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.700982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f2a7e-564d-423f-a068-30f8d498fdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.701674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f2a7e-564d-423f-a068-30f8d498fdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.703890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f2a7e-564d-423f-a068-30f8d498fdd9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.733555 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1127/2246] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:35.734613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f2a7e-564d-423f-a068-30f8d498fdd9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.738197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0b3f2a7e-564d-423f-a068-30f8d498fdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:35.741024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e86e15-02ac-481a-94a0-95945a6bf370 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.760570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828498-beaa-4bce-83ad-958859df216e tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.761643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828498-beaa-4bce-83ad-958859df216e tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.762473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828498-beaa-4bce-83ad-958859df216e tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.762646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828498-beaa-4bce-83ad-958859df216e tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.763851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828498-beaa-4bce-83ad-958859df216e tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:35.764401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828498-beaa-4bce-83ad-958859df216e tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.772194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828498-beaa-4bce-83ad-958859df216e tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.811923 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1120/2247] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:35.813656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828498-beaa-4bce-83ad-958859df216e tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.836307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828498-beaa-4bce-83ad-958859df216e tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.846565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2adc88-d0c4-4497-81ab-33ab4301825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.847608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2adc88-d0c4-4497-81ab-33ab4301825e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.848103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2adc88-d0c4-4497-81ab-33ab4301825e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.848584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2adc88-d0c4-4497-81ab-33ab4301825e admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.849794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2adc88-d0c4-4497-81ab-33ab4301825e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.856437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2adc88-d0c4-4497-81ab-33ab4301825e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.875518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f2a7e-564d-423f-a068-30f8d498fdd9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:35.892990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14773a0-6497-46b9-a9a0-aba18145ae1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:35.894368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14773a0-6497-46b9-a9a0-aba18145ae1a service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:35.895225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14773a0-6497-46b9-a9a0-aba18145ae1a service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:35.896011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14773a0-6497-46b9-a9a0-aba18145ae1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:35.908551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:35.919413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14773a0-6497-46b9-a9a0-aba18145ae1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:35.925369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14773a0-6497-46b9-a9a0-aba18145ae1a service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:35.940884 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1121/2248] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:35 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:35.942248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2adc88-d0c4-4497-81ab-33ab4301825e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.962543 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1128/2249] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:35.963517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14773a0-6497-46b9-a9a0-aba18145ae1a service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:35.995644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14773a0-6497-46b9-a9a0-aba18145ae1a service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:36.048510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2adc88-d0c4-4497-81ab-33ab4301825e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:36.057202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab9b05-57ac-45c2-b869-6201b9c1f0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:36.058301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9b05-57ac-45c2-b869-6201b9c1f0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:36.058710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9b05-57ac-45c2-b869-6201b9c1f0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:36.059233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9b05-57ac-45c2-b869-6201b9c1f0c5 admin admin] PATH_INFO: `/v3/projects/866a5b0d5b3542d88cc9300086da8d06/users/b5ae7d5674674760911c699a4585c0eb/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:36.087459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab9b05-57ac-45c2-b869-6201b9c1f0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866a5b0d5b3542d88cc9300086da8d06, user_id=b5ae7d5674674760911c699a4585c0eb, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:36.090898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab9b05-57ac-45c2-b869-6201b9c1f0c5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:36.113351 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1122/2250] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:35 2022] PUT /identity/v3/projects/866a5b0d5b3542d88cc9300086da8d06/users/b5ae7d5674674760911c699a4585c0eb/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:36.115248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab9b05-57ac-45c2-b869-6201b9c1f0c5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:36.120852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f9f11-581b-4fb4-ab9b-a9527de42c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:36.122350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f9f11-581b-4fb4-ab9b-a9527de42c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:36.122350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f9f11-581b-4fb4-ab9b-a9527de42c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:36.122809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f9f11-581b-4fb4-ab9b-a9527de42c31 admin admin] PATH_INFO: `/v3/projects/7f83c0c32c354d19ae1aa4b2af640f5c/users/f3b5f23e54f94c3db5599cdf95c98bcd/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:36.125412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f9f11-581b-4fb4-ab9b-a9527de42c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f83c0c32c354d19ae1aa4b2af640f5c, user_id=f3b5f23e54f94c3db5599cdf95c98bcd, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:36.129927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f9f11-581b-4fb4-ab9b-a9527de42c31 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:36.149856 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1129/2251] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:35 2022] PUT /identity/v3/projects/7f83c0c32c354d19ae1aa4b2af640f5c/users/f3b5f23e54f94c3db5599cdf95c98bcd/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:36.151563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c015cf1-bac1-49ac-83fe-7f3acdb1d0ff None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:36.152282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c015cf1-bac1-49ac-83fe-7f3acdb1d0ff None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:36.152886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c015cf1-bac1-49ac-83fe-7f3acdb1d0ff None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:36.155725 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1130/2252] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:36.162505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c015cf1-bac1-49ac-83fe-7f3acdb1d0ff None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:36.216323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab9b05-57ac-45c2-b869-6201b9c1f0c5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:36.287190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:36.292553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c015cf1-bac1-49ac-83fe-7f3acdb1d0ff None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:36.299747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa216729-1f6c-428a-9f5d-af4b429c139a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:36.300387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa216729-1f6c-428a-9f5d-af4b429c139a service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:36.300668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa216729-1f6c-428a-9f5d-af4b429c139a service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:36.300943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa216729-1f6c-428a-9f5d-af4b429c139a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:36.302820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fa216729-1f6c-428a-9f5d-af4b429c139a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:36.306069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaa6b5-db6d-4877-bdb5-2f3285d8e9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:36.306815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa6b5-db6d-4877-bdb5-2f3285d8e9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:36.307196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa6b5-db6d-4877-bdb5-2f3285d8e9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:36.307568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa6b5-db6d-4877-bdb5-2f3285d8e9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:36.308378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaa6b5-db6d-4877-bdb5-2f3285d8e9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:36.321073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaa6b5-db6d-4877-bdb5-2f3285d8e9b9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:36.366339 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1123/2253] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:36 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:36.370322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaa6b5-db6d-4877-bdb5-2f3285d8e9b9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:36.411005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa216729-1f6c-428a-9f5d-af4b429c139a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:36.412651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa216729-1f6c-428a-9f5d-af4b429c139a service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:36.415900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaa6b5-db6d-4877-bdb5-2f3285d8e9b9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:36.424789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699e39-09cd-4b52-8195-ab6927f33dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:36.425571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699e39-09cd-4b52-8195-ab6927f33dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:36.425952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699e39-09cd-4b52-8195-ab6927f33dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:36.426330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699e39-09cd-4b52-8195-ab6927f33dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:36.426920 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1131/2254] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:36.427248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2699e39-09cd-4b52-8195-ab6927f33dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:36.427938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d982c2c-88c9-4c98-b2ab-c4517cead9aa None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:36.428220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d982c2c-88c9-4c98-b2ab-c4517cead9aa None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:36.428488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d982c2c-88c9-4c98-b2ab-c4517cead9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:36.430724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2699e39-09cd-4b52-8195-ab6927f33dd0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:36.461046 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1124/2255] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:36.463438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699e39-09cd-4b52-8195-ab6927f33dd0 admin admin] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:36.469739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d2699e39-09cd-4b52-8195-ab6927f33dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:36.478196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6d982c2c-88c9-4c98-b2ab-c4517cead9aa None None] MFA Rules not processed for user `f3b5f23e54f94c3db5599cdf95c98bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:36.479546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6d982c2c-88c9-4c98-b2ab-c4517cead9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:36.496129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:36.501167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699e39-09cd-4b52-8195-ab6927f33dd0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:36.619127 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1132/2256] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:36.620274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d982c2c-88c9-4c98-b2ab-c4517cead9aa None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:36.621920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6d982c2c-88c9-4c98-b2ab-c4517cead9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:36.638046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699e39-09cd-4b52-8195-ab6927f33dd0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:36.643541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d982c2c-88c9-4c98-b2ab-c4517cead9aa None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:36.646515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e00c6-6408-4838-bfed-663d9b358f03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:36.647161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e00c6-6408-4838-bfed-663d9b358f03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:36.647450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e00c6-6408-4838-bfed-663d9b358f03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:36.647729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e00c6-6408-4838-bfed-663d9b358f03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/projects/53220f0bab9e40e9961eb1e1bd8ea024` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:36.648874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e00c6-6408-4838-bfed-663d9b358f03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:get_project(project_id=53220f0bab9e40e9961eb1e1bd8ea024)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:36.649753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:36.650464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:36.650811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:36.651155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] PATH_INFO: `/v3/projects/0cf3b494c9d84687b66c817df0fb173d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:36.651257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e00c6-6408-4838-bfed-663d9b358f03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:36.652446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf3b494c9d84687b66c817df0fb173d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:36.652964 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1125/2257] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:36 2022] GET /identity/v3/projects/53220f0bab9e40e9961eb1e1bd8ea024 => generated 371 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:36.653656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e00c6-6408-4838-bfed-663d9b358f03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:36.655774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:36.680760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e00c6-6408-4838-bfed-663d9b358f03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:36.685972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b96ad-a763-47a5-961d-df2087b25e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:36.686592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b96ad-a763-47a5-961d-df2087b25e9a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:36.686873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b96ad-a763-47a5-961d-df2087b25e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:36.687183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b96ad-a763-47a5-961d-df2087b25e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:36.687837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b96ad-a763-47a5-961d-df2087b25e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:36.690451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b96ad-a763-47a5-961d-df2087b25e9a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:36.707406 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1126/2258] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:36.708415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b96ad-a763-47a5-961d-df2087b25e9a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:36.722382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b96ad-a763-47a5-961d-df2087b25e9a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:36.748140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf3b494c9d84687b66c817df0fb173d', 'request_id': 'req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:36.757813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf3b494c9d84687b66c817df0fb173d', 'request_id': 'req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:36.771069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf3b494c9d84687b66c817df0fb173d', 'request_id': 'req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:36.795903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] The token cache is being invalidate because project 0cf3b494c9d84687b66c817df0fb173d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:36.796201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:36.798149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:36.801643 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1133/2259] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:36 2022] DELETE /identity/v3/projects/0cf3b494c9d84687b66c817df0fb173d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:36.803114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:36.806056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:36.866643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb07da4-9009-4476-88c5-d03c108d3e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:36.867493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07da4-9009-4476-88c5-d03c108d3e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:36.867898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07da4-9009-4476-88c5-d03c108d3e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:36.868240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07da4-9009-4476-88c5-d03c108d3e83 admin admin] PATH_INFO: `/v3/projects/866a5b0d5b3542d88cc9300086da8d06/users/b5ae7d5674674760911c699a4585c0eb/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:36.873047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb07da4-9009-4476-88c5-d03c108d3e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866a5b0d5b3542d88cc9300086da8d06, user_id=b5ae7d5674674760911c699a4585c0eb, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:36.882451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb07da4-9009-4476-88c5-d03c108d3e83 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:36.907453 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1127/2260] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:36 2022] PUT /identity/v3/projects/866a5b0d5b3542d88cc9300086da8d06/users/b5ae7d5674674760911c699a4585c0eb/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:36.908309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb07da4-9009-4476-88c5-d03c108d3e83 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:36.928506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1fb07da4-9009-4476-88c5-d03c108d3e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:36.986769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2170f8-a108-4fb9-b1b3-8ee8fea4d771 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:37.048890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:37.054469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:37.075997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb07da4-9009-4476-88c5-d03c108d3e83 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:37.084136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d83b1d-6067-4dbb-b682-8d797113babb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:37.084901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d83b1d-6067-4dbb-b682-8d797113babb admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:37.085842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d83b1d-6067-4dbb-b682-8d797113babb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:37.085842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d83b1d-6067-4dbb-b682-8d797113babb admin admin] PATH_INFO: `/v3/projects/85bf30f6e95d46a786d3455606f6d0ec/users/09c772e20c9d4b71b5565a0412958818/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:37.102896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d83b1d-6067-4dbb-b682-8d797113babb admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bf30f6e95d46a786d3455606f6d0ec, user_id=09c772e20c9d4b71b5565a0412958818, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:37.107083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d83b1d-6067-4dbb-b682-8d797113babb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:37.126925 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1128/2261] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:36 2022] PUT /identity/v3/projects/85bf30f6e95d46a786d3455606f6d0ec/users/09c772e20c9d4b71b5565a0412958818/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:37.127952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d83b1d-6067-4dbb-b682-8d797113babb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:37.129973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b0d83b1d-6067-4dbb-b682-8d797113babb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:37.134053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414a3df-6a6a-4155-b5dd-b66fdd718465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:37.134681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414a3df-6a6a-4155-b5dd-b66fdd718465 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:37.134960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414a3df-6a6a-4155-b5dd-b66fdd718465 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:37.135283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414a3df-6a6a-4155-b5dd-b66fdd718465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:37.137867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1414a3df-6a6a-4155-b5dd-b66fdd718465 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:37.212278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d83b1d-6067-4dbb-b682-8d797113babb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:37.217226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0b9d5-5624-419d-bb96-11452529989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:37.217895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b9d5-5624-419d-bb96-11452529989a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:37.218175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b9d5-5624-419d-bb96-11452529989a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:37.218452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b9d5-5624-419d-bb96-11452529989a admin admin] PATH_INFO: `/v3/users/5fb88976339a4a6b970c404a985817d9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:37.219651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0b9d5-5624-419d-bb96-11452529989a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb88976339a4a6b970c404a985817d9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:37.222173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0b9d5-5624-419d-bb96-11452529989a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:37.229011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414a3df-6a6a-4155-b5dd-b66fdd718465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:37.230438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414a3df-6a6a-4155-b5dd-b66fdd718465 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:37.244608 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1134/2262] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:37.247648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601baa0b-21e1-4411-81fd-7555184e1262 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:37.248044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601baa0b-21e1-4411-81fd-7555184e1262 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:37.248401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601baa0b-21e1-4411-81fd-7555184e1262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:37.291787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-601baa0b-21e1-4411-81fd-7555184e1262 None None] MFA Rules not processed for user `b5ae7d5674674760911c699a4585c0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:37.294355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-601baa0b-21e1-4411-81fd-7555184e1262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:37.301997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7ba0b9d5-5624-419d-bb96-11452529989a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb88976339a4a6b970c404a985817d9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:37.302855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7ba0b9d5-5624-419d-bb96-11452529989a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb88976339a4a6b970c404a985817d9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:37.330213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7ba0b9d5-5624-419d-bb96-11452529989a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb88976339a4a6b970c404a985817d9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:37.331523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7ba0b9d5-5624-419d-bb96-11452529989a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb88976339a4a6b970c404a985817d9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:37.346853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7ba0b9d5-5624-419d-bb96-11452529989a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb88976339a4a6b970c404a985817d9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:37.378736 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1129/2263] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:37 2022] DELETE /identity/v3/users/5fb88976339a4a6b970c404a985817d9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:37.380603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0d6ed-35d5-4823-a51b-ec3afa1f87d5 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:37.381001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0d6ed-35d5-4823-a51b-ec3afa1f87d5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:37.381380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0d6ed-35d5-4823-a51b-ec3afa1f87d5 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:37.383180 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1130/2264] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:37.384089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0d6ed-35d5-4823-a51b-ec3afa1f87d5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:37.386809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-17b0d6ed-35d5-4823-a51b-ec3afa1f87d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:37.455139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:37.487431 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1135/2265] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:37.494456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601baa0b-21e1-4411-81fd-7555184e1262 None None] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:26:37.502605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0d6ed-35d5-4823-a51b-ec3afa1f87d5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:37.503437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-601baa0b-21e1-4411-81fd-7555184e1262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:37.517232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44819880-605d-431f-b9d5-a0967db8cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:37.517956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44819880-605d-431f-b9d5-a0967db8cdcf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:37.518265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44819880-605d-431f-b9d5-a0967db8cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:37.518751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44819880-605d-431f-b9d5-a0967db8cdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:37.519585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44819880-605d-431f-b9d5-a0967db8cdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:37.524387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44819880-605d-431f-b9d5-a0967db8cdcf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:37.549548 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1131/2266] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:37.553024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44819880-605d-431f-b9d5-a0967db8cdcf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:37.585716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44819880-605d-431f-b9d5-a0967db8cdcf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:37.596498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:37.601276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92c4cf-a186-4b4e-9dec-066d93ee3b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:37.603249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c4cf-a186-4b4e-9dec-066d93ee3b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:37.604617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c4cf-a186-4b4e-9dec-066d93ee3b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:37.608373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c4cf-a186-4b4e-9dec-066d93ee3b5f admin admin] PATH_INFO: `/v3/projects/85bf30f6e95d46a786d3455606f6d0ec/users/09c772e20c9d4b71b5565a0412958818/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:37.614361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92c4cf-a186-4b4e-9dec-066d93ee3b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bf30f6e95d46a786d3455606f6d0ec, user_id=09c772e20c9d4b71b5565a0412958818, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:37.621381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92c4cf-a186-4b4e-9dec-066d93ee3b5f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:37.649440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601baa0b-21e1-4411-81fd-7555184e1262 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:37.651052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-601baa0b-21e1-4411-81fd-7555184e1262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:37.661698 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1132/2267] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:37 2022] PUT /identity/v3/projects/85bf30f6e95d46a786d3455606f6d0ec/users/09c772e20c9d4b71b5565a0412958818/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:26:37.680246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895b5a7-6ed5-465e-8c0f-d4e734e73f8e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:37.680354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895b5a7-6ed5-465e-8c0f-d4e734e73f8e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:37.680721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895b5a7-6ed5-465e-8c0f-d4e734e73f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:37.763247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2895b5a7-6ed5-465e-8c0f-d4e734e73f8e None None] MFA Rules not processed for user `09c772e20c9d4b71b5565a0412958818`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:37.764491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2895b5a7-6ed5-465e-8c0f-d4e734e73f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:37.827334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601baa0b-21e1-4411-81fd-7555184e1262 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:37.933092 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1133/2268] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:37.948447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678fade-35de-4ffd-be68-d674c9f5ca03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:37.948776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678fade-35de-4ffd-be68-d674c9f5ca03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:37.949059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678fade-35de-4ffd-be68-d674c9f5ca03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:37.949331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678fade-35de-4ffd-be68-d674c9f5ca03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/projects/53220f0bab9e40e9961eb1e1bd8ea024` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:37.953102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678fade-35de-4ffd-be68-d674c9f5ca03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:get_project(project_id=53220f0bab9e40e9961eb1e1bd8ea024)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:37.955900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678fade-35de-4ffd-be68-d674c9f5ca03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:37.958037 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1136/2269] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:26:37 2022] GET /identity/v3/projects/53220f0bab9e40e9961eb1e1bd8ea024 => generated 371 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:38.001784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895b5a7-6ed5-465e-8c0f-d4e734e73f8e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:38.024036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895b5a7-6ed5-465e-8c0f-d4e734e73f8e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:38.029964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678fade-35de-4ffd-be68-d674c9f5ca03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:38.041909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:38.044231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:38.044534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:38.044817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/users/fd2ea8d4f35344b1828f5b95534672c2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:38.067479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fd2ea8d4f35344b1828f5b95534672c2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:38.069881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:38.168255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2ea8d4f35344b1828f5b95534672c2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:38.168993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2ea8d4f35344b1828f5b95534672c2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:38.181641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678fade-35de-4ffd-be68-d674c9f5ca03 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:38.189629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656fd7e-94d6-4939-a17d-fc67ba27b2f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:38.190461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656fd7e-94d6-4939-a17d-fc67ba27b2f4 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:38.191481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656fd7e-94d6-4939-a17d-fc67ba27b2f4 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:38.191771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656fd7e-94d6-4939-a17d-fc67ba27b2f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:38.200217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2ea8d4f35344b1828f5b95534672c2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:38.200972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2ea8d4f35344b1828f5b95534672c2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:38.202177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b656fd7e-94d6-4939-a17d-fc67ba27b2f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:38.210097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2ea8d4f35344b1828f5b95534672c2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:38.232960 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1134/2270] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:38 2022] DELETE /identity/v3/users/fd2ea8d4f35344b1828f5b95534672c2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:38.233990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:38.237285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:38.275443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:38.286294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:38.330133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656fd7e-94d6-4939-a17d-fc67ba27b2f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:38.332017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656fd7e-94d6-4939-a17d-fc67ba27b2f4 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:38.345790 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1137/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:38.346668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656fd7e-94d6-4939-a17d-fc67ba27b2f4 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:38.346931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517e281-6242-46f0-94be-259d96fa1449 tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:38.348303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b656fd7e-94d6-4939-a17d-fc67ba27b2f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:38.355555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebab86-fd79-4103-ac7b-6277f0064249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:38.356475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebab86-fd79-4103-ac7b-6277f0064249 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:38.357114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebab86-fd79-4103-ac7b-6277f0064249 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:38.357565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebab86-fd79-4103-ac7b-6277f0064249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:38.360722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bbebab86-fd79-4103-ac7b-6277f0064249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:38.502497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656fd7e-94d6-4939-a17d-fc67ba27b2f4 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:38.520279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebab86-fd79-4103-ac7b-6277f0064249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:38.522579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebab86-fd79-4103-ac7b-6277f0064249 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:38.551955 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1135/2272] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:38.555437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebab86-fd79-4103-ac7b-6277f0064249 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:38.559604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bbebab86-fd79-4103-ac7b-6277f0064249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:38.642401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:38.644862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:38.646203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:38.646203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] PATH_INFO: `/v3/projects/130f7d379e424f3c94400d03f12f11f9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:38.647930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=130f7d379e424f3c94400d03f12f11f9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:38.649835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:38.734208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130f7d379e424f3c94400d03f12f11f9', 'request_id': 'req-f0f6f50d-7236-46f1-ade8-de31093ceb87'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:38.752249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130f7d379e424f3c94400d03f12f11f9', 'request_id': 'req-f0f6f50d-7236-46f1-ade8-de31093ceb87'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:38.774086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130f7d379e424f3c94400d03f12f11f9', 'request_id': 'req-f0f6f50d-7236-46f1-ade8-de31093ceb87'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:38.774930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebab86-fd79-4103-ac7b-6277f0064249 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:38.814486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] The token cache is being invalidate because project 130f7d379e424f3c94400d03f12f11f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:38.814785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:38.818028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:38.837341 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1138/2273] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:38 2022] DELETE /identity/v3/projects/130f7d379e424f3c94400d03f12f11f9 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:38.837341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:38.840258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:38.844309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:38.942961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac53d9f1203a42e6ab38f2ef0816aeb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f566e934ade44c1bbdd35f7697692a4e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:38.942961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:38.943194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:38.943574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] PATH_INFO: `/v3/projects/53220f0bab9e40e9961eb1e1bd8ea024` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:38.945242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorizing `identity:delete_project(project_id=53220f0bab9e40e9961eb1e1bd8ea024)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:38.947422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:38.962451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:38.994268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f50d-7236-46f1-ade8-de31093ceb87 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:39.015347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1420ec-7e45-4029-a3a4-3a2f8bb273c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:39.016812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1420ec-7e45-4029-a3a4-3a2f8bb273c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:39.017297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1420ec-7e45-4029-a3a4-3a2f8bb273c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:39.017833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1420ec-7e45-4029-a3a4-3a2f8bb273c3 admin admin] PATH_INFO: `/v3/users/3005cb51a7934df4aaa46614d89b248e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:39.019371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1420ec-7e45-4029-a3a4-3a2f8bb273c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3005cb51a7934df4aaa46614d89b248e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:39.021579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1420ec-7e45-4029-a3a4-3a2f8bb273c3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:39.044831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53220f0bab9e40e9961eb1e1bd8ea024', 'request_id': 'req-e1c2f9df-32e4-4168-ab89-0087d84b522c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.058231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53220f0bab9e40e9961eb1e1bd8ea024', 'request_id': 'req-e1c2f9df-32e4-4168-ab89-0087d84b522c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.077870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53220f0bab9e40e9961eb1e1bd8ea024', 'request_id': 'req-e1c2f9df-32e4-4168-ab89-0087d84b522c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.120420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1b1420ec-7e45-4029-a3a4-3a2f8bb273c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3005cb51a7934df4aaa46614d89b248e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.121446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1b1420ec-7e45-4029-a3a4-3a2f8bb273c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3005cb51a7934df4aaa46614d89b248e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.124055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] The token cache is being invalidate because project 53220f0bab9e40e9961eb1e1bd8ea024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:39.124532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.128285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.132664 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1136/2274] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:38 2022] DELETE /identity/v3/projects/53220f0bab9e40e9961eb1e1bd8ea024 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:39.134502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:39.138603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:39.152408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1b1420ec-7e45-4029-a3a4-3a2f8bb273c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3005cb51a7934df4aaa46614d89b248e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.163335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1b1420ec-7e45-4029-a3a4-3a2f8bb273c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3005cb51a7934df4aaa46614d89b248e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.178223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1b1420ec-7e45-4029-a3a4-3a2f8bb273c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3005cb51a7934df4aaa46614d89b248e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.191689 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1139/2275] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:38 2022] DELETE /identity/v3/users/3005cb51a7934df4aaa46614d89b248e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:39.192790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f49a-ba6f-4590-8f41-a36bbf26e266 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:39.193079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f49a-ba6f-4590-8f41-a36bbf26e266 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:39.193357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f49a-ba6f-4590-8f41-a36bbf26e266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:39.232489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-bff8f49a-ba6f-4590-8f41-a36bbf26e266 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:39.233751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bff8f49a-ba6f-4590-8f41-a36bbf26e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:39.268599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2f9df-32e4-4168-ab89-0087d84b522c tempest-QuotasAdminTestV236-571832040 tempest-QuotasAdminTestV236-571832040-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:39.356653 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1140/2276] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:39.357858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8f49a-ba6f-4590-8f41-a36bbf26e266 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:39.360390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bff8f49a-ba6f-4590-8f41-a36bbf26e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:39.373816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8f49a-ba6f-4590-8f41-a36bbf26e266 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:39.382360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17008b-8fa5-4232-b42c-aa66c9760471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:39.383101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17008b-8fa5-4232-b42c-aa66c9760471 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:39.383508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17008b-8fa5-4232-b42c-aa66c9760471 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:39.384404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17008b-8fa5-4232-b42c-aa66c9760471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:39.387030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48f563-3ab2-44a8-a1a3-2066b4d12074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:39.387959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48f563-3ab2-44a8-a1a3-2066b4d12074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:39.388822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-be17008b-8fa5-4232-b42c-aa66c9760471 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:39.389741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48f563-3ab2-44a8-a1a3-2066b4d12074 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:39.390044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48f563-3ab2-44a8-a1a3-2066b4d12074 admin admin] PATH_INFO: `/v3/users/2b8e1aa0f9034c38a5d99fd3aa70a758` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:39.394033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48f563-3ab2-44a8-a1a3-2066b4d12074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8e1aa0f9034c38a5d99fd3aa70a758)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:39.396011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48f563-3ab2-44a8-a1a3-2066b4d12074 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:39.443837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:39.469729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:39.510403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4b48f563-3ab2-44a8-a1a3-2066b4d12074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8e1aa0f9034c38a5d99fd3aa70a758'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.512768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4b48f563-3ab2-44a8-a1a3-2066b4d12074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8e1aa0f9034c38a5d99fd3aa70a758'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.543267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17008b-8fa5-4232-b42c-aa66c9760471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:39.545132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17008b-8fa5-4232-b42c-aa66c9760471 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:39.551492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4b48f563-3ab2-44a8-a1a3-2066b4d12074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8e1aa0f9034c38a5d99fd3aa70a758'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.559544 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1137/2277] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:39.560962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17008b-8fa5-4232-b42c-aa66c9760471 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:39.562732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-be17008b-8fa5-4232-b42c-aa66c9760471 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:39.581703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17008b-8fa5-4232-b42c-aa66c9760471 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:39.587809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1209b2-3295-4728-8c98-b7c13f63b34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:39.588959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1209b2-3295-4728-8c98-b7c13f63b34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:39.589584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1209b2-3295-4728-8c98-b7c13f63b34b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:39.590407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1209b2-3295-4728-8c98-b7c13f63b34b admin admin] PATH_INFO: `/v3/users/ec17d316bce743b6bff066bd3b3134da` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:39.590653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4b48f563-3ab2-44a8-a1a3-2066b4d12074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8e1aa0f9034c38a5d99fd3aa70a758'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.592343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1209b2-3295-4728-8c98-b7c13f63b34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec17d316bce743b6bff066bd3b3134da)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:39.595385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1209b2-3295-4728-8c98-b7c13f63b34b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:39.619688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4b48f563-3ab2-44a8-a1a3-2066b4d12074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8e1aa0f9034c38a5d99fd3aa70a758'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.630799 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1141/2278] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:39 2022] DELETE /identity/v3/users/2b8e1aa0f9034c38a5d99fd3aa70a758 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:39.630799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad7ee7-886c-40f1-a9d7-2d781a00ccd9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:39.630799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad7ee7-886c-40f1-a9d7-2d781a00ccd9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:39.630799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad7ee7-886c-40f1-a9d7-2d781a00ccd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:39.685801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6b1209b2-3295-4728-8c98-b7c13f63b34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec17d316bce743b6bff066bd3b3134da'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.687759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6b1209b2-3295-4728-8c98-b7c13f63b34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec17d316bce743b6bff066bd3b3134da'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.692932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0fad7ee7-886c-40f1-a9d7-2d781a00ccd9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:39.699609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0fad7ee7-886c-40f1-a9d7-2d781a00ccd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:39.709294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6b1209b2-3295-4728-8c98-b7c13f63b34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec17d316bce743b6bff066bd3b3134da'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.710170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6b1209b2-3295-4728-8c98-b7c13f63b34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec17d316bce743b6bff066bd3b3134da'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.721915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6b1209b2-3295-4728-8c98-b7c13f63b34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec17d316bce743b6bff066bd3b3134da'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:39.750380 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1138/2279] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:39 2022] DELETE /identity/v3/users/ec17d316bce743b6bff066bd3b3134da => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:39.758030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6de03-cce6-4d9c-be2f-77afe52d1039 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:39.759238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6de03-cce6-4d9c-be2f-77afe52d1039 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:39.759581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6de03-cce6-4d9c-be2f-77afe52d1039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:39.797239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8bb6de03-cce6-4d9c-be2f-77afe52d1039 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:39.800180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8bb6de03-cce6-4d9c-be2f-77afe52d1039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:39.843453 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1142/2280] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:39.846794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f727-4466-45f6-8cd8-feb34282d815 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:39.847117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f727-4466-45f6-8cd8-feb34282d815 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:39.847760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f727-4466-45f6-8cd8-feb34282d815 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:39.851260 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1143/2281] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:26:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:39.852494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931f727-4466-45f6-8cd8-feb34282d815 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:39.854980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b931f727-4466-45f6-8cd8-feb34282d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:39.917537 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1139/2282] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:39.919237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f4391-2943-4871-a7c7-f8b147521ae3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:39.919540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f4391-2943-4871-a7c7-f8b147521ae3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:39.919801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f4391-2943-4871-a7c7-f8b147521ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:39.954436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-db9f4391-2943-4871-a7c7-f8b147521ae3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:39.956531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-db9f4391-2943-4871-a7c7-f8b147521ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:39.965923 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1140/2283] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:39.969171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa842a-2cef-4ed6-be9b-28041c24a5b1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:39.969171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa842a-2cef-4ed6-be9b-28041c24a5b1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:39.969171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa842a-2cef-4ed6-be9b-28041c24a5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:39.981022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931f727-4466-45f6-8cd8-feb34282d815 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:39.988508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:39.989322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:39.989695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:39.990056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] PATH_INFO: `/v3/users/32ae3b30b8274ef183d20f1631ab3322` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:39.992995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ae3b30b8274ef183d20f1631ab3322)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:39.995316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:39.995833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-41fa842a-2cef-4ed6-be9b-28041c24a5b1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:39.997554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-41fa842a-2cef-4ed6-be9b-28041c24a5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.006613 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1141/2284] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:40.007597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa842a-2cef-4ed6-be9b-28041c24a5b1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.014548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-41fa842a-2cef-4ed6-be9b-28041c24a5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.027958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa842a-2cef-4ed6-be9b-28041c24a5b1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.040462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ccdcb-503b-4651-aa8e-b8af31cb3be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.041505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccdcb-503b-4651-aa8e-b8af31cb3be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.041778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccdcb-503b-4651-aa8e-b8af31cb3be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.042116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccdcb-503b-4651-aa8e-b8af31cb3be1 admin admin] PATH_INFO: `/v3/users/d932721340b9432a80b70b361dc1b644` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.044149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ccdcb-503b-4651-aa8e-b8af31cb3be1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d932721340b9432a80b70b361dc1b644)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.046697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ccdcb-503b-4651-aa8e-b8af31cb3be1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.051221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:40.063807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ae3b30b8274ef183d20f1631ab3322'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.065420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ae3b30b8274ef183d20f1631ab3322'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.089785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:40.090575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ae3b30b8274ef183d20f1631ab3322'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.109528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ae3b30b8274ef183d20f1631ab3322'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.122198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ae3b30b8274ef183d20f1631ab3322'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.132463 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1144/2285] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:39 2022] DELETE /identity/v3/users/32ae3b30b8274ef183d20f1631ab3322 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:40.133301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-264ccdcb-503b-4651-aa8e-b8af31cb3be1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd932721340b9432a80b70b361dc1b644'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.134165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-264ccdcb-503b-4651-aa8e-b8af31cb3be1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd932721340b9432a80b70b361dc1b644'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.134415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.136288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.150392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-264ccdcb-503b-4651-aa8e-b8af31cb3be1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd932721340b9432a80b70b361dc1b644'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.151751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-264ccdcb-503b-4651-aa8e-b8af31cb3be1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd932721340b9432a80b70b361dc1b644'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.163000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-264ccdcb-503b-4651-aa8e-b8af31cb3be1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd932721340b9432a80b70b361dc1b644'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.177511 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1142/2286] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:40 2022] DELETE /identity/v3/users/d932721340b9432a80b70b361dc1b644 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:40.178945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93e4e7-5c62-41dd-b376-9bb64ed61c42 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.179629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93e4e7-5c62-41dd-b376-9bb64ed61c42 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.179906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93e4e7-5c62-41dd-b376-9bb64ed61c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.203374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5f93e4e7-5c62-41dd-b376-9bb64ed61c42 None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:40.204639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5f93e4e7-5c62-41dd-b376-9bb64ed61c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.214831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f409ae-7ff8-4342-a318-2ee73d4f5edd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.265677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8d221-a6fc-4ab0-b139-4941403c41fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.266956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d221-a6fc-4ab0-b139-4941403c41fe service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.267243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d221-a6fc-4ab0-b139-4941403c41fe service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.267530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d221-a6fc-4ab0-b139-4941403c41fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.269331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dea8d221-a6fc-4ab0-b139-4941403c41fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.274066 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1143/2287] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:40.280386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93e4e7-5c62-41dd-b376-9bb64ed61c42 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.281852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5f93e4e7-5c62-41dd-b376-9bb64ed61c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.345560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8d221-a6fc-4ab0-b139-4941403c41fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.347103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8d221-a6fc-4ab0-b139-4941403c41fe service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.357516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93e4e7-5c62-41dd-b376-9bb64ed61c42 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.358071 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1145/2288] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:40.358849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8d221-a6fc-4ab0-b139-4941403c41fe service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.360803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dea8d221-a6fc-4ab0-b139-4941403c41fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.364267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927fb79-35e8-4024-900e-41372b5fb1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.365138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927fb79-35e8-4024-900e-41372b5fb1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.365612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927fb79-35e8-4024-900e-41372b5fb1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.366043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927fb79-35e8-4024-900e-41372b5fb1c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.366852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927fb79-35e8-4024-900e-41372b5fb1c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:40.367303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927fb79-35e8-4024-900e-41372b5fb1c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.369194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927fb79-35e8-4024-900e-41372b5fb1c1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.386330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8d221-a6fc-4ab0-b139-4941403c41fe service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.386813 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1144/2289] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:40.386813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927fb79-35e8-4024-900e-41372b5fb1c1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.390241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf59d0-add6-46ee-a388-6e5b070f44a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.391820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf59d0-add6-46ee-a388-6e5b070f44a4 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.393540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf59d0-add6-46ee-a388-6e5b070f44a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.394044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf59d0-add6-46ee-a388-6e5b070f44a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.397248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927fb79-35e8-4024-900e-41372b5fb1c1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.397949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-61bf59d0-add6-46ee-a388-6e5b070f44a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.402045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ae14b-ed8e-4bf4-a0ab-4473882f03ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.402747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae14b-ed8e-4bf4-a0ab-4473882f03ff service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.403101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae14b-ed8e-4bf4-a0ab-4473882f03ff service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.403469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae14b-ed8e-4bf4-a0ab-4473882f03ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.406007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-732ae14b-ed8e-4bf4-a0ab-4473882f03ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.420860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ae14b-ed8e-4bf4-a0ab-4473882f03ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.422686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ae14b-ed8e-4bf4-a0ab-4473882f03ff service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.423977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf59d0-add6-46ee-a388-6e5b070f44a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.427393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf59d0-add6-46ee-a388-6e5b070f44a4 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.433948 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1145/2290] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:40.435353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727e95b-7ca8-4310-a358-9957e8f6f587 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.435644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727e95b-7ca8-4310-a358-9957e8f6f587 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.435922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727e95b-7ca8-4310-a358-9957e8f6f587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.466555 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1146/2291] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:40.469412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca492e-dd5a-467e-b9e3-ff1846fc0a46 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.470488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca492e-dd5a-467e-b9e3-ff1846fc0a46 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.471072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca492e-dd5a-467e-b9e3-ff1846fc0a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.473501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0727e95b-7ca8-4310-a358-9957e8f6f587 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:40.476954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0727e95b-7ca8-4310-a358-9957e8f6f587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.498146 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1146/2292] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:40.499146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727e95b-7ca8-4310-a358-9957e8f6f587 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.503736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:40.510937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0727e95b-7ca8-4310-a358-9957e8f6f587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.518363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-74ca492e-dd5a-467e-b9e3-ff1846fc0a46 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:40.528441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-74ca492e-dd5a-467e-b9e3-ff1846fc0a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.543496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727e95b-7ca8-4310-a358-9957e8f6f587 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.554305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4187fd-e449-44fb-b459-78372eb965f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.555184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4187fd-e449-44fb-b459-78372eb965f9 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.555965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4187fd-e449-44fb-b459-78372eb965f9 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.556443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4187fd-e449-44fb-b459-78372eb965f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.561273 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1147/2293] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:40.561273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca492e-dd5a-467e-b9e3-ff1846fc0a46 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.567194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:40.570658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4187fd-e449-44fb-b459-78372eb965f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.572536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4187fd-e449-44fb-b459-78372eb965f9 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.575507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca492e-dd5a-467e-b9e3-ff1846fc0a46 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.586901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c390fa-aac9-4578-91d8-1e98bfb4e151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.587883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c390fa-aac9-4578-91d8-1e98bfb4e151 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.588328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c390fa-aac9-4578-91d8-1e98bfb4e151 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.588735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c390fa-aac9-4578-91d8-1e98bfb4e151 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.589709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c390fa-aac9-4578-91d8-1e98bfb4e151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.591221 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1147/2294] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:40.592490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4187fd-e449-44fb-b459-78372eb965f9 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.605852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c390fa-aac9-4578-91d8-1e98bfb4e151 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.610026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4187fd-e449-44fb-b459-78372eb965f9 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.615773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7e491-813e-4fd8-9f4b-4513bea98639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.616587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7e491-813e-4fd8-9f4b-4513bea98639 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.616949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7e491-813e-4fd8-9f4b-4513bea98639 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.617378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7e491-813e-4fd8-9f4b-4513bea98639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.633324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7e491-813e-4fd8-9f4b-4513bea98639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.635849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7e491-813e-4fd8-9f4b-4513bea98639 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.652881 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1148/2295] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:40.654191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7e491-813e-4fd8-9f4b-4513bea98639 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.664176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7e491-813e-4fd8-9f4b-4513bea98639 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.668913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf9c18-f6c5-406a-ba44-235fcee06365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.669892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9c18-f6c5-406a-ba44-235fcee06365 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.670352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9c18-f6c5-406a-ba44-235fcee06365 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.670900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9c18-f6c5-406a-ba44-235fcee06365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.672426 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1148/2296] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:40 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:40.676644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c390fa-aac9-4578-91d8-1e98bfb4e151 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.690017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf9c18-f6c5-406a-ba44-235fcee06365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.691814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf9c18-f6c5-406a-ba44-235fcee06365 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.715895 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1149/2297] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:40.770369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c390fa-aac9-4578-91d8-1e98bfb4e151 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.777567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200274cf-9fc3-48bf-b4d5-4213edb06b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.778174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200274cf-9fc3-48bf-b4d5-4213edb06b3f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.778458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200274cf-9fc3-48bf-b4d5-4213edb06b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.778736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200274cf-9fc3-48bf-b4d5-4213edb06b3f admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.779783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200274cf-9fc3-48bf-b4d5-4213edb06b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.782731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200274cf-9fc3-48bf-b4d5-4213edb06b3f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.814644 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1149/2298] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:40 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:40.816216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf9c18-f6c5-406a-ba44-235fcee06365 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.818024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-57cf9c18-f6c5-406a-ba44-235fcee06365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:40.827691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200274cf-9fc3-48bf-b4d5-4213edb06b3f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.839145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf9c18-f6c5-406a-ba44-235fcee06365 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.842615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200274cf-9fc3-48bf-b4d5-4213edb06b3f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.850293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.851018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.851442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.852072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] PATH_INFO: `/v3/projects/f3ee15fab1284e2c90c55aad176c6604` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.853375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ee15fab1284e2c90c55aad176c6604)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.855966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.857059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458671a-0abb-4aa2-945a-21674ca6b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.857997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458671a-0abb-4aa2-945a-21674ca6b2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.858362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458671a-0abb-4aa2-945a-21674ca6b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.858826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458671a-0abb-4aa2-945a-21674ca6b2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.860750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458671a-0abb-4aa2-945a-21674ca6b2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.863921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458671a-0abb-4aa2-945a-21674ca6b2f9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.875393 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1150/2299] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:40.879468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458671a-0abb-4aa2-945a-21674ca6b2f9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.891389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458671a-0abb-4aa2-945a-21674ca6b2f9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.896556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1c4b5-7cde-4fb4-a8be-c2ca1f20b909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:40.897199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1c4b5-7cde-4fb4-a8be-c2ca1f20b909 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:40.897510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1c4b5-7cde-4fb4-a8be-c2ca1f20b909 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:40.897786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1c4b5-7cde-4fb4-a8be-c2ca1f20b909 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:40.898503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1c4b5-7cde-4fb4-a8be-c2ca1f20b909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:40.900134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1c4b5-7cde-4fb4-a8be-c2ca1f20b909 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:40.916508 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1151/2300] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:26:40.921196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1c4b5-7cde-4fb4-a8be-c2ca1f20b909 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.940001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1c4b5-7cde-4fb4-a8be-c2ca1f20b909 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:40.941431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ee15fab1284e2c90c55aad176c6604', 'request_id': 'req-0e283200-08ac-4277-b106-254d240f0949'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.952676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ee15fab1284e2c90c55aad176c6604', 'request_id': 'req-0e283200-08ac-4277-b106-254d240f0949'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.962618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ee15fab1284e2c90c55aad176c6604', 'request_id': 'req-0e283200-08ac-4277-b106-254d240f0949'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.980966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] The token cache is being invalidate because project f3ee15fab1284e2c90c55aad176c6604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:40.981310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.982865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:40.984483 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1150/2301] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:40 2022] DELETE /identity/v3/projects/f3ee15fab1284e2c90c55aad176c6604 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:40.990130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:40.992102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:41.062394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a3c3-a946-4959-8236-2c73714960bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:41.063676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a3c3-a946-4959-8236-2c73714960bc admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:41.064093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a3c3-a946-4959-8236-2c73714960bc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:41.064693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a3c3-a946-4959-8236-2c73714960bc admin admin] PATH_INFO: `/v3/projects/bd61633b44584714922d96fb45e99df3/users/d82a2ce4c0e94e43b108755ebd7ccda0/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:41.084853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e283200-08ac-4277-b106-254d240f0949 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:41.091286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:41.092247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:41.092820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:41.093191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] PATH_INFO: `/v3/users/09c772e20c9d4b71b5565a0412958818` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:41.095618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c772e20c9d4b71b5565a0412958818)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:41.098089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:41.103110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6a3c3-a946-4959-8236-2c73714960bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd61633b44584714922d96fb45e99df3, user_id=d82a2ce4c0e94e43b108755ebd7ccda0, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:41.111413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6a3c3-a946-4959-8236-2c73714960bc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:41.176236 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1152/2302] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:40 2022] PUT /identity/v3/projects/bd61633b44584714922d96fb45e99df3/users/d82a2ce4c0e94e43b108755ebd7ccda0/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:41.176839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c772e20c9d4b71b5565a0412958818'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:41.176839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c772e20c9d4b71b5565a0412958818'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:41.179035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:41.181636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7760fe4-9ca2-4a61-bfc0-52bdc6fbf8ae None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:41.182308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7760fe4-9ca2-4a61-bfc0-52bdc6fbf8ae None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:41.182837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7760fe4-9ca2-4a61-bfc0-52bdc6fbf8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:41.192535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c772e20c9d4b71b5565a0412958818'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:41.193893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c772e20c9d4b71b5565a0412958818'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:41.207819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c772e20c9d4b71b5565a0412958818'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:41.233941 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1151/2303] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:40 2022] DELETE /identity/v3/users/09c772e20c9d4b71b5565a0412958818 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:41.251291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c7760fe4-9ca2-4a61-bfc0-52bdc6fbf8ae None None] MFA Rules not processed for user `d82a2ce4c0e94e43b108755ebd7ccda0`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:41.253774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c7760fe4-9ca2-4a61-bfc0-52bdc6fbf8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:41.294561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:41.430770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:41.432951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:41.434429 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1153/2304] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:41.441428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7760fe4-9ca2-4a61-bfc0-52bdc6fbf8ae None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:41.443156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c7760fe4-9ca2-4a61-bfc0-52bdc6fbf8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:41.569902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7760fe4-9ca2-4a61-bfc0-52bdc6fbf8ae None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:41.584603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c48fe9-d0ca-44d5-a389-7549102b0060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:41.585241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c48fe9-d0ca-44d5-a389-7549102b0060 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:41.585557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c48fe9-d0ca-44d5-a389-7549102b0060 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:41.585834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c48fe9-d0ca-44d5-a389-7549102b0060 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:41.586502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c48fe9-d0ca-44d5-a389-7549102b0060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:41.588539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c48fe9-d0ca-44d5-a389-7549102b0060 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:41.611509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ed990-ed73-4b02-a63e-6a7af1392972 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:41.621502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:41.621900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:41.622359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:41.622634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] PATH_INFO: `/v3/projects/9165cdc861b94445bfa9d491e4ebc85c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:41.626057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9165cdc861b94445bfa9d491e4ebc85c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:41.629318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:41.653274 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1154/2305] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:41 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:41.654457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c48fe9-d0ca-44d5-a389-7549102b0060 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:41.656169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-02c48fe9-d0ca-44d5-a389-7549102b0060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:41.728177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9165cdc861b94445bfa9d491e4ebc85c', 'request_id': 'req-3293c172-f260-41cd-86ad-a2d2aaef3ea0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:41.745107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9165cdc861b94445bfa9d491e4ebc85c', 'request_id': 'req-3293c172-f260-41cd-86ad-a2d2aaef3ea0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:41.766102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9165cdc861b94445bfa9d491e4ebc85c', 'request_id': 'req-3293c172-f260-41cd-86ad-a2d2aaef3ea0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:41.768347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c48fe9-d0ca-44d5-a389-7549102b0060 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:41.785841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] The token cache is being invalidate because project 9165cdc861b94445bfa9d491e4ebc85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:41.785841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:41.785841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:41.791135 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1152/2306] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:41 2022] DELETE /identity/v3/projects/9165cdc861b94445bfa9d491e4ebc85c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:26:41.792403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:41.794775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:41.834553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:41.869489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:41.870497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:41.871144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:41.871726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] PATH_INFO: `/v3/projects/ed82cd2c42b44f94a84f0c56a0aa66cb` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:41.873724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed82cd2c42b44f94a84f0c56a0aa66cb)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:41.877472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:41.899989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293c172-f260-41cd-86ad-a2d2aaef3ea0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:41.909682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb28361-9d9c-4599-9fb4-759549e9ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:41.910595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb28361-9d9c-4599-9fb4-759549e9ba3f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:41.910900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb28361-9d9c-4599-9fb4-759549e9ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:41.911785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb28361-9d9c-4599-9fb4-759549e9ba3f admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:41.912599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb28361-9d9c-4599-9fb4-759549e9ba3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:41.914937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb28361-9d9c-4599-9fb4-759549e9ba3f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:41.931089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:41.954190 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1153/2307] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:41 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:41.955122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb28361-9d9c-4599-9fb4-759549e9ba3f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:41.956940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ffb28361-9d9c-4599-9fb4-759549e9ba3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:41.972604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb28361-9d9c-4599-9fb4-759549e9ba3f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:41.997288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed82cd2c42b44f94a84f0c56a0aa66cb', 'request_id': 'req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.006831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed82cd2c42b44f94a84f0c56a0aa66cb', 'request_id': 'req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.023944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed82cd2c42b44f94a84f0c56a0aa66cb', 'request_id': 'req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.039819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] The token cache is being invalidate because project ed82cd2c42b44f94a84f0c56a0aa66cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:42.040140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.040951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.042614 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1155/2308] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:41 2022] DELETE /identity/v3/projects/ed82cd2c42b44f94a84f0c56a0aa66cb => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:42.043743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:42.045181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:42.079479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:42.080143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:42.080421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:42.080695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] PATH_INFO: `/v3/projects/44ce50453878420baa186ecda9e20aa7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:42.082074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ce50453878420baa186ecda9e20aa7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:42.084050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:42.153485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca438ef7-9f3f-451e-bd37-3d78fd1fc790 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:42.169637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ce50453878420baa186ecda9e20aa7', 'request_id': 'req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.187447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ce50453878420baa186ecda9e20aa7', 'request_id': 'req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.207373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ce50453878420baa186ecda9e20aa7', 'request_id': 'req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.242507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] The token cache is being invalidate because project 44ce50453878420baa186ecda9e20aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:42.242947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.244213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.249450 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1154/2309] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:41 2022] DELETE /identity/v3/projects/44ce50453878420baa186ecda9e20aa7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:42.249450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:42.253169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:42.266489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:42.267172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:42.267763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:42.268067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] PATH_INFO: `/v3/users/ac53d9f1203a42e6ab38f2ef0816aeb8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:42.270673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac53d9f1203a42e6ab38f2ef0816aeb8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:42.272885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:42.354106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:42.378335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafba8fc-b1ba-4e6e-97e8-86f7d15bab2b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:42.387413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:42.388524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:42.388945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:42.389202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] PATH_INFO: `/v3/projects/ce262e4887af455d9ad4c2a366e4d2e3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:42.390904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce262e4887af455d9ad4c2a366e4d2e3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:42.394993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:42.402924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac53d9f1203a42e6ab38f2ef0816aeb8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.405178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac53d9f1203a42e6ab38f2ef0816aeb8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.447808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:42.454901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac53d9f1203a42e6ab38f2ef0816aeb8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.475652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac53d9f1203a42e6ab38f2ef0816aeb8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.495768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac53d9f1203a42e6ab38f2ef0816aeb8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.508445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce262e4887af455d9ad4c2a366e4d2e3', 'request_id': 'req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.512371 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1156/2310] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:42 2022] DELETE /identity/v3/users/ac53d9f1203a42e6ab38f2ef0816aeb8 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:42.512371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:42.514778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:42.525004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce262e4887af455d9ad4c2a366e4d2e3', 'request_id': 'req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.550884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce262e4887af455d9ad4c2a366e4d2e3', 'request_id': 'req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.567148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] The token cache is being invalidate because project ce262e4887af455d9ad4c2a366e4d2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:42.568564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.569801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.572117 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1155/2311] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:42 2022] DELETE /identity/v3/projects/ce262e4887af455d9ad4c2a366e4d2e3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:42.573307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:42.575068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:42.673056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858dd7f-eed4-4d99-b786-a087ffb0e7ad admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:42.692111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:42.693422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:42.693727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014517fb-69d2-4ba5-bcda-d5ea86114c66 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:42.694643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:42.696699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] PATH_INFO: `/v3/users/f3b5f23e54f94c3db5599cdf95c98bcd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:42.699365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b5f23e54f94c3db5599cdf95c98bcd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:42.701088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c4d87-95e2-43c0-9cfa-a2f0935a4633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:42.701935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4d87-95e2-43c0-9cfa-a2f0935a4633 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:42.702283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4d87-95e2-43c0-9cfa-a2f0935a4633 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:42.702621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4d87-95e2-43c0-9cfa-a2f0935a4633 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:42.703341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c4d87-95e2-43c0-9cfa-a2f0935a4633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:42.705053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:42.706503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c4d87-95e2-43c0-9cfa-a2f0935a4633 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:42.721623 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1157/2312] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:42.724150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c4d87-95e2-43c0-9cfa-a2f0935a4633 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:42.726200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4b6c4d87-95e2-43c0-9cfa-a2f0935a4633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:42.741271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c4d87-95e2-43c0-9cfa-a2f0935a4633 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:42.747294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:42.748032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:42.748436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:42.748716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] PATH_INFO: `/v3/users/b5ae7d5674674760911c699a4585c0eb` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:42.750053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ae7d5674674760911c699a4585c0eb)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:42.752177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:42.816169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b5f23e54f94c3db5599cdf95c98bcd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.817069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b5f23e54f94c3db5599cdf95c98bcd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.834257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ae7d5674674760911c699a4585c0eb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.835059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ae7d5674674760911c699a4585c0eb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.851719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b5f23e54f94c3db5599cdf95c98bcd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.852583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b5f23e54f94c3db5599cdf95c98bcd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.859942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ae7d5674674760911c699a4585c0eb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.881505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b5f23e54f94c3db5599cdf95c98bcd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.881819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ae7d5674674760911c699a4585c0eb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.893028 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1156/2313] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:42 2022] DELETE /identity/v3/users/f3b5f23e54f94c3db5599cdf95c98bcd => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:42.896233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:42.899931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ae7d5674674760911c699a4585c0eb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:42.900189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:42.923751 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1158/2314] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:42 2022] DELETE /identity/v3/users/b5ae7d5674674760911c699a4585c0eb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:42.925427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:42.927641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:42.980617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:42.990290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:43.084774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e2aa1-6718-4543-8b5e-9b4a0768ee7e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:43.112346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e017b0-b459-4e0b-822c-3e0136c0951d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:43.123556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:43.125067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:43.126280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:43.126726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] PATH_INFO: `/v3/users/7224d95ff4c249a5bee937c2e805b5d2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:43.128659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7224d95ff4c249a5bee937c2e805b5d2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:43.132296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:43.238656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7224d95ff4c249a5bee937c2e805b5d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.239857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7224d95ff4c249a5bee937c2e805b5d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.269608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7224d95ff4c249a5bee937c2e805b5d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.275786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:43.276554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:43.276835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:43.277106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] PATH_INFO: `/v3/projects/85bf30f6e95d46a786d3455606f6d0ec` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:43.279438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bf30f6e95d46a786d3455606f6d0ec)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:43.280384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7224d95ff4c249a5bee937c2e805b5d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.282299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:43.290896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7224d95ff4c249a5bee937c2e805b5d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.305558 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1159/2315] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:42 2022] DELETE /identity/v3/users/7224d95ff4c249a5bee937c2e805b5d2 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:43.306753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:43.308461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:43.394527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd174ab-7739-4416-877e-a449536196cf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:43.418137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bf30f6e95d46a786d3455606f6d0ec', 'request_id': 'req-d67ce285-955d-4ad7-ba59-ef700947e997'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.439115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bf30f6e95d46a786d3455606f6d0ec', 'request_id': 'req-d67ce285-955d-4ad7-ba59-ef700947e997'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.450169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bf30f6e95d46a786d3455606f6d0ec', 'request_id': 'req-d67ce285-955d-4ad7-ba59-ef700947e997'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.464613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] The token cache is being invalidate because project 85bf30f6e95d46a786d3455606f6d0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:43.465190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.465515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:43.467083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d67ce285-955d-4ad7-ba59-ef700947e997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.469540 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1157/2316] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:42 2022] DELETE /identity/v3/projects/85bf30f6e95d46a786d3455606f6d0ec => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:43.476576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb15223-51c8-4ce2-96a0-a45f36160908 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:43.476861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb15223-51c8-4ce2-96a0-a45f36160908 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:43.477132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb15223-51c8-4ce2-96a0-a45f36160908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:43.508016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52de36-2ecb-4516-a627-072e3acc243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:43.509251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52de36-2ecb-4516-a627-072e3acc243b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:43.510037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52de36-2ecb-4516-a627-072e3acc243b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:43.511303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52de36-2ecb-4516-a627-072e3acc243b admin admin] PATH_INFO: `/v3/projects/5c42d60b0db747d09e12fa554e0eb2e1/users/f5757d8d8b35489984ab6cef2a165ce8/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:43.525652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cfb15223-51c8-4ce2-96a0-a45f36160908 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:43.527122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cfb15223-51c8-4ce2-96a0-a45f36160908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:43.546737 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1158/2317] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:43.551997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecd45e-bdec-41a4-95b8-cd73551a073f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:43.553135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecd45e-bdec-41a4-95b8-cd73551a073f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:43.553666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecd45e-bdec-41a4-95b8-cd73551a073f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:43.574370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52de36-2ecb-4516-a627-072e3acc243b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c42d60b0db747d09e12fa554e0eb2e1, user_id=f5757d8d8b35489984ab6cef2a165ce8, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:43.578429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52de36-2ecb-4516-a627-072e3acc243b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:43.600483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-15ecd45e-bdec-41a4-95b8-cd73551a073f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:43.601805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-15ecd45e-bdec-41a4-95b8-cd73551a073f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:43.611473 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1160/2318] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:43 2022] PUT /identity/v3/projects/5c42d60b0db747d09e12fa554e0eb2e1/users/f5757d8d8b35489984ab6cef2a165ce8/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:43.614259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52de36-2ecb-4516-a627-072e3acc243b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:43.616531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de52de36-2ecb-4516-a627-072e3acc243b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:43.700539 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1159/2319] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:43.706372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecd45e-bdec-41a4-95b8-cd73551a073f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:43.709246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:43.729719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecd45e-bdec-41a4-95b8-cd73551a073f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:43.748365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b66b-472c-4999-acc4-3c45acaa60e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:43.748974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b66b-472c-4999-acc4-3c45acaa60e9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:43.749258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b66b-472c-4999-acc4-3c45acaa60e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:43.749689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b66b-472c-4999-acc4-3c45acaa60e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:43.750351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056b66b-472c-4999-acc4-3c45acaa60e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:43.750663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056b66b-472c-4999-acc4-3c45acaa60e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:43.755186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056b66b-472c-4999-acc4-3c45acaa60e9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:43.767835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52de36-2ecb-4516-a627-072e3acc243b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:43.777863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4745c-8cfe-437f-8431-fc75658d744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:43.778273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4745c-8cfe-437f-8431-fc75658d744f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:43.778539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4745c-8cfe-437f-8431-fc75658d744f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:43.779045 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1160/2320] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:26:43.779153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4745c-8cfe-437f-8431-fc75658d744f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:43.779720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4745c-8cfe-437f-8431-fc75658d744f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:43.780013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b66b-472c-4999-acc4-3c45acaa60e9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:43.781340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4745c-8cfe-437f-8431-fc75658d744f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:43.782593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d056b66b-472c-4999-acc4-3c45acaa60e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:43.804800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b66b-472c-4999-acc4-3c45acaa60e9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:43.816412 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1161/2321] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:43.816412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4745c-8cfe-437f-8431-fc75658d744f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:43.819867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:43.820611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:43.821052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:43.821352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] PATH_INFO: `/v3/projects/f566e934ade44c1bbdd35f7697692a4e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:43.822991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f566e934ade44c1bbdd35f7697692a4e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:43.826507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4745c-8cfe-437f-8431-fc75658d744f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:43.826942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:43.833416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61d14b-35c6-4580-8e8a-bc2b6e1f1a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:43.834046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d14b-35c6-4580-8e8a-bc2b6e1f1a12 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:43.834326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d14b-35c6-4580-8e8a-bc2b6e1f1a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:43.834601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d14b-35c6-4580-8e8a-bc2b6e1f1a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:43.835247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61d14b-35c6-4580-8e8a-bc2b6e1f1a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:43.838695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61d14b-35c6-4580-8e8a-bc2b6e1f1a12 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:43.876435 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1162/2322] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:43 2022] POST /identity/v3/projects => generated 401 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:43.877425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61d14b-35c6-4580-8e8a-bc2b6e1f1a12 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:43.879138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ce61d14b-35c6-4580-8e8a-bc2b6e1f1a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:43.937119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f566e934ade44c1bbdd35f7697692a4e', 'request_id': 'req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.948423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f566e934ade44c1bbdd35f7697692a4e', 'request_id': 'req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.959986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f566e934ade44c1bbdd35f7697692a4e', 'request_id': 'req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.975977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] The token cache is being invalidate because project f566e934ade44c1bbdd35f7697692a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:43.976236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.977349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:43.979823 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1161/2323] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:43 2022] DELETE /identity/v3/projects/f566e934ade44c1bbdd35f7697692a4e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:43.979823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:43.981750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:43.990556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61d14b-35c6-4580-8e8a-bc2b6e1f1a12 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:44.050560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:44.071005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:44.071790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.072209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.072400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] PATH_INFO: `/v3/projects/866a5b0d5b3542d88cc9300086da8d06` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.073854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] RBAC: Authorizing `identity:delete_project(project_id=866a5b0d5b3542d88cc9300086da8d06)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:44.076076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:44.089337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d2579-8f2b-4da1-98f4-8dac1d59bf63 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:44.094826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:44.095827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.096060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.096372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] PATH_INFO: `/v3/projects/7f83c0c32c354d19ae1aa4b2af640f5c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.097774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f83c0c32c354d19ae1aa4b2af640f5c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:44.099904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:44.156659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866a5b0d5b3542d88cc9300086da8d06', 'request_id': 'req-7cd80614-8259-4b89-831e-2c2f4852e19a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.167501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866a5b0d5b3542d88cc9300086da8d06', 'request_id': 'req-7cd80614-8259-4b89-831e-2c2f4852e19a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.169671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f83c0c32c354d19ae1aa4b2af640f5c', 'request_id': 'req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.177696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866a5b0d5b3542d88cc9300086da8d06', 'request_id': 'req-7cd80614-8259-4b89-831e-2c2f4852e19a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.181697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f83c0c32c354d19ae1aa4b2af640f5c', 'request_id': 'req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.190391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] The token cache is being invalidate because project 866a5b0d5b3542d88cc9300086da8d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:44.190709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.191596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.193477 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1163/2324] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:43 2022] DELETE /identity/v3/projects/866a5b0d5b3542d88cc9300086da8d06 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:44.194801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f83c0c32c354d19ae1aa4b2af640f5c', 'request_id': 'req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.199461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:44.201415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.211142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] The token cache is being invalidate because project 7f83c0c32c354d19ae1aa4b2af640f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:44.211375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.212059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.213726 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1162/2325] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:43 2022] DELETE /identity/v3/projects/7f83c0c32c354d19ae1aa4b2af640f5c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:44.214469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:44.215803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.221122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:44.285827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd80614-8259-4b89-831e-2c2f4852e19a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:44.291502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65088a3-062c-4bc9-9ac3-320a5414a518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:44.292297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65088a3-062c-4bc9-9ac3-320a5414a518 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.292652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65088a3-062c-4bc9-9ac3-320a5414a518 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.293005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65088a3-062c-4bc9-9ac3-320a5414a518 admin admin] PATH_INFO: `/v3/projects/5c42d60b0db747d09e12fa554e0eb2e1/users/f5757d8d8b35489984ab6cef2a165ce8/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.295528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65088a3-062c-4bc9-9ac3-320a5414a518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c42d60b0db747d09e12fa554e0eb2e1, user_id=f5757d8d8b35489984ab6cef2a165ce8, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:44.299004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65088a3-062c-4bc9-9ac3-320a5414a518 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:44.299925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca841d-ed3b-453e-a0b3-4044f81f1f2e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:44.304869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d292e35-31e4-467e-b183-25ec10432784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:44.305592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d292e35-31e4-467e-b183-25ec10432784 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.305986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d292e35-31e4-467e-b183-25ec10432784 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.306281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d292e35-31e4-467e-b183-25ec10432784 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.307272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d292e35-31e4-467e-b183-25ec10432784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:44.310836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d292e35-31e4-467e-b183-25ec10432784 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:44.313018 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1164/2326] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:44 2022] PUT /identity/v3/projects/5c42d60b0db747d09e12fa554e0eb2e1/users/f5757d8d8b35489984ab6cef2a165ce8/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:44.314606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352f773-4773-47e8-9525-c4723953c918 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.314885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352f773-4773-47e8-9525-c4723953c918 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.315173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352f773-4773-47e8-9525-c4723953c918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.342640 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1163/2327] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:44 2022] POST /identity/v3/users => generated 301 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:44.343820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b352f773-4773-47e8-9525-c4723953c918 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:44.343996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d292e35-31e4-467e-b183-25ec10432784 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:44.345645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b352f773-4773-47e8-9525-c4723953c918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.346453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1d292e35-31e4-467e-b183-25ec10432784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.363113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d292e35-31e4-467e-b183-25ec10432784 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:44.439153 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1165/2328] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:44.439738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2517-0d84-450c-8030-2dd43b1ffdc0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.440179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2517-0d84-450c-8030-2dd43b1ffdc0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.440678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2517-0d84-450c-8030-2dd43b1ffdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.464448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:44.465011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.465268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.465367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d0de2517-0d84-450c-8030-2dd43b1ffdc0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:44.465764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] PATH_INFO: `/v3/projects/fec309eded5a45209c21b015f17118ba` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.467404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec309eded5a45209c21b015f17118ba)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:44.467529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d0de2517-0d84-450c-8030-2dd43b1ffdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.470071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:44.482209 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1166/2329] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:44.483793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7395e-3d92-4e89-9e57-1cbccdbd21a8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.484076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7395e-3d92-4e89-9e57-1cbccdbd21a8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.484352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7395e-3d92-4e89-9e57-1cbccdbd21a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.497258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:44.511487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9cf7395e-3d92-4e89-9e57-1cbccdbd21a8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:44.513725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9cf7395e-3d92-4e89-9e57-1cbccdbd21a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.523891 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1167/2330] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:44.525260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205a59-40c7-4874-a0ee-31ea41c1e251 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.525697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205a59-40c7-4874-a0ee-31ea41c1e251 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.525974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205a59-40c7-4874-a0ee-31ea41c1e251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.537375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec309eded5a45209c21b015f17118ba', 'request_id': 'req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.551992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec309eded5a45209c21b015f17118ba', 'request_id': 'req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.558900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec309eded5a45209c21b015f17118ba', 'request_id': 'req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.566858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fd205a59-40c7-4874-a0ee-31ea41c1e251 None None] MFA Rules not processed for user `f5757d8d8b35489984ab6cef2a165ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:44.568192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fd205a59-40c7-4874-a0ee-31ea41c1e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.571142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] The token cache is being invalidate because project fec309eded5a45209c21b015f17118ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:44.571369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.572102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:44.573577 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1164/2331] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:44 2022] DELETE /identity/v3/projects/fec309eded5a45209c21b015f17118ba => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:44.574344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:44.575599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.603536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:44.650208 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1168/2332] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:44.651574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078237f-934a-4d93-b588-c80a31edbe01 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.651839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078237f-934a-4d93-b588-c80a31edbe01 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.652122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078237f-934a-4d93-b588-c80a31edbe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.653695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84fbfc-0ca1-4e10-bcde-eda39dc94cce admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:44.660630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd033873-b55c-45ad-9ad5-2cd40c245087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:44.661250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd033873-b55c-45ad-9ad5-2cd40c245087 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.661559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd033873-b55c-45ad-9ad5-2cd40c245087 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.661846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd033873-b55c-45ad-9ad5-2cd40c245087 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.662475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd033873-b55c-45ad-9ad5-2cd40c245087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:44.664288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd033873-b55c-45ad-9ad5-2cd40c245087 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:44.676410 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1165/2333] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:44.680680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48d24-1e4f-48c2-b115-e51b7c3bf86a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.680953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48d24-1e4f-48c2-b115-e51b7c3bf86a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.682102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48d24-1e4f-48c2-b115-e51b7c3bf86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.698440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9078237f-934a-4d93-b588-c80a31edbe01 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:44.701258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9078237f-934a-4d93-b588-c80a31edbe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.711298 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1169/2334] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:44.711640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a7b48d24-1e4f-48c2-b115-e51b7c3bf86a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:44.713221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc195-f8f5-40cf-a169-efec58f0d9dd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.713435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc195-f8f5-40cf-a169-efec58f0d9dd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.713852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc195-f8f5-40cf-a169-efec58f0d9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.714012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a7b48d24-1e4f-48c2-b115-e51b7c3bf86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.737712 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1166/2335] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:44.740915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-773dc195-f8f5-40cf-a169-efec58f0d9dd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:44.742133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-773dc195-f8f5-40cf-a169-efec58f0d9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.743421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa4653-1f75-4413-9170-459dd61475ea None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.743849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa4653-1f75-4413-9170-459dd61475ea None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.745314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa4653-1f75-4413-9170-459dd61475ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.754590 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1170/2336] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:44.759054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc195-f8f5-40cf-a169-efec58f0d9dd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:44.760548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-773dc195-f8f5-40cf-a169-efec58f0d9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.772942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-adaa4653-1f75-4413-9170-459dd61475ea None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:44.774207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-adaa4653-1f75-4413-9170-459dd61475ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:44.789218 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1167/2337] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:44.790131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa4653-1f75-4413-9170-459dd61475ea None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:44.807675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa4653-1f75-4413-9170-459dd61475ea None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:44.816365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d8c2f-b57d-463f-bff7-56c1fb4cf1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:44.817372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d8c2f-b57d-463f-bff7-56c1fb4cf1eb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.818183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d8c2f-b57d-463f-bff7-56c1fb4cf1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.818682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d8c2f-b57d-463f-bff7-56c1fb4cf1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.819898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d8c2f-b57d-463f-bff7-56c1fb4cf1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:44.823553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d8c2f-b57d-463f-bff7-56c1fb4cf1eb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:44.839116 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1168/2338] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:44.843984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d8c2f-b57d-463f-bff7-56c1fb4cf1eb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:44.861293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d8c2f-b57d-463f-bff7-56c1fb4cf1eb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:44.866727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31489b6-72ad-422a-a9d5-f2e489ff2a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:44.867431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31489b6-72ad-422a-a9d5-f2e489ff2a25 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.867754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31489b6-72ad-422a-a9d5-f2e489ff2a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.868034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31489b6-72ad-422a-a9d5-f2e489ff2a25 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.868701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31489b6-72ad-422a-a9d5-f2e489ff2a25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:44.869012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31489b6-72ad-422a-a9d5-f2e489ff2a25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:44.870826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31489b6-72ad-422a-a9d5-f2e489ff2a25 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:44.871786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc195-f8f5-40cf-a169-efec58f0d9dd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:44.880452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd97e9-480e-44c7-8817-62e06542b42e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:44.881210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd97e9-480e-44c7-8817-62e06542b42e service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.881607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd97e9-480e-44c7-8817-62e06542b42e service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.882069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd97e9-480e-44c7-8817-62e06542b42e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.891894 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1169/2339] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:44.891894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31489b6-72ad-422a-a9d5-f2e489ff2a25 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:44.900762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31489b6-72ad-422a-a9d5-f2e489ff2a25 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:44.901890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd97e9-480e-44c7-8817-62e06542b42e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:44.904743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd97e9-480e-44c7-8817-62e06542b42e service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:44.906363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee48985-0236-4e5c-9229-5c6ba3ebbbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:44.907685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee48985-0236-4e5c-9229-5c6ba3ebbbbb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.907973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee48985-0236-4e5c-9229-5c6ba3ebbbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.908244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee48985-0236-4e5c-9229-5c6ba3ebbbbb admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.908900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee48985-0236-4e5c-9229-5c6ba3ebbbbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:44.909203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee48985-0236-4e5c-9229-5c6ba3ebbbbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:44.911088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee48985-0236-4e5c-9229-5c6ba3ebbbbb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:44.925278 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1171/2340] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:44.926767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd97e9-480e-44c7-8817-62e06542b42e service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:44.942913 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1170/2341] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:44.943848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd97e9-480e-44c7-8817-62e06542b42e service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:44.945681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea2f5c-ed79-4e60-8d92-79167d74448d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.947279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea2f5c-ed79-4e60-8d92-79167d74448d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.947997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea2f5c-ed79-4e60-8d92-79167d74448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.957619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e9c0-2063-44d1-99a1-94bcffa1152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:44.958536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e9c0-2063-44d1-99a1-94bcffa1152a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:44.959200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e9c0-2063-44d1-99a1-94bcffa1152a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:44.959582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e9c0-2063-44d1-99a1-94bcffa1152a admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:44.960409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6e9c0-2063-44d1-99a1-94bcffa1152a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:44.960821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6e9c0-2063-44d1-99a1-94bcffa1152a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:44.962692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6e9c0-2063-44d1-99a1-94bcffa1152a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:44.988004 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1172/2342] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:44.992816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e9c0-2063-44d1-99a1-94bcffa1152a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:44.995084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b0ea2f5c-ed79-4e60-8d92-79167d74448d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:44.998183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b0ea2f5c-ed79-4e60-8d92-79167d74448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:45.010864 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1171/2343] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:45.012022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea2f5c-ed79-4e60-8d92-79167d74448d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.021548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e9c0-2063-44d1-99a1-94bcffa1152a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.034137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59c5a8-eb46-41a7-90d0-1b52e30249c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.034881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c5a8-eb46-41a7-90d0-1b52e30249c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.035164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c5a8-eb46-41a7-90d0-1b52e30249c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.035442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59c5a8-eb46-41a7-90d0-1b52e30249c3 admin admin] PATH_INFO: `/v3/projects/6e9ae755ad68447087da4df60c36c746/users/199c2a20a7e8425e8df281cfe251c880/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.038040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea2f5c-ed79-4e60-8d92-79167d74448d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.046728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef5ea9-f70e-4fac-82db-14537985cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.048876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5ea9-f70e-4fac-82db-14537985cc15 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.050324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5ea9-f70e-4fac-82db-14537985cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.051839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5ea9-f70e-4fac-82db-14537985cc15 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.052850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef5ea9-f70e-4fac-82db-14537985cc15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.056516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59c5a8-eb46-41a7-90d0-1b52e30249c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9ae755ad68447087da4df60c36c746, user_id=199c2a20a7e8425e8df281cfe251c880, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.057725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef5ea9-f70e-4fac-82db-14537985cc15 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.060100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59c5a8-eb46-41a7-90d0-1b52e30249c3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.088880 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1173/2344] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:44 2022] PUT /identity/v3/projects/6e9ae755ad68447087da4df60c36c746/users/199c2a20a7e8425e8df281cfe251c880/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:45.090023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59c5a8-eb46-41a7-90d0-1b52e30249c3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.133556 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1172/2345] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:45 2022] POST /identity/v3/projects => generated 395 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:45.135078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef5ea9-f70e-4fac-82db-14537985cc15 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.137897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:45.270004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef5ea9-f70e-4fac-82db-14537985cc15 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.276826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966c063-d4ca-46f5-babb-3bc2b14e712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.277484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966c063-d4ca-46f5-babb-3bc2b14e712f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.277772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966c063-d4ca-46f5-babb-3bc2b14e712f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.278047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966c063-d4ca-46f5-babb-3bc2b14e712f admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.278705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966c063-d4ca-46f5-babb-3bc2b14e712f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.280892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966c063-d4ca-46f5-babb-3bc2b14e712f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.285526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59c5a8-eb46-41a7-90d0-1b52e30249c3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.293710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836c0fd-182e-48c1-aaad-0515417739b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.294542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836c0fd-182e-48c1-aaad-0515417739b5 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.294927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836c0fd-182e-48c1-aaad-0515417739b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.295307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836c0fd-182e-48c1-aaad-0515417739b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.297427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836c0fd-182e-48c1-aaad-0515417739b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.303403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836c0fd-182e-48c1-aaad-0515417739b5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.345595 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1173/2346] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:45 2022] POST /identity/v3/projects => generated 403 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:45.346669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966c063-d4ca-46f5-babb-3bc2b14e712f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.359759 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1174/2347] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:45 2022] POST /identity/v3/projects => generated 377 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:45.367617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdab6b3-784b-4e0c-8ac6-e91ec96795e0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.369532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdab6b3-784b-4e0c-8ac6-e91ec96795e0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.370673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdab6b3-784b-4e0c-8ac6-e91ec96795e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.431873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2bdab6b3-784b-4e0c-8ac6-e91ec96795e0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:45.433152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2bdab6b3-784b-4e0c-8ac6-e91ec96795e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:45.437319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:45.520672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966c063-d4ca-46f5-babb-3bc2b14e712f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.554892 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1175/2348] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:45.554892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdab6b3-784b-4e0c-8ac6-e91ec96795e0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.566171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdab6b3-784b-4e0c-8ac6-e91ec96795e0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.571968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57912d4f-aee6-4054-8787-659a52063cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.572698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57912d4f-aee6-4054-8787-659a52063cab admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.573078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57912d4f-aee6-4054-8787-659a52063cab admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.573482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57912d4f-aee6-4054-8787-659a52063cab admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.574237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57912d4f-aee6-4054-8787-659a52063cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.576284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57912d4f-aee6-4054-8787-659a52063cab admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.600355 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1176/2349] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:45 2022] POST /identity/v3/users => generated 298 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:45.601587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57912d4f-aee6-4054-8787-659a52063cab admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.612705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57912d4f-aee6-4054-8787-659a52063cab admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.617716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d8f25-8123-41e5-85f6-3812586d953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.618463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d8f25-8123-41e5-85f6-3812586d953f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.618839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d8f25-8123-41e5-85f6-3812586d953f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.619228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d8f25-8123-41e5-85f6-3812586d953f admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.619977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d8f25-8123-41e5-85f6-3812586d953f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.621078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2f5e9-b110-4453-a791-b6ab11ea8efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.622163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d8f25-8123-41e5-85f6-3812586d953f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.622299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2f5e9-b110-4453-a791-b6ab11ea8efb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.622665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2f5e9-b110-4453-a791-b6ab11ea8efb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.623159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2f5e9-b110-4453-a791-b6ab11ea8efb admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.624371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2f5e9-b110-4453-a791-b6ab11ea8efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:45.624912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2f5e9-b110-4453-a791-b6ab11ea8efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.628632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2f5e9-b110-4453-a791-b6ab11ea8efb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.650946 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1177/2350] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:45 2022] POST /identity/v3/users => generated 302 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:45.650946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d8f25-8123-41e5-85f6-3812586d953f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.656182 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1174/2351] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:45.656182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2f5e9-b110-4453-a791-b6ab11ea8efb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.658559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c8a2f5e9-b110-4453-a791-b6ab11ea8efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:45.665253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d8f25-8123-41e5-85f6-3812586d953f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.676235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11872b2-6ad9-48a8-8152-23afdc0c75c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.676951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11872b2-6ad9-48a8-8152-23afdc0c75c9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.677345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11872b2-6ad9-48a8-8152-23afdc0c75c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.677713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11872b2-6ad9-48a8-8152-23afdc0c75c9 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.678252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2f5e9-b110-4453-a791-b6ab11ea8efb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.678489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11872b2-6ad9-48a8-8152-23afdc0c75c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.680573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11872b2-6ad9-48a8-8152-23afdc0c75c9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.686041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.687230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.687848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.688945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] PATH_INFO: `/v3/users/d82a2ce4c0e94e43b108755ebd7ccda0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.691095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82a2ce4c0e94e43b108755ebd7ccda0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.696012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.707849 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1178/2352] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:45 2022] POST /identity/v3/users => generated 289 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:45.708735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11872b2-6ad9-48a8-8152-23afdc0c75c9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.710780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e11872b2-6ad9-48a8-8152-23afdc0c75c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:45.768521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82a2ce4c0e94e43b108755ebd7ccda0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:45.769501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82a2ce4c0e94e43b108755ebd7ccda0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:45.784133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82a2ce4c0e94e43b108755ebd7ccda0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:45.784979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82a2ce4c0e94e43b108755ebd7ccda0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:45.788987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11872b2-6ad9-48a8-8152-23afdc0c75c9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.792464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82a2ce4c0e94e43b108755ebd7ccda0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:45.793033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75170306-e391-4491-aeb1-08fe673fdddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.793759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170306-e391-4491-aeb1-08fe673fdddd service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.794105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170306-e391-4491-aeb1-08fe673fdddd service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.794444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170306-e391-4491-aeb1-08fe673fdddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.796329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-75170306-e391-4491-aeb1-08fe673fdddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:45.806777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:45.814898 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1175/2353] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:45 2022] DELETE /identity/v3/users/d82a2ce4c0e94e43b108755ebd7ccda0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:45.816418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.818310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:45.820825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75170306-e391-4491-aeb1-08fe673fdddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.822691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75170306-e391-4491-aeb1-08fe673fdddd service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.837798 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1179/2354] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:45.839536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75170306-e391-4491-aeb1-08fe673fdddd service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.841815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-75170306-e391-4491-aeb1-08fe673fdddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:45.869880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75170306-e391-4491-aeb1-08fe673fdddd service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.881886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:45.916153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11c254-ad45-4df2-a807-c663421d9b0c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.925617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078eedbe-b3c1-42a7-a9e1-a24a2f6806c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.926199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eedbe-b3c1-42a7-a9e1-a24a2f6806c0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.926537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eedbe-b3c1-42a7-a9e1-a24a2f6806c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.926818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eedbe-b3c1-42a7-a9e1-a24a2f6806c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.927611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078eedbe-b3c1-42a7-a9e1-a24a2f6806c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.929946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078eedbe-b3c1-42a7-a9e1-a24a2f6806c0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.958212 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1176/2355] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:45.958212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078eedbe-b3c1-42a7-a9e1-a24a2f6806c0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:45.962480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-078eedbe-b3c1-42a7-a9e1-a24a2f6806c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:45.980972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81820707-4571-4d8b-9b2d-8ad7be093f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.981881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81820707-4571-4d8b-9b2d-8ad7be093f9a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.981881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81820707-4571-4d8b-9b2d-8ad7be093f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.982176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81820707-4571-4d8b-9b2d-8ad7be093f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.982886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81820707-4571-4d8b-9b2d-8ad7be093f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:45.984489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81820707-4571-4d8b-9b2d-8ad7be093f9a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:45.987874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078eedbe-b3c1-42a7-a9e1-a24a2f6806c0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:45.993407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff96b29-343c-4073-b2c8-4bfff9b61d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:45.994245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96b29-343c-4073-b2c8-4bfff9b61d60 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:45.994583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96b29-343c-4073-b2c8-4bfff9b61d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:45.994959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96b29-343c-4073-b2c8-4bfff9b61d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:45.995872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff96b29-343c-4073-b2c8-4bfff9b61d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:46.002256 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1180/2356] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:46.002562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff96b29-343c-4073-b2c8-4bfff9b61d60 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:46.002730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81820707-4571-4d8b-9b2d-8ad7be093f9a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:46.003892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-81820707-4571-4d8b-9b2d-8ad7be093f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:46.018454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81820707-4571-4d8b-9b2d-8ad7be093f9a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:46.024495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60529c91-349d-4860-b62b-f615a4966e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:46.025135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60529c91-349d-4860-b62b-f615a4966e28 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.025967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60529c91-349d-4860-b62b-f615a4966e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.025967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60529c91-349d-4860-b62b-f615a4966e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.026545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60529c91-349d-4860-b62b-f615a4966e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:46.028266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60529c91-349d-4860-b62b-f615a4966e28 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:46.040118 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1177/2357] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:45 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:46.040118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b34d4-9800-46ba-a7f5-717d3bc28950 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.040118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b34d4-9800-46ba-a7f5-717d3bc28950 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.040118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b34d4-9800-46ba-a7f5-717d3bc28950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.046851 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1181/2358] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:46.048663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60529c91-349d-4860-b62b-f615a4966e28 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:46.062223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60529c91-349d-4860-b62b-f615a4966e28 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:46.089309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b21b34d4-9800-46ba-a7f5-717d3bc28950 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:46.094027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b21b34d4-9800-46ba-a7f5-717d3bc28950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:46.152101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bc366-c392-4c41-9c17-57cd46f347d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:46.153091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bc366-c392-4c41-9c17-57cd46f347d9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.153586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bc366-c392-4c41-9c17-57cd46f347d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.154161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bc366-c392-4c41-9c17-57cd46f347d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.154947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bc366-c392-4c41-9c17-57cd46f347d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:46.157547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bc366-c392-4c41-9c17-57cd46f347d9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:46.179001 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1182/2359] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:46.180517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bc366-c392-4c41-9c17-57cd46f347d9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:46.187819 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1178/2360] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:46.189770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b34d4-9800-46ba-a7f5-717d3bc28950 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:46.206105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b34d4-9800-46ba-a7f5-717d3bc28950 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:46.208913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bc366-c392-4c41-9c17-57cd46f347d9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:46.212520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6c180-38c6-448f-8ab7-ca581155d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:46.213282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c180-38c6-448f-8ab7-ca581155d127 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.213759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c180-38c6-448f-8ab7-ca581155d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.214185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c180-38c6-448f-8ab7-ca581155d127 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.215833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6c180-38c6-448f-8ab7-ca581155d127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:46.217497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4cc2a-43f9-4dc3-b00f-dd1c35c93cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:46.218977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6c180-38c6-448f-8ab7-ca581155d127 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:46.219220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4cc2a-43f9-4dc3-b00f-dd1c35c93cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.219220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4cc2a-43f9-4dc3-b00f-dd1c35c93cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.219220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4cc2a-43f9-4dc3-b00f-dd1c35c93cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.220363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4cc2a-43f9-4dc3-b00f-dd1c35c93cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:46.225209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4cc2a-43f9-4dc3-b00f-dd1c35c93cf1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:46.249007 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1183/2361] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:46.249007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4cc2a-43f9-4dc3-b00f-dd1c35c93cf1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:46.249741 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1179/2362] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:46 2022] POST /identity/v3/users => generated 286 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:46.251397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6c180-38c6-448f-8ab7-ca581155d127 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:46.264057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6c180-38c6-448f-8ab7-ca581155d127 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:46.268497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4cc2a-43f9-4dc3-b00f-dd1c35c93cf1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:46.273734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda79ced-26c0-45a2-959a-1a197282c0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:46.275784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda79ced-26c0-45a2-959a-1a197282c0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.276524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda79ced-26c0-45a2-959a-1a197282c0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.276680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0b86b-5c23-49a4-9a04-a4f32ae68175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:46.277993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0b86b-5c23-49a4-9a04-a4f32ae68175 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.278198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda79ced-26c0-45a2-959a-1a197282c0b9 admin admin] PATH_INFO: `/v3/projects/1708c977c6404a1b918d9029810f2e5a/users/115d32baeb934185992b0753fbdd8e8e/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.278289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0b86b-5c23-49a4-9a04-a4f32ae68175 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.278289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0b86b-5c23-49a4-9a04-a4f32ae68175 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.279765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0b86b-5c23-49a4-9a04-a4f32ae68175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:46.293746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0b86b-5c23-49a4-9a04-a4f32ae68175 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:46.306351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda79ced-26c0-45a2-959a-1a197282c0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1708c977c6404a1b918d9029810f2e5a, user_id=115d32baeb934185992b0753fbdd8e8e, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:46.310446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda79ced-26c0-45a2-959a-1a197282c0b9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:46.324578 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1184/2363] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:46.328704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0b86b-5c23-49a4-9a04-a4f32ae68175 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:46.331510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76f0b86b-5c23-49a4-9a04-a4f32ae68175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:46.349572 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1180/2364] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:46 2022] PUT /identity/v3/projects/1708c977c6404a1b918d9029810f2e5a/users/115d32baeb934185992b0753fbdd8e8e/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:46.349572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda79ced-26c0-45a2-959a-1a197282c0b9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:46.464689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0b86b-5c23-49a4-9a04-a4f32ae68175 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:46.483844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda79ced-26c0-45a2-959a-1a197282c0b9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:46.492401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:46.515286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae16393-a4d3-46d0-b79f-b048bb962d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:46.515935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae16393-a4d3-46d0-b79f-b048bb962d8b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.516750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae16393-a4d3-46d0-b79f-b048bb962d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.517025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae16393-a4d3-46d0-b79f-b048bb962d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.518344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae16393-a4d3-46d0-b79f-b048bb962d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:46.519632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae16393-a4d3-46d0-b79f-b048bb962d8b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:46.547943 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1181/2365] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:46.548863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae16393-a4d3-46d0-b79f-b048bb962d8b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:46.565379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae16393-a4d3-46d0-b79f-b048bb962d8b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:46.575104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2b791-5bd2-4e6f-b194-44cf149c685a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:46.575793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2b791-5bd2-4e6f-b194-44cf149c685a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.576081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2b791-5bd2-4e6f-b194-44cf149c685a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.576434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2b791-5bd2-4e6f-b194-44cf149c685a admin admin] PATH_INFO: `/v3/projects/ce1ede705ef64e21b32141624ee2ffe5/users/0b1859c03d84435db08be11ac1422e23/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.579899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:46.610798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2b791-5bd2-4e6f-b194-44cf149c685a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1ede705ef64e21b32141624ee2ffe5, user_id=0b1859c03d84435db08be11ac1422e23, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:46.617964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2b791-5bd2-4e6f-b194-44cf149c685a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:46.630185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fb21c-485f-47e0-8473-f7b2c56dd606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:46.632791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fb21c-485f-47e0-8473-f7b2c56dd606 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.633462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fb21c-485f-47e0-8473-f7b2c56dd606 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.635666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fb21c-485f-47e0-8473-f7b2c56dd606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.647512 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1182/2366] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:46 2022] PUT /identity/v3/projects/ce1ede705ef64e21b32141624ee2ffe5/users/0b1859c03d84435db08be11ac1422e23/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:46.652365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2b791-5bd2-4e6f-b194-44cf149c685a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:46.675691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fb21c-485f-47e0-8473-f7b2c56dd606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:46.677829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fb21c-485f-47e0-8473-f7b2c56dd606 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:46.701544 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1185/2367] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:46.703307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978373d-d235-4979-aa49-85496bbc30a8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.703852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978373d-d235-4979-aa49-85496bbc30a8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.704281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978373d-d235-4979-aa49-85496bbc30a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.824896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2b791-5bd2-4e6f-b194-44cf149c685a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:46.827914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7978373d-d235-4979-aa49-85496bbc30a8 None None] MFA Rules not processed for user `115d32baeb934185992b0753fbdd8e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:46.829218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7978373d-d235-4979-aa49-85496bbc30a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:46.832928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128fe4-c44b-4aa1-b568-e7a9ce482842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:46.834094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128fe4-c44b-4aa1-b568-e7a9ce482842 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:46.834578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128fe4-c44b-4aa1-b568-e7a9ce482842 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:46.835060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128fe4-c44b-4aa1-b568-e7a9ce482842 admin admin] PATH_INFO: `/v3/projects/b38d842b03e34a2d915ec77e3143a45e/users/379f5eb5bbd14591a1ea3c2126b13563/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:46.855912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d128fe4-c44b-4aa1-b568-e7a9ce482842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38d842b03e34a2d915ec77e3143a45e, user_id=379f5eb5bbd14591a1ea3c2126b13563, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:46.861557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d128fe4-c44b-4aa1-b568-e7a9ce482842 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:46.883209 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1183/2368] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:46 2022] PUT /identity/v3/projects/b38d842b03e34a2d915ec77e3143a45e/users/379f5eb5bbd14591a1ea3c2126b13563/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:46.884499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128fe4-c44b-4aa1-b568-e7a9ce482842 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:47.006002 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1186/2369] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:47.007461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11bc72-809f-4d73-bfb4-a41d5dbc0976 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:47.007750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11bc72-809f-4d73-bfb4-a41d5dbc0976 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:47.008051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11bc72-809f-4d73-bfb4-a41d5dbc0976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:47.063396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8f11bc72-809f-4d73-bfb4-a41d5dbc0976 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:47.063396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8f11bc72-809f-4d73-bfb4-a41d5dbc0976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:47.076111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128fe4-c44b-4aa1-b568-e7a9ce482842 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:47.081772 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1187/2370] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:47.084019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe84861-48f2-402c-88e6-f9efa3ffaca8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:47.085616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe84861-48f2-402c-88e6-f9efa3ffaca8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:47.085899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe84861-48f2-402c-88e6-f9efa3ffaca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:47.097136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a1152-2bca-4432-9c3a-7208e22b601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:47.100495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1152-2bca-4432-9c3a-7208e22b601a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:47.101041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1152-2bca-4432-9c3a-7208e22b601a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:47.102069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1152-2bca-4432-9c3a-7208e22b601a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:47.107319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a1152-2bca-4432-9c3a-7208e22b601a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:47.113036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a1152-2bca-4432-9c3a-7208e22b601a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:47.144072 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1184/2371] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:47.147017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a1152-2bca-4432-9c3a-7208e22b601a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:47.153375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5fe84861-48f2-402c-88e6-f9efa3ffaca8 None None] MFA Rules not processed for user `379f5eb5bbd14591a1ea3c2126b13563`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:47.155179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5fe84861-48f2-402c-88e6-f9efa3ffaca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:47.175832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a1152-2bca-4432-9c3a-7208e22b601a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:47.190449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b108b2b-7603-4fa7-875c-1a2524ce7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:47.191676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108b2b-7603-4fa7-875c-1a2524ce7f70 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:47.192134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108b2b-7603-4fa7-875c-1a2524ce7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:47.192584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108b2b-7603-4fa7-875c-1a2524ce7f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:47.194817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b108b2b-7603-4fa7-875c-1a2524ce7f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:47.202591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b108b2b-7603-4fa7-875c-1a2524ce7f70 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:47.296941 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1185/2372] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:47 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:47.298872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b108b2b-7603-4fa7-875c-1a2524ce7f70 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:47.341524 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1188/2373] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:47.342572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe84861-48f2-402c-88e6-f9efa3ffaca8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:47.354292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5fe84861-48f2-402c-88e6-f9efa3ffaca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:47.397453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:47.416238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:47.452179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b108b2b-7603-4fa7-875c-1a2524ce7f70 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:47.464043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8659be-46e2-4ac1-9ace-d2f0c49df230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:47.465256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8659be-46e2-4ac1-9ace-d2f0c49df230 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:47.465752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8659be-46e2-4ac1-9ace-d2f0c49df230 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:47.466371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8659be-46e2-4ac1-9ace-d2f0c49df230 admin admin] PATH_INFO: `/v3/projects/74754c19f05f41428bc6d499aac1f9e5/users/e7e71fcf6711470db5a71ddc74ff709c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:47.488730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe84861-48f2-402c-88e6-f9efa3ffaca8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:47.511048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8659be-46e2-4ac1-9ace-d2f0c49df230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74754c19f05f41428bc6d499aac1f9e5, user_id=e7e71fcf6711470db5a71ddc74ff709c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:47.516574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8659be-46e2-4ac1-9ace-d2f0c49df230 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:47.545972 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1186/2374] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:47 2022] PUT /identity/v3/projects/74754c19f05f41428bc6d499aac1f9e5/users/e7e71fcf6711470db5a71ddc74ff709c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:47.546914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8659be-46e2-4ac1-9ace-d2f0c49df230 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:47.607028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce9252-707f-46aa-820f-6251a66be57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:47.607964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce9252-707f-46aa-820f-6251a66be57f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:47.608165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce9252-707f-46aa-820f-6251a66be57f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:47.608441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce9252-707f-46aa-820f-6251a66be57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:47.630583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce9252-707f-46aa-820f-6251a66be57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:47.635287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce9252-707f-46aa-820f-6251a66be57f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:47.658367 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1189/2375] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:47.659436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce9252-707f-46aa-820f-6251a66be57f service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:47.662517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-70ce9252-707f-46aa-820f-6251a66be57f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:47.697879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8659be-46e2-4ac1-9ace-d2f0c49df230 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:47.712281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7940a-e4fa-4ddc-b9c9-212e53e2a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:47.713461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7940a-e4fa-4ddc-b9c9-212e53e2a4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:47.713461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7940a-e4fa-4ddc-b9c9-212e53e2a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:47.713698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7940a-e4fa-4ddc-b9c9-212e53e2a4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:47.714289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7940a-e4fa-4ddc-b9c9-212e53e2a4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:47.716755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7940a-e4fa-4ddc-b9c9-212e53e2a4e8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:47.767226 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1187/2376] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:47 2022] POST /identity/v3/users => generated 303 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:47.768698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06753fb7-6b79-416d-bdde-d581c5d3f112 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:47.770398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06753fb7-6b79-416d-bdde-d581c5d3f112 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:47.770680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06753fb7-6b79-416d-bdde-d581c5d3f112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:47.812425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-06753fb7-6b79-416d-bdde-d581c5d3f112 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:47.815739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-06753fb7-6b79-416d-bdde-d581c5d3f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:47.842245 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1188/2377] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:47.842245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06753fb7-6b79-416d-bdde-d581c5d3f112 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:47.845164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce9252-707f-46aa-820f-6251a66be57f service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:47.846620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-06753fb7-6b79-416d-bdde-d581c5d3f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:47.863636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06753fb7-6b79-416d-bdde-d581c5d3f112 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:47.872861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:47.874198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:47.874560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:47.874905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] PATH_INFO: `/v3/projects/bd61633b44584714922d96fb45e99df3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:47.876372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd61633b44584714922d96fb45e99df3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:47.879806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:47.950956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401cc85-aa68-4b45-8df6-176878caa399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:47.951688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401cc85-aa68-4b45-8df6-176878caa399 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:47.952042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401cc85-aa68-4b45-8df6-176878caa399 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:47.952388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401cc85-aa68-4b45-8df6-176878caa399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:47.977158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd61633b44584714922d96fb45e99df3', 'request_id': 'req-0d7098a7-010e-4250-9751-19a35603fc7b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:47.984665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:47.990834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd61633b44584714922d96fb45e99df3', 'request_id': 'req-0d7098a7-010e-4250-9751-19a35603fc7b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:48.014468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd61633b44584714922d96fb45e99df3', 'request_id': 'req-0d7098a7-010e-4250-9751-19a35603fc7b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:48.039636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] The token cache is being invalidate because project bd61633b44584714922d96fb45e99df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:48.039967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:48.041736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:48.050776 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1189/2378] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:47 2022] DELETE /identity/v3/projects/bd61633b44584714922d96fb45e99df3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:48.050776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:48.051280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:48.108598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401cc85-aa68-4b45-8df6-176878caa399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:48.116985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401cc85-aa68-4b45-8df6-176878caa399 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:48.144245 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1190/2379] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:48.147738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401cc85-aa68-4b45-8df6-176878caa399 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:48.163314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:48.253994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7098a7-010e-4250-9751-19a35603fc7b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:48.277665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa13be7-fa2e-46ab-b93e-edaad95a3395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:48.278456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa13be7-fa2e-46ab-b93e-edaad95a3395 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:48.278799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa13be7-fa2e-46ab-b93e-edaad95a3395 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:48.279402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa13be7-fa2e-46ab-b93e-edaad95a3395 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:48.280146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa13be7-fa2e-46ab-b93e-edaad95a3395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:48.286992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa13be7-fa2e-46ab-b93e-edaad95a3395 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:48.310518 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1190/2380] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:48.312710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa13be7-fa2e-46ab-b93e-edaad95a3395 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:48.319995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6aa13be7-fa2e-46ab-b93e-edaad95a3395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:48.349048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa13be7-fa2e-46ab-b93e-edaad95a3395 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:48.366159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401cc85-aa68-4b45-8df6-176878caa399 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:48.370719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:48.371441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:48.371800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:48.372084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] PATH_INFO: `/v3/users/f5757d8d8b35489984ab6cef2a165ce8` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:48.373840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5757d8d8b35489984ab6cef2a165ce8)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:48.375868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:48.489568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5757d8d8b35489984ab6cef2a165ce8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:48.491214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5757d8d8b35489984ab6cef2a165ce8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:48.551759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5757d8d8b35489984ab6cef2a165ce8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:48.553987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5757d8d8b35489984ab6cef2a165ce8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:48.582882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5757d8d8b35489984ab6cef2a165ce8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:48.617476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803502b-03fa-4224-b3b2-e1e43fe8a69c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:48.618017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803502b-03fa-4224-b3b2-e1e43fe8a69c service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:48.622869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803502b-03fa-4224-b3b2-e1e43fe8a69c service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:48.623237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803502b-03fa-4224-b3b2-e1e43fe8a69c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:48.633418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b803502b-03fa-4224-b3b2-e1e43fe8a69c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:48.642206 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1191/2381] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:48 2022] DELETE /identity/v3/users/f5757d8d8b35489984ab6cef2a165ce8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:48.649598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:48.652348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:48.657532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803502b-03fa-4224-b3b2-e1e43fe8a69c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:48.659476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803502b-03fa-4224-b3b2-e1e43fe8a69c service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:48.676810 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1191/2382] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:48.715459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142113ff-b5d5-47ce-9ea1-602dbb0598a9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:48.715782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142113ff-b5d5-47ce-9ea1-602dbb0598a9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:48.716206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142113ff-b5d5-47ce-9ea1-602dbb0598a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:48.765721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-142113ff-b5d5-47ce-9ea1-602dbb0598a9 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:48.768504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-142113ff-b5d5-47ce-9ea1-602dbb0598a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:48.884654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a205949-1c12-442b-bc47-3ecf81d638c0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:48.912686 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1192/2383] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:26:48.930183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca85ec3-19f6-4e89-948f-78bbf06b06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:48.938559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca85ec3-19f6-4e89-948f-78bbf06b06da admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:48.938940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca85ec3-19f6-4e89-948f-78bbf06b06da admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:48.939203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca85ec3-19f6-4e89-948f-78bbf06b06da admin admin] PATH_INFO: `/v3/projects/6e9753b2799348c6aa2c4e1502861530/users/0e8e29cf27324903b24775a596b97d45/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:48.940712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142113ff-b5d5-47ce-9ea1-602dbb0598a9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:48.942369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-142113ff-b5d5-47ce-9ea1-602dbb0598a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:48.989414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca85ec3-19f6-4e89-948f-78bbf06b06da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9753b2799348c6aa2c4e1502861530, user_id=0e8e29cf27324903b24775a596b97d45, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:48.996243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca85ec3-19f6-4e89-948f-78bbf06b06da admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:49.003909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:49.027903 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1192/2384] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:48 2022] PUT /identity/v3/projects/6e9753b2799348c6aa2c4e1502861530/users/0e8e29cf27324903b24775a596b97d45/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:49.032382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca85ec3-19f6-4e89-948f-78bbf06b06da admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:49.107922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:49.187356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142113ff-b5d5-47ce-9ea1-602dbb0598a9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:49.240296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca85ec3-19f6-4e89-948f-78bbf06b06da admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:49.264893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304094fc-00c8-4e05-ada1-7abf6c7429f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:49.265819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304094fc-00c8-4e05-ada1-7abf6c7429f1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:49.267365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304094fc-00c8-4e05-ada1-7abf6c7429f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:49.267731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304094fc-00c8-4e05-ada1-7abf6c7429f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:49.268485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304094fc-00c8-4e05-ada1-7abf6c7429f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:49.277571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304094fc-00c8-4e05-ada1-7abf6c7429f1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:49.386420 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1193/2385] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:49.392764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304094fc-00c8-4e05-ada1-7abf6c7429f1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:49.426139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304094fc-00c8-4e05-ada1-7abf6c7429f1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:49.442747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4e258-8c59-4673-8ac7-b849f287b46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:49.443594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4e258-8c59-4673-8ac7-b849f287b46d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:49.443879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4e258-8c59-4673-8ac7-b849f287b46d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:49.444314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4e258-8c59-4673-8ac7-b849f287b46d admin admin] PATH_INFO: `/v3/projects/6e9753b2799348c6aa2c4e1502861530/users/0e8e29cf27324903b24775a596b97d45/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:49.455735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4e258-8c59-4673-8ac7-b849f287b46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9753b2799348c6aa2c4e1502861530, user_id=0e8e29cf27324903b24775a596b97d45, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:49.458690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4e258-8c59-4673-8ac7-b849f287b46d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:49.470550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08c71e-2a4a-46e8-be84-60049bc6eca9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:49.471391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08c71e-2a4a-46e8-be84-60049bc6eca9 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:49.472206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08c71e-2a4a-46e8-be84-60049bc6eca9 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:49.472653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08c71e-2a4a-46e8-be84-60049bc6eca9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:49.487060 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1194/2386] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:49 2022] PUT /identity/v3/projects/6e9753b2799348c6aa2c4e1502861530/users/0e8e29cf27324903b24775a596b97d45/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:49.510973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d994-2ffd-4b35-bd94-f1b32778f692 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:49.511464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d994-2ffd-4b35-bd94-f1b32778f692 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:49.512074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d994-2ffd-4b35-bd94-f1b32778f692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:49.608005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9e67d994-2ffd-4b35-bd94-f1b32778f692 None None] MFA Rules not processed for user `0e8e29cf27324903b24775a596b97d45`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:49.610911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9e67d994-2ffd-4b35-bd94-f1b32778f692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:49.656198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08c71e-2a4a-46e8-be84-60049bc6eca9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:49.658566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08c71e-2a4a-46e8-be84-60049bc6eca9 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:49.673663 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1193/2387] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:26:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:26:49.905335 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1195/2388] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:26:49.968740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3d69d-1e69-4738-a7b2-25ef5444c859 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:49.968740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3d69d-1e69-4738-a7b2-25ef5444c859 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:49.970723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3d69d-1e69-4738-a7b2-25ef5444c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:49.999813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3cb3d69d-1e69-4738-a7b2-25ef5444c859 None None] MFA Rules not processed for user `379f5eb5bbd14591a1ea3c2126b13563`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:50.002015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3cb3d69d-1e69-4738-a7b2-25ef5444c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:50.115768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d994-2ffd-4b35-bd94-f1b32778f692 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:50.118844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9e67d994-2ffd-4b35-bd94-f1b32778f692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:50.155178 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1194/2389] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:50.249414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d994-2ffd-4b35-bd94-f1b32778f692 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:50.257553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54d9d7-09b0-4171-bf5c-c897898207fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:50.259996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54d9d7-09b0-4171-bf5c-c897898207fc service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:50.260434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54d9d7-09b0-4171-bf5c-c897898207fc service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:50.262906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54d9d7-09b0-4171-bf5c-c897898207fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:50.285210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54d9d7-09b0-4171-bf5c-c897898207fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:50.288640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54d9d7-09b0-4171-bf5c-c897898207fc service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:50.308243 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1196/2390] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:26:50.444337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3d69d-1e69-4738-a7b2-25ef5444c859 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:50.446025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3cb3d69d-1e69-4738-a7b2-25ef5444c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:50.502203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:50.583962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3d69d-1e69-4738-a7b2-25ef5444c859 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:50.589244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:50.589844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:50.590194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:50.590535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] PATH_INFO: `/v3/projects/5c42d60b0db747d09e12fa554e0eb2e1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:50.592072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c42d60b0db747d09e12fa554e0eb2e1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:50.594701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:50.706115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c42d60b0db747d09e12fa554e0eb2e1', 'request_id': 'req-1026e986-e955-4043-8736-3f7b1221fa0b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:50.718662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c42d60b0db747d09e12fa554e0eb2e1', 'request_id': 'req-1026e986-e955-4043-8736-3f7b1221fa0b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:50.770200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c42d60b0db747d09e12fa554e0eb2e1', 'request_id': 'req-1026e986-e955-4043-8736-3f7b1221fa0b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:50.804486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] The token cache is being invalidate because project 5c42d60b0db747d09e12fa554e0eb2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:50.805022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:50.806343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1026e986-e955-4043-8736-3f7b1221fa0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:50.816316 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1195/2391] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:50 2022] DELETE /identity/v3/projects/5c42d60b0db747d09e12fa554e0eb2e1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:50.817826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0055a-d4ed-461b-8634-7b4b309126f4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:50.818103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0055a-d4ed-461b-8634-7b4b309126f4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:50.818553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0055a-d4ed-461b-8634-7b4b309126f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:50.843937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-52d0055a-d4ed-461b-8634-7b4b309126f4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:50.845608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-52d0055a-d4ed-461b-8634-7b4b309126f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:50.861297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:51.001644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae97ea-2894-44ff-bec8-dc7ffb1e115e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:51.002068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae97ea-2894-44ff-bec8-dc7ffb1e115e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:51.002443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae97ea-2894-44ff-bec8-dc7ffb1e115e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:51.011629 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1197/2392] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:51.052363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-adae97ea-2894-44ff-bec8-dc7ffb1e115e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:51.053656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-adae97ea-2894-44ff-bec8-dc7ffb1e115e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:51.079731 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1196/2393] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:51.085140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0055a-d4ed-461b-8634-7b4b309126f4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:51.122449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0055a-d4ed-461b-8634-7b4b309126f4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:51.135577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f541f9c-a6ee-4223-851b-1b395b811e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:51.137309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f541f9c-a6ee-4223-851b-1b395b811e0b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:51.137805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f541f9c-a6ee-4223-851b-1b395b811e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:51.138719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f541f9c-a6ee-4223-851b-1b395b811e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:51.139558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f541f9c-a6ee-4223-851b-1b395b811e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:51.140521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f541f9c-a6ee-4223-851b-1b395b811e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:51.143574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f541f9c-a6ee-4223-851b-1b395b811e0b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:51.203464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae97ea-2894-44ff-bec8-dc7ffb1e115e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:51.208570 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1198/2394] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:51.224303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae97ea-2894-44ff-bec8-dc7ffb1e115e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:51.238277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d78b5-7bf2-42aa-9975-12094a491b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:51.238919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d78b5-7bf2-42aa-9975-12094a491b2b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:51.239205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d78b5-7bf2-42aa-9975-12094a491b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:51.239552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d78b5-7bf2-42aa-9975-12094a491b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:51.240142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d78b5-7bf2-42aa-9975-12094a491b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:51.242135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d78b5-7bf2-42aa-9975-12094a491b2b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:51.256260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379cda0-5b52-4a87-900f-c05231c0ba9d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:51.257078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379cda0-5b52-4a87-900f-c05231c0ba9d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:51.257564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379cda0-5b52-4a87-900f-c05231c0ba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:51.299782 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1197/2395] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:51 2022] POST /identity/v3/projects => generated 397 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:26:51.304152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d78b5-7bf2-42aa-9975-12094a491b2b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:51.319111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3379cda0-5b52-4a87-900f-c05231c0ba9d None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:51.340489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3379cda0-5b52-4a87-900f-c05231c0ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:51.528459 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1199/2396] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:26:51.545331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d78b5-7bf2-42aa-9975-12094a491b2b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:51.546270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379cda0-5b52-4a87-900f-c05231c0ba9d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:51.549062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3379cda0-5b52-4a87-900f-c05231c0ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:51.560029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5698c-09c4-463b-9458-db748a4f2ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:51.561406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5698c-09c4-463b-9458-db748a4f2ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:51.562495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5698c-09c4-463b-9458-db748a4f2ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:51.562854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5698c-09c4-463b-9458-db748a4f2ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:51.563813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5698c-09c4-463b-9458-db748a4f2ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:51.580635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5698c-09c4-463b-9458-db748a4f2ff2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:51.627470 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1198/2397] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:51 2022] POST /identity/v3/users => generated 299 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:26:51.634772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5698c-09c4-463b-9458-db748a4f2ff2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:51.651371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:51.667046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5698c-09c4-463b-9458-db748a4f2ff2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:51.674365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d715a9-e305-4241-a53f-36225691e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:51.675627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d715a9-e305-4241-a53f-36225691e99c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:51.676104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d715a9-e305-4241-a53f-36225691e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:51.676571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d715a9-e305-4241-a53f-36225691e99c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:51.677449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d715a9-e305-4241-a53f-36225691e99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:51.680058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d715a9-e305-4241-a53f-36225691e99c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:51.697910 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1199/2398] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:51.699200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d715a9-e305-4241-a53f-36225691e99c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:51.711858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d715a9-e305-4241-a53f-36225691e99c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:51.717666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894d171-ac00-450a-9061-b442654b314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:51.719162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d171-ac00-450a-9061-b442654b314c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:51.719660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d171-ac00-450a-9061-b442654b314c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:51.720122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d171-ac00-450a-9061-b442654b314c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:51.721131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894d171-ac00-450a-9061-b442654b314c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:51.723316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894d171-ac00-450a-9061-b442654b314c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:51.757192 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1200/2399] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:51.758617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894d171-ac00-450a-9061-b442654b314c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:51.765365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379cda0-5b52-4a87-900f-c05231c0ba9d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:51.770508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894d171-ac00-450a-9061-b442654b314c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:51.776369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287d4e9-64de-4dbd-9c03-b508312d19e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:51.777325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d4e9-64de-4dbd-9c03-b508312d19e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:51.777942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d4e9-64de-4dbd-9c03-b508312d19e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:51.779340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d4e9-64de-4dbd-9c03-b508312d19e3 admin admin] PATH_INFO: `/v3/projects/0145760115bc47d188f32fca7793b863/users/f331c1e3ee1442ad863d8909ca76020b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:51.782246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10405f36-31f4-46e1-8fe7-ae1025869be7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:51.784072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10405f36-31f4-46e1-8fe7-ae1025869be7 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:51.784364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10405f36-31f4-46e1-8fe7-ae1025869be7 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:51.785763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10405f36-31f4-46e1-8fe7-ae1025869be7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:51.804651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10405f36-31f4-46e1-8fe7-ae1025869be7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:51.806929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10405f36-31f4-46e1-8fe7-ae1025869be7 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:51.818385 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1200/2400] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:26:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:51.841053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287d4e9-64de-4dbd-9c03-b508312d19e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0145760115bc47d188f32fca7793b863, user_id=f331c1e3ee1442ad863d8909ca76020b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:51.849574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287d4e9-64de-4dbd-9c03-b508312d19e3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:51.902720 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1201/2401] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:51 2022] PUT /identity/v3/projects/0145760115bc47d188f32fca7793b863/users/f331c1e3ee1442ad863d8909ca76020b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:51.904694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192a45-25a9-40ed-bbf9-01bf3a91840e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:51.904984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192a45-25a9-40ed-bbf9-01bf3a91840e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:51.905256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192a45-25a9-40ed-bbf9-01bf3a91840e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:51.966523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ba192a45-25a9-40ed-bbf9-01bf3a91840e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:51.967783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ba192a45-25a9-40ed-bbf9-01bf3a91840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:52.053788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b83f7-760b-4443-b3e0-15d97827ed78 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:52.054082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b83f7-760b-4443-b3e0-15d97827ed78 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:52.055050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b83f7-760b-4443-b3e0-15d97827ed78 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:52.058840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:52.068041 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1202/2402] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:26:52 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:26:52.074248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847103e7-44d0-4379-8937-db8733650b74 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:52.074792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847103e7-44d0-4379-8937-db8733650b74 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:52.075246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847103e7-44d0-4379-8937-db8733650b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:52.123650 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1201/2403] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:52.139957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-847103e7-44d0-4379-8937-db8733650b74 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:52.147167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-847103e7-44d0-4379-8937-db8733650b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:52.152264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba192a45-25a9-40ed-bbf9-01bf3a91840e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:52.154489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ba192a45-25a9-40ed-bbf9-01bf3a91840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:52.260457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba192a45-25a9-40ed-bbf9-01bf3a91840e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:52.262045 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1203/2404] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:52.263116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847103e7-44d0-4379-8937-db8733650b74 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:52.264659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-847103e7-44d0-4379-8937-db8733650b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:52.272723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cfda2-0f7a-4667-a2ef-9136917474bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:52.274375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cfda2-0f7a-4667-a2ef-9136917474bc service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:52.274785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cfda2-0f7a-4667-a2ef-9136917474bc service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:52.275179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cfda2-0f7a-4667-a2ef-9136917474bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:52.286369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cfda2-0f7a-4667-a2ef-9136917474bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:52.287986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cfda2-0f7a-4667-a2ef-9136917474bc service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:52.299231 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1202/2405] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:52.301230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847103e7-44d0-4379-8937-db8733650b74 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:52.313490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:52.314404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:52.314829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:52.315278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] PATH_INFO: `/v3/users/379f5eb5bbd14591a1ea3c2126b13563` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:52.316661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379f5eb5bbd14591a1ea3c2126b13563)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:52.318790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:52.330373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cfda2-0f7a-4667-a2ef-9136917474bc service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:52.332006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-833cfda2-0f7a-4667-a2ef-9136917474bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:52.361267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cfda2-0f7a-4667-a2ef-9136917474bc service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:52.372031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8dadf-5543-4e31-a250-4e2af5658e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:52.375499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8dadf-5543-4e31-a250-4e2af5658e75 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:52.379950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8dadf-5543-4e31-a250-4e2af5658e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:52.381285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8dadf-5543-4e31-a250-4e2af5658e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:52.408130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8dadf-5543-4e31-a250-4e2af5658e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:52.417913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8dadf-5543-4e31-a250-4e2af5658e75 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:52.431760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379f5eb5bbd14591a1ea3c2126b13563'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:52.432907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379f5eb5bbd14591a1ea3c2126b13563'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:52.443000 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1203/2406] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:26:52.456737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379f5eb5bbd14591a1ea3c2126b13563'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:52.475417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379f5eb5bbd14591a1ea3c2126b13563'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:52.501361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379f5eb5bbd14591a1ea3c2126b13563'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:52.528353 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1204/2407] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:52 2022] DELETE /identity/v3/users/379f5eb5bbd14591a1ea3c2126b13563 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:52.530825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a1ca9-692f-4c6a-8648-af9831a286c8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:52.531629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a1ca9-692f-4c6a-8648-af9831a286c8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:52.532323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a1ca9-692f-4c6a-8648-af9831a286c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:52.580699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-436a1ca9-692f-4c6a-8648-af9831a286c8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:52.585463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-436a1ca9-692f-4c6a-8648-af9831a286c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:52.631765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:52.633553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:52.710633 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1204/2408] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:52.764313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a1ca9-692f-4c6a-8648-af9831a286c8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:52.765065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:52.767791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-436a1ca9-692f-4c6a-8648-af9831a286c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:52.821930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ea1e3-c2f5-456e-947a-89f933b007a9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:52.830871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ac469-f4b0-4533-80de-7170700e9d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:52.831633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ac469-f4b0-4533-80de-7170700e9d43 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:52.832005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ac469-f4b0-4533-80de-7170700e9d43 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:52.833270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ac469-f4b0-4533-80de-7170700e9d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:52.836813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-698ac469-f4b0-4533-80de-7170700e9d43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:52.970382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ac469-f4b0-4533-80de-7170700e9d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:52.975320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ac469-f4b0-4533-80de-7170700e9d43 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:52.977820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a1ca9-692f-4c6a-8648-af9831a286c8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:52.989509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e28a9-fc91-4c31-9778-ada4bc8b9939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:52.992482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e28a9-fc91-4c31-9778-ada4bc8b9939 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:52.992890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e28a9-fc91-4c31-9778-ada4bc8b9939 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:52.993679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e28a9-fc91-4c31-9778-ada4bc8b9939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:52.995619 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1205/2409] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:52 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:26:53.031895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ac469-f4b0-4533-80de-7170700e9d43 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:53.033397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-698ac469-f4b0-4533-80de-7170700e9d43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:53.035905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e28a9-fc91-4c31-9778-ada4bc8b9939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:53.040144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e28a9-fc91-4c31-9778-ada4bc8b9939 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:53.059171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ac469-f4b0-4533-80de-7170700e9d43 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:53.067974 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1205/2410] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:26:53.078732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:53.079415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:53.079693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:53.079976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] PATH_INFO: `/v3/users/115d32baeb934185992b0753fbdd8e8e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:53.081825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=115d32baeb934185992b0753fbdd8e8e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:53.083895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:53.196731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115d32baeb934185992b0753fbdd8e8e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:53.199550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115d32baeb934185992b0753fbdd8e8e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:53.235874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115d32baeb934185992b0753fbdd8e8e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:53.246546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115d32baeb934185992b0753fbdd8e8e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:53.259005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115d32baeb934185992b0753fbdd8e8e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:53.267411 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1206/2411] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:53 2022] DELETE /identity/v3/users/115d32baeb934185992b0753fbdd8e8e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:26:53.273219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71dc28-d411-4324-8f13-94d7cf228dba None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:53.273988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71dc28-d411-4324-8f13-94d7cf228dba None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:53.274440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71dc28-d411-4324-8f13-94d7cf228dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:53.306718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-af71dc28-d411-4324-8f13-94d7cf228dba None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:53.309002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-af71dc28-d411-4324-8f13-94d7cf228dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:53.317781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:53.451473 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1206/2412] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:26:53.644171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:53.645790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:53.787428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:53.811439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd0a97-05cb-4f08-95d0-27e6d2a82f72 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:53.845677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a648b-bb8e-4ed0-ae4a-82daacb5c670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:53.848094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a648b-bb8e-4ed0-ae4a-82daacb5c670 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:53.848478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a648b-bb8e-4ed0-ae4a-82daacb5c670 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:53.848854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a648b-bb8e-4ed0-ae4a-82daacb5c670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:53.881538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a648b-bb8e-4ed0-ae4a-82daacb5c670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:53.886713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a648b-bb8e-4ed0-ae4a-82daacb5c670 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:53.915637 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1207/2413] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:55.171295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71dc28-d411-4324-8f13-94d7cf228dba None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:55.174578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-af71dc28-d411-4324-8f13-94d7cf228dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:55.198192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71dc28-d411-4324-8f13-94d7cf228dba None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:55.204824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:55.205799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:55.206260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:55.206827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] PATH_INFO: `/v3/projects/b38d842b03e34a2d915ec77e3143a45e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:55.209890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38d842b03e34a2d915ec77e3143a45e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:55.215644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:55.314773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38d842b03e34a2d915ec77e3143a45e', 'request_id': 'req-88dc0bc1-c702-477f-92c3-f16f86f700ec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:55.328184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38d842b03e34a2d915ec77e3143a45e', 'request_id': 'req-88dc0bc1-c702-477f-92c3-f16f86f700ec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:55.350248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38d842b03e34a2d915ec77e3143a45e', 'request_id': 'req-88dc0bc1-c702-477f-92c3-f16f86f700ec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:55.374799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] The token cache is being invalidate because project b38d842b03e34a2d915ec77e3143a45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:55.375118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:55.379103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88dc0bc1-c702-477f-92c3-f16f86f700ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:55.383516 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1207/2414] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:55 2022] DELETE /identity/v3/projects/b38d842b03e34a2d915ec77e3143a45e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:55.390669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c1373-91bc-4a8d-94ce-b2bac067a68e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:55.390669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c1373-91bc-4a8d-94ce-b2bac067a68e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:55.393074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c1373-91bc-4a8d-94ce-b2bac067a68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:55.447302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-423c1373-91bc-4a8d-94ce-b2bac067a68e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:55.454524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-423c1373-91bc-4a8d-94ce-b2bac067a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:55.594055 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1208/2415] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:55.601732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a495e-c1c0-4857-aa9b-0cd55a2ff690 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:55.602033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a495e-c1c0-4857-aa9b-0cd55a2ff690 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:55.602284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a495e-c1c0-4857-aa9b-0cd55a2ff690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:55.646546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cc6a495e-c1c0-4857-aa9b-0cd55a2ff690 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:55.649185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cc6a495e-c1c0-4857-aa9b-0cd55a2ff690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:55.669627 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1208/2416] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:55.674476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c1373-91bc-4a8d-94ce-b2bac067a68e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:55.687074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c1373-91bc-4a8d-94ce-b2bac067a68e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:55.693680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283c28d-01b5-4d53-b88a-a56ab7292d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:55.694621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283c28d-01b5-4d53-b88a-a56ab7292d55 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:55.695673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283c28d-01b5-4d53-b88a-a56ab7292d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:55.696178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283c28d-01b5-4d53-b88a-a56ab7292d55 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:55.697040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283c28d-01b5-4d53-b88a-a56ab7292d55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:55.697674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283c28d-01b5-4d53-b88a-a56ab7292d55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:55.700762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283c28d-01b5-4d53-b88a-a56ab7292d55 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:55.726245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a495e-c1c0-4857-aa9b-0cd55a2ff690 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:55.728730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cc6a495e-c1c0-4857-aa9b-0cd55a2ff690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:55.733435 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1209/2417] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:26:55.737714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283c28d-01b5-4d53-b88a-a56ab7292d55 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:55.746621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a495e-c1c0-4857-aa9b-0cd55a2ff690 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:55.758941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:55.763201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:55.763753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:55.763923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283c28d-01b5-4d53-b88a-a56ab7292d55 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:55.764375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] PATH_INFO: `/v3/projects/1708c977c6404a1b918d9029810f2e5a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:55.767779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1708c977c6404a1b918d9029810f2e5a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:55.774387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:55.778837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f2ba3-39c1-42d1-a0cd-29aaaef5b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:55.780235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f2ba3-39c1-42d1-a0cd-29aaaef5b4ef admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:55.780235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f2ba3-39c1-42d1-a0cd-29aaaef5b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:55.780235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f2ba3-39c1-42d1-a0cd-29aaaef5b4ef admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:55.780882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f2ba3-39c1-42d1-a0cd-29aaaef5b4ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:55.789291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f2ba3-39c1-42d1-a0cd-29aaaef5b4ef admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:55.863473 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1210/2418] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:55 2022] POST /identity/v3/projects => generated 399 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:26:55.874796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f2ba3-39c1-42d1-a0cd-29aaaef5b4ef admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:55.949062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1708c977c6404a1b918d9029810f2e5a', 'request_id': 'req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:55.965743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1708c977c6404a1b918d9029810f2e5a', 'request_id': 'req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:55.983225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1708c977c6404a1b918d9029810f2e5a', 'request_id': 'req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:55.998803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] The token cache is being invalidate because project 1708c977c6404a1b918d9029810f2e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:55.999159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:56.004142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:56.007605 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1209/2419] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:55 2022] DELETE /identity/v3/projects/1708c977c6404a1b918d9029810f2e5a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:56.011811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:56.014265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:56.046773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f2ba3-39c1-42d1-a0cd-29aaaef5b4ef admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:56.059383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:56.156639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e40ded-3880-4755-b311-3c3993345e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:56.157291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e40ded-3880-4755-b311-3c3993345e0c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:56.157619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e40ded-3880-4755-b311-3c3993345e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:56.157896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e40ded-3880-4755-b311-3c3993345e0c admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:56.161840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e40ded-3880-4755-b311-3c3993345e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:56.179712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e40ded-3880-4755-b311-3c3993345e0c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:56.206326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:56.250016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca43dd-ed9f-4e1e-a5cd-93b23a81169d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:56.257905 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1211/2420] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:55 2022] POST /identity/v3/users => generated 300 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:26:56.260040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e40ded-3880-4755-b311-3c3993345e0c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:56.264504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-64e40ded-3880-4755-b311-3c3993345e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:56.271137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af77faf-ac7b-42f9-b785-6a9495ed9326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:56.271863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af77faf-ac7b-42f9-b785-6a9495ed9326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:56.272147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af77faf-ac7b-42f9-b785-6a9495ed9326 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:56.272425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af77faf-ac7b-42f9-b785-6a9495ed9326 admin admin] PATH_INFO: `/v3/users/0e8e29cf27324903b24775a596b97d45` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:56.275697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af77faf-ac7b-42f9-b785-6a9495ed9326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8e29cf27324903b24775a596b97d45)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:56.283883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af77faf-ac7b-42f9-b785-6a9495ed9326 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:56.340340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e40ded-3880-4755-b311-3c3993345e0c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:56.367439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14718e0-ea85-4ec3-ac99-6ce8b64a4194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:56.368190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14718e0-ea85-4ec3-ac99-6ce8b64a4194 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:56.368430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14718e0-ea85-4ec3-ac99-6ce8b64a4194 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:56.368796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14718e0-ea85-4ec3-ac99-6ce8b64a4194 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:56.369366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14718e0-ea85-4ec3-ac99-6ce8b64a4194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:56.371614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14718e0-ea85-4ec3-ac99-6ce8b64a4194 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:56.395790 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1212/2421] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:56.397608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14718e0-ea85-4ec3-ac99-6ce8b64a4194 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:56.416729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5af77faf-ac7b-42f9-b785-6a9495ed9326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8e29cf27324903b24775a596b97d45'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:56.417754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5af77faf-ac7b-42f9-b785-6a9495ed9326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8e29cf27324903b24775a596b97d45'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:56.427299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14718e0-ea85-4ec3-ac99-6ce8b64a4194 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:56.443563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f5d7d-1936-4d52-bebe-90470740d37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:56.444918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f5d7d-1936-4d52-bebe-90470740d37f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:56.444918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f5d7d-1936-4d52-bebe-90470740d37f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:56.445970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5af77faf-ac7b-42f9-b785-6a9495ed9326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8e29cf27324903b24775a596b97d45'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:56.446124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f5d7d-1936-4d52-bebe-90470740d37f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:56.447649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5af77faf-ac7b-42f9-b785-6a9495ed9326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8e29cf27324903b24775a596b97d45'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:56.449629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f5d7d-1936-4d52-bebe-90470740d37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:56.454017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f5d7d-1936-4d52-bebe-90470740d37f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:56.467250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5af77faf-ac7b-42f9-b785-6a9495ed9326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8e29cf27324903b24775a596b97d45'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:56.483817 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1213/2422] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:56.488574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f5d7d-1936-4d52-bebe-90470740d37f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:56.491708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-735f5d7d-1936-4d52-bebe-90470740d37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:56.503924 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1210/2423] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:56 2022] DELETE /identity/v3/users/0e8e29cf27324903b24775a596b97d45 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:26:56.523603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f5d7d-1936-4d52-bebe-90470740d37f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:56.662739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266b05b-022b-416e-a0b5-f4bf0d281d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:56.663609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266b05b-022b-416e-a0b5-f4bf0d281d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:56.664025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266b05b-022b-416e-a0b5-f4bf0d281d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:56.664541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266b05b-022b-416e-a0b5-f4bf0d281d30 admin admin] PATH_INFO: `/v3/projects/7ef825b35f554cbb81bc25e06e2b5681/users/7bd967d46f614bb4a187218498e934f3/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:56.692462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266b05b-022b-416e-a0b5-f4bf0d281d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef825b35f554cbb81bc25e06e2b5681, user_id=7bd967d46f614bb4a187218498e934f3, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:56.696608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266b05b-022b-416e-a0b5-f4bf0d281d30 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:56.724368 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1214/2424] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:56 2022] PUT /identity/v3/projects/7ef825b35f554cbb81bc25e06e2b5681/users/7bd967d46f614bb4a187218498e934f3/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:26:56.727893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46826799-cbb8-4817-91d3-6fd6aa4bf2c3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:56.728224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46826799-cbb8-4817-91d3-6fd6aa4bf2c3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:56.728552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46826799-cbb8-4817-91d3-6fd6aa4bf2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:56.753330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-46826799-cbb8-4817-91d3-6fd6aa4bf2c3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:56.756381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-46826799-cbb8-4817-91d3-6fd6aa4bf2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:56.871170 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1211/2425] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:26:57.204011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266b05b-022b-416e-a0b5-f4bf0d281d30 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:57.211286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5266b05b-022b-416e-a0b5-f4bf0d281d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:57.422368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266b05b-022b-416e-a0b5-f4bf0d281d30 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:57.428883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5486e7-03b6-4f7c-9ab2-5b05fe429b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:57.429998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5486e7-03b6-4f7c-9ab2-5b05fe429b58 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:57.430547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5486e7-03b6-4f7c-9ab2-5b05fe429b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:57.430834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5486e7-03b6-4f7c-9ab2-5b05fe429b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:57.463147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5486e7-03b6-4f7c-9ab2-5b05fe429b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:57.464767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5486e7-03b6-4f7c-9ab2-5b05fe429b58 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:57.478156 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1215/2426] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:26:58.555538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46826799-cbb8-4817-91d3-6fd6aa4bf2c3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:58.558808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-46826799-cbb8-4817-91d3-6fd6aa4bf2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:58.589265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46826799-cbb8-4817-91d3-6fd6aa4bf2c3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:58.607271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:58.607929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:58.608212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:58.608483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] PATH_INFO: `/v3/projects/6e9753b2799348c6aa2c4e1502861530` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:58.614423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9753b2799348c6aa2c4e1502861530)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:58.624111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:58.708177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:58.815915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9753b2799348c6aa2c4e1502861530', 'request_id': 'req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:58.837762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9753b2799348c6aa2c4e1502861530', 'request_id': 'req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:58.856043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9753b2799348c6aa2c4e1502861530', 'request_id': 'req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:58.895767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] The token cache is being invalidate because project 6e9753b2799348c6aa2c4e1502861530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:26:58.896120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:58.897095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53dd9291-f445-420f-bf5a-6b6e3f82cb0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:26:58.900304 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1212/2427] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:26:58 2022] DELETE /identity/v3/projects/6e9753b2799348c6aa2c4e1502861530 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:58.907218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007daf6-ad9e-4e79-bc90-4d582850e3b5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:58.907646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007daf6-ad9e-4e79-bc90-4d582850e3b5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:58.907724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007daf6-ad9e-4e79-bc90-4d582850e3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:58.954890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8007daf6-ad9e-4e79-bc90-4d582850e3b5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:58.956794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8007daf6-ad9e-4e79-bc90-4d582850e3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:59.062073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:59.115789 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1216/2428] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:59.118018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85d86-d04d-4399-a523-aaf52e647cd8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:59.119236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85d86-d04d-4399-a523-aaf52e647cd8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:59.119592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85d86-d04d-4399-a523-aaf52e647cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:59.165542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4de85d86-d04d-4399-a523-aaf52e647cd8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:59.165910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4de85d86-d04d-4399-a523-aaf52e647cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:59.179251 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1213/2429] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:59.183724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007daf6-ad9e-4e79-bc90-4d582850e3b5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:59.195896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007daf6-ad9e-4e79-bc90-4d582850e3b5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:59.201622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88726784-c39d-4944-83e9-4064edec8d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:59.202256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726784-c39d-4944-83e9-4064edec8d2c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:59.202537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726784-c39d-4944-83e9-4064edec8d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:59.202812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726784-c39d-4944-83e9-4064edec8d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:59.203513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88726784-c39d-4944-83e9-4064edec8d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:26:59.203817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88726784-c39d-4944-83e9-4064edec8d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:59.205944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88726784-c39d-4944-83e9-4064edec8d2c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:59.219463 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1217/2430] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:26:59.223733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85d86-d04d-4399-a523-aaf52e647cd8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:59.236587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85d86-d04d-4399-a523-aaf52e647cd8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:59.242689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48671eb3-c285-423c-9956-6949eccd303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:59.243221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48671eb3-c285-423c-9956-6949eccd303c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:59.243498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48671eb3-c285-423c-9956-6949eccd303c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:59.243766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48671eb3-c285-423c-9956-6949eccd303c admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:59.244455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48671eb3-c285-423c-9956-6949eccd303c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:59.246910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48671eb3-c285-423c-9956-6949eccd303c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:59.283515 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1214/2431] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:26:59 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:26:59.287222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88726784-c39d-4944-83e9-4064edec8d2c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:59.301543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88726784-c39d-4944-83e9-4064edec8d2c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:59.459895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cc523-6670-4d10-b1af-2b4d6d1f5933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:59.460991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cc523-6670-4d10-b1af-2b4d6d1f5933 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:59.461456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cc523-6670-4d10-b1af-2b4d6d1f5933 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:59.461800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cc523-6670-4d10-b1af-2b4d6d1f5933 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:59.462853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cc523-6670-4d10-b1af-2b4d6d1f5933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:59.467733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cc523-6670-4d10-b1af-2b4d6d1f5933 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:59.521956 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1218/2432] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:26:59 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:26:59.526482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48671eb3-c285-423c-9956-6949eccd303c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:59.545999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48671eb3-c285-423c-9956-6949eccd303c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:59.554725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed8ee8-b159-4269-827a-0ffd4ac27ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:59.555456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed8ee8-b159-4269-827a-0ffd4ac27ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:59.556423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed8ee8-b159-4269-827a-0ffd4ac27ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:59.557416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed8ee8-b159-4269-827a-0ffd4ac27ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:59.558546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed8ee8-b159-4269-827a-0ffd4ac27ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:59.560945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed8ee8-b159-4269-827a-0ffd4ac27ec4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:59.583979 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1215/2433] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:59.588057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cc523-6670-4d10-b1af-2b4d6d1f5933 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:59.607636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cc523-6670-4d10-b1af-2b4d6d1f5933 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:59.615514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2cd52-629d-48c8-97ff-aa54c64839d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:59.616091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cd52-629d-48c8-97ff-aa54c64839d5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:59.616377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cd52-629d-48c8-97ff-aa54c64839d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:59.616656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cd52-629d-48c8-97ff-aa54c64839d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:59.619220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2cd52-629d-48c8-97ff-aa54c64839d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:59.620867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2cd52-629d-48c8-97ff-aa54c64839d5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:59.645254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed8ee8-b159-4269-827a-0ffd4ac27ec4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:59.645750 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1219/2434] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:26:59.657217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed8ee8-b159-4269-827a-0ffd4ac27ec4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:26:59.664357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf73669-bf5e-440d-a064-b63304c741d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:26:59.665199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf73669-bf5e-440d-a064-b63304c741d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:59.665683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf73669-bf5e-440d-a064-b63304c741d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:59.666058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf73669-bf5e-440d-a064-b63304c741d2 admin admin] PATH_INFO: `/v3/projects/879d436e9d1a43ee8df0e652dbb6307a/users/1ff9744258414abeb64b442b0d295c1c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:59.685409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf73669-bf5e-440d-a064-b63304c741d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879d436e9d1a43ee8df0e652dbb6307a, user_id=1ff9744258414abeb64b442b0d295c1c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:26:59.686801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf73669-bf5e-440d-a064-b63304c741d2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:26:59.723145 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1216/2435] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:26:59 2022] PUT /identity/v3/projects/879d436e9d1a43ee8df0e652dbb6307a/users/1ff9744258414abeb64b442b0d295c1c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:26:59.728373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab761e9f-a715-4eba-950f-ed612c21ba73 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:26:59.728872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab761e9f-a715-4eba-950f-ed612c21ba73 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:26:59.729270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab761e9f-a715-4eba-950f-ed612c21ba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:26:59.770392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ab761e9f-a715-4eba-950f-ed612c21ba73 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:26:59.771781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ab761e9f-a715-4eba-950f-ed612c21ba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:59.830712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf73669-bf5e-440d-a064-b63304c741d2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:26:59.832532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0cf73669-bf5e-440d-a064-b63304c741d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:26:59.935962 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1220/2436] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:26:59.987254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf73669-bf5e-440d-a064-b63304c741d2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:00.001681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:00.002618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:00.003270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:00.004310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] PATH_INFO: `/v3/users/b15e02211d3e4253a2edba6e63425ca7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:00.006708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15e02211d3e4253a2edba6e63425ca7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:00.009103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:00.162437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15e02211d3e4253a2edba6e63425ca7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:00.165599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15e02211d3e4253a2edba6e63425ca7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:00.173959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:00.207926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15e02211d3e4253a2edba6e63425ca7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:00.208985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15e02211d3e4253a2edba6e63425ca7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:00.229727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15e02211d3e4253a2edba6e63425ca7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:00.258700 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1217/2437] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:26:59 2022] DELETE /identity/v3/users/b15e02211d3e4253a2edba6e63425ca7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:00.264322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b29f22-e05a-433e-b963-a5d584fe81c8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:00.264621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b29f22-e05a-433e-b963-a5d584fe81c8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:00.265103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b29f22-e05a-433e-b963-a5d584fe81c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:00.309726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-77b29f22-e05a-433e-b963-a5d584fe81c8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:00.319193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-77b29f22-e05a-433e-b963-a5d584fe81c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:00.474244 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1221/2438] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:00.481661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:00.484830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:00.716492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18babfa-ceae-4864-8f6d-6f326c373414 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:00.725137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19782f2-4652-4ce1-98f8-980636e52ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:00.726253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19782f2-4652-4ce1-98f8-980636e52ade service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:00.727546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19782f2-4652-4ce1-98f8-980636e52ade service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:00.728146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19782f2-4652-4ce1-98f8-980636e52ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:00.731481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d19782f2-4652-4ce1-98f8-980636e52ade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:00.765527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19782f2-4652-4ce1-98f8-980636e52ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:00.768587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19782f2-4652-4ce1-98f8-980636e52ade service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:00.783888 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1218/2439] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:27:00.805941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b29f22-e05a-433e-b963-a5d584fe81c8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:00.808477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-77b29f22-e05a-433e-b963-a5d584fe81c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:00.819919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:00.840560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b29f22-e05a-433e-b963-a5d584fe81c8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:00.858519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cdd8c-d61c-4abc-813f-8d924744a9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:00.859215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cdd8c-d61c-4abc-813f-8d924744a9cf service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:00.859969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cdd8c-d61c-4abc-813f-8d924744a9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:00.860242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cdd8c-d61c-4abc-813f-8d924744a9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:00.927848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cdd8c-d61c-4abc-813f-8d924744a9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:00.931959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cdd8c-d61c-4abc-813f-8d924744a9cf service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:00.963158 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1222/2440] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:01.740227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1bafa-534c-4a3d-ab8d-f1297994eeaf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:01.741889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1bafa-534c-4a3d-ab8d-f1297994eeaf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:01.742596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1bafa-534c-4a3d-ab8d-f1297994eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:01.828952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8aa1bafa-534c-4a3d-ab8d-f1297994eeaf None None] MFA Rules not processed for user `199c2a20a7e8425e8df281cfe251c880`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:01.830716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8aa1bafa-534c-4a3d-ab8d-f1297994eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:02.027227 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1219/2441] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:01 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:02.031365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cdd8c-d61c-4abc-813f-8d924744a9cf service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:02.032846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3a5cdd8c-d61c-4abc-813f-8d924744a9cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:02.073353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cdd8c-d61c-4abc-813f-8d924744a9cf service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:02.117028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc381323-482e-468a-8138-9e27991b2492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:02.117954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381323-482e-468a-8138-9e27991b2492 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:02.118390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381323-482e-468a-8138-9e27991b2492 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:02.118842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381323-482e-468a-8138-9e27991b2492 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:02.119661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc381323-482e-468a-8138-9e27991b2492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:02.121822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc381323-482e-468a-8138-9e27991b2492 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:02.190073 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1223/2442] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:02 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:02.195315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1bafa-534c-4a3d-ab8d-f1297994eeaf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:02.216950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1bafa-534c-4a3d-ab8d-f1297994eeaf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:02.365297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91bfe5-ca9e-4e7a-a83b-52b9d69f5e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:02.366467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91bfe5-ca9e-4e7a-a83b-52b9d69f5e0d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:02.367147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91bfe5-ca9e-4e7a-a83b-52b9d69f5e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:02.368050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91bfe5-ca9e-4e7a-a83b-52b9d69f5e0d admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:02.374710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91bfe5-ca9e-4e7a-a83b-52b9d69f5e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:02.378209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91bfe5-ca9e-4e7a-a83b-52b9d69f5e0d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:02.428383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:02.472364 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1220/2443] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:02 2022] POST /identity/v3/users => generated 308 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:02.477643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc381323-482e-468a-8138-9e27991b2492 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:02.496725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc381323-482e-468a-8138-9e27991b2492 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:02.508589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3156e66-8ff2-46a8-9bb2-2cbc85880afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:02.514470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3156e66-8ff2-46a8-9bb2-2cbc85880afc admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:02.516601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3156e66-8ff2-46a8-9bb2-2cbc85880afc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:02.517367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3156e66-8ff2-46a8-9bb2-2cbc85880afc admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:02.520292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3156e66-8ff2-46a8-9bb2-2cbc85880afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:02.527157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3156e66-8ff2-46a8-9bb2-2cbc85880afc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:02.574296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91bfe5-ca9e-4e7a-a83b-52b9d69f5e0d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:02.575167 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1224/2444] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:02.601045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91bfe5-ca9e-4e7a-a83b-52b9d69f5e0d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:02.616866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81aecf4-a133-4667-be61-f7c3bd6b9327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:02.617594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81aecf4-a133-4667-be61-f7c3bd6b9327 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:02.617877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81aecf4-a133-4667-be61-f7c3bd6b9327 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:02.618719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81aecf4-a133-4667-be61-f7c3bd6b9327 admin admin] PATH_INFO: `/v3/projects/2d62a388e7f14c98bfe0c4b18b559b97/users/5a35e1e03bb048e5a5d29d779c3d21e6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:02.665075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81aecf4-a133-4667-be61-f7c3bd6b9327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d62a388e7f14c98bfe0c4b18b559b97, user_id=5a35e1e03bb048e5a5d29d779c3d21e6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:02.667787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81aecf4-a133-4667-be61-f7c3bd6b9327 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:02.713368 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1221/2445] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:02 2022] PUT /identity/v3/projects/2d62a388e7f14c98bfe0c4b18b559b97/users/5a35e1e03bb048e5a5d29d779c3d21e6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:02.714775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3156e66-8ff2-46a8-9bb2-2cbc85880afc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:02.731373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3156e66-8ff2-46a8-9bb2-2cbc85880afc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:02.830446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81aecf4-a133-4667-be61-f7c3bd6b9327 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:02.832429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c81aecf4-a133-4667-be61-f7c3bd6b9327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:02.922922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8bebf-9fb3-438d-ad11-2ec91dadc556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:02.924341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8bebf-9fb3-438d-ad11-2ec91dadc556 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:02.924928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8bebf-9fb3-438d-ad11-2ec91dadc556 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:02.925429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8bebf-9fb3-438d-ad11-2ec91dadc556 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:02.926612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8bebf-9fb3-438d-ad11-2ec91dadc556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:02.928519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8bebf-9fb3-438d-ad11-2ec91dadc556 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:02.968989 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1225/2446] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:02.973154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8bebf-9fb3-438d-ad11-2ec91dadc556 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:02.999263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81aecf4-a133-4667-be61-f7c3bd6b9327 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:03.006642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:03.008406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:03.008406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:03.008555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] PATH_INFO: `/v3/projects/8c8b592ba7bb42b0b875db6065b0929c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:03.009813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8b592ba7bb42b0b875db6065b0929c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:03.011451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8bebf-9fb3-438d-ad11-2ec91dadc556 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:03.012156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:03.021749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674f067-f765-460a-aa02-00e41104809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:03.022821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674f067-f765-460a-aa02-00e41104809e admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:03.023589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674f067-f765-460a-aa02-00e41104809e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:03.024188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674f067-f765-460a-aa02-00e41104809e admin admin] PATH_INFO: `/v3/projects/2d62a388e7f14c98bfe0c4b18b559b97/users/5a35e1e03bb048e5a5d29d779c3d21e6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:03.028612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674f067-f765-460a-aa02-00e41104809e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d62a388e7f14c98bfe0c4b18b559b97, user_id=5a35e1e03bb048e5a5d29d779c3d21e6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:03.034700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674f067-f765-460a-aa02-00e41104809e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:03.072702 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1226/2447] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:02 2022] PUT /identity/v3/projects/2d62a388e7f14c98bfe0c4b18b559b97/users/5a35e1e03bb048e5a5d29d779c3d21e6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:03.075307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8b592ba7bb42b0b875db6065b0929c', 'request_id': 'req-c11539c4-beb5-40ed-832c-023354e63f73'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:03.082771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8b592ba7bb42b0b875db6065b0929c', 'request_id': 'req-c11539c4-beb5-40ed-832c-023354e63f73'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:03.094019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8b592ba7bb42b0b875db6065b0929c', 'request_id': 'req-c11539c4-beb5-40ed-832c-023354e63f73'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:03.108155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] The token cache is being invalidate because project 8c8b592ba7bb42b0b875db6065b0929c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:27:03.108449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:03.109184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:03.111637 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1222/2448] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:02 2022] DELETE /identity/v3/projects/8c8b592ba7bb42b0b875db6065b0929c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:27:03.115526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674f067-f765-460a-aa02-00e41104809e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:03.118109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a674f067-f765-460a-aa02-00e41104809e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:03.326688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674f067-f765-460a-aa02-00e41104809e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:03.503595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:03.543042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a72ecd-7a12-4532-94c9-0f5dd60bb7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:03.544382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a72ecd-7a12-4532-94c9-0f5dd60bb7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:03.548576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a72ecd-7a12-4532-94c9-0f5dd60bb7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:03.548886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a72ecd-7a12-4532-94c9-0f5dd60bb7ce admin admin] PATH_INFO: `/v3/users/f23cea6c1904468c9b54ee548966dead` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:03.550345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a72ecd-7a12-4532-94c9-0f5dd60bb7ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23cea6c1904468c9b54ee548966dead)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:03.561711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a72ecd-7a12-4532-94c9-0f5dd60bb7ce admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:03.733290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a72ecd-7a12-4532-94c9-0f5dd60bb7ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23cea6c1904468c9b54ee548966dead'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:03.734788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a72ecd-7a12-4532-94c9-0f5dd60bb7ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23cea6c1904468c9b54ee548966dead'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:03.780723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a72ecd-7a12-4532-94c9-0f5dd60bb7ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23cea6c1904468c9b54ee548966dead'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:03.851204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a72ecd-7a12-4532-94c9-0f5dd60bb7ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23cea6c1904468c9b54ee548966dead'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:03.871802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a72ecd-7a12-4532-94c9-0f5dd60bb7ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23cea6c1904468c9b54ee548966dead'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:03.908293 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1227/2449] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:27:03 2022] DELETE /identity/v3/users/f23cea6c1904468c9b54ee548966dead => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:04.612524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:04.614794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:04.654442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11539c4-beb5-40ed-832c-023354e63f73 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:04.921790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:04.951092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f720fb1-bc2e-4b7e-82a0-f55ecba5586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:04.957027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f720fb1-bc2e-4b7e-82a0-f55ecba5586d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:04.957769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f720fb1-bc2e-4b7e-82a0-f55ecba5586d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:04.958054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f720fb1-bc2e-4b7e-82a0-f55ecba5586d admin admin] PATH_INFO: `/v3/users/0e05f5de07aa4189bc933dd2a5fb0205` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:04.964475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f720fb1-bc2e-4b7e-82a0-f55ecba5586d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e05f5de07aa4189bc933dd2a5fb0205)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:04.971991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f720fb1-bc2e-4b7e-82a0-f55ecba5586d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:05.132209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f720fb1-bc2e-4b7e-82a0-f55ecba5586d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e05f5de07aa4189bc933dd2a5fb0205'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:05.133219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f720fb1-bc2e-4b7e-82a0-f55ecba5586d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e05f5de07aa4189bc933dd2a5fb0205'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:05.168225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f720fb1-bc2e-4b7e-82a0-f55ecba5586d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e05f5de07aa4189bc933dd2a5fb0205'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:05.169010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f720fb1-bc2e-4b7e-82a0-f55ecba5586d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e05f5de07aa4189bc933dd2a5fb0205'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:05.190507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f720fb1-bc2e-4b7e-82a0-f55ecba5586d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e05f5de07aa4189bc933dd2a5fb0205'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:05.221534 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1223/2450] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:27:04 2022] DELETE /identity/v3/users/0e05f5de07aa4189bc933dd2a5fb0205 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:05.223854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894cb28-f67f-4b3d-8574-41425afb7964 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:05.224325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894cb28-f67f-4b3d-8574-41425afb7964 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:05.224873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894cb28-f67f-4b3d-8574-41425afb7964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:05.307761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1894cb28-f67f-4b3d-8574-41425afb7964 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:05.317411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1894cb28-f67f-4b3d-8574-41425afb7964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:05.592834 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1228/2451] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:05.621325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56215a-e307-4140-9b3d-f34cadafbdb3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:05.622208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56215a-e307-4140-9b3d-f34cadafbdb3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:05.622494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56215a-e307-4140-9b3d-f34cadafbdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:05.686586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894cb28-f67f-4b3d-8574-41425afb7964 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:05.688720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1894cb28-f67f-4b3d-8574-41425afb7964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:05.698420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2a56215a-e307-4140-9b3d-f34cadafbdb3 None None] MFA Rules not processed for user `0b1859c03d84435db08be11ac1422e23`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:05.699984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2a56215a-e307-4140-9b3d-f34cadafbdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:05.904722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894cb28-f67f-4b3d-8574-41425afb7964 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:05.929019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd4266-bbed-4126-9cbe-1737ce0e2cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:05.931076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd4266-bbed-4126-9cbe-1737ce0e2cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:05.931402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd4266-bbed-4126-9cbe-1737ce0e2cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:05.931747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd4266-bbed-4126-9cbe-1737ce0e2cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:05.972208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd4266-bbed-4126-9cbe-1737ce0e2cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:05.977254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd4266-bbed-4126-9cbe-1737ce0e2cd2 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:05.986902 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1224/2452] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:27:05.993481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56215a-e307-4140-9b3d-f34cadafbdb3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:05.995351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2a56215a-e307-4140-9b3d-f34cadafbdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:06.016461 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1229/2453] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:27:06.040478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56215a-e307-4140-9b3d-f34cadafbdb3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:06.055163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414824d-a087-47e8-8e66-ca1401c6f362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:06.055842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414824d-a087-47e8-8e66-ca1401c6f362 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:06.056151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414824d-a087-47e8-8e66-ca1401c6f362 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:06.056450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414824d-a087-47e8-8e66-ca1401c6f362 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:06.059528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414824d-a087-47e8-8e66-ca1401c6f362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:06.064877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414824d-a087-47e8-8e66-ca1401c6f362 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:06.145605 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1225/2454] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:05 2022] POST /identity/v3/projects => generated 405 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:27:06.149854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd4266-bbed-4126-9cbe-1737ce0e2cd2 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:06.165802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd4266-bbed-4126-9cbe-1737ce0e2cd2 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:06.193686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:06.377656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a528f7-077a-4690-9222-fcac78bb13da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:06.378809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a528f7-077a-4690-9222-fcac78bb13da admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:06.379098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a528f7-077a-4690-9222-fcac78bb13da admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:06.379381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a528f7-077a-4690-9222-fcac78bb13da admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:06.380068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a528f7-077a-4690-9222-fcac78bb13da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:06.388950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a528f7-077a-4690-9222-fcac78bb13da admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:06.437895 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1230/2455] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:06 2022] POST /identity/v3/users => generated 309 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:06.440949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414824d-a087-47e8-8e66-ca1401c6f362 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:06.459598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414824d-a087-47e8-8e66-ca1401c6f362 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:06.471742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c773876-e0db-4dce-b66c-7d62f7d3ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:06.474241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c773876-e0db-4dce-b66c-7d62f7d3ba79 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:06.474750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c773876-e0db-4dce-b66c-7d62f7d3ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:06.475040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c773876-e0db-4dce-b66c-7d62f7d3ba79 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:06.481959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c773876-e0db-4dce-b66c-7d62f7d3ba79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:06.482783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c773876-e0db-4dce-b66c-7d62f7d3ba79 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:06.525150 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1226/2456] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:06.529985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a528f7-077a-4690-9222-fcac78bb13da admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:06.548983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a528f7-077a-4690-9222-fcac78bb13da admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:06.560916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9a4b2-29da-4ec1-9e4f-ec9122bb31dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:06.561642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9a4b2-29da-4ec1-9e4f-ec9122bb31dc admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:06.561931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9a4b2-29da-4ec1-9e4f-ec9122bb31dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:06.565031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9a4b2-29da-4ec1-9e4f-ec9122bb31dc admin admin] PATH_INFO: `/v3/projects/006fe095fe244d0d832ad0e40ad964df/users/7f8d1eebe02949738af4ac6452560795/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:06.606277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9a4b2-29da-4ec1-9e4f-ec9122bb31dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=006fe095fe244d0d832ad0e40ad964df, user_id=7f8d1eebe02949738af4ac6452560795, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:06.609034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9a4b2-29da-4ec1-9e4f-ec9122bb31dc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:06.653555 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1231/2457] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:06 2022] PUT /identity/v3/projects/006fe095fe244d0d832ad0e40ad964df/users/7f8d1eebe02949738af4ac6452560795/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:06.658173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c773876-e0db-4dce-b66c-7d62f7d3ba79 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:06.687936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c773876-e0db-4dce-b66c-7d62f7d3ba79 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:06.776663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:06.855696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5feb-3f5b-4290-bc3e-7d8abfae7789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:06.861021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5feb-3f5b-4290-bc3e-7d8abfae7789 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:06.861369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5feb-3f5b-4290-bc3e-7d8abfae7789 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:06.861693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5feb-3f5b-4290-bc3e-7d8abfae7789 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:06.863992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a5feb-3f5b-4290-bc3e-7d8abfae7789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:06.868794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a5feb-3f5b-4290-bc3e-7d8abfae7789 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:06.892955 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1227/2458] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:06.896124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9a4b2-29da-4ec1-9e4f-ec9122bb31dc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:06.914590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9a4b2-29da-4ec1-9e4f-ec9122bb31dc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:06.931283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e50e67-079e-42ba-8c8b-7d2be28b9970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:06.934272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e50e67-079e-42ba-8c8b-7d2be28b9970 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:06.935480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e50e67-079e-42ba-8c8b-7d2be28b9970 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:06.936159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e50e67-079e-42ba-8c8b-7d2be28b9970 admin admin] PATH_INFO: `/v3/projects/006fe095fe244d0d832ad0e40ad964df/users/7f8d1eebe02949738af4ac6452560795/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:06.944934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e50e67-079e-42ba-8c8b-7d2be28b9970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006fe095fe244d0d832ad0e40ad964df, user_id=7f8d1eebe02949738af4ac6452560795, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:06.955964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e50e67-079e-42ba-8c8b-7d2be28b9970 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:06.989273 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1232/2459] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:06 2022] PUT /identity/v3/projects/006fe095fe244d0d832ad0e40ad964df/users/7f8d1eebe02949738af4ac6452560795/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:27:07.089377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5feb-3f5b-4290-bc3e-7d8abfae7789 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:07.093667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4e4a5feb-3f5b-4290-bc3e-7d8abfae7789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:07.112319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e50e67-079e-42ba-8c8b-7d2be28b9970 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:07.114442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b2e50e67-079e-42ba-8c8b-7d2be28b9970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:07.130025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5feb-3f5b-4290-bc3e-7d8abfae7789 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:07.287674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e50e67-079e-42ba-8c8b-7d2be28b9970 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:07.288877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:07.289647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:07.290953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:07.291689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] PATH_INFO: `/v3/projects/cacd3a8ccc674a0ab775b2aa20ec08ec` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:07.295446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cacd3a8ccc674a0ab775b2aa20ec08ec)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:07.302656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:07.304430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:07.307333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:07.309478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:07.310287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] PATH_INFO: `/v3/projects/ba249d380db04f328158c701e9ec2b47` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:07.313692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba249d380db04f328158c701e9ec2b47)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:07.319082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:07.450800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'request_id': 'req-9ce61d4c-e3dc-4457-a644-ca3be40ce251'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:07.496792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'request_id': 'req-9ce61d4c-e3dc-4457-a644-ca3be40ce251'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:07.509914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba249d380db04f328158c701e9ec2b47', 'request_id': 'req-ea15cb80-d660-4c7b-9cc8-08379166b021'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:07.539637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cacd3a8ccc674a0ab775b2aa20ec08ec', 'request_id': 'req-9ce61d4c-e3dc-4457-a644-ca3be40ce251'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:07.551802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba249d380db04f328158c701e9ec2b47', 'request_id': 'req-ea15cb80-d660-4c7b-9cc8-08379166b021'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:07.568852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:07.585601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba249d380db04f328158c701e9ec2b47', 'request_id': 'req-ea15cb80-d660-4c7b-9cc8-08379166b021'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:07.587322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] The token cache is being invalidate because project cacd3a8ccc674a0ab775b2aa20ec08ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:27:07.587617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:07.590473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:07.597274 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1228/2460] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:07 2022] DELETE /identity/v3/projects/cacd3a8ccc674a0ab775b2aa20ec08ec => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:07.602852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:07.606328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:07.637026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] The token cache is being invalidate because project ba249d380db04f328158c701e9ec2b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:27:07.640250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:07.643881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ea15cb80-d660-4c7b-9cc8-08379166b021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:07.661360 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1233/2461] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:07 2022] DELETE /identity/v3/projects/ba249d380db04f328158c701e9ec2b47 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:07.667512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd1e89-c41e-413b-ac9f-01e4c7489095 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:07.668023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd1e89-c41e-413b-ac9f-01e4c7489095 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:07.669110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd1e89-c41e-413b-ac9f-01e4c7489095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:07.731118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d6fd1e89-c41e-413b-ac9f-01e4c7489095 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:07.732388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d6fd1e89-c41e-413b-ac9f-01e4c7489095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:07.801411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:07.816847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce61d4c-e3dc-4457-a644-ca3be40ce251 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:07.932402 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1234/2462] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:27:07.934114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaf4bc-50c9-4eee-8c19-3f166f32e9b9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:07.934507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaf4bc-50c9-4eee-8c19-3f166f32e9b9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:07.934793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaf4bc-50c9-4eee-8c19-3f166f32e9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:07.980645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:07.981310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:07.981627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:07.981911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] PATH_INFO: `/v3/users/926654a9e5524c8299925b6a648409a9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:07.984984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-99aaf4bc-50c9-4eee-8c19-3f166f32e9b9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:07.986271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=926654a9e5524c8299925b6a648409a9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:07.988279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:07.988644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-99aaf4bc-50c9-4eee-8c19-3f166f32e9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:08.012271 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1235/2463] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:27:08.013986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaf4bc-50c9-4eee-8c19-3f166f32e9b9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:08.050913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaf4bc-50c9-4eee-8c19-3f166f32e9b9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:08.073011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181c9a8-4897-445b-93f2-bff64c1d0d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:08.073808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181c9a8-4897-445b-93f2-bff64c1d0d6f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:08.074301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181c9a8-4897-445b-93f2-bff64c1d0d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:08.074554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181c9a8-4897-445b-93f2-bff64c1d0d6f admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:08.077514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181c9a8-4897-445b-93f2-bff64c1d0d6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:27:08.078383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181c9a8-4897-445b-93f2-bff64c1d0d6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:08.084389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181c9a8-4897-445b-93f2-bff64c1d0d6f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:08.112208 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1236/2464] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:27:08.116489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181c9a8-4897-445b-93f2-bff64c1d0d6f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:08.127204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926654a9e5524c8299925b6a648409a9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:08.132801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926654a9e5524c8299925b6a648409a9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:08.137072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181c9a8-4897-445b-93f2-bff64c1d0d6f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:08.151738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571094c7-d50d-4043-8133-ae36094588db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:08.151988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571094c7-d50d-4043-8133-ae36094588db admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:08.152260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571094c7-d50d-4043-8133-ae36094588db admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:08.152581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571094c7-d50d-4043-8133-ae36094588db admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:08.153293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571094c7-d50d-4043-8133-ae36094588db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:08.155703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571094c7-d50d-4043-8133-ae36094588db admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:08.172465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926654a9e5524c8299925b6a648409a9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:08.188084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926654a9e5524c8299925b6a648409a9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:08.215151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926654a9e5524c8299925b6a648409a9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:08.223760 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1237/2465] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:08 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:08.225827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571094c7-d50d-4043-8133-ae36094588db admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:08.230093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-571094c7-d50d-4043-8133-ae36094588db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:08.259084 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1229/2466] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:27:07 2022] DELETE /identity/v3/users/926654a9e5524c8299925b6a648409a9 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:08.345001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571094c7-d50d-4043-8133-ae36094588db admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:08.465324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:08.486095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bab22-3b28-40a7-9da9-8eca86096626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:08.486748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bab22-3b28-40a7-9da9-8eca86096626 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:08.488936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bab22-3b28-40a7-9da9-8eca86096626 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:08.489172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bab22-3b28-40a7-9da9-8eca86096626 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:08.491872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bab22-3b28-40a7-9da9-8eca86096626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:08.495664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bab22-3b28-40a7-9da9-8eca86096626 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:08.564196 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1238/2467] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:08 2022] POST /identity/v3/users => generated 285 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:08.568549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:08.580371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd455ff-5496-43e7-8b6b-e826ce255faa admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:08.598731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d258a7-c863-441e-b1fb-570b827e57eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:08.600397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d258a7-c863-441e-b1fb-570b827e57eb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:08.601024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d258a7-c863-441e-b1fb-570b827e57eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:08.601598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d258a7-c863-441e-b1fb-570b827e57eb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:08.602458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d258a7-c863-441e-b1fb-570b827e57eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:08.609029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d258a7-c863-441e-b1fb-570b827e57eb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:08.657130 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1230/2468] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:08.660215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bab22-3b28-40a7-9da9-8eca86096626 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:08.676363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bab22-3b28-40a7-9da9-8eca86096626 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:08.685712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632f945-0ce3-48d0-9636-2002ea5d7a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:08.686665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f945-0ce3-48d0-9636-2002ea5d7a20 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:08.687094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f945-0ce3-48d0-9636-2002ea5d7a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:08.687607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f945-0ce3-48d0-9636-2002ea5d7a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:08.688653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632f945-0ce3-48d0-9636-2002ea5d7a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:08.694952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632f945-0ce3-48d0-9636-2002ea5d7a20 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:08.723735 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1239/2469] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:08.725918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d258a7-c863-441e-b1fb-570b827e57eb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:08.745625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d258a7-c863-441e-b1fb-570b827e57eb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:08.767780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd9fab-bb42-4ff8-8a35-5b7c23f10dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:08.768435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd9fab-bb42-4ff8-8a35-5b7c23f10dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:08.768721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd9fab-bb42-4ff8-8a35-5b7c23f10dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:08.768992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd9fab-bb42-4ff8-8a35-5b7c23f10dd4 admin admin] PATH_INFO: `/v3/projects/b9b97953a3f4422daff2f39e2f550f69/users/1090ca71c5b247d1a54473c1b1823126/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:08.797818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd9fab-bb42-4ff8-8a35-5b7c23f10dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b97953a3f4422daff2f39e2f550f69, user_id=1090ca71c5b247d1a54473c1b1823126, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:08.800578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd9fab-bb42-4ff8-8a35-5b7c23f10dd4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:08.841674 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1231/2470] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:08 2022] PUT /identity/v3/projects/b9b97953a3f4422daff2f39e2f550f69/users/1090ca71c5b247d1a54473c1b1823126/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:08.845364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3828dac-a647-43e0-afd2-556c7ceb5203 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:08.845728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3828dac-a647-43e0-afd2-556c7ceb5203 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:08.846012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3828dac-a647-43e0-afd2-556c7ceb5203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:08.928418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c3828dac-a647-43e0-afd2-556c7ceb5203 None None] MFA Rules not processed for user `1090ca71c5b247d1a54473c1b1823126`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:08.932196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c3828dac-a647-43e0-afd2-556c7ceb5203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:09.172688 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1240/2471] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:09.191055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd9fab-bb42-4ff8-8a35-5b7c23f10dd4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:09.193279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f8bd9fab-bb42-4ff8-8a35-5b7c23f10dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:09.312863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:09.315040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3828dac-a647-43e0-afd2-556c7ceb5203 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:09.317979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c3828dac-a647-43e0-afd2-556c7ceb5203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:09.421466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd9fab-bb42-4ff8-8a35-5b7c23f10dd4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:09.442596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bee02-5c60-4546-b0af-b32b2b5aa682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:09.443223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bee02-5c60-4546-b0af-b32b2b5aa682 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:09.443505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bee02-5c60-4546-b0af-b32b2b5aa682 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:09.443776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bee02-5c60-4546-b0af-b32b2b5aa682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:09.459600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bee02-5c60-4546-b0af-b32b2b5aa682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:09.463297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bee02-5c60-4546-b0af-b32b2b5aa682 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:09.512485 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1232/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:09.543593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3828dac-a647-43e0-afd2-556c7ceb5203 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:09.557264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:09.558043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:09.558326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:09.558652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] PATH_INFO: `/v3/projects/31f2208094e3493690a0cf3e6f17bf9c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:09.562033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f2208094e3493690a0cf3e6f17bf9c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:09.564197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:09.701202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f2208094e3493690a0cf3e6f17bf9c', 'request_id': 'req-fe8b624c-f3b5-4ada-9773-737626e95df7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:09.726677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f2208094e3493690a0cf3e6f17bf9c', 'request_id': 'req-fe8b624c-f3b5-4ada-9773-737626e95df7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:09.754561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f2208094e3493690a0cf3e6f17bf9c', 'request_id': 'req-fe8b624c-f3b5-4ada-9773-737626e95df7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:09.762014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:09.793683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] The token cache is being invalidate because project 31f2208094e3493690a0cf3e6f17bf9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:27:09.794064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:09.795107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe8b624c-f3b5-4ada-9773-737626e95df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:09.808383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfca0df-05bf-4173-bdf8-1d72adb344bb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:09.808708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfca0df-05bf-4173-bdf8-1d72adb344bb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:09.808994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfca0df-05bf-4173-bdf8-1d72adb344bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:09.814751 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1241/2473] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:09 2022] DELETE /identity/v3/projects/31f2208094e3493690a0cf3e6f17bf9c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:09.866544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1dfca0df-05bf-4173-bdf8-1d72adb344bb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:09.872431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1dfca0df-05bf-4173-bdf8-1d72adb344bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:10.046498 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1233/2474] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:10.057296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae8d8-545f-4a68-88f8-9f24274543cb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:10.057766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae8d8-545f-4a68-88f8-9f24274543cb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:10.058146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae8d8-545f-4a68-88f8-9f24274543cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:10.117499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1dfae8d8-545f-4a68-88f8-9f24274543cb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:10.121245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1dfae8d8-545f-4a68-88f8-9f24274543cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:10.142089 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1242/2475] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:10.147112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfca0df-05bf-4173-bdf8-1d72adb344bb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:10.170691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfca0df-05bf-4173-bdf8-1d72adb344bb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:10.178492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e0024-9a46-4776-98d5-1fb4e4139ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:10.180969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0024-9a46-4776-98d5-1fb4e4139ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:10.182829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0024-9a46-4776-98d5-1fb4e4139ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:10.183082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0024-9a46-4776-98d5-1fb4e4139ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:10.185107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e0024-9a46-4776-98d5-1fb4e4139ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:27:10.185454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e0024-9a46-4776-98d5-1fb4e4139ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:10.195428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e0024-9a46-4776-98d5-1fb4e4139ac2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:10.227305 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1234/2476] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:27:10.232286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfae8d8-545f-4a68-88f8-9f24274543cb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:10.254941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfae8d8-545f-4a68-88f8-9f24274543cb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:10.259967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274bbef-349f-42a4-8830-e8636e1ed379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:10.260596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274bbef-349f-42a4-8830-e8636e1ed379 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:10.260872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274bbef-349f-42a4-8830-e8636e1ed379 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:10.261144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274bbef-349f-42a4-8830-e8636e1ed379 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:10.261824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274bbef-349f-42a4-8830-e8636e1ed379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:10.266335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274bbef-349f-42a4-8830-e8636e1ed379 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:10.411368 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1243/2477] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:10 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:10.414137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e0024-9a46-4776-98d5-1fb4e4139ac2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:10.487224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e0024-9a46-4776-98d5-1fb4e4139ac2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:10.765918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7180cb-410a-427c-9221-ccb291247ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:10.766566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7180cb-410a-427c-9221-ccb291247ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:10.766845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7180cb-410a-427c-9221-ccb291247ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:10.767118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7180cb-410a-427c-9221-ccb291247ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:10.767783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7180cb-410a-427c-9221-ccb291247ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:10.769883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7180cb-410a-427c-9221-ccb291247ff5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:10.774565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274bbef-349f-42a4-8830-e8636e1ed379 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:10.777953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f274bbef-349f-42a4-8830-e8636e1ed379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:10.802832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274bbef-349f-42a4-8830-e8636e1ed379 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:10.819398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fb43-9661-4747-bfb5-2edda24ef48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:10.820603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fb43-9661-4747-bfb5-2edda24ef48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:10.821535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fb43-9661-4747-bfb5-2edda24ef48b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:10.822464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fb43-9661-4747-bfb5-2edda24ef48b admin admin] PATH_INFO: `/v3/users/1090ca71c5b247d1a54473c1b1823126` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:10.826718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6fb43-9661-4747-bfb5-2edda24ef48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1090ca71c5b247d1a54473c1b1823126)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:10.833101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6fb43-9661-4747-bfb5-2edda24ef48b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:10.849480 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1235/2478] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:10 2022] POST /identity/v3/users => generated 293 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:10.851515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7180cb-410a-427c-9221-ccb291247ff5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:10.875823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7180cb-410a-427c-9221-ccb291247ff5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:10.883665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e7f8f-caab-4bd4-9ef0-0d3b77f1e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:10.884358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7f8f-caab-4bd4-9ef0-0d3b77f1e9bb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:10.884706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7f8f-caab-4bd4-9ef0-0d3b77f1e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:10.884984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7f8f-caab-4bd4-9ef0-0d3b77f1e9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:10.885675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e7f8f-caab-4bd4-9ef0-0d3b77f1e9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:10.890230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e7f8f-caab-4bd4-9ef0-0d3b77f1e9bb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:10.912076 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1236/2479] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:27:10.918004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e7f8f-caab-4bd4-9ef0-0d3b77f1e9bb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:10.943782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e7f8f-caab-4bd4-9ef0-0d3b77f1e9bb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:10.952439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-26a6fb43-9661-4747-bfb5-2edda24ef48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1090ca71c5b247d1a54473c1b1823126'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:10.953299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-26a6fb43-9661-4747-bfb5-2edda24ef48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1090ca71c5b247d1a54473c1b1823126'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:10.958009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2587e-d5f3-4efd-b8c1-30baf67f4ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:10.959841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2587e-d5f3-4efd-b8c1-30baf67f4ced admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:10.960372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2587e-d5f3-4efd-b8c1-30baf67f4ced admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:10.961848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2587e-d5f3-4efd-b8c1-30baf67f4ced admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:10.962755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2587e-d5f3-4efd-b8c1-30baf67f4ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:10.964402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2587e-d5f3-4efd-b8c1-30baf67f4ced admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:10.985640 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1237/2480] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:10.990347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-26a6fb43-9661-4747-bfb5-2edda24ef48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1090ca71c5b247d1a54473c1b1823126'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:10.993260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2587e-d5f3-4efd-b8c1-30baf67f4ced admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:11.005000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-26a6fb43-9661-4747-bfb5-2edda24ef48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1090ca71c5b247d1a54473c1b1823126'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:11.017943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-26a6fb43-9661-4747-bfb5-2edda24ef48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1090ca71c5b247d1a54473c1b1823126'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:11.019853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2587e-d5f3-4efd-b8c1-30baf67f4ced admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:11.034943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f969b6-35dd-4cad-ae58-095c97035b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:11.036324 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1244/2481] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:27:10 2022] DELETE /identity/v3/users/1090ca71c5b247d1a54473c1b1823126 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:11.040251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f969b6-35dd-4cad-ae58-095c97035b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:11.040873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f969b6-35dd-4cad-ae58-095c97035b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:11.041208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070227-fa6f-4fa0-bd14-4a320a741751 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:11.041600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f969b6-35dd-4cad-ae58-095c97035b76 admin admin] PATH_INFO: `/v3/projects/d1c30e219a764f70a70ffe5bf6c640b3/users/36b5833ebde5402491bd80f82f6bfa23/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:11.041875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070227-fa6f-4fa0-bd14-4a320a741751 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:11.042155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070227-fa6f-4fa0-bd14-4a320a741751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:11.083737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f969b6-35dd-4cad-ae58-095c97035b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c30e219a764f70a70ffe5bf6c640b3, user_id=36b5833ebde5402491bd80f82f6bfa23, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:11.085647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-42070227-fa6f-4fa0-bd14-4a320a741751 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:11.086898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42070227-fa6f-4fa0-bd14-4a320a741751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:11.087609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f969b6-35dd-4cad-ae58-095c97035b76 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:11.111693 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1238/2482] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:10 2022] PUT /identity/v3/projects/d1c30e219a764f70a70ffe5bf6c640b3/users/36b5833ebde5402491bd80f82f6bfa23/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:11.127983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f8929-bfb9-4a55-b16d-3a26dcd6a17d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:11.128660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f8929-bfb9-4a55-b16d-3a26dcd6a17d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:11.147373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f8929-bfb9-4a55-b16d-3a26dcd6a17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:11.214086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:11.244230 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1245/2483] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:11.270651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-873f8929-bfb9-4a55-b16d-3a26dcd6a17d None None] MFA Rules not processed for user `36b5833ebde5402491bd80f82f6bfa23`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:11.272675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-873f8929-bfb9-4a55-b16d-3a26dcd6a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:11.304056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42070227-fa6f-4fa0-bd14-4a320a741751 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:11.305828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42070227-fa6f-4fa0-bd14-4a320a741751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:11.438505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:11.463079 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1239/2484] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:11.471454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f8929-bfb9-4a55-b16d-3a26dcd6a17d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:11.476791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-873f8929-bfb9-4a55-b16d-3a26dcd6a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:11.506665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42070227-fa6f-4fa0-bd14-4a320a741751 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:11.662771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55662fb9-30d4-4cd5-b026-b68dd3df314d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:11.664018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662fb9-30d4-4cd5-b026-b68dd3df314d service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:11.664301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662fb9-30d4-4cd5-b026-b68dd3df314d service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:11.664577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662fb9-30d4-4cd5-b026-b68dd3df314d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:11.803486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f8929-bfb9-4a55-b16d-3a26dcd6a17d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:11.811754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba9443-cd4c-4cac-ba4a-470156eec133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:11.812462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba9443-cd4c-4cac-ba4a-470156eec133 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:11.812773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba9443-cd4c-4cac-ba4a-470156eec133 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:11.814498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba9443-cd4c-4cac-ba4a-470156eec133 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:11.815320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba9443-cd4c-4cac-ba4a-470156eec133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:11.822200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55662fb9-30d4-4cd5-b026-b68dd3df314d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:11.825448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55662fb9-30d4-4cd5-b026-b68dd3df314d service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:11.844483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba9443-cd4c-4cac-ba4a-470156eec133 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:11.854201 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1246/2485] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:27:11.923658 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1240/2486] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:11 2022] POST /identity/v3/projects => generated 385 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:11.925112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55662fb9-30d4-4cd5-b026-b68dd3df314d service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:11.955844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55662fb9-30d4-4cd5-b026-b68dd3df314d service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:12.254633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771a7f5-0520-451c-8e76-994f9d2b26e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:12.256044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771a7f5-0520-451c-8e76-994f9d2b26e0 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:12.256750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771a7f5-0520-451c-8e76-994f9d2b26e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:12.258681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771a7f5-0520-451c-8e76-994f9d2b26e0 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:12.260228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771a7f5-0520-451c-8e76-994f9d2b26e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:12.266227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771a7f5-0520-451c-8e76-994f9d2b26e0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:12.333072 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1247/2487] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:11 2022] POST /identity/v3/users => generated 299 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:12.337420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba9443-cd4c-4cac-ba4a-470156eec133 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:12.373425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba9443-cd4c-4cac-ba4a-470156eec133 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:12.393964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f7e44-4e3f-463a-a6a9-a3007e3ac6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:12.395529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f7e44-4e3f-463a-a6a9-a3007e3ac6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:12.398218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f7e44-4e3f-463a-a6a9-a3007e3ac6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:12.398949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f7e44-4e3f-463a-a6a9-a3007e3ac6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:12.400688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f7e44-4e3f-463a-a6a9-a3007e3ac6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:12.404834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f7e44-4e3f-463a-a6a9-a3007e3ac6b4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:12.432280 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1241/2488] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:12.437893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771a7f5-0520-451c-8e76-994f9d2b26e0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:12.483249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771a7f5-0520-451c-8e76-994f9d2b26e0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:12.508880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fc5d9-e28c-4e9a-8822-583d983c9e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:12.513831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fc5d9-e28c-4e9a-8822-583d983c9e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:12.517357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fc5d9-e28c-4e9a-8822-583d983c9e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:12.518121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fc5d9-e28c-4e9a-8822-583d983c9e1d admin admin] PATH_INFO: `/v3/projects/4858f81bee9942009b6fb2df52a3e745/users/937fc4573c374061a53d6e45d38d58eb/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:12.563919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fc5d9-e28c-4e9a-8822-583d983c9e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4858f81bee9942009b6fb2df52a3e745, user_id=937fc4573c374061a53d6e45d38d58eb, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:12.572506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fc5d9-e28c-4e9a-8822-583d983c9e1d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:12.617274 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1248/2489] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:12 2022] PUT /identity/v3/projects/4858f81bee9942009b6fb2df52a3e745/users/937fc4573c374061a53d6e45d38d58eb/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:12.623439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f7e44-4e3f-463a-a6a9-a3007e3ac6b4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:12.656099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f7e44-4e3f-463a-a6a9-a3007e3ac6b4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:12.725569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4bd8-083f-43b1-a24a-8842ae66a117 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:12.726450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4bd8-083f-43b1-a24a-8842ae66a117 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:12.726739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4bd8-083f-43b1-a24a-8842ae66a117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:12.777128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:12.793436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-844d4bd8-083f-43b1-a24a-8842ae66a117 None None] MFA Rules not processed for user `f331c1e3ee1442ad863d8909ca76020b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:12.794810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-844d4bd8-083f-43b1-a24a-8842ae66a117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:12.985956 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1249/2490] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:12.991290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d4bd8-083f-43b1-a24a-8842ae66a117 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:12.992940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-844d4bd8-083f-43b1-a24a-8842ae66a117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:13.001337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554a15-8eb7-4f19-bdc2-53b3ecf0149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:13.002666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554a15-8eb7-4f19-bdc2-53b3ecf0149f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:13.003229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554a15-8eb7-4f19-bdc2-53b3ecf0149f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:13.003756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554a15-8eb7-4f19-bdc2-53b3ecf0149f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:13.004961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df554a15-8eb7-4f19-bdc2-53b3ecf0149f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:13.008239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df554a15-8eb7-4f19-bdc2-53b3ecf0149f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:13.026069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d4bd8-083f-43b1-a24a-8842ae66a117 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:13.047486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d0934-0ce0-400d-b463-6cece9a028c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:13.048129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0934-0ce0-400d-b463-6cece9a028c6 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:13.048401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0934-0ce0-400d-b463-6cece9a028c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:13.050811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0934-0ce0-400d-b463-6cece9a028c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:13.051526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d0934-0ce0-400d-b463-6cece9a028c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:13.066447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d0934-0ce0-400d-b463-6cece9a028c6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:13.070057 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1242/2491] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:13.076442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554a15-8eb7-4f19-bdc2-53b3ecf0149f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:13.117793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:13.137292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554a15-8eb7-4f19-bdc2-53b3ecf0149f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:13.167807 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1250/2492] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:12 2022] POST /identity/v3/projects => generated 397 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:13.176025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d0934-0ce0-400d-b463-6cece9a028c6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:13.182698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e4394-328c-4732-8521-fc0eff96a0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:13.184722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e4394-328c-4732-8521-fc0eff96a0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:13.185194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e4394-328c-4732-8521-fc0eff96a0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:13.185918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e4394-328c-4732-8521-fc0eff96a0e7 admin admin] PATH_INFO: `/v3/projects/4858f81bee9942009b6fb2df52a3e745/users/937fc4573c374061a53d6e45d38d58eb/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:13.197355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e4394-328c-4732-8521-fc0eff96a0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4858f81bee9942009b6fb2df52a3e745, user_id=937fc4573c374061a53d6e45d38d58eb, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:13.210189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e4394-328c-4732-8521-fc0eff96a0e7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:13.273413 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1243/2493] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:13 2022] PUT /identity/v3/projects/4858f81bee9942009b6fb2df52a3e745/users/937fc4573c374061a53d6e45d38d58eb/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:13.299880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31435879-9809-4ad5-95d0-113a8b525c4f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:13.300303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31435879-9809-4ad5-95d0-113a8b525c4f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:13.300797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31435879-9809-4ad5-95d0-113a8b525c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:13.461184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-31435879-9809-4ad5-95d0-113a8b525c4f None None] MFA Rules not processed for user `937fc4573c374061a53d6e45d38d58eb`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:13.466431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-31435879-9809-4ad5-95d0-113a8b525c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:13.513694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d0934-0ce0-400d-b463-6cece9a028c6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:13.774089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6d9f1-a0b3-490f-8099-e6255f7d1440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:13.774863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6d9f1-a0b3-490f-8099-e6255f7d1440 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:13.775208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6d9f1-a0b3-490f-8099-e6255f7d1440 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:13.775545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6d9f1-a0b3-490f-8099-e6255f7d1440 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:13.776283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6d9f1-a0b3-490f-8099-e6255f7d1440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:13.778479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6d9f1-a0b3-490f-8099-e6255f7d1440 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:13.804373 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1244/2494] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:13.804373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924dfb4-09d7-4fd2-87f6-96063fa22134 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:13.804373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924dfb4-09d7-4fd2-87f6-96063fa22134 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:13.804373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924dfb4-09d7-4fd2-87f6-96063fa22134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:13.855907 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1251/2495] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:13 2022] POST /identity/v3/users => generated 305 bytes in 682 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:13.856747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6d9f1-a0b3-490f-8099-e6255f7d1440 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:13.862918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-28d6d9f1-a0b3-490f-8099-e6255f7d1440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:13.904808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6d9f1-a0b3-490f-8099-e6255f7d1440 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:13.915756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:13.916538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:13.916873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:13.917215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] PATH_INFO: `/v3/projects/b9b97953a3f4422daff2f39e2f550f69` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:13.921086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b97953a3f4422daff2f39e2f550f69)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:13.924306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:13.964755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:13.979583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d924dfb4-09d7-4fd2-87f6-96063fa22134 None None] MFA Rules not processed for user `e7e71fcf6711470db5a71ddc74ff709c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:14.006651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d924dfb4-09d7-4fd2-87f6-96063fa22134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:14.085416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b97953a3f4422daff2f39e2f550f69', 'request_id': 'req-9c551d80-f459-43fb-88d8-cf50c7e35df9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:14.105517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b97953a3f4422daff2f39e2f550f69', 'request_id': 'req-9c551d80-f459-43fb-88d8-cf50c7e35df9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:14.121758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b97953a3f4422daff2f39e2f550f69', 'request_id': 'req-9c551d80-f459-43fb-88d8-cf50c7e35df9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:14.160081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] The token cache is being invalidate because project b9b97953a3f4422daff2f39e2f550f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:27:14.160453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:14.162111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:14.175143 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1252/2496] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:13 2022] DELETE /identity/v3/projects/b9b97953a3f4422daff2f39e2f550f69 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:14.176182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:14.179697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:14.309314 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1245/2497] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:14.310407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924dfb4-09d7-4fd2-87f6-96063fa22134 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:14.321578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d924dfb4-09d7-4fd2-87f6-96063fa22134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:14.373719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924dfb4-09d7-4fd2-87f6-96063fa22134 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:14.382113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c551d80-f459-43fb-88d8-cf50c7e35df9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:14.390917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1b8a6-7f8b-4b8d-b4d7-91f1c7f1dceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:14.392824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1b8a6-7f8b-4b8d-b4d7-91f1c7f1dceb service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:14.395795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1b8a6-7f8b-4b8d-b4d7-91f1c7f1dceb service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:14.398239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1b8a6-7f8b-4b8d-b4d7-91f1c7f1dceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:14.407552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-edf1b8a6-7f8b-4b8d-b4d7-91f1c7f1dceb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:14.558911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1b8a6-7f8b-4b8d-b4d7-91f1c7f1dceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:14.564219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1b8a6-7f8b-4b8d-b4d7-91f1c7f1dceb service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:14.588528 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1253/2498] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:14.590524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641cff-79d1-456d-ba8e-95f8247323f7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:14.591005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641cff-79d1-456d-ba8e-95f8247323f7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:14.591116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641cff-79d1-456d-ba8e-95f8247323f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:14.607501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef02c6e-197d-45c2-ad38-455f99dfe9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:14.607784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02c6e-197d-45c2-ad38-455f99dfe9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:14.608028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02c6e-197d-45c2-ad38-455f99dfe9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:14.608302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02c6e-197d-45c2-ad38-455f99dfe9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:14.610474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef02c6e-197d-45c2-ad38-455f99dfe9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:14.612001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef02c6e-197d-45c2-ad38-455f99dfe9e8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:14.625785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-76641cff-79d1-456d-ba8e-95f8247323f7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:14.634756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76641cff-79d1-456d-ba8e-95f8247323f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:14.651135 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1254/2499] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:14.654700 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1246/2500] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:14.656584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef02c6e-197d-45c2-ad38-455f99dfe9e8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:14.660747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641cff-79d1-456d-ba8e-95f8247323f7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:14.664572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1ef02c6e-197d-45c2-ad38-455f99dfe9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:14.686156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:14.699470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef02c6e-197d-45c2-ad38-455f99dfe9e8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:14.707787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641cff-79d1-456d-ba8e-95f8247323f7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:14.721449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f64d0-863a-463e-9da3-4d97c2c77d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:14.722093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f64d0-863a-463e-9da3-4d97c2c77d81 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:14.722375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f64d0-863a-463e-9da3-4d97c2c77d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:14.722650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f64d0-863a-463e-9da3-4d97c2c77d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:14.723301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f64d0-863a-463e-9da3-4d97c2c77d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:14.725298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f64d0-863a-463e-9da3-4d97c2c77d81 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:14.742267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681793e-09f6-4fd9-8848-68db287ee5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:14.744915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681793e-09f6-4fd9-8848-68db287ee5df admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:14.745666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681793e-09f6-4fd9-8848-68db287ee5df admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:14.747987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681793e-09f6-4fd9-8848-68db287ee5df admin admin] PATH_INFO: `/v3/projects/6e4f427a535b4d51a0476f4b2cb71196/users/0c9580da14a34c67b6d53ddbb9e96df6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:14.801810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681793e-09f6-4fd9-8848-68db287ee5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4f427a535b4d51a0476f4b2cb71196, user_id=0c9580da14a34c67b6d53ddbb9e96df6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:14.802238 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1247/2501] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:14 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:14.803843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb471e5-27a4-4a5f-bc1f-55cf675eacaf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:14.804126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb471e5-27a4-4a5f-bc1f-55cf675eacaf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:14.804398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb471e5-27a4-4a5f-bc1f-55cf675eacaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:14.811746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681793e-09f6-4fd9-8848-68db287ee5df admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:14.831759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:14.840229 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1255/2502] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:14 2022] PUT /identity/v3/projects/6e4f427a535b4d51a0476f4b2cb71196/users/0c9580da14a34c67b6d53ddbb9e96df6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:14.842011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681793e-09f6-4fd9-8848-68db287ee5df admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:14.843779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bdb471e5-27a4-4a5f-bc1f-55cf675eacaf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:14.845268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bdb471e5-27a4-4a5f-bc1f-55cf675eacaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:14.994930 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1248/2503] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:14.997455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb471e5-27a4-4a5f-bc1f-55cf675eacaf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:14.999940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681793e-09f6-4fd9-8848-68db287ee5df admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:15.005497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48025914-de76-4309-99ef-c893411b4ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:15.006022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48025914-de76-4309-99ef-c893411b4ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.006842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48025914-de76-4309-99ef-c893411b4ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.006842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48025914-de76-4309-99ef-c893411b4ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.007355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48025914-de76-4309-99ef-c893411b4ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:15.009965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48025914-de76-4309-99ef-c893411b4ec9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:15.013254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb471e5-27a4-4a5f-bc1f-55cf675eacaf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:15.028492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edc16c-23e2-4ff1-aae2-d1718f3acedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:15.029772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edc16c-23e2-4ff1-aae2-d1718f3acedb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.029772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edc16c-23e2-4ff1-aae2-d1718f3acedb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.030095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edc16c-23e2-4ff1-aae2-d1718f3acedb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.030601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edc16c-23e2-4ff1-aae2-d1718f3acedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:15.033665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edc16c-23e2-4ff1-aae2-d1718f3acedb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:15.055054 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1249/2504] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:15.058197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edc16c-23e2-4ff1-aae2-d1718f3acedb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:15.059826 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1256/2505] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:14 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:15.062038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48025914-de76-4309-99ef-c893411b4ec9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:15.079388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edc16c-23e2-4ff1-aae2-d1718f3acedb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:15.087886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48025914-de76-4309-99ef-c893411b4ec9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:15.095189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de9ad9-df4a-4358-96f6-4ce98d77b3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:15.096056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9ad9-df4a-4358-96f6-4ce98d77b3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.096346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9ad9-df4a-4358-96f6-4ce98d77b3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.096623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9ad9-df4a-4358-96f6-4ce98d77b3f6 admin admin] PATH_INFO: `/v3/projects/6e4f427a535b4d51a0476f4b2cb71196/users/0c9580da14a34c67b6d53ddbb9e96df6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.099024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de9ad9-df4a-4358-96f6-4ce98d77b3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4f427a535b4d51a0476f4b2cb71196, user_id=0c9580da14a34c67b6d53ddbb9e96df6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:15.103190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de9ad9-df4a-4358-96f6-4ce98d77b3f6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:15.107066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38acf4-a399-465f-9705-21affe7872d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:15.107701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38acf4-a399-465f-9705-21affe7872d9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.107979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38acf4-a399-465f-9705-21affe7872d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.108254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38acf4-a399-465f-9705-21affe7872d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.108913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38acf4-a399-465f-9705-21affe7872d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:27:15.109252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38acf4-a399-465f-9705-21affe7872d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:15.111091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38acf4-a399-465f-9705-21affe7872d9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:15.123114 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1257/2506] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:15 2022] PUT /identity/v3/projects/6e4f427a535b4d51a0476f4b2cb71196/users/0c9580da14a34c67b6d53ddbb9e96df6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:15.125628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de9ad9-df4a-4358-96f6-4ce98d77b3f6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:15.135935 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1250/2507] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:27:15.141584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38acf4-a399-465f-9705-21affe7872d9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:15.176512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38acf4-a399-465f-9705-21affe7872d9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:15.316416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9864d-81f3-4979-898d-06540b068269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:15.317043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9864d-81f3-4979-898d-06540b068269 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.317322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9864d-81f3-4979-898d-06540b068269 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.317624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9864d-81f3-4979-898d-06540b068269 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.318271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9864d-81f3-4979-898d-06540b068269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:15.320253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9864d-81f3-4979-898d-06540b068269 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:15.348943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de9ad9-df4a-4358-96f6-4ce98d77b3f6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:15.362377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796bba6-4fd9-44a8-b566-3d9935a28b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:15.366058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796bba6-4fd9-44a8-b566-3d9935a28b2d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.367757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796bba6-4fd9-44a8-b566-3d9935a28b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.368175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796bba6-4fd9-44a8-b566-3d9935a28b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.370920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796bba6-4fd9-44a8-b566-3d9935a28b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:15.375801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796bba6-4fd9-44a8-b566-3d9935a28b2d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:15.382944 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1251/2508] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:15 2022] POST /identity/v3/projects => generated 391 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:27:15.387150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9864d-81f3-4979-898d-06540b068269 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:15.424536 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1258/2509] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:15.426630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796bba6-4fd9-44a8-b566-3d9935a28b2d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:15.457351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796bba6-4fd9-44a8-b566-3d9935a28b2d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:15.486243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:15.523490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9864d-81f3-4979-898d-06540b068269 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:15.541158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293792ed-e70f-449e-aef6-78fe67a44ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:15.541158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293792ed-e70f-449e-aef6-78fe67a44ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.541158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293792ed-e70f-449e-aef6-78fe67a44ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.541158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293792ed-e70f-449e-aef6-78fe67a44ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.541912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293792ed-e70f-449e-aef6-78fe67a44ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:15.541912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293792ed-e70f-449e-aef6-78fe67a44ee3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:15.582232 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1252/2510] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:15 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:27:15.586234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293792ed-e70f-449e-aef6-78fe67a44ee3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:15.611756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293792ed-e70f-449e-aef6-78fe67a44ee3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:15.636972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e937ac1-4353-4249-aa04-45be50127b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:15.638085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e937ac1-4353-4249-aa04-45be50127b9d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.638626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e937ac1-4353-4249-aa04-45be50127b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.639144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e937ac1-4353-4249-aa04-45be50127b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.639969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e937ac1-4353-4249-aa04-45be50127b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:15.644480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e937ac1-4353-4249-aa04-45be50127b9d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:15.673416 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1253/2511] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:15.681142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e937ac1-4353-4249-aa04-45be50127b9d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:15.720567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe663d8-08d3-4167-bb12-eb20c6a39655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:15.720823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e937ac1-4353-4249-aa04-45be50127b9d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:15.722347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe663d8-08d3-4167-bb12-eb20c6a39655 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.723201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe663d8-08d3-4167-bb12-eb20c6a39655 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.724106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe663d8-08d3-4167-bb12-eb20c6a39655 admin admin] PATH_INFO: `/v3/projects/cdcb7146465e4984baa0c8b700e0ad18/users/95277645ba9a481e97aae929322f2a04/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.732258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a23feb-0368-443a-ba61-7bbdd2e55c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:15.732892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23feb-0368-443a-ba61-7bbdd2e55c97 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.733171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23feb-0368-443a-ba61-7bbdd2e55c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.733474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23feb-0368-443a-ba61-7bbdd2e55c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.734670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a23feb-0368-443a-ba61-7bbdd2e55c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:15.736284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a23feb-0368-443a-ba61-7bbdd2e55c97 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:15.761619 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1254/2512] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:15.769454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a23feb-0368-443a-ba61-7bbdd2e55c97 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:15.791772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a23feb-0368-443a-ba61-7bbdd2e55c97 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:15.799423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17d331-da08-4a56-a065-8811e0617690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:15.800152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17d331-da08-4a56-a065-8811e0617690 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.800425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17d331-da08-4a56-a065-8811e0617690 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.800769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17d331-da08-4a56-a065-8811e0617690 admin admin] PATH_INFO: `/v3/projects/f6f618c91ce540038aa1698ae84216d2/users/ad54919d097f4a5eada522d696ced88b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.829266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe663d8-08d3-4167-bb12-eb20c6a39655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcb7146465e4984baa0c8b700e0ad18, user_id=95277645ba9a481e97aae929322f2a04, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:15.834779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe663d8-08d3-4167-bb12-eb20c6a39655 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:15.835510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17d331-da08-4a56-a065-8811e0617690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f618c91ce540038aa1698ae84216d2, user_id=ad54919d097f4a5eada522d696ced88b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:15.839613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17d331-da08-4a56-a065-8811e0617690 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:15.870531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:15.873233 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1255/2513] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:15 2022] PUT /identity/v3/projects/f6f618c91ce540038aa1698ae84216d2/users/ad54919d097f4a5eada522d696ced88b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:15.878645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c748e-7810-44d4-8452-9e4829e2c63d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:15.879314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c748e-7810-44d4-8452-9e4829e2c63d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:15.879762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c748e-7810-44d4-8452-9e4829e2c63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:15.918722 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1259/2514] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:15 2022] PUT /identity/v3/projects/cdcb7146465e4984baa0c8b700e0ad18/users/95277645ba9a481e97aae929322f2a04/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:15.920177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ca5c748e-7810-44d4-8452-9e4829e2c63d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:15.921715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ca5c748e-7810-44d4-8452-9e4829e2c63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:15.931800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe663d8-08d3-4167-bb12-eb20c6a39655 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:16.063945 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1256/2515] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:27:16.066378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c748e-7810-44d4-8452-9e4829e2c63d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:16.075730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ca5c748e-7810-44d4-8452-9e4829e2c63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:16.106371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c748e-7810-44d4-8452-9e4829e2c63d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:16.125474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:16.127772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:16.128512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:16.129175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] PATH_INFO: `/v3/users/36b5833ebde5402491bd80f82f6bfa23` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:16.132079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b5833ebde5402491bd80f82f6bfa23)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:16.136879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:16.175825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe663d8-08d3-4167-bb12-eb20c6a39655 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:16.183125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12ab77-92bc-4177-88ed-d3e2bf4e4041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:16.184010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ab77-92bc-4177-88ed-d3e2bf4e4041 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:16.184185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ab77-92bc-4177-88ed-d3e2bf4e4041 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:16.184648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ab77-92bc-4177-88ed-d3e2bf4e4041 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:16.185508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12ab77-92bc-4177-88ed-d3e2bf4e4041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:16.189264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12ab77-92bc-4177-88ed-d3e2bf4e4041 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:16.208023 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1260/2516] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:16.208023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12ab77-92bc-4177-88ed-d3e2bf4e4041 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:16.213750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8a12ab77-92bc-4177-88ed-d3e2bf4e4041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:16.260034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b5833ebde5402491bd80f82f6bfa23'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:16.262945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b5833ebde5402491bd80f82f6bfa23'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:16.289851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b5833ebde5402491bd80f82f6bfa23'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:16.290675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b5833ebde5402491bd80f82f6bfa23'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:16.307272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b5833ebde5402491bd80f82f6bfa23'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:16.325734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:16.336949 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1257/2517] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:27:16 2022] DELETE /identity/v3/users/36b5833ebde5402491bd80f82f6bfa23 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:16.336949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:16.338331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:16.344708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12ab77-92bc-4177-88ed-d3e2bf4e4041 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:16.444796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5a9c-5299-4a39-9d0e-07ccceace5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:16.445625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5a9c-5299-4a39-9d0e-07ccceace5ac service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:16.446046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5a9c-5299-4a39-9d0e-07ccceace5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:16.446432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5a9c-5299-4a39-9d0e-07ccceace5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:16.448448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-693d5a9c-5299-4a39-9d0e-07ccceace5ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:16.501988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd6f8f-91c6-4af6-94c4-f37d36c572aa admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:16.528212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d5a9c-5299-4a39-9d0e-07ccceace5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:16.530201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d5a9c-5299-4a39-9d0e-07ccceace5ac service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:16.530347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104c70f-0275-4eb7-9928-c18de7e1af81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:16.531042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104c70f-0275-4eb7-9928-c18de7e1af81 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:16.531818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104c70f-0275-4eb7-9928-c18de7e1af81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:16.532091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104c70f-0275-4eb7-9928-c18de7e1af81 admin admin] PATH_INFO: `/v3/projects/cdcb7146465e4984baa0c8b700e0ad18/users/95277645ba9a481e97aae929322f2a04/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:16.538378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104c70f-0275-4eb7-9928-c18de7e1af81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcb7146465e4984baa0c8b700e0ad18, user_id=95277645ba9a481e97aae929322f2a04, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:16.541116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104c70f-0275-4eb7-9928-c18de7e1af81 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:16.543471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:16.543789 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1261/2518] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:16.546514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272b347-b2cf-44ec-834e-d5a4435b58d3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:16.547154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272b347-b2cf-44ec-834e-d5a4435b58d3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:16.547713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272b347-b2cf-44ec-834e-d5a4435b58d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:16.575752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f272b347-b2cf-44ec-834e-d5a4435b58d3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:16.577240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f272b347-b2cf-44ec-834e-d5a4435b58d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:16.581852 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1258/2519] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:16 2022] PUT /identity/v3/projects/cdcb7146465e4984baa0c8b700e0ad18/users/95277645ba9a481e97aae929322f2a04/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:16.658019 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1262/2520] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:16.732478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104c70f-0275-4eb7-9928-c18de7e1af81 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:16.735897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0104c70f-0275-4eb7-9928-c18de7e1af81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:16.885908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104c70f-0275-4eb7-9928-c18de7e1af81 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:16.895482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9d91e-b518-4e2d-a04d-ce90c2a525b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:16.896118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d91e-b518-4e2d-a04d-ce90c2a525b6 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:16.896396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d91e-b518-4e2d-a04d-ce90c2a525b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:16.896862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d91e-b518-4e2d-a04d-ce90c2a525b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:16.925890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9d91e-b518-4e2d-a04d-ce90c2a525b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:16.927669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9d91e-b518-4e2d-a04d-ce90c2a525b6 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:16.955044 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1259/2521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:18.811456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272b347-b2cf-44ec-834e-d5a4435b58d3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:18.813862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f272b347-b2cf-44ec-834e-d5a4435b58d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:18.842318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272b347-b2cf-44ec-834e-d5a4435b58d3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:18.865728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:18.867464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:18.868088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:18.868581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] PATH_INFO: `/v3/projects/d1c30e219a764f70a70ffe5bf6c640b3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:18.871167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c30e219a764f70a70ffe5bf6c640b3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:18.887778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:19.096480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c30e219a764f70a70ffe5bf6c640b3', 'request_id': 'req-750ee283-2209-4ab5-b355-1951ff2dffcc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:19.152025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c30e219a764f70a70ffe5bf6c640b3', 'request_id': 'req-750ee283-2209-4ab5-b355-1951ff2dffcc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:19.187610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c30e219a764f70a70ffe5bf6c640b3', 'request_id': 'req-750ee283-2209-4ab5-b355-1951ff2dffcc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:19.231800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] The token cache is being invalidate because project d1c30e219a764f70a70ffe5bf6c640b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:27:19.234734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:19.235739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:19.243809 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1263/2522] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:18 2022] DELETE /identity/v3/projects/d1c30e219a764f70a70ffe5bf6c640b3 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:19.244840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9d91e-b518-4e2d-a04d-ce90c2a525b6 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:19.261902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9d91e-b518-4e2d-a04d-ce90c2a525b6 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:19.572593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740fde5-e884-4ef9-a666-48b676f0f60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:19.573255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740fde5-e884-4ef9-a666-48b676f0f60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:19.573570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740fde5-e884-4ef9-a666-48b676f0f60c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:19.575504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740fde5-e884-4ef9-a666-48b676f0f60c admin admin] PATH_INFO: `/v3/users/937fc4573c374061a53d6e45d38d58eb` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:19.579795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740fde5-e884-4ef9-a666-48b676f0f60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=937fc4573c374061a53d6e45d38d58eb)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:19.588394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740fde5-e884-4ef9-a666-48b676f0f60c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:19.696494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:19.761830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9740fde5-e884-4ef9-a666-48b676f0f60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937fc4573c374061a53d6e45d38d58eb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:19.766769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9740fde5-e884-4ef9-a666-48b676f0f60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937fc4573c374061a53d6e45d38d58eb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:19.833510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9740fde5-e884-4ef9-a666-48b676f0f60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937fc4573c374061a53d6e45d38d58eb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:19.835900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9740fde5-e884-4ef9-a666-48b676f0f60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937fc4573c374061a53d6e45d38d58eb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:19.897952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9740fde5-e884-4ef9-a666-48b676f0f60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937fc4573c374061a53d6e45d38d58eb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:19.939686 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1260/2523] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:27:19 2022] DELETE /identity/v3/users/937fc4573c374061a53d6e45d38d58eb => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:22.444494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:22.446142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:22.476639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ee283-2209-4ab5-b355-1951ff2dffcc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:22.684112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:22.684791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:22.685078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:22.685354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] PATH_INFO: `/v3/projects/4858f81bee9942009b6fb2df52a3e745` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:22.690512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4858f81bee9942009b6fb2df52a3e745)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:22.693238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:22.745345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:22.880221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4858f81bee9942009b6fb2df52a3e745', 'request_id': 'req-925fadb9-02fa-4761-8de1-f833ba918a48'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:22.922225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4858f81bee9942009b6fb2df52a3e745', 'request_id': 'req-925fadb9-02fa-4761-8de1-f833ba918a48'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:22.949029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4858f81bee9942009b6fb2df52a3e745', 'request_id': 'req-925fadb9-02fa-4761-8de1-f833ba918a48'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:23.008586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] The token cache is being invalidate because project 4858f81bee9942009b6fb2df52a3e745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:27:23.009506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:23.013685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-925fadb9-02fa-4761-8de1-f833ba918a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:23.019936 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1264/2524] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:22 2022] DELETE /identity/v3/projects/4858f81bee9942009b6fb2df52a3e745 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:23.025123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e39e2-0a3b-43c3-a622-c27657b2a71d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:23.025971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e39e2-0a3b-43c3-a622-c27657b2a71d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:23.025971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e39e2-0a3b-43c3-a622-c27657b2a71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:23.070407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d93e39e2-0a3b-43c3-a622-c27657b2a71d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:23.074523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d93e39e2-0a3b-43c3-a622-c27657b2a71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:23.286370 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1261/2525] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:23.290549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e764-d954-4af2-b9e6-dee06f3fbd39 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:23.291371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e764-d954-4af2-b9e6-dee06f3fbd39 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:23.291982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e764-d954-4af2-b9e6-dee06f3fbd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:23.391713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ac73e764-d954-4af2-b9e6-dee06f3fbd39 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:23.398091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ac73e764-d954-4af2-b9e6-dee06f3fbd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:23.446032 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1265/2526] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:23.446655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e39e2-0a3b-43c3-a622-c27657b2a71d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:23.462068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e39e2-0a3b-43c3-a622-c27657b2a71d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:23.476405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbb9f8-f15d-495c-b9a0-1b5725574a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:23.477051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbb9f8-f15d-495c-b9a0-1b5725574a6a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:23.477334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbb9f8-f15d-495c-b9a0-1b5725574a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:23.477642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbb9f8-f15d-495c-b9a0-1b5725574a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:23.478384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbb9f8-f15d-495c-b9a0-1b5725574a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:27:23.478694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbb9f8-f15d-495c-b9a0-1b5725574a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:23.484157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbb9f8-f15d-495c-b9a0-1b5725574a6a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:23.528778 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1262/2527] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:27:23.530130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73e764-d954-4af2-b9e6-dee06f3fbd39 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:23.543666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73e764-d954-4af2-b9e6-dee06f3fbd39 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:23.572987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a011-fe76-4354-aa0c-4617bdc43ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:23.573719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a011-fe76-4354-aa0c-4617bdc43ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:23.574031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a011-fe76-4354-aa0c-4617bdc43ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:23.574306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a011-fe76-4354-aa0c-4617bdc43ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:23.575068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819a011-fe76-4354-aa0c-4617bdc43ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:23.577189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819a011-fe76-4354-aa0c-4617bdc43ab3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:23.687717 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1266/2528] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:23 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:23.691920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbb9f8-f15d-495c-b9a0-1b5725574a6a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:23.704246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbb9f8-f15d-495c-b9a0-1b5725574a6a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:23.849369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c89ce-2686-443f-9235-d5bd814ad65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:23.850152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c89ce-2686-443f-9235-d5bd814ad65f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:23.850504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c89ce-2686-443f-9235-d5bd814ad65f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:23.850844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c89ce-2686-443f-9235-d5bd814ad65f admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:23.852008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c89ce-2686-443f-9235-d5bd814ad65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:23.854318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c89ce-2686-443f-9235-d5bd814ad65f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:23.900452 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1263/2529] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:23 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:23.900659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a011-fe76-4354-aa0c-4617bdc43ab3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:23.924429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a011-fe76-4354-aa0c-4617bdc43ab3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:23.932625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da50c6f-0558-4635-a794-76c30e088f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:23.933352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da50c6f-0558-4635-a794-76c30e088f2a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:23.933742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da50c6f-0558-4635-a794-76c30e088f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:23.934093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da50c6f-0558-4635-a794-76c30e088f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:23.935098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da50c6f-0558-4635-a794-76c30e088f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:23.938142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da50c6f-0558-4635-a794-76c30e088f2a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:23.958671 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1267/2530] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:23.962575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c89ce-2686-443f-9235-d5bd814ad65f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:23.979338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c89ce-2686-443f-9235-d5bd814ad65f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:23.995986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b22499-8ebc-4cb4-9810-3a42c9f934a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:23.996707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b22499-8ebc-4cb4-9810-3a42c9f934a6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:23.996992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b22499-8ebc-4cb4-9810-3a42c9f934a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:23.997508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b22499-8ebc-4cb4-9810-3a42c9f934a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:23.998202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b22499-8ebc-4cb4-9810-3a42c9f934a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:24.002535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b22499-8ebc-4cb4-9810-3a42c9f934a6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:24.038165 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1264/2531] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:24.038820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da50c6f-0558-4635-a794-76c30e088f2a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:24.053030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da50c6f-0558-4635-a794-76c30e088f2a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:24.067867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4788d55-5a1d-4084-bd5f-61e33bdf5c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:24.068668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4788d55-5a1d-4084-bd5f-61e33bdf5c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:24.069059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4788d55-5a1d-4084-bd5f-61e33bdf5c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:24.069550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4788d55-5a1d-4084-bd5f-61e33bdf5c24 admin admin] PATH_INFO: `/v3/projects/0228a8d14c4643f5bb76a31f15a9a763/users/9cec178fc98f47ea9f27fd2b458fd651/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:24.117144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4788d55-5a1d-4084-bd5f-61e33bdf5c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0228a8d14c4643f5bb76a31f15a9a763, user_id=9cec178fc98f47ea9f27fd2b458fd651, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:24.120486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4788d55-5a1d-4084-bd5f-61e33bdf5c24 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:24.149789 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1268/2532] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:24 2022] PUT /identity/v3/projects/0228a8d14c4643f5bb76a31f15a9a763/users/9cec178fc98f47ea9f27fd2b458fd651/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:24.161322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66291c5-8018-4ce2-90de-48c9b049190f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:24.161703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66291c5-8018-4ce2-90de-48c9b049190f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:24.161907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66291c5-8018-4ce2-90de-48c9b049190f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:24.216903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c66291c5-8018-4ce2-90de-48c9b049190f None None] MFA Rules not processed for user `9cec178fc98f47ea9f27fd2b458fd651`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:24.218269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c66291c5-8018-4ce2-90de-48c9b049190f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:24.229806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:24.377163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4788d55-5a1d-4084-bd5f-61e33bdf5c24 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:24.377548 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1265/2533] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:24.490151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4788d55-5a1d-4084-bd5f-61e33bdf5c24 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:24.496374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db64b8-16b0-4d49-9b95-31007b50c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:24.497116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db64b8-16b0-4d49-9b95-31007b50c822 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:24.497578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db64b8-16b0-4d49-9b95-31007b50c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:24.502317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db64b8-16b0-4d49-9b95-31007b50c822 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:24.503186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db64b8-16b0-4d49-9b95-31007b50c822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:24.505136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db64b8-16b0-4d49-9b95-31007b50c822 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:24.567083 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1269/2534] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:24 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:27:24.572639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66291c5-8018-4ce2-90de-48c9b049190f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:24.594352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66291c5-8018-4ce2-90de-48c9b049190f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:24.751520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8231-a509-4101-8fdd-5d0735ac5bef None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:24.751943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8231-a509-4101-8fdd-5d0735ac5bef None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:24.752226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8231-a509-4101-8fdd-5d0735ac5bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:24.774348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ac636-7399-45c4-9f7d-accbfaa2017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:24.775194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ac636-7399-45c4-9f7d-accbfaa2017a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:24.775701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ac636-7399-45c4-9f7d-accbfaa2017a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:24.776039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ac636-7399-45c4-9f7d-accbfaa2017a admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:24.776751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ac636-7399-45c4-9f7d-accbfaa2017a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:24.784519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ac636-7399-45c4-9f7d-accbfaa2017a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:24.819390 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1266/2535] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:24 2022] POST /identity/v3/users => generated 296 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:24.824557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ac636-7399-45c4-9f7d-accbfaa2017a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:24.843612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-80aa8231-a509-4101-8fdd-5d0735ac5bef None None] MFA Rules not processed for user `7bd967d46f614bb4a187218498e934f3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:24.844714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-80aa8231-a509-4101-8fdd-5d0735ac5bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:24.848875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ac636-7399-45c4-9f7d-accbfaa2017a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:24.857583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378563b-a149-405f-9e29-533124a858e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:24.858304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378563b-a149-405f-9e29-533124a858e4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:24.858587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378563b-a149-405f-9e29-533124a858e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:24.859682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378563b-a149-405f-9e29-533124a858e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:24.860666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378563b-a149-405f-9e29-533124a858e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:24.864244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378563b-a149-405f-9e29-533124a858e4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:24.890424 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1267/2536] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:24.896354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378563b-a149-405f-9e29-533124a858e4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:24.897206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:24.921633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378563b-a149-405f-9e29-533124a858e4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:24.929537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405e4b1-e2d8-4d8b-a575-a01c0e7b1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:24.930647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e4b1-e2d8-4d8b-a575-a01c0e7b1052 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:24.931090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e4b1-e2d8-4d8b-a575-a01c0e7b1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:24.931547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e4b1-e2d8-4d8b-a575-a01c0e7b1052 admin admin] PATH_INFO: `/v3/projects/bca143f610e7447bacf6b744ce382e06/users/ffc179ccd2064a0d8f463699a9091a17/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:24.952233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405e4b1-e2d8-4d8b-a575-a01c0e7b1052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca143f610e7447bacf6b744ce382e06, user_id=ffc179ccd2064a0d8f463699a9091a17, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:24.956071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405e4b1-e2d8-4d8b-a575-a01c0e7b1052 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:24.991783 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1268/2537] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:24 2022] PUT /identity/v3/projects/bca143f610e7447bacf6b744ce382e06/users/ffc179ccd2064a0d8f463699a9091a17/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:24.994317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405e4b1-e2d8-4d8b-a575-a01c0e7b1052 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:25.016316 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1270/2538] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:25.027687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334dd4-45f0-4739-b009-36b6fed6fc2f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:25.028155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334dd4-45f0-4739-b009-36b6fed6fc2f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:25.028560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334dd4-45f0-4739-b009-36b6fed6fc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:25.075942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e0334dd4-45f0-4739-b009-36b6fed6fc2f None None] MFA Rules not processed for user `7bd967d46f614bb4a187218498e934f3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:25.079032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e0334dd4-45f0-4739-b009-36b6fed6fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:25.188084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405e4b1-e2d8-4d8b-a575-a01c0e7b1052 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:25.210181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5198d0-78e8-4cd6-b83c-dbb054b8eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:25.211550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5198d0-78e8-4cd6-b83c-dbb054b8eabe admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:25.214534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5198d0-78e8-4cd6-b83c-dbb054b8eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:25.216116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5198d0-78e8-4cd6-b83c-dbb054b8eabe admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:25.219373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5198d0-78e8-4cd6-b83c-dbb054b8eabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:25.229289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5198d0-78e8-4cd6-b83c-dbb054b8eabe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:25.239666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:25.262623 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1269/2539] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:25.264773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5198d0-78e8-4cd6-b83c-dbb054b8eabe admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:25.284329 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1271/2540] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:27:25.296208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0334dd4-45f0-4739-b009-36b6fed6fc2f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:25.300659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e0334dd4-45f0-4739-b009-36b6fed6fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:25.314819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5198d0-78e8-4cd6-b83c-dbb054b8eabe admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:25.329836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b8b38-5f16-4e2d-a956-85b855493d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:25.330519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b8b38-5f16-4e2d-a956-85b855493d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:25.330801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b8b38-5f16-4e2d-a956-85b855493d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:25.331078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b8b38-5f16-4e2d-a956-85b855493d9d admin admin] PATH_INFO: `/v3/projects/bca143f610e7447bacf6b744ce382e06/users/ffc179ccd2064a0d8f463699a9091a17/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:25.337270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b8b38-5f16-4e2d-a956-85b855493d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca143f610e7447bacf6b744ce382e06, user_id=ffc179ccd2064a0d8f463699a9091a17, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:25.344512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b8b38-5f16-4e2d-a956-85b855493d9d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:25.373364 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1270/2541] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:25 2022] PUT /identity/v3/projects/bca143f610e7447bacf6b744ce382e06/users/ffc179ccd2064a0d8f463699a9091a17/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:25.392314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8f9f-ac8d-42a6-824b-6ea4e86c9e4b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:25.392662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8f9f-ac8d-42a6-824b-6ea4e86c9e4b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:25.395017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8f9f-ac8d-42a6-824b-6ea4e86c9e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:25.492711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5e7a8f9f-ac8d-42a6-824b-6ea4e86c9e4b None None] MFA Rules not processed for user `ffc179ccd2064a0d8f463699a9091a17`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:25.498046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5e7a8f9f-ac8d-42a6-824b-6ea4e86c9e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:25.545786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0334dd4-45f0-4739-b009-36b6fed6fc2f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:25.717208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:25.722414 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1271/2542] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:25.741275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8f9f-ac8d-42a6-824b-6ea4e86c9e4b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:25.746058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5e7a8f9f-ac8d-42a6-824b-6ea4e86c9e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:25.748495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49a757-e23b-4243-b7df-83b0f0a819bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:25.749276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49a757-e23b-4243-b7df-83b0f0a819bc service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:25.749779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49a757-e23b-4243-b7df-83b0f0a819bc service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:25.750155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49a757-e23b-4243-b7df-83b0f0a819bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:25.808672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8f9f-ac8d-42a6-824b-6ea4e86c9e4b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:25.820576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476ef9a-4971-4b5d-a870-439109b7660b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:25.822342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476ef9a-4971-4b5d-a870-439109b7660b service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:25.822848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476ef9a-4971-4b5d-a870-439109b7660b service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:25.823283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476ef9a-4971-4b5d-a870-439109b7660b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:25.878107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476ef9a-4971-4b5d-a870-439109b7660b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:25.879756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476ef9a-4971-4b5d-a870-439109b7660b service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:25.893779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49a757-e23b-4243-b7df-83b0f0a819bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:25.895851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49a757-e23b-4243-b7df-83b0f0a819bc service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:25.903630 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1272/2543] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:25.912768 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1272/2544] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:26.265734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476ef9a-4971-4b5d-a870-439109b7660b service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:26.397174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476ef9a-4971-4b5d-a870-439109b7660b service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:26.413509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:26.414741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:26.415173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:26.416538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] PATH_INFO: `/v3/users/9cec178fc98f47ea9f27fd2b458fd651` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:26.418747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cec178fc98f47ea9f27fd2b458fd651)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:26.421491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:26.539464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cec178fc98f47ea9f27fd2b458fd651'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:26.540738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cec178fc98f47ea9f27fd2b458fd651'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:26.565120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:26.568949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cec178fc98f47ea9f27fd2b458fd651'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:26.570104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cec178fc98f47ea9f27fd2b458fd651'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:26.582361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cec178fc98f47ea9f27fd2b458fd651'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:26.633867 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1273/2545] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:27:26 2022] DELETE /identity/v3/users/9cec178fc98f47ea9f27fd2b458fd651 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:26.639286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f0875-71cd-4361-94e2-01609173dd2f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:26.640616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f0875-71cd-4361-94e2-01609173dd2f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:26.641051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f0875-71cd-4361-94e2-01609173dd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:26.675278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-682f0875-71cd-4361-94e2-01609173dd2f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:26.676940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-682f0875-71cd-4361-94e2-01609173dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:26.772445 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1273/2546] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:26.865741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:26.867361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:26.942516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e6659-138f-4de1-aef0-33b7ede3d5f3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:26.947426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e18df0-8693-4699-bbd3-1aee4d7510b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:26.948401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e18df0-8693-4699-bbd3-1aee4d7510b6 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:26.948684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e18df0-8693-4699-bbd3-1aee4d7510b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:26.948956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e18df0-8693-4699-bbd3-1aee4d7510b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:26.963685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e18df0-8693-4699-bbd3-1aee4d7510b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:26.965739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e18df0-8693-4699-bbd3-1aee4d7510b6 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:26.995983 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1274/2547] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:27.931071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f71e7-67de-49ea-8b5f-29fd16a21c1e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:27.931563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f71e7-67de-49ea-8b5f-29fd16a21c1e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:27.931714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f71e7-67de-49ea-8b5f-29fd16a21c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:28.011486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-022f71e7-67de-49ea-8b5f-29fd16a21c1e None None] MFA Rules not processed for user `1ff9744258414abeb64b442b0d295c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:28.017229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-022f71e7-67de-49ea-8b5f-29fd16a21c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:28.191729 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1274/2548] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:28.195239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e18df0-8693-4699-bbd3-1aee4d7510b6 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:28.197240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-13e18df0-8693-4699-bbd3-1aee4d7510b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:28.224370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e18df0-8693-4699-bbd3-1aee4d7510b6 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:28.257192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfdeb0-a30d-414a-a2d9-566a3e76555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:28.258862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfdeb0-a30d-414a-a2d9-566a3e76555d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:28.259167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfdeb0-a30d-414a-a2d9-566a3e76555d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:28.259446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfdeb0-a30d-414a-a2d9-566a3e76555d admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:28.260134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfdeb0-a30d-414a-a2d9-566a3e76555d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:28.262319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfdeb0-a30d-414a-a2d9-566a3e76555d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:28.367808 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1275/2549] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:28 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:27:28.373313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f71e7-67de-49ea-8b5f-29fd16a21c1e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:28.426419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f71e7-67de-49ea-8b5f-29fd16a21c1e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:28.559353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:28.696540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd29d5-350a-4267-afce-31ea8aea0aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:28.696794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd29d5-350a-4267-afce-31ea8aea0aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:28.697047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd29d5-350a-4267-afce-31ea8aea0aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:28.697486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd29d5-350a-4267-afce-31ea8aea0aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:28.698011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd29d5-350a-4267-afce-31ea8aea0aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:28.700083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd29d5-350a-4267-afce-31ea8aea0aa3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:28.799598 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1275/2550] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:28 2022] POST /identity/v3/users => generated 299 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:28.803474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfdeb0-a30d-414a-a2d9-566a3e76555d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:28.815257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfdeb0-a30d-414a-a2d9-566a3e76555d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:28.851617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3ec9b-76c5-4535-98b5-392b753ec850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:28.852255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3ec9b-76c5-4535-98b5-392b753ec850 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:28.852535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3ec9b-76c5-4535-98b5-392b753ec850 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:28.852808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3ec9b-76c5-4535-98b5-392b753ec850 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:28.853490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3ec9b-76c5-4535-98b5-392b753ec850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:28.855339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3ec9b-76c5-4535-98b5-392b753ec850 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:28.908381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd29d5-350a-4267-afce-31ea8aea0aa3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:28.929896 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1276/2551] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:28.953450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd29d5-350a-4267-afce-31ea8aea0aa3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:28.978677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1a6b2-7fbc-416f-88e4-2448bdfcb1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:29.001214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1a6b2-7fbc-416f-88e4-2448bdfcb1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:29.007965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1a6b2-7fbc-416f-88e4-2448bdfcb1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:29.011095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1a6b2-7fbc-416f-88e4-2448bdfcb1bf admin admin] PATH_INFO: `/v3/projects/64edf13094b74182b6d8b33ad3026b5c/users/958a45cf5eb647df9b53037171349898/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:29.098925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1a6b2-7fbc-416f-88e4-2448bdfcb1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=64edf13094b74182b6d8b33ad3026b5c, user_id=958a45cf5eb647df9b53037171349898, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:29.102785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1a6b2-7fbc-416f-88e4-2448bdfcb1bf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:29.164317 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1276/2552] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:28 2022] PUT /identity/v3/projects/64edf13094b74182b6d8b33ad3026b5c/users/958a45cf5eb647df9b53037171349898/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:29.165727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3ec9b-76c5-4535-98b5-392b753ec850 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:29.191491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3ec9b-76c5-4535-98b5-392b753ec850 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:29.257184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd673-d8ad-45f5-acf8-a838c6170240 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:29.257335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd673-d8ad-45f5-acf8-a838c6170240 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:29.257846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd673-d8ad-45f5-acf8-a838c6170240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:29.339360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be33ce-05db-4f29-b3af-3657bb813b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:29.339999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be33ce-05db-4f29-b3af-3657bb813b1e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:29.340269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be33ce-05db-4f29-b3af-3657bb813b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:29.340545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be33ce-05db-4f29-b3af-3657bb813b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:29.341209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be33ce-05db-4f29-b3af-3657bb813b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:29.342909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be33ce-05db-4f29-b3af-3657bb813b1e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:29.359632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-655fd673-d8ad-45f5-acf8-a838c6170240 None None] MFA Rules not processed for user `7f8d1eebe02949738af4ac6452560795`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:29.363396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-655fd673-d8ad-45f5-acf8-a838c6170240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:29.372557 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1277/2553] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:27:29.376989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be33ce-05db-4f29-b3af-3657bb813b1e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:29.392321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be33ce-05db-4f29-b3af-3657bb813b1e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:29.411929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1d8d8-91b0-4d09-bafd-95f4fef07290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:29.412613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d8d8-91b0-4d09-bafd-95f4fef07290 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:29.412895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d8d8-91b0-4d09-bafd-95f4fef07290 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:29.413169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d8d8-91b0-4d09-bafd-95f4fef07290 admin admin] PATH_INFO: `/v3/projects/64edf13094b74182b6d8b33ad3026b5c/users/958a45cf5eb647df9b53037171349898/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:29.415648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1d8d8-91b0-4d09-bafd-95f4fef07290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64edf13094b74182b6d8b33ad3026b5c, user_id=958a45cf5eb647df9b53037171349898, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:29.418395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1d8d8-91b0-4d09-bafd-95f4fef07290 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:29.446517 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1278/2554] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:29 2022] PUT /identity/v3/projects/64edf13094b74182b6d8b33ad3026b5c/users/958a45cf5eb647df9b53037171349898/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:29.580564 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1277/2555] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:29 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:30.373024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1d8d8-91b0-4d09-bafd-95f4fef07290 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:30.375283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-55f1d8d8-91b0-4d09-bafd-95f4fef07290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:30.475210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:30.549838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1d8d8-91b0-4d09-bafd-95f4fef07290 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:30.564274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:30.564811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:30.565098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:30.565380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] PATH_INFO: `/v3/projects/0228a8d14c4643f5bb76a31f15a9a763` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:30.567651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0228a8d14c4643f5bb76a31f15a9a763)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:30.569733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:30.691027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0228a8d14c4643f5bb76a31f15a9a763', 'request_id': 'req-48faade8-ba74-4811-883c-cf4083334792'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:30.706184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0228a8d14c4643f5bb76a31f15a9a763', 'request_id': 'req-48faade8-ba74-4811-883c-cf4083334792'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:30.719731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0228a8d14c4643f5bb76a31f15a9a763', 'request_id': 'req-48faade8-ba74-4811-883c-cf4083334792'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:30.741513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] The token cache is being invalidate because project 0228a8d14c4643f5bb76a31f15a9a763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:27:30.741815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:30.743963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-48faade8-ba74-4811-883c-cf4083334792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:30.748392 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1279/2556] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:30 2022] DELETE /identity/v3/projects/0228a8d14c4643f5bb76a31f15a9a763 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:30.749787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fd673-d8ad-45f5-acf8-a838c6170240 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:30.770656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fd673-d8ad-45f5-acf8-a838c6170240 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:31.011117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:31.012614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:31.013674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:31.014100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] PATH_INFO: `/v3/users/ffc179ccd2064a0d8f463699a9091a17` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:31.016550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc179ccd2064a0d8f463699a9091a17)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:31.018923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:31.115932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:31.165640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc179ccd2064a0d8f463699a9091a17'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:31.166485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc179ccd2064a0d8f463699a9091a17'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:31.197982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc179ccd2064a0d8f463699a9091a17'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:31.213724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642997-e72f-4324-8f4e-087bf1bc7ec9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:31.214014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642997-e72f-4324-8f4e-087bf1bc7ec9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:31.214295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642997-e72f-4324-8f4e-087bf1bc7ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:31.223630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc179ccd2064a0d8f463699a9091a17'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:31.251284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc179ccd2064a0d8f463699a9091a17'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:31.286351 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1278/2557] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:27:30 2022] DELETE /identity/v3/users/ffc179ccd2064a0d8f463699a9091a17 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:31.292726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c6642997-e72f-4324-8f4e-087bf1bc7ec9 None None] MFA Rules not processed for user `5a35e1e03bb048e5a5d29d779c3d21e6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:31.294235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c6642997-e72f-4324-8f4e-087bf1bc7ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:31.482684 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1280/2558] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:31 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:31.518319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:31.522736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:31.802543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6f2ac-24e8-45ee-8ae2-931cd03488a9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:31.813521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee1714-9072-4d11-87b8-c2826f49aa04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:31.814722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee1714-9072-4d11-87b8-c2826f49aa04 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:31.815087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee1714-9072-4d11-87b8-c2826f49aa04 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:31.815430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee1714-9072-4d11-87b8-c2826f49aa04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:31.818393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-59ee1714-9072-4d11-87b8-c2826f49aa04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:31.925640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee1714-9072-4d11-87b8-c2826f49aa04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:31.941104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee1714-9072-4d11-87b8-c2826f49aa04 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:31.980737 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1279/2559] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:31 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:32.055684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6642997-e72f-4324-8f4e-087bf1bc7ec9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:32.121161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6642997-e72f-4324-8f4e-087bf1bc7ec9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:32.158619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d42be5-9851-4b70-b39c-84a6e8f20ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:32.160086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d42be5-9851-4b70-b39c-84a6e8f20ec2 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:32.160819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d42be5-9851-4b70-b39c-84a6e8f20ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:32.161590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d42be5-9851-4b70-b39c-84a6e8f20ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:32.226937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d42be5-9851-4b70-b39c-84a6e8f20ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:32.229322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d42be5-9851-4b70-b39c-84a6e8f20ec2 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:32.272512 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1281/2560] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:32 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:34.851046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee1714-9072-4d11-87b8-c2826f49aa04 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:34.853645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-59ee1714-9072-4d11-87b8-c2826f49aa04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:35.127193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:35.218887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee1714-9072-4d11-87b8-c2826f49aa04 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:35.229132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:35.233409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:35.234602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:35.236220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] PATH_INFO: `/v3/projects/bca143f610e7447bacf6b744ce382e06` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:35.241089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca143f610e7447bacf6b744ce382e06)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:35.246008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:35.325130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca143f610e7447bacf6b744ce382e06', 'request_id': 'req-12c561b0-e860-46e1-bc72-e47a3c6d5b91'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:35.336824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca143f610e7447bacf6b744ce382e06', 'request_id': 'req-12c561b0-e860-46e1-bc72-e47a3c6d5b91'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:35.352161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca143f610e7447bacf6b744ce382e06', 'request_id': 'req-12c561b0-e860-46e1-bc72-e47a3c6d5b91'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:35.371252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] The token cache is being invalidate because project bca143f610e7447bacf6b744ce382e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:27:35.371728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:35.372569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-12c561b0-e860-46e1-bc72-e47a3c6d5b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:27:35.381220 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1280/2561] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:34 2022] DELETE /identity/v3/projects/bca143f610e7447bacf6b744ce382e06 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:27:35.382322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc58d8-32b9-4b4c-b854-3bb8d68e8905 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:35.382797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc58d8-32b9-4b4c-b854-3bb8d68e8905 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:35.383448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc58d8-32b9-4b4c-b854-3bb8d68e8905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:35.418943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0cfc58d8-32b9-4b4c-b854-3bb8d68e8905 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:35.420637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0cfc58d8-32b9-4b4c-b854-3bb8d68e8905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:35.506100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:35.563729 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1282/2562] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:35.571764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e029d4-ab31-4f55-bd77-22dd8ae0a389 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:35.572071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e029d4-ab31-4f55-bd77-22dd8ae0a389 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:35.572431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e029d4-ab31-4f55-bd77-22dd8ae0a389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:35.613883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-94e029d4-ab31-4f55-bd77-22dd8ae0a389 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:35.615116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-94e029d4-ab31-4f55-bd77-22dd8ae0a389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:35.636101 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1281/2563] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:35.641861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc58d8-32b9-4b4c-b854-3bb8d68e8905 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:35.657571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc58d8-32b9-4b4c-b854-3bb8d68e8905 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:35.673353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ff36d-115e-4567-91cc-fc04da772c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:35.674957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ff36d-115e-4567-91cc-fc04da772c00 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:35.675426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ff36d-115e-4567-91cc-fc04da772c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:35.676024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ff36d-115e-4567-91cc-fc04da772c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:35.677771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ff36d-115e-4567-91cc-fc04da772c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:27:35.678221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ff36d-115e-4567-91cc-fc04da772c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:35.680288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ff36d-115e-4567-91cc-fc04da772c00 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:35.701245 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1283/2564] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:27:35.706282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e029d4-ab31-4f55-bd77-22dd8ae0a389 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:35.721404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e029d4-ab31-4f55-bd77-22dd8ae0a389 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:35.748614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79bd09-83d5-47ff-8324-b9d423551922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:35.748614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79bd09-83d5-47ff-8324-b9d423551922 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:35.748614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79bd09-83d5-47ff-8324-b9d423551922 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:35.748614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79bd09-83d5-47ff-8324-b9d423551922 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:35.749856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79bd09-83d5-47ff-8324-b9d423551922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:35.751401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79bd09-83d5-47ff-8324-b9d423551922 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:35.849357 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1282/2565] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:27:35 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:35.853998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ff36d-115e-4567-91cc-fc04da772c00 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:35.871476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ff36d-115e-4567-91cc-fc04da772c00 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:36.130657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6d874-4e34-4d66-a2ae-7511afe47dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:36.134196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6d874-4e34-4d66-a2ae-7511afe47dca admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:36.134196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6d874-4e34-4d66-a2ae-7511afe47dca admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:36.135825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6d874-4e34-4d66-a2ae-7511afe47dca admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:36.135825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6d874-4e34-4d66-a2ae-7511afe47dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:36.145719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6d874-4e34-4d66-a2ae-7511afe47dca admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:36.215242 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1284/2566] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:27:35 2022] POST /identity/v3/users => generated 296 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:27:36.219636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79bd09-83d5-47ff-8324-b9d423551922 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:36.248743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79bd09-83d5-47ff-8324-b9d423551922 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:36.272420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b4f31-11b8-4e3e-bd69-ee292c823deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:36.274150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b4f31-11b8-4e3e-bd69-ee292c823deb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:36.277355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b4f31-11b8-4e3e-bd69-ee292c823deb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:36.277977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b4f31-11b8-4e3e-bd69-ee292c823deb admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:36.285109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b4f31-11b8-4e3e-bd69-ee292c823deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:36.287764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b4f31-11b8-4e3e-bd69-ee292c823deb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:36.311529 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1283/2567] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:36.315878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6d874-4e34-4d66-a2ae-7511afe47dca admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:36.330997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6d874-4e34-4d66-a2ae-7511afe47dca admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:36.345117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552e20a-12ed-4ae0-9d2f-b76217e87a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:36.346148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e20a-12ed-4ae0-9d2f-b76217e87a48 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:36.346658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e20a-12ed-4ae0-9d2f-b76217e87a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:36.347585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e20a-12ed-4ae0-9d2f-b76217e87a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:36.348672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552e20a-12ed-4ae0-9d2f-b76217e87a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:36.350772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552e20a-12ed-4ae0-9d2f-b76217e87a48 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:36.386090 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1285/2568] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:27:36.391126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b4f31-11b8-4e3e-bd69-ee292c823deb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:36.413601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b4f31-11b8-4e3e-bd69-ee292c823deb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:36.427301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06dce2-0daf-413d-82ba-335eaaad7abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:36.428885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06dce2-0daf-413d-82ba-335eaaad7abb admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:36.436298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06dce2-0daf-413d-82ba-335eaaad7abb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:36.437381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06dce2-0daf-413d-82ba-335eaaad7abb admin admin] PATH_INFO: `/v3/projects/12c3f0d480234309a58bfa1e1d1d2bb7/users/bbd52ee53a8d46cdafe1e1da95f9cd6f/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:36.493426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06dce2-0daf-413d-82ba-335eaaad7abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c3f0d480234309a58bfa1e1d1d2bb7, user_id=bbd52ee53a8d46cdafe1e1da95f9cd6f, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:36.509906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06dce2-0daf-413d-82ba-335eaaad7abb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:36.553675 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1284/2569] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:27:36 2022] PUT /identity/v3/projects/12c3f0d480234309a58bfa1e1d1d2bb7/users/bbd52ee53a8d46cdafe1e1da95f9cd6f/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:27:36.558596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da138-076b-4c51-9770-dba5428c8a2f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:36.559897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da138-076b-4c51-9770-dba5428c8a2f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:36.560655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da138-076b-4c51-9770-dba5428c8a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:36.635927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-036da138-076b-4c51-9770-dba5428c8a2f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:36.638687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-036da138-076b-4c51-9770-dba5428c8a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:36.965035 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1286/2570] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:27:37.167080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06dce2-0daf-413d-82ba-335eaaad7abb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:37.172272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3c06dce2-0daf-413d-82ba-335eaaad7abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:37.362775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100820df-6254-45ba-a19d-06231f7a254c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:37.363062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100820df-6254-45ba-a19d-06231f7a254c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:37.363334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100820df-6254-45ba-a19d-06231f7a254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:37.390738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06dce2-0daf-413d-82ba-335eaaad7abb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:37.409021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b5e9b-1423-4fd6-b43a-3e11fa1f210f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:37.410183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b5e9b-1423-4fd6-b43a-3e11fa1f210f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:37.410616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b5e9b-1423-4fd6-b43a-3e11fa1f210f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:37.411222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b5e9b-1423-4fd6-b43a-3e11fa1f210f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:37.434838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b5e9b-1423-4fd6-b43a-3e11fa1f210f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:37.437561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b5e9b-1423-4fd6-b43a-3e11fa1f210f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:37.438622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-100820df-6254-45ba-a19d-06231f7a254c None None] MFA Rules not processed for user `ad54919d097f4a5eada522d696ced88b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:37.446269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-100820df-6254-45ba-a19d-06231f7a254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:37.479374 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1285/2571] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:37.524103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:37.667690 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1287/2572] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:37.678575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32147e-ebc1-45ac-99f1-e1d3f9932ef7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:37.679240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32147e-ebc1-45ac-99f1-e1d3f9932ef7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:37.679725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32147e-ebc1-45ac-99f1-e1d3f9932ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:37.716930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5c32147e-ebc1-45ac-99f1-e1d3f9932ef7 None None] MFA Rules not processed for user `ad54919d097f4a5eada522d696ced88b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:37.720140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5c32147e-ebc1-45ac-99f1-e1d3f9932ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:37.739676 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1286/2573] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:37.759356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100820df-6254-45ba-a19d-06231f7a254c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:37.761067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-100820df-6254-45ba-a19d-06231f7a254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:37.994552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100820df-6254-45ba-a19d-06231f7a254c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:38.012073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768986e2-0534-496a-9863-33e5d746818b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:38.012710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768986e2-0534-496a-9863-33e5d746818b service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:38.012990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768986e2-0534-496a-9863-33e5d746818b service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:38.013300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768986e2-0534-496a-9863-33e5d746818b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:38.036146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768986e2-0534-496a-9863-33e5d746818b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:38.037803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768986e2-0534-496a-9863-33e5d746818b service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:38.086546 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1288/2574] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:39.146492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3364b-d32d-41a1-8f5d-6c5d01457633 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:39.147582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3364b-d32d-41a1-8f5d-6c5d01457633 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:39.148080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3364b-d32d-41a1-8f5d-6c5d01457633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:39.156723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:39.238650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-60f3364b-d32d-41a1-8f5d-6c5d01457633 None None] MFA Rules not processed for user `0c9580da14a34c67b6d53ddbb9e96df6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:39.242557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-60f3364b-d32d-41a1-8f5d-6c5d01457633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:39.475439 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1287/2575] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:39 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:39.488910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e057d7-f3f3-4993-828a-890287941bde None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:39.489511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e057d7-f3f3-4993-828a-890287941bde None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:39.489661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e057d7-f3f3-4993-828a-890287941bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:39.544644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-75e057d7-f3f3-4993-828a-890287941bde None None] MFA Rules not processed for user `f331c1e3ee1442ad863d8909ca76020b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:39.549713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75e057d7-f3f3-4993-828a-890287941bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:39.769214 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1289/2576] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:40.651551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3364b-d32d-41a1-8f5d-6c5d01457633 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:40.684738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3364b-d32d-41a1-8f5d-6c5d01457633 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:40.708573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668db5fd-7802-43ea-9055-4eac315d260f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:40.712138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668db5fd-7802-43ea-9055-4eac315d260f service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:40.713036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668db5fd-7802-43ea-9055-4eac315d260f service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:40.713785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668db5fd-7802-43ea-9055-4eac315d260f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:40.719439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-668db5fd-7802-43ea-9055-4eac315d260f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:40.752913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668db5fd-7802-43ea-9055-4eac315d260f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:40.755108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668db5fd-7802-43ea-9055-4eac315d260f service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:40.806977 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1288/2577] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:43.758126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac1eaf-d110-41b2-9759-dceb625759fb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:43.759471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac1eaf-d110-41b2-9759-dceb625759fb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:43.760089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac1eaf-d110-41b2-9759-dceb625759fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:43.824254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-06ac1eaf-d110-41b2-9759-dceb625759fb None None] MFA Rules not processed for user `199c2a20a7e8425e8df281cfe251c880`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:43.844435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-06ac1eaf-d110-41b2-9759-dceb625759fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:44.098402 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1290/2578] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:49.493101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cdfd5-4094-46d8-b8e0-2b1609514201 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:49.494079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cdfd5-4094-46d8-b8e0-2b1609514201 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:49.494558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cdfd5-4094-46d8-b8e0-2b1609514201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:49.591774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e35cdfd5-4094-46d8-b8e0-2b1609514201 None None] MFA Rules not processed for user `958a45cf5eb647df9b53037171349898`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:49.593667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e35cdfd5-4094-46d8-b8e0-2b1609514201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:49.768418 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1289/2579] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:50.206945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac1eaf-d110-41b2-9759-dceb625759fb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:50.218496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:50.227440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac1eaf-d110-41b2-9759-dceb625759fb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:50.242717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd444ab1-110b-4d69-ad14-e7a1d8bd38bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:50.243465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd444ab1-110b-4d69-ad14-e7a1d8bd38bc service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:50.243794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd444ab1-110b-4d69-ad14-e7a1d8bd38bc service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:50.244068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd444ab1-110b-4d69-ad14-e7a1d8bd38bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:50.251027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fd444ab1-110b-4d69-ad14-e7a1d8bd38bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:50.395111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd444ab1-110b-4d69-ad14-e7a1d8bd38bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:50.397018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd444ab1-110b-4d69-ad14-e7a1d8bd38bc service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:50.409741 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1291/2580] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:52.227165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea15bb-3ad9-47a6-8664-315f9a80cab8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:52.227787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea15bb-3ad9-47a6-8664-315f9a80cab8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:52.228087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea15bb-3ad9-47a6-8664-315f9a80cab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:52.325377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-32ea15bb-3ad9-47a6-8664-315f9a80cab8 None None] MFA Rules not processed for user `95277645ba9a481e97aae929322f2a04`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:52.329555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-32ea15bb-3ad9-47a6-8664-315f9a80cab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:52.514894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:52.599971 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1290/2581] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:52.612653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd30527-f38c-4d82-a103-eaff9107f42d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:52.613213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd30527-f38c-4d82-a103-eaff9107f42d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:52.613213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd30527-f38c-4d82-a103-eaff9107f42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:52.657424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0cd30527-f38c-4d82-a103-eaff9107f42d None None] MFA Rules not processed for user `e7e71fcf6711470db5a71ddc74ff709c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:52.658719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0cd30527-f38c-4d82-a103-eaff9107f42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:52.794583 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1292/2582] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:27:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:54.174778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea15bb-3ad9-47a6-8664-315f9a80cab8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:54.176569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-32ea15bb-3ad9-47a6-8664-315f9a80cab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:54.201698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea15bb-3ad9-47a6-8664-315f9a80cab8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:54.209561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf810aa-e1ec-426d-a500-6b16ddaf2f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:54.210517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf810aa-e1ec-426d-a500-6b16ddaf2f8d service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:54.210986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf810aa-e1ec-426d-a500-6b16ddaf2f8d service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:54.211432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf810aa-e1ec-426d-a500-6b16ddaf2f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:54.213976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0cf810aa-e1ec-426d-a500-6b16ddaf2f8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:54.234238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf810aa-e1ec-426d-a500-6b16ddaf2f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:54.236003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf810aa-e1ec-426d-a500-6b16ddaf2f8d service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:54.284064 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1291/2583] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:27:55.651012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23de0f-7431-4f0c-8aae-7021ad5493d3 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:55.651625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23de0f-7431-4f0c-8aae-7021ad5493d3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:55.651954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23de0f-7431-4f0c-8aae-7021ad5493d3 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:55.654753 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1293/2584] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:27:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:27:55.711930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c7e0-6bd6-4aa6-bebc-9c2a5cb2a9e9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:55.713282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c7e0-6bd6-4aa6-bebc-9c2a5cb2a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:55.715727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c7e0-6bd6-4aa6-bebc-9c2a5cb2a9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:55.815969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4201c7e0-6bd6-4aa6-bebc-9c2a5cb2a9e9 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:27:55.820406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4201c7e0-6bd6-4aa6-bebc-9c2a5cb2a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:55.974392 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1292/2585] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:27:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:27:56.151007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23de0f-7431-4f0c-8aae-7021ad5493d3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:27:56.154659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ae23de0f-7431-4f0c-8aae-7021ad5493d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:27:56.221184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23de0f-7431-4f0c-8aae-7021ad5493d3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:27:56.240375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d1182-9937-434a-828e-d9e0acc80aa3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:27:56.241081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d1182-9937-434a-828e-d9e0acc80aa3 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:27:56.241358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d1182-9937-434a-828e-d9e0acc80aa3 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:27:56.241762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d1182-9937-434a-828e-d9e0acc80aa3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:27:56.281524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d1182-9937-434a-828e-d9e0acc80aa3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:27:56.283738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d1182-9937-434a-828e-d9e0acc80aa3 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:27:56.326598 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1294/2586] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:27:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:04.089760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0de91d-2522-487a-b95d-9920bf32819b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:04.090284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0de91d-2522-487a-b95d-9920bf32819b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:04.090374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0de91d-2522-487a-b95d-9920bf32819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:04.125164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7f0de91d-2522-487a-b95d-9920bf32819b None None] MFA Rules not processed for user `1ff9744258414abeb64b442b0d295c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:04.128771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7f0de91d-2522-487a-b95d-9920bf32819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:04.146205 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1293/2587] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:06.304220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=57 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:09.581210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476cba-6522-46a2-9ef6-42832c5d1857 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:09.582233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476cba-6522-46a2-9ef6-42832c5d1857 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:09.582741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476cba-6522-46a2-9ef6-42832c5d1857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:09.657561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8f476cba-6522-46a2-9ef6-42832c5d1857 None None] MFA Rules not processed for user `bbd52ee53a8d46cdafe1e1da95f9cd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:09.659183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8f476cba-6522-46a2-9ef6-42832c5d1857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:09.871335 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1295/2588] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:10.542765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0de91d-2522-487a-b95d-9920bf32819b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:10.572614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0de91d-2522-487a-b95d-9920bf32819b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:10.586166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892253cf-646e-4f31-b9f1-ade85d82752f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:10.587062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892253cf-646e-4f31-b9f1-ade85d82752f service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:10.589186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892253cf-646e-4f31-b9f1-ade85d82752f service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:10.590833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892253cf-646e-4f31-b9f1-ade85d82752f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:10.632713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892253cf-646e-4f31-b9f1-ade85d82752f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:10.635749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892253cf-646e-4f31-b9f1-ade85d82752f service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:10.678835 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1294/2589] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:11.591467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f476cba-6522-46a2-9ef6-42832c5d1857 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:11.594026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8f476cba-6522-46a2-9ef6-42832c5d1857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:11.619538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f476cba-6522-46a2-9ef6-42832c5d1857 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:11.631261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:11.632125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:11.634614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:11.635529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] PATH_INFO: `/v3/users/0b1859c03d84435db08be11ac1422e23` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:11.637575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1859c03d84435db08be11ac1422e23)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:11.641855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:11.738749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1859c03d84435db08be11ac1422e23'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:11.739453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1859c03d84435db08be11ac1422e23'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:11.760108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1859c03d84435db08be11ac1422e23'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:11.761244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1859c03d84435db08be11ac1422e23'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:11.773011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1859c03d84435db08be11ac1422e23'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:11.801450 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1296/2590] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:28:11 2022] DELETE /identity/v3/users/0b1859c03d84435db08be11ac1422e23 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:28:12.347538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892253cf-646e-4f31-b9f1-ade85d82752f service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:12.362865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892253cf-646e-4f31-b9f1-ade85d82752f service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:12.514578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:12.515534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:12.516452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:12.516921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] PATH_INFO: `/v3/projects/ce1ede705ef64e21b32141624ee2ffe5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:12.518569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1ede705ef64e21b32141624ee2ffe5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:12.521283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:12.638145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1ede705ef64e21b32141624ee2ffe5', 'request_id': 'req-de69e885-90a0-412b-b20b-09fb5eda13c8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:12.639604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:12.665944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1ede705ef64e21b32141624ee2ffe5', 'request_id': 'req-de69e885-90a0-412b-b20b-09fb5eda13c8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:12.682091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1ede705ef64e21b32141624ee2ffe5', 'request_id': 'req-de69e885-90a0-412b-b20b-09fb5eda13c8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:12.705280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] The token cache is being invalidate because project ce1ede705ef64e21b32141624ee2ffe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:28:12.705650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:12.707427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:12.710889 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1295/2591] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:12 2022] DELETE /identity/v3/projects/ce1ede705ef64e21b32141624ee2ffe5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:28:12.715132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:12.718035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:12.743902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6a283-fc81-4648-a85b-314c187da0f4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:12.829499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa631f-0b6e-44c9-9b2c-38ad0e3f9985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:12.830655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa631f-0b6e-44c9-9b2c-38ad0e3f9985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:12.831185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa631f-0b6e-44c9-9b2c-38ad0e3f9985 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:12.831874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa631f-0b6e-44c9-9b2c-38ad0e3f9985 admin admin] PATH_INFO: `/v3/users/7f8d1eebe02949738af4ac6452560795` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:12.833853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa631f-0b6e-44c9-9b2c-38ad0e3f9985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8d1eebe02949738af4ac6452560795)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:12.836654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa631f-0b6e-44c9-9b2c-38ad0e3f9985 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:12.840185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:12.990577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a0aa631f-0b6e-44c9-9b2c-38ad0e3f9985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8d1eebe02949738af4ac6452560795'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:12.994024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a0aa631f-0b6e-44c9-9b2c-38ad0e3f9985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8d1eebe02949738af4ac6452560795'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:13.046497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a0aa631f-0b6e-44c9-9b2c-38ad0e3f9985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8d1eebe02949738af4ac6452560795'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:13.048248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a0aa631f-0b6e-44c9-9b2c-38ad0e3f9985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8d1eebe02949738af4ac6452560795'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:13.072916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a0aa631f-0b6e-44c9-9b2c-38ad0e3f9985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8d1eebe02949738af4ac6452560795'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:13.140829 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1297/2592] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:28:12 2022] DELETE /identity/v3/users/7f8d1eebe02949738af4ac6452560795 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:28:14.682218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:14.684277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:14.714741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69e885-90a0-412b-b20b-09fb5eda13c8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:14.853361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:14.854401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:14.855497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:14.855936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] PATH_INFO: `/v3/projects/006fe095fe244d0d832ad0e40ad964df` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:14.857457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] RBAC: Authorizing `identity:delete_project(project_id=006fe095fe244d0d832ad0e40ad964df)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:14.861306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:14.989237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006fe095fe244d0d832ad0e40ad964df', 'request_id': 'req-6fa8af09-0884-411a-ae1d-6bf37fda056e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:15.012440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006fe095fe244d0d832ad0e40ad964df', 'request_id': 'req-6fa8af09-0884-411a-ae1d-6bf37fda056e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:15.048744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006fe095fe244d0d832ad0e40ad964df', 'request_id': 'req-6fa8af09-0884-411a-ae1d-6bf37fda056e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:15.072816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] The token cache is being invalidate because project 006fe095fe244d0d832ad0e40ad964df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:28:15.073138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:15.074625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fa8af09-0884-411a-ae1d-6bf37fda056e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:15.081028 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1296/2593] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:14 2022] DELETE /identity/v3/projects/006fe095fe244d0d832ad0e40ad964df => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:28:15.083289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d1037-67b5-4ae7-8a6f-f1f887a37e38 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:15.084018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d1037-67b5-4ae7-8a6f-f1f887a37e38 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:15.084018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d1037-67b5-4ae7-8a6f-f1f887a37e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:15.118727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b01d1037-67b5-4ae7-8a6f-f1f887a37e38 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:15.119974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b01d1037-67b5-4ae7-8a6f-f1f887a37e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:15.306777 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1298/2594] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:15.308608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38bc5-dc31-4f22-b058-94c59e05e9dd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:15.309349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38bc5-dc31-4f22-b058-94c59e05e9dd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:15.309724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38bc5-dc31-4f22-b058-94c59e05e9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:15.346913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b2d38bc5-dc31-4f22-b058-94c59e05e9dd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:15.348703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b2d38bc5-dc31-4f22-b058-94c59e05e9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:15.382060 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1297/2595] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:15.387404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d1037-67b5-4ae7-8a6f-f1f887a37e38 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:15.409061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d1037-67b5-4ae7-8a6f-f1f887a37e38 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:15.421538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a3f4a-a5d3-464a-93e9-2f333ba3f0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:15.423927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a3f4a-a5d3-464a-93e9-2f333ba3f0fd admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:15.426144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a3f4a-a5d3-464a-93e9-2f333ba3f0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:15.427295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a3f4a-a5d3-464a-93e9-2f333ba3f0fd admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:15.428281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a3f4a-a5d3-464a-93e9-2f333ba3f0fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:28:15.428805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a3f4a-a5d3-464a-93e9-2f333ba3f0fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:15.430735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a3f4a-a5d3-464a-93e9-2f333ba3f0fd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:15.459700 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1299/2596] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:28:15.462974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38bc5-dc31-4f22-b058-94c59e05e9dd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:15.476667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38bc5-dc31-4f22-b058-94c59e05e9dd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:15.487704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931df985-0651-4122-93ff-8cd3c57af25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:15.490884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df985-0651-4122-93ff-8cd3c57af25e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:15.491492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df985-0651-4122-93ff-8cd3c57af25e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:15.492089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df985-0651-4122-93ff-8cd3c57af25e admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:15.492954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931df985-0651-4122-93ff-8cd3c57af25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:15.495643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931df985-0651-4122-93ff-8cd3c57af25e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:15.559890 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1298/2597] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:28:15 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:28:15.565339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a3f4a-a5d3-464a-93e9-2f333ba3f0fd admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:15.589506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a3f4a-a5d3-464a-93e9-2f333ba3f0fd admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:15.753268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1611ab0-02e7-49df-8a87-1fe5c90b155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:15.754031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1611ab0-02e7-49df-8a87-1fe5c90b155a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:15.754378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1611ab0-02e7-49df-8a87-1fe5c90b155a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:15.754775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1611ab0-02e7-49df-8a87-1fe5c90b155a admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:15.755506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1611ab0-02e7-49df-8a87-1fe5c90b155a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:15.757639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1611ab0-02e7-49df-8a87-1fe5c90b155a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:15.790389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:15.802730 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1300/2598] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:28:15 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:28:15.807269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931df985-0651-4122-93ff-8cd3c57af25e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:15.821110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931df985-0651-4122-93ff-8cd3c57af25e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:15.828958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e34d4-211b-4e0d-94e8-3dac2da2922a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:15.830091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e34d4-211b-4e0d-94e8-3dac2da2922a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:15.830374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e34d4-211b-4e0d-94e8-3dac2da2922a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:15.830666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e34d4-211b-4e0d-94e8-3dac2da2922a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:15.831322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e34d4-211b-4e0d-94e8-3dac2da2922a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:15.832974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e34d4-211b-4e0d-94e8-3dac2da2922a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:15.848777 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1299/2599] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:28:15.853863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1611ab0-02e7-49df-8a87-1fe5c90b155a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:15.865861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1611ab0-02e7-49df-8a87-1fe5c90b155a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:15.871342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4685d04-0a37-441c-86b7-a2b47ceb515d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:15.871985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685d04-0a37-441c-86b7-a2b47ceb515d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:15.872268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685d04-0a37-441c-86b7-a2b47ceb515d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:15.872693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685d04-0a37-441c-86b7-a2b47ceb515d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:15.873948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4685d04-0a37-441c-86b7-a2b47ceb515d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:15.875697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4685d04-0a37-441c-86b7-a2b47ceb515d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:15.896532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e34d4-211b-4e0d-94e8-3dac2da2922a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:15.902275 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1301/2600] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:28:15.908897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e34d4-211b-4e0d-94e8-3dac2da2922a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:15.914970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff587a-f964-4e34-a9a3-55ea9bba962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:15.916086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff587a-f964-4e34-a9a3-55ea9bba962f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:15.916617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff587a-f964-4e34-a9a3-55ea9bba962f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:15.917073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff587a-f964-4e34-a9a3-55ea9bba962f admin admin] PATH_INFO: `/v3/projects/69c81aac0e2b4adba8bc9d9c9c24c097/users/1869270af6874c4db42112d4aa9417a6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:15.940153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff587a-f964-4e34-a9a3-55ea9bba962f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c81aac0e2b4adba8bc9d9c9c24c097, user_id=1869270af6874c4db42112d4aa9417a6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:15.944058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff587a-f964-4e34-a9a3-55ea9bba962f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:15.971642 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1300/2601] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:28:15 2022] PUT /identity/v3/projects/69c81aac0e2b4adba8bc9d9c9c24c097/users/1869270af6874c4db42112d4aa9417a6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:28:15.982694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de1617-cc74-4348-9f4e-fb3185acce69 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:15.983795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de1617-cc74-4348-9f4e-fb3185acce69 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:15.984228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de1617-cc74-4348-9f4e-fb3185acce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:16.016565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-00de1617-cc74-4348-9f4e-fb3185acce69 None None] MFA Rules not processed for user `1869270af6874c4db42112d4aa9417a6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:16.018367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-00de1617-cc74-4348-9f4e-fb3185acce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:16.238406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff587a-f964-4e34-a9a3-55ea9bba962f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:16.239664 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1302/2602] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:16.247778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:16.345223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff587a-f964-4e34-a9a3-55ea9bba962f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:16.352466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f3b06-efde-43e9-ab63-7e2fb2faaf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:16.353173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3b06-efde-43e9-ab63-7e2fb2faaf52 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:16.353499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3b06-efde-43e9-ab63-7e2fb2faaf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:16.353778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3b06-efde-43e9-ab63-7e2fb2faaf52 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:16.355238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f3b06-efde-43e9-ab63-7e2fb2faaf52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:16.357295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f3b06-efde-43e9-ab63-7e2fb2faaf52 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:16.398328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de1617-cc74-4348-9f4e-fb3185acce69 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:16.408120 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1301/2603] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:28:16 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:28:16.413832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de1617-cc74-4348-9f4e-fb3185acce69 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:16.515281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba439c8-50af-4753-a04a-16bd8b43f510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:16.516344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba439c8-50af-4753-a04a-16bd8b43f510 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:16.516991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba439c8-50af-4753-a04a-16bd8b43f510 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:16.517489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba439c8-50af-4753-a04a-16bd8b43f510 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:16.520245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba439c8-50af-4753-a04a-16bd8b43f510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:16.531642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba439c8-50af-4753-a04a-16bd8b43f510 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:16.571062 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1303/2604] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:28:16 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:28:16.575742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f3b06-efde-43e9-ab63-7e2fb2faaf52 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:16.596820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f3b06-efde-43e9-ab63-7e2fb2faaf52 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:16.622871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5bad6-4432-461b-aa40-6b27927458de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:16.627277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5bad6-4432-461b-aa40-6b27927458de admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:16.627602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5bad6-4432-461b-aa40-6b27927458de admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:16.627887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5bad6-4432-461b-aa40-6b27927458de admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:16.628811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5bad6-4432-461b-aa40-6b27927458de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:16.636113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5bad6-4432-461b-aa40-6b27927458de admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:16.675196 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1302/2605] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:28:16.679847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba439c8-50af-4753-a04a-16bd8b43f510 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:16.692429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba439c8-50af-4753-a04a-16bd8b43f510 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:16.700889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca276-462e-474d-a00f-b84aa316d7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:16.702260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca276-462e-474d-a00f-b84aa316d7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:16.702742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca276-462e-474d-a00f-b84aa316d7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:16.703036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ca276-462e-474d-a00f-b84aa316d7f9 admin admin] PATH_INFO: `/v3/projects/99027d125a554aa8ba6d93ec8d8647df/users/a475f784dacf42f09574889b479994c1/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:16.776580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ca276-462e-474d-a00f-b84aa316d7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99027d125a554aa8ba6d93ec8d8647df, user_id=a475f784dacf42f09574889b479994c1, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:16.780653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ca276-462e-474d-a00f-b84aa316d7f9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:16.813429 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1304/2606] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:28:16 2022] PUT /identity/v3/projects/99027d125a554aa8ba6d93ec8d8647df/users/a475f784dacf42f09574889b479994c1/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:28:16.815807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5bad6-4432-461b-aa40-6b27927458de admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:16.836655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5bad6-4432-461b-aa40-6b27927458de admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:17.007416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f3327-d8b3-4235-97d9-7e7f62e2dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:17.008503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3327-d8b3-4235-97d9-7e7f62e2dc6a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:17.008503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3327-d8b3-4235-97d9-7e7f62e2dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:17.008720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3327-d8b3-4235-97d9-7e7f62e2dc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:17.009224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f3327-d8b3-4235-97d9-7e7f62e2dc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:17.011221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f3327-d8b3-4235-97d9-7e7f62e2dc6a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:17.027604 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1303/2607] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:28:17.028907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca276-462e-474d-a00f-b84aa316d7f9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:17.042368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ca276-462e-474d-a00f-b84aa316d7f9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:17.057646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698d709-b666-4336-a07b-32da1649657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:17.058649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698d709-b666-4336-a07b-32da1649657d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:17.059097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698d709-b666-4336-a07b-32da1649657d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:17.059587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698d709-b666-4336-a07b-32da1649657d admin admin] PATH_INFO: `/v3/projects/99027d125a554aa8ba6d93ec8d8647df/users/a475f784dacf42f09574889b479994c1/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:17.063676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698d709-b666-4336-a07b-32da1649657d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99027d125a554aa8ba6d93ec8d8647df, user_id=a475f784dacf42f09574889b479994c1, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:17.074057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698d709-b666-4336-a07b-32da1649657d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:17.100785 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1305/2608] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:28:17 2022] PUT /identity/v3/projects/99027d125a554aa8ba6d93ec8d8647df/users/a475f784dacf42f09574889b479994c1/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:28:17.113647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599f34-3f5a-4d6a-805e-38c9c3374ee6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:17.114010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599f34-3f5a-4d6a-805e-38c9c3374ee6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:17.114354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599f34-3f5a-4d6a-805e-38c9c3374ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:17.173872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5a599f34-3f5a-4d6a-805e-38c9c3374ee6 None None] MFA Rules not processed for user `a475f784dacf42f09574889b479994c1`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:17.182020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5a599f34-3f5a-4d6a-805e-38c9c3374ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:17.353477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:17.365548 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1304/2609] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:17.378768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f2db-8950-4790-a481-2278f4dc8b70 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:17.379320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f2db-8950-4790-a481-2278f4dc8b70 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:17.379320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f2db-8950-4790-a481-2278f4dc8b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:17.417718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-feb0f2db-8950-4790-a481-2278f4dc8b70 None None] MFA Rules not processed for user `1869270af6874c4db42112d4aa9417a6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:17.421970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-feb0f2db-8950-4790-a481-2278f4dc8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:17.496628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:17.597265 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1306/2610] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:18.286731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a599f34-3f5a-4d6a-805e-38c9c3374ee6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:18.290074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5a599f34-3f5a-4d6a-805e-38c9c3374ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:18.472447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a599f34-3f5a-4d6a-805e-38c9c3374ee6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:18.490135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b81b3-742e-4020-90ca-902cb7012461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:18.491151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b81b3-742e-4020-90ca-902cb7012461 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:18.491623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b81b3-742e-4020-90ca-902cb7012461 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:18.492106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b81b3-742e-4020-90ca-902cb7012461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:18.518775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b81b3-742e-4020-90ca-902cb7012461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:18.522116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b81b3-742e-4020-90ca-902cb7012461 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:18.547877 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1305/2611] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:19.484163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0f2db-8950-4790-a481-2278f4dc8b70 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:19.486413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-feb0f2db-8950-4790-a481-2278f4dc8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:19.524938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0f2db-8950-4790-a481-2278f4dc8b70 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:19.542811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbc9b0-575e-4fc2-855c-21a0b8543278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:19.544623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbc9b0-575e-4fc2-855c-21a0b8543278 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:19.545291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbc9b0-575e-4fc2-855c-21a0b8543278 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:19.545874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbc9b0-575e-4fc2-855c-21a0b8543278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:19.550189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-12dbc9b0-575e-4fc2-855c-21a0b8543278 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:19.699891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbc9b0-575e-4fc2-855c-21a0b8543278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:19.702164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbc9b0-575e-4fc2-855c-21a0b8543278 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:19.729072 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1307/2612] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:19 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:21.256646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cd994-ea08-44da-8481-6a5da234b87b None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:21.257518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cd994-ea08-44da-8481-6a5da234b87b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:21.258024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cd994-ea08-44da-8481-6a5da234b87b None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:21.260193 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1306/2613] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:28:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:21.288392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba351f-8228-481c-8fb4-0e6990aab8c3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:21.288392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba351f-8228-481c-8fb4-0e6990aab8c3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:21.288392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba351f-8228-481c-8fb4-0e6990aab8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:21.294829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cd994-ea08-44da-8481-6a5da234b87b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:21.298665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1e3cd994-ea08-44da-8481-6a5da234b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:21.353437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-75ba351f-8228-481c-8fb4-0e6990aab8c3 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:21.358969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75ba351f-8228-481c-8fb4-0e6990aab8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:21.472584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cd994-ea08-44da-8481-6a5da234b87b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:21.481405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:21.482665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:21.483762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:21.483967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] PATH_INFO: `/v3/users/bbd52ee53a8d46cdafe1e1da95f9cd6f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:21.503884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd52ee53a8d46cdafe1e1da95f9cd6f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:21.512417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:21.646516 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1308/2614] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:28:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:21.683848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd52ee53a8d46cdafe1e1da95f9cd6f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:21.685126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd52ee53a8d46cdafe1e1da95f9cd6f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:21.714866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba351f-8228-481c-8fb4-0e6990aab8c3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:21.718036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75ba351f-8228-481c-8fb4-0e6990aab8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:21.728203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd52ee53a8d46cdafe1e1da95f9cd6f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:21.743690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba351f-8228-481c-8fb4-0e6990aab8c3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:21.747978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd52ee53a8d46cdafe1e1da95f9cd6f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:21.772152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd52ee53a8d46cdafe1e1da95f9cd6f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:21.776594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f84004-4d89-4fd9-a468-f02e3aed8d09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:21.777601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f84004-4d89-4fd9-a468-f02e3aed8d09 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:21.778126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f84004-4d89-4fd9-a468-f02e3aed8d09 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:21.780144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f84004-4d89-4fd9-a468-f02e3aed8d09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:21.793674 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1307/2615] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:28:21 2022] DELETE /identity/v3/users/bbd52ee53a8d46cdafe1e1da95f9cd6f => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:28:21.806775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c0f84004-4d89-4fd9-a468-f02e3aed8d09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:21.842866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f84004-4d89-4fd9-a468-f02e3aed8d09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:21.844913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f84004-4d89-4fd9-a468-f02e3aed8d09 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:21.865021 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1309/2616] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:28:22.228511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:22.230007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:22.237332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:22.358667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8cb1e-ee9a-4a5f-9ccf-f207bf22e616 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:22.364011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:22.364697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:22.365008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:22.365288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] PATH_INFO: `/v3/projects/12c3f0d480234309a58bfa1e1d1d2bb7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:22.366544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c3f0d480234309a58bfa1e1d1d2bb7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:22.369321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:22.457558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c3f0d480234309a58bfa1e1d1d2bb7', 'request_id': 'req-cb5f384a-5610-4426-833a-cf56b9ed58a9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:22.466457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c3f0d480234309a58bfa1e1d1d2bb7', 'request_id': 'req-cb5f384a-5610-4426-833a-cf56b9ed58a9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:22.493247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c3f0d480234309a58bfa1e1d1d2bb7', 'request_id': 'req-cb5f384a-5610-4426-833a-cf56b9ed58a9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:22.535832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] The token cache is being invalidate because project 12c3f0d480234309a58bfa1e1d1d2bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:28:22.536043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:22.538136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb5f384a-5610-4426-833a-cf56b9ed58a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:22.540319 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1308/2617] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:22 2022] DELETE /identity/v3/projects/12c3f0d480234309a58bfa1e1d1d2bb7 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:28:22.546068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179eb32-b6cf-4eea-a286-f6b14f081faa None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:22.546655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179eb32-b6cf-4eea-a286-f6b14f081faa None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:22.546655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179eb32-b6cf-4eea-a286-f6b14f081faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:22.592881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f179eb32-b6cf-4eea-a286-f6b14f081faa None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:22.594923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f179eb32-b6cf-4eea-a286-f6b14f081faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:22.679833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:22.716504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351b2be-a8c2-4845-8abe-fc88bf3c530f None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:22.716789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351b2be-a8c2-4845-8abe-fc88bf3c530f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:22.717615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351b2be-a8c2-4845-8abe-fc88bf3c530f None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:22.719264 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1309/2618] 10.222.0.16 () {54 vars in 961 bytes} [Mon Aug 29 15:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:22.726548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c77718-30cf-467b-b54e-f91b18ced625 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:22.726830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c77718-30cf-467b-b54e-f91b18ced625 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:22.727103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c77718-30cf-467b-b54e-f91b18ced625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:22.729358 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1310/2619] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:22.731040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfff6f2-260e-4202-9396-af51a8c5777c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:22.731526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfff6f2-260e-4202-9396-af51a8c5777c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:22.731974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfff6f2-260e-4202-9396-af51a8c5777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:22.758282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3cfff6f2-260e-4202-9396-af51a8c5777c None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:22.759805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3cfff6f2-260e-4202-9396-af51a8c5777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:22.770436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-82c77718-30cf-467b-b54e-f91b18ced625 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:22.771707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-82c77718-30cf-467b-b54e-f91b18ced625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:22.797693 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1310/2620] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:22.803366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c77718-30cf-467b-b54e-f91b18ced625 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:22.846243 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1311/2621] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Aug 29 15:28:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:22.849205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c77718-30cf-467b-b54e-f91b18ced625 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:22.854870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f8b1-484a-4a22-8cc2-ad663c31acc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:22.855454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfff6f2-260e-4202-9396-af51a8c5777c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:22.856189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f8b1-484a-4a22-8cc2-ad663c31acc5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:22.856766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f8b1-484a-4a22-8cc2-ad663c31acc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:22.856944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3cfff6f2-260e-4202-9396-af51a8c5777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:22.858326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f8b1-484a-4a22-8cc2-ad663c31acc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:22.859319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5f8b1-484a-4a22-8cc2-ad663c31acc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:28:22.859802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5f8b1-484a-4a22-8cc2-ad663c31acc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:22.861758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5f8b1-484a-4a22-8cc2-ad663c31acc5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:22.881080 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1311/2622] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:28:22.882366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f8b1-484a-4a22-8cc2-ad663c31acc5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:22.905657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f8b1-484a-4a22-8cc2-ad663c31acc5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:22.914036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc5981-138d-4fd9-a1ad-092505051eff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:22.915096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5981-138d-4fd9-a1ad-092505051eff service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:22.915697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5981-138d-4fd9-a1ad-092505051eff service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:22.916287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5981-138d-4fd9-a1ad-092505051eff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:22.919161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-54dc5981-138d-4fd9-a1ad-092505051eff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:22.954312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc5981-138d-4fd9-a1ad-092505051eff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:22.956703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc5981-138d-4fd9-a1ad-092505051eff service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:22.970326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfff6f2-260e-4202-9396-af51a8c5777c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:22.981153 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1312/2623] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:22.981153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc5981-138d-4fd9-a1ad-092505051eff service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:22.986201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a3207-ce16-49c3-865d-270c59a66d0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:22.987808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a3207-ce16-49c3-865d-270c59a66d0f service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:22.988550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a3207-ce16-49c3-865d-270c59a66d0f service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:22.988997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a3207-ce16-49c3-865d-270c59a66d0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:22.993348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc5981-138d-4fd9-a1ad-092505051eff service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:22.994115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-735a3207-ce16-49c3-865d-270c59a66d0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:22.999337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcde4a-e2a5-4bdd-bed7-3915d6c15fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:23.000022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcde4a-e2a5-4bdd-bed7-3915d6c15fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:23.000343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcde4a-e2a5-4bdd-bed7-3915d6c15fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:23.000635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcde4a-e2a5-4bdd-bed7-3915d6c15fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:23.001377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcde4a-e2a5-4bdd-bed7-3915d6c15fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:23.003784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcde4a-e2a5-4bdd-bed7-3915d6c15fd5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:23.059341 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1313/2624] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:28:22 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:28:23.065847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcde4a-e2a5-4bdd-bed7-3915d6c15fd5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:23.136146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:23.155696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a3207-ce16-49c3-865d-270c59a66d0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:23.158327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a3207-ce16-49c3-865d-270c59a66d0f service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:23.176971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcde4a-e2a5-4bdd-bed7-3915d6c15fd5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:23.184626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4437d8-cfb0-4441-a575-3e592f9514df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:23.186622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4437d8-cfb0-4441-a575-3e592f9514df admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:23.187133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4437d8-cfb0-4441-a575-3e592f9514df admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:23.187607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4437d8-cfb0-4441-a575-3e592f9514df admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:23.188783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4437d8-cfb0-4441-a575-3e592f9514df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:23.191902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4437d8-cfb0-4441-a575-3e592f9514df admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:23.193003 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1312/2625] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:23.229379 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1314/2626] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:28:23 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:28:23.231118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a3207-ce16-49c3-865d-270c59a66d0f service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:23.253240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a3207-ce16-49c3-865d-270c59a66d0f service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:23.273688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb7e09-e8bb-4886-8c3e-0dcf2024a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:23.275638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7e09-e8bb-4886-8c3e-0dcf2024a67c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:23.276026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7e09-e8bb-4886-8c3e-0dcf2024a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:23.276407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7e09-e8bb-4886-8c3e-0dcf2024a67c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:23.278950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb7e09-e8bb-4886-8c3e-0dcf2024a67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:23.284364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb7e09-e8bb-4886-8c3e-0dcf2024a67c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:23.300047 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1313/2627] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:28:23.303685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4437d8-cfb0-4441-a575-3e592f9514df admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:23.316812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4437d8-cfb0-4441-a575-3e592f9514df admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:23.323008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da637f-d5ea-48d8-8730-5e0a919f337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:23.324181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da637f-d5ea-48d8-8730-5e0a919f337d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:23.324465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da637f-d5ea-48d8-8730-5e0a919f337d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:23.324740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da637f-d5ea-48d8-8730-5e0a919f337d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:23.325867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da637f-d5ea-48d8-8730-5e0a919f337d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:23.328778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da637f-d5ea-48d8-8730-5e0a919f337d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:23.356482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb7e09-e8bb-4886-8c3e-0dcf2024a67c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:23.356944 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1315/2628] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:28:23.383861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb7e09-e8bb-4886-8c3e-0dcf2024a67c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:23.395054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f87f8-376b-43ec-bacc-c16d9381a6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:23.396163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f87f8-376b-43ec-bacc-c16d9381a6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:23.396695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f87f8-376b-43ec-bacc-c16d9381a6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:23.397320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f87f8-376b-43ec-bacc-c16d9381a6bb admin admin] PATH_INFO: `/v3/projects/03575bcf80404b0994fc8d967804b6df/users/7ead06f178974869a251628cca018175/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:23.419360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:23.453612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f87f8-376b-43ec-bacc-c16d9381a6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=03575bcf80404b0994fc8d967804b6df, user_id=7ead06f178974869a251628cca018175, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:23.457122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f87f8-376b-43ec-bacc-c16d9381a6bb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:23.492759 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1314/2629] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:28:23 2022] PUT /identity/v3/projects/03575bcf80404b0994fc8d967804b6df/users/7ead06f178974869a251628cca018175/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:28:23.495047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82bac-f8d3-44d6-a6d5-448c097e9bc4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:23.495491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82bac-f8d3-44d6-a6d5-448c097e9bc4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:23.495670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82bac-f8d3-44d6-a6d5-448c097e9bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:23.550960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-98b82bac-f8d3-44d6-a6d5-448c097e9bc4 None None] MFA Rules not processed for user `7ead06f178974869a251628cca018175`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:23.552584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-98b82bac-f8d3-44d6-a6d5-448c097e9bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:23.646585 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1316/2630] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:23.651362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc795e-64e0-4273-bf95-0970adbb1c31 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:23.652246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc795e-64e0-4273-bf95-0970adbb1c31 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:23.652522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc795e-64e0-4273-bf95-0970adbb1c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:23.700348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9abc795e-64e0-4273-bf95-0970adbb1c31 None None] MFA Rules not processed for user `7ead06f178974869a251628cca018175`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:23.703279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9abc795e-64e0-4273-bf95-0970adbb1c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:23.727450 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1315/2631] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:24.058807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb225f-ffd2-485b-935b-bd5f73f9e18e None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:24.059482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb225f-ffd2-485b-935b-bd5f73f9e18e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:24.059925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb225f-ffd2-485b-935b-bd5f73f9e18e None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:24.062400 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1317/2632] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:28:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:24.068799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b891-4bbd-4524-906d-6467f2a58330 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:24.069104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b891-4bbd-4524-906d-6467f2a58330 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:24.069378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b891-4bbd-4524-906d-6467f2a58330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:24.102363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3fe0b891-4bbd-4524-906d-6467f2a58330 None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:24.104155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3fe0b891-4bbd-4524-906d-6467f2a58330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:24.261944 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1316/2633] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:28:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:24.289319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb225f-ffd2-485b-935b-bd5f73f9e18e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:24.298480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aedb225f-ffd2-485b-935b-bd5f73f9e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:24.428399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb225f-ffd2-485b-935b-bd5f73f9e18e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:24.432582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496316-871f-406a-bd86-a4287808f87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:24.433212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496316-871f-406a-bd86-a4287808f87e service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:24.434695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496316-871f-406a-bd86-a4287808f87e service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:24.434695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496316-871f-406a-bd86-a4287808f87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:24.447279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496316-871f-406a-bd86-a4287808f87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:24.449246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496316-871f-406a-bd86-a4287808f87e service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:24.461562 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1318/2634] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:24.501003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16240747-841d-43f2-9562-717a0854b737 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:24.510825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16240747-841d-43f2-9562-717a0854b737 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:24.511364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16240747-841d-43f2-9562-717a0854b737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:24.559464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-16240747-841d-43f2-9562-717a0854b737 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:24.561788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-16240747-841d-43f2-9562-717a0854b737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:24.587374 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1317/2635] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:28:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:28:24.608530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496316-871f-406a-bd86-a4287808f87e service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:24.617535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496316-871f-406a-bd86-a4287808f87e service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:24.643025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57b6f9-901f-4124-871e-afed5293c6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:24.643025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57b6f9-901f-4124-871e-afed5293c6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:24.643025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57b6f9-901f-4124-871e-afed5293c6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:24.643025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57b6f9-901f-4124-871e-afed5293c6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:24.656036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57b6f9-901f-4124-871e-afed5293c6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:24.658360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57b6f9-901f-4124-871e-afed5293c6c7 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:24.669310 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1319/2636] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:24.799611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16240747-841d-43f2-9562-717a0854b737 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:24.821937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16240747-841d-43f2-9562-717a0854b737 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:24.830465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169e020-f5dd-401b-b4bd-517b271a523a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:24.831633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169e020-f5dd-401b-b4bd-517b271a523a service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:24.832160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169e020-f5dd-401b-b4bd-517b271a523a service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:24.832967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169e020-f5dd-401b-b4bd-517b271a523a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:24.852213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169e020-f5dd-401b-b4bd-517b271a523a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:24.856516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169e020-f5dd-401b-b4bd-517b271a523a service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:24.876037 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1318/2637] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:32.605828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b5e47-4158-4d4e-a33c-f17f862ceba1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:32.606695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b5e47-4158-4d4e-a33c-f17f862ceba1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:32.606982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b5e47-4158-4d4e-a33c-f17f862ceba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:32.628704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-905b5e47-4158-4d4e-a33c-f17f862ceba1 None None] MFA Rules not processed for user `7bd967d46f614bb4a187218498e934f3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:32.629945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-905b5e47-4158-4d4e-a33c-f17f862ceba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:32.664509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:32.689977 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1320/2638] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:34.093713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169e020-f5dd-401b-b4bd-517b271a523a service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:34.275117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169e020-f5dd-401b-b4bd-517b271a523a service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:34.285834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eefdd0-db5c-4772-8bd7-147edc35d45c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:34.287270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eefdd0-db5c-4772-8bd7-147edc35d45c service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:34.287773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eefdd0-db5c-4772-8bd7-147edc35d45c service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:34.288275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eefdd0-db5c-4772-8bd7-147edc35d45c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:34.292351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e6eefdd0-db5c-4772-8bd7-147edc35d45c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:34.316632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eefdd0-db5c-4772-8bd7-147edc35d45c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:34.319327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eefdd0-db5c-4772-8bd7-147edc35d45c service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:34.342469 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1319/2639] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:36.793679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b5e47-4158-4d4e-a33c-f17f862ceba1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:36.795656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-905b5e47-4158-4d4e-a33c-f17f862ceba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:36.837812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b5e47-4158-4d4e-a33c-f17f862ceba1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:36.848242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bf935-891f-406f-af0b-12f9a41b457d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:36.849824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bf935-891f-406f-af0b-12f9a41b457d service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:36.850292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bf935-891f-406f-af0b-12f9a41b457d service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:36.851228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bf935-891f-406f-af0b-12f9a41b457d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:36.853937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-163bf935-891f-406f-af0b-12f9a41b457d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:36.951469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bf935-891f-406f-af0b-12f9a41b457d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:36.953545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bf935-891f-406f-af0b-12f9a41b457d service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:36.965779 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1321/2640] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:38.520334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a09a18-5244-4290-8dc0-95f8c61acab4 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:38.523142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a09a18-5244-4290-8dc0-95f8c61acab4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:38.523840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a09a18-5244-4290-8dc0-95f8c61acab4 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:38.526794 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1320/2641] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:28:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:28:38.554368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b84e5-17f9-4a6c-8f79-af949db63683 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:38.554822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b84e5-17f9-4a6c-8f79-af949db63683 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:38.554934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b84e5-17f9-4a6c-8f79-af949db63683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:38.594169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d89b84e5-17f9-4a6c-8f79-af949db63683 None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:38.606603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d89b84e5-17f9-4a6c-8f79-af949db63683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:38.624027 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1322/2642] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:28:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:38.666836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a09a18-5244-4290-8dc0-95f8c61acab4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:38.668645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75a09a18-5244-4290-8dc0-95f8c61acab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:38.685360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a09a18-5244-4290-8dc0-95f8c61acab4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:38.690948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66631a9f-249b-4717-aab8-cec3b30b99b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:38.691597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631a9f-249b-4717-aab8-cec3b30b99b5 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:38.692143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631a9f-249b-4717-aab8-cec3b30b99b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:38.692596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631a9f-249b-4717-aab8-cec3b30b99b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:38.706936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66631a9f-249b-4717-aab8-cec3b30b99b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:38.708868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66631a9f-249b-4717-aab8-cec3b30b99b5 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:38.723459 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1321/2643] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:28:39.242581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b84e5-17f9-4a6c-8f79-af949db63683 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:39.244522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d89b84e5-17f9-4a6c-8f79-af949db63683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:39.282704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b84e5-17f9-4a6c-8f79-af949db63683 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:39.301831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd1453-937c-4b34-a65e-28d90769e078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:39.304499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd1453-937c-4b34-a65e-28d90769e078 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:39.306333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd1453-937c-4b34-a65e-28d90769e078 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:39.307897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd1453-937c-4b34-a65e-28d90769e078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:39.316833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-28dd1453-937c-4b34-a65e-28d90769e078 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:39.352591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd1453-937c-4b34-a65e-28d90769e078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:39.355272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd1453-937c-4b34-a65e-28d90769e078 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:39.389216 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1323/2644] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:40.287006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ab1e5-4070-417d-b7c3-153e3ce14252 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:40.287698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ab1e5-4070-417d-b7c3-153e3ce14252 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:40.287698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ab1e5-4070-417d-b7c3-153e3ce14252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:40.314663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-920ab1e5-4070-417d-b7c3-153e3ce14252 None None] MFA Rules not processed for user `f331c1e3ee1442ad863d8909ca76020b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:40.316693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-920ab1e5-4070-417d-b7c3-153e3ce14252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:40.367903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:40.469252 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1322/2645] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:46.256638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd1453-937c-4b34-a65e-28d90769e078 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:46.258178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-28dd1453-937c-4b34-a65e-28d90769e078 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:46.426382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd1453-937c-4b34-a65e-28d90769e078 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:46.435742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becebf6-762d-44b5-89bb-c4fd4157fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:46.436906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becebf6-762d-44b5-89bb-c4fd4157fc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:46.437464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becebf6-762d-44b5-89bb-c4fd4157fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:46.438795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becebf6-762d-44b5-89bb-c4fd4157fc21 admin admin] PATH_INFO: `/v3/users/ad54919d097f4a5eada522d696ced88b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:46.440677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becebf6-762d-44b5-89bb-c4fd4157fc21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad54919d097f4a5eada522d696ced88b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:46.443241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becebf6-762d-44b5-89bb-c4fd4157fc21 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:46.568459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9becebf6-762d-44b5-89bb-c4fd4157fc21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad54919d097f4a5eada522d696ced88b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:46.571485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9becebf6-762d-44b5-89bb-c4fd4157fc21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad54919d097f4a5eada522d696ced88b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:46.587611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:46.601275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9becebf6-762d-44b5-89bb-c4fd4157fc21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad54919d097f4a5eada522d696ced88b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:46.624611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9becebf6-762d-44b5-89bb-c4fd4157fc21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad54919d097f4a5eada522d696ced88b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:46.644401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9becebf6-762d-44b5-89bb-c4fd4157fc21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad54919d097f4a5eada522d696ced88b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:46.655379 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1324/2646] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:28:46 2022] DELETE /identity/v3/users/ad54919d097f4a5eada522d696ced88b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:28:46.990216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ab1e5-4070-417d-b7c3-153e3ce14252 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:47.004887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ab1e5-4070-417d-b7c3-153e3ce14252 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:47.079829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:47.080572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.080901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.081336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] PATH_INFO: `/v3/projects/f6f618c91ce540038aa1698ae84216d2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:47.082625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f618c91ce540038aa1698ae84216d2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:47.085661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:47.181092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f618c91ce540038aa1698ae84216d2', 'request_id': 'req-024c55c7-08a9-4a76-b26a-b43db5ad265c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:47.194508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f618c91ce540038aa1698ae84216d2', 'request_id': 'req-024c55c7-08a9-4a76-b26a-b43db5ad265c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:47.207239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f618c91ce540038aa1698ae84216d2', 'request_id': 'req-024c55c7-08a9-4a76-b26a-b43db5ad265c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:47.221561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] The token cache is being invalidate because project f6f618c91ce540038aa1698ae84216d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:28:47.222171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:47.222998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-024c55c7-08a9-4a76-b26a-b43db5ad265c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:28:47.225107 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1323/2647] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:46 2022] DELETE /identity/v3/projects/f6f618c91ce540038aa1698ae84216d2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:28:47.234030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0190-7aa8-4ee6-9824-719e34695b07 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.234863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0190-7aa8-4ee6-9824-719e34695b07 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.235597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0190-7aa8-4ee6-9824-719e34695b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:47.265520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-565d0190-7aa8-4ee6-9824-719e34695b07 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:47.267533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-565d0190-7aa8-4ee6-9824-719e34695b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:47.344568 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1325/2648] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:47.353024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f382e8-3703-4891-8470-4bb8f11c72fe None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.353596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f382e8-3703-4891-8470-4bb8f11c72fe None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.353902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f382e8-3703-4891-8470-4bb8f11c72fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:47.390276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-83f382e8-3703-4891-8470-4bb8f11c72fe None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:47.392392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-83f382e8-3703-4891-8470-4bb8f11c72fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:47.408110 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1324/2649] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:47.412823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d0190-7aa8-4ee6-9824-719e34695b07 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:47.430304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d0190-7aa8-4ee6-9824-719e34695b07 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:47.436280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c5ccb-6553-47cb-8c0e-52758d39e4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:47.437025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c5ccb-6553-47cb-8c0e-52758d39e4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.437484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c5ccb-6553-47cb-8c0e-52758d39e4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.437884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c5ccb-6553-47cb-8c0e-52758d39e4c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:47.438700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c5ccb-6553-47cb-8c0e-52758d39e4c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:28:47.439164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c5ccb-6553-47cb-8c0e-52758d39e4c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:47.440944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c5ccb-6553-47cb-8c0e-52758d39e4c2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:47.457473 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1326/2650] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:28:47.461936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f382e8-3703-4891-8470-4bb8f11c72fe None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:47.478111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f382e8-3703-4891-8470-4bb8f11c72fe None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:47.484370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08be0c-e811-41f7-b202-7e1ea5923c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:47.484991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08be0c-e811-41f7-b202-7e1ea5923c1e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.485266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08be0c-e811-41f7-b202-7e1ea5923c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.485798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08be0c-e811-41f7-b202-7e1ea5923c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:47.486710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08be0c-e811-41f7-b202-7e1ea5923c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:47.489592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08be0c-e811-41f7-b202-7e1ea5923c1e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:47.536307 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1325/2651] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:28:47 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:28:47.537532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c5ccb-6553-47cb-8c0e-52758d39e4c2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:47.556267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c5ccb-6553-47cb-8c0e-52758d39e4c2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:47.647905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb89665-f0df-4664-8b3a-a006ab4e18c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:47.649265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb89665-f0df-4664-8b3a-a006ab4e18c4 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.650139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb89665-f0df-4664-8b3a-a006ab4e18c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.650555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb89665-f0df-4664-8b3a-a006ab4e18c4 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:47.652513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb89665-f0df-4664-8b3a-a006ab4e18c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:47.659151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb89665-f0df-4664-8b3a-a006ab4e18c4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:47.701113 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1327/2652] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:28:47 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:28:47.707572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08be0c-e811-41f7-b202-7e1ea5923c1e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:47.730688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08be0c-e811-41f7-b202-7e1ea5923c1e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:47.742493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f0279-34f5-4dbf-b52e-7486aeb4bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:47.743997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f0279-34f5-4dbf-b52e-7486aeb4bf5e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.744748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f0279-34f5-4dbf-b52e-7486aeb4bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.745569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f0279-34f5-4dbf-b52e-7486aeb4bf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:47.747388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f0279-34f5-4dbf-b52e-7486aeb4bf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:47.751344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f0279-34f5-4dbf-b52e-7486aeb4bf5e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:47.776650 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1326/2653] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:28:47.785816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb89665-f0df-4664-8b3a-a006ab4e18c4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:47.800483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb89665-f0df-4664-8b3a-a006ab4e18c4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:47.815193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ac730-332f-4be8-a28b-44960d558f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:47.815913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ac730-332f-4be8-a28b-44960d558f6e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.816264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ac730-332f-4be8-a28b-44960d558f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.817453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ac730-332f-4be8-a28b-44960d558f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:47.818197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ac730-332f-4be8-a28b-44960d558f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:47.822176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ac730-332f-4be8-a28b-44960d558f6e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:47.848267 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1328/2654] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:28:47.849650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f0279-34f5-4dbf-b52e-7486aeb4bf5e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:47.864065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f0279-34f5-4dbf-b52e-7486aeb4bf5e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:47.878549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e9542-9dd6-495d-804a-6bf015f9d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:47.879547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e9542-9dd6-495d-804a-6bf015f9d62c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.880004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e9542-9dd6-495d-804a-6bf015f9d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.885744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e9542-9dd6-495d-804a-6bf015f9d62c admin admin] PATH_INFO: `/v3/projects/905e27cb0f35425d90acb91886ca47e7/users/6350cfd37a994b469e21ecd19908c296/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:47.916605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e9542-9dd6-495d-804a-6bf015f9d62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=905e27cb0f35425d90acb91886ca47e7, user_id=6350cfd37a994b469e21ecd19908c296, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:47.919468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e9542-9dd6-495d-804a-6bf015f9d62c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:47.932939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:47.964249 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1327/2655] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:28:47 2022] PUT /identity/v3/projects/905e27cb0f35425d90acb91886ca47e7/users/6350cfd37a994b469e21ecd19908c296/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:28:47.967291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f349-0a16-4bf7-b16d-83c1cb18571d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:47.967577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f349-0a16-4bf7-b16d-83c1cb18571d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:47.967859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f349-0a16-4bf7-b16d-83c1cb18571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:48.002084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1ad4f349-0a16-4bf7-b16d-83c1cb18571d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:48.004639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1ad4f349-0a16-4bf7-b16d-83c1cb18571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:48.090631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:48.144684 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1329/2656] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:48.165639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e9542-9dd6-495d-804a-6bf015f9d62c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:48.168801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e25e9542-9dd6-495d-804a-6bf015f9d62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:48.256060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e9542-9dd6-495d-804a-6bf015f9d62c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:48.262470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bab50-1870-4aa9-a7a9-a368d908e8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:48.263130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bab50-1870-4aa9-a7a9-a368d908e8af service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:48.264208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bab50-1870-4aa9-a7a9-a368d908e8af service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:48.264646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bab50-1870-4aa9-a7a9-a368d908e8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:48.275630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bab50-1870-4aa9-a7a9-a368d908e8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:48.277377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bab50-1870-4aa9-a7a9-a368d908e8af service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:48.288822 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1328/2657] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:51.631145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbb751-b6f4-4478-a629-4bd5fcb58b6d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:51.631687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbb751-b6f4-4478-a629-4bd5fcb58b6d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:51.631942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbb751-b6f4-4478-a629-4bd5fcb58b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:51.658110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-59bbb751-b6f4-4478-a629-4bd5fcb58b6d None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:51.659689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-59bbb751-b6f4-4478-a629-4bd5fcb58b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:51.742136 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1330/2658] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:51.850229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bab50-1870-4aa9-a7a9-a368d908e8af service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:51.851722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9d3bab50-1870-4aa9-a7a9-a368d908e8af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:52.022986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bab50-1870-4aa9-a7a9-a368d908e8af service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:52.029627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9b66b-9ee6-4722-9c26-62c7bf6505f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:52.030891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9b66b-9ee6-4722-9c26-62c7bf6505f9 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:52.032943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9b66b-9ee6-4722-9c26-62c7bf6505f9 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:52.035458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9b66b-9ee6-4722-9c26-62c7bf6505f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:52.059194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9b66b-9ee6-4722-9c26-62c7bf6505f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:52.069339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9b66b-9ee6-4722-9c26-62c7bf6505f9 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:52.091760 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1329/2659] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:28:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:28:57.500142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adac0d-d49d-4995-b594-d584cbbd6dcd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:57.500770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adac0d-d49d-4995-b594-d584cbbd6dcd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:57.500995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adac0d-d49d-4995-b594-d584cbbd6dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:57.545653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c4adac0d-d49d-4995-b594-d584cbbd6dcd None None] MFA Rules not processed for user `6350cfd37a994b469e21ecd19908c296`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:57.547188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c4adac0d-d49d-4995-b594-d584cbbd6dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:57.733815 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1331/2660] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:57.747176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7922d-884f-4b6e-a428-234aa2af2b66 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:57.748595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7922d-884f-4b6e-a428-234aa2af2b66 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:57.749186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7922d-884f-4b6e-a428-234aa2af2b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:57.774206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5bd7922d-884f-4b6e-a428-234aa2af2b66 None None] MFA Rules not processed for user `6350cfd37a994b469e21ecd19908c296`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:57.776378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5bd7922d-884f-4b6e-a428-234aa2af2b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:57.790990 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1330/2661] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:57.799285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adac0d-d49d-4995-b594-d584cbbd6dcd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:28:57.801767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c4adac0d-d49d-4995-b594-d584cbbd6dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:57.953379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adac0d-d49d-4995-b594-d584cbbd6dcd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:28:57.961117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33e540-1b91-4891-bbb8-dd74eca0c3da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:28:57.962179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33e540-1b91-4891-bbb8-dd74eca0c3da service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:57.962638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33e540-1b91-4891-bbb8-dd74eca0c3da service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:57.963655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33e540-1b91-4891-bbb8-dd74eca0c3da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:57.977604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33e540-1b91-4891-bbb8-dd74eca0c3da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:28:57.979812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33e540-1b91-4891-bbb8-dd74eca0c3da service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:28:57.995130 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1332/2662] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:28:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:28:58.140754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c5298-9c05-4421-a139-514b559e14d0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:58.141032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c5298-9c05-4421-a139-514b559e14d0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:58.141300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c5298-9c05-4421-a139-514b559e14d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:58.163374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fb7c5298-9c05-4421-a139-514b559e14d0 None None] MFA Rules not processed for user `e7e71fcf6711470db5a71ddc74ff709c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:58.164869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fb7c5298-9c05-4421-a139-514b559e14d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:58.299651 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1331/2663] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:28:59.451766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff2570-ecfe-4e2f-a672-b445781fc7a3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:28:59.452830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff2570-ecfe-4e2f-a672-b445781fc7a3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:28:59.454413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff2570-ecfe-4e2f-a672-b445781fc7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:28:59.517813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:59.579632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-80ff2570-ecfe-4e2f-a672-b445781fc7a3 None None] MFA Rules not processed for user `7bd967d46f614bb4a187218498e934f3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:28:59.585159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-80ff2570-ecfe-4e2f-a672-b445781fc7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:28:59.798079 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1333/2664] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:06.005382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86862d1-eb25-4a81-94be-7b99c8505895 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:06.006059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86862d1-eb25-4a81-94be-7b99c8505895 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:06.006059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86862d1-eb25-4a81-94be-7b99c8505895 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:06.007826 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1332/2665] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:29:06.017537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc333e-4499-4ad8-b75e-b21252afbabe None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:06.019107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc333e-4499-4ad8-b75e-b21252afbabe None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:06.020126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc333e-4499-4ad8-b75e-b21252afbabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:06.093290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e5cc333e-4499-4ad8-b75e-b21252afbabe None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:06.095013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e5cc333e-4499-4ad8-b75e-b21252afbabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:06.152313 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1334/2666] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:06.227862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86862d1-eb25-4a81-94be-7b99c8505895 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:06.230510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c86862d1-eb25-4a81-94be-7b99c8505895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:06.276642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86862d1-eb25-4a81-94be-7b99c8505895 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:06.283397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d4b20-cf4e-44c4-9334-5a5a01f8ab07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:06.284294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d4b20-cf4e-44c4-9334-5a5a01f8ab07 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:06.284735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d4b20-cf4e-44c4-9334-5a5a01f8ab07 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:06.285173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d4b20-cf4e-44c4-9334-5a5a01f8ab07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:06.309833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d4b20-cf4e-44c4-9334-5a5a01f8ab07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:06.311696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d4b20-cf4e-44c4-9334-5a5a01f8ab07 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:06.337555 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1333/2667] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:06.386892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8792-89cc-4678-9def-488c36f5eb45 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:06.387376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8792-89cc-4678-9def-488c36f5eb45 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:06.387867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c8792-89cc-4678-9def-488c36f5eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:06.427922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f40c8792-89cc-4678-9def-488c36f5eb45 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:06.429492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f40c8792-89cc-4678-9def-488c36f5eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:06.446951 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1335/2668] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:06.472564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d4b20-cf4e-44c4-9334-5a5a01f8ab07 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:06.513534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d4b20-cf4e-44c4-9334-5a5a01f8ab07 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:06.546411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fedba-3f94-4912-b138-bef0d288141d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:06.547805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fedba-3f94-4912-b138-bef0d288141d service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:06.548328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fedba-3f94-4912-b138-bef0d288141d service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:06.548817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fedba-3f94-4912-b138-bef0d288141d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:06.579646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fedba-3f94-4912-b138-bef0d288141d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:06.581520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fedba-3f94-4912-b138-bef0d288141d service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:06.599869 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1334/2669] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:13.148395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12783d0d-ef40-4e23-ba1e-0c7ef7d0a8f3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:13.149079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12783d0d-ef40-4e23-ba1e-0c7ef7d0a8f3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:13.149079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12783d0d-ef40-4e23-ba1e-0c7ef7d0a8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:13.170410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-12783d0d-ef40-4e23-ba1e-0c7ef7d0a8f3 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:13.171792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-12783d0d-ef40-4e23-ba1e-0c7ef7d0a8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:13.180701 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1336/2670] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:29:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:13.197214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fedba-3f94-4912-b138-bef0d288141d service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:13.209127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:13.221455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fedba-3f94-4912-b138-bef0d288141d service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:13.230054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144fba8-5086-4de8-9cc1-3ac936c5eb9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:13.231120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fba8-5086-4de8-9cc1-3ac936c5eb9f service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:13.231671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fba8-5086-4de8-9cc1-3ac936c5eb9f service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:13.232216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fba8-5086-4de8-9cc1-3ac936c5eb9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:13.248541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144fba8-5086-4de8-9cc1-3ac936c5eb9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:13.250276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144fba8-5086-4de8-9cc1-3ac936c5eb9f service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:13.259706 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1335/2671] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:29:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:19.511324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71814-cf19-4392-b3ba-92b5ee29adae None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:19.512349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71814-cf19-4392-b3ba-92b5ee29adae None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:19.513436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71814-cf19-4392-b3ba-92b5ee29adae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:19.516298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac9ee1-7fc8-4053-8171-d5fb76f90af9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:19.517253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac9ee1-7fc8-4053-8171-d5fb76f90af9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:19.517569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac9ee1-7fc8-4053-8171-d5fb76f90af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:19.544447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-11b71814-cf19-4392-b3ba-92b5ee29adae None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:19.545910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-11b71814-cf19-4392-b3ba-92b5ee29adae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:19.570421 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1337/2672] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:29:19.571984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b71814-cf19-4392-b3ba-92b5ee29adae None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:19.606004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b71814-cf19-4392-b3ba-92b5ee29adae None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:19.606485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c6ac9ee1-7fc8-4053-8171-d5fb76f90af9 None None] MFA Rules not processed for user `1869270af6874c4db42112d4aa9417a6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:19.609521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c6ac9ee1-7fc8-4053-8171-d5fb76f90af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:19.612828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5cfc0-66d7-452d-a56a-9b804dd6c90e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:19.613757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5cfc0-66d7-452d-a56a-9b804dd6c90e service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:19.614209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5cfc0-66d7-452d-a56a-9b804dd6c90e service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:19.614646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5cfc0-66d7-452d-a56a-9b804dd6c90e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:19.627206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5cfc0-66d7-452d-a56a-9b804dd6c90e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:19.629707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5cfc0-66d7-452d-a56a-9b804dd6c90e service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:19.641751 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1338/2673] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:29:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:29:19.794239 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1336/2674] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:29:20.353174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d4805-c024-408e-8e4f-7dfb7b9887c5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:20.353910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d4805-c024-408e-8e4f-7dfb7b9887c5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:20.355862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d4805-c024-408e-8e4f-7dfb7b9887c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:20.429249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d28d4805-c024-408e-8e4f-7dfb7b9887c5 None None] MFA Rules not processed for user `199c2a20a7e8425e8df281cfe251c880`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:20.441335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d28d4805-c024-408e-8e4f-7dfb7b9887c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:20.678639 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1339/2675] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:29:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:29.735222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=30 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:30.643534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=67 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:36.734924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cb9bb-ac85-41f1-b206-77f6fd61b132 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:36.735837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cb9bb-ac85-41f1-b206-77f6fd61b132 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:36.736290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cb9bb-ac85-41f1-b206-77f6fd61b132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:36.791208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2d2cb9bb-ac85-41f1-b206-77f6fd61b132 None None] MFA Rules not processed for user `f331c1e3ee1442ad863d8909ca76020b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:36.794948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2d2cb9bb-ac85-41f1-b206-77f6fd61b132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:37.043496 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1337/2676] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:29:46.205341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d4805-c024-408e-8e4f-7dfb7b9887c5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:46.277038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d4805-c024-408e-8e4f-7dfb7b9887c5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:46.290127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:46.290796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:46.291140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:46.291360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] PATH_INFO: `/v3/users/6350cfd37a994b469e21ecd19908c296` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:46.296713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6350cfd37a994b469e21ecd19908c296)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:46.300587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:46.773142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6350cfd37a994b469e21ecd19908c296'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:46.774152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6350cfd37a994b469e21ecd19908c296'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:46.798378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6350cfd37a994b469e21ecd19908c296'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:46.832364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6350cfd37a994b469e21ecd19908c296'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:46.844353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6350cfd37a994b469e21ecd19908c296'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:46.855469 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1340/2677] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:29:46 2022] DELETE /identity/v3/users/6350cfd37a994b469e21ecd19908c296 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:29:47.015647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=25 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:47.248608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e6bc2-5bb0-461b-bdd0-d34260c02a42 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:47.249234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e6bc2-5bb0-461b-bdd0-d34260c02a42 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:47.249612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e6bc2-5bb0-461b-bdd0-d34260c02a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:47.275032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e49e6bc2-5bb0-461b-bdd0-d34260c02a42 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:47.276417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e49e6bc2-5bb0-461b-bdd0-d34260c02a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:47.358807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:47.360936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:47.428133 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1338/2678] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:29:47.444771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e6bc2-5bb0-461b-bdd0-d34260c02a42 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:47.449238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e49e6bc2-5bb0-461b-bdd0-d34260c02a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:47.588205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f495c6-218d-434f-a7ec-7226845cd92e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:47.594630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:47.595616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:47.596060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:47.596498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] PATH_INFO: `/v3/projects/905e27cb0f35425d90acb91886ca47e7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:47.597918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=905e27cb0f35425d90acb91886ca47e7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:47.600004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:47.653304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e6bc2-5bb0-461b-bdd0-d34260c02a42 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:47.700799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905e27cb0f35425d90acb91886ca47e7', 'request_id': 'req-8962c590-38fd-4aa7-9cf5-55a23866fabc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:47.717884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905e27cb0f35425d90acb91886ca47e7', 'request_id': 'req-8962c590-38fd-4aa7-9cf5-55a23866fabc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:47.729195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905e27cb0f35425d90acb91886ca47e7', 'request_id': 'req-8962c590-38fd-4aa7-9cf5-55a23866fabc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:47.746028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] The token cache is being invalidate because project 905e27cb0f35425d90acb91886ca47e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:29:47.746885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:47.747976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8962c590-38fd-4aa7-9cf5-55a23866fabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:47.750238 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1341/2679] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:47 2022] DELETE /identity/v3/projects/905e27cb0f35425d90acb91886ca47e7 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:29:47.756313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc703-a70b-48de-aa6e-bb7dcaf5f375 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:47.757145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc703-a70b-48de-aa6e-bb7dcaf5f375 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:47.757852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc703-a70b-48de-aa6e-bb7dcaf5f375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:47.773661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:47.863660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fe6cc703-a70b-48de-aa6e-bb7dcaf5f375 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:47.871189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fe6cc703-a70b-48de-aa6e-bb7dcaf5f375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:47.898883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b71fa-d28e-4bd1-8914-77b8e36f6bb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:47.901794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b71fa-d28e-4bd1-8914-77b8e36f6bb2 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:47.902181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b71fa-d28e-4bd1-8914-77b8e36f6bb2 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:47.902501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b71fa-d28e-4bd1-8914-77b8e36f6bb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:47.906628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-628b71fa-d28e-4bd1-8914-77b8e36f6bb2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:47.983376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:47.997779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b71fa-d28e-4bd1-8914-77b8e36f6bb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:48.000076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b71fa-d28e-4bd1-8914-77b8e36f6bb2 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:48.013764 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1339/2680] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:29:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:48.044416 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1342/2681] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:48.127198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb581d5c-b8d7-42db-9928-b865d70b0da2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:48.127730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb581d5c-b8d7-42db-9928-b865d70b0da2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:48.127730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb581d5c-b8d7-42db-9928-b865d70b0da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:48.151781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bb581d5c-b8d7-42db-9928-b865d70b0da2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:48.153564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bb581d5c-b8d7-42db-9928-b865d70b0da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:48.164381 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1340/2682] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:29:48.169175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cc703-a70b-48de-aa6e-bb7dcaf5f375 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:48.180923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cc703-a70b-48de-aa6e-bb7dcaf5f375 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:48.186054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d2324-a7d4-4ae9-9b6b-e6f1ffb889b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:48.189455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d2324-a7d4-4ae9-9b6b-e6f1ffb889b0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:48.189455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d2324-a7d4-4ae9-9b6b-e6f1ffb889b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:48.189455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d2324-a7d4-4ae9-9b6b-e6f1ffb889b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:48.189455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d2324-a7d4-4ae9-9b6b-e6f1ffb889b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:29:48.189455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d2324-a7d4-4ae9-9b6b-e6f1ffb889b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:48.192006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d2324-a7d4-4ae9-9b6b-e6f1ffb889b0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:48.213988 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1343/2683] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:29:48.218701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb581d5c-b8d7-42db-9928-b865d70b0da2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:48.242737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb581d5c-b8d7-42db-9928-b865d70b0da2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:48.248495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6c717-65fd-4a28-ade2-1c6dbd350c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:48.249043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6c717-65fd-4a28-ade2-1c6dbd350c62 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:48.249330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6c717-65fd-4a28-ade2-1c6dbd350c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:48.249648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6c717-65fd-4a28-ade2-1c6dbd350c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:48.250822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6c717-65fd-4a28-ade2-1c6dbd350c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:48.253889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6c717-65fd-4a28-ade2-1c6dbd350c62 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:48.338381 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1341/2684] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:29:48 2022] POST /identity/v3/projects => generated 397 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:29:48.345263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d2324-a7d4-4ae9-9b6b-e6f1ffb889b0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:48.383920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d2324-a7d4-4ae9-9b6b-e6f1ffb889b0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:48.551540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594db3a-2208-487e-944f-02a534b6d80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:48.552348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594db3a-2208-487e-944f-02a534b6d80f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:48.552980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594db3a-2208-487e-944f-02a534b6d80f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:48.554174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594db3a-2208-487e-944f-02a534b6d80f admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:48.555696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594db3a-2208-487e-944f-02a534b6d80f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:48.562911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594db3a-2208-487e-944f-02a534b6d80f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:48.619408 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1344/2685] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:29:48 2022] POST /identity/v3/users => generated 299 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:29:48.625069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6c717-65fd-4a28-ade2-1c6dbd350c62 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:48.638549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6c717-65fd-4a28-ade2-1c6dbd350c62 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:48.644507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41367db2-c402-4c2e-a921-177af1a976d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:48.646137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41367db2-c402-4c2e-a921-177af1a976d8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:48.646454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41367db2-c402-4c2e-a921-177af1a976d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:48.646736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41367db2-c402-4c2e-a921-177af1a976d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:48.647581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41367db2-c402-4c2e-a921-177af1a976d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:48.649800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41367db2-c402-4c2e-a921-177af1a976d8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:48.663164 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1342/2686] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:29:48.667935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594db3a-2208-487e-944f-02a534b6d80f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:48.682121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594db3a-2208-487e-944f-02a534b6d80f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:48.697562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbce2f-6dca-48be-b273-3d59707a6cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:48.698401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbce2f-6dca-48be-b273-3d59707a6cfd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:48.698401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbce2f-6dca-48be-b273-3d59707a6cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:48.698609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbce2f-6dca-48be-b273-3d59707a6cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:48.699151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbce2f-6dca-48be-b273-3d59707a6cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:48.701270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbce2f-6dca-48be-b273-3d59707a6cfd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:48.736207 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1345/2687] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:29:48.737430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41367db2-c402-4c2e-a921-177af1a976d8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:48.753855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41367db2-c402-4c2e-a921-177af1a976d8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:48.767241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd955a7-d149-46e1-a8b3-df9c01e6dcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:48.768292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd955a7-d149-46e1-a8b3-df9c01e6dcf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:48.769034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd955a7-d149-46e1-a8b3-df9c01e6dcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:48.769604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd955a7-d149-46e1-a8b3-df9c01e6dcf0 admin admin] PATH_INFO: `/v3/projects/42f9ff69e07f4f32bb1a6aa14a937d86/users/c886c6bd7a0544b499c77b714c6065f7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:48.798707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd955a7-d149-46e1-a8b3-df9c01e6dcf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f9ff69e07f4f32bb1a6aa14a937d86, user_id=c886c6bd7a0544b499c77b714c6065f7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:48.802126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd955a7-d149-46e1-a8b3-df9c01e6dcf0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:48.820871 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1343/2688] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:29:48 2022] PUT /identity/v3/projects/42f9ff69e07f4f32bb1a6aa14a937d86/users/c886c6bd7a0544b499c77b714c6065f7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:29:48.826803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ddfd3-cd4a-4aef-a638-4690dd3b9d45 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:48.827145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ddfd3-cd4a-4aef-a638-4690dd3b9d45 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:48.827356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ddfd3-cd4a-4aef-a638-4690dd3b9d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:48.850791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d26ddfd3-cd4a-4aef-a638-4690dd3b9d45 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:48.852035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d26ddfd3-cd4a-4aef-a638-4690dd3b9d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:48.999710 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1346/2689] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:49.048079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd955a7-d149-46e1-a8b3-df9c01e6dcf0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:49.049984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ddd955a7-d149-46e1-a8b3-df9c01e6dcf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:49.166831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd955a7-d149-46e1-a8b3-df9c01e6dcf0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:49.171244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3064e-a1d5-4ef0-9ee6-16017ece79c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:49.171884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3064e-a1d5-4ef0-9ee6-16017ece79c0 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:49.172903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3064e-a1d5-4ef0-9ee6-16017ece79c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:49.172903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3064e-a1d5-4ef0-9ee6-16017ece79c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:49.184545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3064e-a1d5-4ef0-9ee6-16017ece79c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:49.186077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3064e-a1d5-4ef0-9ee6-16017ece79c0 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:49.197434 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1344/2690] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:29:53.368090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ddfd3-cd4a-4aef-a638-4690dd3b9d45 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:53.370417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d26ddfd3-cd4a-4aef-a638-4690dd3b9d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:53.397139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ddfd3-cd4a-4aef-a638-4690dd3b9d45 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:53.404649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:53.405947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:53.406389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:53.406810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] PATH_INFO: `/v3/users/7bd967d46f614bb4a187218498e934f3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:53.409090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd967d46f614bb4a187218498e934f3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:53.413109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:53.431986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:53.517362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd967d46f614bb4a187218498e934f3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:53.518108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd967d46f614bb4a187218498e934f3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:53.533574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd967d46f614bb4a187218498e934f3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:53.550095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd967d46f614bb4a187218498e934f3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:53.559605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd967d46f614bb4a187218498e934f3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:53.575132 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1347/2691] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:29:53 2022] DELETE /identity/v3/users/7bd967d46f614bb4a187218498e934f3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:29:54.328255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3064e-a1d5-4ef0-9ee6-16017ece79c0 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:54.358503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3064e-a1d5-4ef0-9ee6-16017ece79c0 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:54.391474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:54.394128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:54.561792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89f4fb-209a-4e45-aec2-00f1ea3d02b2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:54.579028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e71a-9b51-439c-8e6e-9c2a7dc0af0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:54.580077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e71a-9b51-439c-8e6e-9c2a7dc0af0c service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:54.580571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e71a-9b51-439c-8e6e-9c2a7dc0af0c service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:54.581078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e71a-9b51-439c-8e6e-9c2a7dc0af0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:54.584861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5f41e71a-9b51-439c-8e6e-9c2a7dc0af0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:54.617669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:54.618103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:54.618372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:54.618651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] PATH_INFO: `/v3/projects/7ef825b35f554cbb81bc25e06e2b5681` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:54.622227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef825b35f554cbb81bc25e06e2b5681)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:54.624218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:54.731030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:54.754334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41e71a-9b51-439c-8e6e-9c2a7dc0af0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:54.759283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41e71a-9b51-439c-8e6e-9c2a7dc0af0c service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:54.772343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef825b35f554cbb81bc25e06e2b5681', 'request_id': 'req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:54.785431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef825b35f554cbb81bc25e06e2b5681', 'request_id': 'req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:54.812281 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1348/2692] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:54.812897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef825b35f554cbb81bc25e06e2b5681', 'request_id': 'req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:54.850849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] The token cache is being invalidate because project 7ef825b35f554cbb81bc25e06e2b5681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:29:54.851512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:54.854792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-61d33ba6-fdcb-4e03-a2f8-008e7a185b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:54.859568 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1345/2693] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:54 2022] DELETE /identity/v3/projects/7ef825b35f554cbb81bc25e06e2b5681 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:29:54.864430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b6806-0c27-4086-a78b-1cc164716e02 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:54.865554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b6806-0c27-4086-a78b-1cc164716e02 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:54.866045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b6806-0c27-4086-a78b-1cc164716e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:54.940841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ec7b6806-0c27-4086-a78b-1cc164716e02 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:54.944055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ec7b6806-0c27-4086-a78b-1cc164716e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:54.972777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:55.181010 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1349/2694] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:55.183449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5917e-05d7-49d8-adc3-28c75395a0c3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:55.183763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5917e-05d7-49d8-adc3-28c75395a0c3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:55.184104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5917e-05d7-49d8-adc3-28c75395a0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:55.261230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-edb5917e-05d7-49d8-adc3-28c75395a0c3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:55.264227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-edb5917e-05d7-49d8-adc3-28c75395a0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:55.287419 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1346/2695] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:55.291948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b6806-0c27-4086-a78b-1cc164716e02 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:55.315859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b6806-0c27-4086-a78b-1cc164716e02 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:55.331214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be540ce8-1a08-4858-b968-6b813c939d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:55.331857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be540ce8-1a08-4858-b968-6b813c939d21 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:55.332137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be540ce8-1a08-4858-b968-6b813c939d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:55.332415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be540ce8-1a08-4858-b968-6b813c939d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:55.333116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be540ce8-1a08-4858-b968-6b813c939d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:29:55.333490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be540ce8-1a08-4858-b968-6b813c939d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:55.338217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be540ce8-1a08-4858-b968-6b813c939d21 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:55.367810 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1350/2696] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:29:55.372873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5917e-05d7-49d8-adc3-28c75395a0c3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:55.388501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5917e-05d7-49d8-adc3-28c75395a0c3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:55.412570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e89c3-69e6-4629-8331-bbf48256742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:55.415546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e89c3-69e6-4629-8331-bbf48256742a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:55.416638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e89c3-69e6-4629-8331-bbf48256742a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:55.416831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e89c3-69e6-4629-8331-bbf48256742a admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:55.421199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e89c3-69e6-4629-8331-bbf48256742a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:55.426972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e89c3-69e6-4629-8331-bbf48256742a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:55.569139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be540ce8-1a08-4858-b968-6b813c939d21 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:55.570415 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1347/2697] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:29:55 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:29:55.591890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be540ce8-1a08-4858-b968-6b813c939d21 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:55.757512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d8b06-2a0c-4321-87b9-2c17456b72aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:55.758327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d8b06-2a0c-4321-87b9-2c17456b72aa admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:55.758833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d8b06-2a0c-4321-87b9-2c17456b72aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:55.759008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d8b06-2a0c-4321-87b9-2c17456b72aa admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:55.759824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d8b06-2a0c-4321-87b9-2c17456b72aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:55.769536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d8b06-2a0c-4321-87b9-2c17456b72aa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:55.827347 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1351/2698] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:29:55 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:29:55.831598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e89c3-69e6-4629-8331-bbf48256742a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:55.856622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e89c3-69e6-4629-8331-bbf48256742a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:55.862169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ad6f7-7938-48fa-a51f-7ed158600d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:55.862954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ad6f7-7938-48fa-a51f-7ed158600d9f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:55.863675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ad6f7-7938-48fa-a51f-7ed158600d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:55.863965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ad6f7-7938-48fa-a51f-7ed158600d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:55.864640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ad6f7-7938-48fa-a51f-7ed158600d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:55.866338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ad6f7-7938-48fa-a51f-7ed158600d9f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:55.901753 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1348/2699] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:29:55.901957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d8b06-2a0c-4321-87b9-2c17456b72aa admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:55.916890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d8b06-2a0c-4321-87b9-2c17456b72aa admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:55.935523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d283c83-3bd7-4a8d-a9ab-26234893de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:55.941284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283c83-3bd7-4a8d-a9ab-26234893de0c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:55.941792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283c83-3bd7-4a8d-a9ab-26234893de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:55.943272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283c83-3bd7-4a8d-a9ab-26234893de0c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:55.945749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d283c83-3bd7-4a8d-a9ab-26234893de0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:55.951255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d283c83-3bd7-4a8d-a9ab-26234893de0c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:55.979820 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1352/2700] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:29:55.981733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ad6f7-7938-48fa-a51f-7ed158600d9f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:55.998174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ad6f7-7938-48fa-a51f-7ed158600d9f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:56.009926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd99b-07fc-4971-8656-fe72bf2e45db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:56.014099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd99b-07fc-4971-8656-fe72bf2e45db admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:56.018306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd99b-07fc-4971-8656-fe72bf2e45db admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:56.018915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd99b-07fc-4971-8656-fe72bf2e45db admin admin] PATH_INFO: `/v3/projects/18cc1aaed2584885939c5e7351aeb657/users/486709a8644a40dea3786a139896fb57/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:56.075482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bd99b-07fc-4971-8656-fe72bf2e45db admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cc1aaed2584885939c5e7351aeb657, user_id=486709a8644a40dea3786a139896fb57, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:56.088879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bd99b-07fc-4971-8656-fe72bf2e45db admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:56.132180 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1349/2701] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:29:55 2022] PUT /identity/v3/projects/18cc1aaed2584885939c5e7351aeb657/users/486709a8644a40dea3786a139896fb57/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:29:56.158178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0deada-1743-47dc-95ff-517f643000a2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:56.159196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0deada-1743-47dc-95ff-517f643000a2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:56.160262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0deada-1743-47dc-95ff-517f643000a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:56.268671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2d0deada-1743-47dc-95ff-517f643000a2 None None] MFA Rules not processed for user `486709a8644a40dea3786a139896fb57`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:56.271030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2d0deada-1743-47dc-95ff-517f643000a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:56.505500 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1353/2702] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:29:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:56.515373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd99b-07fc-4971-8656-fe72bf2e45db admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:56.517840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-699bd99b-07fc-4971-8656-fe72bf2e45db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:56.667841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd99b-07fc-4971-8656-fe72bf2e45db admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:56.674235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e0d0f-1bf3-4d47-bf0b-c3447edc5284 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:56.674926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e0d0f-1bf3-4d47-bf0b-c3447edc5284 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:56.675203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e0d0f-1bf3-4d47-bf0b-c3447edc5284 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:56.675475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e0d0f-1bf3-4d47-bf0b-c3447edc5284 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:56.687185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e0d0f-1bf3-4d47-bf0b-c3447edc5284 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:56.688702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e0d0f-1bf3-4d47-bf0b-c3447edc5284 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:56.723625 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1350/2703] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:29:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:57.020481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2c23-4633-4125-9a92-5189290e1b0d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:57.020481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2c23-4633-4125-9a92-5189290e1b0d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:57.020481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2c23-4633-4125-9a92-5189290e1b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:57.098366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fe2e2c23-4633-4125-9a92-5189290e1b0d None None] MFA Rules not processed for user `e7e71fcf6711470db5a71ddc74ff709c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:57.099008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fe2e2c23-4633-4125-9a92-5189290e1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:57.112967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:57.314916 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1354/2704] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:58.015603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6f6f-b071-4237-9e8b-19dd8a0dfd87 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:58.016064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6f6f-b071-4237-9e8b-19dd8a0dfd87 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:58.016064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6f6f-b071-4237-9e8b-19dd8a0dfd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:58.082711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-80dc6f6f-b071-4237-9e8b-19dd8a0dfd87 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:58.087320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-80dc6f6f-b071-4237-9e8b-19dd8a0dfd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:58.253535 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1351/2705] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:29:58.290706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e2c23-4633-4125-9a92-5189290e1b0d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:58.294171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fe2e2c23-4633-4125-9a92-5189290e1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:58.691122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e2c23-4633-4125-9a92-5189290e1b0d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:58.721010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b028e5-a3ba-4910-a942-a3b9e1d2b0ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:58.722107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b028e5-a3ba-4910-a942-a3b9e1d2b0ca service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:58.722603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b028e5-a3ba-4910-a942-a3b9e1d2b0ca service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:58.723103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b028e5-a3ba-4910-a942-a3b9e1d2b0ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:58.775344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b028e5-a3ba-4910-a942-a3b9e1d2b0ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:58.784459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b028e5-a3ba-4910-a942-a3b9e1d2b0ca service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:58.814926 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1355/2706] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:29:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:29:59.391066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc6f6f-b071-4237-9e8b-19dd8a0dfd87 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:29:59.392809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-80dc6f6f-b071-4237-9e8b-19dd8a0dfd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:29:59.398948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:59.611444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc6f6f-b071-4237-9e8b-19dd8a0dfd87 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:29:59.636412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:29:59.639469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:59.639859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:59.641302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] PATH_INFO: `/v3/users/7ead06f178974869a251628cca018175` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:59.647142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ead06f178974869a251628cca018175)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:29:59.649777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:29:59.785108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ead06f178974869a251628cca018175'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:59.786373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ead06f178974869a251628cca018175'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:59.811363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ead06f178974869a251628cca018175'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:59.812196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ead06f178974869a251628cca018175'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:59.823404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ead06f178974869a251628cca018175'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:29:59.845079 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1352/2707] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:29:59 2022] DELETE /identity/v3/users/7ead06f178974869a251628cca018175 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:29:59.850819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7ae3-3c46-49ea-909d-065dff5dda68 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:29:59.851824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7ae3-3c46-49ea-909d-065dff5dda68 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:29:59.852251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7ae3-3c46-49ea-909d-065dff5dda68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:29:59.894486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-95fc7ae3-3c46-49ea-909d-065dff5dda68 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:29:59.897189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-95fc7ae3-3c46-49ea-909d-065dff5dda68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:00.077474 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1356/2708] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:00.097531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:00.100132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:00.255916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7f6d2-0f26-4f14-91bb-4b588c541be2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:00.266526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b73ea3-bb6d-446c-8aae-b0209c83b089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:00.267423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b73ea3-bb6d-446c-8aae-b0209c83b089 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:00.267952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b73ea3-bb6d-446c-8aae-b0209c83b089 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:00.268554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b73ea3-bb6d-446c-8aae-b0209c83b089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:00.286208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b73ea3-bb6d-446c-8aae-b0209c83b089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:00.288179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b73ea3-bb6d-446c-8aae-b0209c83b089 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:00.338558 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1353/2709] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:00.889684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3780895-920d-4786-9eb3-dbcef31936dc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:00.890412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3780895-920d-4786-9eb3-dbcef31936dc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:00.891127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3780895-920d-4786-9eb3-dbcef31936dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:00.976877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a3780895-920d-4786-9eb3-dbcef31936dc None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:00.979316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a3780895-920d-4786-9eb3-dbcef31936dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:01.195020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:01.249079 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1357/2710] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:01.270243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b73ea3-bb6d-446c-8aae-b0209c83b089 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:01.273274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d8b73ea3-bb6d-446c-8aae-b0209c83b089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:01.325224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:01.403885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b73ea3-bb6d-446c-8aae-b0209c83b089 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:01.415406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733aeb-5f0e-4b26-911b-49e012944231 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:01.416611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733aeb-5f0e-4b26-911b-49e012944231 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:01.417135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733aeb-5f0e-4b26-911b-49e012944231 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:01.417737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733aeb-5f0e-4b26-911b-49e012944231 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:01.444426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a733aeb-5f0e-4b26-911b-49e012944231 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:01.446811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a733aeb-5f0e-4b26-911b-49e012944231 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:01.464913 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1354/2711] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:30:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:02.029253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3780895-920d-4786-9eb3-dbcef31936dc None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:02.038610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a3780895-920d-4786-9eb3-dbcef31936dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:02.076913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3780895-920d-4786-9eb3-dbcef31936dc None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:02.100647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:02.101614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:02.102080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:02.102528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] PATH_INFO: `/v3/projects/03575bcf80404b0994fc8d967804b6df` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:02.107402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03575bcf80404b0994fc8d967804b6df)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:02.109948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:02.248653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03575bcf80404b0994fc8d967804b6df', 'request_id': 'req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:02.268306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03575bcf80404b0994fc8d967804b6df', 'request_id': 'req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:02.290010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03575bcf80404b0994fc8d967804b6df', 'request_id': 'req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:02.332548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] The token cache is being invalidate because project 03575bcf80404b0994fc8d967804b6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:30:02.342564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:02.354058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff549e4d-d4ff-4185-a06f-75f0a48c1bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:02.357101 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1358/2712] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:02 2022] DELETE /identity/v3/projects/03575bcf80404b0994fc8d967804b6df => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:30:02.362804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f48b7-f820-4a80-b346-ad35c77e97a0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:02.363702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f48b7-f820-4a80-b346-ad35c77e97a0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:02.364171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f48b7-f820-4a80-b346-ad35c77e97a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:02.406066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-db6f48b7-f820-4a80-b346-ad35c77e97a0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:02.407692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-db6f48b7-f820-4a80-b346-ad35c77e97a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:02.564585 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1355/2713] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:02.565933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10eb1a-fb35-4b09-80ca-a0efc8ee127b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:02.566217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10eb1a-fb35-4b09-80ca-a0efc8ee127b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:02.566496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10eb1a-fb35-4b09-80ca-a0efc8ee127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:02.636789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ae10eb1a-fb35-4b09-80ca-a0efc8ee127b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:02.638133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ae10eb1a-fb35-4b09-80ca-a0efc8ee127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:02.661046 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1359/2714] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:30:02.665889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f48b7-f820-4a80-b346-ad35c77e97a0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:02.677498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f48b7-f820-4a80-b346-ad35c77e97a0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:02.702981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977b714-6c0c-411b-98b3-ed04f115890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:02.703848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977b714-6c0c-411b-98b3-ed04f115890d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:02.704295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977b714-6c0c-411b-98b3-ed04f115890d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:02.704746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977b714-6c0c-411b-98b3-ed04f115890d admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:02.709325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977b714-6c0c-411b-98b3-ed04f115890d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:30:02.710230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977b714-6c0c-411b-98b3-ed04f115890d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:02.712172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977b714-6c0c-411b-98b3-ed04f115890d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:02.745077 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1356/2715] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:30:02.746972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10eb1a-fb35-4b09-80ca-a0efc8ee127b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:02.763843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10eb1a-fb35-4b09-80ca-a0efc8ee127b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:02.776943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee004385-c666-480d-b68b-fc30d2966459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:02.777534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004385-c666-480d-b68b-fc30d2966459 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:02.777855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004385-c666-480d-b68b-fc30d2966459 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:02.778089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004385-c666-480d-b68b-fc30d2966459 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:02.778750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee004385-c666-480d-b68b-fc30d2966459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:02.781748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee004385-c666-480d-b68b-fc30d2966459 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:02.852347 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1360/2716] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:30:02 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:30:02.857545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977b714-6c0c-411b-98b3-ed04f115890d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:02.878019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977b714-6c0c-411b-98b3-ed04f115890d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:03.241913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b89c68-e280-4880-bdf6-0f38062a4246 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:03.242467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b89c68-e280-4880-bdf6-0f38062a4246 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:03.242886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b89c68-e280-4880-bdf6-0f38062a4246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:03.301667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e6b89c68-e280-4880-bdf6-0f38062a4246 None None] MFA Rules not processed for user `c886c6bd7a0544b499c77b714c6065f7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:03.303785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e6b89c68-e280-4880-bdf6-0f38062a4246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:03.318781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe7f55-1760-4235-b9b7-89ef15e21ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:03.319409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe7f55-1760-4235-b9b7-89ef15e21ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:03.319683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe7f55-1760-4235-b9b7-89ef15e21ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:03.319959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe7f55-1760-4235-b9b7-89ef15e21ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:03.320604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe7f55-1760-4235-b9b7-89ef15e21ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:03.322620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe7f55-1760-4235-b9b7-89ef15e21ff0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:03.377896 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1357/2717] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:30:02 2022] POST /identity/v3/users => generated 287 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:30:03.381286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe7f55-1760-4235-b9b7-89ef15e21ff0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:03.405172 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1361/2718] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:30:03.405372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe7f55-1760-4235-b9b7-89ef15e21ff0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:03.419190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925972f-2679-40d9-96b6-3068c0b1e1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:03.419821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925972f-2679-40d9-96b6-3068c0b1e1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:03.420100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925972f-2679-40d9-96b6-3068c0b1e1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:03.420371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925972f-2679-40d9-96b6-3068c0b1e1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:03.421038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925972f-2679-40d9-96b6-3068c0b1e1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:03.422914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925972f-2679-40d9-96b6-3068c0b1e1d8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:03.423563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501027b8-01dc-476b-8da1-170aa7e3d8d4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:03.424008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501027b8-01dc-476b-8da1-170aa7e3d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:03.424387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501027b8-01dc-476b-8da1-170aa7e3d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:03.454037 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1358/2719] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:30:03.459243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925972f-2679-40d9-96b6-3068c0b1e1d8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:03.467995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-501027b8-01dc-476b-8da1-170aa7e3d8d4 None None] MFA Rules not processed for user `c886c6bd7a0544b499c77b714c6065f7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:03.470693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-501027b8-01dc-476b-8da1-170aa7e3d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:03.473986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925972f-2679-40d9-96b6-3068c0b1e1d8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:03.487548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51131532-486d-48e5-9b80-48a28b99264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:03.488182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51131532-486d-48e5-9b80-48a28b99264c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:03.488459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51131532-486d-48e5-9b80-48a28b99264c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:03.488726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51131532-486d-48e5-9b80-48a28b99264c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:03.489424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51131532-486d-48e5-9b80-48a28b99264c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:03.491394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51131532-486d-48e5-9b80-48a28b99264c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:03.493975 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1362/2720] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:03.502534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501027b8-01dc-476b-8da1-170aa7e3d8d4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:03.506558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-501027b8-01dc-476b-8da1-170aa7e3d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:03.518750 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1359/2721] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:30:03.519971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51131532-486d-48e5-9b80-48a28b99264c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:03.542476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51131532-486d-48e5-9b80-48a28b99264c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:03.560680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6b9df-833f-4f5d-8da8-58c752f888fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:03.561346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6b9df-833f-4f5d-8da8-58c752f888fc admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:03.561666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6b9df-833f-4f5d-8da8-58c752f888fc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:03.561949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6b9df-833f-4f5d-8da8-58c752f888fc admin admin] PATH_INFO: `/v3/projects/94b2cbec5b884fde96ef9f659a081246/users/2b050f7108464408b2d33a46d9c90235/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:03.567180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:03.583228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:03.592481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6b9df-833f-4f5d-8da8-58c752f888fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b2cbec5b884fde96ef9f659a081246, user_id=2b050f7108464408b2d33a46d9c90235, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:03.595570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6b9df-833f-4f5d-8da8-58c752f888fc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:03.625468 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1360/2722] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:30:03 2022] PUT /identity/v3/projects/94b2cbec5b884fde96ef9f659a081246/users/2b050f7108464408b2d33a46d9c90235/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:30:03.625468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf21a-9cbf-430a-a2fc-bf647b693512 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:03.625468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf21a-9cbf-430a-a2fc-bf647b693512 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:03.625468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf21a-9cbf-430a-a2fc-bf647b693512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:03.670730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b18cf21a-9cbf-430a-a2fc-bf647b693512 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:03.672774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b18cf21a-9cbf-430a-a2fc-bf647b693512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:03.731904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501027b8-01dc-476b-8da1-170aa7e3d8d4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:03.811942 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1361/2723] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:03.814845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee394b-1993-4814-8961-d547e780eccf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:03.815119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee394b-1993-4814-8961-d547e780eccf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:03.815369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee394b-1993-4814-8961-d547e780eccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:03.902001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6a2e1-fce1-405d-b597-2f649d145275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:03.902860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6a2e1-fce1-405d-b597-2f649d145275 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:03.903210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6a2e1-fce1-405d-b597-2f649d145275 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:03.903579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6a2e1-fce1-405d-b597-2f649d145275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:03.912557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f0ee394b-1993-4814-8961-d547e780eccf None None] MFA Rules not processed for user `2b050f7108464408b2d33a46d9c90235`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:03.914792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f0ee394b-1993-4814-8961-d547e780eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:04.010193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6a2e1-fce1-405d-b597-2f649d145275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:04.013645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6a2e1-fce1-405d-b597-2f649d145275 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:04.062142 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1363/2724] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:03 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:04.070490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6a2e1-fce1-405d-b597-2f649d145275 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:04.084618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-acf6a2e1-fce1-405d-b597-2f649d145275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:04.147537 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1362/2725] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:04.164763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee394b-1993-4814-8961-d547e780eccf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:04.167909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f0ee394b-1993-4814-8961-d547e780eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:04.198152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee394b-1993-4814-8961-d547e780eccf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:04.205161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819416a8-5820-46c9-8084-f7766f470a4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:04.205851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819416a8-5820-46c9-8084-f7766f470a4c service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:04.206130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819416a8-5820-46c9-8084-f7766f470a4c service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:04.206455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819416a8-5820-46c9-8084-f7766f470a4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:04.221811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819416a8-5820-46c9-8084-f7766f470a4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:04.222506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819416a8-5820-46c9-8084-f7766f470a4c service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:04.248850 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1363/2726] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:04.301600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:04.307767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6a2e1-fce1-405d-b597-2f649d145275 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:04.314685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecfa05-241f-46e0-8998-349536902747 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:04.315326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecfa05-241f-46e0-8998-349536902747 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:04.315605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecfa05-241f-46e0-8998-349536902747 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:04.315875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecfa05-241f-46e0-8998-349536902747 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:04.344970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecfa05-241f-46e0-8998-349536902747 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:04.354999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecfa05-241f-46e0-8998-349536902747 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:04.399006 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1364/2727] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:30:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:05.897229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819416a8-5820-46c9-8084-f7766f470a4c service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:06.077047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83b7c9-9483-4fbd-ab0d-77fd0d3c351a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:06.077848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83b7c9-9483-4fbd-ab0d-77fd0d3c351a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:06.078335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83b7c9-9483-4fbd-ab0d-77fd0d3c351a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:06.172376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8a83b7c9-9483-4fbd-ab0d-77fd0d3c351a None None] MFA Rules not processed for user `486709a8644a40dea3786a139896fb57`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:06.179356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8a83b7c9-9483-4fbd-ab0d-77fd0d3c351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:06.191895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819416a8-5820-46c9-8084-f7766f470a4c service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:06.212872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:06.214614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:06.215448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:06.221797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] PATH_INFO: `/v3/users/2b050f7108464408b2d33a46d9c90235` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:06.225950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b050f7108464408b2d33a46d9c90235)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:06.231772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:06.264223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:06.469123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b050f7108464408b2d33a46d9c90235'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:06.471595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b050f7108464408b2d33a46d9c90235'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:06.483925 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1365/2728] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:06.561572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b050f7108464408b2d33a46d9c90235'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:06.563109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b050f7108464408b2d33a46d9c90235'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:06.606774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b050f7108464408b2d33a46d9c90235'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:06.734231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a22e7d-4b55-43d2-b6bd-944daae988b8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:06.734722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a22e7d-4b55-43d2-b6bd-944daae988b8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:06.735204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a22e7d-4b55-43d2-b6bd-944daae988b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:06.742163 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1364/2729] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:30:05 2022] DELETE /identity/v3/users/2b050f7108464408b2d33a46d9c90235 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:30:06.859959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-69a22e7d-4b55-43d2-b6bd-944daae988b8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:06.869631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-69a22e7d-4b55-43d2-b6bd-944daae988b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:07.205698 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1366/2730] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:07.219309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:07.221932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:07.479215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d329df-72f2-4739-bf7b-6aad231f1286 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:07.493027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4cd3-ec64-4f46-a21e-e1726b348ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:07.493815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4cd3-ec64-4f46-a21e-e1726b348ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:07.494211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4cd3-ec64-4f46-a21e-e1726b348ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:07.494597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4cd3-ec64-4f46-a21e-e1726b348ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:07.548573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea4cd3-ec64-4f46-a21e-e1726b348ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:07.550568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea4cd3-ec64-4f46-a21e-e1726b348ce9 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:07.572759 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1365/2731] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:08.311462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95ffa-a415-4769-b29c-8e0d13e4a2a8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:08.312238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95ffa-a415-4769-b29c-8e0d13e4a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:08.312238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95ffa-a415-4769-b29c-8e0d13e4a2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:08.380458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-00c95ffa-a415-4769-b29c-8e0d13e4a2a8 None None] MFA Rules not processed for user `486709a8644a40dea3786a139896fb57`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:08.385237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-00c95ffa-a415-4769-b29c-8e0d13e4a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:08.788758 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1367/2732] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:08.987872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4cd3-ec64-4f46-a21e-e1726b348ce9 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:08.990699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b5ea4cd3-ec64-4f46-a21e-e1726b348ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:09.016603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4cd3-ec64-4f46-a21e-e1726b348ce9 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:09.041015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:09.041973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:09.042299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:09.043762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] PATH_INFO: `/v3/projects/94b2cbec5b884fde96ef9f659a081246` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:09.047199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b2cbec5b884fde96ef9f659a081246)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:09.053410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:09.209952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b2cbec5b884fde96ef9f659a081246', 'request_id': 'req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:09.228075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b2cbec5b884fde96ef9f659a081246', 'request_id': 'req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:09.255202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b2cbec5b884fde96ef9f659a081246', 'request_id': 'req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:09.290443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] The token cache is being invalidate because project 94b2cbec5b884fde96ef9f659a081246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:30:09.290827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:09.292909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9fb7db3-8b84-4611-9ba9-21c487ec7bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:30:09.302956 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1366/2733] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:30:08 2022] DELETE /identity/v3/projects/94b2cbec5b884fde96ef9f659a081246 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:30:09.309759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c49dea-d10a-4e7e-9ff4-ffe673d3f63b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:09.310175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c49dea-d10a-4e7e-9ff4-ffe673d3f63b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:09.310455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c49dea-d10a-4e7e-9ff4-ffe673d3f63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:09.403976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f9c49dea-d10a-4e7e-9ff4-ffe673d3f63b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:09.406321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f9c49dea-d10a-4e7e-9ff4-ffe673d3f63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:09.559175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:09.596381 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1368/2734] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:09.719503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549df797-78c0-423c-ae0f-f58ca7b97650 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:09.719995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549df797-78c0-423c-ae0f-f58ca7b97650 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:09.720485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549df797-78c0-423c-ae0f-f58ca7b97650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:09.818977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-549df797-78c0-423c-ae0f-f58ca7b97650 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:09.824988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-549df797-78c0-423c-ae0f-f58ca7b97650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:09.868745 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1367/2735] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:09.869641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c49dea-d10a-4e7e-9ff4-ffe673d3f63b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:09.881407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c49dea-d10a-4e7e-9ff4-ffe673d3f63b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:09.907027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa3620-06ab-4835-a605-bae5b332f7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:09.909464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa3620-06ab-4835-a605-bae5b332f7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:09.909464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa3620-06ab-4835-a605-bae5b332f7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:09.909464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa3620-06ab-4835-a605-bae5b332f7f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:09.915141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa3620-06ab-4835-a605-bae5b332f7f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:30:09.915711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa3620-06ab-4835-a605-bae5b332f7f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:09.917620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa3620-06ab-4835-a605-bae5b332f7f4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:09.950141 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1369/2736] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:30:09.954963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549df797-78c0-423c-ae0f-f58ca7b97650 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:09.961088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:09.983740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549df797-78c0-423c-ae0f-f58ca7b97650 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:09.992451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cc757-a143-4276-bf80-2b3008605d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:09.993378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cc757-a143-4276-bf80-2b3008605d6a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:09.994131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cc757-a143-4276-bf80-2b3008605d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:09.995541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cc757-a143-4276-bf80-2b3008605d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:10.001554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cc757-a143-4276-bf80-2b3008605d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:10.004958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cc757-a143-4276-bf80-2b3008605d6a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:10.125921 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1368/2737] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:30:09 2022] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:30:10.130580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa3620-06ab-4835-a605-bae5b332f7f4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:10.160879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa3620-06ab-4835-a605-bae5b332f7f4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:10.349270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4692d6-84a6-45c0-9614-e859fea75e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:10.350023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4692d6-84a6-45c0-9614-e859fea75e85 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:10.350374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4692d6-84a6-45c0-9614-e859fea75e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:10.350720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4692d6-84a6-45c0-9614-e859fea75e85 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:10.351444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4692d6-84a6-45c0-9614-e859fea75e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:10.354635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4692d6-84a6-45c0-9614-e859fea75e85 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:10.432044 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1370/2738] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:30:10 2022] POST /identity/v3/users => generated 303 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:30:10.437987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cc757-a143-4276-bf80-2b3008605d6a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:10.457073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ce3e0-9a1a-41b8-89d9-40ea13cd3803 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:10.457404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ce3e0-9a1a-41b8-89d9-40ea13cd3803 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:10.457999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ce3e0-9a1a-41b8-89d9-40ea13cd3803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:10.460381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cc757-a143-4276-bf80-2b3008605d6a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:10.467986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafddf2a-b983-4b93-88e8-f98b367af0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:10.469046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafddf2a-b983-4b93-88e8-f98b367af0ee admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:10.469626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafddf2a-b983-4b93-88e8-f98b367af0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:10.470013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafddf2a-b983-4b93-88e8-f98b367af0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:10.471923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafddf2a-b983-4b93-88e8-f98b367af0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:10.473991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafddf2a-b983-4b93-88e8-f98b367af0ee admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:10.492015 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1369/2739] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:30:10.497535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafddf2a-b983-4b93-88e8-f98b367af0ee admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:10.511053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-916ce3e0-9a1a-41b8-89d9-40ea13cd3803 None None] MFA Rules not processed for user `1ff9744258414abeb64b442b0d295c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:10.513239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-916ce3e0-9a1a-41b8-89d9-40ea13cd3803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:10.528249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafddf2a-b983-4b93-88e8-f98b367af0ee admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:10.555839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963e003-5c62-4be4-b15e-acc367e78b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:10.556580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963e003-5c62-4be4-b15e-acc367e78b28 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:10.556912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963e003-5c62-4be4-b15e-acc367e78b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:10.557255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963e003-5c62-4be4-b15e-acc367e78b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:10.561662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963e003-5c62-4be4-b15e-acc367e78b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:10.563427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963e003-5c62-4be4-b15e-acc367e78b28 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:10.618517 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1370/2740] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:30:10.620427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963e003-5c62-4be4-b15e-acc367e78b28 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:10.648129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963e003-5c62-4be4-b15e-acc367e78b28 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:10.663684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756cd8e-1dfb-4b64-95d4-59a102fc71e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:10.664724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756cd8e-1dfb-4b64-95d4-59a102fc71e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:10.665203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756cd8e-1dfb-4b64-95d4-59a102fc71e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:10.665688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756cd8e-1dfb-4b64-95d4-59a102fc71e6 admin admin] PATH_INFO: `/v3/projects/3d21c1f5bb7149a98a466b4d46aa8c7e/users/a4466b28afba4fe395c17aac6d6b6bb5/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:10.675255 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1371/2741] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:10.727726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756cd8e-1dfb-4b64-95d4-59a102fc71e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d21c1f5bb7149a98a466b4d46aa8c7e, user_id=a4466b28afba4fe395c17aac6d6b6bb5, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:10.735258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756cd8e-1dfb-4b64-95d4-59a102fc71e6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:10.811584 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1371/2742] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:30:10 2022] PUT /identity/v3/projects/3d21c1f5bb7149a98a466b4d46aa8c7e/users/a4466b28afba4fe395c17aac6d6b6bb5/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:30:10.816582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eab791-3dd5-4a09-9099-30bd638817fe None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:10.816869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eab791-3dd5-4a09-9099-30bd638817fe None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:10.817159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eab791-3dd5-4a09-9099-30bd638817fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:10.902601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-95eab791-3dd5-4a09-9099-30bd638817fe None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:10.927567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-95eab791-3dd5-4a09-9099-30bd638817fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:11.091198 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1372/2743] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:11.124714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756cd8e-1dfb-4b64-95d4-59a102fc71e6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:11.127263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c756cd8e-1dfb-4b64-95d4-59a102fc71e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:11.296068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756cd8e-1dfb-4b64-95d4-59a102fc71e6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:11.315330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55835d41-76cb-4940-96fe-9bcb32436d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:11.316073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55835d41-76cb-4940-96fe-9bcb32436d75 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:11.316393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55835d41-76cb-4940-96fe-9bcb32436d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:11.316672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55835d41-76cb-4940-96fe-9bcb32436d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:11.341919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55835d41-76cb-4940-96fe-9bcb32436d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:11.343497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55835d41-76cb-4940-96fe-9bcb32436d75 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:11.379882 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1372/2744] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:21.066003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:21.363664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:27.628881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606914d3-5181-403c-8aad-1e5f0815b5b1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:27.629441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606914d3-5181-403c-8aad-1e5f0815b5b1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:27.629441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606914d3-5181-403c-8aad-1e5f0815b5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:27.680702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-606914d3-5181-403c-8aad-1e5f0815b5b1 None None] MFA Rules not processed for user `a4466b28afba4fe395c17aac6d6b6bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:27.682002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-606914d3-5181-403c-8aad-1e5f0815b5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:27.785918 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1373/2745] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:27.796829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55835d41-76cb-4940-96fe-9bcb32436d75 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:27.799602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-55835d41-76cb-4940-96fe-9bcb32436d75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:27.914173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55835d41-76cb-4940-96fe-9bcb32436d75 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:27.920834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a56006-c06f-405e-9b11-b2528c548586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:27.923170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56006-c06f-405e-9b11-b2528c548586 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:27.924545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56006-c06f-405e-9b11-b2528c548586 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:27.926846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56006-c06f-405e-9b11-b2528c548586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:27.940420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a56006-c06f-405e-9b11-b2528c548586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:27.943520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a56006-c06f-405e-9b11-b2528c548586 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:27.973783 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1373/2746] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:27 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:29.051341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eee6b-50e3-4bbb-95c8-a472e3363911 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:29.052375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eee6b-50e3-4bbb-95c8-a472e3363911 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:29.053693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eee6b-50e3-4bbb-95c8-a472e3363911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:29.087483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-de0eee6b-50e3-4bbb-95c8-a472e3363911 None None] MFA Rules not processed for user `c886c6bd7a0544b499c77b714c6065f7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:29.090125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de0eee6b-50e3-4bbb-95c8-a472e3363911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:29.328509 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1374/2747] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:31.457632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c97327-f612-4ab7-9dc3-4de14012ca91 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:31.463381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c97327-f612-4ab7-9dc3-4de14012ca91 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:31.464373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c97327-f612-4ab7-9dc3-4de14012ca91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:31.568129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b5c97327-f612-4ab7-9dc3-4de14012ca91 None None] MFA Rules not processed for user `c886c6bd7a0544b499c77b714c6065f7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:31.574332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b5c97327-f612-4ab7-9dc3-4de14012ca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:31.596928 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1374/2748] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:32.005455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08f0f-4cf1-4f3d-96a3-946a168e536f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:32.007050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08f0f-4cf1-4f3d-96a3-946a168e536f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:32.007902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08f0f-4cf1-4f3d-96a3-946a168e536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:32.089003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9ab08f0f-4cf1-4f3d-96a3-946a168e536f None None] MFA Rules not processed for user `c886c6bd7a0544b499c77b714c6065f7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:32.093293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9ab08f0f-4cf1-4f3d-96a3-946a168e536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:32.128584 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1375/2749] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:32.225376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296480d1-d3f3-45ec-9b9e-3cfebbf761d6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:32.225882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296480d1-d3f3-45ec-9b9e-3cfebbf761d6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:32.226258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296480d1-d3f3-45ec-9b9e-3cfebbf761d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:32.279693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-296480d1-d3f3-45ec-9b9e-3cfebbf761d6 None None] MFA Rules not processed for user `c886c6bd7a0544b499c77b714c6065f7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:32.284198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-296480d1-d3f3-45ec-9b9e-3cfebbf761d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:32.306996 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1375/2750] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:32.712452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37471a-3f61-4a98-82e9-1c1d3c2d4153 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:32.712730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37471a-3f61-4a98-82e9-1c1d3c2d4153 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:32.713014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37471a-3f61-4a98-82e9-1c1d3c2d4153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:32.773174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-db37471a-3f61-4a98-82e9-1c1d3c2d4153 None None] MFA Rules not processed for user `c886c6bd7a0544b499c77b714c6065f7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:32.774855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db37471a-3f61-4a98-82e9-1c1d3c2d4153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:32.826693 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1376/2751] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:39.988569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa881de-5374-4bb2-bf8f-2ca1eaebb2f0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:39.990977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa881de-5374-4bb2-bf8f-2ca1eaebb2f0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:39.991754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa881de-5374-4bb2-bf8f-2ca1eaebb2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:40.062402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-faa881de-5374-4bb2-bf8f-2ca1eaebb2f0 None None] MFA Rules not processed for user `1869270af6874c4db42112d4aa9417a6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:40.067269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-faa881de-5374-4bb2-bf8f-2ca1eaebb2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:40.383040 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1376/2752] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:30:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:42.739748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=63 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:45.848143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec32a6-fa8a-477f-9305-3e0d15e8995d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:45.848835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec32a6-fa8a-477f-9305-3e0d15e8995d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:45.848947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec32a6-fa8a-477f-9305-3e0d15e8995d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:45.908368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7cec32a6-fa8a-477f-9305-3e0d15e8995d None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:30:45.909899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7cec32a6-fa8a-477f-9305-3e0d15e8995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:46.029005 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1377/2753] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:30:46.054701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa881de-5374-4bb2-bf8f-2ca1eaebb2f0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:46.056525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-faa881de-5374-4bb2-bf8f-2ca1eaebb2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:46.419427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa881de-5374-4bb2-bf8f-2ca1eaebb2f0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:46.445064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9c4dc-c78a-4785-9e96-8561ec1a081c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:46.453284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9c4dc-c78a-4785-9e96-8561ec1a081c service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:46.453981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9c4dc-c78a-4785-9e96-8561ec1a081c service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:46.454740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9c4dc-c78a-4785-9e96-8561ec1a081c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:46.507964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9c4dc-c78a-4785-9e96-8561ec1a081c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:46.518525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9c4dc-c78a-4785-9e96-8561ec1a081c service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:46.578990 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1377/2754] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:30:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:53.325841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec32a6-fa8a-477f-9305-3e0d15e8995d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:53.328062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7cec32a6-fa8a-477f-9305-3e0d15e8995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:53.528938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec32a6-fa8a-477f-9305-3e0d15e8995d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:53.542887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cacf9-a2d9-45ae-b2c0-006912e5e024 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:53.546219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cacf9-a2d9-45ae-b2c0-006912e5e024 service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:53.548344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cacf9-a2d9-45ae-b2c0-006912e5e024 service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:53.549837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cacf9-a2d9-45ae-b2c0-006912e5e024 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:53.555224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-498cacf9-a2d9-45ae-b2c0-006912e5e024 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:53.608368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cacf9-a2d9-45ae-b2c0-006912e5e024 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:53.615028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cacf9-a2d9-45ae-b2c0-006912e5e024 service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:53.657132 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1378/2755] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:30:55.878532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9c4dc-c78a-4785-9e96-8561ec1a081c service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:30:55.892284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:55.902643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9c4dc-c78a-4785-9e96-8561ec1a081c service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:30:55.919105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dcd09-b4ac-4b01-b8a5-8d6e4e43c215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:30:55.920228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dcd09-b4ac-4b01-b8a5-8d6e4e43c215 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:30:55.925819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dcd09-b4ac-4b01-b8a5-8d6e4e43c215 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:30:55.926944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dcd09-b4ac-4b01-b8a5-8d6e4e43c215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:30:55.943670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-223dcd09-b4ac-4b01-b8a5-8d6e4e43c215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:30:56.063095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dcd09-b4ac-4b01-b8a5-8d6e4e43c215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:30:56.069672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dcd09-b4ac-4b01-b8a5-8d6e4e43c215 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:30:56.124573 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1378/2756] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:30:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:00.016139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cacf9-a2d9-45ae-b2c0-006912e5e024 service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:00.017700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-498cacf9-a2d9-45ae-b2c0-006912e5e024 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:00.078734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cacf9-a2d9-45ae-b2c0-006912e5e024 service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:00.113875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545703a-c161-42ae-b2b5-844fd5a461f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:00.121400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545703a-c161-42ae-b2b5-844fd5a461f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:00.129661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545703a-c161-42ae-b2b5-844fd5a461f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:00.131152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545703a-c161-42ae-b2b5-844fd5a461f2 admin admin] PATH_INFO: `/v3/users/c886c6bd7a0544b499c77b714c6065f7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:00.140850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545703a-c161-42ae-b2b5-844fd5a461f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c886c6bd7a0544b499c77b714c6065f7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:00.143532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545703a-c161-42ae-b2b5-844fd5a461f2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:00.348270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a545703a-c161-42ae-b2b5-844fd5a461f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c886c6bd7a0544b499c77b714c6065f7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:00.349454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a545703a-c161-42ae-b2b5-844fd5a461f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c886c6bd7a0544b499c77b714c6065f7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:00.409605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a545703a-c161-42ae-b2b5-844fd5a461f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c886c6bd7a0544b499c77b714c6065f7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:00.444010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a545703a-c161-42ae-b2b5-844fd5a461f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c886c6bd7a0544b499c77b714c6065f7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:00.479181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a545703a-c161-42ae-b2b5-844fd5a461f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c886c6bd7a0544b499c77b714c6065f7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:00.504112 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1379/2757] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:31:00 2022] DELETE /identity/v3/users/c886c6bd7a0544b499c77b714c6065f7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:01.964697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dcd09-b4ac-4b01-b8a5-8d6e4e43c215 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:01.980896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dcd09-b4ac-4b01-b8a5-8d6e4e43c215 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:02.238884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:02.242397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:02.242911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:02.244681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] PATH_INFO: `/v3/projects/42f9ff69e07f4f32bb1a6aa14a937d86` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:02.249066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f9ff69e07f4f32bb1a6aa14a937d86)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:02.251462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:02.390393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f9ff69e07f4f32bb1a6aa14a937d86', 'request_id': 'req-c8bff4e1-2ddc-4535-b239-ff0204e0db08'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:02.405588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f9ff69e07f4f32bb1a6aa14a937d86', 'request_id': 'req-c8bff4e1-2ddc-4535-b239-ff0204e0db08'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:02.423311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f9ff69e07f4f32bb1a6aa14a937d86', 'request_id': 'req-c8bff4e1-2ddc-4535-b239-ff0204e0db08'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:02.469463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] The token cache is being invalidate because project 42f9ff69e07f4f32bb1a6aa14a937d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:31:02.474137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:02.477099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:02.496465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597fc06-d361-4787-84c1-9e12a1a4a641 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:02.497081 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1379/2758] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:01 2022] DELETE /identity/v3/projects/42f9ff69e07f4f32bb1a6aa14a937d86 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:02.497669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597fc06-d361-4787-84c1-9e12a1a4a641 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:02.498352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597fc06-d361-4787-84c1-9e12a1a4a641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:02.561189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c597fc06-d361-4787-84c1-9e12a1a4a641 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:02.564497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c597fc06-d361-4787-84c1-9e12a1a4a641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:02.654312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:02.658558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:02.662542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:02.775179 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1380/2759] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:31:02.787552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55b124-a853-47ba-bd67-e9862e9afde9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:02.787945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55b124-a853-47ba-bd67-e9862e9afde9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:02.788309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55b124-a853-47ba-bd67-e9862e9afde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:02.826239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6c55b124-a853-47ba-bd67-e9862e9afde9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:02.830883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6c55b124-a853-47ba-bd67-e9862e9afde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:02.852565 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1381/2760] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:31:02.859445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55b124-a853-47ba-bd67-e9862e9afde9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:02.866872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bff4e1-2ddc-4535-b239-ff0204e0db08 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:02.875059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55b124-a853-47ba-bd67-e9862e9afde9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:02.876187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:02.877155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:02.877310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:02.877676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] PATH_INFO: `/v3/users/a4466b28afba4fe395c17aac6d6b6bb5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:02.879317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4466b28afba4fe395c17aac6d6b6bb5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:02.882310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:02.891704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04dccf-17f4-4ca1-8c3f-d027d105fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:02.892455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04dccf-17f4-4ca1-8c3f-d027d105fe99 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:02.892848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04dccf-17f4-4ca1-8c3f-d027d105fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:02.893196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04dccf-17f4-4ca1-8c3f-d027d105fe99 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:02.894037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04dccf-17f4-4ca1-8c3f-d027d105fe99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:31:02.894418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04dccf-17f4-4ca1-8c3f-d027d105fe99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:02.898720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04dccf-17f4-4ca1-8c3f-d027d105fe99 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:02.963434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:02.987540 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1382/2761] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:31:02.987540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04dccf-17f4-4ca1-8c3f-d027d105fe99 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:03.035953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04dccf-17f4-4ca1-8c3f-d027d105fe99 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:03.050274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32892e7-07f1-4b31-82b1-2c6f2b40721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:03.052256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32892e7-07f1-4b31-82b1-2c6f2b40721e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:03.053169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32892e7-07f1-4b31-82b1-2c6f2b40721e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:03.055322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32892e7-07f1-4b31-82b1-2c6f2b40721e admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:03.064935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32892e7-07f1-4b31-82b1-2c6f2b40721e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:03.075806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32892e7-07f1-4b31-82b1-2c6f2b40721e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:03.089656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4466b28afba4fe395c17aac6d6b6bb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:03.098565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4466b28afba4fe395c17aac6d6b6bb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:03.142315 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1383/2762] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:31:02 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:31:03.143247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32892e7-07f1-4b31-82b1-2c6f2b40721e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:03.156035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a32892e7-07f1-4b31-82b1-2c6f2b40721e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:03.173706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4466b28afba4fe395c17aac6d6b6bb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:03.176944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4466b28afba4fe395c17aac6d6b6bb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:03.225570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4466b28afba4fe395c17aac6d6b6bb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:03.257558 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1380/2763] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:31:02 2022] DELETE /identity/v3/users/a4466b28afba4fe395c17aac6d6b6bb5 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:03.258588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:03.260251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:03.315867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32892e7-07f1-4b31-82b1-2c6f2b40721e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:03.383991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a168a89-f790-499b-9c39-c1626950a2d5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:03.397707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfacef6-1857-4c53-a706-0f25512f3555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:03.398346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfacef6-1857-4c53-a706-0f25512f3555 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:03.398699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfacef6-1857-4c53-a706-0f25512f3555 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:03.399068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfacef6-1857-4c53-a706-0f25512f3555 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:03.399847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfacef6-1857-4c53-a706-0f25512f3555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:03.403154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfacef6-1857-4c53-a706-0f25512f3555 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:03.450972 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1381/2764] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:31:03 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:31:03.452796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfacef6-1857-4c53-a706-0f25512f3555 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:03.472230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfacef6-1857-4c53-a706-0f25512f3555 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:03.482877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:03.484789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:03.485076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:03.485359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] PATH_INFO: `/v3/users/199c2a20a7e8425e8df281cfe251c880` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:03.487600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5bda9-d233-4d7c-ad10-7cd6e11f3a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:03.488516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5bda9-d233-4d7c-ad10-7cd6e11f3a51 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:03.489153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199c2a20a7e8425e8df281cfe251c880)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:03.489367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5bda9-d233-4d7c-ad10-7cd6e11f3a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:03.490014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5bda9-d233-4d7c-ad10-7cd6e11f3a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:03.490857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5bda9-d233-4d7c-ad10-7cd6e11f3a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:03.491145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:03.493000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5bda9-d233-4d7c-ad10-7cd6e11f3a51 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:03.510354 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1382/2765] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:31:03.512298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5bda9-d233-4d7c-ad10-7cd6e11f3a51 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:03.525529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5bda9-d233-4d7c-ad10-7cd6e11f3a51 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:03.532150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337f4cc-649e-4228-80f0-f4ea3b90c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:03.534182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f4cc-649e-4228-80f0-f4ea3b90c1bf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:03.534974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f4cc-649e-4228-80f0-f4ea3b90c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:03.535613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f4cc-649e-4228-80f0-f4ea3b90c1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:03.536520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337f4cc-649e-4228-80f0-f4ea3b90c1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:03.538490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337f4cc-649e-4228-80f0-f4ea3b90c1bf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:03.556716 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1383/2766] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:31:03.558115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337f4cc-649e-4228-80f0-f4ea3b90c1bf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:03.570352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337f4cc-649e-4228-80f0-f4ea3b90c1bf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:03.578927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288e76c-27ea-4516-afa0-601cadb5eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:03.580564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e76c-27ea-4516-afa0-601cadb5eb5c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:03.581368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e76c-27ea-4516-afa0-601cadb5eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:03.582176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288e76c-27ea-4516-afa0-601cadb5eb5c admin admin] PATH_INFO: `/v3/projects/505ab4f3173b48559a5c25611af86fc7/users/a675ad19db254271ba12d2812d0732e3/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:03.606842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:03.621074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288e76c-27ea-4516-afa0-601cadb5eb5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=505ab4f3173b48559a5c25611af86fc7, user_id=a675ad19db254271ba12d2812d0732e3, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:03.627874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288e76c-27ea-4516-afa0-601cadb5eb5c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:03.666054 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1384/2767] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:31:03 2022] PUT /identity/v3/projects/505ab4f3173b48559a5c25611af86fc7/users/a675ad19db254271ba12d2812d0732e3/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:03.671286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec2f58-69c8-466c-94a8-ab7890652413 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:03.672220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec2f58-69c8-466c-94a8-ab7890652413 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:03.679213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec2f58-69c8-466c-94a8-ab7890652413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:03.694676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199c2a20a7e8425e8df281cfe251c880'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:03.696417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199c2a20a7e8425e8df281cfe251c880'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:03.730325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199c2a20a7e8425e8df281cfe251c880'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:03.745788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199c2a20a7e8425e8df281cfe251c880'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:03.754118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1bec2f58-69c8-466c-94a8-ab7890652413 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:03.755712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1bec2f58-69c8-466c-94a8-ab7890652413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:03.761352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199c2a20a7e8425e8df281cfe251c880'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:03.772089 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1384/2768] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:31:03 2022] DELETE /identity/v3/users/199c2a20a7e8425e8df281cfe251c880 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:03.774462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:03.776961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:03.897862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:03.935392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d44073-97ea-4928-ba04-734a034bc383 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:03.941280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:03.942195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:03.942638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:03.943096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] PATH_INFO: `/v3/projects/3d21c1f5bb7149a98a466b4d46aa8c7e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:03.944553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d21c1f5bb7149a98a466b4d46aa8c7e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:03.947264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:03.961858 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1385/2769] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:03.971870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec2f58-69c8-466c-94a8-ab7890652413 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:03.973344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1bec2f58-69c8-466c-94a8-ab7890652413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:04.065571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d21c1f5bb7149a98a466b4d46aa8c7e', 'request_id': 'req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.078160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d21c1f5bb7149a98a466b4d46aa8c7e', 'request_id': 'req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.116566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d21c1f5bb7149a98a466b4d46aa8c7e', 'request_id': 'req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.127630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec2f58-69c8-466c-94a8-ab7890652413 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:04.143958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] The token cache is being invalidate because project 3d21c1f5bb7149a98a466b4d46aa8c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:31:04.145366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.146598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.151649 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1385/2770] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:03 2022] DELETE /identity/v3/projects/3d21c1f5bb7149a98a466b4d46aa8c7e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:04.151649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:04.154087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:04.292555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ad096-e95c-4c02-9a9c-b44dcfdcc6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:04.292795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:04.293259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ad096-e95c-4c02-9a9c-b44dcfdcc6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:04.293568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ad096-e95c-4c02-9a9c-b44dcfdcc6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:04.293826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ad096-e95c-4c02-9a9c-b44dcfdcc6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:04.303483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4f1ad096-e95c-4c02-9a9c-b44dcfdcc6e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:04.382115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caecd6-fe4a-4b44-a642-e4e481f24f2e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:04.394350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:04.395015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:04.395300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:04.395638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] PATH_INFO: `/v3/projects/6e9ae755ad68447087da4df60c36c746` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:04.397939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9ae755ad68447087da4df60c36c746)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:04.399883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:04.438684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ad096-e95c-4c02-9a9c-b44dcfdcc6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:04.440222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ad096-e95c-4c02-9a9c-b44dcfdcc6e2 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:04.464438 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1386/2771] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:31:04.466846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc8d87-45ff-4f95-951b-06b7d55d9e2c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:04.472333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc8d87-45ff-4f95-951b-06b7d55d9e2c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:04.472691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc8d87-45ff-4f95-951b-06b7d55d9e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:04.541030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-16dc8d87-45ff-4f95-951b-06b7d55d9e2c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:04.542342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-16dc8d87-45ff-4f95-951b-06b7d55d9e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:04.579287 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1387/2772] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:04.588199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd8cab-adf7-403b-8263-481b0d001f22 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:04.588541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd8cab-adf7-403b-8263-481b0d001f22 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:04.589493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd8cab-adf7-403b-8263-481b0d001f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:04.622075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9ae755ad68447087da4df60c36c746', 'request_id': 'req-1b414498-95ee-4033-b493-d122286b7d9f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.630348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9ae755ad68447087da4df60c36c746', 'request_id': 'req-1b414498-95ee-4033-b493-d122286b7d9f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.652200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9ae755ad68447087da4df60c36c746', 'request_id': 'req-1b414498-95ee-4033-b493-d122286b7d9f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.668374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] The token cache is being invalidate because project 6e9ae755ad68447087da4df60c36c746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:31:04.668745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.670311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.672416 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1386/2773] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:04 2022] DELETE /identity/v3/projects/6e9ae755ad68447087da4df60c36c746 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:04.672567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-13fd8cab-adf7-403b-8263-481b0d001f22 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:04.673686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-13fd8cab-adf7-403b-8263-481b0d001f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:04.675972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:04.677565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:04.826272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:04.857538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b414498-95ee-4033-b493-d122286b7d9f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:04.863636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:04.864556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:04.864996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:04.865477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] PATH_INFO: `/v3/users/5a35e1e03bb048e5a5d29d779c3d21e6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:04.866890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a35e1e03bb048e5a5d29d779c3d21e6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:04.869032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:04.878070 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1388/2774] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:31:04.882410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd8cab-adf7-403b-8263-481b0d001f22 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:04.895959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd8cab-adf7-403b-8263-481b0d001f22 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:04.911383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff5aaa-531c-4748-9c6b-602e313a521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:04.912309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff5aaa-531c-4748-9c6b-602e313a521e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:04.913078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff5aaa-531c-4748-9c6b-602e313a521e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:04.913369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff5aaa-531c-4748-9c6b-602e313a521e admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:04.914809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff5aaa-531c-4748-9c6b-602e313a521e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:31:04.915094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff5aaa-531c-4748-9c6b-602e313a521e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:04.918043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff5aaa-531c-4748-9c6b-602e313a521e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:04.952342 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1389/2775] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:31:04.956770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff5aaa-531c-4748-9c6b-602e313a521e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:04.967962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a35e1e03bb048e5a5d29d779c3d21e6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.969003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a35e1e03bb048e5a5d29d779c3d21e6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.980157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff5aaa-531c-4748-9c6b-602e313a521e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:04.986894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a35e1e03bb048e5a5d29d779c3d21e6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:04.990857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938eb02-fad7-4b35-b566-f1ac8907bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:04.991121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938eb02-fad7-4b35-b566-f1ac8907bf1d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:04.991255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:04.991379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938eb02-fad7-4b35-b566-f1ac8907bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:04.991615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938eb02-fad7-4b35-b566-f1ac8907bf1d admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:04.992261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938eb02-fad7-4b35-b566-f1ac8907bf1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:04.999957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a35e1e03bb048e5a5d29d779c3d21e6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:05.000423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938eb02-fad7-4b35-b566-f1ac8907bf1d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:05.014766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a35e1e03bb048e5a5d29d779c3d21e6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:05.032852 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1387/2776] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:31:04 2022] DELETE /identity/v3/users/5a35e1e03bb048e5a5d29d779c3d21e6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:31:05.091949 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1390/2777] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:31:04 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:31:05.096317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:05.097858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:05.218952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea2f18-20c8-42f3-911e-f41efadc9bc7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:05.391760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8756bb-e8e3-4f7e-85b9-cc2989cabe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:05.392403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8756bb-e8e3-4f7e-85b9-cc2989cabe2b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:05.392685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8756bb-e8e3-4f7e-85b9-cc2989cabe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:05.392961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8756bb-e8e3-4f7e-85b9-cc2989cabe2b admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:05.393633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8756bb-e8e3-4f7e-85b9-cc2989cabe2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:05.396203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8756bb-e8e3-4f7e-85b9-cc2989cabe2b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:05.463998 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1388/2778] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:31:05 2022] POST /identity/v3/users => generated 288 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:31:05.466830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938eb02-fad7-4b35-b566-f1ac8907bf1d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:05.487680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938eb02-fad7-4b35-b566-f1ac8907bf1d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:05.503777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d891450-0f4e-42fd-988e-dfb5b8c7dabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:05.503777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d891450-0f4e-42fd-988e-dfb5b8c7dabc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:05.503777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d891450-0f4e-42fd-988e-dfb5b8c7dabc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:05.503777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d891450-0f4e-42fd-988e-dfb5b8c7dabc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:05.504769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d891450-0f4e-42fd-988e-dfb5b8c7dabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:05.505774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d891450-0f4e-42fd-988e-dfb5b8c7dabc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:05.521005 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1391/2779] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:31:05.534180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8756bb-e8e3-4f7e-85b9-cc2989cabe2b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:05.555410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8756bb-e8e3-4f7e-85b9-cc2989cabe2b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:05.577755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c271d-3cd8-4a01-b923-398770aa2175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:05.583505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c271d-3cd8-4a01-b923-398770aa2175 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:05.584770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c271d-3cd8-4a01-b923-398770aa2175 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:05.586131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c271d-3cd8-4a01-b923-398770aa2175 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:05.591429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c271d-3cd8-4a01-b923-398770aa2175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:05.597848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c271d-3cd8-4a01-b923-398770aa2175 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:05.647810 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1389/2780] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:31:05.649189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d891450-0f4e-42fd-988e-dfb5b8c7dabc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:05.664440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d891450-0f4e-42fd-988e-dfb5b8c7dabc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:05.680976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bf949-ce3e-4260-82da-3b2c30bb8343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:05.681891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bf949-ce3e-4260-82da-3b2c30bb8343 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:05.682271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bf949-ce3e-4260-82da-3b2c30bb8343 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:05.682672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bf949-ce3e-4260-82da-3b2c30bb8343 admin admin] PATH_INFO: `/v3/projects/2a4920bc88bc467c9c5eb64032ba0c58/users/783eb573b9464ca2a9dc618d07caa679/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:05.717864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bf949-ce3e-4260-82da-3b2c30bb8343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4920bc88bc467c9c5eb64032ba0c58, user_id=783eb573b9464ca2a9dc618d07caa679, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:05.720658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bf949-ce3e-4260-82da-3b2c30bb8343 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:05.751302 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1392/2781] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:31:05 2022] PUT /identity/v3/projects/2a4920bc88bc467c9c5eb64032ba0c58/users/783eb573b9464ca2a9dc618d07caa679/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:05.755148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2dbfd-6251-4cc7-9031-89fbf485d624 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:05.755664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2dbfd-6251-4cc7-9031-89fbf485d624 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:05.756145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2dbfd-6251-4cc7-9031-89fbf485d624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:05.811155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-82b2dbfd-6251-4cc7-9031-89fbf485d624 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:05.812397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-82b2dbfd-6251-4cc7-9031-89fbf485d624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:05.942480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bf949-ce3e-4260-82da-3b2c30bb8343 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:05.944646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f49bf949-ce3e-4260-82da-3b2c30bb8343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:05.986398 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1390/2782] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:06.007885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2dbfd-6251-4cc7-9031-89fbf485d624 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:06.009372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-82b2dbfd-6251-4cc7-9031-89fbf485d624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:06.046458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:06.058486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bf949-ce3e-4260-82da-3b2c30bb8343 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:06.069532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:06.070198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:06.070477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:06.070890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] PATH_INFO: `/v3/projects/2d62a388e7f14c98bfe0c4b18b559b97` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:06.072157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d62a388e7f14c98bfe0c4b18b559b97)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:06.076218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:06.146801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d62a388e7f14c98bfe0c4b18b559b97', 'request_id': 'req-c1d37fb2-48f5-4149-a888-1dc9de996a92'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:06.163692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d62a388e7f14c98bfe0c4b18b559b97', 'request_id': 'req-c1d37fb2-48f5-4149-a888-1dc9de996a92'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:06.180289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d62a388e7f14c98bfe0c4b18b559b97', 'request_id': 'req-c1d37fb2-48f5-4149-a888-1dc9de996a92'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:06.215946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2dbfd-6251-4cc7-9031-89fbf485d624 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:06.222603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] The token cache is being invalidate because project 2d62a388e7f14c98bfe0c4b18b559b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:31:06.224298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:06.228501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1d37fb2-48f5-4149-a888-1dc9de996a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:06.237721 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1393/2783] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:05 2022] DELETE /identity/v3/projects/2d62a388e7f14c98bfe0c4b18b559b97 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:06.239144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf8325-1f48-435b-9933-95535aecafa8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:06.239427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf8325-1f48-435b-9933-95535aecafa8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:06.248179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf8325-1f48-435b-9933-95535aecafa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:06.268899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:06.306530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7faf8325-1f48-435b-9933-95535aecafa8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:06.308374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7faf8325-1f48-435b-9933-95535aecafa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:06.391263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322581d-79f4-4bee-a9ea-bc97e3db1099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:06.391960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322581d-79f4-4bee-a9ea-bc97e3db1099 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:06.392286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322581d-79f4-4bee-a9ea-bc97e3db1099 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:06.392569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322581d-79f4-4bee-a9ea-bc97e3db1099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:06.400462 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1394/2784] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:06.401215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0322581d-79f4-4bee-a9ea-bc97e3db1099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:06.415591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819740b-30c0-4be9-ab90-4fe7b1981f0e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:06.416005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819740b-30c0-4be9-ab90-4fe7b1981f0e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:06.416604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819740b-30c0-4be9-ab90-4fe7b1981f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:06.437817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322581d-79f4-4bee-a9ea-bc97e3db1099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:06.439443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322581d-79f4-4bee-a9ea-bc97e3db1099 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:06.465379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8819740b-30c0-4be9-ab90-4fe7b1981f0e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:06.471431 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1391/2785] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:31:06.471837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8819740b-30c0-4be9-ab90-4fe7b1981f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:06.490041 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1395/2786] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:31:06.497495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322581d-79f4-4bee-a9ea-bc97e3db1099 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:06.526265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322581d-79f4-4bee-a9ea-bc97e3db1099 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:06.547422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1702c-4a8f-4060-9909-4729a1e63a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:06.548122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1702c-4a8f-4060-9909-4729a1e63a1a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:06.548408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1702c-4a8f-4060-9909-4729a1e63a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:06.548686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1702c-4a8f-4060-9909-4729a1e63a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:06.549365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1702c-4a8f-4060-9909-4729a1e63a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:31:06.549708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1702c-4a8f-4060-9909-4729a1e63a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:06.551897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1702c-4a8f-4060-9909-4729a1e63a1a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:06.570887 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1392/2787] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:31:06.573594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819740b-30c0-4be9-ab90-4fe7b1981f0e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:06.593679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819740b-30c0-4be9-ab90-4fe7b1981f0e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:06.616459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a52dd-66b9-4c68-9a83-f755777b3e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:06.617293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a52dd-66b9-4c68-9a83-f755777b3e1e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:06.617554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a52dd-66b9-4c68-9a83-f755777b3e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:06.617945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a52dd-66b9-4c68-9a83-f755777b3e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:06.618700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a52dd-66b9-4c68-9a83-f755777b3e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:06.626153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a52dd-66b9-4c68-9a83-f755777b3e1e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:06.705999 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1396/2788] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:31:06 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:31:06.710675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1702c-4a8f-4060-9909-4729a1e63a1a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:06.727030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1702c-4a8f-4060-9909-4729a1e63a1a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:06.906255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fbe78-91b5-4b19-94c5-27bf2e2c81df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:06.908004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fbe78-91b5-4b19-94c5-27bf2e2c81df admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:06.908287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fbe78-91b5-4b19-94c5-27bf2e2c81df admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:06.908732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fbe78-91b5-4b19-94c5-27bf2e2c81df admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:06.909379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fbe78-91b5-4b19-94c5-27bf2e2c81df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:06.911652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fbe78-91b5-4b19-94c5-27bf2e2c81df admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:07.028709 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1393/2789] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:31:06 2022] POST /identity/v3/users => generated 295 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:31:07.030618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a52dd-66b9-4c68-9a83-f755777b3e1e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:07.059810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a52dd-66b9-4c68-9a83-f755777b3e1e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:07.074900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f39c0-a21c-44e2-af19-31e1b7b7f707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:07.075644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f39c0-a21c-44e2-af19-31e1b7b7f707 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:07.075910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f39c0-a21c-44e2-af19-31e1b7b7f707 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:07.076096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f39c0-a21c-44e2-af19-31e1b7b7f707 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:07.076697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f39c0-a21c-44e2-af19-31e1b7b7f707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:07.081470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f39c0-a21c-44e2-af19-31e1b7b7f707 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:07.116230 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1397/2790] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:31:07.121110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fbe78-91b5-4b19-94c5-27bf2e2c81df admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:07.139739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fbe78-91b5-4b19-94c5-27bf2e2c81df admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:07.155271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5af7d-3c8a-4946-bd84-4d55f4a189f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:07.155956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5af7d-3c8a-4946-bd84-4d55f4a189f8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:07.156821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5af7d-3c8a-4946-bd84-4d55f4a189f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:07.159108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5af7d-3c8a-4946-bd84-4d55f4a189f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:07.160054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5af7d-3c8a-4946-bd84-4d55f4a189f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:07.162504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5af7d-3c8a-4946-bd84-4d55f4a189f8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:07.188130 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1394/2791] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:31:07.193357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f39c0-a21c-44e2-af19-31e1b7b7f707 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:07.208745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f39c0-a21c-44e2-af19-31e1b7b7f707 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:07.223664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f658f-e6d9-4f45-afe0-0d2e5ca69ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:07.225747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f658f-e6d9-4f45-afe0-0d2e5ca69ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:07.226082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f658f-e6d9-4f45-afe0-0d2e5ca69ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:07.226320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f658f-e6d9-4f45-afe0-0d2e5ca69ed2 admin admin] PATH_INFO: `/v3/projects/ce5236a48a4d4aa9800ca11f08fb7b8a/users/a74e72e4a61e4938b54dbb1e51db99dc/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:07.265659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f658f-e6d9-4f45-afe0-0d2e5ca69ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5236a48a4d4aa9800ca11f08fb7b8a, user_id=a74e72e4a61e4938b54dbb1e51db99dc, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:07.268350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f658f-e6d9-4f45-afe0-0d2e5ca69ed2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:07.313660 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1398/2792] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:31:07 2022] PUT /identity/v3/projects/ce5236a48a4d4aa9800ca11f08fb7b8a/users/a74e72e4a61e4938b54dbb1e51db99dc/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:07.317710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ea4a2-56da-462b-bbf6-9e9bc11e4d2a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:07.317710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ea4a2-56da-462b-bbf6-9e9bc11e4d2a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:07.317710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ea4a2-56da-462b-bbf6-9e9bc11e4d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:07.390650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-664ea4a2-56da-462b-bbf6-9e9bc11e4d2a None None] MFA Rules not processed for user `a74e72e4a61e4938b54dbb1e51db99dc`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:07.392274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-664ea4a2-56da-462b-bbf6-9e9bc11e4d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:07.447356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:07.541798 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1395/2793] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:07.545484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f658f-e6d9-4f45-afe0-0d2e5ca69ed2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:07.696675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f658f-e6d9-4f45-afe0-0d2e5ca69ed2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:07.704220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de60556-c025-4a68-b8ad-882d3c437c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:07.704925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de60556-c025-4a68-b8ad-882d3c437c1c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:07.705215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de60556-c025-4a68-b8ad-882d3c437c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:07.706421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de60556-c025-4a68-b8ad-882d3c437c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:07.706421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de60556-c025-4a68-b8ad-882d3c437c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:07.708099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de60556-c025-4a68-b8ad-882d3c437c1c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:07.752032 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1399/2794] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:31:07 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:31:07.756561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ea4a2-56da-462b-bbf6-9e9bc11e4d2a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:07.790888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ea4a2-56da-462b-bbf6-9e9bc11e4d2a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:07.952928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0dc95-7376-4e84-9896-de69eef649b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:07.954808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0dc95-7376-4e84-9896-de69eef649b5 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:07.955098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0dc95-7376-4e84-9896-de69eef649b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:07.957294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0dc95-7376-4e84-9896-de69eef649b5 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:07.959742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0dc95-7376-4e84-9896-de69eef649b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:07.964065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0dc95-7376-4e84-9896-de69eef649b5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:08.066944 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1396/2795] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:31:07 2022] POST /identity/v3/users => generated 300 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:31:08.072338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de60556-c025-4a68-b8ad-882d3c437c1c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:08.107745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de60556-c025-4a68-b8ad-882d3c437c1c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:08.121166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987df14-84c1-47ed-b001-5d879b9b386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:08.123174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987df14-84c1-47ed-b001-5d879b9b386f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:08.123514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987df14-84c1-47ed-b001-5d879b9b386f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:08.123808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987df14-84c1-47ed-b001-5d879b9b386f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:08.124389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987df14-84c1-47ed-b001-5d879b9b386f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:08.126917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987df14-84c1-47ed-b001-5d879b9b386f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:08.149145 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1400/2796] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:31:08.153848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0dc95-7376-4e84-9896-de69eef649b5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:08.179372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0dc95-7376-4e84-9896-de69eef649b5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:08.215432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f527925-39e0-46b0-b0dc-865d612b60b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:08.218558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f527925-39e0-46b0-b0dc-865d612b60b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:08.221589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f527925-39e0-46b0-b0dc-865d612b60b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:08.223488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f527925-39e0-46b0-b0dc-865d612b60b8 admin admin] PATH_INFO: `/v3/projects/fe92f3b58a4a4d9591f63b06088e2267/users/65243ed083394cb7b9a5e9d50f9ebf07/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:08.284191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f527925-39e0-46b0-b0dc-865d612b60b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe92f3b58a4a4d9591f63b06088e2267, user_id=65243ed083394cb7b9a5e9d50f9ebf07, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:08.297964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f527925-39e0-46b0-b0dc-865d612b60b8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:08.345971 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1397/2797] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:31:08 2022] PUT /identity/v3/projects/fe92f3b58a4a4d9591f63b06088e2267/users/65243ed083394cb7b9a5e9d50f9ebf07/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:08.350342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987df14-84c1-47ed-b001-5d879b9b386f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:08.365348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987df14-84c1-47ed-b001-5d879b9b386f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:08.418182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:08.569980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e181ba7-5bad-40fd-adcd-72e0ced43279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:08.570637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e181ba7-5bad-40fd-adcd-72e0ced43279 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:08.570933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e181ba7-5bad-40fd-adcd-72e0ced43279 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:08.571205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e181ba7-5bad-40fd-adcd-72e0ced43279 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:08.571870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e181ba7-5bad-40fd-adcd-72e0ced43279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:08.573642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e181ba7-5bad-40fd-adcd-72e0ced43279 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:08.594225 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1401/2798] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:31:08.595730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f527925-39e0-46b0-b0dc-865d612b60b8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:08.626416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f527925-39e0-46b0-b0dc-865d612b60b8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:08.634997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b3ee-f9c8-4639-9131-c4ddff66d403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:08.636366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b3ee-f9c8-4639-9131-c4ddff66d403 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:08.636888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b3ee-f9c8-4639-9131-c4ddff66d403 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:08.637422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b3ee-f9c8-4639-9131-c4ddff66d403 admin admin] PATH_INFO: `/v3/projects/fe92f3b58a4a4d9591f63b06088e2267/users/65243ed083394cb7b9a5e9d50f9ebf07/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:08.641423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184b3ee-f9c8-4639-9131-c4ddff66d403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe92f3b58a4a4d9591f63b06088e2267, user_id=65243ed083394cb7b9a5e9d50f9ebf07, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:08.647615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184b3ee-f9c8-4639-9131-c4ddff66d403 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:08.693149 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1398/2799] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:31:08 2022] PUT /identity/v3/projects/fe92f3b58a4a4d9591f63b06088e2267/users/65243ed083394cb7b9a5e9d50f9ebf07/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:08.698603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d10e2-3fcd-4c59-975d-d47b82e22b8e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:08.698963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d10e2-3fcd-4c59-975d-d47b82e22b8e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:08.699510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d10e2-3fcd-4c59-975d-d47b82e22b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:08.778918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-370d10e2-3fcd-4c59-975d-d47b82e22b8e None None] MFA Rules not processed for user `65243ed083394cb7b9a5e9d50f9ebf07`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:08.780291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-370d10e2-3fcd-4c59-975d-d47b82e22b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:09.047617 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1402/2800] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:09.065345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae1f04-4660-4a8b-8928-3f1b7a994c68 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:09.066023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae1f04-4660-4a8b-8928-3f1b7a994c68 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:09.066023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae1f04-4660-4a8b-8928-3f1b7a994c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:09.135911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3eae1f04-4660-4a8b-8928-3f1b7a994c68 None None] MFA Rules not processed for user `a74e72e4a61e4938b54dbb1e51db99dc`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:09.140210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3eae1f04-4660-4a8b-8928-3f1b7a994c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:09.283115 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1399/2801] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:09.504415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d10e2-3fcd-4c59-975d-d47b82e22b8e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:09.507050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-370d10e2-3fcd-4c59-975d-d47b82e22b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:09.808384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d10e2-3fcd-4c59-975d-d47b82e22b8e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:09.826147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd042-9d63-4db6-82ec-53ed391a0c92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:09.826936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd042-9d63-4db6-82ec-53ed391a0c92 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:09.827302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd042-9d63-4db6-82ec-53ed391a0c92 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:09.827302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd042-9d63-4db6-82ec-53ed391a0c92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:09.849647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd042-9d63-4db6-82ec-53ed391a0c92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:09.852835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd042-9d63-4db6-82ec-53ed391a0c92 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:09.875211 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1403/2802] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:11.341293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae1f04-4660-4a8b-8928-3f1b7a994c68 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:11.342819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3eae1f04-4660-4a8b-8928-3f1b7a994c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:11.449582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:11.656325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae1f04-4660-4a8b-8928-3f1b7a994c68 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:11.671228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ae949-1aae-450e-9e56-01591bc066b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:11.671867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ae949-1aae-450e-9e56-01591bc066b0 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:11.672145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ae949-1aae-450e-9e56-01591bc066b0 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:11.672413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ae949-1aae-450e-9e56-01591bc066b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:11.683279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-769ae949-1aae-450e-9e56-01591bc066b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:11.737628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ae949-1aae-450e-9e56-01591bc066b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:11.739325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ae949-1aae-450e-9e56-01591bc066b0 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:11.781149 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1400/2803] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:16.640545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd042-9d63-4db6-82ec-53ed391a0c92 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:16.642250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cf3bd042-9d63-4db6-82ec-53ed391a0c92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:16.694870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd042-9d63-4db6-82ec-53ed391a0c92 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:16.759661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad803b2f-0bc7-429a-a9fa-0ea7d34041f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:16.760820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803b2f-0bc7-429a-a9fa-0ea7d34041f4 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:16.761103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803b2f-0bc7-429a-a9fa-0ea7d34041f4 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:16.780427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803b2f-0bc7-429a-a9fa-0ea7d34041f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:16.789429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ad803b2f-0bc7-429a-a9fa-0ea7d34041f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:16.900880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad803b2f-0bc7-429a-a9fa-0ea7d34041f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:16.903229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad803b2f-0bc7-429a-a9fa-0ea7d34041f4 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:16.917341 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1404/2804] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:19.698689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b0812-b6f2-4f5d-8469-848547e2e3bd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:19.698689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b0812-b6f2-4f5d-8469-848547e2e3bd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:19.698689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b0812-b6f2-4f5d-8469-848547e2e3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:19.761159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-af7b0812-b6f2-4f5d-8469-848547e2e3bd None None] MFA Rules not processed for user `a675ad19db254271ba12d2812d0732e3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:19.761294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-af7b0812-b6f2-4f5d-8469-848547e2e3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:19.937949 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1401/2805] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:19.959590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b12c8-ab48-4f78-81a9-98017f86fbd8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:19.960160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b12c8-ab48-4f78-81a9-98017f86fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:19.960160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b12c8-ab48-4f78-81a9-98017f86fbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:19.983833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:20.000356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d91b12c8-ab48-4f78-81a9-98017f86fbd8 None None] MFA Rules not processed for user `a675ad19db254271ba12d2812d0732e3`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:20.001947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d91b12c8-ab48-4f78-81a9-98017f86fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:20.020579 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1405/2806] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:20.200096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b0812-b6f2-4f5d-8469-848547e2e3bd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:20.218745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b0812-b6f2-4f5d-8469-848547e2e3bd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:20.243134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561ea0e-00d9-4c04-a726-6e93f6b38bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:20.249160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561ea0e-00d9-4c04-a726-6e93f6b38bee service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:20.249160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561ea0e-00d9-4c04-a726-6e93f6b38bee service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:20.249160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561ea0e-00d9-4c04-a726-6e93f6b38bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:20.278039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561ea0e-00d9-4c04-a726-6e93f6b38bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:20.281221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561ea0e-00d9-4c04-a726-6e93f6b38bee service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:20.294743 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1402/2807] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:21.288661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b12c8-ab48-4f78-81a9-98017f86fbd8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:21.292645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d91b12c8-ab48-4f78-81a9-98017f86fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:21.481945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b12c8-ab48-4f78-81a9-98017f86fbd8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:21.490249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd528-1e1b-4ba8-8b25-85a54e3e7928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:21.491187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd528-1e1b-4ba8-8b25-85a54e3e7928 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:21.491642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd528-1e1b-4ba8-8b25-85a54e3e7928 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:21.492088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd528-1e1b-4ba8-8b25-85a54e3e7928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:21.502384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-428cd528-1e1b-4ba8-8b25-85a54e3e7928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:21.527037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cd528-1e1b-4ba8-8b25-85a54e3e7928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:21.528783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cd528-1e1b-4ba8-8b25-85a54e3e7928 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:21.546707 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1406/2808] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:23.296175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159c8c-4499-4e0e-a24e-f821716ab13d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:23.297051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159c8c-4499-4e0e-a24e-f821716ab13d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:23.297541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159c8c-4499-4e0e-a24e-f821716ab13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:23.350856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-95159c8c-4499-4e0e-a24e-f821716ab13d None None] MFA Rules not processed for user `a675ad19db254271ba12d2812d0732e3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:23.359234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-95159c8c-4499-4e0e-a24e-f821716ab13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:23.408803 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1403/2809] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:23.442068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf117fc8-412e-4d37-9396-1f44a98463b8 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:23.443794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf117fc8-412e-4d37-9396-1f44a98463b8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:23.444484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf117fc8-412e-4d37-9396-1f44a98463b8 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:23.445983 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1407/2810] 10.222.0.16 () {54 vars in 921 bytes} [Mon Aug 29 15:31:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:31:23.462763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3570-4012-4e15-a68a-859e2370666c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:23.464075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3570-4012-4e15-a68a-859e2370666c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:23.464517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3570-4012-4e15-a68a-859e2370666c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:23.567062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-57ff3570-4012-4e15-a68a-859e2370666c None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:23.575020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-57ff3570-4012-4e15-a68a-859e2370666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:23.642252 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1404/2811] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 15:31:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:31:23.732530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf117fc8-412e-4d37-9396-1f44a98463b8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:23.734675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cf117fc8-412e-4d37-9396-1f44a98463b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:23.767024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf117fc8-412e-4d37-9396-1f44a98463b8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:23.785284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477959e7-812c-45f6-aabd-94be5188b24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:23.787486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477959e7-812c-45f6-aabd-94be5188b24d service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:23.788307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477959e7-812c-45f6-aabd-94be5188b24d service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:23.790158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477959e7-812c-45f6-aabd-94be5188b24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:23.836067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477959e7-812c-45f6-aabd-94be5188b24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:23.837723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477959e7-812c-45f6-aabd-94be5188b24d service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:23.914006 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1408/2812] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:26.451411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff3570-4012-4e15-a68a-859e2370666c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:26.453545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba21c70-6f6a-4a2d-aef6-638194a2b77f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:26.453943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba21c70-6f6a-4a2d-aef6-638194a2b77f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:26.457942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba21c70-6f6a-4a2d-aef6-638194a2b77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:26.496102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff3570-4012-4e15-a68a-859e2370666c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:26.534937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0639b92-d18d-49a5-aab4-f9f4685ae375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:26.536806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0639b92-d18d-49a5-aab4-f9f4685ae375 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:26.537341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0639b92-d18d-49a5-aab4-f9f4685ae375 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:26.537889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0639b92-d18d-49a5-aab4-f9f4685ae375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:26.544458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c0639b92-d18d-49a5-aab4-f9f4685ae375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:26.574175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7ba21c70-6f6a-4a2d-aef6-638194a2b77f None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:26.576368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7ba21c70-6f6a-4a2d-aef6-638194a2b77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:26.603518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0639b92-d18d-49a5-aab4-f9f4685ae375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:26.611635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0639b92-d18d-49a5-aab4-f9f4685ae375 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:26.671746 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1405/2813] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:26.700061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0639b92-d18d-49a5-aab4-f9f4685ae375 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:26.729680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0639b92-d18d-49a5-aab4-f9f4685ae375 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:26.747379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37612d-3295-46b1-a983-17ce262af8da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:26.749196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37612d-3295-46b1-a983-17ce262af8da service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:26.753082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37612d-3295-46b1-a983-17ce262af8da service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:26.753562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37612d-3295-46b1-a983-17ce262af8da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:26.756068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fb37612d-3295-46b1-a983-17ce262af8da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:26.786166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37612d-3295-46b1-a983-17ce262af8da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:26.790781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37612d-3295-46b1-a983-17ce262af8da service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:26.792344 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1409/2814] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:31:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:26.808888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba21c70-6f6a-4a2d-aef6-638194a2b77f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:26.810709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7ba21c70-6f6a-4a2d-aef6-638194a2b77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:26.829855 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1406/2815] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:26.995219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba21c70-6f6a-4a2d-aef6-638194a2b77f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:27.011890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd526475-5a5b-4b97-94b4-6996fbf7d426 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:27.012824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd526475-5a5b-4b97-94b4-6996fbf7d426 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:27.013297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd526475-5a5b-4b97-94b4-6996fbf7d426 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:27.013974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd526475-5a5b-4b97-94b4-6996fbf7d426 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:27.049496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd526475-5a5b-4b97-94b4-6996fbf7d426 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:27.051315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd526475-5a5b-4b97-94b4-6996fbf7d426 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:27.072519 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1410/2816] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:31:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:31:28.750818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78935d81-8f4c-4593-a9f4-b5696574c7bc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:28.751367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78935d81-8f4c-4593-a9f4-b5696574c7bc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:28.751367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78935d81-8f4c-4593-a9f4-b5696574c7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:28.894238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-78935d81-8f4c-4593-a9f4-b5696574c7bc None None] MFA Rules not processed for user `783eb573b9464ca2a9dc618d07caa679`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:28.899830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-78935d81-8f4c-4593-a9f4-b5696574c7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:29.164279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:29.308756 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1407/2817] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 561 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:30.597041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd526475-5a5b-4b97-94b4-6996fbf7d426 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:30.613794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd526475-5a5b-4b97-94b4-6996fbf7d426 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:30.621613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0f646-dc7f-4484-849c-0584ba5f526f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:30.623647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f646-dc7f-4484-849c-0584ba5f526f service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:30.625209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f646-dc7f-4484-849c-0584ba5f526f service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:30.625819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f646-dc7f-4484-849c-0584ba5f526f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:30.641462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0f646-dc7f-4484-849c-0584ba5f526f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:30.644306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0f646-dc7f-4484-849c-0584ba5f526f service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:30.685631 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1411/2818] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:39.284745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:40.652573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:40.919134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78935d81-8f4c-4593-a9f4-b5696574c7bc None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:40.970561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78935d81-8f4c-4593-a9f4-b5696574c7bc None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:40.990112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e308e7-36ac-4156-9ac9-daae416da3f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:40.990774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e308e7-36ac-4156-9ac9-daae416da3f6 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:40.991060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e308e7-36ac-4156-9ac9-daae416da3f6 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:40.991339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e308e7-36ac-4156-9ac9-daae416da3f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:41.019571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e308e7-36ac-4156-9ac9-daae416da3f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:41.021417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e308e7-36ac-4156-9ac9-daae416da3f6 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:41.053075 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1408/2819] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:41.204561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ebcdf-d427-45a2-ae49-d382b521fff9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:41.204903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ebcdf-d427-45a2-ae49-d382b521fff9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:41.205034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ebcdf-d427-45a2-ae49-d382b521fff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:41.246709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7c1ebcdf-d427-45a2-ae49-d382b521fff9 None None] MFA Rules not processed for user `783eb573b9464ca2a9dc618d07caa679`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:41.247582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7c1ebcdf-d427-45a2-ae49-d382b521fff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:41.272073 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1412/2820] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:42.783541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e308e7-36ac-4156-9ac9-daae416da3f6 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:42.797238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e308e7-36ac-4156-9ac9-daae416da3f6 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:42.801528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e262bc-1aa3-4fd1-b719-228a13aa1519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:42.802150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e262bc-1aa3-4fd1-b719-228a13aa1519 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:42.802433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e262bc-1aa3-4fd1-b719-228a13aa1519 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:42.802710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e262bc-1aa3-4fd1-b719-228a13aa1519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:42.805092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-34e262bc-1aa3-4fd1-b719-228a13aa1519 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:42.817434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e262bc-1aa3-4fd1-b719-228a13aa1519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:42.819147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e262bc-1aa3-4fd1-b719-228a13aa1519 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:42.833884 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1409/2821] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:45.112049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ebcdf-d427-45a2-ae49-d382b521fff9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:45.137534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ebcdf-d427-45a2-ae49-d382b521fff9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:45.152945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5230d27-be4d-4245-a6de-27115deb6671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:45.155042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5230d27-be4d-4245-a6de-27115deb6671 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:45.155631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5230d27-be4d-4245-a6de-27115deb6671 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:45.156275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5230d27-be4d-4245-a6de-27115deb6671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:45.158748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e5230d27-be4d-4245-a6de-27115deb6671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:45.185696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5230d27-be4d-4245-a6de-27115deb6671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:45.187354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5230d27-be4d-4245-a6de-27115deb6671 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:45.212733 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1413/2822] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:47.730528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af216d-3597-4e41-9e3c-2d8512fde040 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:47.731130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af216d-3597-4e41-9e3c-2d8512fde040 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:47.731564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af216d-3597-4e41-9e3c-2d8512fde040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:47.765208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-85af216d-3597-4e41-9e3c-2d8512fde040 None None] MFA Rules not processed for user `a74e72e4a61e4938b54dbb1e51db99dc`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:47.768167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-85af216d-3597-4e41-9e3c-2d8512fde040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:47.793200 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1410/2823] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:52.616336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5230d27-be4d-4245-a6de-27115deb6671 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:52.617956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e5230d27-be4d-4245-a6de-27115deb6671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:52.727130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5230d27-be4d-4245-a6de-27115deb6671 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:52.733569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:52.735220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:52.735767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:52.736596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] PATH_INFO: `/v3/users/1ff9744258414abeb64b442b0d295c1c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:52.741163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff9744258414abeb64b442b0d295c1c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:52.746398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:52.824527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff9744258414abeb64b442b0d295c1c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:52.825757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff9744258414abeb64b442b0d295c1c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:52.846248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff9744258414abeb64b442b0d295c1c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:52.848151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff9744258414abeb64b442b0d295c1c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:52.859697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff9744258414abeb64b442b0d295c1c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:52.901590 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1414/2824] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:31:52 2022] DELETE /identity/v3/users/1ff9744258414abeb64b442b0d295c1c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:53.512932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af216d-3597-4e41-9e3c-2d8512fde040 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:53.528753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af216d-3597-4e41-9e3c-2d8512fde040 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:53.648621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:53.649563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:53.649861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:53.650145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] PATH_INFO: `/v3/projects/879d436e9d1a43ee8df0e652dbb6307a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:53.652171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=879d436e9d1a43ee8df0e652dbb6307a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:53.654164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:53.722821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879d436e9d1a43ee8df0e652dbb6307a', 'request_id': 'req-965563f9-7431-48a9-b347-926763f20cff'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:53.731201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879d436e9d1a43ee8df0e652dbb6307a', 'request_id': 'req-965563f9-7431-48a9-b347-926763f20cff'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:53.741659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879d436e9d1a43ee8df0e652dbb6307a', 'request_id': 'req-965563f9-7431-48a9-b347-926763f20cff'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:53.777985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] The token cache is being invalidate because project 879d436e9d1a43ee8df0e652dbb6307a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:31:53.778600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:53.779586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:53.785749 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1411/2825] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:53 2022] DELETE /identity/v3/projects/879d436e9d1a43ee8df0e652dbb6307a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:53.786493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:53.787986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:53.805286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374b563-d254-4d6f-8082-e4c905443761 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:53.910332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187c992-3784-4f96-824a-ff751d87b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:53.912441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187c992-3784-4f96-824a-ff751d87b1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:53.913008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187c992-3784-4f96-824a-ff751d87b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:53.913488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187c992-3784-4f96-824a-ff751d87b1b4 admin admin] PATH_INFO: `/v3/users/958a45cf5eb647df9b53037171349898` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:53.915954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187c992-3784-4f96-824a-ff751d87b1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=958a45cf5eb647df9b53037171349898)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:53.920057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187c992-3784-4f96-824a-ff751d87b1b4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:53.922586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:54.013852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b187c992-3784-4f96-824a-ff751d87b1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '958a45cf5eb647df9b53037171349898'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:54.013852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b187c992-3784-4f96-824a-ff751d87b1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '958a45cf5eb647df9b53037171349898'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:54.022746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b187c992-3784-4f96-824a-ff751d87b1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '958a45cf5eb647df9b53037171349898'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:54.023273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b187c992-3784-4f96-824a-ff751d87b1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '958a45cf5eb647df9b53037171349898'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:54.032888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b187c992-3784-4f96-824a-ff751d87b1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '958a45cf5eb647df9b53037171349898'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:54.054629 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1415/2826] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:31:53 2022] DELETE /identity/v3/users/958a45cf5eb647df9b53037171349898 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:54.460057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:54.462187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:54.480961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965563f9-7431-48a9-b347-926763f20cff admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:54.607391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:54.621137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:54.622135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:54.622847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:54.623308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] PATH_INFO: `/v3/projects/64edf13094b74182b6d8b33ad3026b5c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:54.625957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64edf13094b74182b6d8b33ad3026b5c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:54.628064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:54.696340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64edf13094b74182b6d8b33ad3026b5c', 'request_id': 'req-6e09fd5a-b537-450d-9c68-fb9fa2742d35'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:54.705705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64edf13094b74182b6d8b33ad3026b5c', 'request_id': 'req-6e09fd5a-b537-450d-9c68-fb9fa2742d35'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:54.722335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64edf13094b74182b6d8b33ad3026b5c', 'request_id': 'req-6e09fd5a-b537-450d-9c68-fb9fa2742d35'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:54.779780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] The token cache is being invalidate because project 64edf13094b74182b6d8b33ad3026b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:31:54.780361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:54.781866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6e09fd5a-b537-450d-9c68-fb9fa2742d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:31:54.785531 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1412/2827] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:31:54 2022] DELETE /identity/v3/projects/64edf13094b74182b6d8b33ad3026b5c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:54.791395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5044a2-8a79-40ff-b5ea-51e8fb506811 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:54.791951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5044a2-8a79-40ff-b5ea-51e8fb506811 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:54.791951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5044a2-8a79-40ff-b5ea-51e8fb506811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:54.837264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2c5044a2-8a79-40ff-b5ea-51e8fb506811 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:54.838630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2c5044a2-8a79-40ff-b5ea-51e8fb506811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:54.960355 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1416/2828] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:54.969206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e020-8208-4f4b-9541-1fb635fee625 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:54.970805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e020-8208-4f4b-9541-1fb635fee625 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:54.971513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e020-8208-4f4b-9541-1fb635fee625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:55.012140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1004e020-8208-4f4b-9541-1fb635fee625 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:55.013372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1004e020-8208-4f4b-9541-1fb635fee625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:55.042431 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1413/2829] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:55.047118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5044a2-8a79-40ff-b5ea-51e8fb506811 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:55.060666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5044a2-8a79-40ff-b5ea-51e8fb506811 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:55.074844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74df76-aba1-42e0-9456-a01fa706456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:55.075463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74df76-aba1-42e0-9456-a01fa706456b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:55.075794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74df76-aba1-42e0-9456-a01fa706456b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:55.076063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74df76-aba1-42e0-9456-a01fa706456b admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:55.076762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74df76-aba1-42e0-9456-a01fa706456b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:31:55.077062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74df76-aba1-42e0-9456-a01fa706456b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:55.078723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74df76-aba1-42e0-9456-a01fa706456b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:55.114579 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1417/2830] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:31:55.190534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004e020-8208-4f4b-9541-1fb635fee625 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:55.200534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004e020-8208-4f4b-9541-1fb635fee625 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:55.214446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13cb3b-86da-40d6-80eb-9397972311ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:55.215066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13cb3b-86da-40d6-80eb-9397972311ae admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:55.215550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13cb3b-86da-40d6-80eb-9397972311ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:55.215827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13cb3b-86da-40d6-80eb-9397972311ae admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:55.217577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13cb3b-86da-40d6-80eb-9397972311ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:55.220225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13cb3b-86da-40d6-80eb-9397972311ae admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:55.270684 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1414/2831] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:31:55 2022] POST /identity/v3/projects => generated 397 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:31:55.274847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74df76-aba1-42e0-9456-a01fa706456b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:55.288691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74df76-aba1-42e0-9456-a01fa706456b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:55.370765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eb7ae-cf94-43d8-a47a-cbac6328634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:55.372144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb7ae-cf94-43d8-a47a-cbac6328634c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:55.372637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb7ae-cf94-43d8-a47a-cbac6328634c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:55.373112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb7ae-cf94-43d8-a47a-cbac6328634c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:55.374454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eb7ae-cf94-43d8-a47a-cbac6328634c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:55.378181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eb7ae-cf94-43d8-a47a-cbac6328634c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:55.404910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:55.434701 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1418/2832] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:31:55 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:31:55.438546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13cb3b-86da-40d6-80eb-9397972311ae admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:55.461003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13cb3b-86da-40d6-80eb-9397972311ae admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:55.476453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f46e-0bf2-4567-87f9-2ae00c2bc81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:55.477605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f46e-0bf2-4567-87f9-2ae00c2bc81c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:55.478489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f46e-0bf2-4567-87f9-2ae00c2bc81c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:55.478992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f46e-0bf2-4567-87f9-2ae00c2bc81c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:55.480186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5f46e-0bf2-4567-87f9-2ae00c2bc81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:55.482322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5f46e-0bf2-4567-87f9-2ae00c2bc81c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:55.495702 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1415/2833] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:31:55.499501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eb7ae-cf94-43d8-a47a-cbac6328634c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:55.512515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eb7ae-cf94-43d8-a47a-cbac6328634c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:55.519636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40d623-97f7-4653-827d-14d23425b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:55.520263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40d623-97f7-4653-827d-14d23425b177 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:55.520550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40d623-97f7-4653-827d-14d23425b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:55.520804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40d623-97f7-4653-827d-14d23425b177 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:55.521752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40d623-97f7-4653-827d-14d23425b177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:55.523077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40d623-97f7-4653-827d-14d23425b177 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:55.538509 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1419/2834] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:31:55.542897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f46e-0bf2-4567-87f9-2ae00c2bc81c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:55.554446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f46e-0bf2-4567-87f9-2ae00c2bc81c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:55.560361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7b599-aa2b-4639-b678-08d13ac574bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:55.561066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7b599-aa2b-4639-b678-08d13ac574bc admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:55.561344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7b599-aa2b-4639-b678-08d13ac574bc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:55.561647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7b599-aa2b-4639-b678-08d13ac574bc admin admin] PATH_INFO: `/v3/projects/1b0e1286b14d4f749e3216980f645523/users/a47bb5a8721d4c09933fec4331761a41/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:55.581763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7b599-aa2b-4639-b678-08d13ac574bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0e1286b14d4f749e3216980f645523, user_id=a47bb5a8721d4c09933fec4331761a41, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:55.585125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7b599-aa2b-4639-b678-08d13ac574bc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:55.610536 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1416/2835] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:31:55 2022] PUT /identity/v3/projects/1b0e1286b14d4f749e3216980f645523/users/a47bb5a8721d4c09933fec4331761a41/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:31:55.616011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7a2b-f197-4c2f-a81d-25b090df2f63 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:55.616648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7a2b-f197-4c2f-a81d-25b090df2f63 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:55.617295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7a2b-f197-4c2f-a81d-25b090df2f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:55.646582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d4bf7a2b-f197-4c2f-a81d-25b090df2f63 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:55.647985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d4bf7a2b-f197-4c2f-a81d-25b090df2f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:55.731575 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1420/2836] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:55.777848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7b599-aa2b-4639-b678-08d13ac574bc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:55.779932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4fb7b599-aa2b-4639-b678-08d13ac574bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:55.892121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7b599-aa2b-4639-b678-08d13ac574bc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:31:55.896366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9172d-2ef8-4190-af9a-23001df48963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:31:55.897047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9172d-2ef8-4190-af9a-23001df48963 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:55.897329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9172d-2ef8-4190-af9a-23001df48963 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:55.897659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9172d-2ef8-4190-af9a-23001df48963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:55.909031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9172d-2ef8-4190-af9a-23001df48963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:31:55.910775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9172d-2ef8-4190-af9a-23001df48963 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:31:55.926335 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1417/2837] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:31:59.646701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d2a7-456d-4025-aefb-247756f54d11 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:31:59.647604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d2a7-456d-4025-aefb-247756f54d11 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:31:59.648032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d2a7-456d-4025-aefb-247756f54d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:31:59.692386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f2b4d2a7-456d-4025-aefb-247756f54d11 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:31:59.694000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f2b4d2a7-456d-4025-aefb-247756f54d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:59.844862 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1421/2838] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:31:59.877622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9172d-2ef8-4190-af9a-23001df48963 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:31:59.880540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bcd9172d-2ef8-4190-af9a-23001df48963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:31:59.969734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:00.061799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9172d-2ef8-4190-af9a-23001df48963 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:00.085602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76ae9a-a974-4d60-a8dd-09749fe4e616 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:00.086284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ae9a-a974-4d60-a8dd-09749fe4e616 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:00.086560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ae9a-a974-4d60-a8dd-09749fe4e616 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:00.086830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ae9a-a974-4d60-a8dd-09749fe4e616 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:00.108280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76ae9a-a974-4d60-a8dd-09749fe4e616 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:00.110282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76ae9a-a974-4d60-a8dd-09749fe4e616 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:00.139273 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1418/2839] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:09.452735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54e13-764a-445b-9459-93ba9268728f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:09.453288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54e13-764a-445b-9459-93ba9268728f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:09.453288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54e13-764a-445b-9459-93ba9268728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:09.550544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bac54e13-764a-445b-9459-93ba9268728f None None] MFA Rules not processed for user `a47bb5a8721d4c09933fec4331761a41`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:09.551810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bac54e13-764a-445b-9459-93ba9268728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:09.842442 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1422/2840] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:09.851892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef85a77-3c67-4402-8901-7de5019d2b1a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:09.852802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef85a77-3c67-4402-8901-7de5019d2b1a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:09.853475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef85a77-3c67-4402-8901-7de5019d2b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:09.903112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-bef85a77-3c67-4402-8901-7de5019d2b1a None None] MFA Rules not processed for user `a47bb5a8721d4c09933fec4331761a41`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:09.911459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bef85a77-3c67-4402-8901-7de5019d2b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:09.941504 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1419/2841] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:10.251449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac54e13-764a-445b-9459-93ba9268728f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:10.253375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bac54e13-764a-445b-9459-93ba9268728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:10.288561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:10.357533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac54e13-764a-445b-9459-93ba9268728f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:10.364966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176f699-fedc-4563-b9eb-74cea2a19913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:10.365750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f699-fedc-4563-b9eb-74cea2a19913 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:10.366251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f699-fedc-4563-b9eb-74cea2a19913 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:10.366638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f699-fedc-4563-b9eb-74cea2a19913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:10.379600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176f699-fedc-4563-b9eb-74cea2a19913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:10.381855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176f699-fedc-4563-b9eb-74cea2a19913 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:10.411531 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1423/2842] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:10 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:32:16.057521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfc642-0fa6-4ee1-846b-e26c07c10755 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:16.058063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfc642-0fa6-4ee1-846b-e26c07c10755 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:16.058190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfc642-0fa6-4ee1-846b-e26c07c10755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:16.123971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a8bfc642-0fa6-4ee1-846b-e26c07c10755 None None] MFA Rules not processed for user `1869270af6874c4db42112d4aa9417a6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:16.125224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a8bfc642-0fa6-4ee1-846b-e26c07c10755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:16.299423 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1420/2843] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:19.247716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb43bb-c7fb-4745-a420-6576588e5760 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:19.248993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb43bb-c7fb-4745-a420-6576588e5760 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:19.249455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb43bb-c7fb-4745-a420-6576588e5760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:19.291949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b3eb43bb-c7fb-4745-a420-6576588e5760 None None] MFA Rules not processed for user `f331c1e3ee1442ad863d8909ca76020b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:19.293680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b3eb43bb-c7fb-4745-a420-6576588e5760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:19.515937 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1424/2844] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:22.904326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfc642-0fa6-4ee1-846b-e26c07c10755 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:22.905922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a8bfc642-0fa6-4ee1-846b-e26c07c10755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:22.934457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfc642-0fa6-4ee1-846b-e26c07c10755 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:22.940965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:22.941678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:22.941960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:22.942237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] PATH_INFO: `/v3/users/a74e72e4a61e4938b54dbb1e51db99dc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:22.949244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a74e72e4a61e4938b54dbb1e51db99dc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:22.951287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:23.137180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a74e72e4a61e4938b54dbb1e51db99dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:23.138281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a74e72e4a61e4938b54dbb1e51db99dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:23.171537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a74e72e4a61e4938b54dbb1e51db99dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:23.184723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a74e72e4a61e4938b54dbb1e51db99dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:23.195606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a74e72e4a61e4938b54dbb1e51db99dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:23.207189 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1421/2845] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:32:22 2022] DELETE /identity/v3/users/a74e72e4a61e4938b54dbb1e51db99dc => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:23.211650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da020c-1dcd-4e12-81ee-dd4985dc0841 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:23.212704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da020c-1dcd-4e12-81ee-dd4985dc0841 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:23.213675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da020c-1dcd-4e12-81ee-dd4985dc0841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:23.261061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-37da020c-1dcd-4e12-81ee-dd4985dc0841 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:23.264890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-37da020c-1dcd-4e12-81ee-dd4985dc0841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:23.386255 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1425/2846] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:23.482523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:23.485499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:23.552191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:23.604382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12406-0fdd-4624-8b15-f70668d14154 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:23.608446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd73f7-bfba-49d9-8573-db78d71de1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:23.609186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd73f7-bfba-49d9-8573-db78d71de1cc service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:23.609604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd73f7-bfba-49d9-8573-db78d71de1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:23.609956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd73f7-bfba-49d9-8573-db78d71de1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:23.636213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd73f7-bfba-49d9-8573-db78d71de1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:23.639864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd73f7-bfba-49d9-8573-db78d71de1cc service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:23.662680 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1422/2847] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:25.291706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da020c-1dcd-4e12-81ee-dd4985dc0841 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:25.293331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-37da020c-1dcd-4e12-81ee-dd4985dc0841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:25.324009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da020c-1dcd-4e12-81ee-dd4985dc0841 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:25.338848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:25.343022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:25.343310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:25.343590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] PATH_INFO: `/v3/projects/ce5236a48a4d4aa9800ca11f08fb7b8a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:25.350877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5236a48a4d4aa9800ca11f08fb7b8a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:25.359516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:25.516268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:25.531190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'request_id': 'req-56871994-2c9f-4065-806c-c7a4a6774e26'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:25.550295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'request_id': 'req-56871994-2c9f-4065-806c-c7a4a6774e26'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:25.564080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5236a48a4d4aa9800ca11f08fb7b8a', 'request_id': 'req-56871994-2c9f-4065-806c-c7a4a6774e26'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:25.596509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] The token cache is being invalidate because project ce5236a48a4d4aa9800ca11f08fb7b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:32:25.597896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:25.600324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:25.608014 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1426/2848] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:25 2022] DELETE /identity/v3/projects/ce5236a48a4d4aa9800ca11f08fb7b8a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:25.609304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd73f7-bfba-49d9-8573-db78d71de1cc service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:25.623748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd73f7-bfba-49d9-8573-db78d71de1cc service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:25.752496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e71d17-99f3-47a7-9a8d-15b5d47e91b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:25.753846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e71d17-99f3-47a7-9a8d-15b5d47e91b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:25.754689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e71d17-99f3-47a7-9a8d-15b5d47e91b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:25.754689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e71d17-99f3-47a7-9a8d-15b5d47e91b2 admin admin] PATH_INFO: `/v3/users/65243ed083394cb7b9a5e9d50f9ebf07` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:25.756661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e71d17-99f3-47a7-9a8d-15b5d47e91b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65243ed083394cb7b9a5e9d50f9ebf07)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:25.759297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e71d17-99f3-47a7-9a8d-15b5d47e91b2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:25.851817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-40e71d17-99f3-47a7-9a8d-15b5d47e91b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65243ed083394cb7b9a5e9d50f9ebf07'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:25.853431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-40e71d17-99f3-47a7-9a8d-15b5d47e91b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65243ed083394cb7b9a5e9d50f9ebf07'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:25.881673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-40e71d17-99f3-47a7-9a8d-15b5d47e91b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65243ed083394cb7b9a5e9d50f9ebf07'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:25.899068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-40e71d17-99f3-47a7-9a8d-15b5d47e91b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65243ed083394cb7b9a5e9d50f9ebf07'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:25.912631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-40e71d17-99f3-47a7-9a8d-15b5d47e91b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65243ed083394cb7b9a5e9d50f9ebf07'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:25.921452 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1423/2849] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:32:25 2022] DELETE /identity/v3/users/65243ed083394cb7b9a5e9d50f9ebf07 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:26.415851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:26.417279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:26.439356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871994-2c9f-4065-806c-c7a4a6774e26 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:26.554786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:26.555381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:26.555666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:26.555980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] PATH_INFO: `/v3/projects/fe92f3b58a4a4d9591f63b06088e2267` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:26.557890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe92f3b58a4a4d9591f63b06088e2267)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:26.561986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:26.624737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe92f3b58a4a4d9591f63b06088e2267', 'request_id': 'req-e65174e8-52bf-478f-8221-a9e8c8eaf720'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:26.631699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe92f3b58a4a4d9591f63b06088e2267', 'request_id': 'req-e65174e8-52bf-478f-8221-a9e8c8eaf720'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:26.643039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe92f3b58a4a4d9591f63b06088e2267', 'request_id': 'req-e65174e8-52bf-478f-8221-a9e8c8eaf720'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:26.656352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] The token cache is being invalidate because project fe92f3b58a4a4d9591f63b06088e2267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:32:26.656597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:26.657276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e65174e8-52bf-478f-8221-a9e8c8eaf720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:26.659376 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1427/2850] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:26 2022] DELETE /identity/v3/projects/fe92f3b58a4a4d9591f63b06088e2267 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:26.664046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256bbc3-8ed6-463a-9bc8-902886e785f2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:26.664578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256bbc3-8ed6-463a-9bc8-902886e785f2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:26.664578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256bbc3-8ed6-463a-9bc8-902886e785f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:26.691254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5256bbc3-8ed6-463a-9bc8-902886e785f2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:26.692379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5256bbc3-8ed6-463a-9bc8-902886e785f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:26.750579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:26.773901 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1424/2851] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:26.782981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a80c6-85e7-4dbe-8de6-755b15f4ea4b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:26.783465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a80c6-85e7-4dbe-8de6-755b15f4ea4b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:26.783899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a80c6-85e7-4dbe-8de6-755b15f4ea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:26.819889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-701a80c6-85e7-4dbe-8de6-755b15f4ea4b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:26.821986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-701a80c6-85e7-4dbe-8de6-755b15f4ea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:26.831518 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1428/2852] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:26.835822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256bbc3-8ed6-463a-9bc8-902886e785f2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:26.853312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256bbc3-8ed6-463a-9bc8-902886e785f2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:26.861092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901e0d-9e59-417a-8256-925774a1815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:26.861749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901e0d-9e59-417a-8256-925774a1815e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:26.862027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901e0d-9e59-417a-8256-925774a1815e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:26.862326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901e0d-9e59-417a-8256-925774a1815e admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:26.863201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28901e0d-9e59-417a-8256-925774a1815e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:32:26.863446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28901e0d-9e59-417a-8256-925774a1815e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:26.865272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28901e0d-9e59-417a-8256-925774a1815e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:26.879519 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1425/2853] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:32:26.884954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a80c6-85e7-4dbe-8de6-755b15f4ea4b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:26.900384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a80c6-85e7-4dbe-8de6-755b15f4ea4b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:26.907944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1119c5-e8e2-43ed-9a37-c7d76589adbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:26.908570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1119c5-e8e2-43ed-9a37-c7d76589adbe admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:26.908946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1119c5-e8e2-43ed-9a37-c7d76589adbe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:26.909228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1119c5-e8e2-43ed-9a37-c7d76589adbe admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:26.909908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1119c5-e8e2-43ed-9a37-c7d76589adbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:26.913192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1119c5-e8e2-43ed-9a37-c7d76589adbe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:26.949429 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1429/2854] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:32:26 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:26.953680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901e0d-9e59-417a-8256-925774a1815e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:26.968125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901e0d-9e59-417a-8256-925774a1815e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:27.042204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d9d54-cc44-4337-b529-765bc8fa9b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:27.042437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d9d54-cc44-4337-b529-765bc8fa9b4a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:27.042556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d9d54-cc44-4337-b529-765bc8fa9b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:27.042804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d9d54-cc44-4337-b529-765bc8fa9b4a admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:27.043436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d9d54-cc44-4337-b529-765bc8fa9b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:27.045706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d9d54-cc44-4337-b529-765bc8fa9b4a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:27.083789 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1426/2855] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:32:26 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:27.085019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1119c5-e8e2-43ed-9a37-c7d76589adbe admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:27.099980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1119c5-e8e2-43ed-9a37-c7d76589adbe admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:27.107978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425ad52-baf8-4b5b-af27-aa6ba06da021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:27.109263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425ad52-baf8-4b5b-af27-aa6ba06da021 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:27.110059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425ad52-baf8-4b5b-af27-aa6ba06da021 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:27.110821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425ad52-baf8-4b5b-af27-aa6ba06da021 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:27.111893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425ad52-baf8-4b5b-af27-aa6ba06da021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:27.114542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425ad52-baf8-4b5b-af27-aa6ba06da021 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:27.128258 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1430/2856] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:27.133028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d9d54-cc44-4337-b529-765bc8fa9b4a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:27.149492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d9d54-cc44-4337-b529-765bc8fa9b4a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:27.175227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ce78-b278-497f-8219-8bdd42467e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:27.175998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ce78-b278-497f-8219-8bdd42467e42 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:27.176338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ce78-b278-497f-8219-8bdd42467e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:27.176683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ce78-b278-497f-8219-8bdd42467e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:27.177470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ce78-b278-497f-8219-8bdd42467e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:27.179899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ce78-b278-497f-8219-8bdd42467e42 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:27.204731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425ad52-baf8-4b5b-af27-aa6ba06da021 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:27.205989 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1427/2857] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:27.218452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425ad52-baf8-4b5b-af27-aa6ba06da021 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:27.225536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fd385-fb0f-4a3f-893f-04716a686ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:27.226214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd385-fb0f-4a3f-893f-04716a686ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:27.226777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd385-fb0f-4a3f-893f-04716a686ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:27.227060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd385-fb0f-4a3f-893f-04716a686ef6 admin admin] PATH_INFO: `/v3/projects/beba0e05ab32426db226acfb78ec7d8d/users/75c566d8fca04caab835026d330e2001/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:27.271438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fd385-fb0f-4a3f-893f-04716a686ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beba0e05ab32426db226acfb78ec7d8d, user_id=75c566d8fca04caab835026d330e2001, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:27.275118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fd385-fb0f-4a3f-893f-04716a686ef6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:27.300028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:27.308448 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1431/2858] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:27 2022] PUT /identity/v3/projects/beba0e05ab32426db226acfb78ec7d8d/users/75c566d8fca04caab835026d330e2001/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:27.319340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54aa1f-1489-40e5-97a2-9e74020c8bbb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:27.319686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54aa1f-1489-40e5-97a2-9e74020c8bbb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:27.320062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54aa1f-1489-40e5-97a2-9e74020c8bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:27.354080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-db54aa1f-1489-40e5-97a2-9e74020c8bbb None None] MFA Rules not processed for user `75c566d8fca04caab835026d330e2001`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:27.355440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db54aa1f-1489-40e5-97a2-9e74020c8bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:27.459721 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1428/2859] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:27.464732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fd385-fb0f-4a3f-893f-04716a686ef6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:27.563028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fd385-fb0f-4a3f-893f-04716a686ef6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:27.567811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67da68-e9a7-4e95-b3df-ca268b0a81a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:27.568582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67da68-e9a7-4e95-b3df-ca268b0a81a0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:27.568878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67da68-e9a7-4e95-b3df-ca268b0a81a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:27.569152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67da68-e9a7-4e95-b3df-ca268b0a81a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:27.570572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67da68-e9a7-4e95-b3df-ca268b0a81a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:27.572840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67da68-e9a7-4e95-b3df-ca268b0a81a0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:27.615275 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1432/2860] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:32:27 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:32:27.625606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54aa1f-1489-40e5-97a2-9e74020c8bbb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:27.658526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54aa1f-1489-40e5-97a2-9e74020c8bbb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:27.791431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:27.811222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf45d3-544e-46b0-ae39-0a806704b6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:27.811856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf45d3-544e-46b0-ae39-0a806704b6eb admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:27.812179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf45d3-544e-46b0-ae39-0a806704b6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:27.812610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf45d3-544e-46b0-ae39-0a806704b6eb admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:27.814014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf45d3-544e-46b0-ae39-0a806704b6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:27.816316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf45d3-544e-46b0-ae39-0a806704b6eb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:27.850564 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1429/2861] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:32:27 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:27.852667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67da68-e9a7-4e95-b3df-ca268b0a81a0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:27.870387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67da68-e9a7-4e95-b3df-ca268b0a81a0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:27.885971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed666601-0d81-4fac-980b-fa892d7c8edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:27.886922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed666601-0d81-4fac-980b-fa892d7c8edb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:27.887410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed666601-0d81-4fac-980b-fa892d7c8edb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:27.887887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed666601-0d81-4fac-980b-fa892d7c8edb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:27.888713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed666601-0d81-4fac-980b-fa892d7c8edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:27.894363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed666601-0d81-4fac-980b-fa892d7c8edb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:27.923697 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1433/2862] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:27.928060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf45d3-544e-46b0-ae39-0a806704b6eb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:27.944494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf45d3-544e-46b0-ae39-0a806704b6eb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:27.963595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d854-08af-43ff-91ec-d419a677538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:27.965651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d854-08af-43ff-91ec-d419a677538d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:27.966091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d854-08af-43ff-91ec-d419a677538d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:27.968947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d854-08af-43ff-91ec-d419a677538d admin admin] PATH_INFO: `/v3/projects/d71702c467134f46ad893cd52fdb5d48/users/a511cb1a7c02454da8606d682735c61f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:28.022570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31d854-08af-43ff-91ec-d419a677538d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71702c467134f46ad893cd52fdb5d48, user_id=a511cb1a7c02454da8606d682735c61f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:28.026356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31d854-08af-43ff-91ec-d419a677538d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:28.053758 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1430/2863] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:27 2022] PUT /identity/v3/projects/d71702c467134f46ad893cd52fdb5d48/users/a511cb1a7c02454da8606d682735c61f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:28.057975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed666601-0d81-4fac-980b-fa892d7c8edb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:28.071616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed666601-0d81-4fac-980b-fa892d7c8edb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:28.166168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9932e-7c44-44ab-96a6-f8235f4f1cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:28.167532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9932e-7c44-44ab-96a6-f8235f4f1cdf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:28.168812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9932e-7c44-44ab-96a6-f8235f4f1cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:28.169243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9932e-7c44-44ab-96a6-f8235f4f1cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:28.170266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9932e-7c44-44ab-96a6-f8235f4f1cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:28.172479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9932e-7c44-44ab-96a6-f8235f4f1cdf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:28.192879 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1434/2864] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:28.196811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d854-08af-43ff-91ec-d419a677538d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:28.208034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d854-08af-43ff-91ec-d419a677538d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:28.220367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dce4a8-b5fe-40d9-ae3c-7ca7c4c79117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:28.227865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce4a8-b5fe-40d9-ae3c-7ca7c4c79117 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:28.233938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce4a8-b5fe-40d9-ae3c-7ca7c4c79117 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:28.234313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce4a8-b5fe-40d9-ae3c-7ca7c4c79117 admin admin] PATH_INFO: `/v3/projects/d71702c467134f46ad893cd52fdb5d48/users/a511cb1a7c02454da8606d682735c61f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:28.236772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dce4a8-b5fe-40d9-ae3c-7ca7c4c79117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71702c467134f46ad893cd52fdb5d48, user_id=a511cb1a7c02454da8606d682735c61f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:28.239907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dce4a8-b5fe-40d9-ae3c-7ca7c4c79117 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:28.265424 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1431/2865] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:28 2022] PUT /identity/v3/projects/d71702c467134f46ad893cd52fdb5d48/users/a511cb1a7c02454da8606d682735c61f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:28.274273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c74613-f164-4ead-b2be-f28e0fa5f9d6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:28.275134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c74613-f164-4ead-b2be-f28e0fa5f9d6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:28.275887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c74613-f164-4ead-b2be-f28e0fa5f9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:28.362308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b9c74613-f164-4ead-b2be-f28e0fa5f9d6 None None] MFA Rules not processed for user `a511cb1a7c02454da8606d682735c61f`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:28.363609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b9c74613-f164-4ead-b2be-f28e0fa5f9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:28.466252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:28.481584 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1435/2866] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:28.488444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dce4a8-b5fe-40d9-ae3c-7ca7c4c79117 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:28.490198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-94dce4a8-b5fe-40d9-ae3c-7ca7c4c79117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:28.595079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dce4a8-b5fe-40d9-ae3c-7ca7c4c79117 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:28.602463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222b548-039e-4395-be36-52e858f6ca6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:28.603430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222b548-039e-4395-be36-52e858f6ca6f service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:28.603739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222b548-039e-4395-be36-52e858f6ca6f service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:28.603997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222b548-039e-4395-be36-52e858f6ca6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:28.615577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222b548-039e-4395-be36-52e858f6ca6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:28.617891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222b548-039e-4395-be36-52e858f6ca6f service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:28.631001 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1432/2867] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:31.107284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c74613-f164-4ead-b2be-f28e0fa5f9d6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:31.122218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c74613-f164-4ead-b2be-f28e0fa5f9d6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:31.128395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b478de-95c6-4c2b-8b9e-915d3dc66978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:31.129302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b478de-95c6-4c2b-8b9e-915d3dc66978 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:31.129719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b478de-95c6-4c2b-8b9e-915d3dc66978 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:31.129986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b478de-95c6-4c2b-8b9e-915d3dc66978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:31.211014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b478de-95c6-4c2b-8b9e-915d3dc66978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:31.214224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b478de-95c6-4c2b-8b9e-915d3dc66978 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:31.228552 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1436/2868] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:31.721093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86285dd5-4a5c-47c4-92f5-7e8a4de01c27 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:31.721725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86285dd5-4a5c-47c4-92f5-7e8a4de01c27 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:31.722092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86285dd5-4a5c-47c4-92f5-7e8a4de01c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:31.750071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-86285dd5-4a5c-47c4-92f5-7e8a4de01c27 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:31.753346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-86285dd5-4a5c-47c4-92f5-7e8a4de01c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:31.848989 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1433/2869] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:31.873053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b478de-95c6-4c2b-8b9e-915d3dc66978 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:31.874837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a9b478de-95c6-4c2b-8b9e-915d3dc66978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:32.043849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b478de-95c6-4c2b-8b9e-915d3dc66978 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:32.052680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2114dd5-d6d1-4270-a648-7c9a123a5059 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:32.053357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2114dd5-d6d1-4270-a648-7c9a123a5059 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:32.053677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2114dd5-d6d1-4270-a648-7c9a123a5059 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:32.053952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2114dd5-d6d1-4270-a648-7c9a123a5059 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:32.069062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2114dd5-d6d1-4270-a648-7c9a123a5059 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:32.072331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2114dd5-d6d1-4270-a648-7c9a123a5059 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:32.092942 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1437/2870] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:32:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:32.919359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf65d2-3fd1-474c-9fea-ebe78d43c6bc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:32.920501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf65d2-3fd1-474c-9fea-ebe78d43c6bc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:32.920870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf65d2-3fd1-474c-9fea-ebe78d43c6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:32.951258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9faf65d2-3fd1-474c-9fea-ebe78d43c6bc None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:32.952649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9faf65d2-3fd1-474c-9fea-ebe78d43c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:32.967748 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1434/2871] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:32:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:32.983067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2114dd5-d6d1-4270-a648-7c9a123a5059 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:32.995412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2114dd5-d6d1-4270-a648-7c9a123a5059 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:33.009603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add3aef-0f2d-4757-b07c-fe63fdad9221 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:33.010158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add3aef-0f2d-4757-b07c-fe63fdad9221 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:33.010445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add3aef-0f2d-4757-b07c-fe63fdad9221 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:33.010716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add3aef-0f2d-4757-b07c-fe63fdad9221 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:33.034252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add3aef-0f2d-4757-b07c-fe63fdad9221 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:33.036080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add3aef-0f2d-4757-b07c-fe63fdad9221 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:33.047608 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1438/2872] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:32:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:33.867510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8a723-e345-4f88-957f-62d57f7dbd57 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:33.868282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8a723-e345-4f88-957f-62d57f7dbd57 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:33.868723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8a723-e345-4f88-957f-62d57f7dbd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:33.892877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2ba8a723-e345-4f88-957f-62d57f7dbd57 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:33.894460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2ba8a723-e345-4f88-957f-62d57f7dbd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:33.904178 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1435/2873] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:32:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:33.927441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add3aef-0f2d-4757-b07c-fe63fdad9221 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:33.940655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add3aef-0f2d-4757-b07c-fe63fdad9221 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:33.950926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2291b8c-7959-41ca-bc31-4a05a43ef09c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:33.951715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291b8c-7959-41ca-bc31-4a05a43ef09c service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:33.952185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291b8c-7959-41ca-bc31-4a05a43ef09c service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:33.952793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291b8c-7959-41ca-bc31-4a05a43ef09c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:33.965849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2291b8c-7959-41ca-bc31-4a05a43ef09c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:33.968183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2291b8c-7959-41ca-bc31-4a05a43ef09c service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:33.978793 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1439/2874] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:32:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:34.389925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527b71d-564a-458c-ac2e-112ff36ee058 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:34.390540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527b71d-564a-458c-ac2e-112ff36ee058 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:34.391277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527b71d-564a-458c-ac2e-112ff36ee058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:34.429833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a527b71d-564a-458c-ac2e-112ff36ee058 None None] MFA Rules not processed for user `a47bb5a8721d4c09933fec4331761a41`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:34.433253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a527b71d-564a-458c-ac2e-112ff36ee058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:34.452115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:34.560756 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1436/2875] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:35.369808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2291b8c-7959-41ca-bc31-4a05a43ef09c service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:35.371493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f2291b8c-7959-41ca-bc31-4a05a43ef09c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:35.461576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2291b8c-7959-41ca-bc31-4a05a43ef09c service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:35.467317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9963b-4d0d-40de-baec-f7184f45e8ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:35.467932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9963b-4d0d-40de-baec-f7184f45e8ec service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:35.468341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9963b-4d0d-40de-baec-f7184f45e8ec service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:35.468793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9963b-4d0d-40de-baec-f7184f45e8ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:35.471182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-65e9963b-4d0d-40de-baec-f7184f45e8ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:35.492054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9963b-4d0d-40de-baec-f7184f45e8ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:35.495001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9963b-4d0d-40de-baec-f7184f45e8ec service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:35.506941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:35.525691 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1440/2876] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:35.597484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527b71d-564a-458c-ac2e-112ff36ee058 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:35.599897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a527b71d-564a-458c-ac2e-112ff36ee058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:35.693158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527b71d-564a-458c-ac2e-112ff36ee058 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:35.701141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41212986-ec58-4ef5-8d98-f727c99ebaa1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:35.702247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41212986-ec58-4ef5-8d98-f727c99ebaa1 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:35.702761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41212986-ec58-4ef5-8d98-f727c99ebaa1 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:35.703244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41212986-ec58-4ef5-8d98-f727c99ebaa1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:35.705696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-41212986-ec58-4ef5-8d98-f727c99ebaa1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:35.730113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41212986-ec58-4ef5-8d98-f727c99ebaa1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:35.732849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41212986-ec58-4ef5-8d98-f727c99ebaa1 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:35.764478 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1437/2877] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:38.022407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9963b-4d0d-40de-baec-f7184f45e8ec service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:38.234555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9963b-4d0d-40de-baec-f7184f45e8ec service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:38.253997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:38.255141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:38.257368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:38.257943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] PATH_INFO: `/v3/users/75c566d8fca04caab835026d330e2001` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:38.263915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c566d8fca04caab835026d330e2001)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:38.266642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:38.418040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c566d8fca04caab835026d330e2001'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:38.418866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c566d8fca04caab835026d330e2001'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:38.450176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c566d8fca04caab835026d330e2001'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:38.451414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c566d8fca04caab835026d330e2001'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:38.487706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c566d8fca04caab835026d330e2001'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:38.512007 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1441/2878] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:32:38 2022] DELETE /identity/v3/users/75c566d8fca04caab835026d330e2001 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:38.516865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15bc3a-f75b-44ab-812a-8f00170d26dd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:38.517480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15bc3a-f75b-44ab-812a-8f00170d26dd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:38.518030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15bc3a-f75b-44ab-812a-8f00170d26dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:38.562862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4e15bc3a-f75b-44ab-812a-8f00170d26dd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:38.565212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4e15bc3a-f75b-44ab-812a-8f00170d26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:38.751237 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1438/2879] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:32:38.759721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:38.761417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:38.930002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b412b8-fc77-4b34-91ed-20ccab9c6fb2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:38.937304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c9a83-d57e-4d9c-8bbd-f6c7b306d6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:38.938057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9a83-d57e-4d9c-8bbd-f6c7b306d6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:38.938251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9a83-d57e-4d9c-8bbd-f6c7b306d6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:38.938506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9a83-d57e-4d9c-8bbd-f6c7b306d6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:38.961138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c9a83-d57e-4d9c-8bbd-f6c7b306d6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:38.965472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c9a83-d57e-4d9c-8bbd-f6c7b306d6e5 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:38.981630 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1442/2880] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:39.622556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15bc3a-f75b-44ab-812a-8f00170d26dd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:39.624043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4e15bc3a-f75b-44ab-812a-8f00170d26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:39.640391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15bc3a-f75b-44ab-812a-8f00170d26dd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:39.660052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:39.660997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:39.661484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:39.661928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] PATH_INFO: `/v3/projects/beba0e05ab32426db226acfb78ec7d8d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:39.662073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14011b-8072-403b-a431-a0678d4e9933 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:39.662560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14011b-8072-403b-a431-a0678d4e9933 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:39.662721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14011b-8072-403b-a431-a0678d4e9933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:39.664120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beba0e05ab32426db226acfb78ec7d8d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:39.667335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:39.688954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9f14011b-8072-403b-a431-a0678d4e9933 None None] MFA Rules not processed for user `e7e71fcf6711470db5a71ddc74ff709c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:39.690209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9f14011b-8072-403b-a431-a0678d4e9933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:39.709972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:39.733948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:39.738867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beba0e05ab32426db226acfb78ec7d8d', 'request_id': 'req-89c07e86-2edf-49e0-bf98-eee6ab910692'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:39.748043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beba0e05ab32426db226acfb78ec7d8d', 'request_id': 'req-89c07e86-2edf-49e0-bf98-eee6ab910692'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:39.757223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beba0e05ab32426db226acfb78ec7d8d', 'request_id': 'req-89c07e86-2edf-49e0-bf98-eee6ab910692'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:39.758325 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1443/2881] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:32:39.771296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] The token cache is being invalidate because project beba0e05ab32426db226acfb78ec7d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:32:39.771591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:39.772268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:39.773780 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1439/2882] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:39 2022] DELETE /identity/v3/projects/beba0e05ab32426db226acfb78ec7d8d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:39.778252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14011b-8072-403b-a431-a0678d4e9933 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:39.791306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14011b-8072-403b-a431-a0678d4e9933 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:40.001502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42f06a-fdd9-4d45-82f5-e080262696aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:40.002109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f06a-fdd9-4d45-82f5-e080262696aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:40.002386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f06a-fdd9-4d45-82f5-e080262696aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:40.002655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f06a-fdd9-4d45-82f5-e080262696aa admin admin] PATH_INFO: `/v3/users/a511cb1a7c02454da8606d682735c61f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:40.004509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42f06a-fdd9-4d45-82f5-e080262696aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a511cb1a7c02454da8606d682735c61f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:40.012657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42f06a-fdd9-4d45-82f5-e080262696aa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:40.100584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-db42f06a-fdd9-4d45-82f5-e080262696aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a511cb1a7c02454da8606d682735c61f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:40.101578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-db42f06a-fdd9-4d45-82f5-e080262696aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a511cb1a7c02454da8606d682735c61f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:40.120320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-db42f06a-fdd9-4d45-82f5-e080262696aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a511cb1a7c02454da8606d682735c61f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:40.121627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-db42f06a-fdd9-4d45-82f5-e080262696aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a511cb1a7c02454da8606d682735c61f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:40.131094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-db42f06a-fdd9-4d45-82f5-e080262696aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a511cb1a7c02454da8606d682735c61f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:40.150456 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1444/2883] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:32:39 2022] DELETE /identity/v3/users/a511cb1a7c02454da8606d682735c61f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:40.959626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:40.961773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:40.987045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c07e86-2edf-49e0-bf98-eee6ab910692 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:41.188960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:41.191289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:41.191978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:41.192851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] PATH_INFO: `/v3/projects/d71702c467134f46ad893cd52fdb5d48` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:41.198024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71702c467134f46ad893cd52fdb5d48)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:41.204639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:41.358781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71702c467134f46ad893cd52fdb5d48', 'request_id': 'req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:41.383171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71702c467134f46ad893cd52fdb5d48', 'request_id': 'req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:41.403878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71702c467134f46ad893cd52fdb5d48', 'request_id': 'req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:41.466496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] The token cache is being invalidate because project d71702c467134f46ad893cd52fdb5d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:32:41.467168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:41.473920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:41.484203 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1440/2884] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:40 2022] DELETE /identity/v3/projects/d71702c467134f46ad893cd52fdb5d48 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:41.485369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d8ba1-869c-492b-b5f9-37a9fc0b1e8e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:41.487030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d8ba1-869c-492b-b5f9-37a9fc0b1e8e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:41.488095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d8ba1-869c-492b-b5f9-37a9fc0b1e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:41.580258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b38d8ba1-869c-492b-b5f9-37a9fc0b1e8e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:41.586666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b38d8ba1-869c-492b-b5f9-37a9fc0b1e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:41.713700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:41.715748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:41.797231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:41.843173 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1445/2885] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:41.852160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6faf5d-084f-4d0b-a24d-476782e00839 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:41.852423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6faf5d-084f-4d0b-a24d-476782e00839 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:41.852734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6faf5d-084f-4d0b-a24d-476782e00839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:41.917777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bb6faf5d-084f-4d0b-a24d-476782e00839 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:41.927227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bb6faf5d-084f-4d0b-a24d-476782e00839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:41.954808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:41.978933 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1446/2886] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:41.982804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6faf5d-084f-4d0b-a24d-476782e00839 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:41.983907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d9266-8f78-4a68-b549-5dc8f3dd6f06 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:41.999680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9841177-e429-4eb6-8fdb-dbb1b1068598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:41.999914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6faf5d-084f-4d0b-a24d-476782e00839 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:42.000940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841177-e429-4eb6-8fdb-dbb1b1068598 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:42.001476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841177-e429-4eb6-8fdb-dbb1b1068598 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:42.001997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841177-e429-4eb6-8fdb-dbb1b1068598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:42.004123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c9841177-e429-4eb6-8fdb-dbb1b1068598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:42.023945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecc547-9376-420a-b900-ae1755e6aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:42.025246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecc547-9376-420a-b900-ae1755e6aa9c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:42.025551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecc547-9376-420a-b900-ae1755e6aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:42.025823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecc547-9376-420a-b900-ae1755e6aa9c admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:42.026615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecc547-9376-420a-b900-ae1755e6aa9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:32:42.026991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecc547-9376-420a-b900-ae1755e6aa9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:42.037452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecc547-9376-420a-b900-ae1755e6aa9c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:42.084764 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1447/2887] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:32:42.086136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecc547-9376-420a-b900-ae1755e6aa9c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:42.099704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9841177-e429-4eb6-8fdb-dbb1b1068598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:42.101645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9841177-e429-4eb6-8fdb-dbb1b1068598 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:42.111209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecc547-9376-420a-b900-ae1755e6aa9c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:42.115360 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1441/2888] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:41 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:42.125822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ba026-2909-4ec8-86e8-7fd704b81e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:42.126254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ba026-2909-4ec8-86e8-7fd704b81e14 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:42.126529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ba026-2909-4ec8-86e8-7fd704b81e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:42.126801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ba026-2909-4ec8-86e8-7fd704b81e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:42.127449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ba026-2909-4ec8-86e8-7fd704b81e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:42.129476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ba026-2909-4ec8-86e8-7fd704b81e14 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:42.192837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9841177-e429-4eb6-8fdb-dbb1b1068598 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:42.204459 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1448/2889] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:32:42 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:32:42.208527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9841177-e429-4eb6-8fdb-dbb1b1068598 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:42.291945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce115ef-934b-4c30-af53-11825426fefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:42.292983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce115ef-934b-4c30-af53-11825426fefb admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:42.293576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce115ef-934b-4c30-af53-11825426fefb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:42.294078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce115ef-934b-4c30-af53-11825426fefb admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:42.295223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce115ef-934b-4c30-af53-11825426fefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:42.297615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce115ef-934b-4c30-af53-11825426fefb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:42.350069 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1442/2890] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:32:42 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:42.354641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ba026-2909-4ec8-86e8-7fd704b81e14 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:42.385055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ba026-2909-4ec8-86e8-7fd704b81e14 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:42.399011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2aef0-15e9-4fad-9b7e-563115e68d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:42.399762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2aef0-15e9-4fad-9b7e-563115e68d2b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:42.400138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2aef0-15e9-4fad-9b7e-563115e68d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:42.400510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2aef0-15e9-4fad-9b7e-563115e68d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:42.401275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2aef0-15e9-4fad-9b7e-563115e68d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:42.406233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2aef0-15e9-4fad-9b7e-563115e68d2b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:42.435824 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1449/2891] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:42.436053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce115ef-934b-4c30-af53-11825426fefb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:42.463507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce115ef-934b-4c30-af53-11825426fefb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:42.481778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee9ab4-b67f-4ae6-b897-3274cd95f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:42.482416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee9ab4-b67f-4ae6-b897-3274cd95f934 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:42.482693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee9ab4-b67f-4ae6-b897-3274cd95f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:42.482968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee9ab4-b67f-4ae6-b897-3274cd95f934 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:42.483638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee9ab4-b67f-4ae6-b897-3274cd95f934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:42.488348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee9ab4-b67f-4ae6-b897-3274cd95f934 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:42.517965 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1443/2892] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:42.522003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2aef0-15e9-4fad-9b7e-563115e68d2b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:42.537536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2aef0-15e9-4fad-9b7e-563115e68d2b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:42.554631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d5650-7fad-4f1a-a7db-e0cf2af8dc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:42.560008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d5650-7fad-4f1a-a7db-e0cf2af8dc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:42.560654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d5650-7fad-4f1a-a7db-e0cf2af8dc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:42.561253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d5650-7fad-4f1a-a7db-e0cf2af8dc09 admin admin] PATH_INFO: `/v3/projects/de0f6374fc924d42869a2a724fcb8771/users/a84f3555640048ab9f632f83d70c7d11/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:42.608290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d5650-7fad-4f1a-a7db-e0cf2af8dc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0f6374fc924d42869a2a724fcb8771, user_id=a84f3555640048ab9f632f83d70c7d11, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:42.611837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d5650-7fad-4f1a-a7db-e0cf2af8dc09 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:42.643304 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1450/2893] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:42 2022] PUT /identity/v3/projects/de0f6374fc924d42869a2a724fcb8771/users/a84f3555640048ab9f632f83d70c7d11/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:42.654026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d682a-bb75-448c-af22-96132aaebc6b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:42.654343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d682a-bb75-448c-af22-96132aaebc6b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:42.654589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d682a-bb75-448c-af22-96132aaebc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:42.698997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-789d682a-bb75-448c-af22-96132aaebc6b None None] MFA Rules not processed for user `a84f3555640048ab9f632f83d70c7d11`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:42.700578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-789d682a-bb75-448c-af22-96132aaebc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:42.813659 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1444/2894] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:42.816986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d5650-7fad-4f1a-a7db-e0cf2af8dc09 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:42.972706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d5650-7fad-4f1a-a7db-e0cf2af8dc09 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:43.000892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747bb1f-f941-4fdc-bc24-59186917fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:43.002774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747bb1f-f941-4fdc-bc24-59186917fbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:43.003077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747bb1f-f941-4fdc-bc24-59186917fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:43.004260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747bb1f-f941-4fdc-bc24-59186917fbf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:43.004959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747bb1f-f941-4fdc-bc24-59186917fbf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:43.007935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747bb1f-f941-4fdc-bc24-59186917fbf4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:43.131077 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1451/2895] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:32:42 2022] POST /identity/v3/projects => generated 375 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:43.139764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d682a-bb75-448c-af22-96132aaebc6b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:43.151223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:43.166861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d682a-bb75-448c-af22-96132aaebc6b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:43.389577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b82b8-97f3-47ef-895f-0e531a2d47ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:43.389577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b82b8-97f3-47ef-895f-0e531a2d47ae admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:43.389577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b82b8-97f3-47ef-895f-0e531a2d47ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:43.389577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b82b8-97f3-47ef-895f-0e531a2d47ae admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:43.390015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b82b8-97f3-47ef-895f-0e531a2d47ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:43.390015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b82b8-97f3-47ef-895f-0e531a2d47ae admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:43.460859 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1445/2896] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:32:43 2022] POST /identity/v3/users => generated 294 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:43.464416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747bb1f-f941-4fdc-bc24-59186917fbf4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:43.486151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747bb1f-f941-4fdc-bc24-59186917fbf4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:43.503852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1559096-6e2b-44f4-87fa-2ff809374a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:43.508925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1559096-6e2b-44f4-87fa-2ff809374a22 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:43.511686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1559096-6e2b-44f4-87fa-2ff809374a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:43.512229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1559096-6e2b-44f4-87fa-2ff809374a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:43.513484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1559096-6e2b-44f4-87fa-2ff809374a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:43.517873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1559096-6e2b-44f4-87fa-2ff809374a22 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:43.560697 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1452/2897] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:43.565208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b82b8-97f3-47ef-895f-0e531a2d47ae admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:43.601032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b82b8-97f3-47ef-895f-0e531a2d47ae admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:43.614778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec03e98-9944-4530-a0ee-58aaf5c643c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:43.615857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec03e98-9944-4530-a0ee-58aaf5c643c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:43.616145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec03e98-9944-4530-a0ee-58aaf5c643c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:43.617333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec03e98-9944-4530-a0ee-58aaf5c643c0 admin admin] PATH_INFO: `/v3/projects/585a0d8d11004c86970f893d343242ea/users/e330611983ab4707ab8bd6efdbfb7302/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:43.655132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec03e98-9944-4530-a0ee-58aaf5c643c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585a0d8d11004c86970f893d343242ea, user_id=e330611983ab4707ab8bd6efdbfb7302, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:43.659181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec03e98-9944-4530-a0ee-58aaf5c643c0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:43.706950 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1446/2898] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:43 2022] PUT /identity/v3/projects/585a0d8d11004c86970f893d343242ea/users/e330611983ab4707ab8bd6efdbfb7302/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:43.711204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1559096-6e2b-44f4-87fa-2ff809374a22 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:43.731424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1559096-6e2b-44f4-87fa-2ff809374a22 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:43.890257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:43.947756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77ef58-f17a-4e82-9946-51b102341da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:43.948376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ef58-f17a-4e82-9946-51b102341da0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:43.948645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ef58-f17a-4e82-9946-51b102341da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:43.948920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ef58-f17a-4e82-9946-51b102341da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:43.951631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77ef58-f17a-4e82-9946-51b102341da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:43.953293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77ef58-f17a-4e82-9946-51b102341da0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:43.981499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec03e98-9944-4530-a0ee-58aaf5c643c0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:43.981912 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1453/2899] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:44.014865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec03e98-9944-4530-a0ee-58aaf5c643c0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:44.024707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a66442-e35f-4ec4-9058-0ae5a0064586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:44.025444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a66442-e35f-4ec4-9058-0ae5a0064586 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:44.025992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a66442-e35f-4ec4-9058-0ae5a0064586 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:44.026299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a66442-e35f-4ec4-9058-0ae5a0064586 admin admin] PATH_INFO: `/v3/projects/585a0d8d11004c86970f893d343242ea/users/e330611983ab4707ab8bd6efdbfb7302/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:44.028728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a66442-e35f-4ec4-9058-0ae5a0064586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585a0d8d11004c86970f893d343242ea, user_id=e330611983ab4707ab8bd6efdbfb7302, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:44.032724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a66442-e35f-4ec4-9058-0ae5a0064586 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:44.065466 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1447/2900] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:43 2022] PUT /identity/v3/projects/585a0d8d11004c86970f893d343242ea/users/e330611983ab4707ab8bd6efdbfb7302/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:32:44.139838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79555-aa96-4c37-8b27-71ee4fc217a3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:44.140140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79555-aa96-4c37-8b27-71ee4fc217a3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:44.140377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79555-aa96-4c37-8b27-71ee4fc217a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:44.218015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-00a79555-aa96-4c37-8b27-71ee4fc217a3 None None] MFA Rules not processed for user `e330611983ab4707ab8bd6efdbfb7302`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:44.219564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-00a79555-aa96-4c37-8b27-71ee4fc217a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:44.397345 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1454/2901] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:44.416195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a66442-e35f-4ec4-9058-0ae5a0064586 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:44.427961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-18a66442-e35f-4ec4-9058-0ae5a0064586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:44.599663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a66442-e35f-4ec4-9058-0ae5a0064586 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:44.607799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb081958-0654-486a-9bbb-a2faa19f37b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:44.608438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb081958-0654-486a-9bbb-a2faa19f37b2 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:44.608717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb081958-0654-486a-9bbb-a2faa19f37b2 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:44.608993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb081958-0654-486a-9bbb-a2faa19f37b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:44.620575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb081958-0654-486a-9bbb-a2faa19f37b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:44.622773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb081958-0654-486a-9bbb-a2faa19f37b2 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:44.641602 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1448/2902] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:44.752066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a79555-aa96-4c37-8b27-71ee4fc217a3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:44.754654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-00a79555-aa96-4c37-8b27-71ee4fc217a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:44.798432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a79555-aa96-4c37-8b27-71ee4fc217a3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:44.814853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64b9ba-3821-4aeb-b058-525487484db1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:44.815481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b9ba-3821-4aeb-b058-525487484db1 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:44.815769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b9ba-3821-4aeb-b058-525487484db1 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:44.816044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b9ba-3821-4aeb-b058-525487484db1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:44.966149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64b9ba-3821-4aeb-b058-525487484db1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:44.971106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64b9ba-3821-4aeb-b058-525487484db1 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:44.999817 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1455/2903] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:45.489183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb081958-0654-486a-9bbb-a2faa19f37b2 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:45.564759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:45.599387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb081958-0654-486a-9bbb-a2faa19f37b2 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:45.609562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:45.610284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:45.610493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:45.610803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] PATH_INFO: `/v3/users/a84f3555640048ab9f632f83d70c7d11` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:45.612047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84f3555640048ab9f632f83d70c7d11)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:45.614045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:45.686685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84f3555640048ab9f632f83d70c7d11'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:45.687538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84f3555640048ab9f632f83d70c7d11'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:45.718142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84f3555640048ab9f632f83d70c7d11'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:45.737195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84f3555640048ab9f632f83d70c7d11'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:45.749342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84f3555640048ab9f632f83d70c7d11'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:45.765943 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1449/2904] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:32:45 2022] DELETE /identity/v3/users/a84f3555640048ab9f632f83d70c7d11 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:45.768306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f35c1-b0bc-4b39-bac6-1b803c1a2c45 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:45.769228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f35c1-b0bc-4b39-bac6-1b803c1a2c45 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:45.769959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f35c1-b0bc-4b39-bac6-1b803c1a2c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:45.800339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-008f35c1-b0bc-4b39-bac6-1b803c1a2c45 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:45.802886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-008f35c1-b0bc-4b39-bac6-1b803c1a2c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:45.913931 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1456/2905] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:45.964642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:45.971631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:46.157174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637aae-b0f9-4225-9d09-0d53ad82437b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:46.183716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0ae3d-d829-4fa2-8569-51446a101a51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:46.183716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0ae3d-d829-4fa2-8569-51446a101a51 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:46.183716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0ae3d-d829-4fa2-8569-51446a101a51 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:46.183716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0ae3d-d829-4fa2-8569-51446a101a51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:46.218401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0ae3d-d829-4fa2-8569-51446a101a51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:46.221528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0ae3d-d829-4fa2-8569-51446a101a51 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:46.280968 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1450/2906] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:46.773178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f35c1-b0bc-4b39-bac6-1b803c1a2c45 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:46.774809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-008f35c1-b0bc-4b39-bac6-1b803c1a2c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:46.792881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:46.813157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f35c1-b0bc-4b39-bac6-1b803c1a2c45 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:46.823299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:46.824021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:46.824304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:46.824944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] PATH_INFO: `/v3/projects/de0f6374fc924d42869a2a724fcb8771` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:46.826307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0f6374fc924d42869a2a724fcb8771)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:46.828289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:46.903464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0f6374fc924d42869a2a724fcb8771', 'request_id': 'req-6e26b5db-0795-4323-81be-4f51d99c9396'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:46.913600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0f6374fc924d42869a2a724fcb8771', 'request_id': 'req-6e26b5db-0795-4323-81be-4f51d99c9396'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:46.927235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0f6374fc924d42869a2a724fcb8771', 'request_id': 'req-6e26b5db-0795-4323-81be-4f51d99c9396'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:46.950187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] The token cache is being invalidate because project de0f6374fc924d42869a2a724fcb8771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:32:46.950510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:46.951341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e26b5db-0795-4323-81be-4f51d99c9396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:46.953379 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1457/2907] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:46 2022] DELETE /identity/v3/projects/de0f6374fc924d42869a2a724fcb8771 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:46.957777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0ae3d-d829-4fa2-8569-51446a101a51 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:46.971753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0ae3d-d829-4fa2-8569-51446a101a51 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:47.110247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:47.111349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:47.111944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:47.112380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] PATH_INFO: `/v3/users/e330611983ab4707ab8bd6efdbfb7302` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:47.113752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e330611983ab4707ab8bd6efdbfb7302)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:47.115855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:47.125016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:47.259374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e330611983ab4707ab8bd6efdbfb7302'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:47.260109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e330611983ab4707ab8bd6efdbfb7302'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:47.289813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e330611983ab4707ab8bd6efdbfb7302'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:47.300170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e330611983ab4707ab8bd6efdbfb7302'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:47.317508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e330611983ab4707ab8bd6efdbfb7302'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:47.334230 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1451/2908] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:32:46 2022] DELETE /identity/v3/users/e330611983ab4707ab8bd6efdbfb7302 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:47.863292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374750ca-adde-4550-9df6-55e0db39f9cf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:47.863882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374750ca-adde-4550-9df6-55e0db39f9cf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:47.863882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374750ca-adde-4550-9df6-55e0db39f9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:47.893196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-374750ca-adde-4550-9df6-55e0db39f9cf None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:47.902666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-374750ca-adde-4550-9df6-55e0db39f9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:47.920298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:47.922855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:48.088473 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1458/2909] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:32:48.102446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374750ca-adde-4550-9df6-55e0db39f9cf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:48.104656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-374750ca-adde-4550-9df6-55e0db39f9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:48.126974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111c41b-6ec8-4bc9-8109-92236e46111e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:48.134369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:48.135466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:48.136162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:48.136513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] PATH_INFO: `/v3/projects/585a0d8d11004c86970f893d343242ea` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:48.137954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] RBAC: Authorizing `identity:delete_project(project_id=585a0d8d11004c86970f893d343242ea)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:48.141371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:48.206433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585a0d8d11004c86970f893d343242ea', 'request_id': 'req-da31b33f-416b-4f2c-bca1-c6293e54674d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:48.219257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585a0d8d11004c86970f893d343242ea', 'request_id': 'req-da31b33f-416b-4f2c-bca1-c6293e54674d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:48.231188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585a0d8d11004c86970f893d343242ea', 'request_id': 'req-da31b33f-416b-4f2c-bca1-c6293e54674d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:48.238865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374750ca-adde-4550-9df6-55e0db39f9cf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:48.257283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] The token cache is being invalidate because project 585a0d8d11004c86970f893d343242ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:32:48.259931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:48.261687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da31b33f-416b-4f2c-bca1-c6293e54674d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:48.265835 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1452/2910] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:47 2022] DELETE /identity/v3/projects/585a0d8d11004c86970f893d343242ea => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:48.270026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5db87-1e1a-4e99-a27d-66a5e1210665 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:48.270666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5db87-1e1a-4e99-a27d-66a5e1210665 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:48.271128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5db87-1e1a-4e99-a27d-66a5e1210665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:48.298488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:48.317053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cfa5db87-1e1a-4e99-a27d-66a5e1210665 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:48.318551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cfa5db87-1e1a-4e99-a27d-66a5e1210665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:48.344177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:48.378725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e83a3-ee0a-4b36-9a99-d6cb316f1b56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:48.381798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e83a3-ee0a-4b36-9a99-d6cb316f1b56 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:48.382086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e83a3-ee0a-4b36-9a99-d6cb316f1b56 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:48.382365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e83a3-ee0a-4b36-9a99-d6cb316f1b56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:48.387567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8a4e83a3-ee0a-4b36-9a99-d6cb316f1b56 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:48.491328 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1453/2911] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:32:48.493301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464eeaa-4e07-44fd-821e-11d42e33af4b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:48.493635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464eeaa-4e07-44fd-821e-11d42e33af4b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:48.493918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464eeaa-4e07-44fd-821e-11d42e33af4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:48.523518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e83a3-ee0a-4b36-9a99-d6cb316f1b56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:48.527863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e83a3-ee0a-4b36-9a99-d6cb316f1b56 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:48.538663 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1459/2912] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:32:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:48.553066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3464eeaa-4e07-44fd-821e-11d42e33af4b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:48.554468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3464eeaa-4e07-44fd-821e-11d42e33af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:48.568130 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1454/2913] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:48.569996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e83a3-ee0a-4b36-9a99-d6cb316f1b56 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:48.585086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e83a3-ee0a-4b36-9a99-d6cb316f1b56 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:48.595227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49f0e4-472a-43a6-ba68-30152d04d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:48.596168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f0e4-472a-43a6-ba68-30152d04d3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:48.596275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f0e4-472a-43a6-ba68-30152d04d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:48.596517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f0e4-472a-43a6-ba68-30152d04d3f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:48.597282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49f0e4-472a-43a6-ba68-30152d04d3f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:32:48.597998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49f0e4-472a-43a6-ba68-30152d04d3f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:48.599970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49f0e4-472a-43a6-ba68-30152d04d3f4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:48.634016 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1460/2914] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:32:48.635524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464eeaa-4e07-44fd-821e-11d42e33af4b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:48.650866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464eeaa-4e07-44fd-821e-11d42e33af4b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:48.665810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301cdd5-e5dc-49f8-a447-40732da0b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:48.671924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301cdd5-e5dc-49f8-a447-40732da0b6da admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:48.671924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301cdd5-e5dc-49f8-a447-40732da0b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:48.671924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301cdd5-e5dc-49f8-a447-40732da0b6da admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:48.673262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301cdd5-e5dc-49f8-a447-40732da0b6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:48.675482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301cdd5-e5dc-49f8-a447-40732da0b6da admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:48.766851 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1455/2915] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:32:48 2022] POST /identity/v3/projects => generated 409 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:48.770278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49f0e4-472a-43a6-ba68-30152d04d3f4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:48.786366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49f0e4-472a-43a6-ba68-30152d04d3f4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:48.826167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061279-0340-424b-8e64-179a0d79275a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:48.826471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061279-0340-424b-8e64-179a0d79275a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:48.827458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061279-0340-424b-8e64-179a0d79275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:48.872481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-84061279-0340-424b-8e64-179a0d79275a None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:48.873988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-84061279-0340-424b-8e64-179a0d79275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:48.966483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdaa17-a94f-4275-9189-02749546b344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:48.967479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdaa17-a94f-4275-9189-02749546b344 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:48.968288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdaa17-a94f-4275-9189-02749546b344 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:48.968690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdaa17-a94f-4275-9189-02749546b344 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:48.969782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdaa17-a94f-4275-9189-02749546b344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:48.973093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdaa17-a94f-4275-9189-02749546b344 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:49.010652 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1461/2916] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:32:48 2022] POST /identity/v3/users => generated 305 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:32:49.014663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdaa17-a94f-4275-9189-02749546b344 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.015865 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1456/2917] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:49.034843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdaa17-a94f-4275-9189-02749546b344 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:49.036850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84061279-0340-424b-8e64-179a0d79275a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.039463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-84061279-0340-424b-8e64-179a0d79275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:49.042529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfc894-16d7-44bf-a523-dd4ae71a56f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:49.043231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfc894-16d7-44bf-a523-dd4ae71a56f4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.043520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfc894-16d7-44bf-a523-dd4ae71a56f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.043807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfc894-16d7-44bf-a523-dd4ae71a56f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.045572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfc894-16d7-44bf-a523-dd4ae71a56f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:49.047496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfc894-16d7-44bf-a523-dd4ae71a56f4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:49.066152 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1462/2918] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:32:49.070505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfc894-16d7-44bf-a523-dd4ae71a56f4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.090238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfc894-16d7-44bf-a523-dd4ae71a56f4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:49.096730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94df74-467a-414f-8a68-817be1f7fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:49.097547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94df74-467a-414f-8a68-817be1f7fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.097905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94df74-467a-414f-8a68-817be1f7fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.098249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94df74-467a-414f-8a68-817be1f7fbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.099023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94df74-467a-414f-8a68-817be1f7fbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:49.100936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94df74-467a-414f-8a68-817be1f7fbd1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:49.114968 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1463/2919] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:49.122450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94df74-467a-414f-8a68-817be1f7fbd1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.141855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94df74-467a-414f-8a68-817be1f7fbd1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:49.148835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84061279-0340-424b-8e64-179a0d79275a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:49.154131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d3988-d96a-4871-ba2f-05dcbcc21874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:49.155818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3988-d96a-4871-ba2f-05dcbcc21874 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.157803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3988-d96a-4871-ba2f-05dcbcc21874 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.159063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3988-d96a-4871-ba2f-05dcbcc21874 admin admin] PATH_INFO: `/v3/projects/5043536862344c2b834d06c59c56a7f0/users/d68cd33de55749e0bd867f96e28a8f96/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.159698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb049d6e-fdbe-4908-8c5f-d3dc61e56f34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:49.160306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb049d6e-fdbe-4908-8c5f-d3dc61e56f34 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.160638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb049d6e-fdbe-4908-8c5f-d3dc61e56f34 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.160921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb049d6e-fdbe-4908-8c5f-d3dc61e56f34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.178505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb049d6e-fdbe-4908-8c5f-d3dc61e56f34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:49.183047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb049d6e-fdbe-4908-8c5f-d3dc61e56f34 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:49.195212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d3988-d96a-4871-ba2f-05dcbcc21874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5043536862344c2b834d06c59c56a7f0, user_id=d68cd33de55749e0bd867f96e28a8f96, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:49.200842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d3988-d96a-4871-ba2f-05dcbcc21874 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:49.203941 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1457/2920] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:32:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:32:49.225293 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1464/2921] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:49 2022] PUT /identity/v3/projects/5043536862344c2b834d06c59c56a7f0/users/d68cd33de55749e0bd867f96e28a8f96/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:49.237833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2026b-33d7-4c01-8547-00e73cc0ff06 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.238564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2026b-33d7-4c01-8547-00e73cc0ff06 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.239275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2026b-33d7-4c01-8547-00e73cc0ff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.299266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-dbb2026b-33d7-4c01-8547-00e73cc0ff06 None None] MFA Rules not processed for user `d68cd33de55749e0bd867f96e28a8f96`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:49.300559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dbb2026b-33d7-4c01-8547-00e73cc0ff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:49.317050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:49.411126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941ea2-9111-458c-93ba-b341507cc64e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.412427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941ea2-9111-458c-93ba-b341507cc64e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.412427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941ea2-9111-458c-93ba-b341507cc64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.427383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:49.431106 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1458/2922] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:49 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:49.433957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2026b-33d7-4c01-8547-00e73cc0ff06 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.438095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4e941ea2-9111-458c-93ba-b341507cc64e None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:49.440204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4e941ea2-9111-458c-93ba-b341507cc64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:49.538079 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1465/2923] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:32:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:32:49.543283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2026b-33d7-4c01-8547-00e73cc0ff06 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:49.547058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e941ea2-9111-458c-93ba-b341507cc64e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.552532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329e161-2fae-4d0a-a81d-e3f206975a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:49.553164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329e161-2fae-4d0a-a81d-e3f206975a9f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.553492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329e161-2fae-4d0a-a81d-e3f206975a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.553759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329e161-2fae-4d0a-a81d-e3f206975a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.554376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329e161-2fae-4d0a-a81d-e3f206975a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:49.556813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329e161-2fae-4d0a-a81d-e3f206975a9f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:49.591921 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1459/2924] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:32:49 2022] POST /identity/v3/projects => generated 409 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:49.595662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329e161-2fae-4d0a-a81d-e3f206975a9f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.653812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e941ea2-9111-458c-93ba-b341507cc64e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:49.676787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329e161-2fae-4d0a-a81d-e3f206975a9f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:49.683114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b178c-0f7f-4ed6-ad6b-8b89f534a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:49.683737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b178c-0f7f-4ed6-ad6b-8b89f534a901 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.684018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b178c-0f7f-4ed6-ad6b-8b89f534a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.684308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b178c-0f7f-4ed6-ad6b-8b89f534a901 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.685166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b178c-0f7f-4ed6-ad6b-8b89f534a901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:49.687134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b178c-0f7f-4ed6-ad6b-8b89f534a901 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:49.712571 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1460/2925] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:32:49 2022] POST /identity/v3/users => generated 311 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:49.716404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b178c-0f7f-4ed6-ad6b-8b89f534a901 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.729426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b178c-0f7f-4ed6-ad6b-8b89f534a901 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:49.731585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a748a-4dd9-4110-b8f9-cf9fac1c1875 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:49.732194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a748a-4dd9-4110-b8f9-cf9fac1c1875 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.732469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a748a-4dd9-4110-b8f9-cf9fac1c1875 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.732738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a748a-4dd9-4110-b8f9-cf9fac1c1875 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.735283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9999d-dccc-4af8-9942-05d90d0f3e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:49.735903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9999d-dccc-4af8-9942-05d90d0f3e5e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.737560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9999d-dccc-4af8-9942-05d90d0f3e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.737560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9999d-dccc-4af8-9942-05d90d0f3e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.737560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9999d-dccc-4af8-9942-05d90d0f3e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:49.739636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9999d-dccc-4af8-9942-05d90d0f3e5e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:49.756898 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1461/2926] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:32:49.761797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9999d-dccc-4af8-9942-05d90d0f3e5e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.773889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9999d-dccc-4af8-9942-05d90d0f3e5e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:49.780308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c2c35-5263-4275-be06-feac6cc1c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:49.781233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c2c35-5263-4275-be06-feac6cc1c90e admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.781605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c2c35-5263-4275-be06-feac6cc1c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.781962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c2c35-5263-4275-be06-feac6cc1c90e admin admin] PATH_INFO: `/v3/projects/9d983dfae1584701ae282f462180216b/users/7f6b7ef746e648b495b4592a45d1bde6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.796221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:49.804043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:49.804684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c2c35-5263-4275-be06-feac6cc1c90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d983dfae1584701ae282f462180216b, user_id=7f6b7ef746e648b495b4592a45d1bde6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:49.808757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c2c35-5263-4275-be06-feac6cc1c90e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:49.818691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a748a-4dd9-4110-b8f9-cf9fac1c1875 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:49.820925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a748a-4dd9-4110-b8f9-cf9fac1c1875 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:49.828984 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1462/2927] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:49 2022] PUT /identity/v3/projects/9d983dfae1584701ae282f462180216b/users/7f6b7ef746e648b495b4592a45d1bde6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:49.830150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c2c35-5263-4275-be06-feac6cc1c90e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.839836 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1466/2928] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:32:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:32:49.948752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c2c35-5263-4275-be06-feac6cc1c90e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:49.963374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a748a-4dd9-4110-b8f9-cf9fac1c1875 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.967528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f194be9-968b-40e6-a4f3-80f5a6c49c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:49.968168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f194be9-968b-40e6-a4f3-80f5a6c49c8b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.968445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f194be9-968b-40e6-a4f3-80f5a6c49c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.969099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f194be9-968b-40e6-a4f3-80f5a6c49c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:49.969431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f194be9-968b-40e6-a4f3-80f5a6c49c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:49.971165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f194be9-968b-40e6-a4f3-80f5a6c49c8b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:49.975702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1b3a748a-4dd9-4110-b8f9-cf9fac1c1875 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:49.983718 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1463/2929] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:49.987984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f194be9-968b-40e6-a4f3-80f5a6c49c8b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:49.993330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a748a-4dd9-4110-b8f9-cf9fac1c1875 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:49.998535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e60763-2f42-42f7-be86-754ab32b6919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:49.999165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e60763-2f42-42f7-be86-754ab32b6919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:49.999449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e60763-2f42-42f7-be86-754ab32b6919 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:49.999726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e60763-2f42-42f7-be86-754ab32b6919 admin admin] PATH_INFO: `/v3/users/486709a8644a40dea3786a139896fb57` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:50.001135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e60763-2f42-42f7-be86-754ab32b6919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=486709a8644a40dea3786a139896fb57)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:50.002060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f194be9-968b-40e6-a4f3-80f5a6c49c8b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:50.003813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e60763-2f42-42f7-be86-754ab32b6919 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:50.007114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ec9ff-b854-492f-a8d1-aec5d4e68f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:50.008032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ec9ff-b854-492f-a8d1-aec5d4e68f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:50.008430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ec9ff-b854-492f-a8d1-aec5d4e68f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:50.008902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ec9ff-b854-492f-a8d1-aec5d4e68f5f admin admin] PATH_INFO: `/v3/projects/9d983dfae1584701ae282f462180216b/users/7f6b7ef746e648b495b4592a45d1bde6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:50.011060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ec9ff-b854-492f-a8d1-aec5d4e68f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d983dfae1584701ae282f462180216b, user_id=7f6b7ef746e648b495b4592a45d1bde6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:50.014467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ec9ff-b854-492f-a8d1-aec5d4e68f5f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:50.028203 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1464/2930] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:49 2022] PUT /identity/v3/projects/9d983dfae1584701ae282f462180216b/users/7f6b7ef746e648b495b4592a45d1bde6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:50.044351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ceba-3261-491b-83b9-f5140981ee25 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:50.044635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ceba-3261-491b-83b9-f5140981ee25 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:50.044915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ceba-3261-491b-83b9-f5140981ee25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:50.085302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4ac0ceba-3261-491b-83b9-f5140981ee25 None None] MFA Rules not processed for user `7f6b7ef746e648b495b4592a45d1bde6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:50.087543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4ac0ceba-3261-491b-83b9-f5140981ee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:50.091649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43e60763-2f42-42f7-be86-754ab32b6919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486709a8644a40dea3786a139896fb57'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:50.092317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43e60763-2f42-42f7-be86-754ab32b6919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486709a8644a40dea3786a139896fb57'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:50.112321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43e60763-2f42-42f7-be86-754ab32b6919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486709a8644a40dea3786a139896fb57'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:50.113213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43e60763-2f42-42f7-be86-754ab32b6919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486709a8644a40dea3786a139896fb57'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:50.126311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43e60763-2f42-42f7-be86-754ab32b6919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486709a8644a40dea3786a139896fb57'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:50.148381 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1467/2931] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:32:49 2022] DELETE /identity/v3/users/486709a8644a40dea3786a139896fb57 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:50.153480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319228fe-eac3-446e-be06-c271ee6eb46b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:50.156048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319228fe-eac3-446e-be06-c271ee6eb46b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:50.156215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319228fe-eac3-446e-be06-c271ee6eb46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:50.190745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-319228fe-eac3-446e-be06-c271ee6eb46b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:50.192452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-319228fe-eac3-446e-be06-c271ee6eb46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:50.234504 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1465/2932] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:50.239464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0ceba-3261-491b-83b9-f5140981ee25 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:50.242777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4ac0ceba-3261-491b-83b9-f5140981ee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:50.358739 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1468/2933] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:32:50.370301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319228fe-eac3-446e-be06-c271ee6eb46b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:50.372410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-319228fe-eac3-446e-be06-c271ee6eb46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:50.411173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:50.427722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0ceba-3261-491b-83b9-f5140981ee25 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:50.440463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:50.442822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:50.446360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:50.447553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] PATH_INFO: `/v3/users/d68cd33de55749e0bd867f96e28a8f96` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:50.451494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68cd33de55749e0bd867f96e28a8f96)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:50.455712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:50.578399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319228fe-eac3-446e-be06-c271ee6eb46b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:50.592238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a775f2-6744-45e1-a349-83b9cba9dcf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:50.595206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a775f2-6744-45e1-a349-83b9cba9dcf3 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:50.595542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a775f2-6744-45e1-a349-83b9cba9dcf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:50.598010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a775f2-6744-45e1-a349-83b9cba9dcf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:50.649743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68cd33de55749e0bd867f96e28a8f96'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:50.651942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a775f2-6744-45e1-a349-83b9cba9dcf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:50.653142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68cd33de55749e0bd867f96e28a8f96'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:50.654885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a775f2-6744-45e1-a349-83b9cba9dcf3 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:50.687255 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1469/2934] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:50.694080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68cd33de55749e0bd867f96e28a8f96'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:50.708689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68cd33de55749e0bd867f96e28a8f96'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:50.725923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68cd33de55749e0bd867f96e28a8f96'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:50.747040 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1466/2935] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:32:50 2022] DELETE /identity/v3/users/d68cd33de55749e0bd867f96e28a8f96 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:50.749324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0ab5-8d5f-4789-b3cc-118127d1dc4b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:50.749672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0ab5-8d5f-4789-b3cc-118127d1dc4b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:50.750102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0ab5-8d5f-4789-b3cc-118127d1dc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:50.780668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-900c0ab5-8d5f-4789-b3cc-118127d1dc4b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:50.783254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-900c0ab5-8d5f-4789-b3cc-118127d1dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:50.789638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:50.885442 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1470/2936] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:32:50.893927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:50.895366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:50.970413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7483c-e30b-4a36-ae53-36144d210506 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:50.974370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591dbc6-896c-42b2-bf44-cb8cba5d5a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:50.974989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591dbc6-896c-42b2-bf44-cb8cba5d5a01 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:50.975271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591dbc6-896c-42b2-bf44-cb8cba5d5a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:50.975549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591dbc6-896c-42b2-bf44-cb8cba5d5a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:50.991252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591dbc6-896c-42b2-bf44-cb8cba5d5a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:50.993796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591dbc6-896c-42b2-bf44-cb8cba5d5a01 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:51.018128 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1467/2937] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:51.087688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c0ab5-8d5f-4789-b3cc-118127d1dc4b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:51.090233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-900c0ab5-8d5f-4789-b3cc-118127d1dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:51.117305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c0ab5-8d5f-4789-b3cc-118127d1dc4b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:51.130100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:51.132323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:51.133082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:51.133551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] PATH_INFO: `/v3/projects/18cc1aaed2584885939c5e7351aeb657` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:51.136857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18cc1aaed2584885939c5e7351aeb657)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:51.141931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:51.255958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18cc1aaed2584885939c5e7351aeb657', 'request_id': 'req-245f1a7d-1d9a-453d-8f29-9c543e3a8215'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:51.277793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18cc1aaed2584885939c5e7351aeb657', 'request_id': 'req-245f1a7d-1d9a-453d-8f29-9c543e3a8215'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:51.313294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18cc1aaed2584885939c5e7351aeb657', 'request_id': 'req-245f1a7d-1d9a-453d-8f29-9c543e3a8215'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:51.361502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] The token cache is being invalidate because project 18cc1aaed2584885939c5e7351aeb657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:32:51.361855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:51.362570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-245f1a7d-1d9a-453d-8f29-9c543e3a8215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:51.370435 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1471/2938] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:51 2022] DELETE /identity/v3/projects/18cc1aaed2584885939c5e7351aeb657 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:51.373613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0de97-9790-42a9-8643-7eae0771aa3a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:51.374700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0de97-9790-42a9-8643-7eae0771aa3a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:51.375007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0de97-9790-42a9-8643-7eae0771aa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:51.409833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-abf0de97-9790-42a9-8643-7eae0771aa3a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:51.411063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-abf0de97-9790-42a9-8643-7eae0771aa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:51.494361 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1468/2939] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:51.503599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406896e4-f766-491d-8b70-8bd64a255e29 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:51.504181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406896e4-f766-491d-8b70-8bd64a255e29 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:51.504310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406896e4-f766-491d-8b70-8bd64a255e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:51.540697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-406896e4-f766-491d-8b70-8bd64a255e29 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:51.540697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-406896e4-f766-491d-8b70-8bd64a255e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:51.565799 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1472/2940] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:51.570564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0de97-9790-42a9-8643-7eae0771aa3a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:51.585653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0de97-9790-42a9-8643-7eae0771aa3a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:51.594530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406896e4-f766-491d-8b70-8bd64a255e29 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:51.599396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-406896e4-f766-491d-8b70-8bd64a255e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:51.612570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1176f36-c8a5-456e-b021-8a1f83c323dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:51.613202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176f36-c8a5-456e-b021-8a1f83c323dd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:51.614414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176f36-c8a5-456e-b021-8a1f83c323dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:51.614727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176f36-c8a5-456e-b021-8a1f83c323dd admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:51.616902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1176f36-c8a5-456e-b021-8a1f83c323dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:32:51.616902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1176f36-c8a5-456e-b021-8a1f83c323dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:51.617297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1176f36-c8a5-456e-b021-8a1f83c323dd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:51.625159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406896e4-f766-491d-8b70-8bd64a255e29 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:51.653972 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1469/2941] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:32:51.658914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1176f36-c8a5-456e-b021-8a1f83c323dd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:51.661863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:51.667049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:51.667349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:51.668247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] PATH_INFO: `/v3/projects/5043536862344c2b834d06c59c56a7f0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:51.669596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5043536862344c2b834d06c59c56a7f0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:51.671549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:51.672614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1176f36-c8a5-456e-b021-8a1f83c323dd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:51.680238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca800d-842b-4c72-b889-b056abb95671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:51.680238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca800d-842b-4c72-b889-b056abb95671 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:51.680238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca800d-842b-4c72-b889-b056abb95671 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:51.680689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca800d-842b-4c72-b889-b056abb95671 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:51.682831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca800d-842b-4c72-b889-b056abb95671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:51.685035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca800d-842b-4c72-b889-b056abb95671 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:51.692921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:51.770177 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1470/2942] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:32:51 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:51.772216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5043536862344c2b834d06c59c56a7f0', 'request_id': 'req-85790406-4a92-4b72-8491-9c9d2a293b7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:51.776081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca800d-842b-4c72-b889-b056abb95671 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:51.780192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5043536862344c2b834d06c59c56a7f0', 'request_id': 'req-85790406-4a92-4b72-8491-9c9d2a293b7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:51.790921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5043536862344c2b834d06c59c56a7f0', 'request_id': 'req-85790406-4a92-4b72-8491-9c9d2a293b7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:51.819453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] The token cache is being invalidate because project 5043536862344c2b834d06c59c56a7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:32:51.819689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:51.820515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:51.822918 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1473/2943] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:51 2022] DELETE /identity/v3/projects/5043536862344c2b834d06c59c56a7f0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:51.826714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:51.828390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:51.855724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:51.919431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca800d-842b-4c72-b889-b056abb95671 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:51.932467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619dd34-1aa3-409a-8fed-a8b1740b7a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:51.933155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619dd34-1aa3-409a-8fed-a8b1740b7a6c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:51.933361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619dd34-1aa3-409a-8fed-a8b1740b7a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:51.933666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619dd34-1aa3-409a-8fed-a8b1740b7a6c admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:51.934309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619dd34-1aa3-409a-8fed-a8b1740b7a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:51.936260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619dd34-1aa3-409a-8fed-a8b1740b7a6c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:51.979262 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1471/2944] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:32:51 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:51.981945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85790406-4a92-4b72-8491-9c9d2a293b7c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:51.984435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619dd34-1aa3-409a-8fed-a8b1740b7a6c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:51.986738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7619dd34-1aa3-409a-8fed-a8b1740b7a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:51.987494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407aba6-7713-4b9e-9afd-8e30bf004bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:51.988250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407aba6-7713-4b9e-9afd-8e30bf004bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:51.988533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407aba6-7713-4b9e-9afd-8e30bf004bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:51.988822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407aba6-7713-4b9e-9afd-8e30bf004bf8 admin admin] PATH_INFO: `/v3/users/7f6b7ef746e648b495b4592a45d1bde6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:51.990413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407aba6-7713-4b9e-9afd-8e30bf004bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6b7ef746e648b495b4592a45d1bde6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:51.992970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407aba6-7713-4b9e-9afd-8e30bf004bf8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:52.001276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619dd34-1aa3-409a-8fed-a8b1740b7a6c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:52.006461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6ee7d-eba2-4e51-bb73-3cf792b74af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:52.007074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6ee7d-eba2-4e51-bb73-3cf792b74af0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:52.007375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6ee7d-eba2-4e51-bb73-3cf792b74af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:52.007615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6ee7d-eba2-4e51-bb73-3cf792b74af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:52.008258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6ee7d-eba2-4e51-bb73-3cf792b74af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:52.010873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6ee7d-eba2-4e51-bb73-3cf792b74af0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:52.022487 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1472/2945] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:32:52.027082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6ee7d-eba2-4e51-bb73-3cf792b74af0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:52.038878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6ee7d-eba2-4e51-bb73-3cf792b74af0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:52.044955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c6a36-8427-4b58-8acf-bc025231a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:52.045547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c6a36-8427-4b58-8acf-bc025231a75a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:52.045905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c6a36-8427-4b58-8acf-bc025231a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:52.046199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c6a36-8427-4b58-8acf-bc025231a75a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:52.046861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c6a36-8427-4b58-8acf-bc025231a75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:52.048642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c6a36-8427-4b58-8acf-bc025231a75a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:52.064797 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1473/2946] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:32:52.069929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c6a36-8427-4b58-8acf-bc025231a75a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:52.086004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c6a36-8427-4b58-8acf-bc025231a75a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:52.091363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c407aba6-7713-4b9e-9afd-8e30bf004bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6b7ef746e648b495b4592a45d1bde6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:52.092520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c407aba6-7713-4b9e-9afd-8e30bf004bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6b7ef746e648b495b4592a45d1bde6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:52.098431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af96b4-b775-4fa8-b209-05875e2efd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:52.099406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af96b4-b775-4fa8-b209-05875e2efd70 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:52.099891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af96b4-b775-4fa8-b209-05875e2efd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:52.100247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af96b4-b775-4fa8-b209-05875e2efd70 admin admin] PATH_INFO: `/v3/projects/a8a88db13a164a749bd77563ada8bc71/users/a5363759f60146b49414071f0c0a4a36/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:52.109763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c407aba6-7713-4b9e-9afd-8e30bf004bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6b7ef746e648b495b4592a45d1bde6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:52.110528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c407aba6-7713-4b9e-9afd-8e30bf004bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6b7ef746e648b495b4592a45d1bde6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:52.120200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c407aba6-7713-4b9e-9afd-8e30bf004bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6b7ef746e648b495b4592a45d1bde6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:52.132522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af96b4-b775-4fa8-b209-05875e2efd70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a88db13a164a749bd77563ada8bc71, user_id=a5363759f60146b49414071f0c0a4a36, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:52.136638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af96b4-b775-4fa8-b209-05875e2efd70 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:52.141219 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1474/2947] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:32:51 2022] DELETE /identity/v3/users/7f6b7ef746e648b495b4592a45d1bde6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:32:52.172811 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1474/2948] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:52 2022] PUT /identity/v3/projects/a8a88db13a164a749bd77563ada8bc71/users/a5363759f60146b49414071f0c0a4a36/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:32:52.174840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94925aad-1cab-4e20-b16a-5b94974d024b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:52.175435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94925aad-1cab-4e20-b16a-5b94974d024b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:52.175784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94925aad-1cab-4e20-b16a-5b94974d024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:52.216723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-94925aad-1cab-4e20-b16a-5b94974d024b None None] MFA Rules not processed for user `a5363759f60146b49414071f0c0a4a36`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:52.218418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-94925aad-1cab-4e20-b16a-5b94974d024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:52.322749 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1475/2949] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:52.337794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af96b4-b775-4fa8-b209-05875e2efd70 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:52.340981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-03af96b4-b775-4fa8-b209-05875e2efd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:52.469588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af96b4-b775-4fa8-b209-05875e2efd70 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:52.483232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f16898-2528-4a3e-8042-7c7e8c6ab6cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:52.484213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f16898-2528-4a3e-8042-7c7e8c6ab6cd service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:52.484493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f16898-2528-4a3e-8042-7c7e8c6ab6cd service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:52.484765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f16898-2528-4a3e-8042-7c7e8c6ab6cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:52.495113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f16898-2528-4a3e-8042-7c7e8c6ab6cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:52.496967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f16898-2528-4a3e-8042-7c7e8c6ab6cd service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:52.514092 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1475/2950] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:52.587865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94925aad-1cab-4e20-b16a-5b94974d024b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:52.595078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-94925aad-1cab-4e20-b16a-5b94974d024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:52.635600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f16898-2528-4a3e-8042-7c7e8c6ab6cd service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:52.637140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f5f16898-2528-4a3e-8042-7c7e8c6ab6cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:52.657930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:52.678873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:52.772499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f16898-2528-4a3e-8042-7c7e8c6ab6cd service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:52.793685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338fa79-4064-4fd8-9e4e-d2d4b66ed437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:52.796184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fa79-4064-4fd8-9e4e-d2d4b66ed437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:52.796472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fa79-4064-4fd8-9e4e-d2d4b66ed437 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:52.796755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fa79-4064-4fd8-9e4e-d2d4b66ed437 admin admin] PATH_INFO: `/v3/users/a5363759f60146b49414071f0c0a4a36` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:52.799625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338fa79-4064-4fd8-9e4e-d2d4b66ed437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5363759f60146b49414071f0c0a4a36)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:52.803406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338fa79-4064-4fd8-9e4e-d2d4b66ed437 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:52.862377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94925aad-1cab-4e20-b16a-5b94974d024b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:52.881354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:52.882217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:52.882501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:52.882774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] PATH_INFO: `/v3/projects/9d983dfae1584701ae282f462180216b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:52.897147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d983dfae1584701ae282f462180216b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:52.900622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:52.913727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6338fa79-4064-4fd8-9e4e-d2d4b66ed437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5363759f60146b49414071f0c0a4a36'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:52.915114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6338fa79-4064-4fd8-9e4e-d2d4b66ed437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5363759f60146b49414071f0c0a4a36'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:52.956485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6338fa79-4064-4fd8-9e4e-d2d4b66ed437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5363759f60146b49414071f0c0a4a36'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:52.971269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6338fa79-4064-4fd8-9e4e-d2d4b66ed437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5363759f60146b49414071f0c0a4a36'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:52.990821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6338fa79-4064-4fd8-9e4e-d2d4b66ed437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5363759f60146b49414071f0c0a4a36'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:53.000895 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1476/2951] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:32:52 2022] DELETE /identity/v3/users/a5363759f60146b49414071f0c0a4a36 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:53.007167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51441a77-087d-4adb-a56f-3065578b3c3c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:53.011251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51441a77-087d-4adb-a56f-3065578b3c3c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:53.011251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51441a77-087d-4adb-a56f-3065578b3c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:53.038120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d983dfae1584701ae282f462180216b', 'request_id': 'req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:53.055046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d983dfae1584701ae282f462180216b', 'request_id': 'req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:53.066909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d983dfae1584701ae282f462180216b', 'request_id': 'req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:53.068142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-51441a77-087d-4adb-a56f-3065578b3c3c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:53.070102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-51441a77-087d-4adb-a56f-3065578b3c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:53.100135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] The token cache is being invalidate because project 9d983dfae1584701ae282f462180216b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:32:53.100619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:53.104368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2166f2d5-5fd3-40fe-9a2f-c4dda5a6619f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:53.114077 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1476/2952] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:52 2022] DELETE /identity/v3/projects/9d983dfae1584701ae282f462180216b => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:53.115744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb67ef-64fc-47cd-881c-338b745fdea8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:53.116341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb67ef-64fc-47cd-881c-338b745fdea8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:53.116627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb67ef-64fc-47cd-881c-338b745fdea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:53.164930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7afb67ef-64fc-47cd-881c-338b745fdea8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:53.167064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7afb67ef-64fc-47cd-881c-338b745fdea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:53.186622 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1477/2953] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:32:53.186958 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1477/2954] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:53.193958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff719240-94b9-48d9-b406-51ac938a75bf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:53.194173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51441a77-087d-4adb-a56f-3065578b3c3c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:53.194296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff719240-94b9-48d9-b406-51ac938a75bf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:53.194544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff719240-94b9-48d9-b406-51ac938a75bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:53.197681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-51441a77-087d-4adb-a56f-3065578b3c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:53.224760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ff719240-94b9-48d9-b406-51ac938a75bf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:53.226349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ff719240-94b9-48d9-b406-51ac938a75bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:53.237404 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1478/2955] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:53.242068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff719240-94b9-48d9-b406-51ac938a75bf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:53.262786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:53.271439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff719240-94b9-48d9-b406-51ac938a75bf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:53.286060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f60446-fe5e-43dd-8389-2c4793092ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:53.287336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60446-fe5e-43dd-8389-2c4793092ecf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:53.287336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60446-fe5e-43dd-8389-2c4793092ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:53.288035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60446-fe5e-43dd-8389-2c4793092ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:53.288388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f60446-fe5e-43dd-8389-2c4793092ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:32:53.288803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f60446-fe5e-43dd-8389-2c4793092ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:53.291375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f60446-fe5e-43dd-8389-2c4793092ecf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:53.303530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51441a77-087d-4adb-a56f-3065578b3c3c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:53.307483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249193fb-d61f-4f0d-9ba3-0b10ec939937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:53.308178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249193fb-d61f-4f0d-9ba3-0b10ec939937 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:53.308510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249193fb-d61f-4f0d-9ba3-0b10ec939937 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:53.308848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249193fb-d61f-4f0d-9ba3-0b10ec939937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:53.314651 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1479/2956] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:32:53.318706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f60446-fe5e-43dd-8389-2c4793092ecf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:53.319327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249193fb-d61f-4f0d-9ba3-0b10ec939937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:53.321580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249193fb-d61f-4f0d-9ba3-0b10ec939937 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:53.333997 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1478/2957] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:53.337613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f60446-fe5e-43dd-8389-2c4793092ecf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:53.342804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667e7fe-3924-4507-946b-abd5efa5f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:53.343602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667e7fe-3924-4507-946b-abd5efa5f676 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:53.343887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667e7fe-3924-4507-946b-abd5efa5f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:53.344161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667e7fe-3924-4507-946b-abd5efa5f676 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:53.344918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667e7fe-3924-4507-946b-abd5efa5f676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:53.347471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667e7fe-3924-4507-946b-abd5efa5f676 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:53.398290 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1480/2958] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:32:53 2022] POST /identity/v3/projects => generated 391 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:53.403401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249193fb-d61f-4f0d-9ba3-0b10ec939937 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:53.416755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249193fb-d61f-4f0d-9ba3-0b10ec939937 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:53.554737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad91eb8-e18b-4c40-bc1f-dae8aee051dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:53.556088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad91eb8-e18b-4c40-bc1f-dae8aee051dd admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:53.556545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad91eb8-e18b-4c40-bc1f-dae8aee051dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:53.556925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad91eb8-e18b-4c40-bc1f-dae8aee051dd admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:53.557669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad91eb8-e18b-4c40-bc1f-dae8aee051dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:53.560443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad91eb8-e18b-4c40-bc1f-dae8aee051dd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:53.590960 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1479/2959] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:32:53 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:53.594984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667e7fe-3924-4507-946b-abd5efa5f676 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:53.611103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667e7fe-3924-4507-946b-abd5efa5f676 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:53.624108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1d0c1-531e-448d-9c0e-2a861e4d1b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:53.624669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1d0c1-531e-448d-9c0e-2a861e4d1b72 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:53.624951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1d0c1-531e-448d-9c0e-2a861e4d1b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:53.625503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1d0c1-531e-448d-9c0e-2a861e4d1b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:53.626161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1d0c1-531e-448d-9c0e-2a861e4d1b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:53.627759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1d0c1-531e-448d-9c0e-2a861e4d1b72 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:53.653820 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1481/2960] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:53.656773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad91eb8-e18b-4c40-bc1f-dae8aee051dd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:53.672953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad91eb8-e18b-4c40-bc1f-dae8aee051dd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:53.684884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c8883-7d63-4cef-a81f-076bf813c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:53.685698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c8883-7d63-4cef-a81f-076bf813c6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:53.686183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c8883-7d63-4cef-a81f-076bf813c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:53.687161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c8883-7d63-4cef-a81f-076bf813c6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:53.689320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c8883-7d63-4cef-a81f-076bf813c6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:53.694297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c8883-7d63-4cef-a81f-076bf813c6b9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:53.718702 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1480/2961] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:53.719723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1d0c1-531e-448d-9c0e-2a861e4d1b72 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:53.735964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1d0c1-531e-448d-9c0e-2a861e4d1b72 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:53.749497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba5a7a-6336-483e-a1ab-e291f49ff579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:53.751581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba5a7a-6336-483e-a1ab-e291f49ff579 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:53.752086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba5a7a-6336-483e-a1ab-e291f49ff579 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:53.752612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba5a7a-6336-483e-a1ab-e291f49ff579 admin admin] PATH_INFO: `/v3/projects/2dfc8ff66d444c0e900bdea790c7965c/users/5028d55a6f1f43ecb5ac3063a425fe83/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:53.777658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba5a7a-6336-483e-a1ab-e291f49ff579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfc8ff66d444c0e900bdea790c7965c, user_id=5028d55a6f1f43ecb5ac3063a425fe83, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:53.782616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba5a7a-6336-483e-a1ab-e291f49ff579 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:53.807625 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1482/2962] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:53 2022] PUT /identity/v3/projects/2dfc8ff66d444c0e900bdea790c7965c/users/5028d55a6f1f43ecb5ac3063a425fe83/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:53.820106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd3eb-8ae5-4a90-937c-2657aa6b2f4b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:53.820499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd3eb-8ae5-4a90-937c-2657aa6b2f4b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:53.820843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd3eb-8ae5-4a90-937c-2657aa6b2f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:53.874348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a40bd3eb-8ae5-4a90-937c-2657aa6b2f4b None None] MFA Rules not processed for user `5028d55a6f1f43ecb5ac3063a425fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:53.876502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a40bd3eb-8ae5-4a90-937c-2657aa6b2f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:53.906309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba5a7a-6336-483e-a1ab-e291f49ff579 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:53.911863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-64ba5a7a-6336-483e-a1ab-e291f49ff579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:53.998097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:54.044560 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1481/2963] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:54.047921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bd3eb-8ae5-4a90-937c-2657aa6b2f4b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:54.066718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba5a7a-6336-483e-a1ab-e291f49ff579 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:54.074600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e29e-d6c7-4e9a-8521-a4804097088c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:54.075233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e29e-d6c7-4e9a-8521-a4804097088c service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:54.075509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e29e-d6c7-4e9a-8521-a4804097088c service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:54.075951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e29e-d6c7-4e9a-8521-a4804097088c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:54.078416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d571e29e-d6c7-4e9a-8521-a4804097088c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:54.160427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:54.177638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e29e-d6c7-4e9a-8521-a4804097088c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:54.182021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e29e-d6c7-4e9a-8521-a4804097088c service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:54.199467 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1483/2964] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:32:54.210159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bd3eb-8ae5-4a90-937c-2657aa6b2f4b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:54.228371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342ecb2-f177-4c3c-9974-66ccd8ccf41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:54.229102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342ecb2-f177-4c3c-9974-66ccd8ccf41b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:54.229565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342ecb2-f177-4c3c-9974-66ccd8ccf41b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:54.229845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342ecb2-f177-4c3c-9974-66ccd8ccf41b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:54.232224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342ecb2-f177-4c3c-9974-66ccd8ccf41b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:54.232557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342ecb2-f177-4c3c-9974-66ccd8ccf41b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:54.279030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e29e-d6c7-4e9a-8521-a4804097088c service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:54.281265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d571e29e-d6c7-4e9a-8521-a4804097088c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:54.328580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e29e-d6c7-4e9a-8521-a4804097088c service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:54.336261 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1482/2965] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:32:54 2022] POST /identity/v3/projects => generated 391 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:54.348776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342ecb2-f177-4c3c-9974-66ccd8ccf41b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:54.516596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:54.517253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:54.517569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:54.517841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] PATH_INFO: `/v3/projects/a8a88db13a164a749bd77563ada8bc71` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:54.523361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a88db13a164a749bd77563ada8bc71)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:54.527811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:54.530870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342ecb2-f177-4c3c-9974-66ccd8ccf41b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:54.546215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953c558-4c2c-4dc7-bd93-7ddeb45be8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:54.547147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c558-4c2c-4dc7-bd93-7ddeb45be8fd admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:54.547428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c558-4c2c-4dc7-bd93-7ddeb45be8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:54.547704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c558-4c2c-4dc7-bd93-7ddeb45be8fd admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:54.548345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953c558-4c2c-4dc7-bd93-7ddeb45be8fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:54.554164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953c558-4c2c-4dc7-bd93-7ddeb45be8fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:54.616746 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1483/2966] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:32:54 2022] POST /identity/v3/users => generated 302 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:54.624070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953c558-4c2c-4dc7-bd93-7ddeb45be8fd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:54.674501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953c558-4c2c-4dc7-bd93-7ddeb45be8fd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:54.696183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a88db13a164a749bd77563ada8bc71', 'request_id': 'req-723014ea-6234-4dc2-b077-1f0cc1d85e2b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:54.713266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a88db13a164a749bd77563ada8bc71', 'request_id': 'req-723014ea-6234-4dc2-b077-1f0cc1d85e2b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:54.736930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a88db13a164a749bd77563ada8bc71', 'request_id': 'req-723014ea-6234-4dc2-b077-1f0cc1d85e2b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:54.786083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] The token cache is being invalidate because project a8a88db13a164a749bd77563ada8bc71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:32:54.786407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:54.789560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-723014ea-6234-4dc2-b077-1f0cc1d85e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:32:54.798183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed9a01-40c5-4403-9374-fba9fbd68196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:54.799074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9a01-40c5-4403-9374-fba9fbd68196 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:54.799446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9a01-40c5-4403-9374-fba9fbd68196 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:54.799834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9a01-40c5-4403-9374-fba9fbd68196 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:54.800244 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1484/2967] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:54 2022] DELETE /identity/v3/projects/a8a88db13a164a749bd77563ada8bc71 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:54.804482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed9a01-40c5-4403-9374-fba9fbd68196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:54.805295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00984273-6bef-498d-8cae-e1a73099a269 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:54.805654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00984273-6bef-498d-8cae-e1a73099a269 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:54.806457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00984273-6bef-498d-8cae-e1a73099a269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:54.807892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed9a01-40c5-4403-9374-fba9fbd68196 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:54.823204 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1484/2968] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:54.824471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed9a01-40c5-4403-9374-fba9fbd68196 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:54.826729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-afed9a01-40c5-4403-9374-fba9fbd68196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:54.874495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed9a01-40c5-4403-9374-fba9fbd68196 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:54.875846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-00984273-6bef-498d-8cae-e1a73099a269 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:54.877783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-00984273-6bef-498d-8cae-e1a73099a269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:54.890841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80715c72-7ef5-4e85-ae75-1aa07cde7374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:54.891545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715c72-7ef5-4e85-ae75-1aa07cde7374 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:54.891826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715c72-7ef5-4e85-ae75-1aa07cde7374 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:54.892104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715c72-7ef5-4e85-ae75-1aa07cde7374 admin admin] PATH_INFO: `/v3/projects/2e22572a39b6411783a720645deb3f6c/users/622335deeda54ff7bf3632df13d9777a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:54.901301 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1485/2969] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:32:54.907259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db5ee-5af5-492b-8aa4-eafdce9740a4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:54.909023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db5ee-5af5-492b-8aa4-eafdce9740a4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:54.910123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db5ee-5af5-492b-8aa4-eafdce9740a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:54.938493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80715c72-7ef5-4e85-ae75-1aa07cde7374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e22572a39b6411783a720645deb3f6c, user_id=622335deeda54ff7bf3632df13d9777a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:54.941177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80715c72-7ef5-4e85-ae75-1aa07cde7374 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:54.944226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:54.975410 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1485/2970] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:54 2022] PUT /identity/v3/projects/2e22572a39b6411783a720645deb3f6c/users/622335deeda54ff7bf3632df13d9777a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:54.977862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80715c72-7ef5-4e85-ae75-1aa07cde7374 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:54.986778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d84db5ee-5af5-492b-8aa4-eafdce9740a4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:54.992548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d84db5ee-5af5-492b-8aa4-eafdce9740a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:55.097076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:55.127454 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1486/2971] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:55.132256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db5ee-5af5-492b-8aa4-eafdce9740a4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:55.152009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db5ee-5af5-492b-8aa4-eafdce9740a4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:55.159505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80715c72-7ef5-4e85-ae75-1aa07cde7374 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:55.165808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd6ffd-994c-4531-8376-6959e46ade7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:55.166461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd6ffd-994c-4531-8376-6959e46ade7f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:55.166706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd6ffd-994c-4531-8376-6959e46ade7f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:55.166995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd6ffd-994c-4531-8376-6959e46ade7f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:55.167758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd6ffd-994c-4531-8376-6959e46ade7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:55.169411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd6ffd-994c-4531-8376-6959e46ade7f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:55.170497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5568a08-49f2-43cd-988c-336fdaefd5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:55.171573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5568a08-49f2-43cd-988c-336fdaefd5ad admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:55.171957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5568a08-49f2-43cd-988c-336fdaefd5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:55.172329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5568a08-49f2-43cd-988c-336fdaefd5ad admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:55.174389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5568a08-49f2-43cd-988c-336fdaefd5ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:32:55.175729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5568a08-49f2-43cd-988c-336fdaefd5ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:55.179402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5568a08-49f2-43cd-988c-336fdaefd5ad admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:55.193662 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1486/2972] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:55.201281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd6ffd-994c-4531-8376-6959e46ade7f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:55.209775 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1487/2973] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:32:55.213360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5568a08-49f2-43cd-988c-336fdaefd5ad admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:55.235996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd6ffd-994c-4531-8376-6959e46ade7f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:55.252964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd97d30-bf3b-49ad-9bfa-728cf0fd74d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:55.255822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5568a08-49f2-43cd-988c-336fdaefd5ad admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:55.256499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd97d30-bf3b-49ad-9bfa-728cf0fd74d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:55.257113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd97d30-bf3b-49ad-9bfa-728cf0fd74d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:55.258288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd97d30-bf3b-49ad-9bfa-728cf0fd74d5 admin admin] PATH_INFO: `/v3/projects/2e22572a39b6411783a720645deb3f6c/users/622335deeda54ff7bf3632df13d9777a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:55.269101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd97d30-bf3b-49ad-9bfa-728cf0fd74d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e22572a39b6411783a720645deb3f6c, user_id=622335deeda54ff7bf3632df13d9777a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:55.280116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd97d30-bf3b-49ad-9bfa-728cf0fd74d5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:55.286221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c016d68-b24c-4116-9656-f0bbe4b9cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:55.291437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c016d68-b24c-4116-9656-f0bbe4b9cd72 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:55.294023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c016d68-b24c-4116-9656-f0bbe4b9cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:55.294418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c016d68-b24c-4116-9656-f0bbe4b9cd72 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:55.295968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c016d68-b24c-4116-9656-f0bbe4b9cd72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:55.298626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c016d68-b24c-4116-9656-f0bbe4b9cd72 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:55.316043 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1487/2974] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:55 2022] PUT /identity/v3/projects/2e22572a39b6411783a720645deb3f6c/users/622335deeda54ff7bf3632df13d9777a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:32:55.327218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f312a-2651-4c1a-b84e-bef149dde696 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:55.327798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f312a-2651-4c1a-b84e-bef149dde696 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:55.328506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f312a-2651-4c1a-b84e-bef149dde696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:55.373245 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1488/2975] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:32:55 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:32:55.377429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c016d68-b24c-4116-9656-f0bbe4b9cd72 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:55.403528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1d3f312a-2651-4c1a-b84e-bef149dde696 None None] MFA Rules not processed for user `622335deeda54ff7bf3632df13d9777a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:55.406743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1d3f312a-2651-4c1a-b84e-bef149dde696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:55.577756 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1488/2976] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:32:55.589647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c016d68-b24c-4116-9656-f0bbe4b9cd72 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:55.601751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8044e-e00f-44be-a106-98a79dc0389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:55.603896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8044e-e00f-44be-a106-98a79dc0389c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:55.605516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8044e-e00f-44be-a106-98a79dc0389c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:55.605902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8044e-e00f-44be-a106-98a79dc0389c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:55.607365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8044e-e00f-44be-a106-98a79dc0389c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:55.610647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8044e-e00f-44be-a106-98a79dc0389c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:55.671666 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1489/2977] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:32:55 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:32:55.675758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f312a-2651-4c1a-b84e-bef149dde696 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:55.688972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f312a-2651-4c1a-b84e-bef149dde696 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:55.700936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573b4d5-4bf8-4a96-ba3d-8056ee7acd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:55.701514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573b4d5-4bf8-4a96-ba3d-8056ee7acd0e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:55.701808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573b4d5-4bf8-4a96-ba3d-8056ee7acd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:55.702211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573b4d5-4bf8-4a96-ba3d-8056ee7acd0e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:55.702732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573b4d5-4bf8-4a96-ba3d-8056ee7acd0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:55.704372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573b4d5-4bf8-4a96-ba3d-8056ee7acd0e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:55.731174 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1489/2978] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:55.735156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8044e-e00f-44be-a106-98a79dc0389c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:55.739092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573b4d5-4bf8-4a96-ba3d-8056ee7acd0e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:55.740887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c4f8044e-e00f-44be-a106-98a79dc0389c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:55.768271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573b4d5-4bf8-4a96-ba3d-8056ee7acd0e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:55.778716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee668a9-671a-4a0f-8008-c5890633c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:55.780052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee668a9-671a-4a0f-8008-c5890633c1bd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:55.780333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee668a9-671a-4a0f-8008-c5890633c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:55.780611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee668a9-671a-4a0f-8008-c5890633c1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:55.781267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee668a9-671a-4a0f-8008-c5890633c1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:55.782911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee668a9-671a-4a0f-8008-c5890633c1bd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:55.828275 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1490/2979] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:32:55.829855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee668a9-671a-4a0f-8008-c5890633c1bd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:55.859408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee668a9-671a-4a0f-8008-c5890633c1bd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:55.870962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131982c-0035-4f22-ab12-276cd057e04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:55.873370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131982c-0035-4f22-ab12-276cd057e04d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:55.873683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131982c-0035-4f22-ab12-276cd057e04d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:55.873982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131982c-0035-4f22-ab12-276cd057e04d admin admin] PATH_INFO: `/v3/projects/5628dcd53a614a4589eb526ba20c291c/users/59d36e55c8ad494eb6260410fdecd1a1/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:55.887455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:55.909833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131982c-0035-4f22-ab12-276cd057e04d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5628dcd53a614a4589eb526ba20c291c, user_id=59d36e55c8ad494eb6260410fdecd1a1, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:55.916448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131982c-0035-4f22-ab12-276cd057e04d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:55.927317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8044e-e00f-44be-a106-98a79dc0389c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:55.952622 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1491/2980] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:32:55 2022] PUT /identity/v3/projects/5628dcd53a614a4589eb526ba20c291c/users/59d36e55c8ad494eb6260410fdecd1a1/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:32:55.962134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc16b39-939b-4c44-9732-5c935dfea7bd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:55.962729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc16b39-939b-4c44-9732-5c935dfea7bd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:55.963344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc16b39-939b-4c44-9732-5c935dfea7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:56.000655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6bc16b39-939b-4c44-9732-5c935dfea7bd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:32:56.002429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6bc16b39-939b-4c44-9732-5c935dfea7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:56.113604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:56.156404 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1492/2981] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:32:56.158688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc16b39-939b-4c44-9732-5c935dfea7bd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:56.160866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d4c6-bcf2-44fd-941b-7bbbe2b1546c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:56.161904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6bc16b39-939b-4c44-9732-5c935dfea7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:56.163402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d4c6-bcf2-44fd-941b-7bbbe2b1546c service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:56.164587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d4c6-bcf2-44fd-941b-7bbbe2b1546c service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:56.166627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d4c6-bcf2-44fd-941b-7bbbe2b1546c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:56.169488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f370d4c6-bcf2-44fd-941b-7bbbe2b1546c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:32:56.265328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370d4c6-bcf2-44fd-941b-7bbbe2b1546c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:56.268318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370d4c6-bcf2-44fd-941b-7bbbe2b1546c service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:56.269871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc16b39-939b-4c44-9732-5c935dfea7bd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:56.278179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd668b26-0d8c-4566-9491-967a3e71be10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:56.283329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd668b26-0d8c-4566-9491-967a3e71be10 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:56.283829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd668b26-0d8c-4566-9491-967a3e71be10 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:56.284446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd668b26-0d8c-4566-9491-967a3e71be10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:56.292005 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1490/2982] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:56.299413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd668b26-0d8c-4566-9491-967a3e71be10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:56.301360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd668b26-0d8c-4566-9491-967a3e71be10 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:56.313438 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1493/2983] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:32:58.786695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d4c6-bcf2-44fd-941b-7bbbe2b1546c service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:32:58.821482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d4c6-bcf2-44fd-941b-7bbbe2b1546c service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:32:58.843508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d51eb-0628-49f9-875c-1d799604c61e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:32:58.844253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d51eb-0628-49f9-875c-1d799604c61e service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:32:58.844534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d51eb-0628-49f9-875c-1d799604c61e service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:32:58.844809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d51eb-0628-49f9-875c-1d799604c61e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:32:58.981226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d51eb-0628-49f9-875c-1d799604c61e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:32:58.983060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d51eb-0628-49f9-875c-1d799604c61e service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:32:58.999132 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1491/2984] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:32:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:33:06.309599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=29 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:06.507808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead13308-a4c6-47b9-9fb4-b86579ad1f9c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:06.508050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead13308-a4c6-47b9-9fb4-b86579ad1f9c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:06.508418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead13308-a4c6-47b9-9fb4-b86579ad1f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:06.610459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ead13308-a4c6-47b9-9fb4-b86579ad1f9c None None] MFA Rules not processed for user `59d36e55c8ad494eb6260410fdecd1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:06.611717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ead13308-a4c6-47b9-9fb4-b86579ad1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:06.745159 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1494/2985] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:08.359335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d51eb-0628-49f9-875c-1d799604c61e service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:08.373988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d51eb-0628-49f9-875c-1d799604c61e service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:08.389888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854a65d-dafb-4c8b-b78c-ef1dedd278d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:08.390463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854a65d-dafb-4c8b-b78c-ef1dedd278d6 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:08.390890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854a65d-dafb-4c8b-b78c-ef1dedd278d6 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:08.391336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854a65d-dafb-4c8b-b78c-ef1dedd278d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:08.427902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854a65d-dafb-4c8b-b78c-ef1dedd278d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:08.435848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854a65d-dafb-4c8b-b78c-ef1dedd278d6 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:08.450744 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1492/2986] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:33:12.253541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4afbe-6e83-415a-9cd9-07c9a51ba885 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:12.254012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4afbe-6e83-415a-9cd9-07c9a51ba885 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:12.254118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4afbe-6e83-415a-9cd9-07c9a51ba885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:12.312532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c7d4afbe-6e83-415a-9cd9-07c9a51ba885 None None] MFA Rules not processed for user `59d36e55c8ad494eb6260410fdecd1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:12.314612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c7d4afbe-6e83-415a-9cd9-07c9a51ba885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:12.357493 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1495/2987] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:33:17.312993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854a65d-dafb-4c8b-b78c-ef1dedd278d6 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:17.314673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a854a65d-dafb-4c8b-b78c-ef1dedd278d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:17.330912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854a65d-dafb-4c8b-b78c-ef1dedd278d6 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:17.336260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9f3fb-eba9-496a-8326-fd29892cbece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:17.337596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f3fb-eba9-496a-8326-fd29892cbece admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:17.338217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f3fb-eba9-496a-8326-fd29892cbece admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:17.338502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f3fb-eba9-496a-8326-fd29892cbece admin admin] PATH_INFO: `/v3/users/783eb573b9464ca2a9dc618d07caa679` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:17.346638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9f3fb-eba9-496a-8326-fd29892cbece admin admin] RBAC: Authorizing `identity:delete_user(user_id=783eb573b9464ca2a9dc618d07caa679)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:17.350099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9f3fb-eba9-496a-8326-fd29892cbece admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:17.370882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:17.435933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-deb9f3fb-eba9-496a-8326-fd29892cbece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783eb573b9464ca2a9dc618d07caa679'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:17.440514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-deb9f3fb-eba9-496a-8326-fd29892cbece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783eb573b9464ca2a9dc618d07caa679'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:17.457995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-deb9f3fb-eba9-496a-8326-fd29892cbece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783eb573b9464ca2a9dc618d07caa679'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:17.459183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-deb9f3fb-eba9-496a-8326-fd29892cbece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783eb573b9464ca2a9dc618d07caa679'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:17.470888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-deb9f3fb-eba9-496a-8326-fd29892cbece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783eb573b9464ca2a9dc618d07caa679'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:17.494241 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1493/2988] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:33:17 2022] DELETE /identity/v3/users/783eb573b9464ca2a9dc618d07caa679 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:18.205852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4afbe-6e83-415a-9cd9-07c9a51ba885 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:18.218908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4afbe-6e83-415a-9cd9-07c9a51ba885 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:18.327447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:18.331348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:18.333366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:18.334229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] PATH_INFO: `/v3/projects/2a4920bc88bc467c9c5eb64032ba0c58` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:18.336081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4920bc88bc467c9c5eb64032ba0c58)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:18.339299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:18.493199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4920bc88bc467c9c5eb64032ba0c58', 'request_id': 'req-ac1aec5a-c455-4717-875b-16c65ed4feb6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:18.507729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4920bc88bc467c9c5eb64032ba0c58', 'request_id': 'req-ac1aec5a-c455-4717-875b-16c65ed4feb6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:18.519967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4920bc88bc467c9c5eb64032ba0c58', 'request_id': 'req-ac1aec5a-c455-4717-875b-16c65ed4feb6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:18.548880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] The token cache is being invalidate because project 2a4920bc88bc467c9c5eb64032ba0c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:33:18.549360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:18.551770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ac1aec5a-c455-4717-875b-16c65ed4feb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:18.553898 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1496/2989] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:33:18 2022] DELETE /identity/v3/projects/2a4920bc88bc467c9c5eb64032ba0c58 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:18.559452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa6f7f-09dd-4c72-bf3d-f2732fbc9057 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:18.560423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa6f7f-09dd-4c72-bf3d-f2732fbc9057 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:18.560699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa6f7f-09dd-4c72-bf3d-f2732fbc9057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:18.582300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-71aa6f7f-09dd-4c72-bf3d-f2732fbc9057 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:18.583754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-71aa6f7f-09dd-4c72-bf3d-f2732fbc9057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:18.658294 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1494/2990] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:18.659584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe2c5f-1c62-4450-a217-3d9a5ab890d5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:18.659969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe2c5f-1c62-4450-a217-3d9a5ab890d5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:18.660364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe2c5f-1c62-4450-a217-3d9a5ab890d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:18.700991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-44fe2c5f-1c62-4450-a217-3d9a5ab890d5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:18.702483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-44fe2c5f-1c62-4450-a217-3d9a5ab890d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:18.746290 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1497/2991] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:18.751120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa6f7f-09dd-4c72-bf3d-f2732fbc9057 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:18.768185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa6f7f-09dd-4c72-bf3d-f2732fbc9057 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:18.774294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1590fe7-e38b-45ca-bb1f-89517a584e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:18.774913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1590fe7-e38b-45ca-bb1f-89517a584e1f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:18.775189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1590fe7-e38b-45ca-bb1f-89517a584e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:18.775449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1590fe7-e38b-45ca-bb1f-89517a584e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:18.776523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1590fe7-e38b-45ca-bb1f-89517a584e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:33:18.776830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1590fe7-e38b-45ca-bb1f-89517a584e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:18.778574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1590fe7-e38b-45ca-bb1f-89517a584e1f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:18.814569 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1495/2992] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:33:18.814998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe2c5f-1c62-4450-a217-3d9a5ab890d5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:18.827853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe2c5f-1c62-4450-a217-3d9a5ab890d5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:18.835004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aa37f-c368-4e78-906e-323ef1c94504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:18.836071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aa37f-c368-4e78-906e-323ef1c94504 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:18.836571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aa37f-c368-4e78-906e-323ef1c94504 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:18.837068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aa37f-c368-4e78-906e-323ef1c94504 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:18.838943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364aa37f-c368-4e78-906e-323ef1c94504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:18.841872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364aa37f-c368-4e78-906e-323ef1c94504 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:18.847591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:18.893433 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1498/2993] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:33:18 2022] POST /identity/v3/projects => generated 389 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:33:18.896428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1590fe7-e38b-45ca-bb1f-89517a584e1f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:18.912166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1590fe7-e38b-45ca-bb1f-89517a584e1f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:19.079533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee109f-4021-488b-ab13-8baf97fa62e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:19.080345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee109f-4021-488b-ab13-8baf97fa62e3 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:19.080629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee109f-4021-488b-ab13-8baf97fa62e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:19.080907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee109f-4021-488b-ab13-8baf97fa62e3 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:19.081618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee109f-4021-488b-ab13-8baf97fa62e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:19.083713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee109f-4021-488b-ab13-8baf97fa62e3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:19.113971 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1496/2994] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:33:18 2022] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:33:19.118415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aa37f-c368-4e78-906e-323ef1c94504 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:19.157817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aa37f-c368-4e78-906e-323ef1c94504 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:19.178104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23605504-80cf-453a-ba13-fbc2bd933566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:19.185732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23605504-80cf-453a-ba13-fbc2bd933566 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:19.186288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23605504-80cf-453a-ba13-fbc2bd933566 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:19.186740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23605504-80cf-453a-ba13-fbc2bd933566 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:19.194343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23605504-80cf-453a-ba13-fbc2bd933566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:19.196270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23605504-80cf-453a-ba13-fbc2bd933566 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:19.217282 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1499/2995] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:33:19.221480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee109f-4021-488b-ab13-8baf97fa62e3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:19.229225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:19.244474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee109f-4021-488b-ab13-8baf97fa62e3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:19.263656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70ee33-30bd-4802-ae5e-d056df4a0177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:19.266368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70ee33-30bd-4802-ae5e-d056df4a0177 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:19.266987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70ee33-30bd-4802-ae5e-d056df4a0177 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:19.267504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70ee33-30bd-4802-ae5e-d056df4a0177 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:19.268477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70ee33-30bd-4802-ae5e-d056df4a0177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:19.270974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70ee33-30bd-4802-ae5e-d056df4a0177 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:19.303805 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1497/2996] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:33:19.307107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23605504-80cf-453a-ba13-fbc2bd933566 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:19.317557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23605504-80cf-453a-ba13-fbc2bd933566 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:19.344428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f9923-da66-4443-953f-68ff8ed68d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:19.345674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f9923-da66-4443-953f-68ff8ed68d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:19.346154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f9923-da66-4443-953f-68ff8ed68d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:19.350655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f9923-da66-4443-953f-68ff8ed68d06 admin admin] PATH_INFO: `/v3/projects/dfce36a97ee446a5a79d91b67b855558/users/33daa615bc42447b9056611bc563e131/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:19.402435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f9923-da66-4443-953f-68ff8ed68d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfce36a97ee446a5a79d91b67b855558, user_id=33daa615bc42447b9056611bc563e131, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:19.405202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f9923-da66-4443-953f-68ff8ed68d06 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:19.434938 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1500/2997] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:33:19 2022] PUT /identity/v3/projects/dfce36a97ee446a5a79d91b67b855558/users/33daa615bc42447b9056611bc563e131/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:19.440113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4f52-15ba-4af0-bad7-26fbf20da832 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:19.440403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4f52-15ba-4af0-bad7-26fbf20da832 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:19.440681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4f52-15ba-4af0-bad7-26fbf20da832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:19.480632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-463e4f52-15ba-4af0-bad7-26fbf20da832 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:19.481899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-463e4f52-15ba-4af0-bad7-26fbf20da832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:19.669544 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1498/2998] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:19.790824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f9923-da66-4443-953f-68ff8ed68d06 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:19.792599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-600f9923-da66-4443-953f-68ff8ed68d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:19.820669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e4f52-15ba-4af0-bad7-26fbf20da832 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:19.822594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-463e4f52-15ba-4af0-bad7-26fbf20da832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:19.843712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e4f52-15ba-4af0-bad7-26fbf20da832 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:19.867224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114931f-b1d8-4285-9944-08570f1c48ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:19.868526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114931f-b1d8-4285-9944-08570f1c48ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:19.868722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114931f-b1d8-4285-9944-08570f1c48ab admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:19.869003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114931f-b1d8-4285-9944-08570f1c48ab admin admin] PATH_INFO: `/v3/users/5028d55a6f1f43ecb5ac3063a425fe83` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:19.876718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114931f-b1d8-4285-9944-08570f1c48ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5028d55a6f1f43ecb5ac3063a425fe83)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:19.878764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114931f-b1d8-4285-9944-08570f1c48ab admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:19.986010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0114931f-b1d8-4285-9944-08570f1c48ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5028d55a6f1f43ecb5ac3063a425fe83'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:19.988617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0114931f-b1d8-4285-9944-08570f1c48ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5028d55a6f1f43ecb5ac3063a425fe83'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:20.020735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f9923-da66-4443-953f-68ff8ed68d06 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:20.039631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0114931f-b1d8-4285-9944-08570f1c48ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5028d55a6f1f43ecb5ac3063a425fe83'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:20.041067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c359aa-9403-44db-b38d-ee17a5043ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:20.041702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0114931f-b1d8-4285-9944-08570f1c48ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5028d55a6f1f43ecb5ac3063a425fe83'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:20.042120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c359aa-9403-44db-b38d-ee17a5043ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:20.042683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c359aa-9403-44db-b38d-ee17a5043ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:20.043209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c359aa-9403-44db-b38d-ee17a5043ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:20.046888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-64c359aa-9403-44db-b38d-ee17a5043ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:20.066090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0114931f-b1d8-4285-9944-08570f1c48ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5028d55a6f1f43ecb5ac3063a425fe83'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:20.069102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c359aa-9403-44db-b38d-ee17a5043ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:20.072643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c359aa-9403-44db-b38d-ee17a5043ce0 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:20.089554 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1501/2999] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:33:20.090922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c359aa-9403-44db-b38d-ee17a5043ce0 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:20.093720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-64c359aa-9403-44db-b38d-ee17a5043ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:20.103233 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1499/3000] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:33:19 2022] DELETE /identity/v3/users/5028d55a6f1f43ecb5ac3063a425fe83 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:20.107385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989677df-f991-43e8-9cce-4a338fb325f6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:20.107740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989677df-f991-43e8-9cce-4a338fb325f6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:20.108022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989677df-f991-43e8-9cce-4a338fb325f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:20.171810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-989677df-f991-43e8-9cce-4a338fb325f6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:20.173077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-989677df-f991-43e8-9cce-4a338fb325f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:20.324507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c359aa-9403-44db-b38d-ee17a5043ce0 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:20.363027 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1500/3001] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:33:20.422222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989677df-f991-43e8-9cce-4a338fb325f6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:20.423538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-989677df-f991-43e8-9cce-4a338fb325f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:20.440911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:20.448558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:20.487739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4597653-1765-4b1e-a665-d5f3fdbfc75f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:20.488391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4597653-1765-4b1e-a665-d5f3fdbfc75f service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:20.488668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4597653-1765-4b1e-a665-d5f3fdbfc75f service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:20.489055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4597653-1765-4b1e-a665-d5f3fdbfc75f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:20.498879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d4597653-1765-4b1e-a665-d5f3fdbfc75f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:20.590014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989677df-f991-43e8-9cce-4a338fb325f6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:20.600239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12da45c-3960-49e0-9ce8-d799a2956a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:20.603899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12da45c-3960-49e0-9ce8-d799a2956a3e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:20.606031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12da45c-3960-49e0-9ce8-d799a2956a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:20.606515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12da45c-3960-49e0-9ce8-d799a2956a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:20.630244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12da45c-3960-49e0-9ce8-d799a2956a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:20.635021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12da45c-3960-49e0-9ce8-d799a2956a3e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:20.638727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4597653-1765-4b1e-a665-d5f3fdbfc75f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:20.640338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4597653-1765-4b1e-a665-d5f3fdbfc75f service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:20.670380 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1502/3002] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:33:20.678650 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1501/3003] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:33:21.272971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4597653-1765-4b1e-a665-d5f3fdbfc75f service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:21.292505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4597653-1765-4b1e-a665-d5f3fdbfc75f service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:21.310397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722722b-ab69-47fd-9229-36f04bf8a190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:21.311617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722722b-ab69-47fd-9229-36f04bf8a190 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:21.314354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722722b-ab69-47fd-9229-36f04bf8a190 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:21.314856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722722b-ab69-47fd-9229-36f04bf8a190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:21.321898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f722722b-ab69-47fd-9229-36f04bf8a190 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:21.478740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722722b-ab69-47fd-9229-36f04bf8a190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:21.486902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722722b-ab69-47fd-9229-36f04bf8a190 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:21.525976 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1503/3004] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:21 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:33:21.598983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12da45c-3960-49e0-9ce8-d799a2956a3e service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:21.602891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f12da45c-3960-49e0-9ce8-d799a2956a3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:21.621974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12da45c-3960-49e0-9ce8-d799a2956a3e service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:21.629684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:21.634699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:21.635704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:21.636285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] PATH_INFO: `/v3/projects/2dfc8ff66d444c0e900bdea790c7965c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:21.638451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dfc8ff66d444c0e900bdea790c7965c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:21.643808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:21.748582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dfc8ff66d444c0e900bdea790c7965c', 'request_id': 'req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:21.767984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dfc8ff66d444c0e900bdea790c7965c', 'request_id': 'req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:21.789215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dfc8ff66d444c0e900bdea790c7965c', 'request_id': 'req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:21.811788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] The token cache is being invalidate because project 2dfc8ff66d444c0e900bdea790c7965c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:33:21.812084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:21.813223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:21.815563 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1502/3005] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:33:21 2022] DELETE /identity/v3/projects/2dfc8ff66d444c0e900bdea790c7965c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:21.819515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722722b-ab69-47fd-9229-36f04bf8a190 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:21.834380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722722b-ab69-47fd-9229-36f04bf8a190 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:22.045725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52564b26-7754-4f2b-9048-08a4dc3f03ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:22.047186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564b26-7754-4f2b-9048-08a4dc3f03ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:22.047593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564b26-7754-4f2b-9048-08a4dc3f03ce admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:22.049154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564b26-7754-4f2b-9048-08a4dc3f03ce admin admin] PATH_INFO: `/v3/users/622335deeda54ff7bf3632df13d9777a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:22.054207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52564b26-7754-4f2b-9048-08a4dc3f03ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=622335deeda54ff7bf3632df13d9777a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:22.068089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52564b26-7754-4f2b-9048-08a4dc3f03ce admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:22.104867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:22.169513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52564b26-7754-4f2b-9048-08a4dc3f03ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622335deeda54ff7bf3632df13d9777a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:22.170224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52564b26-7754-4f2b-9048-08a4dc3f03ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622335deeda54ff7bf3632df13d9777a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:22.197358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52564b26-7754-4f2b-9048-08a4dc3f03ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622335deeda54ff7bf3632df13d9777a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:22.217238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52564b26-7754-4f2b-9048-08a4dc3f03ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622335deeda54ff7bf3632df13d9777a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:22.236782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52564b26-7754-4f2b-9048-08a4dc3f03ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622335deeda54ff7bf3632df13d9777a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:22.252160 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1504/3006] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:33:21 2022] DELETE /identity/v3/users/622335deeda54ff7bf3632df13d9777a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:23.415745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:23.417211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:23.440840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6334d7-4cd0-4502-8edf-f4a6d6e2d339 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:23.689276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:23.690304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:23.690596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:23.690930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] PATH_INFO: `/v3/projects/2e22572a39b6411783a720645deb3f6c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:23.692498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e22572a39b6411783a720645deb3f6c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:23.695328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:23.789352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:23.825935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e22572a39b6411783a720645deb3f6c', 'request_id': 'req-cb82fcfe-0459-413f-814f-03b16ffdc5ed'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:23.841070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e22572a39b6411783a720645deb3f6c', 'request_id': 'req-cb82fcfe-0459-413f-814f-03b16ffdc5ed'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:23.855318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e22572a39b6411783a720645deb3f6c', 'request_id': 'req-cb82fcfe-0459-413f-814f-03b16ffdc5ed'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:23.889882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] The token cache is being invalidate because project 2e22572a39b6411783a720645deb3f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:33:23.890183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:23.897864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb82fcfe-0459-413f-814f-03b16ffdc5ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:33:23.903636 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1503/3007] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:33:23 2022] DELETE /identity/v3/projects/2e22572a39b6411783a720645deb3f6c => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:23.905275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6456d-0aca-44cb-94a8-af1e99d553e0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:23.906104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6456d-0aca-44cb-94a8-af1e99d553e0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:23.906541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6456d-0aca-44cb-94a8-af1e99d553e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:23.975885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-aed6456d-0aca-44cb-94a8-af1e99d553e0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:23.984021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aed6456d-0aca-44cb-94a8-af1e99d553e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:24.153896 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1505/3008] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:24.155994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eda55c-8d4b-419d-9ef9-4e1acdaee9b7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:24.156280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eda55c-8d4b-419d-9ef9-4e1acdaee9b7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:24.156584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eda55c-8d4b-419d-9ef9-4e1acdaee9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:24.195093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-52eda55c-8d4b-419d-9ef9-4e1acdaee9b7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:24.196876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-52eda55c-8d4b-419d-9ef9-4e1acdaee9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:24.218192 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1504/3009] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:24.219501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6456d-0aca-44cb-94a8-af1e99d553e0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:24.241698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eda55c-8d4b-419d-9ef9-4e1acdaee9b7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:24.242919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6456d-0aca-44cb-94a8-af1e99d553e0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:24.243182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-52eda55c-8d4b-419d-9ef9-4e1acdaee9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:24.254168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8708e1-7673-4767-8cb5-1ea248c2cce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:24.255077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8708e1-7673-4767-8cb5-1ea248c2cce6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:24.255544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8708e1-7673-4767-8cb5-1ea248c2cce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:24.255975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8708e1-7673-4767-8cb5-1ea248c2cce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:24.256794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8708e1-7673-4767-8cb5-1ea248c2cce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:33:24.257268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8708e1-7673-4767-8cb5-1ea248c2cce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:24.263217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8708e1-7673-4767-8cb5-1ea248c2cce6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:24.296654 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1506/3010] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:33:24.297252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8708e1-7673-4767-8cb5-1ea248c2cce6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:24.316144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8708e1-7673-4767-8cb5-1ea248c2cce6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:24.329027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5e2df-6764-481e-83f9-496fe22d84f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:24.330069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5e2df-6764-481e-83f9-496fe22d84f8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:24.330069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5e2df-6764-481e-83f9-496fe22d84f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:24.330331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5e2df-6764-481e-83f9-496fe22d84f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:24.330932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5e2df-6764-481e-83f9-496fe22d84f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:24.336853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5e2df-6764-481e-83f9-496fe22d84f8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:24.389200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eda55c-8d4b-419d-9ef9-4e1acdaee9b7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:24.400605 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1507/3011] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:33:24 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:33:24.402047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5e2df-6764-481e-83f9-496fe22d84f8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:24.405950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d889eec-fca6-4a8e-a214-651aa0aba728 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:24.406634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d889eec-fca6-4a8e-a214-651aa0aba728 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:24.406852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d889eec-fca6-4a8e-a214-651aa0aba728 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:24.407130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d889eec-fca6-4a8e-a214-651aa0aba728 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:24.409475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1d889eec-fca6-4a8e-a214-651aa0aba728 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:24.435776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d889eec-fca6-4a8e-a214-651aa0aba728 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:24.438689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d889eec-fca6-4a8e-a214-651aa0aba728 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:24.466632 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1505/3012] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:33:24.587304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5e2df-6764-481e-83f9-496fe22d84f8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:24.613202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bde66-7fd0-438b-9e14-b2c62f3720f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:24.614083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bde66-7fd0-438b-9e14-b2c62f3720f9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:24.614358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bde66-7fd0-438b-9e14-b2c62f3720f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:24.615163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bde66-7fd0-438b-9e14-b2c62f3720f9 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:24.615425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bde66-7fd0-438b-9e14-b2c62f3720f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:24.617972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bde66-7fd0-438b-9e14-b2c62f3720f9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:24.646939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:24.661040 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1508/3013] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:33:24 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:33:24.665927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d889eec-fca6-4a8e-a214-651aa0aba728 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:24.691407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d889eec-fca6-4a8e-a214-651aa0aba728 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:24.699218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1814e7c-f2a2-432d-a714-97dc51b023eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:24.700160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1814e7c-f2a2-432d-a714-97dc51b023eb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:24.700637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1814e7c-f2a2-432d-a714-97dc51b023eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:24.701077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1814e7c-f2a2-432d-a714-97dc51b023eb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:24.701915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1814e7c-f2a2-432d-a714-97dc51b023eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:24.703744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1814e7c-f2a2-432d-a714-97dc51b023eb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:24.747468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bde66-7fd0-438b-9e14-b2c62f3720f9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:24.769088 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1506/3014] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:33:24.780658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bde66-7fd0-438b-9e14-b2c62f3720f9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:24.793309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58400977-48f8-40d0-85be-3fb6f7ba5b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:24.793990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400977-48f8-40d0-85be-3fb6f7ba5b35 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:24.794270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400977-48f8-40d0-85be-3fb6f7ba5b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:24.794551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400977-48f8-40d0-85be-3fb6f7ba5b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:24.795443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58400977-48f8-40d0-85be-3fb6f7ba5b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:24.796912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58400977-48f8-40d0-85be-3fb6f7ba5b35 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:24.828913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1814e7c-f2a2-432d-a714-97dc51b023eb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:24.844197 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1509/3015] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:33:24.844540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1814e7c-f2a2-432d-a714-97dc51b023eb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:24.850859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde4cd5-0b1d-4e53-a65e-9770c0dfe0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:24.852307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4cd5-0b1d-4e53-a65e-9770c0dfe0df admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:24.852759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4cd5-0b1d-4e53-a65e-9770c0dfe0df admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:24.853227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4cd5-0b1d-4e53-a65e-9770c0dfe0df admin admin] PATH_INFO: `/v3/projects/c785a2ff808848958fa8e54ac1db2fdb/users/a1ab26a46d314c97808cab66c3386ceb/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:24.894472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde4cd5-0b1d-4e53-a65e-9770c0dfe0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c785a2ff808848958fa8e54ac1db2fdb, user_id=a1ab26a46d314c97808cab66c3386ceb, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:24.897249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde4cd5-0b1d-4e53-a65e-9770c0dfe0df admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:24.952731 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1507/3016] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:33:24 2022] PUT /identity/v3/projects/c785a2ff808848958fa8e54ac1db2fdb/users/a1ab26a46d314c97808cab66c3386ceb/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:24.954950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80f8e-b104-4fa4-836b-94507a1c25f6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:24.956309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80f8e-b104-4fa4-836b-94507a1c25f6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:24.956766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80f8e-b104-4fa4-836b-94507a1c25f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:25.029195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-34a80f8e-b104-4fa4-836b-94507a1c25f6 None None] MFA Rules not processed for user `a1ab26a46d314c97808cab66c3386ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:25.039134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-34a80f8e-b104-4fa4-836b-94507a1c25f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:25.192457 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1510/3017] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:25.193743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde4cd5-0b1d-4e53-a65e-9770c0dfe0df admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:25.322738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde4cd5-0b1d-4e53-a65e-9770c0dfe0df admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:25.332673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2515b7-3c94-44ca-a238-d5e03dc575f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:25.333311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2515b7-3c94-44ca-a238-d5e03dc575f8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:25.333659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2515b7-3c94-44ca-a238-d5e03dc575f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:25.333933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2515b7-3c94-44ca-a238-d5e03dc575f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:25.334572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2515b7-3c94-44ca-a238-d5e03dc575f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:25.337111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2515b7-3c94-44ca-a238-d5e03dc575f8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:25.388492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:25.414351 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1508/3018] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:33:25 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:33:25.416271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a80f8e-b104-4fa4-836b-94507a1c25f6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:25.432459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a80f8e-b104-4fa4-836b-94507a1c25f6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:25.582281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2364a3e-02b1-499c-ae91-c2e30ade54ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:25.583035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364a3e-02b1-499c-ae91-c2e30ade54ff admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:25.583314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364a3e-02b1-499c-ae91-c2e30ade54ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:25.583584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364a3e-02b1-499c-ae91-c2e30ade54ff admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:25.584231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2364a3e-02b1-499c-ae91-c2e30ade54ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:25.586842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2364a3e-02b1-499c-ae91-c2e30ade54ff admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:25.626654 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1511/3019] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:33:25 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:33:25.632476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2515b7-3c94-44ca-a238-d5e03dc575f8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:25.644721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2515b7-3c94-44ca-a238-d5e03dc575f8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:25.652033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5dd2-abd5-4d15-9748-5e5958bc7b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:25.652700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5dd2-abd5-4d15-9748-5e5958bc7b8f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:25.653123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5dd2-abd5-4d15-9748-5e5958bc7b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:25.653435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5dd2-abd5-4d15-9748-5e5958bc7b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:25.654193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d5dd2-abd5-4d15-9748-5e5958bc7b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:25.655812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d5dd2-abd5-4d15-9748-5e5958bc7b8f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:25.685307 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1509/3020] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:33:25.689719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2364a3e-02b1-499c-ae91-c2e30ade54ff admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:25.707438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2364a3e-02b1-499c-ae91-c2e30ade54ff admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:25.715468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d1404-94f4-4d7b-ab34-ae459cf0d82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:25.716352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d1404-94f4-4d7b-ab34-ae459cf0d82a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:25.716703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d1404-94f4-4d7b-ab34-ae459cf0d82a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:25.717056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d1404-94f4-4d7b-ab34-ae459cf0d82a admin admin] PATH_INFO: `/v3/projects/0fc33da4b2d542c1a13a626c080cd25a/users/86cde79a358343a9b3c4614b2cc48847/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:25.753235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d1404-94f4-4d7b-ab34-ae459cf0d82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc33da4b2d542c1a13a626c080cd25a, user_id=86cde79a358343a9b3c4614b2cc48847, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:25.756067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d1404-94f4-4d7b-ab34-ae459cf0d82a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:25.782772 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1512/3021] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:33:25 2022] PUT /identity/v3/projects/0fc33da4b2d542c1a13a626c080cd25a/users/86cde79a358343a9b3c4614b2cc48847/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:25.784507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5dd2-abd5-4d15-9748-5e5958bc7b8f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:25.798295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5dd2-abd5-4d15-9748-5e5958bc7b8f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:25.899701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2e681-0a46-45db-a22f-812e3696c4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:25.901217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e681-0a46-45db-a22f-812e3696c4bb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:25.901793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e681-0a46-45db-a22f-812e3696c4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:25.902406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2e681-0a46-45db-a22f-812e3696c4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:25.903601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2e681-0a46-45db-a22f-812e3696c4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:25.905994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2e681-0a46-45db-a22f-812e3696c4bb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:25.932353 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1510/3022] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:33:25.933896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d1404-94f4-4d7b-ab34-ae459cf0d82a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:25.952853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d1404-94f4-4d7b-ab34-ae459cf0d82a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:25.969221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742ebd6-49c3-4227-ba27-e8a1b261958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:25.971860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ebd6-49c3-4227-ba27-e8a1b261958b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:25.972208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ebd6-49c3-4227-ba27-e8a1b261958b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:25.972632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ebd6-49c3-4227-ba27-e8a1b261958b admin admin] PATH_INFO: `/v3/projects/0fc33da4b2d542c1a13a626c080cd25a/users/86cde79a358343a9b3c4614b2cc48847/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:25.976235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742ebd6-49c3-4227-ba27-e8a1b261958b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc33da4b2d542c1a13a626c080cd25a, user_id=86cde79a358343a9b3c4614b2cc48847, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:25.979855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742ebd6-49c3-4227-ba27-e8a1b261958b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:26.004613 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1513/3023] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:33:25 2022] PUT /identity/v3/projects/0fc33da4b2d542c1a13a626c080cd25a/users/86cde79a358343a9b3c4614b2cc48847/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:26.016277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f479a-b359-4bc6-9290-6cc5b5a253f7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:26.016946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f479a-b359-4bc6-9290-6cc5b5a253f7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:26.017417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f479a-b359-4bc6-9290-6cc5b5a253f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:26.091618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b27f479a-b359-4bc6-9290-6cc5b5a253f7 None None] MFA Rules not processed for user `86cde79a358343a9b3c4614b2cc48847`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:26.098274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b27f479a-b359-4bc6-9290-6cc5b5a253f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:26.226419 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1511/3024] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:26.237857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58e7ec-3b02-44d0-95b6-41d2fb816ded None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:26.238139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58e7ec-3b02-44d0-95b6-41d2fb816ded None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:26.238250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58e7ec-3b02-44d0-95b6-41d2fb816ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:26.283851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0b58e7ec-3b02-44d0-95b6-41d2fb816ded None None] MFA Rules not processed for user `a1ab26a46d314c97808cab66c3386ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:26.286553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0b58e7ec-3b02-44d0-95b6-41d2fb816ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:26.323024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:26.379918 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1514/3025] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:27.514789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f479a-b359-4bc6-9290-6cc5b5a253f7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:27.518646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b27f479a-b359-4bc6-9290-6cc5b5a253f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:27.790162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f479a-b359-4bc6-9290-6cc5b5a253f7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:27.796295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa892064-0f6e-41ab-b7cd-b924c0b39a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:27.796944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892064-0f6e-41ab-b7cd-b924c0b39a7e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:27.797228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892064-0f6e-41ab-b7cd-b924c0b39a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:27.797549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892064-0f6e-41ab-b7cd-b924c0b39a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:27.799714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fa892064-0f6e-41ab-b7cd-b924c0b39a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:27.848872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:27.939567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa892064-0f6e-41ab-b7cd-b924c0b39a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:27.941785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa892064-0f6e-41ab-b7cd-b924c0b39a7e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:27.962559 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1512/3026] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:33:28.003407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58e7ec-3b02-44d0-95b6-41d2fb816ded None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:28.024279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58e7ec-3b02-44d0-95b6-41d2fb816ded None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:28.028985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d49e6f-4766-4393-a106-c928178a608f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:28.029895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d49e6f-4766-4393-a106-c928178a608f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:28.030333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d49e6f-4766-4393-a106-c928178a608f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:28.030765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d49e6f-4766-4393-a106-c928178a608f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:28.033419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-48d49e6f-4766-4393-a106-c928178a608f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:28.053547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d49e6f-4766-4393-a106-c928178a608f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:28.055849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d49e6f-4766-4393-a106-c928178a608f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:28.080106 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1515/3027] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:33:28.494601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ab5b7-c978-470d-93f3-be4ea9466ebc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:28.494894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ab5b7-c978-470d-93f3-be4ea9466ebc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:28.495174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ab5b7-c978-470d-93f3-be4ea9466ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:28.572282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-244ab5b7-c978-470d-93f3-be4ea9466ebc None None] MFA Rules not processed for user `a675ad19db254271ba12d2812d0732e3`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:28.574298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-244ab5b7-c978-470d-93f3-be4ea9466ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:28.645994 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1513/3028] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:29.649355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d49e6f-4766-4393-a106-c928178a608f service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:29.651260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-48d49e6f-4766-4393-a106-c928178a608f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:29.683721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d49e6f-4766-4393-a106-c928178a608f service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:29.696337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119039f-f45a-4dbc-a02e-8529e2579178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:29.696982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119039f-f45a-4dbc-a02e-8529e2579178 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:29.697256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119039f-f45a-4dbc-a02e-8529e2579178 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:29.697567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119039f-f45a-4dbc-a02e-8529e2579178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:29.713154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119039f-f45a-4dbc-a02e-8529e2579178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:29.715437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119039f-f45a-4dbc-a02e-8529e2579178 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:29.730647 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1516/3029] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:33:30.917258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af5b14-8cb7-41b8-8a4d-9c2b9f206c66 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:30.917791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af5b14-8cb7-41b8-8a4d-9c2b9f206c66 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:30.917899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af5b14-8cb7-41b8-8a4d-9c2b9f206c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:30.978487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a7af5b14-8cb7-41b8-8a4d-9c2b9f206c66 None None] MFA Rules not processed for user `a1ab26a46d314c97808cab66c3386ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:30.980081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a7af5b14-8cb7-41b8-8a4d-9c2b9f206c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:31.053431 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1514/3030] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:33.936050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9cc4c-2213-4d48-8e59-39a93bb1e89c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:33.938942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9cc4c-2213-4d48-8e59-39a93bb1e89c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:33.941006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9cc4c-2213-4d48-8e59-39a93bb1e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:34.029908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fff9cc4c-2213-4d48-8e59-39a93bb1e89c None None] MFA Rules not processed for user `33daa615bc42447b9056611bc563e131`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:34.031647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fff9cc4c-2213-4d48-8e59-39a93bb1e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:34.207520 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1517/3031] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:34.210742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af5b14-8cb7-41b8-8a4d-9c2b9f206c66 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:34.212471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a7af5b14-8cb7-41b8-8a4d-9c2b9f206c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:34.344751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af5b14-8cb7-41b8-8a4d-9c2b9f206c66 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:34.349873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df1b0e-6593-4774-9abe-20327dfb9bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:34.350495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1b0e-6593-4774-9abe-20327dfb9bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:34.350776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1b0e-6593-4774-9abe-20327dfb9bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:34.351045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1b0e-6593-4774-9abe-20327dfb9bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:34.351782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df1b0e-6593-4774-9abe-20327dfb9bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:34.353969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df1b0e-6593-4774-9abe-20327dfb9bf5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:34.380436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:34.395917 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1515/3032] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:33:34 2022] POST /identity/v3/projects => generated 389 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:33:34.399916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9cc4c-2213-4d48-8e59-39a93bb1e89c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:34.424353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9cc4c-2213-4d48-8e59-39a93bb1e89c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:34.531507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6d738-462d-4995-ad89-68a94ab93179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:34.533892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6d738-462d-4995-ad89-68a94ab93179 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:34.535152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6d738-462d-4995-ad89-68a94ab93179 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:34.536473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6d738-462d-4995-ad89-68a94ab93179 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:34.538400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6d738-462d-4995-ad89-68a94ab93179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:34.542432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6d738-462d-4995-ad89-68a94ab93179 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:34.592180 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1518/3033] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:33:34 2022] POST /identity/v3/users => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:33:34.596623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df1b0e-6593-4774-9abe-20327dfb9bf5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:34.609686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df1b0e-6593-4774-9abe-20327dfb9bf5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:34.615035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c412e9b-7045-449f-af2a-503b426da075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:34.616477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c412e9b-7045-449f-af2a-503b426da075 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:34.616725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c412e9b-7045-449f-af2a-503b426da075 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:34.617263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c412e9b-7045-449f-af2a-503b426da075 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:34.618726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c412e9b-7045-449f-af2a-503b426da075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:34.620701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c412e9b-7045-449f-af2a-503b426da075 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:34.636770 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1516/3034] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:33:34.641081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6d738-462d-4995-ad89-68a94ab93179 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:34.657373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6d738-462d-4995-ad89-68a94ab93179 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:34.674828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9377f-dd5f-46df-82a0-39eaed715c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:34.675522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9377f-dd5f-46df-82a0-39eaed715c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:34.675804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9377f-dd5f-46df-82a0-39eaed715c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:34.676077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9377f-dd5f-46df-82a0-39eaed715c84 admin admin] PATH_INFO: `/v3/projects/6cb52652b5ca4f46bd8847728396a1cc/users/16577adfa018436395667bd238d29db7/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:34.711616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9377f-dd5f-46df-82a0-39eaed715c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb52652b5ca4f46bd8847728396a1cc, user_id=16577adfa018436395667bd238d29db7, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:34.716247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9377f-dd5f-46df-82a0-39eaed715c84 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:34.738329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:34.748222 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1519/3035] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:33:34 2022] PUT /identity/v3/projects/6cb52652b5ca4f46bd8847728396a1cc/users/16577adfa018436395667bd238d29db7/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:34.752804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c412e9b-7045-449f-af2a-503b426da075 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:34.768733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c412e9b-7045-449f-af2a-503b426da075 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:34.885283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb90cae-bfce-4d93-bd0b-ef07d47f00fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:34.886294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb90cae-bfce-4d93-bd0b-ef07d47f00fe admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:34.886738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb90cae-bfce-4d93-bd0b-ef07d47f00fe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:34.887378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb90cae-bfce-4d93-bd0b-ef07d47f00fe admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:34.888204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb90cae-bfce-4d93-bd0b-ef07d47f00fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:34.890385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb90cae-bfce-4d93-bd0b-ef07d47f00fe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:34.903287 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1517/3036] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:33:34.909283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9377f-dd5f-46df-82a0-39eaed715c84 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:34.926156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9377f-dd5f-46df-82a0-39eaed715c84 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:34.946173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9b9ec-ae80-42c7-b5b5-95377790765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:34.947988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9b9ec-ae80-42c7-b5b5-95377790765a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:34.948485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9b9ec-ae80-42c7-b5b5-95377790765a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:34.950036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9b9ec-ae80-42c7-b5b5-95377790765a admin admin] PATH_INFO: `/v3/projects/6cb52652b5ca4f46bd8847728396a1cc/users/16577adfa018436395667bd238d29db7/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:34.958152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9b9ec-ae80-42c7-b5b5-95377790765a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb52652b5ca4f46bd8847728396a1cc, user_id=16577adfa018436395667bd238d29db7, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:34.965776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9b9ec-ae80-42c7-b5b5-95377790765a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:35.000193 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1520/3037] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:33:34 2022] PUT /identity/v3/projects/6cb52652b5ca4f46bd8847728396a1cc/users/16577adfa018436395667bd238d29db7/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:33:35.075910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb90cae-bfce-4d93-bd0b-ef07d47f00fe admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:35.138756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9b9ec-ae80-42c7-b5b5-95377790765a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:35.140559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-acb9b9ec-ae80-42c7-b5b5-95377790765a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:35.395389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb90cae-bfce-4d93-bd0b-ef07d47f00fe admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:35.419972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9b9ec-ae80-42c7-b5b5-95377790765a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:35.420508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ca774-5664-4570-b5e9-9288a3186cc0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:35.421316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ca774-5664-4570-b5e9-9288a3186cc0 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:35.422042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ca774-5664-4570-b5e9-9288a3186cc0 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:35.422910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ca774-5664-4570-b5e9-9288a3186cc0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:35.428235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c40ca774-5664-4570-b5e9-9288a3186cc0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:35.437224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175ea1b-ddad-4afa-80c2-9ca9275aa160 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:35.437995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175ea1b-ddad-4afa-80c2-9ca9275aa160 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:35.438274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175ea1b-ddad-4afa-80c2-9ca9275aa160 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:35.438553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175ea1b-ddad-4afa-80c2-9ca9275aa160 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:35.465246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175ea1b-ddad-4afa-80c2-9ca9275aa160 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:35.467892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175ea1b-ddad-4afa-80c2-9ca9275aa160 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:35.468409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ca774-5664-4570-b5e9-9288a3186cc0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:35.476158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ca774-5664-4570-b5e9-9288a3186cc0 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:35.485529 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1521/3038] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:33:35.515615 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1518/3039] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:33:45.480420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:45.503287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=78 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:46.384588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175ea1b-ddad-4afa-80c2-9ca9275aa160 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:46.398695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175ea1b-ddad-4afa-80c2-9ca9275aa160 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:46.406461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277b524-dc23-40b9-ac38-0757c3a24260 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:46.407371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277b524-dc23-40b9-ac38-0757c3a24260 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:46.407864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277b524-dc23-40b9-ac38-0757c3a24260 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:46.408211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277b524-dc23-40b9-ac38-0757c3a24260 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:46.410740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5277b524-dc23-40b9-ac38-0757c3a24260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:46.429063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277b524-dc23-40b9-ac38-0757c3a24260 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:46.432148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277b524-dc23-40b9-ac38-0757c3a24260 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:46.451529 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1522/3040] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:33:48.907412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ca774-5664-4570-b5e9-9288a3186cc0 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:48.912047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c40ca774-5664-4570-b5e9-9288a3186cc0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:49.161869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ca774-5664-4570-b5e9-9288a3186cc0 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:49.176178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f8141-c5b4-43d5-9842-cedf4e452234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:49.177168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f8141-c5b4-43d5-9842-cedf4e452234 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:49.177823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f8141-c5b4-43d5-9842-cedf4e452234 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:49.178407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f8141-c5b4-43d5-9842-cedf4e452234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:49.181611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-739f8141-c5b4-43d5-9842-cedf4e452234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:49.269157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f8141-c5b4-43d5-9842-cedf4e452234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:49.271608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f8141-c5b4-43d5-9842-cedf4e452234 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:49.307112 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1519/3041] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:33:50.651070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5cca9-494b-45b6-8aa0-521cbf908a79 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:50.651699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5cca9-494b-45b6-8aa0-521cbf908a79 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:50.651996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5cca9-494b-45b6-8aa0-521cbf908a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:50.732589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0fc5cca9-494b-45b6-8aa0-521cbf908a79 None None] MFA Rules not processed for user `16577adfa018436395667bd238d29db7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:33:50.734463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0fc5cca9-494b-45b6-8aa0-521cbf908a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:50.874347 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1523/3042] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:33:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:33:50.899143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f8141-c5b4-43d5-9842-cedf4e452234 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:33:50.900609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-739f8141-c5b4-43d5-9842-cedf4e452234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:33:51.058977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f8141-c5b4-43d5-9842-cedf4e452234 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:33:51.070079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad641c-efbc-4d64-b933-6667e5adc209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:33:51.075491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad641c-efbc-4d64-b933-6667e5adc209 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:33:51.075813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad641c-efbc-4d64-b933-6667e5adc209 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:33:51.076086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad641c-efbc-4d64-b933-6667e5adc209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:33:51.193024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:51.222811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad641c-efbc-4d64-b933-6667e5adc209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:33:51.224271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad641c-efbc-4d64-b933-6667e5adc209 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:33:51.250863 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1520/3043] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:33:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:34:00.856028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=40 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:01.237686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:02.579443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35557d-a4b2-4744-bff6-89b9acbd89d0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:02.580194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35557d-a4b2-4744-bff6-89b9acbd89d0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:02.580394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35557d-a4b2-4744-bff6-89b9acbd89d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:02.605974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7b35557d-a4b2-4744-bff6-89b9acbd89d0 None None] MFA Rules not processed for user `59d36e55c8ad494eb6260410fdecd1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:02.607327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7b35557d-a4b2-4744-bff6-89b9acbd89d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:02.703150 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1524/3044] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:06.421103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab9e1-eacf-47fa-9107-cdaec6c88818 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:06.421801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab9e1-eacf-47fa-9107-cdaec6c88818 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:06.421801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab9e1-eacf-47fa-9107-cdaec6c88818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:06.478849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8c2ab9e1-eacf-47fa-9107-cdaec6c88818 None None] MFA Rules not processed for user `a1ab26a46d314c97808cab66c3386ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:06.480160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8c2ab9e1-eacf-47fa-9107-cdaec6c88818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:06.656190 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1521/3045] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:08.660587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35557d-a4b2-4744-bff6-89b9acbd89d0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:08.662230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7b35557d-a4b2-4744-bff6-89b9acbd89d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:08.900481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35557d-a4b2-4744-bff6-89b9acbd89d0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:08.920476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:08.921150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:08.926265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:08.927684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] PATH_INFO: `/v3/users/1869270af6874c4db42112d4aa9417a6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:08.932568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1869270af6874c4db42112d4aa9417a6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:08.940663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:09.126393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1869270af6874c4db42112d4aa9417a6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:09.128809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1869270af6874c4db42112d4aa9417a6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:09.167699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1869270af6874c4db42112d4aa9417a6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:09.189632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1869270af6874c4db42112d4aa9417a6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:09.211655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1869270af6874c4db42112d4aa9417a6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:09.233274 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1525/3046] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:34:08 2022] DELETE /identity/v3/users/1869270af6874c4db42112d4aa9417a6 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:34:09.237934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5349d-f954-4c1a-92b3-9492535462f9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:09.238498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5349d-f954-4c1a-92b3-9492535462f9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:09.238498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5349d-f954-4c1a-92b3-9492535462f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:09.286309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5ba5349d-f954-4c1a-92b3-9492535462f9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:09.288022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5ba5349d-f954-4c1a-92b3-9492535462f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:09.497768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:09.498000 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1522/3047] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:09.499234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:09.607742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:09.700172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289280fd-2ad8-4647-aa0d-722d23b9c260 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:09.705927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc3886-344e-4c3f-9e1c-271840b9f39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:09.707367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc3886-344e-4c3f-9e1c-271840b9f39f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:09.719851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc3886-344e-4c3f-9e1c-271840b9f39f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:09.724416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc3886-344e-4c3f-9e1c-271840b9f39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:09.761182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc3886-344e-4c3f-9e1c-271840b9f39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:09.776355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc3886-344e-4c3f-9e1c-271840b9f39f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:09.820858 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1526/3048] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:34:10.286053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5349d-f954-4c1a-92b3-9492535462f9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:10.287613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5ba5349d-f954-4c1a-92b3-9492535462f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:10.307218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5349d-f954-4c1a-92b3-9492535462f9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:10.321452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:10.321452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:10.321452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:10.321452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] PATH_INFO: `/v3/projects/69c81aac0e2b4adba8bc9d9c9c24c097` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:10.322154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c81aac0e2b4adba8bc9d9c9c24c097)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:10.322154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:10.419107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c81aac0e2b4adba8bc9d9c9c24c097', 'request_id': 'req-70c27854-1426-4bfe-a0f4-ac152266766f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:10.426212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c81aac0e2b4adba8bc9d9c9c24c097', 'request_id': 'req-70c27854-1426-4bfe-a0f4-ac152266766f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:10.439089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c81aac0e2b4adba8bc9d9c9c24c097', 'request_id': 'req-70c27854-1426-4bfe-a0f4-ac152266766f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:10.458746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] The token cache is being invalidate because project 69c81aac0e2b4adba8bc9d9c9c24c097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:34:10.459392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:10.461187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:10.463404 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1523/3049] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:34:10 2022] DELETE /identity/v3/projects/69c81aac0e2b4adba8bc9d9c9c24c097 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:34:10.467820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc3886-344e-4c3f-9e1c-271840b9f39f service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:10.484932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc3886-344e-4c3f-9e1c-271840b9f39f service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:10.616913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:10.618147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:10.618616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:10.619081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] PATH_INFO: `/v3/users/a475f784dacf42f09574889b479994c1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:10.620512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a475f784dacf42f09574889b479994c1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:10.622706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:10.732553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a475f784dacf42f09574889b479994c1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:10.732553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a475f784dacf42f09574889b479994c1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:10.748356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a475f784dacf42f09574889b479994c1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:10.759863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a475f784dacf42f09574889b479994c1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:10.786348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a475f784dacf42f09574889b479994c1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:10.799022 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1527/3050] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:34:10 2022] DELETE /identity/v3/users/a475f784dacf42f09574889b479994c1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:34:10.837206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:10.839838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:10.895366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:11.068550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c27854-1426-4bfe-a0f4-ac152266766f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:11.181555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3a110-612b-48e1-83e4-21f1cff62b17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:11.182332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3a110-612b-48e1-83e4-21f1cff62b17 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:11.182650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3a110-612b-48e1-83e4-21f1cff62b17 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:11.182975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3a110-612b-48e1-83e4-21f1cff62b17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:11.185440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-69c3a110-612b-48e1-83e4-21f1cff62b17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:11.205593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3a110-612b-48e1-83e4-21f1cff62b17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:11.207654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3a110-612b-48e1-83e4-21f1cff62b17 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:11.219119 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1524/3051] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:34:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:34:11.247675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:11.249213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:11.337054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:11.368236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec4e09-e0fa-4c6c-b2c0-3550c304f64c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:11.376603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:11.378531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:11.378899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:11.379254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] PATH_INFO: `/v3/projects/99027d125a554aa8ba6d93ec8d8647df` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:11.380668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] RBAC: Authorizing `identity:delete_project(project_id=99027d125a554aa8ba6d93ec8d8647df)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:11.383133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:11.478018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99027d125a554aa8ba6d93ec8d8647df', 'request_id': 'req-8beb86f7-0978-4381-a2ed-dbb36b50779d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:11.485175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99027d125a554aa8ba6d93ec8d8647df', 'request_id': 'req-8beb86f7-0978-4381-a2ed-dbb36b50779d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:11.496731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99027d125a554aa8ba6d93ec8d8647df', 'request_id': 'req-8beb86f7-0978-4381-a2ed-dbb36b50779d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:11.523361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] The token cache is being invalidate because project 99027d125a554aa8ba6d93ec8d8647df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:34:11.523361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:11.525422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8beb86f7-0978-4381-a2ed-dbb36b50779d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:11.529420 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1528/3052] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:34:11 2022] DELETE /identity/v3/projects/99027d125a554aa8ba6d93ec8d8647df => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:34:11.531957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bdced-cd39-4c42-a5de-1c27e7a52827 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:11.532465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bdced-cd39-4c42-a5de-1c27e7a52827 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:11.532559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bdced-cd39-4c42-a5de-1c27e7a52827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:11.606318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-665bdced-cd39-4c42-a5de-1c27e7a52827 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:11.607519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-665bdced-cd39-4c42-a5de-1c27e7a52827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:11.725135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980e3c3-4984-48a0-9505-a73aade30309 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:11.725669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980e3c3-4984-48a0-9505-a73aade30309 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:11.726801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980e3c3-4984-48a0-9505-a73aade30309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:11.726948 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1525/3053] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:11.736775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bdced-cd39-4c42-a5de-1c27e7a52827 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:11.738868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-665bdced-cd39-4c42-a5de-1c27e7a52827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:11.819551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bdced-cd39-4c42-a5de-1c27e7a52827 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:11.824452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3980e3c3-4984-48a0-9505-a73aade30309 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:11.827396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3980e3c3-4984-48a0-9505-a73aade30309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:11.828765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:11.829833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:11.830396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:11.830983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] PATH_INFO: `/v3/users/a47bb5a8721d4c09933fec4331761a41` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:11.832848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47bb5a8721d4c09933fec4331761a41)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:11.836271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:11.840174 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1529/3054] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:11.847413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980e3c3-4984-48a0-9505-a73aade30309 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:11.866409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980e3c3-4984-48a0-9505-a73aade30309 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:11.872530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:11.876624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ec3ff-bcf1-4490-854e-5206704f07a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:11.876872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ec3ff-bcf1-4490-854e-5206704f07a7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:11.877198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ec3ff-bcf1-4490-854e-5206704f07a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:11.879019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ec3ff-bcf1-4490-854e-5206704f07a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:11.880410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ec3ff-bcf1-4490-854e-5206704f07a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:34:11.880964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ec3ff-bcf1-4490-854e-5206704f07a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:11.885490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ec3ff-bcf1-4490-854e-5206704f07a7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:11.930925 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1530/3055] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:34:11.934199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47bb5a8721d4c09933fec4331761a41'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:11.935226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47bb5a8721d4c09933fec4331761a41'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:11.936904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ec3ff-bcf1-4490-854e-5206704f07a7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:11.940158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f35ec3ff-bcf1-4490-854e-5206704f07a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:11.950432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47bb5a8721d4c09933fec4331761a41'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:11.951302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47bb5a8721d4c09933fec4331761a41'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:11.960231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47bb5a8721d4c09933fec4331761a41'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:11.969266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ec3ff-bcf1-4490-854e-5206704f07a7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:11.981486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8758e10-ae21-4f72-b0b5-83fda8969a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:11.982670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8758e10-ae21-4f72-b0b5-83fda8969a73 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:11.983179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8758e10-ae21-4f72-b0b5-83fda8969a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:11.983784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8758e10-ae21-4f72-b0b5-83fda8969a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:11.984896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8758e10-ae21-4f72-b0b5-83fda8969a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:11.989828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8758e10-ae21-4f72-b0b5-83fda8969a73 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:11.992492 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1526/3056] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:34:11 2022] DELETE /identity/v3/users/a47bb5a8721d4c09933fec4331761a41 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:34:12.063723 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1531/3057] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:34:11 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:34:12.064065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:12.158037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123f23-02a2-49d4-bcc5-261052a9644a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:12.258228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b2eed-1920-43e9-93fb-2edb01079f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:12.259441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b2eed-1920-43e9-93fb-2edb01079f9f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:12.259930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b2eed-1920-43e9-93fb-2edb01079f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:12.260555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b2eed-1920-43e9-93fb-2edb01079f9f admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:12.261467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b2eed-1920-43e9-93fb-2edb01079f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:12.263899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b2eed-1920-43e9-93fb-2edb01079f9f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:12.305938 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1527/3058] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:34:12 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:34:12.311088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8758e10-ae21-4f72-b0b5-83fda8969a73 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:12.312568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b2eed-1920-43e9-93fb-2edb01079f9f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:12.316278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-aa7b2eed-1920-43e9-93fb-2edb01079f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:12.327109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8758e10-ae21-4f72-b0b5-83fda8969a73 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:12.335764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babeb53-cfdc-458b-83cb-d1ef867a0654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:12.336780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babeb53-cfdc-458b-83cb-d1ef867a0654 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:12.337317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babeb53-cfdc-458b-83cb-d1ef867a0654 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:12.337846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babeb53-cfdc-458b-83cb-d1ef867a0654 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:12.338853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babeb53-cfdc-458b-83cb-d1ef867a0654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:12.341531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babeb53-cfdc-458b-83cb-d1ef867a0654 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:12.364808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b2eed-1920-43e9-93fb-2edb01079f9f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:12.371099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:12.371875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:12.372226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:12.372650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] PATH_INFO: `/v3/projects/1b0e1286b14d4f749e3216980f645523` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:12.373949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0e1286b14d4f749e3216980f645523)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:12.376231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:12.379714 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1532/3059] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:34:12.384544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babeb53-cfdc-458b-83cb-d1ef867a0654 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:12.408518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babeb53-cfdc-458b-83cb-d1ef867a0654 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:12.419876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca19ec-2cda-498d-94c1-16a66c8072bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:12.422185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca19ec-2cda-498d-94c1-16a66c8072bd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:12.422820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca19ec-2cda-498d-94c1-16a66c8072bd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:12.423351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca19ec-2cda-498d-94c1-16a66c8072bd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:12.424419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca19ec-2cda-498d-94c1-16a66c8072bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:12.426582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca19ec-2cda-498d-94c1-16a66c8072bd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:12.429776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:12.446372 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1533/3060] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:34:12.451557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca19ec-2cda-498d-94c1-16a66c8072bd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:12.472796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca19ec-2cda-498d-94c1-16a66c8072bd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:12.475087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0e1286b14d4f749e3216980f645523', 'request_id': 'req-5e002f6c-1cb4-4143-b8cf-62188f41545a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:12.494566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0e1286b14d4f749e3216980f645523', 'request_id': 'req-5e002f6c-1cb4-4143-b8cf-62188f41545a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:12.511997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0e1286b14d4f749e3216980f645523', 'request_id': 'req-5e002f6c-1cb4-4143-b8cf-62188f41545a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:12.542531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:12.544006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] The token cache is being invalidate because project 1b0e1286b14d4f749e3216980f645523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:34:12.545481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:12.548778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e002f6c-1cb4-4143-b8cf-62188f41545a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:12.552073 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1528/3061] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:34:12 2022] DELETE /identity/v3/projects/1b0e1286b14d4f749e3216980f645523 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:34:12.570993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477b33d-daa9-43bc-86b4-9c5da256e554 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:12.572399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477b33d-daa9-43bc-86b4-9c5da256e554 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:12.573740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477b33d-daa9-43bc-86b4-9c5da256e554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:12.578506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112700a-6e95-481c-a410-d266c5461c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:12.579265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112700a-6e95-481c-a410-d266c5461c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:12.579558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112700a-6e95-481c-a410-d266c5461c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:12.580981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112700a-6e95-481c-a410-d266c5461c10 admin admin] PATH_INFO: `/v3/projects/472ac27a5ec24dcbb2bacd4f2d2aed73/users/2de7e02a3f8242ea85479c80821c0edf/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:12.605716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112700a-6e95-481c-a410-d266c5461c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=472ac27a5ec24dcbb2bacd4f2d2aed73, user_id=2de7e02a3f8242ea85479c80821c0edf, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:12.608890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112700a-6e95-481c-a410-d266c5461c10 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:12.630314 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1534/3062] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:34:12 2022] PUT /identity/v3/projects/472ac27a5ec24dcbb2bacd4f2d2aed73/users/2de7e02a3f8242ea85479c80821c0edf/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:34:12.631482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c477b33d-daa9-43bc-86b4-9c5da256e554 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:12.635868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c477b33d-daa9-43bc-86b4-9c5da256e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:12.642937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8706ab3-fca8-4982-a4d0-e5c298603047 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:12.643683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8706ab3-fca8-4982-a4d0-e5c298603047 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:12.644775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8706ab3-fca8-4982-a4d0-e5c298603047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:12.715314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d8706ab3-fca8-4982-a4d0-e5c298603047 None None] MFA Rules not processed for user `2de7e02a3f8242ea85479c80821c0edf`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:12.719257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d8706ab3-fca8-4982-a4d0-e5c298603047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:12.791279 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1529/3063] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:12.793305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737c9b7-46f7-4c86-8b68-d26299fc3469 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:12.793636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737c9b7-46f7-4c86-8b68-d26299fc3469 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:12.793909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737c9b7-46f7-4c86-8b68-d26299fc3469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:12.826896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0737c9b7-46f7-4c86-8b68-d26299fc3469 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:12.828168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0737c9b7-46f7-4c86-8b68-d26299fc3469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:12.842576 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1530/3064] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:34:12.847018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737c9b7-46f7-4c86-8b68-d26299fc3469 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:12.858357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737c9b7-46f7-4c86-8b68-d26299fc3469 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:12.866545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07792da-6a49-4bd0-8ab9-ab6178c58f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:12.867502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07792da-6a49-4bd0-8ab9-ab6178c58f70 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:12.868242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07792da-6a49-4bd0-8ab9-ab6178c58f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:12.868714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07792da-6a49-4bd0-8ab9-ab6178c58f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:12.869754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07792da-6a49-4bd0-8ab9-ab6178c58f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:34:12.870293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07792da-6a49-4bd0-8ab9-ab6178c58f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:12.872114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07792da-6a49-4bd0-8ab9-ab6178c58f70 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:12.875986 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1535/3065] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:12.876996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8706ab3-fca8-4982-a4d0-e5c298603047 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:12.878584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d8706ab3-fca8-4982-a4d0-e5c298603047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:12.897310 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1531/3066] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:34:12.899489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07792da-6a49-4bd0-8ab9-ab6178c58f70 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:12.905019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8706ab3-fca8-4982-a4d0-e5c298603047 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:12.912744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fff14-c15d-43b6-9593-79c0f095e4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:12.913432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fff14-c15d-43b6-9593-79c0f095e4db admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:12.913737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fff14-c15d-43b6-9593-79c0f095e4db admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:12.914015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fff14-c15d-43b6-9593-79c0f095e4db admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:12.914666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fff14-c15d-43b6-9593-79c0f095e4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:12.916275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07792da-6a49-4bd0-8ab9-ab6178c58f70 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:12.917987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fff14-c15d-43b6-9593-79c0f095e4db admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:12.926125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b6d2-60a0-4b30-b869-bded63213add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:12.926862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b6d2-60a0-4b30-b869-bded63213add admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:12.927058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b6d2-60a0-4b30-b869-bded63213add admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:12.929547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b6d2-60a0-4b30-b869-bded63213add admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:12.931803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80b6d2-60a0-4b30-b869-bded63213add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:12.937644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80b6d2-60a0-4b30-b869-bded63213add admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:12.987376 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1532/3067] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:34:12 2022] POST /identity/v3/projects => generated 397 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:34:12.989414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b6d2-60a0-4b30-b869-bded63213add admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:12.992395 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1536/3068] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:34:12 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:34:12.998217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fff14-c15d-43b6-9593-79c0f095e4db admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:13.146999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b6d2-60a0-4b30-b869-bded63213add admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:13.170334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3093-cb62-4198-857c-495e43379003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:13.170980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3093-cb62-4198-857c-495e43379003 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:13.171258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3093-cb62-4198-857c-495e43379003 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:13.171530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3093-cb62-4198-857c-495e43379003 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:13.174237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d3093-cb62-4198-857c-495e43379003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:13.176402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fff14-c15d-43b6-9593-79c0f095e4db admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:13.184643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d3093-cb62-4198-857c-495e43379003 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:13.191843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00062a93-732c-4fc9-995a-577deaf8bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:13.192471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00062a93-732c-4fc9-995a-577deaf8bd1a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:13.192751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00062a93-732c-4fc9-995a-577deaf8bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:13.193030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00062a93-732c-4fc9-995a-577deaf8bd1a admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:13.193734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00062a93-732c-4fc9-995a-577deaf8bd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:13.196854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00062a93-732c-4fc9-995a-577deaf8bd1a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:13.244725 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1533/3069] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:34:12 2022] POST /identity/v3/users => generated 299 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:34:13.249119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3093-cb62-4198-857c-495e43379003 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:13.251533 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1537/3070] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:34:12 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:34:13.255422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00062a93-732c-4fc9-995a-577deaf8bd1a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:13.259546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:13.265370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3093-cb62-4198-857c-495e43379003 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:13.274898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5009909-3fe5-48f4-ad1a-f55aea13cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:13.275977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5009909-3fe5-48f4-ad1a-f55aea13cfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:13.276512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5009909-3fe5-48f4-ad1a-f55aea13cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:13.276660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00062a93-732c-4fc9-995a-577deaf8bd1a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:13.277549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5009909-3fe5-48f4-ad1a-f55aea13cfa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:13.278731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5009909-3fe5-48f4-ad1a-f55aea13cfa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:13.281119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5009909-3fe5-48f4-ad1a-f55aea13cfa0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:13.290576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dff83c-6eda-42e0-87e5-ba611db42d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:13.291201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dff83c-6eda-42e0-87e5-ba611db42d2b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:13.291482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dff83c-6eda-42e0-87e5-ba611db42d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:13.291758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dff83c-6eda-42e0-87e5-ba611db42d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:13.292419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dff83c-6eda-42e0-87e5-ba611db42d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:13.294071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dff83c-6eda-42e0-87e5-ba611db42d2b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:13.298827 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1534/3071] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:34:13.304657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5009909-3fe5-48f4-ad1a-f55aea13cfa0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:13.338391 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1538/3072] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:34:13.338657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5009909-3fe5-48f4-ad1a-f55aea13cfa0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:13.338803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dff83c-6eda-42e0-87e5-ba611db42d2b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:13.345242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643a3d-1ad0-4cdf-8719-d3fd4a2fe9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:13.345919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643a3d-1ad0-4cdf-8719-d3fd4a2fe9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:13.346199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643a3d-1ad0-4cdf-8719-d3fd4a2fe9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:13.346735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643a3d-1ad0-4cdf-8719-d3fd4a2fe9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:13.347392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643a3d-1ad0-4cdf-8719-d3fd4a2fe9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:13.350211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643a3d-1ad0-4cdf-8719-d3fd4a2fe9c3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:13.363677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dff83c-6eda-42e0-87e5-ba611db42d2b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:13.378281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974769d-4aef-4a83-a332-fe4462a8b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:13.379234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974769d-4aef-4a83-a332-fe4462a8b8af admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:13.379525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974769d-4aef-4a83-a332-fe4462a8b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:13.379810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974769d-4aef-4a83-a332-fe4462a8b8af admin admin] PATH_INFO: `/v3/projects/d5227619f68f43ca952c4c5c999a6d3d/users/6b63c7c667684d65a149ec100df2f323/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:13.384641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:13.386063 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1535/3073] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:34:13.388946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643a3d-1ad0-4cdf-8719-d3fd4a2fe9c3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:13.411050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974769d-4aef-4a83-a332-fe4462a8b8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5227619f68f43ca952c4c5c999a6d3d, user_id=6b63c7c667684d65a149ec100df2f323, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:13.414836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974769d-4aef-4a83-a332-fe4462a8b8af admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:13.415703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643a3d-1ad0-4cdf-8719-d3fd4a2fe9c3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:13.421325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd8684-97e8-4ca8-9485-60ff54dd27ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:13.423189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd8684-97e8-4ca8-9485-60ff54dd27ba admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:13.423553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd8684-97e8-4ca8-9485-60ff54dd27ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:13.423894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd8684-97e8-4ca8-9485-60ff54dd27ba admin admin] PATH_INFO: `/v3/projects/5ed3025a83094f7fa05d519da260f542/users/0bdd4cb707404bf28dfa892a1a5aaa76/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:13.446283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd8684-97e8-4ca8-9485-60ff54dd27ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed3025a83094f7fa05d519da260f542, user_id=0bdd4cb707404bf28dfa892a1a5aaa76, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:13.448305 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1539/3074] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:34:13 2022] PUT /identity/v3/projects/d5227619f68f43ca952c4c5c999a6d3d/users/6b63c7c667684d65a149ec100df2f323/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:34:13.449509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd8684-97e8-4ca8-9485-60ff54dd27ba admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:13.452458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974769d-4aef-4a83-a332-fe4462a8b8af admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:13.478084 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1536/3075] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:34:13 2022] PUT /identity/v3/projects/5ed3025a83094f7fa05d519da260f542/users/0bdd4cb707404bf28dfa892a1a5aaa76/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:34:13.479909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e508-38e8-472e-b472-d62ccb1e0621 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:13.480260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e508-38e8-472e-b472-d62ccb1e0621 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:13.480595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e508-38e8-472e-b472-d62ccb1e0621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:13.517815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7620e508-38e8-472e-b472-d62ccb1e0621 None None] MFA Rules not processed for user `0bdd4cb707404bf28dfa892a1a5aaa76`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:13.519479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7620e508-38e8-472e-b472-d62ccb1e0621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:13.587176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974769d-4aef-4a83-a332-fe4462a8b8af admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:13.634969 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1537/3076] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:34:13.718008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45089b-59f5-428d-8cd0-746d26205fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:13.718812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45089b-59f5-428d-8cd0-746d26205fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:13.719323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45089b-59f5-428d-8cd0-746d26205fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:13.720312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45089b-59f5-428d-8cd0-746d26205fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:13.721163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45089b-59f5-428d-8cd0-746d26205fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:13.723029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45089b-59f5-428d-8cd0-746d26205fe0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:13.747809 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1540/3077] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:34:13.751859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620e508-38e8-472e-b472-d62ccb1e0621 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:13.772423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620e508-38e8-472e-b472-d62ccb1e0621 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:13.791149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82932ecc-c8c5-41ea-b25c-ea32f5e3afb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:13.792283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82932ecc-c8c5-41ea-b25c-ea32f5e3afb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:13.792837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82932ecc-c8c5-41ea-b25c-ea32f5e3afb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:13.793671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82932ecc-c8c5-41ea-b25c-ea32f5e3afb8 admin admin] PATH_INFO: `/v3/projects/d5227619f68f43ca952c4c5c999a6d3d/users/6b63c7c667684d65a149ec100df2f323/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:13.796080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82932ecc-c8c5-41ea-b25c-ea32f5e3afb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5227619f68f43ca952c4c5c999a6d3d, user_id=6b63c7c667684d65a149ec100df2f323, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:13.819070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82932ecc-c8c5-41ea-b25c-ea32f5e3afb8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:13.844433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45089b-59f5-428d-8cd0-746d26205fe0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:13.847011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ae45089b-59f5-428d-8cd0-746d26205fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:13.872582 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1538/3078] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:34:13 2022] PUT /identity/v3/projects/d5227619f68f43ca952c4c5c999a6d3d/users/6b63c7c667684d65a149ec100df2f323/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:34:13.874496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217026-a552-4ca3-8311-a3ea9e85510c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:13.874704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217026-a552-4ca3-8311-a3ea9e85510c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:13.875113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217026-a552-4ca3-8311-a3ea9e85510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:13.968550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f1217026-a552-4ca3-8311-a3ea9e85510c None None] MFA Rules not processed for user `6b63c7c667684d65a149ec100df2f323`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:13.970387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f1217026-a552-4ca3-8311-a3ea9e85510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:14.100056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:14.100699 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1539/3079] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:34:14.112444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d5793-1033-4b30-b14e-82cff431502d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:14.112709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d5793-1033-4b30-b14e-82cff431502d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:14.112958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d5793-1033-4b30-b14e-82cff431502d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:14.115937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45089b-59f5-428d-8cd0-746d26205fe0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:14.196675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e21d5793-1033-4b30-b14e-82cff431502d None None] MFA Rules not processed for user `2de7e02a3f8242ea85479c80821c0edf`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:14.202092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e21d5793-1033-4b30-b14e-82cff431502d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:14.219474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966f3f5-066e-4988-8f89-a9f6795e9f15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:14.221905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f3f5-066e-4988-8f89-a9f6795e9f15 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:14.222854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f3f5-066e-4988-8f89-a9f6795e9f15 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:14.223816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f3f5-066e-4988-8f89-a9f6795e9f15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:14.237639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:14.338671 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1540/3080] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:14.375751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966f3f5-066e-4988-8f89-a9f6795e9f15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:14.381039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966f3f5-066e-4988-8f89-a9f6795e9f15 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:14.408326 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1541/3081] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:34:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:34:14.487048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d5793-1033-4b30-b14e-82cff431502d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:14.495796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e811d4f-9891-47a1-b125-1c1271553bd4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:14.495796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e811d4f-9891-47a1-b125-1c1271553bd4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:14.496100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e811d4f-9891-47a1-b125-1c1271553bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:14.517808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d5793-1033-4b30-b14e-82cff431502d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:14.535721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fcb8f-1e1d-42e7-a573-32a8c347ef94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:14.536809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fcb8f-1e1d-42e7-a573-32a8c347ef94 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:14.538031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fcb8f-1e1d-42e7-a573-32a8c347ef94 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:14.538598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fcb8f-1e1d-42e7-a573-32a8c347ef94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:14.545274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9e811d4f-9891-47a1-b125-1c1271553bd4 None None] MFA Rules not processed for user `0bdd4cb707404bf28dfa892a1a5aaa76`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:14.547012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9e811d4f-9891-47a1-b125-1c1271553bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:14.557641 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1542/3082] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:14.564068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fcb8f-1e1d-42e7-a573-32a8c347ef94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:14.567865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fcb8f-1e1d-42e7-a573-32a8c347ef94 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:14.590678 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1541/3083] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:34:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:34:15.632998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e811d4f-9891-47a1-b125-1c1271553bd4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:15.781691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e811d4f-9891-47a1-b125-1c1271553bd4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:15.792936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:15.793892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:15.794178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:15.794461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] PATH_INFO: `/v3/users/0bdd4cb707404bf28dfa892a1a5aaa76` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:15.796002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bdd4cb707404bf28dfa892a1a5aaa76)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:15.797992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:15.871250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:15.938361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bdd4cb707404bf28dfa892a1a5aaa76'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:15.939160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bdd4cb707404bf28dfa892a1a5aaa76'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:15.967808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bdd4cb707404bf28dfa892a1a5aaa76'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:15.985205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bdd4cb707404bf28dfa892a1a5aaa76'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:16.000265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bdd4cb707404bf28dfa892a1a5aaa76'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:16.019364 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1543/3084] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:34:15 2022] DELETE /identity/v3/users/0bdd4cb707404bf28dfa892a1a5aaa76 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:34:16.024111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8d17-86ec-4ae4-9179-2061eb2bc77e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:16.025899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8d17-86ec-4ae4-9179-2061eb2bc77e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:16.026397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8d17-86ec-4ae4-9179-2061eb2bc77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:16.060908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7e8f8d17-86ec-4ae4-9179-2061eb2bc77e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:16.063053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7e8f8d17-86ec-4ae4-9179-2061eb2bc77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:16.252460 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1542/3085] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:16.269594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:16.272448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:16.426402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4409030-72ab-43b6-9ce1-7f07286116b6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:16.433464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922a5f8-4a3d-40f5-ab03-e8afb736a080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:16.434567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922a5f8-4a3d-40f5-ab03-e8afb736a080 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:16.435083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922a5f8-4a3d-40f5-ab03-e8afb736a080 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:16.435777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922a5f8-4a3d-40f5-ab03-e8afb736a080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:16.453833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922a5f8-4a3d-40f5-ab03-e8afb736a080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:16.456051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922a5f8-4a3d-40f5-ab03-e8afb736a080 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:16.488835 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1544/3086] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:34:18.380222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f8d17-86ec-4ae4-9179-2061eb2bc77e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:18.382905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7e8f8d17-86ec-4ae4-9179-2061eb2bc77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:18.399431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f8d17-86ec-4ae4-9179-2061eb2bc77e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:18.431028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:18.432838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:18.433893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:18.435055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] PATH_INFO: `/v3/projects/5ed3025a83094f7fa05d519da260f542` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:18.437055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed3025a83094f7fa05d519da260f542)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:18.441707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:18.524280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed3025a83094f7fa05d519da260f542', 'request_id': 'req-3d684277-bb72-4e27-beaf-23dfab71e573'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:18.533793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed3025a83094f7fa05d519da260f542', 'request_id': 'req-3d684277-bb72-4e27-beaf-23dfab71e573'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:18.556302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed3025a83094f7fa05d519da260f542', 'request_id': 'req-3d684277-bb72-4e27-beaf-23dfab71e573'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:18.578900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] The token cache is being invalidate because project 5ed3025a83094f7fa05d519da260f542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:34:18.579235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:18.579967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d684277-bb72-4e27-beaf-23dfab71e573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:34:18.585602 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1543/3087] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:34:18 2022] DELETE /identity/v3/projects/5ed3025a83094f7fa05d519da260f542 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:34:18.586986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268fdcb-3b7d-4f08-8d6a-4ef6fffbbbe6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:18.587464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268fdcb-3b7d-4f08-8d6a-4ef6fffbbbe6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:18.587587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268fdcb-3b7d-4f08-8d6a-4ef6fffbbbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:18.646499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c268fdcb-3b7d-4f08-8d6a-4ef6fffbbbe6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:18.647739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c268fdcb-3b7d-4f08-8d6a-4ef6fffbbbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:18.876825 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1545/3088] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:18.885085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585da15-5286-4a42-a399-ba30ac5af971 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:18.885373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585da15-5286-4a42-a399-ba30ac5af971 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:18.885880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585da15-5286-4a42-a399-ba30ac5af971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:18.927491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f585da15-5286-4a42-a399-ba30ac5af971 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:18.931649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f585da15-5286-4a42-a399-ba30ac5af971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:18.968261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268fdcb-3b7d-4f08-8d6a-4ef6fffbbbe6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:18.970079 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1544/3089] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:18.987175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268fdcb-3b7d-4f08-8d6a-4ef6fffbbbe6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:19.001884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d7a1a-ace4-46a3-a836-2005cb01c2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:19.005777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d7a1a-ace4-46a3-a836-2005cb01c2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:19.006097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d7a1a-ace4-46a3-a836-2005cb01c2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:19.006419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d7a1a-ace4-46a3-a836-2005cb01c2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:19.012633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d7a1a-ace4-46a3-a836-2005cb01c2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:34:19.013170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d7a1a-ace4-46a3-a836-2005cb01c2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:19.015886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d7a1a-ace4-46a3-a836-2005cb01c2c9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:19.046621 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1546/3090] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:34:19.048532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585da15-5286-4a42-a399-ba30ac5af971 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:19.079662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585da15-5286-4a42-a399-ba30ac5af971 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:19.104473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040a02c-b664-427e-b9fc-05ce71a05371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:19.107192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040a02c-b664-427e-b9fc-05ce71a05371 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:19.109092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040a02c-b664-427e-b9fc-05ce71a05371 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:19.111581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040a02c-b664-427e-b9fc-05ce71a05371 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:19.114520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040a02c-b664-427e-b9fc-05ce71a05371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:19.126049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040a02c-b664-427e-b9fc-05ce71a05371 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:19.232073 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1545/3091] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:34:19 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:34:19.233127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d7a1a-ace4-46a3-a836-2005cb01c2c9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:19.246688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d7a1a-ace4-46a3-a836-2005cb01c2c9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:19.304561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:19.360381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609d829-e770-4f63-a7ff-ae68a81cb084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:19.362697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609d829-e770-4f63-a7ff-ae68a81cb084 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:19.364276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609d829-e770-4f63-a7ff-ae68a81cb084 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:19.364786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609d829-e770-4f63-a7ff-ae68a81cb084 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:19.367310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609d829-e770-4f63-a7ff-ae68a81cb084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:19.372524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609d829-e770-4f63-a7ff-ae68a81cb084 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:19.409594 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1547/3092] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:34:19 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:34:19.414049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040a02c-b664-427e-b9fc-05ce71a05371 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:19.430381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040a02c-b664-427e-b9fc-05ce71a05371 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:19.462890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f4154-9be1-40b1-8d58-beac31489a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:19.464242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4154-9be1-40b1-8d58-beac31489a5e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:19.464779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4154-9be1-40b1-8d58-beac31489a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:19.465557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4154-9be1-40b1-8d58-beac31489a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:19.466994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f4154-9be1-40b1-8d58-beac31489a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:19.472051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f4154-9be1-40b1-8d58-beac31489a5e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:19.486980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:19.526226 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1546/3093] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:34:19.531064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609d829-e770-4f63-a7ff-ae68a81cb084 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:19.551482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609d829-e770-4f63-a7ff-ae68a81cb084 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:19.563789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31fa46-3f6c-492a-b186-5a5f32aaaaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:19.568571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31fa46-3f6c-492a-b186-5a5f32aaaaaa admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:19.569549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31fa46-3f6c-492a-b186-5a5f32aaaaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:19.569935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31fa46-3f6c-492a-b186-5a5f32aaaaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:19.570683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31fa46-3f6c-492a-b186-5a5f32aaaaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:19.572733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31fa46-3f6c-492a-b186-5a5f32aaaaaa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:19.612511 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1548/3094] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:34:19.621646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f4154-9be1-40b1-8d58-beac31489a5e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:19.638578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f4154-9be1-40b1-8d58-beac31489a5e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:19.645447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46918f18-70d7-40aa-82cc-442dab31af87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:19.647414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46918f18-70d7-40aa-82cc-442dab31af87 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:19.648230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46918f18-70d7-40aa-82cc-442dab31af87 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:19.648776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46918f18-70d7-40aa-82cc-442dab31af87 admin admin] PATH_INFO: `/v3/projects/fb4265e2a96c4b9ba49452d382cc413c/users/736591425d2d40cda2331153600f20df/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:19.675628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46918f18-70d7-40aa-82cc-442dab31af87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb4265e2a96c4b9ba49452d382cc413c, user_id=736591425d2d40cda2331153600f20df, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:19.684650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46918f18-70d7-40aa-82cc-442dab31af87 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:19.702285 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1547/3095] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:34:19 2022] PUT /identity/v3/projects/fb4265e2a96c4b9ba49452d382cc413c/users/736591425d2d40cda2331153600f20df/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:34:19.708373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed838c3-0976-4a28-98ad-67a2a3f46d73 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:19.708978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed838c3-0976-4a28-98ad-67a2a3f46d73 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:19.709479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed838c3-0976-4a28-98ad-67a2a3f46d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:19.732268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-aed838c3-0976-4a28-98ad-67a2a3f46d73 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:19.733695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aed838c3-0976-4a28-98ad-67a2a3f46d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:19.817090 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1549/3096] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:19.824084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46918f18-70d7-40aa-82cc-442dab31af87 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:19.826197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-46918f18-70d7-40aa-82cc-442dab31af87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:19.943429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46918f18-70d7-40aa-82cc-442dab31af87 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:19.950102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15df53-77dc-4d0b-a2b8-0c36381e2436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:19.951062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15df53-77dc-4d0b-a2b8-0c36381e2436 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:19.951603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15df53-77dc-4d0b-a2b8-0c36381e2436 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:19.952127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15df53-77dc-4d0b-a2b8-0c36381e2436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:19.967553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15df53-77dc-4d0b-a2b8-0c36381e2436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:19.971155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15df53-77dc-4d0b-a2b8-0c36381e2436 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:20.003457 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1548/3097] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:34:29.804309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=43,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:29.999864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=47,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:30.392389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358473-aca7-4faa-aa4a-d939ec5b87bd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:30.393790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358473-aca7-4faa-aa4a-d939ec5b87bd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:30.395062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358473-aca7-4faa-aa4a-d939ec5b87bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:30.490056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c9358473-aca7-4faa-aa4a-d939ec5b87bd None None] MFA Rules not processed for user `736591425d2d40cda2331153600f20df`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:30.494981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c9358473-aca7-4faa-aa4a-d939ec5b87bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:30.688779 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1550/3098] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:31.027024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15df53-77dc-4d0b-a2b8-0c36381e2436 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:31.028577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5a15df53-77dc-4d0b-a2b8-0c36381e2436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:31.243045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15df53-77dc-4d0b-a2b8-0c36381e2436 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:31.252783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d763593-225f-46fd-91fc-bdd0d74baa8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:31.253525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d763593-225f-46fd-91fc-bdd0d74baa8d service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:31.253804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d763593-225f-46fd-91fc-bdd0d74baa8d service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:31.254077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d763593-225f-46fd-91fc-bdd0d74baa8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:31.269042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d763593-225f-46fd-91fc-bdd0d74baa8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:31.272039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d763593-225f-46fd-91fc-bdd0d74baa8d service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:31.304704 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1549/3099] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:34:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:34:36.751227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bbc50-1629-4dfa-9961-70f06326cc4a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:36.751887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bbc50-1629-4dfa-9961-70f06326cc4a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:36.751887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bbc50-1629-4dfa-9961-70f06326cc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:36.801814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c24bbc50-1629-4dfa-9961-70f06326cc4a None None] MFA Rules not processed for user `736591425d2d40cda2331153600f20df`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:36.801814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c24bbc50-1629-4dfa-9961-70f06326cc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:36.817321 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1551/3100] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:34:37.698283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d763593-225f-46fd-91fc-bdd0d74baa8d service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:37.700350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0d763593-225f-46fd-91fc-bdd0d74baa8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:37.718213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d763593-225f-46fd-91fc-bdd0d74baa8d service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:37.736474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d044e-8ab1-4b4e-b323-7938e8355cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:37.737185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d044e-8ab1-4b4e-b323-7938e8355cba service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:37.737752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d044e-8ab1-4b4e-b323-7938e8355cba service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:37.738109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d044e-8ab1-4b4e-b323-7938e8355cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:37.740171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-983d044e-8ab1-4b4e-b323-7938e8355cba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:37.891952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d044e-8ab1-4b4e-b323-7938e8355cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:37.893602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d044e-8ab1-4b4e-b323-7938e8355cba service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:37.908870 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1550/3101] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:34:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:34:39.635427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41cb3-14e8-459f-9664-39177f84ba13 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:39.635984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41cb3-14e8-459f-9664-39177f84ba13 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:39.635984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41cb3-14e8-459f-9664-39177f84ba13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:39.670600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a5c41cb3-14e8-459f-9664-39177f84ba13 None None] MFA Rules not processed for user `33daa615bc42447b9056611bc563e131`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:39.671734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a5c41cb3-14e8-459f-9664-39177f84ba13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:39.836056 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1552/3102] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:39.847397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089cce9-d9b8-48eb-a359-734b4b67a5d6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:39.848123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089cce9-d9b8-48eb-a359-734b4b67a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:39.848123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089cce9-d9b8-48eb-a359-734b4b67a5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:39.902577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8089cce9-d9b8-48eb-a359-734b4b67a5d6 None None] MFA Rules not processed for user `33daa615bc42447b9056611bc563e131`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:34:39.904096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8089cce9-d9b8-48eb-a359-734b4b67a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:39.916046 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1551/3103] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:34:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:34:45.114385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41cb3-14e8-459f-9664-39177f84ba13 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:45.126903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41cb3-14e8-459f-9664-39177f84ba13 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:45.132295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aebc7-aa0a-4301-9538-7c34693bff73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:45.133945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aebc7-aa0a-4301-9538-7c34693bff73 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:45.134784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aebc7-aa0a-4301-9538-7c34693bff73 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:45.135302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aebc7-aa0a-4301-9538-7c34693bff73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:45.138779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6f9aebc7-aa0a-4301-9538-7c34693bff73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:45.154807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9aebc7-aa0a-4301-9538-7c34693bff73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:45.156558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9aebc7-aa0a-4301-9538-7c34693bff73 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:45.169892 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1553/3104] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:34:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:34:46.816432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089cce9-d9b8-48eb-a359-734b4b67a5d6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:34:46.817721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8089cce9-d9b8-48eb-a359-734b4b67a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:46.856817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089cce9-d9b8-48eb-a359-734b4b67a5d6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:34:46.866017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b95ab-840b-45af-aa36-e350f3457f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:34:46.866528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b95ab-840b-45af-aa36-e350f3457f15 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:34:46.866806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b95ab-840b-45af-aa36-e350f3457f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:34:46.867075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b95ab-840b-45af-aa36-e350f3457f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:34:46.877153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bc7b95ab-840b-45af-aa36-e350f3457f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:34:46.910632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b95ab-840b-45af-aa36-e350f3457f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:34:46.912264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b95ab-840b-45af-aa36-e350f3457f15 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:34:46.946849 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1552/3105] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:34:55.164129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=66 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:56.920288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=73 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:02.973752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aebc7-aa0a-4301-9538-7c34693bff73 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:02.975960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6f9aebc7-aa0a-4301-9538-7c34693bff73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:02.998998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aebc7-aa0a-4301-9538-7c34693bff73 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:03.021447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:03.023027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:03.023599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:03.024096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] PATH_INFO: `/v3/users/f331c1e3ee1442ad863d8909ca76020b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:03.025699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f331c1e3ee1442ad863d8909ca76020b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:03.027997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:03.127579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f331c1e3ee1442ad863d8909ca76020b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:03.129061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f331c1e3ee1442ad863d8909ca76020b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:03.162279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f331c1e3ee1442ad863d8909ca76020b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:03.179411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f331c1e3ee1442ad863d8909ca76020b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:03.192299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f331c1e3ee1442ad863d8909ca76020b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:03.210356 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1554/3106] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:35:02 2022] DELETE /identity/v3/users/f331c1e3ee1442ad863d8909ca76020b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:03.860504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b95ab-840b-45af-aa36-e350f3457f15 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:03.876444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b95ab-840b-45af-aa36-e350f3457f15 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:04.050619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:04.051459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:04.051844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:04.052230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] PATH_INFO: `/v3/projects/0145760115bc47d188f32fca7793b863` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:04.053619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0145760115bc47d188f32fca7793b863)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:04.065745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:04.220551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0145760115bc47d188f32fca7793b863', 'request_id': 'req-276d3476-45c4-47e0-aa48-39092882226f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:04.235949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0145760115bc47d188f32fca7793b863', 'request_id': 'req-276d3476-45c4-47e0-aa48-39092882226f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:04.259023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0145760115bc47d188f32fca7793b863', 'request_id': 'req-276d3476-45c4-47e0-aa48-39092882226f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:04.292493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] The token cache is being invalidate because project 0145760115bc47d188f32fca7793b863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:35:04.294325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:04.295164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:04.305113 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1553/3107] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:35:03 2022] DELETE /identity/v3/projects/0145760115bc47d188f32fca7793b863 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:04.306617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:04.308072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:04.343083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390b0df-1d05-42f4-9d80-9447a72cdbb2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:04.503479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c898099-b634-4abb-98a0-0e9eccaa04cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:04.507451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c898099-b634-4abb-98a0-0e9eccaa04cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:04.509681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c898099-b634-4abb-98a0-0e9eccaa04cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:04.510002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c898099-b634-4abb-98a0-0e9eccaa04cc admin admin] PATH_INFO: `/v3/users/0c9580da14a34c67b6d53ddbb9e96df6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:04.515589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c898099-b634-4abb-98a0-0e9eccaa04cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9580da14a34c67b6d53ddbb9e96df6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:04.522459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c898099-b634-4abb-98a0-0e9eccaa04cc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:04.708721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c898099-b634-4abb-98a0-0e9eccaa04cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9580da14a34c67b6d53ddbb9e96df6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:04.711850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c898099-b634-4abb-98a0-0e9eccaa04cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9580da14a34c67b6d53ddbb9e96df6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:04.743070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c898099-b634-4abb-98a0-0e9eccaa04cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9580da14a34c67b6d53ddbb9e96df6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:04.760346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c898099-b634-4abb-98a0-0e9eccaa04cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9580da14a34c67b6d53ddbb9e96df6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:04.762970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:04.796825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c898099-b634-4abb-98a0-0e9eccaa04cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9580da14a34c67b6d53ddbb9e96df6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:04.816048 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1555/3108] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:35:04 2022] DELETE /identity/v3/users/0c9580da14a34c67b6d53ddbb9e96df6 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:05.549024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:05.550850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:05.578520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d3476-45c4-47e0-aa48-39092882226f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:05.747331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:05.747943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:05.748355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:05.748639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] PATH_INFO: `/v3/projects/6e4f427a535b4d51a0476f4b2cb71196` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:05.749863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4f427a535b4d51a0476f4b2cb71196)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:05.751725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:05.845452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:05.873508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4f427a535b4d51a0476f4b2cb71196', 'request_id': 'req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:05.892007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4f427a535b4d51a0476f4b2cb71196', 'request_id': 'req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:05.909923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4f427a535b4d51a0476f4b2cb71196', 'request_id': 'req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:05.932861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] The token cache is being invalidate because project 6e4f427a535b4d51a0476f4b2cb71196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:35:05.933156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:05.935691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-559ae6bc-9b33-49e0-b90e-c3b4f2d7ff6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:05.937452 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1554/3109] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:35:05 2022] DELETE /identity/v3/projects/6e4f427a535b4d51a0476f4b2cb71196 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:05.945019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04f0ab-4daa-4fb7-9032-eead64207f02 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:05.945529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04f0ab-4daa-4fb7-9032-eead64207f02 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:05.945599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04f0ab-4daa-4fb7-9032-eead64207f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:05.968692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2f04f0ab-4daa-4fb7-9032-eead64207f02 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:05.969970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2f04f0ab-4daa-4fb7-9032-eead64207f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:06.106675 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1556/3110] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:06.115774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c42c2-5bfc-417d-ba7f-0580552c7c72 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:06.116466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c42c2-5bfc-417d-ba7f-0580552c7c72 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:06.116877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c42c2-5bfc-417d-ba7f-0580552c7c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:06.162629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0d3c42c2-5bfc-417d-ba7f-0580552c7c72 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:06.165411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0d3c42c2-5bfc-417d-ba7f-0580552c7c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:06.203607 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1555/3111] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:35:06.208072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04f0ab-4daa-4fb7-9032-eead64207f02 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:06.241140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04f0ab-4daa-4fb7-9032-eead64207f02 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:06.253728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945ba5e-ec22-4fc5-bb59-727e0d9e355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:06.254368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945ba5e-ec22-4fc5-bb59-727e0d9e355a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:06.254652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945ba5e-ec22-4fc5-bb59-727e0d9e355a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:06.254926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945ba5e-ec22-4fc5-bb59-727e0d9e355a admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:06.257356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945ba5e-ec22-4fc5-bb59-727e0d9e355a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:35:06.258387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945ba5e-ec22-4fc5-bb59-727e0d9e355a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:06.263828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945ba5e-ec22-4fc5-bb59-727e0d9e355a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:06.301455 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1557/3112] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:35:06.304868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c42c2-5bfc-417d-ba7f-0580552c7c72 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:06.323958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c42c2-5bfc-417d-ba7f-0580552c7c72 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:06.335075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1a5d1-b633-46c5-82e5-46dced5bf607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:06.335830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a5d1-b633-46c5-82e5-46dced5bf607 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:06.337467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a5d1-b633-46c5-82e5-46dced5bf607 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:06.337848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a5d1-b633-46c5-82e5-46dced5bf607 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:06.338612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1a5d1-b633-46c5-82e5-46dced5bf607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:06.345066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1a5d1-b633-46c5-82e5-46dced5bf607 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:06.435440 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1556/3113] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:35:06 2022] POST /identity/v3/projects => generated 411 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:06.439935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945ba5e-ec22-4fc5-bb59-727e0d9e355a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:06.466708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945ba5e-ec22-4fc5-bb59-727e0d9e355a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:06.691799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624a04b-5715-4ccc-a339-2defb1e138e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:06.706305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624a04b-5715-4ccc-a339-2defb1e138e8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:06.707055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624a04b-5715-4ccc-a339-2defb1e138e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:06.707551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624a04b-5715-4ccc-a339-2defb1e138e8 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:06.708569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624a04b-5715-4ccc-a339-2defb1e138e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:06.711459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624a04b-5715-4ccc-a339-2defb1e138e8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:06.760930 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1558/3114] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:35:06 2022] POST /identity/v3/users => generated 306 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:06.766427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1a5d1-b633-46c5-82e5-46dced5bf607 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:06.792333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1a5d1-b633-46c5-82e5-46dced5bf607 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:06.804804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfff36-c26a-4606-b168-a5624e0f1e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:06.805715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfff36-c26a-4606-b168-a5624e0f1e66 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:06.806017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfff36-c26a-4606-b168-a5624e0f1e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:06.807924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfff36-c26a-4606-b168-a5624e0f1e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:06.808640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfff36-c26a-4606-b168-a5624e0f1e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:06.815031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfff36-c26a-4606-b168-a5624e0f1e66 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:06.839217 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1557/3115] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:06.839938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624a04b-5715-4ccc-a339-2defb1e138e8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:06.868880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624a04b-5715-4ccc-a339-2defb1e138e8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:06.879109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666058e-b389-4db5-a85f-b63ed228d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:06.881940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666058e-b389-4db5-a85f-b63ed228d6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:06.882946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666058e-b389-4db5-a85f-b63ed228d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:06.883244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666058e-b389-4db5-a85f-b63ed228d6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:06.884479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666058e-b389-4db5-a85f-b63ed228d6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:06.891140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666058e-b389-4db5-a85f-b63ed228d6c2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:06.976854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfff36-c26a-4606-b168-a5624e0f1e66 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:06.987623 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1559/3116] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:06.993245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfff36-c26a-4606-b168-a5624e0f1e66 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:07.007597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7550172-a600-4448-b3f3-8a0ce774a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:07.010614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7550172-a600-4448-b3f3-8a0ce774a243 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:07.010963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7550172-a600-4448-b3f3-8a0ce774a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:07.012561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7550172-a600-4448-b3f3-8a0ce774a243 admin admin] PATH_INFO: `/v3/projects/ef312cb51a84470d8c0d38c9c2a65b79/users/d844cb81667346a6aaf07c288c6918be/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:07.079972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7550172-a600-4448-b3f3-8a0ce774a243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef312cb51a84470d8c0d38c9c2a65b79, user_id=d844cb81667346a6aaf07c288c6918be, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:07.083424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7550172-a600-4448-b3f3-8a0ce774a243 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:07.112942 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1558/3117] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:35:06 2022] PUT /identity/v3/projects/ef312cb51a84470d8c0d38c9c2a65b79/users/d844cb81667346a6aaf07c288c6918be/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:07.118932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4443b-ad38-4ad4-8348-3f0f7bf8a473 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:07.119524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4443b-ad38-4ad4-8348-3f0f7bf8a473 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:07.119976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4443b-ad38-4ad4-8348-3f0f7bf8a473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:07.149153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0df4443b-ad38-4ad4-8348-3f0f7bf8a473 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:07.150690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0df4443b-ad38-4ad4-8348-3f0f7bf8a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:07.326294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:07.341482 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1560/3118] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:35:07.396009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7550172-a600-4448-b3f3-8a0ce774a243 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:07.399352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d7550172-a600-4448-b3f3-8a0ce774a243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:07.610642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7550172-a600-4448-b3f3-8a0ce774a243 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:07.625275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78626ebf-a1e8-46b7-bacd-53c47e54f16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:07.625971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626ebf-a1e8-46b7-bacd-53c47e54f16e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:07.626251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626ebf-a1e8-46b7-bacd-53c47e54f16e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:07.626714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626ebf-a1e8-46b7-bacd-53c47e54f16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:07.652436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78626ebf-a1e8-46b7-bacd-53c47e54f16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:07.654768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78626ebf-a1e8-46b7-bacd-53c47e54f16e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:07.672219 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1559/3119] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:08.828690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4443b-ad38-4ad4-8348-3f0f7bf8a473 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:08.830501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0df4443b-ad38-4ad4-8348-3f0f7bf8a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:09.021560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4443b-ad38-4ad4-8348-3f0f7bf8a473 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:09.033207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c086b-002b-459d-801e-2a1129a27b21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:09.033875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c086b-002b-459d-801e-2a1129a27b21 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:09.034165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c086b-002b-459d-801e-2a1129a27b21 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:09.034449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c086b-002b-459d-801e-2a1129a27b21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:09.041498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-728c086b-002b-459d-801e-2a1129a27b21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:09.183306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c086b-002b-459d-801e-2a1129a27b21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:09.184928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c086b-002b-459d-801e-2a1129a27b21 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:09.207908 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1561/3120] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:14.596586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78626ebf-a1e8-46b7-bacd-53c47e54f16e service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:14.598071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-78626ebf-a1e8-46b7-bacd-53c47e54f16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:14.624185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78626ebf-a1e8-46b7-bacd-53c47e54f16e service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:14.643246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd009d5-45d9-44f5-8de9-d2ddfe900493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:14.645129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd009d5-45d9-44f5-8de9-d2ddfe900493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:14.649126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd009d5-45d9-44f5-8de9-d2ddfe900493 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:14.653532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd009d5-45d9-44f5-8de9-d2ddfe900493 admin admin] PATH_INFO: `/v3/users/59d36e55c8ad494eb6260410fdecd1a1` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:14.655166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd009d5-45d9-44f5-8de9-d2ddfe900493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d36e55c8ad494eb6260410fdecd1a1)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:14.657314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd009d5-45d9-44f5-8de9-d2ddfe900493 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:14.857795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6fd009d5-45d9-44f5-8de9-d2ddfe900493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d36e55c8ad494eb6260410fdecd1a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:14.858794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6fd009d5-45d9-44f5-8de9-d2ddfe900493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d36e55c8ad494eb6260410fdecd1a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:14.871337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:14.891141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6fd009d5-45d9-44f5-8de9-d2ddfe900493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d36e55c8ad494eb6260410fdecd1a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:14.901906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6fd009d5-45d9-44f5-8de9-d2ddfe900493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d36e55c8ad494eb6260410fdecd1a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:14.911869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6fd009d5-45d9-44f5-8de9-d2ddfe900493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d36e55c8ad494eb6260410fdecd1a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:14.939154 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1560/3121] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:35:14 2022] DELETE /identity/v3/users/59d36e55c8ad494eb6260410fdecd1a1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:16.991207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c086b-002b-459d-801e-2a1129a27b21 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:17.018869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c086b-002b-459d-801e-2a1129a27b21 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:17.133840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:17.135062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:17.135670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:17.136269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] PATH_INFO: `/v3/projects/5628dcd53a614a4589eb526ba20c291c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:17.139353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5628dcd53a614a4589eb526ba20c291c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:17.145047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:17.200262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:17.223346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5628dcd53a614a4589eb526ba20c291c', 'request_id': 'req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:17.230931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5628dcd53a614a4589eb526ba20c291c', 'request_id': 'req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:17.241568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5628dcd53a614a4589eb526ba20c291c', 'request_id': 'req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:17.258682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] The token cache is being invalidate because project 5628dcd53a614a4589eb526ba20c291c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:35:17.258986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:17.259910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6fe48d34-ab0a-4ccd-b7eb-67a44bdb594a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:17.261632 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1562/3122] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:35:16 2022] DELETE /identity/v3/projects/5628dcd53a614a4589eb526ba20c291c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:35:17.272046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648143-a639-476f-8fa2-23c906c3a5d0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:17.272487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648143-a639-476f-8fa2-23c906c3a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:17.272675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648143-a639-476f-8fa2-23c906c3a5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:17.303269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b0648143-a639-476f-8fa2-23c906c3a5d0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:17.305167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b0648143-a639-476f-8fa2-23c906c3a5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:17.421374 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1561/3123] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:17.430467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c0f8b-9ab5-46ea-9c81-04326584a046 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:17.430992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c0f8b-9ab5-46ea-9c81-04326584a046 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:17.432389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c0f8b-9ab5-46ea-9c81-04326584a046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:17.461368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-551c0f8b-9ab5-46ea-9c81-04326584a046 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:17.463534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-551c0f8b-9ab5-46ea-9c81-04326584a046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:17.476020 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1563/3124] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:17.480261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0648143-a639-476f-8fa2-23c906c3a5d0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:17.510078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0648143-a639-476f-8fa2-23c906c3a5d0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:17.525912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e3d9c-f8e9-4019-a2c1-986651bfff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:17.527862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3d9c-f8e9-4019-a2c1-986651bfff84 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:17.528107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3d9c-f8e9-4019-a2c1-986651bfff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:17.529506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3d9c-f8e9-4019-a2c1-986651bfff84 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:17.530459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e3d9c-f8e9-4019-a2c1-986651bfff84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:35:17.532559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e3d9c-f8e9-4019-a2c1-986651bfff84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:17.539657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e3d9c-f8e9-4019-a2c1-986651bfff84 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:17.557325 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1562/3125] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:35:17.562093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c0f8b-9ab5-46ea-9c81-04326584a046 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:17.576219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c0f8b-9ab5-46ea-9c81-04326584a046 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:17.582007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843d3f6-bc4c-47fc-8ba2-ea5eaf03c8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:17.582764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d3f6-bc4c-47fc-8ba2-ea5eaf03c8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:17.583264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d3f6-bc4c-47fc-8ba2-ea5eaf03c8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:17.583802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d3f6-bc4c-47fc-8ba2-ea5eaf03c8e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:17.585184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843d3f6-bc4c-47fc-8ba2-ea5eaf03c8e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:17.587242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843d3f6-bc4c-47fc-8ba2-ea5eaf03c8e2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:17.662145 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1564/3126] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:35:17 2022] POST /identity/v3/projects => generated 359 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:17.663931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e3d9c-f8e9-4019-a2c1-986651bfff84 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:17.675158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e3d9c-f8e9-4019-a2c1-986651bfff84 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:17.799007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cd342-3a5b-4f9f-819b-4805b7e5a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:17.799652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cd342-3a5b-4f9f-819b-4805b7e5a9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:17.799943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cd342-3a5b-4f9f-819b-4805b7e5a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:17.800221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cd342-3a5b-4f9f-819b-4805b7e5a9b0 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:17.800912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cd342-3a5b-4f9f-819b-4805b7e5a9b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:17.803596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cd342-3a5b-4f9f-819b-4805b7e5a9b0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:17.852553 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1563/3127] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:35:17 2022] POST /identity/v3/users => generated 280 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:17.863766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843d3f6-bc4c-47fc-8ba2-ea5eaf03c8e2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:17.880149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843d3f6-bc4c-47fc-8ba2-ea5eaf03c8e2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:17.888451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f04aec-d9fa-47d5-98ee-5ddc73bba8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:17.889250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f04aec-d9fa-47d5-98ee-5ddc73bba8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:17.889652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f04aec-d9fa-47d5-98ee-5ddc73bba8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:17.890147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f04aec-d9fa-47d5-98ee-5ddc73bba8d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:17.890969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f04aec-d9fa-47d5-98ee-5ddc73bba8d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:17.893815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f04aec-d9fa-47d5-98ee-5ddc73bba8d3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:17.910550 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1565/3128] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:17.915456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cd342-3a5b-4f9f-819b-4805b7e5a9b0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:17.929189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cd342-3a5b-4f9f-819b-4805b7e5a9b0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:17.941140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750af86-8f3b-452f-bd46-afa997747c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:17.941852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750af86-8f3b-452f-bd46-afa997747c2a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:17.942162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750af86-8f3b-452f-bd46-afa997747c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:17.942476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750af86-8f3b-452f-bd46-afa997747c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:17.943157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750af86-8f3b-452f-bd46-afa997747c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:17.944882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750af86-8f3b-452f-bd46-afa997747c2a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:17.962935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f04aec-d9fa-47d5-98ee-5ddc73bba8d3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:17.964718 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1564/3129] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:17.977624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f04aec-d9fa-47d5-98ee-5ddc73bba8d3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:17.984049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdd677-d2bf-4f58-bb05-d04cf7f531fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:17.984915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd677-d2bf-4f58-bb05-d04cf7f531fa admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:17.985292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd677-d2bf-4f58-bb05-d04cf7f531fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:17.986604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd677-d2bf-4f58-bb05-d04cf7f531fa admin admin] PATH_INFO: `/v3/projects/98139e6a976f42ebb058ac2ab076b469/users/5a6638b419ed4b45accc8362f7584893/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:18.004874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdd677-d2bf-4f58-bb05-d04cf7f531fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=98139e6a976f42ebb058ac2ab076b469, user_id=5a6638b419ed4b45accc8362f7584893, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:18.008688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdd677-d2bf-4f58-bb05-d04cf7f531fa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:18.024924 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1566/3130] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:35:17 2022] PUT /identity/v3/projects/98139e6a976f42ebb058ac2ab076b469/users/5a6638b419ed4b45accc8362f7584893/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:35:18.035533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993198d-d673-4619-a5e8-caabdc2c8c77 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:18.035865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993198d-d673-4619-a5e8-caabdc2c8c77 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:18.036081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993198d-d673-4619-a5e8-caabdc2c8c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:18.067339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0993198d-d673-4619-a5e8-caabdc2c8c77 None None] MFA Rules not processed for user `5a6638b419ed4b45accc8362f7584893`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:18.068214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0993198d-d673-4619-a5e8-caabdc2c8c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:18.099378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:18.154291 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1565/3131] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:18.190183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdd677-d2bf-4f58-bb05-d04cf7f531fa admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:18.191905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-84fdd677-d2bf-4f58-bb05-d04cf7f531fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:18.315255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdd677-d2bf-4f58-bb05-d04cf7f531fa admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:18.329813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3eb28-165d-4702-b84c-b5d6568bcafa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:18.330444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3eb28-165d-4702-b84c-b5d6568bcafa service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:18.330724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3eb28-165d-4702-b84c-b5d6568bcafa service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:18.331002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3eb28-165d-4702-b84c-b5d6568bcafa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:18.342724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3eb28-165d-4702-b84c-b5d6568bcafa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:18.344334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3eb28-165d-4702-b84c-b5d6568bcafa service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:18.367156 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1567/3132] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:18.411759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993198d-d673-4619-a5e8-caabdc2c8c77 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:18.520611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993198d-d673-4619-a5e8-caabdc2c8c77 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:18.536066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:18.536723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:18.537003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:18.537309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] PATH_INFO: `/v3/users/5a6638b419ed4b45accc8362f7584893` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:18.540723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6638b419ed4b45accc8362f7584893)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:18.542086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:18.626847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6638b419ed4b45accc8362f7584893'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:18.627732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6638b419ed4b45accc8362f7584893'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:18.647579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6638b419ed4b45accc8362f7584893'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:18.648514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6638b419ed4b45accc8362f7584893'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:18.657556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6638b419ed4b45accc8362f7584893'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:18.676619 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1566/3133] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:35:18 2022] DELETE /identity/v3/users/5a6638b419ed4b45accc8362f7584893 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:18.681257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5511b68-ebc8-47e9-9fe5-4c3660e9369d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:18.681724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5511b68-ebc8-47e9-9fe5-4c3660e9369d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:18.682110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5511b68-ebc8-47e9-9fe5-4c3660e9369d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:18.721044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f5511b68-ebc8-47e9-9fe5-4c3660e9369d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:18.722912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f5511b68-ebc8-47e9-9fe5-4c3660e9369d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:18.792344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:18.821881 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1568/3134] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:18.829186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:18.830680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:18.908971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:18.917262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224df3-46c0-4cf6-934e-fe8f8eb605c3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:18.924770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b6c7c-36d2-4614-afb5-f2f3882c686c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:18.925814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b6c7c-36d2-4614-afb5-f2f3882c686c service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:18.926294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b6c7c-36d2-4614-afb5-f2f3882c686c service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:18.926663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b6c7c-36d2-4614-afb5-f2f3882c686c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:18.942430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b6c7c-36d2-4614-afb5-f2f3882c686c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:18.946503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b6c7c-36d2-4614-afb5-f2f3882c686c service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:18.962232 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1567/3135] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:19.699320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5511b68-ebc8-47e9-9fe5-4c3660e9369d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:19.701654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f5511b68-ebc8-47e9-9fe5-4c3660e9369d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:19.728367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5511b68-ebc8-47e9-9fe5-4c3660e9369d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:19.734505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:19.735097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:19.735374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:19.735648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] PATH_INFO: `/v3/projects/98139e6a976f42ebb058ac2ab076b469` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:19.739092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98139e6a976f42ebb058ac2ab076b469)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:19.741928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:19.887226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98139e6a976f42ebb058ac2ab076b469', 'request_id': 'req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:19.902749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98139e6a976f42ebb058ac2ab076b469', 'request_id': 'req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:19.923226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98139e6a976f42ebb058ac2ab076b469', 'request_id': 'req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:19.954729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] The token cache is being invalidate because project 98139e6a976f42ebb058ac2ab076b469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:35:19.955240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:19.956119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18d99ce1-48fe-4271-8a43-aa7ec88a13f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:19.964411 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1569/3136] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:35:19 2022] DELETE /identity/v3/projects/98139e6a976f42ebb058ac2ab076b469 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:19.967250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345afa7-1b43-49e5-bddd-866fe36f3602 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:19.967766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345afa7-1b43-49e5-bddd-866fe36f3602 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:19.967855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345afa7-1b43-49e5-bddd-866fe36f3602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:19.999895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2345afa7-1b43-49e5-bddd-866fe36f3602 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:20.001241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2345afa7-1b43-49e5-bddd-866fe36f3602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:20.130890 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1568/3137] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:20.138985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ca09d-0e33-4a34-ab8c-4808ec4bc97d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:20.139384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ca09d-0e33-4a34-ab8c-4808ec4bc97d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:20.139754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ca09d-0e33-4a34-ab8c-4808ec4bc97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:20.208421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1d3ca09d-0e33-4a34-ab8c-4808ec4bc97d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:20.218165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1d3ca09d-0e33-4a34-ab8c-4808ec4bc97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:20.262770 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1570/3138] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:20.267218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345afa7-1b43-49e5-bddd-866fe36f3602 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:20.303956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345afa7-1b43-49e5-bddd-866fe36f3602 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:20.328071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af6daa-f561-4916-80b1-66cfbcbaa2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:20.329499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af6daa-f561-4916-80b1-66cfbcbaa2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:20.332214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af6daa-f561-4916-80b1-66cfbcbaa2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:20.334963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af6daa-f561-4916-80b1-66cfbcbaa2d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:20.337763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af6daa-f561-4916-80b1-66cfbcbaa2d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:35:20.341833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af6daa-f561-4916-80b1-66cfbcbaa2d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:20.350097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af6daa-f561-4916-80b1-66cfbcbaa2d0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:20.398979 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1569/3139] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:35:20.401418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ca09d-0e33-4a34-ab8c-4808ec4bc97d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:20.413477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ca09d-0e33-4a34-ab8c-4808ec4bc97d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:20.430265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a32542-a5dd-4959-8894-86aea9469288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:20.431099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a32542-a5dd-4959-8894-86aea9469288 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:20.431506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a32542-a5dd-4959-8894-86aea9469288 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:20.432006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a32542-a5dd-4959-8894-86aea9469288 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:20.432813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a32542-a5dd-4959-8894-86aea9469288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:20.435262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a32542-a5dd-4959-8894-86aea9469288 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:20.490784 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1571/3140] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:35:20 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:20.495122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af6daa-f561-4916-80b1-66cfbcbaa2d0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:20.509191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af6daa-f561-4916-80b1-66cfbcbaa2d0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:20.724336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acba9b4-728c-4fdc-a092-e6dc6776458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:20.725009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acba9b4-728c-4fdc-a092-e6dc6776458d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:20.725288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acba9b4-728c-4fdc-a092-e6dc6776458d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:20.725620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acba9b4-728c-4fdc-a092-e6dc6776458d admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:20.726264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acba9b4-728c-4fdc-a092-e6dc6776458d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:20.735756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acba9b4-728c-4fdc-a092-e6dc6776458d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:20.826423 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1570/3141] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:35:20 2022] POST /identity/v3/users => generated 290 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:20.830928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a32542-a5dd-4959-8894-86aea9469288 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:20.842245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a32542-a5dd-4959-8894-86aea9469288 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:20.857721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2262a-b4b3-422e-8233-04463a1c339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:20.858587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2262a-b4b3-422e-8233-04463a1c339d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:20.858942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2262a-b4b3-422e-8233-04463a1c339d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:20.859366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2262a-b4b3-422e-8233-04463a1c339d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:20.860313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2262a-b4b3-422e-8233-04463a1c339d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:20.862278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2262a-b4b3-422e-8233-04463a1c339d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:20.877205 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1572/3142] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:20.881658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acba9b4-728c-4fdc-a092-e6dc6776458d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:20.894109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acba9b4-728c-4fdc-a092-e6dc6776458d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:20.900155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70423c37-c241-400f-af5d-c55c176ef64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:20.900808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70423c37-c241-400f-af5d-c55c176ef64d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:20.901162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70423c37-c241-400f-af5d-c55c176ef64d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:20.901595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70423c37-c241-400f-af5d-c55c176ef64d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:20.902378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70423c37-c241-400f-af5d-c55c176ef64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:20.904764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70423c37-c241-400f-af5d-c55c176ef64d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:20.924864 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1571/3143] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:20.929420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2262a-b4b3-422e-8233-04463a1c339d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:20.941875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2262a-b4b3-422e-8233-04463a1c339d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:20.947512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5399a-d910-4da0-81fb-3ee0da21e08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:20.948595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5399a-d910-4da0-81fb-3ee0da21e08e admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:20.949112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5399a-d910-4da0-81fb-3ee0da21e08e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:20.949978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5399a-d910-4da0-81fb-3ee0da21e08e admin admin] PATH_INFO: `/v3/projects/8f71ab69d5754077b34ee79ccb42d7cc/users/065c5a92f9c04400be8a515e8233fb0d/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:20.968946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5399a-d910-4da0-81fb-3ee0da21e08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f71ab69d5754077b34ee79ccb42d7cc, user_id=065c5a92f9c04400be8a515e8233fb0d, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:20.972762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5399a-d910-4da0-81fb-3ee0da21e08e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:21.004982 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1573/3144] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:35:20 2022] PUT /identity/v3/projects/8f71ab69d5754077b34ee79ccb42d7cc/users/065c5a92f9c04400be8a515e8233fb0d/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:35:21.011078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e7043-603e-438c-9789-10f61373dc9e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:21.011637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e7043-603e-438c-9789-10f61373dc9e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:21.011857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e7043-603e-438c-9789-10f61373dc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:21.035086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-239e7043-603e-438c-9789-10f61373dc9e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:21.037193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-239e7043-603e-438c-9789-10f61373dc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:21.096593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:21.119452 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1572/3145] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:21.128741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5399a-d910-4da0-81fb-3ee0da21e08e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:21.131642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b7e5399a-d910-4da0-81fb-3ee0da21e08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:21.260195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5399a-d910-4da0-81fb-3ee0da21e08e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:21.273213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efbf1a-6a40-4fbe-a523-d6fa15eb9b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:21.274114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efbf1a-6a40-4fbe-a523-d6fa15eb9b03 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:21.274557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efbf1a-6a40-4fbe-a523-d6fa15eb9b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:21.275022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efbf1a-6a40-4fbe-a523-d6fa15eb9b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:21.301854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efbf1a-6a40-4fbe-a523-d6fa15eb9b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:21.303506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efbf1a-6a40-4fbe-a523-d6fa15eb9b03 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:21.357196 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1574/3146] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:28.001293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc17e20-bd8c-431e-b63a-6400aa1bb50b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:28.001839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc17e20-bd8c-431e-b63a-6400aa1bb50b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:28.002081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc17e20-bd8c-431e-b63a-6400aa1bb50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:28.066691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-efc17e20-bd8c-431e-b63a-6400aa1bb50b None None] MFA Rules not processed for user `d844cb81667346a6aaf07c288c6918be`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:28.070878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-efc17e20-bd8c-431e-b63a-6400aa1bb50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:28.236692 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1573/3147] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:27 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:28.243956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6f67e-a132-4409-b684-c276da8fc0e9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:28.244917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6f67e-a132-4409-b684-c276da8fc0e9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:28.245195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6f67e-a132-4409-b684-c276da8fc0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:28.261469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:28.294746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-73e6f67e-a132-4409-b684-c276da8fc0e9 None None] MFA Rules not processed for user `d844cb81667346a6aaf07c288c6918be`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:28.295911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-73e6f67e-a132-4409-b684-c276da8fc0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:28.312336 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1575/3148] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:28 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:28.398553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc17e20-bd8c-431e-b63a-6400aa1bb50b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:28.400518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-efc17e20-bd8c-431e-b63a-6400aa1bb50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:28.551879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc17e20-bd8c-431e-b63a-6400aa1bb50b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:28.558669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ef655-2cad-42d9-9833-ce8a01faad73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:28.559289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ef655-2cad-42d9-9833-ce8a01faad73 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:28.559572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ef655-2cad-42d9-9833-ce8a01faad73 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:28.559846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ef655-2cad-42d9-9833-ce8a01faad73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:28.570008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ef655-2cad-42d9-9833-ce8a01faad73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:28.571616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ef655-2cad-42d9-9833-ce8a01faad73 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:28.587830 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1574/3149] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:28 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:35:32.055372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75c931-c37b-4767-bca9-6b6283a00f24 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:32.055859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75c931-c37b-4767-bca9-6b6283a00f24 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:32.056023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75c931-c37b-4767-bca9-6b6283a00f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:32.096640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2e75c931-c37b-4767-bca9-6b6283a00f24 None None] MFA Rules not processed for user `065c5a92f9c04400be8a515e8233fb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:32.098639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2e75c931-c37b-4767-bca9-6b6283a00f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:32.205114 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1576/3150] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:32.216655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d4f7a-da7c-47cd-a1e8-99ee83f6fc54 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:32.217514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d4f7a-da7c-47cd-a1e8-99ee83f6fc54 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:32.217514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d4f7a-da7c-47cd-a1e8-99ee83f6fc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:32.260283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e51d4f7a-da7c-47cd-a1e8-99ee83f6fc54 None None] MFA Rules not processed for user `065c5a92f9c04400be8a515e8233fb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:32.261911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e51d4f7a-da7c-47cd-a1e8-99ee83f6fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:32.270646 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1575/3151] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:32.484975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75c931-c37b-4767-bca9-6b6283a00f24 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:32.486712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2e75c931-c37b-4767-bca9-6b6283a00f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:32.515359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75c931-c37b-4767-bca9-6b6283a00f24 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:32.523285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c0d7d-4c54-4e31-933c-832417f71a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:32.525174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c0d7d-4c54-4e31-933c-832417f71a1a service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:32.525824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c0d7d-4c54-4e31-933c-832417f71a1a service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:32.526104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c0d7d-4c54-4e31-933c-832417f71a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:32.539202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c0d7d-4c54-4e31-933c-832417f71a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:32.541244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c0d7d-4c54-4e31-933c-832417f71a1a service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:32.554746 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1577/3152] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:36.200668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d4f7a-da7c-47cd-a1e8-99ee83f6fc54 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:36.211783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d4f7a-da7c-47cd-a1e8-99ee83f6fc54 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:36.215627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d797c69-c610-4ab1-ab3b-5aa54d3a9b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:36.216242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d797c69-c610-4ab1-ab3b-5aa54d3a9b0c service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:36.216522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d797c69-c610-4ab1-ab3b-5aa54d3a9b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:36.216797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d797c69-c610-4ab1-ab3b-5aa54d3a9b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:36.218702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9d797c69-c610-4ab1-ab3b-5aa54d3a9b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:36.231865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d797c69-c610-4ab1-ab3b-5aa54d3a9b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:36.233318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d797c69-c610-4ab1-ab3b-5aa54d3a9b0c service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:36.244318 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1576/3153] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:41.071951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751301f6-facf-41e3-b82a-202db951fdd1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:41.072864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751301f6-facf-41e3-b82a-202db951fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:41.073270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751301f6-facf-41e3-b82a-202db951fdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:41.120686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-751301f6-facf-41e3-b82a-202db951fdd1 None None] MFA Rules not processed for user `a675ad19db254271ba12d2812d0732e3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:41.123383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-751301f6-facf-41e3-b82a-202db951fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:41.241736 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1578/3154] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:42.433491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d797c69-c610-4ab1-ab3b-5aa54d3a9b0c service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:42.434921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9d797c69-c610-4ab1-ab3b-5aa54d3a9b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:42.538402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:42.560432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d797c69-c610-4ab1-ab3b-5aa54d3a9b0c service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:42.565827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62267f-9999-4763-969f-1424bb79fe14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:42.566574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62267f-9999-4763-969f-1424bb79fe14 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:42.566860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62267f-9999-4763-969f-1424bb79fe14 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:42.567187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62267f-9999-4763-969f-1424bb79fe14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:42.568977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8e62267f-9999-4763-969f-1424bb79fe14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:42.582483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62267f-9999-4763-969f-1424bb79fe14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:42.584679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62267f-9999-4763-969f-1424bb79fe14 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:42.596072 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1577/3155] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:49.741324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751301f6-facf-41e3-b82a-202db951fdd1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:49.743418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-751301f6-facf-41e3-b82a-202db951fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:49.768831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751301f6-facf-41e3-b82a-202db951fdd1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:49.779215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:49.782901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:49.785250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:49.786134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] PATH_INFO: `/v3/users/e7e71fcf6711470db5a71ddc74ff709c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:49.788325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e71fcf6711470db5a71ddc74ff709c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:49.792091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:49.929153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e71fcf6711470db5a71ddc74ff709c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:49.930835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e71fcf6711470db5a71ddc74ff709c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:49.952155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e71fcf6711470db5a71ddc74ff709c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:49.963985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e71fcf6711470db5a71ddc74ff709c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:49.967689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:49.982911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e71fcf6711470db5a71ddc74ff709c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:50.001617 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1579/3156] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:35:49 2022] DELETE /identity/v3/users/e7e71fcf6711470db5a71ddc74ff709c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:50.264025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62267f-9999-4763-969f-1424bb79fe14 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:50.265979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8e62267f-9999-4763-969f-1424bb79fe14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:50.270636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:50.273530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:50.302273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62267f-9999-4763-969f-1424bb79fe14 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:50.398250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca53768-e3f6-4c8e-a18c-e6112669bddf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:50.404812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:50.405622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:50.405975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:50.406331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] PATH_INFO: `/v3/projects/74754c19f05f41428bc6d499aac1f9e5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:50.408778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74754c19f05f41428bc6d499aac1f9e5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:50.412398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:50.441771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b3c36-f49d-4b8d-b649-ebf512acbe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:50.443930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3c36-f49d-4b8d-b649-ebf512acbe99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:50.445105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3c36-f49d-4b8d-b649-ebf512acbe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:50.445620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3c36-f49d-4b8d-b649-ebf512acbe99 admin admin] PATH_INFO: `/v3/users/2de7e02a3f8242ea85479c80821c0edf` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:50.448275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b3c36-f49d-4b8d-b649-ebf512acbe99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de7e02a3f8242ea85479c80821c0edf)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:50.451433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b3c36-f49d-4b8d-b649-ebf512acbe99 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:50.493992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74754c19f05f41428bc6d499aac1f9e5', 'request_id': 'req-566658b0-c202-4a16-9cef-b1a3167b4f81'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:50.502691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74754c19f05f41428bc6d499aac1f9e5', 'request_id': 'req-566658b0-c202-4a16-9cef-b1a3167b4f81'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:50.515486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74754c19f05f41428bc6d499aac1f9e5', 'request_id': 'req-566658b0-c202-4a16-9cef-b1a3167b4f81'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:50.544264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] The token cache is being invalidate because project 74754c19f05f41428bc6d499aac1f9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:35:50.545025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:50.545560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:50.547238 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1580/3157] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:35:50 2022] DELETE /identity/v3/projects/74754c19f05f41428bc6d499aac1f9e5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:35:50.551661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:50.553669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:50.577088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b84b3c36-f49d-4b8d-b649-ebf512acbe99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de7e02a3f8242ea85479c80821c0edf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:50.578060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b84b3c36-f49d-4b8d-b649-ebf512acbe99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de7e02a3f8242ea85479c80821c0edf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:50.616485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b84b3c36-f49d-4b8d-b649-ebf512acbe99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de7e02a3f8242ea85479c80821c0edf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:50.617459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b84b3c36-f49d-4b8d-b649-ebf512acbe99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de7e02a3f8242ea85479c80821c0edf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:50.631582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b84b3c36-f49d-4b8d-b649-ebf512acbe99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de7e02a3f8242ea85479c80821c0edf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:50.654050 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1578/3158] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:35:50 2022] DELETE /identity/v3/users/2de7e02a3f8242ea85479c80821c0edf => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:50.656187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9c3a2-7624-4f46-b844-0786b6e0ca98 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:50.656638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9c3a2-7624-4f46-b844-0786b6e0ca98 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:50.657067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9c3a2-7624-4f46-b844-0786b6e0ca98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:50.684713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dba9c3a2-7624-4f46-b844-0786b6e0ca98 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:50.686213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dba9c3a2-7624-4f46-b844-0786b6e0ca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:50.725571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566658b0-c202-4a16-9cef-b1a3167b4f81 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:50.795682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:50.851401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:50.885434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:50.886666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:50.886968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:50.887227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] PATH_INFO: `/v3/users/95277645ba9a481e97aae929322f2a04` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:50.891897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95277645ba9a481e97aae929322f2a04)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:50.892224 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1579/3159] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:50.895981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:50.907086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9c3a2-7624-4f46-b844-0786b6e0ca98 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:50.909235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dba9c3a2-7624-4f46-b844-0786b6e0ca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:51.017875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95277645ba9a481e97aae929322f2a04'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:51.018924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95277645ba9a481e97aae929322f2a04'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:51.026088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9c3a2-7624-4f46-b844-0786b6e0ca98 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:51.033307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b29251-9876-4f22-a127-b788b60c9a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:51.034696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b29251-9876-4f22-a127-b788b60c9a90 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:51.035391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b29251-9876-4f22-a127-b788b60c9a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:51.036689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b29251-9876-4f22-a127-b788b60c9a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:51.049433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95277645ba9a481e97aae929322f2a04'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:51.062779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95277645ba9a481e97aae929322f2a04'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:51.086820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95277645ba9a481e97aae929322f2a04'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:51.093344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b29251-9876-4f22-a127-b788b60c9a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:51.097007 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1581/3160] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:35:50 2022] DELETE /identity/v3/users/95277645ba9a481e97aae929322f2a04 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:35:51.103945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b29251-9876-4f22-a127-b788b60c9a90 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:51.128984 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1580/3161] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:35:51.658680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:51.660236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:51.812062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757935e-c268-43fc-876a-8d1116ae4d66 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:51.818520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:51.823802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:51.823802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:51.823802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] PATH_INFO: `/v3/projects/cdcb7146465e4984baa0c8b700e0ad18` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:51.823802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdcb7146465e4984baa0c8b700e0ad18)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:51.823802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:51.911003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdcb7146465e4984baa0c8b700e0ad18', 'request_id': 'req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:51.913805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:51.926132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdcb7146465e4984baa0c8b700e0ad18', 'request_id': 'req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:51.942065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdcb7146465e4984baa0c8b700e0ad18', 'request_id': 'req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:51.962503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] The token cache is being invalidate because project cdcb7146465e4984baa0c8b700e0ad18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:35:51.963095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:51.964265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4856603f-5148-4ce6-8ad0-2a2b63a6e28f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:51.968061 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1582/3162] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:35:51 2022] DELETE /identity/v3/projects/cdcb7146465e4984baa0c8b700e0ad18 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:51.976075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f7008-81a8-4bd3-a704-56aac130ece7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:51.977055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f7008-81a8-4bd3-a704-56aac130ece7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:51.977957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f7008-81a8-4bd3-a704-56aac130ece7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:52.025817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c98f7008-81a8-4bd3-a704-56aac130ece7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:52.027237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c98f7008-81a8-4bd3-a704-56aac130ece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:52.113957 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1581/3163] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:52.123509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cca424-7fae-4b1e-ba62-9799e2496894 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:52.124365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cca424-7fae-4b1e-ba62-9799e2496894 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:52.124693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cca424-7fae-4b1e-ba62-9799e2496894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:52.148682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b8cca424-7fae-4b1e-ba62-9799e2496894 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:52.150038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b8cca424-7fae-4b1e-ba62-9799e2496894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:52.161188 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1583/3164] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:52.166645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f7008-81a8-4bd3-a704-56aac130ece7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:52.178520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f7008-81a8-4bd3-a704-56aac130ece7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:52.183689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9d744-59b2-41d5-9b24-d103500002d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:52.184511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9d744-59b2-41d5-9b24-d103500002d2 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:52.184810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9d744-59b2-41d5-9b24-d103500002d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:52.185205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9d744-59b2-41d5-9b24-d103500002d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:52.186236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9d744-59b2-41d5-9b24-d103500002d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:35:52.186919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9d744-59b2-41d5-9b24-d103500002d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:52.188769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9d744-59b2-41d5-9b24-d103500002d2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:52.216724 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1582/3165] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:35:52.217771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cca424-7fae-4b1e-ba62-9799e2496894 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:52.235865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cca424-7fae-4b1e-ba62-9799e2496894 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:52.248321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4b734-f31c-433e-a985-cd073d951379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:52.248985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b734-f31c-433e-a985-cd073d951379 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:52.249316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b734-f31c-433e-a985-cd073d951379 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:52.249778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b734-f31c-433e-a985-cd073d951379 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:52.250523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4b734-f31c-433e-a985-cd073d951379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:52.252607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4b734-f31c-433e-a985-cd073d951379 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:52.310681 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1584/3166] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:35:52 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:52.312383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9d744-59b2-41d5-9b24-d103500002d2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:52.335115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9d744-59b2-41d5-9b24-d103500002d2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:52.494087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcc2ac-4ce9-43ce-8421-19a232cc63ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:52.494791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcc2ac-4ce9-43ce-8421-19a232cc63ee admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:52.495076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcc2ac-4ce9-43ce-8421-19a232cc63ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:52.495403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcc2ac-4ce9-43ce-8421-19a232cc63ee admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:52.496002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcc2ac-4ce9-43ce-8421-19a232cc63ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:52.498784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcc2ac-4ce9-43ce-8421-19a232cc63ee admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:52.526751 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1583/3167] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:35:52 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:52.531250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4b734-f31c-433e-a985-cd073d951379 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:52.554426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4b734-f31c-433e-a985-cd073d951379 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:52.560227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a7bf6-26ae-41d2-96cc-245136075c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:52.560894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a7bf6-26ae-41d2-96cc-245136075c45 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:52.561177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a7bf6-26ae-41d2-96cc-245136075c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:52.562149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a7bf6-26ae-41d2-96cc-245136075c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:52.562829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a7bf6-26ae-41d2-96cc-245136075c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:52.564598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a7bf6-26ae-41d2-96cc-245136075c45 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:52.600726 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1585/3168] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:52.601800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcc2ac-4ce9-43ce-8421-19a232cc63ee admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:52.614001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcc2ac-4ce9-43ce-8421-19a232cc63ee admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:52.619400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fa9fa-2670-4a88-9e0e-f5030196a7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:52.620127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fa9fa-2670-4a88-9e0e-f5030196a7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:52.620409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fa9fa-2670-4a88-9e0e-f5030196a7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:52.620681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fa9fa-2670-4a88-9e0e-f5030196a7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:52.621372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fa9fa-2670-4a88-9e0e-f5030196a7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:52.623142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fa9fa-2670-4a88-9e0e-f5030196a7f9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:52.636903 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1584/3169] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:35:52.640993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a7bf6-26ae-41d2-96cc-245136075c45 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:52.653868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a7bf6-26ae-41d2-96cc-245136075c45 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:52.661994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad57202-8da2-4dbe-bad4-9410406ddc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:52.662895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57202-8da2-4dbe-bad4-9410406ddc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:52.663184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57202-8da2-4dbe-bad4-9410406ddc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:52.663468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57202-8da2-4dbe-bad4-9410406ddc37 admin admin] PATH_INFO: `/v3/projects/ea522276832442f7925e3a7cf5ac8f90/users/0dcf2e2a6cb0494fa8c8bb0867bd38df/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:52.683383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad57202-8da2-4dbe-bad4-9410406ddc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea522276832442f7925e3a7cf5ac8f90, user_id=0dcf2e2a6cb0494fa8c8bb0867bd38df, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:52.687935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad57202-8da2-4dbe-bad4-9410406ddc37 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:52.705511 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1586/3170] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:35:52 2022] PUT /identity/v3/projects/ea522276832442f7925e3a7cf5ac8f90/users/0dcf2e2a6cb0494fa8c8bb0867bd38df/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:52.718126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c45be-7ad0-4460-9564-6415ecf21dde None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:52.718420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c45be-7ad0-4460-9564-6415ecf21dde None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:52.718701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c45be-7ad0-4460-9564-6415ecf21dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:52.743457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:52.756457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-805c45be-7ad0-4460-9564-6415ecf21dde None None] MFA Rules not processed for user `0dcf2e2a6cb0494fa8c8bb0867bd38df`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:52.758594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-805c45be-7ad0-4460-9564-6415ecf21dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:52.841774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad57202-8da2-4dbe-bad4-9410406ddc37 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:52.843584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9ad57202-8da2-4dbe-bad4-9410406ddc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:52.852326 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1585/3171] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:52.858535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c45be-7ad0-4460-9564-6415ecf21dde None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:53.040402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c45be-7ad0-4460-9564-6415ecf21dde None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:53.062357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2754b78-262f-4c64-8e37-08bd34c410f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:53.063307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754b78-262f-4c64-8e37-08bd34c410f2 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:53.063772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754b78-262f-4c64-8e37-08bd34c410f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:53.064149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754b78-262f-4c64-8e37-08bd34c410f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:53.066185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2754b78-262f-4c64-8e37-08bd34c410f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:53.071183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2754b78-262f-4c64-8e37-08bd34c410f2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:53.088614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad57202-8da2-4dbe-bad4-9410406ddc37 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:53.097116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:53.098090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:53.098639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:53.100238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] PATH_INFO: `/v3/projects/472ac27a5ec24dcbb2bacd4f2d2aed73` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:53.104423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=472ac27a5ec24dcbb2bacd4f2d2aed73)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:53.108562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:53.168597 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1586/3172] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:35:52 2022] POST /identity/v3/projects => generated 385 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:53.171291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2754b78-262f-4c64-8e37-08bd34c410f2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:53.210856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'request_id': 'req-0b2d4739-8396-4da9-a8e2-07a673edc152'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:53.223461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'request_id': 'req-0b2d4739-8396-4da9-a8e2-07a673edc152'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:53.238712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472ac27a5ec24dcbb2bacd4f2d2aed73', 'request_id': 'req-0b2d4739-8396-4da9-a8e2-07a673edc152'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:53.242943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:53.265358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] The token cache is being invalidate because project 472ac27a5ec24dcbb2bacd4f2d2aed73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:35:53.266267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:53.267926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:53.274949 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1587/3173] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:35:52 2022] DELETE /identity/v3/projects/472ac27a5ec24dcbb2bacd4f2d2aed73 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:53.278092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:53.283931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:53.286426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2754b78-262f-4c64-8e37-08bd34c410f2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:53.335352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:53.384352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f049d-d7cf-44a6-8da5-2a4d205322b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:53.386061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f049d-d7cf-44a6-8da5-2a4d205322b6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:53.386445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f049d-d7cf-44a6-8da5-2a4d205322b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:53.388222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f049d-d7cf-44a6-8da5-2a4d205322b6 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:53.389069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f049d-d7cf-44a6-8da5-2a4d205322b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:53.391535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f049d-d7cf-44a6-8da5-2a4d205322b6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:53.427322 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1587/3174] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:35:53 2022] POST /identity/v3/users => generated 299 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:53.430462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f049d-d7cf-44a6-8da5-2a4d205322b6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:53.432732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-020f049d-d7cf-44a6-8da5-2a4d205322b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:53.446264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d4739-8396-4da9-a8e2-07a673edc152 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:53.453058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f049d-d7cf-44a6-8da5-2a4d205322b6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:53.453703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:53.454882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:53.455194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:53.456181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] PATH_INFO: `/v3/users/6b63c7c667684d65a149ec100df2f323` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:53.456985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b63c7c667684d65a149ec100df2f323)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:53.461783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:53.464011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea8fbe-3df3-4a11-8426-13db3efbaba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:53.465561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea8fbe-3df3-4a11-8426-13db3efbaba8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:53.466113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea8fbe-3df3-4a11-8426-13db3efbaba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:53.468573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea8fbe-3df3-4a11-8426-13db3efbaba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:53.470777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea8fbe-3df3-4a11-8426-13db3efbaba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:53.474040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea8fbe-3df3-4a11-8426-13db3efbaba8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:53.495377 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1588/3175] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:35:53.501094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea8fbe-3df3-4a11-8426-13db3efbaba8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:53.523621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea8fbe-3df3-4a11-8426-13db3efbaba8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:53.531333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471e13c-79c4-48cc-931f-de3060e2d244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:53.534109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471e13c-79c4-48cc-931f-de3060e2d244 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:53.534527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471e13c-79c4-48cc-931f-de3060e2d244 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:53.534932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471e13c-79c4-48cc-931f-de3060e2d244 admin admin] PATH_INFO: `/v3/projects/389c140497884dce873f601472b1a915/users/d5db82ca7f8146d6919c88b4977cff0c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:53.551004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b63c7c667684d65a149ec100df2f323'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:53.552869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b63c7c667684d65a149ec100df2f323'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:53.562454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471e13c-79c4-48cc-931f-de3060e2d244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389c140497884dce873f601472b1a915, user_id=d5db82ca7f8146d6919c88b4977cff0c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:53.568939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471e13c-79c4-48cc-931f-de3060e2d244 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:53.594784 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1589/3176] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:35:53 2022] PUT /identity/v3/projects/389c140497884dce873f601472b1a915/users/d5db82ca7f8146d6919c88b4977cff0c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:53.599750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b63c7c667684d65a149ec100df2f323'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:53.602200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471e13c-79c4-48cc-931f-de3060e2d244 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:53.621600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b63c7c667684d65a149ec100df2f323'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:53.638889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b63c7c667684d65a149ec100df2f323'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:53.655416 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1588/3177] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:35:53 2022] DELETE /identity/v3/users/6b63c7c667684d65a149ec100df2f323 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:53.712711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:53.715161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:53.774063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471e13c-79c4-48cc-931f-de3060e2d244 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:53.922356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a70b1-7fd3-46e0-b954-e987de5ad5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:53.924979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a70b1-7fd3-46e0-b954-e987de5ad5de admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:53.925746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a70b1-7fd3-46e0-b954-e987de5ad5de admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:53.926246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a70b1-7fd3-46e0-b954-e987de5ad5de admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:53.926754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef253cc4-b990-416f-9443-70b1a276ffe4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:53.927679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a70b1-7fd3-46e0-b954-e987de5ad5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:53.941953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a70b1-7fd3-46e0-b954-e987de5ad5de admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:53.950991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d2284-8e00-42ca-8ab9-ab8e29496b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:53.951658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d2284-8e00-42ca-8ab9-ab8e29496b20 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:53.951938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d2284-8e00-42ca-8ab9-ab8e29496b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:53.952212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d2284-8e00-42ca-8ab9-ab8e29496b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:53.966556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-611d2284-8e00-42ca-8ab9-ab8e29496b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:53.967891 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1590/3178] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:53.970809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a70b1-7fd3-46e0-b954-e987de5ad5de admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:53.973168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-de2a70b1-7fd3-46e0-b954-e987de5ad5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:54.019970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a70b1-7fd3-46e0-b954-e987de5ad5de admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:54.045866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c51a6-8fd5-4c5e-aa7d-e0179b80ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:54.045866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c51a6-8fd5-4c5e-aa7d-e0179b80ca8d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:54.045866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c51a6-8fd5-4c5e-aa7d-e0179b80ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:54.045866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c51a6-8fd5-4c5e-aa7d-e0179b80ca8d admin admin] PATH_INFO: `/v3/projects/389c140497884dce873f601472b1a915/users/d5db82ca7f8146d6919c88b4977cff0c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:54.046584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c51a6-8fd5-4c5e-aa7d-e0179b80ca8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=389c140497884dce873f601472b1a915, user_id=d5db82ca7f8146d6919c88b4977cff0c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:54.053910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c51a6-8fd5-4c5e-aa7d-e0179b80ca8d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:54.075052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:54.121225 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1591/3179] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:35:53 2022] PUT /identity/v3/projects/389c140497884dce873f601472b1a915/users/d5db82ca7f8146d6919c88b4977cff0c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:54.125227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07139-a934-447b-86f3-cc285c38b0c8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:54.125227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07139-a934-447b-86f3-cc285c38b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:54.125227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07139-a934-447b-86f3-cc285c38b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:54.207014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-12b07139-a934-447b-86f3-cc285c38b0c8 None None] MFA Rules not processed for user `d5db82ca7f8146d6919c88b4977cff0c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:54.208552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-12b07139-a934-447b-86f3-cc285c38b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:54.213470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:54.243439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d2284-8e00-42ca-8ab9-ab8e29496b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:54.246765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d2284-8e00-42ca-8ab9-ab8e29496b20 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:54.263786 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1589/3180] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:35:54.311946 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1592/3181] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:54.327271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d2284-8e00-42ca-8ab9-ab8e29496b20 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:54.329138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-611d2284-8e00-42ca-8ab9-ab8e29496b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:54.347707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d2284-8e00-42ca-8ab9-ab8e29496b20 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:54.460332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93114d-f06c-4648-aaf6-d48239535649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:54.461556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93114d-f06c-4648-aaf6-d48239535649 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:54.461983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93114d-f06c-4648-aaf6-d48239535649 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:54.462362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93114d-f06c-4648-aaf6-d48239535649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:54.480218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93114d-f06c-4648-aaf6-d48239535649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:54.484985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93114d-f06c-4648-aaf6-d48239535649 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:54.507965 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1590/3182] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:54.557657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b07139-a934-447b-86f3-cc285c38b0c8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:54.559522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-12b07139-a934-447b-86f3-cc285c38b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:54.731097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b07139-a934-447b-86f3-cc285c38b0c8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:54.746358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:54.747226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:54.747520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:54.747796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] PATH_INFO: `/v3/projects/d5227619f68f43ca952c4c5c999a6d3d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:54.751141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5227619f68f43ca952c4c5c999a6d3d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:54.768788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:54.911226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5227619f68f43ca952c4c5c999a6d3d', 'request_id': 'req-1301dfd0-310c-4d90-ab91-d79b9d25c95c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:54.934378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5227619f68f43ca952c4c5c999a6d3d', 'request_id': 'req-1301dfd0-310c-4d90-ab91-d79b9d25c95c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:54.945872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5227619f68f43ca952c4c5c999a6d3d', 'request_id': 'req-1301dfd0-310c-4d90-ab91-d79b9d25c95c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:54.962090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] The token cache is being invalidate because project d5227619f68f43ca952c4c5c999a6d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:35:54.962389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:54.963106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301dfd0-310c-4d90-ab91-d79b9d25c95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:54.970888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20402c1-15db-48db-abc0-cbaf674215dd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:54.971452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20402c1-15db-48db-abc0-cbaf674215dd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:54.971452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20402c1-15db-48db-abc0-cbaf674215dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:54.974190 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1593/3183] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:35:54 2022] DELETE /identity/v3/projects/d5227619f68f43ca952c4c5c999a6d3d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:55.006933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f20402c1-15db-48db-abc0-cbaf674215dd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:55.008277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f20402c1-15db-48db-abc0-cbaf674215dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:55.125953 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1591/3184] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:55.195406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e271e6-6110-473e-b518-da288dfe2bdf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:55.195966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e271e6-6110-473e-b518-da288dfe2bdf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:55.195966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e271e6-6110-473e-b518-da288dfe2bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:55.236604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-48e271e6-6110-473e-b518-da288dfe2bdf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:55.236604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-48e271e6-6110-473e-b518-da288dfe2bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:55.251708 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1594/3185] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:55.258653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20402c1-15db-48db-abc0-cbaf674215dd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:55.280017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20402c1-15db-48db-abc0-cbaf674215dd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:55.292867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9573795-5cfa-4054-851b-d409ee2c5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:55.294348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9573795-5cfa-4054-851b-d409ee2c5f0d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:55.294348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9573795-5cfa-4054-851b-d409ee2c5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:55.294348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9573795-5cfa-4054-851b-d409ee2c5f0d admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:55.295087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9573795-5cfa-4054-851b-d409ee2c5f0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:35:55.296234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9573795-5cfa-4054-851b-d409ee2c5f0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:55.301032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9573795-5cfa-4054-851b-d409ee2c5f0d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:55.356158 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1592/3186] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:35:55.362305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e271e6-6110-473e-b518-da288dfe2bdf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:55.409766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e271e6-6110-473e-b518-da288dfe2bdf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:55.449321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7e53f-0860-47f6-9228-ea771b3ed07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:55.450234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7e53f-0860-47f6-9228-ea771b3ed07a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:55.450606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7e53f-0860-47f6-9228-ea771b3ed07a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:55.450887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7e53f-0860-47f6-9228-ea771b3ed07a admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:55.452706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7e53f-0860-47f6-9228-ea771b3ed07a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:55.455660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7e53f-0860-47f6-9228-ea771b3ed07a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:55.544353 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1595/3187] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:35:55 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:55.548797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9573795-5cfa-4054-851b-d409ee2c5f0d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:55.568620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9573795-5cfa-4054-851b-d409ee2c5f0d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:55.588483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7e53f-0860-47f6-9228-ea771b3ed07a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:55.590741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a1a7e53f-0860-47f6-9228-ea771b3ed07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:55.596963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:55.648265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:55.733523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f50c4b-0b98-4a8e-8fcc-f76e6b7ddbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:55.734364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f50c4b-0b98-4a8e-8fcc-f76e6b7ddbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:55.734815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f50c4b-0b98-4a8e-8fcc-f76e6b7ddbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:55.735191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f50c4b-0b98-4a8e-8fcc-f76e6b7ddbd8 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:55.735963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f50c4b-0b98-4a8e-8fcc-f76e6b7ddbd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:55.738365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f50c4b-0b98-4a8e-8fcc-f76e6b7ddbd8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:55.801281 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1593/3188] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:35:55 2022] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:55.801516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7e53f-0860-47f6-9228-ea771b3ed07a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:55.803713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f50c4b-0b98-4a8e-8fcc-f76e6b7ddbd8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:55.814331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77486e27-20ab-4f5b-85b6-dd6e063c2cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:55.815285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486e27-20ab-4f5b-85b6-dd6e063c2cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:55.815285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486e27-20ab-4f5b-85b6-dd6e063c2cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:55.816262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486e27-20ab-4f5b-85b6-dd6e063c2cd4 admin admin] PATH_INFO: `/v3/users/0dcf2e2a6cb0494fa8c8bb0867bd38df` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:55.821634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77486e27-20ab-4f5b-85b6-dd6e063c2cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcf2e2a6cb0494fa8c8bb0867bd38df)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:55.825985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77486e27-20ab-4f5b-85b6-dd6e063c2cd4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:55.829849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f50c4b-0b98-4a8e-8fcc-f76e6b7ddbd8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:55.857847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb52dea-fbad-4b1b-af95-b6535e7443da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:55.858493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb52dea-fbad-4b1b-af95-b6535e7443da admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:55.858772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb52dea-fbad-4b1b-af95-b6535e7443da admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:55.859054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb52dea-fbad-4b1b-af95-b6535e7443da admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:55.859722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb52dea-fbad-4b1b-af95-b6535e7443da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:55.867680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb52dea-fbad-4b1b-af95-b6535e7443da admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:55.908311 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1594/3189] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:55.914544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb52dea-fbad-4b1b-af95-b6535e7443da admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:55.939831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb52dea-fbad-4b1b-af95-b6535e7443da admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:55.946813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77486e27-20ab-4f5b-85b6-dd6e063c2cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcf2e2a6cb0494fa8c8bb0867bd38df'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:55.948507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77486e27-20ab-4f5b-85b6-dd6e063c2cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcf2e2a6cb0494fa8c8bb0867bd38df'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:55.952624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1a24f-0361-4f47-8b45-23e7d4720b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:55.954123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1a24f-0361-4f47-8b45-23e7d4720b25 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:55.954623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1a24f-0361-4f47-8b45-23e7d4720b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:55.956534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1a24f-0361-4f47-8b45-23e7d4720b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:55.957402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1a24f-0361-4f47-8b45-23e7d4720b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:55.960668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1a24f-0361-4f47-8b45-23e7d4720b25 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:55.972696 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1595/3190] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:55.976880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1a24f-0361-4f47-8b45-23e7d4720b25 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:55.980261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-34d1a24f-0361-4f47-8b45-23e7d4720b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:55.992183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77486e27-20ab-4f5b-85b6-dd6e063c2cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcf2e2a6cb0494fa8c8bb0867bd38df'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:55.994956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77486e27-20ab-4f5b-85b6-dd6e063c2cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcf2e2a6cb0494fa8c8bb0867bd38df'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:56.000993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1a24f-0361-4f47-8b45-23e7d4720b25 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:56.008043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0da76-d5fa-49d3-9375-db11535cd837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:56.009074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0da76-d5fa-49d3-9375-db11535cd837 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:56.009682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0da76-d5fa-49d3-9375-db11535cd837 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:56.010395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0da76-d5fa-49d3-9375-db11535cd837 admin admin] PATH_INFO: `/v3/projects/5bc4a6b62df34515a6df68cfc28f2526/users/0b9bbdf34e904843ab7cd7b40bf3720d/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:56.013185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77486e27-20ab-4f5b-85b6-dd6e063c2cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcf2e2a6cb0494fa8c8bb0867bd38df'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:56.042672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0da76-d5fa-49d3-9375-db11535cd837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc4a6b62df34515a6df68cfc28f2526, user_id=0b9bbdf34e904843ab7cd7b40bf3720d, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:56.046052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0da76-d5fa-49d3-9375-db11535cd837 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:56.052951 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1596/3191] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:35:55 2022] DELETE /identity/v3/users/0dcf2e2a6cb0494fa8c8bb0867bd38df => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:56.055934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902b94e-af73-437f-8079-dacb8e0d19a4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:56.056343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902b94e-af73-437f-8079-dacb8e0d19a4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:56.056722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902b94e-af73-437f-8079-dacb8e0d19a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:56.081786 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1596/3192] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:35:55 2022] PUT /identity/v3/projects/5bc4a6b62df34515a6df68cfc28f2526/users/0b9bbdf34e904843ab7cd7b40bf3720d/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:56.090995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a902b94e-af73-437f-8079-dacb8e0d19a4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:56.092021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f4f1-ca3a-41d5-8578-8a9acc5f6084 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:56.093269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f4f1-ca3a-41d5-8578-8a9acc5f6084 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:56.093424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a902b94e-af73-437f-8079-dacb8e0d19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:56.093868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f4f1-ca3a-41d5-8578-8a9acc5f6084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:56.180121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3084f4f1-ca3a-41d5-8578-8a9acc5f6084 None None] MFA Rules not processed for user `0b9bbdf34e904843ab7cd7b40bf3720d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:56.181881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3084f4f1-ca3a-41d5-8578-8a9acc5f6084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:56.218634 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1597/3193] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:56.233196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902b94e-af73-437f-8079-dacb8e0d19a4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:56.235790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a902b94e-af73-437f-8079-dacb8e0d19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:56.304253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:56.364773 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1597/3194] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:35:56.366681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084f4f1-ca3a-41d5-8578-8a9acc5f6084 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:56.387538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902b94e-af73-437f-8079-dacb8e0d19a4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:56.400199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7793f4b-78b4-447a-aa2b-1d48b27f1763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:56.400821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7793f4b-78b4-447a-aa2b-1d48b27f1763 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:56.401136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7793f4b-78b4-447a-aa2b-1d48b27f1763 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:56.401512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7793f4b-78b4-447a-aa2b-1d48b27f1763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:56.402425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084f4f1-ca3a-41d5-8578-8a9acc5f6084 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:56.410212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4402984-1632-401f-a1dd-fa98c45035f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:56.411515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4402984-1632-401f-a1dd-fa98c45035f3 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:56.413429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4402984-1632-401f-a1dd-fa98c45035f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:56.413873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4402984-1632-401f-a1dd-fa98c45035f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:56.415353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4402984-1632-401f-a1dd-fa98c45035f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:56.418685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4402984-1632-401f-a1dd-fa98c45035f3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:56.430808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7793f4b-78b4-447a-aa2b-1d48b27f1763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:56.432317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7793f4b-78b4-447a-aa2b-1d48b27f1763 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:56.452187 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1598/3195] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:56.472526 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1598/3196] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:35:56 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:56.473526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7793f4b-78b4-447a-aa2b-1d48b27f1763 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:56.494803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7793f4b-78b4-447a-aa2b-1d48b27f1763 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:56.582804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c4bd9-84df-4b90-8074-45364e0538d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:56.584471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c4bd9-84df-4b90-8074-45364e0538d4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:56.585093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c4bd9-84df-4b90-8074-45364e0538d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:56.586040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c4bd9-84df-4b90-8074-45364e0538d4 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:56.587338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c4bd9-84df-4b90-8074-45364e0538d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:56.592048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c4bd9-84df-4b90-8074-45364e0538d4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:56.647603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4402984-1632-401f-a1dd-fa98c45035f3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:56.663510 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1599/3197] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:35:56 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:35:56.672645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4402984-1632-401f-a1dd-fa98c45035f3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:56.679631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ad199-2857-4088-beb0-2535bea8f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:56.680379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ad199-2857-4088-beb0-2535bea8f876 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:56.680791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ad199-2857-4088-beb0-2535bea8f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:56.681197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ad199-2857-4088-beb0-2535bea8f876 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:56.682040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ad199-2857-4088-beb0-2535bea8f876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:56.684643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ad199-2857-4088-beb0-2535bea8f876 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:56.690028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97431c2-ce38-424a-8512-d7fb3fcceea2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:56.691104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97431c2-ce38-424a-8512-d7fb3fcceea2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:56.691503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97431c2-ce38-424a-8512-d7fb3fcceea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:56.717136 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1599/3198] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:56.718634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ad199-2857-4088-beb0-2535bea8f876 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:56.721901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c97431c2-ce38-424a-8512-d7fb3fcceea2 None None] MFA Rules not processed for user `065c5a92f9c04400be8a515e8233fb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:56.723460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c97431c2-ce38-424a-8512-d7fb3fcceea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:56.737293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ad199-2857-4088-beb0-2535bea8f876 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:56.755868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dfa92-fae4-41a4-b64b-a5dfd4e05fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:56.757004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dfa92-fae4-41a4-b64b-a5dfd4e05fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:56.757371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dfa92-fae4-41a4-b64b-a5dfd4e05fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:56.759317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dfa92-fae4-41a4-b64b-a5dfd4e05fe7 admin admin] PATH_INFO: `/v3/projects/5393752392a4442e94cb2d82ad8ff3e1/users/a6ed4421ecfb4c4a830c5c8b0db678f0/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:56.790807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dfa92-fae4-41a4-b64b-a5dfd4e05fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5393752392a4442e94cb2d82ad8ff3e1, user_id=a6ed4421ecfb4c4a830c5c8b0db678f0, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:56.796692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dfa92-fae4-41a4-b64b-a5dfd4e05fe7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:56.827571 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1600/3199] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:35:56 2022] PUT /identity/v3/projects/5393752392a4442e94cb2d82ad8ff3e1/users/a6ed4421ecfb4c4a830c5c8b0db678f0/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:56.832853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dfa92-fae4-41a4-b64b-a5dfd4e05fe7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:56.835822 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1600/3200] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:56.845803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:56.884168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97431c2-ce38-424a-8512-d7fb3fcceea2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:56.885507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c97431c2-ce38-424a-8512-d7fb3fcceea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:56.930576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dfa92-fae4-41a4-b64b-a5dfd4e05fe7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:56.942273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f94c0-7d6e-421a-affd-866eb90f8fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:56.943583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f94c0-7d6e-421a-affd-866eb90f8fba admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:56.943936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f94c0-7d6e-421a-affd-866eb90f8fba admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:56.944278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f94c0-7d6e-421a-affd-866eb90f8fba admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:56.945014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f94c0-7d6e-421a-affd-866eb90f8fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:56.946874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f94c0-7d6e-421a-affd-866eb90f8fba admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:56.963163 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1601/3201] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:35:56.964180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f94c0-7d6e-421a-affd-866eb90f8fba admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:56.976759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f94c0-7d6e-421a-affd-866eb90f8fba admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:56.982027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:56.990257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53884bc-d1f0-4e32-9bb0-c42659a4f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:56.991488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53884bc-d1f0-4e32-9bb0-c42659a4f14b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:56.991488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53884bc-d1f0-4e32-9bb0-c42659a4f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:56.991825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53884bc-d1f0-4e32-9bb0-c42659a4f14b admin admin] PATH_INFO: `/v3/projects/5393752392a4442e94cb2d82ad8ff3e1/users/a6ed4421ecfb4c4a830c5c8b0db678f0/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:56.998206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53884bc-d1f0-4e32-9bb0-c42659a4f14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5393752392a4442e94cb2d82ad8ff3e1, user_id=a6ed4421ecfb4c4a830c5c8b0db678f0, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:57.000929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53884bc-d1f0-4e32-9bb0-c42659a4f14b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:57.025222 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1602/3202] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:35:56 2022] PUT /identity/v3/projects/5393752392a4442e94cb2d82ad8ff3e1/users/a6ed4421ecfb4c4a830c5c8b0db678f0/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:57.038752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101bf93-0306-4a0a-b79b-2dfb11c17a8b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:57.040856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101bf93-0306-4a0a-b79b-2dfb11c17a8b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:57.041344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101bf93-0306-4a0a-b79b-2dfb11c17a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:57.043869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97431c2-ce38-424a-8512-d7fb3fcceea2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:57.089438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f101bf93-0306-4a0a-b79b-2dfb11c17a8b None None] MFA Rules not processed for user `a6ed4421ecfb4c4a830c5c8b0db678f0`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:57.091142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f101bf93-0306-4a0a-b79b-2dfb11c17a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:57.141030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b138d9-5d17-43ce-aced-acbea9e8d103 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:57.141710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b138d9-5d17-43ce-aced-acbea9e8d103 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:57.142590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b138d9-5d17-43ce-aced-acbea9e8d103 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:57.142590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b138d9-5d17-43ce-aced-acbea9e8d103 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:57.147291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-21b138d9-5d17-43ce-aced-acbea9e8d103 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:57.227160 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1603/3203] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:35:57.228894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101bf93-0306-4a0a-b79b-2dfb11c17a8b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:57.231098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f101bf93-0306-4a0a-b79b-2dfb11c17a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:57.305737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b138d9-5d17-43ce-aced-acbea9e8d103 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:57.307351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b138d9-5d17-43ce-aced-acbea9e8d103 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:57.324389 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1601/3204] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:35:57.325890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c082aa-0ef6-49c6-b47a-4334077594d7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:57.326282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c082aa-0ef6-49c6-b47a-4334077594d7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:57.326629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c082aa-0ef6-49c6-b47a-4334077594d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:57.359442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101bf93-0306-4a0a-b79b-2dfb11c17a8b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:57.367978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-73c082aa-0ef6-49c6-b47a-4334077594d7 None None] MFA Rules not processed for user `0b9bbdf34e904843ab7cd7b40bf3720d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:57.369020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-73c082aa-0ef6-49c6-b47a-4334077594d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:57.381309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:57.382067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:57.382449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:57.382825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] PATH_INFO: `/v3/projects/ea522276832442f7925e3a7cf5ac8f90` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:57.384329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea522276832442f7925e3a7cf5ac8f90)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:57.386934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:57.416392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:57.448407 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1602/3205] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:57.471746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea522276832442f7925e3a7cf5ac8f90', 'request_id': 'req-6046515c-79f7-42c2-b809-146b386b75ba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:57.478435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea522276832442f7925e3a7cf5ac8f90', 'request_id': 'req-6046515c-79f7-42c2-b809-146b386b75ba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:57.491537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea522276832442f7925e3a7cf5ac8f90', 'request_id': 'req-6046515c-79f7-42c2-b809-146b386b75ba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:57.529629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] The token cache is being invalidate because project ea522276832442f7925e3a7cf5ac8f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:35:57.529961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:57.530662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:57.532550 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1604/3206] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:35:57 2022] DELETE /identity/v3/projects/ea522276832442f7925e3a7cf5ac8f90 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:57.536692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c082aa-0ef6-49c6-b47a-4334077594d7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:57.554526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c082aa-0ef6-49c6-b47a-4334077594d7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:57.613529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:57.637491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:57.638144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:57.638423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:57.638700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] PATH_INFO: `/v3/users/d5db82ca7f8146d6919c88b4977cff0c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:57.640972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5db82ca7f8146d6919c88b4977cff0c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:57.642963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:57.709670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5db82ca7f8146d6919c88b4977cff0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:57.710862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5db82ca7f8146d6919c88b4977cff0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:57.738592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5db82ca7f8146d6919c88b4977cff0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:57.739875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5db82ca7f8146d6919c88b4977cff0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:57.748784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5db82ca7f8146d6919c88b4977cff0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:57.772962 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1603/3207] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:35:57 2022] DELETE /identity/v3/users/d5db82ca7f8146d6919c88b4977cff0c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:35:57.906971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:57.908549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:58.029530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046515c-79f7-42c2-b809-146b386b75ba admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:58.115991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb087f32-1f90-44d0-a7aa-e409f1447aa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:58.116831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb087f32-1f90-44d0-a7aa-e409f1447aa0 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:58.117211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb087f32-1f90-44d0-a7aa-e409f1447aa0 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:58.117619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb087f32-1f90-44d0-a7aa-e409f1447aa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:58.119617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-eb087f32-1f90-44d0-a7aa-e409f1447aa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:58.176412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:58.226369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb087f32-1f90-44d0-a7aa-e409f1447aa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:58.228039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb087f32-1f90-44d0-a7aa-e409f1447aa0 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:58.238995 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1605/3208] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:35:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:35:58.662630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:58.664112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:58.836273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ca44b-f7a4-4c61-92f7-562ace7355a9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:58.860890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:58.861561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:58.862017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:58.862290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] PATH_INFO: `/v3/projects/389c140497884dce873f601472b1a915` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:58.863508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=389c140497884dce873f601472b1a915)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:58.865908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:59.032398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389c140497884dce873f601472b1a915', 'request_id': 'req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:59.045541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389c140497884dce873f601472b1a915', 'request_id': 'req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:59.060405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389c140497884dce873f601472b1a915', 'request_id': 'req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:59.068530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:59.101923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] The token cache is being invalidate because project 389c140497884dce873f601472b1a915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:35:59.107568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:59.117938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3cb2f02f-6f3f-4437-bdf2-4174a4ffdb7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:35:59.124881 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1604/3209] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:35:58 2022] DELETE /identity/v3/projects/389c140497884dce873f601472b1a915 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:35:59.130597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3a6c1-f492-4e27-ae91-55186c03c4ed None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:59.131312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3a6c1-f492-4e27-ae91-55186c03c4ed None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:59.131312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3a6c1-f492-4e27-ae91-55186c03c4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:59.193905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cbd3a6c1-f492-4e27-ae91-55186c03c4ed None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:59.196314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cbd3a6c1-f492-4e27-ae91-55186c03c4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:59.392026 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1606/3210] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:59.394042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a084-b434-44f9-9afb-8859b4410866 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:59.394659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a084-b434-44f9-9afb-8859b4410866 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:59.395037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a084-b434-44f9-9afb-8859b4410866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:59.446619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b785a084-b434-44f9-9afb-8859b4410866 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:35:59.447932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b785a084-b434-44f9-9afb-8859b4410866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:35:59.485455 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1605/3211] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:35:59.487522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3a6c1-f492-4e27-ae91-55186c03c4ed None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:59.521053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3a6c1-f492-4e27-ae91-55186c03c4ed None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:59.542011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b3ef-d5fa-4166-b7c4-89619a4c3d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:59.543030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b3ef-d5fa-4166-b7c4-89619a4c3d76 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:59.543414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b3ef-d5fa-4166-b7c4-89619a4c3d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:59.543756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b3ef-d5fa-4166-b7c4-89619a4c3d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:59.544503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591b3ef-d5fa-4166-b7c4-89619a4c3d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:35:59.544896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591b3ef-d5fa-4166-b7c4-89619a4c3d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:59.546876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591b3ef-d5fa-4166-b7c4-89619a4c3d76 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:59.613088 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1607/3212] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:35:59.614303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785a084-b434-44f9-9afb-8859b4410866 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:59.650313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785a084-b434-44f9-9afb-8859b4410866 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:59.674920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1e55-1c02-48d4-9035-b7fe9ed3bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:35:59.680140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1e55-1c02-48d4-9035-b7fe9ed3bd05 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:35:59.681009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1e55-1c02-48d4-9035-b7fe9ed3bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:35:59.681467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1e55-1c02-48d4-9035-b7fe9ed3bd05 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:35:59.682295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c1e55-1c02-48d4-9035-b7fe9ed3bd05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:35:59.686049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c1e55-1c02-48d4-9035-b7fe9ed3bd05 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:35:59.738286 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1606/3213] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:35:59 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:35:59.745423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b3ef-d5fa-4166-b7c4-89619a4c3d76 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:59.777531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b3ef-d5fa-4166-b7c4-89619a4c3d76 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:35:59.926417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1e55-1c02-48d4-9035-b7fe9ed3bd05 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:35:59.931475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-072c1e55-1c02-48d4-9035-b7fe9ed3bd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:00.007450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdd06f-c95c-4740-921a-3fb5460ec4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:00.008511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdd06f-c95c-4740-921a-3fb5460ec4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:00.008812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdd06f-c95c-4740-921a-3fb5460ec4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:00.009238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdd06f-c95c-4740-921a-3fb5460ec4f4 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:00.010093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdd06f-c95c-4740-921a-3fb5460ec4f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:00.015563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdd06f-c95c-4740-921a-3fb5460ec4f4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:00.092132 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1608/3214] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:35:59 2022] POST /identity/v3/users => generated 288 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:00.094067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdd06f-c95c-4740-921a-3fb5460ec4f4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:00.137860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdd06f-c95c-4740-921a-3fb5460ec4f4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:00.156613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1e55-1c02-48d4-9035-b7fe9ed3bd05 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:00.160610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c1a38-2f96-492f-93c7-fc5c3e6d2ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:00.162178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1a38-2f96-492f-93c7-fc5c3e6d2ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:00.163240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1a38-2f96-492f-93c7-fc5c3e6d2ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:00.165165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1a38-2f96-492f-93c7-fc5c3e6d2ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:00.166925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c1a38-2f96-492f-93c7-fc5c3e6d2ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:00.170444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c1a38-2f96-492f-93c7-fc5c3e6d2ef8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:00.172081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9a681-c62c-4fe0-9b01-6bab6a222a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:00.172756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9a681-c62c-4fe0-9b01-6bab6a222a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:00.173032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9a681-c62c-4fe0-9b01-6bab6a222a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:00.173306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9a681-c62c-4fe0-9b01-6bab6a222a95 admin admin] PATH_INFO: `/v3/users/a1ab26a46d314c97808cab66c3386ceb` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:00.175701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9a681-c62c-4fe0-9b01-6bab6a222a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ab26a46d314c97808cab66c3386ceb)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:00.179515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9a681-c62c-4fe0-9b01-6bab6a222a95 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:00.188329 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1609/3215] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:36:00.195596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c1a38-2f96-492f-93c7-fc5c3e6d2ef8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:00.235055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c1a38-2f96-492f-93c7-fc5c3e6d2ef8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:00.242867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d29d9a-0e91-44fa-b77e-155d4218add5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:00.244178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d29d9a-0e91-44fa-b77e-155d4218add5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:00.244975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d29d9a-0e91-44fa-b77e-155d4218add5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:00.245662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d29d9a-0e91-44fa-b77e-155d4218add5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:00.246858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d29d9a-0e91-44fa-b77e-155d4218add5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:00.249650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d29d9a-0e91-44fa-b77e-155d4218add5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:00.278847 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1610/3216] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:00.292646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d29d9a-0e91-44fa-b77e-155d4218add5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:00.340988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d29d9a-0e91-44fa-b77e-155d4218add5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:00.346869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8d9a681-c62c-4fe0-9b01-6bab6a222a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ab26a46d314c97808cab66c3386ceb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:00.348132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8d9a681-c62c-4fe0-9b01-6bab6a222a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ab26a46d314c97808cab66c3386ceb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:00.357233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae733ab-408a-43d4-ab17-38ed203677dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:00.360081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae733ab-408a-43d4-ab17-38ed203677dd admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:00.360736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae733ab-408a-43d4-ab17-38ed203677dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:00.361624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae733ab-408a-43d4-ab17-38ed203677dd admin admin] PATH_INFO: `/v3/projects/24dcbd2a5cee479988d82645ca00535c/users/04388877a1d246bf8a5db955e97172f0/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:00.406329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8d9a681-c62c-4fe0-9b01-6bab6a222a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ab26a46d314c97808cab66c3386ceb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:00.409991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8d9a681-c62c-4fe0-9b01-6bab6a222a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ab26a46d314c97808cab66c3386ceb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:00.430249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae733ab-408a-43d4-ab17-38ed203677dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dcbd2a5cee479988d82645ca00535c, user_id=04388877a1d246bf8a5db955e97172f0, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:00.430918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8d9a681-c62c-4fe0-9b01-6bab6a222a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ab26a46d314c97808cab66c3386ceb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:00.433889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae733ab-408a-43d4-ab17-38ed203677dd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:00.469860 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1607/3217] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:35:59 2022] DELETE /identity/v3/users/a1ab26a46d314c97808cab66c3386ceb => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:00.470038 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1611/3218] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:00 2022] PUT /identity/v3/projects/24dcbd2a5cee479988d82645ca00535c/users/04388877a1d246bf8a5db955e97172f0/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:00.470236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9d377-fc66-4fff-8114-7ffddd0b2b6c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:00.470236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9d377-fc66-4fff-8114-7ffddd0b2b6c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:00.470236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9d377-fc66-4fff-8114-7ffddd0b2b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:00.508942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4ba9d377-fc66-4fff-8114-7ffddd0b2b6c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:00.510372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4ba9d377-fc66-4fff-8114-7ffddd0b2b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:00.549124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7afbf-5a10-4161-8b27-e8885c23db5b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:00.549663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7afbf-5a10-4161-8b27-e8885c23db5b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:00.550043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7afbf-5a10-4161-8b27-e8885c23db5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:00.595422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:00.617190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-26a7afbf-5a10-4161-8b27-e8885c23db5b None None] MFA Rules not processed for user `04388877a1d246bf8a5db955e97172f0`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:00.618766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-26a7afbf-5a10-4161-8b27-e8885c23db5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:00.643393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:00.752961 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1608/3219] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:00.769736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9d377-fc66-4fff-8114-7ffddd0b2b6c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:00.772588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4ba9d377-fc66-4fff-8114-7ffddd0b2b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:00.838828 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1612/3220] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:00.842532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7afbf-5a10-4161-8b27-e8885c23db5b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:00.848784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-26a7afbf-5a10-4161-8b27-e8885c23db5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:00.905327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7afbf-5a10-4161-8b27-e8885c23db5b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:00.934703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0ae32-d92b-4f9c-9ed6-047b6fafa8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:00.939008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0ae32-d92b-4f9c-9ed6-047b6fafa8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:00.941273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0ae32-d92b-4f9c-9ed6-047b6fafa8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:00.941703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0ae32-d92b-4f9c-9ed6-047b6fafa8b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:00.942537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0ae32-d92b-4f9c-9ed6-047b6fafa8b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:00.950761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0ae32-d92b-4f9c-9ed6-047b6fafa8b7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:01.020696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9d377-fc66-4fff-8114-7ffddd0b2b6c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:01.023012 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1613/3221] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:00 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:01.027682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0ae32-d92b-4f9c-9ed6-047b6fafa8b7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:01.139477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ae37-4077-4f11-a9c0-ccad8e1a0344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:01.141112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ae37-4077-4f11-a9c0-ccad8e1a0344 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:01.141423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ae37-4077-4f11-a9c0-ccad8e1a0344 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:01.141697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ae37-4077-4f11-a9c0-ccad8e1a0344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:01.201425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0ae32-d92b-4f9c-9ed6-047b6fafa8b7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:01.222061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f4a2-0263-4535-80d7-5f0b255e4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:01.222973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f4a2-0263-4535-80d7-5f0b255e4741 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:01.223261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f4a2-0263-4535-80d7-5f0b255e4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:01.223542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f4a2-0263-4535-80d7-5f0b255e4741 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:01.227461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325f4a2-0263-4535-80d7-5f0b255e4741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:01.238806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325f4a2-0263-4535-80d7-5f0b255e4741 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:01.312941 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1614/3222] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:01 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:01.317050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f4a2-0263-4535-80d7-5f0b255e4741 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:01.338150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f4a2-0263-4535-80d7-5f0b255e4741 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:01.348140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ae37-4077-4f11-a9c0-ccad8e1a0344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:01.349016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555935f-a1e1-4eb0-b499-363c41505a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:01.349987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555935f-a1e1-4eb0-b499-363c41505a3d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:01.350810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555935f-a1e1-4eb0-b499-363c41505a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:01.351308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555935f-a1e1-4eb0-b499-363c41505a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:01.352113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ae37-4077-4f11-a9c0-ccad8e1a0344 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:01.352310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555935f-a1e1-4eb0-b499-363c41505a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:01.354127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555935f-a1e1-4eb0-b499-363c41505a3d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:01.375704 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1615/3223] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:36:01.380316 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1609/3224] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:01.381100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555935f-a1e1-4eb0-b499-363c41505a3d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:01.411573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555935f-a1e1-4eb0-b499-363c41505a3d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:01.421736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13095362-f686-4383-9e0f-be09dc4504a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:01.423047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095362-f686-4383-9e0f-be09dc4504a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:01.423177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095362-f686-4383-9e0f-be09dc4504a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:01.423627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095362-f686-4383-9e0f-be09dc4504a5 admin admin] PATH_INFO: `/v3/projects/bbe39e03703c4909a5a6081c351b6de4/users/89a2fbc5003549f6bd6dc173f0cc3d05/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:01.457789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13095362-f686-4383-9e0f-be09dc4504a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe39e03703c4909a5a6081c351b6de4, user_id=89a2fbc5003549f6bd6dc173f0cc3d05, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:01.460767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13095362-f686-4383-9e0f-be09dc4504a5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:01.481225 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1616/3225] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:01 2022] PUT /identity/v3/projects/bbe39e03703c4909a5a6081c351b6de4/users/89a2fbc5003549f6bd6dc173f0cc3d05/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:01.485330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ae37-4077-4f11-a9c0-ccad8e1a0344 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:01.511943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ae37-4077-4f11-a9c0-ccad8e1a0344 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:01.641314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:01.663347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039eb4a-4e92-4419-aca8-9b619884bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:01.664286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039eb4a-4e92-4419-aca8-9b619884bd2c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:01.664758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039eb4a-4e92-4419-aca8-9b619884bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:01.665222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039eb4a-4e92-4419-aca8-9b619884bd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:01.666579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039eb4a-4e92-4419-aca8-9b619884bd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:01.679148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039eb4a-4e92-4419-aca8-9b619884bd2c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:01.695875 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1610/3226] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:01.700599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13095362-f686-4383-9e0f-be09dc4504a5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:01.729373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13095362-f686-4383-9e0f-be09dc4504a5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:01.743691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bab560-13ac-41a7-8788-7be054eeb1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:01.745832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bab560-13ac-41a7-8788-7be054eeb1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:01.747684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bab560-13ac-41a7-8788-7be054eeb1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:01.748197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bab560-13ac-41a7-8788-7be054eeb1dd admin admin] PATH_INFO: `/v3/projects/bbe39e03703c4909a5a6081c351b6de4/users/89a2fbc5003549f6bd6dc173f0cc3d05/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:01.752362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bab560-13ac-41a7-8788-7be054eeb1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe39e03703c4909a5a6081c351b6de4, user_id=89a2fbc5003549f6bd6dc173f0cc3d05, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:01.757900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bab560-13ac-41a7-8788-7be054eeb1dd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:01.789781 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1617/3227] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:01 2022] PUT /identity/v3/projects/bbe39e03703c4909a5a6081c351b6de4/users/89a2fbc5003549f6bd6dc173f0cc3d05/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:01.801247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529017d2-151d-484c-9f38-21c4cc21acc4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:01.801829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529017d2-151d-484c-9f38-21c4cc21acc4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:01.802273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529017d2-151d-484c-9f38-21c4cc21acc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:01.850466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-529017d2-151d-484c-9f38-21c4cc21acc4 None None] MFA Rules not processed for user `89a2fbc5003549f6bd6dc173f0cc3d05`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:01.851759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-529017d2-151d-484c-9f38-21c4cc21acc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:02.063349 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1611/3228] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:02.070962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bab560-13ac-41a7-8788-7be054eeb1dd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:02.087451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bab560-13ac-41a7-8788-7be054eeb1dd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:02.094220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7654507-77d2-43ae-863f-861a38e68295 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:02.095586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7654507-77d2-43ae-863f-861a38e68295 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:02.096075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7654507-77d2-43ae-863f-861a38e68295 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:02.096544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7654507-77d2-43ae-863f-861a38e68295 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:02.097455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7654507-77d2-43ae-863f-861a38e68295 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:02.097997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7654507-77d2-43ae-863f-861a38e68295 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:02.100609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7654507-77d2-43ae-863f-861a38e68295 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:02.123329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529017d2-151d-484c-9f38-21c4cc21acc4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:02.129500 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1618/3229] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:02.134480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529017d2-151d-484c-9f38-21c4cc21acc4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:02.141575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43192ee2-39ee-4c26-b5a2-cdf675af68e1 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:02.142634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43192ee2-39ee-4c26-b5a2-cdf675af68e1 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:02.143169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43192ee2-39ee-4c26-b5a2-cdf675af68e1 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:02.143995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43192ee2-39ee-4c26-b5a2-cdf675af68e1 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:02.145262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43192ee2-39ee-4c26-b5a2-cdf675af68e1 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:02.147970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43192ee2-39ee-4c26-b5a2-cdf675af68e1 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:02.202981 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1612/3230] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:02 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:02.207605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7654507-77d2-43ae-863f-861a38e68295 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:02.220605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:02.232797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7654507-77d2-43ae-863f-861a38e68295 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:02.343554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62ac09-c3bc-42e3-97dc-6e710d1c6fbb tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:02.345615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ac09-c3bc-42e3-97dc-6e710d1c6fbb tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:02.346151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ac09-c3bc-42e3-97dc-6e710d1c6fbb tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:02.346661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ac09-c3bc-42e3-97dc-6e710d1c6fbb tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:02.347609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62ac09-c3bc-42e3-97dc-6e710d1c6fbb tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:02.348141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62ac09-c3bc-42e3-97dc-6e710d1c6fbb tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:02.350994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62ac09-c3bc-42e3-97dc-6e710d1c6fbb tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:02.366542 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1619/3231] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:36:02.547321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43192ee2-39ee-4c26-b5a2-cdf675af68e1 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:02.549262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-43192ee2-39ee-4c26-b5a2-cdf675af68e1 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:02.686877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43192ee2-39ee-4c26-b5a2-cdf675af68e1 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:02.694203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5e4e4-aabd-48a2-8ddd-c2b1c4b46e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:02.694856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5e4e4-aabd-48a2-8ddd-c2b1c4b46e5f service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:02.695146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5e4e4-aabd-48a2-8ddd-c2b1c4b46e5f service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:02.695474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5e4e4-aabd-48a2-8ddd-c2b1c4b46e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:02.706339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5e4e4-aabd-48a2-8ddd-c2b1c4b46e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:02.708119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5e4e4-aabd-48a2-8ddd-c2b1c4b46e5f service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:02.724526 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1613/3232] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:02.749631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd556eb-0a87-45a6-b476-01c542ce83d7 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:02.750097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd556eb-0a87-45a6-b476-01c542ce83d7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:02.750538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd556eb-0a87-45a6-b476-01c542ce83d7 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:02.752590 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1620/3233] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:02.761378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5e4e4-aabd-48a2-8ddd-c2b1c4b46e5f service nova] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:02.778421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5e4e4-aabd-48a2-8ddd-c2b1c4b46e5f service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:02.811897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5e4e4-aabd-48a2-8ddd-c2b1c4b46e5f service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:02.830008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15f304-3c1e-4106-964a-3bef9a8d4ecc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:02.830782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f304-3c1e-4106-964a-3bef9a8d4ecc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:02.830950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f304-3c1e-4106-964a-3bef9a8d4ecc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:02.831229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f304-3c1e-4106-964a-3bef9a8d4ecc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/f6f8e260178e44bdb1994f3f558bbb8f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:02.833985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15f304-3c1e-4106-964a-3bef9a8d4ecc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:get_project(project_id=f6f8e260178e44bdb1994f3f558bbb8f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:02.841442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15f304-3c1e-4106-964a-3bef9a8d4ecc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:02.843741 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1614/3234] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:02 2022] GET /identity/v3/projects/f6f8e260178e44bdb1994f3f558bbb8f => generated 369 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:02.905464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd556eb-0a87-45a6-b476-01c542ce83d7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:02.907857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1fd556eb-0a87-45a6-b476-01c542ce83d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:03.085841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd556eb-0a87-45a6-b476-01c542ce83d7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:03.093058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:03.093462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89eedf-d297-4a3d-8ef7-0efe5d366cab None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:03.093584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89eedf-d297-4a3d-8ef7-0efe5d366cab None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:03.093794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:03.093902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89eedf-d297-4a3d-8ef7-0efe5d366cab None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:03.094075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:03.094439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] PATH_INFO: `/v3/projects/c785a2ff808848958fa8e54ac1db2fdb` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:03.095439 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1615/3235] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:36:03.095998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c785a2ff808848958fa8e54ac1db2fdb)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:03.100021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:03.104888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89eedf-d297-4a3d-8ef7-0efe5d366cab None None] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:03.108759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bb89eedf-d297-4a3d-8ef7-0efe5d366cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:03.142714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89eedf-d297-4a3d-8ef7-0efe5d366cab None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:03.159392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89eedf-d297-4a3d-8ef7-0efe5d366cab None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:03.166768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3428f45-3ff4-4d76-9fa8-e685de536c55 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:03.167439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3428f45-3ff4-4d76-9fa8-e685de536c55 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:03.167724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3428f45-3ff4-4d76-9fa8-e685de536c55 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:03.167998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3428f45-3ff4-4d76-9fa8-e685de536c55 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/f6f8e260178e44bdb1994f3f558bbb8f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:03.169328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3428f45-3ff4-4d76-9fa8-e685de536c55 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:get_project(project_id=f6f8e260178e44bdb1994f3f558bbb8f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:03.171429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3428f45-3ff4-4d76-9fa8-e685de536c55 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:03.188061 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1616/3236] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:03 2022] GET /identity/v3/projects/f6f8e260178e44bdb1994f3f558bbb8f => generated 369 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:03.220352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c785a2ff808848958fa8e54ac1db2fdb', 'request_id': 'req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.233637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c785a2ff808848958fa8e54ac1db2fdb', 'request_id': 'req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.243926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c785a2ff808848958fa8e54ac1db2fdb', 'request_id': 'req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.260567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] The token cache is being invalidate because project c785a2ff808848958fa8e54ac1db2fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:03.260567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.261591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5aee4999-3ce7-4f78-9ee5-094ffc1851a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.265454 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1621/3237] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:02 2022] DELETE /identity/v3/projects/c785a2ff808848958fa8e54ac1db2fdb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:03.268487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3428f45-3ff4-4d76-9fa8-e685de536c55 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:03.276010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d3428f45-3ff4-4d76-9fa8-e685de536c55 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:03.287388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3428f45-3ff4-4d76-9fa8-e685de536c55 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:03.313189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:03.326832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ba0fc-afbb-44d5-be26-8446fddf719e None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:03.327112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ba0fc-afbb-44d5-be26-8446fddf719e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:03.327381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ba0fc-afbb-44d5-be26-8446fddf719e None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:03.329114 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1622/3238] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:36:03.335578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ba0fc-afbb-44d5-be26-8446fddf719e None None] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:03.337599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-524ba0fc-afbb-44d5-be26-8446fddf719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:03.375405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:03.376434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:03.376931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:03.377582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] PATH_INFO: `/v3/users/86cde79a358343a9b3c4614b2cc48847` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:03.379317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86cde79a358343a9b3c4614b2cc48847)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:03.382719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:03.387870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:03.466595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ba0fc-afbb-44d5-be26-8446fddf719e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:03.468188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86cde79a358343a9b3c4614b2cc48847'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.469320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86cde79a358343a9b3c4614b2cc48847'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.472824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-524ba0fc-afbb-44d5-be26-8446fddf719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:03.495237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86cde79a358343a9b3c4614b2cc48847'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.496738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86cde79a358343a9b3c4614b2cc48847'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.506739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86cde79a358343a9b3c4614b2cc48847'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.529183 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1617/3239] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:36:03 2022] DELETE /identity/v3/users/86cde79a358343a9b3c4614b2cc48847 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:03.573607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ba0fc-afbb-44d5-be26-8446fddf719e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:03.675613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aec9e-f507-4132-a5de-40a81103e676 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:03.675847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aec9e-f507-4132-a5de-40a81103e676 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:03.676118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aec9e-f507-4132-a5de-40a81103e676 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:03.676397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aec9e-f507-4132-a5de-40a81103e676 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/f6f8e260178e44bdb1994f3f558bbb8f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:03.677687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aec9e-f507-4132-a5de-40a81103e676 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:get_project(project_id=f6f8e260178e44bdb1994f3f558bbb8f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:03.680312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aec9e-f507-4132-a5de-40a81103e676 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:03.683007 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1623/3240] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:03 2022] GET /identity/v3/projects/f6f8e260178e44bdb1994f3f558bbb8f => generated 369 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:36:03.716512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:03.718510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:03.754642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85601fc2-0340-425e-b540-3bead6d04a07 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:03.768455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:03.770084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:03.771803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:03.772803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/f6f8e260178e44bdb1994f3f558bbb8f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:03.775396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f6f8e260178e44bdb1994f3f558bbb8f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:03.780693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:03.867338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f8e260178e44bdb1994f3f558bbb8f', 'request_id': 'req-9db6d405-009d-4bdd-b53d-751acf29b725'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.885863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f8e260178e44bdb1994f3f558bbb8f', 'request_id': 'req-9db6d405-009d-4bdd-b53d-751acf29b725'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.895396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f8e260178e44bdb1994f3f558bbb8f', 'request_id': 'req-9db6d405-009d-4bdd-b53d-751acf29b725'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.910690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] The token cache is being invalidate because project f6f8e260178e44bdb1994f3f558bbb8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:03.911306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.912754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9db6d405-009d-4bdd-b53d-751acf29b725 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:03.914543 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1618/3241] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:03 2022] DELETE /identity/v3/projects/f6f8e260178e44bdb1994f3f558bbb8f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:03.975218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aec9e-f507-4132-a5de-40a81103e676 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:03.977930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1b0aec9e-f507-4132-a5de-40a81103e676 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:04.157798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aec9e-f507-4132-a5de-40a81103e676 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:04.184717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:04.241683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:04.242345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:04.242594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:04.242865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] PATH_INFO: `/v3/projects/0fc33da4b2d542c1a13a626c080cd25a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:04.244096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc33da4b2d542c1a13a626c080cd25a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:04.246116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:04.364164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc33da4b2d542c1a13a626c080cd25a', 'request_id': 'req-46a96208-dd62-4d95-a758-77564144d9fd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:04.381873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc33da4b2d542c1a13a626c080cd25a', 'request_id': 'req-46a96208-dd62-4d95-a758-77564144d9fd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:04.400440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc33da4b2d542c1a13a626c080cd25a', 'request_id': 'req-46a96208-dd62-4d95-a758-77564144d9fd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:04.416357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c50237-df25-4443-9f3a-b37b73d031e6 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:04.416632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c50237-df25-4443-9f3a-b37b73d031e6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:04.416938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c50237-df25-4443-9f3a-b37b73d031e6 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:04.418660 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1619/3242] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:36:04.422307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] The token cache is being invalidate because project 0fc33da4b2d542c1a13a626c080cd25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:04.422682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:04.423481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:04.425076 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1624/3243] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:03 2022] DELETE /identity/v3/projects/0fc33da4b2d542c1a13a626c080cd25a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:04.432210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc9cb8-2b67-4d82-a60a-c2005c015c97 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:04.432944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc9cb8-2b67-4d82-a60a-c2005c015c97 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:04.433570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc9cb8-2b67-4d82-a60a-c2005c015c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:04.444028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:04.449138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:04.473596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c5fc9cb8-2b67-4d82-a60a-c2005c015c97 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:04.477510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c5fc9cb8-2b67-4d82-a60a-c2005c015c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:04.505985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:04.589055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:04.590877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:04.606577 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1620/3244] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:04.610716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71b86-900f-4437-9305-f8ecb52a915c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:04.611112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71b86-900f-4437-9305-f8ecb52a915c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:04.611415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71b86-900f-4437-9305-f8ecb52a915c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:04.644822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-41b71b86-900f-4437-9305-f8ecb52a915c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:04.646412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-41b71b86-900f-4437-9305-f8ecb52a915c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:04.660894 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1621/3245] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:04.662682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b71b86-900f-4437-9305-f8ecb52a915c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:04.674012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:04.676635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b71b86-900f-4437-9305-f8ecb52a915c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:04.687692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5d538-3f99-4bd2-be87-e2de052d5c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:04.688705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d538-3f99-4bd2-be87-e2de052d5c97 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:04.689170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d538-3f99-4bd2-be87-e2de052d5c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:04.689506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5d538-3f99-4bd2-be87-e2de052d5c97 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:04.690468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5d538-3f99-4bd2-be87-e2de052d5c97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:04.690935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5d538-3f99-4bd2-be87-e2de052d5c97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:04.693117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5d538-3f99-4bd2-be87-e2de052d5c97 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:04.708313 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1622/3246] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:04.708547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a96208-dd62-4d95-a758-77564144d9fd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:04.712876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5d538-3f99-4bd2-be87-e2de052d5c97 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:04.715942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f688214-4aae-4660-b6ef-3af374e41aa9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:04.716475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688214-4aae-4660-b6ef-3af374e41aa9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:04.716890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688214-4aae-4660-b6ef-3af374e41aa9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:04.717297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688214-4aae-4660-b6ef-3af374e41aa9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/24dcbd2a5cee479988d82645ca00535c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:04.718915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f688214-4aae-4660-b6ef-3af374e41aa9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:get_project(project_id=24dcbd2a5cee479988d82645ca00535c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:04.721601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f688214-4aae-4660-b6ef-3af374e41aa9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:04.723778 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1625/3247] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:04 2022] GET /identity/v3/projects/24dcbd2a5cee479988d82645ca00535c => generated 375 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:04.726435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5d538-3f99-4bd2-be87-e2de052d5c97 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:04.734939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e31dc1-9339-49e3-9a06-09e698cc0418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:04.735583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31dc1-9339-49e3-9a06-09e698cc0418 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:04.745164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31dc1-9339-49e3-9a06-09e698cc0418 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:04.745164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31dc1-9339-49e3-9a06-09e698cc0418 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:04.745164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e31dc1-9339-49e3-9a06-09e698cc0418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:04.746843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f688214-4aae-4660-b6ef-3af374e41aa9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:04.759682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e31dc1-9339-49e3-9a06-09e698cc0418 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:04.782733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f688214-4aae-4660-b6ef-3af374e41aa9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:04.795623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85f5a0-599c-4ac1-993c-9681788c312e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:04.797838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85f5a0-599c-4ac1-993c-9681788c312e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:04.798445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85f5a0-599c-4ac1-993c-9681788c312e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:04.799086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85f5a0-599c-4ac1-993c-9681788c312e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:04.800536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85f5a0-599c-4ac1-993c-9681788c312e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:04.802400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85f5a0-599c-4ac1-993c-9681788c312e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:04.804640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85f5a0-599c-4ac1-993c-9681788c312e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:04.812916 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1623/3248] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:04 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:04.817897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e31dc1-9339-49e3-9a06-09e698cc0418 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:04.825634 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1626/3249] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:04.829504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85f5a0-599c-4ac1-993c-9681788c312e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:04.848171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85f5a0-599c-4ac1-993c-9681788c312e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:04.959004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e31dc1-9339-49e3-9a06-09e698cc0418 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:04.973681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524afc5-97da-499d-ac57-128e53710e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:04.975066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524afc5-97da-499d-ac57-128e53710e03 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:04.975525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524afc5-97da-499d-ac57-128e53710e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:04.975896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524afc5-97da-499d-ac57-128e53710e03 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:04.976639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524afc5-97da-499d-ac57-128e53710e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:04.978771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524afc5-97da-499d-ac57-128e53710e03 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:04.988051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e76a68-f91d-489c-a748-08291fa5cb04 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:04.989064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76a68-f91d-489c-a748-08291fa5cb04 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:04.989330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76a68-f91d-489c-a748-08291fa5cb04 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:04.989807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76a68-f91d-489c-a748-08291fa5cb04 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:04.991606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e76a68-f91d-489c-a748-08291fa5cb04 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:05.001068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e76a68-f91d-489c-a748-08291fa5cb04 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:05.006349 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1624/3250] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:04 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:36:05.010190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524afc5-97da-499d-ac57-128e53710e03 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:05.022722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524afc5-97da-499d-ac57-128e53710e03 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:05.043516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae216e04-e516-40eb-b486-a7a395b8d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:05.046628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216e04-e516-40eb-b486-a7a395b8d6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:05.047063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216e04-e516-40eb-b486-a7a395b8d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:05.048036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216e04-e516-40eb-b486-a7a395b8d6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:05.049293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae216e04-e516-40eb-b486-a7a395b8d6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:05.052393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae216e04-e516-40eb-b486-a7a395b8d6b3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:05.078372 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1625/3251] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:05.085353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae216e04-e516-40eb-b486-a7a395b8d6b3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:05.098362 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1627/3252] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:04 2022] POST /identity/v3/projects => generated 369 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:05.103167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e76a68-f91d-489c-a748-08291fa5cb04 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:05.111660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae216e04-e516-40eb-b486-a7a395b8d6b3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:05.265407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:05.275401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e76a68-f91d-489c-a748-08291fa5cb04 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:05.281535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58ea53-f273-47eb-bddd-6e8f5f418cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:05.282475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ea53-f273-47eb-bddd-6e8f5f418cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:05.282830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ea53-f273-47eb-bddd-6e8f5f418cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:05.283416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ea53-f273-47eb-bddd-6e8f5f418cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:05.284671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58ea53-f273-47eb-bddd-6e8f5f418cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:05.287236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58ea53-f273-47eb-bddd-6e8f5f418cc7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:05.291788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d017-5969-49b0-8c6f-1e37e7ea3dd8 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:05.292554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d017-5969-49b0-8c6f-1e37e7ea3dd8 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:05.292901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d017-5969-49b0-8c6f-1e37e7ea3dd8 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:05.293379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d017-5969-49b0-8c6f-1e37e7ea3dd8 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:05.294152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77d017-5969-49b0-8c6f-1e37e7ea3dd8 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:05.295492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77d017-5969-49b0-8c6f-1e37e7ea3dd8 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:05.305712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77d017-5969-49b0-8c6f-1e37e7ea3dd8 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:05.320703 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1626/3253] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:05.323054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58ea53-f273-47eb-bddd-6e8f5f418cc7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:05.340364 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1628/3254] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:05.343125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58ea53-f273-47eb-bddd-6e8f5f418cc7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:05.349171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2f526-2141-48ae-aa54-33723e83980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:05.350022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2f526-2141-48ae-aa54-33723e83980a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:05.350401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2f526-2141-48ae-aa54-33723e83980a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:05.350781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2f526-2141-48ae-aa54-33723e83980a admin admin] PATH_INFO: `/v3/projects/f64f2469ff0345d680db3cae9444d749/users/6b448f96ae8b4a6698169ff4ef319ae2/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:05.367451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2f526-2141-48ae-aa54-33723e83980a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64f2469ff0345d680db3cae9444d749, user_id=6b448f96ae8b4a6698169ff4ef319ae2, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:05.371124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2f526-2141-48ae-aa54-33723e83980a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:05.390393 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1627/3255] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:05 2022] PUT /identity/v3/projects/f64f2469ff0345d680db3cae9444d749/users/6b448f96ae8b4a6698169ff4ef319ae2/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:05.404063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70156b-be19-4911-99dc-bd7abe80f714 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:05.404496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70156b-be19-4911-99dc-bd7abe80f714 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:05.404926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70156b-be19-4911-99dc-bd7abe80f714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:05.449884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cc70156b-be19-4911-99dc-bd7abe80f714 None None] MFA Rules not processed for user `6b448f96ae8b4a6698169ff4ef319ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:05.451539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cc70156b-be19-4911-99dc-bd7abe80f714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:05.516446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:05.555511 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1629/3256] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:05.560358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2f526-2141-48ae-aa54-33723e83980a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:05.619773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87588f13-d960-452d-a2b8-f305bd2b0949 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:05.620215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87588f13-d960-452d-a2b8-f305bd2b0949 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:05.620667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87588f13-d960-452d-a2b8-f305bd2b0949 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:05.623002 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1630/3257] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:36:05.629442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87588f13-d960-452d-a2b8-f305bd2b0949 None None] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:05.667148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2f526-2141-48ae-aa54-33723e83980a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:05.675347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4d14-2a39-4bd0-839c-246099169400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:05.676710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4d14-2a39-4bd0-839c-246099169400 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:05.677090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4d14-2a39-4bd0-839c-246099169400 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:05.678019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4d14-2a39-4bd0-839c-246099169400 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:05.679037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b4d14-2a39-4bd0-839c-246099169400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:05.681206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b4d14-2a39-4bd0-839c-246099169400 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:05.713368 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1628/3258] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:05 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:05.719912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4d14-2a39-4bd0-839c-246099169400 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:05.738332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87588f13-d960-452d-a2b8-f305bd2b0949 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:05.816846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4d14-2a39-4bd0-839c-246099169400 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:05.824500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcb4fe-3ba1-4f25-baee-94fc73e039ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:05.825300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcb4fe-3ba1-4f25-baee-94fc73e039ea admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:05.825735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcb4fe-3ba1-4f25-baee-94fc73e039ea admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:05.825885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcb4fe-3ba1-4f25-baee-94fc73e039ea admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:05.826528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcb4fe-3ba1-4f25-baee-94fc73e039ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:05.828884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcb4fe-3ba1-4f25-baee-94fc73e039ea admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:05.829677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87588f13-d960-452d-a2b8-f305bd2b0949 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:05.860371 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1629/3259] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:05 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:36:05.861915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcb4fe-3ba1-4f25-baee-94fc73e039ea admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:05.874283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcb4fe-3ba1-4f25-baee-94fc73e039ea admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:05.879933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f37e4-2bc1-4b35-b4c3-bdab12d91927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:05.881452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f37e4-2bc1-4b35-b4c3-bdab12d91927 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:05.881857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f37e4-2bc1-4b35-b4c3-bdab12d91927 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:05.882243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f37e4-2bc1-4b35-b4c3-bdab12d91927 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:05.883148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f37e4-2bc1-4b35-b4c3-bdab12d91927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:05.885002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f37e4-2bc1-4b35-b4c3-bdab12d91927 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:05.897348 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1630/3260] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:05.901297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f37e4-2bc1-4b35-b4c3-bdab12d91927 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:05.913773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f37e4-2bc1-4b35-b4c3-bdab12d91927 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:05.916731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5ab3b-d529-48c8-9e5c-e6a34173e88e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:05.917518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5ab3b-d529-48c8-9e5c-e6a34173e88e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:05.917872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5ab3b-d529-48c8-9e5c-e6a34173e88e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:05.918289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5ab3b-d529-48c8-9e5c-e6a34173e88e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/39761f1cdb904e5fa8d0cfb8616a2ab9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:05.919205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2f7cf-69a5-49e1-8fac-b7f18cb7913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:05.919593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5ab3b-d529-48c8-9e5c-e6a34173e88e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:get_project(project_id=39761f1cdb904e5fa8d0cfb8616a2ab9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:05.920125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f7cf-69a5-49e1-8fac-b7f18cb7913f admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:05.920479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f7cf-69a5-49e1-8fac-b7f18cb7913f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:05.920835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f7cf-69a5-49e1-8fac-b7f18cb7913f admin admin] PATH_INFO: `/v3/projects/b3ec75d1b5034e0cb8e6b4bd0cd0e45e/users/2111e35ebdb648fea876436ef7c68fcf/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:05.922012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5ab3b-d529-48c8-9e5c-e6a34173e88e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:05.924663 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1631/3261] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:05 2022] GET /identity/v3/projects/39761f1cdb904e5fa8d0cfb8616a2ab9 => generated 369 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:36:05.939684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2f7cf-69a5-49e1-8fac-b7f18cb7913f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ec75d1b5034e0cb8e6b4bd0cd0e45e, user_id=2111e35ebdb648fea876436ef7c68fcf, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:05.942586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2f7cf-69a5-49e1-8fac-b7f18cb7913f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:05.962803 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1631/3262] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:05 2022] PUT /identity/v3/projects/b3ec75d1b5034e0cb8e6b4bd0cd0e45e/users/2111e35ebdb648fea876436ef7c68fcf/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:05.964968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5ab3b-d529-48c8-9e5c-e6a34173e88e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:05.985756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5ab3b-d529-48c8-9e5c-e6a34173e88e tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:06.030980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:06.073517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c22ff0-cd88-4b98-bdc2-a2d130378764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:06.074043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c22ff0-cd88-4b98-bdc2-a2d130378764 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:06.074484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c22ff0-cd88-4b98-bdc2-a2d130378764 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:06.074718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c22ff0-cd88-4b98-bdc2-a2d130378764 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:06.075414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c22ff0-cd88-4b98-bdc2-a2d130378764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:06.077573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c22ff0-cd88-4b98-bdc2-a2d130378764 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:06.093632 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1632/3263] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:06.097798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2f7cf-69a5-49e1-8fac-b7f18cb7913f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:06.109269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2f7cf-69a5-49e1-8fac-b7f18cb7913f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:06.115474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd746571-d0dc-46a8-9a84-2cae192dc6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:06.116148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746571-d0dc-46a8-9a84-2cae192dc6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:06.116437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746571-d0dc-46a8-9a84-2cae192dc6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:06.116852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746571-d0dc-46a8-9a84-2cae192dc6bc admin admin] PATH_INFO: `/v3/projects/b3ec75d1b5034e0cb8e6b4bd0cd0e45e/users/2111e35ebdb648fea876436ef7c68fcf/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:06.119393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd746571-d0dc-46a8-9a84-2cae192dc6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ec75d1b5034e0cb8e6b4bd0cd0e45e, user_id=2111e35ebdb648fea876436ef7c68fcf, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:06.123726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd746571-d0dc-46a8-9a84-2cae192dc6bc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:06.127167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:06.150006 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1632/3264] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:06 2022] PUT /identity/v3/projects/b3ec75d1b5034e0cb8e6b4bd0cd0e45e/users/2111e35ebdb648fea876436ef7c68fcf/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:06.157413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b7019-fcfe-4aab-a0d0-c4af1600eb5d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:06.158128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b7019-fcfe-4aab-a0d0-c4af1600eb5d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:06.158668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b7019-fcfe-4aab-a0d0-c4af1600eb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:06.213371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bc1d9-efd7-4718-90b4-b75108b6c969 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:06.214451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bc1d9-efd7-4718-90b4-b75108b6c969 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:06.214989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bc1d9-efd7-4718-90b4-b75108b6c969 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:06.216765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-254b7019-fcfe-4aab-a0d0-c4af1600eb5d None None] MFA Rules not processed for user `2111e35ebdb648fea876436ef7c68fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:06.216960 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1633/3265] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:36:06.218124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-254b7019-fcfe-4aab-a0d0-c4af1600eb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:06.223087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bc1d9-efd7-4718-90b4-b75108b6c969 None None] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:06.313451 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1633/3266] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:06.326993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0369b80-6bf1-4ae9-b0f6-f929b594b486 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:06.327543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0369b80-6bf1-4ae9-b0f6-f929b594b486 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:06.327991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0369b80-6bf1-4ae9-b0f6-f929b594b486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:06.338558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bc1d9-efd7-4718-90b4-b75108b6c969 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:06.352554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c0369b80-6bf1-4ae9-b0f6-f929b594b486 None None] MFA Rules not processed for user `6b448f96ae8b4a6698169ff4ef319ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:06.353869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c0369b80-6bf1-4ae9-b0f6-f929b594b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:06.426910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bc1d9-efd7-4718-90b4-b75108b6c969 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:06.432781 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1634/3267] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:06.433914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81b5f6-d21e-42cb-9cd8-6363aedc26b9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:06.434583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b5f6-d21e-42cb-9cd8-6363aedc26b9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:06.434871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b5f6-d21e-42cb-9cd8-6363aedc26b9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:06.435152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b5f6-d21e-42cb-9cd8-6363aedc26b9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/39761f1cdb904e5fa8d0cfb8616a2ab9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:06.436618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81b5f6-d21e-42cb-9cd8-6363aedc26b9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:get_project(project_id=39761f1cdb904e5fa8d0cfb8616a2ab9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:06.438881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81b5f6-d21e-42cb-9cd8-6363aedc26b9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:06.440863 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1634/3268] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:06 2022] GET /identity/v3/projects/39761f1cdb904e5fa8d0cfb8616a2ab9 => generated 369 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:06.491032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0369b80-6bf1-4ae9-b0f6-f929b594b486 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:06.508102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0369b80-6bf1-4ae9-b0f6-f929b594b486 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:06.513472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7777970-7356-4196-83c4-ad3d20d2722a tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:06.514303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777970-7356-4196-83c4-ad3d20d2722a tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:06.514564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777970-7356-4196-83c4-ad3d20d2722a tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:06.514954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777970-7356-4196-83c4-ad3d20d2722a tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:06.515647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7777970-7356-4196-83c4-ad3d20d2722a tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:06.515924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7777970-7356-4196-83c4-ad3d20d2722a tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:06.517988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7777970-7356-4196-83c4-ad3d20d2722a tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:06.545487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81b5f6-d21e-42cb-9cd8-6363aedc26b9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:06.554498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1635/3269] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:06.560352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81b5f6-d21e-42cb-9cd8-6363aedc26b9 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:06.565968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928487-eb8c-49a0-869c-3d9bf17c3546 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:06.566754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928487-eb8c-49a0-869c-3d9bf17c3546 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:06.567286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928487-eb8c-49a0-869c-3d9bf17c3546 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:06.567640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928487-eb8c-49a0-869c-3d9bf17c3546 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:06.568933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f928487-eb8c-49a0-869c-3d9bf17c3546 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:06.571052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f928487-eb8c-49a0-869c-3d9bf17c3546 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:06.599299 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1635/3270] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:06 2022] POST /identity/v3/users => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:06.603290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7777970-7356-4196-83c4-ad3d20d2722a tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:06.623011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7777970-7356-4196-83c4-ad3d20d2722a tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:06.632530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ef074-43a8-469f-bddc-ad452e534616 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:06.633652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ef074-43a8-469f-bddc-ad452e534616 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:06.633652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ef074-43a8-469f-bddc-ad452e534616 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:06.634000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ef074-43a8-469f-bddc-ad452e534616 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:06.634936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ef074-43a8-469f-bddc-ad452e534616 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:06.635411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ef074-43a8-469f-bddc-ad452e534616 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:06.637732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ef074-43a8-469f-bddc-ad452e534616 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:06.658433 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1636/3271] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:36:06.720185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928487-eb8c-49a0-869c-3d9bf17c3546 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:06.735806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928487-eb8c-49a0-869c-3d9bf17c3546 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:06.744066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebb01a-4b13-4002-9bfc-c860bd2be144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:06.745429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb01a-4b13-4002-9bfc-c860bd2be144 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:06.745429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb01a-4b13-4002-9bfc-c860bd2be144 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:06.745660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb01a-4b13-4002-9bfc-c860bd2be144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:06.754867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebb01a-4b13-4002-9bfc-c860bd2be144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:06.756604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebb01a-4b13-4002-9bfc-c860bd2be144 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:06.766566 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1636/3272] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:07.206759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1241ba-c706-4523-903a-32341b58196c None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:07.207120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1241ba-c706-4523-903a-32341b58196c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:07.207343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1241ba-c706-4523-903a-32341b58196c None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:07.208749 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1637/3273] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:07.214966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebb01a-4b13-4002-9bfc-c860bd2be144 service nova] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:07.238677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebb01a-4b13-4002-9bfc-c860bd2be144 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:07.252983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebb01a-4b13-4002-9bfc-c860bd2be144 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:07.259324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fea05a-0638-43a9-b8fb-e1f55529f242 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:07.260269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea05a-0638-43a9-b8fb-e1f55529f242 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:07.261679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea05a-0638-43a9-b8fb-e1f55529f242 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:07.262172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea05a-0638-43a9-b8fb-e1f55529f242 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/39761f1cdb904e5fa8d0cfb8616a2ab9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:07.263580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fea05a-0638-43a9-b8fb-e1f55529f242 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:get_project(project_id=39761f1cdb904e5fa8d0cfb8616a2ab9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:07.267980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fea05a-0638-43a9-b8fb-e1f55529f242 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:07.277564 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1637/3274] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:07 2022] GET /identity/v3/projects/39761f1cdb904e5fa8d0cfb8616a2ab9 => generated 369 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:08.167157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022ec8a-4843-414d-82ca-1a82cbecdf6e None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:08.167608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022ec8a-4843-414d-82ca-1a82cbecdf6e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:08.167697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022ec8a-4843-414d-82ca-1a82cbecdf6e None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:08.169214 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1638/3275] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:08.174769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fea05a-0638-43a9-b8fb-e1f55529f242 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:08.176509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-88fea05a-0638-43a9-b8fb-e1f55529f242 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:08.196044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fea05a-0638-43a9-b8fb-e1f55529f242 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:08.206815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fea05a-0638-43a9-b8fb-e1f55529f242 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:08.212247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc9488-9af0-4a33-9ffc-c2eff0365392 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:08.212964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc9488-9af0-4a33-9ffc-c2eff0365392 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:08.213377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc9488-9af0-4a33-9ffc-c2eff0365392 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:08.213655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc9488-9af0-4a33-9ffc-c2eff0365392 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/39761f1cdb904e5fa8d0cfb8616a2ab9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:08.224639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc9488-9af0-4a33-9ffc-c2eff0365392 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:get_project(project_id=39761f1cdb904e5fa8d0cfb8616a2ab9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:08.226820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc9488-9af0-4a33-9ffc-c2eff0365392 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:08.228712 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1638/3276] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:08 2022] GET /identity/v3/projects/39761f1cdb904e5fa8d0cfb8616a2ab9 => generated 369 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:08.272783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022ec8a-4843-414d-82ca-1a82cbecdf6e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:08.290574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022ec8a-4843-414d-82ca-1a82cbecdf6e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:08.297983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779a93c-5503-450b-b753-48dbf303af90 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:08.299443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779a93c-5503-450b-b753-48dbf303af90 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:08.299812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779a93c-5503-450b-b753-48dbf303af90 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:08.300314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779a93c-5503-450b-b753-48dbf303af90 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/users/48848d15097b4fac9cc0ca7e110c43ca` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:08.319735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779a93c-5503-450b-b753-48dbf303af90 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:delete_user(user_id=48848d15097b4fac9cc0ca7e110c43ca)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:08.321939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779a93c-5503-450b-b753-48dbf303af90 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:08.334611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:08.383615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4779a93c-5503-450b-b753-48dbf303af90 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48848d15097b4fac9cc0ca7e110c43ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:08.384721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4779a93c-5503-450b-b753-48dbf303af90 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48848d15097b4fac9cc0ca7e110c43ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:08.403259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4779a93c-5503-450b-b753-48dbf303af90 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48848d15097b4fac9cc0ca7e110c43ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:08.413594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4779a93c-5503-450b-b753-48dbf303af90 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48848d15097b4fac9cc0ca7e110c43ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:08.424403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4779a93c-5503-450b-b753-48dbf303af90 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48848d15097b4fac9cc0ca7e110c43ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:08.431770 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1639/3277] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:36:08 2022] DELETE /identity/v3/users/48848d15097b4fac9cc0ca7e110c43ca => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:08.436256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc9488-9af0-4a33-9ffc-c2eff0365392 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:08.438299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-59bc9488-9af0-4a33-9ffc-c2eff0365392 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:08.453872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc9488-9af0-4a33-9ffc-c2eff0365392 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:08.509782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:08.529755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:08.530554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:08.530900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:08.531181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/39761f1cdb904e5fa8d0cfb8616a2ab9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:08.532338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:delete_project(project_id=39761f1cdb904e5fa8d0cfb8616a2ab9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:08.535196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:08.593853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39761f1cdb904e5fa8d0cfb8616a2ab9', 'request_id': 'req-5bab2c63-52a7-40c3-933d-45f01d36c2dc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:08.602005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39761f1cdb904e5fa8d0cfb8616a2ab9', 'request_id': 'req-5bab2c63-52a7-40c3-933d-45f01d36c2dc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:08.613781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39761f1cdb904e5fa8d0cfb8616a2ab9', 'request_id': 'req-5bab2c63-52a7-40c3-933d-45f01d36c2dc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:08.629000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] The token cache is being invalidate because project 39761f1cdb904e5fa8d0cfb8616a2ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:08.629326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:08.631322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:08.633113 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1639/3278] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:08 2022] DELETE /identity/v3/projects/39761f1cdb904e5fa8d0cfb8616a2ab9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:08.651053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46ec54-069e-4aec-83ea-c789f943c617 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:08.651372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46ec54-069e-4aec-83ea-c789f943c617 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:08.651630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46ec54-069e-4aec-83ea-c789f943c617 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:08.653205 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1640/3279] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:08.659527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:08.661870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:08.768328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:08.769800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:08.843228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab2c63-52a7-40c3-933d-45f01d36c2dc tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:08.851296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3597f-5a38-4857-bd17-d5d431a9cc20 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:08.852024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3597f-5a38-4857-bd17-d5d431a9cc20 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:08.852689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3597f-5a38-4857-bd17-d5d431a9cc20 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:08.852969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3597f-5a38-4857-bd17-d5d431a9cc20 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/24dcbd2a5cee479988d82645ca00535c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:08.854442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3597f-5a38-4857-bd17-d5d431a9cc20 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:get_project(project_id=24dcbd2a5cee479988d82645ca00535c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:08.856709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3597f-5a38-4857-bd17-d5d431a9cc20 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:08.858852 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1640/3280] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:08 2022] GET /identity/v3/projects/24dcbd2a5cee479988d82645ca00535c => generated 375 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:08.895295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a869-a693-4f12-86e6-052afd89668d None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:08.896324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a869-a693-4f12-86e6-052afd89668d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:08.896324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a869-a693-4f12-86e6-052afd89668d None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:08.897999 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1641/3281] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:08.905085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3597f-5a38-4857-bd17-d5d431a9cc20 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:08.921915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3597f-5a38-4857-bd17-d5d431a9cc20 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:08.928289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:08.933821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3597f-5a38-4857-bd17-d5d431a9cc20 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:08.939603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb2248-56f4-4861-a890-701f777c48c3 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:08.940354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2248-56f4-4861-a890-701f777c48c3 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:08.940699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2248-56f4-4861-a890-701f777c48c3 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:08.940984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2248-56f4-4861-a890-701f777c48c3 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/24dcbd2a5cee479988d82645ca00535c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:08.942218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb2248-56f4-4861-a890-701f777c48c3 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:get_project(project_id=24dcbd2a5cee479988d82645ca00535c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:08.944474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb2248-56f4-4861-a890-701f777c48c3 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:08.946196 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1641/3282] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:08 2022] GET /identity/v3/projects/24dcbd2a5cee479988d82645ca00535c => generated 375 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:09.391707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965da9c-62fc-4264-bf85-f8253b1dbc61 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:09.393341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965da9c-62fc-4264-bf85-f8253b1dbc61 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:09.393848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965da9c-62fc-4264-bf85-f8253b1dbc61 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:09.397677 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1642/3283] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:09.405478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb2248-56f4-4861-a890-701f777c48c3 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:09.420817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb2248-56f4-4861-a890-701f777c48c3 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:09.431770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb2248-56f4-4861-a890-701f777c48c3 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:09.436717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fb396-4ae2-4b99-95bd-cf382e13b1d4 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a2fbc5003549f6bd6dc173f0cc3d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbe39e03703c4909a5a6081c351b6de4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:09.437492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fb396-4ae2-4b99-95bd-cf382e13b1d4 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:09.437842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fb396-4ae2-4b99-95bd-cf382e13b1d4 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:09.438186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fb396-4ae2-4b99-95bd-cf382e13b1d4 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] PATH_INFO: `/v3/projects/24dcbd2a5cee479988d82645ca00535c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:09.439407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fb396-4ae2-4b99-95bd-cf382e13b1d4 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorizing `identity:get_project(project_id=24dcbd2a5cee479988d82645ca00535c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:09.441576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fb396-4ae2-4b99-95bd-cf382e13b1d4 tempest-QuotasAdminTestJSON-1984626488 tempest-QuotasAdminTestJSON-1984626488-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:09.443488 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1642/3284] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:09 2022] GET /identity/v3/projects/24dcbd2a5cee479988d82645ca00535c => generated 375 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:36:09.782490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965da9c-62fc-4264-bf85-f8253b1dbc61 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:09.787508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f965da9c-62fc-4264-bf85-f8253b1dbc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:09.886526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965da9c-62fc-4264-bf85-f8253b1dbc61 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:09.891311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:09.891970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:09.892248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:09.892536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] PATH_INFO: `/v3/users/04388877a1d246bf8a5db955e97172f0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:09.893733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04388877a1d246bf8a5db955e97172f0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:09.895683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:09.958526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04388877a1d246bf8a5db955e97172f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:09.959890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04388877a1d246bf8a5db955e97172f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:09.995681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04388877a1d246bf8a5db955e97172f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:10.009024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04388877a1d246bf8a5db955e97172f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:10.019248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04388877a1d246bf8a5db955e97172f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:10.027467 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1643/3285] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:36:09 2022] DELETE /identity/v3/users/04388877a1d246bf8a5db955e97172f0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:36:10.032065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc379b-4bd7-40ed-a4ea-4f78720b76f8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:10.032343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc379b-4bd7-40ed-a4ea-4f78720b76f8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:10.032933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc379b-4bd7-40ed-a4ea-4f78720b76f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:10.058159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-32fc379b-4bd7-40ed-a4ea-4f78720b76f8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:10.059661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-32fc379b-4bd7-40ed-a4ea-4f78720b76f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:10.133168 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1643/3286] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:10.145221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:10.147109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:10.158349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:10.221230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379103e-9176-4d10-b556-bcf53703c256 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:10.224762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c37e51-a121-42f7-85b3-df4ba13407eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:10.225380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c37e51-a121-42f7-85b3-df4ba13407eb service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:10.225688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c37e51-a121-42f7-85b3-df4ba13407eb service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:10.225961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c37e51-a121-42f7-85b3-df4ba13407eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:10.235723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c37e51-a121-42f7-85b3-df4ba13407eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:10.237170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c37e51-a121-42f7-85b3-df4ba13407eb service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:10.248408 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1644/3287] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:11.003729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc379b-4bd7-40ed-a4ea-4f78720b76f8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:11.005250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-32fc379b-4bd7-40ed-a4ea-4f78720b76f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:11.030170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc379b-4bd7-40ed-a4ea-4f78720b76f8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:11.046844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:11.047911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:11.048195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:11.048468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] PATH_INFO: `/v3/projects/24dcbd2a5cee479988d82645ca00535c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:11.051023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=24dcbd2a5cee479988d82645ca00535c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:11.053865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:11.183856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24dcbd2a5cee479988d82645ca00535c', 'request_id': 'req-23758094-7d39-44ab-bc31-90a735dd7fdc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:11.201713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24dcbd2a5cee479988d82645ca00535c', 'request_id': 'req-23758094-7d39-44ab-bc31-90a735dd7fdc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:11.217827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24dcbd2a5cee479988d82645ca00535c', 'request_id': 'req-23758094-7d39-44ab-bc31-90a735dd7fdc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:11.252141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] The token cache is being invalidate because project 24dcbd2a5cee479988d82645ca00535c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:11.253288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:11.256364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:11.263095 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1644/3288] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:11 2022] DELETE /identity/v3/projects/24dcbd2a5cee479988d82645ca00535c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:11.264697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c37e51-a121-42f7-85b3-df4ba13407eb service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:11.280616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c37e51-a121-42f7-85b3-df4ba13407eb service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:11.416225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fc0b9-50e0-4464-8f7c-f5093d7b37bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:11.418554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc0b9-50e0-4464-8f7c-f5093d7b37bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:11.418948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc0b9-50e0-4464-8f7c-f5093d7b37bd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:11.419463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc0b9-50e0-4464-8f7c-f5093d7b37bd admin admin] PATH_INFO: `/v3/users/89a2fbc5003549f6bd6dc173f0cc3d05` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:11.423555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fc0b9-50e0-4464-8f7c-f5093d7b37bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a2fbc5003549f6bd6dc173f0cc3d05)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:11.428114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fc0b9-50e0-4464-8f7c-f5093d7b37bd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:11.517371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b96fc0b9-50e0-4464-8f7c-f5093d7b37bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a2fbc5003549f6bd6dc173f0cc3d05'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:11.518251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b96fc0b9-50e0-4464-8f7c-f5093d7b37bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a2fbc5003549f6bd6dc173f0cc3d05'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:11.539936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b96fc0b9-50e0-4464-8f7c-f5093d7b37bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a2fbc5003549f6bd6dc173f0cc3d05'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:11.561764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b96fc0b9-50e0-4464-8f7c-f5093d7b37bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a2fbc5003549f6bd6dc173f0cc3d05'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:11.598655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b96fc0b9-50e0-4464-8f7c-f5093d7b37bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a2fbc5003549f6bd6dc173f0cc3d05'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:11.627339 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1645/3289] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:36:11 2022] DELETE /identity/v3/users/89a2fbc5003549f6bd6dc173f0cc3d05 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:12.861523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:12.863530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:12.886129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23758094-7d39-44ab-bc31-90a735dd7fdc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:13.063311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:13.064491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:13.065012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:13.065475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] PATH_INFO: `/v3/projects/bbe39e03703c4909a5a6081c351b6de4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:13.069102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe39e03703c4909a5a6081c351b6de4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:13.071710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:13.110903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:13.168342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe39e03703c4909a5a6081c351b6de4', 'request_id': 'req-13878d65-ce1a-4ee2-b923-39630bda0b8a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:13.180571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe39e03703c4909a5a6081c351b6de4', 'request_id': 'req-13878d65-ce1a-4ee2-b923-39630bda0b8a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:13.200953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe39e03703c4909a5a6081c351b6de4', 'request_id': 'req-13878d65-ce1a-4ee2-b923-39630bda0b8a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:13.220243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] The token cache is being invalidate because project bbe39e03703c4909a5a6081c351b6de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:13.220589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:13.221447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13878d65-ce1a-4ee2-b923-39630bda0b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:13.223373 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1645/3290] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:12 2022] DELETE /identity/v3/projects/bbe39e03703c4909a5a6081c351b6de4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:13.232929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0018df1-fe3b-4008-8c15-200b73998c2b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:13.233597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0018df1-fe3b-4008-8c15-200b73998c2b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:13.233782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0018df1-fe3b-4008-8c15-200b73998c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:13.263099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a0018df1-fe3b-4008-8c15-200b73998c2b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:13.264413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a0018df1-fe3b-4008-8c15-200b73998c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:13.303747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:13.366133 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1646/3291] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:13.377089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940f459-c77e-4742-8708-cefde6cd43cb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:13.377492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940f459-c77e-4742-8708-cefde6cd43cb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:13.378034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940f459-c77e-4742-8708-cefde6cd43cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:13.416289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5940f459-c77e-4742-8708-cefde6cd43cb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:13.417600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5940f459-c77e-4742-8708-cefde6cd43cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:13.427292 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1646/3292] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:13.432554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0018df1-fe3b-4008-8c15-200b73998c2b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:13.448927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0018df1-fe3b-4008-8c15-200b73998c2b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:13.455358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61993264-b046-47e4-84b1-673b53cbd0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:13.456294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61993264-b046-47e4-84b1-673b53cbd0da admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:13.456699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61993264-b046-47e4-84b1-673b53cbd0da admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:13.457432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61993264-b046-47e4-84b1-673b53cbd0da admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:13.458085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61993264-b046-47e4-84b1-673b53cbd0da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:13.459089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61993264-b046-47e4-84b1-673b53cbd0da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:13.461171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61993264-b046-47e4-84b1-673b53cbd0da admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:13.480002 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1647/3293] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:13.485257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940f459-c77e-4742-8708-cefde6cd43cb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:13.497097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940f459-c77e-4742-8708-cefde6cd43cb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:13.508270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c019d-5db3-4c7b-a3d7-ccb7af055b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:13.509004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c019d-5db3-4c7b-a3d7-ccb7af055b49 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:13.510093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c019d-5db3-4c7b-a3d7-ccb7af055b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:13.510402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c019d-5db3-4c7b-a3d7-ccb7af055b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:13.511173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c019d-5db3-4c7b-a3d7-ccb7af055b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:13.514028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c019d-5db3-4c7b-a3d7-ccb7af055b49 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:13.566786 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1647/3294] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:13 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:13.568250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61993264-b046-47e4-84b1-673b53cbd0da admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:13.583029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61993264-b046-47e4-84b1-673b53cbd0da admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:13.670017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e677-16fe-4e28-8fb7-83c89124d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:13.670731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e677-16fe-4e28-8fb7-83c89124d644 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:13.671320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e677-16fe-4e28-8fb7-83c89124d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:13.671495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e677-16fe-4e28-8fb7-83c89124d644 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:13.672231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4e677-16fe-4e28-8fb7-83c89124d644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:13.674445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4e677-16fe-4e28-8fb7-83c89124d644 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:13.710355 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1648/3295] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:13 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:36:13.714964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c019d-5db3-4c7b-a3d7-ccb7af055b49 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:13.726883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c019d-5db3-4c7b-a3d7-ccb7af055b49 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:13.732889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c24de-07c7-46e1-97af-bbfe8de91a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:13.733558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c24de-07c7-46e1-97af-bbfe8de91a3a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:13.734054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c24de-07c7-46e1-97af-bbfe8de91a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:13.734184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c24de-07c7-46e1-97af-bbfe8de91a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:13.734758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c24de-07c7-46e1-97af-bbfe8de91a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:13.737120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c24de-07c7-46e1-97af-bbfe8de91a3a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:13.750981 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1648/3296] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:13.755971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e677-16fe-4e28-8fb7-83c89124d644 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:13.770271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e677-16fe-4e28-8fb7-83c89124d644 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:13.776553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7770a-70ba-4996-a544-15ea900949d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:13.777549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7770a-70ba-4996-a544-15ea900949d5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:13.777849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7770a-70ba-4996-a544-15ea900949d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:13.778358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7770a-70ba-4996-a544-15ea900949d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:13.779110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7770a-70ba-4996-a544-15ea900949d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:13.781018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7770a-70ba-4996-a544-15ea900949d5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:13.797418 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1649/3297] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:13.802651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c24de-07c7-46e1-97af-bbfe8de91a3a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:13.814094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c24de-07c7-46e1-97af-bbfe8de91a3a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:13.820081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108405d-ebc6-4801-916e-40d7dc9503d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:13.820846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108405d-ebc6-4801-916e-40d7dc9503d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:13.821228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108405d-ebc6-4801-916e-40d7dc9503d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:13.821618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108405d-ebc6-4801-916e-40d7dc9503d3 admin admin] PATH_INFO: `/v3/projects/b8bc1721e94d41edb24ff9027d20490e/users/3f22459d2aa34cd0a982bbd32afb1588/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:13.839346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108405d-ebc6-4801-916e-40d7dc9503d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bc1721e94d41edb24ff9027d20490e, user_id=3f22459d2aa34cd0a982bbd32afb1588, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:13.843740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108405d-ebc6-4801-916e-40d7dc9503d3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:13.861860 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1649/3298] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:13 2022] PUT /identity/v3/projects/b8bc1721e94d41edb24ff9027d20490e/users/3f22459d2aa34cd0a982bbd32afb1588/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:13.878513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea9d77-3aa0-4b28-8806-30113e24012f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:13.878877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea9d77-3aa0-4b28-8806-30113e24012f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:13.879103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea9d77-3aa0-4b28-8806-30113e24012f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:13.938054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-daea9d77-3aa0-4b28-8806-30113e24012f None None] MFA Rules not processed for user `3f22459d2aa34cd0a982bbd32afb1588`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:13.940683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-daea9d77-3aa0-4b28-8806-30113e24012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:14.075852 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1650/3299] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:14.081619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108405d-ebc6-4801-916e-40d7dc9503d3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:14.171020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108405d-ebc6-4801-916e-40d7dc9503d3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:14.183169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72c3be-362e-42c3-903c-efbb93902b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:14.184008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c3be-362e-42c3-903c-efbb93902b9a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:14.184646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c3be-362e-42c3-903c-efbb93902b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:14.185079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c3be-362e-42c3-903c-efbb93902b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:14.185901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72c3be-362e-42c3-903c-efbb93902b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:14.188196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72c3be-362e-42c3-903c-efbb93902b9a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:14.223090 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1650/3300] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:14 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:14.224841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea9d77-3aa0-4b28-8806-30113e24012f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:14.243096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea9d77-3aa0-4b28-8806-30113e24012f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:14.266294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:14.326264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9ffbf-2e67-4b10-a471-217369dafb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:14.327167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9ffbf-2e67-4b10-a471-217369dafb89 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:14.327506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9ffbf-2e67-4b10-a471-217369dafb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:14.327997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9ffbf-2e67-4b10-a471-217369dafb89 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:14.328788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9ffbf-2e67-4b10-a471-217369dafb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:14.331132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9ffbf-2e67-4b10-a471-217369dafb89 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:14.369756 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1651/3301] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:14 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:14.371019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72c3be-362e-42c3-903c-efbb93902b9a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:14.383018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72c3be-362e-42c3-903c-efbb93902b9a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:14.390375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e33938-5f04-42f8-a060-ec9197fd83aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:14.391230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e33938-5f04-42f8-a060-ec9197fd83aa admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:14.391733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e33938-5f04-42f8-a060-ec9197fd83aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:14.392216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e33938-5f04-42f8-a060-ec9197fd83aa admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:14.393058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e33938-5f04-42f8-a060-ec9197fd83aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:14.399095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e33938-5f04-42f8-a060-ec9197fd83aa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:14.416880 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1651/3302] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:36:14.418530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9ffbf-2e67-4b10-a471-217369dafb89 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:14.450604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9ffbf-2e67-4b10-a471-217369dafb89 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:14.457850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c95de-196b-4015-9138-db3147c42c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:14.459194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c95de-196b-4015-9138-db3147c42c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:14.459194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c95de-196b-4015-9138-db3147c42c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:14.460035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c95de-196b-4015-9138-db3147c42c32 admin admin] PATH_INFO: `/v3/projects/48dcc9825a5c4207a8da8b6f0af3b757/users/e1e1a7cb4aed43e5a74fa44890ab90c6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:14.491152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c95de-196b-4015-9138-db3147c42c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48dcc9825a5c4207a8da8b6f0af3b757, user_id=e1e1a7cb4aed43e5a74fa44890ab90c6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:14.494989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c95de-196b-4015-9138-db3147c42c32 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:14.534979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e33938-5f04-42f8-a060-ec9197fd83aa admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:14.545890 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1652/3303] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:14 2022] PUT /identity/v3/projects/48dcc9825a5c4207a8da8b6f0af3b757/users/e1e1a7cb4aed43e5a74fa44890ab90c6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:36:14.552018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e33938-5f04-42f8-a060-ec9197fd83aa admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:14.570597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:14.651228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d6641-ef6a-43f6-9213-b8ebda469a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:14.652189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d6641-ef6a-43f6-9213-b8ebda469a5b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:14.652569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d6641-ef6a-43f6-9213-b8ebda469a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:14.654785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d6641-ef6a-43f6-9213-b8ebda469a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:14.656665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d6641-ef6a-43f6-9213-b8ebda469a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:14.658975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d6641-ef6a-43f6-9213-b8ebda469a5b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:14.675265 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1652/3304] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:14.680232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c95de-196b-4015-9138-db3147c42c32 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:14.696595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c95de-196b-4015-9138-db3147c42c32 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:14.704984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498cd3d-8d4f-4959-a814-561224453119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:14.705965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498cd3d-8d4f-4959-a814-561224453119 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:14.706348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498cd3d-8d4f-4959-a814-561224453119 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:14.706956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498cd3d-8d4f-4959-a814-561224453119 admin admin] PATH_INFO: `/v3/projects/48dcc9825a5c4207a8da8b6f0af3b757/users/e1e1a7cb4aed43e5a74fa44890ab90c6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:14.725224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498cd3d-8d4f-4959-a814-561224453119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48dcc9825a5c4207a8da8b6f0af3b757, user_id=e1e1a7cb4aed43e5a74fa44890ab90c6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:14.735635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498cd3d-8d4f-4959-a814-561224453119 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:14.788735 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1653/3305] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:14 2022] PUT /identity/v3/projects/48dcc9825a5c4207a8da8b6f0af3b757/users/e1e1a7cb4aed43e5a74fa44890ab90c6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:36:14.795935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b239961-5928-48a1-a76c-f44d18949e70 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:14.796355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b239961-5928-48a1-a76c-f44d18949e70 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:14.796734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b239961-5928-48a1-a76c-f44d18949e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:14.854832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5b239961-5928-48a1-a76c-f44d18949e70 None None] MFA Rules not processed for user `e1e1a7cb4aed43e5a74fa44890ab90c6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:14.856932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5b239961-5928-48a1-a76c-f44d18949e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:14.986473 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1653/3306] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:15.242873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498cd3d-8d4f-4959-a814-561224453119 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:15.245215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b498cd3d-8d4f-4959-a814-561224453119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:15.372561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498cd3d-8d4f-4959-a814-561224453119 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:15.386258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be12e4a-822b-4215-b66d-2d82680ae9e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:15.387147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be12e4a-822b-4215-b66d-2d82680ae9e6 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:15.387581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be12e4a-822b-4215-b66d-2d82680ae9e6 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:15.388008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be12e4a-822b-4215-b66d-2d82680ae9e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:15.401047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be12e4a-822b-4215-b66d-2d82680ae9e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:15.403557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be12e4a-822b-4215-b66d-2d82680ae9e6 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:15.417929 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1654/3307] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:15.434487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df52928-0994-4617-ba37-736d3e3b00ea None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:15.434979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df52928-0994-4617-ba37-736d3e3b00ea None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:15.435396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df52928-0994-4617-ba37-736d3e3b00ea None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:15.437685 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1654/3308] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:15.444961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be12e4a-822b-4215-b66d-2d82680ae9e6 service nova] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:15.459286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be12e4a-822b-4215-b66d-2d82680ae9e6 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:15.469877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be12e4a-822b-4215-b66d-2d82680ae9e6 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:15.476057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebab86e-947a-4ce2-bc99-4e2c6fea0c23 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e1a7cb4aed43e5a74fa44890ab90c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dcc9825a5c4207a8da8b6f0af3b757', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:15.477123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebab86e-947a-4ce2-bc99-4e2c6fea0c23 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:15.477650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebab86e-947a-4ce2-bc99-4e2c6fea0c23 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:15.478071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebab86e-947a-4ce2-bc99-4e2c6fea0c23 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] PATH_INFO: `/v3/projects/b8bc1721e94d41edb24ff9027d20490e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:15.479440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebab86e-947a-4ce2-bc99-4e2c6fea0c23 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8bc1721e94d41edb24ff9027d20490e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:15.481890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebab86e-947a-4ce2-bc99-4e2c6fea0c23 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:15.497163 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1655/3309] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:15 2022] GET /identity/v3/projects/b8bc1721e94d41edb24ff9027d20490e => generated 383 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:15.851119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30014-b328-481e-b7fa-388ac1b22456 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:15.851403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30014-b328-481e-b7fa-388ac1b22456 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:15.851683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30014-b328-481e-b7fa-388ac1b22456 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:15.853017 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1655/3310] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:15.858025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebab86e-947a-4ce2-bc99-4e2c6fea0c23 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:15.872348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebab86e-947a-4ce2-bc99-4e2c6fea0c23 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:15.882480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebab86e-947a-4ce2-bc99-4e2c6fea0c23 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:15.887114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa041f-26d6-4dae-a553-2101d6d3d31e tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e1a7cb4aed43e5a74fa44890ab90c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dcc9825a5c4207a8da8b6f0af3b757', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:15.887814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa041f-26d6-4dae-a553-2101d6d3d31e tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:15.888087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa041f-26d6-4dae-a553-2101d6d3d31e tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:15.888357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa041f-26d6-4dae-a553-2101d6d3d31e tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] PATH_INFO: `/v3/projects/b8bc1721e94d41edb24ff9027d20490e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:15.889504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa041f-26d6-4dae-a553-2101d6d3d31e tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8bc1721e94d41edb24ff9027d20490e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:15.891548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa041f-26d6-4dae-a553-2101d6d3d31e tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:15.894047 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1656/3311] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:15 2022] GET /identity/v3/projects/b8bc1721e94d41edb24ff9027d20490e => generated 383 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:15.982835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e827e-5f6b-4b4b-b69a-17ac01baea14 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:15.982835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e827e-5f6b-4b4b-b69a-17ac01baea14 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:15.982835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e827e-5f6b-4b4b-b69a-17ac01baea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:16.002589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0b2e827e-5f6b-4b4b-b69a-17ac01baea14 None None] MFA Rules not processed for user `3f22459d2aa34cd0a982bbd32afb1588`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:16.004614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0b2e827e-5f6b-4b4b-b69a-17ac01baea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:16.073283 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1656/3312] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:36:16.140748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa041f-26d6-4dae-a553-2101d6d3d31e tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:16.154335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa041f-26d6-4dae-a553-2101d6d3d31e tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:16.159981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba136-2243-4767-bedf-d7db5022810d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:16.160677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba136-2243-4767-bedf-d7db5022810d service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:16.161026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba136-2243-4767-bedf-d7db5022810d service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:16.161726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba136-2243-4767-bedf-d7db5022810d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:16.170095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ba136-2243-4767-bedf-d7db5022810d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:16.171944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ba136-2243-4767-bedf-d7db5022810d service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:16.181948 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1657/3313] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:16.548217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf573b9-acf2-40a2-96e4-e67df3cd722b None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:16.548527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf573b9-acf2-40a2-96e4-e67df3cd722b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:16.548810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf573b9-acf2-40a2-96e4-e67df3cd722b None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:16.550176 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1657/3314] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:16.556189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba136-2243-4767-bedf-d7db5022810d service nova] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:16.567305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba136-2243-4767-bedf-d7db5022810d service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:16.577042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba136-2243-4767-bedf-d7db5022810d service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:16.581860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dc5b0-5945-442d-a486-7ae9a183499a tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e1a7cb4aed43e5a74fa44890ab90c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dcc9825a5c4207a8da8b6f0af3b757', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:16.582570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dc5b0-5945-442d-a486-7ae9a183499a tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:16.582950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dc5b0-5945-442d-a486-7ae9a183499a tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:16.583289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dc5b0-5945-442d-a486-7ae9a183499a tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] PATH_INFO: `/v3/projects/b8bc1721e94d41edb24ff9027d20490e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:16.584492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dc5b0-5945-442d-a486-7ae9a183499a tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8bc1721e94d41edb24ff9027d20490e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:16.586644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dc5b0-5945-442d-a486-7ae9a183499a tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:16.588543 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1658/3315] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:16 2022] GET /identity/v3/projects/b8bc1721e94d41edb24ff9027d20490e => generated 383 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:16.688459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1da73-5921-4efe-aee0-b0af6c8ccd61 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:16.688744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1da73-5921-4efe-aee0-b0af6c8ccd61 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:16.689031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1da73-5921-4efe-aee0-b0af6c8ccd61 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:16.690397 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1658/3316] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:16.695727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dc5b0-5945-442d-a486-7ae9a183499a tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:16.712593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dc5b0-5945-442d-a486-7ae9a183499a tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:16.722879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dc5b0-5945-442d-a486-7ae9a183499a tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:16.728324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987005b-c797-47df-b1da-85a9315bb666 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e1a7cb4aed43e5a74fa44890ab90c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dcc9825a5c4207a8da8b6f0af3b757', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:16.729007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987005b-c797-47df-b1da-85a9315bb666 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:16.729284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987005b-c797-47df-b1da-85a9315bb666 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:16.729643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987005b-c797-47df-b1da-85a9315bb666 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] PATH_INFO: `/v3/projects/b8bc1721e94d41edb24ff9027d20490e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:16.730732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987005b-c797-47df-b1da-85a9315bb666 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8bc1721e94d41edb24ff9027d20490e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:16.732787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987005b-c797-47df-b1da-85a9315bb666 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:16.734622 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1659/3317] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:16 2022] GET /identity/v3/projects/b8bc1721e94d41edb24ff9027d20490e => generated 383 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:16.775220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeed2d-325a-43f2-acdd-1282e1f61d1e None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:16.775503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeed2d-325a-43f2-acdd-1282e1f61d1e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:16.775778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeed2d-325a-43f2-acdd-1282e1f61d1e None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:16.777129 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1659/3318] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:16.781864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987005b-c797-47df-b1da-85a9315bb666 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:16.796022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987005b-c797-47df-b1da-85a9315bb666 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:16.805506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987005b-c797-47df-b1da-85a9315bb666 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:16.810533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede309a0-ebaf-47b4-affa-5560c328c3e1 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e1a7cb4aed43e5a74fa44890ab90c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dcc9825a5c4207a8da8b6f0af3b757', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:16.811220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede309a0-ebaf-47b4-affa-5560c328c3e1 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:16.811505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede309a0-ebaf-47b4-affa-5560c328c3e1 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:16.811786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede309a0-ebaf-47b4-affa-5560c328c3e1 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] PATH_INFO: `/v3/projects/b8bc1721e94d41edb24ff9027d20490e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:16.813026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede309a0-ebaf-47b4-affa-5560c328c3e1 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8bc1721e94d41edb24ff9027d20490e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:16.815110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede309a0-ebaf-47b4-affa-5560c328c3e1 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:16.816959 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1660/3319] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:16 2022] GET /identity/v3/projects/b8bc1721e94d41edb24ff9027d20490e => generated 383 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:16.899219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e680-1514-4054-8411-cab20a3dfcd1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:16.899755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e680-1514-4054-8411-cab20a3dfcd1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:16.900297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e680-1514-4054-8411-cab20a3dfcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:16.922233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-28c1e680-1514-4054-8411-cab20a3dfcd1 None None] MFA Rules not processed for user `3f22459d2aa34cd0a982bbd32afb1588`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:16.923506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-28c1e680-1514-4054-8411-cab20a3dfcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:16.930818 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1660/3320] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:17.357368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede309a0-ebaf-47b4-affa-5560c328c3e1 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:17.365787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:17.372013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede309a0-ebaf-47b4-affa-5560c328c3e1 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:17.378295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de85db-49b2-4c1c-b3bf-42ce669b7dd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:17.378976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de85db-49b2-4c1c-b3bf-42ce669b7dd6 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:17.379252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de85db-49b2-4c1c-b3bf-42ce669b7dd6 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:17.379618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de85db-49b2-4c1c-b3bf-42ce669b7dd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:17.382089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e4de85db-49b2-4c1c-b3bf-42ce669b7dd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:17.435421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113ecb7-7010-49dd-915f-1d9fb4af5bc5 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:17.435922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113ecb7-7010-49dd-915f-1d9fb4af5bc5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:17.436044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113ecb7-7010-49dd-915f-1d9fb4af5bc5 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:17.437293 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1661/3321] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:36:17.442077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113ecb7-7010-49dd-915f-1d9fb4af5bc5 None None] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:17.444410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e113ecb7-7010-49dd-915f-1d9fb4af5bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:17.453320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de85db-49b2-4c1c-b3bf-42ce669b7dd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:17.455652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de85db-49b2-4c1c-b3bf-42ce669b7dd6 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:17.463977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113ecb7-7010-49dd-915f-1d9fb4af5bc5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:17.465776 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1661/3322] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:17.474982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113ecb7-7010-49dd-915f-1d9fb4af5bc5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:17.480694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4b917-31bd-42c4-8c31-315a5c268fe4 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e1a7cb4aed43e5a74fa44890ab90c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dcc9825a5c4207a8da8b6f0af3b757', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:17.481341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4b917-31bd-42c4-8c31-315a5c268fe4 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:17.481657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4b917-31bd-42c4-8c31-315a5c268fe4 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:17.481931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4b917-31bd-42c4-8c31-315a5c268fe4 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] PATH_INFO: `/v3/projects/b8bc1721e94d41edb24ff9027d20490e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:17.483117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4b917-31bd-42c4-8c31-315a5c268fe4 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8bc1721e94d41edb24ff9027d20490e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:17.485174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4b917-31bd-42c4-8c31-315a5c268fe4 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:17.488272 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1662/3323] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:17 2022] GET /identity/v3/projects/b8bc1721e94d41edb24ff9027d20490e => generated 383 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:36:17.759293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3843192-bbc6-44c3-bbd0-90435126b1c8 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:17.759771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3843192-bbc6-44c3-bbd0-90435126b1c8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:17.760684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3843192-bbc6-44c3-bbd0-90435126b1c8 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:17.762715 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1662/3324] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:17.770638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4b917-31bd-42c4-8c31-315a5c268fe4 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:17.797462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4b917-31bd-42c4-8c31-315a5c268fe4 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:17.810711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4b917-31bd-42c4-8c31-315a5c268fe4 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:17.817640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025a541-3892-4ca4-bb4b-9f8047d9980d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e1a7cb4aed43e5a74fa44890ab90c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dcc9825a5c4207a8da8b6f0af3b757', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:17.818973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025a541-3892-4ca4-bb4b-9f8047d9980d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:17.819283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025a541-3892-4ca4-bb4b-9f8047d9980d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:17.819840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025a541-3892-4ca4-bb4b-9f8047d9980d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] PATH_INFO: `/v3/projects/b8bc1721e94d41edb24ff9027d20490e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:17.820702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025a541-3892-4ca4-bb4b-9f8047d9980d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8bc1721e94d41edb24ff9027d20490e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:17.822774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025a541-3892-4ca4-bb4b-9f8047d9980d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:17.824476 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1663/3325] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:17 2022] GET /identity/v3/projects/b8bc1721e94d41edb24ff9027d20490e => generated 383 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:36:17.874308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfed4cd-8e20-4637-8e8f-8443d59e7a75 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:17.874888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfed4cd-8e20-4637-8e8f-8443d59e7a75 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:17.875166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfed4cd-8e20-4637-8e8f-8443d59e7a75 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:17.876545 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1663/3326] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:36:17.882604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025a541-3892-4ca4-bb4b-9f8047d9980d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:17.899694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025a541-3892-4ca4-bb4b-9f8047d9980d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:17.909035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025a541-3892-4ca4-bb4b-9f8047d9980d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:17.914820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d79351-8fab-4983-b954-1b8d803542d2 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e1a7cb4aed43e5a74fa44890ab90c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dcc9825a5c4207a8da8b6f0af3b757', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:17.915441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d79351-8fab-4983-b954-1b8d803542d2 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:17.915889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d79351-8fab-4983-b954-1b8d803542d2 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:17.916161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d79351-8fab-4983-b954-1b8d803542d2 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] PATH_INFO: `/v3/projects/b8bc1721e94d41edb24ff9027d20490e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:17.917284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d79351-8fab-4983-b954-1b8d803542d2 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8bc1721e94d41edb24ff9027d20490e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:17.919366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d79351-8fab-4983-b954-1b8d803542d2 tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:17.921178 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1664/3327] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:17 2022] GET /identity/v3/projects/b8bc1721e94d41edb24ff9027d20490e => generated 383 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:17.922893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe841d10-22c0-4b06-be36-9ee8ba8beccf None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:17.923183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe841d10-22c0-4b06-be36-9ee8ba8beccf None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:17.923464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe841d10-22c0-4b06-be36-9ee8ba8beccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:17.951003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fe841d10-22c0-4b06-be36-9ee8ba8beccf None None] MFA Rules not processed for user `0b9bbdf34e904843ab7cd7b40bf3720d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:17.952543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fe841d10-22c0-4b06-be36-9ee8ba8beccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:18.012712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b640f0-c0c4-49f5-9329-12635148709b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:18.013223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b640f0-c0c4-49f5-9329-12635148709b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:18.013531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b640f0-c0c4-49f5-9329-12635148709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:18.015000 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1664/3328] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:18.035542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-56b640f0-c0c4-49f5-9329-12635148709b None None] MFA Rules not processed for user `3f22459d2aa34cd0a982bbd32afb1588`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:18.037764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-56b640f0-c0c4-49f5-9329-12635148709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:18.047535 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1665/3329] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:18.799930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe841d10-22c0-4b06-be36-9ee8ba8beccf None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:18.801368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fe841d10-22c0-4b06-be36-9ee8ba8beccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:18.852534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb65f6-3389-490c-a4cb-9817080ca653 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:18.853787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb65f6-3389-490c-a4cb-9817080ca653 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:18.854177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb65f6-3389-490c-a4cb-9817080ca653 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:18.855988 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1666/3330] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:36:18.862111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb65f6-3389-490c-a4cb-9817080ca653 None None] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:36:18.874001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:18.894208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb65f6-3389-490c-a4cb-9817080ca653 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:18.916536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb65f6-3389-490c-a4cb-9817080ca653 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:18.929084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193c097-997c-4198-8388-17920d94959d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e1a7cb4aed43e5a74fa44890ab90c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dcc9825a5c4207a8da8b6f0af3b757', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:18.929752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193c097-997c-4198-8388-17920d94959d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:18.932281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193c097-997c-4198-8388-17920d94959d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:18.933375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193c097-997c-4198-8388-17920d94959d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] PATH_INFO: `/v3/projects/b8bc1721e94d41edb24ff9027d20490e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:18.934940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193c097-997c-4198-8388-17920d94959d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8bc1721e94d41edb24ff9027d20490e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:18.937234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193c097-997c-4198-8388-17920d94959d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:18.939874 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1667/3331] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:36:18 2022] GET /identity/v3/projects/b8bc1721e94d41edb24ff9027d20490e => generated 383 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:18.949638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe841d10-22c0-4b06-be36-9ee8ba8beccf None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:18.957006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4732e6-ba12-435d-a5e3-005ec1c1ca18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:18.958097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4732e6-ba12-435d-a5e3-005ec1c1ca18 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:18.958445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4732e6-ba12-435d-a5e3-005ec1c1ca18 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:18.958723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4732e6-ba12-435d-a5e3-005ec1c1ca18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:18.961118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5f4732e6-ba12-435d-a5e3-005ec1c1ca18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:18.974788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4732e6-ba12-435d-a5e3-005ec1c1ca18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:18.977295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4732e6-ba12-435d-a5e3-005ec1c1ca18 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:19.001145 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1665/3332] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:19.108043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193c097-997c-4198-8388-17920d94959d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:19.132768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193c097-997c-4198-8388-17920d94959d tempest-QuotasAdminNegativeTest-2097242887 tempest-QuotasAdminNegativeTest-2097242887-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:19.152146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e377d91-ec55-4505-934f-8c26870c8d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:19.153069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377d91-ec55-4505-934f-8c26870c8d10 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:19.153379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377d91-ec55-4505-934f-8c26870c8d10 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:19.153758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377d91-ec55-4505-934f-8c26870c8d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:19.163630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1e377d91-ec55-4505-934f-8c26870c8d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:19.185656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e377d91-ec55-4505-934f-8c26870c8d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:19.194968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4732e6-ba12-435d-a5e3-005ec1c1ca18 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:19.198177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e377d91-ec55-4505-934f-8c26870c8d10 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:19.219149 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1668/3333] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:19.295777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:19.406301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4732e6-ba12-435d-a5e3-005ec1c1ca18 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:19.420238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:19.421375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:19.422089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:19.424240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] PATH_INFO: `/v3/users/3f22459d2aa34cd0a982bbd32afb1588` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:19.426878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f22459d2aa34cd0a982bbd32afb1588)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:19.432934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:19.526399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f22459d2aa34cd0a982bbd32afb1588'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:19.527143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f22459d2aa34cd0a982bbd32afb1588'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:19.557785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f22459d2aa34cd0a982bbd32afb1588'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:19.567595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f22459d2aa34cd0a982bbd32afb1588'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:19.577862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f22459d2aa34cd0a982bbd32afb1588'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:19.584795 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1666/3334] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:36:19 2022] DELETE /identity/v3/users/3f22459d2aa34cd0a982bbd32afb1588 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:19.589505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a28e6-a51e-47fe-ac83-21a48c3b4829 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:19.589783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a28e6-a51e-47fe-ac83-21a48c3b4829 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:19.590218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a28e6-a51e-47fe-ac83-21a48c3b4829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:19.611648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-299a28e6-a51e-47fe-ac83-21a48c3b4829 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:19.612883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-299a28e6-a51e-47fe-ac83-21a48c3b4829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:19.695355 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1669/3335] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:19.706415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:19.708259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:19.790488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c1247-16d7-4250-b033-5987d6607d23 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:19.795186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6aba1-3dc8-4870-89a2-b0d467c59f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:19.796244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6aba1-3dc8-4870-89a2-b0d467c59f73 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:19.796544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6aba1-3dc8-4870-89a2-b0d467c59f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:19.796822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6aba1-3dc8-4870-89a2-b0d467c59f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:19.809318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6aba1-3dc8-4870-89a2-b0d467c59f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:19.812235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6aba1-3dc8-4870-89a2-b0d467c59f73 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:19.829729 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1667/3336] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:36:20.491202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a28e6-a51e-47fe-ac83-21a48c3b4829 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:20.498227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-299a28e6-a51e-47fe-ac83-21a48c3b4829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:20.528512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a28e6-a51e-47fe-ac83-21a48c3b4829 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:20.545238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:20.547058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:20.547340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:20.547612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] PATH_INFO: `/v3/projects/b8bc1721e94d41edb24ff9027d20490e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:20.553828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8bc1721e94d41edb24ff9027d20490e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:20.562006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:20.663176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8bc1721e94d41edb24ff9027d20490e', 'request_id': 'req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:20.670960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8bc1721e94d41edb24ff9027d20490e', 'request_id': 'req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:20.681047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8bc1721e94d41edb24ff9027d20490e', 'request_id': 'req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:20.697485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] The token cache is being invalidate because project b8bc1721e94d41edb24ff9027d20490e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:20.698068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:20.698955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:20.701294 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1670/3337] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:20 2022] DELETE /identity/v3/projects/b8bc1721e94d41edb24ff9027d20490e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:20.706363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6aba1-3dc8-4870-89a2-b0d467c59f73 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:20.720261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6aba1-3dc8-4870-89a2-b0d467c59f73 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:20.799579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:20.810917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c27f9a-3a0e-435c-b4b4-23ca42ba8cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:20.811809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c27f9a-3a0e-435c-b4b4-23ca42ba8cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:20.812704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c27f9a-3a0e-435c-b4b4-23ca42ba8cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:20.813161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c27f9a-3a0e-435c-b4b4-23ca42ba8cd9 admin admin] PATH_INFO: `/v3/users/e1e1a7cb4aed43e5a74fa44890ab90c6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:20.817073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c27f9a-3a0e-435c-b4b4-23ca42ba8cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e1a7cb4aed43e5a74fa44890ab90c6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:20.819941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c27f9a-3a0e-435c-b4b4-23ca42ba8cd9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:20.893378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-25c27f9a-3a0e-435c-b4b4-23ca42ba8cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e1a7cb4aed43e5a74fa44890ab90c6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:20.894268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-25c27f9a-3a0e-435c-b4b4-23ca42ba8cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e1a7cb4aed43e5a74fa44890ab90c6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:20.909109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-25c27f9a-3a0e-435c-b4b4-23ca42ba8cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e1a7cb4aed43e5a74fa44890ab90c6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:20.919716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-25c27f9a-3a0e-435c-b4b4-23ca42ba8cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e1a7cb4aed43e5a74fa44890ab90c6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:20.932870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-25c27f9a-3a0e-435c-b4b4-23ca42ba8cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e1a7cb4aed43e5a74fa44890ab90c6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:20.943227 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1668/3338] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:36:20 2022] DELETE /identity/v3/users/e1e1a7cb4aed43e5a74fa44890ab90c6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:21.281427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:21.283333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:21.300396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67366c7-fb92-439d-a0f0-1c27cf5a2c00 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:21.385644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:21.386358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:21.386703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:21.386987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] PATH_INFO: `/v3/projects/48dcc9825a5c4207a8da8b6f0af3b757` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:21.388287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=48dcc9825a5c4207a8da8b6f0af3b757)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:21.391345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:21.402925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:21.467703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48dcc9825a5c4207a8da8b6f0af3b757', 'request_id': 'req-62cc89a3-ad5c-416e-ad9e-58d661015c0e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:21.477283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48dcc9825a5c4207a8da8b6f0af3b757', 'request_id': 'req-62cc89a3-ad5c-416e-ad9e-58d661015c0e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:21.488833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48dcc9825a5c4207a8da8b6f0af3b757', 'request_id': 'req-62cc89a3-ad5c-416e-ad9e-58d661015c0e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:21.566722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] The token cache is being invalidate because project 48dcc9825a5c4207a8da8b6f0af3b757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:21.567283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:21.568872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62cc89a3-ad5c-416e-ad9e-58d661015c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:21.580529 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1671/3339] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:21 2022] DELETE /identity/v3/projects/48dcc9825a5c4207a8da8b6f0af3b757 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:21.581019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e432-3dc4-46af-bf64-cb3ee6cb317a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:21.581527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e432-3dc4-46af-bf64-cb3ee6cb317a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:21.581821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5e432-3dc4-46af-bf64-cb3ee6cb317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:21.638170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c3f5e432-3dc4-46af-bf64-cb3ee6cb317a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:21.639505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c3f5e432-3dc4-46af-bf64-cb3ee6cb317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:21.767615 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1669/3340] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:21.787476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12df62-ebe0-4f84-a6e0-34a913b7f0fa None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:21.788055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12df62-ebe0-4f84-a6e0-34a913b7f0fa None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:21.788432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12df62-ebe0-4f84-a6e0-34a913b7f0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:21.804638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5e432-3dc4-46af-bf64-cb3ee6cb317a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:21.808120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c3f5e432-3dc4-46af-bf64-cb3ee6cb317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:21.835302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2b12df62-ebe0-4f84-a6e0-34a913b7f0fa None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:21.836660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2b12df62-ebe0-4f84-a6e0-34a913b7f0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:21.851782 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1672/3341] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:21.852840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12df62-ebe0-4f84-a6e0-34a913b7f0fa None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:21.865345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12df62-ebe0-4f84-a6e0-34a913b7f0fa None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:21.873353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a55a2-fdef-40d0-a651-1344516efa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:21.874504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a55a2-fdef-40d0-a651-1344516efa64 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:21.875042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a55a2-fdef-40d0-a651-1344516efa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:21.875605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a55a2-fdef-40d0-a651-1344516efa64 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:21.877118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a55a2-fdef-40d0-a651-1344516efa64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:21.877855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a55a2-fdef-40d0-a651-1344516efa64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:21.880307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a55a2-fdef-40d0-a651-1344516efa64 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:21.898896 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1673/3342] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:21.900577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a55a2-fdef-40d0-a651-1344516efa64 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:21.922428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a55a2-fdef-40d0-a651-1344516efa64 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:21.928932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615c49-7fd8-4737-b0c5-0ac9e8af8731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:21.929368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615c49-7fd8-4737-b0c5-0ac9e8af8731 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:21.929542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615c49-7fd8-4737-b0c5-0ac9e8af8731 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:21.929821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615c49-7fd8-4737-b0c5-0ac9e8af8731 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:21.930513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615c49-7fd8-4737-b0c5-0ac9e8af8731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:21.933311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615c49-7fd8-4737-b0c5-0ac9e8af8731 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:22.005771 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1674/3343] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:21 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:22.007578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615c49-7fd8-4737-b0c5-0ac9e8af8731 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:22.012724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5e432-3dc4-46af-bf64-cb3ee6cb317a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:22.065847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:22.235327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615c49-7fd8-4737-b0c5-0ac9e8af8731 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:22.240668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85774e90-12fb-4b8f-a332-703b9f4ab4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:22.241288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85774e90-12fb-4b8f-a332-703b9f4ab4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:22.241856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85774e90-12fb-4b8f-a332-703b9f4ab4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:22.242143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85774e90-12fb-4b8f-a332-703b9f4ab4f9 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:22.243246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85774e90-12fb-4b8f-a332-703b9f4ab4f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:22.245316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85774e90-12fb-4b8f-a332-703b9f4ab4f9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:22.264612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af4add-907e-4335-b331-8ea365bd1071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:22.266140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4add-907e-4335-b331-8ea365bd1071 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:22.267111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4add-907e-4335-b331-8ea365bd1071 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:22.268584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4add-907e-4335-b331-8ea365bd1071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:22.273070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42af4add-907e-4335-b331-8ea365bd1071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:22.276834 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1675/3344] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:22 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:22.282232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85774e90-12fb-4b8f-a332-703b9f4ab4f9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:22.305116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85774e90-12fb-4b8f-a332-703b9f4ab4f9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:22.311621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76872b28-28d2-44ec-8bac-12ab7adaa828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:22.312875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76872b28-28d2-44ec-8bac-12ab7adaa828 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:22.313462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76872b28-28d2-44ec-8bac-12ab7adaa828 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:22.313940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76872b28-28d2-44ec-8bac-12ab7adaa828 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:22.314891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76872b28-28d2-44ec-8bac-12ab7adaa828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:22.316853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76872b28-28d2-44ec-8bac-12ab7adaa828 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:22.329051 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1676/3345] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:36:22.335145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76872b28-28d2-44ec-8bac-12ab7adaa828 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:22.352271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76872b28-28d2-44ec-8bac-12ab7adaa828 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:22.368184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009f141-4581-4f6a-ac83-8045528a06a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:22.368789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009f141-4581-4f6a-ac83-8045528a06a6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:22.369064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009f141-4581-4f6a-ac83-8045528a06a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:22.369335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009f141-4581-4f6a-ac83-8045528a06a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:22.370104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009f141-4581-4f6a-ac83-8045528a06a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:22.371712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009f141-4581-4f6a-ac83-8045528a06a6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:22.390579 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1677/3346] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:22.395009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009f141-4581-4f6a-ac83-8045528a06a6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:22.413316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009f141-4581-4f6a-ac83-8045528a06a6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:22.420391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69168e30-c442-46d7-8854-9387b0d6c71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:22.421330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168e30-c442-46d7-8854-9387b0d6c71c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:22.421847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168e30-c442-46d7-8854-9387b0d6c71c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:22.422286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168e30-c442-46d7-8854-9387b0d6c71c admin admin] PATH_INFO: `/v3/projects/4e12170916e24a33ab0ad5309ac2ab21/users/8b2f1d48248d45fdb39ed3c1ee4b2734/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:22.436360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af4add-907e-4335-b331-8ea365bd1071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:22.438373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af4add-907e-4335-b331-8ea365bd1071 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:22.445372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69168e30-c442-46d7-8854-9387b0d6c71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e12170916e24a33ab0ad5309ac2ab21, user_id=8b2f1d48248d45fdb39ed3c1ee4b2734, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:22.448868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69168e30-c442-46d7-8854-9387b0d6c71c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:22.449910 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1670/3347] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:22.453528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:22.481052 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1678/3348] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:22 2022] PUT /identity/v3/projects/4e12170916e24a33ab0ad5309ac2ab21/users/8b2f1d48248d45fdb39ed3c1ee4b2734/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:36:22.492488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b326-b603-495c-9202-0330885c141b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:22.492779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b326-b603-495c-9202-0330885c141b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:22.493055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b326-b603-495c-9202-0330885c141b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:22.595821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4400b326-b603-495c-9202-0330885c141b None None] MFA Rules not processed for user `8b2f1d48248d45fdb39ed3c1ee4b2734`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:22.602683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4400b326-b603-495c-9202-0330885c141b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:22.774769 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1671/3349] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:22.777431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69168e30-c442-46d7-8854-9387b0d6c71c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:22.990354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69168e30-c442-46d7-8854-9387b0d6c71c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:23.004849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb3955-f511-4f62-9276-32b4d250b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:23.006577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3955-f511-4f62-9276-32b4d250b481 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:23.007168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3955-f511-4f62-9276-32b4d250b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:23.007921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3955-f511-4f62-9276-32b4d250b481 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:23.010194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb3955-f511-4f62-9276-32b4d250b481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:23.016365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb3955-f511-4f62-9276-32b4d250b481 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:23.084064 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1679/3350] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:22 2022] POST /identity/v3/projects => generated 393 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:23.084897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400b326-b603-495c-9202-0330885c141b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:23.102701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400b326-b603-495c-9202-0330885c141b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:23.171120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:23.203593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea0773-b943-49e2-b698-d282ed448dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:23.204513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea0773-b943-49e2-b698-d282ed448dee admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:23.204858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea0773-b943-49e2-b698-d282ed448dee admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:23.205270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea0773-b943-49e2-b698-d282ed448dee admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:23.206013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea0773-b943-49e2-b698-d282ed448dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:23.208295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea0773-b943-49e2-b698-d282ed448dee admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:23.256140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb3955-f511-4f62-9276-32b4d250b481 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:23.265567 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1672/3351] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:23 2022] POST /identity/v3/users => generated 303 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:23.271152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb3955-f511-4f62-9276-32b4d250b481 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:23.276658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2bf61-8c61-41e7-848d-a7f9fb690490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:23.277364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2bf61-8c61-41e7-848d-a7f9fb690490 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:23.277743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2bf61-8c61-41e7-848d-a7f9fb690490 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:23.278104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2bf61-8c61-41e7-848d-a7f9fb690490 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:23.278816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2bf61-8c61-41e7-848d-a7f9fb690490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:23.280543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2bf61-8c61-41e7-848d-a7f9fb690490 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:23.296580 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1680/3352] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:23.301344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea0773-b943-49e2-b698-d282ed448dee admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:23.312531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea0773-b943-49e2-b698-d282ed448dee admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:23.317898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6523-b1f9-429c-b3a2-ba3f3a043f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:23.318617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6523-b1f9-429c-b3a2-ba3f3a043f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:23.318985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6523-b1f9-429c-b3a2-ba3f3a043f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:23.319392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6523-b1f9-429c-b3a2-ba3f3a043f0f admin admin] PATH_INFO: `/v3/projects/27712ebbd794448681471a673a8de9da/users/b2bfb928bb804952a9051449e1489cd4/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:23.348549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b6523-b1f9-429c-b3a2-ba3f3a043f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27712ebbd794448681471a673a8de9da, user_id=b2bfb928bb804952a9051449e1489cd4, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:23.352663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b6523-b1f9-429c-b3a2-ba3f3a043f0f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:23.383472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2bf61-8c61-41e7-848d-a7f9fb690490 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:23.384008 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1673/3353] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:23 2022] PUT /identity/v3/projects/27712ebbd794448681471a673a8de9da/users/b2bfb928bb804952a9051449e1489cd4/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:23.400877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2bf61-8c61-41e7-848d-a7f9fb690490 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:23.625703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb88f6-b290-4c96-98cc-7b7c2bbfc049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:23.626561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb88f6-b290-4c96-98cc-7b7c2bbfc049 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:23.626858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb88f6-b290-4c96-98cc-7b7c2bbfc049 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:23.628233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb88f6-b290-4c96-98cc-7b7c2bbfc049 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:23.628541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb88f6-b290-4c96-98cc-7b7c2bbfc049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:23.631253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb88f6-b290-4c96-98cc-7b7c2bbfc049 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:23.681543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6523-b1f9-429c-b3a2-ba3f3a043f0f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:23.691117 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1681/3354] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:23.695361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6523-b1f9-429c-b3a2-ba3f3a043f0f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:23.711535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faf3dc-bf49-4231-977b-2d3ed6c060ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:23.714380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faf3dc-bf49-4231-977b-2d3ed6c060ce admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:23.714793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faf3dc-bf49-4231-977b-2d3ed6c060ce admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:23.715137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faf3dc-bf49-4231-977b-2d3ed6c060ce admin admin] PATH_INFO: `/v3/projects/27712ebbd794448681471a673a8de9da/users/b2bfb928bb804952a9051449e1489cd4/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:23.719472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faf3dc-bf49-4231-977b-2d3ed6c060ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=27712ebbd794448681471a673a8de9da, user_id=b2bfb928bb804952a9051449e1489cd4, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:23.724664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faf3dc-bf49-4231-977b-2d3ed6c060ce admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:23.772144 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1674/3355] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:23 2022] PUT /identity/v3/projects/27712ebbd794448681471a673a8de9da/users/b2bfb928bb804952a9051449e1489cd4/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:23.774158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f60dd-44ce-45de-bcde-edf9b7b8845f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:23.774443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f60dd-44ce-45de-bcde-edf9b7b8845f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:23.774721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f60dd-44ce-45de-bcde-edf9b7b8845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:23.825042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-843f60dd-44ce-45de-bcde-edf9b7b8845f None None] MFA Rules not processed for user `b2bfb928bb804952a9051449e1489cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:23.827520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-843f60dd-44ce-45de-bcde-edf9b7b8845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:23.912912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:23.939284 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1682/3356] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:23 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:23.952504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822a0d-08e2-493f-9adb-c074a0fc35ed None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:23.952791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822a0d-08e2-493f-9adb-c074a0fc35ed None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:23.953066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822a0d-08e2-493f-9adb-c074a0fc35ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:23.976225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9a822a0d-08e2-493f-9adb-c074a0fc35ed None None] MFA Rules not processed for user `8b2f1d48248d45fdb39ed3c1ee4b2734`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:23.977825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9a822a0d-08e2-493f-9adb-c074a0fc35ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:24.059386 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1675/3357] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:24.083115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f60dd-44ce-45de-bcde-edf9b7b8845f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:24.178364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f60dd-44ce-45de-bcde-edf9b7b8845f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:24.184725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674317-d488-4b38-ad11-1c19b21fb996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:24.185351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674317-d488-4b38-ad11-1c19b21fb996 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:24.185666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674317-d488-4b38-ad11-1c19b21fb996 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:24.185944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674317-d488-4b38-ad11-1c19b21fb996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:24.196045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce674317-d488-4b38-ad11-1c19b21fb996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:24.197729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce674317-d488-4b38-ad11-1c19b21fb996 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:24.207667 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1683/3358] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:24.238415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a822a0d-08e2-493f-9adb-c074a0fc35ed None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:24.240783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9a822a0d-08e2-493f-9adb-c074a0fc35ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:24.381951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a822a0d-08e2-493f-9adb-c074a0fc35ed None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:24.389274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c222ca6-9396-4f72-9b84-2f203704be14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:24.389958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c222ca6-9396-4f72-9b84-2f203704be14 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:24.390244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c222ca6-9396-4f72-9b84-2f203704be14 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:24.390561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c222ca6-9396-4f72-9b84-2f203704be14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:24.400626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5c222ca6-9396-4f72-9b84-2f203704be14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:24.416971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c222ca6-9396-4f72-9b84-2f203704be14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:24.418401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c222ca6-9396-4f72-9b84-2f203704be14 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:24.436366 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1676/3359] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:25.209897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674317-d488-4b38-ad11-1c19b21fb996 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:25.211929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ce674317-d488-4b38-ad11-1c19b21fb996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:25.404870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674317-d488-4b38-ad11-1c19b21fb996 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:25.434063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2de02-5479-4e10-aa82-9598190b4503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:25.434795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2de02-5479-4e10-aa82-9598190b4503 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:25.435071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2de02-5479-4e10-aa82-9598190b4503 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:25.435346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2de02-5479-4e10-aa82-9598190b4503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:25.454403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-95c2de02-5479-4e10-aa82-9598190b4503 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:25.582691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2de02-5479-4e10-aa82-9598190b4503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:25.585648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2de02-5479-4e10-aa82-9598190b4503 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:25.614722 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1684/3360] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:29.381931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c222ca6-9396-4f72-9b84-2f203704be14 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:29.384790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5c222ca6-9396-4f72-9b84-2f203704be14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:29.466502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:29.517992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c222ca6-9396-4f72-9b84-2f203704be14 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:29.527491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:29.528932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:29.529371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:29.530795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] PATH_INFO: `/v3/users/d844cb81667346a6aaf07c288c6918be` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:29.532188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d844cb81667346a6aaf07c288c6918be)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:29.541894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:29.621927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd844cb81667346a6aaf07c288c6918be'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:29.622875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd844cb81667346a6aaf07c288c6918be'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:29.648522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd844cb81667346a6aaf07c288c6918be'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:29.665533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd844cb81667346a6aaf07c288c6918be'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:29.682112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd844cb81667346a6aaf07c288c6918be'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:29.690884 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1677/3361] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:36:29 2022] DELETE /identity/v3/users/d844cb81667346a6aaf07c288c6918be => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:29.870553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2de02-5479-4e10-aa82-9598190b4503 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:29.874598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-95c2de02-5479-4e10-aa82-9598190b4503 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:29.907002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2de02-5479-4e10-aa82-9598190b4503 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:29.962306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:30.040582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:30.042412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:30.051399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb889-6505-4ab6-b804-21030e33d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:30.052874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb889-6505-4ab6-b804-21030e33d5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.053971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb889-6505-4ab6-b804-21030e33d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.054402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb889-6505-4ab6-b804-21030e33d5ae admin admin] PATH_INFO: `/v3/users/6b448f96ae8b4a6698169ff4ef319ae2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.056304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eb889-6505-4ab6-b804-21030e33d5ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b448f96ae8b4a6698169ff4ef319ae2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:30.071415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eb889-6505-4ab6-b804-21030e33d5ae admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:30.169656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b92eb889-6505-4ab6-b804-21030e33d5ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b448f96ae8b4a6698169ff4ef319ae2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.170411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b92eb889-6505-4ab6-b804-21030e33d5ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b448f96ae8b4a6698169ff4ef319ae2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.186963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b92eb889-6505-4ab6-b804-21030e33d5ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b448f96ae8b4a6698169ff4ef319ae2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.188043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b92eb889-6505-4ab6-b804-21030e33d5ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b448f96ae8b4a6698169ff4ef319ae2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.202484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bae921-83af-41b1-8cbc-d7bdc4f45482 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:30.207311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b92eb889-6505-4ab6-b804-21030e33d5ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b448f96ae8b4a6698169ff4ef319ae2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.212700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:30.213242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.213602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.214038 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1685/3362] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:36:29 2022] DELETE /identity/v3/users/6b448f96ae8b4a6698169ff4ef319ae2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:30.214165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] PATH_INFO: `/v3/projects/ef312cb51a84470d8c0d38c9c2a65b79` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.215358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef312cb51a84470d8c0d38c9c2a65b79)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:30.218569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ba6c-4215-4aa1-a29d-9227f497b128 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.218896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:30.218999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ba6c-4215-4aa1-a29d-9227f497b128 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.219157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ba6c-4215-4aa1-a29d-9227f497b128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.242752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-faf8ba6c-4215-4aa1-a29d-9227f497b128 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:30.244272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-faf8ba6c-4215-4aa1-a29d-9227f497b128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:30.326860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef312cb51a84470d8c0d38c9c2a65b79', 'request_id': 'req-cbb2e9b7-bb23-474b-a841-97d15c9f6022'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.342740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:30.345616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef312cb51a84470d8c0d38c9c2a65b79', 'request_id': 'req-cbb2e9b7-bb23-474b-a841-97d15c9f6022'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.353238 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1686/3363] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:30.359380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef312cb51a84470d8c0d38c9c2a65b79', 'request_id': 'req-cbb2e9b7-bb23-474b-a841-97d15c9f6022'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.365920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8ba6c-4215-4aa1-a29d-9227f497b128 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:30.367790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-faf8ba6c-4215-4aa1-a29d-9227f497b128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:30.377126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] The token cache is being invalidate because project ef312cb51a84470d8c0d38c9c2a65b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:30.377494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.378241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cbb2e9b7-bb23-474b-a841-97d15c9f6022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.380673 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1678/3364] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:30 2022] DELETE /identity/v3/projects/ef312cb51a84470d8c0d38c9c2a65b79 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:36:30.386228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59d97c-647c-433f-a9c3-dbc6aa62b63e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.387511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59d97c-647c-433f-a9c3-dbc6aa62b63e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.388047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59d97c-647c-433f-a9c3-dbc6aa62b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.413949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-de59d97c-647c-433f-a9c3-dbc6aa62b63e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:30.415679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de59d97c-647c-433f-a9c3-dbc6aa62b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:30.447721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8ba6c-4215-4aa1-a29d-9227f497b128 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:30.452041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:30.499155 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1679/3365] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:30.505566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbddcf3-5c26-4646-ba2d-c78e17dd8308 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.505566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbddcf3-5c26-4646-ba2d-c78e17dd8308 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.505566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbddcf3-5c26-4646-ba2d-c78e17dd8308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.511078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd08e1-c228-4b88-9009-cb0ec27a4dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:30.511685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd08e1-c228-4b88-9009-cb0ec27a4dff service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.512011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd08e1-c228-4b88-9009-cb0ec27a4dff service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.512286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd08e1-c228-4b88-9009-cb0ec27a4dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.514094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-16bd08e1-c228-4b88-9009-cb0ec27a4dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:30.527596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd08e1-c228-4b88-9009-cb0ec27a4dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:30.529791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd08e1-c228-4b88-9009-cb0ec27a4dff service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:30.532354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8dbddcf3-5c26-4646-ba2d-c78e17dd8308 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:30.540234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8dbddcf3-5c26-4646-ba2d-c78e17dd8308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:30.543633 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1687/3366] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:30.554703 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1680/3367] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:30.555358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd08e1-c228-4b88-9009-cb0ec27a4dff service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:30.568975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd08e1-c228-4b88-9009-cb0ec27a4dff service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:30.573881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c62b5-547a-4751-83a7-1730193f90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:30.574490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c62b5-547a-4751-83a7-1730193f90fa admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.574765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c62b5-547a-4751-83a7-1730193f90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.575038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c62b5-547a-4751-83a7-1730193f90fa admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.575694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c62b5-547a-4751-83a7-1730193f90fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:30.575981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c62b5-547a-4751-83a7-1730193f90fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:30.577592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c62b5-547a-4751-83a7-1730193f90fa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:30.594120 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1688/3368] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:30.595653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbddcf3-5c26-4646-ba2d-c78e17dd8308 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:30.606475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbddcf3-5c26-4646-ba2d-c78e17dd8308 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:30.612887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee5177-6bf1-481c-9140-6f064a370eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:30.613779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee5177-6bf1-481c-9140-6f064a370eaf admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.615239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee5177-6bf1-481c-9140-6f064a370eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.615694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee5177-6bf1-481c-9140-6f064a370eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.616870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee5177-6bf1-481c-9140-6f064a370eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:30.620085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee5177-6bf1-481c-9140-6f064a370eaf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:30.658233 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1681/3369] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:30 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:36:30.659123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c62b5-547a-4751-83a7-1730193f90fa admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:30.670432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c62b5-547a-4751-83a7-1730193f90fa admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:30.737695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1514a6-4577-4d72-859e-7e1f4c043112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:30.738306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1514a6-4577-4d72-859e-7e1f4c043112 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.738722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1514a6-4577-4d72-859e-7e1f4c043112 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.739001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1514a6-4577-4d72-859e-7e1f4c043112 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.740227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1514a6-4577-4d72-859e-7e1f4c043112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:30.744171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1514a6-4577-4d72-859e-7e1f4c043112 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:30.777361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee5177-6bf1-481c-9140-6f064a370eaf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:30.779157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-84ee5177-6bf1-481c-9140-6f064a370eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:30.795021 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1689/3370] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:30 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:30.797050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1514a6-4577-4d72-859e-7e1f4c043112 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:30.800181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee5177-6bf1-481c-9140-6f064a370eaf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:30.821057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1514a6-4577-4d72-859e-7e1f4c043112 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:30.828046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38307aa6-8b19-40db-85f3-cee1304458d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:30.828962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38307aa6-8b19-40db-85f3-cee1304458d9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.829590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38307aa6-8b19-40db-85f3-cee1304458d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.830160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38307aa6-8b19-40db-85f3-cee1304458d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.831383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38307aa6-8b19-40db-85f3-cee1304458d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:30.833620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38307aa6-8b19-40db-85f3-cee1304458d9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:30.840518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:30.841167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.841473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.841754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] PATH_INFO: `/v3/projects/f64f2469ff0345d680db3cae9444d749` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.843084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64f2469ff0345d680db3cae9444d749)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:30.859455 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1690/3371] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:30.861322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38307aa6-8b19-40db-85f3-cee1304458d9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:30.870253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:30.884062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38307aa6-8b19-40db-85f3-cee1304458d9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:30.895631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2bb4d-b5c6-4498-af77-3b1d5b76ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:30.898760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2bb4d-b5c6-4498-af77-3b1d5b76ad30 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.899197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2bb4d-b5c6-4498-af77-3b1d5b76ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.899959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2bb4d-b5c6-4498-af77-3b1d5b76ad30 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.902009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2bb4d-b5c6-4498-af77-3b1d5b76ad30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:30.906070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2bb4d-b5c6-4498-af77-3b1d5b76ad30 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:30.925128 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1691/3372] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:30.929974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2bb4d-b5c6-4498-af77-3b1d5b76ad30 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:30.941407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2bb4d-b5c6-4498-af77-3b1d5b76ad30 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:30.954208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ab833-6611-471b-9088-9d208f2fe053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:30.956292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ab833-6611-471b-9088-9d208f2fe053 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:30.957457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ab833-6611-471b-9088-9d208f2fe053 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:30.957755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ab833-6611-471b-9088-9d208f2fe053 admin admin] PATH_INFO: `/v3/projects/7b6d552efe0040308b2314fabedb7a4e/users/23d02b0782134c01b8b987efd175f6c4/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:30.971894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64f2469ff0345d680db3cae9444d749', 'request_id': 'req-70444b86-9e58-4fde-a898-fef83eb84897'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.977305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ab833-6611-471b-9088-9d208f2fe053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6d552efe0040308b2314fabedb7a4e, user_id=23d02b0782134c01b8b987efd175f6c4, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:30.980945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ab833-6611-471b-9088-9d208f2fe053 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:30.981579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64f2469ff0345d680db3cae9444d749', 'request_id': 'req-70444b86-9e58-4fde-a898-fef83eb84897'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:30.993680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64f2469ff0345d680db3cae9444d749', 'request_id': 'req-70444b86-9e58-4fde-a898-fef83eb84897'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:31.009821 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1692/3373] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:30 2022] PUT /identity/v3/projects/7b6d552efe0040308b2314fabedb7a4e/users/23d02b0782134c01b8b987efd175f6c4/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:36:31.011769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896961a7-cee5-479c-abee-580467324ada None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:31.012110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896961a7-cee5-479c-abee-580467324ada None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:31.012444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896961a7-cee5-479c-abee-580467324ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:31.019511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] The token cache is being invalidate because project f64f2469ff0345d680db3cae9444d749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:31.021599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:31.023348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:31.028066 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1682/3374] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:30 2022] DELETE /identity/v3/projects/f64f2469ff0345d680db3cae9444d749 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:36:31.032991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:31.036932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:31.054431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-896961a7-cee5-479c-abee-580467324ada None None] MFA Rules not processed for user `23d02b0782134c01b8b987efd175f6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:31.055698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-896961a7-cee5-479c-abee-580467324ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:31.096817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:31.170113 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1693/3375] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:31.180612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:31.190750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896961a7-cee5-479c-abee-580467324ada None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:31.193848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-896961a7-cee5-479c-abee-580467324ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:31.217866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70444b86-9e58-4fde-a898-fef83eb84897 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:31.326858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896961a7-cee5-479c-abee-580467324ada None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:31.331374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc1dc5-4717-40dd-b445-e0398dcfa82d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:31.333046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1dc5-4717-40dd-b445-e0398dcfa82d service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:31.333046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1dc5-4717-40dd-b445-e0398dcfa82d service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:31.333046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1dc5-4717-40dd-b445-e0398dcfa82d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:31.359832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:31.360982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:31.361619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:31.362261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] PATH_INFO: `/v3/users/2111e35ebdb648fea876436ef7c68fcf` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:31.363933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2111e35ebdb648fea876436ef7c68fcf)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:31.365990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc1dc5-4717-40dd-b445-e0398dcfa82d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:31.367759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc1dc5-4717-40dd-b445-e0398dcfa82d service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:31.369326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:31.418900 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1694/3376] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:31.525966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2111e35ebdb648fea876436ef7c68fcf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:31.525966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2111e35ebdb648fea876436ef7c68fcf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:31.556959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2111e35ebdb648fea876436ef7c68fcf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:31.573932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2111e35ebdb648fea876436ef7c68fcf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:31.600294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2111e35ebdb648fea876436ef7c68fcf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:31.623413 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1683/3377] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:36:31 2022] DELETE /identity/v3/users/2111e35ebdb648fea876436ef7c68fcf => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:31.747155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158bf25-9cbd-4b3f-9e64-d3ade35bae89 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:31.747691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158bf25-9cbd-4b3f-9e64-d3ade35bae89 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:31.752781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158bf25-9cbd-4b3f-9e64-d3ade35bae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:31.849491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e158bf25-9cbd-4b3f-9e64-d3ade35bae89 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:31.851197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e158bf25-9cbd-4b3f-9e64-d3ade35bae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:31.969610 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1695/3378] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:36:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:32.033247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:32.034842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:32.191384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158bf25-9cbd-4b3f-9e64-d3ade35bae89 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:32.192657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e158bf25-9cbd-4b3f-9e64-d3ade35bae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:32.260237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:32.314569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f967d-aaa4-4063-a9b1-73e053004a34 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:32.322451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3c50d-b399-49e5-84a3-5b8cf907e7ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:32.323096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3c50d-b399-49e5-84a3-5b8cf907e7ae service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:32.323383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3c50d-b399-49e5-84a3-5b8cf907e7ae service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:32.323658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3c50d-b399-49e5-84a3-5b8cf907e7ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:32.344520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:32.345617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3c50d-b399-49e5-84a3-5b8cf907e7ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:32.348203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3c50d-b399-49e5-84a3-5b8cf907e7ae service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:32.364147 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1684/3379] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:36:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:36:32.365680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3c50d-b399-49e5-84a3-5b8cf907e7ae service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:32.367615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b6f3c50d-b399-49e5-84a3-5b8cf907e7ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:32.493775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158bf25-9cbd-4b3f-9e64-d3ade35bae89 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:32.515315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:32.517886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:32.518612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:32.520053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] PATH_INFO: `/v3/projects/b3ec75d1b5034e0cb8e6b4bd0cd0e45e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:32.521974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3c50d-b399-49e5-84a3-5b8cf907e7ae service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:32.525622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ec75d1b5034e0cb8e6b4bd0cd0e45e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:32.534188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:32.540818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64f6a5-e3ca-4963-8e5c-cedf73759071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:32.541526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64f6a5-e3ca-4963-8e5c-cedf73759071 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:32.549026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64f6a5-e3ca-4963-8e5c-cedf73759071 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:32.550722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64f6a5-e3ca-4963-8e5c-cedf73759071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:32.553626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ae64f6a5-e3ca-4963-8e5c-cedf73759071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:32.566681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64f6a5-e3ca-4963-8e5c-cedf73759071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:32.569001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64f6a5-e3ca-4963-8e5c-cedf73759071 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:32.594812 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1685/3380] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:32.708471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ec75d1b5034e0cb8e6b4bd0cd0e45e', 'request_id': 'req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:32.720278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ec75d1b5034e0cb8e6b4bd0cd0e45e', 'request_id': 'req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:32.735798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ec75d1b5034e0cb8e6b4bd0cd0e45e', 'request_id': 'req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:32.760510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] The token cache is being invalidate because project b3ec75d1b5034e0cb8e6b4bd0cd0e45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:32.761041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:32.762872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b1c243ea-4a95-4ea3-8e87-732eb8a7851f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:32.765696 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1696/3381] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:32 2022] DELETE /identity/v3/projects/b3ec75d1b5034e0cb8e6b4bd0cd0e45e => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:36:32.773734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ea488-7213-4f58-b9d5-98ae3e6d0f86 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:32.774956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ea488-7213-4f58-b9d5-98ae3e6d0f86 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:32.776207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ea488-7213-4f58-b9d5-98ae3e6d0f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:32.805248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-369ea488-7213-4f58-b9d5-98ae3e6d0f86 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:32.807930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-369ea488-7213-4f58-b9d5-98ae3e6d0f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:32.918139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f3473-6853-408b-9a3b-51512c65bea9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:32.918483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f3473-6853-408b-9a3b-51512c65bea9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:32.918721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f3473-6853-408b-9a3b-51512c65bea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:32.919156 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1686/3382] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:32.965422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e20f3473-6853-408b-9a3b-51512c65bea9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:32.966975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e20f3473-6853-408b-9a3b-51512c65bea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:32.984909 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1697/3383] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:32.990845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ea488-7213-4f58-b9d5-98ae3e6d0f86 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:33.006332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ea488-7213-4f58-b9d5-98ae3e6d0f86 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:33.012453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01552c-a08b-4e9e-acf2-bbab98851bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:33.014330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01552c-a08b-4e9e-acf2-bbab98851bef admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:33.015217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01552c-a08b-4e9e-acf2-bbab98851bef admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:33.015708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01552c-a08b-4e9e-acf2-bbab98851bef admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:33.016950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01552c-a08b-4e9e-acf2-bbab98851bef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:33.017604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01552c-a08b-4e9e-acf2-bbab98851bef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:33.019614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01552c-a08b-4e9e-acf2-bbab98851bef admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:33.095408 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1687/3384] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:36:33.101827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f3473-6853-408b-9a3b-51512c65bea9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:33.114251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f3473-6853-408b-9a3b-51512c65bea9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:33.128842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8bc2-3958-4a12-8d81-b117cf4d984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:33.128842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8bc2-3958-4a12-8d81-b117cf4d984d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:33.129136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8bc2-3958-4a12-8d81-b117cf4d984d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:33.131303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8bc2-3958-4a12-8d81-b117cf4d984d admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:33.132736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff8bc2-3958-4a12-8d81-b117cf4d984d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:33.136893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff8bc2-3958-4a12-8d81-b117cf4d984d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:33.206922 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1698/3385] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:33 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:33.207128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01552c-a08b-4e9e-acf2-bbab98851bef admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:33.219843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01552c-a08b-4e9e-acf2-bbab98851bef admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:33.353518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38259d1-cbd9-4585-b618-0d4a856b3906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:33.354296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38259d1-cbd9-4585-b618-0d4a856b3906 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:33.354666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38259d1-cbd9-4585-b618-0d4a856b3906 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:33.355041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38259d1-cbd9-4585-b618-0d4a856b3906 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:33.355932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38259d1-cbd9-4585-b618-0d4a856b3906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:33.358274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38259d1-cbd9-4585-b618-0d4a856b3906 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:33.375589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:33.395576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8bc2-3958-4a12-8d81-b117cf4d984d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:33.403104 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1688/3386] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:33 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:36:33.407838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8bc2-3958-4a12-8d81-b117cf4d984d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:33.422083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71067678-d74a-467e-9e4c-cb31741e3ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:33.424085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71067678-d74a-467e-9e4c-cb31741e3ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:33.425854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71067678-d74a-467e-9e4c-cb31741e3ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:33.426234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71067678-d74a-467e-9e4c-cb31741e3ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:33.428019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71067678-d74a-467e-9e4c-cb31741e3ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:33.433302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71067678-d74a-467e-9e4c-cb31741e3ab0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:33.473323 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1699/3387] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:33.475859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38259d1-cbd9-4585-b618-0d4a856b3906 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:33.490390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38259d1-cbd9-4585-b618-0d4a856b3906 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:33.503018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e976cb4-30e6-41ee-8f4a-baf46c43f424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:33.504190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e976cb4-30e6-41ee-8f4a-baf46c43f424 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:33.504190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e976cb4-30e6-41ee-8f4a-baf46c43f424 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:33.505815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e976cb4-30e6-41ee-8f4a-baf46c43f424 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:33.508962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e976cb4-30e6-41ee-8f4a-baf46c43f424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:33.510915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e976cb4-30e6-41ee-8f4a-baf46c43f424 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:33.538671 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1689/3388] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:33.542546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71067678-d74a-467e-9e4c-cb31741e3ab0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:33.579807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71067678-d74a-467e-9e4c-cb31741e3ab0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:33.609442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8e643-cbdd-4b60-a8ba-d3174c8fb0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:33.611077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8e643-cbdd-4b60-a8ba-d3174c8fb0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:33.611364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8e643-cbdd-4b60-a8ba-d3174c8fb0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:33.612770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8e643-cbdd-4b60-a8ba-d3174c8fb0c1 admin admin] PATH_INFO: `/v3/projects/a252756856a8491fb600a3b03f24c598/users/26cfb36460a54faca6f9a512c9329d25/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:33.648005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8e643-cbdd-4b60-a8ba-d3174c8fb0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a252756856a8491fb600a3b03f24c598, user_id=26cfb36460a54faca6f9a512c9329d25, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:33.652476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8e643-cbdd-4b60-a8ba-d3174c8fb0c1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:33.713127 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1700/3389] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:33 2022] PUT /identity/v3/projects/a252756856a8491fb600a3b03f24c598/users/26cfb36460a54faca6f9a512c9329d25/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:33.719269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d95cdc-8584-4512-a724-1b33cc86d249 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:33.719926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d95cdc-8584-4512-a724-1b33cc86d249 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:33.719926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d95cdc-8584-4512-a724-1b33cc86d249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:33.809945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f5d95cdc-8584-4512-a724-1b33cc86d249 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:33.811170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f5d95cdc-8584-4512-a724-1b33cc86d249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:34.015609 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1690/3390] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:34.047960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8e643-cbdd-4b60-a8ba-d3174c8fb0c1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:34.057473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9fd8e643-cbdd-4b60-a8ba-d3174c8fb0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:34.111546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d95cdc-8584-4512-a724-1b33cc86d249 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:34.113106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f5d95cdc-8584-4512-a724-1b33cc86d249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:34.288836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8e643-cbdd-4b60-a8ba-d3174c8fb0c1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:34.295473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d95cdc-8584-4512-a724-1b33cc86d249 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:34.296078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31648979-46e8-4f0a-8e03-ac2fc96ed001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:34.297128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31648979-46e8-4f0a-8e03-ac2fc96ed001 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:34.297582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31648979-46e8-4f0a-8e03-ac2fc96ed001 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:34.297997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31648979-46e8-4f0a-8e03-ac2fc96ed001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:34.314292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5c0b1-8809-457d-b8c4-809f041fe2e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:34.314940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5c0b1-8809-457d-b8c4-809f041fe2e6 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:34.315228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5c0b1-8809-457d-b8c4-809f041fe2e6 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:34.315505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5c0b1-8809-457d-b8c4-809f041fe2e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:34.317597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bdc5c0b1-8809-457d-b8c4-809f041fe2e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:34.322252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31648979-46e8-4f0a-8e03-ac2fc96ed001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:34.323712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31648979-46e8-4f0a-8e03-ac2fc96ed001 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:34.339900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5c0b1-8809-457d-b8c4-809f041fe2e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:34.341736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5c0b1-8809-457d-b8c4-809f041fe2e6 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:34.349881 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1701/3391] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:34.377193 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1691/3392] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:36:40.181905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ad2b9-049b-40c3-bb72-6f28b4c2767a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:40.183069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ad2b9-049b-40c3-bb72-6f28b4c2767a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:40.183637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ad2b9-049b-40c3-bb72-6f28b4c2767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:40.204274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:40.223028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fc4ad2b9-049b-40c3-bb72-6f28b4c2767a None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:40.225750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc4ad2b9-049b-40c3-bb72-6f28b4c2767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:40.324308 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1702/3393] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:36:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:40.325441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5c0b1-8809-457d-b8c4-809f041fe2e6 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:40.327083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bdc5c0b1-8809-457d-b8c4-809f041fe2e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:40.486417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5c0b1-8809-457d-b8c4-809f041fe2e6 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:40.492849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704081c8-efb6-483b-be26-52a06d83c370 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:40.493679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704081c8-efb6-483b-be26-52a06d83c370 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:40.493965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704081c8-efb6-483b-be26-52a06d83c370 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:40.494238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704081c8-efb6-483b-be26-52a06d83c370 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:40.512158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704081c8-efb6-483b-be26-52a06d83c370 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:40.514077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704081c8-efb6-483b-be26-52a06d83c370 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:40.520049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:40.548359 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1692/3394] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:36:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:40.728886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ad2b9-049b-40c3-bb72-6f28b4c2767a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:40.730642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc4ad2b9-049b-40c3-bb72-6f28b4c2767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:40.758384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ad2b9-049b-40c3-bb72-6f28b4c2767a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:40.767756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:40.768470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:40.768754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:40.769250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] PATH_INFO: `/v3/users/23d02b0782134c01b8b987efd175f6c4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:40.771016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d02b0782134c01b8b987efd175f6c4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:40.778514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:40.931915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d02b0782134c01b8b987efd175f6c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:40.932682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d02b0782134c01b8b987efd175f6c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:40.956665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d02b0782134c01b8b987efd175f6c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:40.958114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d02b0782134c01b8b987efd175f6c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:40.969261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d02b0782134c01b8b987efd175f6c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:40.999577 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1703/3395] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:36:40 2022] DELETE /identity/v3/users/23d02b0782134c01b8b987efd175f6c4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:41.004312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c685ef-e242-40f2-b04d-781a9a610ebb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:41.004709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c685ef-e242-40f2-b04d-781a9a610ebb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:41.005590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c685ef-e242-40f2-b04d-781a9a610ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:41.089018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-08c685ef-e242-40f2-b04d-781a9a610ebb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:41.090763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-08c685ef-e242-40f2-b04d-781a9a610ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:41.261974 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1693/3396] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:41.262572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:41.265763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:41.351569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c533e6-3c2c-4fad-a32a-c6d940697405 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:41.356494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8a91a-cc88-48d9-a884-c04faa26b658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:41.357424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a91a-cc88-48d9-a884-c04faa26b658 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:41.357862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a91a-cc88-48d9-a884-c04faa26b658 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:41.358321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a91a-cc88-48d9-a884-c04faa26b658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:41.394762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8a91a-cc88-48d9-a884-c04faa26b658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:41.398310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8a91a-cc88-48d9-a884-c04faa26b658 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:41.417247 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1704/3397] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:36:42.116451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c685ef-e242-40f2-b04d-781a9a610ebb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:42.117964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-08c685ef-e242-40f2-b04d-781a9a610ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:42.142264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c685ef-e242-40f2-b04d-781a9a610ebb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:42.158836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:42.159508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:42.162001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:42.162298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] PATH_INFO: `/v3/projects/7b6d552efe0040308b2314fabedb7a4e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:42.176345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6d552efe0040308b2314fabedb7a4e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:42.183613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:42.321658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6d552efe0040308b2314fabedb7a4e', 'request_id': 'req-a13abc8e-b86c-4c97-8737-7fa0712f2736'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:42.328149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6d552efe0040308b2314fabedb7a4e', 'request_id': 'req-a13abc8e-b86c-4c97-8737-7fa0712f2736'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:42.341436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6d552efe0040308b2314fabedb7a4e', 'request_id': 'req-a13abc8e-b86c-4c97-8737-7fa0712f2736'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:42.380943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] The token cache is being invalidate because project 7b6d552efe0040308b2314fabedb7a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:36:42.381310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:42.382166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a13abc8e-b86c-4c97-8737-7fa0712f2736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:36:42.385652 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1694/3398] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:36:42 2022] DELETE /identity/v3/projects/7b6d552efe0040308b2314fabedb7a4e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:42.391088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1962ae-ffa6-4984-b0ee-5844e50dde70 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:42.392224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1962ae-ffa6-4984-b0ee-5844e50dde70 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:42.392793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1962ae-ffa6-4984-b0ee-5844e50dde70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:42.465482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8c1962ae-ffa6-4984-b0ee-5844e50dde70 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:42.467050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8c1962ae-ffa6-4984-b0ee-5844e50dde70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:42.497439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:42.646883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f4757-35a9-4f13-a545-b202938b7888 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:42.647245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f4757-35a9-4f13-a545-b202938b7888 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:42.647454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f4757-35a9-4f13-a545-b202938b7888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:42.649607 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1705/3399] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:42.703429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-361f4757-35a9-4f13-a545-b202938b7888 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:42.705651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-361f4757-35a9-4f13-a545-b202938b7888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:42.747506 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1695/3400] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:36:42.752282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1962ae-ffa6-4984-b0ee-5844e50dde70 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:42.768002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1962ae-ffa6-4984-b0ee-5844e50dde70 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:42.780461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e8a85-d273-4fd5-8bad-380e1bf2740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:42.781756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e8a85-d273-4fd5-8bad-380e1bf2740b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:42.782058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e8a85-d273-4fd5-8bad-380e1bf2740b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:42.782335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e8a85-d273-4fd5-8bad-380e1bf2740b admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:42.783106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e8a85-d273-4fd5-8bad-380e1bf2740b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:36:42.783413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e8a85-d273-4fd5-8bad-380e1bf2740b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:42.787867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e8a85-d273-4fd5-8bad-380e1bf2740b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:42.835959 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1706/3401] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:36:42.843008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f4757-35a9-4f13-a545-b202938b7888 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:42.862286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f4757-35a9-4f13-a545-b202938b7888 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:42.868511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8a14e-abdb-424a-9e80-0264e89ef7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:42.869142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8a14e-abdb-424a-9e80-0264e89ef7fd admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:42.869452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8a14e-abdb-424a-9e80-0264e89ef7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:42.869730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8a14e-abdb-424a-9e80-0264e89ef7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:42.870963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8a14e-abdb-424a-9e80-0264e89ef7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:42.872888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8a14e-abdb-424a-9e80-0264e89ef7fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:42.935870 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1696/3402] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:42 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:42.940204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e8a85-d273-4fd5-8bad-380e1bf2740b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:42.977850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e8a85-d273-4fd5-8bad-380e1bf2740b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:43.119423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb8a26-3952-4254-bd29-216d1a053763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:43.120056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb8a26-3952-4254-bd29-216d1a053763 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:43.120341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb8a26-3952-4254-bd29-216d1a053763 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:43.120619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb8a26-3952-4254-bd29-216d1a053763 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:43.121264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb8a26-3952-4254-bd29-216d1a053763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:43.123272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb8a26-3952-4254-bd29-216d1a053763 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:43.164166 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1707/3403] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:42 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:43.165628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8a14e-abdb-424a-9e80-0264e89ef7fd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:43.188262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8a14e-abdb-424a-9e80-0264e89ef7fd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:43.206910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a846c-29e3-4a39-8612-36462d8abdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:43.211797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a846c-29e3-4a39-8612-36462d8abdcd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:43.215274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a846c-29e3-4a39-8612-36462d8abdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:43.215846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a846c-29e3-4a39-8612-36462d8abdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:43.216779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a846c-29e3-4a39-8612-36462d8abdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:43.218651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a846c-29e3-4a39-8612-36462d8abdcd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:43.277745 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1697/3404] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:43.281718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb8a26-3952-4254-bd29-216d1a053763 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:43.297998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb8a26-3952-4254-bd29-216d1a053763 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:43.313975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c9514-86a1-4873-b319-a00830f8e4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:43.314611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c9514-86a1-4873-b319-a00830f8e4ca admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:43.314894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c9514-86a1-4873-b319-a00830f8e4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:43.315299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c9514-86a1-4873-b319-a00830f8e4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:43.316409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c9514-86a1-4873-b319-a00830f8e4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:43.318831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c9514-86a1-4873-b319-a00830f8e4ca admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:43.351027 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1708/3405] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:43.354223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a846c-29e3-4a39-8612-36462d8abdcd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:43.369909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a846c-29e3-4a39-8612-36462d8abdcd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:43.389798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb224c5-95ea-4222-b332-978abb23cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:43.390496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb224c5-95ea-4222-b332-978abb23cf80 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:43.390781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb224c5-95ea-4222-b332-978abb23cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:43.391225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb224c5-95ea-4222-b332-978abb23cf80 admin admin] PATH_INFO: `/v3/projects/c4289f452ed34003a85d00e8f6959d78/users/c631f558d99f40feb637f376bac1cffa/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:43.408998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a81af-5596-4c76-b914-8d6ab5ce1a1b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:43.409541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a81af-5596-4c76-b914-8d6ab5ce1a1b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:43.409896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a81af-5596-4c76-b914-8d6ab5ce1a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:43.443927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5d7a81af-5596-4c76-b914-8d6ab5ce1a1b None None] MFA Rules not processed for user `0b9bbdf34e904843ab7cd7b40bf3720d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:43.445971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5d7a81af-5596-4c76-b914-8d6ab5ce1a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:43.453365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb224c5-95ea-4222-b332-978abb23cf80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4289f452ed34003a85d00e8f6959d78, user_id=c631f558d99f40feb637f376bac1cffa, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:43.463406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb224c5-95ea-4222-b332-978abb23cf80 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:43.497027 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1698/3406] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:43 2022] PUT /identity/v3/projects/c4289f452ed34003a85d00e8f6959d78/users/c631f558d99f40feb637f376bac1cffa/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:43.501994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6496e-948e-45c7-8075-6372498c2977 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:43.502524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6496e-948e-45c7-8075-6372498c2977 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:43.507527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6496e-948e-45c7-8075-6372498c2977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:43.554359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-30c6496e-948e-45c7-8075-6372498c2977 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:43.555551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-30c6496e-948e-45c7-8075-6372498c2977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:43.616655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:43.622834 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1709/3407] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:36:43.721625 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1699/3408] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:43.750277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a81af-5596-4c76-b914-8d6ab5ce1a1b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:43.751825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5d7a81af-5596-4c76-b914-8d6ab5ce1a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:43.889735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:43.931954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a81af-5596-4c76-b914-8d6ab5ce1a1b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:44.052357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f6c7f-9ca7-4276-a496-4e2b7256152e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:44.053408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f6c7f-9ca7-4276-a496-4e2b7256152e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:44.053408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f6c7f-9ca7-4276-a496-4e2b7256152e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:44.054176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f6c7f-9ca7-4276-a496-4e2b7256152e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:44.069169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f6c7f-9ca7-4276-a496-4e2b7256152e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:44.071509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f6c7f-9ca7-4276-a496-4e2b7256152e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:44.086323 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1710/3409] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:44.244352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4a71-6377-4205-8315-bb59c303c560 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:44.246668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4a71-6377-4205-8315-bb59c303c560 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:44.247181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4a71-6377-4205-8315-bb59c303c560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:44.282638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a67d4a71-6377-4205-8315-bb59c303c560 None None] MFA Rules not processed for user `26cfb36460a54faca6f9a512c9329d25`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:44.284309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a67d4a71-6377-4205-8315-bb59c303c560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:44.425289 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1700/3410] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:44.426418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f6c7f-9ca7-4276-a496-4e2b7256152e service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:44.428552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-752f6c7f-9ca7-4276-a496-4e2b7256152e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:44.460440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f6c7f-9ca7-4276-a496-4e2b7256152e service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:44.486350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcba547-dfe4-441d-b7db-65f0cad08439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:44.486977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcba547-dfe4-441d-b7db-65f0cad08439 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:44.487255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcba547-dfe4-441d-b7db-65f0cad08439 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:44.487523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcba547-dfe4-441d-b7db-65f0cad08439 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:44.492987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d4a71-6377-4205-8315-bb59c303c560 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:44.494786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a67d4a71-6377-4205-8315-bb59c303c560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:44.496814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcba547-dfe4-441d-b7db-65f0cad08439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:44.512473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcba547-dfe4-441d-b7db-65f0cad08439 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:44.585737 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1711/3411] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:36:44 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:44.586799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcba547-dfe4-441d-b7db-65f0cad08439 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:44.696312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d4a71-6377-4205-8315-bb59c303c560 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:44.748931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcba547-dfe4-441d-b7db-65f0cad08439 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:44.765120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492105-7661-42c5-b955-78de3d3013f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:44.766007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492105-7661-42c5-b955-78de3d3013f1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:44.766482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492105-7661-42c5-b955-78de3d3013f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:44.766943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492105-7661-42c5-b955-78de3d3013f1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:44.767771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16492105-7661-42c5-b955-78de3d3013f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:44.775249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16492105-7661-42c5-b955-78de3d3013f1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:44.857916 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1712/3412] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:36:44 2022] POST /identity/v3/users => generated 299 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:36:44.863724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:44.867323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492105-7661-42c5-b955-78de3d3013f1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:44.895496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492105-7661-42c5-b955-78de3d3013f1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:44.904594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c14a5-3162-4c6f-bf55-ebeb7a13b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:44.906444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c14a5-3162-4c6f-bf55-ebeb7a13b02d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:44.906871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c14a5-3162-4c6f-bf55-ebeb7a13b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:44.907547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c14a5-3162-4c6f-bf55-ebeb7a13b02d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:44.908329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c14a5-3162-4c6f-bf55-ebeb7a13b02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:44.917686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c14a5-3162-4c6f-bf55-ebeb7a13b02d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:44.973168 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1713/3413] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:44.976211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da710cd1-56d1-4c3b-b1b5-8aa998e5318e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:44.980260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da710cd1-56d1-4c3b-b1b5-8aa998e5318e service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:44.982337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c14a5-3162-4c6f-bf55-ebeb7a13b02d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:44.984412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da710cd1-56d1-4c3b-b1b5-8aa998e5318e service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:44.988621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da710cd1-56d1-4c3b-b1b5-8aa998e5318e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:44.997682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-da710cd1-56d1-4c3b-b1b5-8aa998e5318e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:45.035230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c14a5-3162-4c6f-bf55-ebeb7a13b02d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:45.070031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c4338-64be-4c73-9d86-a3d3a013a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:45.073793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c4338-64be-4c73-9d86-a3d3a013a422 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:45.074600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c4338-64be-4c73-9d86-a3d3a013a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:45.074600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c4338-64be-4c73-9d86-a3d3a013a422 admin admin] PATH_INFO: `/v3/projects/0d4e4f004c334e7195d9c7eb737b54cc/users/3a22eebaed5147cfaa130838d566e75f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:45.134458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c4338-64be-4c73-9d86-a3d3a013a422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4e4f004c334e7195d9c7eb737b54cc, user_id=3a22eebaed5147cfaa130838d566e75f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:45.142339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c4338-64be-4c73-9d86-a3d3a013a422 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:45.190894 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1714/3414] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:44 2022] PUT /identity/v3/projects/0d4e4f004c334e7195d9c7eb737b54cc/users/3a22eebaed5147cfaa130838d566e75f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:45.193092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c4338-64be-4c73-9d86-a3d3a013a422 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:45.288016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da710cd1-56d1-4c3b-b1b5-8aa998e5318e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:45.299244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da710cd1-56d1-4c3b-b1b5-8aa998e5318e service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:45.336941 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1701/3415] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 845 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:36:45.338747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:45.393206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44ab69-cf8b-4f99-9f5f-bf2eb669785d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:45.393820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44ab69-cf8b-4f99-9f5f-bf2eb669785d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:45.394372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44ab69-cf8b-4f99-9f5f-bf2eb669785d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:45.452085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5b44ab69-cf8b-4f99-9f5f-bf2eb669785d None None] MFA Rules not processed for user `8b2f1d48248d45fdb39ed3c1ee4b2734`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:36:45.456810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5b44ab69-cf8b-4f99-9f5f-bf2eb669785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:45.470959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c4338-64be-4c73-9d86-a3d3a013a422 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:45.523273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df1550-1749-4f38-90cf-b2a1c01c48eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:45.527238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df1550-1749-4f38-90cf-b2a1c01c48eb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:45.528023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df1550-1749-4f38-90cf-b2a1c01c48eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:45.528466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df1550-1749-4f38-90cf-b2a1c01c48eb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:45.530398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df1550-1749-4f38-90cf-b2a1c01c48eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:45.544232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df1550-1749-4f38-90cf-b2a1c01c48eb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:45.577411 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1715/3416] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:36:45.579467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df1550-1749-4f38-90cf-b2a1c01c48eb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:45.606977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df1550-1749-4f38-90cf-b2a1c01c48eb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:45.622028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350fe69-0ba2-4f9a-b1d1-c65540ae017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:45.623168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350fe69-0ba2-4f9a-b1d1-c65540ae017f admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:45.623615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350fe69-0ba2-4f9a-b1d1-c65540ae017f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:45.624144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350fe69-0ba2-4f9a-b1d1-c65540ae017f admin admin] PATH_INFO: `/v3/projects/0d4e4f004c334e7195d9c7eb737b54cc/users/3a22eebaed5147cfaa130838d566e75f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:45.634573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350fe69-0ba2-4f9a-b1d1-c65540ae017f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4e4f004c334e7195d9c7eb737b54cc, user_id=3a22eebaed5147cfaa130838d566e75f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:45.642346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350fe69-0ba2-4f9a-b1d1-c65540ae017f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:45.669505 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1702/3417] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:36:45.681145 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1716/3418] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:36:45 2022] PUT /identity/v3/projects/0d4e4f004c334e7195d9c7eb737b54cc/users/3a22eebaed5147cfaa130838d566e75f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:36:45.746446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44ab69-cf8b-4f99-9f5f-bf2eb669785d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:36:45.748587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5b44ab69-cf8b-4f99-9f5f-bf2eb669785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:45.975182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44ab69-cf8b-4f99-9f5f-bf2eb669785d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:36:46.021896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:46.127223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ef40a-f53b-468a-a0b8-68e93b08b3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:36:46.127933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ef40a-f53b-468a-a0b8-68e93b08b3e6 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:36:46.128213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ef40a-f53b-468a-a0b8-68e93b08b3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:36:46.128489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ef40a-f53b-468a-a0b8-68e93b08b3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:36:46.132586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-456ef40a-f53b-468a-a0b8-68e93b08b3e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:36:46.158946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ef40a-f53b-468a-a0b8-68e93b08b3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:36:46.163081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ef40a-f53b-468a-a0b8-68e93b08b3e6 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:36:46.210231 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1703/3419] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:36:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:36:55.664573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=22,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:56.190350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=23 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:05.099884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a907f-b128-4fb0-addc-562f2e9075b7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:05.100459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a907f-b128-4fb0-addc-562f2e9075b7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:05.100459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a907f-b128-4fb0-addc-562f2e9075b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:05.171669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cb2a907f-b128-4fb0-addc-562f2e9075b7 None None] MFA Rules not processed for user `065c5a92f9c04400be8a515e8233fb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:05.176604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cb2a907f-b128-4fb0-addc-562f2e9075b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:05.427673 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1717/3420] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:08.785250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf008f-1c32-4a13-b569-400bebf0e718 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:08.786474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf008f-1c32-4a13-b569-400bebf0e718 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:08.786910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf008f-1c32-4a13-b569-400bebf0e718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:08.854631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-97cf008f-1c32-4a13-b569-400bebf0e718 None None] MFA Rules not processed for user `c631f558d99f40feb637f376bac1cffa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:08.856438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-97cf008f-1c32-4a13-b569-400bebf0e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:08.923877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7ba92-7be7-4339-8dff-4bb0578b7c8d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:08.923877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7ba92-7be7-4339-8dff-4bb0578b7c8d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:08.923877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7ba92-7be7-4339-8dff-4bb0578b7c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:08.977863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c8a7ba92-7be7-4339-8dff-4bb0578b7c8d None None] MFA Rules not processed for user `3a22eebaed5147cfaa130838d566e75f`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:08.979678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c8a7ba92-7be7-4339-8dff-4bb0578b7c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:09.187907 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1704/3421] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:09.189783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3afca9-534a-4726-b67b-8214a3491d2e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:09.190061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3afca9-534a-4726-b67b-8214a3491d2e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:09.190337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3afca9-534a-4726-b67b-8214a3491d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:09.205799 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1718/3422] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:37:09.210832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7ba92-7be7-4339-8dff-4bb0578b7c8d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:09.212476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c8a7ba92-7be7-4339-8dff-4bb0578b7c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:09.223775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5f3afca9-534a-4726-b67b-8214a3491d2e None None] MFA Rules not processed for user `c631f558d99f40feb637f376bac1cffa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:09.227842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5f3afca9-534a-4726-b67b-8214a3491d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:09.247011 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1705/3423] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:37:09.401246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7ba92-7be7-4339-8dff-4bb0578b7c8d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:09.407628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60108a-f413-4ba6-bc31-886279cc8d0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:09.408256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60108a-f413-4ba6-bc31-886279cc8d0b service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:09.410522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60108a-f413-4ba6-bc31-886279cc8d0b service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:09.413112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60108a-f413-4ba6-bc31-886279cc8d0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:09.424033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3afca9-534a-4726-b67b-8214a3491d2e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:09.449502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3afca9-534a-4726-b67b-8214a3491d2e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:09.458389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60108a-f413-4ba6-bc31-886279cc8d0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:09.459879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60108a-f413-4ba6-bc31-886279cc8d0b service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:09.477401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d232983-cbfd-4bbd-9fb9-923f7f0fe312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:09.478351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232983-cbfd-4bbd-9fb9-923f7f0fe312 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:09.478824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232983-cbfd-4bbd-9fb9-923f7f0fe312 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:09.479103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232983-cbfd-4bbd-9fb9-923f7f0fe312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:09.513002 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1719/3424] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:09.515487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d232983-cbfd-4bbd-9fb9-923f7f0fe312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:09.520701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d232983-cbfd-4bbd-9fb9-923f7f0fe312 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:09.555085 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1706/3425] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:37:10.913969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60108a-f413-4ba6-bc31-886279cc8d0b service glance] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:10.954103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d232983-cbfd-4bbd-9fb9-923f7f0fe312 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:10.956103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7d232983-cbfd-4bbd-9fb9-923f7f0fe312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:11.045923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:11.097829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60108a-f413-4ba6-bc31-886279cc8d0b service glance] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:11.105156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e3109-14c9-4182-a8a6-2152b03c77e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:11.106410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e3109-14c9-4182-a8a6-2152b03c77e6 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:11.108529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e3109-14c9-4182-a8a6-2152b03c77e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:11.109270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e3109-14c9-4182-a8a6-2152b03c77e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:11.111726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4f6e3109-14c9-4182-a8a6-2152b03c77e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:11.143763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e3109-14c9-4182-a8a6-2152b03c77e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:11.148371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e3109-14c9-4182-a8a6-2152b03c77e6 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:11.183800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d232983-cbfd-4bbd-9fb9-923f7f0fe312 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:11.185155 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1720/3426] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:11.199844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f68d9f-be45-4ce4-8ff7-ef78c646592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:11.202335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f68d9f-be45-4ce4-8ff7-ef78c646592e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:11.202851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f68d9f-be45-4ce4-8ff7-ef78c646592e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:11.203525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f68d9f-be45-4ce4-8ff7-ef78c646592e admin admin] PATH_INFO: `/v3/users/736591425d2d40cda2331153600f20df` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:11.206487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f68d9f-be45-4ce4-8ff7-ef78c646592e admin admin] RBAC: Authorizing `identity:delete_user(user_id=736591425d2d40cda2331153600f20df)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:11.212645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f68d9f-be45-4ce4-8ff7-ef78c646592e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:11.348562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-71f68d9f-be45-4ce4-8ff7-ef78c646592e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736591425d2d40cda2331153600f20df'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:11.353129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-71f68d9f-be45-4ce4-8ff7-ef78c646592e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736591425d2d40cda2331153600f20df'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:11.383788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-71f68d9f-be45-4ce4-8ff7-ef78c646592e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736591425d2d40cda2331153600f20df'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:11.406430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-71f68d9f-be45-4ce4-8ff7-ef78c646592e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736591425d2d40cda2331153600f20df'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:11.408139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:11.438320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-71f68d9f-be45-4ce4-8ff7-ef78c646592e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736591425d2d40cda2331153600f20df'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:11.449011 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1707/3427] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:10 2022] DELETE /identity/v3/users/736591425d2d40cda2331153600f20df => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:37:12.778083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9db2-4201-4c9c-b043-262e41feb286 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:12.780536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9db2-4201-4c9c-b043-262e41feb286 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:12.780986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9db2-4201-4c9c-b043-262e41feb286 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:12.782985 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1721/3428] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:37:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:37:12.789806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c8b8f-1246-435f-8846-0833b6db6a37 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:12.790874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c8b8f-1246-435f-8846-0833b6db6a37 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:12.791325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c8b8f-1246-435f-8846-0833b6db6a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:12.886372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-129c8b8f-1246-435f-8846-0833b6db6a37 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:12.891032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-129c8b8f-1246-435f-8846-0833b6db6a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:13.128758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a9db2-4201-4c9c-b043-262e41feb286 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:13.139085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3c7a9db2-4201-4c9c-b043-262e41feb286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:13.140931 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1708/3429] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:13.268780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c8b8f-1246-435f-8846-0833b6db6a37 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:13.270784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-129c8b8f-1246-435f-8846-0833b6db6a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:13.292263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c8b8f-1246-435f-8846-0833b6db6a37 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:13.308914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec257b-49ec-4462-ade5-fdb0b9319fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:13.309802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec257b-49ec-4462-ade5-fdb0b9319fff service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:13.310221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec257b-49ec-4462-ade5-fdb0b9319fff service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:13.310666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec257b-49ec-4462-ade5-fdb0b9319fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:13.344383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec257b-49ec-4462-ade5-fdb0b9319fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:13.353962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec257b-49ec-4462-ade5-fdb0b9319fff service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:13.394848 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1709/3430] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:13.490241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a9db2-4201-4c9c-b043-262e41feb286 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:13.533036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:13.538009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:13.538560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:13.539146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] PATH_INFO: `/v3/projects/fb4265e2a96c4b9ba49452d382cc413c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:13.542625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb4265e2a96c4b9ba49452d382cc413c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:13.550676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:13.739995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb4265e2a96c4b9ba49452d382cc413c', 'request_id': 'req-533fddf2-9179-4284-bee6-fd9cea78497f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:13.748870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb4265e2a96c4b9ba49452d382cc413c', 'request_id': 'req-533fddf2-9179-4284-bee6-fd9cea78497f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:13.787486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb4265e2a96c4b9ba49452d382cc413c', 'request_id': 'req-533fddf2-9179-4284-bee6-fd9cea78497f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:13.835181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] The token cache is being invalidate because project fb4265e2a96c4b9ba49452d382cc413c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:13.836037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:13.837353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-533fddf2-9179-4284-bee6-fd9cea78497f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:13.848785 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1722/3431] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:13 2022] DELETE /identity/v3/projects/fb4265e2a96c4b9ba49452d382cc413c => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:13.849368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89667c-8123-4b4d-84c5-43d6a9cc77d6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:13.849846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89667c-8123-4b4d-84c5-43d6a9cc77d6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:13.850230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89667c-8123-4b4d-84c5-43d6a9cc77d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:13.887096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7f89667c-8123-4b4d-84c5-43d6a9cc77d6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:13.891401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7f89667c-8123-4b4d-84c5-43d6a9cc77d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:14.058537 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1710/3432] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:37:14.067518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4393-e677-4b32-9fa1-8eb3cab65112 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:14.068702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4393-e677-4b32-9fa1-8eb3cab65112 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:14.069142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4393-e677-4b32-9fa1-8eb3cab65112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:14.162683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dbfe4393-e677-4b32-9fa1-8eb3cab65112 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:14.176523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dbfe4393-e677-4b32-9fa1-8eb3cab65112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:14.254614 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1723/3433] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:14.260107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89667c-8123-4b4d-84c5-43d6a9cc77d6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:14.287651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89667c-8123-4b4d-84c5-43d6a9cc77d6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:14.311971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627a34d-4b56-459a-af01-6cec698dacd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:14.313834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627a34d-4b56-459a-af01-6cec698dacd3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:14.315609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627a34d-4b56-459a-af01-6cec698dacd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:14.318421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627a34d-4b56-459a-af01-6cec698dacd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:14.318421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627a34d-4b56-459a-af01-6cec698dacd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:14.318640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627a34d-4b56-459a-af01-6cec698dacd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:14.331943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627a34d-4b56-459a-af01-6cec698dacd3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:14.396243 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1711/3434] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:14.401202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe4393-e677-4b32-9fa1-8eb3cab65112 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:14.415373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe4393-e677-4b32-9fa1-8eb3cab65112 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:14.449756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda0b3b-c5e6-493c-bea9-fc6fa0296994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:14.450622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0b3b-c5e6-493c-bea9-fc6fa0296994 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:14.451049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0b3b-c5e6-493c-bea9-fc6fa0296994 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:14.451491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0b3b-c5e6-493c-bea9-fc6fa0296994 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:14.452700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda0b3b-c5e6-493c-bea9-fc6fa0296994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:14.455508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda0b3b-c5e6-493c-bea9-fc6fa0296994 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:14.510418 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1724/3435] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:14 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:14.515856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627a34d-4b56-459a-af01-6cec698dacd3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:14.544834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627a34d-4b56-459a-af01-6cec698dacd3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:14.891356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc5800-b52a-415e-aeac-1224006fa4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:14.891992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5800-b52a-415e-aeac-1224006fa4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:14.894251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5800-b52a-415e-aeac-1224006fa4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:14.897824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5800-b52a-415e-aeac-1224006fa4f2 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:14.898717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc5800-b52a-415e-aeac-1224006fa4f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:14.902604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc5800-b52a-415e-aeac-1224006fa4f2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:14.953904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:15.014600 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1712/3436] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:14 2022] POST /identity/v3/users => generated 288 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:15.015237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda0b3b-c5e6-493c-bea9-fc6fa0296994 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:15.042046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda0b3b-c5e6-493c-bea9-fc6fa0296994 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:15.074228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb024867-fbc6-4bca-af2c-973bc31a335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:15.074900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb024867-fbc6-4bca-af2c-973bc31a335e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:15.075169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb024867-fbc6-4bca-af2c-973bc31a335e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:15.075441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb024867-fbc6-4bca-af2c-973bc31a335e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:15.076107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb024867-fbc6-4bca-af2c-973bc31a335e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:15.085049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb024867-fbc6-4bca-af2c-973bc31a335e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:15.119697 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1725/3437] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:37:15.122165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc5800-b52a-415e-aeac-1224006fa4f2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:15.141626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc5800-b52a-415e-aeac-1224006fa4f2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:15.157101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b273c-014b-4913-8e62-8e4c2b670a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:15.157987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b273c-014b-4913-8e62-8e4c2b670a89 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:15.158375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b273c-014b-4913-8e62-8e4c2b670a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:15.158755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b273c-014b-4913-8e62-8e4c2b670a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:15.159523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b273c-014b-4913-8e62-8e4c2b670a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:15.161306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b273c-014b-4913-8e62-8e4c2b670a89 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:15.190783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb024867-fbc6-4bca-af2c-973bc31a335e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:15.194547 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1713/3438] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:15.211719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb024867-fbc6-4bca-af2c-973bc31a335e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:15.258385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71040198-273c-4661-b27d-21ffbcf92384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:15.259118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71040198-273c-4661-b27d-21ffbcf92384 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:15.259341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71040198-273c-4661-b27d-21ffbcf92384 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:15.259615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71040198-273c-4661-b27d-21ffbcf92384 admin admin] PATH_INFO: `/v3/projects/069a60f32d554f05b34f429706187490/users/48a7b8433888412abc328cbc3aea214b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:15.314281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71040198-273c-4661-b27d-21ffbcf92384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069a60f32d554f05b34f429706187490, user_id=48a7b8433888412abc328cbc3aea214b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:15.326418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71040198-273c-4661-b27d-21ffbcf92384 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:15.372905 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1726/3439] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:15 2022] PUT /identity/v3/projects/069a60f32d554f05b34f429706187490/users/48a7b8433888412abc328cbc3aea214b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:15.377208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b91c3-88db-492e-b890-db86b35af9a1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:15.378173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b91c3-88db-492e-b890-db86b35af9a1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:15.379932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b91c3-88db-492e-b890-db86b35af9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:15.457968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c08b91c3-88db-492e-b890-db86b35af9a1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:15.458980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c08b91c3-88db-492e-b890-db86b35af9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:15.617303 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1714/3440] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:15.672612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71040198-273c-4661-b27d-21ffbcf92384 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:15.674606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-71040198-273c-4661-b27d-21ffbcf92384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:15.681697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:15.919270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71040198-273c-4661-b27d-21ffbcf92384 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:15.951525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53220cdf-7b05-4894-81ed-5f6e915f6ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:15.952420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53220cdf-7b05-4894-81ed-5f6e915f6ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:15.952919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53220cdf-7b05-4894-81ed-5f6e915f6ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:15.956661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53220cdf-7b05-4894-81ed-5f6e915f6ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:15.984555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53220cdf-7b05-4894-81ed-5f6e915f6ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:15.989082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53220cdf-7b05-4894-81ed-5f6e915f6ca0 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:16.035424 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1727/3441] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:17.444087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949c58-5c8a-4c59-bdce-0b8feb9a01f4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:17.444668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949c58-5c8a-4c59-bdce-0b8feb9a01f4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:17.444748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949c58-5c8a-4c59-bdce-0b8feb9a01f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:17.515516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8e949c58-5c8a-4c59-bdce-0b8feb9a01f4 None None] MFA Rules not processed for user `065c5a92f9c04400be8a515e8233fb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:17.516754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8e949c58-5c8a-4c59-bdce-0b8feb9a01f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:17.750821 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1715/3442] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:37:19.796063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53220cdf-7b05-4894-81ed-5f6e915f6ca0 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:19.797826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-53220cdf-7b05-4894-81ed-5f6e915f6ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:19.825946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53220cdf-7b05-4894-81ed-5f6e915f6ca0 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:19.831755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cad119-e7d4-45be-af0a-97a7161af11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:19.833037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad119-e7d4-45be-af0a-97a7161af11a service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:19.833441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad119-e7d4-45be-af0a-97a7161af11a service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:19.833732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad119-e7d4-45be-af0a-97a7161af11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:19.835627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d7cad119-e7d4-45be-af0a-97a7161af11a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:19.906852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cad119-e7d4-45be-af0a-97a7161af11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:19.908320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cad119-e7d4-45be-af0a-97a7161af11a service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:19.932139 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1728/3443] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:22.119059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8793f-5071-4b2a-b5d4-a9208f528009 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:22.119991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8793f-5071-4b2a-b5d4-a9208f528009 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:22.120487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8793f-5071-4b2a-b5d4-a9208f528009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:22.202619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c4f8793f-5071-4b2a-b5d4-a9208f528009 None None] MFA Rules not processed for user `0b9bbdf34e904843ab7cd7b40bf3720d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:22.207025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c4f8793f-5071-4b2a-b5d4-a9208f528009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:22.417484 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1716/3444] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:22.812221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908ffdf-3667-47b9-a668-83d8550c4c01 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:22.812855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908ffdf-3667-47b9-a668-83d8550c4c01 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:22.813572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908ffdf-3667-47b9-a668-83d8550c4c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:22.843979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6908ffdf-3667-47b9-a668-83d8550c4c01 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:22.845928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6908ffdf-3667-47b9-a668-83d8550c4c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:22.966839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8793f-5071-4b2a-b5d4-a9208f528009 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:22.968657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c4f8793f-5071-4b2a-b5d4-a9208f528009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:22.977980 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1729/3445] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:37:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:37:23.012478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:23.086722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8793f-5071-4b2a-b5d4-a9208f528009 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:23.095192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65112d36-985b-444f-af6b-77ae206effef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:23.096014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65112d36-985b-444f-af6b-77ae206effef service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:23.096304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65112d36-985b-444f-af6b-77ae206effef service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:23.096583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65112d36-985b-444f-af6b-77ae206effef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:23.111284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65112d36-985b-444f-af6b-77ae206effef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:23.114066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65112d36-985b-444f-af6b-77ae206effef service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:23.132776 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1717/3446] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:37:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:29.582767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3283290-061b-4e3a-b169-5f4c8b422ca9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:29.583861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3283290-061b-4e3a-b169-5f4c8b422ca9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:29.584312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3283290-061b-4e3a-b169-5f4c8b422ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:29.641270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a3283290-061b-4e3a-b169-5f4c8b422ca9 None None] MFA Rules not processed for user `48a7b8433888412abc328cbc3aea214b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:29.643123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a3283290-061b-4e3a-b169-5f4c8b422ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:29.884868 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1730/3447] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:29.896368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65112d36-985b-444f-af6b-77ae206effef service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:29.898574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-65112d36-985b-444f-af6b-77ae206effef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:30.154870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65112d36-985b-444f-af6b-77ae206effef service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:30.178197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e04c54-b6ae-41d6-955a-9a76a2071d82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:30.178831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e04c54-b6ae-41d6-955a-9a76a2071d82 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:30.179115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e04c54-b6ae-41d6-955a-9a76a2071d82 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:30.179387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e04c54-b6ae-41d6-955a-9a76a2071d82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:30.215068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e04c54-b6ae-41d6-955a-9a76a2071d82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:30.217150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e04c54-b6ae-41d6-955a-9a76a2071d82 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:30.241718 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1718/3448] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:35.625822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3283290-061b-4e3a-b169-5f4c8b422ca9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:35.627379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a3283290-061b-4e3a-b169-5f4c8b422ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:35.661930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3283290-061b-4e3a-b169-5f4c8b422ca9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:35.692517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43fec1-4824-4afc-871e-4ebfc7811b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:35.693175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43fec1-4824-4afc-871e-4ebfc7811b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:35.693498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43fec1-4824-4afc-871e-4ebfc7811b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:35.695925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43fec1-4824-4afc-871e-4ebfc7811b01 admin admin] PATH_INFO: `/v3/users/a675ad19db254271ba12d2812d0732e3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:35.701259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43fec1-4824-4afc-871e-4ebfc7811b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a675ad19db254271ba12d2812d0732e3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:35.703264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43fec1-4824-4afc-871e-4ebfc7811b01 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:35.758200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:35.820447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-eb43fec1-4824-4afc-871e-4ebfc7811b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a675ad19db254271ba12d2812d0732e3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:35.821157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-eb43fec1-4824-4afc-871e-4ebfc7811b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a675ad19db254271ba12d2812d0732e3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:35.853050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-eb43fec1-4824-4afc-871e-4ebfc7811b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a675ad19db254271ba12d2812d0732e3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:35.854559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-eb43fec1-4824-4afc-871e-4ebfc7811b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a675ad19db254271ba12d2812d0732e3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:35.882653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-eb43fec1-4824-4afc-871e-4ebfc7811b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a675ad19db254271ba12d2812d0732e3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:35.919103 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1731/3449] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:35 2022] DELETE /identity/v3/users/a675ad19db254271ba12d2812d0732e3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:36.002085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e04c54-b6ae-41d6-955a-9a76a2071d82 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:36.003692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e7e04c54-b6ae-41d6-955a-9a76a2071d82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:36.040424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e04c54-b6ae-41d6-955a-9a76a2071d82 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:36.352344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:36.354523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:36.358651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:36.359316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] PATH_INFO: `/v3/users/8b2f1d48248d45fdb39ed3c1ee4b2734` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:36.361760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2f1d48248d45fdb39ed3c1ee4b2734)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:36.370741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:36.535341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:36.547706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2f1d48248d45fdb39ed3c1ee4b2734'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:36.550814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2f1d48248d45fdb39ed3c1ee4b2734'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:36.591302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2f1d48248d45fdb39ed3c1ee4b2734'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:36.612560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2f1d48248d45fdb39ed3c1ee4b2734'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:36.624084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2f1d48248d45fdb39ed3c1ee4b2734'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:36.641104 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1719/3450] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:36 2022] DELETE /identity/v3/users/8b2f1d48248d45fdb39ed3c1ee4b2734 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:36.642351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df532462-7909-4ccb-a5bc-c6b51e6ba30d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:36.642803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df532462-7909-4ccb-a5bc-c6b51e6ba30d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:36.642900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df532462-7909-4ccb-a5bc-c6b51e6ba30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:36.646869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:36.649423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:36.713514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-df532462-7909-4ccb-a5bc-c6b51e6ba30d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:36.715236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-df532462-7909-4ccb-a5bc-c6b51e6ba30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:36.762869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753ea14-190b-4737-a052-8569251483dc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:36.768653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:36.770134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:36.770533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:36.770957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] PATH_INFO: `/v3/projects/505ab4f3173b48559a5c25611af86fc7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:36.772325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] RBAC: Authorizing `identity:delete_project(project_id=505ab4f3173b48559a5c25611af86fc7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:36.775913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:36.859719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '505ab4f3173b48559a5c25611af86fc7', 'request_id': 'req-46626a94-b3f7-41c4-b171-1fe44a0bc21e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:36.867584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '505ab4f3173b48559a5c25611af86fc7', 'request_id': 'req-46626a94-b3f7-41c4-b171-1fe44a0bc21e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:36.883177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '505ab4f3173b48559a5c25611af86fc7', 'request_id': 'req-46626a94-b3f7-41c4-b171-1fe44a0bc21e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:36.903800 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1732/3451] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:37:36.919583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] The token cache is being invalidate because project 505ab4f3173b48559a5c25611af86fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:36.920036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:36.921130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:36.928901 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1720/3452] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:36 2022] DELETE /identity/v3/projects/505ab4f3173b48559a5c25611af86fc7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:36.929717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7490a-c6b2-4164-9cc5-24b83a543d70 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:36.930209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7490a-c6b2-4164-9cc5-24b83a543d70 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:36.930632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7490a-c6b2-4164-9cc5-24b83a543d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:36.940037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:36.942213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:36.981517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-35c7490a-c6b2-4164-9cc5-24b83a543d70 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:36.982682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-35c7490a-c6b2-4164-9cc5-24b83a543d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:37.082904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46626a94-b3f7-41c4-b171-1fe44a0bc21e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:37.087938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88753ed7-94e5-4d2a-82e5-39e650ad24b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:37.088653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88753ed7-94e5-4d2a-82e5-39e650ad24b4 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:37.089036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88753ed7-94e5-4d2a-82e5-39e650ad24b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:37.089407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88753ed7-94e5-4d2a-82e5-39e650ad24b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:37.091457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-88753ed7-94e5-4d2a-82e5-39e650ad24b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:37.104990 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1733/3453] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:37.106524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee512fba-06d9-4e77-ab15-873dab6de276 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:37.106976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee512fba-06d9-4e77-ab15-873dab6de276 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:37.107548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee512fba-06d9-4e77-ab15-873dab6de276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:37.136687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:37.142240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88753ed7-94e5-4d2a-82e5-39e650ad24b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:37.143909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88753ed7-94e5-4d2a-82e5-39e650ad24b4 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:37.144033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ee512fba-06d9-4e77-ab15-873dab6de276 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:37.145364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ee512fba-06d9-4e77-ab15-873dab6de276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:37.158847 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1721/3454] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:37.168526 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1734/3455] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:37.172433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88753ed7-94e5-4d2a-82e5-39e650ad24b4 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:37.183358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88753ed7-94e5-4d2a-82e5-39e650ad24b4 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:37.188682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e7586-418d-437f-9008-078a5a3ebf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:37.189486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7586-418d-437f-9008-078a5a3ebf33 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:37.189871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7586-418d-437f-9008-078a5a3ebf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:37.190253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7586-418d-437f-9008-078a5a3ebf33 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:37.191016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e7586-418d-437f-9008-078a5a3ebf33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:37.191998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e7586-418d-437f-9008-078a5a3ebf33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:37.193761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e7586-418d-437f-9008-078a5a3ebf33 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:37.210409 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1722/3456] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:37:37.214368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee512fba-06d9-4e77-ab15-873dab6de276 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:37.224354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee512fba-06d9-4e77-ab15-873dab6de276 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:37.232275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28820c57-b41b-40a6-9bc2-24651cec0540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:37.232275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28820c57-b41b-40a6-9bc2-24651cec0540 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:37.232275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28820c57-b41b-40a6-9bc2-24651cec0540 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:37.232275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28820c57-b41b-40a6-9bc2-24651cec0540 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:37.232799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28820c57-b41b-40a6-9bc2-24651cec0540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:37.233756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28820c57-b41b-40a6-9bc2-24651cec0540 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:37.281579 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1735/3457] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:37 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:37.284825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e7586-418d-437f-9008-078a5a3ebf33 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:37.300018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e7586-418d-437f-9008-078a5a3ebf33 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:37.459609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4917e8-5f94-45b6-b744-51917066248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:37.461806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4917e8-5f94-45b6-b744-51917066248c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:37.462328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4917e8-5f94-45b6-b744-51917066248c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:37.462910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4917e8-5f94-45b6-b744-51917066248c admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:37.463611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4917e8-5f94-45b6-b744-51917066248c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:37.466968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4917e8-5f94-45b6-b744-51917066248c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:37.518532 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1723/3458] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:37 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:37.522592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28820c57-b41b-40a6-9bc2-24651cec0540 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:37.548668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28820c57-b41b-40a6-9bc2-24651cec0540 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:37.560563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4917e8-5f94-45b6-b744-51917066248c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:37.562885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cd4917e8-5f94-45b6-b744-51917066248c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:37.584651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4917e8-5f94-45b6-b744-51917066248c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:37.586863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87bfb-8fbd-4eae-9fa6-e1c86cc1f286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:37.587496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87bfb-8fbd-4eae-9fa6-e1c86cc1f286 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:37.587775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87bfb-8fbd-4eae-9fa6-e1c86cc1f286 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:37.588044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87bfb-8fbd-4eae-9fa6-e1c86cc1f286 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:37.593656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:37.598444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:37.600254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:37.601169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] PATH_INFO: `/v3/projects/4e12170916e24a33ab0ad5309ac2ab21` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:37.603619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d87bfb-8fbd-4eae-9fa6-e1c86cc1f286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:37.604173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e12170916e24a33ab0ad5309ac2ab21)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:37.607253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:37.608385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d87bfb-8fbd-4eae-9fa6-e1c86cc1f286 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:37.622973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:37.650624 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1736/3459] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:37.651698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87bfb-8fbd-4eae-9fa6-e1c86cc1f286 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:37.667268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87bfb-8fbd-4eae-9fa6-e1c86cc1f286 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:37.698320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e12170916e24a33ab0ad5309ac2ab21', 'request_id': 'req-2c3a8967-05f3-4bdf-8594-506e729a69fa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:37.712757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e12170916e24a33ab0ad5309ac2ab21', 'request_id': 'req-2c3a8967-05f3-4bdf-8594-506e729a69fa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:37.738207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e12170916e24a33ab0ad5309ac2ab21', 'request_id': 'req-2c3a8967-05f3-4bdf-8594-506e729a69fa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:37.787884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] The token cache is being invalidate because project 4e12170916e24a33ab0ad5309ac2ab21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:37.788604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:37.791207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c3a8967-05f3-4bdf-8594-506e729a69fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:37.798123 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1724/3460] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:37 2022] DELETE /identity/v3/projects/4e12170916e24a33ab0ad5309ac2ab21 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:37.800878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4e3a-2155-478f-b83d-f0f42e3edf72 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:37.802993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4e3a-2155-478f-b83d-f0f42e3edf72 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:37.804432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c4e3a-2155-478f-b83d-f0f42e3edf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:37.832929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39abdfe-2669-493f-b07d-3ff771d44225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:37.833766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39abdfe-2669-493f-b07d-3ff771d44225 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:37.834111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39abdfe-2669-493f-b07d-3ff771d44225 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:37.834639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39abdfe-2669-493f-b07d-3ff771d44225 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:37.835389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39abdfe-2669-493f-b07d-3ff771d44225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:37.837359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39abdfe-2669-493f-b07d-3ff771d44225 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:37.843757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fb5c4e3a-2155-478f-b83d-f0f42e3edf72 None None] MFA Rules not processed for user `48a7b8433888412abc328cbc3aea214b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:37.845545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fb5c4e3a-2155-478f-b83d-f0f42e3edf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:37.852623 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1737/3461] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:37.856600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39abdfe-2669-493f-b07d-3ff771d44225 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:37.866725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b39abdfe-2669-493f-b07d-3ff771d44225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:37.885023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39abdfe-2669-493f-b07d-3ff771d44225 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:37.891409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efbd57-5c8c-4714-bf9d-63bd25d7da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:37.892266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efbd57-5c8c-4714-bf9d-63bd25d7da66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:37.892874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efbd57-5c8c-4714-bf9d-63bd25d7da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:37.893258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efbd57-5c8c-4714-bf9d-63bd25d7da66 admin admin] PATH_INFO: `/v3/users/b2bfb928bb804952a9051449e1489cd4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:37.896802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efbd57-5c8c-4714-bf9d-63bd25d7da66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2bfb928bb804952a9051449e1489cd4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:37.898996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efbd57-5c8c-4714-bf9d-63bd25d7da66 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:37.959490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:38.048198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53efbd57-5c8c-4714-bf9d-63bd25d7da66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2bfb928bb804952a9051449e1489cd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:38.048954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53efbd57-5c8c-4714-bf9d-63bd25d7da66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2bfb928bb804952a9051449e1489cd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:38.064363 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1725/3462] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:38.066675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4e3a-2155-478f-b83d-f0f42e3edf72 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:38.070848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fb5c4e3a-2155-478f-b83d-f0f42e3edf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:38.080851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53efbd57-5c8c-4714-bf9d-63bd25d7da66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2bfb928bb804952a9051449e1489cd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:38.084557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53efbd57-5c8c-4714-bf9d-63bd25d7da66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2bfb928bb804952a9051449e1489cd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:38.103176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c4e3a-2155-478f-b83d-f0f42e3edf72 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:38.104558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53efbd57-5c8c-4714-bf9d-63bd25d7da66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2bfb928bb804952a9051449e1489cd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:38.108814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808724ac-47ba-4404-b60d-4cfb4d4e7f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:38.109382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808724ac-47ba-4404-b60d-4cfb4d4e7f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:38.109799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808724ac-47ba-4404-b60d-4cfb4d4e7f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:38.110139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808724ac-47ba-4404-b60d-4cfb4d4e7f93 admin admin] PATH_INFO: `/v3/projects/fbe0e5fcbfed48aaaac38493038900d5/users/d900c75dc1dd4f5d9cac369d156e2745/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:38.136661 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1738/3463] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:37:37 2022] DELETE /identity/v3/users/b2bfb928bb804952a9051449e1489cd4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:38.143234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808724ac-47ba-4404-b60d-4cfb4d4e7f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe0e5fcbfed48aaaac38493038900d5, user_id=d900c75dc1dd4f5d9cac369d156e2745, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:38.146546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808724ac-47ba-4404-b60d-4cfb4d4e7f93 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:38.180171 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1726/3464] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:38 2022] PUT /identity/v3/projects/fbe0e5fcbfed48aaaac38493038900d5/users/d900c75dc1dd4f5d9cac369d156e2745/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:38.185554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f64a8-c50d-454b-b3ad-49e941a422f5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:38.186093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f64a8-c50d-454b-b3ad-49e941a422f5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:38.186489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f64a8-c50d-454b-b3ad-49e941a422f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:38.224339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-883f64a8-c50d-454b-b3ad-49e941a422f5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:38.226218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-883f64a8-c50d-454b-b3ad-49e941a422f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:38.318542 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1739/3465] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:38.330023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808724ac-47ba-4404-b60d-4cfb4d4e7f93 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:38.332788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-808724ac-47ba-4404-b60d-4cfb4d4e7f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:38.452382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808724ac-47ba-4404-b60d-4cfb4d4e7f93 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:38.458917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9881581-47bd-4ef2-be4a-1bc4f161e112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:38.459563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881581-47bd-4ef2-be4a-1bc4f161e112 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:38.459848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881581-47bd-4ef2-be4a-1bc4f161e112 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:38.460129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881581-47bd-4ef2-be4a-1bc4f161e112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:38.485641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9881581-47bd-4ef2-be4a-1bc4f161e112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:38.487260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9881581-47bd-4ef2-be4a-1bc4f161e112 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:38.510521 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1727/3466] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:38.670346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f64a8-c50d-454b-b3ad-49e941a422f5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:38.671865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-883f64a8-c50d-454b-b3ad-49e941a422f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:38.717584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f64a8-c50d-454b-b3ad-49e941a422f5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:38.748497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:38.749217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:38.749524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:38.749796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] PATH_INFO: `/v3/projects/27712ebbd794448681471a673a8de9da` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:38.752928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=27712ebbd794448681471a673a8de9da)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:38.760331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:38.764091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:38.828894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27712ebbd794448681471a673a8de9da', 'request_id': 'req-3078c481-8e38-42d0-ad85-33300519ad5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:38.837766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27712ebbd794448681471a673a8de9da', 'request_id': 'req-3078c481-8e38-42d0-ad85-33300519ad5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:38.849367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27712ebbd794448681471a673a8de9da', 'request_id': 'req-3078c481-8e38-42d0-ad85-33300519ad5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:38.871424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] The token cache is being invalidate because project 27712ebbd794448681471a673a8de9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:37:38.871715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:38.872526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3078c481-8e38-42d0-ad85-33300519ad5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:37:38.882442 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1740/3467] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:37:38 2022] DELETE /identity/v3/projects/27712ebbd794448681471a673a8de9da => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:38.886279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ca8e-452f-47c3-baff-53258ebfe0a4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:38.886476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ca8e-452f-47c3-baff-53258ebfe0a4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:38.886743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ca8e-452f-47c3-baff-53258ebfe0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:38.946679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-15e2ca8e-452f-47c3-baff-53258ebfe0a4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:38.950020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-15e2ca8e-452f-47c3-baff-53258ebfe0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:39.119134 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1728/3468] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:39.123364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5f38-ccdd-4535-ab84-5417557a8502 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:39.123803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5f38-ccdd-4535-ab84-5417557a8502 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:39.124357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5f38-ccdd-4535-ab84-5417557a8502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:39.154500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8b9a5f38-ccdd-4535-ab84-5417557a8502 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:39.155862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8b9a5f38-ccdd-4535-ab84-5417557a8502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:39.168964 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1741/3469] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:39.173130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2ca8e-452f-47c3-baff-53258ebfe0a4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:39.186736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2ca8e-452f-47c3-baff-53258ebfe0a4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:39.196486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade8d0-c1d5-4974-ba91-2999c1ec70c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:39.197487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade8d0-c1d5-4974-ba91-2999c1ec70c7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:39.198003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade8d0-c1d5-4974-ba91-2999c1ec70c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:39.199006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade8d0-c1d5-4974-ba91-2999c1ec70c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:39.200108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaade8d0-c1d5-4974-ba91-2999c1ec70c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:37:39.200573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaade8d0-c1d5-4974-ba91-2999c1ec70c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:39.204671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaade8d0-c1d5-4974-ba91-2999c1ec70c7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:39.211145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a5f38-ccdd-4535-ab84-5417557a8502 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:39.212990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8b9a5f38-ccdd-4535-ab84-5417557a8502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:39.222413 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1729/3470] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:37:39.235091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade8d0-c1d5-4974-ba91-2999c1ec70c7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:39.270369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade8d0-c1d5-4974-ba91-2999c1ec70c7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:39.284816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c810f-e6db-41c0-adbd-89dfcd259dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:39.286430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c810f-e6db-41c0-adbd-89dfcd259dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:39.287995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c810f-e6db-41c0-adbd-89dfcd259dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:39.288402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c810f-e6db-41c0-adbd-89dfcd259dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:39.290404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c810f-e6db-41c0-adbd-89dfcd259dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:39.294341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c810f-e6db-41c0-adbd-89dfcd259dc5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:39.352573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a5f38-ccdd-4535-ab84-5417557a8502 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:39.362600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1ac9a-01cc-4f2b-9627-9810422ac800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:39.363281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1ac9a-01cc-4f2b-9627-9810422ac800 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:39.363528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1ac9a-01cc-4f2b-9627-9810422ac800 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:39.363801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1ac9a-01cc-4f2b-9627-9810422ac800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:39.367314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3dc1ac9a-01cc-4f2b-9627-9810422ac800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:39.382838 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1730/3471] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:37:39 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:39.385186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c810f-e6db-41c0-adbd-89dfcd259dc5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:39.402193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1ac9a-01cc-4f2b-9627-9810422ac800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:39.404259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1ac9a-01cc-4f2b-9627-9810422ac800 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:39.421078 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1742/3472] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:37:39.485256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:39.507804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c810f-e6db-41c0-adbd-89dfcd259dc5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:39.517815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179eca1-7de1-4229-80ce-1bc5ec66a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:39.519049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179eca1-7de1-4229-80ce-1bc5ec66a22f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:39.520415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179eca1-7de1-4229-80ce-1bc5ec66a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:39.520946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179eca1-7de1-4229-80ce-1bc5ec66a22f admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:39.522092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179eca1-7de1-4229-80ce-1bc5ec66a22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:39.524583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179eca1-7de1-4229-80ce-1bc5ec66a22f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:39.566192 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1731/3473] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:37:39 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:37:39.568205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1ac9a-01cc-4f2b-9627-9810422ac800 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:39.588860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1ac9a-01cc-4f2b-9627-9810422ac800 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:39.599510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf853cb1-8c5c-4904-ae37-7c8b54202c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:39.600599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf853cb1-8c5c-4904-ae37-7c8b54202c4b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:39.600939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf853cb1-8c5c-4904-ae37-7c8b54202c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:39.601561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf853cb1-8c5c-4904-ae37-7c8b54202c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:39.602526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf853cb1-8c5c-4904-ae37-7c8b54202c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:39.604973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf853cb1-8c5c-4904-ae37-7c8b54202c4b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:39.652674 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1743/3474] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:39.653044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179eca1-7de1-4229-80ce-1bc5ec66a22f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:39.667824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179eca1-7de1-4229-80ce-1bc5ec66a22f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:39.697831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d64930-d617-4c03-ae6e-844336cfcdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:39.701143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64930-d617-4c03-ae6e-844336cfcdab admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:39.701453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64930-d617-4c03-ae6e-844336cfcdab admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:39.701739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64930-d617-4c03-ae6e-844336cfcdab admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:39.702461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d64930-d617-4c03-ae6e-844336cfcdab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:39.710060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d64930-d617-4c03-ae6e-844336cfcdab admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:39.724591 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1732/3475] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:37:39.728215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf853cb1-8c5c-4904-ae37-7c8b54202c4b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:39.747958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf853cb1-8c5c-4904-ae37-7c8b54202c4b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:39.764318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0140a-5cbc-475f-9a5d-08a7919111e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:39.765869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0140a-5cbc-475f-9a5d-08a7919111e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:39.767088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0140a-5cbc-475f-9a5d-08a7919111e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:39.768269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0140a-5cbc-475f-9a5d-08a7919111e1 admin admin] PATH_INFO: `/v3/projects/2cc7a1d46df542979c99fe07a65961cb/users/3481331d8f7745abbd1de6916f7f4c36/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:39.806161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0140a-5cbc-475f-9a5d-08a7919111e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc7a1d46df542979c99fe07a65961cb, user_id=3481331d8f7745abbd1de6916f7f4c36, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:39.814077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0140a-5cbc-475f-9a5d-08a7919111e1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:39.839625 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1744/3476] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:37:39 2022] PUT /identity/v3/projects/2cc7a1d46df542979c99fe07a65961cb/users/3481331d8f7745abbd1de6916f7f4c36/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:37:39.846173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983016bb-8bd5-4f59-815e-e7eec62fb48d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:39.846545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983016bb-8bd5-4f59-815e-e7eec62fb48d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:39.847077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983016bb-8bd5-4f59-815e-e7eec62fb48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:39.899934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-983016bb-8bd5-4f59-815e-e7eec62fb48d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:39.901275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-983016bb-8bd5-4f59-815e-e7eec62fb48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:40.087538 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1733/3477] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:40.100001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0140a-5cbc-475f-9a5d-08a7919111e1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:40.292778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0140a-5cbc-475f-9a5d-08a7919111e1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:40.300141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70527497-79b4-42f7-b8a7-3030b82066cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:40.301742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527497-79b4-42f7-b8a7-3030b82066cd service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:40.301742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527497-79b4-42f7-b8a7-3030b82066cd service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:40.301938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527497-79b4-42f7-b8a7-3030b82066cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:40.319910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:40.324556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70527497-79b4-42f7-b8a7-3030b82066cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:40.330193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70527497-79b4-42f7-b8a7-3030b82066cd service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:40.358212 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1745/3478] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:42.969929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7485-a4c3-4222-9a50-baced91b2a87 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:42.970652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7485-a4c3-4222-9a50-baced91b2a87 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:42.970652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7485-a4c3-4222-9a50-baced91b2a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.022697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a5ab7485-a4c3-4222-9a50-baced91b2a87 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:43.029022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a5ab7485-a4c3-4222-9a50-baced91b2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.191157 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1734/3479] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:43.208064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70527497-79b4-42f7-b8a7-3030b82066cd service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:43.209637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-70527497-79b4-42f7-b8a7-3030b82066cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:43.425554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70527497-79b4-42f7-b8a7-3030b82066cd service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:43.442377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ae83e-15ad-4e86-a954-466a0968fda8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:43.442999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ae83e-15ad-4e86-a954-466a0968fda8 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:43.443281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ae83e-15ad-4e86-a954-466a0968fda8 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:43.443743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ae83e-15ad-4e86-a954-466a0968fda8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:43.468998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ae83e-15ad-4e86-a954-466a0968fda8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:43.470646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ae83e-15ad-4e86-a954-466a0968fda8 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:43.491840 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1746/3480] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:37:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:46.277822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c3b8b-1cbd-47af-8000-9a3c0a8a8656 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:46.278286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c3b8b-1cbd-47af-8000-9a3c0a8a8656 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:46.278409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c3b8b-1cbd-47af-8000-9a3c0a8a8656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:46.338929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a45c3b8b-1cbd-47af-8000-9a3c0a8a8656 None None] MFA Rules not processed for user `065c5a92f9c04400be8a515e8233fb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:46.340096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a45c3b8b-1cbd-47af-8000-9a3c0a8a8656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:46.512556 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1735/3481] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:47.603353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ae83e-15ad-4e86-a954-466a0968fda8 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:47.603353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ef2ae83e-15ad-4e86-a954-466a0968fda8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.610108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95005c2-a6fc-448a-8678-a28b1edc82b6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.611016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95005c2-a6fc-448a-8678-a28b1edc82b6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.611676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95005c2-a6fc-448a-8678-a28b1edc82b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.634167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a95005c2-a6fc-448a-8678-a28b1edc82b6 None None] MFA Rules not processed for user `0b9bbdf34e904843ab7cd7b40bf3720d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:47.635763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a95005c2-a6fc-448a-8678-a28b1edc82b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:47.645816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:47.772019 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1736/3482] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:37:47.873142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ae83e-15ad-4e86-a954-466a0968fda8 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:47.908650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02408e66-7f08-4c28-a01e-2f77eaea5bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:47.913546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02408e66-7f08-4c28-a01e-2f77eaea5bb4 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:47.915679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02408e66-7f08-4c28-a01e-2f77eaea5bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:47.916162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02408e66-7f08-4c28-a01e-2f77eaea5bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:47.921809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-02408e66-7f08-4c28-a01e-2f77eaea5bb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:48.101426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02408e66-7f08-4c28-a01e-2f77eaea5bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:48.112638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02408e66-7f08-4c28-a01e-2f77eaea5bb4 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:48.174673 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1747/3483] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:53.766573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8c66-da58-43a7-b9ca-9a2d2a8b748e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:53.767381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8c66-da58-43a7-b9ca-9a2d2a8b748e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:53.767805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8c66-da58-43a7-b9ca-9a2d2a8b748e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:53.795052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3b5b8c66-da58-43a7-b9ca-9a2d2a8b748e None None] MFA Rules not processed for user `26cfb36460a54faca6f9a512c9329d25`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:53.796909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3b5b8c66-da58-43a7-b9ca-9a2d2a8b748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:53.807512 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1737/3484] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:58.151173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:59.054748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0eb87-a5c4-4248-9e1c-caffe91153f8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.055069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0eb87-a5c4-4248-9e1c-caffe91153f8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.055707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0eb87-a5c4-4248-9e1c-caffe91153f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.112602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f3d0eb87-a5c4-4248-9e1c-caffe91153f8 None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:59.119804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f3d0eb87-a5c4-4248-9e1c-caffe91153f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:59.337034 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1748/3485] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:59.349860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87134840-d4dc-4070-a459-5115a9931e75 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.350375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87134840-d4dc-4070-a459-5115a9931e75 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.350471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87134840-d4dc-4070-a459-5115a9931e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.414625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-87134840-d4dc-4070-a459-5115a9931e75 None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:37:59.441822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-87134840-d4dc-4070-a459-5115a9931e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:59.479007 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1738/3486] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:37:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:37:59.820262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0eb87-a5c4-4248-9e1c-caffe91153f8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:37:59.822205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f3d0eb87-a5c4-4248-9e1c-caffe91153f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:37:59.858638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0eb87-a5c4-4248-9e1c-caffe91153f8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:37:59.882401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47df921-2a82-4d31-a751-0e17bb5054c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:37:59.883387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df921-2a82-4d31-a751-0e17bb5054c6 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:37:59.883897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df921-2a82-4d31-a751-0e17bb5054c6 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:37:59.884382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df921-2a82-4d31-a751-0e17bb5054c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:37:59.912493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47df921-2a82-4d31-a751-0e17bb5054c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:37:59.915387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47df921-2a82-4d31-a751-0e17bb5054c6 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:37:59.970943 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1749/3487] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:37:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:00.511785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868ec8f-20ab-4663-9321-e822fd239cf0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:00.512297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868ec8f-20ab-4663-9321-e822fd239cf0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:00.512499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868ec8f-20ab-4663-9321-e822fd239cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:00.614113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1868ec8f-20ab-4663-9321-e822fd239cf0 None None] MFA Rules not processed for user `3481331d8f7745abbd1de6916f7f4c36`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:00.621062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1868ec8f-20ab-4663-9321-e822fd239cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:00.874157 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1739/3488] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:01.230295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187aec8-bf06-49fd-b818-0223f4b850dc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:01.230852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187aec8-bf06-49fd-b818-0223f4b850dc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:01.231745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187aec8-bf06-49fd-b818-0223f4b850dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:01.272245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0187aec8-bf06-49fd-b818-0223f4b850dc None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:01.275831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0187aec8-bf06-49fd-b818-0223f4b850dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:01.297172 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1750/3489] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:01.318054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868ec8f-20ab-4663-9321-e822fd239cf0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:01.337612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868ec8f-20ab-4663-9321-e822fd239cf0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:01.351219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a77ce3-f011-4098-86c5-f9a7e6f3711c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:01.352702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a77ce3-f011-4098-86c5-f9a7e6f3711c service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:01.353170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a77ce3-f011-4098-86c5-f9a7e6f3711c service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:01.353623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a77ce3-f011-4098-86c5-f9a7e6f3711c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:01.384399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a77ce3-f011-4098-86c5-f9a7e6f3711c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:01.387220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a77ce3-f011-4098-86c5-f9a7e6f3711c service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:01.428076 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1740/3490] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:38:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:03.490174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187aec8-bf06-49fd-b818-0223f4b850dc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:03.521780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187aec8-bf06-49fd-b818-0223f4b850dc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:03.549100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9352b8-1a7e-4fae-937f-c33f5a440163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:03.554392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9352b8-1a7e-4fae-937f-c33f5a440163 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:03.567192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9352b8-1a7e-4fae-937f-c33f5a440163 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:03.567892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9352b8-1a7e-4fae-937f-c33f5a440163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:03.609945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9352b8-1a7e-4fae-937f-c33f5a440163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:03.614586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9352b8-1a7e-4fae-937f-c33f5a440163 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:03.697876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1751/3491] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:11.418351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=63 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:13.269857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbbb32-a542-4f47-ae4c-4b3a2f49d7c7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:13.270530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbbb32-a542-4f47-ae4c-4b3a2f49d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:13.270696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbbb32-a542-4f47-ae4c-4b3a2f49d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:13.354856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6ebbbb32-a542-4f47-ae4c-4b3a2f49d7c7 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:13.359874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6ebbbb32-a542-4f47-ae4c-4b3a2f49d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:13.392317 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1741/3492] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:38:13.409161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9352b8-1a7e-4fae-937f-c33f5a440163 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:13.430021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9352b8-1a7e-4fae-937f-c33f5a440163 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:13.447338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1927380-9f6c-4de4-8171-bdb8aa713d9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:13.448266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1927380-9f6c-4de4-8171-bdb8aa713d9b service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:13.448710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1927380-9f6c-4de4-8171-bdb8aa713d9b service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:13.449193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1927380-9f6c-4de4-8171-bdb8aa713d9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:13.481594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1927380-9f6c-4de4-8171-bdb8aa713d9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:13.486990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1927380-9f6c-4de4-8171-bdb8aa713d9b service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:13.525416 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1752/3493] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:38:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:38:15.055910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e04a41-882d-4122-af02-5d333de0b8b4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:15.056915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e04a41-882d-4122-af02-5d333de0b8b4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:15.057424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e04a41-882d-4122-af02-5d333de0b8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:15.091891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-72e04a41-882d-4122-af02-5d333de0b8b4 None None] MFA Rules not processed for user `c631f558d99f40feb637f376bac1cffa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:15.094815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72e04a41-882d-4122-af02-5d333de0b8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:15.193593 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1742/3494] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:20.454109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe9671-6f40-41f0-b485-5f3e3f7a5073 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:20.454668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe9671-6f40-41f0-b485-5f3e3f7a5073 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:20.454668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe9671-6f40-41f0-b485-5f3e3f7a5073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:20.474700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d4fe9671-6f40-41f0-b485-5f3e3f7a5073 None None] MFA Rules not processed for user `0b9bbdf34e904843ab7cd7b40bf3720d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:20.475922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d4fe9671-6f40-41f0-b485-5f3e3f7a5073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:20.486321 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1753/3495] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:22.615618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb79717-92db-46bf-901b-6ea464815b78 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:22.616203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb79717-92db-46bf-901b-6ea464815b78 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:22.616203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb79717-92db-46bf-901b-6ea464815b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:22.644473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5cb79717-92db-46bf-901b-6ea464815b78 None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:22.646491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5cb79717-92db-46bf-901b-6ea464815b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:22.659067 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1743/3496] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:24.961429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe9671-6f40-41f0-b485-5f3e3f7a5073 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:24.975970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe9671-6f40-41f0-b485-5f3e3f7a5073 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:24.986222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a408771-86eb-4c6c-8211-1007d6cf2b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:24.986629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a408771-86eb-4c6c-8211-1007d6cf2b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:24.990539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a408771-86eb-4c6c-8211-1007d6cf2b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:24.991385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a408771-86eb-4c6c-8211-1007d6cf2b62 admin admin] PATH_INFO: `/v3/users/3481331d8f7745abbd1de6916f7f4c36` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:24.993323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a408771-86eb-4c6c-8211-1007d6cf2b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3481331d8f7745abbd1de6916f7f4c36)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:24.995870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a408771-86eb-4c6c-8211-1007d6cf2b62 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:25.090959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a408771-86eb-4c6c-8211-1007d6cf2b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3481331d8f7745abbd1de6916f7f4c36'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:25.092151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a408771-86eb-4c6c-8211-1007d6cf2b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3481331d8f7745abbd1de6916f7f4c36'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:25.114451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a408771-86eb-4c6c-8211-1007d6cf2b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3481331d8f7745abbd1de6916f7f4c36'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:25.116066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a408771-86eb-4c6c-8211-1007d6cf2b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3481331d8f7745abbd1de6916f7f4c36'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:25.177341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a408771-86eb-4c6c-8211-1007d6cf2b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3481331d8f7745abbd1de6916f7f4c36'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:25.196448 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1754/3497] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:24 2022] DELETE /identity/v3/users/3481331d8f7745abbd1de6916f7f4c36 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:38:25.484838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb79717-92db-46bf-901b-6ea464815b78 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:25.513066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb79717-92db-46bf-901b-6ea464815b78 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:25.600485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:25.602201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.603101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.603758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] PATH_INFO: `/v3/projects/2cc7a1d46df542979c99fe07a65961cb` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.605816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc7a1d46df542979c99fe07a65961cb)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:25.608181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:25.686521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc7a1d46df542979c99fe07a65961cb', 'request_id': 'req-ff8e7d23-c25d-4918-9de3-81d1c062569d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:25.696963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc7a1d46df542979c99fe07a65961cb', 'request_id': 'req-ff8e7d23-c25d-4918-9de3-81d1c062569d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:25.720561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc7a1d46df542979c99fe07a65961cb', 'request_id': 'req-ff8e7d23-c25d-4918-9de3-81d1c062569d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:25.737181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] The token cache is being invalidate because project 2cc7a1d46df542979c99fe07a65961cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:38:25.738589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:25.740018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff8e7d23-c25d-4918-9de3-81d1c062569d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:38:25.742135 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1744/3498] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:25 2022] DELETE /identity/v3/projects/2cc7a1d46df542979c99fe07a65961cb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:25.747166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601173f-68f2-4c4d-8b56-20f4f502e7f3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.747763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601173f-68f2-4c4d-8b56-20f4f502e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.748821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601173f-68f2-4c4d-8b56-20f4f502e7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.779870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8601173f-68f2-4c4d-8b56-20f4f502e7f3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:25.782183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8601173f-68f2-4c4d-8b56-20f4f502e7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:25.790529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:25.893267 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1755/3499] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:25.902802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547643f-d2f8-4af1-a22e-28b189752817 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.908087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547643f-d2f8-4af1-a22e-28b189752817 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.908725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547643f-d2f8-4af1-a22e-28b189752817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.945270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f547643f-d2f8-4af1-a22e-28b189752817 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:25.946942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f547643f-d2f8-4af1-a22e-28b189752817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:25.955700 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1745/3500] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:25.960432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601173f-68f2-4c4d-8b56-20f4f502e7f3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:25.972766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601173f-68f2-4c4d-8b56-20f4f502e7f3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:25.978909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30c10c-aeb3-4354-aa89-63bda7d8e594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:25.979520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30c10c-aeb3-4354-aa89-63bda7d8e594 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:25.979982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30c10c-aeb3-4354-aa89-63bda7d8e594 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:25.980260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30c10c-aeb3-4354-aa89-63bda7d8e594 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:25.980917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30c10c-aeb3-4354-aa89-63bda7d8e594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:38:25.981225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30c10c-aeb3-4354-aa89-63bda7d8e594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:25.982931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30c10c-aeb3-4354-aa89-63bda7d8e594 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:26.009348 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1756/3501] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:38:26.014371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547643f-d2f8-4af1-a22e-28b189752817 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:26.028447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547643f-d2f8-4af1-a22e-28b189752817 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:26.035889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687a196-33fb-4615-94a8-5c73c229b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:26.036860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687a196-33fb-4615-94a8-5c73c229b6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:26.037447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687a196-33fb-4615-94a8-5c73c229b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:26.037968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687a196-33fb-4615-94a8-5c73c229b6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:26.039154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687a196-33fb-4615-94a8-5c73c229b6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:26.041705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687a196-33fb-4615-94a8-5c73c229b6c4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:26.079500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:26.104099 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1746/3502] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:38:26 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:38:26.108636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30c10c-aeb3-4354-aa89-63bda7d8e594 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:26.121486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30c10c-aeb3-4354-aa89-63bda7d8e594 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:26.191654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda55f12-e5ac-42b3-8628-3b3ac2f62405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:26.192612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda55f12-e5ac-42b3-8628-3b3ac2f62405 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:26.193157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda55f12-e5ac-42b3-8628-3b3ac2f62405 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:26.193738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda55f12-e5ac-42b3-8628-3b3ac2f62405 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:26.194564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda55f12-e5ac-42b3-8628-3b3ac2f62405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:26.196619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda55f12-e5ac-42b3-8628-3b3ac2f62405 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:26.236668 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1757/3503] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:38:26 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:38:26.239507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687a196-33fb-4615-94a8-5c73c229b6c4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:26.251530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687a196-33fb-4615-94a8-5c73c229b6c4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:26.256952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ab3ab-bb87-4806-a763-806892dbd007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:26.257506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ab3ab-bb87-4806-a763-806892dbd007 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:26.258382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ab3ab-bb87-4806-a763-806892dbd007 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:26.258675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ab3ab-bb87-4806-a763-806892dbd007 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:26.259326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ab3ab-bb87-4806-a763-806892dbd007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:26.260940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ab3ab-bb87-4806-a763-806892dbd007 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:26.273956 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1747/3504] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:26.277988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda55f12-e5ac-42b3-8628-3b3ac2f62405 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:26.288933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda55f12-e5ac-42b3-8628-3b3ac2f62405 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:26.295995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0e897-fc27-4ae5-baf2-6ea7b939692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:26.295995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e897-fc27-4ae5-baf2-6ea7b939692d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:26.295995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e897-fc27-4ae5-baf2-6ea7b939692d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:26.295995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e897-fc27-4ae5-baf2-6ea7b939692d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:26.296414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0e897-fc27-4ae5-baf2-6ea7b939692d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:26.297904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0e897-fc27-4ae5-baf2-6ea7b939692d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:26.313429 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1758/3505] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:38:26.316131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ab3ab-bb87-4806-a763-806892dbd007 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:26.328638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ab3ab-bb87-4806-a763-806892dbd007 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:26.336149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bd26e-eddf-4a94-8876-40814fa80a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:26.337978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bd26e-eddf-4a94-8876-40814fa80a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:26.338487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bd26e-eddf-4a94-8876-40814fa80a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:26.338980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bd26e-eddf-4a94-8876-40814fa80a5d admin admin] PATH_INFO: `/v3/projects/ca2f5edb98e54c699a28f840ab356895/users/57db38bcade34d99a4ab7e3975a536a4/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:26.369722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bd26e-eddf-4a94-8876-40814fa80a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2f5edb98e54c699a28f840ab356895, user_id=57db38bcade34d99a4ab7e3975a536a4, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:26.377111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bd26e-eddf-4a94-8876-40814fa80a5d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:26.406188 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1748/3506] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:38:26 2022] PUT /identity/v3/projects/ca2f5edb98e54c699a28f840ab356895/users/57db38bcade34d99a4ab7e3975a536a4/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:38:26.406399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbbece-7b44-48ae-82bc-967a110907d3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:26.406734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbbece-7b44-48ae-82bc-967a110907d3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:26.407043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbbece-7b44-48ae-82bc-967a110907d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:26.438900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4fdbbece-7b44-48ae-82bc-967a110907d3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:26.440119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4fdbbece-7b44-48ae-82bc-967a110907d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:26.520505 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1759/3507] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:26.538791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bd26e-eddf-4a94-8876-40814fa80a5d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:26.540832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-521bd26e-eddf-4a94-8876-40814fa80a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:26.635473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bd26e-eddf-4a94-8876-40814fa80a5d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:26.643236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c96618-bbd6-4b0a-b8f3-20037d47ffc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:26.644104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c96618-bbd6-4b0a-b8f3-20037d47ffc6 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:26.644457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c96618-bbd6-4b0a-b8f3-20037d47ffc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:26.645371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c96618-bbd6-4b0a-b8f3-20037d47ffc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:26.656287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c96618-bbd6-4b0a-b8f3-20037d47ffc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:26.657874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c96618-bbd6-4b0a-b8f3-20037d47ffc6 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:26.673078 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1749/3508] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:33.570896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e466fd-21ba-47e3-8709-75bc28d22a35 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:33.571380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e466fd-21ba-47e3-8709-75bc28d22a35 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:33.571645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e466fd-21ba-47e3-8709-75bc28d22a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:33.615107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-66e466fd-21ba-47e3-8709-75bc28d22a35 None None] MFA Rules not processed for user `57db38bcade34d99a4ab7e3975a536a4`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:33.616603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66e466fd-21ba-47e3-8709-75bc28d22a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:33.627584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:33.728615 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1760/3509] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:33.743347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725de58-fc17-43a3-b461-e5139b84d510 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:33.743840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725de58-fc17-43a3-b461-e5139b84d510 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:33.743949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725de58-fc17-43a3-b461-e5139b84d510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:33.766394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1725de58-fc17-43a3-b461-e5139b84d510 None None] MFA Rules not processed for user `57db38bcade34d99a4ab7e3975a536a4`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:33.768119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1725de58-fc17-43a3-b461-e5139b84d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:33.777706 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1750/3510] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:33.790325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e466fd-21ba-47e3-8709-75bc28d22a35 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:33.794182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66e466fd-21ba-47e3-8709-75bc28d22a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:33.885523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e466fd-21ba-47e3-8709-75bc28d22a35 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:33.891313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603295d8-9664-466d-8325-db60559a4693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:33.892026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603295d8-9664-466d-8325-db60559a4693 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:33.892181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603295d8-9664-466d-8325-db60559a4693 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:33.892545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603295d8-9664-466d-8325-db60559a4693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:33.908999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603295d8-9664-466d-8325-db60559a4693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:33.911304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603295d8-9664-466d-8325-db60559a4693 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:33.921846 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1761/3511] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:43.077896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725de58-fc17-43a3-b461-e5139b84d510 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:43.081713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1725de58-fc17-43a3-b461-e5139b84d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:43.243427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725de58-fc17-43a3-b461-e5139b84d510 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:43.250837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207268e6-62aa-4ec2-b3c8-f442f91802a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:43.251919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207268e6-62aa-4ec2-b3c8-f442f91802a7 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:43.252122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207268e6-62aa-4ec2-b3c8-f442f91802a7 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:43.252553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207268e6-62aa-4ec2-b3c8-f442f91802a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:43.254549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-207268e6-62aa-4ec2-b3c8-f442f91802a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:43.272948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207268e6-62aa-4ec2-b3c8-f442f91802a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:43.274839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207268e6-62aa-4ec2-b3c8-f442f91802a7 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:43.289330 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1751/3512] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:43.917286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=59 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:44.658561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9e18-41af-4060-99a3-92d5b6d8a430 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:44.658840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9e18-41af-4060-99a3-92d5b6d8a430 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:44.659698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9e18-41af-4060-99a3-92d5b6d8a430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:44.687090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-13db9e18-41af-4060-99a3-92d5b6d8a430 None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:44.688456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-13db9e18-41af-4060-99a3-92d5b6d8a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:44.758780 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1762/3513] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:47.902704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dfa6b-a1bf-4dbf-b575-ac02c41c7e16 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:47.903280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dfa6b-a1bf-4dbf-b575-ac02c41c7e16 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:47.903280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dfa6b-a1bf-4dbf-b575-ac02c41c7e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:47.939975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3a6dfa6b-a1bf-4dbf-b575-ac02c41c7e16 None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:47.941524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3a6dfa6b-a1bf-4dbf-b575-ac02c41c7e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:47.949468 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1752/3514] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:49.249727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c5d6b-e660-4f7f-a486-d4c7a3f34303 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:49.250250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c5d6b-e660-4f7f-a486-d4c7a3f34303 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:49.250383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c5d6b-e660-4f7f-a486-d4c7a3f34303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:49.274585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e09c5d6b-e660-4f7f-a486-d4c7a3f34303 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:49.275748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e09c5d6b-e660-4f7f-a486-d4c7a3f34303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:49.355058 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1763/3515] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:49.383594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6dfa6b-a1bf-4dbf-b575-ac02c41c7e16 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:49.386147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3a6dfa6b-a1bf-4dbf-b575-ac02c41c7e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:49.419528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c5d6b-e660-4f7f-a486-d4c7a3f34303 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:38:49.422480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e09c5d6b-e660-4f7f-a486-d4c7a3f34303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:49.449037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c5d6b-e660-4f7f-a486-d4c7a3f34303 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:49.471650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:49.474511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a497f3-2487-4a44-a3c0-c70ab65476ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:49.478725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a497f3-2487-4a44-a3c0-c70ab65476ba service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:49.479060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a497f3-2487-4a44-a3c0-c70ab65476ba service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:49.479538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a497f3-2487-4a44-a3c0-c70ab65476ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:49.482847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-21a497f3-2487-4a44-a3c0-c70ab65476ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:49.498025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a497f3-2487-4a44-a3c0-c70ab65476ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:49.501187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a497f3-2487-4a44-a3c0-c70ab65476ba service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:49.559930 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1764/3516] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:38:49.574552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6dfa6b-a1bf-4dbf-b575-ac02c41c7e16 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:38:49.590800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e4312-977c-4aed-8030-cba9d3bbe4ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:38:49.591597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e4312-977c-4aed-8030-cba9d3bbe4ea service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:49.595331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e4312-977c-4aed-8030-cba9d3bbe4ea service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:49.595900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e4312-977c-4aed-8030-cba9d3bbe4ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:49.632290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e4312-977c-4aed-8030-cba9d3bbe4ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:38:49.634764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e4312-977c-4aed-8030-cba9d3bbe4ea service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:38:49.652581 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1753/3517] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:38:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:38:50.100470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2b8c7-3526-461b-8baf-08178e90db51 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.101279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2b8c7-3526-461b-8baf-08178e90db51 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.101886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2b8c7-3526-461b-8baf-08178e90db51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.136952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0bc2b8c7-3526-461b-8baf-08178e90db51 None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:50.138909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0bc2b8c7-3526-461b-8baf-08178e90db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:50.153124 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1765/3518] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:50.962436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec99de-f0eb-4526-b4ee-c1451dd1dfe9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:50.963009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec99de-f0eb-4526-b4ee-c1451dd1dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:50.963332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec99de-f0eb-4526-b4ee-c1451dd1dfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:50.989638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2dec99de-f0eb-4526-b4ee-c1451dd1dfe9 None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:50.991473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2dec99de-f0eb-4526-b4ee-c1451dd1dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:50.999128 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1754/3519] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:51.789143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1660e92-ccfe-44cd-8f3e-2691be09801f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:51.790275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1660e92-ccfe-44cd-8f3e-2691be09801f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:51.790886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1660e92-ccfe-44cd-8f3e-2691be09801f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:51.837689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c1660e92-ccfe-44cd-8f3e-2691be09801f None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:51.842449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c1660e92-ccfe-44cd-8f3e-2691be09801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:51.866308 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1766/3520] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:53.011025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbe180-b8d0-41ea-97ac-1265dac4fc69 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:53.012224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbe180-b8d0-41ea-97ac-1265dac4fc69 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:53.012865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbe180-b8d0-41ea-97ac-1265dac4fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:53.107631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-94fbe180-b8d0-41ea-97ac-1265dac4fc69 None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:53.115004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-94fbe180-b8d0-41ea-97ac-1265dac4fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:53.154002 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1755/3521] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:54.603514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2778f1e-8f4f-4e1c-b66d-c9914eb5bcb9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:54.604583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2778f1e-8f4f-4e1c-b66d-c9914eb5bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:54.605094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2778f1e-8f4f-4e1c-b66d-c9914eb5bcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:54.644993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c2778f1e-8f4f-4e1c-b66d-c9914eb5bcb9 None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:54.651436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c2778f1e-8f4f-4e1c-b66d-c9914eb5bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:54.691658 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1767/3522] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:55.336926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d3e20-c940-4f60-b3d7-ba56ed385a6c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:55.338027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d3e20-c940-4f60-b3d7-ba56ed385a6c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:55.338514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d3e20-c940-4f60-b3d7-ba56ed385a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:55.374832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8c1d3e20-c940-4f60-b3d7-ba56ed385a6c None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:55.376155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8c1d3e20-c940-4f60-b3d7-ba56ed385a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:55.395507 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1756/3523] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:56.258519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257e50a-6363-49ee-ba53-53acca000fcb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:56.259055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257e50a-6363-49ee-ba53-53acca000fcb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:56.259360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257e50a-6363-49ee-ba53-53acca000fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:56.295572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c257e50a-6363-49ee-ba53-53acca000fcb None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:56.297015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c257e50a-6363-49ee-ba53-53acca000fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:56.319709 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1768/3524] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:38:57.724942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89cbde-506e-4eca-8529-cba9a9b097db None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:38:57.726258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89cbde-506e-4eca-8529-cba9a9b097db None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:38:57.726886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89cbde-506e-4eca-8529-cba9a9b097db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:38:57.788292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ae89cbde-506e-4eca-8529-cba9a9b097db None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:38:57.793001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ae89cbde-506e-4eca-8529-cba9a9b097db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:38:57.820257 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1757/3525] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:03.709752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257e50a-6363-49ee-ba53-53acca000fcb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:03.732679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257e50a-6363-49ee-ba53-53acca000fcb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:03.739033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:03.740067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:03.740633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:03.741053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] PATH_INFO: `/v3/users/57db38bcade34d99a4ab7e3975a536a4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:03.743298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57db38bcade34d99a4ab7e3975a536a4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:03.745595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:03.861115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57db38bcade34d99a4ab7e3975a536a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.862022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57db38bcade34d99a4ab7e3975a536a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.891769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57db38bcade34d99a4ab7e3975a536a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.892597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57db38bcade34d99a4ab7e3975a536a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.896976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:03.915107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57db38bcade34d99a4ab7e3975a536a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:03.936445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd08f2-fc2b-45a4-a29a-53af24d6e664 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:03.937997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd08f2-fc2b-45a4-a29a-53af24d6e664 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:03.938432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd08f2-fc2b-45a4-a29a-53af24d6e664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:03.939061 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1769/3526] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:03 2022] DELETE /identity/v3/users/57db38bcade34d99a4ab7e3975a536a4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:03.970343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-19fd08f2-fc2b-45a4-a29a-53af24d6e664 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:03.972382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-19fd08f2-fc2b-45a4-a29a-53af24d6e664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:04.119370 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1758/3527] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:04.162721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:04.165887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:04.362908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676383d-7a36-4ba3-b542-ce0b61f55f07 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:04.368982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f453e-cf96-46fb-8639-9882a5139b5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:04.370036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f453e-cf96-46fb-8639-9882a5139b5a service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:04.370412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f453e-cf96-46fb-8639-9882a5139b5a service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:04.370792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f453e-cf96-46fb-8639-9882a5139b5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:04.381873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f453e-cf96-46fb-8639-9882a5139b5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:04.396887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f453e-cf96-46fb-8639-9882a5139b5a service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:04.427422 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1770/3528] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:39:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:04.521115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd08f2-fc2b-45a4-a29a-53af24d6e664 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:04.523346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-19fd08f2-fc2b-45a4-a29a-53af24d6e664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:04.737481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd08f2-fc2b-45a4-a29a-53af24d6e664 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:04.748589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:04.749694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:04.750351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:04.751118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] PATH_INFO: `/v3/projects/ca2f5edb98e54c699a28f840ab356895` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:04.753150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2f5edb98e54c699a28f840ab356895)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:04.756044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:04.822022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:04.827980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2f5edb98e54c699a28f840ab356895', 'request_id': 'req-710020db-1e04-4b03-b8ef-c3a61cac82a3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.838190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2f5edb98e54c699a28f840ab356895', 'request_id': 'req-710020db-1e04-4b03-b8ef-c3a61cac82a3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.852945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2f5edb98e54c699a28f840ab356895', 'request_id': 'req-710020db-1e04-4b03-b8ef-c3a61cac82a3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.911728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] The token cache is being invalidate because project ca2f5edb98e54c699a28f840ab356895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:04.912437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.914457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-710020db-1e04-4b03-b8ef-c3a61cac82a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:04.917174 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1759/3529] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:04 2022] DELETE /identity/v3/projects/ca2f5edb98e54c699a28f840ab356895 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:04.923232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9813-da77-4344-ae59-81e3b694adad None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:04.924135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9813-da77-4344-ae59-81e3b694adad None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:04.924512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9813-da77-4344-ae59-81e3b694adad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:04.996296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1b3b9813-da77-4344-ae59-81e3b694adad None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:05.000019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1b3b9813-da77-4344-ae59-81e3b694adad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:05.172308 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1771/3530] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:05.172822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256711-318f-4235-962f-86747d773ed5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:05.173662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256711-318f-4235-962f-86747d773ed5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:05.174091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256711-318f-4235-962f-86747d773ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:05.237632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-48256711-318f-4235-962f-86747d773ed5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:05.239657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-48256711-318f-4235-962f-86747d773ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:05.260359 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1760/3531] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:05.263998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b9813-da77-4344-ae59-81e3b694adad None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:05.287310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b9813-da77-4344-ae59-81e3b694adad None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:05.304766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461edb32-3fb7-4c1d-b1be-6f83990e9b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:05.306073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461edb32-3fb7-4c1d-b1be-6f83990e9b97 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:05.307043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461edb32-3fb7-4c1d-b1be-6f83990e9b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:05.307043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461edb32-3fb7-4c1d-b1be-6f83990e9b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:05.310183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461edb32-3fb7-4c1d-b1be-6f83990e9b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:05.310183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461edb32-3fb7-4c1d-b1be-6f83990e9b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:05.332212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461edb32-3fb7-4c1d-b1be-6f83990e9b97 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:05.384946 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1772/3532] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:05.385167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256711-318f-4235-962f-86747d773ed5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:05.405921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256711-318f-4235-962f-86747d773ed5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:05.445870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad144d7-f412-4e16-9708-8891cedc2dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:05.451008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad144d7-f412-4e16-9708-8891cedc2dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:05.451307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad144d7-f412-4e16-9708-8891cedc2dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:05.463621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad144d7-f412-4e16-9708-8891cedc2dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:05.463621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad144d7-f412-4e16-9708-8891cedc2dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:05.469289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad144d7-f412-4e16-9708-8891cedc2dc2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:05.633785 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1761/3533] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:05 2022] POST /identity/v3/projects => generated 397 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:05.637648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461edb32-3fb7-4c1d-b1be-6f83990e9b97 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:05.651258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461edb32-3fb7-4c1d-b1be-6f83990e9b97 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:05.794433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da08bf5-f8ed-4cd2-872c-579c3fa7b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:05.797119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da08bf5-f8ed-4cd2-872c-579c3fa7b9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:05.797422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da08bf5-f8ed-4cd2-872c-579c3fa7b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:05.797717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da08bf5-f8ed-4cd2-872c-579c3fa7b9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:05.798378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da08bf5-f8ed-4cd2-872c-579c3fa7b9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:05.803015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da08bf5-f8ed-4cd2-872c-579c3fa7b9f1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:05.854960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:05.911636 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1773/3534] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:05 2022] POST /identity/v3/users => generated 299 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:05.914489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad144d7-f412-4e16-9708-8891cedc2dc2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:05.939621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad144d7-f412-4e16-9708-8891cedc2dc2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:05.953490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99052130-47b5-4727-96d5-d938e95e8f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:05.954394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99052130-47b5-4727-96d5-d938e95e8f77 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:05.954824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99052130-47b5-4727-96d5-d938e95e8f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:05.956415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99052130-47b5-4727-96d5-d938e95e8f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:05.963287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99052130-47b5-4727-96d5-d938e95e8f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:05.965528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99052130-47b5-4727-96d5-d938e95e8f77 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:05.979761 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1762/3535] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:05.984736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da08bf5-f8ed-4cd2-872c-579c3fa7b9f1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:06.019211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da08bf5-f8ed-4cd2-872c-579c3fa7b9f1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:06.063042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64224c11-18e6-453f-b816-7e29c1443676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:06.069118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224c11-18e6-453f-b816-7e29c1443676 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.069477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224c11-18e6-453f-b816-7e29c1443676 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.074049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224c11-18e6-453f-b816-7e29c1443676 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.074912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64224c11-18e6-453f-b816-7e29c1443676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:06.087618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64224c11-18e6-453f-b816-7e29c1443676 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:06.130553 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1774/3536] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:06.132194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99052130-47b5-4727-96d5-d938e95e8f77 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:06.149036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99052130-47b5-4727-96d5-d938e95e8f77 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:06.217877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f7f0f-3798-43d1-8f50-08a4820a6ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:06.219544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f7f0f-3798-43d1-8f50-08a4820a6ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.219971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f7f0f-3798-43d1-8f50-08a4820a6ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.220423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f7f0f-3798-43d1-8f50-08a4820a6ae8 admin admin] PATH_INFO: `/v3/projects/3bb6fbf36e924067b4c98bd14a30ff3f/users/1e7f1e9746ee441a9c8d7bf64e22fb35/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.285759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f7f0f-3798-43d1-8f50-08a4820a6ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb6fbf36e924067b4c98bd14a30ff3f, user_id=1e7f1e9746ee441a9c8d7bf64e22fb35, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:06.288740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f7f0f-3798-43d1-8f50-08a4820a6ae8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:06.323454 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1763/3537] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:06 2022] PUT /identity/v3/projects/3bb6fbf36e924067b4c98bd14a30ff3f/users/1e7f1e9746ee441a9c8d7bf64e22fb35/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:06.328397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f390b0-5cd3-4072-9b13-d5fbe0648ba7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.328800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f390b0-5cd3-4072-9b13-d5fbe0648ba7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.329147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f390b0-5cd3-4072-9b13-d5fbe0648ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.399008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-07f390b0-5cd3-4072-9b13-d5fbe0648ba7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:06.400261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-07f390b0-5cd3-4072-9b13-d5fbe0648ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.694290 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1775/3538] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:06.705488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f7f0f-3798-43d1-8f50-08a4820a6ae8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:06.709426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b43f7f0f-3798-43d1-8f50-08a4820a6ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:06.937929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f7f0f-3798-43d1-8f50-08a4820a6ae8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:06.954861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecae3e-a439-460c-9558-f71b4b7b09dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:06.955501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecae3e-a439-460c-9558-f71b4b7b09dd service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:06.955944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecae3e-a439-460c-9558-f71b4b7b09dd service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:06.956221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecae3e-a439-460c-9558-f71b4b7b09dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:06.987829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecae3e-a439-460c-9558-f71b4b7b09dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:06.989506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecae3e-a439-460c-9558-f71b4b7b09dd service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:07.024909 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1764/3539] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:07.411018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3ff38-aaef-419a-809f-ba9b9dab489b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:07.411602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3ff38-aaef-419a-809f-ba9b9dab489b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:07.411715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3ff38-aaef-419a-809f-ba9b9dab489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:07.472947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4ad3ff38-aaef-419a-809f-ba9b9dab489b None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:07.479055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4ad3ff38-aaef-419a-809f-ba9b9dab489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:07.710365 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1776/3540] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:10.491143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794c80-9e29-4afc-8282-018556fff1a8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:10.492478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794c80-9e29-4afc-8282-018556fff1a8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:10.492764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794c80-9e29-4afc-8282-018556fff1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:10.533236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4d794c80-9e29-4afc-8282-018556fff1a8 None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:10.536029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4d794c80-9e29-4afc-8282-018556fff1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:10.558339 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1765/3541] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:14.763523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf64330-d69d-42a7-ac18-e4df475a9570 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:14.764074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf64330-d69d-42a7-ac18-e4df475a9570 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:14.764074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf64330-d69d-42a7-ac18-e4df475a9570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:14.835130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-abf64330-d69d-42a7-ac18-e4df475a9570 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:14.846854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-abf64330-d69d-42a7-ac18-e4df475a9570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:14.880748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d794c80-9e29-4afc-8282-018556fff1a8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:14.882795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4d794c80-9e29-4afc-8282-018556fff1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:14.920569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d794c80-9e29-4afc-8282-018556fff1a8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:14.934885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77399aac-e951-448a-b539-a386a154a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:14.935174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399aac-e951-448a-b539-a386a154a585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:14.935466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399aac-e951-448a-b539-a386a154a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:14.935743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399aac-e951-448a-b539-a386a154a585 admin admin] PATH_INFO: `/v3/users/0b9bbdf34e904843ab7cd7b40bf3720d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:14.941494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77399aac-e951-448a-b539-a386a154a585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9bbdf34e904843ab7cd7b40bf3720d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:14.943473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77399aac-e951-448a-b539-a386a154a585 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:15.018775 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1777/3542] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:39:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:15.055162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf64330-d69d-42a7-ac18-e4df475a9570 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:15.056848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-abf64330-d69d-42a7-ac18-e4df475a9570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:15.079157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-77399aac-e951-448a-b539-a386a154a585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9bbdf34e904843ab7cd7b40bf3720d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:15.085875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-77399aac-e951-448a-b539-a386a154a585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9bbdf34e904843ab7cd7b40bf3720d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:15.125965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:15.127836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-77399aac-e951-448a-b539-a386a154a585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9bbdf34e904843ab7cd7b40bf3720d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:15.146288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-77399aac-e951-448a-b539-a386a154a585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9bbdf34e904843ab7cd7b40bf3720d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:15.161901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-77399aac-e951-448a-b539-a386a154a585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9bbdf34e904843ab7cd7b40bf3720d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:15.166521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:15.175009 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1766/3543] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:14 2022] DELETE /identity/v3/users/0b9bbdf34e904843ab7cd7b40bf3720d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:15.179147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa23a4-bc79-43d2-b27f-55284673d246 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:15.179698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa23a4-bc79-43d2-b27f-55284673d246 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:15.180159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa23a4-bc79-43d2-b27f-55284673d246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:15.235992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-afaa23a4-bc79-43d2-b27f-55284673d246 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:15.237826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-afaa23a4-bc79-43d2-b27f-55284673d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:15.279360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf64330-d69d-42a7-ac18-e4df475a9570 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:15.367973 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1767/3544] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:15.380533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa23a4-bc79-43d2-b27f-55284673d246 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:15.382098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-afaa23a4-bc79-43d2-b27f-55284673d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:15.421123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3edd23-50cc-4b10-8471-bebd61840bf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:15.421781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3edd23-50cc-4b10-8471-bebd61840bf1 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:15.422058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3edd23-50cc-4b10-8471-bebd61840bf1 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:15.422329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3edd23-50cc-4b10-8471-bebd61840bf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:15.425772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fa3edd23-50cc-4b10-8471-bebd61840bf1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:15.503800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3edd23-50cc-4b10-8471-bebd61840bf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:15.505548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3edd23-50cc-4b10-8471-bebd61840bf1 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:15.519150 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1778/3545] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:15.595674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa23a4-bc79-43d2-b27f-55284673d246 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:15.620906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cc232-b55c-46da-98ba-6e370ff2f25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:15.621579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cc232-b55c-46da-98ba-6e370ff2f25c service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:15.621862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cc232-b55c-46da-98ba-6e370ff2f25c service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:15.622139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cc232-b55c-46da-98ba-6e370ff2f25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:15.650138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cc232-b55c-46da-98ba-6e370ff2f25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:15.651603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cc232-b55c-46da-98ba-6e370ff2f25c service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:15.665161 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1768/3546] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:16.175378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3edd23-50cc-4b10-8471-bebd61840bf1 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:16.176871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fa3edd23-50cc-4b10-8471-bebd61840bf1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:16.207790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3edd23-50cc-4b10-8471-bebd61840bf1 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:16.242814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:16.243681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:16.243961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:16.244238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] PATH_INFO: `/v3/projects/5bc4a6b62df34515a6df68cfc28f2526` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:16.246178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc4a6b62df34515a6df68cfc28f2526)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:16.248176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:16.419568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc4a6b62df34515a6df68cfc28f2526', 'request_id': 'req-d8876316-110d-4df2-a785-0fb1bf3cff2e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.440762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc4a6b62df34515a6df68cfc28f2526', 'request_id': 'req-d8876316-110d-4df2-a785-0fb1bf3cff2e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.468460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc4a6b62df34515a6df68cfc28f2526', 'request_id': 'req-d8876316-110d-4df2-a785-0fb1bf3cff2e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.488193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:16.498114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] The token cache is being invalidate because project 5bc4a6b62df34515a6df68cfc28f2526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:16.498396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.500560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.504031 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1779/3547] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:16 2022] DELETE /identity/v3/projects/5bc4a6b62df34515a6df68cfc28f2526 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:16.508283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cc232-b55c-46da-98ba-6e370ff2f25c service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:16.526269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cc232-b55c-46da-98ba-6e370ff2f25c service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:16.722674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:16.724842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:16.725150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:16.727289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] PATH_INFO: `/v3/users/a6ed4421ecfb4c4a830c5c8b0db678f0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:16.729763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ed4421ecfb4c4a830c5c8b0db678f0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:16.736446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:16.813452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:16.866876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ed4421ecfb4c4a830c5c8b0db678f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.868417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ed4421ecfb4c4a830c5c8b0db678f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.902562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ed4421ecfb4c4a830c5c8b0db678f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.919443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ed4421ecfb4c4a830c5c8b0db678f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.939046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ed4421ecfb4c4a830c5c8b0db678f0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:16.951708 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1769/3548] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:16 2022] DELETE /identity/v3/users/a6ed4421ecfb4c4a830c5c8b0db678f0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:17.474255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:17.475701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:17.606859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:17.608216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:17.657323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8876316-110d-4df2-a785-0fb1bf3cff2e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:17.780865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1246a-ec13-4d08-8a3d-45f3bd902639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:17.781836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1246a-ec13-4d08-8a3d-45f3bd902639 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:17.782302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1246a-ec13-4d08-8a3d-45f3bd902639 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:17.782719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1246a-ec13-4d08-8a3d-45f3bd902639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:17.784960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9ef1246a-ec13-4d08-8a3d-45f3bd902639 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:17.832166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a386d5-dce8-47fb-81ce-4bcd607cea2c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:17.850054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:17.854106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:17.859853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:17.860592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] PATH_INFO: `/v3/projects/5393752392a4442e94cb2d82ad8ff3e1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:17.864043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5393752392a4442e94cb2d82ad8ff3e1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:17.868914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:17.938915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1246a-ec13-4d08-8a3d-45f3bd902639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:17.941959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1246a-ec13-4d08-8a3d-45f3bd902639 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:17.957255 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1780/3549] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:18.065788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5393752392a4442e94cb2d82ad8ff3e1', 'request_id': 'req-00bd78ea-2340-4729-a60b-c47a9488a9ec'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:18.080251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5393752392a4442e94cb2d82ad8ff3e1', 'request_id': 'req-00bd78ea-2340-4729-a60b-c47a9488a9ec'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:18.098803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5393752392a4442e94cb2d82ad8ff3e1', 'request_id': 'req-00bd78ea-2340-4729-a60b-c47a9488a9ec'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:18.134665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] The token cache is being invalidate because project 5393752392a4442e94cb2d82ad8ff3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:18.136127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:18.138923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-00bd78ea-2340-4729-a60b-c47a9488a9ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:18.147431 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1770/3550] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:17 2022] DELETE /identity/v3/projects/5393752392a4442e94cb2d82ad8ff3e1 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:18.152966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3f05-4280-4579-b07c-9e3c30718995 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.153700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3f05-4280-4579-b07c-9e3c30718995 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.154155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3f05-4280-4579-b07c-9e3c30718995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.203978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fccd3f05-4280-4579-b07c-9e3c30718995 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:18.205243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fccd3f05-4280-4579-b07c-9e3c30718995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.289915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:18.410360 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1781/3551] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:18.418137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7a800-cd68-460c-81b7-41ed131a79c1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.422156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7a800-cd68-460c-81b7-41ed131a79c1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.422538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7a800-cd68-460c-81b7-41ed131a79c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.461605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b9091-bdc8-46cb-8b64-7e364baf0203 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.462211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b9091-bdc8-46cb-8b64-7e364baf0203 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.462720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b9091-bdc8-46cb-8b64-7e364baf0203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.483679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-acd7a800-cd68-460c-81b7-41ed131a79c1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:18.484071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-acd7a800-cd68-460c-81b7-41ed131a79c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.508992 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1771/3552] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:18.509674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7a800-cd68-460c-81b7-41ed131a79c1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:18.511077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-acd7a800-cd68-460c-81b7-41ed131a79c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.543765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-af2b9091-bdc8-46cb-8b64-7e364baf0203 None None] MFA Rules not processed for user `1e7f1e9746ee441a9c8d7bf64e22fb35`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:18.544331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-af2b9091-bdc8-46cb-8b64-7e364baf0203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.599109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:18.722045 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1782/3553] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:18.722942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b9091-bdc8-46cb-8b64-7e364baf0203 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:18.771540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7a800-cd68-460c-81b7-41ed131a79c1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:18.773550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b9091-bdc8-46cb-8b64-7e364baf0203 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:18.793480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f396c-d87c-45b2-8f94-9b4d6698dad9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:18.795359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f396c-d87c-45b2-8f94-9b4d6698dad9 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.796135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f396c-d87c-45b2-8f94-9b4d6698dad9 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.799275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f396c-d87c-45b2-8f94-9b4d6698dad9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.801167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6df6ad-4657-445a-b7d2-a0839a388f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:18.802514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df6ad-4657-445a-b7d2-a0839a388f16 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.803881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bf2f396c-d87c-45b2-8f94-9b4d6698dad9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:18.804974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df6ad-4657-445a-b7d2-a0839a388f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.805829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df6ad-4657-445a-b7d2-a0839a388f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.808315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6df6ad-4657-445a-b7d2-a0839a388f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:18.813050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6df6ad-4657-445a-b7d2-a0839a388f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:18.817231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6df6ad-4657-445a-b7d2-a0839a388f16 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:18.848745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f396c-d87c-45b2-8f94-9b4d6698dad9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:18.852887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f396c-d87c-45b2-8f94-9b4d6698dad9 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:18.860962 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1783/3554] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:18.862348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6df6ad-4657-445a-b7d2-a0839a388f16 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:18.890092 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1772/3555] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:18.896471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6df6ad-4657-445a-b7d2-a0839a388f16 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:18.909418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06863d-4cca-4ab3-bd95-5df5b71636e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:18.918755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06863d-4cca-4ab3-bd95-5df5b71636e0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:18.919163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06863d-4cca-4ab3-bd95-5df5b71636e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:18.919544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06863d-4cca-4ab3-bd95-5df5b71636e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:18.920299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06863d-4cca-4ab3-bd95-5df5b71636e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:18.922399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06863d-4cca-4ab3-bd95-5df5b71636e0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.002923 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1784/3556] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:18 2022] POST /identity/v3/projects => generated 403 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:19.007221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f396c-d87c-45b2-8f94-9b4d6698dad9 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.026414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f396c-d87c-45b2-8f94-9b4d6698dad9 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.210751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4eff4-4280-416c-9941-2e8f54e21fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.211385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4eff4-4280-416c-9941-2e8f54e21fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.211672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4eff4-4280-416c-9941-2e8f54e21fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.211955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4eff4-4280-416c-9941-2e8f54e21fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.212622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4eff4-4280-416c-9941-2e8f54e21fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.220930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4eff4-4280-416c-9941-2e8f54e21fb6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.264038 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1773/3557] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:19 2022] POST /identity/v3/users => generated 302 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:39:19.265298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06863d-4cca-4ab3-bd95-5df5b71636e0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.279988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06863d-4cca-4ab3-bd95-5df5b71636e0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.302187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804513c0-4a76-44d4-aeb1-b78a6fb56691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.302808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804513c0-4a76-44d4-aeb1-b78a6fb56691 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.303085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804513c0-4a76-44d4-aeb1-b78a6fb56691 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.303351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804513c0-4a76-44d4-aeb1-b78a6fb56691 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.305268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804513c0-4a76-44d4-aeb1-b78a6fb56691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.305655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804513c0-4a76-44d4-aeb1-b78a6fb56691 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.352834 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1785/3558] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:19.354293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4eff4-4280-416c-9941-2e8f54e21fb6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.401418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4eff4-4280-416c-9941-2e8f54e21fb6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.416245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a92bb-cf4d-4b1e-b0fb-eb2e20d4af5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.418310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a92bb-cf4d-4b1e-b0fb-eb2e20d4af5f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.418807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a92bb-cf4d-4b1e-b0fb-eb2e20d4af5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.420188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a92bb-cf4d-4b1e-b0fb-eb2e20d4af5f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.425675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a92bb-cf4d-4b1e-b0fb-eb2e20d4af5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.431974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a92bb-cf4d-4b1e-b0fb-eb2e20d4af5f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.468480 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1774/3559] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:19.470250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804513c0-4a76-44d4-aeb1-b78a6fb56691 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.485379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804513c0-4a76-44d4-aeb1-b78a6fb56691 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.501703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77179b-d764-47f2-8326-0fd9a31538a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.502976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77179b-d764-47f2-8326-0fd9a31538a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.503441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77179b-d764-47f2-8326-0fd9a31538a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.503892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77179b-d764-47f2-8326-0fd9a31538a5 admin admin] PATH_INFO: `/v3/projects/b334df134f284700bf2e2ce6e639138d/users/a7e987f3fba14c4e8b588bae82e5a728/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.542248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77179b-d764-47f2-8326-0fd9a31538a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b334df134f284700bf2e2ce6e639138d, user_id=a7e987f3fba14c4e8b588bae82e5a728, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.545783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77179b-d764-47f2-8326-0fd9a31538a5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:19.581590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a92bb-cf4d-4b1e-b0fb-eb2e20d4af5f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.584485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-302a92bb-cf4d-4b1e-b0fb-eb2e20d4af5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:19.585155 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1786/3560] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:19 2022] PUT /identity/v3/projects/b334df134f284700bf2e2ce6e639138d/users/a7e987f3fba14c4e8b588bae82e5a728/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:39:19.590955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05413f3a-e444-4b5b-8433-947e64d54891 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.591236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05413f3a-e444-4b5b-8433-947e64d54891 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.595047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05413f3a-e444-4b5b-8433-947e64d54891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.631379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-05413f3a-e444-4b5b-8433-947e64d54891 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:19.633793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-05413f3a-e444-4b5b-8433-947e64d54891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:19.719963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:19.760220 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1787/3561] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:19.770305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05413f3a-e444-4b5b-8433-947e64d54891 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:19.771879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-05413f3a-e444-4b5b-8433-947e64d54891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:19.775040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a92bb-cf4d-4b1e-b0fb-eb2e20d4af5f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.926167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05413f3a-e444-4b5b-8433-947e64d54891 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:19.940107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312158a-ff96-4f9c-bdda-322a7ca1e92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:19.940107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312158a-ff96-4f9c-bdda-322a7ca1e92a service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:19.940107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312158a-ff96-4f9c-bdda-322a7ca1e92a service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:19.940107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312158a-ff96-4f9c-bdda-322a7ca1e92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:19.953993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:19.977754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312158a-ff96-4f9c-bdda-322a7ca1e92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:19.979499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312158a-ff96-4f9c-bdda-322a7ca1e92a service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:20.069109 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1788/3562] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:20.070932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7aee5-8d78-4b86-8548-b010fc42346d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:20.072879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7aee5-8d78-4b86-8548-b010fc42346d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:20.074602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7aee5-8d78-4b86-8548-b010fc42346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:20.099813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28c569-3808-4207-8eea-bc044c3f83d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:20.104570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28c569-3808-4207-8eea-bc044c3f83d1 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:20.106696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28c569-3808-4207-8eea-bc044c3f83d1 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:20.107724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28c569-3808-4207-8eea-bc044c3f83d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:20.139458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8db7aee5-8d78-4b86-8548-b010fc42346d None None] MFA Rules not processed for user `065c5a92f9c04400be8a515e8233fb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:20.145330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8db7aee5-8d78-4b86-8548-b010fc42346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:20.286539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28c569-3808-4207-8eea-bc044c3f83d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:20.291235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28c569-3808-4207-8eea-bc044c3f83d1 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:20.327106 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1789/3563] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:20.335449 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1775/3564] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:30.296144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=55 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:30.323075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=41 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:30.599856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb94a6-1f00-4c1f-a05b-a35f4d0e0a6c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:30.600245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb94a6-1f00-4c1f-a05b-a35f4d0e0a6c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:30.600726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb94a6-1f00-4c1f-a05b-a35f4d0e0a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:30.622193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-50bb94a6-1f00-4c1f-a05b-a35f4d0e0a6c None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:30.624531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-50bb94a6-1f00-4c1f-a05b-a35f4d0e0a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:30.721909 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1790/3565] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:39:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:30.730377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28c569-3808-4207-8eea-bc044c3f83d1 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:30.731926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-eb28c569-3808-4207-8eea-bc044c3f83d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:30.829811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28c569-3808-4207-8eea-bc044c3f83d1 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:30.837672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e8dbc-af29-4b86-acd1-ef06e84c31d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:30.838376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e8dbc-af29-4b86-acd1-ef06e84c31d6 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:30.838962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e8dbc-af29-4b86-acd1-ef06e84c31d6 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:30.839327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e8dbc-af29-4b86-acd1-ef06e84c31d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:30.854513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e8dbc-af29-4b86-acd1-ef06e84c31d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:30.856638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e8dbc-af29-4b86-acd1-ef06e84c31d6 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:30.867965 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1776/3566] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:39:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:31.778122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc0f04-06a5-4279-b19a-97c4329e868b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:31.779372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc0f04-06a5-4279-b19a-97c4329e868b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:31.779872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc0f04-06a5-4279-b19a-97c4329e868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:31.819526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0dbc0f04-06a5-4279-b19a-97c4329e868b None None] MFA Rules not processed for user `a7e987f3fba14c4e8b588bae82e5a728`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:31.822755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0dbc0f04-06a5-4279-b19a-97c4329e868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:31.917642 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1791/3567] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:31 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:32.024494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2ca3e-a0c4-40b2-80fe-5ba14192f45c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:32.025080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2ca3e-a0c4-40b2-80fe-5ba14192f45c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:32.025080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2ca3e-a0c4-40b2-80fe-5ba14192f45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:32.050421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-15f2ca3e-a0c4-40b2-80fe-5ba14192f45c None None] MFA Rules not processed for user `c631f558d99f40feb637f376bac1cffa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:32.052005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-15f2ca3e-a0c4-40b2-80fe-5ba14192f45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:32.172734 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1777/3568] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:32.226163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc0f04-06a5-4279-b19a-97c4329e868b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:32.227811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0dbc0f04-06a5-4279-b19a-97c4329e868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:32.248204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc0f04-06a5-4279-b19a-97c4329e868b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:32.284799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68887310-c417-4566-8abe-a20be73db9ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:32.285801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887310-c417-4566-8abe-a20be73db9ed service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:32.286251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887310-c417-4566-8abe-a20be73db9ed service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:32.286692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887310-c417-4566-8abe-a20be73db9ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:32.306053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68887310-c417-4566-8abe-a20be73db9ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:32.308397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68887310-c417-4566-8abe-a20be73db9ed service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:32.329596 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1792/3569] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:32 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:38.134714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5e672-ad02-44e5-86bb-09d1696f4e7a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:38.135543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5e672-ad02-44e5-86bb-09d1696f4e7a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:38.135971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5e672-ad02-44e5-86bb-09d1696f4e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:38.179088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-dec5e672-ad02-44e5-86bb-09d1696f4e7a None None] MFA Rules not processed for user `d900c75dc1dd4f5d9cac369d156e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:38.180566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dec5e672-ad02-44e5-86bb-09d1696f4e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:38.311756 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1778/3570] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:42.316251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=63 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:42.968589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68887310-c417-4566-8abe-a20be73db9ed service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:43.112185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68887310-c417-4566-8abe-a20be73db9ed service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:43.126149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fee470-e04e-4f88-aee6-5d10bf00e7af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:43.127054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fee470-e04e-4f88-aee6-5d10bf00e7af service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:43.127888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fee470-e04e-4f88-aee6-5d10bf00e7af service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:43.128239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fee470-e04e-4f88-aee6-5d10bf00e7af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:43.131126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-06fee470-e04e-4f88-aee6-5d10bf00e7af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:43.182494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fee470-e04e-4f88-aee6-5d10bf00e7af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:43.185050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fee470-e04e-4f88-aee6-5d10bf00e7af service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:43.257461 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1793/3571] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:43.395786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5e672-ad02-44e5-86bb-09d1696f4e7a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:43.398239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dec5e672-ad02-44e5-86bb-09d1696f4e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:43.425538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5e672-ad02-44e5-86bb-09d1696f4e7a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:43.446924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b4562-3084-44ec-8144-dc5c2def1496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:43.447989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b4562-3084-44ec-8144-dc5c2def1496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:43.449401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b4562-3084-44ec-8144-dc5c2def1496 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:43.449906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b4562-3084-44ec-8144-dc5c2def1496 admin admin] PATH_INFO: `/v3/users/1e7f1e9746ee441a9c8d7bf64e22fb35` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:43.455736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b4562-3084-44ec-8144-dc5c2def1496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7f1e9746ee441a9c8d7bf64e22fb35)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:43.464724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b4562-3084-44ec-8144-dc5c2def1496 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:43.550726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:43.568891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e10b4562-3084-44ec-8144-dc5c2def1496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7f1e9746ee441a9c8d7bf64e22fb35'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:43.569999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e10b4562-3084-44ec-8144-dc5c2def1496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7f1e9746ee441a9c8d7bf64e22fb35'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:43.592247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e10b4562-3084-44ec-8144-dc5c2def1496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7f1e9746ee441a9c8d7bf64e22fb35'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:43.605887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e10b4562-3084-44ec-8144-dc5c2def1496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7f1e9746ee441a9c8d7bf64e22fb35'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:43.617599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e10b4562-3084-44ec-8144-dc5c2def1496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7f1e9746ee441a9c8d7bf64e22fb35'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:43.631106 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1779/3572] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:43 2022] DELETE /identity/v3/users/1e7f1e9746ee441a9c8d7bf64e22fb35 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:44.788839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fee470-e04e-4f88-aee6-5d10bf00e7af service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:44.819860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fee470-e04e-4f88-aee6-5d10bf00e7af service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:45.059902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:45.060935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:45.063394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:45.064269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] PATH_INFO: `/v3/projects/3bb6fbf36e924067b4c98bd14a30ff3f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:45.070691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb6fbf36e924067b4c98bd14a30ff3f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:45.076134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:45.167984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb6fbf36e924067b4c98bd14a30ff3f', 'request_id': 'req-b3fdc966-1e56-49ad-8bba-8f7b3667e224'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:45.176332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb6fbf36e924067b4c98bd14a30ff3f', 'request_id': 'req-b3fdc966-1e56-49ad-8bba-8f7b3667e224'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:45.185906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb6fbf36e924067b4c98bd14a30ff3f', 'request_id': 'req-b3fdc966-1e56-49ad-8bba-8f7b3667e224'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:45.199988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] The token cache is being invalidate because project 3bb6fbf36e924067b4c98bd14a30ff3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:45.200516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:45.202228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3fdc966-1e56-49ad-8bba-8f7b3667e224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:45.204744 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1794/3573] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:44 2022] DELETE /identity/v3/projects/3bb6fbf36e924067b4c98bd14a30ff3f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:45.211684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34792401-d836-4db0-9c8c-291ac3e98a4d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:45.212588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34792401-d836-4db0-9c8c-291ac3e98a4d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:45.213039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34792401-d836-4db0-9c8c-291ac3e98a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:45.252555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-34792401-d836-4db0-9c8c-291ac3e98a4d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:45.254327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-34792401-d836-4db0-9c8c-291ac3e98a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:45.336792 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1780/3574] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:45.345321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720567f8-deb2-4871-a6c5-bf3c444bdf1f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:45.346570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720567f8-deb2-4871-a6c5-bf3c444bdf1f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:45.347089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720567f8-deb2-4871-a6c5-bf3c444bdf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:45.387913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-720567f8-deb2-4871-a6c5-bf3c444bdf1f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:45.396007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-720567f8-deb2-4871-a6c5-bf3c444bdf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:45.415086 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1795/3575] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:45.418876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34792401-d836-4db0-9c8c-291ac3e98a4d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:45.432715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34792401-d836-4db0-9c8c-291ac3e98a4d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:45.438982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74027a-7815-4c9c-a803-debf25bf8255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:45.440840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74027a-7815-4c9c-a803-debf25bf8255 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:45.441303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74027a-7815-4c9c-a803-debf25bf8255 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:45.442131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74027a-7815-4c9c-a803-debf25bf8255 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:45.443522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74027a-7815-4c9c-a803-debf25bf8255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:45.444128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74027a-7815-4c9c-a803-debf25bf8255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:45.446127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74027a-7815-4c9c-a803-debf25bf8255 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:45.463005 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1781/3576] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:45.467259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720567f8-deb2-4871-a6c5-bf3c444bdf1f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:45.477428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720567f8-deb2-4871-a6c5-bf3c444bdf1f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:45.501434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540822bd-f520-41e3-86f7-73e80e83e2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:45.502079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540822bd-f520-41e3-86f7-73e80e83e2cd admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:45.502374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540822bd-f520-41e3-86f7-73e80e83e2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:45.502687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540822bd-f520-41e3-86f7-73e80e83e2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:45.503267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540822bd-f520-41e3-86f7-73e80e83e2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:45.505245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540822bd-f520-41e3-86f7-73e80e83e2cd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:45.527914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:45.563034 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1796/3577] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:45 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:45.564005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74027a-7815-4c9c-a803-debf25bf8255 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:45.581568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74027a-7815-4c9c-a803-debf25bf8255 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:45.672100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f0d1-2c17-4fe1-8084-69bdfd4a02d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:45.672980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f0d1-2c17-4fe1-8084-69bdfd4a02d7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:45.673518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f0d1-2c17-4fe1-8084-69bdfd4a02d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:45.674073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f0d1-2c17-4fe1-8084-69bdfd4a02d7 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:45.674961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885f0d1-2c17-4fe1-8084-69bdfd4a02d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:45.677254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885f0d1-2c17-4fe1-8084-69bdfd4a02d7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:45.706416 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1782/3578] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:45 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:39:45.710321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540822bd-f520-41e3-86f7-73e80e83e2cd admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:45.725381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540822bd-f520-41e3-86f7-73e80e83e2cd admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:45.737736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb43f5-e0ac-4195-aaeb-1510b337f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:45.739391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb43f5-e0ac-4195-aaeb-1510b337f6af admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:45.740268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb43f5-e0ac-4195-aaeb-1510b337f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:45.740628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb43f5-e0ac-4195-aaeb-1510b337f6af admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:45.741975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb43f5-e0ac-4195-aaeb-1510b337f6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:45.746014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb43f5-e0ac-4195-aaeb-1510b337f6af admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:45.784489 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1797/3579] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:45.785330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f0d1-2c17-4fe1-8084-69bdfd4a02d7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:45.800197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f0d1-2c17-4fe1-8084-69bdfd4a02d7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:45.806927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ee25b-9777-4b56-9f1b-c787bf6c55fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:45.807865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ee25b-9777-4b56-9f1b-c787bf6c55fe admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:45.808407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ee25b-9777-4b56-9f1b-c787bf6c55fe admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:45.808953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ee25b-9777-4b56-9f1b-c787bf6c55fe admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:45.809916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ee25b-9777-4b56-9f1b-c787bf6c55fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:45.811966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ee25b-9777-4b56-9f1b-c787bf6c55fe admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:45.829055 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1783/3580] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:39:45.834651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb43f5-e0ac-4195-aaeb-1510b337f6af admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:45.860168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb43f5-e0ac-4195-aaeb-1510b337f6af admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:45.869084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac09b87-70cf-4d91-aeb4-56facf4ce8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:45.870544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09b87-70cf-4d91-aeb4-56facf4ce8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:45.871188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09b87-70cf-4d91-aeb4-56facf4ce8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:45.871798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac09b87-70cf-4d91-aeb4-56facf4ce8b5 admin admin] PATH_INFO: `/v3/projects/fe151c445bb64766b4a8f2282ed2f1de/users/f0c165a4dd4648888d45d44df5acbe2b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:45.895443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac09b87-70cf-4d91-aeb4-56facf4ce8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe151c445bb64766b4a8f2282ed2f1de, user_id=f0c165a4dd4648888d45d44df5acbe2b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:45.899022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac09b87-70cf-4d91-aeb4-56facf4ce8b5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:45.933253 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1798/3581] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:45 2022] PUT /identity/v3/projects/fe151c445bb64766b4a8f2282ed2f1de/users/f0c165a4dd4648888d45d44df5acbe2b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:45.942566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f4e0-4534-4b3a-86b0-9c8da69d2885 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:45.942977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f4e0-4534-4b3a-86b0-9c8da69d2885 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:45.943486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f4e0-4534-4b3a-86b0-9c8da69d2885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:45.989148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac09b87-70cf-4d91-aeb4-56facf4ce8b5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:45.994666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5ac09b87-70cf-4d91-aeb4-56facf4ce8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:46.016448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5953f4e0-4534-4b3a-86b0-9c8da69d2885 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:46.023108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5953f4e0-4534-4b3a-86b0-9c8da69d2885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:46.073029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:46.149470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac09b87-70cf-4d91-aeb4-56facf4ce8b5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:46.162507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ef277-1f73-4fb6-9fa0-37d9fb5a3165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:46.163411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef277-1f73-4fb6-9fa0-37d9fb5a3165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:46.169181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef277-1f73-4fb6-9fa0-37d9fb5a3165 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:46.169725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef277-1f73-4fb6-9fa0-37d9fb5a3165 admin admin] PATH_INFO: `/v3/users/a7e987f3fba14c4e8b588bae82e5a728` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:46.172716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ef277-1f73-4fb6-9fa0-37d9fb5a3165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e987f3fba14c4e8b588bae82e5a728)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:46.179259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ef277-1f73-4fb6-9fa0-37d9fb5a3165 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:46.184281 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1784/3582] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:46.193070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f4e0-4534-4b3a-86b0-9c8da69d2885 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:46.195230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5953f4e0-4534-4b3a-86b0-9c8da69d2885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:46.276681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f4e0-4534-4b3a-86b0-9c8da69d2885 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:46.283675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e9ca8-2b0d-4cf0-abcc-d1175c88623f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:46.286286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e9ca8-2b0d-4cf0-abcc-d1175c88623f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:46.286729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e9ca8-2b0d-4cf0-abcc-d1175c88623f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:46.287695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e9ca8-2b0d-4cf0-abcc-d1175c88623f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:46.299252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-039ef277-1f73-4fb6-9fa0-37d9fb5a3165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e987f3fba14c4e8b588bae82e5a728'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.300139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-039ef277-1f73-4fb6-9fa0-37d9fb5a3165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e987f3fba14c4e8b588bae82e5a728'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.312208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e9ca8-2b0d-4cf0-abcc-d1175c88623f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:46.314080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e9ca8-2b0d-4cf0-abcc-d1175c88623f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:46.331812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-039ef277-1f73-4fb6-9fa0-37d9fb5a3165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e987f3fba14c4e8b588bae82e5a728'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.332962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-039ef277-1f73-4fb6-9fa0-37d9fb5a3165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e987f3fba14c4e8b588bae82e5a728'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.339292 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1785/3583] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:46.344291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-039ef277-1f73-4fb6-9fa0-37d9fb5a3165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e987f3fba14c4e8b588bae82e5a728'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:46.372091 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1799/3584] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:45 2022] DELETE /identity/v3/users/a7e987f3fba14c4e8b588bae82e5a728 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:46.681495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e9ca8-2b0d-4cf0-abcc-d1175c88623f service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:46.706954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e9ca8-2b0d-4cf0-abcc-d1175c88623f service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:46.825479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:46.826063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:46.826438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:46.826723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] PATH_INFO: `/v3/projects/b334df134f284700bf2e2ce6e639138d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:46.835229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b334df134f284700bf2e2ce6e639138d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:46.837195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.030507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b334df134f284700bf2e2ce6e639138d', 'request_id': 'req-af03cd13-374d-4f0b-b542-65a992e06077'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.045562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b334df134f284700bf2e2ce6e639138d', 'request_id': 'req-af03cd13-374d-4f0b-b542-65a992e06077'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.050938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:47.063690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b334df134f284700bf2e2ce6e639138d', 'request_id': 'req-af03cd13-374d-4f0b-b542-65a992e06077'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.085038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] The token cache is being invalidate because project b334df134f284700bf2e2ce6e639138d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:47.085335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.086048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af03cd13-374d-4f0b-b542-65a992e06077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:47.093315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86918ed2-d332-4cc2-8c70-037aa9d4fe67 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.093764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86918ed2-d332-4cc2-8c70-037aa9d4fe67 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.093869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86918ed2-d332-4cc2-8c70-037aa9d4fe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.103949 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1786/3585] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:46 2022] DELETE /identity/v3/projects/b334df134f284700bf2e2ce6e639138d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:47.132086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-86918ed2-d332-4cc2-8c70-037aa9d4fe67 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:47.137107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-86918ed2-d332-4cc2-8c70-037aa9d4fe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:47.220163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:47.300525 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1800/3586] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:47.301639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e89f2-fc4c-4c69-9587-079a4efaf46e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.302438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e89f2-fc4c-4c69-9587-079a4efaf46e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.302724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e89f2-fc4c-4c69-9587-079a4efaf46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.343887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-414e89f2-fc4c-4c69-9587-079a4efaf46e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:47.345155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-414e89f2-fc4c-4c69-9587-079a4efaf46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:47.366404 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1787/3587] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:47.371207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86918ed2-d332-4cc2-8c70-037aa9d4fe67 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.384558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86918ed2-d332-4cc2-8c70-037aa9d4fe67 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.389958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90747c-ad00-48d4-bff5-4925313d41b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.390779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90747c-ad00-48d4-bff5-4925313d41b3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.391314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90747c-ad00-48d4-bff5-4925313d41b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.391911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90747c-ad00-48d4-bff5-4925313d41b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.392864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90747c-ad00-48d4-bff5-4925313d41b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:47.393339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90747c-ad00-48d4-bff5-4925313d41b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.395550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90747c-ad00-48d4-bff5-4925313d41b3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.415319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e89f2-fc4c-4c69-9587-079a4efaf46e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.421683 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1801/3588] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:47.427636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e89f2-fc4c-4c69-9587-079a4efaf46e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.432964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98acc1-afdb-429a-8138-7774b08f5803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.433941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98acc1-afdb-429a-8138-7774b08f5803 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.434403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98acc1-afdb-429a-8138-7774b08f5803 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.435016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98acc1-afdb-429a-8138-7774b08f5803 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.436152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98acc1-afdb-429a-8138-7774b08f5803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.438393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98acc1-afdb-429a-8138-7774b08f5803 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.513231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90747c-ad00-48d4-bff5-4925313d41b3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.520332 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1788/3589] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:47 2022] POST /identity/v3/projects => generated 401 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:47.530006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90747c-ad00-48d4-bff5-4925313d41b3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.668605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598cf69-f877-4c76-8a55-d162f27cb4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.669523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598cf69-f877-4c76-8a55-d162f27cb4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.670809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598cf69-f877-4c76-8a55-d162f27cb4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.671257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598cf69-f877-4c76-8a55-d162f27cb4b8 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.671925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598cf69-f877-4c76-8a55-d162f27cb4b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.673971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598cf69-f877-4c76-8a55-d162f27cb4b8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.735093 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1802/3590] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:47 2022] POST /identity/v3/users => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:47.739386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98acc1-afdb-429a-8138-7774b08f5803 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.755488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98acc1-afdb-429a-8138-7774b08f5803 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.765004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3514808-724b-40c4-9da7-ed0fa97f8b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.765581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3514808-724b-40c4-9da7-ed0fa97f8b65 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.765867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3514808-724b-40c4-9da7-ed0fa97f8b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.766147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3514808-724b-40c4-9da7-ed0fa97f8b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.766811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3514808-724b-40c4-9da7-ed0fa97f8b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.768431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3514808-724b-40c4-9da7-ed0fa97f8b65 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.785680 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1789/3591] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:47.790235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598cf69-f877-4c76-8a55-d162f27cb4b8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.805623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598cf69-f877-4c76-8a55-d162f27cb4b8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.819735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c836f-b493-4a76-b4cc-3f1a2c39de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.820471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c836f-b493-4a76-b4cc-3f1a2c39de27 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.821787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c836f-b493-4a76-b4cc-3f1a2c39de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.823249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c836f-b493-4a76-b4cc-3f1a2c39de27 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.824154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c836f-b493-4a76-b4cc-3f1a2c39de27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.831081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c836f-b493-4a76-b4cc-3f1a2c39de27 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.848498 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1803/3592] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:47.850322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3514808-724b-40c4-9da7-ed0fa97f8b65 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:47.876368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3514808-724b-40c4-9da7-ed0fa97f8b65 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:47.888428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb560ac-ea5c-4131-a7da-36321e04ee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:47.889601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb560ac-ea5c-4131-a7da-36321e04ee4f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.890842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb560ac-ea5c-4131-a7da-36321e04ee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.892897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb560ac-ea5c-4131-a7da-36321e04ee4f admin admin] PATH_INFO: `/v3/projects/213958ef743d4e4ca1fab9535912590b/users/6462cf2be07848bc9b05d492f49c7866/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:47.917885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb560ac-ea5c-4131-a7da-36321e04ee4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=213958ef743d4e4ca1fab9535912590b, user_id=6462cf2be07848bc9b05d492f49c7866, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:47.920553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb560ac-ea5c-4131-a7da-36321e04ee4f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:47.953570 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1790/3593] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:47 2022] PUT /identity/v3/projects/213958ef743d4e4ca1fab9535912590b/users/6462cf2be07848bc9b05d492f49c7866/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:47.958661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af43bb-f3fc-4c50-a9e1-a0098085230a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:47.958951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af43bb-f3fc-4c50-a9e1-a0098085230a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:47.959228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af43bb-f3fc-4c50-a9e1-a0098085230a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.006486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-49af43bb-f3fc-4c50-a9e1-a0098085230a None None] MFA Rules not processed for user `6462cf2be07848bc9b05d492f49c7866`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:48.008907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-49af43bb-f3fc-4c50-a9e1-a0098085230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:48.123594 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1804/3594] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:48.304332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb560ac-ea5c-4131-a7da-36321e04ee4f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.306512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3bb560ac-ea5c-4131-a7da-36321e04ee4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:48.465552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb560ac-ea5c-4131-a7da-36321e04ee4f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.482976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adc1fb-cf13-4205-b68f-59e75aa0599a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.484650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adc1fb-cf13-4205-b68f-59e75aa0599a service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.484998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adc1fb-cf13-4205-b68f-59e75aa0599a service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.485348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adc1fb-cf13-4205-b68f-59e75aa0599a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.496751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adc1fb-cf13-4205-b68f-59e75aa0599a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.509148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adc1fb-cf13-4205-b68f-59e75aa0599a service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.546316 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1791/3595] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:48 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:48.596501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af43bb-f3fc-4c50-a9e1-a0098085230a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:48.693726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:48.778887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af43bb-f3fc-4c50-a9e1-a0098085230a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:48.791559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:48.792231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.792515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.792799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] PATH_INFO: `/v3/users/6462cf2be07848bc9b05d492f49c7866` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:48.794457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6462cf2be07848bc9b05d492f49c7866)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:48.797207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:48.898808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6462cf2be07848bc9b05d492f49c7866'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.899531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6462cf2be07848bc9b05d492f49c7866'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.925814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6462cf2be07848bc9b05d492f49c7866'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.926719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6462cf2be07848bc9b05d492f49c7866'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.950637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6462cf2be07848bc9b05d492f49c7866'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:48.967074 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1805/3596] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:48 2022] DELETE /identity/v3/users/6462cf2be07848bc9b05d492f49c7866 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:48.971763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935edb-fd7d-4b30-a551-6e7553160698 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:48.972401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935edb-fd7d-4b30-a551-6e7553160698 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:48.973035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935edb-fd7d-4b30-a551-6e7553160698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.008494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-42935edb-fd7d-4b30-a551-6e7553160698 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:49.010311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42935edb-fd7d-4b30-a551-6e7553160698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:49.155265 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1792/3597] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:49.205722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:49.208749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:49.322002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ba28a-65ff-4fee-be2a-8d589492d0ec admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:49.326645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baec30-66d3-474c-902c-b4261a6d7368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:49.327555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baec30-66d3-474c-902c-b4261a6d7368 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:49.328059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baec30-66d3-474c-902c-b4261a6d7368 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:49.328713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baec30-66d3-474c-902c-b4261a6d7368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:49.348685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baec30-66d3-474c-902c-b4261a6d7368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:49.353136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baec30-66d3-474c-902c-b4261a6d7368 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:49.372156 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1806/3598] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:50.279560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935edb-fd7d-4b30-a551-6e7553160698 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:50.282213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42935edb-fd7d-4b30-a551-6e7553160698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:50.303590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935edb-fd7d-4b30-a551-6e7553160698 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:50.319002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:50.319661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.319940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.320893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] PATH_INFO: `/v3/projects/213958ef743d4e4ca1fab9535912590b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.322136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=213958ef743d4e4ca1fab9535912590b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:50.324136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:50.335464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:50.362498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0c81-c09f-413f-a244-df0564cb2e10 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.362963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0c81-c09f-413f-a244-df0564cb2e10 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.362963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0c81-c09f-413f-a244-df0564cb2e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.401846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f15c0c81-c09f-413f-a244-df0564cb2e10 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:50.403857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f15c0c81-c09f-413f-a244-df0564cb2e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:50.443594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213958ef743d4e4ca1fab9535912590b', 'request_id': 'req-9b5a83f7-1e38-495b-af47-3470cb1c4426'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:50.464551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213958ef743d4e4ca1fab9535912590b', 'request_id': 'req-9b5a83f7-1e38-495b-af47-3470cb1c4426'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:50.476688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213958ef743d4e4ca1fab9535912590b', 'request_id': 'req-9b5a83f7-1e38-495b-af47-3470cb1c4426'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:50.485644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:50.530049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] The token cache is being invalidate because project 213958ef743d4e4ca1fab9535912590b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:50.531122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:50.532578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:50.541725 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1807/3599] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:39:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:50.542966 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1793/3600] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:50 2022] DELETE /identity/v3/projects/213958ef743d4e4ca1fab9535912590b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:50.558168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541ba8e-5106-4cae-8ba3-76c440839021 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.558692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541ba8e-5106-4cae-8ba3-76c440839021 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.559180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541ba8e-5106-4cae-8ba3-76c440839021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.559303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:50.560951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:50.601088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6541ba8e-5106-4cae-8ba3-76c440839021 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:50.607370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6541ba8e-5106-4cae-8ba3-76c440839021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:50.717162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a83f7-1e38-495b-af47-3470cb1c4426 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:50.743239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc53a0d-da73-4bd9-aa34-6e233bd2ab93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:50.744096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53a0d-da73-4bd9-aa34-6e233bd2ab93 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.744383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53a0d-da73-4bd9-aa34-6e233bd2ab93 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.744665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53a0d-da73-4bd9-aa34-6e233bd2ab93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.750047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8cc53a0d-da73-4bd9-aa34-6e233bd2ab93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:50.761445 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1808/3601] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:50.770230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c475-b4a2-44a0-a292-afe010e88d20 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.770709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c475-b4a2-44a0-a292-afe010e88d20 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.771144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c475-b4a2-44a0-a292-afe010e88d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.814578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4ba4c475-b4a2-44a0-a292-afe010e88d20 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:50.818201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4ba4c475-b4a2-44a0-a292-afe010e88d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:50.842679 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1809/3602] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:50.847081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4c475-b4a2-44a0-a292-afe010e88d20 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:50.867214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4c475-b4a2-44a0-a292-afe010e88d20 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:50.882324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1f84-2acb-4351-a3d1-e65ad0c61f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:50.882958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1f84-2acb-4351-a3d1-e65ad0c61f11 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.885712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1f84-2acb-4351-a3d1-e65ad0c61f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.886071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1f84-2acb-4351-a3d1-e65ad0c61f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.886947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd1f84-2acb-4351-a3d1-e65ad0c61f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:50.887259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd1f84-2acb-4351-a3d1-e65ad0c61f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:50.888891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd1f84-2acb-4351-a3d1-e65ad0c61f11 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:50.925547 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1810/3603] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:39:50.927317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1f84-2acb-4351-a3d1-e65ad0c61f11 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:50.948310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1f84-2acb-4351-a3d1-e65ad0c61f11 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:50.959586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365ea83-623b-4248-80e3-f74089636298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:50.960214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365ea83-623b-4248-80e3-f74089636298 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:50.960496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365ea83-623b-4248-80e3-f74089636298 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:50.960770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365ea83-623b-4248-80e3-f74089636298 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:50.961495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365ea83-623b-4248-80e3-f74089636298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:50.965250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365ea83-623b-4248-80e3-f74089636298 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:51.002349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc53a0d-da73-4bd9-aa34-6e233bd2ab93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:51.015411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc53a0d-da73-4bd9-aa34-6e233bd2ab93 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:51.028943 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1811/3604] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:50 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:51.030206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365ea83-623b-4248-80e3-f74089636298 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:51.052784 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1794/3605] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:39:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:51.232488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365ea83-623b-4248-80e3-f74089636298 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:51.246447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beccdd-ae29-45c4-9a9f-70c546bcb2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:51.247871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beccdd-ae29-45c4-9a9f-70c546bcb2ad admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:51.249866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beccdd-ae29-45c4-9a9f-70c546bcb2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:51.250223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beccdd-ae29-45c4-9a9f-70c546bcb2ad admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:51.258139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beccdd-ae29-45c4-9a9f-70c546bcb2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:51.264234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beccdd-ae29-45c4-9a9f-70c546bcb2ad admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:51.325863 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1812/3606] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:51 2022] POST /identity/v3/users => generated 286 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:51.326119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc53a0d-da73-4bd9-aa34-6e233bd2ab93 service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:51.343658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc53a0d-da73-4bd9-aa34-6e233bd2ab93 service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:51.370033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051da77d-63fc-403e-b35a-89cb6451f1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:51.372306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051da77d-63fc-403e-b35a-89cb6451f1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:51.372591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051da77d-63fc-403e-b35a-89cb6451f1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:51.372872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051da77d-63fc-403e-b35a-89cb6451f1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:51.379747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051da77d-63fc-403e-b35a-89cb6451f1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:51.385188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051da77d-63fc-403e-b35a-89cb6451f1c9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:51.455256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beccdd-ae29-45c4-9a9f-70c546bcb2ad admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:51.458435 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1795/3607] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:51.484529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beccdd-ae29-45c4-9a9f-70c546bcb2ad admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:51.495720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d87e7-d934-48b3-8ee6-90e0b03a26da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:51.497616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d87e7-d934-48b3-8ee6-90e0b03a26da admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:51.500614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d87e7-d934-48b3-8ee6-90e0b03a26da admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:51.501578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d87e7-d934-48b3-8ee6-90e0b03a26da admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:51.504407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d87e7-d934-48b3-8ee6-90e0b03a26da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:51.510682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d87e7-d934-48b3-8ee6-90e0b03a26da admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:51.543234 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1813/3608] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:51.543770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051da77d-63fc-403e-b35a-89cb6451f1c9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:51.569846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051da77d-63fc-403e-b35a-89cb6451f1c9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:51.575059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038eaecb-6412-490f-b21b-21e594037fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:51.575724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038eaecb-6412-490f-b21b-21e594037fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:51.576003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038eaecb-6412-490f-b21b-21e594037fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:51.576277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038eaecb-6412-490f-b21b-21e594037fc8 admin admin] PATH_INFO: `/v3/projects/1a7f041a45b14dd6a3ee43d4b2e55a03/users/3fa47fbc7a23461a89b2a0ed04e8277a/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:51.634495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038eaecb-6412-490f-b21b-21e594037fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7f041a45b14dd6a3ee43d4b2e55a03, user_id=3fa47fbc7a23461a89b2a0ed04e8277a, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:51.640515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038eaecb-6412-490f-b21b-21e594037fc8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:51.683122 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1796/3609] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:51 2022] PUT /identity/v3/projects/1a7f041a45b14dd6a3ee43d4b2e55a03/users/3fa47fbc7a23461a89b2a0ed04e8277a/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:51.690011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44c4b-9825-4e69-b3af-6783531fc909 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:51.690989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44c4b-9825-4e69-b3af-6783531fc909 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:51.691531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44c4b-9825-4e69-b3af-6783531fc909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:51.738407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f9a44c4b-9825-4e69-b3af-6783531fc909 None None] MFA Rules not processed for user `3fa47fbc7a23461a89b2a0ed04e8277a`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:51.739668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f9a44c4b-9825-4e69-b3af-6783531fc909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:51.786450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:51.840594 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1814/3610] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:51.855770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038eaecb-6412-490f-b21b-21e594037fc8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:51.859001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-038eaecb-6412-490f-b21b-21e594037fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:51.865725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:52.007230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038eaecb-6412-490f-b21b-21e594037fc8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:52.014856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d87f9-3f68-4af5-afd2-b60f967e6159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:52.016833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d87f9-3f68-4af5-afd2-b60f967e6159 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:52.016833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d87f9-3f68-4af5-afd2-b60f967e6159 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:52.016833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d87f9-3f68-4af5-afd2-b60f967e6159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:52.048244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d87f9-3f68-4af5-afd2-b60f967e6159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:52.055857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d87f9-3f68-4af5-afd2-b60f967e6159 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:52.067579 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1797/3611] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:53.551950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a44c4b-9825-4e69-b3af-6783531fc909 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:53.696666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a44c4b-9825-4e69-b3af-6783531fc909 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:53.707057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:53.707977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:53.708426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:53.708850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] PATH_INFO: `/v3/users/3fa47fbc7a23461a89b2a0ed04e8277a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:53.710242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa47fbc7a23461a89b2a0ed04e8277a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:53.712717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:53.794112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa47fbc7a23461a89b2a0ed04e8277a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.794826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa47fbc7a23461a89b2a0ed04e8277a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.818082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa47fbc7a23461a89b2a0ed04e8277a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.819079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa47fbc7a23461a89b2a0ed04e8277a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.830399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa47fbc7a23461a89b2a0ed04e8277a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:53.856486 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1815/3612] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:39:53 2022] DELETE /identity/v3/users/3fa47fbc7a23461a89b2a0ed04e8277a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:53.860657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01b37d-08d5-4e6c-b07a-3bac3ecbe786 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:53.861218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01b37d-08d5-4e6c-b07a-3bac3ecbe786 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:53.861317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01b37d-08d5-4e6c-b07a-3bac3ecbe786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:53.907234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ad01b37d-08d5-4e6c-b07a-3bac3ecbe786 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:53.909859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ad01b37d-08d5-4e6c-b07a-3bac3ecbe786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:54.029403 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1798/3613] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:54.056618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:54.058467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:54.182297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:54.196890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370f83-d680-43fd-9160-3531c063dd6f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:54.202350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41075aa-0167-43b8-a4a0-535d99b26b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:54.203090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41075aa-0167-43b8-a4a0-535d99b26b39 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:54.203487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41075aa-0167-43b8-a4a0-535d99b26b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:54.203862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41075aa-0167-43b8-a4a0-535d99b26b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:54.218946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41075aa-0167-43b8-a4a0-535d99b26b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:54.220605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41075aa-0167-43b8-a4a0-535d99b26b39 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:54.242809 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1816/3614] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:55.117739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01b37d-08d5-4e6c-b07a-3bac3ecbe786 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:55.119253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ad01b37d-08d5-4e6c-b07a-3bac3ecbe786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:55.139856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01b37d-08d5-4e6c-b07a-3bac3ecbe786 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:55.146367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:55.147291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:55.148061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:55.148526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] PATH_INFO: `/v3/projects/1a7f041a45b14dd6a3ee43d4b2e55a03` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:55.150433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7f041a45b14dd6a3ee43d4b2e55a03)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:55.152999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:55.326402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7f041a45b14dd6a3ee43d4b2e55a03', 'request_id': 'req-d41df204-5403-4b96-a890-cd66693be0ed'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.333766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7f041a45b14dd6a3ee43d4b2e55a03', 'request_id': 'req-d41df204-5403-4b96-a890-cd66693be0ed'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.344160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7f041a45b14dd6a3ee43d4b2e55a03', 'request_id': 'req-d41df204-5403-4b96-a890-cd66693be0ed'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.369161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] The token cache is being invalidate because project 1a7f041a45b14dd6a3ee43d4b2e55a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:39:55.369796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.370964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d41df204-5403-4b96-a890-cd66693be0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:39:55.373105 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1799/3615] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:39:55 2022] DELETE /identity/v3/projects/1a7f041a45b14dd6a3ee43d4b2e55a03 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:55.378642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3a6dd-7d27-4282-a790-3fb0e48d3eb5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:55.379157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3a6dd-7d27-4282-a790-3fb0e48d3eb5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:55.379242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3a6dd-7d27-4282-a790-3fb0e48d3eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:55.422552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-35e3a6dd-7d27-4282-a790-3fb0e48d3eb5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:55.424524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-35e3a6dd-7d27-4282-a790-3fb0e48d3eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:55.568300 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1817/3616] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:55.575878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2110b-343d-47f9-8748-37a78d0fdb1d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:55.577549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2110b-343d-47f9-8748-37a78d0fdb1d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:55.577879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2110b-343d-47f9-8748-37a78d0fdb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:55.604661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5da2110b-343d-47f9-8748-37a78d0fdb1d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:55.606829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5da2110b-343d-47f9-8748-37a78d0fdb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:55.643356 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1800/3617] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:55.645563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3a6dd-7d27-4282-a790-3fb0e48d3eb5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:55.657406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3a6dd-7d27-4282-a790-3fb0e48d3eb5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:55.683675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3767d9-b55d-44fc-957b-6ec91ad53211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:55.692106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3767d9-b55d-44fc-957b-6ec91ad53211 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:55.692390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3767d9-b55d-44fc-957b-6ec91ad53211 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:55.692672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3767d9-b55d-44fc-957b-6ec91ad53211 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:55.693354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3767d9-b55d-44fc-957b-6ec91ad53211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:39:55.693700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3767d9-b55d-44fc-957b-6ec91ad53211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:55.695445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3767d9-b55d-44fc-957b-6ec91ad53211 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:55.730339 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1818/3618] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:39:55.732335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2110b-343d-47f9-8748-37a78d0fdb1d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:55.747951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:55.753937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2110b-343d-47f9-8748-37a78d0fdb1d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:55.769922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07ef9a-c497-4f1c-88f5-a6188412edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:55.770550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07ef9a-c497-4f1c-88f5-a6188412edaf admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:55.770832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07ef9a-c497-4f1c-88f5-a6188412edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:55.771109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07ef9a-c497-4f1c-88f5-a6188412edaf admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:55.771755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07ef9a-c497-4f1c-88f5-a6188412edaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:55.779606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07ef9a-c497-4f1c-88f5-a6188412edaf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:55.827833 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1801/3619] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:39:55 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:55.829331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3767d9-b55d-44fc-957b-6ec91ad53211 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:55.843260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3767d9-b55d-44fc-957b-6ec91ad53211 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:55.961316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49049120-60d8-4fdd-9429-8c6a0feff198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:55.962153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49049120-60d8-4fdd-9429-8c6a0feff198 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:55.962537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49049120-60d8-4fdd-9429-8c6a0feff198 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:55.962917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49049120-60d8-4fdd-9429-8c6a0feff198 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:55.963677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49049120-60d8-4fdd-9429-8c6a0feff198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:55.965922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49049120-60d8-4fdd-9429-8c6a0feff198 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:56.008632 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1819/3620] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:39:55 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:39:56.012609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07ef9a-c497-4f1c-88f5-a6188412edaf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:56.032688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07ef9a-c497-4f1c-88f5-a6188412edaf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:56.043111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2bff6-dcb0-4f05-a86b-e378558e93cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:56.043744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2bff6-dcb0-4f05-a86b-e378558e93cd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.044024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2bff6-dcb0-4f05-a86b-e378558e93cd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.044299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2bff6-dcb0-4f05-a86b-e378558e93cd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.044958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2bff6-dcb0-4f05-a86b-e378558e93cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:56.046614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2bff6-dcb0-4f05-a86b-e378558e93cd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:56.076124 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1802/3621] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:39:56.077003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49049120-60d8-4fdd-9429-8c6a0feff198 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:56.093170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49049120-60d8-4fdd-9429-8c6a0feff198 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:56.108897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587d6da-dd70-4132-b039-960f0e532f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:56.109940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587d6da-dd70-4132-b039-960f0e532f06 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.110499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587d6da-dd70-4132-b039-960f0e532f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.111515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587d6da-dd70-4132-b039-960f0e532f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.112405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587d6da-dd70-4132-b039-960f0e532f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:56.114716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587d6da-dd70-4132-b039-960f0e532f06 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:56.143907 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1820/3622] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:39:56.148243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2bff6-dcb0-4f05-a86b-e378558e93cd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:56.167333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2bff6-dcb0-4f05-a86b-e378558e93cd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:56.183161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b37c2d-e102-4053-aed1-1b8c4c0b0c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:56.183849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b37c2d-e102-4053-aed1-1b8c4c0b0c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.184128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b37c2d-e102-4053-aed1-1b8c4c0b0c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.184414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b37c2d-e102-4053-aed1-1b8c4c0b0c90 admin admin] PATH_INFO: `/v3/projects/0e1f9ed29dd545da93c61d1a8cf9f37f/users/3b0b3cb059bc44e5b3eb892827315411/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.226761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b37c2d-e102-4053-aed1-1b8c4c0b0c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1f9ed29dd545da93c61d1a8cf9f37f, user_id=3b0b3cb059bc44e5b3eb892827315411, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:56.232360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b37c2d-e102-4053-aed1-1b8c4c0b0c90 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:56.269736 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1803/3623] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:39:56 2022] PUT /identity/v3/projects/0e1f9ed29dd545da93c61d1a8cf9f37f/users/3b0b3cb059bc44e5b3eb892827315411/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:39:56.274525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab627e1-05d3-4f94-9139-564ff5534f94 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.274816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab627e1-05d3-4f94-9139-564ff5534f94 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.275090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab627e1-05d3-4f94-9139-564ff5534f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.316460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3ab627e1-05d3-4f94-9139-564ff5534f94 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:56.317746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3ab627e1-05d3-4f94-9139-564ff5534f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:56.398678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a58ab-480b-4b33-b81a-4cabcde7147f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.402891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a58ab-480b-4b33-b81a-4cabcde7147f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.403524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a58ab-480b-4b33-b81a-4cabcde7147f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.424358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:56.440934 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1821/3624] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:56.451872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab627e1-05d3-4f94-9139-564ff5534f94 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:56.453647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3ab627e1-05d3-4f94-9139-564ff5534f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:56.453812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-845a58ab-480b-4b33-b81a-4cabcde7147f None None] MFA Rules not processed for user `f0c165a4dd4648888d45d44df5acbe2b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:56.456010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-845a58ab-480b-4b33-b81a-4cabcde7147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:56.546166 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1804/3625] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:39:56.554842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab627e1-05d3-4f94-9139-564ff5534f94 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:56.559884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20feb92d-b8f9-4b98-8f93-b485fd84900e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:56.560897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20feb92d-b8f9-4b98-8f93-b485fd84900e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.561285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20feb92d-b8f9-4b98-8f93-b485fd84900e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.561700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20feb92d-b8f9-4b98-8f93-b485fd84900e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.565815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a58ab-480b-4b33-b81a-4cabcde7147f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:56.587538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a58ab-480b-4b33-b81a-4cabcde7147f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:56.588516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20feb92d-b8f9-4b98-8f93-b485fd84900e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:56.590286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20feb92d-b8f9-4b98-8f93-b485fd84900e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:56.594297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bab3a7-5308-44a7-ac6e-a91b408f9471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:56.595452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab3a7-5308-44a7-ac6e-a91b408f9471 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:56.595926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab3a7-5308-44a7-ac6e-a91b408f9471 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:56.597142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab3a7-5308-44a7-ac6e-a91b408f9471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:56.613934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bab3a7-5308-44a7-ac6e-a91b408f9471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:56.615906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bab3a7-5308-44a7-ac6e-a91b408f9471 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:56.621423 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1822/3626] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:39:56.634735 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1805/3627] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:39:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:59.184873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b540-306f-47fc-ade5-29677f14722d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:59.185976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b540-306f-47fc-ade5-29677f14722d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:59.186417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b540-306f-47fc-ade5-29677f14722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:59.232540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-47a7b540-306f-47fc-ade5-29677f14722d None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:59.234308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-47a7b540-306f-47fc-ade5-29677f14722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:59.357688 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1823/3628] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:39:59.387158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bab3a7-5308-44a7-ac6e-a91b408f9471 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:39:59.389130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f9bab3a7-5308-44a7-ac6e-a91b408f9471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:59.512795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bab3a7-5308-44a7-ac6e-a91b408f9471 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:39:59.538321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb399f6-3142-4bd9-8ccd-895d829c524e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:39:59.539062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb399f6-3142-4bd9-8ccd-895d829c524e service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:59.539400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb399f6-3142-4bd9-8ccd-895d829c524e service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:59.540146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb399f6-3142-4bd9-8ccd-895d829c524e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:59.557295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb399f6-3142-4bd9-8ccd-895d829c524e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:39:59.559211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb399f6-3142-4bd9-8ccd-895d829c524e service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:39:59.579196 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1806/3629] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:39:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:59.733716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe764-6854-4083-8386-e4e52ada6a87 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:39:59.734009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe764-6854-4083-8386-e4e52ada6a87 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:39:59.734289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe764-6854-4083-8386-e4e52ada6a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:39:59.780098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8d2fe764-6854-4083-8386-e4e52ada6a87 None None] MFA Rules not processed for user `f0c165a4dd4648888d45d44df5acbe2b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:39:59.782091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8d2fe764-6854-4083-8386-e4e52ada6a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:39:59.808808 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1824/3630] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:01.877904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac3352-16ef-4129-bb97-d96b415237c7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:01.878431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac3352-16ef-4129-bb97-d96b415237c7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:01.878518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac3352-16ef-4129-bb97-d96b415237c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:01.924442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-85ac3352-16ef-4129-bb97-d96b415237c7 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:01.925241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-85ac3352-16ef-4129-bb97-d96b415237c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:01.945367 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1807/3631] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:01.978339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fe764-6854-4083-8386-e4e52ada6a87 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:02.016362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fe764-6854-4083-8386-e4e52ada6a87 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:02.036866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa7b66-413c-4256-9a5d-193bd034b6f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:02.038903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7b66-413c-4256-9a5d-193bd034b6f6 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:02.039565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7b66-413c-4256-9a5d-193bd034b6f6 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:02.040834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7b66-413c-4256-9a5d-193bd034b6f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:02.066328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa7b66-413c-4256-9a5d-193bd034b6f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:02.069237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa7b66-413c-4256-9a5d-193bd034b6f6 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:02.101235 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1825/3632] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:40:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:11.903243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:12.088990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=63 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:16.755220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892bbd-dc97-4947-9816-627d7ad0a08e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:16.756176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892bbd-dc97-4947-9816-627d7ad0a08e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:16.756707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892bbd-dc97-4947-9816-627d7ad0a08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:16.921015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-77892bbd-dc97-4947-9816-627d7ad0a08e None None] MFA Rules not processed for user `3b0b3cb059bc44e5b3eb892827315411`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:16.926810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-77892bbd-dc97-4947-9816-627d7ad0a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:17.252335 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1808/3633] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:18.322911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa7b66-413c-4256-9a5d-193bd034b6f6 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:18.324548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4eaa7b66-413c-4256-9a5d-193bd034b6f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:18.612309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa7b66-413c-4256-9a5d-193bd034b6f6 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:18.632805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a18954-d43c-409b-9e1a-b2eadf38ae2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:18.633659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18954-d43c-409b-9e1a-b2eadf38ae2e service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:18.640800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18954-d43c-409b-9e1a-b2eadf38ae2e service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:18.641209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18954-d43c-409b-9e1a-b2eadf38ae2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:18.675203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a18954-d43c-409b-9e1a-b2eadf38ae2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:18.679267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a18954-d43c-409b-9e1a-b2eadf38ae2e service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:18.718609 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1826/3634] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:40:23.842756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481f8cf-4d94-4346-a9fc-542dbdf098d6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:23.843616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481f8cf-4d94-4346-a9fc-542dbdf098d6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:23.844150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481f8cf-4d94-4346-a9fc-542dbdf098d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:23.936912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a481f8cf-4d94-4346-a9fc-542dbdf098d6 None None] MFA Rules not processed for user `065c5a92f9c04400be8a515e8233fb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:23.944323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a481f8cf-4d94-4346-a9fc-542dbdf098d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:24.208758 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1809/3635] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:40:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:40:26.835295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a18954-d43c-409b-9e1a-b2eadf38ae2e service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:26.836786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d2a18954-d43c-409b-9e1a-b2eadf38ae2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:26.863505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a18954-d43c-409b-9e1a-b2eadf38ae2e service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:26.875589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:26.876276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:26.876561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:26.879853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] PATH_INFO: `/v3/users/26cfb36460a54faca6f9a512c9329d25` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:26.896758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26cfb36460a54faca6f9a512c9329d25)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:26.908480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:27.058750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26cfb36460a54faca6f9a512c9329d25'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:27.060109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26cfb36460a54faca6f9a512c9329d25'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:27.093435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26cfb36460a54faca6f9a512c9329d25'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:27.094586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26cfb36460a54faca6f9a512c9329d25'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:27.116771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26cfb36460a54faca6f9a512c9329d25'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:27.146219 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1827/3636] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:26 2022] DELETE /identity/v3/users/26cfb36460a54faca6f9a512c9329d25 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:27.592706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb0359-a3f0-4d0c-b11c-78dee8b1d318 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:27.593174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb0359-a3f0-4d0c-b11c-78dee8b1d318 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:27.594125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb0359-a3f0-4d0c-b11c-78dee8b1d318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:27.678731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f9fb0359-a3f0-4d0c-b11c-78dee8b1d318 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:27.686243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f9fb0359-a3f0-4d0c-b11c-78dee8b1d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:27.874833 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1810/3637] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:40:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:27.888233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:27.891188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:28.010062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb0359-a3f0-4d0c-b11c-78dee8b1d318 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:28.012058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f9fb0359-a3f0-4d0c-b11c-78dee8b1d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:28.069125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:28.103491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118c21f-e576-4e54-bdaf-30405ecd56b6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:28.112289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f4e51-5792-49fa-a5f8-7b6236e844be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:28.114232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4e51-5792-49fa-a5f8-7b6236e844be service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:28.115839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4e51-5792-49fa-a5f8-7b6236e844be service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:28.116534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4e51-5792-49fa-a5f8-7b6236e844be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:28.148059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f4e51-5792-49fa-a5f8-7b6236e844be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:28.156109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f4e51-5792-49fa-a5f8-7b6236e844be service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:28.185748 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1828/3638] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:40:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:28.236365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:28.282473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb0359-a3f0-4d0c-b11c-78dee8b1d318 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:28.291658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:28.292788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:28.293189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:28.294670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] PATH_INFO: `/v3/projects/a252756856a8491fb600a3b03f24c598` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:28.297014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a252756856a8491fb600a3b03f24c598)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:28.301692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:28.435287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a252756856a8491fb600a3b03f24c598', 'request_id': 'req-2aba083e-092d-4c00-8462-0149c8982803'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.452723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a252756856a8491fb600a3b03f24c598', 'request_id': 'req-2aba083e-092d-4c00-8462-0149c8982803'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.467657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a252756856a8491fb600a3b03f24c598', 'request_id': 'req-2aba083e-092d-4c00-8462-0149c8982803'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.488850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] The token cache is being invalidate because project a252756856a8491fb600a3b03f24c598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:28.489176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.489818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2aba083e-092d-4c00-8462-0149c8982803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.491640 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1811/3639] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:28 2022] DELETE /identity/v3/projects/a252756856a8491fb600a3b03f24c598 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:28.495315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f4e51-5792-49fa-a5f8-7b6236e844be service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:28.514136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f4e51-5792-49fa-a5f8-7b6236e844be service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:28.600954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:28.601819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:28.605649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:28.606126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] PATH_INFO: `/v3/users/3a22eebaed5147cfaa130838d566e75f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:28.611065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a22eebaed5147cfaa130838d566e75f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:28.617779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:28.768926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a22eebaed5147cfaa130838d566e75f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.771654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a22eebaed5147cfaa130838d566e75f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.810250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a22eebaed5147cfaa130838d566e75f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.811388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a22eebaed5147cfaa130838d566e75f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.822547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a22eebaed5147cfaa130838d566e75f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:28.840754 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1829/3640] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:40:28 2022] DELETE /identity/v3/users/3a22eebaed5147cfaa130838d566e75f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:29.464293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d38f-966c-4a5c-a963-5465ceba8c8a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.464823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d38f-966c-4a5c-a963-5465ceba8c8a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.464823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434d38f-966c-4a5c-a963-5465ceba8c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.514343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6434d38f-966c-4a5c-a963-5465ceba8c8a None None] MFA Rules not processed for user `c631f558d99f40feb637f376bac1cffa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:29.515888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6434d38f-966c-4a5c-a963-5465ceba8c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:29.616959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:29.618519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:29.655896 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1812/3641] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:29.768756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c08805-b437-4838-8d04-12faf1878307 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:29.776708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:29.777773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.778407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.778879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] PATH_INFO: `/v3/projects/0d4e4f004c334e7195d9c7eb737b54cc` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.780590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4e4f004c334e7195d9c7eb737b54cc)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:29.783406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:29.798492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:29.896136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4e4f004c334e7195d9c7eb737b54cc', 'request_id': 'req-8a66b314-635f-4997-b0d3-0c33d56be146'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.906461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4e4f004c334e7195d9c7eb737b54cc', 'request_id': 'req-8a66b314-635f-4997-b0d3-0c33d56be146'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.918175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4e4f004c334e7195d9c7eb737b54cc', 'request_id': 'req-8a66b314-635f-4997-b0d3-0c33d56be146'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.949901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] The token cache is being invalidate because project 0d4e4f004c334e7195d9c7eb737b54cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:40:29.950213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.950927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a66b314-635f-4997-b0d3-0c33d56be146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:40:29.957547 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1830/3642] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:29 2022] DELETE /identity/v3/projects/0d4e4f004c334e7195d9c7eb737b54cc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:29.959023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b5275-5d30-4fc5-8edc-f3565b03a1db None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:29.959314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b5275-5d30-4fc5-8edc-f3565b03a1db None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:29.959587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b5275-5d30-4fc5-8edc-f3565b03a1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:29.982378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-aa2b5275-5d30-4fc5-8edc-f3565b03a1db None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:29.983971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aa2b5275-5d30-4fc5-8edc-f3565b03a1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:30.054560 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1813/3643] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:30.064604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ade6-b108-44ce-9609-bd1c74c30f55 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.064920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ade6-b108-44ce-9609-bd1c74c30f55 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.065301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ade6-b108-44ce-9609-bd1c74c30f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.099215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d8f3ade6-b108-44ce-9609-bd1c74c30f55 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:30.103082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d8f3ade6-b108-44ce-9609-bd1c74c30f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:30.122986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b5275-5d30-4fc5-8edc-f3565b03a1db None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.129018 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1831/3644] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:30.152307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b5275-5d30-4fc5-8edc-f3565b03a1db None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.166836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dadb5-1eaf-4961-b23d-42c8632d5133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.167728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dadb5-1eaf-4961-b23d-42c8632d5133 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.168021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dadb5-1eaf-4961-b23d-42c8632d5133 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.168503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dadb5-1eaf-4961-b23d-42c8632d5133 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.171251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dadb5-1eaf-4961-b23d-42c8632d5133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:40:30.171612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dadb5-1eaf-4961-b23d-42c8632d5133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.174766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dadb5-1eaf-4961-b23d-42c8632d5133 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.195203 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1814/3645] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:40:30.198926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3ade6-b108-44ce-9609-bd1c74c30f55 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.218982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3ade6-b108-44ce-9609-bd1c74c30f55 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.225831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5831c7-4663-4b20-bb5e-5aca53da6dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.226945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5831c7-4663-4b20-bb5e-5aca53da6dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.227501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5831c7-4663-4b20-bb5e-5aca53da6dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.227995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5831c7-4663-4b20-bb5e-5aca53da6dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.228935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5831c7-4663-4b20-bb5e-5aca53da6dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.232142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5831c7-4663-4b20-bb5e-5aca53da6dc4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.282402 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1832/3646] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:40:30 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:30.282789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dadb5-1eaf-4961-b23d-42c8632d5133 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.292171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:30.308908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dadb5-1eaf-4961-b23d-42c8632d5133 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.398936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ebd5f-cb5b-49d9-81a5-3667b10aa2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.399978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ebd5f-cb5b-49d9-81a5-3667b10aa2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.400266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ebd5f-cb5b-49d9-81a5-3667b10aa2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.400545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ebd5f-cb5b-49d9-81a5-3667b10aa2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.401192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ebd5f-cb5b-49d9-81a5-3667b10aa2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.403585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ebd5f-cb5b-49d9-81a5-3667b10aa2d8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.444757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5831c7-4663-4b20-bb5e-5aca53da6dc4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.445609 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1815/3647] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:40:30 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:40:30.457846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5831c7-4663-4b20-bb5e-5aca53da6dc4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.479342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8935c1-da68-4bd4-b461-8ed1599f1397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.479984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8935c1-da68-4bd4-b461-8ed1599f1397 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.480297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8935c1-da68-4bd4-b461-8ed1599f1397 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.480609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8935c1-da68-4bd4-b461-8ed1599f1397 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.481353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8935c1-da68-4bd4-b461-8ed1599f1397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.483966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8935c1-da68-4bd4-b461-8ed1599f1397 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.513362 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1833/3648] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:40:30.514309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ebd5f-cb5b-49d9-81a5-3667b10aa2d8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.526998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ebd5f-cb5b-49d9-81a5-3667b10aa2d8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.539114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d6cc0-a9de-4c3f-8baf-c10a1d8e1a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.539114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d6cc0-a9de-4c3f-8baf-c10a1d8e1a30 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.539114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d6cc0-a9de-4c3f-8baf-c10a1d8e1a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.539114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d6cc0-a9de-4c3f-8baf-c10a1d8e1a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.539597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d6cc0-a9de-4c3f-8baf-c10a1d8e1a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.539879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d6cc0-a9de-4c3f-8baf-c10a1d8e1a30 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.558283 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1816/3649] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:40:30.559708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8935c1-da68-4bd4-b461-8ed1599f1397 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.572686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8935c1-da68-4bd4-b461-8ed1599f1397 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.582438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f9f13-4140-48e8-a293-f1484a01e1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.584594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f9f13-4140-48e8-a293-f1484a01e1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.585259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f9f13-4140-48e8-a293-f1484a01e1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.585730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f9f13-4140-48e8-a293-f1484a01e1ea admin admin] PATH_INFO: `/v3/projects/099a54274df84f75b89d412cffb6739d/users/d51c25b62584479ca6f2310e986b05e5/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.607101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f9f13-4140-48e8-a293-f1484a01e1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=099a54274df84f75b89d412cffb6739d, user_id=d51c25b62584479ca6f2310e986b05e5, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:30.611083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f9f13-4140-48e8-a293-f1484a01e1ea admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:30.635200 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1834/3650] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:40:30 2022] PUT /identity/v3/projects/099a54274df84f75b89d412cffb6739d/users/d51c25b62584479ca6f2310e986b05e5/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:40:30.636829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914e3f-348d-433d-9a65-668173235c58 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.637145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914e3f-348d-433d-9a65-668173235c58 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.637446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914e3f-348d-433d-9a65-668173235c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:30.658123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-de914e3f-348d-433d-9a65-668173235c58 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:30.659343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de914e3f-348d-433d-9a65-668173235c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:30.791763 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1817/3651] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:30.805251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f9f13-4140-48e8-a293-f1484a01e1ea admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:30.809795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7a6f9f13-4140-48e8-a293-f1484a01e1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:30.980342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f9f13-4140-48e8-a293-f1484a01e1ea admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:30.989107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c0f62-876f-4d5d-8063-83a7334cd62d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:30.992026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0f62-876f-4d5d-8063-83a7334cd62d service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:30.992308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0f62-876f-4d5d-8063-83a7334cd62d service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:30.992578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0f62-876f-4d5d-8063-83a7334cd62d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:31.017453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c0f62-876f-4d5d-8063-83a7334cd62d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:31.018884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c0f62-876f-4d5d-8063-83a7334cd62d service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:31.042441 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1835/3652] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:32.669124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de914e3f-348d-433d-9a65-668173235c58 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:32.671624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de914e3f-348d-433d-9a65-668173235c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:32.694416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de914e3f-348d-433d-9a65-668173235c58 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:32.706543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638b824-c850-4a40-ba38-6eb906d8a2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:32.708336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638b824-c850-4a40-ba38-6eb906d8a2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:32.708825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638b824-c850-4a40-ba38-6eb906d8a2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:32.710420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638b824-c850-4a40-ba38-6eb906d8a2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:32.716858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3638b824-c850-4a40-ba38-6eb906d8a2f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:32.886449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638b824-c850-4a40-ba38-6eb906d8a2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:32.888593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638b824-c850-4a40-ba38-6eb906d8a2f1 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:32.903874 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1818/3653] 10.222.0.16 () {60 vars in 1396 bytes} [Mon Aug 29 15:40:32 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:36.391690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c0f62-876f-4d5d-8063-83a7334cd62d service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:36.395715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ec2c0f62-876f-4d5d-8063-83a7334cd62d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:36.486083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:36.527576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c0f62-876f-4d5d-8063-83a7334cd62d service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:36.542938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc79adb-7254-46e7-a26a-8940cd3a8718 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:36.544046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc79adb-7254-46e7-a26a-8940cd3a8718 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:36.544046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc79adb-7254-46e7-a26a-8940cd3a8718 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:36.545942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc79adb-7254-46e7-a26a-8940cd3a8718 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:36.548277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ccc79adb-7254-46e7-a26a-8940cd3a8718 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:36.706996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc79adb-7254-46e7-a26a-8940cd3a8718 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:36.709592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc79adb-7254-46e7-a26a-8940cd3a8718 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:36.730635 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1836/3654] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:36.881018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638b824-c850-4a40-ba38-6eb906d8a2f1 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:36.896386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638b824-c850-4a40-ba38-6eb906d8a2f1 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:36.911563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42061e8-7779-45d9-9262-4e69e11cfdee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:36.914727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42061e8-7779-45d9-9262-4e69e11cfdee service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:36.915111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42061e8-7779-45d9-9262-4e69e11cfdee service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:36.915648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42061e8-7779-45d9-9262-4e69e11cfdee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:36.921318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f42061e8-7779-45d9-9262-4e69e11cfdee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:36.950644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42061e8-7779-45d9-9262-4e69e11cfdee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:36.957292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42061e8-7779-45d9-9262-4e69e11cfdee service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:36.992798 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1819/3655] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:38.060309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc79adb-7254-46e7-a26a-8940cd3a8718 service glance] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:38.077026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc79adb-7254-46e7-a26a-8940cd3a8718 service glance] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:38.087843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee8f89-99e6-4da8-800d-e07c16b9e798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:38.090549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee8f89-99e6-4da8-800d-e07c16b9e798 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:38.091025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee8f89-99e6-4da8-800d-e07c16b9e798 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:38.094328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee8f89-99e6-4da8-800d-e07c16b9e798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:38.099101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f1ee8f89-99e6-4da8-800d-e07c16b9e798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:38.147315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee8f89-99e6-4da8-800d-e07c16b9e798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:38.166964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee8f89-99e6-4da8-800d-e07c16b9e798 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:38.202102 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1837/3656] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:45.776264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae085b-88bf-4c6e-9e42-c2abf7e96593 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:45.776810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae085b-88bf-4c6e-9e42-c2abf7e96593 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:45.777115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae085b-88bf-4c6e-9e42-c2abf7e96593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:45.803710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:45.813904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-76ae085b-88bf-4c6e-9e42-c2abf7e96593 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:45.819235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76ae085b-88bf-4c6e-9e42-c2abf7e96593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:45.903996 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1820/3657] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:45.912599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee8f89-99e6-4da8-800d-e07c16b9e798 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:45.914351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f1ee8f89-99e6-4da8-800d-e07c16b9e798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:46.027370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee8f89-99e6-4da8-800d-e07c16b9e798 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:46.036164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76510278-0622-4693-a9af-cd29c0df9ad9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:46.037056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76510278-0622-4693-a9af-cd29c0df9ad9 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:46.037622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76510278-0622-4693-a9af-cd29c0df9ad9 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:46.038109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76510278-0622-4693-a9af-cd29c0df9ad9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:46.054104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76510278-0622-4693-a9af-cd29c0df9ad9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:46.057594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76510278-0622-4693-a9af-cd29c0df9ad9 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:46.077669 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1838/3658] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:40:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:48.218579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ecf11-2c22-4a89-b4fb-048b425cf38b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:48.219099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ecf11-2c22-4a89-b4fb-048b425cf38b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:48.219408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ecf11-2c22-4a89-b4fb-048b425cf38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:48.261989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-361ecf11-2c22-4a89-b4fb-048b425cf38b None None] MFA Rules not processed for user `d51c25b62584479ca6f2310e986b05e5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:40:48.263355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-361ecf11-2c22-4a89-b4fb-048b425cf38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:48.388778 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1821/3659] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:40:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:40:48.490271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76510278-0622-4693-a9af-cd29c0df9ad9 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:48.493189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-76510278-0622-4693-a9af-cd29c0df9ad9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:48.511310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76510278-0622-4693-a9af-cd29c0df9ad9 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:48.524095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f66c93-aa80-4518-8750-f063b958cd17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:48.525711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66c93-aa80-4518-8750-f063b958cd17 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:48.528353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66c93-aa80-4518-8750-f063b958cd17 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:48.528776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66c93-aa80-4518-8750-f063b958cd17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:48.562498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f66c93-aa80-4518-8750-f063b958cd17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:48.565602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f66c93-aa80-4518-8750-f063b958cd17 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:48.592401 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1839/3660] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:48.649897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ecf11-2c22-4a89-b4fb-048b425cf38b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:48.668413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ecf11-2c22-4a89-b4fb-048b425cf38b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:48.676083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bb982-f044-4fd3-af47-179c7bc0e9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:48.677195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb982-f044-4fd3-af47-179c7bc0e9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:48.677794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb982-f044-4fd3-af47-179c7bc0e9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:48.678556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bb982-f044-4fd3-af47-179c7bc0e9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:48.681098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-517bb982-f044-4fd3-af47-179c7bc0e9a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:48.715226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bb982-f044-4fd3-af47-179c7bc0e9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:48.717253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bb982-f044-4fd3-af47-179c7bc0e9a4 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:48.772982 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1822/3661] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:56.737680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f66c93-aa80-4518-8750-f063b958cd17 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:56.747225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f66c93-aa80-4518-8750-f063b958cd17 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:56.751586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b863ed-7ca1-4c44-93b9-e31c69d818e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:56.752326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b863ed-7ca1-4c44-93b9-e31c69d818e5 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:56.752721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b863ed-7ca1-4c44-93b9-e31c69d818e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:56.753145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b863ed-7ca1-4c44-93b9-e31c69d818e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:56.755399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-83b863ed-7ca1-4c44-93b9-e31c69d818e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:56.771928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b863ed-7ca1-4c44-93b9-e31c69d818e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:56.773556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b863ed-7ca1-4c44-93b9-e31c69d818e5 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:56.785984 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1840/3662] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:40:58.747814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=60 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:59.130725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bb982-f044-4fd3-af47-179c7bc0e9a4 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:40:59.141993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bb982-f044-4fd3-af47-179c7bc0e9a4 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:40:59.147014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a7eec-3f6b-4024-8d29-055b4c0c716d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:40:59.147014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a7eec-3f6b-4024-8d29-055b4c0c716d service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:40:59.147459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a7eec-3f6b-4024-8d29-055b4c0c716d service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:40:59.147611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a7eec-3f6b-4024-8d29-055b4c0c716d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:40:59.149820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f09a7eec-3f6b-4024-8d29-055b4c0c716d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:40:59.178286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a7eec-3f6b-4024-8d29-055b4c0c716d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:40:59.181356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a7eec-3f6b-4024-8d29-055b4c0c716d service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:40:59.213559 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1823/3663] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:40:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:00.725936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b863ed-7ca1-4c44-93b9-e31c69d818e5 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:00.727383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-83b863ed-7ca1-4c44-93b9-e31c69d818e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:00.795338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:00.867433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b863ed-7ca1-4c44-93b9-e31c69d818e5 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:00.872974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906c992-371c-42a5-94d1-1096b74c3737 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:00.873770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906c992-371c-42a5-94d1-1096b74c3737 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:00.874221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906c992-371c-42a5-94d1-1096b74c3737 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:00.874497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906c992-371c-42a5-94d1-1096b74c3737 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:00.876882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6906c992-371c-42a5-94d1-1096b74c3737 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:00.892323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906c992-371c-42a5-94d1-1096b74c3737 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:00.894368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906c992-371c-42a5-94d1-1096b74c3737 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:00.906693 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1841/3664] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:02.520358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a7eec-3f6b-4024-8d29-055b4c0c716d service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:02.521858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f09a7eec-3f6b-4024-8d29-055b4c0c716d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:02.539836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a7eec-3f6b-4024-8d29-055b4c0c716d service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:02.551376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3639a-7883-4d27-b038-d7f72cdb41b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:02.552485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3639a-7883-4d27-b038-d7f72cdb41b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:02.552956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3639a-7883-4d27-b038-d7f72cdb41b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:02.553441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3639a-7883-4d27-b038-d7f72cdb41b5 admin admin] PATH_INFO: `/v3/users/3b0b3cb059bc44e5b3eb892827315411` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:02.554920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3639a-7883-4d27-b038-d7f72cdb41b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0b3cb059bc44e5b3eb892827315411)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:02.557311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3639a-7883-4d27-b038-d7f72cdb41b5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:02.616532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9e3639a-7883-4d27-b038-d7f72cdb41b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0b3cb059bc44e5b3eb892827315411'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:02.625584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9e3639a-7883-4d27-b038-d7f72cdb41b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0b3cb059bc44e5b3eb892827315411'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:02.660158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9e3639a-7883-4d27-b038-d7f72cdb41b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0b3cb059bc44e5b3eb892827315411'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:02.679464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9e3639a-7883-4d27-b038-d7f72cdb41b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0b3cb059bc44e5b3eb892827315411'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:02.697324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9e3639a-7883-4d27-b038-d7f72cdb41b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0b3cb059bc44e5b3eb892827315411'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:02.716498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1824/3665] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:02 2022] DELETE /identity/v3/users/3b0b3cb059bc44e5b3eb892827315411 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:03.026204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906c992-371c-42a5-94d1-1096b74c3737 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:03.046026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906c992-371c-42a5-94d1-1096b74c3737 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:03.162578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:03.164646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:03.165109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:03.165603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] PATH_INFO: `/v3/projects/0e1f9ed29dd545da93c61d1a8cf9f37f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:03.168083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1f9ed29dd545da93c61d1a8cf9f37f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:03.171758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:03.275434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1f9ed29dd545da93c61d1a8cf9f37f', 'request_id': 'req-a6594301-261d-4c45-ad09-2e941a952d5f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:03.286177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1f9ed29dd545da93c61d1a8cf9f37f', 'request_id': 'req-a6594301-261d-4c45-ad09-2e941a952d5f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:03.296099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1f9ed29dd545da93c61d1a8cf9f37f', 'request_id': 'req-a6594301-261d-4c45-ad09-2e941a952d5f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:03.322894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] The token cache is being invalidate because project 0e1f9ed29dd545da93c61d1a8cf9f37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:03.323200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:03.324610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6594301-261d-4c45-ad09-2e941a952d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:03.334199 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1842/3666] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:03 2022] DELETE /identity/v3/projects/0e1f9ed29dd545da93c61d1a8cf9f37f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:03.334898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0a61-c947-45c8-af99-9f3df990e213 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:03.335189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0a61-c947-45c8-af99-9f3df990e213 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:03.335485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0a61-c947-45c8-af99-9f3df990e213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:03.378094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2dbd0a61-c947-45c8-af99-9f3df990e213 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:03.389376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2dbd0a61-c947-45c8-af99-9f3df990e213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:03.483247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12745299-0d9c-4969-a567-a7ea7013dcc9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:03.486193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12745299-0d9c-4969-a567-a7ea7013dcc9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:03.486485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12745299-0d9c-4969-a567-a7ea7013dcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:03.496435 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1825/3667] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:03.526523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-12745299-0d9c-4969-a567-a7ea7013dcc9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:03.528235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-12745299-0d9c-4969-a567-a7ea7013dcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:03.547233 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1843/3668] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:03.553012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd0a61-c947-45c8-af99-9f3df990e213 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:03.568481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd0a61-c947-45c8-af99-9f3df990e213 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:03.577778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8732b-c9cc-4e64-a5a7-2f04f79c24fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:03.579321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8732b-c9cc-4e64-a5a7-2f04f79c24fd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:03.579823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8732b-c9cc-4e64-a5a7-2f04f79c24fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:03.580328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8732b-c9cc-4e64-a5a7-2f04f79c24fd admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:03.581219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8732b-c9cc-4e64-a5a7-2f04f79c24fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:03.581770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8732b-c9cc-4e64-a5a7-2f04f79c24fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:03.584188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8732b-c9cc-4e64-a5a7-2f04f79c24fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:03.602418 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1826/3669] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:03.606406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12745299-0d9c-4969-a567-a7ea7013dcc9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:03.634279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12745299-0d9c-4969-a567-a7ea7013dcc9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:03.643548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4beee6e-8067-4bda-acfc-79bf45b2a5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:03.644744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4beee6e-8067-4bda-acfc-79bf45b2a5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:03.645301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4beee6e-8067-4bda-acfc-79bf45b2a5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:03.646051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4beee6e-8067-4bda-acfc-79bf45b2a5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:03.647474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4beee6e-8067-4bda-acfc-79bf45b2a5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:03.651833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4beee6e-8067-4bda-acfc-79bf45b2a5c1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:03.725176 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1844/3670] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:03 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:41:03.729012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8732b-c9cc-4e64-a5a7-2f04f79c24fd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:03.741302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8732b-c9cc-4e64-a5a7-2f04f79c24fd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:03.810127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:03.829853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba265-296d-42b3-9541-8dbba9a16f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:03.830800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba265-296d-42b3-9541-8dbba9a16f2e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:03.834370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba265-296d-42b3-9541-8dbba9a16f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:03.834912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba265-296d-42b3-9541-8dbba9a16f2e admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:03.835818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ba265-296d-42b3-9541-8dbba9a16f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:03.838064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ba265-296d-42b3-9541-8dbba9a16f2e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:03.872645 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1827/3671] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:03 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:03.877798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4beee6e-8067-4bda-acfc-79bf45b2a5c1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:03.897819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4beee6e-8067-4bda-acfc-79bf45b2a5c1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:03.902988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee486-da4d-49ac-8a54-8a2925e69ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:03.903606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee486-da4d-49ac-8a54-8a2925e69ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:03.903890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee486-da4d-49ac-8a54-8a2925e69ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:03.904182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee486-da4d-49ac-8a54-8a2925e69ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:03.904941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacee486-da4d-49ac-8a54-8a2925e69ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:03.907945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacee486-da4d-49ac-8a54-8a2925e69ca8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:03.920905 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1845/3672] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:03.925203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba265-296d-42b3-9541-8dbba9a16f2e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:03.940582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba265-296d-42b3-9541-8dbba9a16f2e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:03.946462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29216b4c-588f-4756-99a2-239a42f6c711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:03.947362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216b4c-588f-4756-99a2-239a42f6c711 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:03.947845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216b4c-588f-4756-99a2-239a42f6c711 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:03.948411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216b4c-588f-4756-99a2-239a42f6c711 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:03.949432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29216b4c-588f-4756-99a2-239a42f6c711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:03.951254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29216b4c-588f-4756-99a2-239a42f6c711 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:03.969222 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1828/3673] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:41:03.970266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee486-da4d-49ac-8a54-8a2925e69ca8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:03.983175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee486-da4d-49ac-8a54-8a2925e69ca8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:03.989468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f793e-8282-4c8c-a21c-23e0db189bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:03.990011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f793e-8282-4c8c-a21c-23e0db189bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:03.990309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f793e-8282-4c8c-a21c-23e0db189bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:03.990588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f793e-8282-4c8c-a21c-23e0db189bb0 admin admin] PATH_INFO: `/v3/projects/948fbbd2c9974beb93713e4366834b28/users/550baba8a2304466962f501a027d7a82/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:03.993130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:04.030067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f793e-8282-4c8c-a21c-23e0db189bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948fbbd2c9974beb93713e4366834b28, user_id=550baba8a2304466962f501a027d7a82, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:04.033936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f793e-8282-4c8c-a21c-23e0db189bb0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:04.101770 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1846/3674] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:03 2022] PUT /identity/v3/projects/948fbbd2c9974beb93713e4366834b28/users/550baba8a2304466962f501a027d7a82/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:04.105544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f785c-2845-4942-b73a-c758c9103ec1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:04.106020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f785c-2845-4942-b73a-c758c9103ec1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:04.106499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f785c-2845-4942-b73a-c758c9103ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:04.150295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4a1f785c-2845-4942-b73a-c758c9103ec1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:04.151800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4a1f785c-2845-4942-b73a-c758c9103ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:04.314414 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1829/3675] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:04.448021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f793e-8282-4c8c-a21c-23e0db189bb0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:04.450852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7a5f793e-8282-4c8c-a21c-23e0db189bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:04.588473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f793e-8282-4c8c-a21c-23e0db189bb0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:04.599517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b6288-56fb-4159-9daa-2c86a6785417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:04.605531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b6288-56fb-4159-9daa-2c86a6785417 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:04.605957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b6288-56fb-4159-9daa-2c86a6785417 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:04.606231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b6288-56fb-4159-9daa-2c86a6785417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:04.629416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b6288-56fb-4159-9daa-2c86a6785417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:04.634459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b6288-56fb-4159-9daa-2c86a6785417 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:04.658102 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1847/3676] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:05.849539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a0fd-68f4-417d-aa0b-492fe00860c8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:05.850137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a0fd-68f4-417d-aa0b-492fe00860c8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:05.850137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a0fd-68f4-417d-aa0b-492fe00860c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:05.913488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1b28a0fd-68f4-417d-aa0b-492fe00860c8 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:05.923520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1b28a0fd-68f4-417d-aa0b-492fe00860c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:06.194812 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1830/3677] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:41:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:06.221472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b6288-56fb-4159-9daa-2c86a6785417 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:06.223490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-298b6288-56fb-4159-9daa-2c86a6785417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:06.422676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b6288-56fb-4159-9daa-2c86a6785417 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:06.442096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653e86-9274-4d62-9e80-4af0e5ac992f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:06.446700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653e86-9274-4d62-9e80-4af0e5ac992f service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:06.447119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653e86-9274-4d62-9e80-4af0e5ac992f service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:06.447458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653e86-9274-4d62-9e80-4af0e5ac992f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:06.470097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e653e86-9274-4d62-9e80-4af0e5ac992f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:06.475150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e653e86-9274-4d62-9e80-4af0e5ac992f service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:06.485875 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1848/3678] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:41:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.379235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28a0fd-68f4-417d-aa0b-492fe00860c8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:07.380776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1b28a0fd-68f4-417d-aa0b-492fe00860c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:07.403872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28a0fd-68f4-417d-aa0b-492fe00860c8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:07.410251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f6b9a-8035-4d8b-87fe-7d95a8aaa131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:07.410903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6b9a-8035-4d8b-87fe-7d95a8aaa131 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:07.411368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6b9a-8035-4d8b-87fe-7d95a8aaa131 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:07.412053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6b9a-8035-4d8b-87fe-7d95a8aaa131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:07.419409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a69f6b9a-8035-4d8b-87fe-7d95a8aaa131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:07.458776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f6b9a-8035-4d8b-87fe-7d95a8aaa131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:07.460273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f6b9a-8035-4d8b-87fe-7d95a8aaa131 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:07.483359 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1831/3679] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:13.928293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce177-bf49-4519-b316-c1ddd09d6c2c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:13.928756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce177-bf49-4519-b316-c1ddd09d6c2c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:13.928897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce177-bf49-4519-b316-c1ddd09d6c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:13.984487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b59ce177-bf49-4519-b316-c1ddd09d6c2c None None] MFA Rules not processed for user `f0c165a4dd4648888d45d44df5acbe2b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:13.988887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b59ce177-bf49-4519-b316-c1ddd09d6c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:14.134825 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1849/3680] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:14.191962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f6b9a-8035-4d8b-87fe-7d95a8aaa131 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:14.193736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a69f6b9a-8035-4d8b-87fe-7d95a8aaa131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:14.220529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f6b9a-8035-4d8b-87fe-7d95a8aaa131 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:14.240400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:14.241365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:14.241859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:14.242284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] PATH_INFO: `/v3/users/33daa615bc42447b9056611bc563e131` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:14.245996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33daa615bc42447b9056611bc563e131)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:14.248277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:14.379332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33daa615bc42447b9056611bc563e131'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:14.380044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33daa615bc42447b9056611bc563e131'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:14.398659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:14.418548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33daa615bc42447b9056611bc563e131'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:14.428851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33daa615bc42447b9056611bc563e131'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:14.446895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33daa615bc42447b9056611bc563e131'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:14.464700 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1832/3681] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:14 2022] DELETE /identity/v3/users/33daa615bc42447b9056611bc563e131 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:15.259870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ce177-bf49-4519-b316-c1ddd09d6c2c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:15.279765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ce177-bf49-4519-b316-c1ddd09d6c2c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:15.302066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:15.388917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:15.390373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:15.391388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:15.391917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] PATH_INFO: `/v3/projects/dfce36a97ee446a5a79d91b67b855558` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:15.394339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfce36a97ee446a5a79d91b67b855558)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:15.399998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:15.530544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfce36a97ee446a5a79d91b67b855558', 'request_id': 'req-e1b62001-2259-44b0-87cc-ae4beb91be71'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.559332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfce36a97ee446a5a79d91b67b855558', 'request_id': 'req-e1b62001-2259-44b0-87cc-ae4beb91be71'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.573350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfce36a97ee446a5a79d91b67b855558', 'request_id': 'req-e1b62001-2259-44b0-87cc-ae4beb91be71'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.599420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] The token cache is being invalidate because project dfce36a97ee446a5a79d91b67b855558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:15.599872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.601538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.609028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:15.610558 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1850/3682] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:15 2022] DELETE /identity/v3/projects/dfce36a97ee446a5a79d91b67b855558 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:15.610692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:15.635354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2572c42-9194-413f-9512-1e9fc645b648 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:15.784747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2081f7-26cb-4f0d-8aca-63591f605c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:15.785679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2081f7-26cb-4f0d-8aca-63591f605c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:15.785963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2081f7-26cb-4f0d-8aca-63591f605c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:15.786246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2081f7-26cb-4f0d-8aca-63591f605c32 admin admin] PATH_INFO: `/v3/users/16577adfa018436395667bd238d29db7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:15.798376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2081f7-26cb-4f0d-8aca-63591f605c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16577adfa018436395667bd238d29db7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:15.800423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2081f7-26cb-4f0d-8aca-63591f605c32 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:15.877472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6d2081f7-26cb-4f0d-8aca-63591f605c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16577adfa018436395667bd238d29db7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.878166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6d2081f7-26cb-4f0d-8aca-63591f605c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16577adfa018436395667bd238d29db7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.899964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6d2081f7-26cb-4f0d-8aca-63591f605c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16577adfa018436395667bd238d29db7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.911188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6d2081f7-26cb-4f0d-8aca-63591f605c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16577adfa018436395667bd238d29db7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.926470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6d2081f7-26cb-4f0d-8aca-63591f605c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16577adfa018436395667bd238d29db7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:15.936837 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1833/3683] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:15 2022] DELETE /identity/v3/users/16577adfa018436395667bd238d29db7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:16.750233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:16.752510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:16.796949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b62001-2259-44b0-87cc-ae4beb91be71 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:17.006007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:17.006672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:17.006956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:17.007233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] PATH_INFO: `/v3/projects/6cb52652b5ca4f46bd8847728396a1cc` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:17.010244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb52652b5ca4f46bd8847728396a1cc)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:17.024323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:17.145843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb52652b5ca4f46bd8847728396a1cc', 'request_id': 'req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:17.148571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:17.160958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb52652b5ca4f46bd8847728396a1cc', 'request_id': 'req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:17.170919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb52652b5ca4f46bd8847728396a1cc', 'request_id': 'req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:17.200063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] The token cache is being invalidate because project 6cb52652b5ca4f46bd8847728396a1cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:17.200411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:17.201837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5fdb6e0e-ba0d-4896-b242-4ebc66a83adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:17.211216 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1851/3684] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:16 2022] DELETE /identity/v3/projects/6cb52652b5ca4f46bd8847728396a1cc => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:17.213323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfe896-881b-4d51-bd25-53a71b0cc5ec None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:17.214221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfe896-881b-4d51-bd25-53a71b0cc5ec None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:17.214733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfe896-881b-4d51-bd25-53a71b0cc5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:17.267608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0dbfe896-881b-4d51-bd25-53a71b0cc5ec None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:17.273416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0dbfe896-881b-4d51-bd25-53a71b0cc5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:17.480459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:17.526440 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1834/3685] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:17.535541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400554a-cfdb-4b6d-86ee-fcfe94c7702a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:17.536071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400554a-cfdb-4b6d-86ee-fcfe94c7702a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:17.536522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400554a-cfdb-4b6d-86ee-fcfe94c7702a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:17.586680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9400554a-cfdb-4b6d-86ee-fcfe94c7702a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:17.587926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9400554a-cfdb-4b6d-86ee-fcfe94c7702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:17.619220 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1852/3686] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:17.623480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfe896-881b-4d51-bd25-53a71b0cc5ec None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:17.643619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfe896-881b-4d51-bd25-53a71b0cc5ec None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:17.656440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70767-2fe7-4a49-a32f-c6b1a34f7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:17.657651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70767-2fe7-4a49-a32f-c6b1a34f7110 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:17.658190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70767-2fe7-4a49-a32f-c6b1a34f7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:17.658534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70767-2fe7-4a49-a32f-c6b1a34f7110 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:17.659278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70767-2fe7-4a49-a32f-c6b1a34f7110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:17.663911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70767-2fe7-4a49-a32f-c6b1a34f7110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:17.665509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70767-2fe7-4a49-a32f-c6b1a34f7110 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:17.694405 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1835/3687] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:17.698895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400554a-cfdb-4b6d-86ee-fcfe94c7702a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:17.712609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400554a-cfdb-4b6d-86ee-fcfe94c7702a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:17.728720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1c4b7-a03f-4366-a8d2-a259e71d3238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:17.729347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1c4b7-a03f-4366-a8d2-a259e71d3238 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:17.729686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1c4b7-a03f-4366-a8d2-a259e71d3238 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:17.729964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1c4b7-a03f-4366-a8d2-a259e71d3238 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:17.730607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1c4b7-a03f-4366-a8d2-a259e71d3238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:17.732591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1c4b7-a03f-4366-a8d2-a259e71d3238 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:17.772541 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1853/3688] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:17 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:17.777544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70767-2fe7-4a49-a32f-c6b1a34f7110 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:17.804253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70767-2fe7-4a49-a32f-c6b1a34f7110 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:18.046639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553511a3-60b2-4bee-aeb8-7b5e224d7eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:18.047686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553511a3-60b2-4bee-aeb8-7b5e224d7eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:18.048168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553511a3-60b2-4bee-aeb8-7b5e224d7eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:18.048612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553511a3-60b2-4bee-aeb8-7b5e224d7eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:18.049596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553511a3-60b2-4bee-aeb8-7b5e224d7eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:18.054346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553511a3-60b2-4bee-aeb8-7b5e224d7eb6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:18.142255 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1836/3689] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:17 2022] POST /identity/v3/users => generated 292 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:41:18.143859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1c4b7-a03f-4366-a8d2-a259e71d3238 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:18.155674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1c4b7-a03f-4366-a8d2-a259e71d3238 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:18.173493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0ba25-f450-4370-a89d-6b2f234d3e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:18.174389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ba25-f450-4370-a89d-6b2f234d3e79 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:18.174826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ba25-f450-4370-a89d-6b2f234d3e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:18.175255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ba25-f450-4370-a89d-6b2f234d3e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:18.176092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0ba25-f450-4370-a89d-6b2f234d3e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:18.179653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0ba25-f450-4370-a89d-6b2f234d3e79 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:18.220297 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1854/3690] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:18.221919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553511a3-60b2-4bee-aeb8-7b5e224d7eb6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:18.240642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553511a3-60b2-4bee-aeb8-7b5e224d7eb6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:18.259647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bca5b-fcdb-4d5a-ae27-c850710f2096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:18.260552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bca5b-fcdb-4d5a-ae27-c850710f2096 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:18.261269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bca5b-fcdb-4d5a-ae27-c850710f2096 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:18.262481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bca5b-fcdb-4d5a-ae27-c850710f2096 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:18.264942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bca5b-fcdb-4d5a-ae27-c850710f2096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:18.270090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bca5b-fcdb-4d5a-ae27-c850710f2096 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:18.298366 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1837/3691] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:18.304064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0ba25-f450-4370-a89d-6b2f234d3e79 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:18.319313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0ba25-f450-4370-a89d-6b2f234d3e79 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:18.343988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e27a65-db81-4a7f-ab14-3d5a8a415264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:18.344453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e27a65-db81-4a7f-ab14-3d5a8a415264 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:18.344733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e27a65-db81-4a7f-ab14-3d5a8a415264 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:18.345007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e27a65-db81-4a7f-ab14-3d5a8a415264 admin admin] PATH_INFO: `/v3/projects/0340e062377e49ff99fabbc16cc73c9a/users/bb6c138e67fa4aa9805412ba7283592c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:18.406100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e27a65-db81-4a7f-ab14-3d5a8a415264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0340e062377e49ff99fabbc16cc73c9a, user_id=bb6c138e67fa4aa9805412ba7283592c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:18.411401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e27a65-db81-4a7f-ab14-3d5a8a415264 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:18.468298 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1855/3692] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:18 2022] PUT /identity/v3/projects/0340e062377e49ff99fabbc16cc73c9a/users/bb6c138e67fa4aa9805412ba7283592c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:18.473604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a37f6a-13eb-4f8c-a807-61724cb7dfeb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:18.474172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a37f6a-13eb-4f8c-a807-61724cb7dfeb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:18.474604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a37f6a-13eb-4f8c-a807-61724cb7dfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:18.517710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-15a37f6a-13eb-4f8c-a807-61724cb7dfeb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:18.525192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-15a37f6a-13eb-4f8c-a807-61724cb7dfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:18.659448 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1838/3693] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:18.708306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e27a65-db81-4a7f-ab14-3d5a8a415264 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:18.710164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-53e27a65-db81-4a7f-ab14-3d5a8a415264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:18.844633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e27a65-db81-4a7f-ab14-3d5a8a415264 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:18.852377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108cdc0-0373-460a-b37c-6ddabb7468a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:18.853218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108cdc0-0373-460a-b37c-6ddabb7468a4 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:18.853946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108cdc0-0373-460a-b37c-6ddabb7468a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:18.854595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108cdc0-0373-460a-b37c-6ddabb7468a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:18.868851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108cdc0-0373-460a-b37c-6ddabb7468a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:18.871509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108cdc0-0373-460a-b37c-6ddabb7468a4 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:18.899894 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1856/3694] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:21.287911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a37f6a-13eb-4f8c-a807-61724cb7dfeb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:21.289663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-15a37f6a-13eb-4f8c-a807-61724cb7dfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:21.320428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108cdc0-0373-460a-b37c-6ddabb7468a4 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:21.322844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5108cdc0-0373-460a-b37c-6ddabb7468a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:21.333428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a37f6a-13eb-4f8c-a807-61724cb7dfeb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:21.345334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108cdc0-0373-460a-b37c-6ddabb7468a4 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:21.357374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8b68c-a126-47a3-be75-77ebacdfaa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:21.358154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:21.358825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:21.359100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:21.359380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] PATH_INFO: `/v3/users/c631f558d99f40feb637f376bac1cffa` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:21.362085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8b68c-a126-47a3-be75-77ebacdfaa6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:21.362829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8b68c-a126-47a3-be75-77ebacdfaa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:21.363329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8b68c-a126-47a3-be75-77ebacdfaa6c admin admin] PATH_INFO: `/v3/users/065c5a92f9c04400be8a515e8233fb0d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:21.364839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8b68c-a126-47a3-be75-77ebacdfaa6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=065c5a92f9c04400be8a515e8233fb0d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:21.368665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8b68c-a126-47a3-be75-77ebacdfaa6c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:21.368856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c631f558d99f40feb637f376bac1cffa)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:21.370695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:21.476543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c631f558d99f40feb637f376bac1cffa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:21.478500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c631f558d99f40feb637f376bac1cffa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:21.482336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:21.482883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-acd8b68c-a126-47a3-be75-77ebacdfaa6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065c5a92f9c04400be8a515e8233fb0d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:21.485264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-acd8b68c-a126-47a3-be75-77ebacdfaa6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065c5a92f9c04400be8a515e8233fb0d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:21.550680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c631f558d99f40feb637f376bac1cffa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:21.568842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-acd8b68c-a126-47a3-be75-77ebacdfaa6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065c5a92f9c04400be8a515e8233fb0d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:21.573720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-acd8b68c-a126-47a3-be75-77ebacdfaa6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065c5a92f9c04400be8a515e8233fb0d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:21.590722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c631f558d99f40feb637f376bac1cffa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:21.617511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-acd8b68c-a126-47a3-be75-77ebacdfaa6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065c5a92f9c04400be8a515e8233fb0d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:21.620105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:21.632171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c631f558d99f40feb637f376bac1cffa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:21.656505 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1857/3695] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:21 2022] DELETE /identity/v3/users/065c5a92f9c04400be8a515e8233fb0d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:21.666868 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1839/3696] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:21 2022] DELETE /identity/v3/users/c631f558d99f40feb637f376bac1cffa => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:21.979444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67901f8-8e74-4322-a007-3cb9a514d57e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:21.979624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67901f8-8e74-4322-a007-3cb9a514d57e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:21.979964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67901f8-8e74-4322-a007-3cb9a514d57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:22.046638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b67901f8-8e74-4322-a007-3cb9a514d57e None None] MFA Rules not processed for user `550baba8a2304466962f501a027d7a82`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:22.049764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b67901f8-8e74-4322-a007-3cb9a514d57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:22.231605 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1858/3697] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:22.232950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:22.234462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:22.302986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67901f8-8e74-4322-a007-3cb9a514d57e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:22.304501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b67901f8-8e74-4322-a007-3cb9a514d57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:22.391725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fe130-0f6d-4507-909d-197d7d0223b0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:22.398349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ab4ec-ce63-47e5-88f5-2df67fbd5eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:22.399719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ab4ec-ce63-47e5-88f5-2df67fbd5eba admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:22.400397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ab4ec-ce63-47e5-88f5-2df67fbd5eba admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:22.400974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ab4ec-ce63-47e5-88f5-2df67fbd5eba admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:22.402099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ab4ec-ce63-47e5-88f5-2df67fbd5eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:22.404274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ab4ec-ce63-47e5-88f5-2df67fbd5eba admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:22.445692 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1840/3698] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:22 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:22.446990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ab4ec-ce63-47e5-88f5-2df67fbd5eba admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:22.450008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d58ab4ec-ce63-47e5-88f5-2df67fbd5eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:22.489042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67901f8-8e74-4322-a007-3cb9a514d57e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:22.610505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:22.611171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:22.611455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:22.611734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] PATH_INFO: `/v3/projects/c4289f452ed34003a85d00e8f6959d78` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:22.613247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4289f452ed34003a85d00e8f6959d78)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:22.615780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:22.673081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:22.678633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ab4ec-ce63-47e5-88f5-2df67fbd5eba admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:22.722074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4289f452ed34003a85d00e8f6959d78', 'request_id': 'req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:22.747682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4289f452ed34003a85d00e8f6959d78', 'request_id': 'req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:22.766750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4289f452ed34003a85d00e8f6959d78', 'request_id': 'req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:22.789617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:22.790896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:22.791684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:22.791968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] PATH_INFO: `/v3/projects/8f71ab69d5754077b34ee79ccb42d7cc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:22.793925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f71ab69d5754077b34ee79ccb42d7cc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:22.795916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:22.797902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:22.803893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] The token cache is being invalidate because project c4289f452ed34003a85d00e8f6959d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:22.804178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:22.806137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:22.812350 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1859/3699] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:22 2022] DELETE /identity/v3/projects/c4289f452ed34003a85d00e8f6959d78 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:22.812350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:22.815931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:22.851573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37bf7c-0ddc-42ea-aece-ec6342a5f976 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:22.886441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f71ab69d5754077b34ee79ccb42d7cc', 'request_id': 'req-cb8b6231-24e7-4f84-81e3-43c057da6750'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:22.903916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f71ab69d5754077b34ee79ccb42d7cc', 'request_id': 'req-cb8b6231-24e7-4f84-81e3-43c057da6750'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:22.918934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f71ab69d5754077b34ee79ccb42d7cc', 'request_id': 'req-cb8b6231-24e7-4f84-81e3-43c057da6750'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:22.944548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] The token cache is being invalidate because project 8f71ab69d5754077b34ee79ccb42d7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:22.945332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:22.946627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cb8b6231-24e7-4f84-81e3-43c057da6750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:22.950239 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1841/3700] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:22 2022] DELETE /identity/v3/projects/8f71ab69d5754077b34ee79ccb42d7cc => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:22.958156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b60f43-0229-4a0e-8f22-567b460da5d0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:22.958830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b60f43-0229-4a0e-8f22-567b460da5d0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:22.959395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b60f43-0229-4a0e-8f22-567b460da5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:22.985432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-75b60f43-0229-4a0e-8f22-567b460da5d0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:22.987196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-75b60f43-0229-4a0e-8f22-567b460da5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:23.015296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fe853-47e1-4671-b4f4-0ba436fbaddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.016478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fe853-47e1-4671-b4f4-0ba436fbaddf admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.016769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fe853-47e1-4671-b4f4-0ba436fbaddf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.017043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fe853-47e1-4671-b4f4-0ba436fbaddf admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.017710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fe853-47e1-4671-b4f4-0ba436fbaddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.019658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fe853-47e1-4671-b4f4-0ba436fbaddf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:23.065366 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1842/3701] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:23.067507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cb061-e920-48ac-a8fc-440d59796944 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.068374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cb061-e920-48ac-a8fc-440d59796944 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.069056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cb061-e920-48ac-a8fc-440d59796944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.079008 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1860/3702] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:22 2022] POST /identity/v3/users => generated 296 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:23.079900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7befc-d0f1-4219-8ca4-5ec4bb3a9e30 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.080192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7befc-d0f1-4219-8ca4-5ec4bb3a9e30 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.080468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7befc-d0f1-4219-8ca4-5ec4bb3a9e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.127154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0f4cb061-e920-48ac-a8fc-440d59796944 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:23.128807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0f4cb061-e920-48ac-a8fc-440d59796944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:23.133273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-67c7befc-d0f1-4219-8ca4-5ec4bb3a9e30 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:23.136646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-67c7befc-d0f1-4219-8ca4-5ec4bb3a9e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:23.149719 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1843/3703] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:23.151026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cb061-e920-48ac-a8fc-440d59796944 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.156111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0f4cb061-e920-48ac-a8fc-440d59796944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:23.163767 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1861/3704] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:23.165222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9e6ce-c572-4c86-a051-64d7db3dd8f2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.165553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9e6ce-c572-4c86-a051-64d7db3dd8f2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.165828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9e6ce-c572-4c86-a051-64d7db3dd8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.184204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cb061-e920-48ac-a8fc-440d59796944 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:23.190249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c8d9e6ce-c572-4c86-a051-64d7db3dd8f2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:23.191494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c8d9e6ce-c572-4c86-a051-64d7db3dd8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:23.195103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb58a8-7c02-41b2-b4e8-6717b0a9a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.197207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb58a8-7c02-41b2-b4e8-6717b0a9a153 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.198817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb58a8-7c02-41b2-b4e8-6717b0a9a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.198817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb58a8-7c02-41b2-b4e8-6717b0a9a153 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.198817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb58a8-7c02-41b2-b4e8-6717b0a9a153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.204324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb58a8-7c02-41b2-b4e8-6717b0a9a153 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:23.209550 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1862/3705] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:23.210457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9e6ce-c572-4c86-a051-64d7db3dd8f2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.222464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9e6ce-c572-4c86-a051-64d7db3dd8f2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:23.228439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daba5e-9135-4db4-98dc-17c7de936ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.229064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daba5e-9135-4db4-98dc-17c7de936ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.232077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daba5e-9135-4db4-98dc-17c7de936ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.232077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daba5e-9135-4db4-98dc-17c7de936ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.232077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daba5e-9135-4db4-98dc-17c7de936ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:23.232453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daba5e-9135-4db4-98dc-17c7de936ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.233845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daba5e-9135-4db4-98dc-17c7de936ee5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:23.247527 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1844/3706] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:23.248722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb58a8-7c02-41b2-b4e8-6717b0a9a153 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.255935 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1863/3707] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:23.257334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daba5e-9135-4db4-98dc-17c7de936ee5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.268273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb58a8-7c02-41b2-b4e8-6717b0a9a153 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:23.271969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daba5e-9135-4db4-98dc-17c7de936ee5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:23.277754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cfd3f-aea6-4e3d-8814-e8999906e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.278439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cfd3f-aea6-4e3d-8814-e8999906e981 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.279652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cfd3f-aea6-4e3d-8814-e8999906e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.279652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cfd3f-aea6-4e3d-8814-e8999906e981 admin admin] PATH_INFO: `/v3/projects/7bafdc5d341d4181a8155f4f9b3480cb/users/99a9d6160e024b39bd283af5e9321892/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.279888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2082b73-a661-4efa-8743-44936b1d8e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.283026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082b73-a661-4efa-8743-44936b1d8e4f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.283243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082b73-a661-4efa-8743-44936b1d8e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.283710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082b73-a661-4efa-8743-44936b1d8e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.284810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2082b73-a661-4efa-8743-44936b1d8e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:23.285235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2082b73-a661-4efa-8743-44936b1d8e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.288462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2082b73-a661-4efa-8743-44936b1d8e4f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:23.310393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cfd3f-aea6-4e3d-8814-e8999906e981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bafdc5d341d4181a8155f4f9b3480cb, user_id=99a9d6160e024b39bd283af5e9321892, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.319318 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1845/3708] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:23.320341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2082b73-a661-4efa-8743-44936b1d8e4f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.326601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cfd3f-aea6-4e3d-8814-e8999906e981 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:23.341459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2082b73-a661-4efa-8743-44936b1d8e4f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:23.346559 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1864/3709] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:23 2022] PUT /identity/v3/projects/7bafdc5d341d4181a8155f4f9b3480cb/users/99a9d6160e024b39bd283af5e9321892/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:23.347977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cfd3f-aea6-4e3d-8814-e8999906e981 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.476933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cfd3f-aea6-4e3d-8814-e8999906e981 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:23.478560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:23.486238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9e1d3-3f2e-403c-bdb2-393797e78a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.487645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9e1d3-3f2e-403c-bdb2-393797e78a2b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.488013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9e1d3-3f2e-403c-bdb2-393797e78a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.488369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9e1d3-3f2e-403c-bdb2-393797e78a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.489286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d80a7d-9952-48a5-8bc5-3d0a50cf13ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.489812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9e1d3-3f2e-403c-bdb2-393797e78a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.490275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d80a7d-9952-48a5-8bc5-3d0a50cf13ba admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.491296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d80a7d-9952-48a5-8bc5-3d0a50cf13ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.491650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d80a7d-9952-48a5-8bc5-3d0a50cf13ba admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.492800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9e1d3-3f2e-403c-bdb2-393797e78a2b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:23.493641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d80a7d-9952-48a5-8bc5-3d0a50cf13ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.495670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d80a7d-9952-48a5-8bc5-3d0a50cf13ba admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:23.515875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:23.565224 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1865/3710] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:23 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:23.566234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9e1d3-3f2e-403c-bdb2-393797e78a2b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.572624 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1846/3711] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:23 2022] POST /identity/v3/projects => generated 393 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:23.573519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d80a7d-9952-48a5-8bc5-3d0a50cf13ba admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.699640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9e1d3-3f2e-403c-bdb2-393797e78a2b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:23.736564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d80a7d-9952-48a5-8bc5-3d0a50cf13ba admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:23.746785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b9688-98ff-47f6-a566-d9719d4a7033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.747428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b9688-98ff-47f6-a566-d9719d4a7033 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.747710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b9688-98ff-47f6-a566-d9719d4a7033 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.748763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b9688-98ff-47f6-a566-d9719d4a7033 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.749376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b9688-98ff-47f6-a566-d9719d4a7033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.755650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b9688-98ff-47f6-a566-d9719d4a7033 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:23.822136 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1847/3712] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:23 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:23.822136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b9688-98ff-47f6-a566-d9719d4a7033 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.834712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b9688-98ff-47f6-a566-d9719d4a7033 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:23.848255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5b9d0-292b-45b7-a5cf-91012cf7e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.848740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5b9d0-292b-45b7-a5cf-91012cf7e9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.849778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5b9d0-292b-45b7-a5cf-91012cf7e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.850111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5b9d0-292b-45b7-a5cf-91012cf7e9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.851081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5b9d0-292b-45b7-a5cf-91012cf7e9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.855112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5b9d0-292b-45b7-a5cf-91012cf7e9f2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:23.892656 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1848/3713] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:23 2022] POST /identity/v3/users => generated 297 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:23.892888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f79e5-1734-457d-b500-10b1ad780608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.893365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f79e5-1734-457d-b500-10b1ad780608 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.893654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5b9d0-292b-45b7-a5cf-91012cf7e9f2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.893817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f79e5-1734-457d-b500-10b1ad780608 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.893934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f79e5-1734-457d-b500-10b1ad780608 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.894609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f79e5-1734-457d-b500-10b1ad780608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.896254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f79e5-1734-457d-b500-10b1ad780608 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:23.906187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5b9d0-292b-45b7-a5cf-91012cf7e9f2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:23.915262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fc643-a8e3-4cbc-95dc-def5a26b5187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.917503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc643-a8e3-4cbc-95dc-def5a26b5187 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.917805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc643-a8e3-4cbc-95dc-def5a26b5187 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.918079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc643-a8e3-4cbc-95dc-def5a26b5187 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.918749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fc643-a8e3-4cbc-95dc-def5a26b5187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.924384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fc643-a8e3-4cbc-95dc-def5a26b5187 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:23.930932 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1866/3714] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:23.934882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f79e5-1734-457d-b500-10b1ad780608 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.950776 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1849/3715] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:23.951740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fc643-a8e3-4cbc-95dc-def5a26b5187 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:23.967294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f79e5-1734-457d-b500-10b1ad780608 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:23.984022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f157c3-7a90-444d-86ed-25525ea43555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:23.984603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f157c3-7a90-444d-86ed-25525ea43555 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:23.986261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f157c3-7a90-444d-86ed-25525ea43555 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:23.986593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f157c3-7a90-444d-86ed-25525ea43555 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:23.987260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f157c3-7a90-444d-86ed-25525ea43555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:23.993772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f157c3-7a90-444d-86ed-25525ea43555 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:24.006845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fc643-a8e3-4cbc-95dc-def5a26b5187 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:24.025999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a5083-9f1d-48e1-92f9-b6ff7c22b149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:24.027415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a5083-9f1d-48e1-92f9-b6ff7c22b149 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:24.027708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a5083-9f1d-48e1-92f9-b6ff7c22b149 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:24.027988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a5083-9f1d-48e1-92f9-b6ff7c22b149 admin admin] PATH_INFO: `/v3/projects/7bafdc5d341d4181a8155f4f9b3480cb/users/99a9d6160e024b39bd283af5e9321892/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:24.030403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a5083-9f1d-48e1-92f9-b6ff7c22b149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bafdc5d341d4181a8155f4f9b3480cb, user_id=99a9d6160e024b39bd283af5e9321892, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:24.033732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a5083-9f1d-48e1-92f9-b6ff7c22b149 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:24.052881 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1867/3716] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:24.063697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f157c3-7a90-444d-86ed-25525ea43555 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:24.068060 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1850/3717] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:23 2022] PUT /identity/v3/projects/7bafdc5d341d4181a8155f4f9b3480cb/users/99a9d6160e024b39bd283af5e9321892/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:24.068060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a5083-9f1d-48e1-92f9-b6ff7c22b149 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:24.087261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f157c3-7a90-444d-86ed-25525ea43555 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:24.204290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a5083-9f1d-48e1-92f9-b6ff7c22b149 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:24.229596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f31aa-a940-48cc-985b-ca37c8283298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:24.229985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f31aa-a940-48cc-985b-ca37c8283298 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:24.230640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f31aa-a940-48cc-985b-ca37c8283298 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:24.230640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f31aa-a940-48cc-985b-ca37c8283298 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:24.231235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f31aa-a940-48cc-985b-ca37c8283298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:24.232804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f31aa-a940-48cc-985b-ca37c8283298 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:24.237968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddf721-f3d7-4fe3-bfbc-476c9f1578b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:24.243133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf721-f3d7-4fe3-bfbc-476c9f1578b3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:24.248469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf721-f3d7-4fe3-bfbc-476c9f1578b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:24.251468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf721-f3d7-4fe3-bfbc-476c9f1578b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:24.252417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddf721-f3d7-4fe3-bfbc-476c9f1578b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:24.259934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddf721-f3d7-4fe3-bfbc-476c9f1578b3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:24.260350 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1851/3718] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:24.270648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f31aa-a940-48cc-985b-ca37c8283298 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:24.290470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f31aa-a940-48cc-985b-ca37c8283298 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:24.294816 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1868/3719] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:24.296404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddf721-f3d7-4fe3-bfbc-476c9f1578b3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:24.303351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ae4d8-83a7-4fbd-9cc2-deca38b6e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:24.304367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ae4d8-83a7-4fbd-9cc2-deca38b6e76c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:24.304367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ae4d8-83a7-4fbd-9cc2-deca38b6e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:24.304583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ae4d8-83a7-4fbd-9cc2-deca38b6e76c admin admin] PATH_INFO: `/v3/projects/0d729e16452c423a8814423076f29283/users/0821d6e67ebc40bcac1e1c176511f512/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:24.345939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddf721-f3d7-4fe3-bfbc-476c9f1578b3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:24.353924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ae4d8-83a7-4fbd-9cc2-deca38b6e76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d729e16452c423a8814423076f29283, user_id=0821d6e67ebc40bcac1e1c176511f512, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:24.356632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ae4d8-83a7-4fbd-9cc2-deca38b6e76c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:24.361885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff5779-859a-4b1c-96ba-186909e468fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:24.362524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff5779-859a-4b1c-96ba-186909e468fa admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:24.362807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff5779-859a-4b1c-96ba-186909e468fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:24.363083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff5779-859a-4b1c-96ba-186909e468fa admin admin] PATH_INFO: `/v3/projects/871a37b020bc46d5b1840e19ad0a997e/users/3aacfc6a126542f2897c3d3e51e736dc/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:24.387796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:24.393068 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1852/3720] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:24 2022] PUT /identity/v3/projects/0d729e16452c423a8814423076f29283/users/0821d6e67ebc40bcac1e1c176511f512/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:24.404203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7be9cb-2cef-4e8b-b26e-fa7b491a148d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:24.405050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7be9cb-2cef-4e8b-b26e-fa7b491a148d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:24.405050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7be9cb-2cef-4e8b-b26e-fa7b491a148d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:24.410981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff5779-859a-4b1c-96ba-186909e468fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=871a37b020bc46d5b1840e19ad0a997e, user_id=3aacfc6a126542f2897c3d3e51e736dc, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:24.413750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff5779-859a-4b1c-96ba-186909e468fa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:24.441235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:24.452137 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1869/3721] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:24 2022] PUT /identity/v3/projects/871a37b020bc46d5b1840e19ad0a997e/users/3aacfc6a126542f2897c3d3e51e736dc/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:24.457692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534b3d4-b2ab-4634-8e4c-cf3ee4d77f6e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:24.457992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534b3d4-b2ab-4634-8e4c-cf3ee4d77f6e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:24.458311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534b3d4-b2ab-4634-8e4c-cf3ee4d77f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:24.515721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7534b3d4-b2ab-4634-8e4c-cf3ee4d77f6e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:24.522499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7534b3d4-b2ab-4634-8e4c-cf3ee4d77f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:24.523560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ec7be9cb-2cef-4e8b-b26e-fa7b491a148d None None] MFA Rules not processed for user `0821d6e67ebc40bcac1e1c176511f512`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:24.538947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ec7be9cb-2cef-4e8b-b26e-fa7b491a148d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:24.710249 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1853/3722] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:24.715238 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1870/3723] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:24.815448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7be9cb-2cef-4e8b-b26e-fa7b491a148d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:24.817162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ec7be9cb-2cef-4e8b-b26e-fa7b491a148d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:25.000849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7be9cb-2cef-4e8b-b26e-fa7b491a148d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:25.013351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642bf4b-44ce-4a01-a973-65d5a23ede21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:25.014264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642bf4b-44ce-4a01-a973-65d5a23ede21 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:25.014667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642bf4b-44ce-4a01-a973-65d5a23ede21 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:25.014959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642bf4b-44ce-4a01-a973-65d5a23ede21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:25.049965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642bf4b-44ce-4a01-a973-65d5a23ede21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:25.051701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642bf4b-44ce-4a01-a973-65d5a23ede21 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:25.068686 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1854/3724] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:25.174161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534b3d4-b2ab-4634-8e4c-cf3ee4d77f6e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:25.175936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7534b3d4-b2ab-4634-8e4c-cf3ee4d77f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:25.323555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534b3d4-b2ab-4634-8e4c-cf3ee4d77f6e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:25.331018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debb78e-2b7d-4a04-8950-f169003b5ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:25.332149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debb78e-2b7d-4a04-8950-f169003b5ae8 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:25.332594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debb78e-2b7d-4a04-8950-f169003b5ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:25.333086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debb78e-2b7d-4a04-8950-f169003b5ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:25.348716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debb78e-2b7d-4a04-8950-f169003b5ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:25.351608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debb78e-2b7d-4a04-8950-f169003b5ae8 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:25.380259 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1871/3725] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:25.402206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642bf4b-44ce-4a01-a973-65d5a23ede21 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:25.425282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642bf4b-44ce-4a01-a973-65d5a23ede21 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:25.436536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761717b-de4e-461f-b94b-b5363ce50f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:25.437178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761717b-de4e-461f-b94b-b5363ce50f29 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:25.437503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761717b-de4e-461f-b94b-b5363ce50f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:25.437822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761717b-de4e-461f-b94b-b5363ce50f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:25.442508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1761717b-de4e-461f-b94b-b5363ce50f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:25.469640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761717b-de4e-461f-b94b-b5363ce50f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:25.471461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761717b-de4e-461f-b94b-b5363ce50f29 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:25.486827 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1855/3726] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:26.373669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debb78e-2b7d-4a04-8950-f169003b5ae8 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:26.390753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debb78e-2b7d-4a04-8950-f169003b5ae8 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:26.407450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:26.408139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:26.408421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:26.408797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] PATH_INFO: `/v3/users/0821d6e67ebc40bcac1e1c176511f512` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:26.410317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0821d6e67ebc40bcac1e1c176511f512)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:26.414108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:26.530043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0821d6e67ebc40bcac1e1c176511f512'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:26.531430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0821d6e67ebc40bcac1e1c176511f512'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:26.564345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0821d6e67ebc40bcac1e1c176511f512'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:26.578255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0821d6e67ebc40bcac1e1c176511f512'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:26.583782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:26.590790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0821d6e67ebc40bcac1e1c176511f512'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:26.613763 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1872/3727] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:26 2022] DELETE /identity/v3/users/0821d6e67ebc40bcac1e1c176511f512 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:26.618467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37186a67-84f1-46d1-a37c-674bd0733316 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:26.619043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37186a67-84f1-46d1-a37c-674bd0733316 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:26.619043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37186a67-84f1-46d1-a37c-674bd0733316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:26.646860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-37186a67-84f1-46d1-a37c-674bd0733316 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:26.648114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-37186a67-84f1-46d1-a37c-674bd0733316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:26.769763 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1856/3728] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:26.802747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:26.804224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:26.904903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f3b3c-277f-4295-b5be-920b238d272b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:26.910131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1252606-7985-4e7a-aad0-15c59689c2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:26.911334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1252606-7985-4e7a-aad0-15c59689c2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:26.911334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1252606-7985-4e7a-aad0-15c59689c2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:26.911562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1252606-7985-4e7a-aad0-15c59689c2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:26.942125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1252606-7985-4e7a-aad0-15c59689c2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:26.943580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1252606-7985-4e7a-aad0-15c59689c2d2 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:26.987705 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1873/3729] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:27.731447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37186a67-84f1-46d1-a37c-674bd0733316 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:27.734534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-37186a67-84f1-46d1-a37c-674bd0733316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:27.756280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37186a67-84f1-46d1-a37c-674bd0733316 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:27.805099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:27.805957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:27.806312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:27.806664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] PATH_INFO: `/v3/projects/0d729e16452c423a8814423076f29283` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:27.810722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d729e16452c423a8814423076f29283)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:27.813290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:27.855203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:27.896209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d729e16452c423a8814423076f29283', 'request_id': 'req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:27.912754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d729e16452c423a8814423076f29283', 'request_id': 'req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:27.925833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d729e16452c423a8814423076f29283', 'request_id': 'req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:27.941278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] The token cache is being invalidate because project 0d729e16452c423a8814423076f29283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:27.941764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:27.942788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13b03d56-5f03-4fdd-a4b0-9d843ecc9f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:27.946046 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1857/3730] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:27 2022] DELETE /identity/v3/projects/0d729e16452c423a8814423076f29283 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:27.949943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbddce-ce34-4dbf-bfbd-fc7bd874eb5a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:27.950990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbddce-ce34-4dbf-bfbd-fc7bd874eb5a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:27.951492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbddce-ce34-4dbf-bfbd-fc7bd874eb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:27.976080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f4cbddce-ce34-4dbf-bfbd-fc7bd874eb5a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:27.977806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f4cbddce-ce34-4dbf-bfbd-fc7bd874eb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:28.076524 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1874/3731] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:28.085169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f70f-f606-476f-bb27-a1b80aebbc81 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.085545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f70f-f606-476f-bb27-a1b80aebbc81 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.086011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f70f-f606-476f-bb27-a1b80aebbc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.108692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5610f70f-f606-476f-bb27-a1b80aebbc81 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:28.110307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5610f70f-f606-476f-bb27-a1b80aebbc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:28.119272 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1858/3732] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:28.123752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbddce-ce34-4dbf-bfbd-fc7bd874eb5a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.136574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbddce-ce34-4dbf-bfbd-fc7bd874eb5a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:28.142770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d91459-74e4-446b-8369-d8be5e8b76c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.143729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91459-74e4-446b-8369-d8be5e8b76c3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.144258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91459-74e4-446b-8369-d8be5e8b76c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.144752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91459-74e4-446b-8369-d8be5e8b76c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.145720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d91459-74e4-446b-8369-d8be5e8b76c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:28.146853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d91459-74e4-446b-8369-d8be5e8b76c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.149350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d91459-74e4-446b-8369-d8be5e8b76c3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.173083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f70f-f606-476f-bb27-a1b80aebbc81 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.181871 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1875/3733] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:41:28.187701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f70f-f606-476f-bb27-a1b80aebbc81 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:28.195967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9505ecf-e244-42c7-9319-ad26b909c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.196908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9505ecf-e244-42c7-9319-ad26b909c0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.198512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9505ecf-e244-42c7-9319-ad26b909c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.199039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9505ecf-e244-42c7-9319-ad26b909c0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.200107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9505ecf-e244-42c7-9319-ad26b909c0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.202968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9505ecf-e244-42c7-9319-ad26b909c0e3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.292457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d91459-74e4-446b-8369-d8be5e8b76c3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.295275 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1859/3734] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:28 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:28.321484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d91459-74e4-446b-8369-d8be5e8b76c3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:28.436577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2ea54-b692-4406-b31f-cbfef84512c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.440368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2ea54-b692-4406-b31f-cbfef84512c7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.441176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2ea54-b692-4406-b31f-cbfef84512c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.442037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2ea54-b692-4406-b31f-cbfef84512c7 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.445183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2ea54-b692-4406-b31f-cbfef84512c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.450029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2ea54-b692-4406-b31f-cbfef84512c7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.502819 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1876/3735] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:28 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:41:28.506997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9505ecf-e244-42c7-9319-ad26b909c0e3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.538285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9505ecf-e244-42c7-9319-ad26b909c0e3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:28.568150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d04bb-7b7b-4d56-912c-174d24b9bdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.569915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d04bb-7b7b-4d56-912c-174d24b9bdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.569915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d04bb-7b7b-4d56-912c-174d24b9bdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.569915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d04bb-7b7b-4d56-912c-174d24b9bdb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.570377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d04bb-7b7b-4d56-912c-174d24b9bdb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.572953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d04bb-7b7b-4d56-912c-174d24b9bdb3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.590876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2ea54-b692-4406-b31f-cbfef84512c7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.592404 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1860/3736] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:28.600580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:28.608717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2ea54-b692-4406-b31f-cbfef84512c7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:28.614899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb201dd4-e51a-4eaf-b07a-d6c3cf4a1a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.615987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb201dd4-e51a-4eaf-b07a-d6c3cf4a1a31 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.616516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb201dd4-e51a-4eaf-b07a-d6c3cf4a1a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.617188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb201dd4-e51a-4eaf-b07a-d6c3cf4a1a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.618524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb201dd4-e51a-4eaf-b07a-d6c3cf4a1a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.621006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb201dd4-e51a-4eaf-b07a-d6c3cf4a1a31 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.640155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d04bb-7b7b-4d56-912c-174d24b9bdb3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.649466 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1877/3737] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:28.654233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d04bb-7b7b-4d56-912c-174d24b9bdb3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:28.677013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb655-e601-48cd-9a84-2e6d49bf42f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:28.678237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb655-e601-48cd-9a84-2e6d49bf42f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.678770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb655-e601-48cd-9a84-2e6d49bf42f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.679339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb655-e601-48cd-9a84-2e6d49bf42f3 admin admin] PATH_INFO: `/v3/projects/309d278f6e73403493d64a833dcea802/users/bc96cbe7dc5848538bad1b075b301f34/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.706547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cb655-e601-48cd-9a84-2e6d49bf42f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309d278f6e73403493d64a833dcea802, user_id=bc96cbe7dc5848538bad1b075b301f34, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:28.709925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cb655-e601-48cd-9a84-2e6d49bf42f3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:28.740135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364eb8c-2a2e-41cb-8d31-df48b6db5ff4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:28.740611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364eb8c-2a2e-41cb-8d31-df48b6db5ff4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:28.741330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364eb8c-2a2e-41cb-8d31-df48b6db5ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:28.745254 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1861/3738] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:28 2022] PUT /identity/v3/projects/309d278f6e73403493d64a833dcea802/users/bc96cbe7dc5848538bad1b075b301f34/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:28.780089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1364eb8c-2a2e-41cb-8d31-df48b6db5ff4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:28.781987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1364eb8c-2a2e-41cb-8d31-df48b6db5ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:28.914178 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1878/3739] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:28.996297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb655-e601-48cd-9a84-2e6d49bf42f3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:28.999059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6b5cb655-e601-48cd-9a84-2e6d49bf42f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:29.111734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb655-e601-48cd-9a84-2e6d49bf42f3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:29.116046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b22f5-bc10-46e6-8d06-1fe09a1592a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:29.116669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b22f5-bc10-46e6-8d06-1fe09a1592a9 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:29.116944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b22f5-bc10-46e6-8d06-1fe09a1592a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:29.117215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b22f5-bc10-46e6-8d06-1fe09a1592a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:29.132001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b22f5-bc10-46e6-8d06-1fe09a1592a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:29.134818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b22f5-bc10-46e6-8d06-1fe09a1592a9 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:29.148348 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1862/3740] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:33.805013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b3e94-f6b4-4690-9b5a-8b811315c404 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:33.805996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b3e94-f6b4-4690-9b5a-8b811315c404 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:33.806488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b3e94-f6b4-4690-9b5a-8b811315c404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:33.878603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2f7b3e94-f6b4-4690-9b5a-8b811315c404 None None] MFA Rules not processed for user `3aacfc6a126542f2897c3d3e51e736dc`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:33.880082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2f7b3e94-f6b4-4690-9b5a-8b811315c404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:34.046057 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1879/3741] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:34.336449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b22f5-bc10-46e6-8d06-1fe09a1592a9 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:34.336449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-910b22f5-bc10-46e6-8d06-1fe09a1592a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:34.444485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:34.503861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b22f5-bc10-46e6-8d06-1fe09a1592a9 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:34.510830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1989a-7315-4592-b398-8a3546a6903c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:34.511730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1989a-7315-4592-b398-8a3546a6903c service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:34.512240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1989a-7315-4592-b398-8a3546a6903c service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:34.513094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1989a-7315-4592-b398-8a3546a6903c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:34.523573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1989a-7315-4592-b398-8a3546a6903c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:34.525876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1989a-7315-4592-b398-8a3546a6903c service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:34.551568 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1863/3742] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:36.395701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a212e3e-179c-435c-a9c9-3e182dece71a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:36.396257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a212e3e-179c-435c-a9c9-3e182dece71a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:36.396449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a212e3e-179c-435c-a9c9-3e182dece71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:36.449225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0a212e3e-179c-435c-a9c9-3e182dece71a None None] MFA Rules not processed for user `3aacfc6a126542f2897c3d3e51e736dc`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:36.450611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0a212e3e-179c-435c-a9c9-3e182dece71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:36.458285 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1880/3743] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:38.576786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1989a-7315-4592-b398-8a3546a6903c service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:38.583158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-86b1989a-7315-4592-b398-8a3546a6903c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:38.752468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1989a-7315-4592-b398-8a3546a6903c service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:38.762453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62383f32-ba97-4fb6-b7d7-1af29d4ebe9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:38.763537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383f32-ba97-4fb6-b7d7-1af29d4ebe9b service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:38.765755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383f32-ba97-4fb6-b7d7-1af29d4ebe9b service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:38.766374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383f32-ba97-4fb6-b7d7-1af29d4ebe9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:38.772678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-62383f32-ba97-4fb6-b7d7-1af29d4ebe9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:38.795238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62383f32-ba97-4fb6-b7d7-1af29d4ebe9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:38.798258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62383f32-ba97-4fb6-b7d7-1af29d4ebe9b service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:38.813718 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1864/3744] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:41.831550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a212e3e-179c-435c-a9c9-3e182dece71a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:41.834823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0a212e3e-179c-435c-a9c9-3e182dece71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:41.852509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a212e3e-179c-435c-a9c9-3e182dece71a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:41.858502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c49640-c81f-4f3f-8aee-914cd5d11fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:41.859545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c49640-c81f-4f3f-8aee-914cd5d11fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:41.860717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c49640-c81f-4f3f-8aee-914cd5d11fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:41.861348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c49640-c81f-4f3f-8aee-914cd5d11fb4 admin admin] PATH_INFO: `/v3/users/d51c25b62584479ca6f2310e986b05e5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:41.864383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c49640-c81f-4f3f-8aee-914cd5d11fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51c25b62584479ca6f2310e986b05e5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:41.868968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c49640-c81f-4f3f-8aee-914cd5d11fb4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:41.975003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-55c49640-c81f-4f3f-8aee-914cd5d11fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51c25b62584479ca6f2310e986b05e5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:41.979776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-55c49640-c81f-4f3f-8aee-914cd5d11fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51c25b62584479ca6f2310e986b05e5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:42.012063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-55c49640-c81f-4f3f-8aee-914cd5d11fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51c25b62584479ca6f2310e986b05e5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:42.013606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-55c49640-c81f-4f3f-8aee-914cd5d11fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51c25b62584479ca6f2310e986b05e5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:42.028144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:42.035455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-55c49640-c81f-4f3f-8aee-914cd5d11fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51c25b62584479ca6f2310e986b05e5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:42.066235 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1881/3745] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:41 2022] DELETE /identity/v3/users/d51c25b62584479ca6f2310e986b05e5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:43.338526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62383f32-ba97-4fb6-b7d7-1af29d4ebe9b service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:43.353714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62383f32-ba97-4fb6-b7d7-1af29d4ebe9b service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:43.478088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:43.479329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.479939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.480533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] PATH_INFO: `/v3/projects/099a54274df84f75b89d412cffb6739d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.484068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=099a54274df84f75b89d412cffb6739d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:43.488127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:43.596830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099a54274df84f75b89d412cffb6739d', 'request_id': 'req-eb4289d8-a6d3-4961-951e-db0381b142d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.608782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099a54274df84f75b89d412cffb6739d', 'request_id': 'req-eb4289d8-a6d3-4961-951e-db0381b142d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.614106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:43.624037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099a54274df84f75b89d412cffb6739d', 'request_id': 'req-eb4289d8-a6d3-4961-951e-db0381b142d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.654695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] The token cache is being invalidate because project 099a54274df84f75b89d412cffb6739d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:43.656966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.658047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb4289d8-a6d3-4961-951e-db0381b142d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:43.659964 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1865/3746] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:43 2022] DELETE /identity/v3/projects/099a54274df84f75b89d412cffb6739d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:43.664792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d0b5-6955-4b6c-8ef2-7d1871e1a7d5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.665710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d0b5-6955-4b6c-8ef2-7d1871e1a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.666152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d0b5-6955-4b6c-8ef2-7d1871e1a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.700702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a5b6d0b5-6955-4b6c-8ef2-7d1871e1a7d5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:43.703018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a5b6d0b5-6955-4b6c-8ef2-7d1871e1a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:43.860316 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1882/3747] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:43.869380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd352-e6df-4fb2-a51f-0e089d97ac4f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.869691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd352-e6df-4fb2-a51f-0e089d97ac4f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.869973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd352-e6df-4fb2-a51f-0e089d97ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.909920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-12cbd352-e6df-4fb2-a51f-0e089d97ac4f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:43.911106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-12cbd352-e6df-4fb2-a51f-0e089d97ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:43.932368 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1866/3748] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:43.936900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6d0b5-6955-4b6c-8ef2-7d1871e1a7d5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:43.957702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6d0b5-6955-4b6c-8ef2-7d1871e1a7d5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:43.970290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f4bcb-5646-43fc-9684-e6bf53b1b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:43.971204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4bcb-5646-43fc-9684-e6bf53b1b608 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:43.971682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4bcb-5646-43fc-9684-e6bf53b1b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:43.972114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4bcb-5646-43fc-9684-e6bf53b1b608 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:43.972951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f4bcb-5646-43fc-9684-e6bf53b1b608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:43.973445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f4bcb-5646-43fc-9684-e6bf53b1b608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:43.975259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f4bcb-5646-43fc-9684-e6bf53b1b608 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:43.998447 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1883/3749] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:44.002841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbd352-e6df-4fb2-a51f-0e089d97ac4f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.020320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbd352-e6df-4fb2-a51f-0e089d97ac4f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.026132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c91162-f9c9-44e2-99d1-7a730610a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.026779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c91162-f9c9-44e2-99d1-7a730610a62d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.027062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c91162-f9c9-44e2-99d1-7a730610a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.027343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c91162-f9c9-44e2-99d1-7a730610a62d admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.027994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c91162-f9c9-44e2-99d1-7a730610a62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.029997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c91162-f9c9-44e2-99d1-7a730610a62d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.091872 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1867/3750] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:44 2022] POST /identity/v3/projects => generated 395 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:44.095838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f4bcb-5646-43fc-9684-e6bf53b1b608 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.108579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f4bcb-5646-43fc-9684-e6bf53b1b608 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.231004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e3a0d-e36f-4c36-9907-417a82704219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.231703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e3a0d-e36f-4c36-9907-417a82704219 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.232073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e3a0d-e36f-4c36-9907-417a82704219 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.232413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e3a0d-e36f-4c36-9907-417a82704219 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.233125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e3a0d-e36f-4c36-9907-417a82704219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.235305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e3a0d-e36f-4c36-9907-417a82704219 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.265405 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1884/3751] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:44 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:44.267418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c91162-f9c9-44e2-99d1-7a730610a62d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.281133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c91162-f9c9-44e2-99d1-7a730610a62d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.291173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7a3fd-8b78-4813-b8df-b682841ba1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.292223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a3fd-8b78-4813-b8df-b682841ba1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.292717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a3fd-8b78-4813-b8df-b682841ba1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.293452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a3fd-8b78-4813-b8df-b682841ba1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.294235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7a3fd-8b78-4813-b8df-b682841ba1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.299490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7a3fd-8b78-4813-b8df-b682841ba1e2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.329264 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1868/3752] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:44.333610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e3a0d-e36f-4c36-9907-417a82704219 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.346042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e3a0d-e36f-4c36-9907-417a82704219 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.363945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e3f45-7d61-44e3-ba4c-af9cef6bebda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.365689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e3f45-7d61-44e3-ba4c-af9cef6bebda admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.366200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e3f45-7d61-44e3-ba4c-af9cef6bebda admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.366688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e3f45-7d61-44e3-ba4c-af9cef6bebda admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.367774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e3f45-7d61-44e3-ba4c-af9cef6bebda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.371437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e3f45-7d61-44e3-ba4c-af9cef6bebda admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.388131 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1885/3753] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:44.392712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7a3fd-8b78-4813-b8df-b682841ba1e2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.410636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7a3fd-8b78-4813-b8df-b682841ba1e2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.422269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38ab9a-bc35-44f3-b122-ae8b06210ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.424524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38ab9a-bc35-44f3-b122-ae8b06210ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.424736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38ab9a-bc35-44f3-b122-ae8b06210ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.425019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38ab9a-bc35-44f3-b122-ae8b06210ec4 admin admin] PATH_INFO: `/v3/projects/d5fdf46130f848b793d96f5b8710ee63/users/0fe76a8ee1b04b81afaed92ad7c0a664/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.447295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38ab9a-bc35-44f3-b122-ae8b06210ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fdf46130f848b793d96f5b8710ee63, user_id=0fe76a8ee1b04b81afaed92ad7c0a664, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.451165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38ab9a-bc35-44f3-b122-ae8b06210ec4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:44.490993 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1869/3754] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:44 2022] PUT /identity/v3/projects/d5fdf46130f848b793d96f5b8710ee63/users/0fe76a8ee1b04b81afaed92ad7c0a664/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:44.493198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e32574-a007-42bb-be0f-81a61045f83f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.493838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e32574-a007-42bb-be0f-81a61045f83f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.507078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e32574-a007-42bb-be0f-81a61045f83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.583561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f9e32574-a007-42bb-be0f-81a61045f83f None None] MFA Rules not processed for user `0fe76a8ee1b04b81afaed92ad7c0a664`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:44.583561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f9e32574-a007-42bb-be0f-81a61045f83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:44.691530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:44.757473 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1886/3755] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:44.769320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38ab9a-bc35-44f3-b122-ae8b06210ec4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:44.771460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9d38ab9a-bc35-44f3-b122-ae8b06210ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:44.962867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38ab9a-bc35-44f3-b122-ae8b06210ec4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:44.967990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a053307-33f1-458f-a4eb-313fc1b845b5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.968277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a053307-33f1-458f-a4eb-313fc1b845b5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.968579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a053307-33f1-458f-a4eb-313fc1b845b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.974885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262847-4172-4b87-b897-fa48f596784d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:44.975869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262847-4172-4b87-b897-fa48f596784d service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:44.976157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262847-4172-4b87-b897-fa48f596784d service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:44.976433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262847-4172-4b87-b897-fa48f596784d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:44.987519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60262847-4172-4b87-b897-fa48f596784d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:44.989158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60262847-4172-4b87-b897-fa48f596784d service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:45.000784 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1870/3756] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:44 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:45.040600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4a053307-33f1-458f-a4eb-313fc1b845b5 None None] MFA Rules not processed for user `99a9d6160e024b39bd283af5e9321892`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:45.047768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a053307-33f1-458f-a4eb-313fc1b845b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:45.304302 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1887/3757] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:45.314282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262847-4172-4b87-b897-fa48f596784d service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:45.316608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-60262847-4172-4b87-b897-fa48f596784d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:45.440862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262847-4172-4b87-b897-fa48f596784d service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:45.447865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac477bf-edf9-4a5d-bf55-e013fd92b9bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:45.449064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac477bf-edf9-4a5d-bf55-e013fd92b9bb service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:45.452552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac477bf-edf9-4a5d-bf55-e013fd92b9bb service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:45.452943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac477bf-edf9-4a5d-bf55-e013fd92b9bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:45.459577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cac477bf-edf9-4a5d-bf55-e013fd92b9bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:45.520404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:45.620415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac477bf-edf9-4a5d-bf55-e013fd92b9bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:45.621931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac477bf-edf9-4a5d-bf55-e013fd92b9bb service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:45.682930 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1871/3758] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:46.007719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a053307-33f1-458f-a4eb-313fc1b845b5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:46.143833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a053307-33f1-458f-a4eb-313fc1b845b5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:46.155751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:46.157233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:46.157786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:46.158469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] PATH_INFO: `/v3/users/0fe76a8ee1b04b81afaed92ad7c0a664` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:46.163567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe76a8ee1b04b81afaed92ad7c0a664)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:46.166383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:46.277204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe76a8ee1b04b81afaed92ad7c0a664'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:46.277785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe76a8ee1b04b81afaed92ad7c0a664'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:46.300460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe76a8ee1b04b81afaed92ad7c0a664'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:46.301248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe76a8ee1b04b81afaed92ad7c0a664'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:46.310722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:46.315364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe76a8ee1b04b81afaed92ad7c0a664'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:46.381984 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1888/3759] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:46 2022] DELETE /identity/v3/users/0fe76a8ee1b04b81afaed92ad7c0a664 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:46.382358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782d5e-7d44-4fd8-a024-0406aaeab48b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:46.382652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782d5e-7d44-4fd8-a024-0406aaeab48b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:46.382959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782d5e-7d44-4fd8-a024-0406aaeab48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:46.404658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:46.409858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:46.450940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-17782d5e-7d44-4fd8-a024-0406aaeab48b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:46.452192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-17782d5e-7d44-4fd8-a024-0406aaeab48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:46.652519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f3963-bfbd-462c-b7ea-1738799b5d43 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:46.672827 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1872/3760] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:46.684807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d177d-1d0e-4ed3-9f1a-8abd0657e71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:46.688378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d177d-1d0e-4ed3-9f1a-8abd0657e71b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:46.688624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d177d-1d0e-4ed3-9f1a-8abd0657e71b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:46.688887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d177d-1d0e-4ed3-9f1a-8abd0657e71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:46.695782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b81d177d-1d0e-4ed3-9f1a-8abd0657e71b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:46.720051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d177d-1d0e-4ed3-9f1a-8abd0657e71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:46.723034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d177d-1d0e-4ed3-9f1a-8abd0657e71b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:46.767849 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1889/3761] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:46.800080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782d5e-7d44-4fd8-a024-0406aaeab48b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:46.802608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-17782d5e-7d44-4fd8-a024-0406aaeab48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:46.861770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782d5e-7d44-4fd8-a024-0406aaeab48b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:46.873018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadd901-e4f5-41a9-8ba9-152b9fde2ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:46.875347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadd901-e4f5-41a9-8ba9-152b9fde2ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:46.877066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadd901-e4f5-41a9-8ba9-152b9fde2ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:46.877680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadd901-e4f5-41a9-8ba9-152b9fde2ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:46.921923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadd901-e4f5-41a9-8ba9-152b9fde2ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:46.930974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadd901-e4f5-41a9-8ba9-152b9fde2ff8 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:46.960508 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1873/3762] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:47.026246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc136e50-0082-4200-8cc5-291f64ac326a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:47.026700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc136e50-0082-4200-8cc5-291f64ac326a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:47.026786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc136e50-0082-4200-8cc5-291f64ac326a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:47.074104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cc136e50-0082-4200-8cc5-291f64ac326a None None] MFA Rules not processed for user `bb6c138e67fa4aa9805412ba7283592c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:47.076505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cc136e50-0082-4200-8cc5-291f64ac326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:47.320648 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1890/3763] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:47.333188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b1bf-1c05-48a1-b011-84e8f68fa2a6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:47.333582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b1bf-1c05-48a1-b011-84e8f68fa2a6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:47.334207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b1bf-1c05-48a1-b011-84e8f68fa2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:47.410188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fb97b1bf-1c05-48a1-b011-84e8f68fa2a6 None None] MFA Rules not processed for user `bb6c138e67fa4aa9805412ba7283592c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:47.416254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fb97b1bf-1c05-48a1-b011-84e8f68fa2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:47.451689 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1874/3764] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:47.806551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc136e50-0082-4200-8cc5-291f64ac326a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:47.807997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cc136e50-0082-4200-8cc5-291f64ac326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:47.987488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc136e50-0082-4200-8cc5-291f64ac326a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:48.019646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca874f-64f8-4cc0-9353-750429adde8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:48.020989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca874f-64f8-4cc0-9353-750429adde8f service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:48.020989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca874f-64f8-4cc0-9353-750429adde8f service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:48.020989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca874f-64f8-4cc0-9353-750429adde8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:48.047518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca874f-64f8-4cc0-9353-750429adde8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:48.056798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca874f-64f8-4cc0-9353-750429adde8f service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:48.106752 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1891/3765] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:50.121796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97b1bf-1c05-48a1-b011-84e8f68fa2a6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:50.124006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fb97b1bf-1c05-48a1-b011-84e8f68fa2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:50.154002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97b1bf-1c05-48a1-b011-84e8f68fa2a6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:50.171518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:50.172484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:50.172931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:50.173378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] PATH_INFO: `/v3/projects/d5fdf46130f848b793d96f5b8710ee63` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:50.176995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5fdf46130f848b793d96f5b8710ee63)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:50.179209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:50.355282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5fdf46130f848b793d96f5b8710ee63', 'request_id': 'req-a887ecdd-6d52-40fa-bcf9-ab07d568adee'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:50.374640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5fdf46130f848b793d96f5b8710ee63', 'request_id': 'req-a887ecdd-6d52-40fa-bcf9-ab07d568adee'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:50.397234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5fdf46130f848b793d96f5b8710ee63', 'request_id': 'req-a887ecdd-6d52-40fa-bcf9-ab07d568adee'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:50.437262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] The token cache is being invalidate because project d5fdf46130f848b793d96f5b8710ee63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:50.438125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:50.438988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a887ecdd-6d52-40fa-bcf9-ab07d568adee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:50.440713 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1875/3766] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:50 2022] DELETE /identity/v3/projects/d5fdf46130f848b793d96f5b8710ee63 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:50.449319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f5929-8bbd-4015-9836-86885140abff None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:50.477531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f5929-8bbd-4015-9836-86885140abff None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:50.477867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f5929-8bbd-4015-9836-86885140abff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:50.594254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:50.617733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3c2f5929-8bbd-4015-9836-86885140abff None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:50.619699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3c2f5929-8bbd-4015-9836-86885140abff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:50.805737 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1892/3767] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:50.813747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8f1c9-11e8-4dab-af4c-abea082867f1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:50.814379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8f1c9-11e8-4dab-af4c-abea082867f1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:50.814871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8f1c9-11e8-4dab-af4c-abea082867f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:50.869618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4dc8f1c9-11e8-4dab-af4c-abea082867f1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:50.871458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4dc8f1c9-11e8-4dab-af4c-abea082867f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:50.905071 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1876/3768] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:50.910660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f5929-8bbd-4015-9836-86885140abff None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:50.931666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f5929-8bbd-4015-9836-86885140abff None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:50.947786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63649469-8e96-4692-817e-17196d8ac90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:50.948424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63649469-8e96-4692-817e-17196d8ac90d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:50.948702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63649469-8e96-4692-817e-17196d8ac90d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:50.948972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63649469-8e96-4692-817e-17196d8ac90d admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:50.950540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63649469-8e96-4692-817e-17196d8ac90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:50.951929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63649469-8e96-4692-817e-17196d8ac90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:50.960534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63649469-8e96-4692-817e-17196d8ac90d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:51.009270 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1893/3769] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:51.014514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8f1c9-11e8-4dab-af4c-abea082867f1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:51.042327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8f1c9-11e8-4dab-af4c-abea082867f1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:51.049919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e925a-5e38-4c4b-8c3d-8c585f5e53fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:51.050660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e925a-5e38-4c4b-8c3d-8c585f5e53fe admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:51.051043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e925a-5e38-4c4b-8c3d-8c585f5e53fe admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:51.051940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e925a-5e38-4c4b-8c3d-8c585f5e53fe admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:51.052714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e925a-5e38-4c4b-8c3d-8c585f5e53fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:51.055013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e925a-5e38-4c4b-8c3d-8c585f5e53fe admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:51.147328 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1877/3770] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:51 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:51.151503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63649469-8e96-4692-817e-17196d8ac90d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:51.170670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63649469-8e96-4692-817e-17196d8ac90d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:51.293117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e925a-5e38-4c4b-8c3d-8c585f5e53fe admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:51.294951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bc0e925a-5e38-4c4b-8c3d-8c585f5e53fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:51.301255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:51.392431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cff294-a80f-4b34-bad6-238f53c77ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:51.393988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cff294-a80f-4b34-bad6-238f53c77ceb admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:51.394481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cff294-a80f-4b34-bad6-238f53c77ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:51.396079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cff294-a80f-4b34-bad6-238f53c77ceb admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:51.397488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cff294-a80f-4b34-bad6-238f53c77ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:51.404371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cff294-a80f-4b34-bad6-238f53c77ceb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:51.444864 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1894/3771] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:51 2022] POST /identity/v3/users => generated 292 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:51.451564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cff294-a80f-4b34-bad6-238f53c77ceb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:51.475951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cff294-a80f-4b34-bad6-238f53c77ceb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:51.491428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9b0d7-137f-4485-aa5c-d8ae15e46002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:51.491428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9b0d7-137f-4485-aa5c-d8ae15e46002 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:51.491797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9b0d7-137f-4485-aa5c-d8ae15e46002 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:51.492027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9b0d7-137f-4485-aa5c-d8ae15e46002 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:51.493147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9b0d7-137f-4485-aa5c-d8ae15e46002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:51.498455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9b0d7-137f-4485-aa5c-d8ae15e46002 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:51.528403 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1895/3772] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:51.529595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9b0d7-137f-4485-aa5c-d8ae15e46002 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:51.549938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9b0d7-137f-4485-aa5c-d8ae15e46002 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:51.566418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca7644-ecff-46b4-96d9-012c5bcb429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:51.567088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca7644-ecff-46b4-96d9-012c5bcb429e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:51.568245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca7644-ecff-46b4-96d9-012c5bcb429e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:51.568245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca7644-ecff-46b4-96d9-012c5bcb429e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:51.568656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca7644-ecff-46b4-96d9-012c5bcb429e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:51.570331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca7644-ecff-46b4-96d9-012c5bcb429e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:51.588653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e925a-5e38-4c4b-8c3d-8c585f5e53fe admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:51.613576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0edc36-c8d9-4b1f-a099-929c85e96448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:51.614219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0edc36-c8d9-4b1f-a099-929c85e96448 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:51.614503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0edc36-c8d9-4b1f-a099-929c85e96448 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:51.617441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0edc36-c8d9-4b1f-a099-929c85e96448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:51.617650 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1896/3773] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:41:51.620123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca7644-ecff-46b4-96d9-012c5bcb429e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:51.626891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ad0edc36-c8d9-4b1f-a099-929c85e96448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:51.639481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca7644-ecff-46b4-96d9-012c5bcb429e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:51.646997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90871d-6286-40f5-ab2c-98a4db1138c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:51.648093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90871d-6286-40f5-ab2c-98a4db1138c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:51.648607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90871d-6286-40f5-ab2c-98a4db1138c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:51.649103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90871d-6286-40f5-ab2c-98a4db1138c7 admin admin] PATH_INFO: `/v3/projects/a791f93738c54fab81cd15aa60db9dc4/users/b1111a8787d4470b9fd6cec9f2a0a18d/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:51.682322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0edc36-c8d9-4b1f-a099-929c85e96448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:51.683661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90871d-6286-40f5-ab2c-98a4db1138c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a791f93738c54fab81cd15aa60db9dc4, user_id=b1111a8787d4470b9fd6cec9f2a0a18d, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:51.683953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0edc36-c8d9-4b1f-a099-929c85e96448 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:51.687485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90871d-6286-40f5-ab2c-98a4db1138c7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:51.731479 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1897/3774] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:51 2022] PUT /identity/v3/projects/a791f93738c54fab81cd15aa60db9dc4/users/b1111a8787d4470b9fd6cec9f2a0a18d/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:51.737857 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1878/3775] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:41:51.810649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55ceb6-bdd3-4cc3-9667-abc78cc4fd5c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:51.810937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55ceb6-bdd3-4cc3-9667-abc78cc4fd5c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:51.811215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55ceb6-bdd3-4cc3-9667-abc78cc4fd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:51.895682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4a55ceb6-bdd3-4cc3-9667-abc78cc4fd5c None None] MFA Rules not processed for user `b1111a8787d4470b9fd6cec9f2a0a18d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:51.897145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a55ceb6-bdd3-4cc3-9667-abc78cc4fd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:51.944897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:52.048477 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1898/3776] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:53.091683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0edc36-c8d9-4b1f-a099-929c85e96448 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:53.095125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ad0edc36-c8d9-4b1f-a099-929c85e96448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:53.141603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0edc36-c8d9-4b1f-a099-929c85e96448 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:53.244079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd73caf-73c0-4d0a-a6ad-f32bb98307cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:53.244989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73caf-73c0-4d0a-a6ad-f32bb98307cd service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:53.245487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73caf-73c0-4d0a-a6ad-f32bb98307cd service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:53.245954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73caf-73c0-4d0a-a6ad-f32bb98307cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:53.257024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd73caf-73c0-4d0a-a6ad-f32bb98307cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:53.259872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd73caf-73c0-4d0a-a6ad-f32bb98307cd service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:53.272058 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1879/3777] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:55.354858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55ceb6-bdd3-4cc3-9667-abc78cc4fd5c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:55.726070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55ceb6-bdd3-4cc3-9667-abc78cc4fd5c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:55.742519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:55.743188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:55.743467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:55.746891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] PATH_INFO: `/v3/users/b1111a8787d4470b9fd6cec9f2a0a18d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:55.750445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1111a8787d4470b9fd6cec9f2a0a18d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:55.772213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:55.954799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1111a8787d4470b9fd6cec9f2a0a18d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:55.955521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1111a8787d4470b9fd6cec9f2a0a18d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:56.001584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1111a8787d4470b9fd6cec9f2a0a18d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:56.002894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1111a8787d4470b9fd6cec9f2a0a18d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:56.021895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1111a8787d4470b9fd6cec9f2a0a18d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:56.050639 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1899/3778] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:41:55 2022] DELETE /identity/v3/users/b1111a8787d4470b9fd6cec9f2a0a18d => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:56.054076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22970c-66a1-4583-8217-fedaa0f8bc16 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:56.054586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22970c-66a1-4583-8217-fedaa0f8bc16 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:56.054688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22970c-66a1-4583-8217-fedaa0f8bc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:56.091641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5e22970c-66a1-4583-8217-fedaa0f8bc16 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:56.093516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5e22970c-66a1-4583-8217-fedaa0f8bc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:56.212974 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1880/3779] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:56.287341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:56.288855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:56.399774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:56.408056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44867932-a1ce-4287-83be-70031cd69316 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:56.423395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0e74-5d3c-4b89-962b-8139f5408155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:56.424055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0e74-5d3c-4b89-962b-8139f5408155 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:56.424335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0e74-5d3c-4b89-962b-8139f5408155 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:56.424609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0e74-5d3c-4b89-962b-8139f5408155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:56.450170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c0e74-5d3c-4b89-962b-8139f5408155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:56.455455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c0e74-5d3c-4b89-962b-8139f5408155 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:56.477944 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1900/3780] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:56.519740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22970c-66a1-4583-8217-fedaa0f8bc16 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:56.521229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5e22970c-66a1-4583-8217-fedaa0f8bc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:56.560807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:56.688931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631eeb62-2b51-4e5e-926e-b35de425f2b6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:56.690215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631eeb62-2b51-4e5e-926e-b35de425f2b6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:56.690722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631eeb62-2b51-4e5e-926e-b35de425f2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:56.756225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-631eeb62-2b51-4e5e-926e-b35de425f2b6 None None] MFA Rules not processed for user `bc96cbe7dc5848538bad1b075b301f34`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:56.760832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-631eeb62-2b51-4e5e-926e-b35de425f2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:56.763791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22970c-66a1-4583-8217-fedaa0f8bc16 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:56.785750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f044d-e42a-4257-b4dd-303925821f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:56.786400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f044d-e42a-4257-b4dd-303925821f14 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:56.786678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f044d-e42a-4257-b4dd-303925821f14 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:56.786949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f044d-e42a-4257-b4dd-303925821f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:56.792240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-603f044d-e42a-4257-b4dd-303925821f14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:56.843645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f044d-e42a-4257-b4dd-303925821f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:56.846069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f044d-e42a-4257-b4dd-303925821f14 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:56.873919 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1881/3781] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:56.879646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cec620-2530-4d52-8f4d-7d738105e55e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:56.880242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cec620-2530-4d52-8f4d-7d738105e55e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:56.883278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cec620-2530-4d52-8f4d-7d738105e55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:56.929548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c8cec620-2530-4d52-8f4d-7d738105e55e None None] MFA Rules not processed for user `48a7b8433888412abc328cbc3aea214b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:56.931111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c8cec620-2530-4d52-8f4d-7d738105e55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:57.007342 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1901/3782] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:41:57.026105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631eeb62-2b51-4e5e-926e-b35de425f2b6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:57.039315 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1882/3783] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:57.068005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631eeb62-2b51-4e5e-926e-b35de425f2b6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:57.077597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2443465-95ad-483d-b3f3-0dcd865e0bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:57.078277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2443465-95ad-483d-b3f3-0dcd865e0bf4 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:57.078561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2443465-95ad-483d-b3f3-0dcd865e0bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:57.078844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2443465-95ad-483d-b3f3-0dcd865e0bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:57.088596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2443465-95ad-483d-b3f3-0dcd865e0bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:57.090731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2443465-95ad-483d-b3f3-0dcd865e0bf4 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:57.102459 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1902/3784] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:41:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:41:58.177942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cec620-2530-4d52-8f4d-7d738105e55e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:58.179620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c8cec620-2530-4d52-8f4d-7d738105e55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:58.210414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cec620-2530-4d52-8f4d-7d738105e55e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:58.222947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:58.226205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:58.226501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:58.228200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] PATH_INFO: `/v3/projects/a791f93738c54fab81cd15aa60db9dc4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:58.230391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a791f93738c54fab81cd15aa60db9dc4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:58.232327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:58.360843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a791f93738c54fab81cd15aa60db9dc4', 'request_id': 'req-86602f03-34c6-4f7c-83f8-39b4ce30fb60'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:58.375495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a791f93738c54fab81cd15aa60db9dc4', 'request_id': 'req-86602f03-34c6-4f7c-83f8-39b4ce30fb60'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:58.390184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a791f93738c54fab81cd15aa60db9dc4', 'request_id': 'req-86602f03-34c6-4f7c-83f8-39b4ce30fb60'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:58.416202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] The token cache is being invalidate because project a791f93738c54fab81cd15aa60db9dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:41:58.417857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:58.418625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-86602f03-34c6-4f7c-83f8-39b4ce30fb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:41:58.424480 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1883/3785] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:58 2022] DELETE /identity/v3/projects/a791f93738c54fab81cd15aa60db9dc4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:41:58.427272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e17f2-eb1b-44aa-aead-cf3d759f3b69 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:58.428259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e17f2-eb1b-44aa-aead-cf3d759f3b69 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:58.428864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e17f2-eb1b-44aa-aead-cf3d759f3b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:58.474629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-171e17f2-eb1b-44aa-aead-cf3d759f3b69 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:58.476132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-171e17f2-eb1b-44aa-aead-cf3d759f3b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:58.617192 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1903/3786] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:58.618078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0a76e-5ea4-42d3-b3ec-9d126a43e2e1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:58.618366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0a76e-5ea4-42d3-b3ec-9d126a43e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:58.618656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0a76e-5ea4-42d3-b3ec-9d126a43e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:58.691501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-16a0a76e-5ea4-42d3-b3ec-9d126a43e2e1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:58.692760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-16a0a76e-5ea4-42d3-b3ec-9d126a43e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:58.750583 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1884/3787] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:41:58.754501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e17f2-eb1b-44aa-aead-cf3d759f3b69 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:58.786705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e17f2-eb1b-44aa-aead-cf3d759f3b69 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:58.814012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81807a-ce3b-410e-979a-198f318844b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:58.817196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81807a-ce3b-410e-979a-198f318844b9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:58.817753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81807a-ce3b-410e-979a-198f318844b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:58.818262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81807a-ce3b-410e-979a-198f318844b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:58.822558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81807a-ce3b-410e-979a-198f318844b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:41:58.829236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81807a-ce3b-410e-979a-198f318844b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:58.836736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81807a-ce3b-410e-979a-198f318844b9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:58.878256 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1904/3788] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:41:58.882454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0a76e-5ea4-42d3-b3ec-9d126a43e2e1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:58.906200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0a76e-5ea4-42d3-b3ec-9d126a43e2e1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:58.924671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2762d-adfc-4bd0-b31c-e282cf7933df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:58.930442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2762d-adfc-4bd0-b31c-e282cf7933df admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:58.932580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2762d-adfc-4bd0-b31c-e282cf7933df admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:58.934161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2762d-adfc-4bd0-b31c-e282cf7933df admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:58.937054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2762d-adfc-4bd0-b31c-e282cf7933df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:58.945768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2762d-adfc-4bd0-b31c-e282cf7933df admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:59.010914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:59.037509 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1885/3789] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:41:58 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:59.041503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81807a-ce3b-410e-979a-198f318844b9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:59.058716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81807a-ce3b-410e-979a-198f318844b9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:59.171173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:59.190908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5bfb4-af3d-4b08-9cc2-1b2f7484c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:59.191618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5bfb4-af3d-4b08-9cc2-1b2f7484c890 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:59.191973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5bfb4-af3d-4b08-9cc2-1b2f7484c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:59.192314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5bfb4-af3d-4b08-9cc2-1b2f7484c890 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:59.192979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5bfb4-af3d-4b08-9cc2-1b2f7484c890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:59.195475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5bfb4-af3d-4b08-9cc2-1b2f7484c890 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:59.257483 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1905/3790] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:41:59 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:41:59.261622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2762d-adfc-4bd0-b31c-e282cf7933df admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:59.278758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2762d-adfc-4bd0-b31c-e282cf7933df admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:59.293443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e9cbd-6878-43b9-8b08-ba8339d5208a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:59.294274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e9cbd-6878-43b9-8b08-ba8339d5208a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:59.294594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e9cbd-6878-43b9-8b08-ba8339d5208a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:59.294875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e9cbd-6878-43b9-8b08-ba8339d5208a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:59.295704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e9cbd-6878-43b9-8b08-ba8339d5208a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:59.297497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e9cbd-6878-43b9-8b08-ba8339d5208a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:59.345401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5bfb4-af3d-4b08-9cc2-1b2f7484c890 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:59.348463 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1886/3791] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:59.376843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5bfb4-af3d-4b08-9cc2-1b2f7484c890 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:59.390214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75851129-389b-4948-99f6-26e610e69bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:59.392062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851129-389b-4948-99f6-26e610e69bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:59.392347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851129-389b-4948-99f6-26e610e69bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:59.392623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851129-389b-4948-99f6-26e610e69bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:59.393376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75851129-389b-4948-99f6-26e610e69bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:59.397707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75851129-389b-4948-99f6-26e610e69bc1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:59.430374 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1906/3792] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:41:59.432226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e9cbd-6878-43b9-8b08-ba8339d5208a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:41:59.449685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e9cbd-6878-43b9-8b08-ba8339d5208a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:41:59.470504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a07d9-5ba6-4b45-84cd-2046d0d04dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:41:59.479366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a07d9-5ba6-4b45-84cd-2046d0d04dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:59.479637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a07d9-5ba6-4b45-84cd-2046d0d04dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:59.480748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a07d9-5ba6-4b45-84cd-2046d0d04dd7 admin admin] PATH_INFO: `/v3/projects/72c8b7b1bf85460b8da7a6226458fa79/users/46d63ff4182d4208abff51516727cb0c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:59.545008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a07d9-5ba6-4b45-84cd-2046d0d04dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c8b7b1bf85460b8da7a6226458fa79, user_id=46d63ff4182d4208abff51516727cb0c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:41:59.555053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a07d9-5ba6-4b45-84cd-2046d0d04dd7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:41:59.599714 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1887/3793] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:41:59 2022] PUT /identity/v3/projects/72c8b7b1bf85460b8da7a6226458fa79/users/46d63ff4182d4208abff51516727cb0c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:41:59.602134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619700-315f-4dbc-805f-265bc789635e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:41:59.602466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619700-315f-4dbc-805f-265bc789635e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:41:59.602689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619700-315f-4dbc-805f-265bc789635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:41:59.685666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-77619700-315f-4dbc-805f-265bc789635e None None] MFA Rules not processed for user `46d63ff4182d4208abff51516727cb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:41:59.686836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-77619700-315f-4dbc-805f-265bc789635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:41:59.839573 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1907/3794] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:41:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:00.394228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a07d9-5ba6-4b45-84cd-2046d0d04dd7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:00.396770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-143a07d9-5ba6-4b45-84cd-2046d0d04dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:00.580622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a07d9-5ba6-4b45-84cd-2046d0d04dd7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:00.595469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377196c-e19a-4937-a009-04080501ebb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:00.596381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377196c-e19a-4937-a009-04080501ebb2 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:00.598052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377196c-e19a-4937-a009-04080501ebb2 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:00.598553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377196c-e19a-4937-a009-04080501ebb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:00.623451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377196c-e19a-4937-a009-04080501ebb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:00.630226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377196c-e19a-4937-a009-04080501ebb2 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:00.650927 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1888/3795] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:00.830290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bf2dd-af22-4bca-87ae-e043fed858b0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:00.831330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bf2dd-af22-4bca-87ae-e043fed858b0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:00.831986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bf2dd-af22-4bca-87ae-e043fed858b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:00.870180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-be8bf2dd-af22-4bca-87ae-e043fed858b0 None None] MFA Rules not processed for user `bc96cbe7dc5848538bad1b075b301f34`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:00.873473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-be8bf2dd-af22-4bca-87ae-e043fed858b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:00.972646 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1908/3796] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:09.118411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377196c-e19a-4937-a009-04080501ebb2 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:09.288392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377196c-e19a-4937-a009-04080501ebb2 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:09.304735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:09.307634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:09.309516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:09.310082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] PATH_INFO: `/v3/users/46d63ff4182d4208abff51516727cb0c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:09.312984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d63ff4182d4208abff51516727cb0c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:09.320218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:09.494895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d63ff4182d4208abff51516727cb0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:09.495703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d63ff4182d4208abff51516727cb0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:09.503938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:09.541233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d63ff4182d4208abff51516727cb0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:09.566687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d63ff4182d4208abff51516727cb0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:09.577557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d63ff4182d4208abff51516727cb0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:09.589123 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1889/3797] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:09 2022] DELETE /identity/v3/users/46d63ff4182d4208abff51516727cb0c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:09.590966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29d02-fed6-4957-a482-b361290bde42 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:09.591459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29d02-fed6-4957-a482-b361290bde42 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:09.591804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29d02-fed6-4957-a482-b361290bde42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:09.630586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-41f29d02-fed6-4957-a482-b361290bde42 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:09.631846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-41f29d02-fed6-4957-a482-b361290bde42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:09.723498 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1909/3798] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:09.771871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:09.774005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:09.928158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e7e05-c2cf-403b-995e-424f53850299 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:09.934475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bfaac-8046-4194-af01-2c7fe63112b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:09.935120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bfaac-8046-4194-af01-2c7fe63112b3 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:09.935407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bfaac-8046-4194-af01-2c7fe63112b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:09.935688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bfaac-8046-4194-af01-2c7fe63112b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:09.961478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bfaac-8046-4194-af01-2c7fe63112b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:09.962987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bfaac-8046-4194-af01-2c7fe63112b3 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:09.972609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29d02-fed6-4957-a482-b361290bde42 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:09.974199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-41f29d02-fed6-4957-a482-b361290bde42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:09.997687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:10.010525 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1890/3799] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:10.105614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29d02-fed6-4957-a482-b361290bde42 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:10.113854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f5162-eb68-4ce4-8e67-0b063fc89d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:10.114492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f5162-eb68-4ce4-8e67-0b063fc89d5d service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:10.114778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f5162-eb68-4ce4-8e67-0b063fc89d5d service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:10.115056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f5162-eb68-4ce4-8e67-0b063fc89d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:10.117357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-868f5162-eb68-4ce4-8e67-0b063fc89d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:10.135043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f5162-eb68-4ce4-8e67-0b063fc89d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:10.136966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f5162-eb68-4ce4-8e67-0b063fc89d5d service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:10.150007 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1910/3800] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:42:11.726137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bfaac-8046-4194-af01-2c7fe63112b3 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:11.729584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3b4bfaac-8046-4194-af01-2c7fe63112b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:11.756747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bfaac-8046-4194-af01-2c7fe63112b3 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:11.762516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:11.764030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:11.764561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:11.765076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] PATH_INFO: `/v3/projects/72c8b7b1bf85460b8da7a6226458fa79` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:11.774277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c8b7b1bf85460b8da7a6226458fa79)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:11.776695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:11.838060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c8b7b1bf85460b8da7a6226458fa79', 'request_id': 'req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:11.847071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c8b7b1bf85460b8da7a6226458fa79', 'request_id': 'req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:11.856689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c8b7b1bf85460b8da7a6226458fa79', 'request_id': 'req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:11.888084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] The token cache is being invalidate because project 72c8b7b1bf85460b8da7a6226458fa79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:11.888564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:11.889493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-44ae77e0-287f-47e6-95ad-c4d3b5493c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:11.897867 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1891/3801] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:11 2022] DELETE /identity/v3/projects/72c8b7b1bf85460b8da7a6226458fa79 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:11.908851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95250556-d4b2-4a84-98c3-267dddbd691d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:11.909776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95250556-d4b2-4a84-98c3-267dddbd691d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:11.910301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95250556-d4b2-4a84-98c3-267dddbd691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:11.978440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-95250556-d4b2-4a84-98c3-267dddbd691d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:11.983426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-95250556-d4b2-4a84-98c3-267dddbd691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:12.126835 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1911/3802] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:12.129375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd030c02-7cfd-46ce-9cd5-d0e7a21f910a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:12.129687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd030c02-7cfd-46ce-9cd5-d0e7a21f910a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:12.130128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd030c02-7cfd-46ce-9cd5-d0e7a21f910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:12.169303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cd030c02-7cfd-46ce-9cd5-d0e7a21f910a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:12.172223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cd030c02-7cfd-46ce-9cd5-d0e7a21f910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:12.186168 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1892/3803] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:12.191721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95250556-d4b2-4a84-98c3-267dddbd691d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:12.204665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95250556-d4b2-4a84-98c3-267dddbd691d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:12.218243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ce454-7b0e-47ff-b242-d6a342c8c807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:12.218913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ce454-7b0e-47ff-b242-d6a342c8c807 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:12.219195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ce454-7b0e-47ff-b242-d6a342c8c807 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:12.219467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ce454-7b0e-47ff-b242-d6a342c8c807 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:12.220134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ce454-7b0e-47ff-b242-d6a342c8c807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:12.220432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ce454-7b0e-47ff-b242-d6a342c8c807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:12.222501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ce454-7b0e-47ff-b242-d6a342c8c807 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:12.236407 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1912/3804] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:42:12.240356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd030c02-7cfd-46ce-9cd5-d0e7a21f910a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:12.256448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd030c02-7cfd-46ce-9cd5-d0e7a21f910a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:12.268758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc03bc8-bbbc-4179-8794-552c95962232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:12.269376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc03bc8-bbbc-4179-8794-552c95962232 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:12.269689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc03bc8-bbbc-4179-8794-552c95962232 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:12.269962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc03bc8-bbbc-4179-8794-552c95962232 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:12.270592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc03bc8-bbbc-4179-8794-552c95962232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:12.272651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc03bc8-bbbc-4179-8794-552c95962232 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:12.303932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ce454-7b0e-47ff-b242-d6a342c8c807 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:12.306572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a88ce454-7b0e-47ff-b242-d6a342c8c807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:12.311018 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1893/3805] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:12 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:12.315525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc03bc8-bbbc-4179-8794-552c95962232 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:12.339795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ce454-7b0e-47ff-b242-d6a342c8c807 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:12.360102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:12.458848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc03bc8-bbbc-4179-8794-552c95962232 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:12.464647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476c517-3a64-4141-8f54-704d144999fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:12.465358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476c517-3a64-4141-8f54-704d144999fa admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:12.465736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476c517-3a64-4141-8f54-704d144999fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:12.466092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476c517-3a64-4141-8f54-704d144999fa admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:12.469493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476c517-3a64-4141-8f54-704d144999fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:12.471858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476c517-3a64-4141-8f54-704d144999fa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:12.496991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:12.497943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:12.498401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:12.498854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] PATH_INFO: `/v3/users/d900c75dc1dd4f5d9cac369d156e2745` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:12.500956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d900c75dc1dd4f5d9cac369d156e2745)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:12.503391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:12.537830 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1894/3806] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:12 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:12.542661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476c517-3a64-4141-8f54-704d144999fa admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:12.566140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:12.570281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476c517-3a64-4141-8f54-704d144999fa admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:12.598311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d071-61dc-4bc3-8928-058dadd33c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:12.598960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d071-61dc-4bc3-8928-058dadd33c74 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:12.599242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d071-61dc-4bc3-8928-058dadd33c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:12.599511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d071-61dc-4bc3-8928-058dadd33c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:12.600171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61d071-61dc-4bc3-8928-058dadd33c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:12.602498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61d071-61dc-4bc3-8928-058dadd33c74 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:12.610821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd900c75dc1dd4f5d9cac369d156e2745'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:12.611514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd900c75dc1dd4f5d9cac369d156e2745'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:12.624481 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1895/3807] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:12.637772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d071-61dc-4bc3-8928-058dadd33c74 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:12.638166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ba61d071-61dc-4bc3-8928-058dadd33c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:12.650800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd900c75dc1dd4f5d9cac369d156e2745'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:12.655386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd900c75dc1dd4f5d9cac369d156e2745'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:12.668733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d071-61dc-4bc3-8928-058dadd33c74 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:12.673979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd900c75dc1dd4f5d9cac369d156e2745'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:12.708374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd84e9-fe10-4e4e-9430-89b978636c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:12.710759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd84e9-fe10-4e4e-9430-89b978636c7f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:12.711890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd84e9-fe10-4e4e-9430-89b978636c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:12.712694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd84e9-fe10-4e4e-9430-89b978636c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:12.720008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd84e9-fe10-4e4e-9430-89b978636c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:12.727450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd84e9-fe10-4e4e-9430-89b978636c7f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:12.730689 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1913/3808] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:12 2022] DELETE /identity/v3/users/d900c75dc1dd4f5d9cac369d156e2745 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:12.762717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:12.764190 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1896/3809] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:12.924455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92399fde-c891-4798-aed5-90b2d7eebe93 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:12.944691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fe76b-5199-4c26-bf32-a8a5d6014da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:12.945713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe76b-5199-4c26-bf32-a8a5d6014da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:12.946095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe76b-5199-4c26-bf32-a8a5d6014da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:12.946476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe76b-5199-4c26-bf32-a8a5d6014da9 admin admin] PATH_INFO: `/v3/projects/0be795a7587c4c2c8e5d71a01f5ba732/users/f1fd00311fa540658cfd4076c9a88976/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:13.010769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fe76b-5199-4c26-bf32-a8a5d6014da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be795a7587c4c2c8e5d71a01f5ba732, user_id=f1fd00311fa540658cfd4076c9a88976, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:13.013759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fe76b-5199-4c26-bf32-a8a5d6014da9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:13.048291 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1914/3810] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:12 2022] PUT /identity/v3/projects/0be795a7587c4c2c8e5d71a01f5ba732/users/f1fd00311fa540658cfd4076c9a88976/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:13.053443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167bd48-c27b-483d-a294-fbeef0f88dc1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:13.053877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167bd48-c27b-483d-a294-fbeef0f88dc1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:13.054252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167bd48-c27b-483d-a294-fbeef0f88dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:13.100573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3167bd48-c27b-483d-a294-fbeef0f88dc1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:13.103983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3167bd48-c27b-483d-a294-fbeef0f88dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:13.267999 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1897/3811] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:13.435690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fe76b-5199-4c26-bf32-a8a5d6014da9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:13.438572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-598fe76b-5199-4c26-bf32-a8a5d6014da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:13.543668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167bd48-c27b-483d-a294-fbeef0f88dc1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:13.546464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3167bd48-c27b-483d-a294-fbeef0f88dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:13.570627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fe76b-5199-4c26-bf32-a8a5d6014da9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:13.576982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb5958-4543-4a68-9c7a-6cd095c9da0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:13.578925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5958-4543-4a68-9c7a-6cd095c9da0b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:13.579430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5958-4543-4a68-9c7a-6cd095c9da0b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:13.579866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5958-4543-4a68-9c7a-6cd095c9da0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:13.595519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167bd48-c27b-483d-a294-fbeef0f88dc1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:13.604868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb5958-4543-4a68-9c7a-6cd095c9da0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:13.607469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb5958-4543-4a68-9c7a-6cd095c9da0b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:13.617489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:13.618623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:13.619034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:13.619423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] PATH_INFO: `/v3/projects/fbe0e5fcbfed48aaaac38493038900d5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:13.622971 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1915/3812] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:13.624823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe0e5fcbfed48aaaac38493038900d5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:13.628535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:13.705995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe0e5fcbfed48aaaac38493038900d5', 'request_id': 'req-f81894e0-1392-41a1-8290-b8f2b9d79e9b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:13.717648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe0e5fcbfed48aaaac38493038900d5', 'request_id': 'req-f81894e0-1392-41a1-8290-b8f2b9d79e9b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:13.731799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe0e5fcbfed48aaaac38493038900d5', 'request_id': 'req-f81894e0-1392-41a1-8290-b8f2b9d79e9b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:13.747940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] The token cache is being invalidate because project fbe0e5fcbfed48aaaac38493038900d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:13.748284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:13.749016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f81894e0-1392-41a1-8290-b8f2b9d79e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:13.752867 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1898/3813] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:13 2022] DELETE /identity/v3/projects/fbe0e5fcbfed48aaaac38493038900d5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:13.762707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004621c9-a7cc-4db2-a37e-fd6b5d404805 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:13.763261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004621c9-a7cc-4db2-a37e-fd6b5d404805 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:13.763777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004621c9-a7cc-4db2-a37e-fd6b5d404805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:13.789518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-004621c9-a7cc-4db2-a37e-fd6b5d404805 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:13.790977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-004621c9-a7cc-4db2-a37e-fd6b5d404805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:13.837790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:13.937954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95070b-80c5-4567-9875-b1988e1cb041 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:13.938232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95070b-80c5-4567-9875-b1988e1cb041 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:13.938682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95070b-80c5-4567-9875-b1988e1cb041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:13.945368 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1916/3814] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:13.966859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2a95070b-80c5-4567-9875-b1988e1cb041 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:13.968415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2a95070b-80c5-4567-9875-b1988e1cb041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:13.992364 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1899/3815] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:13.997129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004621c9-a7cc-4db2-a37e-fd6b5d404805 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:14.008396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004621c9-a7cc-4db2-a37e-fd6b5d404805 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:14.014688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50412d4b-f4f6-4341-b9ee-5d064b5c3b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:14.016195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50412d4b-f4f6-4341-b9ee-5d064b5c3b03 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:14.016650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50412d4b-f4f6-4341-b9ee-5d064b5c3b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:14.017079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50412d4b-f4f6-4341-b9ee-5d064b5c3b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:14.018401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50412d4b-f4f6-4341-b9ee-5d064b5c3b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:14.018933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50412d4b-f4f6-4341-b9ee-5d064b5c3b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:14.020907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50412d4b-f4f6-4341-b9ee-5d064b5c3b03 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:14.038318 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1917/3816] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:14.039149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95070b-80c5-4567-9875-b1988e1cb041 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:14.053149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95070b-80c5-4567-9875-b1988e1cb041 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:14.060119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd966-c3a1-4687-8f11-f7a07ffeaa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:14.062523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd966-c3a1-4687-8f11-f7a07ffeaa45 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:14.065406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd966-c3a1-4687-8f11-f7a07ffeaa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:14.065981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd966-c3a1-4687-8f11-f7a07ffeaa45 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:14.067540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cd966-c3a1-4687-8f11-f7a07ffeaa45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:14.070953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cd966-c3a1-4687-8f11-f7a07ffeaa45 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:14.079249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:14.123374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50412d4b-f4f6-4341-b9ee-5d064b5c3b03 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:14.133240 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1900/3817] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:14 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:14.142033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50412d4b-f4f6-4341-b9ee-5d064b5c3b03 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:14.231712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499768e9-6d31-4d72-b6a3-6551ff832ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:14.232453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499768e9-6d31-4d72-b6a3-6551ff832ade admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:14.232997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499768e9-6d31-4d72-b6a3-6551ff832ade admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:14.233377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499768e9-6d31-4d72-b6a3-6551ff832ade admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:14.234181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499768e9-6d31-4d72-b6a3-6551ff832ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:14.236213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499768e9-6d31-4d72-b6a3-6551ff832ade admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:14.261415 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1918/3818] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:14 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:14.266697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd966-c3a1-4687-8f11-f7a07ffeaa45 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:14.281152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd966-c3a1-4687-8f11-f7a07ffeaa45 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:14.306506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde8f7-2229-42fe-a1a9-30b82b24579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:14.307122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde8f7-2229-42fe-a1a9-30b82b24579f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:14.307422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde8f7-2229-42fe-a1a9-30b82b24579f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:14.307684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde8f7-2229-42fe-a1a9-30b82b24579f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:14.308392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcde8f7-2229-42fe-a1a9-30b82b24579f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:14.310015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcde8f7-2229-42fe-a1a9-30b82b24579f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:14.353731 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1901/3819] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:14.355473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499768e9-6d31-4d72-b6a3-6551ff832ade admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:14.369801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499768e9-6d31-4d72-b6a3-6551ff832ade admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:14.388855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585fd9e-bb48-4547-ba30-a4479637a445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:14.389668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585fd9e-bb48-4547-ba30-a4479637a445 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:14.390249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585fd9e-bb48-4547-ba30-a4479637a445 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:14.391128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585fd9e-bb48-4547-ba30-a4479637a445 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:14.391875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585fd9e-bb48-4547-ba30-a4479637a445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:14.393616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585fd9e-bb48-4547-ba30-a4479637a445 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:14.420491 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1919/3820] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:14.424771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde8f7-2229-42fe-a1a9-30b82b24579f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:14.439154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde8f7-2229-42fe-a1a9-30b82b24579f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:14.457602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b776a72-a77a-4b88-a015-24a9dddcf1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:14.458296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776a72-a77a-4b88-a015-24a9dddcf1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:14.458579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776a72-a77a-4b88-a015-24a9dddcf1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:14.458858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776a72-a77a-4b88-a015-24a9dddcf1ee admin admin] PATH_INFO: `/v3/projects/efc0c22b589644a88c694eaaaa5c256f/users/d4ebe9324ede4da88ed10750ab2b59ac/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:14.495930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b776a72-a77a-4b88-a015-24a9dddcf1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc0c22b589644a88c694eaaaa5c256f, user_id=d4ebe9324ede4da88ed10750ab2b59ac, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:14.501287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b776a72-a77a-4b88-a015-24a9dddcf1ee admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:14.541491 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1902/3821] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:14 2022] PUT /identity/v3/projects/efc0c22b589644a88c694eaaaa5c256f/users/d4ebe9324ede4da88ed10750ab2b59ac/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:14.632014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e928-7ceb-4bbc-9309-846b6b005a73 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:14.632921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e928-7ceb-4bbc-9309-846b6b005a73 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:14.633461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e928-7ceb-4bbc-9309-846b6b005a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:14.685743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-01d9e928-7ceb-4bbc-9309-846b6b005a73 None None] MFA Rules not processed for user `d4ebe9324ede4da88ed10750ab2b59ac`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:14.688455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-01d9e928-7ceb-4bbc-9309-846b6b005a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:14.786061 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1920/3822] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:14.787691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b776a72-a77a-4b88-a015-24a9dddcf1ee admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:14.897509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b776a72-a77a-4b88-a015-24a9dddcf1ee admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:14.908706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600334af-be24-4a16-a9f9-fb31fc3f8fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:14.909349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600334af-be24-4a16-a9f9-fb31fc3f8fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:14.913853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600334af-be24-4a16-a9f9-fb31fc3f8fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:14.913853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600334af-be24-4a16-a9f9-fb31fc3f8fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:14.913853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600334af-be24-4a16-a9f9-fb31fc3f8fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:14.919607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600334af-be24-4a16-a9f9-fb31fc3f8fc9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:14.989436 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1903/3823] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:14 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:14.993122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9e928-7ceb-4bbc-9309-846b6b005a73 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:15.008382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9e928-7ceb-4bbc-9309-846b6b005a73 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:15.033340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:15.098370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae344d7-da08-420b-bfac-7ad15322d8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:15.099576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae344d7-da08-420b-bfac-7ad15322d8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:15.100029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae344d7-da08-420b-bfac-7ad15322d8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:15.100512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae344d7-da08-420b-bfac-7ad15322d8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:15.101420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae344d7-da08-420b-bfac-7ad15322d8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:15.103929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae344d7-da08-420b-bfac-7ad15322d8f9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:15.145766 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1921/3824] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:14 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:15.150171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600334af-be24-4a16-a9f9-fb31fc3f8fc9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:15.162991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600334af-be24-4a16-a9f9-fb31fc3f8fc9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:15.169755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecc9c8-f051-4fa5-a89b-8aea8c7784f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:15.170379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecc9c8-f051-4fa5-a89b-8aea8c7784f0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:15.170661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecc9c8-f051-4fa5-a89b-8aea8c7784f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:15.170936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecc9c8-f051-4fa5-a89b-8aea8c7784f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:15.171628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecc9c8-f051-4fa5-a89b-8aea8c7784f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:15.173239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecc9c8-f051-4fa5-a89b-8aea8c7784f0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:15.188336 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1904/3825] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:15.195805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae344d7-da08-420b-bfac-7ad15322d8f9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:15.207532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae344d7-da08-420b-bfac-7ad15322d8f9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:15.212657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e34004-2a0c-4e51-8fe0-6fbd4351a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:15.213437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e34004-2a0c-4e51-8fe0-6fbd4351a8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:15.214015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e34004-2a0c-4e51-8fe0-6fbd4351a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:15.214404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e34004-2a0c-4e51-8fe0-6fbd4351a8ae admin admin] PATH_INFO: `/v3/projects/d7fef34b7a6644f78ba9e6549efe2ba0/users/8c11ddf016eb43e391bd7259b5fa4d4d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:15.273810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e34004-2a0c-4e51-8fe0-6fbd4351a8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fef34b7a6644f78ba9e6549efe2ba0, user_id=8c11ddf016eb43e391bd7259b5fa4d4d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:15.277538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e34004-2a0c-4e51-8fe0-6fbd4351a8ae admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:15.297163 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1922/3826] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:15 2022] PUT /identity/v3/projects/d7fef34b7a6644f78ba9e6549efe2ba0/users/8c11ddf016eb43e391bd7259b5fa4d4d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:15.301307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecc9c8-f051-4fa5-a89b-8aea8c7784f0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:15.321986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecc9c8-f051-4fa5-a89b-8aea8c7784f0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:15.469208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f6262-3fce-4ed1-adcd-831e9fadbcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:15.470468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6262-3fce-4ed1-adcd-831e9fadbcde admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:15.471125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6262-3fce-4ed1-adcd-831e9fadbcde admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:15.471562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6262-3fce-4ed1-adcd-831e9fadbcde admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:15.472392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f6262-3fce-4ed1-adcd-831e9fadbcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:15.481084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f6262-3fce-4ed1-adcd-831e9fadbcde admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:15.507423 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1905/3827] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:15.511314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e34004-2a0c-4e51-8fe0-6fbd4351a8ae admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:15.526729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e34004-2a0c-4e51-8fe0-6fbd4351a8ae admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:15.534808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368c75e-18f0-4fd5-95cc-a1d3e6ac8b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:15.535494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c75e-18f0-4fd5-95cc-a1d3e6ac8b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:15.535775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c75e-18f0-4fd5-95cc-a1d3e6ac8b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:15.536053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c75e-18f0-4fd5-95cc-a1d3e6ac8b9f admin admin] PATH_INFO: `/v3/projects/d7fef34b7a6644f78ba9e6549efe2ba0/users/8c11ddf016eb43e391bd7259b5fa4d4d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:15.538540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368c75e-18f0-4fd5-95cc-a1d3e6ac8b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fef34b7a6644f78ba9e6549efe2ba0, user_id=8c11ddf016eb43e391bd7259b5fa4d4d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:15.543578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368c75e-18f0-4fd5-95cc-a1d3e6ac8b9f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:15.557086 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1923/3828] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:15 2022] PUT /identity/v3/projects/d7fef34b7a6644f78ba9e6549efe2ba0/users/8c11ddf016eb43e391bd7259b5fa4d4d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:15.567288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bfdec-e1dc-4355-8ab8-769c859b313d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:15.568195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bfdec-e1dc-4355-8ab8-769c859b313d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:15.568715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bfdec-e1dc-4355-8ab8-769c859b313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:15.626202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6b7bfdec-e1dc-4355-8ab8-769c859b313d None None] MFA Rules not processed for user `8c11ddf016eb43e391bd7259b5fa4d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:15.627434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6b7bfdec-e1dc-4355-8ab8-769c859b313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:15.650053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:15.820615 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1906/3829] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:15.826244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368c75e-18f0-4fd5-95cc-a1d3e6ac8b9f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:15.841697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368c75e-18f0-4fd5-95cc-a1d3e6ac8b9f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:15.853639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de2ba-a7f9-45b1-8e9a-8f3db4c1e587 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:15.854874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de2ba-a7f9-45b1-8e9a-8f3db4c1e587 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:15.855785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de2ba-a7f9-45b1-8e9a-8f3db4c1e587 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:15.857841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de2ba-a7f9-45b1-8e9a-8f3db4c1e587 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:15.859516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de2ba-a7f9-45b1-8e9a-8f3db4c1e587 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:15.862289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de2ba-a7f9-45b1-8e9a-8f3db4c1e587 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:15.865625 n-d-854882-3 devstack@keystone.service[89681]: WARNING keystone.server.flask.common [None req-0c4de2ba-a7f9-45b1-8e9a-8f3db4c1e587 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 15:42:15.952136 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1924/3830] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:42:15 2022] POST /identity/v3/projects => generated 348 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:15.957135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bfdec-e1dc-4355-8ab8-769c859b313d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:15.988219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bfdec-e1dc-4355-8ab8-769c859b313d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:16.159736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4064b-63e3-4e56-b381-9e53df0f35d5 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:16.160274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4064b-63e3-4e56-b381-9e53df0f35d5 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:16.160563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4064b-63e3-4e56-b381-9e53df0f35d5 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:16.160846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4064b-63e3-4e56-b381-9e53df0f35d5 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:16.161783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4064b-63e3-4e56-b381-9e53df0f35d5 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.165882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4064b-63e3-4e56-b381-9e53df0f35d5 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.247992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de2ba-a7f9-45b1-8e9a-8f3db4c1e587 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:16.248703 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1907/3831] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:15 2022] POST /identity/v3/projects => generated 351 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:16.269594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de2ba-a7f9-45b1-8e9a-8f3db4c1e587 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:16.414270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4f983-48cd-413e-b05a-0fe838cdbce4 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:16.415203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4f983-48cd-413e-b05a-0fe838cdbce4 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:16.415683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4f983-48cd-413e-b05a-0fe838cdbce4 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:16.416144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4f983-48cd-413e-b05a-0fe838cdbce4 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/users/d4ebe9324ede4da88ed10750ab2b59ac` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:16.418964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4f983-48cd-413e-b05a-0fe838cdbce4 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:get_user(user_id=d4ebe9324ede4da88ed10750ab2b59ac)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.425184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4f983-48cd-413e-b05a-0fe838cdbce4 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.434340 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1925/3832] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:42:16 2022] GET /identity/v3/users/d4ebe9324ede4da88ed10750ab2b59ac => generated 288 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:16.436468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4064b-63e3-4e56-b381-9e53df0f35d5 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:16.450623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4064b-63e3-4e56-b381-9e53df0f35d5 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:16.457125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d55cb-a14a-49a0-8c65-5599a46e9602 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:16.458375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d55cb-a14a-49a0-8c65-5599a46e9602 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:16.458832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d55cb-a14a-49a0-8c65-5599a46e9602 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:16.459545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d55cb-a14a-49a0-8c65-5599a46e9602 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:16.460402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d55cb-a14a-49a0-8c65-5599a46e9602 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.462857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d55cb-a14a-49a0-8c65-5599a46e9602 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.525333 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1908/3833] 10.222.0.16 () {60 vars in 1162 bytes} [Mon Aug 29 15:42:16 2022] POST /identity/v3/credentials => generated 430 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:16.525624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4f983-48cd-413e-b05a-0fe838cdbce4 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:16.566696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4f983-48cd-413e-b05a-0fe838cdbce4 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:16.580622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d68247-c528-40c5-bc01-39ce29519e0b tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:16.581702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d68247-c528-40c5-bc01-39ce29519e0b tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:16.582212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d68247-c528-40c5-bc01-39ce29519e0b tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:16.582659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d68247-c528-40c5-bc01-39ce29519e0b tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/credentials/cdeed151d1427785a5849c352fb7cef49226cfb14b87e844105156b353b614bd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:16.589184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d68247-c528-40c5-bc01-39ce29519e0b tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=cdeed151d1427785a5849c352fb7cef49226cfb14b87e844105156b353b614bd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.591332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d68247-c528-40c5-bc01-39ce29519e0b tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.602640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d68247-c528-40c5-bc01-39ce29519e0b tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=cdeed151d1427785a5849c352fb7cef49226cfb14b87e844105156b353b614bd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.606198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d68247-c528-40c5-bc01-39ce29519e0b tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.636161 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1926/3834] 10.222.0.16 () {60 vars in 1358 bytes} [Mon Aug 29 15:42:16 2022] PATCH /identity/v3/credentials/cdeed151d1427785a5849c352fb7cef49226cfb14b87e844105156b353b614bd => generated 437 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:16.636311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d55cb-a14a-49a0-8c65-5599a46e9602 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:16.650292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d55cb-a14a-49a0-8c65-5599a46e9602 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:16.659407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811801c3-9c6a-46fd-8e00-addd2e1668d0 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:16.661951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811801c3-9c6a-46fd-8e00-addd2e1668d0 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:16.662312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811801c3-9c6a-46fd-8e00-addd2e1668d0 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:16.663996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811801c3-9c6a-46fd-8e00-addd2e1668d0 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/credentials/cdeed151d1427785a5849c352fb7cef49226cfb14b87e844105156b353b614bd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:16.670402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811801c3-9c6a-46fd-8e00-addd2e1668d0 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=cdeed151d1427785a5849c352fb7cef49226cfb14b87e844105156b353b614bd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.672363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811801c3-9c6a-46fd-8e00-addd2e1668d0 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.676431 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1909/3835] 10.222.0.16 () {58 vars in 1335 bytes} [Mon Aug 29 15:42:16 2022] GET /identity/v3/credentials/cdeed151d1427785a5849c352fb7cef49226cfb14b87e844105156b353b614bd => generated 437 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:42:16.681023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d68247-c528-40c5-bc01-39ce29519e0b tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:16.695199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d68247-c528-40c5-bc01-39ce29519e0b tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:16.707892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb029bb9-ec3e-4c91-a827-7bf298aa5381 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:16.708545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb029bb9-ec3e-4c91-a827-7bf298aa5381 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:16.709444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb029bb9-ec3e-4c91-a827-7bf298aa5381 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:16.709444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb029bb9-ec3e-4c91-a827-7bf298aa5381 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/credentials/cdeed151d1427785a5849c352fb7cef49226cfb14b87e844105156b353b614bd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:16.712978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb029bb9-ec3e-4c91-a827-7bf298aa5381 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=cdeed151d1427785a5849c352fb7cef49226cfb14b87e844105156b353b614bd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.715007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb029bb9-ec3e-4c91-a827-7bf298aa5381 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.758892 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1927/3836] 10.222.0.16 () {58 vars in 1338 bytes} [Mon Aug 29 15:42:16 2022] DELETE /identity/v3/credentials/cdeed151d1427785a5849c352fb7cef49226cfb14b87e844105156b353b614bd => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:16.764175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811801c3-9c6a-46fd-8e00-addd2e1668d0 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:16.776954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811801c3-9c6a-46fd-8e00-addd2e1668d0 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:16.783126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33ffd1-1c62-473f-a846-62b0edba0b1f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:16.783792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33ffd1-1c62-473f-a846-62b0edba0b1f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:16.784123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33ffd1-1c62-473f-a846-62b0edba0b1f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:16.784450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33ffd1-1c62-473f-a846-62b0edba0b1f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:16.785148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33ffd1-1c62-473f-a846-62b0edba0b1f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.797506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33ffd1-1c62-473f-a846-62b0edba0b1f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.831474 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1910/3837] 10.222.0.16 () {60 vars in 1162 bytes} [Mon Aug 29 15:42:16 2022] POST /identity/v3/credentials => generated 431 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:16.835228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb029bb9-ec3e-4c91-a827-7bf298aa5381 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:16.847617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb029bb9-ec3e-4c91-a827-7bf298aa5381 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:16.853701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26371555-8c73-41f8-951f-17f84a46e082 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:16.855331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371555-8c73-41f8-951f-17f84a46e082 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:16.855830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371555-8c73-41f8-951f-17f84a46e082 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:16.856363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371555-8c73-41f8-951f-17f84a46e082 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/credentials` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:16.857261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26371555-8c73-41f8-951f-17f84a46e082 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.859607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26371555-8c73-41f8-951f-17f84a46e082 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.885467 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1928/3838] 10.222.0.16 () {60 vars in 1162 bytes} [Mon Aug 29 15:42:16 2022] POST /identity/v3/credentials => generated 430 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:16.887185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33ffd1-1c62-473f-a846-62b0edba0b1f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:16.899074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33ffd1-1c62-473f-a846-62b0edba0b1f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:16.908512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:16.909629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:16.910621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:16.911131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:16.912032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.914743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.931043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.934941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.942081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.944623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:16.947783 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1911/3839] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Aug 29 15:42:16 2022] GET /identity/v3/credentials => generated 946 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:16.952301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26371555-8c73-41f8-951f-17f84a46e082 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:16.977104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26371555-8c73-41f8-951f-17f84a46e082 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:16.983762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c11fa-2881-4b14-8bc8-0260cdd5ff54 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:16.985436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c11fa-2881-4b14-8bc8-0260cdd5ff54 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:16.985987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c11fa-2881-4b14-8bc8-0260cdd5ff54 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:16.986483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c11fa-2881-4b14-8bc8-0260cdd5ff54 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/credentials/e3cfb00c9835092d56209a11a8694c12100736b7abb2bf761fbe261dee6c9aaa` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:16.989291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c11fa-2881-4b14-8bc8-0260cdd5ff54 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=e3cfb00c9835092d56209a11a8694c12100736b7abb2bf761fbe261dee6c9aaa)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:16.992101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c11fa-2881-4b14-8bc8-0260cdd5ff54 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:17.007039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:17.020958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:17.021766 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1929/3840] 10.222.0.16 () {58 vars in 1338 bytes} [Mon Aug 29 15:42:16 2022] DELETE /identity/v3/credentials/e3cfb00c9835092d56209a11a8694c12100736b7abb2bf761fbe261dee6c9aaa => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:17.039477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8679b-7320-44e2-a637-f4e2a4f59ef2 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:17.045499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4bed7-0d52-43b6-8c2c-f3219469e139 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:17.047521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bed7-0d52-43b6-8c2c-f3219469e139 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:17.048133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bed7-0d52-43b6-8c2c-f3219469e139 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:17.048693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bed7-0d52-43b6-8c2c-f3219469e139 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/credentials/c36aef59cb82e4591082bd734a15af68309d8d8835b1ed603a08063e117f357b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:17.052004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4bed7-0d52-43b6-8c2c-f3219469e139 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=c36aef59cb82e4591082bd734a15af68309d8d8835b1ed603a08063e117f357b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:17.054741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4bed7-0d52-43b6-8c2c-f3219469e139 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:17.086234 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1912/3841] 10.222.0.16 () {58 vars in 1338 bytes} [Mon Aug 29 15:42:17 2022] DELETE /identity/v3/credentials/c36aef59cb82e4591082bd734a15af68309d8d8835b1ed603a08063e117f357b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:17.091658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c11fa-2881-4b14-8bc8-0260cdd5ff54 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:17.105710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c11fa-2881-4b14-8bc8-0260cdd5ff54 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:17.111374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:17.112020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:17.112429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:17.112698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/projects/0af0e338195c4c6e84278f35b89c7d7b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:17.113889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0af0e338195c4c6e84278f35b89c7d7b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:17.115894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:17.197501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af0e338195c4c6e84278f35b89c7d7b', 'request_id': 'req-2ba76952-2c99-4e3e-a220-8207502ca29f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:17.206599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af0e338195c4c6e84278f35b89c7d7b', 'request_id': 'req-2ba76952-2c99-4e3e-a220-8207502ca29f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:17.216132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af0e338195c4c6e84278f35b89c7d7b', 'request_id': 'req-2ba76952-2c99-4e3e-a220-8207502ca29f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:17.228403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] The token cache is being invalidate because project 0af0e338195c4c6e84278f35b89c7d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:17.228835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:17.229731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:17.231663 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1930/3842] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:17 2022] DELETE /identity/v3/projects/0af0e338195c4c6e84278f35b89c7d7b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:17.235416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4bed7-0d52-43b6-8c2c-f3219469e139 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:17.237299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7fe4bed7-0d52-43b6-8c2c-f3219469e139 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:17.250827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4bed7-0d52-43b6-8c2c-f3219469e139 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:17.297216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:17.326275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c11ddf016eb43e391bd7259b5fa4d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:17.327165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:17.327396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:17.328292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] PATH_INFO: `/v3/projects/d629896bd2694d63a8ea403abe38219a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:17.329626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d629896bd2694d63a8ea403abe38219a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:17.331696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:17.425684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd629896bd2694d63a8ea403abe38219a', 'request_id': 'req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:17.447392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd629896bd2694d63a8ea403abe38219a', 'request_id': 'req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:17.462737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd629896bd2694d63a8ea403abe38219a', 'request_id': 'req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:17.492197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] The token cache is being invalidate because project d629896bd2694d63a8ea403abe38219a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:17.492501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:17.494350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6abfd43e-6ec2-454d-b7ee-6ebd4728b766 tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:17.498226 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1913/3843] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:17 2022] DELETE /identity/v3/projects/d629896bd2694d63a8ea403abe38219a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:17.500935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:17.503202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:17.756972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba76952-2c99-4e3e-a220-8207502ca29f tempest-CredentialsTestJSON-590916271 tempest-CredentialsTestJSON-590916271-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:17.908567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:17.909542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:17.909927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:17.910387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] PATH_INFO: `/v3/users/d4ebe9324ede4da88ed10750ab2b59ac` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:17.912036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ebe9324ede4da88ed10750ab2b59ac)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:17.914225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:17.970046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:17.998870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ebe9324ede4da88ed10750ab2b59ac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:18.000194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ebe9324ede4da88ed10750ab2b59ac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:18.029292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ebe9324ede4da88ed10750ab2b59ac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:18.031771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ebe9324ede4da88ed10750ab2b59ac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:18.074871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ebe9324ede4da88ed10750ab2b59ac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:18.106252 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1931/3844] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:17 2022] DELETE /identity/v3/users/d4ebe9324ede4da88ed10750ab2b59ac => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:18.110501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb99750-3a9d-403f-9f51-325403bbe51c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:18.111033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb99750-3a9d-403f-9f51-325403bbe51c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:18.111297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb99750-3a9d-403f-9f51-325403bbe51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:18.137911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ceb99750-3a9d-403f-9f51-325403bbe51c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:18.140059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ceb99750-3a9d-403f-9f51-325403bbe51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:18.295923 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1914/3845] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:18.346768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:18.349017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:18.478187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16c341-1663-4116-b7aa-f287e75d9306 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:18.495292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518ce69-cb5a-488b-a5e2-e7118ca7e9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:18.497009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518ce69-cb5a-488b-a5e2-e7118ca7e9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:18.497422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518ce69-cb5a-488b-a5e2-e7118ca7e9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:18.497583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518ce69-cb5a-488b-a5e2-e7118ca7e9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:18.522337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518ce69-cb5a-488b-a5e2-e7118ca7e9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:18.523819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518ce69-cb5a-488b-a5e2-e7118ca7e9c5 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:18.548743 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1932/3846] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:20.529620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb99750-3a9d-403f-9f51-325403bbe51c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:20.531912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ceb99750-3a9d-403f-9f51-325403bbe51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:20.556080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb99750-3a9d-403f-9f51-325403bbe51c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:20.573139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:20.579086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:20.579621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:20.581927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] PATH_INFO: `/v3/projects/efc0c22b589644a88c694eaaaa5c256f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:20.587463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc0c22b589644a88c694eaaaa5c256f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:20.591356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:20.750616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc0c22b589644a88c694eaaaa5c256f', 'request_id': 'req-ff29fa81-e2cf-4536-9660-d201a6ceefc5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:20.763278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc0c22b589644a88c694eaaaa5c256f', 'request_id': 'req-ff29fa81-e2cf-4536-9660-d201a6ceefc5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:20.769444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:20.784169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc0c22b589644a88c694eaaaa5c256f', 'request_id': 'req-ff29fa81-e2cf-4536-9660-d201a6ceefc5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:20.812849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] The token cache is being invalidate because project efc0c22b589644a88c694eaaaa5c256f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:20.813129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:20.815294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:20.817684 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1915/3847] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:20 2022] DELETE /identity/v3/projects/efc0c22b589644a88c694eaaaa5c256f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:20.821488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518ce69-cb5a-488b-a5e2-e7118ca7e9c5 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:20.833259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518ce69-cb5a-488b-a5e2-e7118ca7e9c5 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:20.954137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c59b90-ed4d-488d-9a83-b309da6b3552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:20.954785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c59b90-ed4d-488d-9a83-b309da6b3552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:20.955066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c59b90-ed4d-488d-9a83-b309da6b3552 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:20.955347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c59b90-ed4d-488d-9a83-b309da6b3552 admin admin] PATH_INFO: `/v3/users/8c11ddf016eb43e391bd7259b5fa4d4d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:20.956799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c59b90-ed4d-488d-9a83-b309da6b3552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c11ddf016eb43e391bd7259b5fa4d4d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:20.958766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c59b90-ed4d-488d-9a83-b309da6b3552 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:21.099473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3c59b90-ed4d-488d-9a83-b309da6b3552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c11ddf016eb43e391bd7259b5fa4d4d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:21.100197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3c59b90-ed4d-488d-9a83-b309da6b3552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c11ddf016eb43e391bd7259b5fa4d4d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:21.120717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:21.140890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3c59b90-ed4d-488d-9a83-b309da6b3552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c11ddf016eb43e391bd7259b5fa4d4d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:21.141704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3c59b90-ed4d-488d-9a83-b309da6b3552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c11ddf016eb43e391bd7259b5fa4d4d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:21.159815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b3c59b90-ed4d-488d-9a83-b309da6b3552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c11ddf016eb43e391bd7259b5fa4d4d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:21.188519 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1933/3848] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:20 2022] DELETE /identity/v3/users/8c11ddf016eb43e391bd7259b5fa4d4d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:23.165898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:23.167964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:23.199586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29fa81-e2cf-4536-9660-d201a6ceefc5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:23.293618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:23.294274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:23.294704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:23.294985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] PATH_INFO: `/v3/projects/d7fef34b7a6644f78ba9e6549efe2ba0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:23.296332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7fef34b7a6644f78ba9e6549efe2ba0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:23.298661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:23.368564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'request_id': 'req-290e284e-7690-45de-9e35-3dbf57615461'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:23.377231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'request_id': 'req-290e284e-7690-45de-9e35-3dbf57615461'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:23.389291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7fef34b7a6644f78ba9e6549efe2ba0', 'request_id': 'req-290e284e-7690-45de-9e35-3dbf57615461'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:23.446956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] The token cache is being invalidate because project d7fef34b7a6644f78ba9e6549efe2ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:23.447250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:23.451863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-290e284e-7690-45de-9e35-3dbf57615461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:23.455928 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1916/3849] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:23 2022] DELETE /identity/v3/projects/d7fef34b7a6644f78ba9e6549efe2ba0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:23.461268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaae6e6-59f6-469d-8a29-b976542f725a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:23.461827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaae6e6-59f6-469d-8a29-b976542f725a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:23.461827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaae6e6-59f6-469d-8a29-b976542f725a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:23.510487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fcaae6e6-59f6-469d-8a29-b976542f725a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:23.512893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fcaae6e6-59f6-469d-8a29-b976542f725a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:23.680678 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1934/3850] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:23.689060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19844a0-8de1-4319-8b3d-3b9460d7c4bd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:23.689323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19844a0-8de1-4319-8b3d-3b9460d7c4bd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:23.689558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19844a0-8de1-4319-8b3d-3b9460d7c4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:23.719963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b19844a0-8de1-4319-8b3d-3b9460d7c4bd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:23.719963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b19844a0-8de1-4319-8b3d-3b9460d7c4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:23.733100 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1917/3851] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:23.734157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaae6e6-59f6-469d-8a29-b976542f725a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:23.750893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaae6e6-59f6-469d-8a29-b976542f725a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:23.772338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17ac6d-3d7e-4fcc-aa67-f0df2c21c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:23.773893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17ac6d-3d7e-4fcc-aa67-f0df2c21c266 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:23.774288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17ac6d-3d7e-4fcc-aa67-f0df2c21c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:23.774667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17ac6d-3d7e-4fcc-aa67-f0df2c21c266 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:23.775464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17ac6d-3d7e-4fcc-aa67-f0df2c21c266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:23.775878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17ac6d-3d7e-4fcc-aa67-f0df2c21c266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:23.778350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17ac6d-3d7e-4fcc-aa67-f0df2c21c266 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:23.808851 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1935/3852] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:23.810196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19844a0-8de1-4319-8b3d-3b9460d7c4bd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:23.829952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19844a0-8de1-4319-8b3d-3b9460d7c4bd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:23.849981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4beddb-c4f2-4555-8260-7c7702a5b43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:23.850990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4beddb-c4f2-4555-8260-7c7702a5b43c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:23.851566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4beddb-c4f2-4555-8260-7c7702a5b43c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:23.852014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4beddb-c4f2-4555-8260-7c7702a5b43c admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:23.854319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4beddb-c4f2-4555-8260-7c7702a5b43c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:23.864072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4beddb-c4f2-4555-8260-7c7702a5b43c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:23.935883 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1918/3853] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:23 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:23.936058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17ac6d-3d7e-4fcc-aa67-f0df2c21c266 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:23.953876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17ac6d-3d7e-4fcc-aa67-f0df2c21c266 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:24.144177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f1e28-03f8-4e1f-9d88-5b946d2a9089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:24.145137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f1e28-03f8-4e1f-9d88-5b946d2a9089 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:24.145616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f1e28-03f8-4e1f-9d88-5b946d2a9089 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:24.146046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f1e28-03f8-4e1f-9d88-5b946d2a9089 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:24.146890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f1e28-03f8-4e1f-9d88-5b946d2a9089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:24.157756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f1e28-03f8-4e1f-9d88-5b946d2a9089 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:24.206781 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1936/3854] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:23 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:24.211322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4beddb-c4f2-4555-8260-7c7702a5b43c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:24.231685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4beddb-c4f2-4555-8260-7c7702a5b43c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:24.244558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49a9d9-f8d3-4cc5-9781-ca4b33079ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:24.245185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49a9d9-f8d3-4cc5-9781-ca4b33079ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:24.245709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49a9d9-f8d3-4cc5-9781-ca4b33079ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:24.246171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49a9d9-f8d3-4cc5-9781-ca4b33079ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:24.246986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49a9d9-f8d3-4cc5-9781-ca4b33079ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:24.248867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49a9d9-f8d3-4cc5-9781-ca4b33079ad0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:24.278742 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1919/3855] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:24.283524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f1e28-03f8-4e1f-9d88-5b946d2a9089 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:24.298953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f1e28-03f8-4e1f-9d88-5b946d2a9089 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:24.310740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978e20d-0c73-4ab6-8781-764de2be59de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:24.311385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978e20d-0c73-4ab6-8781-764de2be59de admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:24.311673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978e20d-0c73-4ab6-8781-764de2be59de admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:24.311985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978e20d-0c73-4ab6-8781-764de2be59de admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:24.312723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978e20d-0c73-4ab6-8781-764de2be59de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:24.314411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978e20d-0c73-4ab6-8781-764de2be59de admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:24.344943 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1937/3856] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:24.352125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49a9d9-f8d3-4cc5-9781-ca4b33079ad0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:24.369664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49a9d9-f8d3-4cc5-9781-ca4b33079ad0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:24.382259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48f973-462e-4855-9f53-b252668545c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:24.384351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f973-462e-4855-9f53-b252668545c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:24.384673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f973-462e-4855-9f53-b252668545c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:24.384961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f973-462e-4855-9f53-b252668545c7 admin admin] PATH_INFO: `/v3/projects/0c228401dc284d84a7c631a46f6daa8c/users/83865ca01c894b7e928bdc1cfe0524c0/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:24.421489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48f973-462e-4855-9f53-b252668545c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c228401dc284d84a7c631a46f6daa8c, user_id=83865ca01c894b7e928bdc1cfe0524c0, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:24.429497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48f973-462e-4855-9f53-b252668545c7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:24.466968 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1920/3857] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:24 2022] PUT /identity/v3/projects/0c228401dc284d84a7c631a46f6daa8c/users/83865ca01c894b7e928bdc1cfe0524c0/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:24.471843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553933c-5499-473c-bcfa-9a41780419a9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:24.473850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553933c-5499-473c-bcfa-9a41780419a9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:24.474305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553933c-5499-473c-bcfa-9a41780419a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:24.525753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b553933c-5499-473c-bcfa-9a41780419a9 None None] MFA Rules not processed for user `83865ca01c894b7e928bdc1cfe0524c0`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:24.527040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b553933c-5499-473c-bcfa-9a41780419a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:24.587161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:24.671841 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1938/3858] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:24.676230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48f973-462e-4855-9f53-b252668545c7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:24.713808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:24.789592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48f973-462e-4855-9f53-b252668545c7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:24.797231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26237e6d-2cf2-475e-8dca-b33eed1d5234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:24.798225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237e6d-2cf2-475e-8dca-b33eed1d5234 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:24.798582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237e6d-2cf2-475e-8dca-b33eed1d5234 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:24.798926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237e6d-2cf2-475e-8dca-b33eed1d5234 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:24.799644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26237e6d-2cf2-475e-8dca-b33eed1d5234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:24.801996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26237e6d-2cf2-475e-8dca-b33eed1d5234 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:24.851090 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1921/3859] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:24 2022] POST /identity/v3/projects => generated 389 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:24.853235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553933c-5499-473c-bcfa-9a41780419a9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:24.875751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553933c-5499-473c-bcfa-9a41780419a9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:25.055986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be82be-7ddb-4f21-8a7a-09d9273a56b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:25.056571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be82be-7ddb-4f21-8a7a-09d9273a56b6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:25.056848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be82be-7ddb-4f21-8a7a-09d9273a56b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:25.057120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be82be-7ddb-4f21-8a7a-09d9273a56b6 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:25.057859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be82be-7ddb-4f21-8a7a-09d9273a56b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:25.060231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be82be-7ddb-4f21-8a7a-09d9273a56b6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:25.118328 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1939/3860] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:24 2022] POST /identity/v3/users => generated 301 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:25.119300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26237e6d-2cf2-475e-8dca-b33eed1d5234 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:25.137010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26237e6d-2cf2-475e-8dca-b33eed1d5234 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:25.161500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1c0b-16f6-459a-81b8-42744f7b99e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:25.162200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1c0b-16f6-459a-81b8-42744f7b99e0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:25.162584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1c0b-16f6-459a-81b8-42744f7b99e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:25.162936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1c0b-16f6-459a-81b8-42744f7b99e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:25.163728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1c0b-16f6-459a-81b8-42744f7b99e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:25.169803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1c0b-16f6-459a-81b8-42744f7b99e0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:25.209688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be82be-7ddb-4f21-8a7a-09d9273a56b6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:25.217457 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1922/3861] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:42:25.228213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be82be-7ddb-4f21-8a7a-09d9273a56b6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:25.242290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7677ed8-6926-455c-bf5f-f68ef5541bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:25.243458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7677ed8-6926-455c-bf5f-f68ef5541bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:25.244019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7677ed8-6926-455c-bf5f-f68ef5541bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:25.244494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7677ed8-6926-455c-bf5f-f68ef5541bf8 admin admin] PATH_INFO: `/v3/projects/5e2681ef82344b359f2f58dea65683c4/users/a3d231f7ff2f49d5b3a3e80639a29ee2/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:25.287317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7677ed8-6926-455c-bf5f-f68ef5541bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2681ef82344b359f2f58dea65683c4, user_id=a3d231f7ff2f49d5b3a3e80639a29ee2, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:25.301413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7677ed8-6926-455c-bf5f-f68ef5541bf8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:25.358416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1c0b-16f6-459a-81b8-42744f7b99e0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:25.359344 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1940/3862] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:25 2022] PUT /identity/v3/projects/5e2681ef82344b359f2f58dea65683c4/users/a3d231f7ff2f49d5b3a3e80639a29ee2/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:25.373248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1c0b-16f6-459a-81b8-42744f7b99e0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:25.470703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73007e-4f46-419b-99af-08bbaa019e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:25.472354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73007e-4f46-419b-99af-08bbaa019e46 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:25.472891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73007e-4f46-419b-99af-08bbaa019e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:25.473554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73007e-4f46-419b-99af-08bbaa019e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:25.474606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73007e-4f46-419b-99af-08bbaa019e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:25.477451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73007e-4f46-419b-99af-08bbaa019e46 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:25.496425 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1923/3863] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:25.499356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7677ed8-6926-455c-bf5f-f68ef5541bf8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:25.518668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7677ed8-6926-455c-bf5f-f68ef5541bf8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:25.524494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55fba1-a22d-4721-8fe1-35cda1769cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:25.525624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55fba1-a22d-4721-8fe1-35cda1769cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:25.526090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55fba1-a22d-4721-8fe1-35cda1769cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:25.526376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55fba1-a22d-4721-8fe1-35cda1769cb8 admin admin] PATH_INFO: `/v3/projects/5e2681ef82344b359f2f58dea65683c4/users/a3d231f7ff2f49d5b3a3e80639a29ee2/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:25.529100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55fba1-a22d-4721-8fe1-35cda1769cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2681ef82344b359f2f58dea65683c4, user_id=a3d231f7ff2f49d5b3a3e80639a29ee2, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:25.532729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55fba1-a22d-4721-8fe1-35cda1769cb8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:25.564784 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1941/3864] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:25 2022] PUT /identity/v3/projects/5e2681ef82344b359f2f58dea65683c4/users/a3d231f7ff2f49d5b3a3e80639a29ee2/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:25.566842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fd0ed-ab92-43bb-ae1c-debd109a8819 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:25.567382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fd0ed-ab92-43bb-ae1c-debd109a8819 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:25.567727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fd0ed-ab92-43bb-ae1c-debd109a8819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:25.610519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-298fd0ed-ab92-43bb-ae1c-debd109a8819 None None] MFA Rules not processed for user `a3d231f7ff2f49d5b3a3e80639a29ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:25.611900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-298fd0ed-ab92-43bb-ae1c-debd109a8819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:25.742214 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1924/3865] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:25 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:25.743787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55fba1-a22d-4721-8fe1-35cda1769cb8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:25.762250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55fba1-a22d-4721-8fe1-35cda1769cb8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:25.780426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab780ef-6c2c-4231-85fc-0b58bc5549b0 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:25.781657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab780ef-6c2c-4231-85fc-0b58bc5549b0 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:25.781940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab780ef-6c2c-4231-85fc-0b58bc5549b0 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:25.782206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab780ef-6c2c-4231-85fc-0b58bc5549b0 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects/0c228401dc284d84a7c631a46f6daa8c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:25.783389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab780ef-6c2c-4231-85fc-0b58bc5549b0 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:get_project(project_id=0c228401dc284d84a7c631a46f6daa8c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:25.785518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab780ef-6c2c-4231-85fc-0b58bc5549b0 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:25.793690 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1942/3866] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:42:25 2022] GET /identity/v3/projects/0c228401dc284d84a7c631a46f6daa8c => generated 385 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:25.795125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fd0ed-ab92-43bb-ae1c-debd109a8819 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:25.813276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fd0ed-ab92-43bb-ae1c-debd109a8819 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:25.821406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b02d57-fe29-44ee-b1b6-7e579e6a0eb6 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:25.822779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b02d57-fe29-44ee-b1b6-7e579e6a0eb6 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:25.823840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b02d57-fe29-44ee-b1b6-7e579e6a0eb6 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:25.824428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b02d57-fe29-44ee-b1b6-7e579e6a0eb6 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:25.828120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b02d57-fe29-44ee-b1b6-7e579e6a0eb6 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:25.833052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b02d57-fe29-44ee-b1b6-7e579e6a0eb6 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:25.869617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:25.915283 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1925/3867] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:42:25 2022] POST /identity/v3/projects => generated 338 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:25.920725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab780ef-6c2c-4231-85fc-0b58bc5549b0 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:25.935915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab780ef-6c2c-4231-85fc-0b58bc5549b0 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.066939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ab19b-1d05-49f4-ae67-9d566cfecc76 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.067849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ab19b-1d05-49f4-ae67-9d566cfecc76 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.068234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ab19b-1d05-49f4-ae67-9d566cfecc76 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.068613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ab19b-1d05-49f4-ae67-9d566cfecc76 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.069513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ab19b-1d05-49f4-ae67-9d566cfecc76 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.070971 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-d51ab19b-1d05-49f4-ae67-9d566cfecc76 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:42:26.070971 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:42:26.070971 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:42:26.074310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ab19b-1d05-49f4-ae67-9d566cfecc76 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.113696 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1943/3868] 10.222.0.16 () {58 vars in 1131 bytes} [Mon Aug 29 15:42:25 2022] GET /identity/v3/projects => generated 6565 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:26.116280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b02d57-fe29-44ee-b1b6-7e579e6a0eb6 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.138705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b02d57-fe29-44ee-b1b6-7e579e6a0eb6 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.157003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9d13-2217-4173-a0d5-996118ec14b2 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.157695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9d13-2217-4173-a0d5-996118ec14b2 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.157974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9d13-2217-4173-a0d5-996118ec14b2 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.158250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9d13-2217-4173-a0d5-996118ec14b2 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects/0c228401dc284d84a7c631a46f6daa8c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.166802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9d13-2217-4173-a0d5-996118ec14b2 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:get_project(project_id=0c228401dc284d84a7c631a46f6daa8c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.170693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9d13-2217-4173-a0d5-996118ec14b2 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.181646 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1926/3869] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:42:26 2022] GET /identity/v3/projects/0c228401dc284d84a7c631a46f6daa8c => generated 385 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:26.182328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ab19b-1d05-49f4-ae67-9d566cfecc76 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.200280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ab19b-1d05-49f4-ae67-9d566cfecc76 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.210017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14f1b4-a5e1-4814-95b1-99ff17104861 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.211065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f1b4-a5e1-4814-95b1-99ff17104861 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.212302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f1b4-a5e1-4814-95b1-99ff17104861 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.212692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f1b4-a5e1-4814-95b1-99ff17104861 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects/a2f565744e2a4e52b972db2877295285` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.214418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14f1b4-a5e1-4814-95b1-99ff17104861 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2f565744e2a4e52b972db2877295285)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.226585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14f1b4-a5e1-4814-95b1-99ff17104861 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.235237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9d13-2217-4173-a0d5-996118ec14b2 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.243738 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1944/3870] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:42:26 2022] GET /identity/v3/projects/a2f565744e2a4e52b972db2877295285 => generated 338 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:42:26.250833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9d13-2217-4173-a0d5-996118ec14b2 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.257230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372292cb-1030-4244-bf4b-493596fc83c5 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.258137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372292cb-1030-4244-bf4b-493596fc83c5 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.258517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372292cb-1030-4244-bf4b-493596fc83c5 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.258892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372292cb-1030-4244-bf4b-493596fc83c5 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.260814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372292cb-1030-4244-bf4b-493596fc83c5 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.263624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372292cb-1030-4244-bf4b-493596fc83c5 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.326481 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1927/3871] 10.222.0.16 () {58 vars in 1131 bytes} [Mon Aug 29 15:42:26 2022] GET /identity/v3/projects => generated 6565 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:26.337355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14f1b4-a5e1-4814-95b1-99ff17104861 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.350153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:26.366230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14f1b4-a5e1-4814-95b1-99ff17104861 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.375955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ef70d-ece3-4e38-9f8b-f38d57c9a254 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.376606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ef70d-ece3-4e38-9f8b-f38d57c9a254 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.376892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ef70d-ece3-4e38-9f8b-f38d57c9a254 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.377519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ef70d-ece3-4e38-9f8b-f38d57c9a254 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.378680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ef70d-ece3-4e38-9f8b-f38d57c9a254 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:26.378999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ef70d-ece3-4e38-9f8b-f38d57c9a254 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.381532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ef70d-ece3-4e38-9f8b-f38d57c9a254 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.425432 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1945/3872] 10.222.0.16 () {58 vars in 1166 bytes} [Mon Aug 29 15:42:26 2022] GET /identity/v3/projects?domain_id=default => generated 6234 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:26.427816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372292cb-1030-4244-bf4b-493596fc83c5 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.461404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372292cb-1030-4244-bf4b-493596fc83c5 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.495935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932808-c980-4526-b7a4-87d9e81b67bc tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.496876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932808-c980-4526-b7a4-87d9e81b67bc tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.503659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932808-c980-4526-b7a4-87d9e81b67bc tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.503659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932808-c980-4526-b7a4-87d9e81b67bc tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.503659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6932808-c980-4526-b7a4-87d9e81b67bc tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.503659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6932808-c980-4526-b7a4-87d9e81b67bc tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.613199 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1928/3873] 10.222.0.16 () {58 vars in 1131 bytes} [Mon Aug 29 15:42:26 2022] GET /identity/v3/projects => generated 6565 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:26.619338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ef70d-ece3-4e38-9f8b-f38d57c9a254 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.635285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ef70d-ece3-4e38-9f8b-f38d57c9a254 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.645019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f849c-6c7d-43d7-b292-118099f34688 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.645998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f849c-6c7d-43d7-b292-118099f34688 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.646185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f849c-6c7d-43d7-b292-118099f34688 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.646578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f849c-6c7d-43d7-b292-118099f34688 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.648024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f849c-6c7d-43d7-b292-118099f34688 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:26.648024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f849c-6c7d-43d7-b292-118099f34688 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.657737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f849c-6c7d-43d7-b292-118099f34688 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.686528 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1946/3874] 10.222.0.16 () {58 vars in 1166 bytes} [Mon Aug 29 15:42:26 2022] GET /identity/v3/projects?domain_id=default => generated 6234 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:26.693415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932808-c980-4526-b7a4-87d9e81b67bc tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.710333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932808-c980-4526-b7a4-87d9e81b67bc tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.717459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad74414-d0d8-4117-8617-dc317257f46d tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.728344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad74414-d0d8-4117-8617-dc317257f46d tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.728633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad74414-d0d8-4117-8617-dc317257f46d tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.728916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad74414-d0d8-4117-8617-dc317257f46d tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.732489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad74414-d0d8-4117-8617-dc317257f46d tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.734885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad74414-d0d8-4117-8617-dc317257f46d tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.799607 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1929/3875] 10.222.0.16 () {58 vars in 1131 bytes} [Mon Aug 29 15:42:26 2022] GET /identity/v3/projects => generated 6565 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:26.800871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f849c-6c7d-43d7-b292-118099f34688 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.819890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f849c-6c7d-43d7-b292-118099f34688 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.831752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a79fa0-2720-417e-886b-61a2a6e6241e tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.838880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a79fa0-2720-417e-886b-61a2a6e6241e tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.839178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a79fa0-2720-417e-886b-61a2a6e6241e tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.839427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a79fa0-2720-417e-886b-61a2a6e6241e tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.840414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a79fa0-2720-417e-886b-61a2a6e6241e tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-14089687) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:26.840727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a79fa0-2720-417e-886b-61a2a6e6241e tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.846773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a79fa0-2720-417e-886b-61a2a6e6241e tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:26.896692 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1947/3876] 10.222.0.16 () {58 vars in 1228 bytes} [Mon Aug 29 15:42:26 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-14089687 => generated 531 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:26.899579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad74414-d0d8-4117-8617-dc317257f46d tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:26.916808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad74414-d0d8-4117-8617-dc317257f46d tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:26.934620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d231f7ff2f49d5b3a3e80639a29ee2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2681ef82344b359f2f58dea65683c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:26.935331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:26.935995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:26.935995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] PATH_INFO: `/v3/projects/a2f565744e2a4e52b972db2877295285` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:26.938530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2f565744e2a4e52b972db2877295285)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:26.940560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:27.061132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f565744e2a4e52b972db2877295285', 'request_id': 'req-f98504c8-c15f-4ffa-91cc-a672f4057493'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:27.070767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f565744e2a4e52b972db2877295285', 'request_id': 'req-f98504c8-c15f-4ffa-91cc-a672f4057493'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:27.085920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f565744e2a4e52b972db2877295285', 'request_id': 'req-f98504c8-c15f-4ffa-91cc-a672f4057493'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:27.106755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] The token cache is being invalidate because project a2f565744e2a4e52b972db2877295285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:27.107337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:27.108202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f98504c8-c15f-4ffa-91cc-a672f4057493 tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:27.110722 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1930/3877] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:26 2022] DELETE /identity/v3/projects/a2f565744e2a4e52b972db2877295285 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:27.114852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a79fa0-2720-417e-886b-61a2a6e6241e tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:27.116665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-79a79fa0-2720-417e-886b-61a2a6e6241e tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:27.260154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a79fa0-2720-417e-886b-61a2a6e6241e tempest-ListProjectsStaticTestJSON-1663262389 tempest-ListProjectsStaticTestJSON-1663262389-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:27.400890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:27.402032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.402611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.403035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] PATH_INFO: `/v3/users/83865ca01c894b7e928bdc1cfe0524c0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.404412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83865ca01c894b7e928bdc1cfe0524c0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:27.406772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:27.524083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83865ca01c894b7e928bdc1cfe0524c0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:27.525008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83865ca01c894b7e928bdc1cfe0524c0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:27.570699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83865ca01c894b7e928bdc1cfe0524c0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:27.572288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83865ca01c894b7e928bdc1cfe0524c0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:27.596558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:27.605601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83865ca01c894b7e928bdc1cfe0524c0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:27.635145 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1948/3878] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:27 2022] DELETE /identity/v3/users/83865ca01c894b7e928bdc1cfe0524c0 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:27.637450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b711fa-c112-450b-b32d-056952016631 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.638032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b711fa-c112-450b-b32d-056952016631 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.638032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b711fa-c112-450b-b32d-056952016631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.676684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-44b711fa-c112-450b-b32d-056952016631 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:27.679513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-44b711fa-c112-450b-b32d-056952016631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:27.768700 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1931/3879] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:27.809320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:27.818149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:27.928547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdef7f-da46-4b04-b5b9-b489cce029e2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:27.936030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d29d3b-3b96-41f8-ab5b-79b7224828af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:27.938682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d29d3b-3b96-41f8-ab5b-79b7224828af service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:27.938962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d29d3b-3b96-41f8-ab5b-79b7224828af service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:27.939304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d29d3b-3b96-41f8-ab5b-79b7224828af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:27.959598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d29d3b-3b96-41f8-ab5b-79b7224828af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:27.963868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d29d3b-3b96-41f8-ab5b-79b7224828af service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:28.009556 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1949/3880] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:28.794449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b711fa-c112-450b-b32d-056952016631 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:28.797021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-44b711fa-c112-450b-b32d-056952016631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:28.819837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b711fa-c112-450b-b32d-056952016631 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:28.827676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880037d3-648d-4cdd-88e1-5cb1c86dc4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:28.828596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880037d3-648d-4cdd-88e1-5cb1c86dc4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:28.829070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880037d3-648d-4cdd-88e1-5cb1c86dc4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:28.829590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880037d3-648d-4cdd-88e1-5cb1c86dc4e1 admin admin] PATH_INFO: `/v3/users/3aacfc6a126542f2897c3d3e51e736dc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:28.831118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880037d3-648d-4cdd-88e1-5cb1c86dc4e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aacfc6a126542f2897c3d3e51e736dc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:28.833344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880037d3-648d-4cdd-88e1-5cb1c86dc4e1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:28.883400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:28.931147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-880037d3-648d-4cdd-88e1-5cb1c86dc4e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aacfc6a126542f2897c3d3e51e736dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:28.932358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-880037d3-648d-4cdd-88e1-5cb1c86dc4e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aacfc6a126542f2897c3d3e51e736dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:28.947245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-880037d3-648d-4cdd-88e1-5cb1c86dc4e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aacfc6a126542f2897c3d3e51e736dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:28.957211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-880037d3-648d-4cdd-88e1-5cb1c86dc4e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aacfc6a126542f2897c3d3e51e736dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:28.971231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-880037d3-648d-4cdd-88e1-5cb1c86dc4e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aacfc6a126542f2897c3d3e51e736dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:28.978824 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1932/3881] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:28 2022] DELETE /identity/v3/users/3aacfc6a126542f2897c3d3e51e736dc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:29.371955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5ae7a-0cbb-4ff4-b004-ef5e7b52aae2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:29.372847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5ae7a-0cbb-4ff4-b004-ef5e7b52aae2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:29.373724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5ae7a-0cbb-4ff4-b004-ef5e7b52aae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:29.438549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cfc5ae7a-0cbb-4ff4-b004-ef5e7b52aae2 None None] MFA Rules not processed for user `f1fd00311fa540658cfd4076c9a88976`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:29.439701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cfc5ae7a-0cbb-4ff4-b004-ef5e7b52aae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:29.599059 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1950/3882] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:29.610990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefd0e2-e9ce-432d-bea8-8bf85e3ddd7c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:29.611453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefd0e2-e9ce-432d-bea8-8bf85e3ddd7c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:29.611754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefd0e2-e9ce-432d-bea8-8bf85e3ddd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:29.658867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9cefd0e2-e9ce-432d-bea8-8bf85e3ddd7c None None] MFA Rules not processed for user `f1fd00311fa540658cfd4076c9a88976`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:29.660273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9cefd0e2-e9ce-432d-bea8-8bf85e3ddd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:29.684634 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1933/3883] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:29.702985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5ae7a-0cbb-4ff4-b004-ef5e7b52aae2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:29.704927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cfc5ae7a-0cbb-4ff4-b004-ef5e7b52aae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:29.801530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefd0e2-e9ce-432d-bea8-8bf85e3ddd7c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:29.803236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9cefd0e2-e9ce-432d-bea8-8bf85e3ddd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:29.933419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5ae7a-0cbb-4ff4-b004-ef5e7b52aae2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:29.948469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f96ce6-c498-4b40-9c6b-b51d67b3e35c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:29.949107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f96ce6-c498-4b40-9c6b-b51d67b3e35c service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:29.949296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f96ce6-c498-4b40-9c6b-b51d67b3e35c service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:29.949603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f96ce6-c498-4b40-9c6b-b51d67b3e35c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:29.965358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f96ce6-c498-4b40-9c6b-b51d67b3e35c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:29.967001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f96ce6-c498-4b40-9c6b-b51d67b3e35c service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:29.991753 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1951/3884] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:29.993546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f96ce6-c498-4b40-9c6b-b51d67b3e35c service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:30.003086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d4f96ce6-c498-4b40-9c6b-b51d67b3e35c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:30.004588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefd0e2-e9ce-432d-bea8-8bf85e3ddd7c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:30.016021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:30.016816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:30.017195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:30.017611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] PATH_INFO: `/v3/projects/0c228401dc284d84a7c631a46f6daa8c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:30.021754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c228401dc284d84a7c631a46f6daa8c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:30.023826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:30.037008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f96ce6-c498-4b40-9c6b-b51d67b3e35c service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:30.041595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:30.042503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:30.042786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:30.043063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] PATH_INFO: `/v3/projects/871a37b020bc46d5b1840e19ad0a997e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:30.046847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=871a37b020bc46d5b1840e19ad0a997e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:30.048802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:30.050581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:30.192890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871a37b020bc46d5b1840e19ad0a997e', 'request_id': 'req-acb63277-b8a0-4fb1-b943-3e0045f4f63b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.207774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c228401dc284d84a7c631a46f6daa8c', 'request_id': 'req-594ed98e-9f08-4f3f-850d-8a67a40abcea'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.225874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871a37b020bc46d5b1840e19ad0a997e', 'request_id': 'req-acb63277-b8a0-4fb1-b943-3e0045f4f63b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.246088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c228401dc284d84a7c631a46f6daa8c', 'request_id': 'req-594ed98e-9f08-4f3f-850d-8a67a40abcea'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.246808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871a37b020bc46d5b1840e19ad0a997e', 'request_id': 'req-acb63277-b8a0-4fb1-b943-3e0045f4f63b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.257924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c228401dc284d84a7c631a46f6daa8c', 'request_id': 'req-594ed98e-9f08-4f3f-850d-8a67a40abcea'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.284076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] The token cache is being invalidate because project 0c228401dc284d84a7c631a46f6daa8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:30.284481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.284872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] The token cache is being invalidate because project 871a37b020bc46d5b1840e19ad0a997e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:30.285348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.285513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.286650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-acb63277-b8a0-4fb1-b943-3e0045f4f63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.287721 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1934/3885] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:29 2022] DELETE /identity/v3/projects/0c228401dc284d84a7c631a46f6daa8c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:30.289459 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1952/3886] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:29 2022] DELETE /identity/v3/projects/871a37b020bc46d5b1840e19ad0a997e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:30.292916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:30.294178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:30.295381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9dd8-437b-4773-8d02-b9bc391245f8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:30.295840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9dd8-437b-4773-8d02-b9bc391245f8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:30.296833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9dd8-437b-4773-8d02-b9bc391245f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:30.369185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:30.383020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-858f9dd8-437b-4773-8d02-b9bc391245f8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:30.384958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-858f9dd8-437b-4773-8d02-b9bc391245f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:30.500092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ed98e-9f08-4f3f-850d-8a67a40abcea admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:30.520815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:30.521499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:30.521785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:30.522060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] PATH_INFO: `/v3/users/a3d231f7ff2f49d5b3a3e80639a29ee2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:30.524502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d231f7ff2f49d5b3a3e80639a29ee2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:30.526882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:30.586850 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1953/3887] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:30.594179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974a3b3-45fd-4833-b1bd-98adde4e503b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:30.594503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974a3b3-45fd-4833-b1bd-98adde4e503b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:30.598208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974a3b3-45fd-4833-b1bd-98adde4e503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:30.645835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a974a3b3-45fd-4833-b1bd-98adde4e503b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:30.646745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a974a3b3-45fd-4833-b1bd-98adde4e503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:30.678168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d231f7ff2f49d5b3a3e80639a29ee2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.678901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d231f7ff2f49d5b3a3e80639a29ee2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.684536 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1954/3888] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:30.694494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974a3b3-45fd-4833-b1bd-98adde4e503b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:30.711927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d231f7ff2f49d5b3a3e80639a29ee2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.714924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974a3b3-45fd-4833-b1bd-98adde4e503b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:30.731942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d231f7ff2f49d5b3a3e80639a29ee2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.740301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d047837-dcb0-4cb1-8d0a-b38624d1415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:30.741251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d047837-dcb0-4cb1-8d0a-b38624d1415f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:30.747656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d047837-dcb0-4cb1-8d0a-b38624d1415f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:30.748411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d047837-dcb0-4cb1-8d0a-b38624d1415f admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:30.755612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d231f7ff2f49d5b3a3e80639a29ee2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:30.759356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d047837-dcb0-4cb1-8d0a-b38624d1415f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:30.760028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d047837-dcb0-4cb1-8d0a-b38624d1415f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:30.762682 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1935/3889] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:30 2022] DELETE /identity/v3/users/a3d231f7ff2f49d5b3a3e80639a29ee2 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:30.767286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d047837-dcb0-4cb1-8d0a-b38624d1415f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:30.793246 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1955/3890] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:30.798628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:30.800113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:30.991838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5e2f9-72ab-4321-b140-b2f1113e6e1a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:31.012995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec9356-93e1-43f5-a578-7eb6113060a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:31.013749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9356-93e1-43f5-a578-7eb6113060a9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:31.014103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9356-93e1-43f5-a578-7eb6113060a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:31.015992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9356-93e1-43f5-a578-7eb6113060a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:31.016764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec9356-93e1-43f5-a578-7eb6113060a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:31.020731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec9356-93e1-43f5-a578-7eb6113060a9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:31.072456 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1936/3891] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:30 2022] POST /identity/v3/projects => generated 375 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:31.076483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d047837-dcb0-4cb1-8d0a-b38624d1415f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:31.092170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d047837-dcb0-4cb1-8d0a-b38624d1415f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:31.244596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8db9-092f-4f52-a210-ce36bdf88f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:31.245448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8db9-092f-4f52-a210-ce36bdf88f74 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:31.245891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8db9-092f-4f52-a210-ce36bdf88f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:31.246350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8db9-092f-4f52-a210-ce36bdf88f74 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:31.247285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c8db9-092f-4f52-a210-ce36bdf88f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:31.252212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c8db9-092f-4f52-a210-ce36bdf88f74 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:31.292236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:31.319032 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1956/3892] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:31 2022] POST /identity/v3/users => generated 288 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:31.323391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec9356-93e1-43f5-a578-7eb6113060a9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:31.344071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec9356-93e1-43f5-a578-7eb6113060a9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:31.371418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9235a1-e0a4-445c-8b4f-859741772dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:31.372112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9235a1-e0a4-445c-8b4f-859741772dff admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:31.372401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9235a1-e0a4-445c-8b4f-859741772dff admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:31.372731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9235a1-e0a4-445c-8b4f-859741772dff admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:31.378339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9235a1-e0a4-445c-8b4f-859741772dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:31.383743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9235a1-e0a4-445c-8b4f-859741772dff admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:31.447203 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1937/3893] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:31.449064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8db9-092f-4f52-a210-ce36bdf88f74 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:31.473307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8db9-092f-4f52-a210-ce36bdf88f74 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:31.480243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b7ac5-8e8b-44d8-b17a-183b73d78eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:31.481254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7ac5-8e8b-44d8-b17a-183b73d78eab admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:31.481910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7ac5-8e8b-44d8-b17a-183b73d78eab admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:31.482418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7ac5-8e8b-44d8-b17a-183b73d78eab admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:31.483302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b7ac5-8e8b-44d8-b17a-183b73d78eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:31.485831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b7ac5-8e8b-44d8-b17a-183b73d78eab admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:31.512680 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1957/3894] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:31.517562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9235a1-e0a4-445c-8b4f-859741772dff admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:31.533023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9235a1-e0a4-445c-8b4f-859741772dff admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:31.554558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef0bbd-4157-44a5-9ff0-86c906393c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:31.556140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef0bbd-4157-44a5-9ff0-86c906393c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:31.556425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef0bbd-4157-44a5-9ff0-86c906393c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:31.556703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef0bbd-4157-44a5-9ff0-86c906393c80 admin admin] PATH_INFO: `/v3/projects/3f9940a1fec84128b318a5f80884447b/users/351e59b6021b44a29665281568960f8b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:31.612749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef0bbd-4157-44a5-9ff0-86c906393c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9940a1fec84128b318a5f80884447b, user_id=351e59b6021b44a29665281568960f8b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:31.622513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef0bbd-4157-44a5-9ff0-86c906393c80 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:31.632544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:31.663138 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1938/3895] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:31 2022] PUT /identity/v3/projects/3f9940a1fec84128b318a5f80884447b/users/351e59b6021b44a29665281568960f8b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:31.665557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fb15-58a5-4712-a407-ac697da15aae None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:31.665855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fb15-58a5-4712-a407-ac697da15aae None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:31.667297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fb15-58a5-4712-a407-ac697da15aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:31.721176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-13a5fb15-58a5-4712-a407-ac697da15aae None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:31.724335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-13a5fb15-58a5-4712-a407-ac697da15aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:31.862025 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1958/3896] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:31.988088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef0bbd-4157-44a5-9ff0-86c906393c80 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:31.990121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4bef0bbd-4157-44a5-9ff0-86c906393c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:32.114552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef0bbd-4157-44a5-9ff0-86c906393c80 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:32.122172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d4d10-909e-47f2-9c26-4f81bce837d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:32.122856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d4d10-909e-47f2-9c26-4f81bce837d9 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:32.123333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d4d10-909e-47f2-9c26-4f81bce837d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:32.123775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d4d10-909e-47f2-9c26-4f81bce837d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:32.148939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d4d10-909e-47f2-9c26-4f81bce837d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:32.150813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d4d10-909e-47f2-9c26-4f81bce837d9 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:32.179327 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1939/3897] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:32.894709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5fb15-58a5-4712-a407-ac697da15aae None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:32.900419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-13a5fb15-58a5-4712-a407-ac697da15aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:32.940645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5fb15-58a5-4712-a407-ac697da15aae None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:32.966111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:32.967014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:32.967469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:32.967948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] PATH_INFO: `/v3/projects/5e2681ef82344b359f2f58dea65683c4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:32.970125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2681ef82344b359f2f58dea65683c4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:32.973864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:33.152867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2681ef82344b359f2f58dea65683c4', 'request_id': 'req-cf81c565-31f4-42e6-8fc4-07139b9604b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:33.170275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2681ef82344b359f2f58dea65683c4', 'request_id': 'req-cf81c565-31f4-42e6-8fc4-07139b9604b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:33.185815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2681ef82344b359f2f58dea65683c4', 'request_id': 'req-cf81c565-31f4-42e6-8fc4-07139b9604b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:33.221136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] The token cache is being invalidate because project 5e2681ef82344b359f2f58dea65683c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:33.221499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:33.222136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cf81c565-31f4-42e6-8fc4-07139b9604b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:33.226985 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1959/3898] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:32 2022] DELETE /identity/v3/projects/5e2681ef82344b359f2f58dea65683c4 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:33.228702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a28270-81ef-4990-b376-43712023dd92 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:33.229167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a28270-81ef-4990-b376-43712023dd92 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:33.229315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a28270-81ef-4990-b376-43712023dd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:33.288749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b1a28270-81ef-4990-b376-43712023dd92 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:33.290106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b1a28270-81ef-4990-b376-43712023dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:33.457011 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1940/3899] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:33.466695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f21de4-7be7-4d44-9d34-782b8aad1e55 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:33.467293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f21de4-7be7-4d44-9d34-782b8aad1e55 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:33.468303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f21de4-7be7-4d44-9d34-782b8aad1e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:33.510508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-34f21de4-7be7-4d44-9d34-782b8aad1e55 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:33.511755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-34f21de4-7be7-4d44-9d34-782b8aad1e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:33.546110 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1960/3900] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:33.546391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a28270-81ef-4990-b376-43712023dd92 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:33.564344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a28270-81ef-4990-b376-43712023dd92 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:33.582195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4071ab-5e84-4ced-8545-eb3c8e7a6912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:33.582841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4071ab-5e84-4ced-8545-eb3c8e7a6912 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:33.583121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4071ab-5e84-4ced-8545-eb3c8e7a6912 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:33.583441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4071ab-5e84-4ced-8545-eb3c8e7a6912 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:33.584057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4071ab-5e84-4ced-8545-eb3c8e7a6912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:33.584365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4071ab-5e84-4ced-8545-eb3c8e7a6912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:33.587522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4071ab-5e84-4ced-8545-eb3c8e7a6912 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:33.608083 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1941/3901] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:33.611794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f21de4-7be7-4d44-9d34-782b8aad1e55 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:33.630197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f21de4-7be7-4d44-9d34-782b8aad1e55 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:33.640051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568bb22-a4c8-4aaa-9651-7b0a83019075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:33.641164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568bb22-a4c8-4aaa-9651-7b0a83019075 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:33.641831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568bb22-a4c8-4aaa-9651-7b0a83019075 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:33.642299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568bb22-a4c8-4aaa-9651-7b0a83019075 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:33.643247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568bb22-a4c8-4aaa-9651-7b0a83019075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:33.646160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568bb22-a4c8-4aaa-9651-7b0a83019075 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:33.719611 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1961/3902] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:33 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:33.719844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4071ab-5e84-4ced-8545-eb3c8e7a6912 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:33.737554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4071ab-5e84-4ced-8545-eb3c8e7a6912 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:33.854363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f21ca4-3101-4a9f-b661-001d2d8aa463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:33.855452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f21ca4-3101-4a9f-b661-001d2d8aa463 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:33.855956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f21ca4-3101-4a9f-b661-001d2d8aa463 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:33.856702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f21ca4-3101-4a9f-b661-001d2d8aa463 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:33.857614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f21ca4-3101-4a9f-b661-001d2d8aa463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:33.866701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f21ca4-3101-4a9f-b661-001d2d8aa463 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:33.918522 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1942/3903] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:33 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:33.919600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568bb22-a4c8-4aaa-9651-7b0a83019075 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:33.944451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568bb22-a4c8-4aaa-9651-7b0a83019075 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:33.986673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d101fd-db77-4593-bab0-d169e892912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:33.987407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d101fd-db77-4593-bab0-d169e892912c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:33.990616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d101fd-db77-4593-bab0-d169e892912c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:33.991001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d101fd-db77-4593-bab0-d169e892912c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:33.991786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d101fd-db77-4593-bab0-d169e892912c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:33.995802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d101fd-db77-4593-bab0-d169e892912c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:34.041600 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1962/3904] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:34.045261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f21ca4-3101-4a9f-b661-001d2d8aa463 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:34.064099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f21ca4-3101-4a9f-b661-001d2d8aa463 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:34.087313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9b4bf-3f5f-4eef-8c3b-e92735d8aff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:34.088537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9b4bf-3f5f-4eef-8c3b-e92735d8aff5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:34.088889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9b4bf-3f5f-4eef-8c3b-e92735d8aff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:34.089228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9b4bf-3f5f-4eef-8c3b-e92735d8aff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:34.094948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9b4bf-3f5f-4eef-8c3b-e92735d8aff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:34.096784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9b4bf-3f5f-4eef-8c3b-e92735d8aff5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:34.150214 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1943/3905] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:34.154171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d101fd-db77-4593-bab0-d169e892912c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:34.172047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d101fd-db77-4593-bab0-d169e892912c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:34.195843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a2879-a2de-4bc3-b901-72b30a7f78ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:34.196526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2879-a2de-4bc3-b901-72b30a7f78ec admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:34.196992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2879-a2de-4bc3-b901-72b30a7f78ec admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:34.197545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2879-a2de-4bc3-b901-72b30a7f78ec admin admin] PATH_INFO: `/v3/projects/0c5cbd9fc0a84b29b04336e92d082fe4/users/21f1e20f993642cfa10e6ab7d666ecce/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:34.235567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a2879-a2de-4bc3-b901-72b30a7f78ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5cbd9fc0a84b29b04336e92d082fe4, user_id=21f1e20f993642cfa10e6ab7d666ecce, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:34.238683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a2879-a2de-4bc3-b901-72b30a7f78ec admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:34.263220 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1963/3906] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:34 2022] PUT /identity/v3/projects/0c5cbd9fc0a84b29b04336e92d082fe4/users/21f1e20f993642cfa10e6ab7d666ecce/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:34.274665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f854213-f863-43cb-824f-f941e7a652aa None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:34.275224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f854213-f863-43cb-824f-f941e7a652aa None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:34.275224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f854213-f863-43cb-824f-f941e7a652aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:34.293403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:34.366428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5f854213-f863-43cb-824f-f941e7a652aa None None] MFA Rules not processed for user `21f1e20f993642cfa10e6ab7d666ecce`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:34.369771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5f854213-f863-43cb-824f-f941e7a652aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:34.538537 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1944/3907] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:34.542956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a2879-a2de-4bc3-b901-72b30a7f78ec admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:34.558029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:34.688530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a2879-a2de-4bc3-b901-72b30a7f78ec admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:34.708201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b74d-16ad-47f4-bd72-186d3885a2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:34.710771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b74d-16ad-47f4-bd72-186d3885a2db admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:34.711334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b74d-16ad-47f4-bd72-186d3885a2db admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:34.711841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b74d-16ad-47f4-bd72-186d3885a2db admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:34.712714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857b74d-16ad-47f4-bd72-186d3885a2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:34.715108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857b74d-16ad-47f4-bd72-186d3885a2db admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:34.793744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f854213-f863-43cb-824f-f941e7a652aa None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:34.803856 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1964/3908] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:34 2022] POST /identity/v3/projects => generated 383 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:34.815963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f854213-f863-43cb-824f-f941e7a652aa None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:34.959467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9997787-3709-4d3b-b574-c08ac0cb11e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:34.960335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9997787-3709-4d3b-b574-c08ac0cb11e1 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:34.960850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9997787-3709-4d3b-b574-c08ac0cb11e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:34.962362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9997787-3709-4d3b-b574-c08ac0cb11e1 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:34.964643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9997787-3709-4d3b-b574-c08ac0cb11e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:34.971028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9997787-3709-4d3b-b574-c08ac0cb11e1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:35.028093 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1945/3909] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:34 2022] POST /identity/v3/users => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:35.033826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b74d-16ad-47f4-bd72-186d3885a2db admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:35.055606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b74d-16ad-47f4-bd72-186d3885a2db admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:35.074305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283faca8-08a1-4c12-b812-2bd0e05c3a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:35.074938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283faca8-08a1-4c12-b812-2bd0e05c3a6a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:35.076281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283faca8-08a1-4c12-b812-2bd0e05c3a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:35.076786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283faca8-08a1-4c12-b812-2bd0e05c3a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:35.077830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283faca8-08a1-4c12-b812-2bd0e05c3a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:35.080020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283faca8-08a1-4c12-b812-2bd0e05c3a6a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:35.107672 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1965/3910] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:35.117313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9997787-3709-4d3b-b574-c08ac0cb11e1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:35.153906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9997787-3709-4d3b-b574-c08ac0cb11e1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:35.169638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fab60f-1bb2-4987-998d-34c705a96428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:35.170885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fab60f-1bb2-4987-998d-34c705a96428 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:35.171969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fab60f-1bb2-4987-998d-34c705a96428 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:35.172480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fab60f-1bb2-4987-998d-34c705a96428 admin admin] PATH_INFO: `/v3/projects/0f8745c693a041c69b58d922abd9708b/users/9a9829fcee6949e69dca6428a146ac14/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:35.224509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fab60f-1bb2-4987-998d-34c705a96428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8745c693a041c69b58d922abd9708b, user_id=9a9829fcee6949e69dca6428a146ac14, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:35.229076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fab60f-1bb2-4987-998d-34c705a96428 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:35.267957 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1946/3911] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:35 2022] PUT /identity/v3/projects/0f8745c693a041c69b58d922abd9708b/users/9a9829fcee6949e69dca6428a146ac14/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:35.272147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283faca8-08a1-4c12-b812-2bd0e05c3a6a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:35.287389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283faca8-08a1-4c12-b812-2bd0e05c3a6a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:35.523501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4aafea-1957-47f6-a868-6fd888eb80c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:35.524415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aafea-1957-47f6-a868-6fd888eb80c3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:35.525027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aafea-1957-47f6-a868-6fd888eb80c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:35.525532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aafea-1957-47f6-a868-6fd888eb80c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:35.528408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4aafea-1957-47f6-a868-6fd888eb80c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:35.531432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4aafea-1957-47f6-a868-6fd888eb80c3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:35.548595 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1966/3912] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:35.554112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fab60f-1bb2-4987-998d-34c705a96428 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:35.569622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fab60f-1bb2-4987-998d-34c705a96428 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:35.592422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f38d6-c791-4d0e-97eb-f99dd0bc3302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:35.593730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f38d6-c791-4d0e-97eb-f99dd0bc3302 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:35.594244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f38d6-c791-4d0e-97eb-f99dd0bc3302 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:35.594523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f38d6-c791-4d0e-97eb-f99dd0bc3302 admin admin] PATH_INFO: `/v3/projects/0f8745c693a041c69b58d922abd9708b/users/9a9829fcee6949e69dca6428a146ac14/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:35.596684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f38d6-c791-4d0e-97eb-f99dd0bc3302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8745c693a041c69b58d922abd9708b, user_id=9a9829fcee6949e69dca6428a146ac14, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:35.600963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f38d6-c791-4d0e-97eb-f99dd0bc3302 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:35.614032 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1947/3913] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:35 2022] PUT /identity/v3/projects/0f8745c693a041c69b58d922abd9708b/users/9a9829fcee6949e69dca6428a146ac14/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:35.624870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff64f7-6e24-4deb-bece-49fc874d4701 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:35.625160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff64f7-6e24-4deb-bece-49fc874d4701 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:35.625463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff64f7-6e24-4deb-bece-49fc874d4701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:35.687098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c5ff64f7-6e24-4deb-bece-49fc874d4701 None None] MFA Rules not processed for user `9a9829fcee6949e69dca6428a146ac14`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:35.689069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c5ff64f7-6e24-4deb-bece-49fc874d4701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:35.879980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f38d6-c791-4d0e-97eb-f99dd0bc3302 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:35.880230 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1967/3914] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:35.902082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f38d6-c791-4d0e-97eb-f99dd0bc3302 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:35.919154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61161-e8ba-468f-8fb2-4d43dc71bbc8 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a9829fcee6949e69dca6428a146ac14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f8745c693a041c69b58d922abd9708b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:35.919800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61161-e8ba-468f-8fb2-4d43dc71bbc8 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:35.920084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61161-e8ba-468f-8fb2-4d43dc71bbc8 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:35.920369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61161-e8ba-468f-8fb2-4d43dc71bbc8 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:35.921093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f61161-e8ba-468f-8fb2-4d43dc71bbc8 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:35.923017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f61161-e8ba-468f-8fb2-4d43dc71bbc8 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:36.020534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff64f7-6e24-4deb-bece-49fc874d4701 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:36.020803 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1948/3915] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:35 2022] POST /identity/v3/projects => generated 358 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:42:36.027524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:36.151336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff64f7-6e24-4deb-bece-49fc874d4701 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:36.247183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7f304-83ec-4062-99e4-1f9ea833e777 tempest-ProjectsNegativeTestJSON-1034616131 tempest-ProjectsNegativeTestJSON-1034616131-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21f1e20f993642cfa10e6ab7d666ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c5cbd9fc0a84b29b04336e92d082fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:36.248025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7f304-83ec-4062-99e4-1f9ea833e777 tempest-ProjectsNegativeTestJSON-1034616131 tempest-ProjectsNegativeTestJSON-1034616131-project] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:36.248605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7f304-83ec-4062-99e4-1f9ea833e777 tempest-ProjectsNegativeTestJSON-1034616131 tempest-ProjectsNegativeTestJSON-1034616131-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:36.249780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7f304-83ec-4062-99e4-1f9ea833e777 tempest-ProjectsNegativeTestJSON-1034616131 tempest-ProjectsNegativeTestJSON-1034616131-project] PATH_INFO: `/v3/projects/0f3cb23c4c30488780e452a957f3d69c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:36.266016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7f304-83ec-4062-99e4-1f9ea833e777 tempest-ProjectsNegativeTestJSON-1034616131 tempest-ProjectsNegativeTestJSON-1034616131-project] RBAC: Authorizing `identity:delete_project(project_id=0f3cb23c4c30488780e452a957f3d69c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-48f7f304-83ec-4062-99e4-1f9ea833e777 tempest-ProjectsNegativeTestJSON-1034616131 tempest-ProjectsNegativeTestJSON-1034616131-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Aug 29 15:42:36.285769 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 29 15:42:36.287205 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 29 15:42:36.287205 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 29 15:42:36.287205 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 29 15:42:36.287205 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 29 15:42:36.287205 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:42:36.287205 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 29 15:42:36.287205 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 29 15:42:36.287205 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:42:36.291243 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1968/3916] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:36 2022] DELETE /identity/v3/projects/0f3cb23c4c30488780e452a957f3d69c => generated 136 bytes in 271 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:42:36.293320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61161-e8ba-468f-8fb2-4d43dc71bbc8 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:36.371687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:36.427930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7f304-83ec-4062-99e4-1f9ea833e777 tempest-ProjectsNegativeTestJSON-1034616131 tempest-ProjectsNegativeTestJSON-1034616131-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:36.430874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-48f7f304-83ec-4062-99e4-1f9ea833e777 tempest-ProjectsNegativeTestJSON-1034616131 tempest-ProjectsNegativeTestJSON-1034616131-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:36.454055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61161-e8ba-468f-8fb2-4d43dc71bbc8 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:36.459702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a9829fcee6949e69dca6428a146ac14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f8745c693a041c69b58d922abd9708b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:36.460503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:36.461416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:36.461821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] PATH_INFO: `/v3/projects/0f3cb23c4c30488780e452a957f3d69c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:36.463477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f3cb23c4c30488780e452a957f3d69c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:36.469213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:36.536144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3cb23c4c30488780e452a957f3d69c', 'request_id': 'req-ec83795a-5a96-4670-8806-6420a341de39'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.546658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3cb23c4c30488780e452a957f3d69c', 'request_id': 'req-ec83795a-5a96-4670-8806-6420a341de39'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.567929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3cb23c4c30488780e452a957f3d69c', 'request_id': 'req-ec83795a-5a96-4670-8806-6420a341de39'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.569719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7f304-83ec-4062-99e4-1f9ea833e777 tempest-ProjectsNegativeTestJSON-1034616131 tempest-ProjectsNegativeTestJSON-1034616131-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:36.588082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] The token cache is being invalidate because project 0f3cb23c4c30488780e452a957f3d69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:36.588828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.590629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.596585 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1949/3917] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:36 2022] DELETE /identity/v3/projects/0f3cb23c4c30488780e452a957f3d69c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:36.598369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:36.601115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:36.708891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e1009-0f00-4d9f-9271-0acc6a1ead9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:36.710374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1009-0f00-4d9f-9271-0acc6a1ead9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:36.718695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1009-0f00-4d9f-9271-0acc6a1ead9a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:36.719107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1009-0f00-4d9f-9271-0acc6a1ead9a admin admin] PATH_INFO: `/v3/users/f0c165a4dd4648888d45d44df5acbe2b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:36.725114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e1009-0f00-4d9f-9271-0acc6a1ead9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c165a4dd4648888d45d44df5acbe2b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:36.727630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e1009-0f00-4d9f-9271-0acc6a1ead9a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:36.732250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83795a-5a96-4670-8806-6420a341de39 tempest-ProjectsNegativeTestJSON-205115143 tempest-ProjectsNegativeTestJSON-205115143-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:36.738929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:36.740371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:36.740857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:36.741981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] PATH_INFO: `/v3/users/21f1e20f993642cfa10e6ab7d666ecce` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:36.744932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f1e20f993642cfa10e6ab7d666ecce)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:36.745472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:36.753481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:36.814265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-531e1009-0f00-4d9f-9271-0acc6a1ead9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c165a4dd4648888d45d44df5acbe2b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.815156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-531e1009-0f00-4d9f-9271-0acc6a1ead9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c165a4dd4648888d45d44df5acbe2b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.842147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-531e1009-0f00-4d9f-9271-0acc6a1ead9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c165a4dd4648888d45d44df5acbe2b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.843747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f1e20f993642cfa10e6ab7d666ecce'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.844420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-531e1009-0f00-4d9f-9271-0acc6a1ead9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c165a4dd4648888d45d44df5acbe2b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.845711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f1e20f993642cfa10e6ab7d666ecce'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.864351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-531e1009-0f00-4d9f-9271-0acc6a1ead9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c165a4dd4648888d45d44df5acbe2b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.868739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:36.883385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f1e20f993642cfa10e6ab7d666ecce'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.894234 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1969/3918] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:36 2022] DELETE /identity/v3/users/f0c165a4dd4648888d45d44df5acbe2b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:36.904485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f1e20f993642cfa10e6ab7d666ecce'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.917925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f1e20f993642cfa10e6ab7d666ecce'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:36.929097 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1950/3919] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:36 2022] DELETE /identity/v3/users/21f1e20f993642cfa10e6ab7d666ecce => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:36.933874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7c3fe-d3e6-4785-9b2a-4cc03b9b8d0c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:36.934622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7c3fe-d3e6-4785-9b2a-4cc03b9b8d0c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:36.935149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7c3fe-d3e6-4785-9b2a-4cc03b9b8d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:36.968643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9ec7c3fe-d3e6-4785-9b2a-4cc03b9b8d0c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:36.970473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9ec7c3fe-d3e6-4785-9b2a-4cc03b9b8d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:37.066932 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1970/3920] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:37.081427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:37.083779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:37.174285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7c3fe-d3e6-4785-9b2a-4cc03b9b8d0c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:37.176708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9ec7c3fe-d3e6-4785-9b2a-4cc03b9b8d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:37.198821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7c3fe-d3e6-4785-9b2a-4cc03b9b8d0c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:37.207001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:37.208271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:37.208271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:37.208652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] PATH_INFO: `/v3/projects/fe151c445bb64766b4a8f2282ed2f1de` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:37.210162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe151c445bb64766b4a8f2282ed2f1de)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:37.213557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:37.245936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c05ba0-53a5-4e9d-81a2-af85c7de085b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:37.261099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe40fa-ba43-4cc1-b396-f7063e643ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:37.263111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe40fa-ba43-4cc1-b396-f7063e643ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:37.274820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe40fa-ba43-4cc1-b396-f7063e643ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:37.277314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe40fa-ba43-4cc1-b396-f7063e643ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:37.304221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe40fa-ba43-4cc1-b396-f7063e643ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:37.306252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe40fa-ba43-4cc1-b396-f7063e643ee7 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:37.310785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe151c445bb64766b4a8f2282ed2f1de', 'request_id': 'req-8db3fa8f-5366-47be-a11c-4143db804f9f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:37.317968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe151c445bb64766b4a8f2282ed2f1de', 'request_id': 'req-8db3fa8f-5366-47be-a11c-4143db804f9f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:37.337082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe151c445bb64766b4a8f2282ed2f1de', 'request_id': 'req-8db3fa8f-5366-47be-a11c-4143db804f9f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:37.349768 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1951/3921] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:37.357836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] The token cache is being invalidate because project fe151c445bb64766b4a8f2282ed2f1de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:37.358238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:37.359351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8db3fa8f-5366-47be-a11c-4143db804f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:37.362252 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1971/3922] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:37 2022] DELETE /identity/v3/projects/fe151c445bb64766b4a8f2282ed2f1de => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:37.367027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b146c-c132-4eea-bea3-9513b2e11305 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:37.367364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b146c-c132-4eea-bea3-9513b2e11305 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:37.367597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b146c-c132-4eea-bea3-9513b2e11305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:37.403527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0b6b146c-c132-4eea-bea3-9513b2e11305 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:37.407641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0b6b146c-c132-4eea-bea3-9513b2e11305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:37.654155 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1952/3923] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:37.661709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efff6-5994-4745-8941-db11f6b6eeb9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:37.662267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efff6-5994-4745-8941-db11f6b6eeb9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:37.662712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efff6-5994-4745-8941-db11f6b6eeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:37.697226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-821efff6-5994-4745-8941-db11f6b6eeb9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:37.698866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-821efff6-5994-4745-8941-db11f6b6eeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:37.713805 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1972/3924] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:37.714998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b146c-c132-4eea-bea3-9513b2e11305 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:37.729232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b146c-c132-4eea-bea3-9513b2e11305 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:37.739876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890953e-f3cd-4854-9f16-eed6dae7253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:37.741878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890953e-f3cd-4854-9f16-eed6dae7253d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:37.748484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890953e-f3cd-4854-9f16-eed6dae7253d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:37.749722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890953e-f3cd-4854-9f16-eed6dae7253d admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:37.757700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890953e-f3cd-4854-9f16-eed6dae7253d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:37.759485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890953e-f3cd-4854-9f16-eed6dae7253d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:37.761944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890953e-f3cd-4854-9f16-eed6dae7253d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:37.787276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821efff6-5994-4745-8941-db11f6b6eeb9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:37.794097 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1953/3925] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:37.802112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821efff6-5994-4745-8941-db11f6b6eeb9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:37.809030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39eb88-af58-4d11-a177-dcfaa7b5037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:37.809732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39eb88-af58-4d11-a177-dcfaa7b5037b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:37.810136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39eb88-af58-4d11-a177-dcfaa7b5037b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:37.810617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39eb88-af58-4d11-a177-dcfaa7b5037b admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:37.811944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39eb88-af58-4d11-a177-dcfaa7b5037b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:37.814827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39eb88-af58-4d11-a177-dcfaa7b5037b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:37.822232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:37.875880 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1973/3926] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:37 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:37.879465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890953e-f3cd-4854-9f16-eed6dae7253d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:37.894962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890953e-f3cd-4854-9f16-eed6dae7253d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:37.978355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2190246-6491-4f22-a1a0-03fd3faa0253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:37.978979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2190246-6491-4f22-a1a0-03fd3faa0253 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:37.979263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2190246-6491-4f22-a1a0-03fd3faa0253 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:37.979544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2190246-6491-4f22-a1a0-03fd3faa0253 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:37.980201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2190246-6491-4f22-a1a0-03fd3faa0253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:37.982723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2190246-6491-4f22-a1a0-03fd3faa0253 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:37.997230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:38.021658 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1954/3927] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:37 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:38.022709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39eb88-af58-4d11-a177-dcfaa7b5037b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:38.047344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39eb88-af58-4d11-a177-dcfaa7b5037b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:38.064285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933c9fd-cd64-4857-84b0-67c715fd6e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:38.065016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c9fd-cd64-4857-84b0-67c715fd6e9b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:38.065304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c9fd-cd64-4857-84b0-67c715fd6e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:38.065610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c9fd-cd64-4857-84b0-67c715fd6e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:38.066270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933c9fd-cd64-4857-84b0-67c715fd6e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:38.067893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933c9fd-cd64-4857-84b0-67c715fd6e9b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:38.089895 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1974/3928] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:42:38.091469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2190246-6491-4f22-a1a0-03fd3faa0253 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:38.106273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2190246-6491-4f22-a1a0-03fd3faa0253 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:38.121650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4311c4b-a0ca-406d-b273-c884a124fd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:38.122293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4311c4b-a0ca-406d-b273-c884a124fd6a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:38.123029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4311c4b-a0ca-406d-b273-c884a124fd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:38.123029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4311c4b-a0ca-406d-b273-c884a124fd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:38.123493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4311c4b-a0ca-406d-b273-c884a124fd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:38.125906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4311c4b-a0ca-406d-b273-c884a124fd6a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:38.145878 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1955/3929] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:38.150064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933c9fd-cd64-4857-84b0-67c715fd6e9b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:38.164793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933c9fd-cd64-4857-84b0-67c715fd6e9b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:38.183943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea60067-a1df-4bdf-a22a-33aebc1848ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:38.186949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60067-a1df-4bdf-a22a-33aebc1848ae admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:38.187568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60067-a1df-4bdf-a22a-33aebc1848ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:38.188201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60067-a1df-4bdf-a22a-33aebc1848ae admin admin] PATH_INFO: `/v3/projects/b02b576809484d8ba672697987f1447c/users/84feafb1d3ef4704a583d08c2e17b48c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:38.226675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4311c4b-a0ca-406d-b273-c884a124fd6a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:38.228949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f4311c4b-a0ca-406d-b273-c884a124fd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:38.232762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea60067-a1df-4bdf-a22a-33aebc1848ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02b576809484d8ba672697987f1447c, user_id=84feafb1d3ef4704a583d08c2e17b48c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:38.236120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea60067-a1df-4bdf-a22a-33aebc1848ae admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:38.246109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4311c4b-a0ca-406d-b273-c884a124fd6a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:38.254796 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1975/3930] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:38 2022] PUT /identity/v3/projects/b02b576809484d8ba672697987f1447c/users/84feafb1d3ef4704a583d08c2e17b48c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:38.259708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d03f09-3840-4810-b3ab-e601243f2895 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:38.260236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d03f09-3840-4810-b3ab-e601243f2895 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:38.260683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d03f09-3840-4810-b3ab-e601243f2895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:38.302210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-76d03f09-3840-4810-b3ab-e601243f2895 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:38.303745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-76d03f09-3840-4810-b3ab-e601243f2895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:38.350772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:38.351499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:38.351883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:38.352273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] PATH_INFO: `/v3/projects/0c5cbd9fc0a84b29b04336e92d082fe4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:38.354168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5cbd9fc0a84b29b04336e92d082fe4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:38.357810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:38.382904 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1976/3931] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:38.394646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d03f09-3840-4810-b3ab-e601243f2895 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:38.399001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-76d03f09-3840-4810-b3ab-e601243f2895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:38.417674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d03f09-3840-4810-b3ab-e601243f2895 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:38.425149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:38.425832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:38.426107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:38.426373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] PATH_INFO: `/v3/users/bb6c138e67fa4aa9805412ba7283592c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:38.427759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6c138e67fa4aa9805412ba7283592c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:38.441953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:38.459196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5cbd9fc0a84b29b04336e92d082fe4', 'request_id': 'req-34804ea0-9696-4f3b-af1d-b481442a9600'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.473990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5cbd9fc0a84b29b04336e92d082fe4', 'request_id': 'req-34804ea0-9696-4f3b-af1d-b481442a9600'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.487501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5cbd9fc0a84b29b04336e92d082fe4', 'request_id': 'req-34804ea0-9696-4f3b-af1d-b481442a9600'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.505699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] The token cache is being invalidate because project 0c5cbd9fc0a84b29b04336e92d082fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:38.505994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.506891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.509312 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1956/3932] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:38 2022] DELETE /identity/v3/projects/0c5cbd9fc0a84b29b04336e92d082fe4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:38.510249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:38.510791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6c138e67fa4aa9805412ba7283592c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.511694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:38.512106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6c138e67fa4aa9805412ba7283592c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.534690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6c138e67fa4aa9805412ba7283592c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.535825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6c138e67fa4aa9805412ba7283592c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.547339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6c138e67fa4aa9805412ba7283592c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.574273 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1977/3933] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:38 2022] DELETE /identity/v3/users/bb6c138e67fa4aa9805412ba7283592c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:38.575900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:38.581846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:38.602443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34804ea0-9696-4f3b-af1d-b481442a9600 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:38.629082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:38.662432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:38.681376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dedea-7817-4815-8328-031bb5108d58 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:38.687657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8e748-93a0-4984-9f90-dfbd49923d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:38.688565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e748-93a0-4984-9f90-dfbd49923d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:38.688866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e748-93a0-4984-9f90-dfbd49923d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:38.689179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e748-93a0-4984-9f90-dfbd49923d74 admin admin] PATH_INFO: `/v3/users/9a9829fcee6949e69dca6428a146ac14` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:38.690738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8e748-93a0-4984-9f90-dfbd49923d74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a9829fcee6949e69dca6428a146ac14)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:38.693664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8e748-93a0-4984-9f90-dfbd49923d74 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:38.744477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5cde-6d36-48e9-886b-a0a935f732b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:38.745495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5cde-6d36-48e9-886b-a0a935f732b0 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:38.747935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5cde-6d36-48e9-886b-a0a935f732b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:38.747935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5cde-6d36-48e9-886b-a0a935f732b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:38.748838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-09ee5cde-6d36-48e9-886b-a0a935f732b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:38.765800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee5cde-6d36-48e9-886b-a0a935f732b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:38.767797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee5cde-6d36-48e9-886b-a0a935f732b0 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:38.786710 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1957/3934] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:38.810699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-46b8e748-93a0-4984-9f90-dfbd49923d74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a9829fcee6949e69dca6428a146ac14'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.812432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-46b8e748-93a0-4984-9f90-dfbd49923d74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a9829fcee6949e69dca6428a146ac14'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.845471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-46b8e748-93a0-4984-9f90-dfbd49923d74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a9829fcee6949e69dca6428a146ac14'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.847314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-46b8e748-93a0-4984-9f90-dfbd49923d74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a9829fcee6949e69dca6428a146ac14'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.862248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-46b8e748-93a0-4984-9f90-dfbd49923d74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a9829fcee6949e69dca6428a146ac14'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:38.894382 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1978/3935] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:38 2022] DELETE /identity/v3/users/9a9829fcee6949e69dca6428a146ac14 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:39.360334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5cde-6d36-48e9-886b-a0a935f732b0 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:39.363161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-09ee5cde-6d36-48e9-886b-a0a935f732b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:39.380690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5cde-6d36-48e9-886b-a0a935f732b0 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:39.463376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:39.464457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:39.464834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:39.465218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] PATH_INFO: `/v3/projects/0340e062377e49ff99fabbc16cc73c9a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:39.466736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0340e062377e49ff99fabbc16cc73c9a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:39.469508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:39.554668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0340e062377e49ff99fabbc16cc73c9a', 'request_id': 'req-0680f783-95de-4f50-b259-d8805117236a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:39.563793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0340e062377e49ff99fabbc16cc73c9a', 'request_id': 'req-0680f783-95de-4f50-b259-d8805117236a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:39.572294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0340e062377e49ff99fabbc16cc73c9a', 'request_id': 'req-0680f783-95de-4f50-b259-d8805117236a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:39.586424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] The token cache is being invalidate because project 0340e062377e49ff99fabbc16cc73c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:39.586993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:39.588020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0680f783-95de-4f50-b259-d8805117236a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:39.589754 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1958/3936] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:39 2022] DELETE /identity/v3/projects/0340e062377e49ff99fabbc16cc73c9a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:39.598472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef948130-35af-4925-9d91-5aeb19955132 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:39.602100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef948130-35af-4925-9d91-5aeb19955132 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:39.604009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef948130-35af-4925-9d91-5aeb19955132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:39.634017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ef948130-35af-4925-9d91-5aeb19955132 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:39.635224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ef948130-35af-4925-9d91-5aeb19955132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:39.780988 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1979/3937] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:39.790565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79350e1e-444d-4bff-b4c2-6effee4fa96c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:39.791379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79350e1e-444d-4bff-b4c2-6effee4fa96c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:39.791835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79350e1e-444d-4bff-b4c2-6effee4fa96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:39.819161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-79350e1e-444d-4bff-b4c2-6effee4fa96c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:39.820588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-79350e1e-444d-4bff-b4c2-6effee4fa96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:39.834822 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1959/3938] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:39.839695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef948130-35af-4925-9d91-5aeb19955132 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:39.854727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef948130-35af-4925-9d91-5aeb19955132 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:39.861803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79350e1e-444d-4bff-b4c2-6effee4fa96c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:39.865013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-79350e1e-444d-4bff-b4c2-6effee4fa96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:39.865422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fd402-a679-4d36-a295-383aa4441c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:39.866366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fd402-a679-4d36-a295-383aa4441c72 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:39.866898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fd402-a679-4d36-a295-383aa4441c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:39.867404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fd402-a679-4d36-a295-383aa4441c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:39.868372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fd402-a679-4d36-a295-383aa4441c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:39.868893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fd402-a679-4d36-a295-383aa4441c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:39.870853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fd402-a679-4d36-a295-383aa4441c72 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:39.892331 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1980/3939] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:39.893639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fd402-a679-4d36-a295-383aa4441c72 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:39.894271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79350e1e-444d-4bff-b4c2-6effee4fa96c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:39.899949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:39.900595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:39.901044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:39.901329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] PATH_INFO: `/v3/projects/0f8745c693a041c69b58d922abd9708b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:39.903295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f8745c693a041c69b58d922abd9708b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:39.905708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:39.908756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fd402-a679-4d36-a295-383aa4441c72 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:39.916013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28539a8-3bc8-4f53-8d10-fc52767b588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:39.916784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28539a8-3bc8-4f53-8d10-fc52767b588d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:39.917430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28539a8-3bc8-4f53-8d10-fc52767b588d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:39.917838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28539a8-3bc8-4f53-8d10-fc52767b588d admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:39.918892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28539a8-3bc8-4f53-8d10-fc52767b588d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:39.921834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28539a8-3bc8-4f53-8d10-fc52767b588d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:39.974702 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1981/3940] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:39 2022] POST /identity/v3/projects => generated 399 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:39.979344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28539a8-3bc8-4f53-8d10-fc52767b588d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:39.989547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:39.992243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f8745c693a041c69b58d922abd9708b', 'request_id': 'req-fdbe6e53-c0e5-46e2-8188-8ed91373c442'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:39.993909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:40.004968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f8745c693a041c69b58d922abd9708b', 'request_id': 'req-fdbe6e53-c0e5-46e2-8188-8ed91373c442'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:40.019614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f8745c693a041c69b58d922abd9708b', 'request_id': 'req-fdbe6e53-c0e5-46e2-8188-8ed91373c442'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:40.046346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] The token cache is being invalidate because project 0f8745c693a041c69b58d922abd9708b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:40.046793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:40.048392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdbe6e53-c0e5-46e2-8188-8ed91373c442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:40.050536 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1960/3941] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:39 2022] DELETE /identity/v3/projects/0f8745c693a041c69b58d922abd9708b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:40.056917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b533-b02c-4dd2-ad06-3b858d36f004 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.057333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b533-b02c-4dd2-ad06-3b858d36f004 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.057732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956b533-b02c-4dd2-ad06-3b858d36f004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.083948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4956b533-b02c-4dd2-ad06-3b858d36f004 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:40.085362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4956b533-b02c-4dd2-ad06-3b858d36f004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:40.096473 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1961/3942] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:40.098362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28539a8-3bc8-4f53-8d10-fc52767b588d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.106368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3c335-94b2-4914-ac5e-0fb16849463d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.107284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3c335-94b2-4914-ac5e-0fb16849463d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.107661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3c335-94b2-4914-ac5e-0fb16849463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.110349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8c59-658f-432e-9ed1-4f393a2a6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:40.111583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8c59-658f-432e-9ed1-4f393a2a6e92 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.111949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8c59-658f-432e-9ed1-4f393a2a6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.112300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8c59-658f-432e-9ed1-4f393a2a6e92 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.113013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc8c59-658f-432e-9ed1-4f393a2a6e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:40.115082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc8c59-658f-432e-9ed1-4f393a2a6e92 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:40.149650 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1982/3943] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:39 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:40.150748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8c59-658f-432e-9ed1-4f393a2a6e92 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:40.151509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-04d3c335-94b2-4914-ac5e-0fb16849463d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:40.152664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a2cc8c59-658f-432e-9ed1-4f393a2a6e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:40.156779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-04d3c335-94b2-4914-ac5e-0fb16849463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:40.168269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8c59-658f-432e-9ed1-4f393a2a6e92 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.173229 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1962/3944] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:40.177532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3c335-94b2-4914-ac5e-0fb16849463d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:40.177894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aba1a1-982d-47a2-a6f8-58896a911138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:40.178867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba1a1-982d-47a2-a6f8-58896a911138 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.179146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba1a1-982d-47a2-a6f8-58896a911138 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.179631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba1a1-982d-47a2-a6f8-58896a911138 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.180316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba1a1-982d-47a2-a6f8-58896a911138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:40.181986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba1a1-982d-47a2-a6f8-58896a911138 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:40.191614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3c335-94b2-4914-ac5e-0fb16849463d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.200279 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1983/3945] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:42:40.204015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fda9b-5654-4b32-a730-2d6a29d4ed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:40.205974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fda9b-5654-4b32-a730-2d6a29d4ed2d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.206297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aba1a1-982d-47a2-a6f8-58896a911138 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:40.207181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fda9b-5654-4b32-a730-2d6a29d4ed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.208075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fda9b-5654-4b32-a730-2d6a29d4ed2d admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.210357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fda9b-5654-4b32-a730-2d6a29d4ed2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:40.210866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fda9b-5654-4b32-a730-2d6a29d4ed2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:40.216047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fda9b-5654-4b32-a730-2d6a29d4ed2d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:40.222619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aba1a1-982d-47a2-a6f8-58896a911138 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.228654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dedb16-e97f-41ba-81c3-d72a862ad3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:40.229491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedb16-e97f-41ba-81c3-d72a862ad3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.229902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedb16-e97f-41ba-81c3-d72a862ad3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.230410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedb16-e97f-41ba-81c3-d72a862ad3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.231191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dedb16-e97f-41ba-81c3-d72a862ad3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:40.232939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dedb16-e97f-41ba-81c3-d72a862ad3b6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:40.237610 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1963/3946] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:42:40.239973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fda9b-5654-4b32-a730-2d6a29d4ed2d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:40.254168 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1984/3947] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:40.256143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dedb16-e97f-41ba-81c3-d72a862ad3b6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:40.267099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fda9b-5654-4b32-a730-2d6a29d4ed2d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.269601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dedb16-e97f-41ba-81c3-d72a862ad3b6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.276350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936a0b6-bac9-4b23-a9aa-8728526bf022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:40.277191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a0b6-bac9-4b23-a9aa-8728526bf022 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.277610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a0b6-bac9-4b23-a9aa-8728526bf022 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.277995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a0b6-bac9-4b23-a9aa-8728526bf022 admin admin] PATH_INFO: `/v3/projects/883fcc619d694f89960bac6e7cb9c488/users/87ab13dbc341434db7373fb4772fdf07/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.279084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d9984-d2b1-4b06-98bc-123f1818b61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:40.280583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9984-d2b1-4b06-98bc-123f1818b61e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.283349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9984-d2b1-4b06-98bc-123f1818b61e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.283823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d9984-d2b1-4b06-98bc-123f1818b61e admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.284693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d9984-d2b1-4b06-98bc-123f1818b61e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:40.287747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d9984-d2b1-4b06-98bc-123f1818b61e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:40.297127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936a0b6-bac9-4b23-a9aa-8728526bf022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883fcc619d694f89960bac6e7cb9c488, user_id=87ab13dbc341434db7373fb4772fdf07, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:40.300075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936a0b6-bac9-4b23-a9aa-8728526bf022 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:40.328729 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1985/3948] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:40 2022] PUT /identity/v3/projects/883fcc619d694f89960bac6e7cb9c488/users/87ab13dbc341434db7373fb4772fdf07/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:40.330833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbf180-71e1-4239-8b6e-74db0cbe4e49 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.331196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbf180-71e1-4239-8b6e-74db0cbe4e49 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.331733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbf180-71e1-4239-8b6e-74db0cbe4e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.338023 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1964/3949] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:40 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:40.341866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d9984-d2b1-4b06-98bc-123f1818b61e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:40.357981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-efcbf180-71e1-4239-8b6e-74db0cbe4e49 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:40.359558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-efcbf180-71e1-4239-8b6e-74db0cbe4e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:40.431008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d9984-d2b1-4b06-98bc-123f1818b61e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.437078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4eb38-c043-4d96-b000-b20c631f0bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:40.437780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4eb38-c043-4d96-b000-b20c631f0bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.438069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4eb38-c043-4d96-b000-b20c631f0bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.438349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4eb38-c043-4d96-b000-b20c631f0bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.439032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4eb38-c043-4d96-b000-b20c631f0bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:40.440949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4eb38-c043-4d96-b000-b20c631f0bb5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:40.442779 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1986/3950] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:40.455192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbf180-71e1-4239-8b6e-74db0cbe4e49 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:40.456916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-efcbf180-71e1-4239-8b6e-74db0cbe4e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:40.467326 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1965/3951] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:40 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:40.471111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4eb38-c043-4d96-b000-b20c631f0bb5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:40.481567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4eb38-c043-4d96-b000-b20c631f0bb5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.488895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0617b-d9b9-400f-80d0-fa74885801ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:40.489731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0617b-d9b9-400f-80d0-fa74885801ad admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.490104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0617b-d9b9-400f-80d0-fa74885801ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.490488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0617b-d9b9-400f-80d0-fa74885801ad admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.491243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0617b-d9b9-400f-80d0-fa74885801ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:40.492943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0617b-d9b9-400f-80d0-fa74885801ad admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:40.506620 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1966/3952] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:40.510740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0617b-d9b9-400f-80d0-fa74885801ad admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:40.522679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0617b-d9b9-400f-80d0-fa74885801ad admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.528995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18ecfb-7737-4769-b54e-50ff35754149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:40.529656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ecfb-7737-4769-b54e-50ff35754149 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.529978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ecfb-7737-4769-b54e-50ff35754149 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.530254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ecfb-7737-4769-b54e-50ff35754149 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.530925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18ecfb-7737-4769-b54e-50ff35754149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:40.532534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18ecfb-7737-4769-b54e-50ff35754149 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:40.548353 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1967/3953] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:42:40.549136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbf180-71e1-4239-8b6e-74db0cbe4e49 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.549557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18ecfb-7737-4769-b54e-50ff35754149 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:40.554010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931327d-d8a1-4ce5-93a5-afe184b23fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:40.555010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931327d-d8a1-4ce5-93a5-afe184b23fdd service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.555356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931327d-d8a1-4ce5-93a5-afe184b23fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.555727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931327d-d8a1-4ce5-93a5-afe184b23fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.560374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18ecfb-7737-4769-b54e-50ff35754149 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.564879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:40.566263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d43b0-e48a-4c05-9bad-9423ac8625c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:40.567678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d43b0-e48a-4c05-9bad-9423ac8625c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.567678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d43b0-e48a-4c05-9bad-9423ac8625c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.567678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d43b0-e48a-4c05-9bad-9423ac8625c3 admin admin] PATH_INFO: `/v3/projects/f5a6bb787dc04d4291f55e88a6794199/users/eb8a88c775ea486f9b35c5bacae462f9/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.571873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931327d-d8a1-4ce5-93a5-afe184b23fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:40.573298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931327d-d8a1-4ce5-93a5-afe184b23fdd service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:40.592040 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1987/3954] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:40.602945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d43b0-e48a-4c05-9bad-9423ac8625c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a6bb787dc04d4291f55e88a6794199, user_id=eb8a88c775ea486f9b35c5bacae462f9, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:40.605935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d43b0-e48a-4c05-9bad-9423ac8625c3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:40.629835 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1968/3955] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:40 2022] PUT /identity/v3/projects/f5a6bb787dc04d4291f55e88a6794199/users/eb8a88c775ea486f9b35c5bacae462f9/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:40.642025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954427-105f-4101-b3da-80beee217bc0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:40.642589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954427-105f-4101-b3da-80beee217bc0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:40.642716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954427-105f-4101-b3da-80beee217bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:40.690691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-56954427-105f-4101-b3da-80beee217bc0 None None] MFA Rules not processed for user `eb8a88c775ea486f9b35c5bacae462f9`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:40.692202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-56954427-105f-4101-b3da-80beee217bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:40.812926 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1988/3956] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:40.813128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d43b0-e48a-4c05-9bad-9423ac8625c3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:40.924212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:40.990428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d43b0-e48a-4c05-9bad-9423ac8625c3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:40.999197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0059c-5511-42e7-bb9b-52b46f363471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:41.000151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0059c-5511-42e7-bb9b-52b46f363471 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:41.001534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0059c-5511-42e7-bb9b-52b46f363471 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:41.001995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0059c-5511-42e7-bb9b-52b46f363471 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:41.003153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0059c-5511-42e7-bb9b-52b46f363471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:41.005736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0059c-5511-42e7-bb9b-52b46f363471 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:41.101805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56954427-105f-4101-b3da-80beee217bc0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:41.102900 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1969/3957] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:40 2022] POST /identity/v3/projects => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:42:41.121980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56954427-105f-4101-b3da-80beee217bc0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:41.212339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a01c-6e55-4a18-ba48-c37c584a68b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:41.213459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a01c-6e55-4a18-ba48-c37c584a68b4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:41.213960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a01c-6e55-4a18-ba48-c37c584a68b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:41.214573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a01c-6e55-4a18-ba48-c37c584a68b4 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:41.215679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39a01c-6e55-4a18-ba48-c37c584a68b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:41.218147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39a01c-6e55-4a18-ba48-c37c584a68b4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:41.253747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0059c-5511-42e7-bb9b-52b46f363471 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:41.273519 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1989/3958] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:41 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:41.278668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0059c-5511-42e7-bb9b-52b46f363471 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:41.286660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff18e5-2b8f-41a8-ae1e-dd2037a7f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:41.287299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff18e5-2b8f-41a8-ae1e-dd2037a7f217 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:41.287580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff18e5-2b8f-41a8-ae1e-dd2037a7f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:41.287856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff18e5-2b8f-41a8-ae1e-dd2037a7f217 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:41.288712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff18e5-2b8f-41a8-ae1e-dd2037a7f217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:41.291011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff18e5-2b8f-41a8-ae1e-dd2037a7f217 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:41.315306 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1970/3959] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:41.315924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a01c-6e55-4a18-ba48-c37c584a68b4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:41.332903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a01c-6e55-4a18-ba48-c37c584a68b4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:41.343131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d52ae-0348-43b2-8027-b43e58c8b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:41.343762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d52ae-0348-43b2-8027-b43e58c8b170 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:41.344042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d52ae-0348-43b2-8027-b43e58c8b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:41.344316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d52ae-0348-43b2-8027-b43e58c8b170 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:41.349040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d52ae-0348-43b2-8027-b43e58c8b170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:41.350864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d52ae-0348-43b2-8027-b43e58c8b170 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:41.364697 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1990/3960] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:41.369706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff18e5-2b8f-41a8-ae1e-dd2037a7f217 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:41.383044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff18e5-2b8f-41a8-ae1e-dd2037a7f217 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:41.389951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b49a8-4e64-4b1c-900f-00b93bbdeb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:41.390730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b49a8-4e64-4b1c-900f-00b93bbdeb5c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:41.391583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b49a8-4e64-4b1c-900f-00b93bbdeb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:41.391583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b49a8-4e64-4b1c-900f-00b93bbdeb5c admin admin] PATH_INFO: `/v3/projects/c5cc2c5ee762499299554e469fe395b5/users/99813003d5a74b89aae2d4ec2f8f7873/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:41.412735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b49a8-4e64-4b1c-900f-00b93bbdeb5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cc2c5ee762499299554e469fe395b5, user_id=99813003d5a74b89aae2d4ec2f8f7873, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:41.415657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b49a8-4e64-4b1c-900f-00b93bbdeb5c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:41.441775 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1971/3961] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:41 2022] PUT /identity/v3/projects/c5cc2c5ee762499299554e469fe395b5/users/99813003d5a74b89aae2d4ec2f8f7873/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:41.448549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65566f72-ba83-47f1-ab8f-ce00db72c002 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:41.448783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65566f72-ba83-47f1-ab8f-ce00db72c002 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:41.449058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65566f72-ba83-47f1-ab8f-ce00db72c002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:41.499793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-65566f72-ba83-47f1-ab8f-ce00db72c002 None None] MFA Rules not processed for user `99813003d5a74b89aae2d4ec2f8f7873`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:41.501879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-65566f72-ba83-47f1-ab8f-ce00db72c002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:41.594376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:41.627312 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1991/3962] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:41.631362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b49a8-4e64-4b1c-900f-00b93bbdeb5c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:41.720636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b49a8-4e64-4b1c-900f-00b93bbdeb5c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:41.727059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03688787-3fbc-4c2f-a8ac-438b68c3a55c tempest-IdentityV3ProjectsTest-580359899 tempest-IdentityV3ProjectsTest-580359899-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb8a88c775ea486f9b35c5bacae462f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a6bb787dc04d4291f55e88a6794199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:41.727730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688787-3fbc-4c2f-a8ac-438b68c3a55c tempest-IdentityV3ProjectsTest-580359899 tempest-IdentityV3ProjectsTest-580359899-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:41.728073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688787-3fbc-4c2f-a8ac-438b68c3a55c tempest-IdentityV3ProjectsTest-580359899 tempest-IdentityV3ProjectsTest-580359899-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:41.728588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03688787-3fbc-4c2f-a8ac-438b68c3a55c tempest-IdentityV3ProjectsTest-580359899 tempest-IdentityV3ProjectsTest-580359899-project] PATH_INFO: `/v3/users/eb8a88c775ea486f9b35c5bacae462f9/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:41.730918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03688787-3fbc-4c2f-a8ac-438b68c3a55c tempest-IdentityV3ProjectsTest-580359899 tempest-IdentityV3ProjectsTest-580359899-project] RBAC: Authorizing `identity:list_user_projects(user_id=eb8a88c775ea486f9b35c5bacae462f9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:41.733823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03688787-3fbc-4c2f-a8ac-438b68c3a55c tempest-IdentityV3ProjectsTest-580359899 tempest-IdentityV3ProjectsTest-580359899-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:41.819079 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1972/3963] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:42:41 2022] GET /identity/v3/users/eb8a88c775ea486f9b35c5bacae462f9/projects => generated 515 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:41.821323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b038959-95e3-40ca-be91-27cfc945d0a0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:41.822096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b038959-95e3-40ca-be91-27cfc945d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:41.822574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b038959-95e3-40ca-be91-27cfc945d0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:41.861431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2b038959-95e3-40ca-be91-27cfc945d0a0 None None] MFA Rules not processed for user `eb8a88c775ea486f9b35c5bacae462f9`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:41.865001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2b038959-95e3-40ca-be91-27cfc945d0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:41.876258 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1992/3964] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:41.882395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca236d1-61b9-40bf-809b-40481e44597c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:41.883514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca236d1-61b9-40bf-809b-40481e44597c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:41.883959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca236d1-61b9-40bf-809b-40481e44597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:41.908860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fca236d1-61b9-40bf-809b-40481e44597c None None] MFA Rules not processed for user `eb8a88c775ea486f9b35c5bacae462f9`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:41.910135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fca236d1-61b9-40bf-809b-40481e44597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:41.973785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.models.token_model [None req-fca236d1-61b9-40bf-809b-40481e44597c None None] User eb8a88c775ea486f9b35c5bacae462f9 has no access to project c5cc2c5ee762499299554e469fe395b5 {{(pid=89680) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Aug 29 15:42:41.977907 n-d-854882-3 devstack@keystone.service[89680]: WARNING keystone.server.flask.application [None req-fca236d1-61b9-40bf-809b-40481e44597c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 15:42:41.983486 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1973/3965] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:41 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 98 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 29 15:42:41.984801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b038959-95e3-40ca-be91-27cfc945d0a0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:42.114788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b038959-95e3-40ca-be91-27cfc945d0a0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:42.120039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da95e85-a076-4df4-818e-d7895304fc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:42.120853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95e85-a076-4df4-818e-d7895304fc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:42.121137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95e85-a076-4df4-818e-d7895304fc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:42.121443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95e85-a076-4df4-818e-d7895304fc47 admin admin] PATH_INFO: `/v3/users/eb8a88c775ea486f9b35c5bacae462f9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:42.122659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da95e85-a076-4df4-818e-d7895304fc47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8a88c775ea486f9b35c5bacae462f9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:42.125124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da95e85-a076-4df4-818e-d7895304fc47 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:42.188674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7da95e85-a076-4df4-818e-d7895304fc47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8a88c775ea486f9b35c5bacae462f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:42.189514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7da95e85-a076-4df4-818e-d7895304fc47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8a88c775ea486f9b35c5bacae462f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:42.216935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7da95e85-a076-4df4-818e-d7895304fc47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8a88c775ea486f9b35c5bacae462f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:42.218118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7da95e85-a076-4df4-818e-d7895304fc47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8a88c775ea486f9b35c5bacae462f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:42.237156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7da95e85-a076-4df4-818e-d7895304fc47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8a88c775ea486f9b35c5bacae462f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:42.260990 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1993/3966] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:41 2022] DELETE /identity/v3/users/eb8a88c775ea486f9b35c5bacae462f9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:42.267728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc40c3-1a92-44ee-adb2-835a10313d04 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:42.268029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc40c3-1a92-44ee-adb2-835a10313d04 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:42.268436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc40c3-1a92-44ee-adb2-835a10313d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:42.287791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:42.298213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fdcc40c3-1a92-44ee-adb2-835a10313d04 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:42.300437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fdcc40c3-1a92-44ee-adb2-835a10313d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:42.348356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255bde-3068-4e90-9117-096ad203c129 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:42.348769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255bde-3068-4e90-9117-096ad203c129 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:42.349167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255bde-3068-4e90-9117-096ad203c129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:42.391349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2f255bde-3068-4e90-9117-096ad203c129 None None] MFA Rules not processed for user `550baba8a2304466962f501a027d7a82`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:42.393284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2f255bde-3068-4e90-9117-096ad203c129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:42.396721 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1974/3967] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:42.407419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc40c3-1a92-44ee-adb2-835a10313d04 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:42.409364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fdcc40c3-1a92-44ee-adb2-835a10313d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:42.510026 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1994/3968] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:42.524904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9c39-4b90-4e4d-af52-9417ec82d83c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:42.525368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9c39-4b90-4e4d-af52-9417ec82d83c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:42.526459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9c39-4b90-4e4d-af52-9417ec82d83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:42.538455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:42.543729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc40c3-1a92-44ee-adb2-835a10313d04 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:42.548694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce95ce-dfe1-457d-afa8-2fb0da07d752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:42.549369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce95ce-dfe1-457d-afa8-2fb0da07d752 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:42.549667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce95ce-dfe1-457d-afa8-2fb0da07d752 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:42.549950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce95ce-dfe1-457d-afa8-2fb0da07d752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:42.564311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce95ce-dfe1-457d-afa8-2fb0da07d752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:42.566020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce95ce-dfe1-457d-afa8-2fb0da07d752 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:42.571019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-98ec9c39-4b90-4e4d-af52-9417ec82d83c None None] MFA Rules not processed for user `550baba8a2304466962f501a027d7a82`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:42.572290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-98ec9c39-4b90-4e4d-af52-9417ec82d83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:42.581356 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1975/3969] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:42:42.585425 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1995/3970] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:44.427992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce95ce-dfe1-457d-afa8-2fb0da07d752 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:44.441600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce95ce-dfe1-457d-afa8-2fb0da07d752 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:44.454250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d21e0d-4f82-498a-8357-640dd0da18ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:44.455262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d21e0d-4f82-498a-8357-640dd0da18ac service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:44.455706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d21e0d-4f82-498a-8357-640dd0da18ac service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:44.456151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d21e0d-4f82-498a-8357-640dd0da18ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:44.462377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d8d21e0d-4f82-498a-8357-640dd0da18ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:44.493325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d21e0d-4f82-498a-8357-640dd0da18ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:44.495117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d21e0d-4f82-498a-8357-640dd0da18ac service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:44.510242 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1976/3971] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:44.576624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec9c39-4b90-4e4d-af52-9417ec82d83c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:44.579270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-98ec9c39-4b90-4e4d-af52-9417ec82d83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:44.601110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec9c39-4b90-4e4d-af52-9417ec82d83c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:44.616715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:44.617422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:44.617686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:44.617955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] PATH_INFO: `/v3/projects/f5a6bb787dc04d4291f55e88a6794199` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:44.619138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a6bb787dc04d4291f55e88a6794199)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:44.622155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:44.701050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a6bb787dc04d4291f55e88a6794199', 'request_id': 'req-4dc1e302-1e32-44a0-93b3-bb97592276f6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:44.727707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a6bb787dc04d4291f55e88a6794199', 'request_id': 'req-4dc1e302-1e32-44a0-93b3-bb97592276f6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:44.751718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a6bb787dc04d4291f55e88a6794199', 'request_id': 'req-4dc1e302-1e32-44a0-93b3-bb97592276f6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:44.768350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] The token cache is being invalidate because project f5a6bb787dc04d4291f55e88a6794199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:44.768990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:44.769950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:44.772401 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1996/3972] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:44 2022] DELETE /identity/v3/projects/f5a6bb787dc04d4291f55e88a6794199 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:44.776281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d21e0d-4f82-498a-8357-640dd0da18ac service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:44.799469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d21e0d-4f82-498a-8357-640dd0da18ac service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:44.947097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e55db-b5f0-48ad-8794-5a6bc8d140b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:44.947849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e55db-b5f0-48ad-8794-5a6bc8d140b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:44.948139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e55db-b5f0-48ad-8794-5a6bc8d140b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:44.948420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e55db-b5f0-48ad-8794-5a6bc8d140b8 admin admin] PATH_INFO: `/v3/users/99813003d5a74b89aae2d4ec2f8f7873` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:44.949678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e55db-b5f0-48ad-8794-5a6bc8d140b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99813003d5a74b89aae2d4ec2f8f7873)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:44.951802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e55db-b5f0-48ad-8794-5a6bc8d140b8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:45.043890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:45.060276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d19e55db-b5f0-48ad-8794-5a6bc8d140b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99813003d5a74b89aae2d4ec2f8f7873'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:45.061788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d19e55db-b5f0-48ad-8794-5a6bc8d140b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99813003d5a74b89aae2d4ec2f8f7873'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:45.098571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d19e55db-b5f0-48ad-8794-5a6bc8d140b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99813003d5a74b89aae2d4ec2f8f7873'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:45.121086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d19e55db-b5f0-48ad-8794-5a6bc8d140b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99813003d5a74b89aae2d4ec2f8f7873'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:45.143983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d19e55db-b5f0-48ad-8794-5a6bc8d140b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99813003d5a74b89aae2d4ec2f8f7873'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:45.175498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1977/3973] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:44 2022] DELETE /identity/v3/users/99813003d5a74b89aae2d4ec2f8f7873 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:46.948957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:46.950518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:46.974563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1e302-1e32-44a0-93b3-bb97592276f6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:47.126623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:47.128206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:47.129210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:47.129704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] PATH_INFO: `/v3/projects/c5cc2c5ee762499299554e469fe395b5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:47.135341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5cc2c5ee762499299554e469fe395b5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:47.137317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:47.254834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5cc2c5ee762499299554e469fe395b5', 'request_id': 'req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:47.261886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5cc2c5ee762499299554e469fe395b5', 'request_id': 'req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:47.286064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5cc2c5ee762499299554e469fe395b5', 'request_id': 'req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:47.301272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e47252-d6ee-4c12-94b2-66f9546ca36e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:47.302250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e47252-d6ee-4c12-94b2-66f9546ca36e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:47.302730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e47252-d6ee-4c12-94b2-66f9546ca36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:47.326836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] The token cache is being invalidate because project c5cc2c5ee762499299554e469fe395b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:47.329420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:47.330901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b93dc8a7-9c13-428a-9a01-bfb51c8ecde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:47.334425 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1997/3974] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:46 2022] DELETE /identity/v3/projects/c5cc2c5ee762499299554e469fe395b5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:47.343875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e18377-8662-4680-abf0-cdaacf13f088 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:47.351270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e18377-8662-4680-abf0-cdaacf13f088 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:47.351829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e18377-8662-4680-abf0-cdaacf13f088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:47.376029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-08e47252-d6ee-4c12-94b2-66f9546ca36e None None] MFA Rules not processed for user `351e59b6021b44a29665281568960f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:47.379011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-08e47252-d6ee-4c12-94b2-66f9546ca36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:47.390283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-80e18377-8662-4680-abf0-cdaacf13f088 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:47.393030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-80e18377-8662-4680-abf0-cdaacf13f088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:47.404386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:47.553271 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1998/3975] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:47.562644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52a7a7-97f4-49cc-96e6-7c82d1af2449 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:47.564002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52a7a7-97f4-49cc-96e6-7c82d1af2449 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:47.564397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52a7a7-97f4-49cc-96e6-7c82d1af2449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:47.565811 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1978/3976] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:47.656756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9577e4-39b8-43ed-9fd8-482b322cc23d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:47.657132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9577e4-39b8-43ed-9fd8-482b322cc23d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:47.657355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9577e4-39b8-43ed-9fd8-482b322cc23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:47.661069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7a52a7a7-97f4-49cc-96e6-7c82d1af2449 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:47.664126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7a52a7a7-97f4-49cc-96e6-7c82d1af2449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:47.681471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-dd9577e4-39b8-43ed-9fd8-482b322cc23d None None] MFA Rules not processed for user `351e59b6021b44a29665281568960f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:47.683240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dd9577e4-39b8-43ed-9fd8-482b322cc23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:47.690489 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 1999/3977] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:47.695969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52a7a7-97f4-49cc-96e6-7c82d1af2449 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:47.714262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52a7a7-97f4-49cc-96e6-7c82d1af2449 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:47.724692 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1979/3978] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:47.727603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d457-6663-4bb8-9218-045db3cff653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:47.728496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d457-6663-4bb8-9218-045db3cff653 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:47.728786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d457-6663-4bb8-9218-045db3cff653 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:47.729059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d457-6663-4bb8-9218-045db3cff653 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:47.729769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0d457-6663-4bb8-9218-045db3cff653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:47.730064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0d457-6663-4bb8-9218-045db3cff653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:47.731677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0d457-6663-4bb8-9218-045db3cff653 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:47.761855 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2000/3979] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:47.763877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9577e4-39b8-43ed-9fd8-482b322cc23d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:47.780776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9577e4-39b8-43ed-9fd8-482b322cc23d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:47.786568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9ee5c-bb46-479a-8ff4-17ee371f7203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:47.787500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ee5c-bb46-479a-8ff4-17ee371f7203 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:47.787930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ee5c-bb46-479a-8ff4-17ee371f7203 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:47.788347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ee5c-bb46-479a-8ff4-17ee371f7203 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:47.789342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9ee5c-bb46-479a-8ff4-17ee371f7203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:47.795126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9ee5c-bb46-479a-8ff4-17ee371f7203 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:47.839816 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1980/3980] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:47 2022] POST /identity/v3/projects => generated 399 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:42:47.845145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d457-6663-4bb8-9218-045db3cff653 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:47.859334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d457-6663-4bb8-9218-045db3cff653 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:47.944435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05f8e-a94d-4d4b-9ff2-f13946f6fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:47.945311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05f8e-a94d-4d4b-9ff2-f13946f6fe85 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:47.949587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05f8e-a94d-4d4b-9ff2-f13946f6fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:47.950185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05f8e-a94d-4d4b-9ff2-f13946f6fe85 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:47.951098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd05f8e-a94d-4d4b-9ff2-f13946f6fe85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:47.953897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd05f8e-a94d-4d4b-9ff2-f13946f6fe85 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:47.984635 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2001/3981] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:47 2022] POST /identity/v3/users => generated 306 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:42:47.988897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9ee5c-bb46-479a-8ff4-17ee371f7203 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.002165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9ee5c-bb46-479a-8ff4-17ee371f7203 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:48.008334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81b60a-84ac-4319-be16-af32d729664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:48.009034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81b60a-84ac-4319-be16-af32d729664a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.009376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81b60a-84ac-4319-be16-af32d729664a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.010073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81b60a-84ac-4319-be16-af32d729664a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.010484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81b60a-84ac-4319-be16-af32d729664a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:48.012483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81b60a-84ac-4319-be16-af32d729664a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:48.029864 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1981/3982] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:42:48.031419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05f8e-a94d-4d4b-9ff2-f13946f6fe85 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.045705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05f8e-a94d-4d4b-9ff2-f13946f6fe85 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:48.051770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c7b9e-915f-461a-81c9-d3186c7f2b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:48.053188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7b9e-915f-461a-81c9-d3186c7f2b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.053856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7b9e-915f-461a-81c9-d3186c7f2b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.054309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7b9e-915f-461a-81c9-d3186c7f2b37 admin admin] PATH_INFO: `/v3/projects/2d75a58725dc442dbe8649a851a95623/users/531f5959d3f240759ae8e65068fa73d6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.075512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c7b9e-915f-461a-81c9-d3186c7f2b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d75a58725dc442dbe8649a851a95623, user_id=531f5959d3f240759ae8e65068fa73d6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:48.079396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c7b9e-915f-461a-81c9-d3186c7f2b37 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:48.108847 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2002/3983] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:48 2022] PUT /identity/v3/projects/2d75a58725dc442dbe8649a851a95623/users/531f5959d3f240759ae8e65068fa73d6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:48.110394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81b60a-84ac-4319-be16-af32d729664a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.126566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81b60a-84ac-4319-be16-af32d729664a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:48.215340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8deb0-a552-422d-ac8b-e72322b3319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:48.218058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8deb0-a552-422d-ac8b-e72322b3319f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.218578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8deb0-a552-422d-ac8b-e72322b3319f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.219685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8deb0-a552-422d-ac8b-e72322b3319f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.221454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8deb0-a552-422d-ac8b-e72322b3319f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:48.223765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8deb0-a552-422d-ac8b-e72322b3319f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:48.245994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c7b9e-915f-461a-81c9-d3186c7f2b37 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.246194 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1982/3984] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:48.261578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c7b9e-915f-461a-81c9-d3186c7f2b37 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:48.276528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd15d7-299a-4af2-af94-47aa6c606de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:48.277254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd15d7-299a-4af2-af94-47aa6c606de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.277596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd15d7-299a-4af2-af94-47aa6c606de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.277880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd15d7-299a-4af2-af94-47aa6c606de8 admin admin] PATH_INFO: `/v3/projects/2d75a58725dc442dbe8649a851a95623/users/531f5959d3f240759ae8e65068fa73d6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.279957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd15d7-299a-4af2-af94-47aa6c606de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d75a58725dc442dbe8649a851a95623, user_id=531f5959d3f240759ae8e65068fa73d6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:48.282804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd15d7-299a-4af2-af94-47aa6c606de8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:48.287669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8deb0-a552-422d-ac8b-e72322b3319f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.289857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4ec8deb0-a552-422d-ac8b-e72322b3319f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:48.300471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:48.317949 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2003/3985] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:48 2022] PUT /identity/v3/projects/2d75a58725dc442dbe8649a851a95623/users/531f5959d3f240759ae8e65068fa73d6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:48.330308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9503e-a249-4ac6-a4ab-0583d7f15071 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.330610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9503e-a249-4ac6-a4ab-0583d7f15071 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.330895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9503e-a249-4ac6-a4ab-0583d7f15071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.395478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f9f9503e-a249-4ac6-a4ab-0583d7f15071 None None] MFA Rules not processed for user `531f5959d3f240759ae8e65068fa73d6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:48.398017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f9f9503e-a249-4ac6-a4ab-0583d7f15071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:48.443320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8deb0-a552-422d-ac8b-e72322b3319f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:48.477779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:48.578120 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2004/3986] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:48.579723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9503e-a249-4ac6-a4ab-0583d7f15071 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.607321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500faf6-a7c7-449c-b6ab-bf38453efd31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:48.608478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500faf6-a7c7-449c-b6ab-bf38453efd31 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.608760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500faf6-a7c7-449c-b6ab-bf38453efd31 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.609032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500faf6-a7c7-449c-b6ab-bf38453efd31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.753732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9503e-a249-4ac6-a4ab-0583d7f15071 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:48.764495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500faf6-a7c7-449c-b6ab-bf38453efd31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:48.766160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500faf6-a7c7-449c-b6ab-bf38453efd31 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:48.778958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec004812-3dc4-4101-a1cc-628c12a88d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:48.779581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec004812-3dc4-4101-a1cc-628c12a88d7b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:48.780392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec004812-3dc4-4101-a1cc-628c12a88d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:48.780663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec004812-3dc4-4101-a1cc-628c12a88d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:48.781311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec004812-3dc4-4101-a1cc-628c12a88d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:48.785791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec004812-3dc4-4101-a1cc-628c12a88d7b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:48.800111 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1983/3987] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:42:48.846799 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2005/3988] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:48 2022] POST /identity/v3/projects => generated 397 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:48.851351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500faf6-a7c7-449c-b6ab-bf38453efd31 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:48.871531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500faf6-a7c7-449c-b6ab-bf38453efd31 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:48.985024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:49.044617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855ba58-8c75-48e4-abaf-388238fe3ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:49.045873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855ba58-8c75-48e4-abaf-388238fe3ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:49.046411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855ba58-8c75-48e4-abaf-388238fe3ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:49.046933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855ba58-8c75-48e4-abaf-388238fe3ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:49.047805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855ba58-8c75-48e4-abaf-388238fe3ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:49.050001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855ba58-8c75-48e4-abaf-388238fe3ef1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:49.099222 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1984/3989] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:48 2022] POST /identity/v3/users => generated 299 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:49.102921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec004812-3dc4-4101-a1cc-628c12a88d7b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:49.119292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec004812-3dc4-4101-a1cc-628c12a88d7b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:49.127022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1f8c8-8c50-42fa-bc65-3fc66050cd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:49.128779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1f8c8-8c50-42fa-bc65-3fc66050cd90 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:49.129338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1f8c8-8c50-42fa-bc65-3fc66050cd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:49.129934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1f8c8-8c50-42fa-bc65-3fc66050cd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:49.130940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1f8c8-8c50-42fa-bc65-3fc66050cd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:49.134100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1f8c8-8c50-42fa-bc65-3fc66050cd90 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:49.149521 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2006/3990] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:49.153805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855ba58-8c75-48e4-abaf-388238fe3ef1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:49.171462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855ba58-8c75-48e4-abaf-388238fe3ef1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:49.187592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e8384-b6cd-46cb-8f87-95304bc5e8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:49.190232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e8384-b6cd-46cb-8f87-95304bc5e8fa admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:49.190864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e8384-b6cd-46cb-8f87-95304bc5e8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:49.191150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e8384-b6cd-46cb-8f87-95304bc5e8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:49.191835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e8384-b6cd-46cb-8f87-95304bc5e8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:49.193492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e8384-b6cd-46cb-8f87-95304bc5e8fa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:49.230047 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1985/3991] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:49.234420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1f8c8-8c50-42fa-bc65-3fc66050cd90 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:49.249629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1f8c8-8c50-42fa-bc65-3fc66050cd90 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:49.263553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600116d-1af5-4ab2-845f-27632c6964b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:49.265418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600116d-1af5-4ab2-845f-27632c6964b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:49.266630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600116d-1af5-4ab2-845f-27632c6964b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:49.267160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600116d-1af5-4ab2-845f-27632c6964b9 admin admin] PATH_INFO: `/v3/projects/4efc2424a0744affb68e5348e2775232/users/1083312e8ac141eeb1a668bcce1883c4/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:49.302461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600116d-1af5-4ab2-845f-27632c6964b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efc2424a0744affb68e5348e2775232, user_id=1083312e8ac141eeb1a668bcce1883c4, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:49.309926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600116d-1af5-4ab2-845f-27632c6964b9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:49.349219 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2007/3992] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:49 2022] PUT /identity/v3/projects/4efc2424a0744affb68e5348e2775232/users/1083312e8ac141eeb1a668bcce1883c4/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:49.355500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985f1aa-a1a5-4400-96dc-e53c58f909c4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:49.356148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985f1aa-a1a5-4400-96dc-e53c58f909c4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:49.356653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985f1aa-a1a5-4400-96dc-e53c58f909c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:49.412159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d985f1aa-a1a5-4400-96dc-e53c58f909c4 None None] MFA Rules not processed for user `1083312e8ac141eeb1a668bcce1883c4`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:49.418469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d985f1aa-a1a5-4400-96dc-e53c58f909c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:49.537109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600116d-1af5-4ab2-845f-27632c6964b9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:49.539358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0600116d-1af5-4ab2-845f-27632c6964b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:49.550101 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1986/3993] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:49.688297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600116d-1af5-4ab2-845f-27632c6964b9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:49.695577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832396b-94e9-4feb-8bb4-e13a1bead550 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:49.696366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832396b-94e9-4feb-8bb4-e13a1bead550 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:49.696745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832396b-94e9-4feb-8bb4-e13a1bead550 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:49.698460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832396b-94e9-4feb-8bb4-e13a1bead550 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:49.765993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985f1aa-a1a5-4400-96dc-e53c58f909c4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:49.767800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d985f1aa-a1a5-4400-96dc-e53c58f909c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:49.829045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:49.907141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832396b-94e9-4feb-8bb4-e13a1bead550 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:49.910989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832396b-94e9-4feb-8bb4-e13a1bead550 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:49.913086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985f1aa-a1a5-4400-96dc-e53c58f909c4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:49.923583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de1166-ed79-4533-92f6-4aa974aad745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:49.924370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de1166-ed79-4533-92f6-4aa974aad745 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:49.924603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de1166-ed79-4533-92f6-4aa974aad745 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:49.924921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de1166-ed79-4533-92f6-4aa974aad745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:49.926883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-04de1166-ed79-4533-92f6-4aa974aad745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:49.938491 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2008/3994] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:49 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:42:50.071433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:50.103236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de1166-ed79-4533-92f6-4aa974aad745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:50.104709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de1166-ed79-4533-92f6-4aa974aad745 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:50.154721 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1987/3995] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:50.199865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832396b-94e9-4feb-8bb4-e13a1bead550 service glance] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:50.213469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832396b-94e9-4feb-8bb4-e13a1bead550 service glance] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:50.223291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dface3-713e-4d07-a75a-84f5ba9930c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:50.223931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dface3-713e-4d07-a75a-84f5ba9930c0 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:50.224214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dface3-713e-4d07-a75a-84f5ba9930c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:50.224489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dface3-713e-4d07-a75a-84f5ba9930c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:50.232150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c1dface3-713e-4d07-a75a-84f5ba9930c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:50.256270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dface3-713e-4d07-a75a-84f5ba9930c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:50.259459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dface3-713e-4d07-a75a-84f5ba9930c0 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:50.297972 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2009/3996] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:42:50.582509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de1166-ed79-4533-92f6-4aa974aad745 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:50.584069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-04de1166-ed79-4533-92f6-4aa974aad745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:50.601440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de1166-ed79-4533-92f6-4aa974aad745 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:50.609636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd337722-ddee-46dd-b38c-e00a4b8cecc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:50.610683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337722-ddee-46dd-b38c-e00a4b8cecc3 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:50.611228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337722-ddee-46dd-b38c-e00a4b8cecc3 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:50.611695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337722-ddee-46dd-b38c-e00a4b8cecc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:50.614710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bd337722-ddee-46dd-b38c-e00a4b8cecc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:50.736928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd337722-ddee-46dd-b38c-e00a4b8cecc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:50.738882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd337722-ddee-46dd-b38c-e00a4b8cecc3 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:50.750383 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1988/3997] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:50.801805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dface3-713e-4d07-a75a-84f5ba9930c0 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:50.926967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dface3-713e-4d07-a75a-84f5ba9930c0 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:50.932760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:50.933425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:50.933711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:50.934120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] PATH_INFO: `/v3/users/531f5959d3f240759ae8e65068fa73d6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:50.936151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=531f5959d3f240759ae8e65068fa73d6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:50.940488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:51.037874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531f5959d3f240759ae8e65068fa73d6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:51.038629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531f5959d3f240759ae8e65068fa73d6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:51.062820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531f5959d3f240759ae8e65068fa73d6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:51.063617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531f5959d3f240759ae8e65068fa73d6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:51.073607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531f5959d3f240759ae8e65068fa73d6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:51.099989 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2010/3998] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:50 2022] DELETE /identity/v3/users/531f5959d3f240759ae8e65068fa73d6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:51.101480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0055ebc-44ac-4b51-aa8b-c7eb42ff70ef None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:51.101780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0055ebc-44ac-4b51-aa8b-c7eb42ff70ef None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:51.102060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0055ebc-44ac-4b51-aa8b-c7eb42ff70ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:51.162394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b0055ebc-44ac-4b51-aa8b-c7eb42ff70ef None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:51.163637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b0055ebc-44ac-4b51-aa8b-c7eb42ff70ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:51.368232 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1989/3999] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:51.392306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:51.394634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:51.479012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:51.582500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7627d-4c4e-40f5-92ea-572fdba606a8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:51.596305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac6db-d3b4-45dd-b822-20f3645eaa11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:51.596954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac6db-d3b4-45dd-b822-20f3645eaa11 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:51.599208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac6db-d3b4-45dd-b822-20f3645eaa11 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:51.599491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac6db-d3b4-45dd-b822-20f3645eaa11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:51.644132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fac6db-d3b4-45dd-b822-20f3645eaa11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:51.651603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fac6db-d3b4-45dd-b822-20f3645eaa11 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:51.696249 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2011/4000] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:52.226654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0055ebc-44ac-4b51-aa8b-c7eb42ff70ef None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:52.234618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b0055ebc-44ac-4b51-aa8b-c7eb42ff70ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:52.265128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0055ebc-44ac-4b51-aa8b-c7eb42ff70ef None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:52.279181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:52.281688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:52.291646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:52.292627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] PATH_INFO: `/v3/projects/2d75a58725dc442dbe8649a851a95623` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:52.295029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d75a58725dc442dbe8649a851a95623)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:52.304351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:52.569194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d75a58725dc442dbe8649a851a95623', 'request_id': 'req-bd266e65-74ff-4efb-91a4-d9d42d23ba68'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:52.578208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d75a58725dc442dbe8649a851a95623', 'request_id': 'req-bd266e65-74ff-4efb-91a4-d9d42d23ba68'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:52.593461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d75a58725dc442dbe8649a851a95623', 'request_id': 'req-bd266e65-74ff-4efb-91a4-d9d42d23ba68'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:52.633648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] The token cache is being invalidate because project 2d75a58725dc442dbe8649a851a95623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:52.637869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:52.639895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bd266e65-74ff-4efb-91a4-d9d42d23ba68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:52.643193 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1990/4001] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:52 2022] DELETE /identity/v3/projects/2d75a58725dc442dbe8649a851a95623 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:52.646816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac6db-d3b4-45dd-b822-20f3645eaa11 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:52.664028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac6db-d3b4-45dd-b822-20f3645eaa11 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:52.916382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be25d6-a985-4e9d-a1d2-fc06c47525b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:52.917549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be25d6-a985-4e9d-a1d2-fc06c47525b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:52.917915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be25d6-a985-4e9d-a1d2-fc06c47525b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:52.918263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be25d6-a985-4e9d-a1d2-fc06c47525b9 admin admin] PATH_INFO: `/v3/users/1083312e8ac141eeb1a668bcce1883c4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:52.922665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be25d6-a985-4e9d-a1d2-fc06c47525b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1083312e8ac141eeb1a668bcce1883c4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:52.925015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be25d6-a985-4e9d-a1d2-fc06c47525b9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:53.063979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e0be25d6-a985-4e9d-a1d2-fc06c47525b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1083312e8ac141eeb1a668bcce1883c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:53.064749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e0be25d6-a985-4e9d-a1d2-fc06c47525b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1083312e8ac141eeb1a668bcce1883c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:53.096005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e0be25d6-a985-4e9d-a1d2-fc06c47525b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1083312e8ac141eeb1a668bcce1883c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:53.103562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e0be25d6-a985-4e9d-a1d2-fc06c47525b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1083312e8ac141eeb1a668bcce1883c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:53.129056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e0be25d6-a985-4e9d-a1d2-fc06c47525b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1083312e8ac141eeb1a668bcce1883c4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:53.148711 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2012/4002] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:42:52 2022] DELETE /identity/v3/users/1083312e8ac141eeb1a668bcce1883c4 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:54.997831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbf98-a671-493d-a0e0-124bb144a1e4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:54.998435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbf98-a671-493d-a0e0-124bb144a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:54.998652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbf98-a671-493d-a0e0-124bb144a1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:55.075445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:55.101706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5b2dbf98-a671-493d-a0e0-124bb144a1e4 None None] MFA Rules not processed for user `84feafb1d3ef4704a583d08c2e17b48c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:55.103078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5b2dbf98-a671-493d-a0e0-124bb144a1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:55.362964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8bee6-d8bb-46ed-8b83-5297b3a086f6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:55.363465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8bee6-d8bb-46ed-8b83-5297b3a086f6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:55.363725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8bee6-d8bb-46ed-8b83-5297b3a086f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:55.367693 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1991/4003] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:55.416722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cdc8bee6-d8bb-46ed-8b83-5297b3a086f6 None None] MFA Rules not processed for user `84feafb1d3ef4704a583d08c2e17b48c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:55.429124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cdc8bee6-d8bb-46ed-8b83-5297b3a086f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:55.462831 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2013/4004] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:55.744660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dbf98-a671-493d-a0e0-124bb144a1e4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:55.746376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5b2dbf98-a671-493d-a0e0-124bb144a1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:55.965824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dbf98-a671-493d-a0e0-124bb144a1e4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:55.991231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed599b5-a2e0-460b-b9b0-df11e4ed08b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:55.992081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed599b5-a2e0-460b-b9b0-df11e4ed08b9 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:55.992471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed599b5-a2e0-460b-b9b0-df11e4ed08b9 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:55.992855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed599b5-a2e0-460b-b9b0-df11e4ed08b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:56.009122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed599b5-a2e0-460b-b9b0-df11e4ed08b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:56.015325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed599b5-a2e0-460b-b9b0-df11e4ed08b9 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:56.036869 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1992/4005] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:57.046803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8bee6-d8bb-46ed-8b83-5297b3a086f6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:57.050080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cdc8bee6-d8bb-46ed-8b83-5297b3a086f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:57.235626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:57.293730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8bee6-d8bb-46ed-8b83-5297b3a086f6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:57.321168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:57.322356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:57.322829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:57.323308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] PATH_INFO: `/v3/projects/4efc2424a0744affb68e5348e2775232` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:57.324873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4efc2424a0744affb68e5348e2775232)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:57.328831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:57.471915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4efc2424a0744affb68e5348e2775232', 'request_id': 'req-cb02796e-4e68-41ae-ae87-c3b30263f513'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:57.483912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4efc2424a0744affb68e5348e2775232', 'request_id': 'req-cb02796e-4e68-41ae-ae87-c3b30263f513'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:57.517181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4efc2424a0744affb68e5348e2775232', 'request_id': 'req-cb02796e-4e68-41ae-ae87-c3b30263f513'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:57.556634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] The token cache is being invalidate because project 4efc2424a0744affb68e5348e2775232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:42:57.560380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:57.562671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cb02796e-4e68-41ae-ae87-c3b30263f513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:42:57.569769 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2014/4006] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:57 2022] DELETE /identity/v3/projects/4efc2424a0744affb68e5348e2775232 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:42:57.574414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf81fb-430e-418a-9b7c-178107441004 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:57.574961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf81fb-430e-418a-9b7c-178107441004 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:57.574961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf81fb-430e-418a-9b7c-178107441004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:57.614166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6adf81fb-430e-418a-9b7c-178107441004 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:57.615706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6adf81fb-430e-418a-9b7c-178107441004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:57.749280 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1993/4007] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:57.750003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812a7e4-9322-40df-8db0-6ce8915b60fc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:57.750356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812a7e4-9322-40df-8db0-6ce8915b60fc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:57.750706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812a7e4-9322-40df-8db0-6ce8915b60fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:57.792955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c812a7e4-9322-40df-8db0-6ce8915b60fc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:57.794585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c812a7e4-9322-40df-8db0-6ce8915b60fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:57.818857 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2015/4008] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:42:57.823314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf81fb-430e-418a-9b7c-178107441004 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:57.843095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf81fb-430e-418a-9b7c-178107441004 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:57.850919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d602a6-2b7a-475a-801c-815437b097a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:57.851829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d602a6-2b7a-475a-801c-815437b097a1 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:57.852274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d602a6-2b7a-475a-801c-815437b097a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:57.852741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d602a6-2b7a-475a-801c-815437b097a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:57.853624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d602a6-2b7a-475a-801c-815437b097a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:42:57.853920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d602a6-2b7a-475a-801c-815437b097a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:57.855721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d602a6-2b7a-475a-801c-815437b097a1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:57.895984 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1994/4009] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:42:57.897572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812a7e4-9322-40df-8db0-6ce8915b60fc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:57.907875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812a7e4-9322-40df-8db0-6ce8915b60fc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:57.926202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83839ccb-9214-45d6-8432-98ab39656ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:57.927203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83839ccb-9214-45d6-8432-98ab39656ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:57.927671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83839ccb-9214-45d6-8432-98ab39656ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:57.927830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83839ccb-9214-45d6-8432-98ab39656ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:57.928774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83839ccb-9214-45d6-8432-98ab39656ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:57.934091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83839ccb-9214-45d6-8432-98ab39656ff0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:58.042448 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2016/4010] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:42:57 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:58.047374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d602a6-2b7a-475a-801c-815437b097a1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:58.058064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d602a6-2b7a-475a-801c-815437b097a1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:58.101580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:58.266506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7973f-69fd-4566-ab9e-673703393a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:58.267172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7973f-69fd-4566-ab9e-673703393a15 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:58.267472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7973f-69fd-4566-ab9e-673703393a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:58.267786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7973f-69fd-4566-ab9e-673703393a15 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:58.268442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7973f-69fd-4566-ab9e-673703393a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:58.270435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7973f-69fd-4566-ab9e-673703393a15 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:58.319280 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1995/4011] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:42:58 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:42:58.324518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83839ccb-9214-45d6-8432-98ab39656ff0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:58.335513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83839ccb-9214-45d6-8432-98ab39656ff0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:58.353617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f0437-68a3-473d-807d-23283dc3f8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:58.354343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f0437-68a3-473d-807d-23283dc3f8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:58.354717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f0437-68a3-473d-807d-23283dc3f8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:58.355105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f0437-68a3-473d-807d-23283dc3f8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:58.355842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f0437-68a3-473d-807d-23283dc3f8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:58.358180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f0437-68a3-473d-807d-23283dc3f8b7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:58.381338 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2017/4012] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:58.385564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7973f-69fd-4566-ab9e-673703393a15 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:58.401805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7973f-69fd-4566-ab9e-673703393a15 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:58.417104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bd1f7-140c-41a4-94d2-3687f5ca0edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:58.421958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd1f7-140c-41a4-94d2-3687f5ca0edf admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:58.422247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd1f7-140c-41a4-94d2-3687f5ca0edf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:58.422527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd1f7-140c-41a4-94d2-3687f5ca0edf admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:58.426009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bd1f7-140c-41a4-94d2-3687f5ca0edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:58.428028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bd1f7-140c-41a4-94d2-3687f5ca0edf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:58.458125 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1996/4013] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:42:58.462377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f0437-68a3-473d-807d-23283dc3f8b7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:58.493001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f0437-68a3-473d-807d-23283dc3f8b7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:58.499227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ad7f0-738d-477e-8284-4ee9c7ecb0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:58.500277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad7f0-738d-477e-8284-4ee9c7ecb0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:58.500898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad7f0-738d-477e-8284-4ee9c7ecb0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:58.501421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad7f0-738d-477e-8284-4ee9c7ecb0d4 admin admin] PATH_INFO: `/v3/projects/af3d9e62093d4743b9b372beacebd5db/users/1f8da8834abf4b8bb2324f637a17f58f/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:58.522981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ad7f0-738d-477e-8284-4ee9c7ecb0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3d9e62093d4743b9b372beacebd5db, user_id=1f8da8834abf4b8bb2324f637a17f58f, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:58.526086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ad7f0-738d-477e-8284-4ee9c7ecb0d4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:58.556070 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2018/4014] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:42:58 2022] PUT /identity/v3/projects/af3d9e62093d4743b9b372beacebd5db/users/1f8da8834abf4b8bb2324f637a17f58f/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:42:58.566323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f5956-f9a1-4a3f-9d35-55dde11b3b1d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:58.566904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f5956-f9a1-4a3f-9d35-55dde11b3b1d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:58.567957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f5956-f9a1-4a3f-9d35-55dde11b3b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:58.624116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2a4f5956-f9a1-4a3f-9d35-55dde11b3b1d None None] MFA Rules not processed for user `1f8da8834abf4b8bb2324f637a17f58f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:58.629514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2a4f5956-f9a1-4a3f-9d35-55dde11b3b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:58.669493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980457be-5ddb-428c-9f1d-e90a7a14a95c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:58.670990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980457be-5ddb-428c-9f1d-e90a7a14a95c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:58.671422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980457be-5ddb-428c-9f1d-e90a7a14a95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:58.760033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-980457be-5ddb-428c-9f1d-e90a7a14a95c None None] MFA Rules not processed for user `87ab13dbc341434db7373fb4772fdf07`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:58.763312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-980457be-5ddb-428c-9f1d-e90a7a14a95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:58.874253 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1997/4015] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:58.894247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f5956-f9a1-4a3f-9d35-55dde11b3b1d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:58.896115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2a4f5956-f9a1-4a3f-9d35-55dde11b3b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:59.031477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f5956-f9a1-4a3f-9d35-55dde11b3b1d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:59.042186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393bd70-4e49-4cf2-8ab6-82bbb646e238 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:59.042923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393bd70-4e49-4cf2-8ab6-82bbb646e238 service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:59.043306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393bd70-4e49-4cf2-8ab6-82bbb646e238 service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:59.043685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393bd70-4e49-4cf2-8ab6-82bbb646e238 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:59.067400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393bd70-4e49-4cf2-8ab6-82bbb646e238 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:59.069180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393bd70-4e49-4cf2-8ab6-82bbb646e238 service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:59.088921 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2019/4016] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:59.091630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379476d4-5762-495c-b12f-f857c006ef8f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:59.092608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379476d4-5762-495c-b12f-f857c006ef8f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:59.092793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379476d4-5762-495c-b12f-f857c006ef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:59.112318 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1998/4017] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:42:59.130568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:59.182211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-379476d4-5762-495c-b12f-f857c006ef8f None None] MFA Rules not processed for user `87ab13dbc341434db7373fb4772fdf07`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:59.187270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-379476d4-5762-495c-b12f-f857c006ef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:59.221073 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2020/4018] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:42:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:42:59.444724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393bd70-4e49-4cf2-8ab6-82bbb646e238 service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:42:59.446340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3393bd70-4e49-4cf2-8ab6-82bbb646e238 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:59.525541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ee7c6-b7f1-4aac-be24-f0610d5108f3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:59.526089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ee7c6-b7f1-4aac-be24-f0610d5108f3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:59.526191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ee7c6-b7f1-4aac-be24-f0610d5108f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:59.541621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:59.622686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393bd70-4e49-4cf2-8ab6-82bbb646e238 service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:42:59.623059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-889ee7c6-b7f1-4aac-be24-f0610d5108f3 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:42:59.628156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-889ee7c6-b7f1-4aac-be24-f0610d5108f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:42:59.646812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97477b-a9db-4879-b2b9-a1d7fdd3ac1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:42:59.650655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97477b-a9db-4879-b2b9-a1d7fdd3ac1c service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:42:59.652094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97477b-a9db-4879-b2b9-a1d7fdd3ac1c service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:42:59.653467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97477b-a9db-4879-b2b9-a1d7fdd3ac1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:42:59.684654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97477b-a9db-4879-b2b9-a1d7fdd3ac1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:42:59.693365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97477b-a9db-4879-b2b9-a1d7fdd3ac1c service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:42:59.718889 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 1999/4019] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:42:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:42:59.954398 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2021/4020] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:42:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:43:00.022904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97477b-a9db-4879-b2b9-a1d7fdd3ac1c service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:00.024797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4c97477b-a9db-4879-b2b9-a1d7fdd3ac1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:00.236160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97477b-a9db-4879-b2b9-a1d7fdd3ac1c service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:00.274843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b4322-9d4c-4f4f-839b-28376ba23fd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:00.276945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4322-9d4c-4f4f-839b-28376ba23fd7 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:00.285221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4322-9d4c-4f4f-839b-28376ba23fd7 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:00.285788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4322-9d4c-4f4f-839b-28376ba23fd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:00.306687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b4322-9d4c-4f4f-839b-28376ba23fd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:00.308870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b4322-9d4c-4f4f-839b-28376ba23fd7 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:00.336399 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2000/4021] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:43:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:01.214891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5dfb5-c6e0-4691-9f73-8d48224c2771 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:01.215613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5dfb5-c6e0-4691-9f73-8d48224c2771 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:01.215613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5dfb5-c6e0-4691-9f73-8d48224c2771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:01.272851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-96c5dfb5-c6e0-4691-9f73-8d48224c2771 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:01.274112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-96c5dfb5-c6e0-4691-9f73-8d48224c2771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:01.304608 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2022/4022] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:43:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:01.313084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b4322-9d4c-4f4f-839b-28376ba23fd7 service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:01.331011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b4322-9d4c-4f4f-839b-28376ba23fd7 service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:01.352443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa56927-d6ee-4f04-b2eb-cb49175aea86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:01.356500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56927-d6ee-4f04-b2eb-cb49175aea86 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:01.358234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56927-d6ee-4f04-b2eb-cb49175aea86 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:01.359251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56927-d6ee-4f04-b2eb-cb49175aea86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:01.413696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa56927-d6ee-4f04-b2eb-cb49175aea86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:01.418388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa56927-d6ee-4f04-b2eb-cb49175aea86 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:01.477412 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2001/4023] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:43:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:02.569627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d1be-a399-45b4-9ef0-5904c6969110 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:02.570202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d1be-a399-45b4-9ef0-5904c6969110 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:02.570202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d1be-a399-45b4-9ef0-5904c6969110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:02.628474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c502d1be-a399-45b4-9ef0-5904c6969110 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:02.629752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c502d1be-a399-45b4-9ef0-5904c6969110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:02.677039 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2023/4024] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:43:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:43:02.693952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa56927-d6ee-4f04-b2eb-cb49175aea86 service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:02.704848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa56927-d6ee-4f04-b2eb-cb49175aea86 service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:02.734257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5297d2-3dd8-4389-b761-8bec676369ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:02.734893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5297d2-3dd8-4389-b761-8bec676369ab service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:02.735361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5297d2-3dd8-4389-b761-8bec676369ab service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:02.735815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5297d2-3dd8-4389-b761-8bec676369ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:02.756658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5297d2-3dd8-4389-b761-8bec676369ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:02.767176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5297d2-3dd8-4389-b761-8bec676369ab service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:02.798453 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2002/4025] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:43:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:03.155582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081271-a481-4eaf-9698-cde44bb6ff1c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:03.155856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081271-a481-4eaf-9698-cde44bb6ff1c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:03.156688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081271-a481-4eaf-9698-cde44bb6ff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:03.210057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-54081271-a481-4eaf-9698-cde44bb6ff1c None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:03.211641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-54081271-a481-4eaf-9698-cde44bb6ff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:03.233716 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2024/4026] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:43:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:03.246879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5297d2-3dd8-4389-b761-8bec676369ab service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:03.265941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5297d2-3dd8-4389-b761-8bec676369ab service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:03.284986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692fb47-6eaf-4c26-afb4-14e6e4dedd2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:03.289529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692fb47-6eaf-4c26-afb4-14e6e4dedd2f service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:03.290450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692fb47-6eaf-4c26-afb4-14e6e4dedd2f service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:03.291040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692fb47-6eaf-4c26-afb4-14e6e4dedd2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:03.317582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692fb47-6eaf-4c26-afb4-14e6e4dedd2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:03.322739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692fb47-6eaf-4c26-afb4-14e6e4dedd2f service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:03.343836 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2003/4027] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:43:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:04.019111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535b36-2e16-424a-9566-67f754bc8ba7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:04.020051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535b36-2e16-424a-9566-67f754bc8ba7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:04.020662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535b36-2e16-424a-9566-67f754bc8ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:04.053571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-77535b36-2e16-424a-9566-67f754bc8ba7 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:04.056233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-77535b36-2e16-424a-9566-67f754bc8ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:04.082270 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2025/4028] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:04.089904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692fb47-6eaf-4c26-afb4-14e6e4dedd2f service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:04.105885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692fb47-6eaf-4c26-afb4-14e6e4dedd2f service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:04.116587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b3b84-3f2c-4eac-b855-ca6cc257345e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:04.117221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b3b84-3f2c-4eac-b855-ca6cc257345e service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:04.117529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b3b84-3f2c-4eac-b855-ca6cc257345e service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:04.117803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b3b84-3f2c-4eac-b855-ca6cc257345e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:04.134530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b3b84-3f2c-4eac-b855-ca6cc257345e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:04.136986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b3b84-3f2c-4eac-b855-ca6cc257345e service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:04.161240 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2004/4029] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:43:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:04.581536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323293c8-d69d-448a-a265-624f357e5459 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:04.582060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323293c8-d69d-448a-a265-624f357e5459 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:04.582500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323293c8-d69d-448a-a265-624f357e5459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:04.620105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-323293c8-d69d-448a-a265-624f357e5459 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:04.622103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-323293c8-d69d-448a-a265-624f357e5459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:04.636227 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2026/4030] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:04.651657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b3b84-3f2c-4eac-b855-ca6cc257345e service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:04.664034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b3b84-3f2c-4eac-b855-ca6cc257345e service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:04.686592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3558-c60a-437d-85ed-28760bdc4b82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:04.687605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3558-c60a-437d-85ed-28760bdc4b82 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:04.688264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3558-c60a-437d-85ed-28760bdc4b82 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:04.688777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3558-c60a-437d-85ed-28760bdc4b82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:04.706688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3558-c60a-437d-85ed-28760bdc4b82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:04.708683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3558-c60a-437d-85ed-28760bdc4b82 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:04.741490 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2005/4031] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:43:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:05.024273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323293c8-d69d-448a-a265-624f357e5459 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:05.254719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323293c8-d69d-448a-a265-624f357e5459 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:05.269603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:05.270915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:05.271545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:05.272424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] PATH_INFO: `/v3/users/1f8da8834abf4b8bb2324f637a17f58f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:05.274070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8da8834abf4b8bb2324f637a17f58f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:05.276476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:05.393176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8da8834abf4b8bb2324f637a17f58f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:05.394466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8da8834abf4b8bb2324f637a17f58f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:05.441272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8da8834abf4b8bb2324f637a17f58f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:05.443723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8da8834abf4b8bb2324f637a17f58f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:05.467357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:05.476589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8da8834abf4b8bb2324f637a17f58f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:05.531958 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2027/4032] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:43:05 2022] DELETE /identity/v3/users/1f8da8834abf4b8bb2324f637a17f58f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:05.534109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794eae-e565-4f43-ba11-9bdbf7c15df5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:05.545953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794eae-e565-4f43-ba11-9bdbf7c15df5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:05.546471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794eae-e565-4f43-ba11-9bdbf7c15df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:05.587023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-44794eae-e565-4f43-ba11-9bdbf7c15df5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:05.588689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-44794eae-e565-4f43-ba11-9bdbf7c15df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:05.677320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:05.758247 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2006/4033] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:06.077162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:06.078895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:06.319417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e882da-6c7f-4b9c-b3f3-6e0ef330638b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:06.337914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06beeb5-def6-43c4-881f-c4f160303a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:06.339099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06beeb5-def6-43c4-881f-c4f160303a0e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:06.339867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06beeb5-def6-43c4-881f-c4f160303a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:06.340308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06beeb5-def6-43c4-881f-c4f160303a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:06.355979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06beeb5-def6-43c4-881f-c4f160303a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:06.358258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06beeb5-def6-43c4-881f-c4f160303a0e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:06.395939 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2028/4034] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:07.098145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44794eae-e565-4f43-ba11-9bdbf7c15df5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:07.101071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-44794eae-e565-4f43-ba11-9bdbf7c15df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:07.121567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44794eae-e565-4f43-ba11-9bdbf7c15df5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:07.131926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:07.133578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:07.134089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:07.134653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] PATH_INFO: `/v3/projects/af3d9e62093d4743b9b372beacebd5db` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:07.140494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3d9e62093d4743b9b372beacebd5db)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:07.143033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:07.245288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3d9e62093d4743b9b372beacebd5db', 'request_id': 'req-48bd5a9e-b103-4cca-98ef-b4ec0870c311'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:07.274708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3d9e62093d4743b9b372beacebd5db', 'request_id': 'req-48bd5a9e-b103-4cca-98ef-b4ec0870c311'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:07.291650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3d9e62093d4743b9b372beacebd5db', 'request_id': 'req-48bd5a9e-b103-4cca-98ef-b4ec0870c311'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:07.319857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] The token cache is being invalidate because project af3d9e62093d4743b9b372beacebd5db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:43:07.320571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:07.322384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48bd5a9e-b103-4cca-98ef-b4ec0870c311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:07.326771 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2007/4035] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:07 2022] DELETE /identity/v3/projects/af3d9e62093d4743b9b372beacebd5db => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:43:07.334614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f456bc-d8b6-498c-8166-250b27c8c3bf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:07.335757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f456bc-d8b6-498c-8166-250b27c8c3bf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:07.336282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f456bc-d8b6-498c-8166-250b27c8c3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:07.370590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-96f456bc-d8b6-498c-8166-250b27c8c3bf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:07.372284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-96f456bc-d8b6-498c-8166-250b27c8c3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:07.445452 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2029/4036] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:07.454762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970c2bd-eef2-4d28-be76-82722fef1aab None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:07.455359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970c2bd-eef2-4d28-be76-82722fef1aab None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:07.455902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970c2bd-eef2-4d28-be76-82722fef1aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:07.487025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6970c2bd-eef2-4d28-be76-82722fef1aab None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:07.490064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6970c2bd-eef2-4d28-be76-82722fef1aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:07.501088 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2008/4037] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:07.505335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f456bc-d8b6-498c-8166-250b27c8c3bf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:07.517062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f456bc-d8b6-498c-8166-250b27c8c3bf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:07.522506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c529ee-67ea-4687-a278-68b1f1e6bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:07.523485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c529ee-67ea-4687-a278-68b1f1e6bf43 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:07.524118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c529ee-67ea-4687-a278-68b1f1e6bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:07.524628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c529ee-67ea-4687-a278-68b1f1e6bf43 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:07.527370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c529ee-67ea-4687-a278-68b1f1e6bf43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:43:07.527955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c529ee-67ea-4687-a278-68b1f1e6bf43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:07.530173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c529ee-67ea-4687-a278-68b1f1e6bf43 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:07.549589 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2030/4038] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:43:07.554210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970c2bd-eef2-4d28-be76-82722fef1aab None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:07.569873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970c2bd-eef2-4d28-be76-82722fef1aab None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:07.577187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df32d4-69ca-46f2-9bb8-b26173c2513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:07.578318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df32d4-69ca-46f2-9bb8-b26173c2513b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:07.578836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df32d4-69ca-46f2-9bb8-b26173c2513b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:07.579367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df32d4-69ca-46f2-9bb8-b26173c2513b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:07.580361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df32d4-69ca-46f2-9bb8-b26173c2513b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:07.584197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df32d4-69ca-46f2-9bb8-b26173c2513b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:07.638349 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2009/4039] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:43:07 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:07.643172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c529ee-67ea-4687-a278-68b1f1e6bf43 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:07.655644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c529ee-67ea-4687-a278-68b1f1e6bf43 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:07.755579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a875fe7-fe45-4821-adb1-24c54ee9db40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:07.756340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a875fe7-fe45-4821-adb1-24c54ee9db40 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:07.756722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a875fe7-fe45-4821-adb1-24c54ee9db40 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:07.757143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a875fe7-fe45-4821-adb1-24c54ee9db40 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:07.758044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a875fe7-fe45-4821-adb1-24c54ee9db40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:07.761369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a875fe7-fe45-4821-adb1-24c54ee9db40 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:07.798225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df32d4-69ca-46f2-9bb8-b26173c2513b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:07.810830 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2031/4040] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:43:07 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:07.814789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df32d4-69ca-46f2-9bb8-b26173c2513b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:07.830281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a49d0-35fc-4a7b-be7c-16f933b7e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:07.831188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a49d0-35fc-4a7b-be7c-16f933b7e1fd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:07.832777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a49d0-35fc-4a7b-be7c-16f933b7e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:07.833942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a49d0-35fc-4a7b-be7c-16f933b7e1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:07.835388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a49d0-35fc-4a7b-be7c-16f933b7e1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:07.839301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a49d0-35fc-4a7b-be7c-16f933b7e1fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:07.863394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a875fe7-fe45-4821-adb1-24c54ee9db40 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:07.875539 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2010/4041] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:07.876697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a875fe7-fe45-4821-adb1-24c54ee9db40 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:07.882995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e6a26-3ce8-4ba9-96ef-263a32481a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:07.884203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e6a26-3ce8-4ba9-96ef-263a32481a7b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:07.884633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e6a26-3ce8-4ba9-96ef-263a32481a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:07.885001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e6a26-3ce8-4ba9-96ef-263a32481a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:07.886476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e6a26-3ce8-4ba9-96ef-263a32481a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:07.888229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e6a26-3ce8-4ba9-96ef-263a32481a7b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:07.891489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:07.907188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a49d0-35fc-4a7b-be7c-16f933b7e1fd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:07.920758 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2032/4042] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:07.921051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a49d0-35fc-4a7b-be7c-16f933b7e1fd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:07.927413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6d94c-9fc4-410e-a336-fbbb70dbf896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:07.928371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6d94c-9fc4-410e-a336-fbbb70dbf896 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:07.928751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6d94c-9fc4-410e-a336-fbbb70dbf896 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:07.930458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6d94c-9fc4-410e-a336-fbbb70dbf896 admin admin] PATH_INFO: `/v3/projects/3642b129851a4565b46cab72cffbec2e/users/f0f38fd9744e465a92c179e35800d6f1/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:07.954055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6d94c-9fc4-410e-a336-fbbb70dbf896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3642b129851a4565b46cab72cffbec2e, user_id=f0f38fd9744e465a92c179e35800d6f1, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:07.960480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6d94c-9fc4-410e-a336-fbbb70dbf896 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:07.990726 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2011/4043] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:07 2022] PUT /identity/v3/projects/3642b129851a4565b46cab72cffbec2e/users/f0f38fd9744e465a92c179e35800d6f1/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:07.992938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592250-4d16-41af-9c08-d4dd71537454 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:07.993347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592250-4d16-41af-9c08-d4dd71537454 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:07.993828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592250-4d16-41af-9c08-d4dd71537454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:08.058911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-11592250-4d16-41af-9c08-d4dd71537454 None None] MFA Rules not processed for user `f0f38fd9744e465a92c179e35800d6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:08.060416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-11592250-4d16-41af-9c08-d4dd71537454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:08.216029 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2033/4044] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:08.234544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6d94c-9fc4-410e-a336-fbbb70dbf896 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:08.236718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9df6d94c-9fc4-410e-a336-fbbb70dbf896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:08.334883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6d94c-9fc4-410e-a336-fbbb70dbf896 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:08.340017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595bf35-f8ed-4cf8-8efc-9796bb32adb3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:08.340700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595bf35-f8ed-4cf8-8efc-9796bb32adb3 service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:08.341042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595bf35-f8ed-4cf8-8efc-9796bb32adb3 service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:08.341443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595bf35-f8ed-4cf8-8efc-9796bb32adb3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:08.348247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:08.352279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595bf35-f8ed-4cf8-8efc-9796bb32adb3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:08.353832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595bf35-f8ed-4cf8-8efc-9796bb32adb3 service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:08.373881 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2012/4045] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:08.655728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11592250-4d16-41af-9c08-d4dd71537454 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:08.766433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11592250-4d16-41af-9c08-d4dd71537454 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:08.772777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:08.773717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:08.774079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:08.774540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] PATH_INFO: `/v3/users/f0f38fd9744e465a92c179e35800d6f1` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:08.776500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f38fd9744e465a92c179e35800d6f1)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:08.780662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:08.888145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f38fd9744e465a92c179e35800d6f1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:08.889580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f38fd9744e465a92c179e35800d6f1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:08.911749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f38fd9744e465a92c179e35800d6f1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:08.912972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f38fd9744e465a92c179e35800d6f1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:08.926477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f38fd9744e465a92c179e35800d6f1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:08.953421 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2034/4046] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:43:08 2022] DELETE /identity/v3/users/f0f38fd9744e465a92c179e35800d6f1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:08.957126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e358d26-c15a-4d9e-92f6-5266cf0a317e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:08.957553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e358d26-c15a-4d9e-92f6-5266cf0a317e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:08.957913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e358d26-c15a-4d9e-92f6-5266cf0a317e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:08.996171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6e358d26-c15a-4d9e-92f6-5266cf0a317e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:09.001616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6e358d26-c15a-4d9e-92f6-5266cf0a317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:09.176939 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2013/4047] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:09.273428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:09.275774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:09.298168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:09.395560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5389de-2c93-42f9-9fbf-177d4906c6d9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:09.399941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b2f02-5966-4b3e-a1ab-1afb477e490f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:09.400957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b2f02-5966-4b3e-a1ab-1afb477e490f service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:09.401494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b2f02-5966-4b3e-a1ab-1afb477e490f service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:09.402013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b2f02-5966-4b3e-a1ab-1afb477e490f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:09.416402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b2f02-5966-4b3e-a1ab-1afb477e490f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:09.423810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b2f02-5966-4b3e-a1ab-1afb477e490f service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:09.437586 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2035/4048] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:11.540565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e358d26-c15a-4d9e-92f6-5266cf0a317e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:11.542948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6e358d26-c15a-4d9e-92f6-5266cf0a317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:11.565883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e358d26-c15a-4d9e-92f6-5266cf0a317e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:11.572756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:11.574024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:11.574315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:11.574634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] PATH_INFO: `/v3/projects/3642b129851a4565b46cab72cffbec2e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:11.577218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3642b129851a4565b46cab72cffbec2e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:11.580171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:11.743296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3642b129851a4565b46cab72cffbec2e', 'request_id': 'req-81b001d1-775b-42de-a695-502dcc7cd748'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:11.755352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3642b129851a4565b46cab72cffbec2e', 'request_id': 'req-81b001d1-775b-42de-a695-502dcc7cd748'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:11.776053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3642b129851a4565b46cab72cffbec2e', 'request_id': 'req-81b001d1-775b-42de-a695-502dcc7cd748'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:11.799531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] The token cache is being invalidate because project 3642b129851a4565b46cab72cffbec2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:43:11.800208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:11.800977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81b001d1-775b-42de-a695-502dcc7cd748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:11.803081 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2014/4049] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:11 2022] DELETE /identity/v3/projects/3642b129851a4565b46cab72cffbec2e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:11.807691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f22236-f41e-4659-8923-34284d000d99 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:11.808193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f22236-f41e-4659-8923-34284d000d99 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:11.808437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f22236-f41e-4659-8923-34284d000d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:11.838672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d9f22236-f41e-4659-8923-34284d000d99 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:11.840116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d9f22236-f41e-4659-8923-34284d000d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:11.929752 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2036/4050] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:11.938467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772b09-a204-4050-aae1-ed27471d9425 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:11.938753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772b09-a204-4050-aae1-ed27471d9425 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:11.939033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16772b09-a204-4050-aae1-ed27471d9425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:11.975805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-16772b09-a204-4050-aae1-ed27471d9425 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:11.977049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-16772b09-a204-4050-aae1-ed27471d9425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:11.989606 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2015/4051] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:11.990591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f22236-f41e-4659-8923-34284d000d99 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:12.001578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f22236-f41e-4659-8923-34284d000d99 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:12.018683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcbcbd-917d-49e2-bec6-e417c93c1a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:12.019423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcbcbd-917d-49e2-bec6-e417c93c1a65 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:12.019763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcbcbd-917d-49e2-bec6-e417c93c1a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:12.020108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcbcbd-917d-49e2-bec6-e417c93c1a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:12.020832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcbcbd-917d-49e2-bec6-e417c93c1a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:43:12.021204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcbcbd-917d-49e2-bec6-e417c93c1a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:12.022914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcbcbd-917d-49e2-bec6-e417c93c1a65 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:12.038557 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2037/4052] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:43:12.042073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16772b09-a204-4050-aae1-ed27471d9425 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:12.051963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16772b09-a204-4050-aae1-ed27471d9425 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:12.056964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ea9b5-a527-4db0-a416-3a120628e8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:12.057621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ea9b5-a527-4db0-a416-3a120628e8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:12.057908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ea9b5-a527-4db0-a416-3a120628e8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:12.058193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ea9b5-a527-4db0-a416-3a120628e8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:12.058851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ea9b5-a527-4db0-a416-3a120628e8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:12.061326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ea9b5-a527-4db0-a416-3a120628e8a7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:12.094956 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2016/4053] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:43:12 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:12.096000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcbcbd-917d-49e2-bec6-e417c93c1a65 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:12.108124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcbcbd-917d-49e2-bec6-e417c93c1a65 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:12.182090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb9117-c6c7-4f28-b56a-0dbfea03e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:12.183015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb9117-c6c7-4f28-b56a-0dbfea03e79f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:12.183472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb9117-c6c7-4f28-b56a-0dbfea03e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:12.183929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb9117-c6c7-4f28-b56a-0dbfea03e79f admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:12.184734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb9117-c6c7-4f28-b56a-0dbfea03e79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:12.188614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb9117-c6c7-4f28-b56a-0dbfea03e79f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:12.231626 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2038/4054] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:43:12 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:43:12.233627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ea9b5-a527-4db0-a416-3a120628e8a7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:12.244298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ea9b5-a527-4db0-a416-3a120628e8a7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:12.250086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732040d-9440-41c8-bffc-589fa34537b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:12.250710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732040d-9440-41c8-bffc-589fa34537b4 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:12.250996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732040d-9440-41c8-bffc-589fa34537b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:12.251280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732040d-9440-41c8-bffc-589fa34537b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:12.251936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732040d-9440-41c8-bffc-589fa34537b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:12.253576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732040d-9440-41c8-bffc-589fa34537b4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:12.266742 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2017/4055] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:12.269982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb9117-c6c7-4f28-b56a-0dbfea03e79f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:12.287103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb9117-c6c7-4f28-b56a-0dbfea03e79f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:12.301223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb4112-f592-44c9-8719-5c03551c19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:12.301882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb4112-f592-44c9-8719-5c03551c19ce admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:12.302226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb4112-f592-44c9-8719-5c03551c19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:12.302500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb4112-f592-44c9-8719-5c03551c19ce admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:12.303140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb4112-f592-44c9-8719-5c03551c19ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:12.304751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb4112-f592-44c9-8719-5c03551c19ce admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:12.318475 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2039/4056] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:12.322363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732040d-9440-41c8-bffc-589fa34537b4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:12.333712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732040d-9440-41c8-bffc-589fa34537b4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:12.339403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c67421-409c-4afe-87e2-b0e29e35ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:12.340287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c67421-409c-4afe-87e2-b0e29e35ac27 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:12.340650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c67421-409c-4afe-87e2-b0e29e35ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:12.340997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c67421-409c-4afe-87e2-b0e29e35ac27 admin admin] PATH_INFO: `/v3/projects/ec5e4b31c94f49f3899ffef6779c0c8f/users/c24952de06034f2b8befeae4213ae61e/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:12.360020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c67421-409c-4afe-87e2-b0e29e35ac27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5e4b31c94f49f3899ffef6779c0c8f, user_id=c24952de06034f2b8befeae4213ae61e, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:12.363235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c67421-409c-4afe-87e2-b0e29e35ac27 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:12.379276 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2018/4057] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:12 2022] PUT /identity/v3/projects/ec5e4b31c94f49f3899ffef6779c0c8f/users/c24952de06034f2b8befeae4213ae61e/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:12.390310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87401-2112-41e2-a495-54ba206b6002 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:12.390906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87401-2112-41e2-a495-54ba206b6002 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:12.391371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87401-2112-41e2-a495-54ba206b6002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:12.433801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b7a87401-2112-41e2-a495-54ba206b6002 None None] MFA Rules not processed for user `c24952de06034f2b8befeae4213ae61e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:12.433801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b7a87401-2112-41e2-a495-54ba206b6002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:12.433801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:12.550011 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2040/4058] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:12.554507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c67421-409c-4afe-87e2-b0e29e35ac27 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:12.575700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:12.665589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c67421-409c-4afe-87e2-b0e29e35ac27 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:12.675673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b3336-179f-4e0d-861a-eda471e010fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:12.676372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b3336-179f-4e0d-861a-eda471e010fa admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:12.676664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b3336-179f-4e0d-861a-eda471e010fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:12.677093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b3336-179f-4e0d-861a-eda471e010fa admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:12.677783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b3336-179f-4e0d-861a-eda471e010fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:12.684322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b3336-179f-4e0d-861a-eda471e010fa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:12.731519 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2019/4059] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:43:12 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:12.735888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a87401-2112-41e2-a495-54ba206b6002 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:12.747897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a87401-2112-41e2-a495-54ba206b6002 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:12.829821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28436-85b5-4764-b216-0a011eae83c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:12.830499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28436-85b5-4764-b216-0a011eae83c3 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:12.831815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28436-85b5-4764-b216-0a011eae83c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:12.832543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28436-85b5-4764-b216-0a011eae83c3 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:12.833997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f28436-85b5-4764-b216-0a011eae83c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:12.838329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f28436-85b5-4764-b216-0a011eae83c3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:12.877477 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2041/4060] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:43:12 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:12.881782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b3336-179f-4e0d-861a-eda471e010fa admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:12.898454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b3336-179f-4e0d-861a-eda471e010fa admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:12.914353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25816fe-c890-4f9f-9770-30089bc57bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:12.915160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25816fe-c890-4f9f-9770-30089bc57bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:12.915417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25816fe-c890-4f9f-9770-30089bc57bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:12.915883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25816fe-c890-4f9f-9770-30089bc57bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:12.916488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25816fe-c890-4f9f-9770-30089bc57bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:12.918450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25816fe-c890-4f9f-9770-30089bc57bf8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:12.933382 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2020/4061] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:12.937531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28436-85b5-4764-b216-0a011eae83c3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:12.952607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28436-85b5-4764-b216-0a011eae83c3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:12.961269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd8a6a-986c-43d0-91bc-51a204f4e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:12.962235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd8a6a-986c-43d0-91bc-51a204f4e040 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:12.962593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd8a6a-986c-43d0-91bc-51a204f4e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:12.962936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd8a6a-986c-43d0-91bc-51a204f4e040 admin admin] PATH_INFO: `/v3/projects/826951a8ebec4ac4a81395da32e241c5/users/514dad1b78e04feabf3b8f7f31781986/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:12.986680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd8a6a-986c-43d0-91bc-51a204f4e040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826951a8ebec4ac4a81395da32e241c5, user_id=514dad1b78e04feabf3b8f7f31781986, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:12.989772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd8a6a-986c-43d0-91bc-51a204f4e040 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:13.007247 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2042/4062] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:12 2022] PUT /identity/v3/projects/826951a8ebec4ac4a81395da32e241c5/users/514dad1b78e04feabf3b8f7f31781986/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:13.011014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25816fe-c890-4f9f-9770-30089bc57bf8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:13.031070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25816fe-c890-4f9f-9770-30089bc57bf8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:13.124166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528583b-4ab7-4821-9d8c-8aa0e2e16fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:13.125051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528583b-4ab7-4821-9d8c-8aa0e2e16fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:13.125454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528583b-4ab7-4821-9d8c-8aa0e2e16fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:13.126377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528583b-4ab7-4821-9d8c-8aa0e2e16fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:13.128707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528583b-4ab7-4821-9d8c-8aa0e2e16fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:13.132320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528583b-4ab7-4821-9d8c-8aa0e2e16fe3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:13.147142 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2021/4063] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:13.150918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd8a6a-986c-43d0-91bc-51a204f4e040 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:13.165253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd8a6a-986c-43d0-91bc-51a204f4e040 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:13.171587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af959d5-4a25-48f4-af8b-5900006e9d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:13.172580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af959d5-4a25-48f4-af8b-5900006e9d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:13.173326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af959d5-4a25-48f4-af8b-5900006e9d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:13.173326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af959d5-4a25-48f4-af8b-5900006e9d29 admin admin] PATH_INFO: `/v3/projects/826951a8ebec4ac4a81395da32e241c5/users/514dad1b78e04feabf3b8f7f31781986/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:13.175689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af959d5-4a25-48f4-af8b-5900006e9d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826951a8ebec4ac4a81395da32e241c5, user_id=514dad1b78e04feabf3b8f7f31781986, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:13.178695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af959d5-4a25-48f4-af8b-5900006e9d29 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:13.192122 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2043/4064] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:13 2022] PUT /identity/v3/projects/826951a8ebec4ac4a81395da32e241c5/users/514dad1b78e04feabf3b8f7f31781986/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:43:13.204548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7edc-cbc9-4da6-a6d8-ec675fb9ddf0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:13.205118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7edc-cbc9-4da6-a6d8-ec675fb9ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:13.205618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7edc-cbc9-4da6-a6d8-ec675fb9ddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:13.240251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a7ed7edc-cbc9-4da6-a6d8-ec675fb9ddf0 None None] MFA Rules not processed for user `514dad1b78e04feabf3b8f7f31781986`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:13.242095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a7ed7edc-cbc9-4da6-a6d8-ec675fb9ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:13.354706 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2022/4065] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:13.386029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af959d5-4a25-48f4-af8b-5900006e9d29 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:13.387998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3af959d5-4a25-48f4-af8b-5900006e9d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:13.565915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af959d5-4a25-48f4-af8b-5900006e9d29 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:13.577644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c66c4-6aa1-42bf-8f71-82e76b185111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:13.578662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c66c4-6aa1-42bf-8f71-82e76b185111 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:13.579110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c66c4-6aa1-42bf-8f71-82e76b185111 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:13.579543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c66c4-6aa1-42bf-8f71-82e76b185111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:13.599811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:13.682324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c66c4-6aa1-42bf-8f71-82e76b185111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:13.685976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c66c4-6aa1-42bf-8f71-82e76b185111 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:13.700294 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2044/4066] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:15.865157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed7edc-cbc9-4da6-a6d8-ec675fb9ddf0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:15.866634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a7ed7edc-cbc9-4da6-a6d8-ec675fb9ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:15.880173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed7edc-cbc9-4da6-a6d8-ec675fb9ddf0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:15.883800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687f14e-24d4-449b-9d75-d2d2b6314c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:15.884412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687f14e-24d4-449b-9d75-d2d2b6314c22 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:15.884726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687f14e-24d4-449b-9d75-d2d2b6314c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:15.884994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687f14e-24d4-449b-9d75-d2d2b6314c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:15.895872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:15.898546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687f14e-24d4-449b-9d75-d2d2b6314c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:15.900076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687f14e-24d4-449b-9d75-d2d2b6314c22 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:15.917550 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2023/4067] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:23.693244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=22 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:24.804933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c66c4-6aa1-42bf-8f71-82e76b185111 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:24.806976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4f0c66c4-6aa1-42bf-8f71-82e76b185111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:25.006699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c66c4-6aa1-42bf-8f71-82e76b185111 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:25.021348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad87140-b667-49f2-a22f-963ae7217dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:25.022023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad87140-b667-49f2-a22f-963ae7217dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:25.022302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad87140-b667-49f2-a22f-963ae7217dae admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:25.022573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad87140-b667-49f2-a22f-963ae7217dae admin admin] PATH_INFO: `/v3/users/bc96cbe7dc5848538bad1b075b301f34` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:25.023714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad87140-b667-49f2-a22f-963ae7217dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc96cbe7dc5848538bad1b075b301f34)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:25.025692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad87140-b667-49f2-a22f-963ae7217dae admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:25.119781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ad87140-b667-49f2-a22f-963ae7217dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc96cbe7dc5848538bad1b075b301f34'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:25.120474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ad87140-b667-49f2-a22f-963ae7217dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc96cbe7dc5848538bad1b075b301f34'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:25.143648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ad87140-b667-49f2-a22f-963ae7217dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc96cbe7dc5848538bad1b075b301f34'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:25.144334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ad87140-b667-49f2-a22f-963ae7217dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc96cbe7dc5848538bad1b075b301f34'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:25.162298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ad87140-b667-49f2-a22f-963ae7217dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc96cbe7dc5848538bad1b075b301f34'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:25.180847 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2045/4068] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:43:24 2022] DELETE /identity/v3/users/bc96cbe7dc5848538bad1b075b301f34 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:25.913632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:25.960062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687f14e-24d4-449b-9d75-d2d2b6314c22 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:25.976132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687f14e-24d4-449b-9d75-d2d2b6314c22 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:26.066214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:26.067119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:26.067599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:26.068222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] PATH_INFO: `/v3/projects/309d278f6e73403493d64a833dcea802` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:26.070123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=309d278f6e73403493d64a833dcea802)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:26.072634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:26.148040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309d278f6e73403493d64a833dcea802', 'request_id': 'req-e5900587-d95f-40cb-bca0-d6ee7496c292'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:26.155358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309d278f6e73403493d64a833dcea802', 'request_id': 'req-e5900587-d95f-40cb-bca0-d6ee7496c292'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:26.164923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309d278f6e73403493d64a833dcea802', 'request_id': 'req-e5900587-d95f-40cb-bca0-d6ee7496c292'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:26.180995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] The token cache is being invalidate because project 309d278f6e73403493d64a833dcea802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:43:26.182907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:26.183717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5900587-d95f-40cb-bca0-d6ee7496c292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:26.187288 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2024/4069] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:25 2022] DELETE /identity/v3/projects/309d278f6e73403493d64a833dcea802 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:26.193530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053495-2767-438c-944a-d028824b6453 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:26.194096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053495-2767-438c-944a-d028824b6453 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:26.194359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053495-2767-438c-944a-d028824b6453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:26.234984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-56053495-2767-438c-944a-d028824b6453 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:26.238901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-56053495-2767-438c-944a-d028824b6453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:26.346253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c989ee4-59d9-4f33-b445-e948a396fb4f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:26.348418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c989ee4-59d9-4f33-b445-e948a396fb4f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:26.348965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c989ee4-59d9-4f33-b445-e948a396fb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:26.389300 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2046/4070] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:26.396868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9c989ee4-59d9-4f33-b445-e948a396fb4f None None] MFA Rules not processed for user `84feafb1d3ef4704a583d08c2e17b48c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:26.397298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73ff1a-b86e-43bf-8b9a-1260ae4ed9b2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:26.398170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9c989ee4-59d9-4f33-b445-e948a396fb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:26.398827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73ff1a-b86e-43bf-8b9a-1260ae4ed9b2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:26.399488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73ff1a-b86e-43bf-8b9a-1260ae4ed9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:26.432187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ef73ff1a-b86e-43bf-8b9a-1260ae4ed9b2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:26.433620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ef73ff1a-b86e-43bf-8b9a-1260ae4ed9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:26.444295 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2047/4071] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:26.449274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73ff1a-b86e-43bf-8b9a-1260ae4ed9b2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:26.489589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73ff1a-b86e-43bf-8b9a-1260ae4ed9b2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:26.492651 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2025/4072] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:43:26.503817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26c480-016d-4835-97ca-77ef0a532794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:26.503817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26c480-016d-4835-97ca-77ef0a532794 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:26.503817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26c480-016d-4835-97ca-77ef0a532794 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:26.503817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26c480-016d-4835-97ca-77ef0a532794 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:26.504369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26c480-016d-4835-97ca-77ef0a532794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:43:26.504369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26c480-016d-4835-97ca-77ef0a532794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:26.504369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26c480-016d-4835-97ca-77ef0a532794 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:26.516627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:26.523887 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2048/4073] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:43:26.529581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c989ee4-59d9-4f33-b445-e948a396fb4f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:26.542596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c989ee4-59d9-4f33-b445-e948a396fb4f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:26.548813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dd935-2f8c-4390-90a9-42552805c3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:26.549725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd935-2f8c-4390-90a9-42552805c3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:26.550298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd935-2f8c-4390-90a9-42552805c3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:26.550741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd935-2f8c-4390-90a9-42552805c3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:26.551493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dd935-2f8c-4390-90a9-42552805c3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:26.553809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dd935-2f8c-4390-90a9-42552805c3d4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:26.601984 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2026/4074] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:43:26 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:26.603143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26c480-016d-4835-97ca-77ef0a532794 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:26.624192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26c480-016d-4835-97ca-77ef0a532794 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:26.747423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11099c7c-f997-4d96-ab1e-b847abd7791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:26.748047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099c7c-f997-4d96-ab1e-b847abd7791b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:26.748323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099c7c-f997-4d96-ab1e-b847abd7791b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:26.748604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099c7c-f997-4d96-ab1e-b847abd7791b admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:26.749225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11099c7c-f997-4d96-ab1e-b847abd7791b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:26.751528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11099c7c-f997-4d96-ab1e-b847abd7791b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:26.801019 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2049/4075] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:43:26 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:26.804808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dd935-2f8c-4390-90a9-42552805c3d4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:26.819180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dd935-2f8c-4390-90a9-42552805c3d4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:26.824738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192312e3-addb-4742-83a1-02dd636864fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:26.842119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192312e3-addb-4742-83a1-02dd636864fb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:26.842591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192312e3-addb-4742-83a1-02dd636864fb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:26.842980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192312e3-addb-4742-83a1-02dd636864fb admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:26.843787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192312e3-addb-4742-83a1-02dd636864fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:26.845608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192312e3-addb-4742-83a1-02dd636864fb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:26.863852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11099c7c-f997-4d96-ab1e-b847abd7791b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:26.864010 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2027/4076] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:26.880805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11099c7c-f997-4d96-ab1e-b847abd7791b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:26.887400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd0c32-a4ee-4697-8215-93da333eed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:26.888797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd0c32-a4ee-4697-8215-93da333eed8c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:26.889185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd0c32-a4ee-4697-8215-93da333eed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:26.889597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd0c32-a4ee-4697-8215-93da333eed8c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:26.891068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd0c32-a4ee-4697-8215-93da333eed8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:26.892812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd0c32-a4ee-4697-8215-93da333eed8c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:26.913764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192312e3-addb-4742-83a1-02dd636864fb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:26.920779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:26.923491 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2050/4077] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:26.943745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192312e3-addb-4742-83a1-02dd636864fb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:26.952723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c3cd7-beff-4627-9409-624a11b7d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:26.953431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c3cd7-beff-4627-9409-624a11b7d633 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:26.953762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c3cd7-beff-4627-9409-624a11b7d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:26.954039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c3cd7-beff-4627-9409-624a11b7d633 admin admin] PATH_INFO: `/v3/projects/d74479e5a17b45fa978b66de4518af3b/users/2b12d5ec1e554d2593d349583fa19691/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:26.973313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c3cd7-beff-4627-9409-624a11b7d633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74479e5a17b45fa978b66de4518af3b, user_id=2b12d5ec1e554d2593d349583fa19691, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:26.976971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c3cd7-beff-4627-9409-624a11b7d633 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:26.998550 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2028/4078] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:26 2022] PUT /identity/v3/projects/d74479e5a17b45fa978b66de4518af3b/users/2b12d5ec1e554d2593d349583fa19691/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:43:27.005505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae6452-957a-4437-83a0-56fd88ca6e28 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:27.005704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae6452-957a-4437-83a0-56fd88ca6e28 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:27.006073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae6452-957a-4437-83a0-56fd88ca6e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:27.030054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-87ae6452-957a-4437-83a0-56fd88ca6e28 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:27.031475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-87ae6452-957a-4437-83a0-56fd88ca6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:27.110192 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2051/4079] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:27.131109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c3cd7-beff-4627-9409-624a11b7d633 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:27.135029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-893c3cd7-beff-4627-9409-624a11b7d633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:27.245923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c3cd7-beff-4627-9409-624a11b7d633 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:27.256127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4ea89-8271-40c3-94e2-9a3efce94c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:27.256776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ea89-8271-40c3-94e2-9a3efce94c4e service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:27.257072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ea89-8271-40c3-94e2-9a3efce94c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:27.257350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ea89-8271-40c3-94e2-9a3efce94c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:27.289640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4ea89-8271-40c3-94e2-9a3efce94c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:27.291180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4ea89-8271-40c3-94e2-9a3efce94c4e service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:27.310554 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2029/4080] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:43:37.098379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:37.300523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:38.136286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daec1fb-7777-4303-bdfa-73a633c1c6a8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:38.136921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daec1fb-7777-4303-bdfa-73a633c1c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:38.136921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daec1fb-7777-4303-bdfa-73a633c1c6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:38.170078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6daec1fb-7777-4303-bdfa-73a633c1c6a8 None None] MFA Rules not processed for user `f1fd00311fa540658cfd4076c9a88976`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:38.171436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6daec1fb-7777-4303-bdfa-73a633c1c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:38.261482 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2052/4081] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:40.442059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4ea89-8271-40c3-94e2-9a3efce94c4e service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:40.444300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-85d4ea89-8271-40c3-94e2-9a3efce94c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:40.530067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4ea89-8271-40c3-94e2-9a3efce94c4e service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:40.539661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:40.540293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:40.540654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:40.540904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] PATH_INFO: `/v3/users/c24952de06034f2b8befeae4213ae61e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:40.542711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24952de06034f2b8befeae4213ae61e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:40.545796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:40.625273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24952de06034f2b8befeae4213ae61e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:40.627349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24952de06034f2b8befeae4213ae61e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:40.648441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24952de06034f2b8befeae4213ae61e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:40.670993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24952de06034f2b8befeae4213ae61e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:40.686782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24952de06034f2b8befeae4213ae61e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:40.697471 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2030/4082] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:43:40 2022] DELETE /identity/v3/users/c24952de06034f2b8befeae4213ae61e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:40.700659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950962-d00e-449a-8628-aff91f79b999 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:40.701062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950962-d00e-449a-8628-aff91f79b999 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:40.701219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950962-d00e-449a-8628-aff91f79b999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:40.729626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0c950962-d00e-449a-8628-aff91f79b999 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:40.731168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0c950962-d00e-449a-8628-aff91f79b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:40.863454 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2053/4083] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:40.906635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:40.908477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:41.039438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6cee1-a8a3-446b-8c16-4fd4277e845b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:41.044581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9936e-bb2a-4b3a-aafa-293e5c948950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:41.045619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9936e-bb2a-4b3a-aafa-293e5c948950 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:41.047742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9936e-bb2a-4b3a-aafa-293e5c948950 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:41.048257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9936e-bb2a-4b3a-aafa-293e5c948950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:41.076602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9936e-bb2a-4b3a-aafa-293e5c948950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:41.079161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9936e-bb2a-4b3a-aafa-293e5c948950 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:41.099170 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2031/4084] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:41.738881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c950962-d00e-449a-8628-aff91f79b999 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:41.740422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0c950962-d00e-449a-8628-aff91f79b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:41.757814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c950962-d00e-449a-8628-aff91f79b999 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:41.778602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:41.779291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:41.779637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:41.779970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] PATH_INFO: `/v3/projects/ec5e4b31c94f49f3899ffef6779c0c8f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:41.792328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5e4b31c94f49f3899ffef6779c0c8f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:41.794587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:41.876098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5e4b31c94f49f3899ffef6779c0c8f', 'request_id': 'req-5e339ed7-d844-4d47-be0e-c383e9bdf985'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:41.884648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5e4b31c94f49f3899ffef6779c0c8f', 'request_id': 'req-5e339ed7-d844-4d47-be0e-c383e9bdf985'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:41.898180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5e4b31c94f49f3899ffef6779c0c8f', 'request_id': 'req-5e339ed7-d844-4d47-be0e-c383e9bdf985'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:41.931148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] The token cache is being invalidate because project ec5e4b31c94f49f3899ffef6779c0c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:43:41.937966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:41.940117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e339ed7-d844-4d47-be0e-c383e9bdf985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:41.947654 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2054/4085] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:41 2022] DELETE /identity/v3/projects/ec5e4b31c94f49f3899ffef6779c0c8f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:41.949424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9936e-bb2a-4b3a-aafa-293e5c948950 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:41.962841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9936e-bb2a-4b3a-aafa-293e5c948950 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:42.006291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:42.037921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:42.038580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:42.039040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:42.039730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] PATH_INFO: `/v3/users/514dad1b78e04feabf3b8f7f31781986` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:42.041009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=514dad1b78e04feabf3b8f7f31781986)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:42.044858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:42.154772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514dad1b78e04feabf3b8f7f31781986'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:42.155416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514dad1b78e04feabf3b8f7f31781986'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:42.185560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514dad1b78e04feabf3b8f7f31781986'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:42.196856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514dad1b78e04feabf3b8f7f31781986'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:42.214206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514dad1b78e04feabf3b8f7f31781986'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:42.236170 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2032/4086] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:43:41 2022] DELETE /identity/v3/users/514dad1b78e04feabf3b8f7f31781986 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:43.484034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63948f-e406-4385-9b6d-8c84a218e4fb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:43.484521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63948f-e406-4385-9b6d-8c84a218e4fb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:43.484640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63948f-e406-4385-9b6d-8c84a218e4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:43.494143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:43.517191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bd63948f-e406-4385-9b6d-8c84a218e4fb None None] MFA Rules not processed for user `351e59b6021b44a29665281568960f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:43.519206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bd63948f-e406-4385-9b6d-8c84a218e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:43.670670 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2055/4087] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:45.108113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:45.110357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:45.300505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83803-66d1-48b4-b24e-a1111bef3e7a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:45.312276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:45.313265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:45.313769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:45.314821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] PATH_INFO: `/v3/projects/826951a8ebec4ac4a81395da32e241c5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:45.316838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=826951a8ebec4ac4a81395da32e241c5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:45.323120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:45.390340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826951a8ebec4ac4a81395da32e241c5', 'request_id': 'req-e5c72e37-4ab4-402b-999f-fbea12dc5a99'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:45.398358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:45.400834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826951a8ebec4ac4a81395da32e241c5', 'request_id': 'req-e5c72e37-4ab4-402b-999f-fbea12dc5a99'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:45.419382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826951a8ebec4ac4a81395da32e241c5', 'request_id': 'req-e5c72e37-4ab4-402b-999f-fbea12dc5a99'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:45.437676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] The token cache is being invalidate because project 826951a8ebec4ac4a81395da32e241c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:43:45.438218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:45.439146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c72e37-4ab4-402b-999f-fbea12dc5a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:45.445764 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2033/4088] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:45 2022] DELETE /identity/v3/projects/826951a8ebec4ac4a81395da32e241c5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:45.446704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57c495-4242-4cd0-843e-49b1a20c55f1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:45.447176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57c495-4242-4cd0-843e-49b1a20c55f1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:45.447272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57c495-4242-4cd0-843e-49b1a20c55f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:45.490475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ae57c495-4242-4cd0-843e-49b1a20c55f1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:45.491742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ae57c495-4242-4cd0-843e-49b1a20c55f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:45.626277 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2056/4089] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:43:45.634399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966513c-222f-49c6-97fb-8cf7aaa9d16c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:45.634695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966513c-222f-49c6-97fb-8cf7aaa9d16c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:45.634969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966513c-222f-49c6-97fb-8cf7aaa9d16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:45.674920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b966513c-222f-49c6-97fb-8cf7aaa9d16c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:45.676271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b966513c-222f-49c6-97fb-8cf7aaa9d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:45.689814 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2034/4090] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:45.691167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57c495-4242-4cd0-843e-49b1a20c55f1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:45.714104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57c495-4242-4cd0-843e-49b1a20c55f1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:45.738246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b323db-d08c-406a-bed3-c81e34b5951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:45.739828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b323db-d08c-406a-bed3-c81e34b5951b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:45.741038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b323db-d08c-406a-bed3-c81e34b5951b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:45.741547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b323db-d08c-406a-bed3-c81e34b5951b admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:45.748867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b323db-d08c-406a-bed3-c81e34b5951b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:43:45.749787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b323db-d08c-406a-bed3-c81e34b5951b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:45.753801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b323db-d08c-406a-bed3-c81e34b5951b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:45.795008 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2057/4091] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:43:45.800295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966513c-222f-49c6-97fb-8cf7aaa9d16c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:45.814463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966513c-222f-49c6-97fb-8cf7aaa9d16c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:45.826838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f8327-e9d3-48f4-9586-49e416dff3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:45.827469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8327-e9d3-48f4-9586-49e416dff3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:45.829304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8327-e9d3-48f4-9586-49e416dff3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:45.829304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8327-e9d3-48f4-9586-49e416dff3c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:45.829304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f8327-e9d3-48f4-9586-49e416dff3c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:45.832295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f8327-e9d3-48f4-9586-49e416dff3c7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:45.891799 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2035/4092] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:43:45 2022] POST /identity/v3/projects => generated 411 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:45.895897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b323db-d08c-406a-bed3-c81e34b5951b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:45.910796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b323db-d08c-406a-bed3-c81e34b5951b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:46.237563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad65a68-2772-469b-b5dd-e366774d5687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:46.237943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad65a68-2772-469b-b5dd-e366774d5687 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:46.238384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad65a68-2772-469b-b5dd-e366774d5687 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:46.238667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad65a68-2772-469b-b5dd-e366774d5687 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:46.239307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad65a68-2772-469b-b5dd-e366774d5687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:46.241335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad65a68-2772-469b-b5dd-e366774d5687 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:46.281376 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2058/4093] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:43:45 2022] POST /identity/v3/users => generated 306 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:46.285785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f8327-e9d3-48f4-9586-49e416dff3c7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:46.304924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f8327-e9d3-48f4-9586-49e416dff3c7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:46.313218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb7cf7-af39-4996-9498-269e3935bee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:46.314437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb7cf7-af39-4996-9498-269e3935bee8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:46.314951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb7cf7-af39-4996-9498-269e3935bee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:46.315534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb7cf7-af39-4996-9498-269e3935bee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:46.316707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb7cf7-af39-4996-9498-269e3935bee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:46.322072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb7cf7-af39-4996-9498-269e3935bee8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:46.344255 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2036/4094] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:43:46.352727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad65a68-2772-469b-b5dd-e366774d5687 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:46.395820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad65a68-2772-469b-b5dd-e366774d5687 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:46.415182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40916df-3b20-4348-9481-19356c87238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:46.415990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40916df-3b20-4348-9481-19356c87238d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:46.417366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40916df-3b20-4348-9481-19356c87238d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:46.417784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40916df-3b20-4348-9481-19356c87238d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:46.418692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40916df-3b20-4348-9481-19356c87238d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:46.420414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40916df-3b20-4348-9481-19356c87238d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:46.469211 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2059/4095] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:46.472124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb7cf7-af39-4996-9498-269e3935bee8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:46.488589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb7cf7-af39-4996-9498-269e3935bee8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:46.517337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71613e-bc5f-43f8-97a2-41e47cde9eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:46.518177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71613e-bc5f-43f8-97a2-41e47cde9eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:46.518459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71613e-bc5f-43f8-97a2-41e47cde9eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:46.518734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71613e-bc5f-43f8-97a2-41e47cde9eb1 admin admin] PATH_INFO: `/v3/projects/97ef7f6f1462407286f00648c3793ada/users/73241ff6bbf746e1b6998a71a7d48bd7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:46.579871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71613e-bc5f-43f8-97a2-41e47cde9eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ef7f6f1462407286f00648c3793ada, user_id=73241ff6bbf746e1b6998a71a7d48bd7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:46.582587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71613e-bc5f-43f8-97a2-41e47cde9eb1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:46.623194 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2037/4096] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:46 2022] PUT /identity/v3/projects/97ef7f6f1462407286f00648c3793ada/users/73241ff6bbf746e1b6998a71a7d48bd7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:46.628122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e84d9-24fb-488d-93b9-d87c9e96f711 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:46.628477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e84d9-24fb-488d-93b9-d87c9e96f711 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:46.631667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e84d9-24fb-488d-93b9-d87c9e96f711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:46.679866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:46.692776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3d5e84d9-24fb-488d-93b9-d87c9e96f711 None None] MFA Rules not processed for user `73241ff6bbf746e1b6998a71a7d48bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:46.694295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3d5e84d9-24fb-488d-93b9-d87c9e96f711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:46.757488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71613e-bc5f-43f8-97a2-41e47cde9eb1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:46.759336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bf71613e-bc5f-43f8-97a2-41e47cde9eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:46.924113 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2060/4097] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:46 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:46.926999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e84d9-24fb-488d-93b9-d87c9e96f711 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:46.933677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71613e-bc5f-43f8-97a2-41e47cde9eb1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:46.947510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:46.948409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:46.948877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:46.949150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] PATH_INFO: `/v3/users/87ab13dbc341434db7373fb4772fdf07` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:46.950977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ab13dbc341434db7373fb4772fdf07)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:46.952903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:46.964941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e84d9-24fb-488d-93b9-d87c9e96f711 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:46.978961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5b6aa-614c-40bc-a0b6-1e7d299ff879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:46.981626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5b6aa-614c-40bc-a0b6-1e7d299ff879 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:46.982407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5b6aa-614c-40bc-a0b6-1e7d299ff879 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:46.982844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5b6aa-614c-40bc-a0b6-1e7d299ff879 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:46.983616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5b6aa-614c-40bc-a0b6-1e7d299ff879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:46.991195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5b6aa-614c-40bc-a0b6-1e7d299ff879 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:47.116898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ab13dbc341434db7373fb4772fdf07'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:47.117731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ab13dbc341434db7373fb4772fdf07'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:47.125428 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2061/4098] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:43:46 2022] POST /identity/v3/projects => generated 411 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:47.130194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5b6aa-614c-40bc-a0b6-1e7d299ff879 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:47.154505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ab13dbc341434db7373fb4772fdf07'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:47.171942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ab13dbc341434db7373fb4772fdf07'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:47.205246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ab13dbc341434db7373fb4772fdf07'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:47.213281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:47.223774 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2038/4099] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:43:46 2022] DELETE /identity/v3/users/87ab13dbc341434db7373fb4772fdf07 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:43:47.292494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5b6aa-614c-40bc-a0b6-1e7d299ff879 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:47.389893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740390b2-6f60-4551-bfe2-7eaf64b99083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:47.392316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740390b2-6f60-4551-bfe2-7eaf64b99083 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:47.392906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740390b2-6f60-4551-bfe2-7eaf64b99083 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:47.394071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740390b2-6f60-4551-bfe2-7eaf64b99083 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:47.395001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740390b2-6f60-4551-bfe2-7eaf64b99083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:47.400587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740390b2-6f60-4551-bfe2-7eaf64b99083 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:47.446645 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2062/4100] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:43:47 2022] POST /identity/v3/users => generated 312 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:47.452152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:47.453824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:47.476339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200596-65f9-45bf-be35-f837329c0f22 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:47.496321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f94eb-1aef-40a3-a748-8ada54a096c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:47.497773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f94eb-1aef-40a3-a748-8ada54a096c2 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:47.498236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f94eb-1aef-40a3-a748-8ada54a096c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:47.498728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f94eb-1aef-40a3-a748-8ada54a096c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:47.499695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f94eb-1aef-40a3-a748-8ada54a096c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:47.507503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f94eb-1aef-40a3-a748-8ada54a096c2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:47.534625 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2039/4101] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:47.535687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740390b2-6f60-4551-bfe2-7eaf64b99083 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:47.558542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740390b2-6f60-4551-bfe2-7eaf64b99083 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:47.578589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa23687-bbf3-4441-bd97-cd677d6b8506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:47.579529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa23687-bbf3-4441-bd97-cd677d6b8506 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:47.579902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa23687-bbf3-4441-bd97-cd677d6b8506 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:47.580243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa23687-bbf3-4441-bd97-cd677d6b8506 admin admin] PATH_INFO: `/v3/projects/c2113e1022aa4f9aad5de623e97238e4/users/3dd743abcb2048e8a21125fad84e9762/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:47.619056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa23687-bbf3-4441-bd97-cd677d6b8506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2113e1022aa4f9aad5de623e97238e4, user_id=3dd743abcb2048e8a21125fad84e9762, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:47.623599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa23687-bbf3-4441-bd97-cd677d6b8506 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:47.626868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:47.661715 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2063/4102] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:47 2022] PUT /identity/v3/projects/c2113e1022aa4f9aad5de623e97238e4/users/3dd743abcb2048e8a21125fad84e9762/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:47.665910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f94eb-1aef-40a3-a748-8ada54a096c2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:47.696021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f94eb-1aef-40a3-a748-8ada54a096c2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:47.736190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa23687-bbf3-4441-bd97-cd677d6b8506 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:47.737546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3aa23687-bbf3-4441-bd97-cd677d6b8506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:47.838028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377d92f-e119-418b-91f1-f9870a4a00c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:47.838669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377d92f-e119-418b-91f1-f9870a4a00c1 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:47.838949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377d92f-e119-418b-91f1-f9870a4a00c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:47.839223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377d92f-e119-418b-91f1-f9870a4a00c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:47.839874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377d92f-e119-418b-91f1-f9870a4a00c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:47.842266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377d92f-e119-418b-91f1-f9870a4a00c1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:47.865407 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2040/4103] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:47.869146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377d92f-e119-418b-91f1-f9870a4a00c1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:47.895340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377d92f-e119-418b-91f1-f9870a4a00c1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:47.905248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c42bba-5aeb-42ae-a5a7-b199e9e33aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:47.906096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c42bba-5aeb-42ae-a5a7-b199e9e33aac admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:47.906437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c42bba-5aeb-42ae-a5a7-b199e9e33aac admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:47.906884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c42bba-5aeb-42ae-a5a7-b199e9e33aac admin admin] PATH_INFO: `/v3/projects/c2113e1022aa4f9aad5de623e97238e4/users/3dd743abcb2048e8a21125fad84e9762/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:47.917642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c42bba-5aeb-42ae-a5a7-b199e9e33aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2113e1022aa4f9aad5de623e97238e4, user_id=3dd743abcb2048e8a21125fad84e9762, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:47.920588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c42bba-5aeb-42ae-a5a7-b199e9e33aac admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:47.950403 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2041/4104] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:47 2022] PUT /identity/v3/projects/c2113e1022aa4f9aad5de623e97238e4/users/3dd743abcb2048e8a21125fad84e9762/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:47.970459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c42bba-5aeb-42ae-a5a7-b199e9e33aac admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:47.975004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa23687-bbf3-4441-bd97-cd677d6b8506 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:47.977535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-91c42bba-5aeb-42ae-a5a7-b199e9e33aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:48.077488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:48.078141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:48.078615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:48.078895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] PATH_INFO: `/v3/projects/883fcc619d694f89960bac6e7cb9c488` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:48.080106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=883fcc619d694f89960bac6e7cb9c488)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:48.082891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:48.234076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883fcc619d694f89960bac6e7cb9c488', 'request_id': 'req-19e44653-30c2-4ff2-91a1-312f33de6e04'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:48.257029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883fcc619d694f89960bac6e7cb9c488', 'request_id': 'req-19e44653-30c2-4ff2-91a1-312f33de6e04'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:48.273239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c42bba-5aeb-42ae-a5a7-b199e9e33aac admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:48.281882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883fcc619d694f89960bac6e7cb9c488', 'request_id': 'req-19e44653-30c2-4ff2-91a1-312f33de6e04'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:48.305266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] The token cache is being invalidate because project 883fcc619d694f89960bac6e7cb9c488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:43:48.305586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:48.306392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19e44653-30c2-4ff2-91a1-312f33de6e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:48.310558 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2064/4105] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:47 2022] DELETE /identity/v3/projects/883fcc619d694f89960bac6e7cb9c488 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:48.312015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582465cc-a799-41ef-ac96-0422032cfbac None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:48.312304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582465cc-a799-41ef-ac96-0422032cfbac None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:48.312580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582465cc-a799-41ef-ac96-0422032cfbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:48.375116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-582465cc-a799-41ef-ac96-0422032cfbac None None] MFA Rules not processed for user `3dd743abcb2048e8a21125fad84e9762`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:48.376360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-582465cc-a799-41ef-ac96-0422032cfbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:48.392883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:48.414488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208d8c2-b901-4a94-91ca-8b81108dd7ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:48.415236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208d8c2-b901-4a94-91ca-8b81108dd7ba service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:48.415522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208d8c2-b901-4a94-91ca-8b81108dd7ba service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:48.415966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208d8c2-b901-4a94-91ca-8b81108dd7ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:48.426571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9208d8c2-b901-4a94-91ca-8b81108dd7ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:48.443506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:48.445006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208d8c2-b901-4a94-91ca-8b81108dd7ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:48.446660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208d8c2-b901-4a94-91ca-8b81108dd7ba service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:48.473371 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2042/4106] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:48.474795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f27a4-172c-49f9-8b7d-bbc6171ece8c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:48.475059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f27a4-172c-49f9-8b7d-bbc6171ece8c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:48.475301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f27a4-172c-49f9-8b7d-bbc6171ece8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:48.518393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ae1f27a4-172c-49f9-8b7d-bbc6171ece8c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:48.519888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ae1f27a4-172c-49f9-8b7d-bbc6171ece8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:48.607359 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2065/4107] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:48 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:48.618156 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2043/4108] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:48.628757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7d69-c250-4ff5-a82b-14c304c00fb5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:48.629174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7d69-c250-4ff5-a82b-14c304c00fb5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:48.629625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7d69-c250-4ff5-a82b-14c304c00fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:48.666363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f27a4-172c-49f9-8b7d-bbc6171ece8c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:48.668704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ae1f27a4-172c-49f9-8b7d-bbc6171ece8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:48.699082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e34e7d69-c250-4ff5-a82b-14c304c00fb5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:48.699082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e34e7d69-c250-4ff5-a82b-14c304c00fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:48.735568 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2066/4109] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:48.740076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e7d69-c250-4ff5-a82b-14c304c00fb5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:48.752044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e7d69-c250-4ff5-a82b-14c304c00fb5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:48.772751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f27a4-172c-49f9-8b7d-bbc6171ece8c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:48.773297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811855e6-026e-408d-ad23-b8f3aba0166a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:48.774094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811855e6-026e-408d-ad23-b8f3aba0166a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:48.774461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811855e6-026e-408d-ad23-b8f3aba0166a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:48.774815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811855e6-026e-408d-ad23-b8f3aba0166a admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:48.775537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811855e6-026e-408d-ad23-b8f3aba0166a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:43:48.775833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811855e6-026e-408d-ad23-b8f3aba0166a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:48.781077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811855e6-026e-408d-ad23-b8f3aba0166a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:48.784619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f44cf-bb17-4ce4-99b0-577fecec2d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:48.785719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f44cf-bb17-4ce4-99b0-577fecec2d18 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:48.786369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f44cf-bb17-4ce4-99b0-577fecec2d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:48.786847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f44cf-bb17-4ce4-99b0-577fecec2d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:48.802073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f44cf-bb17-4ce4-99b0-577fecec2d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:48.804277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f44cf-bb17-4ce4-99b0-577fecec2d18 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:48.817381 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2044/4110] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:48 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:48.824089 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2067/4111] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:43:48.828998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f44cf-bb17-4ce4-99b0-577fecec2d18 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:48.858243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f44cf-bb17-4ce4-99b0-577fecec2d18 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:48.871303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fff267-e20c-4dac-88e5-6f5b7fa6b4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:48.872189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fff267-e20c-4dac-88e5-6f5b7fa6b4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:48.872474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fff267-e20c-4dac-88e5-6f5b7fa6b4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:48.873066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fff267-e20c-4dac-88e5-6f5b7fa6b4f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:48.873847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fff267-e20c-4dac-88e5-6f5b7fa6b4f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:48.876534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fff267-e20c-4dac-88e5-6f5b7fa6b4f6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:48.921614 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2045/4112] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:43:48 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:48.926593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811855e6-026e-408d-ad23-b8f3aba0166a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:48.938795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811855e6-026e-408d-ad23-b8f3aba0166a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:49.045037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441fbc8-da4e-46a2-bbdf-fa702ccd10b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:49.046056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441fbc8-da4e-46a2-bbdf-fa702ccd10b1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:49.046056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441fbc8-da4e-46a2-bbdf-fa702ccd10b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:49.046280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441fbc8-da4e-46a2-bbdf-fa702ccd10b1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:49.046922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441fbc8-da4e-46a2-bbdf-fa702ccd10b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:49.049361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441fbc8-da4e-46a2-bbdf-fa702ccd10b1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:49.081142 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2068/4113] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:43:48 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:49.084278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fff267-e20c-4dac-88e5-6f5b7fa6b4f6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:49.098012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fff267-e20c-4dac-88e5-6f5b7fa6b4f6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:49.105473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e72fde-7b62-4f94-97b3-9da74f0783bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:49.106726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e72fde-7b62-4f94-97b3-9da74f0783bd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:49.107007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e72fde-7b62-4f94-97b3-9da74f0783bd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:49.107854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e72fde-7b62-4f94-97b3-9da74f0783bd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:49.108165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e72fde-7b62-4f94-97b3-9da74f0783bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:49.110015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e72fde-7b62-4f94-97b3-9da74f0783bd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:49.150045 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2046/4114] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:49.152771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441fbc8-da4e-46a2-bbdf-fa702ccd10b1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:49.164703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441fbc8-da4e-46a2-bbdf-fa702ccd10b1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:49.179509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be1c92-1e99-4c1d-b369-2e65c1474f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:49.180480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be1c92-1e99-4c1d-b369-2e65c1474f51 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:49.180480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be1c92-1e99-4c1d-b369-2e65c1474f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:49.180743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be1c92-1e99-4c1d-b369-2e65c1474f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:49.181298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be1c92-1e99-4c1d-b369-2e65c1474f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:49.183075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be1c92-1e99-4c1d-b369-2e65c1474f51 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:49.214005 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2069/4115] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:49.219041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e72fde-7b62-4f94-97b3-9da74f0783bd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:49.231632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e72fde-7b62-4f94-97b3-9da74f0783bd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:49.236792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52978d06-5122-4b77-b2b1-72ee26ba9833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:49.237525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978d06-5122-4b77-b2b1-72ee26ba9833 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:49.237819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978d06-5122-4b77-b2b1-72ee26ba9833 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:49.238155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978d06-5122-4b77-b2b1-72ee26ba9833 admin admin] PATH_INFO: `/v3/projects/7d8d815a02904e98a8345d0ff4a234db/users/021819f70ef84630b9e507283c2a50a8/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:49.257595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52978d06-5122-4b77-b2b1-72ee26ba9833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8d815a02904e98a8345d0ff4a234db, user_id=021819f70ef84630b9e507283c2a50a8, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:49.264612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52978d06-5122-4b77-b2b1-72ee26ba9833 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:49.294603 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2047/4116] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:49 2022] PUT /identity/v3/projects/7d8d815a02904e98a8345d0ff4a234db/users/021819f70ef84630b9e507283c2a50a8/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:49.297083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b398752-d8dd-4229-8fcb-f7ce6b0c47d0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:49.297367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b398752-d8dd-4229-8fcb-f7ce6b0c47d0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:49.298644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b398752-d8dd-4229-8fcb-f7ce6b0c47d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:49.343704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2b398752-d8dd-4229-8fcb-f7ce6b0c47d0 None None] MFA Rules not processed for user `021819f70ef84630b9e507283c2a50a8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:49.345303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2b398752-d8dd-4229-8fcb-f7ce6b0c47d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:49.479892 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2070/4117] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:49.493076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d91ca-ff5b-43d6-9816-6a55b4ddc4a0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:49.493661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d91ca-ff5b-43d6-9816-6a55b4ddc4a0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:49.493661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d91ca-ff5b-43d6-9816-6a55b4ddc4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:49.572950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e15d91ca-ff5b-43d6-9816-6a55b4ddc4a0 None None] MFA Rules not processed for user `021819f70ef84630b9e507283c2a50a8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:49.574530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e15d91ca-ff5b-43d6-9816-6a55b4ddc4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:49.583522 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2048/4118] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:49.595233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b398752-d8dd-4229-8fcb-f7ce6b0c47d0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:49.597221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2b398752-d8dd-4229-8fcb-f7ce6b0c47d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:49.605873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:49.752175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b398752-d8dd-4229-8fcb-f7ce6b0c47d0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:49.771004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350dfbf-7fcc-4bbb-b416-320ba552cf65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:49.775130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350dfbf-7fcc-4bbb-b416-320ba552cf65 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:49.775429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350dfbf-7fcc-4bbb-b416-320ba552cf65 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:49.775710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350dfbf-7fcc-4bbb-b416-320ba552cf65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:49.806988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350dfbf-7fcc-4bbb-b416-320ba552cf65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:49.812032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350dfbf-7fcc-4bbb-b416-320ba552cf65 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:49.830048 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2071/4119] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:52.788205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379e4e-7102-417f-a90e-9a01384781f9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:52.789133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379e4e-7102-417f-a90e-9a01384781f9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:52.789829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379e4e-7102-417f-a90e-9a01384781f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:52.877718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d3379e4e-7102-417f-a90e-9a01384781f9 None None] MFA Rules not processed for user `2b12d5ec1e554d2593d349583fa19691`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:52.878973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d3379e4e-7102-417f-a90e-9a01384781f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:52.896079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:52.988543 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2049/4120] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:53.136512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350dfbf-7fcc-4bbb-b416-320ba552cf65 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:53.139224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1350dfbf-7fcc-4bbb-b416-320ba552cf65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:53.200390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350dfbf-7fcc-4bbb-b416-320ba552cf65 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:53.216330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eaa023-d015-472d-ae03-e1a08d60a385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:53.217250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa023-d015-472d-ae03-e1a08d60a385 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:53.217730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa023-d015-472d-ae03-e1a08d60a385 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:53.218303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa023-d015-472d-ae03-e1a08d60a385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:53.261549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eaa023-d015-472d-ae03-e1a08d60a385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:53.264635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eaa023-d015-472d-ae03-e1a08d60a385 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:53.293450 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2072/4121] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:55.132367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379e4e-7102-417f-a90e-9a01384781f9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:55.133886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d3379e4e-7102-417f-a90e-9a01384781f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:55.281268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379e4e-7102-417f-a90e-9a01384781f9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:55.288256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:55.288964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:55.289246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:55.289572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] PATH_INFO: `/v3/users/73241ff6bbf746e1b6998a71a7d48bd7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:55.292402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73241ff6bbf746e1b6998a71a7d48bd7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:55.294962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:55.426455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73241ff6bbf746e1b6998a71a7d48bd7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:55.427419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73241ff6bbf746e1b6998a71a7d48bd7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:55.442094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73241ff6bbf746e1b6998a71a7d48bd7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:55.455395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73241ff6bbf746e1b6998a71a7d48bd7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:55.481578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73241ff6bbf746e1b6998a71a7d48bd7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:55.494018 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2050/4122] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:43:55 2022] DELETE /identity/v3/users/73241ff6bbf746e1b6998a71a7d48bd7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:55.499115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231a904-e345-4949-babe-968498f526b2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:55.499997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231a904-e345-4949-babe-968498f526b2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:55.500528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231a904-e345-4949-babe-968498f526b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:55.547846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4231a904-e345-4949-babe-968498f526b2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:55.549119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4231a904-e345-4949-babe-968498f526b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:55.690538 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2073/4123] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:55.737092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:55.739145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:55.821458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:55.858941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde73ef9-7173-4222-82b0-4556d7e72363 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:55.862874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03a704-dfae-4503-af34-6d86dbe90a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:55.863480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03a704-dfae-4503-af34-6d86dbe90a76 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:55.863764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03a704-dfae-4503-af34-6d86dbe90a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:55.864046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03a704-dfae-4503-af34-6d86dbe90a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:55.875885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03a704-dfae-4503-af34-6d86dbe90a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:55.877348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03a704-dfae-4503-af34-6d86dbe90a76 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:55.924341 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2051/4124] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:57.342926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231a904-e345-4949-babe-968498f526b2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:57.344344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4231a904-e345-4949-babe-968498f526b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:57.364260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231a904-e345-4949-babe-968498f526b2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:57.370085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:57.370944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:57.372159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:57.372671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] PATH_INFO: `/v3/projects/97ef7f6f1462407286f00648c3793ada` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:57.374056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ef7f6f1462407286f00648c3793ada)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:57.376281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:57.480251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ef7f6f1462407286f00648c3793ada', 'request_id': 'req-be52d836-d4e5-45c4-9dd5-9682afa16420'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:57.492616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ef7f6f1462407286f00648c3793ada', 'request_id': 'req-be52d836-d4e5-45c4-9dd5-9682afa16420'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:57.504795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ef7f6f1462407286f00648c3793ada', 'request_id': 'req-be52d836-d4e5-45c4-9dd5-9682afa16420'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:57.518740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:57.526045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] The token cache is being invalidate because project 97ef7f6f1462407286f00648c3793ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:43:57.527088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:57.528621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be52d836-d4e5-45c4-9dd5-9682afa16420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:57.531842 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2074/4125] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:57 2022] DELETE /identity/v3/projects/97ef7f6f1462407286f00648c3793ada => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:57.535439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03a704-dfae-4503-af34-6d86dbe90a76 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:57.561577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e13b1-c910-4db3-a382-704768e1df6a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:57.564124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03a704-dfae-4503-af34-6d86dbe90a76 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:57.564616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e13b1-c910-4db3-a382-704768e1df6a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:57.564887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e13b1-c910-4db3-a382-704768e1df6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:57.607829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-261e13b1-c910-4db3-a382-704768e1df6a None None] MFA Rules not processed for user `2b12d5ec1e554d2593d349583fa19691`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:57.609203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-261e13b1-c910-4db3-a382-704768e1df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:57.712602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8187385-6ea5-46e0-b6ac-88c7e5768dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:57.713450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8187385-6ea5-46e0-b6ac-88c7e5768dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:57.713798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8187385-6ea5-46e0-b6ac-88c7e5768dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:57.714156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8187385-6ea5-46e0-b6ac-88c7e5768dc9 admin admin] PATH_INFO: `/v3/users/3dd743abcb2048e8a21125fad84e9762` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:57.716547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8187385-6ea5-46e0-b6ac-88c7e5768dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd743abcb2048e8a21125fad84e9762)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:57.719213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8187385-6ea5-46e0-b6ac-88c7e5768dc9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:57.719592 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2075/4126] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:57.779949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8187385-6ea5-46e0-b6ac-88c7e5768dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd743abcb2048e8a21125fad84e9762'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:57.780614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8187385-6ea5-46e0-b6ac-88c7e5768dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd743abcb2048e8a21125fad84e9762'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:57.797029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8187385-6ea5-46e0-b6ac-88c7e5768dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd743abcb2048e8a21125fad84e9762'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:57.806364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8187385-6ea5-46e0-b6ac-88c7e5768dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd743abcb2048e8a21125fad84e9762'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:57.815950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8187385-6ea5-46e0-b6ac-88c7e5768dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd743abcb2048e8a21125fad84e9762'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:57.823880 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2052/4127] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:43:57 2022] DELETE /identity/v3/users/3dd743abcb2048e8a21125fad84e9762 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:58.098495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e13b1-c910-4db3-a382-704768e1df6a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:58.100393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-261e13b1-c910-4db3-a382-704768e1df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:58.124295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e13b1-c910-4db3-a382-704768e1df6a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:58.205336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:58.206117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:58.206474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:58.206822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] PATH_INFO: `/v3/projects/c2113e1022aa4f9aad5de623e97238e4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:58.208131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2113e1022aa4f9aad5de623e97238e4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:58.210533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:58.270202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2113e1022aa4f9aad5de623e97238e4', 'request_id': 'req-5cf6e3ed-249a-4912-9a04-eb3c260c680e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:58.283542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2113e1022aa4f9aad5de623e97238e4', 'request_id': 'req-5cf6e3ed-249a-4912-9a04-eb3c260c680e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:58.297293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2113e1022aa4f9aad5de623e97238e4', 'request_id': 'req-5cf6e3ed-249a-4912-9a04-eb3c260c680e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:58.326242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] The token cache is being invalidate because project c2113e1022aa4f9aad5de623e97238e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:43:58.326916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:58.328431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5cf6e3ed-249a-4912-9a04-eb3c260c680e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:43:58.331267 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2076/4128] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:58 2022] DELETE /identity/v3/projects/c2113e1022aa4f9aad5de623e97238e4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:58.336348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba23b7-d41f-44f8-8598-b13f6dbc8dc6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:58.336639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba23b7-d41f-44f8-8598-b13f6dbc8dc6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:58.336921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba23b7-d41f-44f8-8598-b13f6dbc8dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:58.366384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-dfba23b7-d41f-44f8-8598-b13f6dbc8dc6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:58.368043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dfba23b7-d41f-44f8-8598-b13f6dbc8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:58.454697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:58.479526 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2053/4129] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:58.494222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36540c61-7f11-48b0-a0b7-42388a760697 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:58.495003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36540c61-7f11-48b0-a0b7-42388a760697 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:58.495282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36540c61-7f11-48b0-a0b7-42388a760697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:58.523058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-36540c61-7f11-48b0-a0b7-42388a760697 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:58.524269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-36540c61-7f11-48b0-a0b7-42388a760697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:58.533134 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2077/4130] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:58.537878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba23b7-d41f-44f8-8598-b13f6dbc8dc6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:58.550878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba23b7-d41f-44f8-8598-b13f6dbc8dc6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:58.557152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6358a-5498-4976-8cda-ad548b6b858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:58.558044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6358a-5498-4976-8cda-ad548b6b858c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:58.560194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6358a-5498-4976-8cda-ad548b6b858c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:58.560194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6358a-5498-4976-8cda-ad548b6b858c admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:58.560194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6358a-5498-4976-8cda-ad548b6b858c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:43:58.560194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6358a-5498-4976-8cda-ad548b6b858c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:58.561875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6358a-5498-4976-8cda-ad548b6b858c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:58.580219 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2054/4131] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:43:58.581955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36540c61-7f11-48b0-a0b7-42388a760697 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:58.593164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36540c61-7f11-48b0-a0b7-42388a760697 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:58.598648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac498e6-0c66-4714-8452-8ef6f4f53466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:58.599840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac498e6-0c66-4714-8452-8ef6f4f53466 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:58.600351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac498e6-0c66-4714-8452-8ef6f4f53466 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:58.600843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac498e6-0c66-4714-8452-8ef6f4f53466 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:58.601764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac498e6-0c66-4714-8452-8ef6f4f53466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:58.603886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac498e6-0c66-4714-8452-8ef6f4f53466 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:58.651925 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2078/4132] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:43:58 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:43:58.654399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6358a-5498-4976-8cda-ad548b6b858c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:58.671922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6358a-5498-4976-8cda-ad548b6b858c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:58.752201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b308bd-ef0e-49a2-b041-126ff66e2bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:58.754131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b308bd-ef0e-49a2-b041-126ff66e2bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:58.754478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b308bd-ef0e-49a2-b041-126ff66e2bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:58.754762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b308bd-ef0e-49a2-b041-126ff66e2bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:58.756014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b308bd-ef0e-49a2-b041-126ff66e2bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:58.758654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b308bd-ef0e-49a2-b041-126ff66e2bb0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:58.789429 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2055/4133] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:43:58 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:58.791136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac498e6-0c66-4714-8452-8ef6f4f53466 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:58.803765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac498e6-0c66-4714-8452-8ef6f4f53466 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:58.809854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d8c2a-274e-4ac6-90b5-a72419ddefbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:58.812194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d8c2a-274e-4ac6-90b5-a72419ddefbf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:58.812671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d8c2a-274e-4ac6-90b5-a72419ddefbf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:58.813120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d8c2a-274e-4ac6-90b5-a72419ddefbf admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:58.813976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d8c2a-274e-4ac6-90b5-a72419ddefbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:58.815901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d8c2a-274e-4ac6-90b5-a72419ddefbf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:58.817631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:58.832629 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2079/4134] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:58.837348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b308bd-ef0e-49a2-b041-126ff66e2bb0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:58.850097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b308bd-ef0e-49a2-b041-126ff66e2bb0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:58.855934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93244127-9108-45ea-bd7d-092fce0765a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:58.856552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93244127-9108-45ea-bd7d-092fce0765a4 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:58.856836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93244127-9108-45ea-bd7d-092fce0765a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:58.857114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93244127-9108-45ea-bd7d-092fce0765a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:58.857801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93244127-9108-45ea-bd7d-092fce0765a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:58.859442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93244127-9108-45ea-bd7d-092fce0765a4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:58.871210 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2056/4135] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:58.875132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d8c2a-274e-4ac6-90b5-a72419ddefbf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:58.885579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d8c2a-274e-4ac6-90b5-a72419ddefbf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:58.891344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2a607-51cd-400c-ac36-92b258eb8674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:58.892006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2a607-51cd-400c-ac36-92b258eb8674 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:58.892283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2a607-51cd-400c-ac36-92b258eb8674 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:58.892654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2a607-51cd-400c-ac36-92b258eb8674 admin admin] PATH_INFO: `/v3/projects/82e47bb291e4476fb9788590ac4804c4/users/4ff0e84a90a4469eb25a16bf200aca12/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:58.911239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2a607-51cd-400c-ac36-92b258eb8674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e47bb291e4476fb9788590ac4804c4, user_id=4ff0e84a90a4469eb25a16bf200aca12, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:58.913973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2a607-51cd-400c-ac36-92b258eb8674 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:58.937528 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2080/4136] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:58 2022] PUT /identity/v3/projects/82e47bb291e4476fb9788590ac4804c4/users/4ff0e84a90a4469eb25a16bf200aca12/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:58.940498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9875-878c-4c2d-aad2-c1ff0acbbfd0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:58.940837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9875-878c-4c2d-aad2-c1ff0acbbfd0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:58.941109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9875-878c-4c2d-aad2-c1ff0acbbfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:58.978216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-301e9875-878c-4c2d-aad2-c1ff0acbbfd0 None None] MFA Rules not processed for user `4ff0e84a90a4469eb25a16bf200aca12`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:58.979719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-301e9875-878c-4c2d-aad2-c1ff0acbbfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:59.108288 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2057/4137] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:59.112450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2a607-51cd-400c-ac36-92b258eb8674 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:59.283213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2a607-51cd-400c-ac36-92b258eb8674 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:59.288320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f68d30-6522-49a4-ba04-a571bef537f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:59.288926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f68d30-6522-49a4-ba04-a571bef537f2 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:59.289207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f68d30-6522-49a4-ba04-a571bef537f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:59.289614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f68d30-6522-49a4-ba04-a571bef537f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:59.290360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f68d30-6522-49a4-ba04-a571bef537f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:59.292606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f68d30-6522-49a4-ba04-a571bef537f2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:59.332974 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2081/4138] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:43:59 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:43:59.337325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e9875-878c-4c2d-aad2-c1ff0acbbfd0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:59.361166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e9875-878c-4c2d-aad2-c1ff0acbbfd0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:59.466621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:59.470674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f68d30-6522-49a4-ba04-a571bef537f2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:59.472616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d6f68d30-6522-49a4-ba04-a571bef537f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:59.497055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5fb63-5335-47df-940b-a75fdbaa7bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:59.497441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5fb63-5335-47df-940b-a75fdbaa7bcf admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:59.500717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5fb63-5335-47df-940b-a75fdbaa7bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:59.501042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5fb63-5335-47df-940b-a75fdbaa7bcf admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:59.506609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5fb63-5335-47df-940b-a75fdbaa7bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:59.512847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5fb63-5335-47df-940b-a75fdbaa7bcf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:59.579196 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2058/4139] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:43:59 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:43:59.582962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5fb63-5335-47df-940b-a75fdbaa7bcf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:59.607112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5fb63-5335-47df-940b-a75fdbaa7bcf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:59.618755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da81930-342a-4af2-abbf-78d5ca719308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:59.619376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81930-342a-4af2-abbf-78d5ca719308 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:59.619659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81930-342a-4af2-abbf-78d5ca719308 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:59.619937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81930-342a-4af2-abbf-78d5ca719308 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:59.620657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da81930-342a-4af2-abbf-78d5ca719308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:59.622506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da81930-342a-4af2-abbf-78d5ca719308 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:59.659226 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2059/4140] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:43:59.660430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da81930-342a-4af2-abbf-78d5ca719308 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:59.665141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f68d30-6522-49a4-ba04-a571bef537f2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:59.671497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48297e-3247-48b4-b0d0-3cad2a766c9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:59.672159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48297e-3247-48b4-b0d0-3cad2a766c9b service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:59.672449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48297e-3247-48b4-b0d0-3cad2a766c9b service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:59.672725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48297e-3247-48b4-b0d0-3cad2a766c9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:59.679652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-be48297e-3247-48b4-b0d0-3cad2a766c9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:59.683749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da81930-342a-4af2-abbf-78d5ca719308 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:59.697695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c8d2b-265b-4684-9e51-02d3ee4beb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:59.698531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c8d2b-265b-4684-9e51-02d3ee4beb81 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:59.698819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c8d2b-265b-4684-9e51-02d3ee4beb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:59.699107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c8d2b-265b-4684-9e51-02d3ee4beb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:59.700282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c8d2b-265b-4684-9e51-02d3ee4beb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:59.703784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c8d2b-265b-4684-9e51-02d3ee4beb81 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:59.709020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48297e-3247-48b4-b0d0-3cad2a766c9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:59.714227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48297e-3247-48b4-b0d0-3cad2a766c9b service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:59.729776 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2060/4141] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:43:59.733643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c8d2b-265b-4684-9e51-02d3ee4beb81 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:43:59.737179 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2082/4142] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:43:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:43:59.745559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c8d2b-265b-4684-9e51-02d3ee4beb81 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:43:59.750906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9751c4-eea7-42c7-8364-1ce17125332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:43:59.751614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9751c4-eea7-42c7-8364-1ce17125332a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:59.751847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9751c4-eea7-42c7-8364-1ce17125332a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:59.752318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9751c4-eea7-42c7-8364-1ce17125332a admin admin] PATH_INFO: `/v3/projects/ccd8c283340d48c08cff3a09bb65e155/users/b47d03e9fac648e4b9510888b32daadd/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:59.776837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9751c4-eea7-42c7-8364-1ce17125332a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd8c283340d48c08cff3a09bb65e155, user_id=b47d03e9fac648e4b9510888b32daadd, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:43:59.780993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9751c4-eea7-42c7-8364-1ce17125332a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:43:59.801104 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2061/4143] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:43:59 2022] PUT /identity/v3/projects/ccd8c283340d48c08cff3a09bb65e155/users/b47d03e9fac648e4b9510888b32daadd/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:43:59.811489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f9412-376e-41ab-a838-dc1b34075f9e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:43:59.811870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f9412-376e-41ab-a838-dc1b34075f9e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:43:59.812239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f9412-376e-41ab-a838-dc1b34075f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:43:59.851629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-989f9412-376e-41ab-a838-dc1b34075f9e None None] MFA Rules not processed for user `b47d03e9fac648e4b9510888b32daadd`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:43:59.853003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-989f9412-376e-41ab-a838-dc1b34075f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:43:59.942843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:59.998929 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2083/4144] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:43:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:43:59.999375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9751c4-eea7-42c7-8364-1ce17125332a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:00.131975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9751c4-eea7-42c7-8364-1ce17125332a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:00.137950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc8b52-58a9-497b-91e5-97f5c91ab30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:00.138878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc8b52-58a9-497b-91e5-97f5c91ab30a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:00.139615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc8b52-58a9-497b-91e5-97f5c91ab30a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:00.139615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc8b52-58a9-497b-91e5-97f5c91ab30a admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:00.140534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc8b52-58a9-497b-91e5-97f5c91ab30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:00.145252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc8b52-58a9-497b-91e5-97f5c91ab30a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:00.196695 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2062/4145] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:43:59 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:00.201827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f9412-376e-41ab-a838-dc1b34075f9e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:00.220999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f9412-376e-41ab-a838-dc1b34075f9e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:00.361590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966e384-4e9c-416d-a08b-4de6d9333a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:00.362518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966e384-4e9c-416d-a08b-4de6d9333a26 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:00.362803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966e384-4e9c-416d-a08b-4de6d9333a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:00.363080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966e384-4e9c-416d-a08b-4de6d9333a26 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:00.363886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966e384-4e9c-416d-a08b-4de6d9333a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:00.365870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966e384-4e9c-416d-a08b-4de6d9333a26 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:00.417823 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2084/4146] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:44:00 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:00.422463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc8b52-58a9-497b-91e5-97f5c91ab30a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:00.436680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc8b52-58a9-497b-91e5-97f5c91ab30a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:00.444836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1e82f-8b76-4f36-a4bf-2f2417df56cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:00.445754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1e82f-8b76-4f36-a4bf-2f2417df56cf admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:00.446475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1e82f-8b76-4f36-a4bf-2f2417df56cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:00.446932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1e82f-8b76-4f36-a4bf-2f2417df56cf admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:00.447895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1e82f-8b76-4f36-a4bf-2f2417df56cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:00.449947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1e82f-8b76-4f36-a4bf-2f2417df56cf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:00.469346 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2063/4147] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:00.473993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966e384-4e9c-416d-a08b-4de6d9333a26 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:00.491176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966e384-4e9c-416d-a08b-4de6d9333a26 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:00.520040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f9993-9db2-480f-afce-38ee4b4ae973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:00.521683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9993-9db2-480f-afce-38ee4b4ae973 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:00.523347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9993-9db2-480f-afce-38ee4b4ae973 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:00.524345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9993-9db2-480f-afce-38ee4b4ae973 admin admin] PATH_INFO: `/v3/projects/ca1483b04b6d4754a8fbfb70c6d54b27/users/3232ad15289e4efb96d4dbe75013f80a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:00.569251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f9993-9db2-480f-afce-38ee4b4ae973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1483b04b6d4754a8fbfb70c6d54b27, user_id=3232ad15289e4efb96d4dbe75013f80a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:00.572757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f9993-9db2-480f-afce-38ee4b4ae973 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:00.614726 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2085/4148] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:44:00 2022] PUT /identity/v3/projects/ca1483b04b6d4754a8fbfb70c6d54b27/users/3232ad15289e4efb96d4dbe75013f80a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:00.619205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1e82f-8b76-4f36-a4bf-2f2417df56cf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:00.634145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1e82f-8b76-4f36-a4bf-2f2417df56cf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:00.777143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcbbca-15d7-42f5-b04c-b18cab0eca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:00.778334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcbbca-15d7-42f5-b04c-b18cab0eca90 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:00.779365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcbbca-15d7-42f5-b04c-b18cab0eca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:00.779653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcbbca-15d7-42f5-b04c-b18cab0eca90 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:00.780331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcbbca-15d7-42f5-b04c-b18cab0eca90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:00.783233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcbbca-15d7-42f5-b04c-b18cab0eca90 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:00.841322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f9993-9db2-480f-afce-38ee4b4ae973 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:00.852272 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2064/4149] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:00.858124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f9993-9db2-480f-afce-38ee4b4ae973 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:00.866168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9971-ca88-4277-af7b-384436c5b32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:00.869205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9971-ca88-4277-af7b-384436c5b32f admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:00.869690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9971-ca88-4277-af7b-384436c5b32f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:00.869862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9971-ca88-4277-af7b-384436c5b32f admin admin] PATH_INFO: `/v3/projects/ca1483b04b6d4754a8fbfb70c6d54b27/users/3232ad15289e4efb96d4dbe75013f80a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:00.884875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9971-ca88-4277-af7b-384436c5b32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1483b04b6d4754a8fbfb70c6d54b27, user_id=3232ad15289e4efb96d4dbe75013f80a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:00.892431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9971-ca88-4277-af7b-384436c5b32f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:00.925792 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2086/4150] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:44:00 2022] PUT /identity/v3/projects/ca1483b04b6d4754a8fbfb70c6d54b27/users/3232ad15289e4efb96d4dbe75013f80a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:44:00.936211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201546-fe4d-44d6-9299-1c7339759700 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:00.936504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201546-fe4d-44d6-9299-1c7339759700 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:00.936784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e201546-fe4d-44d6-9299-1c7339759700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:00.985094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:01.083589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0e201546-fe4d-44d6-9299-1c7339759700 None None] MFA Rules not processed for user `3232ad15289e4efb96d4dbe75013f80a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:01.094151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0e201546-fe4d-44d6-9299-1c7339759700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:01.227253 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2065/4151] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:01.249168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9971-ca88-4277-af7b-384436c5b32f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:01.251519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-34bf9971-ca88-4277-af7b-384436c5b32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:01.424689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9971-ca88-4277-af7b-384436c5b32f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:01.435560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c9efa-75e3-405b-9e74-467d9f5a0073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:01.437713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c9efa-75e3-405b-9e74-467d9f5a0073 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:01.437713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c9efa-75e3-405b-9e74-467d9f5a0073 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:01.437713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c9efa-75e3-405b-9e74-467d9f5a0073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:01.493662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:01.519737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c9efa-75e3-405b-9e74-467d9f5a0073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:01.521971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c9efa-75e3-405b-9e74-467d9f5a0073 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:01.532503 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2087/4152] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:05.965256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e201546-fe4d-44d6-9299-1c7339759700 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:05.967108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0e201546-fe4d-44d6-9299-1c7339759700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:06.111905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e201546-fe4d-44d6-9299-1c7339759700 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:06.120450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:06.121471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:06.121843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:06.122911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] PATH_INFO: `/v3/users/021819f70ef84630b9e507283c2a50a8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:06.124476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] RBAC: Authorizing `identity:delete_user(user_id=021819f70ef84630b9e507283c2a50a8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:06.126680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:06.242655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '021819f70ef84630b9e507283c2a50a8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:06.247922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '021819f70ef84630b9e507283c2a50a8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:06.274747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '021819f70ef84630b9e507283c2a50a8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:06.284095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '021819f70ef84630b9e507283c2a50a8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:06.300618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '021819f70ef84630b9e507283c2a50a8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:06.312083 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2066/4153] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:44:05 2022] DELETE /identity/v3/users/021819f70ef84630b9e507283c2a50a8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:06.314279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272be70-0fb1-40fe-a2bc-288ad54382d3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:06.314734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272be70-0fb1-40fe-a2bc-288ad54382d3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:06.319393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272be70-0fb1-40fe-a2bc-288ad54382d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:06.349777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8272be70-0fb1-40fe-a2bc-288ad54382d3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:06.352000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8272be70-0fb1-40fe-a2bc-288ad54382d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:06.438691 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2088/4154] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:44:06.451397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:06.453980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:06.483810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:06.559640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca714e82-4ae2-4e79-b118-cc13d96de61d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:06.565090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dba3f-557e-41df-8f40-431d6ea8dd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:06.566028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dba3f-557e-41df-8f40-431d6ea8dd76 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:06.568370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dba3f-557e-41df-8f40-431d6ea8dd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:06.568370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dba3f-557e-41df-8f40-431d6ea8dd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:06.580448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068dba3f-557e-41df-8f40-431d6ea8dd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:06.582422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068dba3f-557e-41df-8f40-431d6ea8dd76 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:06.596016 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2067/4155] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:44:08.472961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272be70-0fb1-40fe-a2bc-288ad54382d3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:08.475912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8272be70-0fb1-40fe-a2bc-288ad54382d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:08.494277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272be70-0fb1-40fe-a2bc-288ad54382d3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:08.513808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:08.517943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:08.518441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:08.518939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] PATH_INFO: `/v3/projects/7d8d815a02904e98a8345d0ff4a234db` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:08.521278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8d815a02904e98a8345d0ff4a234db)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:08.523938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:08.604513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8d815a02904e98a8345d0ff4a234db', 'request_id': 'req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:08.616756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8d815a02904e98a8345d0ff4a234db', 'request_id': 'req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:08.632430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8d815a02904e98a8345d0ff4a234db', 'request_id': 'req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:08.653156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] The token cache is being invalidate because project 7d8d815a02904e98a8345d0ff4a234db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:44:08.653882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:08.654916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4443710d-4fd2-4cd6-8cfa-4b9627cc57b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:08.658191 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2089/4156] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:08 2022] DELETE /identity/v3/projects/7d8d815a02904e98a8345d0ff4a234db => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:08.663275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a8632-6f24-4b87-81a5-102cc0ad80de None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:08.663843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a8632-6f24-4b87-81a5-102cc0ad80de None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:08.664095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a8632-6f24-4b87-81a5-102cc0ad80de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:08.699714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f20a8632-6f24-4b87-81a5-102cc0ad80de None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:08.701609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f20a8632-6f24-4b87-81a5-102cc0ad80de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:08.792673 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2068/4157] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:08.801100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7fbe1-d8e3-4095-a055-22a952123ac4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:08.801726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7fbe1-d8e3-4095-a055-22a952123ac4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:08.802318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7fbe1-d8e3-4095-a055-22a952123ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:08.828268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-60b7fbe1-d8e3-4095-a055-22a952123ac4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:08.829765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-60b7fbe1-d8e3-4095-a055-22a952123ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:08.841199 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2090/4158] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:08.845863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a8632-6f24-4b87-81a5-102cc0ad80de None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:08.860721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a8632-6f24-4b87-81a5-102cc0ad80de None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:08.867818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273bfce-723b-4ae0-ba8f-bb50848ed1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:08.868454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bfce-723b-4ae0-ba8f-bb50848ed1bf admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:08.868832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bfce-723b-4ae0-ba8f-bb50848ed1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:08.869117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bfce-723b-4ae0-ba8f-bb50848ed1bf admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:08.869820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273bfce-723b-4ae0-ba8f-bb50848ed1bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:44:08.870287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273bfce-723b-4ae0-ba8f-bb50848ed1bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:08.872284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273bfce-723b-4ae0-ba8f-bb50848ed1bf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:08.897571 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2069/4159] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:44:08.902451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7fbe1-d8e3-4095-a055-22a952123ac4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:08.920828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7fbe1-d8e3-4095-a055-22a952123ac4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:08.930075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8b415-1b20-4fc1-9ae0-50723f702043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:08.931541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8b415-1b20-4fc1-9ae0-50723f702043 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:08.932377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8b415-1b20-4fc1-9ae0-50723f702043 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:08.933034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8b415-1b20-4fc1-9ae0-50723f702043 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:08.935447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8b415-1b20-4fc1-9ae0-50723f702043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:08.938797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8b415-1b20-4fc1-9ae0-50723f702043 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:08.993658 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2091/4160] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:44:08 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:08.996955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273bfce-723b-4ae0-ba8f-bb50848ed1bf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:09.028699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273bfce-723b-4ae0-ba8f-bb50848ed1bf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:09.125085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f55dd-b47e-42b3-b006-a7cf3b59f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:09.125085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f55dd-b47e-42b3-b006-a7cf3b59f4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:09.125085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f55dd-b47e-42b3-b006-a7cf3b59f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:09.125490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f55dd-b47e-42b3-b006-a7cf3b59f4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:09.125864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f55dd-b47e-42b3-b006-a7cf3b59f4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:09.132264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f55dd-b47e-42b3-b006-a7cf3b59f4e4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:09.197035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8b415-1b20-4fc1-9ae0-50723f702043 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:09.210838 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2070/4161] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:44:08 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:09.212300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8b415-1b20-4fc1-9ae0-50723f702043 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:09.233239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13069c5c-59c8-4fe4-a7c7-eabdaae51640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:09.233917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13069c5c-59c8-4fe4-a7c7-eabdaae51640 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:09.234197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13069c5c-59c8-4fe4-a7c7-eabdaae51640 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:09.234472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13069c5c-59c8-4fe4-a7c7-eabdaae51640 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:09.235129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13069c5c-59c8-4fe4-a7c7-eabdaae51640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:09.236742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13069c5c-59c8-4fe4-a7c7-eabdaae51640 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:09.257433 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2092/4162] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:09.261545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f55dd-b47e-42b3-b006-a7cf3b59f4e4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:09.272007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f55dd-b47e-42b3-b006-a7cf3b59f4e4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:09.286086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5082ea6-d2b4-46ee-9514-65300e52e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:09.286722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5082ea6-d2b4-46ee-9514-65300e52e315 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:09.287087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5082ea6-d2b4-46ee-9514-65300e52e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:09.287279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5082ea6-d2b4-46ee-9514-65300e52e315 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:09.287943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5082ea6-d2b4-46ee-9514-65300e52e315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:09.289627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5082ea6-d2b4-46ee-9514-65300e52e315 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:09.312899 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2071/4163] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:09.317253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13069c5c-59c8-4fe4-a7c7-eabdaae51640 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:09.353267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13069c5c-59c8-4fe4-a7c7-eabdaae51640 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:09.369641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb95bdb-13a5-4d4a-a0dc-ba038104d260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:09.370694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95bdb-13a5-4d4a-a0dc-ba038104d260 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:09.370694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95bdb-13a5-4d4a-a0dc-ba038104d260 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:09.371611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95bdb-13a5-4d4a-a0dc-ba038104d260 admin admin] PATH_INFO: `/v3/projects/36a76c5994234bfab19624faf79dccc1/users/6f1f36c44f014a95b1a0ce8f43d0a0b2/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:09.405328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb95bdb-13a5-4d4a-a0dc-ba038104d260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a76c5994234bfab19624faf79dccc1, user_id=6f1f36c44f014a95b1a0ce8f43d0a0b2, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:09.410358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb95bdb-13a5-4d4a-a0dc-ba038104d260 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:09.440860 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2093/4164] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:44:09 2022] PUT /identity/v3/projects/36a76c5994234bfab19624faf79dccc1/users/6f1f36c44f014a95b1a0ce8f43d0a0b2/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:44:09.454078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b780e1-25d7-4362-bb3e-59d376afb85f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:09.454355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b780e1-25d7-4362-bb3e-59d376afb85f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:09.454632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b780e1-25d7-4362-bb3e-59d376afb85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:09.652984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a2b780e1-25d7-4362-bb3e-59d376afb85f None None] MFA Rules not processed for user `6f1f36c44f014a95b1a0ce8f43d0a0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:09.654385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a2b780e1-25d7-4362-bb3e-59d376afb85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:09.660189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:09.827548 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2072/4165] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:09.838423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293cd0-987e-45b1-ac83-132e0cb12900 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:09.838875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293cd0-987e-45b1-ac83-132e0cb12900 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:09.838944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293cd0-987e-45b1-ac83-132e0cb12900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:09.851912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:09.882986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3b293cd0-987e-45b1-ac83-132e0cb12900 None None] MFA Rules not processed for user `6f1f36c44f014a95b1a0ce8f43d0a0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:09.884160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3b293cd0-987e-45b1-ac83-132e0cb12900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:09.905170 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2094/4166] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:10.149208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b780e1-25d7-4362-bb3e-59d376afb85f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:10.150754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a2b780e1-25d7-4362-bb3e-59d376afb85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:10.359980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b780e1-25d7-4362-bb3e-59d376afb85f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:10.367638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27142e6b-95e4-4db2-8547-f72d57ec161e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:10.369224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142e6b-95e4-4db2-8547-f72d57ec161e service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:10.369909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142e6b-95e4-4db2-8547-f72d57ec161e service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:10.370379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142e6b-95e4-4db2-8547-f72d57ec161e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:10.383055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27142e6b-95e4-4db2-8547-f72d57ec161e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:10.384909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27142e6b-95e4-4db2-8547-f72d57ec161e service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:10.412354 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2073/4167] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:11.176212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed24a5-3608-4baf-91c0-b11a329f6094 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:11.177875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed24a5-3608-4baf-91c0-b11a329f6094 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:11.178354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed24a5-3608-4baf-91c0-b11a329f6094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:11.215867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e6ed24a5-3608-4baf-91c0-b11a329f6094 None None] MFA Rules not processed for user `6f1f36c44f014a95b1a0ce8f43d0a0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:11.217491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e6ed24a5-3608-4baf-91c0-b11a329f6094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:11.242341 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2095/4168] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:17.920973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27142e6b-95e4-4db2-8547-f72d57ec161e service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:17.922510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-27142e6b-95e4-4db2-8547-f72d57ec161e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:18.133054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27142e6b-95e4-4db2-8547-f72d57ec161e service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:18.139078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f2f5f-745d-4489-af3a-ce518d8016f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:18.147673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f2f5f-745d-4489-af3a-ce518d8016f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:18.148169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f2f5f-745d-4489-af3a-ce518d8016f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:18.149948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f2f5f-745d-4489-af3a-ce518d8016f3 admin admin] PATH_INFO: `/v3/users/84feafb1d3ef4704a583d08c2e17b48c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:18.153265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f2f5f-745d-4489-af3a-ce518d8016f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84feafb1d3ef4704a583d08c2e17b48c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:18.160968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f2f5f-745d-4489-af3a-ce518d8016f3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:18.173302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:18.251177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-824f2f5f-745d-4489-af3a-ce518d8016f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84feafb1d3ef4704a583d08c2e17b48c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:18.252095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-824f2f5f-745d-4489-af3a-ce518d8016f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84feafb1d3ef4704a583d08c2e17b48c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:18.268861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-824f2f5f-745d-4489-af3a-ce518d8016f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84feafb1d3ef4704a583d08c2e17b48c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:18.278362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-824f2f5f-745d-4489-af3a-ce518d8016f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84feafb1d3ef4704a583d08c2e17b48c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:18.314151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-824f2f5f-745d-4489-af3a-ce518d8016f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84feafb1d3ef4704a583d08c2e17b48c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:18.330038 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2074/4169] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:44:17 2022] DELETE /identity/v3/users/84feafb1d3ef4704a583d08c2e17b48c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:19.594669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed24a5-3608-4baf-91c0-b11a329f6094 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:19.613052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed24a5-3608-4baf-91c0-b11a329f6094 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:19.764767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:19.765554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:19.765952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:19.766611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] PATH_INFO: `/v3/projects/b02b576809484d8ba672697987f1447c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:19.767911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02b576809484d8ba672697987f1447c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:19.769991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:19.866340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02b576809484d8ba672697987f1447c', 'request_id': 'req-6492c14f-288d-4458-88e5-94bf2240fcdb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:19.878755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02b576809484d8ba672697987f1447c', 'request_id': 'req-6492c14f-288d-4458-88e5-94bf2240fcdb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:19.892677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02b576809484d8ba672697987f1447c', 'request_id': 'req-6492c14f-288d-4458-88e5-94bf2240fcdb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:19.909218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] The token cache is being invalidate because project b02b576809484d8ba672697987f1447c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:44:19.910114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:19.911080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6492c14f-288d-4458-88e5-94bf2240fcdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:19.916623 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2096/4170] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:19 2022] DELETE /identity/v3/projects/b02b576809484d8ba672697987f1447c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:44:19.918886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91069ad7-c67b-4044-af20-ec8b01a116e9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:19.919328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91069ad7-c67b-4044-af20-ec8b01a116e9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:19.919441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91069ad7-c67b-4044-af20-ec8b01a116e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:20.157331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-91069ad7-c67b-4044-af20-ec8b01a116e9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:20.158629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-91069ad7-c67b-4044-af20-ec8b01a116e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:20.304513 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2075/4171] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:20.307884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd44d-261f-42f2-8c67-e26e5f3c9133 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:20.309443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd44d-261f-42f2-8c67-e26e5f3c9133 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:20.310061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd44d-261f-42f2-8c67-e26e5f3c9133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:20.406262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-316bd44d-261f-42f2-8c67-e26e5f3c9133 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:20.415576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-316bd44d-261f-42f2-8c67-e26e5f3c9133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:20.453716 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2097/4172] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:20.454940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91069ad7-c67b-4044-af20-ec8b01a116e9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:20.483887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91069ad7-c67b-4044-af20-ec8b01a116e9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:20.492735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd7910-59f1-408e-b750-53d50cb27b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:20.493378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7910-59f1-408e-b750-53d50cb27b03 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:20.495010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7910-59f1-408e-b750-53d50cb27b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:20.495318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7910-59f1-408e-b750-53d50cb27b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:20.495993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd7910-59f1-408e-b750-53d50cb27b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:44:20.496289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd7910-59f1-408e-b750-53d50cb27b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:20.498471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd7910-59f1-408e-b750-53d50cb27b03 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:20.521561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2076/4173] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:44:20.524271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bd44d-261f-42f2-8c67-e26e5f3c9133 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:20.537072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bd44d-261f-42f2-8c67-e26e5f3c9133 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:20.543062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddcb31-2cfa-4527-809a-fdc2f7298e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:20.543734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddcb31-2cfa-4527-809a-fdc2f7298e99 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:20.544016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddcb31-2cfa-4527-809a-fdc2f7298e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:20.544285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddcb31-2cfa-4527-809a-fdc2f7298e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:20.544971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddcb31-2cfa-4527-809a-fdc2f7298e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:20.547257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddcb31-2cfa-4527-809a-fdc2f7298e99 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:20.610937 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2098/4174] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:44:20 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:44:20.615144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd7910-59f1-408e-b750-53d50cb27b03 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:20.627054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd7910-59f1-408e-b750-53d50cb27b03 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:20.713114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:20.786983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8bd7a-84b8-45b0-a96e-67c92b7344b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:20.787693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8bd7a-84b8-45b0-a96e-67c92b7344b9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:20.787981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8bd7a-84b8-45b0-a96e-67c92b7344b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:20.788256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8bd7a-84b8-45b0-a96e-67c92b7344b9 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:20.788890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8bd7a-84b8-45b0-a96e-67c92b7344b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:20.791133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8bd7a-84b8-45b0-a96e-67c92b7344b9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:20.830369 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2077/4175] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:44:20 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:44:20.831457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddcb31-2cfa-4527-809a-fdc2f7298e99 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:20.843700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddcb31-2cfa-4527-809a-fdc2f7298e99 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:20.861918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd34ad-6e8e-484f-a933-3b8e7c0e9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:20.862547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd34ad-6e8e-484f-a933-3b8e7c0e9295 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:20.862830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd34ad-6e8e-484f-a933-3b8e7c0e9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:20.863103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd34ad-6e8e-484f-a933-3b8e7c0e9295 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:20.863758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd34ad-6e8e-484f-a933-3b8e7c0e9295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:20.865371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd34ad-6e8e-484f-a933-3b8e7c0e9295 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:20.894626 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2099/4176] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:20.895740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8bd7a-84b8-45b0-a96e-67c92b7344b9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:20.908328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8bd7a-84b8-45b0-a96e-67c92b7344b9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:20.915085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc4859-9228-44d3-ab20-401694e4289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:20.915717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc4859-9228-44d3-ab20-401694e4289f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:20.916001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc4859-9228-44d3-ab20-401694e4289f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:20.916497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc4859-9228-44d3-ab20-401694e4289f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:20.917518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc4859-9228-44d3-ab20-401694e4289f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:20.919419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc4859-9228-44d3-ab20-401694e4289f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:20.938371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd34ad-6e8e-484f-a933-3b8e7c0e9295 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:20.938563 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2078/4177] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:20.951133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd34ad-6e8e-484f-a933-3b8e7c0e9295 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:20.967372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e53237-6c9e-4b2e-a852-1c71f568c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:20.967953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53237-6c9e-4b2e-a852-1c71f568c3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:20.968220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53237-6c9e-4b2e-a852-1c71f568c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:20.968660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53237-6c9e-4b2e-a852-1c71f568c3c3 admin admin] PATH_INFO: `/v3/projects/2c147d42182146409a91f2e0359f2e98/users/a68002795ce541338b30129e6dbb0fb6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:21.002613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e53237-6c9e-4b2e-a852-1c71f568c3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c147d42182146409a91f2e0359f2e98, user_id=a68002795ce541338b30129e6dbb0fb6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:21.005624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e53237-6c9e-4b2e-a852-1c71f568c3c3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:21.035889 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2100/4178] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:44:20 2022] PUT /identity/v3/projects/2c147d42182146409a91f2e0359f2e98/users/a68002795ce541338b30129e6dbb0fb6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:44:21.043199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cc168-701b-4815-a2ad-206695634ebc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:21.043542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cc168-701b-4815-a2ad-206695634ebc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:21.043840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cc168-701b-4815-a2ad-206695634ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:21.087191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e53237-6c9e-4b2e-a852-1c71f568c3c3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:21.089214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-58e53237-6c9e-4b2e-a852-1c71f568c3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:21.104373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-765cc168-701b-4815-a2ad-206695634ebc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:21.106481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-765cc168-701b-4815-a2ad-206695634ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:21.115051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:21.240196 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2079/4179] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:21.245422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e53237-6c9e-4b2e-a852-1c71f568c3c3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:21.250596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cc168-701b-4815-a2ad-206695634ebc None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:21.258958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651f82b-a85b-4a81-9395-b75ddc135e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:21.261032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651f82b-a85b-4a81-9395-b75ddc135e4a service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:21.262375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651f82b-a85b-4a81-9395-b75ddc135e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:21.263756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651f82b-a85b-4a81-9395-b75ddc135e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:21.266836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cc168-701b-4815-a2ad-206695634ebc None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:21.268646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1651f82b-a85b-4a81-9395-b75ddc135e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:21.284459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a2cf7-2221-4b58-9108-4a429765bf11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:21.285515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a2cf7-2221-4b58-9108-4a429765bf11 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:21.286011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a2cf7-2221-4b58-9108-4a429765bf11 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:21.286493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a2cf7-2221-4b58-9108-4a429765bf11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:21.307641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a2cf7-2221-4b58-9108-4a429765bf11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:21.313146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a2cf7-2221-4b58-9108-4a429765bf11 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:21.340361 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2080/4180] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:44:21.463450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651f82b-a85b-4a81-9395-b75ddc135e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:21.465110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651f82b-a85b-4a81-9395-b75ddc135e4a service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:21.492132 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2101/4181] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:44:24.103695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a2cf7-2221-4b58-9108-4a429765bf11 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:24.105852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-975a2cf7-2221-4b58-9108-4a429765bf11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:24.127996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a2cf7-2221-4b58-9108-4a429765bf11 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:24.135520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ce2b7-ca1c-4fa3-a9b7-200bf93104e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:24.138435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce2b7-ca1c-4fa3-a9b7-200bf93104e4 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:24.140132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce2b7-ca1c-4fa3-a9b7-200bf93104e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:24.140588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce2b7-ca1c-4fa3-a9b7-200bf93104e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:24.142997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ec8ce2b7-ca1c-4fa3-a9b7-200bf93104e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:24.164198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ce2b7-ca1c-4fa3-a9b7-200bf93104e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:24.166391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ce2b7-ca1c-4fa3-a9b7-200bf93104e4 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:24.181497 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2081/4182] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:30.846971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651f82b-a85b-4a81-9395-b75ddc135e4a service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:30.850103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1651f82b-a85b-4a81-9395-b75ddc135e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:30.880182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651f82b-a85b-4a81-9395-b75ddc135e4a service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:30.893144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:30.893845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:30.894379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:30.894479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] PATH_INFO: `/v3/users/48a7b8433888412abc328cbc3aea214b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:30.899292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a7b8433888412abc328cbc3aea214b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:30.902049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:30.993070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a7b8433888412abc328cbc3aea214b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:30.995138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a7b8433888412abc328cbc3aea214b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:31.020140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a7b8433888412abc328cbc3aea214b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:31.021056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a7b8433888412abc328cbc3aea214b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:31.030642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a7b8433888412abc328cbc3aea214b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:31.051768 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2102/4183] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:44:30 2022] DELETE /identity/v3/users/48a7b8433888412abc328cbc3aea214b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:31.796565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27085b-a912-4a87-a9f7-cd3da67fa81f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:31.797147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27085b-a912-4a87-a9f7-cd3da67fa81f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:31.797259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27085b-a912-4a87-a9f7-cd3da67fa81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:31.844610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ea27085b-a912-4a87-a9f7-cd3da67fa81f None None] MFA Rules not processed for user `f1fd00311fa540658cfd4076c9a88976`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:31.846087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ea27085b-a912-4a87-a9f7-cd3da67fa81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:31.922192 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2082/4184] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:32.176962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:32.178471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:32.223769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:32.312958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77204d4b-a1cf-4192-8cdb-0af17ca6779d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:32.318972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:32.319993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:32.320745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:32.321169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] PATH_INFO: `/v3/projects/069a60f32d554f05b34f429706187490` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:32.322652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=069a60f32d554f05b34f429706187490)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:32.333609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:32.428538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069a60f32d554f05b34f429706187490', 'request_id': 'req-779d6287-895c-4923-89de-a196ae4c7ff5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:32.441247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069a60f32d554f05b34f429706187490', 'request_id': 'req-779d6287-895c-4923-89de-a196ae4c7ff5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:32.454392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069a60f32d554f05b34f429706187490', 'request_id': 'req-779d6287-895c-4923-89de-a196ae4c7ff5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:32.478405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] The token cache is being invalidate because project 069a60f32d554f05b34f429706187490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:44:32.478765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:32.479693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-779d6287-895c-4923-89de-a196ae4c7ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:32.488826 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2103/4185] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:32 2022] DELETE /identity/v3/projects/069a60f32d554f05b34f429706187490 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:32.490329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ee4e8-0c2c-42b0-b6e8-d603e8d17c3b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:32.490688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ee4e8-0c2c-42b0-b6e8-d603e8d17c3b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:32.491057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ee4e8-0c2c-42b0-b6e8-d603e8d17c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:32.523388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30047d-ee99-4a78-af18-df57e448d442 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:32.523672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30047d-ee99-4a78-af18-df57e448d442 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:32.523952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30047d-ee99-4a78-af18-df57e448d442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:32.534915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fe9ee4e8-0c2c-42b0-b6e8-d603e8d17c3b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:32.536732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fe9ee4e8-0c2c-42b0-b6e8-d603e8d17c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:32.594411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fc30047d-ee99-4a78-af18-df57e448d442 None None] MFA Rules not processed for user `a68002795ce541338b30129e6dbb0fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:32.597781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc30047d-ee99-4a78-af18-df57e448d442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:32.618680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:32.666422 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2083/4186] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:44:32.692352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff12db4-bcda-4961-827d-130898cc90b6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:32.692637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff12db4-bcda-4961-827d-130898cc90b6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:32.692920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff12db4-bcda-4961-827d-130898cc90b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:32.718179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3ff12db4-bcda-4961-827d-130898cc90b6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:32.719719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3ff12db4-bcda-4961-827d-130898cc90b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:32.730229 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2084/4187] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:32.734297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff12db4-bcda-4961-827d-130898cc90b6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:32.747397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff12db4-bcda-4961-827d-130898cc90b6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:32.755566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b5534-0ab3-4578-adee-e13beaece0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:32.756351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b5534-0ab3-4578-adee-e13beaece0cc admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:32.756835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b5534-0ab3-4578-adee-e13beaece0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:32.757983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b5534-0ab3-4578-adee-e13beaece0cc admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:32.758826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b5534-0ab3-4578-adee-e13beaece0cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:44:32.759377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b5534-0ab3-4578-adee-e13beaece0cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:32.762105 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2104/4188] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:32.762763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b5534-0ab3-4578-adee-e13beaece0cc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:32.771623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30047d-ee99-4a78-af18-df57e448d442 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:32.773074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc30047d-ee99-4a78-af18-df57e448d442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:32.778907 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2085/4189] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:44:32.784486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b5534-0ab3-4578-adee-e13beaece0cc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:32.800185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b5534-0ab3-4578-adee-e13beaece0cc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:32.806907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd187de5-18e1-42f0-964a-51d38a8e382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:32.808165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd187de5-18e1-42f0-964a-51d38a8e382b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:32.808649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd187de5-18e1-42f0-964a-51d38a8e382b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:32.809155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd187de5-18e1-42f0-964a-51d38a8e382b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:32.810097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd187de5-18e1-42f0-964a-51d38a8e382b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:32.812451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd187de5-18e1-42f0-964a-51d38a8e382b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:32.875822 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2086/4190] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:44:32 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:32.878270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd187de5-18e1-42f0-964a-51d38a8e382b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:32.903102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:33.047684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd187de5-18e1-42f0-964a-51d38a8e382b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:33.051954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30047d-ee99-4a78-af18-df57e448d442 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:33.067791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae80ce6-700d-464c-b24d-b5e9909f1cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:33.068546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae80ce6-700d-464c-b24d-b5e9909f1cbd admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:33.068831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae80ce6-700d-464c-b24d-b5e9909f1cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:33.073106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae80ce6-700d-464c-b24d-b5e9909f1cbd admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:33.074601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae80ce6-700d-464c-b24d-b5e9909f1cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:33.080743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae80ce6-700d-464c-b24d-b5e9909f1cbd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:33.136869 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2087/4191] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:44:32 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:33.143197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae80ce6-700d-464c-b24d-b5e9909f1cbd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:33.156847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-eae80ce6-700d-464c-b24d-b5e9909f1cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:33.233817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbff7d0-4287-4c05-990a-55dcd0fcf121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:33.234520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbff7d0-4287-4c05-990a-55dcd0fcf121 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:33.234810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbff7d0-4287-4c05-990a-55dcd0fcf121 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:33.235087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbff7d0-4287-4c05-990a-55dcd0fcf121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:33.296343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae80ce6-700d-464c-b24d-b5e9909f1cbd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:33.302905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec441673-bc3c-43ce-b240-e814ea11e655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:33.303539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec441673-bc3c-43ce-b240-e814ea11e655 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:33.303821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec441673-bc3c-43ce-b240-e814ea11e655 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:33.304101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec441673-bc3c-43ce-b240-e814ea11e655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:33.309991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ec441673-bc3c-43ce-b240-e814ea11e655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:33.370319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbff7d0-4287-4c05-990a-55dcd0fcf121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:33.372438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbff7d0-4287-4c05-990a-55dcd0fcf121 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:33.402224 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2105/4192] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:33.407417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:33.420539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbff7d0-4287-4c05-990a-55dcd0fcf121 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:33.447777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbff7d0-4287-4c05-990a-55dcd0fcf121 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:33.457101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d496d8b-28da-4aeb-ac45-e0459b60c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:33.458321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec441673-bc3c-43ce-b240-e814ea11e655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:33.459854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec441673-bc3c-43ce-b240-e814ea11e655 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:33.460523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d496d8b-28da-4aeb-ac45-e0459b60c74e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:33.460819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d496d8b-28da-4aeb-ac45-e0459b60c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:33.461096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d496d8b-28da-4aeb-ac45-e0459b60c74e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:33.461796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d496d8b-28da-4aeb-ac45-e0459b60c74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:33.463470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d496d8b-28da-4aeb-ac45-e0459b60c74e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:33.483431 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2088/4193] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:33.487287 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2106/4194] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:33.491298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec441673-bc3c-43ce-b240-e814ea11e655 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:33.507419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec441673-bc3c-43ce-b240-e814ea11e655 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:33.523331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5cc39-885d-4efb-b1b6-4570c69b60e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:33.524561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cc39-885d-4efb-b1b6-4570c69b60e1 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:33.524561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cc39-885d-4efb-b1b6-4570c69b60e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:33.524561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cc39-885d-4efb-b1b6-4570c69b60e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:33.525140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5cc39-885d-4efb-b1b6-4570c69b60e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:33.526900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5cc39-885d-4efb-b1b6-4570c69b60e1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:33.558737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d496d8b-28da-4aeb-ac45-e0459b60c74e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:33.565085 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2089/4195] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:33.580191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d496d8b-28da-4aeb-ac45-e0459b60c74e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:33.586523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7f69e-9f73-4f4e-ad31-d9084ef8919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:33.587195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7f69e-9f73-4f4e-ad31-d9084ef8919f admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:33.587475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7f69e-9f73-4f4e-ad31-d9084ef8919f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:33.587750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7f69e-9f73-4f4e-ad31-d9084ef8919f admin admin] PATH_INFO: `/v3/projects/10b20946b0cd4fc3b2289200eb839230/users/f70ee130e8e74db88b9b7ffd16ed1bd5/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:33.624541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7f69e-9f73-4f4e-ad31-d9084ef8919f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b20946b0cd4fc3b2289200eb839230, user_id=f70ee130e8e74db88b9b7ffd16ed1bd5, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:33.627347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7f69e-9f73-4f4e-ad31-d9084ef8919f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:33.652203 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2107/4196] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:44:33 2022] PUT /identity/v3/projects/10b20946b0cd4fc3b2289200eb839230/users/f70ee130e8e74db88b9b7ffd16ed1bd5/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:33.653974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9ba29-5464-4f29-99a3-78cb9bfe29e5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:33.654268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9ba29-5464-4f29-99a3-78cb9bfe29e5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:33.654537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9ba29-5464-4f29-99a3-78cb9bfe29e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:33.704848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-55e9ba29-5464-4f29-99a3-78cb9bfe29e5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:33.706497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-55e9ba29-5464-4f29-99a3-78cb9bfe29e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:33.853204 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2090/4197] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:33.887899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7f69e-9f73-4f4e-ad31-d9084ef8919f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:33.891611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c8a7f69e-9f73-4f4e-ad31-d9084ef8919f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:33.926556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:34.030564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7f69e-9f73-4f4e-ad31-d9084ef8919f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:34.040703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c80064-8b19-4524-bdba-63a1bab19a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:34.044395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c80064-8b19-4524-bdba-63a1bab19a95 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:34.044776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c80064-8b19-4524-bdba-63a1bab19a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:34.045568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c80064-8b19-4524-bdba-63a1bab19a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:34.069764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c80064-8b19-4524-bdba-63a1bab19a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:34.073183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c80064-8b19-4524-bdba-63a1bab19a95 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:34.101096 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2108/4198] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:37.923111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59185b32-e099-4426-aae3-d02cf33a9a29 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:37.923573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59185b32-e099-4426-aae3-d02cf33a9a29 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:37.923666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59185b32-e099-4426-aae3-d02cf33a9a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:37.950385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-59185b32-e099-4426-aae3-d02cf33a9a29 None None] MFA Rules not processed for user `a68002795ce541338b30129e6dbb0fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:37.952044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-59185b32-e099-4426-aae3-d02cf33a9a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:38.045118 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2091/4199] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:44.088355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=21 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:44.123560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49cd5e-1e00-4a00-8132-bf1bdca5fa67 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:44.123560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49cd5e-1e00-4a00-8132-bf1bdca5fa67 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:44.123792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49cd5e-1e00-4a00-8132-bf1bdca5fa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:44.163833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bc49cd5e-1e00-4a00-8132-bf1bdca5fa67 None None] MFA Rules not processed for user `f70ee130e8e74db88b9b7ffd16ed1bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:44.165334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bc49cd5e-1e00-4a00-8132-bf1bdca5fa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:44.268560 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2109/4200] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:44.285802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59185b32-e099-4426-aae3-d02cf33a9a29 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:44.448873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59185b32-e099-4426-aae3-d02cf33a9a29 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:44.461790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa43e24-8cd1-4d24-a86d-8ef7a0fe8bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:44.462485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa43e24-8cd1-4d24-a86d-8ef7a0fe8bde service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:44.462780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa43e24-8cd1-4d24-a86d-8ef7a0fe8bde service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:44.463057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa43e24-8cd1-4d24-a86d-8ef7a0fe8bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:44.475608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa43e24-8cd1-4d24-a86d-8ef7a0fe8bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:44.480703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa43e24-8cd1-4d24-a86d-8ef7a0fe8bde service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:44.488498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:44.495933 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2092/4201] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:46.484192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c791ef8-b576-4569-8fb8-e3d67931a6fc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:46.484649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c791ef8-b576-4569-8fb8-e3d67931a6fc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:46.484762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c791ef8-b576-4569-8fb8-e3d67931a6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:46.509617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3c791ef8-b576-4569-8fb8-e3d67931a6fc None None] MFA Rules not processed for user `f70ee130e8e74db88b9b7ffd16ed1bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:46.511394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3c791ef8-b576-4569-8fb8-e3d67931a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:46.519033 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2110/4202] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:50.770011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa43e24-8cd1-4d24-a86d-8ef7a0fe8bde service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:50.772177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2aa43e24-8cd1-4d24-a86d-8ef7a0fe8bde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:50.790375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa43e24-8cd1-4d24-a86d-8ef7a0fe8bde service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:50.799858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:50.800540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:50.800847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:50.801127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] PATH_INFO: `/v3/users/4ff0e84a90a4469eb25a16bf200aca12` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:50.802366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff0e84a90a4469eb25a16bf200aca12)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:50.804861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:50.882350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff0e84a90a4469eb25a16bf200aca12'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:50.883750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff0e84a90a4469eb25a16bf200aca12'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:50.902754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff0e84a90a4469eb25a16bf200aca12'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:50.918390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff0e84a90a4469eb25a16bf200aca12'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:50.937374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff0e84a90a4469eb25a16bf200aca12'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:50.954149 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2093/4203] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:44:50 2022] DELETE /identity/v3/users/4ff0e84a90a4469eb25a16bf200aca12 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:50.958300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23d80c-77db-44ba-b386-55db328a0859 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:50.958878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23d80c-77db-44ba-b386-55db328a0859 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:50.958878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23d80c-77db-44ba-b386-55db328a0859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:50.993867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dc23d80c-77db-44ba-b386-55db328a0859 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:50.998869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc23d80c-77db-44ba-b386-55db328a0859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:51.087711 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2111/4204] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:51.107741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:51.110404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:51.198836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e7ada-9edd-4af7-a43f-d1f5d6b1d473 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:51.203325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e143e-2a8d-4b78-a839-fc1eba7bbf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:51.203957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e143e-2a8d-4b78-a839-fc1eba7bbf70 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:51.204239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e143e-2a8d-4b78-a839-fc1eba7bbf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:51.204512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e143e-2a8d-4b78-a839-fc1eba7bbf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:51.219489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e143e-2a8d-4b78-a839-fc1eba7bbf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:51.220867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e143e-2a8d-4b78-a839-fc1eba7bbf70 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:51.234199 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2094/4205] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:52.331540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23d80c-77db-44ba-b386-55db328a0859 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:52.334650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc23d80c-77db-44ba-b386-55db328a0859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:52.349520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23d80c-77db-44ba-b386-55db328a0859 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:52.360931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:52.371030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:52.371516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:52.373046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] PATH_INFO: `/v3/projects/82e47bb291e4476fb9788590ac4804c4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:52.375614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e47bb291e4476fb9788590ac4804c4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:52.377745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:52.454453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e47bb291e4476fb9788590ac4804c4', 'request_id': 'req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:52.471086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e47bb291e4476fb9788590ac4804c4', 'request_id': 'req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:52.496440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e47bb291e4476fb9788590ac4804c4', 'request_id': 'req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:52.514953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] The token cache is being invalidate because project 82e47bb291e4476fb9788590ac4804c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:44:52.515288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:52.516527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:52.519299 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2112/4206] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:52 2022] DELETE /identity/v3/projects/82e47bb291e4476fb9788590ac4804c4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:52.530661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e143e-2a8d-4b78-a839-fc1eba7bbf70 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:52.576954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e143e-2a8d-4b78-a839-fc1eba7bbf70 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:52.739871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:52.741014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:52.741370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:52.741755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] PATH_INFO: `/v3/users/b47d03e9fac648e4b9510888b32daadd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:52.744518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47d03e9fac648e4b9510888b32daadd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:52.746720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:52.779218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:52.832013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47d03e9fac648e4b9510888b32daadd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:52.833181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47d03e9fac648e4b9510888b32daadd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:52.851298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47d03e9fac648e4b9510888b32daadd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:52.864058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47d03e9fac648e4b9510888b32daadd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:52.873062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47d03e9fac648e4b9510888b32daadd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:52.880368 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2095/4207] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:44:52 2022] DELETE /identity/v3/users/b47d03e9fac648e4b9510888b32daadd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:53.318670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:53.320845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:53.348491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8d66c-d0e9-4868-bc83-df0bef5a4e95 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:53.366940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:53.452335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:53.453477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:53.453982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:53.454507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] PATH_INFO: `/v3/projects/ccd8c283340d48c08cff3a09bb65e155` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:53.456499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd8c283340d48c08cff3a09bb65e155)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:53.460181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:53.532333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd8c283340d48c08cff3a09bb65e155', 'request_id': 'req-19a75d47-7738-4aca-a063-ca77c7173cd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:53.548955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd8c283340d48c08cff3a09bb65e155', 'request_id': 'req-19a75d47-7738-4aca-a063-ca77c7173cd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:53.561530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd8c283340d48c08cff3a09bb65e155', 'request_id': 'req-19a75d47-7738-4aca-a063-ca77c7173cd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:53.584972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] The token cache is being invalidate because project ccd8c283340d48c08cff3a09bb65e155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:44:53.586240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:53.590918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:53.598301 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2113/4208] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:53 2022] DELETE /identity/v3/projects/ccd8c283340d48c08cff3a09bb65e155 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:53.598385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:53.606202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:53.621575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13270e11-868d-441d-9379-bfca1b22d750 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:53.697149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ae538-90e2-4136-ab5f-3536335d9d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:53.698007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ae538-90e2-4136-ab5f-3536335d9d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:53.699757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ae538-90e2-4136-ab5f-3536335d9d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:53.699757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ae538-90e2-4136-ab5f-3536335d9d67 admin admin] PATH_INFO: `/v3/users/3232ad15289e4efb96d4dbe75013f80a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:53.700177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ae538-90e2-4136-ab5f-3536335d9d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3232ad15289e4efb96d4dbe75013f80a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:53.702186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ae538-90e2-4136-ab5f-3536335d9d67 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:53.770810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9f3ae538-90e2-4136-ab5f-3536335d9d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3232ad15289e4efb96d4dbe75013f80a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:53.771581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9f3ae538-90e2-4136-ab5f-3536335d9d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3232ad15289e4efb96d4dbe75013f80a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:53.788166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9f3ae538-90e2-4136-ab5f-3536335d9d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3232ad15289e4efb96d4dbe75013f80a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:53.799114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9f3ae538-90e2-4136-ab5f-3536335d9d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3232ad15289e4efb96d4dbe75013f80a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:53.812044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9f3ae538-90e2-4136-ab5f-3536335d9d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3232ad15289e4efb96d4dbe75013f80a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:53.822584 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2096/4209] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:44:53 2022] DELETE /identity/v3/users/3232ad15289e4efb96d4dbe75013f80a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:54.210289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:54.211741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:54.232438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a75d47-7738-4aca-a063-ca77c7173cd4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:54.309082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:54.309769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.310051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.310324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] PATH_INFO: `/v3/projects/ca1483b04b6d4754a8fbfb70c6d54b27` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:54.311645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1483b04b6d4754a8fbfb70c6d54b27)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:54.314093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:54.368453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:54.380056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1483b04b6d4754a8fbfb70c6d54b27', 'request_id': 'req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:54.392822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1483b04b6d4754a8fbfb70c6d54b27', 'request_id': 'req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:54.404379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1483b04b6d4754a8fbfb70c6d54b27', 'request_id': 'req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:54.421675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] The token cache is being invalidate because project ca1483b04b6d4754a8fbfb70c6d54b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:44:54.422176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:54.423935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2710d21d-7d7c-43b5-ab41-1f5033dd4fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:54.427330 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2114/4210] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:54 2022] DELETE /identity/v3/projects/ca1483b04b6d4754a8fbfb70c6d54b27 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:54.433081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da28564-7e6a-47e1-9a8a-7b8cf41d06ba None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.433448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da28564-7e6a-47e1-9a8a-7b8cf41d06ba None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.433752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da28564-7e6a-47e1-9a8a-7b8cf41d06ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:54.455421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0da28564-7e6a-47e1-9a8a-7b8cf41d06ba None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:54.456650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0da28564-7e6a-47e1-9a8a-7b8cf41d06ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:54.466619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:54.532824 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2097/4211] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:54.542588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6dbb-ccc7-4648-82d1-a9ab47e053a8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.542912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6dbb-ccc7-4648-82d1-a9ab47e053a8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.543190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6dbb-ccc7-4648-82d1-a9ab47e053a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:54.565074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-029e6dbb-ccc7-4648-82d1-a9ab47e053a8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:54.566332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-029e6dbb-ccc7-4648-82d1-a9ab47e053a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:54.575341 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2115/4212] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:54.580847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da28564-7e6a-47e1-9a8a-7b8cf41d06ba None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:54.596041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da28564-7e6a-47e1-9a8a-7b8cf41d06ba None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:54.603167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6c203-02ac-4711-9aa9-12b749cd0784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:54.604529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6c203-02ac-4711-9aa9-12b749cd0784 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.604936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6c203-02ac-4711-9aa9-12b749cd0784 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.605338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6c203-02ac-4711-9aa9-12b749cd0784 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:54.606529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6c203-02ac-4711-9aa9-12b749cd0784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:44:54.607052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6c203-02ac-4711-9aa9-12b749cd0784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:54.609917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6c203-02ac-4711-9aa9-12b749cd0784 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:54.625015 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2098/4213] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:44:54.630035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6dbb-ccc7-4648-82d1-a9ab47e053a8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:54.640206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6dbb-ccc7-4648-82d1-a9ab47e053a8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:54.645327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b47dd-d932-409f-a325-7639d2b8e101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:54.645990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b47dd-d932-409f-a325-7639d2b8e101 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.646249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b47dd-d932-409f-a325-7639d2b8e101 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.646520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b47dd-d932-409f-a325-7639d2b8e101 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:54.647202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b47dd-d932-409f-a325-7639d2b8e101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:54.649139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b47dd-d932-409f-a325-7639d2b8e101 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:54.695018 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2116/4214] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:44:54 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:54.699658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6c203-02ac-4711-9aa9-12b749cd0784 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:54.713130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6c203-02ac-4711-9aa9-12b749cd0784 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:54.783249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6592c-979f-492a-908c-2899b2f59087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:54.783902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6592c-979f-492a-908c-2899b2f59087 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.784182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6592c-979f-492a-908c-2899b2f59087 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.784456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6592c-979f-492a-908c-2899b2f59087 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:54.785102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6592c-979f-492a-908c-2899b2f59087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:54.787149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6592c-979f-492a-908c-2899b2f59087 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:54.817419 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2099/4215] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:44:54 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:54.819402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b47dd-d932-409f-a325-7639d2b8e101 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:54.831881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b47dd-d932-409f-a325-7639d2b8e101 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:54.837662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc87ec-6d88-4e55-8bef-541e1af98dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:54.838989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc87ec-6d88-4e55-8bef-541e1af98dfc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.839267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc87ec-6d88-4e55-8bef-541e1af98dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.839540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc87ec-6d88-4e55-8bef-541e1af98dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:54.840193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc87ec-6d88-4e55-8bef-541e1af98dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:54.841837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc87ec-6d88-4e55-8bef-541e1af98dfc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:54.861939 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2117/4216] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:54.866337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6592c-979f-492a-908c-2899b2f59087 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:54.879980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6592c-979f-492a-908c-2899b2f59087 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:54.887558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e111e-e016-4f11-9ad1-536589404277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:54.888256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e111e-e016-4f11-9ad1-536589404277 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.888597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e111e-e016-4f11-9ad1-536589404277 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.888870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e111e-e016-4f11-9ad1-536589404277 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:54.889626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e111e-e016-4f11-9ad1-536589404277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:54.892389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e111e-e016-4f11-9ad1-536589404277 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:54.907271 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2100/4217] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:44:54.911651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc87ec-6d88-4e55-8bef-541e1af98dfc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:54.924041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc87ec-6d88-4e55-8bef-541e1af98dfc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:54.928968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad13d2-b3ba-4711-bc78-e553bb67e206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:54.929693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad13d2-b3ba-4711-bc78-e553bb67e206 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.929992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad13d2-b3ba-4711-bc78-e553bb67e206 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.930266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad13d2-b3ba-4711-bc78-e553bb67e206 admin admin] PATH_INFO: `/v3/projects/443840492b244f0c87a3f3ce9a0599f0/users/3f85ca9c3df34eb1ac156ab90d5d8a0c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:54.948485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad13d2-b3ba-4711-bc78-e553bb67e206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443840492b244f0c87a3f3ce9a0599f0, user_id=3f85ca9c3df34eb1ac156ab90d5d8a0c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:54.951327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad13d2-b3ba-4711-bc78-e553bb67e206 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:54.970392 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2118/4218] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:44:54 2022] PUT /identity/v3/projects/443840492b244f0c87a3f3ce9a0599f0/users/3f85ca9c3df34eb1ac156ab90d5d8a0c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:54.981536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3835-2320-403b-9e64-166716e486a3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:54.981862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3835-2320-403b-9e64-166716e486a3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:54.982089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3835-2320-403b-9e64-166716e486a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:55.024211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-714e3835-2320-403b-9e64-166716e486a3 None None] MFA Rules not processed for user `3f85ca9c3df34eb1ac156ab90d5d8a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:55.031064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-714e3835-2320-403b-9e64-166716e486a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:55.127812 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2101/4219] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:55.141527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad13d2-b3ba-4711-bc78-e553bb67e206 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:55.143377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66ad13d2-b3ba-4711-bc78-e553bb67e206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:55.224721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad13d2-b3ba-4711-bc78-e553bb67e206 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:55.228930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eaee3-1ae7-4c88-8b5e-8b5263150ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:55.229697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eaee3-1ae7-4c88-8b5e-8b5263150ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:55.229911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eaee3-1ae7-4c88-8b5e-8b5263150ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:55.230657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eaee3-1ae7-4c88-8b5e-8b5263150ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:55.244642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816eaee3-1ae7-4c88-8b5e-8b5263150ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:55.246997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816eaee3-1ae7-4c88-8b5e-8b5263150ce2 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:55.262238 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2119/4220] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:57.130146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e3835-2320-403b-9e64-166716e486a3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:57.153781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:57.336684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e3835-2320-403b-9e64-166716e486a3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:57.347722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:57.349103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:57.351079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:57.354774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] PATH_INFO: `/v3/users/3f85ca9c3df34eb1ac156ab90d5d8a0c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:57.356875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f85ca9c3df34eb1ac156ab90d5d8a0c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:57.360025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:57.515063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f85ca9c3df34eb1ac156ab90d5d8a0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:57.516499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f85ca9c3df34eb1ac156ab90d5d8a0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:57.563656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f85ca9c3df34eb1ac156ab90d5d8a0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:57.582029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f85ca9c3df34eb1ac156ab90d5d8a0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:57.596251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f85ca9c3df34eb1ac156ab90d5d8a0c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:57.606673 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2102/4221] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:44:57 2022] DELETE /identity/v3/users/3f85ca9c3df34eb1ac156ab90d5d8a0c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:57.611510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e385-1f72-401e-bad0-b79a599024e7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:57.612065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e385-1f72-401e-bad0-b79a599024e7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:57.613489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e385-1f72-401e-bad0-b79a599024e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:57.651719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6de3e385-1f72-401e-bad0-b79a599024e7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:57.653733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6de3e385-1f72-401e-bad0-b79a599024e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:57.861153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:57.863066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:57.863388 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2120/4222] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:57.970646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41929b98-67e6-41c7-ac6d-6ce2558049b9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:57.990566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfe539-3327-43ec-8df2-626f1fe6c001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:57.993052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe539-3327-43ec-8df2-626f1fe6c001 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:57.995970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe539-3327-43ec-8df2-626f1fe6c001 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:57.997465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe539-3327-43ec-8df2-626f1fe6c001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:58.022277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfe539-3327-43ec-8df2-626f1fe6c001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:58.027926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfe539-3327-43ec-8df2-626f1fe6c001 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:58.064733 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2103/4223] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:58.460202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3e385-1f72-401e-bad0-b79a599024e7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:58.462068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6de3e385-1f72-401e-bad0-b79a599024e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:58.504345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3e385-1f72-401e-bad0-b79a599024e7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:58.512789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:58.514436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:58.515196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:58.515680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] PATH_INFO: `/v3/projects/443840492b244f0c87a3f3ce9a0599f0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:58.527334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=443840492b244f0c87a3f3ce9a0599f0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:58.533312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:58.540174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:58.603458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443840492b244f0c87a3f3ce9a0599f0', 'request_id': 'req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:58.611300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443840492b244f0c87a3f3ce9a0599f0', 'request_id': 'req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:58.624518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443840492b244f0c87a3f3ce9a0599f0', 'request_id': 'req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:58.638618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] The token cache is being invalidate because project 443840492b244f0c87a3f3ce9a0599f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:44:58.639000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:58.639877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5b8a3c43-27a0-4d7d-8ecf-1f83701a1e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:44:58.641473 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2121/4224] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:58 2022] DELETE /identity/v3/projects/443840492b244f0c87a3f3ce9a0599f0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:44:58.646663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9b8a-14a1-464f-bf0d-370175c3f02e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:58.647292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9b8a-14a1-464f-bf0d-370175c3f02e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:58.647470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9b8a-14a1-464f-bf0d-370175c3f02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:58.670114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1c7b9b8a-14a1-464f-bf0d-370175c3f02e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:58.671670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1c7b9b8a-14a1-464f-bf0d-370175c3f02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:58.708532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:58.776004 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2104/4225] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:44:58.778050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f369-d3c0-492c-b002-4b09d03a97d9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:58.778400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f369-d3c0-492c-b002-4b09d03a97d9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:58.778851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f369-d3c0-492c-b002-4b09d03a97d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:58.816186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3e75f369-d3c0-492c-b002-4b09d03a97d9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:58.819501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3e75f369-d3c0-492c-b002-4b09d03a97d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:58.840368 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2122/4226] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:58.841998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9b8a-14a1-464f-bf0d-370175c3f02e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:58.858983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9b8a-14a1-464f-bf0d-370175c3f02e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:58.884591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db770126-486c-4691-a9cf-63f4d3290e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:58.885334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db770126-486c-4691-a9cf-63f4d3290e3c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:58.885869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db770126-486c-4691-a9cf-63f4d3290e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:58.886274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db770126-486c-4691-a9cf-63f4d3290e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:58.886947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db770126-486c-4691-a9cf-63f4d3290e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:44:58.888304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db770126-486c-4691-a9cf-63f4d3290e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:58.890422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db770126-486c-4691-a9cf-63f4d3290e3c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:58.913183 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2105/4227] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:44:58.914935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75f369-d3c0-492c-b002-4b09d03a97d9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:58.935178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75f369-d3c0-492c-b002-4b09d03a97d9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:58.941478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf8b68-7add-40ce-af0f-0b02ef8db1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:58.942111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf8b68-7add-40ce-af0f-0b02ef8db1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:58.942393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf8b68-7add-40ce-af0f-0b02ef8db1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:58.942671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf8b68-7add-40ce-af0f-0b02ef8db1a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:58.943317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf8b68-7add-40ce-af0f-0b02ef8db1a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:58.945411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf8b68-7add-40ce-af0f-0b02ef8db1a0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:58.987621 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2123/4228] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:44:58 2022] POST /identity/v3/projects => generated 393 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:58.991857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db770126-486c-4691-a9cf-63f4d3290e3c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:59.005691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db770126-486c-4691-a9cf-63f4d3290e3c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:59.141904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e228-5be4-4994-9825-5d9f81f07844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:59.142715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e228-5be4-4994-9825-5d9f81f07844 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:59.145064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e228-5be4-4994-9825-5d9f81f07844 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:59.145419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e228-5be4-4994-9825-5d9f81f07844 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:59.146095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0e228-5be4-4994-9825-5d9f81f07844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:59.148743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0e228-5be4-4994-9825-5d9f81f07844 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:59.189792 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2106/4229] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:44:58 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:44:59.193410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf8b68-7add-40ce-af0f-0b02ef8db1a0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:59.206708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf8b68-7add-40ce-af0f-0b02ef8db1a0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:59.231261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9c18-6039-4e16-b5ad-aa117f20b68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:59.231897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9c18-6039-4e16-b5ad-aa117f20b68a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:59.232179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9c18-6039-4e16-b5ad-aa117f20b68a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:59.232454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9c18-6039-4e16-b5ad-aa117f20b68a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:59.233111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc9c18-6039-4e16-b5ad-aa117f20b68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:59.234851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc9c18-6039-4e16-b5ad-aa117f20b68a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:59.256064 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2124/4230] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:59.260417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e228-5be4-4994-9825-5d9f81f07844 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:59.273568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e228-5be4-4994-9825-5d9f81f07844 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:59.280728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df1d65-d5f6-4598-bb3e-292991a5a6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:59.280728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df1d65-d5f6-4598-bb3e-292991a5a6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:59.281516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df1d65-d5f6-4598-bb3e-292991a5a6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:59.281516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df1d65-d5f6-4598-bb3e-292991a5a6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:59.282231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df1d65-d5f6-4598-bb3e-292991a5a6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:59.284049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df1d65-d5f6-4598-bb3e-292991a5a6d6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:59.302859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9c18-6039-4e16-b5ad-aa117f20b68a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:59.303874 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2107/4231] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:44:59.316335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9c18-6039-4e16-b5ad-aa117f20b68a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:59.321287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650d420-f7f6-4e7f-8bf4-39d59d2a727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:59.322055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650d420-f7f6-4e7f-8bf4-39d59d2a727a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:59.322341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650d420-f7f6-4e7f-8bf4-39d59d2a727a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:59.322654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650d420-f7f6-4e7f-8bf4-39d59d2a727a admin admin] PATH_INFO: `/v3/projects/16897201e4a247d9ad6441324642f89f/users/0d52cdc9eff6462380334606545aea87/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:59.347590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650d420-f7f6-4e7f-8bf4-39d59d2a727a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16897201e4a247d9ad6441324642f89f, user_id=0d52cdc9eff6462380334606545aea87, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:59.359701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650d420-f7f6-4e7f-8bf4-39d59d2a727a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:59.396345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a14e2e-b65b-4e1d-8828-10e23db4fe52 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:59.396638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a14e2e-b65b-4e1d-8828-10e23db4fe52 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:59.396917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a14e2e-b65b-4e1d-8828-10e23db4fe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:59.402176 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2125/4232] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:44:59 2022] PUT /identity/v3/projects/16897201e4a247d9ad6441324642f89f/users/0d52cdc9eff6462380334606545aea87/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:44:59.450313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-72a14e2e-b65b-4e1d-8828-10e23db4fe52 None None] MFA Rules not processed for user `0d52cdc9eff6462380334606545aea87`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:44:59.451955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72a14e2e-b65b-4e1d-8828-10e23db4fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:59.674863 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2108/4233] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:44:59.684068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650d420-f7f6-4e7f-8bf4-39d59d2a727a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:44:59.687650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9650d420-f7f6-4e7f-8bf4-39d59d2a727a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:44:59.835494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650d420-f7f6-4e7f-8bf4-39d59d2a727a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:44:59.841575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5583fcd-9f7d-4bea-870f-44f47df099ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:44:59.842199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583fcd-9f7d-4bea-870f-44f47df099ab service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:44:59.842480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583fcd-9f7d-4bea-870f-44f47df099ab service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:44:59.844148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583fcd-9f7d-4bea-870f-44f47df099ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:44:59.857538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5583fcd-9f7d-4bea-870f-44f47df099ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:44:59.859080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5583fcd-9f7d-4bea-870f-44f47df099ab service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:44:59.873941 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2126/4234] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:44:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:04.868492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a14e2e-b65b-4e1d-8828-10e23db4fe52 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:04.870141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72a14e2e-b65b-4e1d-8828-10e23db4fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:04.979889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:05.055591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a14e2e-b65b-4e1d-8828-10e23db4fe52 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:05.069858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:05.071006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:05.071517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:05.072257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] PATH_INFO: `/v3/users/6f1f36c44f014a95b1a0ce8f43d0a0b2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:05.074834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1f36c44f014a95b1a0ce8f43d0a0b2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:05.078215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:05.161363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1f36c44f014a95b1a0ce8f43d0a0b2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:05.162417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1f36c44f014a95b1a0ce8f43d0a0b2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:05.181589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1f36c44f014a95b1a0ce8f43d0a0b2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:05.194568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1f36c44f014a95b1a0ce8f43d0a0b2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:05.206515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1f36c44f014a95b1a0ce8f43d0a0b2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:05.216596 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2109/4235] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:04 2022] DELETE /identity/v3/users/6f1f36c44f014a95b1a0ce8f43d0a0b2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:05.222400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7710b-3d0e-4d8d-bf6c-35de5067bfa3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:05.223130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7710b-3d0e-4d8d-bf6c-35de5067bfa3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:05.223610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7710b-3d0e-4d8d-bf6c-35de5067bfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:05.265366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-68e7710b-3d0e-4d8d-bf6c-35de5067bfa3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:05.269239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-68e7710b-3d0e-4d8d-bf6c-35de5067bfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:05.305074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:05.386704 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2127/4236] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:05.395282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:05.397219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:05.520557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3544a65-26b3-4265-b3db-37958018c675 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:05.527420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453168a-5e58-4653-b0f6-cb6f2a785296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:05.529344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453168a-5e58-4653-b0f6-cb6f2a785296 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:05.529854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453168a-5e58-4653-b0f6-cb6f2a785296 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:05.530290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453168a-5e58-4653-b0f6-cb6f2a785296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:05.560426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453168a-5e58-4653-b0f6-cb6f2a785296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:05.562652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453168a-5e58-4653-b0f6-cb6f2a785296 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:05.576753 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2110/4237] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:45:06.059193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7710b-3d0e-4d8d-bf6c-35de5067bfa3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:06.063593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-68e7710b-3d0e-4d8d-bf6c-35de5067bfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:06.098023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7710b-3d0e-4d8d-bf6c-35de5067bfa3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:06.112268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:06.112835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:06.113548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:06.114080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] PATH_INFO: `/v3/projects/36a76c5994234bfab19624faf79dccc1` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:06.116063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a76c5994234bfab19624faf79dccc1)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:06.120271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:06.246475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a76c5994234bfab19624faf79dccc1', 'request_id': 'req-ed2b0011-9878-4669-9323-ce5605e0a0af'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:06.263646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a76c5994234bfab19624faf79dccc1', 'request_id': 'req-ed2b0011-9878-4669-9323-ce5605e0a0af'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:06.293694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a76c5994234bfab19624faf79dccc1', 'request_id': 'req-ed2b0011-9878-4669-9323-ce5605e0a0af'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:06.330774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] The token cache is being invalidate because project 36a76c5994234bfab19624faf79dccc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:06.331814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:06.336708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed2b0011-9878-4669-9323-ce5605e0a0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:06.340412 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2128/4238] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:06 2022] DELETE /identity/v3/projects/36a76c5994234bfab19624faf79dccc1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:06.347624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557f94-13cc-4cef-9cc2-b859645c310b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:06.348179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557f94-13cc-4cef-9cc2-b859645c310b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:06.348322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557f94-13cc-4cef-9cc2-b859645c310b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:06.392193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a5557f94-13cc-4cef-9cc2-b859645c310b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:06.393743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a5557f94-13cc-4cef-9cc2-b859645c310b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:06.556522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:06.596721 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2111/4239] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:06.608113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ee05-2474-450f-b581-afd3565904f6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:06.608113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ee05-2474-450f-b581-afd3565904f6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:06.609424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ee05-2474-450f-b581-afd3565904f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:06.659614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1117ee05-2474-450f-b581-afd3565904f6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:06.663172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1117ee05-2474-450f-b581-afd3565904f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:06.684610 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2129/4240] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:06.688770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5557f94-13cc-4cef-9cc2-b859645c310b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:06.705464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5557f94-13cc-4cef-9cc2-b859645c310b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:06.714782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895dbbd-e0c2-485d-a6c6-4883447db9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:06.716865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895dbbd-e0c2-485d-a6c6-4883447db9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:06.717667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895dbbd-e0c2-485d-a6c6-4883447db9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:06.719284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895dbbd-e0c2-485d-a6c6-4883447db9a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:06.720680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895dbbd-e0c2-485d-a6c6-4883447db9a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:06.721724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895dbbd-e0c2-485d-a6c6-4883447db9a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:06.725363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895dbbd-e0c2-485d-a6c6-4883447db9a9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:06.750861 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2112/4241] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:06.755567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117ee05-2474-450f-b581-afd3565904f6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:06.803032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117ee05-2474-450f-b581-afd3565904f6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:06.818435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89245b8-9e29-45b6-9507-0c398dd88cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:06.819767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89245b8-9e29-45b6-9507-0c398dd88cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:06.820130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89245b8-9e29-45b6-9507-0c398dd88cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:06.820612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89245b8-9e29-45b6-9507-0c398dd88cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:06.821143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89245b8-9e29-45b6-9507-0c398dd88cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:06.825617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89245b8-9e29-45b6-9507-0c398dd88cb7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:06.887295 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2130/4242] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:06 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:06.891716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895dbbd-e0c2-485d-a6c6-4883447db9a9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:06.913486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895dbbd-e0c2-485d-a6c6-4883447db9a9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:07.015062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472ce99-0d91-4944-b778-999419cea493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:07.016802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472ce99-0d91-4944-b778-999419cea493 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:07.016802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472ce99-0d91-4944-b778-999419cea493 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:07.017587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472ce99-0d91-4944-b778-999419cea493 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:07.018438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472ce99-0d91-4944-b778-999419cea493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:07.021515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472ce99-0d91-4944-b778-999419cea493 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:07.060349 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2113/4243] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:06 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:07.068343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89245b8-9e29-45b6-9507-0c398dd88cb7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:07.093882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89245b8-9e29-45b6-9507-0c398dd88cb7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:07.104973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb0902-0791-4ca9-aae3-b6e098e40f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:07.106914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb0902-0791-4ca9-aae3-b6e098e40f9a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:07.106914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb0902-0791-4ca9-aae3-b6e098e40f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:07.106914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb0902-0791-4ca9-aae3-b6e098e40f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:07.107722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb0902-0791-4ca9-aae3-b6e098e40f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:07.109667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb0902-0791-4ca9-aae3-b6e098e40f9a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:07.137009 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2131/4244] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:07.142021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472ce99-0d91-4944-b778-999419cea493 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:07.166899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472ce99-0d91-4944-b778-999419cea493 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:07.175246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f6243-4dbb-4387-bd67-17c8a4ce22ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:07.175461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f6243-4dbb-4387-bd67-17c8a4ce22ed admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:07.177029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f6243-4dbb-4387-bd67-17c8a4ce22ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:07.177029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f6243-4dbb-4387-bd67-17c8a4ce22ed admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:07.177937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f6243-4dbb-4387-bd67-17c8a4ce22ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:07.180318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f6243-4dbb-4387-bd67-17c8a4ce22ed admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:07.200306 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2114/4245] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:07.201251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb0902-0791-4ca9-aae3-b6e098e40f9a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:07.220999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb0902-0791-4ca9-aae3-b6e098e40f9a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:07.227420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6f48e-92d1-46b1-9327-d71eee856c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:07.228406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f48e-92d1-46b1-9327-d71eee856c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:07.229917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f48e-92d1-46b1-9327-d71eee856c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:07.230806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f48e-92d1-46b1-9327-d71eee856c00 admin admin] PATH_INFO: `/v3/projects/62bf95e66d0847c4beefeba528ebf447/users/0d7bfb7936cf4c709466b39a6486bf57/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:07.263908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6f48e-92d1-46b1-9327-d71eee856c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bf95e66d0847c4beefeba528ebf447, user_id=0d7bfb7936cf4c709466b39a6486bf57, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:07.270076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6f48e-92d1-46b1-9327-d71eee856c00 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:07.318918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac16e-cfe5-4f18-b299-5b7e97571f0d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:07.319156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac16e-cfe5-4f18-b299-5b7e97571f0d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:07.319389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac16e-cfe5-4f18-b299-5b7e97571f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:07.322621 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2132/4246] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:07 2022] PUT /identity/v3/projects/62bf95e66d0847c4beefeba528ebf447/users/0d7bfb7936cf4c709466b39a6486bf57/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:07.392555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-911ac16e-cfe5-4f18-b299-5b7e97571f0d None None] MFA Rules not processed for user `0d7bfb7936cf4c709466b39a6486bf57`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:07.396811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-911ac16e-cfe5-4f18-b299-5b7e97571f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:07.532115 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2115/4247] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:07.635654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b6de3-abc9-48da-b280-03c726612ff6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:07.636615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b6de3-abc9-48da-b280-03c726612ff6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:07.637044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b6de3-abc9-48da-b280-03c726612ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:07.675384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-157b6de3-abc9-48da-b280-03c726612ff6 None None] MFA Rules not processed for user `0d7bfb7936cf4c709466b39a6486bf57`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:07.676677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-157b6de3-abc9-48da-b280-03c726612ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:07.697688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ac16e-cfe5-4f18-b299-5b7e97571f0d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:07.699467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-911ac16e-cfe5-4f18-b299-5b7e97571f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:07.703366 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2133/4248] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:07.812979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:07.879382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ac16e-cfe5-4f18-b299-5b7e97571f0d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:07.897340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067537a-0462-4d3f-bc71-4ea7eb84e772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:07.899054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067537a-0462-4d3f-bc71-4ea7eb84e772 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:07.899054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067537a-0462-4d3f-bc71-4ea7eb84e772 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:07.899585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067537a-0462-4d3f-bc71-4ea7eb84e772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:07.919373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067537a-0462-4d3f-bc71-4ea7eb84e772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:07.922014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067537a-0462-4d3f-bc71-4ea7eb84e772 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:07.935943 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2116/4249] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:45:11.708936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b6de3-abc9-48da-b280-03c726612ff6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:11.711066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-157b6de3-abc9-48da-b280-03c726612ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:11.787691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:11.800337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067537a-0462-4d3f-bc71-4ea7eb84e772 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:11.802132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5067537a-0462-4d3f-bc71-4ea7eb84e772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:11.840913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b6de3-abc9-48da-b280-03c726612ff6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:11.848329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16106d01-5531-488a-89de-64446772aceb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:11.849192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16106d01-5531-488a-89de-64446772aceb service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:11.849908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16106d01-5531-488a-89de-64446772aceb service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:11.849908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16106d01-5531-488a-89de-64446772aceb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:11.852032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-16106d01-5531-488a-89de-64446772aceb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:11.867962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16106d01-5531-488a-89de-64446772aceb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:11.874016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16106d01-5531-488a-89de-64446772aceb service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:11.887370 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2134/4250] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:11.934715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067537a-0462-4d3f-bc71-4ea7eb84e772 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:11.940816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:11.941536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:11.941840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:11.942149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] PATH_INFO: `/v3/users/0d52cdc9eff6462380334606545aea87` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:11.943443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d52cdc9eff6462380334606545aea87)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:11.945425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:12.011307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d52cdc9eff6462380334606545aea87'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:12.013214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d52cdc9eff6462380334606545aea87'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:12.033870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d52cdc9eff6462380334606545aea87'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:12.045833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d52cdc9eff6462380334606545aea87'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:12.055268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d52cdc9eff6462380334606545aea87'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:12.066471 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2117/4251] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:11 2022] DELETE /identity/v3/users/0d52cdc9eff6462380334606545aea87 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:12.068883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e99d4-0ade-40e2-8dd4-d7a84aa5ca23 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:12.069297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e99d4-0ade-40e2-8dd4-d7a84aa5ca23 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:12.069747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e99d4-0ade-40e2-8dd4-d7a84aa5ca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:12.094095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-df0e99d4-0ade-40e2-8dd4-d7a84aa5ca23 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:12.095429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-df0e99d4-0ade-40e2-8dd4-d7a84aa5ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:12.190629 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2135/4252] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:12.201224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:12.203244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:12.290893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:12.303368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d6713-e44e-4f29-ae12-25c78debad19 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:12.309099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0a26f-18f5-43f1-a3b3-21f5cf27c07f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:12.310741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0a26f-18f5-43f1-a3b3-21f5cf27c07f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:12.311223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0a26f-18f5-43f1-a3b3-21f5cf27c07f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:12.311820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0a26f-18f5-43f1-a3b3-21f5cf27c07f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:12.330877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0a26f-18f5-43f1-a3b3-21f5cf27c07f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:12.332513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0a26f-18f5-43f1-a3b3-21f5cf27c07f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:12.349041 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2118/4253] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:12.584309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e99d4-0ade-40e2-8dd4-d7a84aa5ca23 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:12.586439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-df0e99d4-0ade-40e2-8dd4-d7a84aa5ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:12.611232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e99d4-0ade-40e2-8dd4-d7a84aa5ca23 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:12.618428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:12.619203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:12.619540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:12.619871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] PATH_INFO: `/v3/projects/16897201e4a247d9ad6441324642f89f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:12.621077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16897201e4a247d9ad6441324642f89f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:12.623058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:12.686039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16897201e4a247d9ad6441324642f89f', 'request_id': 'req-9e43de81-b30c-4dcd-9eba-118eeaabc373'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:12.694367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16897201e4a247d9ad6441324642f89f', 'request_id': 'req-9e43de81-b30c-4dcd-9eba-118eeaabc373'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:12.713190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16897201e4a247d9ad6441324642f89f', 'request_id': 'req-9e43de81-b30c-4dcd-9eba-118eeaabc373'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:12.757352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] The token cache is being invalidate because project 16897201e4a247d9ad6441324642f89f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:12.758046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:12.759129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43de81-b30c-4dcd-9eba-118eeaabc373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:12.762250 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2136/4254] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:12 2022] DELETE /identity/v3/projects/16897201e4a247d9ad6441324642f89f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:12.768136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e88a-7eb5-4aa2-acd1-145ef075a65b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:12.768422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e88a-7eb5-4aa2-acd1-145ef075a65b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:12.768732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e88a-7eb5-4aa2-acd1-145ef075a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:12.807080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1f15e88a-7eb5-4aa2-acd1-145ef075a65b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:12.811072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1f15e88a-7eb5-4aa2-acd1-145ef075a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:13.022827 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2119/4255] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:13.034082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f6e8-038b-443a-8899-148e659b4136 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:13.034354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f6e8-038b-443a-8899-148e659b4136 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:13.034577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f6e8-038b-443a-8899-148e659b4136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:13.060736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c927f6e8-038b-443a-8899-148e659b4136 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:13.062213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c927f6e8-038b-443a-8899-148e659b4136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:13.079455 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2137/4256] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:13.083599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15e88a-7eb5-4aa2-acd1-145ef075a65b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:13.101876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15e88a-7eb5-4aa2-acd1-145ef075a65b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:13.113540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862865e9-33c3-464c-843f-88eb5a5bd0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:13.114388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862865e9-33c3-464c-843f-88eb5a5bd0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:13.114741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862865e9-33c3-464c-843f-88eb5a5bd0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:13.115371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862865e9-33c3-464c-843f-88eb5a5bd0a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:13.116466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862865e9-33c3-464c-843f-88eb5a5bd0a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:13.116845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862865e9-33c3-464c-843f-88eb5a5bd0a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:13.119957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862865e9-33c3-464c-843f-88eb5a5bd0a0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:13.142908 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2120/4257] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:13.150101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f6e8-038b-443a-8899-148e659b4136 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:13.169365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f6e8-038b-443a-8899-148e659b4136 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:13.180252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f4498-239b-4c0c-9d53-f9d5a44ec3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:13.180898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f4498-239b-4c0c-9d53-f9d5a44ec3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:13.181752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f4498-239b-4c0c-9d53-f9d5a44ec3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:13.182283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f4498-239b-4c0c-9d53-f9d5a44ec3c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:13.183169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f4498-239b-4c0c-9d53-f9d5a44ec3c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:13.185709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f4498-239b-4c0c-9d53-f9d5a44ec3c7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:13.235227 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2138/4258] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:13 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:13.237317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862865e9-33c3-464c-843f-88eb5a5bd0a0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:13.257702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862865e9-33c3-464c-843f-88eb5a5bd0a0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:13.370949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf0d70-9a66-4538-99d0-6bb3f50f43be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:13.371239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0d70-9a66-4538-99d0-6bb3f50f43be admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:13.371520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0d70-9a66-4538-99d0-6bb3f50f43be admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:13.371790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0d70-9a66-4538-99d0-6bb3f50f43be admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:13.372448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf0d70-9a66-4538-99d0-6bb3f50f43be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:13.374578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf0d70-9a66-4538-99d0-6bb3f50f43be admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:13.402399 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2121/4259] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:13 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:45:13.406649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f4498-239b-4c0c-9d53-f9d5a44ec3c7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:13.420064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f4498-239b-4c0c-9d53-f9d5a44ec3c7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:13.425821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214282f-f7e5-4589-ae63-b7927e139e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:13.426782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214282f-f7e5-4589-ae63-b7927e139e78 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:13.426941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214282f-f7e5-4589-ae63-b7927e139e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:13.427206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214282f-f7e5-4589-ae63-b7927e139e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:13.427876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214282f-f7e5-4589-ae63-b7927e139e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:13.430680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214282f-f7e5-4589-ae63-b7927e139e78 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:13.445823 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2139/4260] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:13.450851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf0d70-9a66-4538-99d0-6bb3f50f43be admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:13.475392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf0d70-9a66-4538-99d0-6bb3f50f43be admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:13.503246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387466d4-0dbf-4fc6-8793-121d1a31f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:13.503246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387466d4-0dbf-4fc6-8793-121d1a31f921 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:13.503246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387466d4-0dbf-4fc6-8793-121d1a31f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:13.503246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387466d4-0dbf-4fc6-8793-121d1a31f921 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:13.504373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387466d4-0dbf-4fc6-8793-121d1a31f921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:13.504373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387466d4-0dbf-4fc6-8793-121d1a31f921 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:13.528185 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2122/4261] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:13.529832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214282f-f7e5-4589-ae63-b7927e139e78 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:13.542969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387466d4-0dbf-4fc6-8793-121d1a31f921 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:13.545327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-387466d4-0dbf-4fc6-8793-121d1a31f921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:13.560210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214282f-f7e5-4589-ae63-b7927e139e78 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:13.569870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1566f4-8427-4074-91fc-22ddfe93ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:13.570960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1566f4-8427-4074-91fc-22ddfe93ce91 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:13.571422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1566f4-8427-4074-91fc-22ddfe93ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:13.571848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1566f4-8427-4074-91fc-22ddfe93ce91 admin admin] PATH_INFO: `/v3/projects/59eb77f8e051424fa47cd048e02154db/users/a6a8462ae5f54157b3e4d6bd2467cd84/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:13.573293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387466d4-0dbf-4fc6-8793-121d1a31f921 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:13.584774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:13.585776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:13.586263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:13.586992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] PATH_INFO: `/v3/users/351e59b6021b44a29665281568960f8b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:13.588509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=351e59b6021b44a29665281568960f8b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:13.592034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:13.616878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:13.624529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1566f4-8427-4074-91fc-22ddfe93ce91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59eb77f8e051424fa47cd048e02154db, user_id=a6a8462ae5f54157b3e4d6bd2467cd84, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:13.636982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1566f4-8427-4074-91fc-22ddfe93ce91 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:13.658321 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2140/4262] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:13 2022] PUT /identity/v3/projects/59eb77f8e051424fa47cd048e02154db/users/a6a8462ae5f54157b3e4d6bd2467cd84/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:13.670002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7092f2-896c-4bec-9b30-43c35abce210 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:13.670292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7092f2-896c-4bec-9b30-43c35abce210 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:13.670897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7092f2-896c-4bec-9b30-43c35abce210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:13.679638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351e59b6021b44a29665281568960f8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:13.680577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351e59b6021b44a29665281568960f8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:13.687204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:13.701037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351e59b6021b44a29665281568960f8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:13.713839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351e59b6021b44a29665281568960f8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:13.714892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fd7092f2-896c-4bec-9b30-43c35abce210 None None] MFA Rules not processed for user `a6a8462ae5f54157b3e4d6bd2467cd84`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:13.716177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fd7092f2-896c-4bec-9b30-43c35abce210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:13.724127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351e59b6021b44a29665281568960f8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:13.734150 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2123/4263] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:13 2022] DELETE /identity/v3/users/351e59b6021b44a29665281568960f8b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:13.846830 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2141/4264] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:13.859667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:13.861876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:14.086024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d3360-5807-4cf1-8af5-ec199b9ffd10 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:14.093646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9504f28-61b0-4695-a3da-58b8dd87680a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:14.094279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9504f28-61b0-4695-a3da-58b8dd87680a service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:14.094557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9504f28-61b0-4695-a3da-58b8dd87680a service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:14.094833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9504f28-61b0-4695-a3da-58b8dd87680a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:14.107630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7092f2-896c-4bec-9b30-43c35abce210 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:14.109802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fd7092f2-896c-4bec-9b30-43c35abce210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:14.240532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9504f28-61b0-4695-a3da-58b8dd87680a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:14.244569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9504f28-61b0-4695-a3da-58b8dd87680a service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:14.252262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7092f2-896c-4bec-9b30-43c35abce210 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:14.259510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2124/4265] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:14.408409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:14.409136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:14.409568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:14.409938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] PATH_INFO: `/v3/projects/3f9940a1fec84128b318a5f80884447b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:14.411583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9940a1fec84128b318a5f80884447b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:14.413856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:14.479136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:14.527614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9940a1fec84128b318a5f80884447b', 'request_id': 'req-f639d073-242d-4193-a292-018e74277b20'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:14.536463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9940a1fec84128b318a5f80884447b', 'request_id': 'req-f639d073-242d-4193-a292-018e74277b20'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:14.562263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9940a1fec84128b318a5f80884447b', 'request_id': 'req-f639d073-242d-4193-a292-018e74277b20'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:14.594223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] The token cache is being invalidate because project 3f9940a1fec84128b318a5f80884447b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:14.594792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:14.599624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f639d073-242d-4193-a292-018e74277b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:14.605915 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2142/4266] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:14 2022] DELETE /identity/v3/projects/3f9940a1fec84128b318a5f80884447b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:14.611250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e013650-8459-450b-a8eb-241b00f2d6f8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:14.611511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e013650-8459-450b-a8eb-241b00f2d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:14.611783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e013650-8459-450b-a8eb-241b00f2d6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:14.662259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4e013650-8459-450b-a8eb-241b00f2d6f8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:14.663994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4e013650-8459-450b-a8eb-241b00f2d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:14.816938 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2125/4267] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:14.825778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601943-6fe5-4ef9-b3f6-9b4c9b961255 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:14.826577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601943-6fe5-4ef9-b3f6-9b4c9b961255 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:14.826844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601943-6fe5-4ef9-b3f6-9b4c9b961255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:14.864702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b9601943-6fe5-4ef9-b3f6-9b4c9b961255 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:14.867110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b9601943-6fe5-4ef9-b3f6-9b4c9b961255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:14.886597 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2143/4268] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:14.896418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e013650-8459-450b-a8eb-241b00f2d6f8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:14.929883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e013650-8459-450b-a8eb-241b00f2d6f8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:14.943863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571eafb-b006-4c66-8920-9406dadf4137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:14.944309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571eafb-b006-4c66-8920-9406dadf4137 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:14.944595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571eafb-b006-4c66-8920-9406dadf4137 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:14.944872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571eafb-b006-4c66-8920-9406dadf4137 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:14.949322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571eafb-b006-4c66-8920-9406dadf4137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:14.949669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571eafb-b006-4c66-8920-9406dadf4137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:14.953894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571eafb-b006-4c66-8920-9406dadf4137 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:14.982114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9601943-6fe5-4ef9-b3f6-9b4c9b961255 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:14.982500 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2126/4269] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:14.996898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9601943-6fe5-4ef9-b3f6-9b4c9b961255 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:15.002141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9068b6-9fca-47c3-93a0-a3e4350b4f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:15.002789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9068b6-9fca-47c3-93a0-a3e4350b4f6b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:15.003213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9068b6-9fca-47c3-93a0-a3e4350b4f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:15.004288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9068b6-9fca-47c3-93a0-a3e4350b4f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:15.005084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9068b6-9fca-47c3-93a0-a3e4350b4f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:15.008429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9068b6-9fca-47c3-93a0-a3e4350b4f6b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:15.060694 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2144/4270] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:14 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:45:15.064768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571eafb-b006-4c66-8920-9406dadf4137 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:15.080116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571eafb-b006-4c66-8920-9406dadf4137 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:15.091834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:15.164687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426d477-c91a-4346-8343-24a0c3aeeb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:15.165671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d477-c91a-4346-8343-24a0c3aeeb67 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:15.166516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d477-c91a-4346-8343-24a0c3aeeb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:15.166787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d477-c91a-4346-8343-24a0c3aeeb67 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:15.167877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426d477-c91a-4346-8343-24a0c3aeeb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:15.170011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426d477-c91a-4346-8343-24a0c3aeeb67 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:15.198467 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2127/4271] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:15 2022] POST /identity/v3/users => generated 283 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:15.202371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9068b6-9fca-47c3-93a0-a3e4350b4f6b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:15.214982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9068b6-9fca-47c3-93a0-a3e4350b4f6b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:15.234204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3ef56-62f3-46e9-b7aa-3895a50915da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:15.234403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3ef56-62f3-46e9-b7aa-3895a50915da admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:15.234845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3ef56-62f3-46e9-b7aa-3895a50915da admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:15.235341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3ef56-62f3-46e9-b7aa-3895a50915da admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:15.236233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3ef56-62f3-46e9-b7aa-3895a50915da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:15.241319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3ef56-62f3-46e9-b7aa-3895a50915da admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:15.270677 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2145/4272] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:15.275484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426d477-c91a-4346-8343-24a0c3aeeb67 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:15.290353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426d477-c91a-4346-8343-24a0c3aeeb67 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:15.297595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f0a29-e859-4cee-85c8-5c6a3aac8af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:15.298438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f0a29-e859-4cee-85c8-5c6a3aac8af3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:15.298934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f0a29-e859-4cee-85c8-5c6a3aac8af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:15.299383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f0a29-e859-4cee-85c8-5c6a3aac8af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:15.301488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f0a29-e859-4cee-85c8-5c6a3aac8af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:15.309895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f0a29-e859-4cee-85c8-5c6a3aac8af3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:15.325761 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2128/4273] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:15.330852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3ef56-62f3-46e9-b7aa-3895a50915da admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:15.343807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3ef56-62f3-46e9-b7aa-3895a50915da admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:15.355544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03349ebb-27e1-42d0-ab42-0e23d9281fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:15.356647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03349ebb-27e1-42d0-ab42-0e23d9281fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:15.357168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03349ebb-27e1-42d0-ab42-0e23d9281fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:15.357713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03349ebb-27e1-42d0-ab42-0e23d9281fd7 admin admin] PATH_INFO: `/v3/projects/9482e62a8ca44bee87723046ac4eceb6/users/928582e69a3741c7929dcf8693d794b6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:15.378632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03349ebb-27e1-42d0-ab42-0e23d9281fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9482e62a8ca44bee87723046ac4eceb6, user_id=928582e69a3741c7929dcf8693d794b6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:15.381930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03349ebb-27e1-42d0-ab42-0e23d9281fd7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:15.401431 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2146/4274] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:15 2022] PUT /identity/v3/projects/9482e62a8ca44bee87723046ac4eceb6/users/928582e69a3741c7929dcf8693d794b6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:15.410893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29337c4-80b6-463c-9f9e-90044496eda5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:15.411178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29337c4-80b6-463c-9f9e-90044496eda5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:15.411450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29337c4-80b6-463c-9f9e-90044496eda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:15.469440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a29337c4-80b6-463c-9f9e-90044496eda5 None None] MFA Rules not processed for user `928582e69a3741c7929dcf8693d794b6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:15.471007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a29337c4-80b6-463c-9f9e-90044496eda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:15.527163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03349ebb-27e1-42d0-ab42-0e23d9281fd7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:15.536518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-03349ebb-27e1-42d0-ab42-0e23d9281fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:15.640013 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2129/4275] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:15.646965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29337c4-80b6-463c-9f9e-90044496eda5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:15.648517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a29337c4-80b6-463c-9f9e-90044496eda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:15.672011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03349ebb-27e1-42d0-ab42-0e23d9281fd7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:15.685591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:15.686215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:15.686498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:15.686774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] PATH_INFO: `/v3/users/f1fd00311fa540658cfd4076c9a88976` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:15.689012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fd00311fa540658cfd4076c9a88976)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:15.692615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:15.817450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fd00311fa540658cfd4076c9a88976'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:15.821250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fd00311fa540658cfd4076c9a88976'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:15.844945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:15.865918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fd00311fa540658cfd4076c9a88976'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:15.867092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29337c4-80b6-463c-9f9e-90044496eda5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:15.868956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fd00311fa540658cfd4076c9a88976'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:15.874888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42c994-8436-414c-8192-30458f4f0b0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:15.876326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c994-8436-414c-8192-30458f4f0b0e service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:15.876813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c994-8436-414c-8192-30458f4f0b0e service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:15.877441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c994-8436-414c-8192-30458f4f0b0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:15.880714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cc42c994-8436-414c-8192-30458f4f0b0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:15.888765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fd00311fa540658cfd4076c9a88976'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:15.897120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42c994-8436-414c-8192-30458f4f0b0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:15.900798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42c994-8436-414c-8192-30458f4f0b0e service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:15.918221 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2147/4276] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:15 2022] DELETE /identity/v3/users/f1fd00311fa540658cfd4076c9a88976 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:15.925611 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2130/4277] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:45:15.974970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:15.976520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:16.085159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f15f6c-9af1-4444-9c7e-dc23dc4f17b1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:16.094960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:16.096021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:16.096818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:16.097153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] PATH_INFO: `/v3/users/928582e69a3741c7929dcf8693d794b6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:16.099200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] RBAC: Authorizing `identity:delete_user(user_id=928582e69a3741c7929dcf8693d794b6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:16.101594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:16.205024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928582e69a3741c7929dcf8693d794b6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:16.206553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928582e69a3741c7929dcf8693d794b6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:16.241362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928582e69a3741c7929dcf8693d794b6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:16.243142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928582e69a3741c7929dcf8693d794b6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:16.255783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928582e69a3741c7929dcf8693d794b6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:16.305906 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2148/4278] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:15 2022] DELETE /identity/v3/users/928582e69a3741c7929dcf8693d794b6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:16.312329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4c678-01ea-4818-ad0a-c788981be1c5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:16.312662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4c678-01ea-4818-ad0a-c788981be1c5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:16.313012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4c678-01ea-4818-ad0a-c788981be1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:16.331842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:16.354334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3af4c678-01ea-4818-ad0a-c788981be1c5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:16.355590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3af4c678-01ea-4818-ad0a-c788981be1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:16.413182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:16.414984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:16.505261 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2131/4279] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:16.524829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4c678-01ea-4818-ad0a-c788981be1c5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:16.527442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3af4c678-01ea-4818-ad0a-c788981be1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:16.593721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:16.643592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75ecda-ec11-49e7-9ff1-31d3aa01549e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:16.654204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:16.655033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:16.657366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:16.659718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] PATH_INFO: `/v3/projects/0be795a7587c4c2c8e5d71a01f5ba732` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:16.674572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be795a7587c4c2c8e5d71a01f5ba732)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:16.678146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:16.719453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4c678-01ea-4818-ad0a-c788981be1c5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:16.741101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7410e-d50c-49ce-b947-0f4ac4af0571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:16.741899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7410e-d50c-49ce-b947-0f4ac4af0571 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:16.742237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7410e-d50c-49ce-b947-0f4ac4af0571 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:16.742513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7410e-d50c-49ce-b947-0f4ac4af0571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:16.778798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7410e-d50c-49ce-b947-0f4ac4af0571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:16.780581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7410e-d50c-49ce-b947-0f4ac4af0571 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:16.804338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be795a7587c4c2c8e5d71a01f5ba732', 'request_id': 'req-3bf2b35a-701e-4698-b366-9cca84e46542'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:16.811692 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2132/4280] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:16.815740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be795a7587c4c2c8e5d71a01f5ba732', 'request_id': 'req-3bf2b35a-701e-4698-b366-9cca84e46542'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:16.839557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be795a7587c4c2c8e5d71a01f5ba732', 'request_id': 'req-3bf2b35a-701e-4698-b366-9cca84e46542'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:16.867161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] The token cache is being invalidate because project 0be795a7587c4c2c8e5d71a01f5ba732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:16.867799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:16.868436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bf2b35a-701e-4698-b366-9cca84e46542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:16.876078 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2149/4281] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:16 2022] DELETE /identity/v3/projects/0be795a7587c4c2c8e5d71a01f5ba732 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:16.877020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034e95-83eb-431e-897f-b68adf39e6b3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:16.877374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034e95-83eb-431e-897f-b68adf39e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:16.877706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034e95-83eb-431e-897f-b68adf39e6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:16.905903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-00034e95-83eb-431e-897f-b68adf39e6b3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:16.907987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-00034e95-83eb-431e-897f-b68adf39e6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:17.045470 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2133/4282] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:17.053871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7aec7-208c-43a0-8c8d-a760698ad0fe None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:17.054229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7aec7-208c-43a0-8c8d-a760698ad0fe None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:17.054559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7aec7-208c-43a0-8c8d-a760698ad0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:17.092658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f4f7aec7-208c-43a0-8c8d-a760698ad0fe None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:17.094265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f4f7aec7-208c-43a0-8c8d-a760698ad0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:17.106495 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2150/4283] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:17.110889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00034e95-83eb-431e-897f-b68adf39e6b3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:17.124989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00034e95-83eb-431e-897f-b68adf39e6b3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:17.133655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ec53-13da-43fd-b172-bab1ae39aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:17.139474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ec53-13da-43fd-b172-bab1ae39aacb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:17.139907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ec53-13da-43fd-b172-bab1ae39aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:17.140338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ec53-13da-43fd-b172-bab1ae39aacb admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:17.141409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64ec53-13da-43fd-b172-bab1ae39aacb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:17.142005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64ec53-13da-43fd-b172-bab1ae39aacb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:17.144981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64ec53-13da-43fd-b172-bab1ae39aacb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:17.163322 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2134/4284] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:17.169867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7aec7-208c-43a0-8c8d-a760698ad0fe None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:17.187006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7aec7-208c-43a0-8c8d-a760698ad0fe None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:17.194737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129d7fc-1dc3-4f16-88d5-2def81fe21e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:17.195645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129d7fc-1dc3-4f16-88d5-2def81fe21e4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:17.196053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129d7fc-1dc3-4f16-88d5-2def81fe21e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:17.196460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129d7fc-1dc3-4f16-88d5-2def81fe21e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:17.198125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129d7fc-1dc3-4f16-88d5-2def81fe21e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:17.202001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129d7fc-1dc3-4f16-88d5-2def81fe21e4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:17.266276 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2151/4285] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:17 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:17.273831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ec53-13da-43fd-b172-bab1ae39aacb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:17.294826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ec53-13da-43fd-b172-bab1ae39aacb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:17.356585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:17.408174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902c4f-4844-41dd-817c-f59131a5c851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:17.409031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902c4f-4844-41dd-817c-f59131a5c851 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:17.409430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902c4f-4844-41dd-817c-f59131a5c851 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:17.409810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902c4f-4844-41dd-817c-f59131a5c851 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:17.410709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e902c4f-4844-41dd-817c-f59131a5c851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:17.413157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e902c4f-4844-41dd-817c-f59131a5c851 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:17.453370 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2135/4286] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:17 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:17.455996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129d7fc-1dc3-4f16-88d5-2def81fe21e4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:17.471932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129d7fc-1dc3-4f16-88d5-2def81fe21e4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:17.479290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7173175-108a-4aba-ae96-9340c5523064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:17.480176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7173175-108a-4aba-ae96-9340c5523064 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:17.480704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7173175-108a-4aba-ae96-9340c5523064 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:17.481196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7173175-108a-4aba-ae96-9340c5523064 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:17.482573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7173175-108a-4aba-ae96-9340c5523064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:17.487564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7173175-108a-4aba-ae96-9340c5523064 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:17.536891 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2152/4287] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:45:17.540062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902c4f-4844-41dd-817c-f59131a5c851 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:17.559012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902c4f-4844-41dd-817c-f59131a5c851 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:17.565275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e6f8c-0d98-4dfe-b531-f09884e15363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:17.565887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e6f8c-0d98-4dfe-b531-f09884e15363 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:17.566187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e6f8c-0d98-4dfe-b531-f09884e15363 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:17.566481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e6f8c-0d98-4dfe-b531-f09884e15363 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:17.567295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e6f8c-0d98-4dfe-b531-f09884e15363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:17.569034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e6f8c-0d98-4dfe-b531-f09884e15363 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:17.589519 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2136/4288] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:17.591973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7173175-108a-4aba-ae96-9340c5523064 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:17.611467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7173175-108a-4aba-ae96-9340c5523064 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:17.619802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da46eed-0a36-4774-a19b-f2c421b313ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:17.621202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46eed-0a36-4774-a19b-f2c421b313ca admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:17.630014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46eed-0a36-4774-a19b-f2c421b313ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:17.630333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46eed-0a36-4774-a19b-f2c421b313ca admin admin] PATH_INFO: `/v3/projects/0902daf78513439fb217487d6dd32fef/users/a8f8403ff3b340869761ae1cfa57ea43/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:17.653051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da46eed-0a36-4774-a19b-f2c421b313ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0902daf78513439fb217487d6dd32fef, user_id=a8f8403ff3b340869761ae1cfa57ea43, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:17.656417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da46eed-0a36-4774-a19b-f2c421b313ca admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:17.678998 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2153/4289] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:17 2022] PUT /identity/v3/projects/0902daf78513439fb217487d6dd32fef/users/a8f8403ff3b340869761ae1cfa57ea43/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:17.686020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bba4c-efd0-4589-ba64-cb961bf1c64a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:17.686564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bba4c-efd0-4589-ba64-cb961bf1c64a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:17.686813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bba4c-efd0-4589-ba64-cb961bf1c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:17.713195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ea3bba4c-efd0-4589-ba64-cb961bf1c64a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:17.715062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ea3bba4c-efd0-4589-ba64-cb961bf1c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:17.825636 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2137/4290] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:17.832402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da46eed-0a36-4774-a19b-f2c421b313ca admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:17.834554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6da46eed-0a36-4774-a19b-f2c421b313ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:17.865431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bba4c-efd0-4589-ba64-cb961bf1c64a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:17.867719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ea3bba4c-efd0-4589-ba64-cb961bf1c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:17.891674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bba4c-efd0-4589-ba64-cb961bf1c64a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:17.904526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872948-c062-44a4-a546-07083548da3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:17.905686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872948-c062-44a4-a546-07083548da3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:17.906199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872948-c062-44a4-a546-07083548da3a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:17.907393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872948-c062-44a4-a546-07083548da3a admin admin] PATH_INFO: `/v3/users/2b12d5ec1e554d2593d349583fa19691` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:17.910740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21872948-c062-44a4-a546-07083548da3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b12d5ec1e554d2593d349583fa19691)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:17.915306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21872948-c062-44a4-a546-07083548da3a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:17.948132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da46eed-0a36-4774-a19b-f2c421b313ca admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:17.957648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987a245-a2f2-4ee0-9cdc-e44579f0e79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:17.958739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a245-a2f2-4ee0-9cdc-e44579f0e79e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:17.959184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a245-a2f2-4ee0-9cdc-e44579f0e79e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:17.959740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a245-a2f2-4ee0-9cdc-e44579f0e79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:17.977541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987a245-a2f2-4ee0-9cdc-e44579f0e79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:17.980225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987a245-a2f2-4ee0-9cdc-e44579f0e79e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:18.024363 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2154/4291] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:18.027799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987a245-a2f2-4ee0-9cdc-e44579f0e79e service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:18.038442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c987a245-a2f2-4ee0-9cdc-e44579f0e79e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:18.074154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-21872948-c062-44a4-a546-07083548da3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b12d5ec1e554d2593d349583fa19691'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.074828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-21872948-c062-44a4-a546-07083548da3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b12d5ec1e554d2593d349583fa19691'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.082822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987a245-a2f2-4ee0-9cdc-e44579f0e79e service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:18.095668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:18.098151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:18.098467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:18.098803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] PATH_INFO: `/v3/projects/9482e62a8ca44bee87723046ac4eceb6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:18.101475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9482e62a8ca44bee87723046ac4eceb6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:18.104653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-21872948-c062-44a4-a546-07083548da3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b12d5ec1e554d2593d349583fa19691'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.108442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:18.118047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-21872948-c062-44a4-a546-07083548da3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b12d5ec1e554d2593d349583fa19691'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.134572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-21872948-c062-44a4-a546-07083548da3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b12d5ec1e554d2593d349583fa19691'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.144473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:18.145326 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2138/4292] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:17 2022] DELETE /identity/v3/users/2b12d5ec1e554d2593d349583fa19691 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:18.211177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9482e62a8ca44bee87723046ac4eceb6', 'request_id': 'req-8a8e77b3-640d-4019-bb89-ace796a5a545'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.221986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9482e62a8ca44bee87723046ac4eceb6', 'request_id': 'req-8a8e77b3-640d-4019-bb89-ace796a5a545'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.234060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9482e62a8ca44bee87723046ac4eceb6', 'request_id': 'req-8a8e77b3-640d-4019-bb89-ace796a5a545'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.266278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] The token cache is being invalidate because project 9482e62a8ca44bee87723046ac4eceb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:18.266700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.267829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a8e77b3-640d-4019-bb89-ace796a5a545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.274187 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2155/4293] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:18 2022] DELETE /identity/v3/projects/9482e62a8ca44bee87723046ac4eceb6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:18.276719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29468-02ac-4594-b0f7-7b5e087e5f01 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:18.277479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29468-02ac-4594-b0f7-7b5e087e5f01 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:18.277479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29468-02ac-4594-b0f7-7b5e087e5f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:18.323407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fea29468-02ac-4594-b0f7-7b5e087e5f01 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:18.325430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fea29468-02ac-4594-b0f7-7b5e087e5f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:18.378463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:18.449649 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2139/4294] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:18.457450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a6e67-fb80-4be3-ac46-5ffb3c44020a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:18.457748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a6e67-fb80-4be3-ac46-5ffb3c44020a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:18.458031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a6e67-fb80-4be3-ac46-5ffb3c44020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:18.489063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dd6a6e67-fb80-4be3-ac46-5ffb3c44020a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:18.490429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dd6a6e67-fb80-4be3-ac46-5ffb3c44020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:18.503589 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2156/4295] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:18.507240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea29468-02ac-4594-b0f7-7b5e087e5f01 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:18.523633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea29468-02ac-4594-b0f7-7b5e087e5f01 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:18.530724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab22026-d501-467c-998a-47bdbdb116af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:18.531441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab22026-d501-467c-998a-47bdbdb116af admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:18.531657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab22026-d501-467c-998a-47bdbdb116af admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:18.531935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab22026-d501-467c-998a-47bdbdb116af admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:18.532603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab22026-d501-467c-998a-47bdbdb116af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:18.532908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab22026-d501-467c-998a-47bdbdb116af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:18.534759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab22026-d501-467c-998a-47bdbdb116af admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:18.552958 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2140/4296] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:18.558527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a6e67-fb80-4be3-ac46-5ffb3c44020a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:18.571704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a6e67-fb80-4be3-ac46-5ffb3c44020a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:18.578581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458097f-2066-42ff-9ec2-a6a413fc15d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:18.579213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458097f-2066-42ff-9ec2-a6a413fc15d0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:18.579547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458097f-2066-42ff-9ec2-a6a413fc15d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:18.579828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458097f-2066-42ff-9ec2-a6a413fc15d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:18.580580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458097f-2066-42ff-9ec2-a6a413fc15d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:18.583068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458097f-2066-42ff-9ec2-a6a413fc15d0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:18.610690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab22026-d501-467c-998a-47bdbdb116af admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:18.613248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5ab22026-d501-467c-998a-47bdbdb116af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:18.634059 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2157/4297] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:18 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:18.635101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458097f-2066-42ff-9ec2-a6a413fc15d0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:18.641819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab22026-d501-467c-998a-47bdbdb116af admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:18.742448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458097f-2066-42ff-9ec2-a6a413fc15d0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:18.745664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:18.746423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:18.746706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:18.746980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] PATH_INFO: `/v3/projects/d74479e5a17b45fa978b66de4518af3b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:18.748266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74479e5a17b45fa978b66de4518af3b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:18.749828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5b6a-986a-4c68-b318-26eea2ed438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:18.750383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:18.751742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5b6a-986a-4c68-b318-26eea2ed438a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:18.752791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5b6a-986a-4c68-b318-26eea2ed438a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:18.754237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5b6a-986a-4c68-b318-26eea2ed438a admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:18.755833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5b6a-986a-4c68-b318-26eea2ed438a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:18.758288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5b6a-986a-4c68-b318-26eea2ed438a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:18.789292 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2158/4298] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:18 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:18.794805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5b6a-986a-4c68-b318-26eea2ed438a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:18.816227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5b6a-986a-4c68-b318-26eea2ed438a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:18.824190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adcc41-02f9-4d28-affa-5124e7166d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:18.825814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adcc41-02f9-4d28-affa-5124e7166d65 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:18.826575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adcc41-02f9-4d28-affa-5124e7166d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:18.827145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adcc41-02f9-4d28-affa-5124e7166d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:18.829090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adcc41-02f9-4d28-affa-5124e7166d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:18.832345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adcc41-02f9-4d28-affa-5124e7166d65 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:18.844123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74479e5a17b45fa978b66de4518af3b', 'request_id': 'req-919ade8b-3cc8-4c0f-858a-99076c292cbd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.849202 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2159/4299] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:45:18.853904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adcc41-02f9-4d28-affa-5124e7166d65 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:18.854568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74479e5a17b45fa978b66de4518af3b', 'request_id': 'req-919ade8b-3cc8-4c0f-858a-99076c292cbd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.866661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74479e5a17b45fa978b66de4518af3b', 'request_id': 'req-919ade8b-3cc8-4c0f-858a-99076c292cbd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.868374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adcc41-02f9-4d28-affa-5124e7166d65 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:18.894912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] The token cache is being invalidate because project d74479e5a17b45fa978b66de4518af3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:18.895388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.896073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-919ade8b-3cc8-4c0f-858a-99076c292cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:18.898195 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2141/4300] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:18 2022] DELETE /identity/v3/projects/d74479e5a17b45fa978b66de4518af3b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:18.904267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40219d5-5131-461d-b4cd-fdaa236db8a6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:18.904810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40219d5-5131-461d-b4cd-fdaa236db8a6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:18.905180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40219d5-5131-461d-b4cd-fdaa236db8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:18.937097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e40219d5-5131-461d-b4cd-fdaa236db8a6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:18.941300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e40219d5-5131-461d-b4cd-fdaa236db8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:18.947532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:18.963468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58c58f-a0ed-4ca8-b21d-27bf3f0f0541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:18.965338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c58f-a0ed-4ca8-b21d-27bf3f0f0541 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:18.967186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c58f-a0ed-4ca8-b21d-27bf3f0f0541 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:18.967865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c58f-a0ed-4ca8-b21d-27bf3f0f0541 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:18.971060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58c58f-a0ed-4ca8-b21d-27bf3f0f0541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:18.972739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58c58f-a0ed-4ca8-b21d-27bf3f0f0541 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:18.998169 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2160/4301] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:45:19.002474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58c58f-a0ed-4ca8-b21d-27bf3f0f0541 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:19.005099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7f58c58f-a0ed-4ca8-b21d-27bf3f0f0541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:19.024239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58c58f-a0ed-4ca8-b21d-27bf3f0f0541 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:19.028334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:19.031952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eb87d-ee68-46d0-b5e2-80e72603c5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:19.032961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb87d-ee68-46d0-b5e2-80e72603c5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:19.033494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb87d-ee68-46d0-b5e2-80e72603c5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:19.034021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb87d-ee68-46d0-b5e2-80e72603c5fb admin admin] PATH_INFO: `/v3/projects/1b2eb9df11664c9b8c6e2b943883ed76/users/86c365a9cc5b4b558dd02516d266b241/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:19.057513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eb87d-ee68-46d0-b5e2-80e72603c5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2eb9df11664c9b8c6e2b943883ed76, user_id=86c365a9cc5b4b558dd02516d266b241, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:19.061050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eb87d-ee68-46d0-b5e2-80e72603c5fb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:19.066417 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2142/4302] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:19.075176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1382a6e-bae8-4e8b-8ef2-3ed20abd11eb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:19.075892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1382a6e-bae8-4e8b-8ef2-3ed20abd11eb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:19.076374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1382a6e-bae8-4e8b-8ef2-3ed20abd11eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:19.094751 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2161/4303] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:19 2022] PUT /identity/v3/projects/1b2eb9df11664c9b8c6e2b943883ed76/users/86c365a9cc5b4b558dd02516d266b241/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:19.106380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d46abe-75f1-42f1-a134-bf77c7c67ac2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:19.106660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d46abe-75f1-42f1-a134-bf77c7c67ac2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:19.106944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d46abe-75f1-42f1-a134-bf77c7c67ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:19.107511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c1382a6e-bae8-4e8b-8ef2-3ed20abd11eb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:19.109410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c1382a6e-bae8-4e8b-8ef2-3ed20abd11eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:19.143468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-58d46abe-75f1-42f1-a134-bf77c7c67ac2 None None] MFA Rules not processed for user `86c365a9cc5b4b558dd02516d266b241`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:19.145306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-58d46abe-75f1-42f1-a134-bf77c7c67ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:19.190057 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2143/4304] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:19.194866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1382a6e-bae8-4e8b-8ef2-3ed20abd11eb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:19.206911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1382a6e-bae8-4e8b-8ef2-3ed20abd11eb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:19.215450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8acdb9-1c02-4150-91ad-742df412004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:19.216074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8acdb9-1c02-4150-91ad-742df412004f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:19.216356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8acdb9-1c02-4150-91ad-742df412004f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:19.217085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8acdb9-1c02-4150-91ad-742df412004f admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:19.218168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8acdb9-1c02-4150-91ad-742df412004f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:19.218338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8acdb9-1c02-4150-91ad-742df412004f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:19.219907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8acdb9-1c02-4150-91ad-742df412004f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:19.236953 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2144/4305] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:19.241208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8acdb9-1c02-4150-91ad-742df412004f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:19.257114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8acdb9-1c02-4150-91ad-742df412004f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:19.257342 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2162/4306] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:19.272891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce0cc0-888f-4c03-9783-cd775ff54f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:19.273243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce0cc0-888f-4c03-9783-cd775ff54f60 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:19.273630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce0cc0-888f-4c03-9783-cd775ff54f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:19.274330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce0cc0-888f-4c03-9783-cd775ff54f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:19.275392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce0cc0-888f-4c03-9783-cd775ff54f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:19.277771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce0cc0-888f-4c03-9783-cd775ff54f60 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:19.280072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d46abe-75f1-42f1-a134-bf77c7c67ac2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:19.283107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-58d46abe-75f1-42f1-a134-bf77c7c67ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:19.317462 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2145/4307] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:19 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:19.321499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce0cc0-888f-4c03-9783-cd775ff54f60 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:19.418768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d46abe-75f1-42f1-a134-bf77c7c67ac2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:19.430964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce0cc0-888f-4c03-9783-cd775ff54f60 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:19.438566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11001f5-7a69-4335-8b8f-82daeec38b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:19.439155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11001f5-7a69-4335-8b8f-82daeec38b1c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:19.439443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11001f5-7a69-4335-8b8f-82daeec38b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:19.439751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11001f5-7a69-4335-8b8f-82daeec38b1c admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:19.440402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11001f5-7a69-4335-8b8f-82daeec38b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:19.443041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11001f5-7a69-4335-8b8f-82daeec38b1c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:19.477498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2146/4308] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:19 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:45:19.478642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11001f5-7a69-4335-8b8f-82daeec38b1c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:19.481121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:19.496885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11001f5-7a69-4335-8b8f-82daeec38b1c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:19.506186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae8748-d1d0-4934-9b2f-0919455b9afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:19.506829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae8748-d1d0-4934-9b2f-0919455b9afb service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:19.507117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae8748-d1d0-4934-9b2f-0919455b9afb service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:19.507390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae8748-d1d0-4934-9b2f-0919455b9afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:19.508274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f3d49-6c2e-4437-a35d-f35393c4f1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:19.508970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f3d49-6c2e-4437-a35d-f35393c4f1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:19.509289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f3d49-6c2e-4437-a35d-f35393c4f1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:19.510253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f3d49-6c2e-4437-a35d-f35393c4f1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:19.511053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f3d49-6c2e-4437-a35d-f35393c4f1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:19.512957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f3d49-6c2e-4437-a35d-f35393c4f1d4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:19.528292 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2147/4309] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:19.532630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f3d49-6c2e-4437-a35d-f35393c4f1d4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:19.555953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f3d49-6c2e-4437-a35d-f35393c4f1d4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:19.562923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879ad8b-190b-4b64-bd7e-c3c46a809575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:19.563940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879ad8b-190b-4b64-bd7e-c3c46a809575 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:19.565440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879ad8b-190b-4b64-bd7e-c3c46a809575 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:19.566440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879ad8b-190b-4b64-bd7e-c3c46a809575 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:19.567473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879ad8b-190b-4b64-bd7e-c3c46a809575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:19.569571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879ad8b-190b-4b64-bd7e-c3c46a809575 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:19.603785 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2148/4310] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:19.605428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879ad8b-190b-4b64-bd7e-c3c46a809575 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:19.617231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879ad8b-190b-4b64-bd7e-c3c46a809575 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:19.625641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2b558-f44d-4c11-a73f-6753dab7bdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:19.626404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b558-f44d-4c11-a73f-6753dab7bdf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:19.626730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b558-f44d-4c11-a73f-6753dab7bdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:19.627128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b558-f44d-4c11-a73f-6753dab7bdf1 admin admin] PATH_INFO: `/v3/projects/e2259cb2720f4b60a478853e8ab3f968/users/422e6b467bac4c08a38b62c9e6c76d16/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:19.656319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae8748-d1d0-4934-9b2f-0919455b9afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:19.662727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae8748-d1d0-4934-9b2f-0919455b9afb service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:19.663996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2b558-f44d-4c11-a73f-6753dab7bdf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2259cb2720f4b60a478853e8ab3f968, user_id=422e6b467bac4c08a38b62c9e6c76d16, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:19.674797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2b558-f44d-4c11-a73f-6753dab7bdf1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:19.679210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:19.698296 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2163/4311] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:19.704303 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2149/4312] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:19 2022] PUT /identity/v3/projects/e2259cb2720f4b60a478853e8ab3f968/users/422e6b467bac4c08a38b62c9e6c76d16/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:19.710272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3ff65-1c42-4001-80e1-bc8d84c42f15 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:19.710663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3ff65-1c42-4001-80e1-bc8d84c42f15 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:19.711035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3ff65-1c42-4001-80e1-bc8d84c42f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:19.764329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7da3ff65-1c42-4001-80e1-bc8d84c42f15 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:19.767450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7da3ff65-1c42-4001-80e1-bc8d84c42f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:19.889455 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2164/4313] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:19.899403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2b558-f44d-4c11-a73f-6753dab7bdf1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:19.901564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6ee2b558-f44d-4c11-a73f-6753dab7bdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:20.034202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2b558-f44d-4c11-a73f-6753dab7bdf1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:20.041323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272a694-254e-4d9f-b557-aeb029b716ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:20.042824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272a694-254e-4d9f-b557-aeb029b716ab service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:20.043607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272a694-254e-4d9f-b557-aeb029b716ab service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:20.044300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272a694-254e-4d9f-b557-aeb029b716ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:20.059231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272a694-254e-4d9f-b557-aeb029b716ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:20.060826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272a694-254e-4d9f-b557-aeb029b716ab service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:20.074525 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2150/4314] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:26.678528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c84a69-308e-403c-af4b-b003c13a1730 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:26.679249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c84a69-308e-403c-af4b-b003c13a1730 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:26.679249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c84a69-308e-403c-af4b-b003c13a1730 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:26.683172 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2165/4315] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:45:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:45:26.690246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035426f-6aae-4efa-baf8-38e1dec10ef1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:26.691680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035426f-6aae-4efa-baf8-38e1dec10ef1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:26.692207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035426f-6aae-4efa-baf8-38e1dec10ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:26.721951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b035426f-6aae-4efa-baf8-38e1dec10ef1 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:26.724554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b035426f-6aae-4efa-baf8-38e1dec10ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:26.735959 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2151/4316] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:45:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:26.754675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c84a69-308e-403c-af4b-b003c13a1730 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:26.756788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f8c84a69-308e-403c-af4b-b003c13a1730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:26.778161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c84a69-308e-403c-af4b-b003c13a1730 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:26.793913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ab13d-f0f9-4214-bb1e-fc2750004218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:26.794948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ab13d-f0f9-4214-bb1e-fc2750004218 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:26.796845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ab13d-f0f9-4214-bb1e-fc2750004218 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:26.797311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ab13d-f0f9-4214-bb1e-fc2750004218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:26.823646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ab13d-f0f9-4214-bb1e-fc2750004218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:26.825940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ab13d-f0f9-4214-bb1e-fc2750004218 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:26.836360 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2166/4317] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:29.148478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a64af-0999-406e-956b-6d9bbcb0f392 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:29.149572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a64af-0999-406e-956b-6d9bbcb0f392 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:29.150750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a64af-0999-406e-956b-6d9bbcb0f392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:29.228834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-574a64af-0999-406e-956b-6d9bbcb0f392 None None] MFA Rules not processed for user `a8f8403ff3b340869761ae1cfa57ea43`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:29.230546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-574a64af-0999-406e-956b-6d9bbcb0f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:29.361641 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2152/4318] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:29.379612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ab13d-f0f9-4214-bb1e-fc2750004218 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:29.384206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-524ab13d-f0f9-4214-bb1e-fc2750004218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:29.581218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ab13d-f0f9-4214-bb1e-fc2750004218 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:29.592112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c594239-4b9b-439b-8e8d-3eb83e293846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:29.592860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594239-4b9b-439b-8e8d-3eb83e293846 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:29.594326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594239-4b9b-439b-8e8d-3eb83e293846 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:29.594326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594239-4b9b-439b-8e8d-3eb83e293846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:29.613780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c594239-4b9b-439b-8e8d-3eb83e293846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:29.616327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c594239-4b9b-439b-8e8d-3eb83e293846 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:29.642701 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2167/4319] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:33.898871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf238d-5436-4c48-87bd-27ff348d4e01 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:33.899439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf238d-5436-4c48-87bd-27ff348d4e01 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:33.899689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf238d-5436-4c48-87bd-27ff348d4e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:33.967674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-27cf238d-5436-4c48-87bd-27ff348d4e01 None None] MFA Rules not processed for user `422e6b467bac4c08a38b62c9e6c76d16`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:33.972446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-27cf238d-5436-4c48-87bd-27ff348d4e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:34.202553 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2153/4320] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:34.204108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a9ee8-5fc0-4c50-bdb6-ef010dee5d82 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:34.205344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a9ee8-5fc0-4c50-bdb6-ef010dee5d82 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:34.206058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a9ee8-5fc0-4c50-bdb6-ef010dee5d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:34.232904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:34.284458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-982a9ee8-5fc0-4c50-bdb6-ef010dee5d82 None None] MFA Rules not processed for user `422e6b467bac4c08a38b62c9e6c76d16`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:34.286919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-982a9ee8-5fc0-4c50-bdb6-ef010dee5d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:34.328126 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2168/4321] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:34.340233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf238d-5436-4c48-87bd-27ff348d4e01 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:34.375270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf238d-5436-4c48-87bd-27ff348d4e01 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:34.387551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0606f-97f3-49af-81bf-ec1597178df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:34.388195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0606f-97f3-49af-81bf-ec1597178df8 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:34.388476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0606f-97f3-49af-81bf-ec1597178df8 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:34.388754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0606f-97f3-49af-81bf-ec1597178df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:34.398894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:34.407560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0606f-97f3-49af-81bf-ec1597178df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:34.410125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0606f-97f3-49af-81bf-ec1597178df8 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:34.432320 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2154/4322] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:36.191615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a9ee8-5fc0-4c50-bdb6-ef010dee5d82 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:36.220674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a9ee8-5fc0-4c50-bdb6-ef010dee5d82 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:36.240658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:36.241629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:36.242116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:36.242599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] PATH_INFO: `/v3/users/86c365a9cc5b4b558dd02516d266b241` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:36.246962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c365a9cc5b4b558dd02516d266b241)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:36.255554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:36.367950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c365a9cc5b4b558dd02516d266b241'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:36.368739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c365a9cc5b4b558dd02516d266b241'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:36.391108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c365a9cc5b4b558dd02516d266b241'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:36.392221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c365a9cc5b4b558dd02516d266b241'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:36.403275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c365a9cc5b4b558dd02516d266b241'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:36.435629 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2169/4323] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:36 2022] DELETE /identity/v3/users/86c365a9cc5b4b558dd02516d266b241 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:36.437625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9f46-5252-48a9-90ba-7b40d5ea1e7a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:36.438157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9f46-5252-48a9-90ba-7b40d5ea1e7a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:36.438157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9f46-5252-48a9-90ba-7b40d5ea1e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:36.494357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-536e9f46-5252-48a9-90ba-7b40d5ea1e7a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:36.496447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-536e9f46-5252-48a9-90ba-7b40d5ea1e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:36.606583 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2155/4324] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:36.784987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:36.789159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:36.953279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77728d83-c4be-4341-9962-aed211bab77f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:36.983283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6fc7-93fe-418d-bd6c-2a035795559b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:36.984157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6fc7-93fe-418d-bd6c-2a035795559b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:36.984644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6fc7-93fe-418d-bd6c-2a035795559b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:36.985022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6fc7-93fe-418d-bd6c-2a035795559b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:37.024647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac6fc7-93fe-418d-bd6c-2a035795559b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:37.026502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac6fc7-93fe-418d-bd6c-2a035795559b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:37.053834 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2170/4325] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:37.227519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e9f46-5252-48a9-90ba-7b40d5ea1e7a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:37.230314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-536e9f46-5252-48a9-90ba-7b40d5ea1e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:37.270333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e9f46-5252-48a9-90ba-7b40d5ea1e7a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:37.277669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f4ec7-7293-41f2-a592-63bf725d3968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:37.278869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f4ec7-7293-41f2-a592-63bf725d3968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:37.279155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f4ec7-7293-41f2-a592-63bf725d3968 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:37.279483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f4ec7-7293-41f2-a592-63bf725d3968 admin admin] PATH_INFO: `/v3/users/a8f8403ff3b340869761ae1cfa57ea43` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:37.281750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f4ec7-7293-41f2-a592-63bf725d3968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8f8403ff3b340869761ae1cfa57ea43)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:37.284136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f4ec7-7293-41f2-a592-63bf725d3968 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:37.364874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0b7f4ec7-7293-41f2-a592-63bf725d3968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8f8403ff3b340869761ae1cfa57ea43'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:37.365633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0b7f4ec7-7293-41f2-a592-63bf725d3968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8f8403ff3b340869761ae1cfa57ea43'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:37.387849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0b7f4ec7-7293-41f2-a592-63bf725d3968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8f8403ff3b340869761ae1cfa57ea43'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:37.398765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0b7f4ec7-7293-41f2-a592-63bf725d3968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8f8403ff3b340869761ae1cfa57ea43'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:37.416741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0b7f4ec7-7293-41f2-a592-63bf725d3968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8f8403ff3b340869761ae1cfa57ea43'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:37.430319 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2156/4326] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:37 2022] DELETE /identity/v3/users/a8f8403ff3b340869761ae1cfa57ea43 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:37.769089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6fc7-93fe-418d-bd6c-2a035795559b service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:37.792637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6fc7-93fe-418d-bd6c-2a035795559b service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:37.996786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:37.998315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:37.999187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:37.999477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] PATH_INFO: `/v3/projects/0902daf78513439fb217487d6dd32fef` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.000938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0902daf78513439fb217487d6dd32fef)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:38.006605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:38.034611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:38.092199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0902daf78513439fb217487d6dd32fef', 'request_id': 'req-72eb07eb-6686-4623-b2b4-3d4c1246a521'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:38.110738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0902daf78513439fb217487d6dd32fef', 'request_id': 'req-72eb07eb-6686-4623-b2b4-3d4c1246a521'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:38.127433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0902daf78513439fb217487d6dd32fef', 'request_id': 'req-72eb07eb-6686-4623-b2b4-3d4c1246a521'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:38.153740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] The token cache is being invalidate because project 0902daf78513439fb217487d6dd32fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:38.153740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:38.153740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:38.161262 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2171/4327] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:37 2022] DELETE /identity/v3/projects/0902daf78513439fb217487d6dd32fef => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:38.166517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d306-9a13-4b1a-8787-aa477ff7d369 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.167013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d306-9a13-4b1a-8787-aa477ff7d369 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.167360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d306-9a13-4b1a-8787-aa477ff7d369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.196026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d8c1d306-9a13-4b1a-8787-aa477ff7d369 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:38.198663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d8c1d306-9a13-4b1a-8787-aa477ff7d369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:38.261601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:38.263617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:38.310982 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2157/4328] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:38.319429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dbef0-02d9-4c7c-99a2-14afe1b363f6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.319710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dbef0-02d9-4c7c-99a2-14afe1b363f6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.319989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dbef0-02d9-4c7c-99a2-14afe1b363f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.367637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e11dbef0-02d9-4c7c-99a2-14afe1b363f6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:38.377513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e11dbef0-02d9-4c7c-99a2-14afe1b363f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:38.396565 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2158/4329] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:38.400845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dbef0-02d9-4c7c-99a2-14afe1b363f6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:38.412901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dbef0-02d9-4c7c-99a2-14afe1b363f6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:38.414441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:38.445643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405a08d-413b-44d9-971c-8f014f357ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:38.448045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405a08d-413b-44d9-971c-8f014f357ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.448573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405a08d-413b-44d9-971c-8f014f357ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.448912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405a08d-413b-44d9-971c-8f014f357ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.449680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405a08d-413b-44d9-971c-8f014f357ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:38.452662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405a08d-413b-44d9-971c-8f014f357ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:38.456388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405a08d-413b-44d9-971c-8f014f357ae5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:38.479106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb07eb-6686-4623-b2b4-3d4c1246a521 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:38.490147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:38.491036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.491187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.491350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] PATH_INFO: `/v3/projects/1b2eb9df11664c9b8c6e2b943883ed76` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.494243 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2159/4330] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:45:38.501371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405a08d-413b-44d9-971c-8f014f357ae5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:38.502095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2eb9df11664c9b8c6e2b943883ed76)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:38.504056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:38.537449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405a08d-413b-44d9-971c-8f014f357ae5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:38.558068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f1666-93a9-4d74-87d3-685e5bc2311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:38.558999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f1666-93a9-4d74-87d3-685e5bc2311a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.559365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f1666-93a9-4d74-87d3-685e5bc2311a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.559758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f1666-93a9-4d74-87d3-685e5bc2311a admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.560504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f1666-93a9-4d74-87d3-685e5bc2311a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:38.563958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f1666-93a9-4d74-87d3-685e5bc2311a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:38.626890 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2160/4331] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:38 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:38.630774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f1666-93a9-4d74-87d3-685e5bc2311a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:38.666272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2eb9df11664c9b8c6e2b943883ed76', 'request_id': 'req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:38.680166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2eb9df11664c9b8c6e2b943883ed76', 'request_id': 'req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:38.698133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2eb9df11664c9b8c6e2b943883ed76', 'request_id': 'req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:38.721511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] The token cache is being invalidate because project 1b2eb9df11664c9b8c6e2b943883ed76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:38.723088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:38.726104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2cab6347-cd98-49f0-9cb7-5dae548fdf7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:38.732770 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2172/4332] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:38 2022] DELETE /identity/v3/projects/1b2eb9df11664c9b8c6e2b943883ed76 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:38.736125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6aa0-31a0-4ce7-ba57-f89c52e8ad74 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.736422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6aa0-31a0-4ce7-ba57-f89c52e8ad74 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.736707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6aa0-31a0-4ce7-ba57-f89c52e8ad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.740323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f1666-93a9-4d74-87d3-685e5bc2311a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:38.747011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a29ef-f8b2-4a12-addc-f0fba33c2254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:38.747991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a29ef-f8b2-4a12-addc-f0fba33c2254 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.748599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a29ef-f8b2-4a12-addc-f0fba33c2254 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.749069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a29ef-f8b2-4a12-addc-f0fba33c2254 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.750060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a29ef-f8b2-4a12-addc-f0fba33c2254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:38.752651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a29ef-f8b2-4a12-addc-f0fba33c2254 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:38.781514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e4df6aa0-31a0-4ce7-ba57-f89c52e8ad74 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:38.782767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e4df6aa0-31a0-4ce7-ba57-f89c52e8ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:38.806755 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2173/4333] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:38.810796 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2161/4334] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:38 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:38.816794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df6aa0-31a0-4ce7-ba57-f89c52e8ad74 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:38.819621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e4df6aa0-31a0-4ce7-ba57-f89c52e8ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:38.823969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f5f6-834d-4384-8354-fa70ec691936 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.825678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f5f6-834d-4384-8354-fa70ec691936 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.827696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f5f6-834d-4384-8354-fa70ec691936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.853194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df6aa0-31a0-4ce7-ba57-f89c52e8ad74 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:38.869601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10374e6-f36a-4ba6-880b-d4b7abbcffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:38.870570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10374e6-f36a-4ba6-880b-d4b7abbcffb3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.870570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10374e6-f36a-4ba6-880b-d4b7abbcffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.870804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10374e6-f36a-4ba6-880b-d4b7abbcffb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.871559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10374e6-f36a-4ba6-880b-d4b7abbcffb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:38.873338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10374e6-f36a-4ba6-880b-d4b7abbcffb3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:38.879074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4095f5f6-834d-4384-8354-fa70ec691936 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:38.880247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4095f5f6-834d-4384-8354-fa70ec691936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:38.892879 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2174/4335] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:38.897947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10374e6-f36a-4ba6-880b-d4b7abbcffb3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:38.910991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10374e6-f36a-4ba6-880b-d4b7abbcffb3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:38.917360 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2162/4336] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:38.922185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c015e4b-8b8b-4f56-84e2-4cfb7a2f9cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:38.923160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c015e4b-8b8b-4f56-84e2-4cfb7a2f9cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.923374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c015e4b-8b8b-4f56-84e2-4cfb7a2f9cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.923682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c015e4b-8b8b-4f56-84e2-4cfb7a2f9cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.924585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c015e4b-8b8b-4f56-84e2-4cfb7a2f9cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:38.925121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095f5f6-834d-4384-8354-fa70ec691936 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:38.927745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c015e4b-8b8b-4f56-84e2-4cfb7a2f9cf2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:38.944601 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2175/4337] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:38.950526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c015e4b-8b8b-4f56-84e2-4cfb7a2f9cf2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:38.952002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095f5f6-834d-4384-8354-fa70ec691936 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:38.959624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0c54c-f70c-4517-9b67-fe30e84b7735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:38.960246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c54c-f70c-4517-9b67-fe30e84b7735 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.960531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c54c-f70c-4517-9b67-fe30e84b7735 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.960894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c54c-f70c-4517-9b67-fe30e84b7735 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:38.961883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0c54c-f70c-4517-9b67-fe30e84b7735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:38.962238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0c54c-f70c-4517-9b67-fe30e84b7735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:38.964098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0c54c-f70c-4517-9b67-fe30e84b7735 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:38.966217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:38.981713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c015e4b-8b8b-4f56-84e2-4cfb7a2f9cf2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:38.988688 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2163/4338] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:38.994071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0c54c-f70c-4517-9b67-fe30e84b7735 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:38.996924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49c4a6-8b2c-4f67-b2b7-9aa2668971e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:38.997640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c4a6-8b2c-4f67-b2b7-9aa2668971e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:38.998037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c4a6-8b2c-4f67-b2b7-9aa2668971e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:38.998240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c4a6-8b2c-4f67-b2b7-9aa2668971e6 admin admin] PATH_INFO: `/v3/projects/2b6f6de6c8ae45b4a0d469b6bb28f245/users/0556380b71674698b3260103ef247c85/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.012329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0c54c-f70c-4517-9b67-fe30e84b7735 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:39.021039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49c4a6-8b2c-4f67-b2b7-9aa2668971e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6f6de6c8ae45b4a0d469b6bb28f245, user_id=0556380b71674698b3260103ef247c85, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:39.022152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f95ca-6ecd-4351-af52-9b87b6fd0c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:39.023054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f95ca-6ecd-4351-af52-9b87b6fd0c34 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.023442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f95ca-6ecd-4351-af52-9b87b6fd0c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.024009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f95ca-6ecd-4351-af52-9b87b6fd0c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.024609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49c4a6-8b2c-4f67-b2b7-9aa2668971e6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:39.025271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f95ca-6ecd-4351-af52-9b87b6fd0c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:39.028389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f95ca-6ecd-4351-af52-9b87b6fd0c34 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:39.047606 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2176/4339] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:38 2022] PUT /identity/v3/projects/2b6f6de6c8ae45b4a0d469b6bb28f245/users/0556380b71674698b3260103ef247c85/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:39.053299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184f636-46d4-494e-8794-7c61ac03c3de None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.053669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184f636-46d4-494e-8794-7c61ac03c3de None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.053954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184f636-46d4-494e-8794-7c61ac03c3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.100230 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2164/4340] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:38 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:39.101057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f95ca-6ecd-4351-af52-9b87b6fd0c34 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:39.103954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f184f636-46d4-494e-8794-7c61ac03c3de None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:39.105625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f184f636-46d4-494e-8794-7c61ac03c3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:39.219170 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2177/4341] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:39.245856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f95ca-6ecd-4351-af52-9b87b6fd0c34 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:39.258929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412ccce-e331-4351-82d5-c7bcfbfab205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:39.260143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412ccce-e331-4351-82d5-c7bcfbfab205 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.260499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412ccce-e331-4351-82d5-c7bcfbfab205 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.260851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412ccce-e331-4351-82d5-c7bcfbfab205 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.261670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412ccce-e331-4351-82d5-c7bcfbfab205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:39.264923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412ccce-e331-4351-82d5-c7bcfbfab205 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:39.299236 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2165/4342] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:39 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:39.303832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184f636-46d4-494e-8794-7c61ac03c3de None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:39.316346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184f636-46d4-494e-8794-7c61ac03c3de None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:39.322795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412ccce-e331-4351-82d5-c7bcfbfab205 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:39.323335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765439d4-058a-4fcb-9738-96c8e021d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:39.323966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765439d4-058a-4fcb-9738-96c8e021d3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.324248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765439d4-058a-4fcb-9738-96c8e021d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.325191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765439d4-058a-4fcb-9738-96c8e021d3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.325191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765439d4-058a-4fcb-9738-96c8e021d3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:39.326720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4412ccce-e331-4351-82d5-c7bcfbfab205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:39.326850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765439d4-058a-4fcb-9738-96c8e021d3b1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:39.339945 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2178/4343] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:39.344153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765439d4-058a-4fcb-9738-96c8e021d3b1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:39.348010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:39.357472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765439d4-058a-4fcb-9738-96c8e021d3b1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:39.363600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3e08-070f-439a-b673-05bb57c17339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:39.364242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3e08-070f-439a-b673-05bb57c17339 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.364520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3e08-070f-439a-b673-05bb57c17339 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.364787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3e08-070f-439a-b673-05bb57c17339 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.365471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c3e08-070f-439a-b673-05bb57c17339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:39.368970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c3e08-070f-439a-b673-05bb57c17339 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:39.385190 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2179/4344] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:45:39.387359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3e08-070f-439a-b673-05bb57c17339 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:39.406548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3e08-070f-439a-b673-05bb57c17339 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:39.412376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe298f-f90f-4086-8095-f1ac485a7869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:39.413068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe298f-f90f-4086-8095-f1ac485a7869 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.413346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe298f-f90f-4086-8095-f1ac485a7869 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.413650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe298f-f90f-4086-8095-f1ac485a7869 admin admin] PATH_INFO: `/v3/projects/194472699bac40078d5a3448e7537b51/users/f403f7f66ea34a6ab46a35c07e5bdc15/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.437619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe298f-f90f-4086-8095-f1ac485a7869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194472699bac40078d5a3448e7537b51, user_id=f403f7f66ea34a6ab46a35c07e5bdc15, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:39.442866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe298f-f90f-4086-8095-f1ac485a7869 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:39.447464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412ccce-e331-4351-82d5-c7bcfbfab205 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:39.453520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfea38e-db67-42fd-a332-4f318cf0c068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:39.454173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfea38e-db67-42fd-a332-4f318cf0c068 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.454435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfea38e-db67-42fd-a332-4f318cf0c068 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.454712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfea38e-db67-42fd-a332-4f318cf0c068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.469470 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2180/4345] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:39 2022] PUT /identity/v3/projects/194472699bac40078d5a3448e7537b51/users/f403f7f66ea34a6ab46a35c07e5bdc15/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:39.481269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60745b-8488-4319-8c6e-a384e1443663 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.481718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60745b-8488-4319-8c6e-a384e1443663 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.482111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60745b-8488-4319-8c6e-a384e1443663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.485949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfea38e-db67-42fd-a332-4f318cf0c068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:39.487608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfea38e-db67-42fd-a332-4f318cf0c068 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:39.500573 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2166/4346] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:39.518427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ba60745b-8488-4319-8c6e-a384e1443663 None None] MFA Rules not processed for user `f403f7f66ea34a6ab46a35c07e5bdc15`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:39.519975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ba60745b-8488-4319-8c6e-a384e1443663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:39.621736 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2181/4347] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:39.624987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfea38e-db67-42fd-a332-4f318cf0c068 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:39.636115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfea38e-db67-42fd-a332-4f318cf0c068 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:39.709744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2559b2-3960-475a-af8b-3822374d0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:39.710369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2559b2-3960-475a-af8b-3822374d0f06 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.710640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2559b2-3960-475a-af8b-3822374d0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.710969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2559b2-3960-475a-af8b-3822374d0f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.711665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2559b2-3960-475a-af8b-3822374d0f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:39.714376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2559b2-3960-475a-af8b-3822374d0f06 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:39.749516 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2167/4348] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:39 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:39.753921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60745b-8488-4319-8c6e-a384e1443663 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:39.779392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60745b-8488-4319-8c6e-a384e1443663 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:39.806869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:39.861676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c362e-e767-4688-ad63-225bd14b308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:39.862406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c362e-e767-4688-ad63-225bd14b308f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.865705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c362e-e767-4688-ad63-225bd14b308f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.866132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c362e-e767-4688-ad63-225bd14b308f admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.867047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c362e-e767-4688-ad63-225bd14b308f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:39.868947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c362e-e767-4688-ad63-225bd14b308f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:39.931519 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2182/4349] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:39 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:45:39.935251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2559b2-3960-475a-af8b-3822374d0f06 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:39.948979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2559b2-3960-475a-af8b-3822374d0f06 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:39.955801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad504419-827f-4f59-8a7d-33771ccc32a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:39.956531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad504419-827f-4f59-8a7d-33771ccc32a7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:39.956923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad504419-827f-4f59-8a7d-33771ccc32a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:39.957266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad504419-827f-4f59-8a7d-33771ccc32a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:39.958034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad504419-827f-4f59-8a7d-33771ccc32a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:39.960004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad504419-827f-4f59-8a7d-33771ccc32a7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:39.982036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c362e-e767-4688-ad63-225bd14b308f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:40.011686 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2168/4350] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:40.017740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c362e-e767-4688-ad63-225bd14b308f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:40.027337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec9e30-5205-42bc-9f4e-a6df78c5eb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:40.028130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec9e30-5205-42bc-9f4e-a6df78c5eb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:40.028479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec9e30-5205-42bc-9f4e-a6df78c5eb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:40.028821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec9e30-5205-42bc-9f4e-a6df78c5eb2a admin admin] PATH_INFO: `/v3/projects/76d2b64d873444daa7b02151020294cb/users/216a97c0168c4eca93c2b08935bb5d5c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:40.053686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec9e30-5205-42bc-9f4e-a6df78c5eb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d2b64d873444daa7b02151020294cb, user_id=216a97c0168c4eca93c2b08935bb5d5c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:40.056463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec9e30-5205-42bc-9f4e-a6df78c5eb2a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:40.079278 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2183/4351] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:39 2022] PUT /identity/v3/projects/76d2b64d873444daa7b02151020294cb/users/216a97c0168c4eca93c2b08935bb5d5c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:40.083038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad504419-827f-4f59-8a7d-33771ccc32a7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:40.097133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad504419-827f-4f59-8a7d-33771ccc32a7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:40.211111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76935d-d402-426e-b194-485021ea13e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:40.211894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76935d-d402-426e-b194-485021ea13e2 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:40.213553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76935d-d402-426e-b194-485021ea13e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:40.214340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76935d-d402-426e-b194-485021ea13e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:40.214952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76935d-d402-426e-b194-485021ea13e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:40.217428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76935d-d402-426e-b194-485021ea13e2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:40.250404 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2169/4352] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:45:40.251792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec9e30-5205-42bc-9f4e-a6df78c5eb2a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:40.268664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec9e30-5205-42bc-9f4e-a6df78c5eb2a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:40.276976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3a134-c174-43b6-8e53-b4d685a6bc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:40.278973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3a134-c174-43b6-8e53-b4d685a6bc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:40.295125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3a134-c174-43b6-8e53-b4d685a6bc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:40.295759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3a134-c174-43b6-8e53-b4d685a6bc1d admin admin] PATH_INFO: `/v3/projects/76d2b64d873444daa7b02151020294cb/users/216a97c0168c4eca93c2b08935bb5d5c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:40.303973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3a134-c174-43b6-8e53-b4d685a6bc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d2b64d873444daa7b02151020294cb, user_id=216a97c0168c4eca93c2b08935bb5d5c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:40.311761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3a134-c174-43b6-8e53-b4d685a6bc1d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:40.355460 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2184/4353] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:40 2022] PUT /identity/v3/projects/76d2b64d873444daa7b02151020294cb/users/216a97c0168c4eca93c2b08935bb5d5c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:40.356567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609ce86-f5d2-4cc1-9686-d4bad1eec097 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:40.357034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609ce86-f5d2-4cc1-9686-d4bad1eec097 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:40.357312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609ce86-f5d2-4cc1-9686-d4bad1eec097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:40.397235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9609ce86-f5d2-4cc1-9686-d4bad1eec097 None None] MFA Rules not processed for user `216a97c0168c4eca93c2b08935bb5d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:40.398495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9609ce86-f5d2-4cc1-9686-d4bad1eec097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:40.409792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:40.560324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3a134-c174-43b6-8e53-b4d685a6bc1d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:40.569454 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2170/4354] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:40.575856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3a134-c174-43b6-8e53-b4d685a6bc1d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:40.589854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81697205-4eda-4429-a91b-b85cbe64185c tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216a97c0168c4eca93c2b08935bb5d5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76d2b64d873444daa7b02151020294cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:40.590554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81697205-4eda-4429-a91b-b85cbe64185c tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:40.590843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81697205-4eda-4429-a91b-b85cbe64185c tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:40.591121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81697205-4eda-4429-a91b-b85cbe64185c tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:40.591795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81697205-4eda-4429-a91b-b85cbe64185c tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:40.593912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81697205-4eda-4429-a91b-b85cbe64185c tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:40.661905 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2185/4355] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:40 2022] POST /identity/v3/projects => generated 334 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:40.664406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609ce86-f5d2-4cc1-9686-d4bad1eec097 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:40.683882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609ce86-f5d2-4cc1-9686-d4bad1eec097 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:40.801043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e3f4a-0619-4fd3-9018-1b0702fabc00 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216a97c0168c4eca93c2b08935bb5d5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76d2b64d873444daa7b02151020294cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:40.801894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e3f4a-0619-4fd3-9018-1b0702fabc00 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:40.802283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e3f4a-0619-4fd3-9018-1b0702fabc00 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:40.802655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e3f4a-0619-4fd3-9018-1b0702fabc00 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:40.803707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e3f4a-0619-4fd3-9018-1b0702fabc00 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:40.806938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e3f4a-0619-4fd3-9018-1b0702fabc00 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:40.851244 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2171/4356] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:45:40 2022] POST /identity/v3/projects => generated 333 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:40.852107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81697205-4eda-4429-a91b-b85cbe64185c tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:40.884498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81697205-4eda-4429-a91b-b85cbe64185c tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:40.971129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de8775-9df3-4ca8-a9a6-2978608f1a66 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216a97c0168c4eca93c2b08935bb5d5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76d2b64d873444daa7b02151020294cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:40.971965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de8775-9df3-4ca8-a9a6-2978608f1a66 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:40.972266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de8775-9df3-4ca8-a9a6-2978608f1a66 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:40.972560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de8775-9df3-4ca8-a9a6-2978608f1a66 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:40.973224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de8775-9df3-4ca8-a9a6-2978608f1a66 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:40.975265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de8775-9df3-4ca8-a9a6-2978608f1a66 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:41.054118 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2186/4357] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:40 2022] POST /identity/v3/projects => generated 357 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:45:41.059339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e3f4a-0619-4fd3-9018-1b0702fabc00 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:41.076575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e3f4a-0619-4fd3-9018-1b0702fabc00 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:41.169890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d59cb-6030-4e3b-bd9e-15d36acdaa74 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216a97c0168c4eca93c2b08935bb5d5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76d2b64d873444daa7b02151020294cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:41.170626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d59cb-6030-4e3b-bd9e-15d36acdaa74 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:41.171133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d59cb-6030-4e3b-bd9e-15d36acdaa74 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:41.171485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d59cb-6030-4e3b-bd9e-15d36acdaa74 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:41.172476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d59cb-6030-4e3b-bd9e-15d36acdaa74 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:41.175090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d59cb-6030-4e3b-bd9e-15d36acdaa74 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:41.206168 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2172/4358] 10.222.0.16 () {58 vars in 1131 bytes} [Mon Aug 29 15:45:41 2022] GET /identity/v3/projects => generated 7205 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:41.211151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de8775-9df3-4ca8-a9a6-2978608f1a66 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:41.225797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de8775-9df3-4ca8-a9a6-2978608f1a66 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:41.234492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdb56e-3e13-48be-8f44-d63cb7fbaec7 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216a97c0168c4eca93c2b08935bb5d5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76d2b64d873444daa7b02151020294cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:41.235124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdb56e-3e13-48be-8f44-d63cb7fbaec7 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:41.241652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdb56e-3e13-48be-8f44-d63cb7fbaec7 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:41.242037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdb56e-3e13-48be-8f44-d63cb7fbaec7 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:41.242961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdb56e-3e13-48be-8f44-d63cb7fbaec7 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:41.243319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdb56e-3e13-48be-8f44-d63cb7fbaec7 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:41.248002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdb56e-3e13-48be-8f44-d63cb7fbaec7 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:41.287913 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2187/4359] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Aug 29 15:45:41 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:41.295147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d59cb-6030-4e3b-bd9e-15d36acdaa74 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:41.308669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d59cb-6030-4e3b-bd9e-15d36acdaa74 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:41.335244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896f3a3-9225-40f2-8765-a778c220e297 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216a97c0168c4eca93c2b08935bb5d5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76d2b64d873444daa7b02151020294cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:41.336059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896f3a3-9225-40f2-8765-a778c220e297 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:41.337728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896f3a3-9225-40f2-8765-a778c220e297 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:41.338188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896f3a3-9225-40f2-8765-a778c220e297 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:41.339381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896f3a3-9225-40f2-8765-a778c220e297 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Adding query filter params (parent_id=1c6bdd22cdfb46328743760109b00844) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:41.339780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896f3a3-9225-40f2-8765-a778c220e297 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:41.341876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896f3a3-9225-40f2-8765-a778c220e297 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:41.370603 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2173/4360] 10.222.0.16 () {58 vars in 1216 bytes} [Mon Aug 29 15:45:41 2022] GET /identity/v3/projects?parent_id=1c6bdd22cdfb46328743760109b00844 => generated 497 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:41.374958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdb56e-3e13-48be-8f44-d63cb7fbaec7 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:41.389363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdb56e-3e13-48be-8f44-d63cb7fbaec7 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:41.401923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216a97c0168c4eca93c2b08935bb5d5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76d2b64d873444daa7b02151020294cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:41.402556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:41.402839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:41.403112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] PATH_INFO: `/v3/projects/37c6b710bb5749e284d79e685d06810b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:41.406623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37c6b710bb5749e284d79e685d06810b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:41.408625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:41.446449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:41.519116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c6b710bb5749e284d79e685d06810b', 'request_id': 'req-98c13424-0918-4686-b48b-c10d616e3581'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:41.536661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c6b710bb5749e284d79e685d06810b', 'request_id': 'req-98c13424-0918-4686-b48b-c10d616e3581'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:41.550986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c6b710bb5749e284d79e685d06810b', 'request_id': 'req-98c13424-0918-4686-b48b-c10d616e3581'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:41.572236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] The token cache is being invalidate because project 37c6b710bb5749e284d79e685d06810b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:41.572721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:41.574180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-98c13424-0918-4686-b48b-c10d616e3581 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:41.579971 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2188/4361] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:41 2022] DELETE /identity/v3/projects/37c6b710bb5749e284d79e685d06810b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:41.581116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896f3a3-9225-40f2-8765-a778c220e297 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:41.584443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6896f3a3-9225-40f2-8765-a778c220e297 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:41.610444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896f3a3-9225-40f2-8765-a778c220e297 tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:41.616678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:41.738610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216a97c0168c4eca93c2b08935bb5d5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76d2b64d873444daa7b02151020294cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:41.739498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:41.739814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:41.740054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] PATH_INFO: `/v3/projects/1c6bdd22cdfb46328743760109b00844` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:41.744496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1c6bdd22cdfb46328743760109b00844)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:41.749848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:41.840572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75894d3-7e5f-4738-a53c-930ef9e5eb2a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:41.841272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75894d3-7e5f-4738-a53c-930ef9e5eb2a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:41.841588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75894d3-7e5f-4738-a53c-930ef9e5eb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:41.853660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6bdd22cdfb46328743760109b00844', 'request_id': 'req-bec0884a-818d-4881-b554-4007cccc4f9b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:41.885562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6bdd22cdfb46328743760109b00844', 'request_id': 'req-bec0884a-818d-4881-b554-4007cccc4f9b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:41.902324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b75894d3-7e5f-4738-a53c-930ef9e5eb2a None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:41.906219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b75894d3-7e5f-4738-a53c-930ef9e5eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:41.917556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6bdd22cdfb46328743760109b00844', 'request_id': 'req-bec0884a-818d-4881-b554-4007cccc4f9b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:41.931367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] The token cache is being invalidate because project 1c6bdd22cdfb46328743760109b00844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:41.931700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:41.932439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:41.934720 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2174/4362] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:41 2022] DELETE /identity/v3/projects/1c6bdd22cdfb46328743760109b00844 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:41.938566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:41.940451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:42.008575 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2189/4363] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:45:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:42.044626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0884a-818d-4881-b554-4007cccc4f9b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:42.054720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216a97c0168c4eca93c2b08935bb5d5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76d2b64d873444daa7b02151020294cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:42.056117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:42.056522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:42.057483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] PATH_INFO: `/v3/projects/819b2305647a4e5cb3acb1e638db12ed` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:42.059849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=819b2305647a4e5cb3acb1e638db12ed)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:42.062198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:42.081767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75894d3-7e5f-4738-a53c-930ef9e5eb2a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:42.085305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b75894d3-7e5f-4738-a53c-930ef9e5eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:42.171999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:42.192040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819b2305647a4e5cb3acb1e638db12ed', 'request_id': 'req-641c7d2f-196b-4acc-8768-93bd02acc97b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:42.207170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819b2305647a4e5cb3acb1e638db12ed', 'request_id': 'req-641c7d2f-196b-4acc-8768-93bd02acc97b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:42.221855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819b2305647a4e5cb3acb1e638db12ed', 'request_id': 'req-641c7d2f-196b-4acc-8768-93bd02acc97b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:42.240276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] The token cache is being invalidate because project 819b2305647a4e5cb3acb1e638db12ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:42.240739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:42.241635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:42.243202 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2175/4364] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:41 2022] DELETE /identity/v3/projects/819b2305647a4e5cb3acb1e638db12ed => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:42.247615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:42.249050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:42.254447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75894d3-7e5f-4738-a53c-930ef9e5eb2a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:42.350149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:42.367388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c7d2f-196b-4acc-8768-93bd02acc97b tempest-ListProjectsTestJSON-2043448605 tempest-ListProjectsTestJSON-2043448605-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:42.373513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:42.373925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa9efd-a085-46ff-bfcd-9ba4925869a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:42.374627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:42.374911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:42.375354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9efd-a085-46ff-bfcd-9ba4925869a4 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:42.375874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9efd-a085-46ff-bfcd-9ba4925869a4 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:42.376163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] PATH_INFO: `/v3/users/f403f7f66ea34a6ab46a35c07e5bdc15` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:42.376944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9efd-a085-46ff-bfcd-9ba4925869a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:42.379927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-87aa9efd-a085-46ff-bfcd-9ba4925869a4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:42.380471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f403f7f66ea34a6ab46a35c07e5bdc15)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:42.385673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:42.465069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa9efd-a085-46ff-bfcd-9ba4925869a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:42.467267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa9efd-a085-46ff-bfcd-9ba4925869a4 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:42.478663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f403f7f66ea34a6ab46a35c07e5bdc15'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:42.480505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f403f7f66ea34a6ab46a35c07e5bdc15'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:42.483682 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2190/4365] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:45:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:42.522471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f403f7f66ea34a6ab46a35c07e5bdc15'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:42.545574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f403f7f66ea34a6ab46a35c07e5bdc15'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:42.583068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f403f7f66ea34a6ab46a35c07e5bdc15'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:42.606085 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2176/4366] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:42 2022] DELETE /identity/v3/users/f403f7f66ea34a6ab46a35c07e5bdc15 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:42.610312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97083fb-3b1d-4802-96e8-eacdf8d839f7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:42.610909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97083fb-3b1d-4802-96e8-eacdf8d839f7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:42.611431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97083fb-3b1d-4802-96e8-eacdf8d839f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:42.653784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c97083fb-3b1d-4802-96e8-eacdf8d839f7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:42.655640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c97083fb-3b1d-4802-96e8-eacdf8d839f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:42.807878 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2191/4367] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:42.828296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:42.830050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:42.965667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:42.980868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1382acd-b526-4334-b98f-a3ee3708d4e3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:42.990384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85075365-f5ec-4b65-8b90-84d22d50677b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:42.991032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85075365-f5ec-4b65-8b90-84d22d50677b service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:42.991372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85075365-f5ec-4b65-8b90-84d22d50677b service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:42.991566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85075365-f5ec-4b65-8b90-84d22d50677b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:43.038610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85075365-f5ec-4b65-8b90-84d22d50677b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:43.040524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85075365-f5ec-4b65-8b90-84d22d50677b service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:43.070306 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2177/4368] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:45.418328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97083fb-3b1d-4802-96e8-eacdf8d839f7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:45.420370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c97083fb-3b1d-4802-96e8-eacdf8d839f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:45.449059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97083fb-3b1d-4802-96e8-eacdf8d839f7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:45.467002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:45.468360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:45.468964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:45.469513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] PATH_INFO: `/v3/projects/194472699bac40078d5a3448e7537b51` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:45.472054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] RBAC: Authorizing `identity:delete_project(project_id=194472699bac40078d5a3448e7537b51)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:45.482739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:45.697219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194472699bac40078d5a3448e7537b51', 'request_id': 'req-091c311f-81f6-4877-a54f-ce1ae503124b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:45.733121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194472699bac40078d5a3448e7537b51', 'request_id': 'req-091c311f-81f6-4877-a54f-ce1ae503124b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:45.747315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194472699bac40078d5a3448e7537b51', 'request_id': 'req-091c311f-81f6-4877-a54f-ce1ae503124b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:45.786871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] The token cache is being invalidate because project 194472699bac40078d5a3448e7537b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:45.787212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:45.790465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:45.804404 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2192/4369] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:45 2022] DELETE /identity/v3/projects/194472699bac40078d5a3448e7537b51 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:45.808681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85075365-f5ec-4b65-8b90-84d22d50677b service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:45.826275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85075365-f5ec-4b65-8b90-84d22d50677b service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:46.027764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89623ca7-3a10-4bbf-8732-3370e4077c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:46.028315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89623ca7-3a10-4bbf-8732-3370e4077c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:46.028600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89623ca7-3a10-4bbf-8732-3370e4077c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:46.028883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89623ca7-3a10-4bbf-8732-3370e4077c4a admin admin] PATH_INFO: `/v3/users/216a97c0168c4eca93c2b08935bb5d5c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:46.030206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89623ca7-3a10-4bbf-8732-3370e4077c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=216a97c0168c4eca93c2b08935bb5d5c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:46.032379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89623ca7-3a10-4bbf-8732-3370e4077c4a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:46.122962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89623ca7-3a10-4bbf-8732-3370e4077c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '216a97c0168c4eca93c2b08935bb5d5c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:46.130357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89623ca7-3a10-4bbf-8732-3370e4077c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '216a97c0168c4eca93c2b08935bb5d5c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:46.171075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89623ca7-3a10-4bbf-8732-3370e4077c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '216a97c0168c4eca93c2b08935bb5d5c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:46.187745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89623ca7-3a10-4bbf-8732-3370e4077c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '216a97c0168c4eca93c2b08935bb5d5c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:46.217310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89623ca7-3a10-4bbf-8732-3370e4077c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '216a97c0168c4eca93c2b08935bb5d5c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:46.229144 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2178/4370] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:45 2022] DELETE /identity/v3/users/216a97c0168c4eca93c2b08935bb5d5c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:47.485985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:47.489098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:47.572816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c311f-81f6-4877-a54f-ce1ae503124b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:47.627701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:47.788707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:47.789358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:47.789686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:47.790155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] PATH_INFO: `/v3/projects/76d2b64d873444daa7b02151020294cb` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:47.791317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d2b64d873444daa7b02151020294cb)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:47.793638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:47.984951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d2b64d873444daa7b02151020294cb', 'request_id': 'req-df79df74-8b81-4851-a66a-64b2bafe5eef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:48.001365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d2b64d873444daa7b02151020294cb', 'request_id': 'req-df79df74-8b81-4851-a66a-64b2bafe5eef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:48.016379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d2b64d873444daa7b02151020294cb', 'request_id': 'req-df79df74-8b81-4851-a66a-64b2bafe5eef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:48.049092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] The token cache is being invalidate because project 76d2b64d873444daa7b02151020294cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:48.049092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:48.051146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df79df74-8b81-4851-a66a-64b2bafe5eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:48.057687 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2193/4371] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:47 2022] DELETE /identity/v3/projects/76d2b64d873444daa7b02151020294cb => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:48.062846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d795246-4cca-4248-ba9e-0f2b0e70e035 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:48.063396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d795246-4cca-4248-ba9e-0f2b0e70e035 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:48.063653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d795246-4cca-4248-ba9e-0f2b0e70e035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:48.113334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7d795246-4cca-4248-ba9e-0f2b0e70e035 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:48.117193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7d795246-4cca-4248-ba9e-0f2b0e70e035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:48.384782 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2179/4372] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:48.389136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff4cf5-e679-497a-9b5d-26f02afe3bd9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:48.389764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff4cf5-e679-497a-9b5d-26f02afe3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:48.390295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff4cf5-e679-497a-9b5d-26f02afe3bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:48.462823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4dff4cf5-e679-497a-9b5d-26f02afe3bd9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:48.470911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4dff4cf5-e679-497a-9b5d-26f02afe3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:48.505168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d795246-4cca-4248-ba9e-0f2b0e70e035 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:48.507433 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2194/4373] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:48.530838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d795246-4cca-4248-ba9e-0f2b0e70e035 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:48.558742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42213255-99e9-45e7-ae01-1bcd5e49d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:48.561976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213255-99e9-45e7-ae01-1bcd5e49d974 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:48.562958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213255-99e9-45e7-ae01-1bcd5e49d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:48.562958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213255-99e9-45e7-ae01-1bcd5e49d974 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:48.567085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42213255-99e9-45e7-ae01-1bcd5e49d974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:48.570005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42213255-99e9-45e7-ae01-1bcd5e49d974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:48.572894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42213255-99e9-45e7-ae01-1bcd5e49d974 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:48.618646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:48.651316 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2180/4374] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:48.656252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff4cf5-e679-497a-9b5d-26f02afe3bd9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:48.676149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff4cf5-e679-497a-9b5d-26f02afe3bd9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:48.697439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3520211-4df8-4fcf-937d-7c410a7bce39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:48.698091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3520211-4df8-4fcf-937d-7c410a7bce39 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:48.698797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3520211-4df8-4fcf-937d-7c410a7bce39 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:48.699081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3520211-4df8-4fcf-937d-7c410a7bce39 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:48.699787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3520211-4df8-4fcf-937d-7c410a7bce39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:48.702312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3520211-4df8-4fcf-937d-7c410a7bce39 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:48.833321 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2195/4375] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:48 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:48.834197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42213255-99e9-45e7-ae01-1bcd5e49d974 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:48.851918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42213255-99e9-45e7-ae01-1bcd5e49d974 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:49.031138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577acb8-0278-47dd-82f5-7a3430d0f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:49.031840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577acb8-0278-47dd-82f5-7a3430d0f92d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:49.032299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577acb8-0278-47dd-82f5-7a3430d0f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:49.032578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577acb8-0278-47dd-82f5-7a3430d0f92d admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:49.033787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577acb8-0278-47dd-82f5-7a3430d0f92d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:49.036053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577acb8-0278-47dd-82f5-7a3430d0f92d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:49.095767 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2181/4376] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:48 2022] POST /identity/v3/users => generated 284 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:45:49.097508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3520211-4df8-4fcf-937d-7c410a7bce39 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:49.120846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3520211-4df8-4fcf-937d-7c410a7bce39 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:49.135153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64c01e-5881-40f3-a916-206762f7025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:49.136073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64c01e-5881-40f3-a916-206762f7025e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:49.136615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64c01e-5881-40f3-a916-206762f7025e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:49.137322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64c01e-5881-40f3-a916-206762f7025e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:49.138183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64c01e-5881-40f3-a916-206762f7025e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:49.142008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64c01e-5881-40f3-a916-206762f7025e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:49.176727 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2196/4377] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:49.177847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577acb8-0278-47dd-82f5-7a3430d0f92d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:49.215853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577acb8-0278-47dd-82f5-7a3430d0f92d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:49.231819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5303012-5652-4d87-b7d7-e03217df9c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:49.232581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5303012-5652-4d87-b7d7-e03217df9c58 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:49.232861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5303012-5652-4d87-b7d7-e03217df9c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:49.233135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5303012-5652-4d87-b7d7-e03217df9c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:49.236235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5303012-5652-4d87-b7d7-e03217df9c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:49.241529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5303012-5652-4d87-b7d7-e03217df9c58 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:49.271856 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2182/4378] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:45:49.278588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64c01e-5881-40f3-a916-206762f7025e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:49.296988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64c01e-5881-40f3-a916-206762f7025e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:49.334504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22e5a2-fd38-48d8-b091-f26bf8569dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:49.335301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22e5a2-fd38-48d8-b091-f26bf8569dde admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:49.337822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22e5a2-fd38-48d8-b091-f26bf8569dde admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:49.338109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22e5a2-fd38-48d8-b091-f26bf8569dde admin admin] PATH_INFO: `/v3/projects/868f2ac2649e4db3ab6dffed7fd1aaa0/users/6dc6938fa46846e5b3a8b4388e9d5962/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:49.419229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22e5a2-fd38-48d8-b091-f26bf8569dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=868f2ac2649e4db3ab6dffed7fd1aaa0, user_id=6dc6938fa46846e5b3a8b4388e9d5962, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:49.427947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22e5a2-fd38-48d8-b091-f26bf8569dde admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:49.480778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508780f-f56c-441c-bad4-eb6270fc7293 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:49.481153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508780f-f56c-441c-bad4-eb6270fc7293 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:49.481336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508780f-f56c-441c-bad4-eb6270fc7293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:49.484536 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2197/4379] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:49 2022] PUT /identity/v3/projects/868f2ac2649e4db3ab6dffed7fd1aaa0/users/6dc6938fa46846e5b3a8b4388e9d5962/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:49.552709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1508780f-f56c-441c-bad4-eb6270fc7293 None None] MFA Rules not processed for user `6dc6938fa46846e5b3a8b4388e9d5962`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:49.557522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1508780f-f56c-441c-bad4-eb6270fc7293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:49.875703 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2183/4380] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:49.876503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22e5a2-fd38-48d8-b091-f26bf8569dde admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:50.088052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:50.232807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22e5a2-fd38-48d8-b091-f26bf8569dde admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:50.250274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d603ba-b846-4f23-9825-d6fb649b6a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:50.251307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d603ba-b846-4f23-9825-d6fb649b6a9c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:50.251797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d603ba-b846-4f23-9825-d6fb649b6a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:50.252275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d603ba-b846-4f23-9825-d6fb649b6a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:50.253317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d603ba-b846-4f23-9825-d6fb649b6a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:50.261646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d603ba-b846-4f23-9825-d6fb649b6a9c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:50.346508 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2198/4381] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:49 2022] POST /identity/v3/projects => generated 367 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:45:50.348495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508780f-f56c-441c-bad4-eb6270fc7293 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:50.366865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508780f-f56c-441c-bad4-eb6270fc7293 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:50.600693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be0ac7-752f-48ce-aa1b-5e46aff04d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:50.601792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be0ac7-752f-48ce-aa1b-5e46aff04d73 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:50.602873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be0ac7-752f-48ce-aa1b-5e46aff04d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:50.603220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be0ac7-752f-48ce-aa1b-5e46aff04d73 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:50.604087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be0ac7-752f-48ce-aa1b-5e46aff04d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:50.606271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be0ac7-752f-48ce-aa1b-5e46aff04d73 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:50.622125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:50.647390 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2184/4382] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:50 2022] POST /identity/v3/users => generated 290 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:50.648136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d603ba-b846-4f23-9825-d6fb649b6a9c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:50.663159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d603ba-b846-4f23-9825-d6fb649b6a9c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:50.690536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f2e2c-e123-433b-868c-f6c53c7fca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:50.691464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f2e2c-e123-433b-868c-f6c53c7fca79 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:50.691918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f2e2c-e123-433b-868c-f6c53c7fca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:50.692465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f2e2c-e123-433b-868c-f6c53c7fca79 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:50.700093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f2e2c-e123-433b-868c-f6c53c7fca79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:50.701964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f2e2c-e123-433b-868c-f6c53c7fca79 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:50.733536 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2199/4383] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:45:50.740453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be0ac7-752f-48ce-aa1b-5e46aff04d73 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:50.769655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be0ac7-752f-48ce-aa1b-5e46aff04d73 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:50.784886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be2056-52d1-4677-b0fd-0f59e3c60261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:50.787428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2056-52d1-4677-b0fd-0f59e3c60261 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:50.788076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2056-52d1-4677-b0fd-0f59e3c60261 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:50.793208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2056-52d1-4677-b0fd-0f59e3c60261 admin admin] PATH_INFO: `/v3/projects/bbcfb27c3f894b84ae48dd6803cf382e/users/7fe22a7ab8744a5199fe95e8d3940fa2/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:50.845544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be2056-52d1-4677-b0fd-0f59e3c60261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcfb27c3f894b84ae48dd6803cf382e, user_id=7fe22a7ab8744a5199fe95e8d3940fa2, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:50.851705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be2056-52d1-4677-b0fd-0f59e3c60261 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:50.880403 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2185/4384] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:50 2022] PUT /identity/v3/projects/bbcfb27c3f894b84ae48dd6803cf382e/users/7fe22a7ab8744a5199fe95e8d3940fa2/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:50.884376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f2e2c-e123-433b-868c-f6c53c7fca79 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:50.910427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f2e2c-e123-433b-868c-f6c53c7fca79 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:51.140594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc662b60-fa9b-4d90-821f-827d65ede6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:51.141234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc662b60-fa9b-4d90-821f-827d65ede6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:51.141543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc662b60-fa9b-4d90-821f-827d65ede6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:51.141816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc662b60-fa9b-4d90-821f-827d65ede6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:51.143700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc662b60-fa9b-4d90-821f-827d65ede6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:51.145424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc662b60-fa9b-4d90-821f-827d65ede6b5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:51.177066 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2200/4385] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:51.183605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be2056-52d1-4677-b0fd-0f59e3c60261 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:51.214154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be2056-52d1-4677-b0fd-0f59e3c60261 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:51.221028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d630a2-7434-451d-858c-10cef4738e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:51.222157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d630a2-7434-451d-858c-10cef4738e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:51.222931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d630a2-7434-451d-858c-10cef4738e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:51.223607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d630a2-7434-451d-858c-10cef4738e4a admin admin] PATH_INFO: `/v3/projects/bbcfb27c3f894b84ae48dd6803cf382e/users/7fe22a7ab8744a5199fe95e8d3940fa2/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:51.226894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d630a2-7434-451d-858c-10cef4738e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcfb27c3f894b84ae48dd6803cf382e, user_id=7fe22a7ab8744a5199fe95e8d3940fa2, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:51.233130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d630a2-7434-451d-858c-10cef4738e4a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:51.251923 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2186/4386] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:51 2022] PUT /identity/v3/projects/bbcfb27c3f894b84ae48dd6803cf382e/users/7fe22a7ab8744a5199fe95e8d3940fa2/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:51.266581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aca22-27ad-48cc-805b-e986f1a5cad7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:51.267163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aca22-27ad-48cc-805b-e986f1a5cad7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:51.267726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aca22-27ad-48cc-805b-e986f1a5cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:51.320203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7c1aca22-27ad-48cc-805b-e986f1a5cad7 None None] MFA Rules not processed for user `7fe22a7ab8744a5199fe95e8d3940fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:51.321789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7c1aca22-27ad-48cc-805b-e986f1a5cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:51.549667 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2201/4387] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:51.554407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d630a2-7434-451d-858c-10cef4738e4a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:51.578771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d630a2-7434-451d-858c-10cef4738e4a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:51.617298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2f716-13af-4856-8573-b6633006a703 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe22a7ab8744a5199fe95e8d3940fa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcfb27c3f894b84ae48dd6803cf382e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:51.618508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f716-13af-4856-8573-b6633006a703 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:51.618803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f716-13af-4856-8573-b6633006a703 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:51.619112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f716-13af-4856-8573-b6633006a703 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] PATH_INFO: `/v3/policies` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:51.620264 n-d-854882-3 devstack@keystone.service[89680]: WARNING oslo_log.versionutils [None req-8ea2f716-13af-4856-8573-b6633006a703 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:45:51.621003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2f716-13af-4856-8573-b6633006a703 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:51.630535 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-8ea2f716-13af-4856-8573-b6633006a703 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:45:51.630535 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:45:51.630535 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:45:51.631474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2f716-13af-4856-8573-b6633006a703 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:51.668961 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2187/4388] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:45:51 2022] POST /identity/v3/policies => generated 229 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:45:51.671773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1aca22-27ad-48cc-805b-e986f1a5cad7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:51.710697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1aca22-27ad-48cc-805b-e986f1a5cad7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:51.723371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5091bf4-7977-4a7e-8878-b92b6dddbe83 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe22a7ab8744a5199fe95e8d3940fa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcfb27c3f894b84ae48dd6803cf382e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:51.724144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5091bf4-7977-4a7e-8878-b92b6dddbe83 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:51.724287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5091bf4-7977-4a7e-8878-b92b6dddbe83 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:51.724565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5091bf4-7977-4a7e-8878-b92b6dddbe83 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] PATH_INFO: `/v3/policies/e1ed1ae65c2348358f5c98e2701bf1a7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:51.729506 n-d-854882-3 devstack@keystone.service[89681]: WARNING oslo_log.versionutils [None req-d5091bf4-7977-4a7e-8878-b92b6dddbe83 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:45:51.730031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5091bf4-7977-4a7e-8878-b92b6dddbe83 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=e1ed1ae65c2348358f5c98e2701bf1a7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:51.736019 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-d5091bf4-7977-4a7e-8878-b92b6dddbe83 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:45:51.736019 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:45:51.736019 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:45:51.736948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5091bf4-7977-4a7e-8878-b92b6dddbe83 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:51.826958 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2202/4389] 10.222.0.16 () {60 vars in 1252 bytes} [Mon Aug 29 15:45:51 2022] PATCH /identity/v3/policies/e1ed1ae65c2348358f5c98e2701bf1a7 => generated 236 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:51.829018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2f716-13af-4856-8573-b6633006a703 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:51.845833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2f716-13af-4856-8573-b6633006a703 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:51.876980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6b5a1-80e9-411f-bb8d-860e5042a47f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe22a7ab8744a5199fe95e8d3940fa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcfb27c3f894b84ae48dd6803cf382e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:51.878333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6b5a1-80e9-411f-bb8d-860e5042a47f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:51.878333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6b5a1-80e9-411f-bb8d-860e5042a47f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:51.878333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6b5a1-80e9-411f-bb8d-860e5042a47f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] PATH_INFO: `/v3/policies/e1ed1ae65c2348358f5c98e2701bf1a7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:51.908950 n-d-854882-3 devstack@keystone.service[89680]: WARNING oslo_log.versionutils [None req-8bc6b5a1-80e9-411f-bb8d-860e5042a47f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:45:51.913173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6b5a1-80e9-411f-bb8d-860e5042a47f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=e1ed1ae65c2348358f5c98e2701bf1a7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:51.914796 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-8bc6b5a1-80e9-411f-bb8d-860e5042a47f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:45:51.914796 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:45:51.914796 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:45:51.917454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6b5a1-80e9-411f-bb8d-860e5042a47f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:51.978835 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2188/4390] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:45:51 2022] GET /identity/v3/policies/e1ed1ae65c2348358f5c98e2701bf1a7 => generated 236 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:51.980323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5091bf4-7977-4a7e-8878-b92b6dddbe83 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:51.996717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5091bf4-7977-4a7e-8878-b92b6dddbe83 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:52.001641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ce257-1602-438e-9e97-77cad6b7ecbf tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe22a7ab8744a5199fe95e8d3940fa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcfb27c3f894b84ae48dd6803cf382e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:52.002303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ce257-1602-438e-9e97-77cad6b7ecbf tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.002599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ce257-1602-438e-9e97-77cad6b7ecbf tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.002865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ce257-1602-438e-9e97-77cad6b7ecbf tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] PATH_INFO: `/v3/policies/e1ed1ae65c2348358f5c98e2701bf1a7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.003660 n-d-854882-3 devstack@keystone.service[89681]: WARNING oslo_log.versionutils [None req-246ce257-1602-438e-9e97-77cad6b7ecbf tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:45:52.004518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ce257-1602-438e-9e97-77cad6b7ecbf tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=e1ed1ae65c2348358f5c98e2701bf1a7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:52.005833 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-246ce257-1602-438e-9e97-77cad6b7ecbf tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:45:52.005833 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:45:52.005833 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:45:52.006741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ce257-1602-438e-9e97-77cad6b7ecbf tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:52.045632 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2203/4391] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:51 2022] DELETE /identity/v3/policies/e1ed1ae65c2348358f5c98e2701bf1a7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:52.050695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6b5a1-80e9-411f-bb8d-860e5042a47f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:52.074662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6b5a1-80e9-411f-bb8d-860e5042a47f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:52.107292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac4383-08d5-47d3-af3b-cea00b4ce931 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe22a7ab8744a5199fe95e8d3940fa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcfb27c3f894b84ae48dd6803cf382e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:52.108117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac4383-08d5-47d3-af3b-cea00b4ce931 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.108410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac4383-08d5-47d3-af3b-cea00b4ce931 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.109085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac4383-08d5-47d3-af3b-cea00b4ce931 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] PATH_INFO: `/v3/policies` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.113092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac4383-08d5-47d3-af3b-cea00b4ce931 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:52.116410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac4383-08d5-47d3-af3b-cea00b4ce931 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:52.187321 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2189/4392] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:45:52 2022] POST /identity/v3/policies => generated 229 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:52.190429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ce257-1602-438e-9e97-77cad6b7ecbf tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:52.209293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ce257-1602-438e-9e97-77cad6b7ecbf tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:52.226347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547a48-edb8-4cbb-94be-768fac97744f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe22a7ab8744a5199fe95e8d3940fa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcfb27c3f894b84ae48dd6803cf382e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:52.228492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547a48-edb8-4cbb-94be-768fac97744f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.228997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547a48-edb8-4cbb-94be-768fac97744f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.229489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547a48-edb8-4cbb-94be-768fac97744f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] PATH_INFO: `/v3/policies` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.236037 n-d-854882-3 devstack@keystone.service[89681]: WARNING oslo_log.versionutils [None req-48547a48-edb8-4cbb-94be-768fac97744f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:45:52.236672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48547a48-edb8-4cbb-94be-768fac97744f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:52.238788 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-48547a48-edb8-4cbb-94be-768fac97744f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:45:52.238788 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:45:52.238788 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:45:52.241629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48547a48-edb8-4cbb-94be-768fac97744f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:52.259192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:52.308268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7bcd1-af59-4867-bb3c-b898af20ee91 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.308934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7bcd1-af59-4867-bb3c-b898af20ee91 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.309358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7bcd1-af59-4867-bb3c-b898af20ee91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.349059 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2204/4393] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:45:52 2022] POST /identity/v3/policies => generated 228 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:45:52.350580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547a48-edb8-4cbb-94be-768fac97744f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:52.410350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547a48-edb8-4cbb-94be-768fac97744f tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:52.425888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d2b7bcd1-af59-4867-bb3c-b898af20ee91 None None] MFA Rules not processed for user `0556380b71674698b3260103ef247c85`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:52.429132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d2b7bcd1-af59-4867-bb3c-b898af20ee91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:52.437176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f249a6-9320-4e7c-88cb-8fa957d3a328 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe22a7ab8744a5199fe95e8d3940fa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcfb27c3f894b84ae48dd6803cf382e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:52.438615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f249a6-9320-4e7c-88cb-8fa957d3a328 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.441214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f249a6-9320-4e7c-88cb-8fa957d3a328 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.441592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f249a6-9320-4e7c-88cb-8fa957d3a328 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] PATH_INFO: `/v3/policies` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.457375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f249a6-9320-4e7c-88cb-8fa957d3a328 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:52.467300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f249a6-9320-4e7c-88cb-8fa957d3a328 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:52.593476 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2205/4394] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:45:52 2022] POST /identity/v3/policies => generated 228 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:52.595965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f249a6-9320-4e7c-88cb-8fa957d3a328 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:52.633228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f249a6-9320-4e7c-88cb-8fa957d3a328 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:52.645776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388736a3-050e-4cd9-966d-f77a639d95e9 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe22a7ab8744a5199fe95e8d3940fa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcfb27c3f894b84ae48dd6803cf382e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:52.646407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388736a3-050e-4cd9-966d-f77a639d95e9 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.646688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388736a3-050e-4cd9-966d-f77a639d95e9 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.646989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388736a3-050e-4cd9-966d-f77a639d95e9 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] PATH_INFO: `/v3/policies` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.648219 n-d-854882-3 devstack@keystone.service[89681]: WARNING oslo_log.versionutils [None req-388736a3-050e-4cd9-966d-f77a639d95e9 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:45:52.653946 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2190/4395] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:52.654546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388736a3-050e-4cd9-966d-f77a639d95e9 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:52.655531 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-388736a3-050e-4cd9-966d-f77a639d95e9 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:45:52.655531 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:45:52.655531 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:45:52.656520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388736a3-050e-4cd9-966d-f77a639d95e9 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:52.666062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c66279-b76c-435b-af8e-349c337e1710 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.666413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c66279-b76c-435b-af8e-349c337e1710 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.666612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c66279-b76c-435b-af8e-349c337e1710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.686277 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2206/4396] 10.222.0.16 () {58 vars in 1131 bytes} [Mon Aug 29 15:45:52 2022] GET /identity/v3/policies => generated 761 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:52.698657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388736a3-050e-4cd9-966d-f77a639d95e9 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:52.714474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388736a3-050e-4cd9-966d-f77a639d95e9 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:52.729453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e5d72-6b1f-4f85-8d78-c0bbf4f0b3df tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe22a7ab8744a5199fe95e8d3940fa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcfb27c3f894b84ae48dd6803cf382e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:52.730587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5d72-6b1f-4f85-8d78-c0bbf4f0b3df tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.730711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-94c66279-b76c-435b-af8e-349c337e1710 None None] MFA Rules not processed for user `0556380b71674698b3260103ef247c85`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:52.731138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5d72-6b1f-4f85-8d78-c0bbf4f0b3df tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.731570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5d72-6b1f-4f85-8d78-c0bbf4f0b3df tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] PATH_INFO: `/v3/policies/f2c02cbaec3e49d2b58c296aa9187dd8` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.731866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-94c66279-b76c-435b-af8e-349c337e1710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:52.733865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e5d72-6b1f-4f85-8d78-c0bbf4f0b3df tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=f2c02cbaec3e49d2b58c296aa9187dd8)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:52.735892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e5d72-6b1f-4f85-8d78-c0bbf4f0b3df tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:52.762047 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2191/4397] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:45:52.772880 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2207/4398] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:52 2022] DELETE /identity/v3/policies/f2c02cbaec3e49d2b58c296aa9187dd8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:52.774630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c66279-b76c-435b-af8e-349c337e1710 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:52.797939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c66279-b76c-435b-af8e-349c337e1710 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:52.811687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9bbf1-8f31-42cb-8a30-d8089266d420 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe22a7ab8744a5199fe95e8d3940fa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcfb27c3f894b84ae48dd6803cf382e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:52.814148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9bbf1-8f31-42cb-8a30-d8089266d420 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.814546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9bbf1-8f31-42cb-8a30-d8089266d420 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.821632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9bbf1-8f31-42cb-8a30-d8089266d420 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] PATH_INFO: `/v3/policies/af8333f360e24ee6840199b3adde5568` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.824333 n-d-854882-3 devstack@keystone.service[89680]: WARNING oslo_log.versionutils [None req-97c9bbf1-8f31-42cb-8a30-d8089266d420 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 29 15:45:52.825144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9bbf1-8f31-42cb-8a30-d8089266d420 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=af8333f360e24ee6840199b3adde5568)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:52.827610 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-97c9bbf1-8f31-42cb-8a30-d8089266d420 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:45:52.827610 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:45:52.827610 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:45:52.830300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9bbf1-8f31-42cb-8a30-d8089266d420 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:52.896182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e5d72-6b1f-4f85-8d78-c0bbf4f0b3df tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:52.897235 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2192/4399] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:52 2022] DELETE /identity/v3/policies/af8333f360e24ee6840199b3adde5568 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:52.898342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cf5e5d72-6b1f-4f85-8d78-c0bbf4f0b3df tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:52.910781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9bbf1-8f31-42cb-8a30-d8089266d420 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:52.967091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9bbf1-8f31-42cb-8a30-d8089266d420 tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:52.988090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc179bee-0edc-4965-bcf3-3398a289948b tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe22a7ab8744a5199fe95e8d3940fa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcfb27c3f894b84ae48dd6803cf382e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:52.992283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179bee-0edc-4965-bcf3-3398a289948b tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:52.994266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179bee-0edc-4965-bcf3-3398a289948b tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:52.994538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179bee-0edc-4965-bcf3-3398a289948b tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] PATH_INFO: `/v3/policies/8520ff6bfeb943b5be6fd8786efca2e0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:52.995675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc179bee-0edc-4965-bcf3-3398a289948b tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8520ff6bfeb943b5be6fd8786efca2e0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:53.020473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc179bee-0edc-4965-bcf3-3398a289948b tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:53.073984 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2193/4400] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:52 2022] DELETE /identity/v3/policies/8520ff6bfeb943b5be6fd8786efca2e0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:53.076353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc179bee-0edc-4965-bcf3-3398a289948b tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:53.194065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e5d72-6b1f-4f85-8d78-c0bbf4f0b3df tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:53.206893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:53.225605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc17a9-a9c6-4396-aca5-94a802764271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:53.226409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc17a9-a9c6-4396-aca5-94a802764271 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:53.226790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc17a9-a9c6-4396-aca5-94a802764271 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:53.227310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc17a9-a9c6-4396-aca5-94a802764271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:53.238104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc17a9-a9c6-4396-aca5-94a802764271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:53.239782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc17a9-a9c6-4396-aca5-94a802764271 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:53.253960 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2208/4401] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:53.318622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc179bee-0edc-4965-bcf3-3398a289948b tempest-PoliciesTestJSON-534062378 tempest-PoliciesTestJSON-534062378-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:53.339252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:53.339923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:53.340209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:53.340738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] PATH_INFO: `/v3/users/6dc6938fa46846e5b3a8b4388e9d5962` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:53.348856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc6938fa46846e5b3a8b4388e9d5962)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:53.355204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:53.502426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc6938fa46846e5b3a8b4388e9d5962'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:53.503615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc6938fa46846e5b3a8b4388e9d5962'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:53.561340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc6938fa46846e5b3a8b4388e9d5962'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:53.572890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc6938fa46846e5b3a8b4388e9d5962'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:53.591357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc6938fa46846e5b3a8b4388e9d5962'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:53.616932 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2194/4402] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:53 2022] DELETE /identity/v3/users/6dc6938fa46846e5b3a8b4388e9d5962 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:53.620433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712db02-e9c4-49a1-b1ed-15fdc6da80a9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:53.621408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712db02-e9c4-49a1-b1ed-15fdc6da80a9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:53.621408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712db02-e9c4-49a1-b1ed-15fdc6da80a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:53.712926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f712db02-e9c4-49a1-b1ed-15fdc6da80a9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:53.715719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f712db02-e9c4-49a1-b1ed-15fdc6da80a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:53.855233 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2209/4403] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:53.868334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:53.871422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:54.051569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712db02-e9c4-49a1-b1ed-15fdc6da80a9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:54.052985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f712db02-e9c4-49a1-b1ed-15fdc6da80a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:54.077027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712db02-e9c4-49a1-b1ed-15fdc6da80a9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:54.078396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db343e-38f4-4f05-97a0-9d6d15ae8d48 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:54.084193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:54.084850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:54.085132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:54.085430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] PATH_INFO: `/v3/users/0d7bfb7936cf4c709466b39a6486bf57` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:54.087369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960be379-2edd-4335-86f0-217a677c7133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:54.088317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be379-2edd-4335-86f0-217a677c7133 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:54.088910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be379-2edd-4335-86f0-217a677c7133 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:54.089425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be379-2edd-4335-86f0-217a677c7133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:54.090824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7bfb7936cf4c709466b39a6486bf57)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:54.092825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:54.102015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960be379-2edd-4335-86f0-217a677c7133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:54.104559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960be379-2edd-4335-86f0-217a677c7133 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:54.166151 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2195/4404] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:54.208247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:54.229790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7bfb7936cf4c709466b39a6486bf57'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:54.232975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7bfb7936cf4c709466b39a6486bf57'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:54.258524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7bfb7936cf4c709466b39a6486bf57'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:54.260274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7bfb7936cf4c709466b39a6486bf57'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:54.285242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7bfb7936cf4c709466b39a6486bf57'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:54.316251 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2210/4405] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:54 2022] DELETE /identity/v3/users/0d7bfb7936cf4c709466b39a6486bf57 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:54.321024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235b7c-20a0-4db0-835b-5c4651cca3a4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:54.321317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235b7c-20a0-4db0-835b-5c4651cca3a4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:54.321629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235b7c-20a0-4db0-835b-5c4651cca3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:54.396750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7b235b7c-20a0-4db0-835b-5c4651cca3a4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:54.397922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7b235b7c-20a0-4db0-835b-5c4651cca3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:54.575483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:54.613975 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2196/4406] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:54.657441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:54.663319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:54.922413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc509b-a689-45f5-ade8-546df49a76db admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:54.933701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bc95c-933a-4411-95a3-21b1b3ce13e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:54.934396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bc95c-933a-4411-95a3-21b1b3ce13e3 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:54.934665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bc95c-933a-4411-95a3-21b1b3ce13e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:54.934943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bc95c-933a-4411-95a3-21b1b3ce13e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:54.959419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bc95c-933a-4411-95a3-21b1b3ce13e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:54.960907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bc95c-933a-4411-95a3-21b1b3ce13e3 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:54.984838 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2211/4407] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:55.238893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b235b7c-20a0-4db0-835b-5c4651cca3a4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:55.240365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7b235b7c-20a0-4db0-835b-5c4651cca3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:55.261879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b235b7c-20a0-4db0-835b-5c4651cca3a4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:55.273847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:55.275332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:55.275776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:55.276205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] PATH_INFO: `/v3/projects/868f2ac2649e4db3ab6dffed7fd1aaa0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:55.278324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868f2ac2649e4db3ab6dffed7fd1aaa0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:55.280432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:55.432335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868f2ac2649e4db3ab6dffed7fd1aaa0', 'request_id': 'req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:55.462786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868f2ac2649e4db3ab6dffed7fd1aaa0', 'request_id': 'req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:55.472323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868f2ac2649e4db3ab6dffed7fd1aaa0', 'request_id': 'req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:55.495525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] The token cache is being invalidate because project 868f2ac2649e4db3ab6dffed7fd1aaa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:55.495817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:55.498436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:55.500366 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2197/4408] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:55 2022] DELETE /identity/v3/projects/868f2ac2649e4db3ab6dffed7fd1aaa0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:55.504260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bc95c-933a-4411-95a3-21b1b3ce13e3 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:55.515996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bc95c-933a-4411-95a3-21b1b3ce13e3 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:55.667580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b4cd7-53a5-429b-afc9-1a1bba49c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:55.668222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4cd7-53a5-429b-afc9-1a1bba49c864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:55.668512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4cd7-53a5-429b-afc9-1a1bba49c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:55.668787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4cd7-53a5-429b-afc9-1a1bba49c864 admin admin] PATH_INFO: `/v3/users/7fe22a7ab8744a5199fe95e8d3940fa2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:55.674621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b4cd7-53a5-429b-afc9-1a1bba49c864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe22a7ab8744a5199fe95e8d3940fa2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:55.676648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b4cd7-53a5-429b-afc9-1a1bba49c864 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:55.833904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f38b4cd7-53a5-429b-afc9-1a1bba49c864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe22a7ab8744a5199fe95e8d3940fa2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:55.834688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f38b4cd7-53a5-429b-afc9-1a1bba49c864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe22a7ab8744a5199fe95e8d3940fa2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:55.854769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:55.860484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f38b4cd7-53a5-429b-afc9-1a1bba49c864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe22a7ab8744a5199fe95e8d3940fa2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:55.861588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f38b4cd7-53a5-429b-afc9-1a1bba49c864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe22a7ab8744a5199fe95e8d3940fa2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:55.879609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f38b4cd7-53a5-429b-afc9-1a1bba49c864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe22a7ab8744a5199fe95e8d3940fa2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:55.914802 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2212/4409] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:45:55 2022] DELETE /identity/v3/users/7fe22a7ab8744a5199fe95e8d3940fa2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:56.048238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:56.049729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:56.088343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5db1b1-fdbf-422f-8dfd-fadad33929b7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:56.291125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:56.291776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:56.292065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:56.292601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] PATH_INFO: `/v3/projects/62bf95e66d0847c4beefeba528ebf447` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:56.294043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62bf95e66d0847c4beefeba528ebf447)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:56.296047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:56.461401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62bf95e66d0847c4beefeba528ebf447', 'request_id': 'req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:56.471782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62bf95e66d0847c4beefeba528ebf447', 'request_id': 'req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:56.486511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62bf95e66d0847c4beefeba528ebf447', 'request_id': 'req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:56.519512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] The token cache is being invalidate because project 62bf95e66d0847c4beefeba528ebf447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:56.519512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:56.524515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:56.538051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc39670-cd11-44c7-8b77-05f71478f005 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:56.544007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc39670-cd11-44c7-8b77-05f71478f005 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:56.544464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc39670-cd11-44c7-8b77-05f71478f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:56.556602 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2198/4410] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:56 2022] DELETE /identity/v3/projects/62bf95e66d0847c4beefeba528ebf447 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:56.582461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7dc39670-cd11-44c7-8b77-05f71478f005 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:56.583946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7dc39670-cd11-44c7-8b77-05f71478f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:56.678117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:56.679564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:56.710171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:56.773381 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2213/4411] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:56.775517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7678aa-0258-46a6-a16f-0286820ecfbe None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:56.776467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7678aa-0258-46a6-a16f-0286820ecfbe None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:56.779103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7678aa-0258-46a6-a16f-0286820ecfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:56.835550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0c7678aa-0258-46a6-a16f-0286820ecfbe None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:56.837619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0c7678aa-0258-46a6-a16f-0286820ecfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:56.852334 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2214/4412] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:56.856834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7678aa-0258-46a6-a16f-0286820ecfbe None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:56.873023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7678aa-0258-46a6-a16f-0286820ecfbe None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:56.880650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22661e50-93c0-4d41-a28f-bb7ebeb0fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:56.887128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661e50-93c0-4d41-a28f-bb7ebeb0fea4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:56.887418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661e50-93c0-4d41-a28f-bb7ebeb0fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:56.887697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661e50-93c0-4d41-a28f-bb7ebeb0fea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:56.888792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22661e50-93c0-4d41-a28f-bb7ebeb0fea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:56.888792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22661e50-93c0-4d41-a28f-bb7ebeb0fea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:56.890315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22661e50-93c0-4d41-a28f-bb7ebeb0fea4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:56.934396 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2215/4413] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:56.938759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22661e50-93c0-4d41-a28f-bb7ebeb0fea4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:56.964705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22661e50-93c0-4d41-a28f-bb7ebeb0fea4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:56.971866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3ea06-bdd1-43f6-a04b-6916bc3a8b87 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:56.982326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd53e-30af-45fd-9966-a41a35800d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:56.982965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd53e-30af-45fd-9966-a41a35800d59 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:56.983251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd53e-30af-45fd-9966-a41a35800d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:56.983524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd53e-30af-45fd-9966-a41a35800d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:56.984304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fd53e-30af-45fd-9966-a41a35800d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:56.986265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fd53e-30af-45fd-9966-a41a35800d59 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:57.001223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:57.002421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:57.002996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:57.003571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] PATH_INFO: `/v3/projects/bbcfb27c3f894b84ae48dd6803cf382e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:57.005237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbcfb27c3f894b84ae48dd6803cf382e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:57.009781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:57.112872 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2216/4414] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:56 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:57.116764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd53e-30af-45fd-9966-a41a35800d59 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:57.172787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbcfb27c3f894b84ae48dd6803cf382e', 'request_id': 'req-d90d618d-f3d4-4034-b785-47cda05240cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:57.199586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbcfb27c3f894b84ae48dd6803cf382e', 'request_id': 'req-d90d618d-f3d4-4034-b785-47cda05240cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:57.224671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbcfb27c3f894b84ae48dd6803cf382e', 'request_id': 'req-d90d618d-f3d4-4034-b785-47cda05240cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:57.294048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] The token cache is being invalidate because project bbcfb27c3f894b84ae48dd6803cf382e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:45:57.294693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:57.300353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d90d618d-f3d4-4034-b785-47cda05240cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:45:57.303850 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2199/4415] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:56 2022] DELETE /identity/v3/projects/bbcfb27c3f894b84ae48dd6803cf382e => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:45:57.309864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b19edd-acff-492f-97dc-1d1681caaf11 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:57.311299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b19edd-acff-492f-97dc-1d1681caaf11 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:57.313744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b19edd-acff-492f-97dc-1d1681caaf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:57.343948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd53e-30af-45fd-9966-a41a35800d59 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:57.371884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-69b19edd-acff-492f-97dc-1d1681caaf11 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:57.377025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-69b19edd-acff-492f-97dc-1d1681caaf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:57.447095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:57.526635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77e6bb-2585-48c9-bc80-57b2f99a392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:57.527264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77e6bb-2585-48c9-bc80-57b2f99a392c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:57.527544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77e6bb-2585-48c9-bc80-57b2f99a392c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:57.527946 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2200/4416] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:57.528071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77e6bb-2585-48c9-bc80-57b2f99a392c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:57.528525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77e6bb-2585-48c9-bc80-57b2f99a392c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:57.530933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77e6bb-2585-48c9-bc80-57b2f99a392c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:57.531964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e7c3-b7d0-4fc3-9521-a1162e82b9ff None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:57.532899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e7c3-b7d0-4fc3-9521-a1162e82b9ff None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:57.533691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e7c3-b7d0-4fc3-9521-a1162e82b9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:57.585377 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2217/4417] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:57 2022] POST /identity/v3/users => generated 293 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:45:57.589757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77e6bb-2585-48c9-bc80-57b2f99a392c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:57.591630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5c77e6bb-2585-48c9-bc80-57b2f99a392c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:57.597747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3ee4e7c3-b7d0-4fc3-9521-a1162e82b9ff None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:57.600641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3ee4e7c3-b7d0-4fc3-9521-a1162e82b9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:57.612261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77e6bb-2585-48c9-bc80-57b2f99a392c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:57.625835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a1e0c-cc9e-4851-9143-74348502222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:57.626478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a1e0c-cc9e-4851-9143-74348502222f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:57.626756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a1e0c-cc9e-4851-9143-74348502222f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:57.627160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a1e0c-cc9e-4851-9143-74348502222f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:57.628170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a1e0c-cc9e-4851-9143-74348502222f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:57.632274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a1e0c-cc9e-4851-9143-74348502222f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:57.654547 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2201/4418] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:57.656245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4e7c3-b7d0-4fc3-9521-a1162e82b9ff None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:57.691396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4e7c3-b7d0-4fc3-9521-a1162e82b9ff None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:57.706491 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2218/4419] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:45:57.707456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d916ce-5aea-4fb1-9e46-666236a661e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:57.708103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d916ce-5aea-4fb1-9e46-666236a661e1 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:57.708389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d916ce-5aea-4fb1-9e46-666236a661e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:57.708667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d916ce-5aea-4fb1-9e46-666236a661e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:57.709332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d916ce-5aea-4fb1-9e46-666236a661e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:45:57.709674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d916ce-5aea-4fb1-9e46-666236a661e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:57.711326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d916ce-5aea-4fb1-9e46-666236a661e1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:57.712509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a1e0c-cc9e-4851-9143-74348502222f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:57.745862 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2202/4420] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:45:57.748174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d916ce-5aea-4fb1-9e46-666236a661e1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:57.777991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d916ce-5aea-4fb1-9e46-666236a661e1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:57.781451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a1e0c-cc9e-4851-9143-74348502222f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:57.791754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184f90a-3873-42bc-b7ed-991e9c5ac3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:57.795499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f90a-3873-42bc-b7ed-991e9c5ac3dc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:57.795986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f90a-3873-42bc-b7ed-991e9c5ac3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:57.797297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f90a-3873-42bc-b7ed-991e9c5ac3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:57.797705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90596acf-7489-469d-ae12-e245bc8a1869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:57.798426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90596acf-7489-469d-ae12-e245bc8a1869 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:57.798611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90596acf-7489-469d-ae12-e245bc8a1869 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:57.798908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90596acf-7489-469d-ae12-e245bc8a1869 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:57.799535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90596acf-7489-469d-ae12-e245bc8a1869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:57.801054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184f90a-3873-42bc-b7ed-991e9c5ac3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:57.807486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184f90a-3873-42bc-b7ed-991e9c5ac3dc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:57.818937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90596acf-7489-469d-ae12-e245bc8a1869 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:57.858589 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2219/4421] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:57.862558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184f90a-3873-42bc-b7ed-991e9c5ac3dc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:57.874944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184f90a-3873-42bc-b7ed-991e9c5ac3dc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:57.880605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a2c8d-af24-435d-8284-6396bcf84127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:57.881542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a2c8d-af24-435d-8284-6396bcf84127 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:57.881986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a2c8d-af24-435d-8284-6396bcf84127 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:57.882423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a2c8d-af24-435d-8284-6396bcf84127 admin admin] PATH_INFO: `/v3/projects/18c9aff606024239a686521ac9ba0ccd/users/50bf76900e48462199fb7ea9337703e7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:57.904380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a2c8d-af24-435d-8284-6396bcf84127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c9aff606024239a686521ac9ba0ccd, user_id=50bf76900e48462199fb7ea9337703e7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:57.907896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a2c8d-af24-435d-8284-6396bcf84127 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:57.919439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:57.939153 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2203/4422] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:57 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:57.940462 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2220/4423] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:57 2022] PUT /identity/v3/projects/18c9aff606024239a686521ac9ba0ccd/users/50bf76900e48462199fb7ea9337703e7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:57.943734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90596acf-7489-469d-ae12-e245bc8a1869 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:57.949673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47208438-8c6b-4c4d-96fc-eb4c45b8fb24 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:57.952512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47208438-8c6b-4c4d-96fc-eb4c45b8fb24 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:57.954178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47208438-8c6b-4c4d-96fc-eb4c45b8fb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:58.041846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-47208438-8c6b-4c4d-96fc-eb4c45b8fb24 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:58.058985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-47208438-8c6b-4c4d-96fc-eb4c45b8fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:58.244861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90596acf-7489-469d-ae12-e245bc8a1869 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:58.256058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9b446-0377-4062-8876-f55fc8939e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:58.257030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9b446-0377-4062-8876-f55fc8939e7b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:58.257584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9b446-0377-4062-8876-f55fc8939e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:58.261110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9b446-0377-4062-8876-f55fc8939e7b admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:58.265301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9b446-0377-4062-8876-f55fc8939e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:58.272489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9b446-0377-4062-8876-f55fc8939e7b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:58.338933 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2204/4424] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:57 2022] POST /identity/v3/users => generated 284 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:58.338933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9b446-0377-4062-8876-f55fc8939e7b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:58.350339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c0a9b446-0377-4062-8876-f55fc8939e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:58.385347 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2221/4425] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:58.386368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47208438-8c6b-4c4d-96fc-eb4c45b8fb24 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:58.423251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47208438-8c6b-4c4d-96fc-eb4c45b8fb24 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:58.439318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bc209-f870-439b-a1e8-a63c920e2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:58.439977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bc209-f870-439b-a1e8-a63c920e2779 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:58.440279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bc209-f870-439b-a1e8-a63c920e2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:58.440568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bc209-f870-439b-a1e8-a63c920e2779 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:58.441202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bc209-f870-439b-a1e8-a63c920e2779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:58.445421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bc209-f870-439b-a1e8-a63c920e2779 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:58.471043 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2222/4426] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:58.481762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bc209-f870-439b-a1e8-a63c920e2779 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:58.494678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9b446-0377-4062-8876-f55fc8939e7b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:58.502684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bc209-f870-439b-a1e8-a63c920e2779 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:58.504477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c80d3e-30be-4fe2-891c-d1d1c7445dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:58.506083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c80d3e-30be-4fe2-891c-d1d1c7445dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:58.506358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c80d3e-30be-4fe2-891c-d1d1c7445dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:58.506629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c80d3e-30be-4fe2-891c-d1d1c7445dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:58.512528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-25c80d3e-30be-4fe2-891c-d1d1c7445dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:58.518904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b6e68-a00f-44ec-a9d3-da8f5e44c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:58.520302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6e68-a00f-44ec-a9d3-da8f5e44c7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:58.520619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6e68-a00f-44ec-a9d3-da8f5e44c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:58.520890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6e68-a00f-44ec-a9d3-da8f5e44c7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:58.523554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b6e68-a00f-44ec-a9d3-da8f5e44c7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:58.525727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b6e68-a00f-44ec-a9d3-da8f5e44c7b3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:58.570846 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2223/4427] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:58.575704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b6e68-a00f-44ec-a9d3-da8f5e44c7b3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:58.596310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b6e68-a00f-44ec-a9d3-da8f5e44c7b3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:58.615954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879ccd7-d780-4670-a776-6b19c605b392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:58.617097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879ccd7-d780-4670-a776-6b19c605b392 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:58.619800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879ccd7-d780-4670-a776-6b19c605b392 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:58.620083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879ccd7-d780-4670-a776-6b19c605b392 admin admin] PATH_INFO: `/v3/projects/790a8aa5b64946f780947a532e7b95f3/users/be48a28700ef4a3faeab5c62d28ea9f2/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:58.670107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879ccd7-d780-4670-a776-6b19c605b392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790a8aa5b64946f780947a532e7b95f3, user_id=be48a28700ef4a3faeab5c62d28ea9f2, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:58.690136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879ccd7-d780-4670-a776-6b19c605b392 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:58.726099 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2224/4428] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:58 2022] PUT /identity/v3/projects/790a8aa5b64946f780947a532e7b95f3/users/be48a28700ef4a3faeab5c62d28ea9f2/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:58.726099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879ccd7-d780-4670-a776-6b19c605b392 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:58.773745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:58.775630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c80d3e-30be-4fe2-891c-d1d1c7445dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:58.776735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c80d3e-30be-4fe2-891c-d1d1c7445dd9 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:58.808104 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2205/4429] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:58.809504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d9b5b-39b9-4e62-bd33-eb7cea5d8358 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:58.809798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d9b5b-39b9-4e62-bd33-eb7cea5d8358 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:58.810078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d9b5b-39b9-4e62-bd33-eb7cea5d8358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:58.830933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879ccd7-d780-4670-a776-6b19c605b392 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:58.845380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c802c2-9056-4a14-b5e9-5eeb051c3fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:58.846086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c802c2-9056-4a14-b5e9-5eeb051c3fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:58.846469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c802c2-9056-4a14-b5e9-5eeb051c3fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:58.846749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c802c2-9056-4a14-b5e9-5eeb051c3fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:58.917842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ab9d9b5b-39b9-4e62-bd33-eb7cea5d8358 None None] MFA Rules not processed for user `be48a28700ef4a3faeab5c62d28ea9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:45:58.919090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ab9d9b5b-39b9-4e62-bd33-eb7cea5d8358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:58.968767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:59.041170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c802c2-9056-4a14-b5e9-5eeb051c3fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:59.042934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c802c2-9056-4a14-b5e9-5eeb051c3fc4 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:59.066126 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2225/4430] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:59.067339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c802c2-9056-4a14-b5e9-5eeb051c3fc4 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:59.078399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f7c802c2-9056-4a14-b5e9-5eeb051c3fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:59.098064 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2206/4431] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:45:59.103500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d9b5b-39b9-4e62-bd33-eb7cea5d8358 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:59.111120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c802c2-9056-4a14-b5e9-5eeb051c3fc4 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:59.117724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190a7e-05fc-4c09-b0bb-b47f18d12915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:59.121352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190a7e-05fc-4c09-b0bb-b47f18d12915 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:59.122744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190a7e-05fc-4c09-b0bb-b47f18d12915 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:59.123136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190a7e-05fc-4c09-b0bb-b47f18d12915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:59.131056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5a190a7e-05fc-4c09-b0bb-b47f18d12915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:45:59.138678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d9b5b-39b9-4e62-bd33-eb7cea5d8358 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:59.152136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4032c6-2a77-453e-aac6-fc820bc0b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:59.152783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4032c6-2a77-453e-aac6-fc820bc0b97c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:59.153062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4032c6-2a77-453e-aac6-fc820bc0b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:59.153333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4032c6-2a77-453e-aac6-fc820bc0b97c admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:59.154090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4032c6-2a77-453e-aac6-fc820bc0b97c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:59.156027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4032c6-2a77-453e-aac6-fc820bc0b97c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:59.339122 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2207/4432] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:45:59 2022] POST /identity/v3/projects => generated 367 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:59.343047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4032c6-2a77-453e-aac6-fc820bc0b97c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:59.528481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4032c6-2a77-453e-aac6-fc820bc0b97c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:59.539807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439d2b2-a6fa-4451-ade8-414a2d525555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:59.540635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439d2b2-a6fa-4451-ade8-414a2d525555 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:59.541026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439d2b2-a6fa-4451-ade8-414a2d525555 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:59.550863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a190a7e-05fc-4c09-b0bb-b47f18d12915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:59.551492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439d2b2-a6fa-4451-ade8-414a2d525555 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:59.553988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439d2b2-a6fa-4451-ade8-414a2d525555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:59.556014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a190a7e-05fc-4c09-b0bb-b47f18d12915 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:59.565184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439d2b2-a6fa-4451-ade8-414a2d525555 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:59.609612 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2226/4433] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:45:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:45:59.639590 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2208/4434] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:45:59 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:45:59.643093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190a7e-05fc-4c09-b0bb-b47f18d12915 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:59.662148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190a7e-05fc-4c09-b0bb-b47f18d12915 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:59.673083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b05ca-9a7b-467a-9c95-d3ee1881bae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:59.673736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b05ca-9a7b-467a-9c95-d3ee1881bae7 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:59.674017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b05ca-9a7b-467a-9c95-d3ee1881bae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:59.674390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b05ca-9a7b-467a-9c95-d3ee1881bae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:59.676956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b05ca-9a7b-467a-9c95-d3ee1881bae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:59.679218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b05ca-9a7b-467a-9c95-d3ee1881bae7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:59.724273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439d2b2-a6fa-4451-ade8-414a2d525555 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:59.726470 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2227/4435] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:45:59.740911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439d2b2-a6fa-4451-ade8-414a2d525555 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:45:59.753767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720fa2-3bd9-482e-bd0b-1e8fb302e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:45:59.754464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720fa2-3bd9-482e-bd0b-1e8fb302e46f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:45:59.754742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720fa2-3bd9-482e-bd0b-1e8fb302e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:45:59.755074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720fa2-3bd9-482e-bd0b-1e8fb302e46f admin admin] PATH_INFO: `/v3/projects/5c091057637a41999323ce6164131d14/users/1764c4b644d1403e835e345e0b95ec81/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:45:59.800617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5720fa2-3bd9-482e-bd0b-1e8fb302e46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c091057637a41999323ce6164131d14, user_id=1764c4b644d1403e835e345e0b95ec81, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:45:59.805692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5720fa2-3bd9-482e-bd0b-1e8fb302e46f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:45:59.836274 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2209/4436] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:45:59 2022] PUT /identity/v3/projects/5c091057637a41999323ce6164131d14/users/1764c4b644d1403e835e345e0b95ec81/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:45:59.840649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b05ca-9a7b-467a-9c95-d3ee1881bae7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:45:59.855700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b05ca-9a7b-467a-9c95-d3ee1881bae7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:00.180889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:00.213423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f8222-f43b-49ff-9849-a08627b1f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:00.219119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8222-f43b-49ff-9849-a08627b1f98c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:00.219413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8222-f43b-49ff-9849-a08627b1f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:00.219694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8222-f43b-49ff-9849-a08627b1f98c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:00.222553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f8222-f43b-49ff-9849-a08627b1f98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:00.228956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f8222-f43b-49ff-9849-a08627b1f98c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:00.280648 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2228/4437] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:00.285131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720fa2-3bd9-482e-bd0b-1e8fb302e46f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:00.308246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720fa2-3bd9-482e-bd0b-1e8fb302e46f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:00.332668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982a791-6846-4ab8-b3d5-8b5bc7812a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:00.333468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982a791-6846-4ab8-b3d5-8b5bc7812a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:00.333761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982a791-6846-4ab8-b3d5-8b5bc7812a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:00.334034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982a791-6846-4ab8-b3d5-8b5bc7812a8a admin admin] PATH_INFO: `/v3/projects/5c091057637a41999323ce6164131d14/users/1764c4b644d1403e835e345e0b95ec81/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:00.346939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982a791-6846-4ab8-b3d5-8b5bc7812a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c091057637a41999323ce6164131d14, user_id=1764c4b644d1403e835e345e0b95ec81, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:00.360645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982a791-6846-4ab8-b3d5-8b5bc7812a8a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:00.415598 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2210/4438] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:00 2022] PUT /identity/v3/projects/5c091057637a41999323ce6164131d14/users/1764c4b644d1403e835e345e0b95ec81/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:00.431968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b68bb-69cc-450b-a6a3-a835b8b92e48 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:00.432313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b68bb-69cc-450b-a6a3-a835b8b92e48 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:00.432608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b68bb-69cc-450b-a6a3-a835b8b92e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:00.506019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3f8b68bb-69cc-450b-a6a3-a835b8b92e48 None None] MFA Rules not processed for user `1764c4b644d1403e835e345e0b95ec81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:00.507286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3f8b68bb-69cc-450b-a6a3-a835b8b92e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:00.746570 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2229/4439] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:00.750816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982a791-6846-4ab8-b3d5-8b5bc7812a8a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:00.771174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982a791-6846-4ab8-b3d5-8b5bc7812a8a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:00.785416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cd4f2-0c82-44b1-ae8e-7e5f1d1184a2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:00.786813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd4f2-0c82-44b1-ae8e-7e5f1d1184a2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:00.787096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd4f2-0c82-44b1-ae8e-7e5f1d1184a2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:00.787372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd4f2-0c82-44b1-ae8e-7e5f1d1184a2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:00.791017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cd4f2-0c82-44b1-ae8e-7e5f1d1184a2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:00.794346 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-6c7cd4f2-0c82-44b1-ae8e-7e5f1d1184a2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:00.794346 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:00.794346 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:00.797069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cd4f2-0c82-44b1-ae8e-7e5f1d1184a2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:00.841431 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2211/4440] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:46:00 2022] POST /identity/v3/roles => generated 235 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:00.843408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b68bb-69cc-450b-a6a3-a835b8b92e48 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:00.855291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b68bb-69cc-450b-a6a3-a835b8b92e48 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:00.870468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d053a-26e6-4a75-bd38-089e73a70985 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:00.871108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d053a-26e6-4a75-bd38-089e73a70985 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:00.871509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d053a-26e6-4a75-bd38-089e73a70985 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:00.873953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d053a-26e6-4a75-bd38-089e73a70985 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:00.878802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d053a-26e6-4a75-bd38-089e73a70985 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:00.880179 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-0b4d053a-26e6-4a75-bd38-089e73a70985 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:00.880179 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:00.880179 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:00.883505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d053a-26e6-4a75-bd38-089e73a70985 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:00.940282 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2230/4441] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:46:00 2022] POST /identity/v3/roles => generated 235 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:00.944274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cd4f2-0c82-44b1-ae8e-7e5f1d1184a2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:00.963076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cd4f2-0c82-44b1-ae8e-7e5f1d1184a2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:00.983180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73a430-1c1c-475c-a347-ad90a59648d0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:00.983180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73a430-1c1c-475c-a347-ad90a59648d0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:00.983180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73a430-1c1c-475c-a347-ad90a59648d0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:00.983715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73a430-1c1c-475c-a347-ad90a59648d0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:00.983715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73a430-1c1c-475c-a347-ad90a59648d0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:00.983715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73a430-1c1c-475c-a347-ad90a59648d0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:01.045456 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2212/4442] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:46:00 2022] POST /identity/v3/roles => generated 235 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:01.047271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d053a-26e6-4a75-bd38-089e73a70985 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:01.061720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d053a-26e6-4a75-bd38-089e73a70985 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:01.093092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b52b0-51f2-427a-be15-ba66e813ac8f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:01.096264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b52b0-51f2-427a-be15-ba66e813ac8f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:01.098993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b52b0-51f2-427a-be15-ba66e813ac8f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:01.100635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b52b0-51f2-427a-be15-ba66e813ac8f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:01.102730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b52b0-51f2-427a-be15-ba66e813ac8f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:01.106255 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-3e2b52b0-51f2-427a-be15-ba66e813ac8f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:01.106255 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:01.106255 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:01.112084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b52b0-51f2-427a-be15-ba66e813ac8f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:01.178812 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2231/4443] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:46:01 2022] POST /identity/v3/domains => generated 276 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:01.179104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73a430-1c1c-475c-a347-ad90a59648d0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:01.189297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73a430-1c1c-475c-a347-ad90a59648d0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:01.242063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:01.315074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef8edd-7423-4be7-be0e-3dd125e27b39 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:01.315659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef8edd-7423-4be7-be0e-3dd125e27b39 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:01.315872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef8edd-7423-4be7-be0e-3dd125e27b39 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:01.316147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef8edd-7423-4be7-be0e-3dd125e27b39 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:01.317544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef8edd-7423-4be7-be0e-3dd125e27b39 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:01.319923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef8edd-7423-4be7-be0e-3dd125e27b39 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:01.366485 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2213/4444] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:01 2022] POST /identity/v3/projects => generated 401 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:01.370504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b52b0-51f2-427a-be15-ba66e813ac8f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:01.393310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b52b0-51f2-427a-be15-ba66e813ac8f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:01.532462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313e0d0-e981-429e-a405-df78f47480c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:01.536658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313e0d0-e981-429e-a405-df78f47480c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:01.537085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313e0d0-e981-429e-a405-df78f47480c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:01.537583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313e0d0-e981-429e-a405-df78f47480c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:01.538307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313e0d0-e981-429e-a405-df78f47480c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:01.541928 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-6313e0d0-e981-429e-a405-df78f47480c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:01.541928 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:01.541928 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:01.543563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313e0d0-e981-429e-a405-df78f47480c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:01.590349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef8edd-7423-4be7-be0e-3dd125e27b39 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:01.599691 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2232/4445] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:46:01 2022] POST /identity/v3/groups => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:01.624064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef8edd-7423-4be7-be0e-3dd125e27b39 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:01.630682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141550d0-72d4-4450-870f-c2bb7280d46f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:01.631754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141550d0-72d4-4450-870f-c2bb7280d46f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:01.632246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141550d0-72d4-4450-870f-c2bb7280d46f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:01.632747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141550d0-72d4-4450-870f-c2bb7280d46f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:01.636397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141550d0-72d4-4450-870f-c2bb7280d46f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:01.640323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141550d0-72d4-4450-870f-c2bb7280d46f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:01.687237 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2214/4446] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:46:01 2022] POST /identity/v3/roles => generated 235 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:01.692065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313e0d0-e981-429e-a405-df78f47480c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:01.730221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313e0d0-e981-429e-a405-df78f47480c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:01.809419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574fe66-01f1-44ed-9bf3-94022ceb9a36 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:01.810953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574fe66-01f1-44ed-9bf3-94022ceb9a36 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:01.811457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574fe66-01f1-44ed-9bf3-94022ceb9a36 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:01.812073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574fe66-01f1-44ed-9bf3-94022ceb9a36 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:01.812992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574fe66-01f1-44ed-9bf3-94022ceb9a36 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:01.816870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574fe66-01f1-44ed-9bf3-94022ceb9a36 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:01.873228 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2233/4447] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:01 2022] POST /identity/v3/users => generated 442 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:01.874951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141550d0-72d4-4450-870f-c2bb7280d46f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:01.895007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141550d0-72d4-4450-870f-c2bb7280d46f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:01.907701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc051c1-1723-4061-839f-ce69a1d737cc tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:01.908340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc051c1-1723-4061-839f-ce69a1d737cc tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:01.908623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc051c1-1723-4061-839f-ce69a1d737cc tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:01.913258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc051c1-1723-4061-839f-ce69a1d737cc tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:01.914083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc051c1-1723-4061-839f-ce69a1d737cc tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:01.918415 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-7bc051c1-1723-4061-839f-ce69a1d737cc tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:01.918415 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:01.918415 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:01.923723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc051c1-1723-4061-839f-ce69a1d737cc tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:01.967032 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2215/4448] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:46:01 2022] POST /identity/v3/roles => generated 270 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:01.969690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574fe66-01f1-44ed-9bf3-94022ceb9a36 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:01.983234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574fe66-01f1-44ed-9bf3-94022ceb9a36 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:01.994537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad47a6a-7d0a-4f49-8693-aa4f6b9f715a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:01.995331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47a6a-7d0a-4f49-8693-aa4f6b9f715a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:01.995617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47a6a-7d0a-4f49-8693-aa4f6b9f715a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:01.996522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47a6a-7d0a-4f49-8693-aa4f6b9f715a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/ad4e02f0e0c84318832dc1e6226f4b9c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:02.040220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad47a6a-7d0a-4f49-8693-aa4f6b9f715a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f19c6bd49ad342369fddf6d3705a4120, user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=ad4e02f0e0c84318832dc1e6226f4b9c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:02.047633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad47a6a-7d0a-4f49-8693-aa4f6b9f715a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:02.075332 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2234/4449] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:01 2022] PUT /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/ad4e02f0e0c84318832dc1e6226f4b9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:02.079962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc051c1-1723-4061-839f-ce69a1d737cc tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:02.094989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc051c1-1723-4061-839f-ce69a1d737cc tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:02.267165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46025f-2e08-4eb2-82c7-f6305995fbb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:02.267795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46025f-2e08-4eb2-82c7-f6305995fbb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:02.268081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46025f-2e08-4eb2-82c7-f6305995fbb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:02.268362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46025f-2e08-4eb2-82c7-f6305995fbb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:02.269559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46025f-2e08-4eb2-82c7-f6305995fbb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Adding query filter params (scope.project.id=f19c6bd49ad342369fddf6d3705a4120, user.id=208f6395a353427eb0cdf98d0fb223a9) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:02.270008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46025f-2e08-4eb2-82c7-f6305995fbb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:02.271207 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-db46025f-2e08-4eb2-82c7-f6305995fbb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:02.271207 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:02.271207 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:02.272373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46025f-2e08-4eb2-82c7-f6305995fbb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:02.346549 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2216/4450] 10.222.0.16 () {58 vars in 1356 bytes} [Mon Aug 29 15:46:02 2022] GET /identity/v3/role_assignments?scope.project.id=f19c6bd49ad342369fddf6d3705a4120&user.id=208f6395a353427eb0cdf98d0fb223a9&effective => generated 228 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:02.348653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad47a6a-7d0a-4f49-8693-aa4f6b9f715a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:02.361541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:02.372884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad47a6a-7d0a-4f49-8693-aa4f6b9f715a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:02.386175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:02.388104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:02.388625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:02.389156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/ad4e02f0e0c84318832dc1e6226f4b9c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:02.392593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f19c6bd49ad342369fddf6d3705a4120, user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=ad4e02f0e0c84318832dc1e6226f4b9c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:02.425529 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:02.425529 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:02.425529 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:02.427528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:02.449030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role ad4e02f0e0c84318832dc1e6226f4b9c was removed from user 208f6395a353427eb0cdf98d0fb223a9 on project f19c6bd49ad342369fddf6d3705a4120. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:02.449309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:02.455497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:02.502598 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2235/4451] 10.222.0.16 () {58 vars in 1467 bytes} [Mon Aug 29 15:46:02 2022] DELETE /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/ad4e02f0e0c84318832dc1e6226f4b9c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:02.507412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46025f-2e08-4eb2-82c7-f6305995fbb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:02.510722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db46025f-2e08-4eb2-82c7-f6305995fbb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:02.537445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46025f-2e08-4eb2-82c7-f6305995fbb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:02.636138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:02.708646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:02.709319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:02.709641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:02.714143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/ad4e02f0e0c84318832dc1e6226f4b9c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:02.717003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=ad4e02f0e0c84318832dc1e6226f4b9c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:02.721421 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:02.721421 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:02.721421 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:02.722361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:02.833344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role ad4e02f0e0c84318832dc1e6226f4b9c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:02.833947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:02.834870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:02.838422 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2217/4452] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:02 2022] DELETE /identity/v3/roles/ad4e02f0e0c84318832dc1e6226f4b9c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:02.844718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:02.858329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1d465-3718-44e1-a9c6-ea08aab31110 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:02.966043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf4b7b-c56f-46f5-b0fc-757f6bc1946b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:02.967175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4b7b-c56f-46f5-b0fc-757f6bc1946b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:02.967661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4b7b-c56f-46f5-b0fc-757f6bc1946b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:02.968158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4b7b-c56f-46f5-b0fc-757f6bc1946b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/e3f26af6d55e43f4b470602b9951b54c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:02.971023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf4b7b-c56f-46f5-b0fc-757f6bc1946b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f19c6bd49ad342369fddf6d3705a4120, user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=e3f26af6d55e43f4b470602b9951b54c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:02.974706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf4b7b-c56f-46f5-b0fc-757f6bc1946b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:03.000306 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2236/4453] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:02 2022] PUT /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/e3f26af6d55e43f4b470602b9951b54c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:03.004121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:03.005634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:03.034975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa35d5-8a6b-4839-a0b1-f01e18b812f5 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:03.226518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79809-d750-454e-8c8a-aaf77fb1b533 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:03.229485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79809-d750-454e-8c8a-aaf77fb1b533 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:03.230242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79809-d750-454e-8c8a-aaf77fb1b533 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:03.230918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e79809-d750-454e-8c8a-aaf77fb1b533 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:03.234683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e79809-d750-454e-8c8a-aaf77fb1b533 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:03.239678 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-24e79809-d750-454e-8c8a-aaf77fb1b533 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:03.239678 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:03.239678 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:03.242127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e79809-d750-454e-8c8a-aaf77fb1b533 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:03.313240 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2218/4454] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:03 2022] PUT /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 521 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:03.319099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf4b7b-c56f-46f5-b0fc-757f6bc1946b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:03.337107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf4b7b-c56f-46f5-b0fc-757f6bc1946b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:03.492657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc839-813a-4d1f-9e18-63e7898ea371 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:03.499505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc839-813a-4d1f-9e18-63e7898ea371 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:03.500304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc839-813a-4d1f-9e18-63e7898ea371 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:03.500971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc839-813a-4d1f-9e18-63e7898ea371 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:03.503207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddc839-813a-4d1f-9e18-63e7898ea371 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Adding query filter params (scope.project.id=f19c6bd49ad342369fddf6d3705a4120, user.id=208f6395a353427eb0cdf98d0fb223a9) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:03.503941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddc839-813a-4d1f-9e18-63e7898ea371 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:03.505989 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-27ddc839-813a-4d1f-9e18-63e7898ea371 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:03.505989 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:03.505989 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:03.508754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddc839-813a-4d1f-9e18-63e7898ea371 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:03.619315 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2237/4455] 10.222.0.16 () {58 vars in 1356 bytes} [Mon Aug 29 15:46:03 2022] GET /identity/v3/role_assignments?scope.project.id=f19c6bd49ad342369fddf6d3705a4120&user.id=208f6395a353427eb0cdf98d0fb223a9&effective => generated 1061 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:46:03.623520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79809-d750-454e-8c8a-aaf77fb1b533 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:03.691066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e79809-d750-454e-8c8a-aaf77fb1b533 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:03.704271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd97da-258d-4292-89ac-3d132591d026 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:03.704271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd97da-258d-4292-89ac-3d132591d026 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:03.704271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd97da-258d-4292-89ac-3d132591d026 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:03.705012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd97da-258d-4292-89ac-3d132591d026 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:03.714691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd97da-258d-4292-89ac-3d132591d026 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:03.716740 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-23dd97da-258d-4292-89ac-3d132591d026 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:03.716740 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:03.716740 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:03.717970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd97da-258d-4292-89ac-3d132591d026 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:03.738670 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2219/4456] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:03 2022] DELETE /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:03.743196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc839-813a-4d1f-9e18-63e7898ea371 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:03.756622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc839-813a-4d1f-9e18-63e7898ea371 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:03.820037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:03.883213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502aae-4db7-497b-a251-5e1482eab5ed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:03.884622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502aae-4db7-497b-a251-5e1482eab5ed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:03.886290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502aae-4db7-497b-a251-5e1482eab5ed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:03.886937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502aae-4db7-497b-a251-5e1482eab5ed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:03.888527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66502aae-4db7-497b-a251-5e1482eab5ed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Adding query filter params (scope.project.id=f19c6bd49ad342369fddf6d3705a4120, user.id=208f6395a353427eb0cdf98d0fb223a9) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:03.889063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66502aae-4db7-497b-a251-5e1482eab5ed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:03.891806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66502aae-4db7-497b-a251-5e1482eab5ed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:03.957962 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2238/4457] 10.222.0.16 () {58 vars in 1356 bytes} [Mon Aug 29 15:46:03 2022] GET /identity/v3/role_assignments?scope.project.id=f19c6bd49ad342369fddf6d3705a4120&user.id=208f6395a353427eb0cdf98d0fb223a9&effective => generated 577 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:03.962777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd97da-258d-4292-89ac-3d132591d026 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:03.976091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd97da-258d-4292-89ac-3d132591d026 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:03.985207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027cbd9-888a-4bc4-b796-6c751a8e719e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:03.986996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027cbd9-888a-4bc4-b796-6c751a8e719e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:03.988220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027cbd9-888a-4bc4-b796-6c751a8e719e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:03.988519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027cbd9-888a-4bc4-b796-6c751a8e719e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:03.995548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027cbd9-888a-4bc4-b796-6c751a8e719e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:03.997374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027cbd9-888a-4bc4-b796-6c751a8e719e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-f027cbd9-888a-4bc4-b796-6c751a8e719e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] e3f26af6d55e43f4b470602b9951b54c does not imply 1590b1d904ba47ef99dc17dec434fdf9.: keystone.exception.ImpliedRoleNotFound: e3f26af6d55e43f4b470602b9951b54c does not imply 1590b1d904ba47ef99dc17dec434fdf9. Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = query.one() Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._iter().one() Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._only_one_row( Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:04.028095 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 29 15:46:04.029379 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 29 15:46:04.030593 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 29 15:46:04.030593 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 29 15:46:04.030593 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 29 15:46:04.030593 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e3f26af6d55e43f4b470602b9951b54c does not imply 1590b1d904ba47ef99dc17dec434fdf9. Aug 29 15:46:04.030593 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:46:04.037426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502aae-4db7-497b-a251-5e1482eab5ed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:04.037869 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2220/4458] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:03 2022] DELETE /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 137 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:46:04.052036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502aae-4db7-497b-a251-5e1482eab5ed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:04.060333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7058ee1-6727-4469-a564-395eb2756abb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:04.061171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7058ee1-6727-4469-a564-395eb2756abb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:04.061293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7058ee1-6727-4469-a564-395eb2756abb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:04.061627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7058ee1-6727-4469-a564-395eb2756abb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/e3f26af6d55e43f4b470602b9951b54c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:04.065058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7058ee1-6727-4469-a564-395eb2756abb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f19c6bd49ad342369fddf6d3705a4120, user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=e3f26af6d55e43f4b470602b9951b54c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:04.068259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7058ee1-6727-4469-a564-395eb2756abb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:04.078998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a7058ee1-6727-4469-a564-395eb2756abb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role e3f26af6d55e43f4b470602b9951b54c was removed from user 208f6395a353427eb0cdf98d0fb223a9 on project f19c6bd49ad342369fddf6d3705a4120. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:04.079299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a7058ee1-6727-4469-a564-395eb2756abb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:04.080063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a7058ee1-6727-4469-a564-395eb2756abb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:04.106757 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2239/4459] 10.222.0.16 () {58 vars in 1467 bytes} [Mon Aug 29 15:46:04 2022] DELETE /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/e3f26af6d55e43f4b470602b9951b54c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:04.112008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027cbd9-888a-4bc4-b796-6c751a8e719e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:04.114006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f027cbd9-888a-4bc4-b796-6c751a8e719e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:04.137446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027cbd9-888a-4bc4-b796-6c751a8e719e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:04.278348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ade812-9948-40ca-a52e-7f660afcae80 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:04.278981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ade812-9948-40ca-a52e-7f660afcae80 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:04.279266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ade812-9948-40ca-a52e-7f660afcae80 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:04.279545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ade812-9948-40ca-a52e-7f660afcae80 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:04.280280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ade812-9948-40ca-a52e-7f660afcae80 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:04.282819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ade812-9948-40ca-a52e-7f660afcae80 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:04.289655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:04.354095 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2221/4460] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:04 2022] POST /identity/v3/roles => generated 272 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:04.358209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7058ee1-6727-4469-a564-395eb2756abb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:04.369343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7058ee1-6727-4469-a564-395eb2756abb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:04.375373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab9cb-54ef-4e34-b3b1-a997470527d4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:04.376213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab9cb-54ef-4e34-b3b1-a997470527d4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:04.376648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab9cb-54ef-4e34-b3b1-a997470527d4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:04.377272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab9cb-54ef-4e34-b3b1-a997470527d4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:04.378373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab9cb-54ef-4e34-b3b1-a997470527d4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Adding query filter params (domain_id=bf7ab92494934f39bbee2c069d445ece) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:04.378844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab9cb-54ef-4e34-b3b1-a997470527d4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:04.380083 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-c0eab9cb-54ef-4e34-b3b1-a997470527d4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:04.380083 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:04.380083 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:04.381550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab9cb-54ef-4e34-b3b1-a997470527d4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:04.394368 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2240/4461] 10.222.0.16 () {58 vars in 1207 bytes} [Mon Aug 29 15:46:04 2022] GET /identity/v3/roles?domain_id=bf7ab92494934f39bbee2c069d445ece => generated 409 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:04.398474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ade812-9948-40ca-a52e-7f660afcae80 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:04.412547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ade812-9948-40ca-a52e-7f660afcae80 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:04.418329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239fec3-2f63-4758-ac56-055a281e2d97 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:04.419959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239fec3-2f63-4758-ac56-055a281e2d97 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:04.420440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239fec3-2f63-4758-ac56-055a281e2d97 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:04.420891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239fec3-2f63-4758-ac56-055a281e2d97 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/ad1383aac765430fac00c20bf250376e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:04.422782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239fec3-2f63-4758-ac56-055a281e2d97 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=ad1383aac765430fac00c20bf250376e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:04.425650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239fec3-2f63-4758-ac56-055a281e2d97 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:04.487474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f239fec3-2f63-4758-ac56-055a281e2d97 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role ad1383aac765430fac00c20bf250376e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:04.488056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f239fec3-2f63-4758-ac56-055a281e2d97 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:04.494399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f239fec3-2f63-4758-ac56-055a281e2d97 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:04.503068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab9cb-54ef-4e34-b3b1-a997470527d4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:04.503803 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2222/4462] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:04 2022] DELETE /identity/v3/roles/ad1383aac765430fac00c20bf250376e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:04.511436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c0eab9cb-54ef-4e34-b3b1-a997470527d4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:04.539405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab9cb-54ef-4e34-b3b1-a997470527d4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:04.661128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0b629-07fc-4158-8693-d00bb19f73ca tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:04.661874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0b629-07fc-4158-8693-d00bb19f73ca tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:04.662224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0b629-07fc-4158-8693-d00bb19f73ca tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:04.662584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0b629-07fc-4158-8693-d00bb19f73ca tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:04.663309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0b629-07fc-4158-8693-d00bb19f73ca tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Adding query filter params (domain_id=bf7ab92494934f39bbee2c069d445ece) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:04.663686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0b629-07fc-4158-8693-d00bb19f73ca tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:04.665951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0b629-07fc-4158-8693-d00bb19f73ca tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:04.679412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239fec3-2f63-4758-ac56-055a281e2d97 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:04.694201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239fec3-2f63-4758-ac56-055a281e2d97 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:04.695455 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2241/4463] 10.222.0.16 () {58 vars in 1207 bytes} [Mon Aug 29 15:46:04 2022] GET /identity/v3/roles?domain_id=bf7ab92494934f39bbee2c069d445ece => generated 148 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:04.709098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a779293-4a4b-4b1a-a109-cbd24c4539e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:04.710347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a779293-4a4b-4b1a-a109-cbd24c4539e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:04.710948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a779293-4a4b-4b1a-a109-cbd24c4539e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:04.711830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a779293-4a4b-4b1a-a109-cbd24c4539e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/ad1383aac765430fac00c20bf250376e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:04.738538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a779293-4a4b-4b1a-a109-cbd24c4539e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-3a779293-4a4b-4b1a-a109-cbd24c4539e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Could not find role: ad1383aac765430fac00c20bf250376e.: keystone.exception.RoleNotFound: Could not find role: ad1383aac765430fac00c20bf250376e. Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Aug 29 15:46:04.744876 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:46:04.746040 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ad1383aac765430fac00c20bf250376e. Aug 29 15:46:04.747249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:46:04.756148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0b629-07fc-4158-8693-d00bb19f73ca tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:04.763878 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2223/4464] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:04 2022] DELETE /identity/v3/roles/ad1383aac765430fac00c20bf250376e => generated 110 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:46:04.768494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0b629-07fc-4158-8693-d00bb19f73ca tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:04.781701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996a743-f9df-4c60-8b52-3a384518845c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:04.782549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996a743-f9df-4c60-8b52-3a384518845c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:04.782919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996a743-f9df-4c60-8b52-3a384518845c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:04.783275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996a743-f9df-4c60-8b52-3a384518845c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/bf7ab92494934f39bbee2c069d445ece/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:04.813288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996a743-f9df-4c60-8b52-3a384518845c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=bf7ab92494934f39bbee2c069d445ece, group_id=54f05765b5c7472889f7a195102d7555, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:04.829470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996a743-f9df-4c60-8b52-3a384518845c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:04.879027 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2242/4465] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:04 2022] PUT /identity/v3/domains/bf7ab92494934f39bbee2c069d445ece/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:04.884565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a779293-4a4b-4b1a-a109-cbd24c4539e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:04.901327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a779293-4a4b-4b1a-a109-cbd24c4539e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:05.020036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9848a2-339d-4095-b51b-e61fa313b99d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:05.020934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9848a2-339d-4095-b51b-e61fa313b99d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:05.021462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9848a2-339d-4095-b51b-e61fa313b99d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:05.021655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9848a2-339d-4095-b51b-e61fa313b99d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/bf7ab92494934f39bbee2c069d445ece/groups/54f05765b5c7472889f7a195102d7555/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:05.023618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9848a2-339d-4095-b51b-e61fa313b99d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=bf7ab92494934f39bbee2c069d445ece, group_id=54f05765b5c7472889f7a195102d7555)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:05.025950 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-ea9848a2-339d-4095-b51b-e61fa313b99d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:05.025950 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:05.025950 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:05.027604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9848a2-339d-4095-b51b-e61fa313b99d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:05.046888 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2224/4466] 10.222.0.16 () {58 vars in 1365 bytes} [Mon Aug 29 15:46:04 2022] GET /identity/v3/domains/bf7ab92494934f39bbee2c069d445ece/groups/54f05765b5c7472889f7a195102d7555/roles => generated 410 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:05.048352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996a743-f9df-4c60-8b52-3a384518845c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:05.063019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996a743-f9df-4c60-8b52-3a384518845c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:05.069536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74235e-e543-4342-8886-c01857400c78 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:05.070219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74235e-e543-4342-8886-c01857400c78 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:05.070503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74235e-e543-4342-8886-c01857400c78 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:05.071661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74235e-e543-4342-8886-c01857400c78 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/bf7ab92494934f39bbee2c069d445ece/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:05.074164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74235e-e543-4342-8886-c01857400c78 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=bf7ab92494934f39bbee2c069d445ece, group_id=54f05765b5c7472889f7a195102d7555, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:05.075356 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-4f74235e-e543-4342-8886-c01857400c78 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:05.075356 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:05.075356 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:05.077710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74235e-e543-4342-8886-c01857400c78 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:05.090530 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2243/4467] 10.222.0.16 () {58 vars in 1465 bytes} [Mon Aug 29 15:46:05 2022] HEAD /identity/v3/domains/bf7ab92494934f39bbee2c069d445ece/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:05.091995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9848a2-339d-4095-b51b-e61fa313b99d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:05.105113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9848a2-339d-4095-b51b-e61fa313b99d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:05.124622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:05.125416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:05.127223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:05.128882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/bf7ab92494934f39bbee2c069d445ece/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:05.139510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=bf7ab92494934f39bbee2c069d445ece, group_id=54f05765b5c7472889f7a195102d7555, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:05.150692 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:05.150692 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:05.150692 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:05.153315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:05.170117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role 749f9a3b448146bfbe04f83f5865760d was removed from group 54f05765b5c7472889f7a195102d7555 on domain bf7ab92494934f39bbee2c069d445ece. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:05.170280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:05.170975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:05.194940 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2225/4468] 10.222.0.16 () {58 vars in 1467 bytes} [Mon Aug 29 15:46:05 2022] DELETE /identity/v3/domains/bf7ab92494934f39bbee2c069d445ece/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:05.201971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74235e-e543-4342-8886-c01857400c78 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:05.204331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4f74235e-e543-4342-8886-c01857400c78 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:05.232195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74235e-e543-4342-8886-c01857400c78 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:05.283994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:05.402928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ffe6a-5bb2-4d49-ad34-398842ce7d71 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:05.403754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ffe6a-5bb2-4d49-ad34-398842ce7d71 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:05.404214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ffe6a-5bb2-4d49-ad34-398842ce7d71 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:05.404585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ffe6a-5bb2-4d49-ad34-398842ce7d71 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:05.417118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ffe6a-5bb2-4d49-ad34-398842ce7d71 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f19c6bd49ad342369fddf6d3705a4120, group_id=54f05765b5c7472889f7a195102d7555, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:05.421579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ffe6a-5bb2-4d49-ad34-398842ce7d71 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:05.451445 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2244/4469] 10.222.0.16 () {60 vars in 1486 bytes} [Mon Aug 29 15:46:05 2022] PUT /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:05.456735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:05.472694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660172-bd33-49c4-8d49-37ca1d9f9b79 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:05.769030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283554a3-12a8-4afd-ac42-24dfad61c29d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:05.769812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283554a3-12a8-4afd-ac42-24dfad61c29d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:05.770107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283554a3-12a8-4afd-ac42-24dfad61c29d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:05.770391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283554a3-12a8-4afd-ac42-24dfad61c29d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/groups/54f05765b5c7472889f7a195102d7555/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:05.781986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283554a3-12a8-4afd-ac42-24dfad61c29d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_grants(project_id=f19c6bd49ad342369fddf6d3705a4120, group_id=54f05765b5c7472889f7a195102d7555)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:05.784552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283554a3-12a8-4afd-ac42-24dfad61c29d tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:05.841924 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2226/4470] 10.222.0.16 () {58 vars in 1368 bytes} [Mon Aug 29 15:46:05 2022] GET /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/groups/54f05765b5c7472889f7a195102d7555/roles => generated 411 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:05.845970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ffe6a-5bb2-4d49-ad34-398842ce7d71 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:05.863708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ffe6a-5bb2-4d49-ad34-398842ce7d71 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:05.873754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358bc42-8991-4a13-ad72-17a2369ae231 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:05.874607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358bc42-8991-4a13-ad72-17a2369ae231 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:05.874992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358bc42-8991-4a13-ad72-17a2369ae231 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:05.875529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358bc42-8991-4a13-ad72-17a2369ae231 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/groups/54f05765b5c7472889f7a195102d7555/users/208f6395a353427eb0cdf98d0fb223a9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:05.882046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358bc42-8991-4a13-ad72-17a2369ae231 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=54f05765b5c7472889f7a195102d7555, user_id=208f6395a353427eb0cdf98d0fb223a9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:05.883842 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-9358bc42-8991-4a13-ad72-17a2369ae231 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:05.883842 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:05.883842 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:05.885829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358bc42-8991-4a13-ad72-17a2369ae231 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:05.939793 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2245/4471] 10.222.0.16 () {60 vars in 1360 bytes} [Mon Aug 29 15:46:05 2022] PUT /identity/v3/groups/54f05765b5c7472889f7a195102d7555/users/208f6395a353427eb0cdf98d0fb223a9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:05.944539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb1f5e-a0dc-4a40-a3c6-faa67c8363c4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:05.944826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb1f5e-a0dc-4a40-a3c6-faa67c8363c4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:05.945102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb1f5e-a0dc-4a40-a3c6-faa67c8363c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:05.953021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:06.031722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6ccb1f5e-a0dc-4a40-a3c6-faa67c8363c4 None None] MFA Rules not processed for user `208f6395a353427eb0cdf98d0fb223a9`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:06.033267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6ccb1f5e-a0dc-4a40-a3c6-faa67c8363c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:06.295961 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2227/4472] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:06.298876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358bc42-8991-4a13-ad72-17a2369ae231 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:06.438566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358bc42-8991-4a13-ad72-17a2369ae231 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:06.453909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e46d8-5cef-4d31-96b8-970f71e7e994 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:06.455125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e46d8-5cef-4d31-96b8-970f71e7e994 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:06.455469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e46d8-5cef-4d31-96b8-970f71e7e994 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:06.457251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e46d8-5cef-4d31-96b8-970f71e7e994 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:06.462659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e46d8-5cef-4d31-96b8-970f71e7e994 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f19c6bd49ad342369fddf6d3705a4120, group_id=54f05765b5c7472889f7a195102d7555, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:06.481485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e46d8-5cef-4d31-96b8-970f71e7e994 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:06.517294 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2246/4473] 10.222.0.16 () {58 vars in 1468 bytes} [Mon Aug 29 15:46:06 2022] HEAD /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:06.521471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb1f5e-a0dc-4a40-a3c6-faa67c8363c4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:06.550246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb1f5e-a0dc-4a40-a3c6-faa67c8363c4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:06.563262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0203285-d9e6-44c7-a305-b446f9d2e846 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:06.564480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0203285-d9e6-44c7-a305-b446f9d2e846 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:06.564767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0203285-d9e6-44c7-a305-b446f9d2e846 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:06.565045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0203285-d9e6-44c7-a305-b446f9d2e846 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:06.574809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0203285-d9e6-44c7-a305-b446f9d2e846 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f19c6bd49ad342369fddf6d3705a4120, group_id=54f05765b5c7472889f7a195102d7555, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:06.577567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0203285-d9e6-44c7-a305-b446f9d2e846 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:06.594168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b0203285-d9e6-44c7-a305-b446f9d2e846 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role 749f9a3b448146bfbe04f83f5865760d was removed from group 54f05765b5c7472889f7a195102d7555 on project f19c6bd49ad342369fddf6d3705a4120. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:06.594470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b0203285-d9e6-44c7-a305-b446f9d2e846 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:06.598036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b0203285-d9e6-44c7-a305-b446f9d2e846 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:06.621627 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2228/4474] 10.222.0.16 () {58 vars in 1470 bytes} [Mon Aug 29 15:46:06 2022] DELETE /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:06.625980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e46d8-5cef-4d31-96b8-970f71e7e994 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:06.628104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-003e46d8-5cef-4d31-96b8-970f71e7e994 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:06.652030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e46d8-5cef-4d31-96b8-970f71e7e994 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:06.901228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c91cad-c938-4103-9691-b1a49abc5e0a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:06.901907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91cad-c938-4103-9691-b1a49abc5e0a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:06.902194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91cad-c938-4103-9691-b1a49abc5e0a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:06.902471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91cad-c938-4103-9691-b1a49abc5e0a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/groups/54f05765b5c7472889f7a195102d7555/users/208f6395a353427eb0cdf98d0fb223a9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:06.907320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c91cad-c938-4103-9691-b1a49abc5e0a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=54f05765b5c7472889f7a195102d7555, user_id=208f6395a353427eb0cdf98d0fb223a9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:06.908905 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-48c91cad-c938-4103-9691-b1a49abc5e0a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:06.908905 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:06.908905 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:06.910693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c91cad-c938-4103-9691-b1a49abc5e0a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:06.931710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-48c91cad-c938-4103-9691-b1a49abc5e0a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '208f6395a353427eb0cdf98d0fb223a9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:06.961247 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2247/4475] 10.222.0.16 () {58 vars in 1344 bytes} [Mon Aug 29 15:46:06 2022] DELETE /identity/v3/groups/54f05765b5c7472889f7a195102d7555/users/208f6395a353427eb0cdf98d0fb223a9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:06.962673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0203285-d9e6-44c7-a305-b446f9d2e846 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:06.978661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0203285-d9e6-44c7-a305-b446f9d2e846 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:07.144638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10a01b-b956-4086-b7be-9c4e2937f8c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:07.145682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10a01b-b956-4086-b7be-9c4e2937f8c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:07.146042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10a01b-b956-4086-b7be-9c4e2937f8c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:07.146542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10a01b-b956-4086-b7be-9c4e2937f8c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/system/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:07.151882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10a01b-b956-4086-b7be-9c4e2937f8c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=54f05765b5c7472889f7a195102d7555, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:07.153113 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-ec10a01b-b956-4086-b7be-9c4e2937f8c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:07.153113 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:07.153113 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:07.156135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10a01b-b956-4086-b7be-9c4e2937f8c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:07.177002 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2229/4476] 10.222.0.16 () {60 vars in 1381 bytes} [Mon Aug 29 15:46:06 2022] PUT /identity/v3/system/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:07.178682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c91cad-c938-4103-9691-b1a49abc5e0a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:07.198760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c91cad-c938-4103-9691-b1a49abc5e0a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:07.207035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcfd81-9a75-450b-85d0-012541c62db3 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:07.207901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcfd81-9a75-450b-85d0-012541c62db3 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:07.208213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcfd81-9a75-450b-85d0-012541c62db3 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:07.208465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcfd81-9a75-450b-85d0-012541c62db3 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/system/groups/54f05765b5c7472889f7a195102d7555/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:07.210616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcfd81-9a75-450b-85d0-012541c62db3 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=54f05765b5c7472889f7a195102d7555)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:07.213822 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-26fcfd81-9a75-450b-85d0-012541c62db3 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:07.213822 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:07.213822 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:07.216640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcfd81-9a75-450b-85d0-012541c62db3 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:07.242536 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2248/4477] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:46:07 2022] GET /identity/v3/system/groups/54f05765b5c7472889f7a195102d7555/roles => generated 376 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:07.243829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10a01b-b956-4086-b7be-9c4e2937f8c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:07.259592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10a01b-b956-4086-b7be-9c4e2937f8c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:07.267598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d0959-91f3-4be0-b369-726230efc980 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:07.269493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0959-91f3-4be0-b369-726230efc980 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:07.269966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0959-91f3-4be0-b369-726230efc980 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:07.271935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0959-91f3-4be0-b369-726230efc980 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/system/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:07.274999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d0959-91f3-4be0-b369-726230efc980 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=54f05765b5c7472889f7a195102d7555, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:07.276600 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-0d0d0959-91f3-4be0-b369-726230efc980 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:07.276600 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:07.276600 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:07.277966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d0959-91f3-4be0-b369-726230efc980 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:07.288616 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2230/4478] 10.222.0.16 () {58 vars in 1363 bytes} [Mon Aug 29 15:46:07 2022] HEAD /identity/v3/system/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:07.293156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcfd81-9a75-450b-85d0-012541c62db3 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:07.319193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcfd81-9a75-450b-85d0-012541c62db3 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:07.341836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd12f7-8cdc-4617-b9b9-53b316a5e386 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:07.343407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd12f7-8cdc-4617-b9b9-53b316a5e386 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:07.343886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd12f7-8cdc-4617-b9b9-53b316a5e386 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:07.344725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd12f7-8cdc-4617-b9b9-53b316a5e386 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/system/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:07.349900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd12f7-8cdc-4617-b9b9-53b316a5e386 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=54f05765b5c7472889f7a195102d7555, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:07.351197 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-03cd12f7-8cdc-4617-b9b9-53b316a5e386 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:07.351197 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:07.351197 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:07.353026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd12f7-8cdc-4617-b9b9-53b316a5e386 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:07.379520 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2249/4479] 10.222.0.16 () {58 vars in 1365 bytes} [Mon Aug 29 15:46:07 2022] DELETE /identity/v3/system/groups/54f05765b5c7472889f7a195102d7555/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:07.379720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d0959-91f3-4be0-b369-726230efc980 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:07.397547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d0959-91f3-4be0-b369-726230efc980 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:07.422982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119e31c-923b-4934-afba-ab2017ec8bba tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:07.423981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119e31c-923b-4934-afba-ab2017ec8bba tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:07.424363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119e31c-923b-4934-afba-ab2017ec8bba tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:07.425891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119e31c-923b-4934-afba-ab2017ec8bba tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/bf7ab92494934f39bbee2c069d445ece/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:07.436328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119e31c-923b-4934-afba-ab2017ec8bba tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=bf7ab92494934f39bbee2c069d445ece, user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:07.439443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119e31c-923b-4934-afba-ab2017ec8bba tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:07.473476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd12f7-8cdc-4617-b9b9-53b316a5e386 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:07.483561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2231/4480] 10.222.0.16 () {60 vars in 1480 bytes} [Mon Aug 29 15:46:07 2022] PUT /identity/v3/domains/bf7ab92494934f39bbee2c069d445ece/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:07.488947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd12f7-8cdc-4617-b9b9-53b316a5e386 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:07.495355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:07.665193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf7fb9-359a-438d-9cf2-cd38696b878b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:07.665978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf7fb9-359a-438d-9cf2-cd38696b878b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:07.666581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf7fb9-359a-438d-9cf2-cd38696b878b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:07.675954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf7fb9-359a-438d-9cf2-cd38696b878b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/bf7ab92494934f39bbee2c069d445ece/users/208f6395a353427eb0cdf98d0fb223a9/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:07.685057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf7fb9-359a-438d-9cf2-cd38696b878b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=bf7ab92494934f39bbee2c069d445ece, user_id=208f6395a353427eb0cdf98d0fb223a9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:07.702191 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-4dcf7fb9-359a-438d-9cf2-cd38696b878b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:07.702191 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:07.702191 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:07.706379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf7fb9-359a-438d-9cf2-cd38696b878b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:07.721209 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2250/4481] 10.222.0.16 () {58 vars in 1362 bytes} [Mon Aug 29 15:46:07 2022] GET /identity/v3/domains/bf7ab92494934f39bbee2c069d445ece/users/208f6395a353427eb0cdf98d0fb223a9/roles => generated 409 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:07.728659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119e31c-923b-4934-afba-ab2017ec8bba tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:07.759346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119e31c-923b-4934-afba-ab2017ec8bba tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:07.776030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d94ad-9cbb-42b5-ad4f-c506a70af683 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:07.777123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d94ad-9cbb-42b5-ad4f-c506a70af683 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:07.777649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d94ad-9cbb-42b5-ad4f-c506a70af683 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:07.778138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d94ad-9cbb-42b5-ad4f-c506a70af683 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/bf7ab92494934f39bbee2c069d445ece/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:07.785294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d94ad-9cbb-42b5-ad4f-c506a70af683 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=bf7ab92494934f39bbee2c069d445ece, user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:07.786753 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-486d94ad-9cbb-42b5-ad4f-c506a70af683 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:07.786753 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:07.786753 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:07.789106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d94ad-9cbb-42b5-ad4f-c506a70af683 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:07.811261 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2232/4482] 10.222.0.16 () {58 vars in 1462 bytes} [Mon Aug 29 15:46:07 2022] HEAD /identity/v3/domains/bf7ab92494934f39bbee2c069d445ece/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:07.815230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf7fb9-359a-438d-9cf2-cd38696b878b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:07.833555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf7fb9-359a-438d-9cf2-cd38696b878b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:07.875296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b95d27-f4eb-427c-883d-c1678cf9258a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:07.876175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b95d27-f4eb-427c-883d-c1678cf9258a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:07.876595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b95d27-f4eb-427c-883d-c1678cf9258a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:07.876933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b95d27-f4eb-427c-883d-c1678cf9258a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/bf7ab92494934f39bbee2c069d445ece/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:07.884998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b95d27-f4eb-427c-883d-c1678cf9258a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=bf7ab92494934f39bbee2c069d445ece, user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:07.887977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b95d27-f4eb-427c-883d-c1678cf9258a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:07.906681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b5b95d27-f4eb-427c-883d-c1678cf9258a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role 749f9a3b448146bfbe04f83f5865760d was removed from user 208f6395a353427eb0cdf98d0fb223a9 on domain bf7ab92494934f39bbee2c069d445ece. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:07.907160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b5b95d27-f4eb-427c-883d-c1678cf9258a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:07.913283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b5b95d27-f4eb-427c-883d-c1678cf9258a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:07.959472 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2251/4483] 10.222.0.16 () {58 vars in 1464 bytes} [Mon Aug 29 15:46:07 2022] DELETE /identity/v3/domains/bf7ab92494934f39bbee2c069d445ece/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:07.965050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d94ad-9cbb-42b5-ad4f-c506a70af683 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:07.967718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-486d94ad-9cbb-42b5-ad4f-c506a70af683 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:07.991085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d94ad-9cbb-42b5-ad4f-c506a70af683 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:08.003425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:08.192678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f56f9d-968c-4bcb-b1fe-8280ed5285ab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:08.195613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f56f9d-968c-4bcb-b1fe-8280ed5285ab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:08.196392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f56f9d-968c-4bcb-b1fe-8280ed5285ab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:08.196674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f56f9d-968c-4bcb-b1fe-8280ed5285ab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:08.203693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f56f9d-968c-4bcb-b1fe-8280ed5285ab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f19c6bd49ad342369fddf6d3705a4120, user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:08.212167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f56f9d-968c-4bcb-b1fe-8280ed5285ab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:08.262116 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2233/4484] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:07 2022] PUT /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:08.263501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b95d27-f4eb-427c-883d-c1678cf9258a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:08.283233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b95d27-f4eb-427c-883d-c1678cf9258a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:08.526940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc57bc-1ecc-4a06-9aa6-5c6120d02349 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:08.527647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc57bc-1ecc-4a06-9aa6-5c6120d02349 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:08.527919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc57bc-1ecc-4a06-9aa6-5c6120d02349 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:08.529939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc57bc-1ecc-4a06-9aa6-5c6120d02349 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:08.545849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc57bc-1ecc-4a06-9aa6-5c6120d02349 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_grants(project_id=f19c6bd49ad342369fddf6d3705a4120, user_id=208f6395a353427eb0cdf98d0fb223a9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:08.548453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc57bc-1ecc-4a06-9aa6-5c6120d02349 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:08.567232 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2252/4485] 10.222.0.16 () {58 vars in 1365 bytes} [Mon Aug 29 15:46:08 2022] GET /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles => generated 410 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:08.571388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f56f9d-968c-4bcb-b1fe-8280ed5285ab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:08.599892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f56f9d-968c-4bcb-b1fe-8280ed5285ab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:08.616718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764828c0-47fb-4e75-946a-25ef6eeabeae tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:08.618154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764828c0-47fb-4e75-946a-25ef6eeabeae tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:08.618552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764828c0-47fb-4e75-946a-25ef6eeabeae tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:08.620079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764828c0-47fb-4e75-946a-25ef6eeabeae tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:08.622860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764828c0-47fb-4e75-946a-25ef6eeabeae tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f19c6bd49ad342369fddf6d3705a4120, user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:08.626408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764828c0-47fb-4e75-946a-25ef6eeabeae tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:08.635045 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2234/4486] 10.222.0.16 () {58 vars in 1465 bytes} [Mon Aug 29 15:46:08 2022] HEAD /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:08.639327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc57bc-1ecc-4a06-9aa6-5c6120d02349 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:08.656222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc57bc-1ecc-4a06-9aa6-5c6120d02349 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:08.673024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd3f88-61c1-45dc-a350-589822282997 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:08.674157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd3f88-61c1-45dc-a350-589822282997 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:08.674525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd3f88-61c1-45dc-a350-589822282997 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:08.674943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd3f88-61c1-45dc-a350-589822282997 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:08.682736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd3f88-61c1-45dc-a350-589822282997 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f19c6bd49ad342369fddf6d3705a4120, user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:08.686050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd3f88-61c1-45dc-a350-589822282997 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:08.711529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7dfd3f88-61c1-45dc-a350-589822282997 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role 749f9a3b448146bfbe04f83f5865760d was removed from user 208f6395a353427eb0cdf98d0fb223a9 on project f19c6bd49ad342369fddf6d3705a4120. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:08.711924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7dfd3f88-61c1-45dc-a350-589822282997 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:08.714968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7dfd3f88-61c1-45dc-a350-589822282997 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:08.741170 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2253/4487] 10.222.0.16 () {58 vars in 1467 bytes} [Mon Aug 29 15:46:08 2022] DELETE /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:08.746773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764828c0-47fb-4e75-946a-25ef6eeabeae tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:08.756585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-764828c0-47fb-4e75-946a-25ef6eeabeae tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:08.785010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764828c0-47fb-4e75-946a-25ef6eeabeae tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:09.006918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a684d98-ee3a-48a0-b1e6-112a068c9c65 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:09.010268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a684d98-ee3a-48a0-b1e6-112a068c9c65 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:09.010879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a684d98-ee3a-48a0-b1e6-112a068c9c65 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:09.011424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a684d98-ee3a-48a0-b1e6-112a068c9c65 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/system/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:09.015781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a684d98-ee3a-48a0-b1e6-112a068c9c65 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:09.019428 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-1a684d98-ee3a-48a0-b1e6-112a068c9c65 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:09.019428 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:09.019428 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:09.020932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a684d98-ee3a-48a0-b1e6-112a068c9c65 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:09.038589 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2235/4488] 10.222.0.16 () {60 vars in 1378 bytes} [Mon Aug 29 15:46:08 2022] PUT /identity/v3/system/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:09.043940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd3f88-61c1-45dc-a350-589822282997 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:09.061619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd3f88-61c1-45dc-a350-589822282997 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:09.072644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56535eba-fc0e-4626-a7d9-a41f4f48ca62 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:09.073656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56535eba-fc0e-4626-a7d9-a41f4f48ca62 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:09.075138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56535eba-fc0e-4626-a7d9-a41f4f48ca62 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:09.075737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56535eba-fc0e-4626-a7d9-a41f4f48ca62 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/system/users/208f6395a353427eb0cdf98d0fb223a9/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:09.079897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56535eba-fc0e-4626-a7d9-a41f4f48ca62 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=208f6395a353427eb0cdf98d0fb223a9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:09.085703 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-56535eba-fc0e-4626-a7d9-a41f4f48ca62 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:09.085703 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:09.085703 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:09.088540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56535eba-fc0e-4626-a7d9-a41f4f48ca62 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:09.139507 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2254/4489] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:46:09 2022] GET /identity/v3/system/users/208f6395a353427eb0cdf98d0fb223a9/roles => generated 375 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:09.143531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a684d98-ee3a-48a0-b1e6-112a068c9c65 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:09.163996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a684d98-ee3a-48a0-b1e6-112a068c9c65 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:09.177946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef191b96-2317-4cf0-92f1-16fdbdd62bcf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:09.180182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef191b96-2317-4cf0-92f1-16fdbdd62bcf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:09.181019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef191b96-2317-4cf0-92f1-16fdbdd62bcf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:09.182085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef191b96-2317-4cf0-92f1-16fdbdd62bcf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/system/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:09.187941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef191b96-2317-4cf0-92f1-16fdbdd62bcf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:09.189941 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-ef191b96-2317-4cf0-92f1-16fdbdd62bcf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:09.189941 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:09.189941 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:09.193104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef191b96-2317-4cf0-92f1-16fdbdd62bcf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:09.209675 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2236/4490] 10.222.0.16 () {58 vars in 1360 bytes} [Mon Aug 29 15:46:09 2022] HEAD /identity/v3/system/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:09.214460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56535eba-fc0e-4626-a7d9-a41f4f48ca62 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:09.230931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56535eba-fc0e-4626-a7d9-a41f4f48ca62 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:09.241518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af20b-fb67-475f-93c9-efef6f0d3f94 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:09.244424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af20b-fb67-475f-93c9-efef6f0d3f94 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:09.245685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af20b-fb67-475f-93c9-efef6f0d3f94 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:09.248135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af20b-fb67-475f-93c9-efef6f0d3f94 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/system/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:09.252909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303af20b-fb67-475f-93c9-efef6f0d3f94 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=208f6395a353427eb0cdf98d0fb223a9, role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:09.254554 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-303af20b-fb67-475f-93c9-efef6f0d3f94 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:09.254554 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:09.254554 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:09.257738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303af20b-fb67-475f-93c9-efef6f0d3f94 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:09.273566 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2255/4491] 10.222.0.16 () {58 vars in 1362 bytes} [Mon Aug 29 15:46:09 2022] DELETE /identity/v3/system/users/208f6395a353427eb0cdf98d0fb223a9/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:09.279729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef191b96-2317-4cf0-92f1-16fdbdd62bcf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:09.292716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef191b96-2317-4cf0-92f1-16fdbdd62bcf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:09.300220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2851f4d-394b-4e55-b576-da1c33f790b4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:09.301219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851f4d-394b-4e55-b576-da1c33f790b4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:09.301715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851f4d-394b-4e55-b576-da1c33f790b4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:09.302138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851f4d-394b-4e55-b576-da1c33f790b4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:09.303049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2851f4d-394b-4e55-b576-da1c33f790b4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:09.305017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2851f4d-394b-4e55-b576-da1c33f790b4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:09.327514 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2237/4492] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:46:09 2022] POST /identity/v3/roles => generated 270 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:09.331796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af20b-fb67-475f-93c9-efef6f0d3f94 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:09.344470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af20b-fb67-475f-93c9-efef6f0d3f94 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:09.350541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f4cd-1bdc-4fdf-b7ca-0721c48d617a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:09.351349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f4cd-1bdc-4fdf-b7ca-0721c48d617a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:09.352670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f4cd-1bdc-4fdf-b7ca-0721c48d617a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:09.353049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f4cd-1bdc-4fdf-b7ca-0721c48d617a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:09.353895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84f4cd-1bdc-4fdf-b7ca-0721c48d617a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:09.355096 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-8f84f4cd-1bdc-4fdf-b7ca-0721c48d617a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:09.355096 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:09.355096 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:09.356271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84f4cd-1bdc-4fdf-b7ca-0721c48d617a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:09.379916 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2256/4493] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:46:09 2022] POST /identity/v3/roles => generated 269 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:09.383694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2851f4d-394b-4e55-b576-da1c33f790b4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:09.400126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2851f4d-394b-4e55-b576-da1c33f790b4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:09.454590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88f0b1-05e6-4e11-a8e2-fbb75d2170eb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:09.455499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88f0b1-05e6-4e11-a8e2-fbb75d2170eb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:09.455997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88f0b1-05e6-4e11-a8e2-fbb75d2170eb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:09.456462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88f0b1-05e6-4e11-a8e2-fbb75d2170eb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/efebaf5149ba4b6890f47a2f096e69cb` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:09.480318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88f0b1-05e6-4e11-a8e2-fbb75d2170eb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0ad491124aca4124b8d8203c064bf379, implied_role_id=efebaf5149ba4b6890f47a2f096e69cb)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:09.481912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88f0b1-05e6-4e11-a8e2-fbb75d2170eb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:09.544659 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2238/4494] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:09 2022] PUT /identity/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/efebaf5149ba4b6890f47a2f096e69cb => generated 530 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:09.548364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f4cd-1bdc-4fdf-b7ca-0721c48d617a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:09.568021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f4cd-1bdc-4fdf-b7ca-0721c48d617a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:09.608114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:09.795471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab7686-f3f3-4cd1-9b0e-ebbd14d97e96 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:09.796126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab7686-f3f3-4cd1-9b0e-ebbd14d97e96 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:09.796404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab7686-f3f3-4cd1-9b0e-ebbd14d97e96 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:09.796694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab7686-f3f3-4cd1-9b0e-ebbd14d97e96 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:09.797431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab7686-f3f3-4cd1-9b0e-ebbd14d97e96 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:09.799605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab7686-f3f3-4cd1-9b0e-ebbd14d97e96 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:09.852867 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2257/4495] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:46:09 2022] POST /identity/v3/domains => generated 276 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:09.870377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88f0b1-05e6-4e11-a8e2-fbb75d2170eb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:09.890472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88f0b1-05e6-4e11-a8e2-fbb75d2170eb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:09.972981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:10.002874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cbe94-3e0f-4912-8be5-761833f7280e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:10.003507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cbe94-3e0f-4912-8be5-761833f7280e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:10.003786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cbe94-3e0f-4912-8be5-761833f7280e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:10.004109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cbe94-3e0f-4912-8be5-761833f7280e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:10.004924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cbe94-3e0f-4912-8be5-761833f7280e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:10.007436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cbe94-3e0f-4912-8be5-761833f7280e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:10.040902 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2239/4496] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:46:09 2022] POST /identity/v3/roles => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:10.045251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab7686-f3f3-4cd1-9b0e-ebbd14d97e96 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:10.064444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab7686-f3f3-4cd1-9b0e-ebbd14d97e96 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:10.086631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47423bd1-ad6e-4e5e-99d7-ee883ed98bed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:10.090191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47423bd1-ad6e-4e5e-99d7-ee883ed98bed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:10.090788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47423bd1-ad6e-4e5e-99d7-ee883ed98bed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:10.091284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47423bd1-ad6e-4e5e-99d7-ee883ed98bed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/502fba0520e84c9f8d8e94da23ba3877` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:10.098461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47423bd1-ad6e-4e5e-99d7-ee883ed98bed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0ad491124aca4124b8d8203c064bf379, implied_role_id=502fba0520e84c9f8d8e94da23ba3877)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:10.106781 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-47423bd1-ad6e-4e5e-99d7-ee883ed98bed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:10.106781 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:10.106781 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:10.112132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47423bd1-ad6e-4e5e-99d7-ee883ed98bed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:10.225297 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2258/4497] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:10 2022] PUT /identity/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/502fba0520e84c9f8d8e94da23ba3877 => generated 530 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:10.225944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cbe94-3e0f-4912-8be5-761833f7280e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:10.239680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cbe94-3e0f-4912-8be5-761833f7280e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:10.415463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779bbec-ed4d-4dc7-8f34-67a76a58c744 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:10.416292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779bbec-ed4d-4dc7-8f34-67a76a58c744 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:10.416675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779bbec-ed4d-4dc7-8f34-67a76a58c744 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:10.417053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779bbec-ed4d-4dc7-8f34-67a76a58c744 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:10.419785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779bbec-ed4d-4dc7-8f34-67a76a58c744 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0ad491124aca4124b8d8203c064bf379, implied_role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:10.421576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779bbec-ed4d-4dc7-8f34-67a76a58c744 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:10.487271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47423bd1-ad6e-4e5e-99d7-ee883ed98bed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:10.496802 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2240/4498] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:10 2022] PUT /identity/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/749f9a3b448146bfbe04f83f5865760d => generated 526 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:10.555459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47423bd1-ad6e-4e5e-99d7-ee883ed98bed tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:10.675644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c639b8d-9a39-439a-95b4-7ea67d3a6307 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:10.676309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c639b8d-9a39-439a-95b4-7ea67d3a6307 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:10.676638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c639b8d-9a39-439a-95b4-7ea67d3a6307 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:10.676921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c639b8d-9a39-439a-95b4-7ea67d3a6307 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/749f9a3b448146bfbe04f83f5865760d/implies/0ad491124aca4124b8d8203c064bf379` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:10.678771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c639b8d-9a39-439a-95b4-7ea67d3a6307 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=749f9a3b448146bfbe04f83f5865760d, implied_role_id=0ad491124aca4124b8d8203c064bf379)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:10.681647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c639b8d-9a39-439a-95b4-7ea67d3a6307 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-5c639b8d-9a39-439a-95b4-7ea67d3a6307 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] 0ad491124aca4124b8d8203c064bf379 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 0ad491124aca4124b8d8203c064bf379 cannot be an implied roles. Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Aug 29 15:46:10.705139 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Aug 29 15:46:10.706133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:10.706133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:10.706133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Aug 29 15:46:10.706133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Aug 29 15:46:10.706133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 0ad491124aca4124b8d8203c064bf379 cannot be an implied roles. Aug 29 15:46:10.706133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:46:10.706472 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2259/4499] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:10 2022] PUT /identity/v3/roles/749f9a3b448146bfbe04f83f5865760d/implies/0ad491124aca4124b8d8203c064bf379 => generated 116 bytes in 220 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:46:10.712529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779bbec-ed4d-4dc7-8f34-67a76a58c744 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:10.726837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779bbec-ed4d-4dc7-8f34-67a76a58c744 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:10.735083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da12f7-ec8a-4a82-bdcd-cc07b7e8e525 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:10.735820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da12f7-ec8a-4a82-bdcd-cc07b7e8e525 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:10.736100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da12f7-ec8a-4a82-bdcd-cc07b7e8e525 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:10.736376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da12f7-ec8a-4a82-bdcd-cc07b7e8e525 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:10.740823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da12f7-ec8a-4a82-bdcd-cc07b7e8e525 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0ad491124aca4124b8d8203c064bf379, implied_role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:10.745052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da12f7-ec8a-4a82-bdcd-cc07b7e8e525 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:10.761341 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2241/4500] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:10 2022] DELETE /identity/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:10.765968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c639b8d-9a39-439a-95b4-7ea67d3a6307 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:10.780009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c639b8d-9a39-439a-95b4-7ea67d3a6307 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:11.025652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3406514-db66-4a9e-ba10-31f696e92306 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:11.026321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3406514-db66-4a9e-ba10-31f696e92306 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:11.026601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3406514-db66-4a9e-ba10-31f696e92306 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:11.026874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3406514-db66-4a9e-ba10-31f696e92306 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/502fba0520e84c9f8d8e94da23ba3877` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:11.033776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3406514-db66-4a9e-ba10-31f696e92306 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0ad491124aca4124b8d8203c064bf379, implied_role_id=502fba0520e84c9f8d8e94da23ba3877)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:11.034828 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-d3406514-db66-4a9e-ba10-31f696e92306 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:11.034828 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:11.034828 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:11.035725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3406514-db66-4a9e-ba10-31f696e92306 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:11.081198 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2260/4501] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:10 2022] DELETE /identity/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/502fba0520e84c9f8d8e94da23ba3877 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:11.085229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da12f7-ec8a-4a82-bdcd-cc07b7e8e525 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:11.105942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da12f7-ec8a-4a82-bdcd-cc07b7e8e525 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:11.261045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7ef7d-0015-4d83-b5e1-90fc4bb72bb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:11.261883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7ef7d-0015-4d83-b5e1-90fc4bb72bb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:11.262229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7ef7d-0015-4d83-b5e1-90fc4bb72bb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:11.262568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7ef7d-0015-4d83-b5e1-90fc4bb72bb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/502fba0520e84c9f8d8e94da23ba3877` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:11.263821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7ef7d-0015-4d83-b5e1-90fc4bb72bb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=502fba0520e84c9f8d8e94da23ba3877)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:11.279008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7ef7d-0015-4d83-b5e1-90fc4bb72bb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:11.373878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3aa7ef7d-0015-4d83-b5e1-90fc4bb72bb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role 502fba0520e84c9f8d8e94da23ba3877 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:11.374226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3aa7ef7d-0015-4d83-b5e1-90fc4bb72bb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:11.375026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3aa7ef7d-0015-4d83-b5e1-90fc4bb72bb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:11.379831 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2242/4502] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:11 2022] DELETE /identity/v3/roles/502fba0520e84c9f8d8e94da23ba3877 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:11.384663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3406514-db66-4a9e-ba10-31f696e92306 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:11.386595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d3406514-db66-4a9e-ba10-31f696e92306 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:11.410156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3406514-db66-4a9e-ba10-31f696e92306 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:11.433761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:11.611268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:11.612685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:11.613172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:11.613778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/0a913f262e6548ea99b7b1699da9a70b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:11.654669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0a913f262e6548ea99b7b1699da9a70b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:11.656293 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:11.656293 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:11.656293 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:11.656626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:11.702592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:11.703585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:11.822330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:11.823653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:11.832966 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2261/4503] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:46:11 2022] PATCH /identity/v3/domains/0a913f262e6548ea99b7b1699da9a70b => generated 277 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:46:11.834299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7ef7d-0015-4d83-b5e1-90fc4bb72bb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:11.854670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7ef7d-0015-4d83-b5e1-90fc4bb72bb8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:11.892649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:11.982251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:11.982971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:11.983262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:11.983537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/0a913f262e6548ea99b7b1699da9a70b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:12.025847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0a913f262e6548ea99b7b1699da9a70b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:12.028453 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:12.028453 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:12.028453 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:12.030452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:12.064000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.096165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.189708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b', 'request_id': 'req-a4096f24-5a54-45eb-b6a8-a732001cff54'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.208649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b', 'request_id': 'req-a4096f24-5a54-45eb-b6a8-a732001cff54'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.225801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b', 'request_id': 'req-a4096f24-5a54-45eb-b6a8-a732001cff54'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.251866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] The token cache is being invalidate because project 0a913f262e6548ea99b7b1699da9a70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:12.252160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.257572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.289691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b', 'request_id': 'req-a4096f24-5a54-45eb-b6a8-a732001cff54'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.292613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b', 'request_id': 'req-a4096f24-5a54-45eb-b6a8-a732001cff54'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.294308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0a913f262e6548ea99b7b1699da9a70b', 'request_id': 'req-a4096f24-5a54-45eb-b6a8-a732001cff54'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.346510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2243/4504] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:46:11 2022] DELETE /identity/v3/domains/0a913f262e6548ea99b7b1699da9a70b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:12.347723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:12.349429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:12.379386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef43e4-2810-4ea5-bd5a-7314738d247f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:12.520974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75fe8a-5625-46b0-8512-9397539beb8b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:12.523133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fe8a-5625-46b0-8512-9397539beb8b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:12.524189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fe8a-5625-46b0-8512-9397539beb8b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:12.524886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fe8a-5625-46b0-8512-9397539beb8b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/efebaf5149ba4b6890f47a2f096e69cb` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:12.527238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75fe8a-5625-46b0-8512-9397539beb8b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0ad491124aca4124b8d8203c064bf379, implied_role_id=efebaf5149ba4b6890f47a2f096e69cb)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:12.530366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75fe8a-5625-46b0-8512-9397539beb8b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:12.555731 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2262/4505] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:12 2022] DELETE /identity/v3/roles/0ad491124aca4124b8d8203c064bf379/implies/efebaf5149ba4b6890f47a2f096e69cb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:12.560663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:12.562311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:12.595487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4096f24-5a54-45eb-b6a8-a732001cff54 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:12.698114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:12.717423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9fdda-73c2-42cd-b018-cae94d4d6e99 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:12.718021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9fdda-73c2-42cd-b018-cae94d4d6e99 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:12.718513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9fdda-73c2-42cd-b018-cae94d4d6e99 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:12.719028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9fdda-73c2-42cd-b018-cae94d4d6e99 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/efebaf5149ba4b6890f47a2f096e69cb` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:12.722496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9fdda-73c2-42cd-b018-cae94d4d6e99 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=efebaf5149ba4b6890f47a2f096e69cb)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:12.724954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9fdda-73c2-42cd-b018-cae94d4d6e99 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:12.824149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dad9fdda-73c2-42cd-b018-cae94d4d6e99 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role efebaf5149ba4b6890f47a2f096e69cb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:12.824372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dad9fdda-73c2-42cd-b018-cae94d4d6e99 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.825023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dad9fdda-73c2-42cd-b018-cae94d4d6e99 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:12.830701 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2244/4506] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:12 2022] DELETE /identity/v3/roles/efebaf5149ba4b6890f47a2f096e69cb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:12.831900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75fe8a-5625-46b0-8512-9397539beb8b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:12.833864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2d75fe8a-5625-46b0-8512-9397539beb8b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:12.882745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75fe8a-5625-46b0-8512-9397539beb8b tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:12.990741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:12.991755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:12.992755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:12.993222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/0ad491124aca4124b8d8203c064bf379` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:12.994975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=0ad491124aca4124b8d8203c064bf379)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:12.996387 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:12.996387 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:12.996387 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:12.998952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:13.017650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:13.069947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role 0ad491124aca4124b8d8203c064bf379 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:13.071835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:13.074226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:13.080688 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2263/4507] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:12 2022] DELETE /identity/v3/roles/0ad491124aca4124b8d8203c064bf379 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:13.089775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9fdda-73c2-42cd-b018-cae94d4d6e99 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:13.108616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9fdda-73c2-42cd-b018-cae94d4d6e99 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:13.238155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72128829-147a-45d9-b8da-2d319725992e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:13.241148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72128829-147a-45d9-b8da-2d319725992e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:13.241479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72128829-147a-45d9-b8da-2d319725992e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:13.241767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72128829-147a-45d9-b8da-2d319725992e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:13.247577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72128829-147a-45d9-b8da-2d319725992e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:13.250639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72128829-147a-45d9-b8da-2d319725992e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:13.331886 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2245/4508] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:13 2022] PUT /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 521 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:13.333636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:13.335414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72128829-147a-45d9-b8da-2d319725992e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:13.335923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:13.339259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72128829-147a-45d9-b8da-2d319725992e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:13.512453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72128829-147a-45d9-b8da-2d319725992e tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:13.531533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:13.533309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:13.544716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:13.547726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:13.550239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:13.552113 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:13.552113 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:13.552113 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:13.553381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:13.554759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:13.555684 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:13.555684 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:13.555684 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:13.556998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:13.575159 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2246/4509] 10.222.0.16 () {58 vars in 1345 bytes} [Mon Aug 29 15:46:13 2022] HEAD /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:13.576155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:13.578751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:13.591813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8a4aa-e603-4cba-896c-25d692c5031f tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:13.661615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:13.700475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd44dc8-3778-4222-b2e5-a1abb92f0c1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:13.701232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd44dc8-3778-4222-b2e5-a1abb92f0c1f service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:13.701551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd44dc8-3778-4222-b2e5-a1abb92f0c1f service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:13.701874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd44dc8-3778-4222-b2e5-a1abb92f0c1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:13.705245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dcd44dc8-3778-4222-b2e5-a1abb92f0c1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:13.749746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03199a31-bb39-40df-96e0-ab97c1995698 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:13.760305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd44dc8-3778-4222-b2e5-a1abb92f0c1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:13.763041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:13.763884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:13.764106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:13.764467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] PATH_INFO: `/v3/users/422e6b467bac4c08a38b62c9e6c76d16` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:13.764858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd44dc8-3778-4222-b2e5-a1abb92f0c1f service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:13.766191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422e6b467bac4c08a38b62c9e6c76d16)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:13.768674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:13.788698 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2264/4510] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:13.789698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd44dc8-3778-4222-b2e5-a1abb92f0c1f service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:13.806001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd44dc8-3778-4222-b2e5-a1abb92f0c1f service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:13.812943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7ebec-7111-4040-8260-07bb024e6dcb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:13.814420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7ebec-7111-4040-8260-07bb024e6dcb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:13.814743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7ebec-7111-4040-8260-07bb024e6dcb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:13.817645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7ebec-7111-4040-8260-07bb024e6dcb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:13.822374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7ebec-7111-4040-8260-07bb024e6dcb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:13.827211 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-5ac7ebec-7111-4040-8260-07bb024e6dcb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:13.827211 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:13.827211 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:13.828825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7ebec-7111-4040-8260-07bb024e6dcb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:13.840749 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2265/4511] 10.222.0.16 () {58 vars in 1344 bytes} [Mon Aug 29 15:46:13 2022] GET /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 521 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:13.846221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7ebec-7111-4040-8260-07bb024e6dcb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:13.869819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7ebec-7111-4040-8260-07bb024e6dcb tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:13.878147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad84c10-e19f-4005-9468-2326527e2bc9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:13.879217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad84c10-e19f-4005-9468-2326527e2bc9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:13.879849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad84c10-e19f-4005-9468-2326527e2bc9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:13.880141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad84c10-e19f-4005-9468-2326527e2bc9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:13.882698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad84c10-e19f-4005-9468-2326527e2bc9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:13.886044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad84c10-e19f-4005-9468-2326527e2bc9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:13.887280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422e6b467bac4c08a38b62c9e6c76d16'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:13.889274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422e6b467bac4c08a38b62c9e6c76d16'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:13.902233 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2266/4512] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:13 2022] DELETE /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:13.906343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad84c10-e19f-4005-9468-2326527e2bc9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:13.918325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422e6b467bac4c08a38b62c9e6c76d16'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:13.936299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422e6b467bac4c08a38b62c9e6c76d16'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:13.949366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422e6b467bac4c08a38b62c9e6c76d16'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:13.968544 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2247/4513] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:13 2022] DELETE /identity/v3/users/422e6b467bac4c08a38b62c9e6c76d16 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:13.983076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:14.017522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad84c10-e19f-4005-9468-2326527e2bc9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:14.102270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cdadc-9754-4651-b66d-7387bcf426cf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:14.102938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cdadc-9754-4651-b66d-7387bcf426cf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.103224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cdadc-9754-4651-b66d-7387bcf426cf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.103542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cdadc-9754-4651-b66d-7387bcf426cf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.118187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cdadc-9754-4651-b66d-7387bcf426cf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:14.120478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cdadc-9754-4651-b66d-7387bcf426cf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-702cdadc-9754-4651-b66d-7387bcf426cf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] e3f26af6d55e43f4b470602b9951b54c does not imply 1590b1d904ba47ef99dc17dec434fdf9.: keystone.exception.ImpliedRoleNotFound: e3f26af6d55e43f4b470602b9951b54c does not imply 1590b1d904ba47ef99dc17dec434fdf9. Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = query.one() Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._iter().one() Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._only_one_row( Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:14.134206 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 29 15:46:14.135215 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 29 15:46:14.136127 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 29 15:46:14.136127 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e3f26af6d55e43f4b470602b9951b54c does not imply 1590b1d904ba47ef99dc17dec434fdf9. Aug 29 15:46:14.136127 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:46:14.136127 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2267/4514] 10.222.0.16 () {58 vars in 1344 bytes} [Mon Aug 29 15:46:13 2022] GET /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 137 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 15:46:14.140459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:14.142153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:14.162261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20dd99-9f25-45a0-9cd7-85b9f6454ea8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:14.168107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76091f8-27f2-4dce-9a6c-94c7262c477a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:14.168922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76091f8-27f2-4dce-9a6c-94c7262c477a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.169262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76091f8-27f2-4dce-9a6c-94c7262c477a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.170120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76091f8-27f2-4dce-9a6c-94c7262c477a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.172291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76091f8-27f2-4dce-9a6c-94c7262c477a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:14.174841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76091f8-27f2-4dce-9a6c-94c7262c477a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-c76091f8-27f2-4dce-9a6c-94c7262c477a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] e3f26af6d55e43f4b470602b9951b54c does not imply 1590b1d904ba47ef99dc17dec434fdf9.: keystone.exception.ImpliedRoleNotFound: e3f26af6d55e43f4b470602b9951b54c does not imply 1590b1d904ba47ef99dc17dec434fdf9. Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = query.one() Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._iter().one() Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._only_one_row( Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:14.186086 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 29 15:46:14.187125 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 29 15:46:14.188025 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 29 15:46:14.188025 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 29 15:46:14.188025 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 29 15:46:14.188025 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e3f26af6d55e43f4b470602b9951b54c does not imply 1590b1d904ba47ef99dc17dec434fdf9. Aug 29 15:46:14.188025 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:46:14.195431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cdadc-9754-4651-b66d-7387bcf426cf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:14.209978 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2248/4515] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:14 2022] DELETE /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 137 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:46:14.215425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cdadc-9754-4651-b66d-7387bcf426cf tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:14.221609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb5a24-5ba5-4d7c-84ab-8d22689c20e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:14.222390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb5a24-5ba5-4d7c-84ab-8d22689c20e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.222751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb5a24-5ba5-4d7c-84ab-8d22689c20e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.223626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb5a24-5ba5-4d7c-84ab-8d22689c20e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.225894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb5a24-5ba5-4d7c-84ab-8d22689c20e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:14.227916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb5a24-5ba5-4d7c-84ab-8d22689c20e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:14.267502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76091f8-27f2-4dce-9a6c-94c7262c477a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:14.277736 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2268/4516] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:14 2022] PUT /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 521 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:14.283264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76091f8-27f2-4dce-9a6c-94c7262c477a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:14.309237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb5a24-5ba5-4d7c-84ab-8d22689c20e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:14.311334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c0fb5a24-5ba5-4d7c-84ab-8d22689c20e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:14.398712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62ac1b-ddf9-4ac9-abe0-74226fd8957c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:14.399672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62ac1b-ddf9-4ac9-abe0-74226fd8957c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.400260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62ac1b-ddf9-4ac9-abe0-74226fd8957c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.400690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62ac1b-ddf9-4ac9-abe0-74226fd8957c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/76bf6eb3fcc049d38648d26d0accde60` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.402586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62ac1b-ddf9-4ac9-abe0-74226fd8957c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=76bf6eb3fcc049d38648d26d0accde60)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:14.404331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62ac1b-ddf9-4ac9-abe0-74226fd8957c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:14.434099 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2249/4517] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:14 2022] PUT /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/76bf6eb3fcc049d38648d26d0accde60 => generated 521 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:14.439281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62ac1b-ddf9-4ac9-abe0-74226fd8957c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:14.443764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb5a24-5ba5-4d7c-84ab-8d22689c20e9 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:14.485848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:14.548167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62ac1b-ddf9-4ac9-abe0-74226fd8957c tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:14.554466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7040623-4965-4d3c-b3d8-354ad5f77b05 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:14.556382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040623-4965-4d3c-b3d8-354ad5f77b05 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.557070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040623-4965-4d3c-b3d8-354ad5f77b05 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.557584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040623-4965-4d3c-b3d8-354ad5f77b05 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/76bf6eb3fcc049d38648d26d0accde60/implies/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.559839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7040623-4965-4d3c-b3d8-354ad5f77b05 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=76bf6eb3fcc049d38648d26d0accde60, implied_role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:14.561735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7040623-4965-4d3c-b3d8-354ad5f77b05 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:14.576494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:14.577123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.577414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.578463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] PATH_INFO: `/v3/projects/e2259cb2720f4b60a478853e8ab3f968` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.580244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2259cb2720f4b60a478853e8ab3f968)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:14.583267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:14.599821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:14.619157 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2250/4518] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:14 2022] PUT /identity/v3/roles/76bf6eb3fcc049d38648d26d0accde60/implies/749f9a3b448146bfbe04f83f5865760d => generated 521 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:14.623689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7040623-4965-4d3c-b3d8-354ad5f77b05 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:14.653498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2259cb2720f4b60a478853e8ab3f968', 'request_id': 'req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:14.661122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2259cb2720f4b60a478853e8ab3f968', 'request_id': 'req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:14.675632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2259cb2720f4b60a478853e8ab3f968', 'request_id': 'req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:14.690621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] The token cache is being invalidate because project e2259cb2720f4b60a478853e8ab3f968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:14.690899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:14.691639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cd9f57ee-95c4-4c83-ab16-ef9c7eb89eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:14.698864 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2269/4519] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:14 2022] DELETE /identity/v3/projects/e2259cb2720f4b60a478853e8ab3f968 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:14.701353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b13f4-caed-4fd5-a27c-8e30d44ce8de None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.701671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b13f4-caed-4fd5-a27c-8e30d44ce8de None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.701941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b13f4-caed-4fd5-a27c-8e30d44ce8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.729019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a63b13f4-caed-4fd5-a27c-8e30d44ce8de None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:14.730289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a63b13f4-caed-4fd5-a27c-8e30d44ce8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:14.733429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7040623-4965-4d3c-b3d8-354ad5f77b05 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:14.828325 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2270/4520] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:14.830558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f8388-8c3e-40eb-9ebb-d78069f9fc14 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.831239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f8388-8c3e-40eb-9ebb-d78069f9fc14 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.831709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f8388-8c3e-40eb-9ebb-d78069f9fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.854544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b56c6-ca58-4bba-8d9a-a26830578bc4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:14.855442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b56c6-ca58-4bba-8d9a-a26830578bc4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.855874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b56c6-ca58-4bba-8d9a-a26830578bc4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.856327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b56c6-ca58-4bba-8d9a-a26830578bc4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.857059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b56c6-ca58-4bba-8d9a-a26830578bc4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:14.858970 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-6a5b56c6-ca58-4bba-8d9a-a26830578bc4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:14.858970 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:14.858970 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:14.860363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b56c6-ca58-4bba-8d9a-a26830578bc4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:14.860918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d51f8388-8c3e-40eb-9ebb-d78069f9fc14 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:14.862998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d51f8388-8c3e-40eb-9ebb-d78069f9fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:14.876723 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2271/4521] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:14.878346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f8388-8c3e-40eb-9ebb-d78069f9fc14 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:14.885636 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2251/4522] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:46:14 2022] GET /identity/v3/role_inferences => generated 1608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:46:14.890164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b56c6-ca58-4bba-8d9a-a26830578bc4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:14.893172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6a5b56c6-ca58-4bba-8d9a-a26830578bc4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:14.893455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f8388-8c3e-40eb-9ebb-d78069f9fc14 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:14.908126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1de523-dedf-454c-af59-790485b1e402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:14.910181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1de523-dedf-454c-af59-790485b1e402 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.910663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1de523-dedf-454c-af59-790485b1e402 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.911009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1de523-dedf-454c-af59-790485b1e402 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.911815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1de523-dedf-454c-af59-790485b1e402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:14.912269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1de523-dedf-454c-af59-790485b1e402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:14.915196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1de523-dedf-454c-af59-790485b1e402 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:14.926105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b56c6-ca58-4bba-8d9a-a26830578bc4 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:14.928446 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2272/4523] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:46:14.934681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1de523-dedf-454c-af59-790485b1e402 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:14.946908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05ad58-50c0-4fb7-807d-554f807395c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:14.947712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05ad58-50c0-4fb7-807d-554f807395c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.948166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05ad58-50c0-4fb7-807d-554f807395c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.948566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05ad58-50c0-4fb7-807d-554f807395c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/76bf6eb3fcc049d38648d26d0accde60/implies/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.951249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05ad58-50c0-4fb7-807d-554f807395c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=76bf6eb3fcc049d38648d26d0accde60, implied_role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:14.953837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05ad58-50c0-4fb7-807d-554f807395c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:14.955604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1de523-dedf-454c-af59-790485b1e402 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:14.964590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fdc16-2d86-47b7-b7ea-f5596b63b9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:14.965212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fdc16-2d86-47b7-b7ea-f5596b63b9cb admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:14.965518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fdc16-2d86-47b7-b7ea-f5596b63b9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:14.965794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fdc16-2d86-47b7-b7ea-f5596b63b9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:14.966436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fdc16-2d86-47b7-b7ea-f5596b63b9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:14.968340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fdc16-2d86-47b7-b7ea-f5596b63b9cb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:14.982560 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2252/4524] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:14 2022] DELETE /identity/v3/roles/76bf6eb3fcc049d38648d26d0accde60/implies/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:14.983965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05ad58-50c0-4fb7-807d-554f807395c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.012909 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2273/4525] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:14 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:15.017797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fdc16-2d86-47b7-b7ea-f5596b63b9cb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.047057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:15.077136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05ad58-50c0-4fb7-807d-554f807395c6 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.110685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:15.115127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fdc16-2d86-47b7-b7ea-f5596b63b9cb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.122750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371665b7-715a-4214-b72b-f6ab7f4a4458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.123450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371665b7-715a-4214-b72b-f6ab7f4a4458 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.123976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371665b7-715a-4214-b72b-f6ab7f4a4458 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.124722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371665b7-715a-4214-b72b-f6ab7f4a4458 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.125487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371665b7-715a-4214-b72b-f6ab7f4a4458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.127566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371665b7-715a-4214-b72b-f6ab7f4a4458 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:15.165757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600524-50ff-4782-9d12-bec0c58b7611 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.178184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600524-50ff-4782-9d12-bec0c58b7611 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.178829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600524-50ff-4782-9d12-bec0c58b7611 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.178943 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2274/4526] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:15 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:15.179480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600524-50ff-4782-9d12-bec0c58b7611 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/76bf6eb3fcc049d38648d26d0accde60` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.181998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371665b7-715a-4214-b72b-f6ab7f4a4458 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.183238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4600524-50ff-4782-9d12-bec0c58b7611 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=76bf6eb3fcc049d38648d26d0accde60)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.185207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4600524-50ff-4782-9d12-bec0c58b7611 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:15.199826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371665b7-715a-4214-b72b-f6ab7f4a4458 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.203704 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2253/4527] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:14 2022] DELETE /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/76bf6eb3fcc049d38648d26d0accde60 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:15.209261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600524-50ff-4782-9d12-bec0c58b7611 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.211897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f74358-b538-4396-b5dc-d9301757fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.212623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f74358-b538-4396-b5dc-d9301757fe7a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.212974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f74358-b538-4396-b5dc-d9301757fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.214912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f74358-b538-4396-b5dc-d9301757fe7a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.216440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f74358-b538-4396-b5dc-d9301757fe7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.219403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f74358-b538-4396-b5dc-d9301757fe7a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:15.236240 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2275/4528] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:15 2022] GET /identity/v3/roles => generated 2324 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:15.241151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f74358-b538-4396-b5dc-d9301757fe7a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.256891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f74358-b538-4396-b5dc-d9301757fe7a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.318520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600524-50ff-4782-9d12-bec0c58b7611 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.336035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad243f-1c40-402b-9b4d-67d8d0adeab2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.336738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad243f-1c40-402b-9b4d-67d8d0adeab2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.337017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad243f-1c40-402b-9b4d-67d8d0adeab2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.337294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad243f-1c40-402b-9b4d-67d8d0adeab2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.339121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad243f-1c40-402b-9b4d-67d8d0adeab2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.340760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad243f-1c40-402b-9b4d-67d8d0adeab2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:15.353817 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2254/4529] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:15 2022] DELETE /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:15.358580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad243f-1c40-402b-9b4d-67d8d0adeab2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.377993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4f7a4-cc51-4192-8515-66b64793f6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.379399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4f7a4-cc51-4192-8515-66b64793f6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.379399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4f7a4-cc51-4192-8515-66b64793f6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.379825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4f7a4-cc51-4192-8515-66b64793f6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.381568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4f7a4-cc51-4192-8515-66b64793f6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.384189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4f7a4-cc51-4192-8515-66b64793f6e1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:15.407757 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2276/4530] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:15 2022] GET /identity/v3/roles => generated 2324 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:15.408929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4f7a4-cc51-4192-8515-66b64793f6e1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.420030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4f7a4-cc51-4192-8515-66b64793f6e1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.448952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad243f-1c40-402b-9b4d-67d8d0adeab2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.455081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e592f51-9782-4747-877f-962b47054da2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.455529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e592f51-9782-4747-877f-962b47054da2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.455814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e592f51-9782-4747-877f-962b47054da2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.456092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e592f51-9782-4747-877f-962b47054da2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.457116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e592f51-9782-4747-877f-962b47054da2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.458591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e592f51-9782-4747-877f-962b47054da2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:15.477533 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2255/4531] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:15 2022] GET /identity/v3/roles => generated 2324 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:15.482201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e592f51-9782-4747-877f-962b47054da2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.499011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e592f51-9782-4747-877f-962b47054da2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.507106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371304ba-1c99-43be-9c8f-a4fc7b2283b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.507783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371304ba-1c99-43be-9c8f-a4fc7b2283b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.508286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371304ba-1c99-43be-9c8f-a4fc7b2283b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.508573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371304ba-1c99-43be-9c8f-a4fc7b2283b9 admin admin] PATH_INFO: `/v3/projects/c694100bb1f945b79ae0010754b82add/users/3dd53cf1dd3343d989e650620d853c0c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.512623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab5a9d-5c40-440c-909e-63188c5a3aab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.513837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab5a9d-5c40-440c-909e-63188c5a3aab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.515357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab5a9d-5c40-440c-909e-63188c5a3aab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.515643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab5a9d-5c40-440c-909e-63188c5a3aab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.516464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab5a9d-5c40-440c-909e-63188c5a3aab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.518045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab5a9d-5c40-440c-909e-63188c5a3aab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:15.528912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371304ba-1c99-43be-9c8f-a4fc7b2283b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c694100bb1f945b79ae0010754b82add, user_id=3dd53cf1dd3343d989e650620d853c0c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.531790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371304ba-1c99-43be-9c8f-a4fc7b2283b9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:15.533118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:15.545377 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2256/4532] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:46:15 2022] POST /identity/v3/roles => generated 235 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:15.548515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab5a9d-5c40-440c-909e-63188c5a3aab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.556525 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2277/4533] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:15 2022] PUT /identity/v3/projects/c694100bb1f945b79ae0010754b82add/users/3dd53cf1dd3343d989e650620d853c0c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:15.558224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a56b2-40eb-46bb-91d8-6b466e6ee060 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.558586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a56b2-40eb-46bb-91d8-6b466e6ee060 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.558932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a56b2-40eb-46bb-91d8-6b466e6ee060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.565097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab5a9d-5c40-440c-909e-63188c5a3aab tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.581224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1c6a56b2-40eb-46bb-91d8-6b466e6ee060 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:15.583151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1c6a56b2-40eb-46bb-91d8-6b466e6ee060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:15.669326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db96ba1-e711-45ef-983d-ab09acef9259 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.670014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96ba1-e711-45ef-983d-ab09acef9259 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.670294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96ba1-e711-45ef-983d-ab09acef9259 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.670568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96ba1-e711-45ef-983d-ab09acef9259 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/c72d10263c89493c8ba0cc55b4f39d44` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.672072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db96ba1-e711-45ef-983d-ab09acef9259 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:update_role(role_id=c72d10263c89493c8ba0cc55b4f39d44)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.673100 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-0db96ba1-e711-45ef-983d-ab09acef9259 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:15.673100 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:15.673100 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:15.674028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db96ba1-e711-45ef-983d-ab09acef9259 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:15.698872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:15.718041 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2278/4534] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:15.719760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc420e3c-12e1-4ccd-9c55-05db600ec237 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.720255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc420e3c-12e1-4ccd-9c55-05db600ec237 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.720731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc420e3c-12e1-4ccd-9c55-05db600ec237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.754058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dc420e3c-12e1-4ccd-9c55-05db600ec237 None None] MFA Rules not processed for user `f70ee130e8e74db88b9b7ffd16ed1bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:15.764391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc420e3c-12e1-4ccd-9c55-05db600ec237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:15.767115 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2257/4535] 10.222.0.16 () {60 vars in 1243 bytes} [Mon Aug 29 15:46:15 2022] PATCH /identity/v3/roles/c72d10263c89493c8ba0cc55b4f39d44 => generated 238 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:15.768295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db96ba1-e711-45ef-983d-ab09acef9259 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.770060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0db96ba1-e711-45ef-983d-ab09acef9259 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:15.903503 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2279/4536] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:15.903503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc420e3c-12e1-4ccd-9c55-05db600ec237 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.912456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db96ba1-e711-45ef-983d-ab09acef9259 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.923003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e135a9c-87b5-4120-9e3b-e42662662247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.923674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e135a9c-87b5-4120-9e3b-e42662662247 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.923952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e135a9c-87b5-4120-9e3b-e42662662247 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.924224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e135a9c-87b5-4120-9e3b-e42662662247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.926067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc420e3c-12e1-4ccd-9c55-05db600ec237 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.937205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcb069-5f01-4bfb-a31f-675176dd7d35 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.937889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcb069-5f01-4bfb-a31f-675176dd7d35 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.939827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcb069-5f01-4bfb-a31f-675176dd7d35 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.940147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcb069-5f01-4bfb-a31f-675176dd7d35 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/c72d10263c89493c8ba0cc55b4f39d44` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.945706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e135a9c-87b5-4120-9e3b-e42662662247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.946834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e135a9c-87b5-4120-9e3b-e42662662247 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:15.958111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcb069-5f01-4bfb-a31f-675176dd7d35 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:get_role(role_id=c72d10263c89493c8ba0cc55b4f39d44)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.959377 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-36dcb069-5f01-4bfb-a31f-675176dd7d35 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:15.959377 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:15.959377 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:15.960053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcb069-5f01-4bfb-a31f-675176dd7d35 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:15.967085 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2280/4537] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:46:15 2022] GET /identity/v3/roles/c72d10263c89493c8ba0cc55b4f39d44 => generated 238 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:15.969274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcb069-5f01-4bfb-a31f-675176dd7d35 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:15.974678 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2258/4538] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:15.984650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcb069-5f01-4bfb-a31f-675176dd7d35 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:15.990761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24346fc0-9124-4c5d-a0df-8932d941f6db tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:15.991910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24346fc0-9124-4c5d-a0df-8932d941f6db tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:15.991910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24346fc0-9124-4c5d-a0df-8932d941f6db tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:15.991910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24346fc0-9124-4c5d-a0df-8932d941f6db tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:15.992800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24346fc0-9124-4c5d-a0df-8932d941f6db tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:15.994470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24346fc0-9124-4c5d-a0df-8932d941f6db tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:16.013853 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2281/4539] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:15 2022] GET /identity/v3/roles => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:16.014369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e135a9c-87b5-4120-9e3b-e42662662247 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:16.031149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e135a9c-87b5-4120-9e3b-e42662662247 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:16.044476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:16.045134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:16.045469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:16.045757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/c72d10263c89493c8ba0cc55b4f39d44` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:16.047252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c72d10263c89493c8ba0cc55b4f39d44)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:16.048285 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:16.048285 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:16.048285 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:16.049578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:16.121685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role c72d10263c89493c8ba0cc55b4f39d44 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:16.122432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:16.123518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:16.128191 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2259/4540] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:16 2022] DELETE /identity/v3/roles/c72d10263c89493c8ba0cc55b4f39d44 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:16.134572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24346fc0-9124-4c5d-a0df-8932d941f6db tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:16.136180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-24346fc0-9124-4c5d-a0df-8932d941f6db tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:16.153225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24346fc0-9124-4c5d-a0df-8932d941f6db tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:16.265017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2b634-e1ac-4c2f-a9ba-1970cb5ba87a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:16.266772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2b634-e1ac-4c2f-a9ba-1970cb5ba87a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:16.267333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2b634-e1ac-4c2f-a9ba-1970cb5ba87a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:16.267824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2b634-e1ac-4c2f-a9ba-1970cb5ba87a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:16.270212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2b634-e1ac-4c2f-a9ba-1970cb5ba87a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:16.272097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2b634-e1ac-4c2f-a9ba-1970cb5ba87a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:16.325109 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2282/4541] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:16 2022] PUT /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 521 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:16.329587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:16.353763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d4f6c-b826-4960-b7b2-6195ffd5bc00 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:16.461813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:16.483014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6ad1b-2c33-4144-8915-f60b3f678359 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:16.483813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6ad1b-2c33-4144-8915-f60b3f678359 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:16.484152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6ad1b-2c33-4144-8915-f60b3f678359 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:16.484442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6ad1b-2c33-4144-8915-f60b3f678359 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/76bf6eb3fcc049d38648d26d0accde60` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:16.486370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6ad1b-2c33-4144-8915-f60b3f678359 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=76bf6eb3fcc049d38648d26d0accde60)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:16.488988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6ad1b-2c33-4144-8915-f60b3f678359 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:16.523737 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2260/4542] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:16 2022] PUT /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/76bf6eb3fcc049d38648d26d0accde60 => generated 521 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:16.528187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2b634-e1ac-4c2f-a9ba-1970cb5ba87a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:16.565749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2b634-e1ac-4c2f-a9ba-1970cb5ba87a tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:16.691224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14ef30-8853-46fe-8a24-f6b5ed45bbd0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:16.692542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14ef30-8853-46fe-8a24-f6b5ed45bbd0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:16.693198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14ef30-8853-46fe-8a24-f6b5ed45bbd0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:16.693832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14ef30-8853-46fe-8a24-f6b5ed45bbd0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/76bf6eb3fcc049d38648d26d0accde60/implies/749f9a3b448146bfbe04f83f5865760d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:16.696420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14ef30-8853-46fe-8a24-f6b5ed45bbd0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=76bf6eb3fcc049d38648d26d0accde60, implied_role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:16.698483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14ef30-8853-46fe-8a24-f6b5ed45bbd0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:16.700669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:16.753467 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2283/4543] 10.222.0.16 () {60 vars in 1363 bytes} [Mon Aug 29 15:46:16 2022] PUT /identity/v3/roles/76bf6eb3fcc049d38648d26d0accde60/implies/749f9a3b448146bfbe04f83f5865760d => generated 521 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:16.755328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6ad1b-2c33-4144-8915-f60b3f678359 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:16.781528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6ad1b-2c33-4144-8915-f60b3f678359 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:16.904772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79bc7b-ab88-428b-aa60-a5796cc17246 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:16.907138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79bc7b-ab88-428b-aa60-a5796cc17246 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:16.907614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79bc7b-ab88-428b-aa60-a5796cc17246 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:16.908828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79bc7b-ab88-428b-aa60-a5796cc17246 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/76bf6eb3fcc049d38648d26d0accde60/implies` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:16.911158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79bc7b-ab88-428b-aa60-a5796cc17246 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=76bf6eb3fcc049d38648d26d0accde60)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:16.914654 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-5a79bc7b-ab88-428b-aa60-a5796cc17246 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:16.914654 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:16.914654 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:16.916372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79bc7b-ab88-428b-aa60-a5796cc17246 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:16.942598 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2261/4544] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:16 2022] GET /identity/v3/roles/76bf6eb3fcc049d38648d26d0accde60/implies => generated 490 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:46:16.948402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14ef30-8853-46fe-8a24-f6b5ed45bbd0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:16.967578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14ef30-8853-46fe-8a24-f6b5ed45bbd0 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:16.977669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155d7b1-cd0e-41d3-8c05-7b2c907b4aec tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:16.977819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155d7b1-cd0e-41d3-8c05-7b2c907b4aec tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:16.978142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155d7b1-cd0e-41d3-8c05-7b2c907b4aec tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:16.978343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155d7b1-cd0e-41d3-8c05-7b2c907b4aec tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:16.982148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155d7b1-cd0e-41d3-8c05-7b2c907b4aec tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=e3f26af6d55e43f4b470602b9951b54c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:16.983281 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-b155d7b1-cd0e-41d3-8c05-7b2c907b4aec tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:16.983281 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:16.983281 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:16.984123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155d7b1-cd0e-41d3-8c05-7b2c907b4aec tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:17.014294 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2284/4545] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:46:16 2022] GET /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies => generated 661 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:17.015116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79bc7b-ab88-428b-aa60-a5796cc17246 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:17.035215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79bc7b-ab88-428b-aa60-a5796cc17246 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:17.052493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a52f8-39a4-4927-8a10-53e077c94f08 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:17.053170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a52f8-39a4-4927-8a10-53e077c94f08 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:17.053481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a52f8-39a4-4927-8a10-53e077c94f08 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:17.053764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a52f8-39a4-4927-8a10-53e077c94f08 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/76bf6eb3fcc049d38648d26d0accde60/implies/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:17.060780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a52f8-39a4-4927-8a10-53e077c94f08 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=76bf6eb3fcc049d38648d26d0accde60, implied_role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:17.062473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a52f8-39a4-4927-8a10-53e077c94f08 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:17.088586 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2262/4546] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:17 2022] DELETE /identity/v3/roles/76bf6eb3fcc049d38648d26d0accde60/implies/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:17.093145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155d7b1-cd0e-41d3-8c05-7b2c907b4aec tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:17.138211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155d7b1-cd0e-41d3-8c05-7b2c907b4aec tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:17.316022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6026911-e109-4ae9-a4e0-5dc3df9876df tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:17.317302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6026911-e109-4ae9-a4e0-5dc3df9876df tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:17.317616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6026911-e109-4ae9-a4e0-5dc3df9876df tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:17.317922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6026911-e109-4ae9-a4e0-5dc3df9876df tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/76bf6eb3fcc049d38648d26d0accde60` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:17.322206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6026911-e109-4ae9-a4e0-5dc3df9876df tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=76bf6eb3fcc049d38648d26d0accde60)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:17.324517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6026911-e109-4ae9-a4e0-5dc3df9876df tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:17.346855 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2285/4547] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:17 2022] DELETE /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/76bf6eb3fcc049d38648d26d0accde60 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:17.350799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a52f8-39a4-4927-8a10-53e077c94f08 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:17.366889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a52f8-39a4-4927-8a10-53e077c94f08 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:17.483974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd95e36-a3b0-4d08-88d4-3bb09d792ed2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:17.484863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95e36-a3b0-4d08-88d4-3bb09d792ed2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:17.485220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95e36-a3b0-4d08-88d4-3bb09d792ed2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:17.486730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95e36-a3b0-4d08-88d4-3bb09d792ed2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:17.488587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd95e36-a3b0-4d08-88d4-3bb09d792ed2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e3f26af6d55e43f4b470602b9951b54c, implied_role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:17.490233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd95e36-a3b0-4d08-88d4-3bb09d792ed2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:17.513628 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2263/4548] 10.222.0.16 () {58 vars in 1347 bytes} [Mon Aug 29 15:46:17 2022] DELETE /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c/implies/1590b1d904ba47ef99dc17dec434fdf9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:17.517944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6026911-e109-4ae9-a4e0-5dc3df9876df tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:17.530712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6026911-e109-4ae9-a4e0-5dc3df9876df tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:17.634490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9da369-f3ae-4cc4-b984-7316fd533632 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:17.636064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9da369-f3ae-4cc4-b984-7316fd533632 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:17.636651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9da369-f3ae-4cc4-b984-7316fd533632 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:17.637170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9da369-f3ae-4cc4-b984-7316fd533632 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/0a913f262e6548ea99b7b1699da9a70b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:17.647390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9da369-f3ae-4cc4-b984-7316fd533632 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-1a9da369-f3ae-4cc4-b984-7316fd533632 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Could not find domain: 0a913f262e6548ea99b7b1699da9a70b.: keystone.exception.DomainNotFound: Could not find domain: 0a913f262e6548ea99b7b1699da9a70b. Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0a913f262e6548ea99b7b1699da9a70b. Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:46:17.657170 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:17.659761 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0a913f262e6548ea99b7b1699da9a70b. Aug 29 15:46:17.665634 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:46:17.678880 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2286/4549] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:46:17 2022] PATCH /identity/v3/domains/0a913f262e6548ea99b7b1699da9a70b => generated 112 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:46:17.679022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd95e36-a3b0-4d08-88d4-3bb09d792ed2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:17.683917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd95e36-a3b0-4d08-88d4-3bb09d792ed2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:17.716484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:17.718062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:17.719790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:17.720487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/users/208f6395a353427eb0cdf98d0fb223a9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:17.730073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_user(user_id=208f6395a353427eb0cdf98d0fb223a9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:17.732197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:17.783067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f150b-4af3-4e0c-874d-b20168a82c55 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:17.783394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f150b-4af3-4e0c-874d-b20168a82c55 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:17.783625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f150b-4af3-4e0c-874d-b20168a82c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:17.818437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ef0f150b-4af3-4e0c-874d-b20168a82c55 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:17.819675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ef0f150b-4af3-4e0c-874d-b20168a82c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:17.855642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:17.866630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208f6395a353427eb0cdf98d0fb223a9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:17.869704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208f6395a353427eb0cdf98d0fb223a9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:17.890020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208f6395a353427eb0cdf98d0fb223a9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:17.907040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208f6395a353427eb0cdf98d0fb223a9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:17.925222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208f6395a353427eb0cdf98d0fb223a9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:17.941351 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2264/4550] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:17 2022] DELETE /identity/v3/users/208f6395a353427eb0cdf98d0fb223a9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:17.945201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:17.948178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:17.955260 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2287/4551] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:46:17.968259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f150b-4af3-4e0c-874d-b20168a82c55 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:17.973097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ef0f150b-4af3-4e0c-874d-b20168a82c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:18.050953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:18.114077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ddce-5a4f-4c55-a905-03941daef3e1 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:18.120710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:18.121459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:18.121754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:18.122255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/749f9a3b448146bfbe04f83f5865760d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:18.124683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_role(role_id=749f9a3b448146bfbe04f83f5865760d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:18.126721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:18.223048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role 749f9a3b448146bfbe04f83f5865760d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:18.223358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:18.224404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:18.228867 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2265/4552] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:17 2022] DELETE /identity/v3/roles/749f9a3b448146bfbe04f83f5865760d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:18.232683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:18.234163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:18.248254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f150b-4af3-4e0c-874d-b20168a82c55 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:18.397088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c05fe7-8b86-4512-948f-136785b6a454 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:18.404901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273213a-6714-41c7-89c2-489bcb4f12c2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:18.405697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273213a-6714-41c7-89c2-489bcb4f12c2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:18.406108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273213a-6714-41c7-89c2-489bcb4f12c2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:18.406298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273213a-6714-41c7-89c2-489bcb4f12c2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/groups/54f05765b5c7472889f7a195102d7555` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:18.406452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509743b-03f9-47f9-890a-852eb38cd928 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:18.407222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509743b-03f9-47f9-890a-852eb38cd928 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:18.407504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509743b-03f9-47f9-890a-852eb38cd928 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:18.407836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509743b-03f9-47f9-890a-852eb38cd928 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:18.408536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273213a-6714-41c7-89c2-489bcb4f12c2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_group(group_id=54f05765b5c7472889f7a195102d7555)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:18.411742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9509743b-03f9-47f9-890a-852eb38cd928 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:18.413487 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-6273213a-6714-41c7-89c2-489bcb4f12c2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:18.413487 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:18.413487 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:18.415892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273213a-6714-41c7-89c2-489bcb4f12c2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:18.493609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:18.545430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509743b-03f9-47f9-890a-852eb38cd928 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:18.547332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509743b-03f9-47f9-890a-852eb38cd928 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:18.554770 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2266/4553] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:46:18 2022] DELETE /identity/v3/groups/54f05765b5c7472889f7a195102d7555 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:18.558940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273213a-6714-41c7-89c2-489bcb4f12c2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:18.563322 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2288/4554] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:18.853577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273213a-6714-41c7-89c2-489bcb4f12c2 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:18.886765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:18.887440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:18.891355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:18.891725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/projects/f19c6bd49ad342369fddf6d3705a4120` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:18.900890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f19c6bd49ad342369fddf6d3705a4120)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:18.902908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:19.141778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19c6bd49ad342369fddf6d3705a4120', 'request_id': 'req-9e23e196-d532-4bec-abcf-9416d062b7a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.163227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19c6bd49ad342369fddf6d3705a4120', 'request_id': 'req-9e23e196-d532-4bec-abcf-9416d062b7a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.201627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19c6bd49ad342369fddf6d3705a4120', 'request_id': 'req-9e23e196-d532-4bec-abcf-9416d062b7a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.251890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] The token cache is being invalidate because project f19c6bd49ad342369fddf6d3705a4120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:19.252236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.258209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.265958 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2267/4555] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:18 2022] DELETE /identity/v3/projects/f19c6bd49ad342369fddf6d3705a4120 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:19.268222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509743b-03f9-47f9-890a-852eb38cd928 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:19.287338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509743b-03f9-47f9-890a-852eb38cd928 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:19.472876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:19.482708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfe7cd-29b6-4a04-9906-f23806907823 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:19.483612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe7cd-29b6-4a04-9906-f23806907823 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:19.483989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe7cd-29b6-4a04-9906-f23806907823 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:19.484279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe7cd-29b6-4a04-9906-f23806907823 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/bf7ab92494934f39bbee2c069d445ece` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:19.485795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfe7cd-29b6-4a04-9906-f23806907823 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bf7ab92494934f39bbee2c069d445ece)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:19.487794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfe7cd-29b6-4a04-9906-f23806907823 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:19.550654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b5cfe7cd-29b6-4a04-9906-f23806907823 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.551748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b5cfe7cd-29b6-4a04-9906-f23806907823 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.606297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b5cfe7cd-29b6-4a04-9906-f23806907823 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.608634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b5cfe7cd-29b6-4a04-9906-f23806907823 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.620710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:19.622621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:19.643240 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2289/4556] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:46:19 2022] PATCH /identity/v3/domains/bf7ab92494934f39bbee2c069d445ece => generated 277 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:46:19.650582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e21c9-612e-4e02-9464-cd27cf9af70e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:19.651811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e21c9-612e-4e02-9464-cd27cf9af70e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:19.651811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e21c9-612e-4e02-9464-cd27cf9af70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:19.657820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23e196-d532-4bec-abcf-9416d062b7a7 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:19.743749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-016e21c9-612e-4e02-9464-cd27cf9af70e None None] MFA Rules not processed for user `50bf76900e48462199fb7ea9337703e7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:19.745106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-016e21c9-612e-4e02-9464-cd27cf9af70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:19.771913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:19.773178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:19.773550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:19.773842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/domains/bf7ab92494934f39bbee2c069d445ece` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:19.790777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bf7ab92494934f39bbee2c069d445ece)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:19.792829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:19.804036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:19.829787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.841823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.907385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece', 'request_id': 'req-738f124d-3fff-4a75-a64e-4c1f50d44e34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.916430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece', 'request_id': 'req-738f124d-3fff-4a75-a64e-4c1f50d44e34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.947753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece', 'request_id': 'req-738f124d-3fff-4a75-a64e-4c1f50d44e34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.965933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] The token cache is being invalidate because project bf7ab92494934f39bbee2c069d445ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:19.966219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.966916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.977183 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2290/4557] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:19.980117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece', 'request_id': 'req-738f124d-3fff-4a75-a64e-4c1f50d44e34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.981184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece', 'request_id': 'req-738f124d-3fff-4a75-a64e-4c1f50d44e34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.981915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bf7ab92494934f39bbee2c069d445ece', 'request_id': 'req-738f124d-3fff-4a75-a64e-4c1f50d44e34'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:19.999070 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2268/4558] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:46:19 2022] DELETE /identity/v3/domains/bf7ab92494934f39bbee2c069d445ece => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:19.999616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e21c9-612e-4e02-9464-cd27cf9af70e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:20.001162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-016e21c9-612e-4e02-9464-cd27cf9af70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:20.035534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e21c9-612e-4e02-9464-cd27cf9af70e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:20.263766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:20.264531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:20.265267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:20.265267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/76bf6eb3fcc049d38648d26d0accde60` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:20.276784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_role(role_id=76bf6eb3fcc049d38648d26d0accde60)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:20.277465 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:20.277465 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:20.277465 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:20.278119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:20.416038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role 76bf6eb3fcc049d38648d26d0accde60 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:20.416509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:20.420671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:20.424343 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2291/4559] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:19 2022] DELETE /identity/v3/roles/76bf6eb3fcc049d38648d26d0accde60 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:20.428424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:20.430313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:20.454843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f124d-3fff-4a75-a64e-4c1f50d44e34 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:20.617981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:20.618678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:20.619068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:20.619275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/1590b1d904ba47ef99dc17dec434fdf9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:20.624987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1590b1d904ba47ef99dc17dec434fdf9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:20.631199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:20.836580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role 1590b1d904ba47ef99dc17dec434fdf9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:20.837105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:20.844908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:20.853958 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2269/4560] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:20 2022] DELETE /identity/v3/roles/1590b1d904ba47ef99dc17dec434fdf9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:20.860609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:20.864785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:20.914444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50e4c5-df58-4ffa-a0f5-46063cc3d170 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:20.956594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:21.226998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a79cc-3237-4347-9fc2-b65dd46f99b8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1764c4b644d1403e835e345e0b95ec81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c091057637a41999323ce6164131d14', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:21.227763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a79cc-3237-4347-9fc2-b65dd46f99b8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:21.228042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a79cc-3237-4347-9fc2-b65dd46f99b8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:21.228315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a79cc-3237-4347-9fc2-b65dd46f99b8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] PATH_INFO: `/v3/roles/e3f26af6d55e43f4b470602b9951b54c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:21.229829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a79cc-3237-4347-9fc2-b65dd46f99b8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e3f26af6d55e43f4b470602b9951b54c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:21.231437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a79cc-3237-4347-9fc2-b65dd46f99b8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:21.337567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df0a79cc-3237-4347-9fc2-b65dd46f99b8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invalidating the token cache because role e3f26af6d55e43f4b470602b9951b54c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:21.338318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df0a79cc-3237-4347-9fc2-b65dd46f99b8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:21.340914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-df0a79cc-3237-4347-9fc2-b65dd46f99b8 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:21.343327 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2292/4561] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:20 2022] DELETE /identity/v3/roles/e3f26af6d55e43f4b470602b9951b54c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:21.348494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:21.350136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:21.423124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:21.535963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e54c5-9cd6-497e-bc7a-376ccfbe3727 tempest-RolesV3TestJSON-1229109301 tempest-RolesV3TestJSON-1229109301-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:21.681895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:21.682728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:21.682995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:21.683262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] PATH_INFO: `/v3/users/be48a28700ef4a3faeab5c62d28ea9f2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:21.685486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=be48a28700ef4a3faeab5c62d28ea9f2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:21.687444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:21.813174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be48a28700ef4a3faeab5c62d28ea9f2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:21.819894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be48a28700ef4a3faeab5c62d28ea9f2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:21.864046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be48a28700ef4a3faeab5c62d28ea9f2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:21.920127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be48a28700ef4a3faeab5c62d28ea9f2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:21.930303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be48a28700ef4a3faeab5c62d28ea9f2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:21.944268 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2270/4562] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:21 2022] DELETE /identity/v3/users/be48a28700ef4a3faeab5c62d28ea9f2 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:21.944478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f78404-9c39-4251-a1f6-c8b2d27d1f5b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:21.944712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f78404-9c39-4251-a1f6-c8b2d27d1f5b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:21.944985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f78404-9c39-4251-a1f6-c8b2d27d1f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:22.004151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f5f78404-9c39-4251-a1f6-c8b2d27d1f5b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:22.005525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f5f78404-9c39-4251-a1f6-c8b2d27d1f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:22.297216 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2293/4563] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:46:22.652988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:22.667767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:22.785346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:22.807762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff09cd4-aab9-4efc-95ff-67ff3000f86b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:22.817100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e4919-d09b-4c85-9b3c-718c9e0a62c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:22.818532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e4919-d09b-4c85-9b3c-718c9e0a62c0 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:22.819182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e4919-d09b-4c85-9b3c-718c9e0a62c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:22.819608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e4919-d09b-4c85-9b3c-718c9e0a62c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:22.844707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e4919-d09b-4c85-9b3c-718c9e0a62c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:22.850591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e4919-d09b-4c85-9b3c-718c9e0a62c0 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:22.895056 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2271/4564] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:25.512619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f78404-9c39-4251-a1f6-c8b2d27d1f5b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:25.542543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f78404-9c39-4251-a1f6-c8b2d27d1f5b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:25.556699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e615e0-8b01-44b0-9a91-a870b7ba7e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:25.557810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e615e0-8b01-44b0-9a91-a870b7ba7e1c service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:25.558271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e615e0-8b01-44b0-9a91-a870b7ba7e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:25.558729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e615e0-8b01-44b0-9a91-a870b7ba7e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:25.561072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e1e615e0-8b01-44b0-9a91-a870b7ba7e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:25.584274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e615e0-8b01-44b0-9a91-a870b7ba7e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:25.587384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e615e0-8b01-44b0-9a91-a870b7ba7e1c service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:25.601432 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2294/4565] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:26.419600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e4919-d09b-4c85-9b3c-718c9e0a62c0 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:26.420918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cb7e4919-d09b-4c85-9b3c-718c9e0a62c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:26.484316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e4919-d09b-4c85-9b3c-718c9e0a62c0 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:26.498650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:26.502839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:26.502839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:26.503210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] PATH_INFO: `/v3/projects/790a8aa5b64946f780947a532e7b95f3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:26.504792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=790a8aa5b64946f780947a532e7b95f3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:26.510489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:26.714771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790a8aa5b64946f780947a532e7b95f3', 'request_id': 'req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:26.723033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790a8aa5b64946f780947a532e7b95f3', 'request_id': 'req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:26.763891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790a8aa5b64946f780947a532e7b95f3', 'request_id': 'req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:26.796097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] The token cache is being invalidate because project 790a8aa5b64946f780947a532e7b95f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:26.796441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:26.801855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:26.805731 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2272/4566] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:26 2022] DELETE /identity/v3/projects/790a8aa5b64946f780947a532e7b95f3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:26.809551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e615e0-8b01-44b0-9a91-a870b7ba7e1c service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:26.827520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e615e0-8b01-44b0-9a91-a870b7ba7e1c service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:26.895546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b929e4-acc6-49ea-b37e-625d91268e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:26.896569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b929e4-acc6-49ea-b37e-625d91268e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:26.897201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b929e4-acc6-49ea-b37e-625d91268e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:26.897841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b929e4-acc6-49ea-b37e-625d91268e75 admin admin] PATH_INFO: `/v3/users/1764c4b644d1403e835e345e0b95ec81` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:26.900004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b929e4-acc6-49ea-b37e-625d91268e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1764c4b644d1403e835e345e0b95ec81)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:26.902923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b929e4-acc6-49ea-b37e-625d91268e75 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:26.916975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:27.011041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-08b929e4-acc6-49ea-b37e-625d91268e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1764c4b644d1403e835e345e0b95ec81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:27.012316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-08b929e4-acc6-49ea-b37e-625d91268e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1764c4b644d1403e835e345e0b95ec81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:27.027737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-08b929e4-acc6-49ea-b37e-625d91268e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1764c4b644d1403e835e345e0b95ec81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:27.028694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-08b929e4-acc6-49ea-b37e-625d91268e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1764c4b644d1403e835e345e0b95ec81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:27.038231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-08b929e4-acc6-49ea-b37e-625d91268e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1764c4b644d1403e835e345e0b95ec81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:27.086508 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2295/4567] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:26 2022] DELETE /identity/v3/users/1764c4b644d1403e835e345e0b95ec81 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:28.686346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:28.687849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:28.718186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae356ff-c8e5-4bb5-9661-92ac3f900ecf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:29.052928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:29.055962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:29.058817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:29.060072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] PATH_INFO: `/v3/projects/5c091057637a41999323ce6164131d14` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:29.065910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c091057637a41999323ce6164131d14)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:29.071546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:29.262076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c091057637a41999323ce6164131d14', 'request_id': 'req-fdc647bd-8465-43ee-ba9d-575327d4b5c5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:29.276840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c091057637a41999323ce6164131d14', 'request_id': 'req-fdc647bd-8465-43ee-ba9d-575327d4b5c5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:29.291614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c091057637a41999323ce6164131d14', 'request_id': 'req-fdc647bd-8465-43ee-ba9d-575327d4b5c5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:29.316882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:29.329703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] The token cache is being invalidate because project 5c091057637a41999323ce6164131d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:29.333362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:29.334379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fdc647bd-8465-43ee-ba9d-575327d4b5c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:29.344335 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2273/4568] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:28 2022] DELETE /identity/v3/projects/5c091057637a41999323ce6164131d14 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:29.346473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb1c53-0c89-4eda-8261-10b0e91ee525 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:29.346949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb1c53-0c89-4eda-8261-10b0e91ee525 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:29.347356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb1c53-0c89-4eda-8261-10b0e91ee525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:29.402870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0acb1c53-0c89-4eda-8261-10b0e91ee525 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:29.404776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0acb1c53-0c89-4eda-8261-10b0e91ee525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:29.605786 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2296/4569] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:29.611428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a2a4-701f-487d-900a-3d9a695b7ccf None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:29.611812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a2a4-701f-487d-900a-3d9a695b7ccf None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:29.612187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a2a4-701f-487d-900a-3d9a695b7ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:29.660672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-22d5a2a4-701f-487d-900a-3d9a695b7ccf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:29.671085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-22d5a2a4-701f-487d-900a-3d9a695b7ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:29.691449 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2274/4570] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:29.695789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb1c53-0c89-4eda-8261-10b0e91ee525 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:29.709726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb1c53-0c89-4eda-8261-10b0e91ee525 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:29.722239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e70c-5f49-478c-be35-5d89aa6f0501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:29.724483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e70c-5f49-478c-be35-5d89aa6f0501 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:29.724783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e70c-5f49-478c-be35-5d89aa6f0501 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:29.725062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e70c-5f49-478c-be35-5d89aa6f0501 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:29.727287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42e70c-5f49-478c-be35-5d89aa6f0501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:29.727636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42e70c-5f49-478c-be35-5d89aa6f0501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:29.729308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42e70c-5f49-478c-be35-5d89aa6f0501 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:29.765846 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2297/4571] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:29.771425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5a2a4-701f-487d-900a-3d9a695b7ccf None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:29.790205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5a2a4-701f-487d-900a-3d9a695b7ccf None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:29.800903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b08d93-26a3-4d6e-b8f3-b3e93d1a2961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:29.802095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b08d93-26a3-4d6e-b8f3-b3e93d1a2961 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:29.804844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b08d93-26a3-4d6e-b8f3-b3e93d1a2961 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:29.805251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b08d93-26a3-4d6e-b8f3-b3e93d1a2961 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:29.806163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b08d93-26a3-4d6e-b8f3-b3e93d1a2961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:29.815838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b08d93-26a3-4d6e-b8f3-b3e93d1a2961 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:29.901807 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2275/4572] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:29 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:29.906251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e70c-5f49-478c-be35-5d89aa6f0501 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:29.924123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e70c-5f49-478c-be35-5d89aa6f0501 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:30.107244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13632c7-bcc1-4c5b-8336-067c50a9eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:30.109151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13632c7-bcc1-4c5b-8336-067c50a9eba2 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:30.113142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13632c7-bcc1-4c5b-8336-067c50a9eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:30.113142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13632c7-bcc1-4c5b-8336-067c50a9eba2 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:30.118175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13632c7-bcc1-4c5b-8336-067c50a9eba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:30.122836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13632c7-bcc1-4c5b-8336-067c50a9eba2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:30.168045 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2298/4573] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:29 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:30.171342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b08d93-26a3-4d6e-b8f3-b3e93d1a2961 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:30.210575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b08d93-26a3-4d6e-b8f3-b3e93d1a2961 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:30.226073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29c931-3a2a-4f21-8f24-f7ad9d5a09bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:30.227576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29c931-3a2a-4f21-8f24-f7ad9d5a09bf admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:30.227958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29c931-3a2a-4f21-8f24-f7ad9d5a09bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:30.229060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29c931-3a2a-4f21-8f24-f7ad9d5a09bf admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:30.230340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29c931-3a2a-4f21-8f24-f7ad9d5a09bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:30.253104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29c931-3a2a-4f21-8f24-f7ad9d5a09bf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:30.289818 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2276/4574] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:30.293273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13632c7-bcc1-4c5b-8336-067c50a9eba2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:30.306621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:30.320853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13632c7-bcc1-4c5b-8336-067c50a9eba2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:30.368998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb3f70-d71f-475c-bc07-f08dcdde433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:30.374028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3f70-d71f-475c-bc07-f08dcdde433c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:30.374399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3f70-d71f-475c-bc07-f08dcdde433c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:30.374682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3f70-d71f-475c-bc07-f08dcdde433c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:30.384136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb3f70-d71f-475c-bc07-f08dcdde433c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:30.391583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb3f70-d71f-475c-bc07-f08dcdde433c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:30.462265 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2299/4575] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:30.462519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29c931-3a2a-4f21-8f24-f7ad9d5a09bf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:30.495783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29c931-3a2a-4f21-8f24-f7ad9d5a09bf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:30.514178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770d8db-61da-456c-a5a5-9ccc9f542304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:30.515690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d8db-61da-456c-a5a5-9ccc9f542304 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:30.516241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d8db-61da-456c-a5a5-9ccc9f542304 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:30.516775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d8db-61da-456c-a5a5-9ccc9f542304 admin admin] PATH_INFO: `/v3/projects/2561458586d64e70bc6b085dc372ce93/users/7c3de3ec24804d1db00bdd4bbdba2504/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:30.556264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770d8db-61da-456c-a5a5-9ccc9f542304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2561458586d64e70bc6b085dc372ce93, user_id=7c3de3ec24804d1db00bdd4bbdba2504, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:30.561335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770d8db-61da-456c-a5a5-9ccc9f542304 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:30.605582 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2277/4576] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:30 2022] PUT /identity/v3/projects/2561458586d64e70bc6b085dc372ce93/users/7c3de3ec24804d1db00bdd4bbdba2504/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:30.608766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1ca42-be7f-4810-8903-ee8693423133 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:30.609413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1ca42-be7f-4810-8903-ee8693423133 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:30.610047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1ca42-be7f-4810-8903-ee8693423133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:30.655807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-33d1ca42-be7f-4810-8903-ee8693423133 None None] MFA Rules not processed for user `7c3de3ec24804d1db00bdd4bbdba2504`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:30.657223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-33d1ca42-be7f-4810-8903-ee8693423133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:30.779585 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2300/4577] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:30.786261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770d8db-61da-456c-a5a5-9ccc9f542304 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:30.807446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770d8db-61da-456c-a5a5-9ccc9f542304 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:30.823767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2a5d7-ae37-4491-8492-b9f5df129d60 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:30.826802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a5d7-ae37-4491-8492-b9f5df129d60 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:30.827521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a5d7-ae37-4491-8492-b9f5df129d60 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:30.828053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a5d7-ae37-4491-8492-b9f5df129d60 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:30.830320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2a5d7-ae37-4491-8492-b9f5df129d60 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:create_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:30.833114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2a5d7-ae37-4491-8492-b9f5df129d60 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:31.074724 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2278/4578] 10.222.0.16 () {60 vars in 1314 bytes} [Mon Aug 29 15:46:30 2022] POST /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials => generated 789 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:31.078325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1ca42-be7f-4810-8903-ee8693423133 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:31.110389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1ca42-be7f-4810-8903-ee8693423133 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:31.125657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38340f9e-4a3e-4ecc-9cf6-9762c4a1d0d8 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:31.127072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38340f9e-4a3e-4ecc-9cf6-9762c4a1d0d8 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:31.127318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38340f9e-4a3e-4ecc-9cf6-9762c4a1d0d8 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:31.127555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38340f9e-4a3e-4ecc-9cf6-9762c4a1d0d8 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/5ebec142882a4a15804ab2b3f00ee40b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:31.185349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38340f9e-4a3e-4ecc-9cf6-9762c4a1d0d8 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:get_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504, application_credential_id=5ebec142882a4a15804ab2b3f00ee40b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:31.195221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38340f9e-4a3e-4ecc-9cf6-9762c4a1d0d8 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:31.205793 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2301/4579] 10.222.0.16 () {58 vars in 1392 bytes} [Mon Aug 29 15:46:31 2022] GET /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/5ebec142882a4a15804ab2b3f00ee40b => generated 689 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:31.213494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4722ba-dbd1-4dc5-bf2d-5548b98b59ed None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:31.216411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4722ba-dbd1-4dc5-bf2d-5548b98b59ed None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:31.220461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4722ba-dbd1-4dc5-bf2d-5548b98b59ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:31.290962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1d4722ba-dbd1-4dc5-bf2d-5548b98b59ed None None] MFA Rules not processed for user `7c3de3ec24804d1db00bdd4bbdba2504`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:31.299538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1d4722ba-dbd1-4dc5-bf2d-5548b98b59ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:31.458024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:31.492711 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2279/4580] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 29 15:46:31.496931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38340f9e-4a3e-4ecc-9cf6-9762c4a1d0d8 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:31.537733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38340f9e-4a3e-4ecc-9cf6-9762c4a1d0d8 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:31.576518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67350-f223-4c96-9546-133979b70e3b tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:31.577197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67350-f223-4c96-9546-133979b70e3b tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:31.577601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67350-f223-4c96-9546-133979b70e3b tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:31.577771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67350-f223-4c96-9546-133979b70e3b tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/5ebec142882a4a15804ab2b3f00ee40b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:31.586930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67350-f223-4c96-9546-133979b70e3b tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:delete_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504, application_credential_id=5ebec142882a4a15804ab2b3f00ee40b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:31.592105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67350-f223-4c96-9546-133979b70e3b tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:31.670183 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2302/4581] 10.222.0.16 () {58 vars in 1395 bytes} [Mon Aug 29 15:46:31 2022] DELETE /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/5ebec142882a4a15804ab2b3f00ee40b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:31.674913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4722ba-dbd1-4dc5-bf2d-5548b98b59ed None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:31.689642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4722ba-dbd1-4dc5-bf2d-5548b98b59ed None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:31.705687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768946-4373-49ae-965f-e33c6cdf4119 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:31.705687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768946-4373-49ae-965f-e33c6cdf4119 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:31.709350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768946-4373-49ae-965f-e33c6cdf4119 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:31.709350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768946-4373-49ae-965f-e33c6cdf4119 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:31.710756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8768946-4373-49ae-965f-e33c6cdf4119 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:create_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:31.715223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8768946-4373-49ae-965f-e33c6cdf4119 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:31.990770 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2280/4582] 10.222.0.16 () {60 vars in 1315 bytes} [Mon Aug 29 15:46:31 2022] POST /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials => generated 920 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:31.996266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67350-f223-4c96-9546-133979b70e3b tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:32.020362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67350-f223-4c96-9546-133979b70e3b tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:32.042662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2086e-fac4-41dd-94a0-d31ae74d9d38 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:32.056932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2086e-fac4-41dd-94a0-d31ae74d9d38 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:32.057658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2086e-fac4-41dd-94a0-d31ae74d9d38 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:32.058177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2086e-fac4-41dd-94a0-d31ae74d9d38 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/1d69c55be0c942f6818acf71156cfa2a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:32.083529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2086e-fac4-41dd-94a0-d31ae74d9d38 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:delete_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504, application_credential_id=1d69c55be0c942f6818acf71156cfa2a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:32.087403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2086e-fac4-41dd-94a0-d31ae74d9d38 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:32.151308 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2303/4583] 10.222.0.16 () {58 vars in 1395 bytes} [Mon Aug 29 15:46:31 2022] DELETE /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/1d69c55be0c942f6818acf71156cfa2a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:32.158550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768946-4373-49ae-965f-e33c6cdf4119 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:32.177482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768946-4373-49ae-965f-e33c6cdf4119 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:32.191132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1d586-7f4b-4196-a630-9560cb83b1f2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:32.192605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1d586-7f4b-4196-a630-9560cb83b1f2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:32.193330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1d586-7f4b-4196-a630-9560cb83b1f2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:32.194666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1d586-7f4b-4196-a630-9560cb83b1f2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:32.195872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1d586-7f4b-4196-a630-9560cb83b1f2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:create_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:32.198332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1d586-7f4b-4196-a630-9560cb83b1f2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:32.520791 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2281/4584] 10.222.0.16 () {60 vars in 1315 bytes} [Mon Aug 29 15:46:32 2022] POST /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials => generated 812 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:32.522325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2086e-fac4-41dd-94a0-d31ae74d9d38 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:32.566274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2086e-fac4-41dd-94a0-d31ae74d9d38 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:32.589488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5d874-f5d2-4880-a7a6-ce3cafb0ade3 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:32.591069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5d874-f5d2-4880-a7a6-ce3cafb0ade3 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:32.591276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5d874-f5d2-4880-a7a6-ce3cafb0ade3 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:32.591561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5d874-f5d2-4880-a7a6-ce3cafb0ade3 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/2ec4b973aa364da696d6afba17cfe3c9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:32.640748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5d874-f5d2-4880-a7a6-ce3cafb0ade3 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:delete_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504, application_credential_id=2ec4b973aa364da696d6afba17cfe3c9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:32.646847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5d874-f5d2-4880-a7a6-ce3cafb0ade3 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:32.725294 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2304/4585] 10.222.0.16 () {58 vars in 1395 bytes} [Mon Aug 29 15:46:32 2022] DELETE /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/2ec4b973aa364da696d6afba17cfe3c9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:32.733381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1d586-7f4b-4196-a630-9560cb83b1f2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:32.756175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1d586-7f4b-4196-a630-9560cb83b1f2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:32.761642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38481b11-2d0e-43b3-a302-9ce4bcbf1b19 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:32.762729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38481b11-2d0e-43b3-a302-9ce4bcbf1b19 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:32.763223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38481b11-2d0e-43b3-a302-9ce4bcbf1b19 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:32.763671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38481b11-2d0e-43b3-a302-9ce4bcbf1b19 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:32.765727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38481b11-2d0e-43b3-a302-9ce4bcbf1b19 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:create_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:32.767131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38481b11-2d0e-43b3-a302-9ce4bcbf1b19 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:32.979411 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2282/4586] 10.222.0.16 () {60 vars in 1314 bytes} [Mon Aug 29 15:46:32 2022] POST /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials => generated 789 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:32.983608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5d874-f5d2-4880-a7a6-ce3cafb0ade3 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:32.998611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5d874-f5d2-4880-a7a6-ce3cafb0ade3 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:33.018972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8831c8-409c-44f5-ad49-ff0cb0decbab tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:33.020077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8831c8-409c-44f5-ad49-ff0cb0decbab tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:33.020588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8831c8-409c-44f5-ad49-ff0cb0decbab tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:33.021086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8831c8-409c-44f5-ad49-ff0cb0decbab tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:33.029638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8831c8-409c-44f5-ad49-ff0cb0decbab tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:create_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:33.031293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8831c8-409c-44f5-ad49-ff0cb0decbab tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:33.160414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:33.261747 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2305/4587] 10.222.0.16 () {60 vars in 1314 bytes} [Mon Aug 29 15:46:32 2022] POST /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials => generated 789 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:33.263096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38481b11-2d0e-43b3-a302-9ce4bcbf1b19 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:33.282574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:33.289515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38481b11-2d0e-43b3-a302-9ce4bcbf1b19 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:33.298709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a194e-9162-4e94-91ba-82881123bf89 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:33.299529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a194e-9162-4e94-91ba-82881123bf89 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:33.300398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a194e-9162-4e94-91ba-82881123bf89 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:33.300796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a194e-9162-4e94-91ba-82881123bf89 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:33.301577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a194e-9162-4e94-91ba-82881123bf89 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:list_application_credentials(user_id=7c3de3ec24804d1db00bdd4bbdba2504)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:33.303882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a194e-9162-4e94-91ba-82881123bf89 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:33.334349 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2283/4588] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Aug 29 15:46:33 2022] GET /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials => generated 1502 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:33.338531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8831c8-409c-44f5-ad49-ff0cb0decbab tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:33.364331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8831c8-409c-44f5-ad49-ff0cb0decbab tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:33.380585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69186-dbb7-40b0-ac23-c26386345bd1 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:33.381461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69186-dbb7-40b0-ac23-c26386345bd1 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:33.381873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69186-dbb7-40b0-ac23-c26386345bd1 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:33.382273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69186-dbb7-40b0-ac23-c26386345bd1 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/c52ccc8f230341bfb7bb02c4861e39af` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:33.404869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b69186-dbb7-40b0-ac23-c26386345bd1 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:delete_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504, application_credential_id=c52ccc8f230341bfb7bb02c4861e39af)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:33.407004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b69186-dbb7-40b0-ac23-c26386345bd1 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:33.443474 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2306/4589] 10.222.0.16 () {58 vars in 1395 bytes} [Mon Aug 29 15:46:33 2022] DELETE /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/c52ccc8f230341bfb7bb02c4861e39af => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:33.448800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a194e-9162-4e94-91ba-82881123bf89 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:33.469035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a194e-9162-4e94-91ba-82881123bf89 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:33.480440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924108-1e32-4b21-845c-895419cb72c2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:33.482062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924108-1e32-4b21-845c-895419cb72c2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:33.495298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924108-1e32-4b21-845c-895419cb72c2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:33.495992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924108-1e32-4b21-845c-895419cb72c2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/cb77556d5ae242f6a216a52b650718ca` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:33.512634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0924108-1e32-4b21-845c-895419cb72c2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:delete_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504, application_credential_id=cb77556d5ae242f6a216a52b650718ca)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:33.514793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0924108-1e32-4b21-845c-895419cb72c2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:33.575031 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2284/4590] 10.222.0.16 () {58 vars in 1395 bytes} [Mon Aug 29 15:46:33 2022] DELETE /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/cb77556d5ae242f6a216a52b650718ca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:33.576268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69186-dbb7-40b0-ac23-c26386345bd1 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:33.613770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69186-dbb7-40b0-ac23-c26386345bd1 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:33.627116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab689fb9-4ddd-4013-b5f9-b716c8bd7111 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:33.628083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689fb9-4ddd-4013-b5f9-b716c8bd7111 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:33.628519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689fb9-4ddd-4013-b5f9-b716c8bd7111 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:33.628946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689fb9-4ddd-4013-b5f9-b716c8bd7111 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:33.629810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab689fb9-4ddd-4013-b5f9-b716c8bd7111 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:create_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:33.631156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab689fb9-4ddd-4013-b5f9-b716c8bd7111 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:33.809101 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2307/4591] 10.222.0.16 () {60 vars in 1314 bytes} [Mon Aug 29 15:46:33 2022] POST /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials => generated 789 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:33.810708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924108-1e32-4b21-845c-895419cb72c2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:33.823518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924108-1e32-4b21-845c-895419cb72c2 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:33.864964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa0f36-6ff3-4fff-8c14-3606bcce7404 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:33.865777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa0f36-6ff3-4fff-8c14-3606bcce7404 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:33.866325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa0f36-6ff3-4fff-8c14-3606bcce7404 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:33.866632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa0f36-6ff3-4fff-8c14-3606bcce7404 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:33.867931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa0f36-6ff3-4fff-8c14-3606bcce7404 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:create_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:33.869219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa0f36-6ff3-4fff-8c14-3606bcce7404 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:34.105411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab689fb9-4ddd-4013-b5f9-b716c8bd7111 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:34.115789 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2285/4592] 10.222.0.16 () {60 vars in 1314 bytes} [Mon Aug 29 15:46:33 2022] POST /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials => generated 788 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:34.129362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab689fb9-4ddd-4013-b5f9-b716c8bd7111 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:34.154373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35b032-c281-429a-8d73-06d65d958bfb tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:34.158329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35b032-c281-429a-8d73-06d65d958bfb tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:34.158640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35b032-c281-429a-8d73-06d65d958bfb tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:34.158953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35b032-c281-429a-8d73-06d65d958bfb tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:34.159741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35b032-c281-429a-8d73-06d65d958bfb tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Adding query filter params (name=tempest-application_credential-624622836) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:34.164353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35b032-c281-429a-8d73-06d65d958bfb tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:list_application_credentials(user_id=7c3de3ec24804d1db00bdd4bbdba2504)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:34.171412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35b032-c281-429a-8d73-06d65d958bfb tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:34.224792 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2308/4593] 10.222.0.16 () {58 vars in 1384 bytes} [Mon Aug 29 15:46:34 2022] GET /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials?name=tempest-application_credential-624622836 => generated 885 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:46:34.229167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa0f36-6ff3-4fff-8c14-3606bcce7404 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:34.244259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa0f36-6ff3-4fff-8c14-3606bcce7404 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:34.265564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69dbbf-80b6-4ac1-87a0-e41f3d14a6cf tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:34.266290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69dbbf-80b6-4ac1-87a0-e41f3d14a6cf tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:34.266490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69dbbf-80b6-4ac1-87a0-e41f3d14a6cf tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:34.266771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69dbbf-80b6-4ac1-87a0-e41f3d14a6cf tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/74e7faeab28745368a2f0b83fa0c4d93` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:34.298720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69dbbf-80b6-4ac1-87a0-e41f3d14a6cf tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:delete_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504, application_credential_id=74e7faeab28745368a2f0b83fa0c4d93)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:34.301152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69dbbf-80b6-4ac1-87a0-e41f3d14a6cf tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:34.363280 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2286/4594] 10.222.0.16 () {58 vars in 1395 bytes} [Mon Aug 29 15:46:34 2022] DELETE /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/74e7faeab28745368a2f0b83fa0c4d93 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:34.368586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35b032-c281-429a-8d73-06d65d958bfb tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:34.414328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35b032-c281-429a-8d73-06d65d958bfb tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:34.430045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99bac4-1bdd-4dc0-9660-449a8a723440 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3de3ec24804d1db00bdd4bbdba2504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2561458586d64e70bc6b085dc372ce93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:34.431511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99bac4-1bdd-4dc0-9660-449a8a723440 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:34.431811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99bac4-1bdd-4dc0-9660-449a8a723440 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:34.432314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99bac4-1bdd-4dc0-9660-449a8a723440 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/3f0f8b8313b647e687e7d225a91195d0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:34.460233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99bac4-1bdd-4dc0-9660-449a8a723440 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorizing `identity:delete_application_credential(user_id=7c3de3ec24804d1db00bdd4bbdba2504, application_credential_id=3f0f8b8313b647e687e7d225a91195d0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:34.462221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99bac4-1bdd-4dc0-9660-449a8a723440 tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:34.557989 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2309/4595] 10.222.0.16 () {58 vars in 1395 bytes} [Mon Aug 29 15:46:34 2022] DELETE /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504/application_credentials/3f0f8b8313b647e687e7d225a91195d0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:34.562693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69dbbf-80b6-4ac1-87a0-e41f3d14a6cf tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:34.728378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69dbbf-80b6-4ac1-87a0-e41f3d14a6cf tempest-ApplicationCredentialsV3Test-1000295167 tempest-ApplicationCredentialsV3Test-1000295167-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:34.738354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:34.739458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:34.739896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:34.740329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] PATH_INFO: `/v3/users/7c3de3ec24804d1db00bdd4bbdba2504` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:34.742641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3de3ec24804d1db00bdd4bbdba2504)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:34.747934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:34.821261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:34.870034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3de3ec24804d1db00bdd4bbdba2504'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:34.872218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3de3ec24804d1db00bdd4bbdba2504'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:34.923169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3de3ec24804d1db00bdd4bbdba2504'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:34.944916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3de3ec24804d1db00bdd4bbdba2504'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:34.986486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3de3ec24804d1db00bdd4bbdba2504'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:34.997953 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2287/4596] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:34 2022] DELETE /identity/v3/users/7c3de3ec24804d1db00bdd4bbdba2504 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:35.004247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e12005-7dba-40da-aa4d-19dfd7c7447d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:35.008071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e12005-7dba-40da-aa4d-19dfd7c7447d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:35.011254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e12005-7dba-40da-aa4d-19dfd7c7447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:35.081106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f9e12005-7dba-40da-aa4d-19dfd7c7447d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:35.083010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f9e12005-7dba-40da-aa4d-19dfd7c7447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:35.225644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:35.243952 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2310/4597] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:35.286543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:35.288134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:35.423747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ae406-a6c3-4bb9-afc7-348392c79baa admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:35.439189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6eae1-5990-44d9-a3ee-5cd85edc1bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:35.439855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6eae1-5990-44d9-a3ee-5cd85edc1bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:35.440141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6eae1-5990-44d9-a3ee-5cd85edc1bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:35.440419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6eae1-5990-44d9-a3ee-5cd85edc1bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:35.469934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6eae1-5990-44d9-a3ee-5cd85edc1bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:35.469934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6eae1-5990-44d9-a3ee-5cd85edc1bb8 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:35.486424 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2288/4598] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:35.575113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e12005-7dba-40da-aa4d-19dfd7c7447d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:35.579088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f9e12005-7dba-40da-aa4d-19dfd7c7447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:35.613715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e12005-7dba-40da-aa4d-19dfd7c7447d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:35.632163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee327f-c833-46da-9985-c224110960af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:35.648921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee327f-c833-46da-9985-c224110960af admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:35.650885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee327f-c833-46da-9985-c224110960af admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:35.652970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee327f-c833-46da-9985-c224110960af admin admin] PATH_INFO: `/v3/users/0556380b71674698b3260103ef247c85` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:35.655606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee327f-c833-46da-9985-c224110960af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0556380b71674698b3260103ef247c85)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:35.658007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee327f-c833-46da-9985-c224110960af admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:35.790329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-46ee327f-c833-46da-9985-c224110960af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0556380b71674698b3260103ef247c85'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:35.791284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-46ee327f-c833-46da-9985-c224110960af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0556380b71674698b3260103ef247c85'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:35.814640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-46ee327f-c833-46da-9985-c224110960af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0556380b71674698b3260103ef247c85'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:35.815963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-46ee327f-c833-46da-9985-c224110960af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0556380b71674698b3260103ef247c85'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:35.830732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-46ee327f-c833-46da-9985-c224110960af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0556380b71674698b3260103ef247c85'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:35.861028 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2311/4599] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:35 2022] DELETE /identity/v3/users/0556380b71674698b3260103ef247c85 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:36.362413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6eae1-5990-44d9-a3ee-5cd85edc1bb8 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:36.369235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d9c6eae1-5990-44d9-a3ee-5cd85edc1bb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:36.400125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6eae1-5990-44d9-a3ee-5cd85edc1bb8 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:36.501880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee327f-c833-46da-9985-c224110960af admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:36.506557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-46ee327f-c833-46da-9985-c224110960af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:36.577832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b30499-1289-4300-9159-341051218a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:36.578497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30499-1289-4300-9159-341051218a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:36.578777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30499-1289-4300-9159-341051218a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:36.579073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30499-1289-4300-9159-341051218a6f admin admin] PATH_INFO: `/v3/projects/2561458586d64e70bc6b085dc372ce93` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:36.581946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b30499-1289-4300-9159-341051218a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2561458586d64e70bc6b085dc372ce93)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:36.583903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b30499-1289-4300-9159-341051218a6f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:36.674071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee327f-c833-46da-9985-c224110960af admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:36.680544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:36.681595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:36.682080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:36.682620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] PATH_INFO: `/v3/projects/2b6f6de6c8ae45b4a0d469b6bb28f245` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:36.684045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6f6de6c8ae45b4a0d469b6bb28f245)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:36.686365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:36.693234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:36.708888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69b30499-1289-4300-9159-341051218a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2561458586d64e70bc6b085dc372ce93', 'request_id': 'req-69b30499-1289-4300-9159-341051218a6f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:36.721975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69b30499-1289-4300-9159-341051218a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2561458586d64e70bc6b085dc372ce93', 'request_id': 'req-69b30499-1289-4300-9159-341051218a6f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:36.750344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'request_id': 'req-d6c96574-3bbe-430f-b3c5-ef238876750b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:36.759912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'request_id': 'req-d6c96574-3bbe-430f-b3c5-ef238876750b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:36.765833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69b30499-1289-4300-9159-341051218a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2561458586d64e70bc6b085dc372ce93', 'request_id': 'req-69b30499-1289-4300-9159-341051218a6f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:36.770919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6f6de6c8ae45b4a0d469b6bb28f245', 'request_id': 'req-d6c96574-3bbe-430f-b3c5-ef238876750b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:36.789337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] The token cache is being invalidate because project 2b6f6de6c8ae45b4a0d469b6bb28f245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:36.789753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:36.794562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6c96574-3bbe-430f-b3c5-ef238876750b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:36.796615 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2312/4600] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:36 2022] DELETE /identity/v3/projects/2b6f6de6c8ae45b4a0d469b6bb28f245 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:36.806729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cda22a-d811-4b56-9475-3f824642b315 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:36.807129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cda22a-d811-4b56-9475-3f824642b315 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:36.807560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cda22a-d811-4b56-9475-3f824642b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:36.820510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:36.841166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-49cda22a-d811-4b56-9475-3f824642b315 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:36.843477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-49cda22a-d811-4b56-9475-3f824642b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:36.843920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69b30499-1289-4300-9159-341051218a6f admin admin] The token cache is being invalidate because project 2561458586d64e70bc6b085dc372ce93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:36.844575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69b30499-1289-4300-9159-341051218a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:36.847329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69b30499-1289-4300-9159-341051218a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:36.849698 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2289/4601] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:36 2022] DELETE /identity/v3/projects/2561458586d64e70bc6b085dc372ce93 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:36.857735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b3cb3-b0d4-492f-a81c-e458460ec7a7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:36.858054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b3cb3-b0d4-492f-a81c-e458460ec7a7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:36.858296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b3cb3-b0d4-492f-a81c-e458460ec7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:36.908685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-719b3cb3-b0d4-492f-a81c-e458460ec7a7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:36.910054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-719b3cb3-b0d4-492f-a81c-e458460ec7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:36.981275 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2313/4602] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:36.991647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b7e12-2ef5-483f-8999-fb7566348f0f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:36.991946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b7e12-2ef5-483f-8999-fb7566348f0f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:36.992224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b7e12-2ef5-483f-8999-fb7566348f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.042189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-935b7e12-2ef5-483f-8999-fb7566348f0f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:37.043590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-935b7e12-2ef5-483f-8999-fb7566348f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:37.054864 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2290/4603] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:37.056652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b001-a42a-4ae8-8c0c-c903be2f7e27 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.056946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b001-a42a-4ae8-8c0c-c903be2f7e27 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.057225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b001-a42a-4ae8-8c0c-c903be2f7e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.077903 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2314/4604] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:37.082614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b7e12-2ef5-483f-8999-fb7566348f0f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.096800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3335b001-a42a-4ae8-8c0c-c903be2f7e27 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:37.098685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3335b001-a42a-4ae8-8c0c-c903be2f7e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:37.107631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b7e12-2ef5-483f-8999-fb7566348f0f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.109552 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2291/4605] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:37.116645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335b001-a42a-4ae8-8c0c-c903be2f7e27 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.121524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd28a11-74be-47a8-87f1-a9a38bad0914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.122323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd28a11-74be-47a8-87f1-a9a38bad0914 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.122609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd28a11-74be-47a8-87f1-a9a38bad0914 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.122884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd28a11-74be-47a8-87f1-a9a38bad0914 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.123546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd28a11-74be-47a8-87f1-a9a38bad0914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:37.123847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd28a11-74be-47a8-87f1-a9a38bad0914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:37.125501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd28a11-74be-47a8-87f1-a9a38bad0914 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:37.129163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335b001-a42a-4ae8-8c0c-c903be2f7e27 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.142755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7c946-e3ef-42f4-b4ec-41476fa6a175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.157599 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2315/4606] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:37.158654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd28a11-74be-47a8-87f1-a9a38bad0914 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.162912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7c946-e3ef-42f4-b4ec-41476fa6a175 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.163540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7c946-e3ef-42f4-b4ec-41476fa6a175 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.164027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7c946-e3ef-42f4-b4ec-41476fa6a175 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.164939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7c946-e3ef-42f4-b4ec-41476fa6a175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:37.166309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7c946-e3ef-42f4-b4ec-41476fa6a175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:37.169175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7c946-e3ef-42f4-b4ec-41476fa6a175 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:37.179522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd28a11-74be-47a8-87f1-a9a38bad0914 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.199786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f321a-17fb-414b-bc75-56180cd01d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.201475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f321a-17fb-414b-bc75-56180cd01d39 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.201475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f321a-17fb-414b-bc75-56180cd01d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.201475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f321a-17fb-414b-bc75-56180cd01d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.201817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f321a-17fb-414b-bc75-56180cd01d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:37.203650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f321a-17fb-414b-bc75-56180cd01d39 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:37.212494 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2292/4607] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:37.216807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7c946-e3ef-42f4-b4ec-41476fa6a175 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.228428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7c946-e3ef-42f4-b4ec-41476fa6a175 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.240624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e0812-eba9-40c0-b08a-2018d9001b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.241726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e0812-eba9-40c0-b08a-2018d9001b2d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.242242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e0812-eba9-40c0-b08a-2018d9001b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.242742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e0812-eba9-40c0-b08a-2018d9001b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.243599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e0812-eba9-40c0-b08a-2018d9001b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:37.246261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e0812-eba9-40c0-b08a-2018d9001b2d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:37.264720 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2316/4608] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:37 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:37.265763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f321a-17fb-414b-bc75-56180cd01d39 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.294108 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2293/4609] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:37 2022] POST /identity/v3/projects => generated 361 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:37.298983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e0812-eba9-40c0-b08a-2018d9001b2d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.392286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f321a-17fb-414b-bc75-56180cd01d39 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.463563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e0812-eba9-40c0-b08a-2018d9001b2d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.468741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abe988-2cb0-4ef1-80ab-502022cfbb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.469379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abe988-2cb0-4ef1-80ab-502022cfbb4c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.470206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abe988-2cb0-4ef1-80ab-502022cfbb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.470206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abe988-2cb0-4ef1-80ab-502022cfbb4c admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.470595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abe988-2cb0-4ef1-80ab-502022cfbb4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:37.472565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abe988-2cb0-4ef1-80ab-502022cfbb4c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:37.519466 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2294/4610] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:37 2022] POST /identity/v3/users => generated 281 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:37.520402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abe988-2cb0-4ef1-80ab-502022cfbb4c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.527464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17995a-f456-4eca-867f-6fd9aaf023ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.529279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17995a-f456-4eca-867f-6fd9aaf023ca admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.529612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17995a-f456-4eca-867f-6fd9aaf023ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.529893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17995a-f456-4eca-867f-6fd9aaf023ca admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.531543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17995a-f456-4eca-867f-6fd9aaf023ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:37.536675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17995a-f456-4eca-867f-6fd9aaf023ca admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:37.536880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abe988-2cb0-4ef1-80ab-502022cfbb4c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.544149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ffb72-c5da-41e4-9429-4bca066128f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.544659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ffb72-c5da-41e4-9429-4bca066128f1 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.544949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ffb72-c5da-41e4-9429-4bca066128f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.545297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ffb72-c5da-41e4-9429-4bca066128f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.546128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ffb72-c5da-41e4-9429-4bca066128f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:37.547810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ffb72-c5da-41e4-9429-4bca066128f1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:37.568436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:37.577029 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2295/4611] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:37.578549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ffb72-c5da-41e4-9429-4bca066128f1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.581693 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2317/4612] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:37 2022] POST /identity/v3/users => generated 286 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:37.587871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17995a-f456-4eca-867f-6fd9aaf023ca admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.592560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ffb72-c5da-41e4-9429-4bca066128f1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.598775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748b6dc-c000-4376-a166-1c38205d5b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.599424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b6dc-c000-4376-a166-1c38205d5b32 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.600253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b6dc-c000-4376-a166-1c38205d5b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.600562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b6dc-c000-4376-a166-1c38205d5b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.602025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748b6dc-c000-4376-a166-1c38205d5b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:37.607826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17995a-f456-4eca-867f-6fd9aaf023ca admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.608283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748b6dc-c000-4376-a166-1c38205d5b32 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:37.611854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:37.646369 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2296/4613] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:37.647314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748b6dc-c000-4376-a166-1c38205d5b32 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.647638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0d1e9-94b4-4214-8679-960760faef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.652405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0d1e9-94b4-4214-8679-960760faef6e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.655149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0d1e9-94b4-4214-8679-960760faef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.655670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0d1e9-94b4-4214-8679-960760faef6e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.659092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0d1e9-94b4-4214-8679-960760faef6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:37.665730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748b6dc-c000-4376-a166-1c38205d5b32 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.668385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0d1e9-94b4-4214-8679-960760faef6e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:37.673720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6d5b-39de-4263-8840-774c129f747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.674904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6d5b-39de-4263-8840-774c129f747f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.675393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6d5b-39de-4263-8840-774c129f747f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.676017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6d5b-39de-4263-8840-774c129f747f admin admin] PATH_INFO: `/v3/projects/353cb07f63e7418bb463b1d9d65afad8/users/d53ddb7d790744968cddbc22e8c9eed4/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.705594 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2318/4614] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:37.708360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0d1e9-94b4-4214-8679-960760faef6e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.728421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a6d5b-39de-4263-8840-774c129f747f admin admin] RBAC: Authorizing `identity:create_grant(project_id=353cb07f63e7418bb463b1d9d65afad8, user_id=d53ddb7d790744968cddbc22e8c9eed4, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:37.734906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a6d5b-39de-4263-8840-774c129f747f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:37.735619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0d1e9-94b4-4214-8679-960760faef6e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.754247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894fb79-bc01-4116-9532-88d414c47b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.754888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894fb79-bc01-4116-9532-88d414c47b43 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.755168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894fb79-bc01-4116-9532-88d414c47b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.757679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894fb79-bc01-4116-9532-88d414c47b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.759716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894fb79-bc01-4116-9532-88d414c47b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:37.762693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894fb79-bc01-4116-9532-88d414c47b43 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:37.774482 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2297/4615] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:37 2022] PUT /identity/v3/projects/353cb07f63e7418bb463b1d9d65afad8/users/d53ddb7d790744968cddbc22e8c9eed4/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:37.777701 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2319/4616] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:37.785420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6d5b-39de-4263-8840-774c129f747f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:37.786821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e256c-e2df-45e2-a98c-83aaad5b81ba None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.787191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e256c-e2df-45e2-a98c-83aaad5b81ba None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:37.787374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e256c-e2df-45e2-a98c-83aaad5b81ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:37.859163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c06e256c-e2df-45e2-a98c-83aaad5b81ba None None] MFA Rules not processed for user `d53ddb7d790744968cddbc22e8c9eed4`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:37.861229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c06e256c-e2df-45e2-a98c-83aaad5b81ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:37.980803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6d5b-39de-4263-8840-774c129f747f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:37.998102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b774175-222b-4f08-b089-8a13e2a228da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:37.999276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b774175-222b-4f08-b089-8a13e2a228da admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:37.999586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b774175-222b-4f08-b089-8a13e2a228da admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:38.000132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b774175-222b-4f08-b089-8a13e2a228da admin admin] PATH_INFO: `/v3/projects/000ed910310c43b5a1b576629945cfba/users/f4f7c8f24789434982e5e2a279077449/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:38.048327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b774175-222b-4f08-b089-8a13e2a228da admin admin] RBAC: Authorizing `identity:create_grant(project_id=000ed910310c43b5a1b576629945cfba, user_id=f4f7c8f24789434982e5e2a279077449, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:38.055896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b774175-222b-4f08-b089-8a13e2a228da admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:38.081012 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2298/4617] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:37 2022] PUT /identity/v3/projects/000ed910310c43b5a1b576629945cfba/users/f4f7c8f24789434982e5e2a279077449/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:38.082929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b774175-222b-4f08-b089-8a13e2a228da admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:38.093884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7b774175-222b-4f08-b089-8a13e2a228da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:38.095601 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2320/4618] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:38.103580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1bbd9-d82c-4b86-9fc9-ce39e8015563 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:38.103924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1bbd9-d82c-4b86-9fc9-ce39e8015563 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:38.104191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1bbd9-d82c-4b86-9fc9-ce39e8015563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:38.187525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c4b1bbd9-d82c-4b86-9fc9-ce39e8015563 None None] MFA Rules not processed for user `f4f7c8f24789434982e5e2a279077449`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:38.192591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c4b1bbd9-d82c-4b86-9fc9-ce39e8015563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:38.254078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b774175-222b-4f08-b089-8a13e2a228da admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:38.261624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e703d60-db16-403b-b186-a5d62f3f3f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:38.262601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e703d60-db16-403b-b186-a5d62f3f3f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:38.262818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e703d60-db16-403b-b186-a5d62f3f3f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:38.263193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e703d60-db16-403b-b186-a5d62f3f3f46 admin admin] PATH_INFO: `/v3/users/50bf76900e48462199fb7ea9337703e7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:38.264601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e703d60-db16-403b-b186-a5d62f3f3f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50bf76900e48462199fb7ea9337703e7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:38.266862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e703d60-db16-403b-b186-a5d62f3f3f46 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:38.342648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6e703d60-db16-403b-b186-a5d62f3f3f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50bf76900e48462199fb7ea9337703e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:38.343566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6e703d60-db16-403b-b186-a5d62f3f3f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50bf76900e48462199fb7ea9337703e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:38.354027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:38.374690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6e703d60-db16-403b-b186-a5d62f3f3f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50bf76900e48462199fb7ea9337703e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:38.390573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6e703d60-db16-403b-b186-a5d62f3f3f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50bf76900e48462199fb7ea9337703e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:38.411448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6e703d60-db16-403b-b186-a5d62f3f3f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50bf76900e48462199fb7ea9337703e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:38.412664 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2321/4619] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:38.414103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fc729-8554-44ac-aa57-e5a9f293b81f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:38.414391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fc729-8554-44ac-aa57-e5a9f293b81f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:38.414892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fc729-8554-44ac-aa57-e5a9f293b81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:38.432237 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2299/4620] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:38 2022] DELETE /identity/v3/users/50bf76900e48462199fb7ea9337703e7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:38.434012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f2e5-1088-4b2f-ac0c-6e95b91538d5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:38.435085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f2e5-1088-4b2f-ac0c-6e95b91538d5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:38.435951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f2e5-1088-4b2f-ac0c-6e95b91538d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:38.459666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9b1fc729-8554-44ac-aa57-e5a9f293b81f None None] MFA Rules not processed for user `d53ddb7d790744968cddbc22e8c9eed4`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:38.461223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9b1fc729-8554-44ac-aa57-e5a9f293b81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:38.474401 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2322/4621] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:38 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:38.478802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fc729-8554-44ac-aa57-e5a9f293b81f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:38.482057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9b1fc729-8554-44ac-aa57-e5a9f293b81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:38.509512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cf29f2e5-1088-4b2f-ac0c-6e95b91538d5 None None] MFA Rules not processed for user `3dd53cf1dd3343d989e650620d853c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:38.510178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cf29f2e5-1088-4b2f-ac0c-6e95b91538d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:38.568140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:38.631778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fc729-8554-44ac-aa57-e5a9f293b81f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:38.647773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0e3aa-70bb-4f1f-b921-73df28f3e7e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:38.648442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0e3aa-70bb-4f1f-b921-73df28f3e7e2 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:38.648754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0e3aa-70bb-4f1f-b921-73df28f3e7e2 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:38.649911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0e3aa-70bb-4f1f-b921-73df28f3e7e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:38.651635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e5e0e3aa-70bb-4f1f-b921-73df28f3e7e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:38.744797 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2300/4622] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:38.758049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f062c7-df3f-4401-aa2d-1fd95558c58d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:38.759199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f062c7-df3f-4401-aa2d-1fd95558c58d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:38.760099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f062c7-df3f-4401-aa2d-1fd95558c58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:38.789528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-35f062c7-df3f-4401-aa2d-1fd95558c58d None None] MFA Rules not processed for user `d53ddb7d790744968cddbc22e8c9eed4`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:38.791636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-35f062c7-df3f-4401-aa2d-1fd95558c58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:38.798562 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2301/4623] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:38 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:38.800706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f062c7-df3f-4401-aa2d-1fd95558c58d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:38.802514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-35f062c7-df3f-4401-aa2d-1fd95558c58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:38.887653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0e3aa-70bb-4f1f-b921-73df28f3e7e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:38.893850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0e3aa-70bb-4f1f-b921-73df28f3e7e2 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:38.927235 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2323/4624] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:38.937924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164327be-cea7-4cb8-aea5-cb77cbfb1653 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:38.938400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164327be-cea7-4cb8-aea5-cb77cbfb1653 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:38.938861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164327be-cea7-4cb8-aea5-cb77cbfb1653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:38.962345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f062c7-df3f-4401-aa2d-1fd95558c58d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:38.969217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:38.970231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:38.970661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:38.971111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] PATH_INFO: `/v3/projects/18c9aff606024239a686521ac9ba0ccd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:38.973242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c9aff606024239a686521ac9ba0ccd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:38.975942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:39.003665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-164327be-cea7-4cb8-aea5-cb77cbfb1653 None None] MFA Rules not processed for user `3dd53cf1dd3343d989e650620d853c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:39.005099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-164327be-cea7-4cb8-aea5-cb77cbfb1653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:39.023623 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2324/4625] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:39.035573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164327be-cea7-4cb8-aea5-cb77cbfb1653 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:39.044681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-164327be-cea7-4cb8-aea5-cb77cbfb1653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:39.077503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c9aff606024239a686521ac9ba0ccd', 'request_id': 'req-feecf417-9d49-414e-81d2-d5cd99501924'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:39.092293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c9aff606024239a686521ac9ba0ccd', 'request_id': 'req-feecf417-9d49-414e-81d2-d5cd99501924'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:39.094192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:39.135196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c9aff606024239a686521ac9ba0ccd', 'request_id': 'req-feecf417-9d49-414e-81d2-d5cd99501924'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:39.158749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] The token cache is being invalidate because project 18c9aff606024239a686521ac9ba0ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:39.159436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:39.160392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:39.175664 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2302/4626] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:38 2022] DELETE /identity/v3/projects/18c9aff606024239a686521ac9ba0ccd => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:39.180522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:39.191753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:39.223761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164327be-cea7-4cb8-aea5-cb77cbfb1653 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:39.368611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da41f9c-ea2a-4805-87fd-1443f025481e tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd53ddb7d790744968cddbc22e8c9eed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '353cb07f63e7418bb463b1d9d65afad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:39.371227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da41f9c-ea2a-4805-87fd-1443f025481e tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] REQUEST_METHOD: `HEAD` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:39.371520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da41f9c-ea2a-4805-87fd-1443f025481e tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:39.371821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da41f9c-ea2a-4805-87fd-1443f025481e tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:39.379018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecf417-9d49-414e-81d2-d5cd99501924 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:39.379403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3da41f9c-ea2a-4805-87fd-1443f025481e tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:39.392725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb95116-e52f-4614-8b66-d7caf26a62bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:39.396363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb95116-e52f-4614-8b66-d7caf26a62bb service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:39.397196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb95116-e52f-4614-8b66-d7caf26a62bb service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:39.397737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb95116-e52f-4614-8b66-d7caf26a62bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:39.401931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dbb95116-e52f-4614-8b66-d7caf26a62bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:39.403209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da41f9c-ea2a-4805-87fd-1443f025481e tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: Authorizing `identity:check_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:39.407728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da41f9c-ea2a-4805-87fd-1443f025481e tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:39.427647 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2325/4627] 10.222.0.16 () {56 vars in 1264 bytes} [Mon Aug 29 15:46:39 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Aug 29 15:46:39.428823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8425c-ae8f-44da-be39-1f6876a5a4dc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:39.429152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8425c-ae8f-44da-be39-1f6876a5a4dc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:39.429449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8425c-ae8f-44da-be39-1f6876a5a4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:39.478791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8ed8425c-ae8f-44da-be39-1f6876a5a4dc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:39.482929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8ed8425c-ae8f-44da-be39-1f6876a5a4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:39.523734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb95116-e52f-4614-8b66-d7caf26a62bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:39.526184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb95116-e52f-4614-8b66-d7caf26a62bb service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:39.545586 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2303/4628] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:39.547123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb95116-e52f-4614-8b66-d7caf26a62bb service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:39.549314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dbb95116-e52f-4614-8b66-d7caf26a62bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:39.570164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb95116-e52f-4614-8b66-d7caf26a62bb service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:39.576154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc929e-7794-46b6-947e-102847501410 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd53ddb7d790744968cddbc22e8c9eed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '353cb07f63e7418bb463b1d9d65afad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:39.576490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc929e-7794-46b6-947e-102847501410 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:39.576873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc929e-7794-46b6-947e-102847501410 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:39.577466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc929e-7794-46b6-947e-102847501410 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:39.586014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc929e-7794-46b6-947e-102847501410 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:39.588527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc929e-7794-46b6-947e-102847501410 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:39.602874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:39.622344 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2304/4629] 10.222.0.16 () {56 vars in 1263 bytes} [Mon Aug 29 15:46:39 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:39.625933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc929e-7794-46b6-947e-102847501410 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:39.641014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc929e-7794-46b6-947e-102847501410 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:39.647858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecfb2c-f597-46e3-9955-5a65cae3cac1 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd53ddb7d790744968cddbc22e8c9eed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '353cb07f63e7418bb463b1d9d65afad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:39.649650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecfb2c-f597-46e3-9955-5a65cae3cac1 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:39.650164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecfb2c-f597-46e3-9955-5a65cae3cac1 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:39.665329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecfb2c-f597-46e3-9955-5a65cae3cac1 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:39.688522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecfb2c-f597-46e3-9955-5a65cae3cac1 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:39.691980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecfb2c-f597-46e3-9955-5a65cae3cac1 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:39.733831 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2305/4630] 10.222.0.16 () {56 vars in 1266 bytes} [Mon Aug 29 15:46:39 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:39.736479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecfb2c-f597-46e3-9955-5a65cae3cac1 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:39.750120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecfb2c-f597-46e3-9955-5a65cae3cac1 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:39.766853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58da426-6083-4580-bcc6-26059c266586 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd53ddb7d790744968cddbc22e8c9eed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '353cb07f63e7418bb463b1d9d65afad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:39.768283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58da426-6083-4580-bcc6-26059c266586 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:39.769286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58da426-6083-4580-bcc6-26059c266586 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:39.769796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58da426-6083-4580-bcc6-26059c266586 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:39.773687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b58da426-6083-4580-bcc6-26059c266586 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:39.789042 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2326/4631] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:39.793540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb07a7-817a-4565-b1d7-cfb5b246c6e6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:39.793833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb07a7-817a-4565-b1d7-cfb5b246c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:39.794145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb07a7-817a-4565-b1d7-cfb5b246c6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-b58da426-6083-4580-bcc6-26059c266586 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Aug 29 15:46:39.812662 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 29 15:46:39.813818 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 29 15:46:39.814862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:39.814862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:39.814862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 29 15:46:39.814862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 29 15:46:39.814862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 29 15:46:39.814862 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:46:39.829082 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2306/4632] 10.222.0.16 () {56 vars in 1264 bytes} [Mon Aug 29 15:46:39 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Aug 29 15:46:39.833862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dd66a-569e-421b-a60c-c7496f7f667d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:39.834414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dd66a-569e-421b-a60c-c7496f7f667d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:39.834997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dd66a-569e-421b-a60c-c7496f7f667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:39.843303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ddcb07a7-817a-4565-b1d7-cfb5b246c6e6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:39.844692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ddcb07a7-817a-4565-b1d7-cfb5b246c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:39.862613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b00dd66a-569e-421b-a60c-c7496f7f667d None None] MFA Rules not processed for user `d53ddb7d790744968cddbc22e8c9eed4`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:39.865109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b00dd66a-569e-421b-a60c-c7496f7f667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:39.874596 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2307/4633] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:39 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:39.876335 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2327/4634] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:39.878278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dd66a-569e-421b-a60c-c7496f7f667d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:39.881903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb07a7-817a-4565-b1d7-cfb5b246c6e6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:39.907070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb07a7-817a-4565-b1d7-cfb5b246c6e6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:39.912443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dd66a-569e-421b-a60c-c7496f7f667d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:39.921832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4da206-958d-4f40-b44d-9d1a73b85e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:39.922756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da206-958d-4f40-b44d-9d1a73b85e22 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:39.924069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da206-958d-4f40-b44d-9d1a73b85e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:39.924353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da206-958d-4f40-b44d-9d1a73b85e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:39.925787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ba923-1566-4e19-ab27-a30f2bfc4043 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd53ddb7d790744968cddbc22e8c9eed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '353cb07f63e7418bb463b1d9d65afad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:39.926334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4da206-958d-4f40-b44d-9d1a73b85e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:39.927156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4da206-958d-4f40-b44d-9d1a73b85e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:39.928177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ba923-1566-4e19-ab27-a30f2bfc4043 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:39.928463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ba923-1566-4e19-ab27-a30f2bfc4043 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:39.928784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ba923-1566-4e19-ab27-a30f2bfc4043 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:39.931542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4da206-958d-4f40-b44d-9d1a73b85e22 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:39.950259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ba923-1566-4e19-ab27-a30f2bfc4043 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:39.952353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ba923-1566-4e19-ab27-a30f2bfc4043 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:39.964797 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2328/4635] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:39.967963 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2308/4636] 10.222.0.16 () {56 vars in 1263 bytes} [Mon Aug 29 15:46:39 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:39.969345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4da206-958d-4f40-b44d-9d1a73b85e22 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:39.973080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ba923-1566-4e19-ab27-a30f2bfc4043 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:39.990187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4da206-958d-4f40-b44d-9d1a73b85e22 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:39.995160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ba923-1566-4e19-ab27-a30f2bfc4043 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:40.002333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7013f25-5186-4f91-bc4c-b967193c281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:40.003766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7013f25-5186-4f91-bc4c-b967193c281f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:40.004948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef8d89-1264-4d7e-8fad-84d762262d17 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd53ddb7d790744968cddbc22e8c9eed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '353cb07f63e7418bb463b1d9d65afad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:40.005516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7013f25-5186-4f91-bc4c-b967193c281f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:40.005804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7013f25-5186-4f91-bc4c-b967193c281f admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:40.006456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7013f25-5186-4f91-bc4c-b967193c281f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:40.006677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef8d89-1264-4d7e-8fad-84d762262d17 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:40.008868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef8d89-1264-4d7e-8fad-84d762262d17 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:40.009302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef8d89-1264-4d7e-8fad-84d762262d17 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:40.015280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7013f25-5186-4f91-bc4c-b967193c281f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:40.029246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef8d89-1264-4d7e-8fad-84d762262d17 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:40.035626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef8d89-1264-4d7e-8fad-84d762262d17 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:40.084589 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2309/4637] 10.222.0.16 () {56 vars in 1266 bytes} [Mon Aug 29 15:46:39 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:40.086854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef8d89-1264-4d7e-8fad-84d762262d17 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:40.097683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:40.106494 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2329/4638] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:39 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:40.108993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef8d89-1264-4d7e-8fad-84d762262d17 tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:40.110164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7013f25-5186-4f91-bc4c-b967193c281f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:40.227268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7013f25-5186-4f91-bc4c-b967193c281f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:40.234405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8afa9-9c97-4a57-b31d-c51aa2b1a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:40.235103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8afa9-9c97-4a57-b31d-c51aa2b1a527 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:40.235438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8afa9-9c97-4a57-b31d-c51aa2b1a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:40.235742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8afa9-9c97-4a57-b31d-c51aa2b1a527 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:40.236449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8afa9-9c97-4a57-b31d-c51aa2b1a527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:40.238767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8afa9-9c97-4a57-b31d-c51aa2b1a527 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:40.287644 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2330/4639] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:40 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:40.293803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8afa9-9c97-4a57-b31d-c51aa2b1a527 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:40.314909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8afa9-9c97-4a57-b31d-c51aa2b1a527 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:40.318458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfebce7-d630-442b-a870-726b3e9a0c2c tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd53ddb7d790744968cddbc22e8c9eed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '353cb07f63e7418bb463b1d9d65afad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:40.321955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c46e02-6d97-4bc5-9a25-a41bd6ba1f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:40.322135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfebce7-d630-442b-a870-726b3e9a0c2c tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:40.322401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfebce7-d630-442b-a870-726b3e9a0c2c tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:40.322690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfebce7-d630-442b-a870-726b3e9a0c2c tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:40.322900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46e02-6d97-4bc5-9a25-a41bd6ba1f37 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:40.323448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46e02-6d97-4bc5-9a25-a41bd6ba1f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:40.323796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46e02-6d97-4bc5-9a25-a41bd6ba1f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:40.324491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c46e02-6d97-4bc5-9a25-a41bd6ba1f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:40.328660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c46e02-6d97-4bc5-9a25-a41bd6ba1f37 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:40.330854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2bfebce7-d630-442b-a870-726b3e9a0c2c tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:40.355245 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2331/4640] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:40.361239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c46e02-6d97-4bc5-9a25-a41bd6ba1f37 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-2bfebce7-d630-442b-a870-726b3e9a0c2c tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 29 15:46:40.373344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 29 15:46:40.374437 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 29 15:46:40.375398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:46:40.375398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:46:40.375398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 29 15:46:40.375398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 29 15:46:40.375398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 29 15:46:40.375398 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:46:40.383519 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2310/4641] 10.222.0.16 () {56 vars in 1263 bytes} [Mon Aug 29 15:46:40 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:46:40.386414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c46e02-6d97-4bc5-9a25-a41bd6ba1f37 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:40.391979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfebce7-d630-442b-a870-726b3e9a0c2c tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:40.393632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2bfebce7-d630-442b-a870-726b3e9a0c2c tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:40.394942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49532f-f265-49c0-bc40-f668a9d215d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:40.395573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49532f-f265-49c0-bc40-f668a9d215d6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:40.395855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49532f-f265-49c0-bc40-f668a9d215d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:40.398855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49532f-f265-49c0-bc40-f668a9d215d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:40.399597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49532f-f265-49c0-bc40-f668a9d215d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:40.404446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49532f-f265-49c0-bc40-f668a9d215d6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:40.425824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfebce7-d630-442b-a870-726b3e9a0c2c tempest-TokensV3Test-1259689030 tempest-TokensV3Test-1259689030-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:40.443135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd45401-d58a-4240-ba0e-1b96b4a88458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:40.443814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd45401-d58a-4240-ba0e-1b96b4a88458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:40.444089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd45401-d58a-4240-ba0e-1b96b4a88458 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:40.444363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd45401-d58a-4240-ba0e-1b96b4a88458 admin admin] PATH_INFO: `/v3/users/d53ddb7d790744968cddbc22e8c9eed4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:40.446020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd45401-d58a-4240-ba0e-1b96b4a88458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53ddb7d790744968cddbc22e8c9eed4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:40.447959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd45401-d58a-4240-ba0e-1b96b4a88458 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:40.466432 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2332/4642] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:40.473197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49532f-f265-49c0-bc40-f668a9d215d6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:40.524866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49532f-f265-49c0-bc40-f668a9d215d6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:40.550897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f933d31-cbc1-4f5f-b73a-d3eff09e105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:40.554959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f933d31-cbc1-4f5f-b73a-d3eff09e105b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:40.555224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f933d31-cbc1-4f5f-b73a-d3eff09e105b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:40.555612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f933d31-cbc1-4f5f-b73a-d3eff09e105b admin admin] PATH_INFO: `/v3/projects/da6f1599da704dbc9ec86f3638638bba/users/dc8f7bc05b984ea0a3d96aea8a65d139/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:40.571388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bcd45401-d58a-4240-ba0e-1b96b4a88458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53ddb7d790744968cddbc22e8c9eed4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:40.572567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bcd45401-d58a-4240-ba0e-1b96b4a88458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53ddb7d790744968cddbc22e8c9eed4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:40.607679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bcd45401-d58a-4240-ba0e-1b96b4a88458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53ddb7d790744968cddbc22e8c9eed4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:40.626971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bcd45401-d58a-4240-ba0e-1b96b4a88458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53ddb7d790744968cddbc22e8c9eed4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:40.627434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f933d31-cbc1-4f5f-b73a-d3eff09e105b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6f1599da704dbc9ec86f3638638bba, user_id=dc8f7bc05b984ea0a3d96aea8a65d139, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:40.639843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bcd45401-d58a-4240-ba0e-1b96b4a88458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53ddb7d790744968cddbc22e8c9eed4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:40.641721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f933d31-cbc1-4f5f-b73a-d3eff09e105b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:40.655366 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2311/4643] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:40 2022] DELETE /identity/v3/users/d53ddb7d790744968cddbc22e8c9eed4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:40.657124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069a75d-3d79-4f15-8511-f457bf1be545 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:40.657498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069a75d-3d79-4f15-8511-f457bf1be545 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:40.657786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069a75d-3d79-4f15-8511-f457bf1be545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:40.690795 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2333/4644] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:40 2022] PUT /identity/v3/projects/da6f1599da704dbc9ec86f3638638bba/users/dc8f7bc05b984ea0a3d96aea8a65d139/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:40.695211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1069a75d-3d79-4f15-8511-f457bf1be545 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:40.698570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab50a75-d4d6-4fab-b84d-9044aec851bb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:40.698570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab50a75-d4d6-4fab-b84d-9044aec851bb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:40.698822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab50a75-d4d6-4fab-b84d-9044aec851bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:40.705118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1069a75d-3d79-4f15-8511-f457bf1be545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:40.745478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6ab50a75-d4d6-4fab-b84d-9044aec851bb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:40.746752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6ab50a75-d4d6-4fab-b84d-9044aec851bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:40.860784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:40.886807 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2312/4645] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:46:40.894413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069a75d-3d79-4f15-8511-f457bf1be545 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:40.896022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1069a75d-3d79-4f15-8511-f457bf1be545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:40.943158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:40.983886 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2334/4646] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:46:40.994791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab50a75-d4d6-4fab-b84d-9044aec851bb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:40.996606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6ab50a75-d4d6-4fab-b84d-9044aec851bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:41.024554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069a75d-3d79-4f15-8511-f457bf1be545 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:41.049544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c82a5-e11d-4965-b627-2c27d320bf6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:41.050578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c82a5-e11d-4965-b627-2c27d320bf6f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:41.050896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c82a5-e11d-4965-b627-2c27d320bf6f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:41.051177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c82a5-e11d-4965-b627-2c27d320bf6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:41.086373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c82a5-e11d-4965-b627-2c27d320bf6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:41.088444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c82a5-e11d-4965-b627-2c27d320bf6f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:41.101271 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2313/4647] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:41.196231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab50a75-d4d6-4fab-b84d-9044aec851bb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:41.207225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735290c-80e7-4e7f-88ca-afbcd0818cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:41.208591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735290c-80e7-4e7f-88ca-afbcd0818cfc service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:41.209483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735290c-80e7-4e7f-88ca-afbcd0818cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:41.210592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735290c-80e7-4e7f-88ca-afbcd0818cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:41.241333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735290c-80e7-4e7f-88ca-afbcd0818cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:41.245688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735290c-80e7-4e7f-88ca-afbcd0818cfc service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:41.278986 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2335/4648] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:42.515856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c82a5-e11d-4965-b627-2c27d320bf6f service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:42.521006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5e3c82a5-e11d-4965-b627-2c27d320bf6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:42.555336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c82a5-e11d-4965-b627-2c27d320bf6f service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:42.584139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:42.584789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:42.585073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:42.585379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] PATH_INFO: `/v3/projects/353cb07f63e7418bb463b1d9d65afad8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:42.589887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=353cb07f63e7418bb463b1d9d65afad8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:42.592902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:42.863156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353cb07f63e7418bb463b1d9d65afad8', 'request_id': 'req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:42.866094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735290c-80e7-4e7f-88ca-afbcd0818cfc service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:42.869070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4735290c-80e7-4e7f-88ca-afbcd0818cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:42.872228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353cb07f63e7418bb463b1d9d65afad8', 'request_id': 'req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:42.945338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353cb07f63e7418bb463b1d9d65afad8', 'request_id': 'req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:43.054601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735290c-80e7-4e7f-88ca-afbcd0818cfc service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:43.128286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] The token cache is being invalidate because project 353cb07f63e7418bb463b1d9d65afad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:43.130489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:43.138088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bbf0cf82-4537-4b9e-9a0d-1ce4546a8ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:43.147827 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2314/4649] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:42 2022] DELETE /identity/v3/projects/353cb07f63e7418bb463b1d9d65afad8 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:43.150402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45145-10b7-4d4c-b5cc-c06eb6d51eaf None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:43.151109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45145-10b7-4d4c-b5cc-c06eb6d51eaf None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:43.151490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45145-10b7-4d4c-b5cc-c06eb6d51eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:43.265095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-40d45145-10b7-4d4c-b5cc-c06eb6d51eaf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:43.273294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-40d45145-10b7-4d4c-b5cc-c06eb6d51eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:43.419127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6355564-4f4e-4854-95c3-2013c0881a12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:43.420867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6355564-4f4e-4854-95c3-2013c0881a12 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:43.421636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6355564-4f4e-4854-95c3-2013c0881a12 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:43.422426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6355564-4f4e-4854-95c3-2013c0881a12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:43.426550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e6355564-4f4e-4854-95c3-2013c0881a12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:43.450828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6355564-4f4e-4854-95c3-2013c0881a12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:43.453993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6355564-4f4e-4854-95c3-2013c0881a12 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:43.497428 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2336/4650] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:43.530366 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2315/4651] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:43.540189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dba98-17f4-4cdb-84e9-8099a99a86a7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:43.545336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dba98-17f4-4cdb-84e9-8099a99a86a7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:43.546534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dba98-17f4-4cdb-84e9-8099a99a86a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:43.611140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:43.647421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-669dba98-17f4-4cdb-84e9-8099a99a86a7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:43.652043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-669dba98-17f4-4cdb-84e9-8099a99a86a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:43.700236 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2337/4652] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:43.701703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d45145-10b7-4d4c-b5cc-c06eb6d51eaf None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:43.733104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d45145-10b7-4d4c-b5cc-c06eb6d51eaf None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:43.758813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad621b61-7bfe-4374-bcbf-ef339e59266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:43.760976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad621b61-7bfe-4374-bcbf-ef339e59266d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:43.761419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad621b61-7bfe-4374-bcbf-ef339e59266d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:43.763113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad621b61-7bfe-4374-bcbf-ef339e59266d admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:43.764188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad621b61-7bfe-4374-bcbf-ef339e59266d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:43.764674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad621b61-7bfe-4374-bcbf-ef339e59266d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:43.767536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad621b61-7bfe-4374-bcbf-ef339e59266d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:43.824713 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2316/4653] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:43.828242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dba98-17f4-4cdb-84e9-8099a99a86a7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:43.842678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dba98-17f4-4cdb-84e9-8099a99a86a7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:43.856459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66baa-0a91-445a-9c78-0cf3204985f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:43.857125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66baa-0a91-445a-9c78-0cf3204985f0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:43.857495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66baa-0a91-445a-9c78-0cf3204985f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:43.857774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66baa-0a91-445a-9c78-0cf3204985f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:43.858368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a66baa-0a91-445a-9c78-0cf3204985f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:43.864659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a66baa-0a91-445a-9c78-0cf3204985f0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:43.935148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad621b61-7bfe-4374-bcbf-ef339e59266d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:43.950528 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2338/4654] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:43 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:43.952191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad621b61-7bfe-4374-bcbf-ef339e59266d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:44.049270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:44.155296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8bfb9-5266-431b-a10f-1c75fd4ba23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:44.155981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8bfb9-5266-431b-a10f-1c75fd4ba23d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:44.156340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8bfb9-5266-431b-a10f-1c75fd4ba23d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:44.160668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8bfb9-5266-431b-a10f-1c75fd4ba23d admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:44.164906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8bfb9-5266-431b-a10f-1c75fd4ba23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:44.174868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8bfb9-5266-431b-a10f-1c75fd4ba23d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:44.254676 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2317/4655] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:43 2022] POST /identity/v3/users => generated 297 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:44.258730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66baa-0a91-445a-9c78-0cf3204985f0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:44.279094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66baa-0a91-445a-9c78-0cf3204985f0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:44.292645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2173ea-0046-4629-8140-f4bf40ed4051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:44.293317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2173ea-0046-4629-8140-f4bf40ed4051 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:44.295232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2173ea-0046-4629-8140-f4bf40ed4051 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:44.295672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2173ea-0046-4629-8140-f4bf40ed4051 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:44.296537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2173ea-0046-4629-8140-f4bf40ed4051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:44.305837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2173ea-0046-4629-8140-f4bf40ed4051 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:44.342118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8bfb9-5266-431b-a10f-1c75fd4ba23d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:44.356264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8bfb9-5266-431b-a10f-1c75fd4ba23d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:44.357008 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2339/4656] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:44.375891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e854da-967e-4489-8abd-dbed823b61ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:44.377846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e854da-967e-4489-8abd-dbed823b61ca admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:44.378141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e854da-967e-4489-8abd-dbed823b61ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:44.378426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e854da-967e-4489-8abd-dbed823b61ca admin admin] PATH_INFO: `/v3/projects/1f1597a7f1844360aa09bd5bff920769/users/e8a3b106f8cf425fa71e35d4d9638a81/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:44.431304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e854da-967e-4489-8abd-dbed823b61ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1597a7f1844360aa09bd5bff920769, user_id=e8a3b106f8cf425fa71e35d4d9638a81, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:44.437422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e854da-967e-4489-8abd-dbed823b61ca admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:44.462972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2173ea-0046-4629-8140-f4bf40ed4051 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:44.474677 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2318/4657] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:44 2022] PUT /identity/v3/projects/1f1597a7f1844360aa09bd5bff920769/users/e8a3b106f8cf425fa71e35d4d9638a81/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:44.477763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2173ea-0046-4629-8140-f4bf40ed4051 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:44.624768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c39287-5408-4e5d-9553-33d0f945b23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:44.625993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c39287-5408-4e5d-9553-33d0f945b23a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:44.626698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c39287-5408-4e5d-9553-33d0f945b23a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:44.627325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c39287-5408-4e5d-9553-33d0f945b23a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:44.628314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c39287-5408-4e5d-9553-33d0f945b23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:44.630419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c39287-5408-4e5d-9553-33d0f945b23a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:44.649343 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2340/4658] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:44.651346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e854da-967e-4489-8abd-dbed823b61ca admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:44.665477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e854da-967e-4489-8abd-dbed823b61ca admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:44.672235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a7451-a37b-43fe-82c3-2bc6bdfb89f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:44.673344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7451-a37b-43fe-82c3-2bc6bdfb89f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:44.673917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7451-a37b-43fe-82c3-2bc6bdfb89f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:44.674430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7451-a37b-43fe-82c3-2bc6bdfb89f9 admin admin] PATH_INFO: `/v3/projects/1f1597a7f1844360aa09bd5bff920769/users/e8a3b106f8cf425fa71e35d4d9638a81/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:44.677615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a7451-a37b-43fe-82c3-2bc6bdfb89f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1597a7f1844360aa09bd5bff920769, user_id=e8a3b106f8cf425fa71e35d4d9638a81, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:44.680953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a7451-a37b-43fe-82c3-2bc6bdfb89f9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:44.723053 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2319/4659] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:44 2022] PUT /identity/v3/projects/1f1597a7f1844360aa09bd5bff920769/users/e8a3b106f8cf425fa71e35d4d9638a81/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:44.728199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd3f8b-205b-418a-83c9-077d366cfdc8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:44.728549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd3f8b-205b-418a-83c9-077d366cfdc8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:44.728783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd3f8b-205b-418a-83c9-077d366cfdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:44.814701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-82fd3f8b-205b-418a-83c9-077d366cfdc8 None None] MFA Rules not processed for user `e8a3b106f8cf425fa71e35d4d9638a81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:44.817740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-82fd3f8b-205b-418a-83c9-077d366cfdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:45.072019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a7451-a37b-43fe-82c3-2bc6bdfb89f9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:45.072730 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2341/4660] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:45.436364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a7451-a37b-43fe-82c3-2bc6bdfb89f9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:45.455804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ef40-05ad-4a00-9b2f-d4b33b53442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:45.456462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ef40-05ad-4a00-9b2f-d4b33b53442c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:45.456738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ef40-05ad-4a00-9b2f-d4b33b53442c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:45.457015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ef40-05ad-4a00-9b2f-d4b33b53442c admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:45.457704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7ef40-05ad-4a00-9b2f-d4b33b53442c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:45.466571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7ef40-05ad-4a00-9b2f-d4b33b53442c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:45.566271 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2320/4661] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:45 2022] POST /identity/v3/projects => generated 379 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:45.571080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd3f8b-205b-418a-83c9-077d366cfdc8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:45.611639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd3f8b-205b-418a-83c9-077d366cfdc8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:45.790408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:45.823690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fd43e-38b4-4f23-8541-f016e78ac6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:45.824748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd43e-38b4-4f23-8541-f016e78ac6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:45.825132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd43e-38b4-4f23-8541-f016e78ac6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:45.825536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd43e-38b4-4f23-8541-f016e78ac6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:45.826361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fd43e-38b4-4f23-8541-f016e78ac6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:45.828929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fd43e-38b4-4f23-8541-f016e78ac6d0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:45.887133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ef40-05ad-4a00-9b2f-d4b33b53442c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:45.887672 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2342/4662] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:45 2022] POST /identity/v3/users => generated 290 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:45.935248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ef40-05ad-4a00-9b2f-d4b33b53442c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:45.997490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe5bf1-b3bb-4780-a51c-51ce9a9d3eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:46.001840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe5bf1-b3bb-4780-a51c-51ce9a9d3eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:46.003009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe5bf1-b3bb-4780-a51c-51ce9a9d3eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:46.005534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe5bf1-b3bb-4780-a51c-51ce9a9d3eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:46.006935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe5bf1-b3bb-4780-a51c-51ce9a9d3eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:46.016435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe5bf1-b3bb-4780-a51c-51ce9a9d3eb7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:46.086187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fd43e-38b4-4f23-8541-f016e78ac6d0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:46.088323 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2321/4663] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:46.107965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fd43e-38b4-4f23-8541-f016e78ac6d0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:46.128260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6b205-2d90-4438-8435-7af2d01b0d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:46.128953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6b205-2d90-4438-8435-7af2d01b0d2c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:46.131369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6b205-2d90-4438-8435-7af2d01b0d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:46.131681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6b205-2d90-4438-8435-7af2d01b0d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:46.133278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6b205-2d90-4438-8435-7af2d01b0d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:46.138752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6b205-2d90-4438-8435-7af2d01b0d2c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:46.169323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe5bf1-b3bb-4780-a51c-51ce9a9d3eb7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:46.172650 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2343/4664] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:46.187201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe5bf1-b3bb-4780-a51c-51ce9a9d3eb7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:46.222330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24148b-a6be-4225-86b0-2d25d20cc180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:46.223661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24148b-a6be-4225-86b0-2d25d20cc180 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:46.224150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24148b-a6be-4225-86b0-2d25d20cc180 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:46.224700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24148b-a6be-4225-86b0-2d25d20cc180 admin admin] PATH_INFO: `/v3/projects/2ec344ea46b8418dacdfdef7d24c7f8c/users/a81593b3f57349d5b6a6012bc3ff8dba/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:46.286785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24148b-a6be-4225-86b0-2d25d20cc180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec344ea46b8418dacdfdef7d24c7f8c, user_id=a81593b3f57349d5b6a6012bc3ff8dba, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:46.289609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24148b-a6be-4225-86b0-2d25d20cc180 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:46.322148 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2322/4665] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:46 2022] PUT /identity/v3/projects/2ec344ea46b8418dacdfdef7d24c7f8c/users/a81593b3f57349d5b6a6012bc3ff8dba/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:46.339987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e8763-a351-49d6-bc05-e5c6f014b63f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:46.340114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e8763-a351-49d6-bc05-e5c6f014b63f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:46.341527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e8763-a351-49d6-bc05-e5c6f014b63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:46.390438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fc8e8763-a351-49d6-bc05-e5c6f014b63f None None] MFA Rules not processed for user `a81593b3f57349d5b6a6012bc3ff8dba`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:46.392742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc8e8763-a351-49d6-bc05-e5c6f014b63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:46.587035 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2344/4666] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:46.630008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24148b-a6be-4225-86b0-2d25d20cc180 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:46.646267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bd24148b-a6be-4225-86b0-2d25d20cc180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:46.719651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:46.861617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24148b-a6be-4225-86b0-2d25d20cc180 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:46.874273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75187890-b428-4dba-80d1-feb9a9b376aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:46.874948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187890-b428-4dba-80d1-feb9a9b376aa service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:46.875660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187890-b428-4dba-80d1-feb9a9b376aa service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:46.876434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187890-b428-4dba-80d1-feb9a9b376aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:47.083541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75187890-b428-4dba-80d1-feb9a9b376aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:47.085732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75187890-b428-4dba-80d1-feb9a9b376aa service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:47.110723 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2323/4667] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:48.581792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e8763-a351-49d6-bc05-e5c6f014b63f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:48.740655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e8763-a351-49d6-bc05-e5c6f014b63f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:48.759397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:48.760103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:48.760479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:48.760836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] PATH_INFO: `/v3/users/e8a3b106f8cf425fa71e35d4d9638a81` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:48.762317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a3b106f8cf425fa71e35d4d9638a81)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:48.765089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:48.891059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a3b106f8cf425fa71e35d4d9638a81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:48.892791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a3b106f8cf425fa71e35d4d9638a81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:48.939880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:48.973493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a3b106f8cf425fa71e35d4d9638a81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:48.976405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a3b106f8cf425fa71e35d4d9638a81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.012141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a3b106f8cf425fa71e35d4d9638a81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.044360 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2345/4668] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:48 2022] DELETE /identity/v3/users/e8a3b106f8cf425fa71e35d4d9638a81 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:49.045677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea25f2-ebee-4e72-af1f-7900a0e8e1e8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:49.046245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea25f2-ebee-4e72-af1f-7900a0e8e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:49.046245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea25f2-ebee-4e72-af1f-7900a0e8e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:49.092324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-37ea25f2-ebee-4e72-af1f-7900a0e8e1e8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:49.093812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-37ea25f2-ebee-4e72-af1f-7900a0e8e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:49.274678 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2324/4669] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:46:49.303022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:49.303022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:49.303631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea25f2-ebee-4e72-af1f-7900a0e8e1e8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:49.305320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-37ea25f2-ebee-4e72-af1f-7900a0e8e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:49.326466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d27607-9207-4274-bc88-b9e40998751a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:49.337487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:49.338149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:49.338426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:49.338708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] PATH_INFO: `/v3/users/f4f7c8f24789434982e5e2a279077449` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:49.344621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f7c8f24789434982e5e2a279077449)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:49.346198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:49.430594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea25f2-ebee-4e72-af1f-7900a0e8e1e8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:49.440998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f7c8f24789434982e5e2a279077449'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.442064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f7c8f24789434982e5e2a279077449'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.451235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311f6f-e39b-466a-909d-dcefffa3a27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:49.455118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311f6f-e39b-466a-909d-dcefffa3a27a service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:49.457075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311f6f-e39b-466a-909d-dcefffa3a27a service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:49.457605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311f6f-e39b-466a-909d-dcefffa3a27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:49.465968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-df311f6f-e39b-466a-909d-dcefffa3a27a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:49.479992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f7c8f24789434982e5e2a279077449'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.481071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f7c8f24789434982e5e2a279077449'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.508078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df311f6f-e39b-466a-909d-dcefffa3a27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:49.510910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df311f6f-e39b-466a-909d-dcefffa3a27a service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:49.511534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f7c8f24789434982e5e2a279077449'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:49.540256 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2325/4670] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:49.563555 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2346/4671] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:49 2022] DELETE /identity/v3/users/f4f7c8f24789434982e5e2a279077449 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:49.569190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df834-62fe-49f1-b5a8-3cbfb20b7bc8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:49.573541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df834-62fe-49f1-b5a8-3cbfb20b7bc8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:49.574371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df834-62fe-49f1-b5a8-3cbfb20b7bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:49.623897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:49.646955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-916df834-62fe-49f1-b5a8-3cbfb20b7bc8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:49.649685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-916df834-62fe-49f1-b5a8-3cbfb20b7bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:49.842375 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2326/4672] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:50.198856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:50.201901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:50.350166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d12961-a000-4378-81dd-8e4c682487cc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:50.359300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9bc9e-ff34-4757-ba5f-5ddc99a5ecd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:50.360423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9bc9e-ff34-4757-ba5f-5ddc99a5ecd7 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:50.365876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9bc9e-ff34-4757-ba5f-5ddc99a5ecd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:50.366571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9bc9e-ff34-4757-ba5f-5ddc99a5ecd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:50.387656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9bc9e-ff34-4757-ba5f-5ddc99a5ecd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:50.390024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9bc9e-ff34-4757-ba5f-5ddc99a5ecd7 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:50.423394 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2347/4673] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:50.653115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df834-62fe-49f1-b5a8-3cbfb20b7bc8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:50.675402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df834-62fe-49f1-b5a8-3cbfb20b7bc8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:50.685563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdb23f-6626-4b49-bc14-a71d945ec26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:50.686413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdb23f-6626-4b49-bc14-a71d945ec26f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:50.686841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdb23f-6626-4b49-bc14-a71d945ec26f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:50.687186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdb23f-6626-4b49-bc14-a71d945ec26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:50.706487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0ebdb23f-6626-4b49-bc14-a71d945ec26f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:50.731043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdb23f-6626-4b49-bc14-a71d945ec26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:50.732523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdb23f-6626-4b49-bc14-a71d945ec26f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:50.769608 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2327/4674] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:51.762683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9bc9e-ff34-4757-ba5f-5ddc99a5ecd7 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:51.764733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2fb9bc9e-ff34-4757-ba5f-5ddc99a5ecd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:51.793247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9bc9e-ff34-4757-ba5f-5ddc99a5ecd7 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:51.859743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:51.864575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:51.874015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:51.875202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] PATH_INFO: `/v3/projects/000ed910310c43b5a1b576629945cfba` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:51.886130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=000ed910310c43b5a1b576629945cfba)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:51.894444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:52.063739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:52.075777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000ed910310c43b5a1b576629945cfba', 'request_id': 'req-b832077e-45c8-46f9-8570-3a9464f62a5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.099256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000ed910310c43b5a1b576629945cfba', 'request_id': 'req-b832077e-45c8-46f9-8570-3a9464f62a5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.124507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000ed910310c43b5a1b576629945cfba', 'request_id': 'req-b832077e-45c8-46f9-8570-3a9464f62a5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.126044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdb23f-6626-4b49-bc14-a71d945ec26f service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:52.129475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0ebdb23f-6626-4b49-bc14-a71d945ec26f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:52.169892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdb23f-6626-4b49-bc14-a71d945ec26f service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:52.195373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] The token cache is being invalidate because project 000ed910310c43b5a1b576629945cfba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:52.196653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.199950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b832077e-45c8-46f9-8570-3a9464f62a5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.216609 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2348/4675] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:51 2022] DELETE /identity/v3/projects/000ed910310c43b5a1b576629945cfba => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:52.218258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbab285-8681-4462-8fea-dea770e5c783 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:52.218602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbab285-8681-4462-8fea-dea770e5c783 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:52.218913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbab285-8681-4462-8fea-dea770e5c783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:52.257524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7dbab285-8681-4462-8fea-dea770e5c783 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:52.261481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7dbab285-8681-4462-8fea-dea770e5c783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:52.326211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:52.326875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:52.327157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:52.327437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] PATH_INFO: `/v3/projects/1f1597a7f1844360aa09bd5bff920769` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:52.328635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1597a7f1844360aa09bd5bff920769)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:52.337236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:52.455930 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2349/4676] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:46:52.456210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1597a7f1844360aa09bd5bff920769', 'request_id': 'req-d9c6e29e-a29c-46f3-9043-a9382974fe79'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.457655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aa4b9-72dd-4952-9e2d-4d038c5f8c06 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:52.457949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aa4b9-72dd-4952-9e2d-4d038c5f8c06 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:52.458290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aa4b9-72dd-4952-9e2d-4d038c5f8c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:52.476735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1597a7f1844360aa09bd5bff920769', 'request_id': 'req-d9c6e29e-a29c-46f3-9043-a9382974fe79'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.493438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1597a7f1844360aa09bd5bff920769', 'request_id': 'req-d9c6e29e-a29c-46f3-9043-a9382974fe79'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.506364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-927aa4b9-72dd-4952-9e2d-4d038c5f8c06 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:52.508234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-927aa4b9-72dd-4952-9e2d-4d038c5f8c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:52.521790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] The token cache is being invalidate because project 1f1597a7f1844360aa09bd5bff920769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:52.522079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.522812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.525034 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2328/4677] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:52 2022] DELETE /identity/v3/projects/1f1597a7f1844360aa09bd5bff920769 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:52.529689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:52.532347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:52.625263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:52.699761 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2350/4678] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:46:52.701518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927aa4b9-72dd-4952-9e2d-4d038c5f8c06 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:52.725875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927aa4b9-72dd-4952-9e2d-4d038c5f8c06 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:52.734398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6e29e-a29c-46f3-9043-a9382974fe79 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:52.738844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6fded-234e-4b94-98a9-5ee8e3a7db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:52.739473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6fded-234e-4b94-98a9-5ee8e3a7db50 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:52.740314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6fded-234e-4b94-98a9-5ee8e3a7db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:52.740610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6fded-234e-4b94-98a9-5ee8e3a7db50 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:52.741846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6fded-234e-4b94-98a9-5ee8e3a7db50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:52.742157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6fded-234e-4b94-98a9-5ee8e3a7db50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:52.745336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6fded-234e-4b94-98a9-5ee8e3a7db50 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:52.748736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:52.749526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:52.749814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:52.750096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] PATH_INFO: `/v3/users/a81593b3f57349d5b6a6012bc3ff8dba` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:52.753063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81593b3f57349d5b6a6012bc3ff8dba)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:52.761990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:52.795443 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2351/4679] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:52.796258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6fded-234e-4b94-98a9-5ee8e3a7db50 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:52.811467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6fded-234e-4b94-98a9-5ee8e3a7db50 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:52.823903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6cd36-5fe0-4829-b409-a812dad68a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:52.824711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6cd36-5fe0-4829-b409-a812dad68a5d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:52.824914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6cd36-5fe0-4829-b409-a812dad68a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:52.827621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6cd36-5fe0-4829-b409-a812dad68a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:52.830783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6cd36-5fe0-4829-b409-a812dad68a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:52.833569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6cd36-5fe0-4829-b409-a812dad68a5d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:52.868617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81593b3f57349d5b6a6012bc3ff8dba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.869900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81593b3f57349d5b6a6012bc3ff8dba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.904901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81593b3f57349d5b6a6012bc3ff8dba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.905116 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2352/4680] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:52 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:52.905959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6cd36-5fe0-4829-b409-a812dad68a5d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:52.925885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81593b3f57349d5b6a6012bc3ff8dba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.937303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81593b3f57349d5b6a6012bc3ff8dba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:52.949768 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2329/4681] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:52 2022] DELETE /identity/v3/users/a81593b3f57349d5b6a6012bc3ff8dba => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:52.987869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:53.049268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6cd36-5fe0-4829-b409-a812dad68a5d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:53.134572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59f7ef-8866-4952-82de-25f2cf9a1b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:53.135272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59f7ef-8866-4952-82de-25f2cf9a1b32 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:53.135557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59f7ef-8866-4952-82de-25f2cf9a1b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:53.135834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59f7ef-8866-4952-82de-25f2cf9a1b32 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:53.136490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59f7ef-8866-4952-82de-25f2cf9a1b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:53.138497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59f7ef-8866-4952-82de-25f2cf9a1b32 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:53.170774 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2353/4682] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:52 2022] POST /identity/v3/users => generated 287 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:53.176137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:53.179438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:53.225455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a688b-073a-4de1-8dee-9a51b2762908 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:53.234485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c3fd3-3f48-418a-aaac-118e270694d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:53.235895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3fd3-3f48-418a-aaac-118e270694d7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:53.236415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3fd3-3f48-418a-aaac-118e270694d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:53.236771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3fd3-3f48-418a-aaac-118e270694d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:53.237867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c3fd3-3f48-418a-aaac-118e270694d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:53.239654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c3fd3-3f48-418a-aaac-118e270694d7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:53.262225 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2330/4683] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:53.267858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59f7ef-8866-4952-82de-25f2cf9a1b32 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:53.283754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59f7ef-8866-4952-82de-25f2cf9a1b32 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:53.292993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ca9b7-ca60-46f8-a518-565f4face031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:53.293989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca9b7-ca60-46f8-a518-565f4face031 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:53.294344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca9b7-ca60-46f8-a518-565f4face031 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:53.295367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca9b7-ca60-46f8-a518-565f4face031 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:53.296378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ca9b7-ca60-46f8-a518-565f4face031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:53.299292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ca9b7-ca60-46f8-a518-565f4face031 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:53.332672 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2354/4684] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:53.336781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c3fd3-3f48-418a-aaac-118e270694d7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:53.360398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c3fd3-3f48-418a-aaac-118e270694d7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:53.381224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b580e8-50ed-40b3-af6e-deb0bbc557f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:53.382336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b580e8-50ed-40b3-af6e-deb0bbc557f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:53.382775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b580e8-50ed-40b3-af6e-deb0bbc557f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:53.383213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b580e8-50ed-40b3-af6e-deb0bbc557f7 admin admin] PATH_INFO: `/v3/projects/94a1cd3e65f14f16ba1718eecacecc5d/users/d4087b27edca4716b8d1fd95e9ff88cc/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:53.427437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b580e8-50ed-40b3-af6e-deb0bbc557f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a1cd3e65f14f16ba1718eecacecc5d, user_id=d4087b27edca4716b8d1fd95e9ff88cc, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:53.433439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b580e8-50ed-40b3-af6e-deb0bbc557f7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:53.486273 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2331/4685] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:53 2022] PUT /identity/v3/projects/94a1cd3e65f14f16ba1718eecacecc5d/users/d4087b27edca4716b8d1fd95e9ff88cc/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:53.488093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead03a7-d669-436d-8328-97a27357ccd3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:53.489501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead03a7-d669-436d-8328-97a27357ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:53.489812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead03a7-d669-436d-8328-97a27357ccd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:53.554370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9ead03a7-d669-436d-8328-97a27357ccd3 None None] MFA Rules not processed for user `d4087b27edca4716b8d1fd95e9ff88cc`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:53.556994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9ead03a7-d669-436d-8328-97a27357ccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:53.748091 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2355/4686] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:53.753027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b580e8-50ed-40b3-af6e-deb0bbc557f7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:54.005830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b580e8-50ed-40b3-af6e-deb0bbc557f7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:54.017961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c9f2d-05fc-4423-8acb-880ac10890be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:54.018999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9f2d-05fc-4423-8acb-880ac10890be admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:54.019438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9f2d-05fc-4423-8acb-880ac10890be admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:54.019863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9f2d-05fc-4423-8acb-880ac10890be admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:54.020703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c9f2d-05fc-4423-8acb-880ac10890be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:54.026112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c9f2d-05fc-4423-8acb-880ac10890be admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:54.055835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:54.087753 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2332/4687] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:53 2022] POST /identity/v3/projects => generated 373 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:54.090002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead03a7-d669-436d-8328-97a27357ccd3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:54.113892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead03a7-d669-436d-8328-97a27357ccd3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:54.244411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c9f2d-05fc-4423-8acb-880ac10890be admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:54.246377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dc9c9f2d-05fc-4423-8acb-880ac10890be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:54.275762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:54.289966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cfbfb-680b-488c-9a88-15d1a5106161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:54.291536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cfbfb-680b-488c-9a88-15d1a5106161 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:54.291686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cfbfb-680b-488c-9a88-15d1a5106161 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:54.291965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cfbfb-680b-488c-9a88-15d1a5106161 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:54.292881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cfbfb-680b-488c-9a88-15d1a5106161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:54.295118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cfbfb-680b-488c-9a88-15d1a5106161 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:54.333112 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2356/4688] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:54 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:54.334648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cfbfb-680b-488c-9a88-15d1a5106161 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:54.353565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cfbfb-680b-488c-9a88-15d1a5106161 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:54.362807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb4963-f23c-4fd1-bbcf-0d76072b0b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:54.363521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb4963-f23c-4fd1-bbcf-0d76072b0b10 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:54.364738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb4963-f23c-4fd1-bbcf-0d76072b0b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:54.365166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb4963-f23c-4fd1-bbcf-0d76072b0b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:54.366804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb4963-f23c-4fd1-bbcf-0d76072b0b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:54.369676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb4963-f23c-4fd1-bbcf-0d76072b0b10 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:54.393446 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2357/4689] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:54.398537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb4963-f23c-4fd1-bbcf-0d76072b0b10 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:54.410661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb4963-f23c-4fd1-bbcf-0d76072b0b10 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:54.416928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd5ad-8ee3-4b89-a1ca-8daa270f0b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:54.418130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd5ad-8ee3-4b89-a1ca-8daa270f0b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:54.418735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd5ad-8ee3-4b89-a1ca-8daa270f0b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:54.419167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd5ad-8ee3-4b89-a1ca-8daa270f0b95 admin admin] PATH_INFO: `/v3/projects/e613ff2ac7ae46fe9e644f7bc3efafb3/users/f2715aa6d5604c86a2c938e17ee03860/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:54.436758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c9f2d-05fc-4423-8acb-880ac10890be admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:54.437577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccd5ad-8ee3-4b89-a1ca-8daa270f0b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e613ff2ac7ae46fe9e644f7bc3efafb3, user_id=f2715aa6d5604c86a2c938e17ee03860, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:54.443167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccd5ad-8ee3-4b89-a1ca-8daa270f0b95 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:54.446374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:54.448826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:54.450733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:54.452023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] PATH_INFO: `/v3/projects/2ec344ea46b8418dacdfdef7d24c7f8c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:54.465535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec344ea46b8418dacdfdef7d24c7f8c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:54.466206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:54.466671 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2358/4690] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:54 2022] PUT /identity/v3/projects/e613ff2ac7ae46fe9e644f7bc3efafb3/users/f2715aa6d5604c86a2c938e17ee03860/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:54.467991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd5ad-8ee3-4b89-a1ca-8daa270f0b95 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:54.629838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd5ad-8ee3-4b89-a1ca-8daa270f0b95 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:54.656690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec344ea46b8418dacdfdef7d24c7f8c', 'request_id': 'req-c7733254-8356-4d51-af9e-5610f35c37ba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:54.674428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec344ea46b8418dacdfdef7d24c7f8c', 'request_id': 'req-c7733254-8356-4d51-af9e-5610f35c37ba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:54.690779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec344ea46b8418dacdfdef7d24c7f8c', 'request_id': 'req-c7733254-8356-4d51-af9e-5610f35c37ba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:54.731181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] The token cache is being invalidate because project 2ec344ea46b8418dacdfdef7d24c7f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:46:54.731851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:54.742798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c7733254-8356-4d51-af9e-5610f35c37ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:46:54.745016 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2333/4691] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:54 2022] DELETE /identity/v3/projects/2ec344ea46b8418dacdfdef7d24c7f8c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:54.750800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b321443-c307-418b-bf7f-0050a8fe356f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:54.751275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b321443-c307-418b-bf7f-0050a8fe356f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:54.751605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b321443-c307-418b-bf7f-0050a8fe356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:54.809750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477900ae-542d-4e99-8287-61a94a163d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:54.810455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477900ae-542d-4e99-8287-61a94a163d95 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:54.810932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477900ae-542d-4e99-8287-61a94a163d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:54.811699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477900ae-542d-4e99-8287-61a94a163d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:54.816232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477900ae-542d-4e99-8287-61a94a163d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:54.816801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477900ae-542d-4e99-8287-61a94a163d95 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:54.825357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4b321443-c307-418b-bf7f-0050a8fe356f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:54.826671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4b321443-c307-418b-bf7f-0050a8fe356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:54.857216 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2334/4692] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:46:54.870010 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2359/4693] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:54.874450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b321443-c307-418b-bf7f-0050a8fe356f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:54.876059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f56dd-fbc6-4c5c-b0c7-61272ae88b6b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:54.876199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4b321443-c307-418b-bf7f-0050a8fe356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:54.876502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f56dd-fbc6-4c5c-b0c7-61272ae88b6b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:54.876828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f56dd-fbc6-4c5c-b0c7-61272ae88b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:54.899216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b321443-c307-418b-bf7f-0050a8fe356f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:54.917953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd3193-7922-4944-83d1-14cc6e0452c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:54.922845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd3193-7922-4944-83d1-14cc6e0452c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:54.923223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd3193-7922-4944-83d1-14cc6e0452c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:54.923520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd3193-7922-4944-83d1-14cc6e0452c5 admin admin] PATH_INFO: `/v3/projects/e613ff2ac7ae46fe9e644f7bc3efafb3/users/f2715aa6d5604c86a2c938e17ee03860/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:54.929285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd3193-7922-4944-83d1-14cc6e0452c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e613ff2ac7ae46fe9e644f7bc3efafb3, user_id=f2715aa6d5604c86a2c938e17ee03860, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:54.930493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-301f56dd-fbc6-4c5c-b0c7-61272ae88b6b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:54.932123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-301f56dd-fbc6-4c5c-b0c7-61272ae88b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:54.936228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd3193-7922-4944-83d1-14cc6e0452c5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:54.955429 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2360/4694] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:54.961239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f56dd-fbc6-4c5c-b0c7-61272ae88b6b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:54.971629 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2335/4695] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:54 2022] PUT /identity/v3/projects/e613ff2ac7ae46fe9e644f7bc3efafb3/users/f2715aa6d5604c86a2c938e17ee03860/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:54.980760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f56dd-fbc6-4c5c-b0c7-61272ae88b6b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:54.991774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd638a-3e2a-4e27-b1aa-1eb690b9c76d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:54.991774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd638a-3e2a-4e27-b1aa-1eb690b9c76d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:54.991774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd638a-3e2a-4e27-b1aa-1eb690b9c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:55.070243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-19fd638a-3e2a-4e27-b1aa-1eb690b9c76d None None] MFA Rules not processed for user `f2715aa6d5604c86a2c938e17ee03860`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:55.071976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-19fd638a-3e2a-4e27-b1aa-1eb690b9c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:55.123283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:55.160937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfc407-52e6-46a5-9241-de8149e18843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:55.162327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc407-52e6-46a5-9241-de8149e18843 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:55.162960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc407-52e6-46a5-9241-de8149e18843 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:55.163430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc407-52e6-46a5-9241-de8149e18843 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:55.164350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfc407-52e6-46a5-9241-de8149e18843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:46:55.164798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfc407-52e6-46a5-9241-de8149e18843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:55.167016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfc407-52e6-46a5-9241-de8149e18843 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:55.208059 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2361/4696] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:46:55.210763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfc407-52e6-46a5-9241-de8149e18843 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:55.259264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfc407-52e6-46a5-9241-de8149e18843 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:55.271001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:55.283120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10363-96ad-4794-bafc-9fc7c7097e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:55.285954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10363-96ad-4794-bafc-9fc7c7097e98 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:55.286439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10363-96ad-4794-bafc-9fc7c7097e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:55.286812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10363-96ad-4794-bafc-9fc7c7097e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:55.290545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b10363-96ad-4794-bafc-9fc7c7097e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:55.294554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b10363-96ad-4794-bafc-9fc7c7097e98 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:55.348594 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2336/4697] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:46:55.349809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd638a-3e2a-4e27-b1aa-1eb690b9c76d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:55.375996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd638a-3e2a-4e27-b1aa-1eb690b9c76d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:55.383262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcc202-a44c-4c14-a609-89d9b62f7da6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:55.384242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc202-a44c-4c14-a609-89d9b62f7da6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:55.384705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc202-a44c-4c14-a609-89d9b62f7da6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:55.385141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc202-a44c-4c14-a609-89d9b62f7da6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:55.386201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcc202-a44c-4c14-a609-89d9b62f7da6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:55.387532 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-7ffcc202-a44c-4c14-a609-89d9b62f7da6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:55.387532 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:55.387532 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:55.388848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcc202-a44c-4c14-a609-89d9b62f7da6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:55.389561 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2362/4698] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:55 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:55.395404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10363-96ad-4794-bafc-9fc7c7097e98 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:55.442287 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2337/4699] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:55 2022] POST /identity/v3/services => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:55.448105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcc202-a44c-4c14-a609-89d9b62f7da6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:55.480992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcc202-a44c-4c14-a609-89d9b62f7da6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:55.684164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10363-96ad-4794-bafc-9fc7c7097e98 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:55.710115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744be42-ff72-40e0-83ca-abff44343bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:55.711177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744be42-ff72-40e0-83ca-abff44343bff admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:55.711666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744be42-ff72-40e0-83ca-abff44343bff admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:55.712140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744be42-ff72-40e0-83ca-abff44343bff admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:55.713314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0b612-a6af-4325-80ad-4b39d689e736 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:55.714130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0b612-a6af-4325-80ad-4b39d689e736 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:55.714259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744be42-ff72-40e0-83ca-abff44343bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:55.714444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0b612-a6af-4325-80ad-4b39d689e736 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:55.716926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744be42-ff72-40e0-83ca-abff44343bff admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:55.718257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0b612-a6af-4325-80ad-4b39d689e736 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:55.719249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0b612-a6af-4325-80ad-4b39d689e736 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:55.722586 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-6ee0b612-a6af-4325-80ad-4b39d689e736 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:55.722586 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:55.722586 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:55.725260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0b612-a6af-4325-80ad-4b39d689e736 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:55.759963 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2338/4700] 10.222.0.16 () {60 vars in 1213 bytes} [Mon Aug 29 15:46:55 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:46:55.760646 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2363/4701] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:55 2022] POST /identity/v3/users => generated 299 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:55.765230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a513-c02a-4719-a79d-87eadb0a615f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:55.765662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a513-c02a-4719-a79d-87eadb0a615f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:55.765851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a513-c02a-4719-a79d-87eadb0a615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:55.766266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744be42-ff72-40e0-83ca-abff44343bff admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:55.805131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744be42-ff72-40e0-83ca-abff44343bff admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:55.826325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e288a-bfdb-4bc3-84fb-2ed5549ae6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:55.827272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e288a-bfdb-4bc3-84fb-2ed5549ae6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:55.827864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e288a-bfdb-4bc3-84fb-2ed5549ae6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:55.828510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e288a-bfdb-4bc3-84fb-2ed5549ae6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:55.829759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e288a-bfdb-4bc3-84fb-2ed5549ae6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:55.832630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e288a-bfdb-4bc3-84fb-2ed5549ae6d5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:55.851743 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2364/4702] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:55.853142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e288a-bfdb-4bc3-84fb-2ed5549ae6d5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:55.874830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e288a-bfdb-4bc3-84fb-2ed5549ae6d5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:55.887081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ba48-043f-416a-84f8-43d22ac4a4d3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:55.888235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ba48-043f-416a-84f8-43d22ac4a4d3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:55.888949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ba48-043f-416a-84f8-43d22ac4a4d3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:55.890323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ba48-043f-416a-84f8-43d22ac4a4d3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:55.893949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620ba48-043f-416a-84f8-43d22ac4a4d3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:55.897174 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-c620ba48-043f-416a-84f8-43d22ac4a4d3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:55.897174 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:55.897174 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:55.900339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620ba48-043f-416a-84f8-43d22ac4a4d3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:55.963690 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2365/4703] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:55 2022] POST /identity/v3/services => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:55.963690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ba48-043f-416a-84f8-43d22ac4a4d3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:55.969632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9776a513-c02a-4719-a79d-87eadb0a615f None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:55.973630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9776a513-c02a-4719-a79d-87eadb0a615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:56.021315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ba48-043f-416a-84f8-43d22ac4a4d3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:56.060687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804d48-8a3b-4e5c-b05d-66abc7a18dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:56.063139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804d48-8a3b-4e5c-b05d-66abc7a18dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:56.063555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804d48-8a3b-4e5c-b05d-66abc7a18dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:56.063902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804d48-8a3b-4e5c-b05d-66abc7a18dd7 admin admin] PATH_INFO: `/v3/projects/916d53803c3f42d9a1701efc5b7557dc/users/35fe2ed2bcd144a98496f558309bdffa/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:56.124345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0804d48-8a3b-4e5c-b05d-66abc7a18dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916d53803c3f42d9a1701efc5b7557dc, user_id=35fe2ed2bcd144a98496f558309bdffa, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:56.134307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0804d48-8a3b-4e5c-b05d-66abc7a18dd7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:56.173022 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2366/4704] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:55 2022] PUT /identity/v3/projects/916d53803c3f42d9a1701efc5b7557dc/users/35fe2ed2bcd144a98496f558309bdffa/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:56.177320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804d48-8a3b-4e5c-b05d-66abc7a18dd7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:56.223771 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2339/4705] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:46:55 2022] POST /identity/v3/auth/tokens => generated 3461 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:56.224936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776a513-c02a-4719-a79d-87eadb0a615f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:56.277673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776a513-c02a-4719-a79d-87eadb0a615f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:56.350474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:56.395064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:56.466419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804d48-8a3b-4e5c-b05d-66abc7a18dd7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:56.476989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ad7b3-d868-4914-ba53-9ab8c9fba3c8 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:56.481713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ad7b3-d868-4914-ba53-9ab8c9fba3c8 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:56.482041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ad7b3-d868-4914-ba53-9ab8c9fba3c8 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:56.482324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ad7b3-d868-4914-ba53-9ab8c9fba3c8 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:56.483054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ad7b3-d868-4914-ba53-9ab8c9fba3c8 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:56.484125 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-192ad7b3-d868-4914-ba53-9ab8c9fba3c8 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:56.484125 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:56.484125 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:56.485041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ad7b3-d868-4914-ba53-9ab8c9fba3c8 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:56.491706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff02e2-2aae-42d0-ae95-ff34678145e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:56.492361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff02e2-2aae-42d0-ae95-ff34678145e2 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:56.492637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff02e2-2aae-42d0-ae95-ff34678145e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:56.492916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff02e2-2aae-42d0-ae95-ff34678145e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:56.493809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff02e2-2aae-42d0-ae95-ff34678145e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:56.495552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff02e2-2aae-42d0-ae95-ff34678145e2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:56.515563 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2367/4706] 10.222.0.16 () {60 vars in 1213 bytes} [Mon Aug 29 15:46:56 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:56.518130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ad7b3-d868-4914-ba53-9ab8c9fba3c8 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:56.524924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-192ad7b3-d868-4914-ba53-9ab8c9fba3c8 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:56.527847 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2340/4707] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:56.528819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff02e2-2aae-42d0-ae95-ff34678145e2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:56.560955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff02e2-2aae-42d0-ae95-ff34678145e2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:56.575979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd58a0b-7891-471c-9698-6b745a19747c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:56.578327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58a0b-7891-471c-9698-6b745a19747c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:56.579816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58a0b-7891-471c-9698-6b745a19747c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:56.579816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58a0b-7891-471c-9698-6b745a19747c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:56.580227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd58a0b-7891-471c-9698-6b745a19747c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:56.583928 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-3cd58a0b-7891-471c-9698-6b745a19747c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:56.583928 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:56.583928 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:56.587324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd58a0b-7891-471c-9698-6b745a19747c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:56.605463 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2341/4708] 10.222.0.16 () {58 vars in 1191 bytes} [Mon Aug 29 15:46:56 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 763 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:56.606191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd58a0b-7891-471c-9698-6b745a19747c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:56.630777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd58a0b-7891-471c-9698-6b745a19747c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:56.639252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c7fa5-9fa1-4547-aa21-299cbcf73fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:56.639565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c7fa5-9fa1-4547-aa21-299cbcf73fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:56.639860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c7fa5-9fa1-4547-aa21-299cbcf73fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:56.640766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c7fa5-9fa1-4547-aa21-299cbcf73fd7 admin admin] PATH_INFO: `/v3/projects/916d53803c3f42d9a1701efc5b7557dc/users/35fe2ed2bcd144a98496f558309bdffa/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:56.644053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c7fa5-9fa1-4547-aa21-299cbcf73fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916d53803c3f42d9a1701efc5b7557dc, user_id=35fe2ed2bcd144a98496f558309bdffa, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:56.649870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c7fa5-9fa1-4547-aa21-299cbcf73fd7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:56.673578 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2342/4709] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:56 2022] PUT /identity/v3/projects/916d53803c3f42d9a1701efc5b7557dc/users/35fe2ed2bcd144a98496f558309bdffa/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:56.676877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c7fa5-9fa1-4547-aa21-299cbcf73fd7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:56.795063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ad7b3-d868-4914-ba53-9ab8c9fba3c8 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:56.827327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c7fa5-9fa1-4547-aa21-299cbcf73fd7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:56.836325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c536b-0e0c-40bf-9587-fbfd49716a7e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:56.837716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c536b-0e0c-40bf-9587-fbfd49716a7e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:56.838488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c536b-0e0c-40bf-9587-fbfd49716a7e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:56.839104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c536b-0e0c-40bf-9587-fbfd49716a7e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/43621a1c6b0248e495fc2bca4d989d1c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:56.841294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c536b-0e0c-40bf-9587-fbfd49716a7e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=43621a1c6b0248e495fc2bca4d989d1c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:56.842618 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-f04c536b-0e0c-40bf-9587-fbfd49716a7e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:56.842618 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:56.842618 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:56.845130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c536b-0e0c-40bf-9587-fbfd49716a7e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:56.854704 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2343/4710] 10.222.0.16 () {58 vars in 1290 bytes} [Mon Aug 29 15:46:56 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/43621a1c6b0248e495fc2bca4d989d1c => generated 332 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:56.856607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cd49a-ef2b-44aa-ac3c-709e11c20aac None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:56.857205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cd49a-ef2b-44aa-ac3c-709e11c20aac None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:56.857694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cd49a-ef2b-44aa-ac3c-709e11c20aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:56.905139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-807cd49a-ef2b-44aa-ac3c-709e11c20aac None None] MFA Rules not processed for user `35fe2ed2bcd144a98496f558309bdffa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:56.907593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-807cd49a-ef2b-44aa-ac3c-709e11c20aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:56.973282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734019a-a972-46b4-b6b2-2b10731a55f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:56.979530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734019a-a972-46b4-b6b2-2b10731a55f5 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:56.980071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734019a-a972-46b4-b6b2-2b10731a55f5 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:56.980636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734019a-a972-46b4-b6b2-2b10731a55f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:57.059943 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2344/4711] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:56 2022] POST /identity/v3/auth/tokens => generated 3595 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:57.061411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cd49a-ef2b-44aa-ac3c-709e11c20aac None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:57.078728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cd49a-ef2b-44aa-ac3c-709e11c20aac None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:57.093407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1844-209f-428a-959d-a6fff831c4c3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:57.094587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1844-209f-428a-959d-a6fff831c4c3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:57.096452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1844-209f-428a-959d-a6fff831c4c3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:57.096967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1844-209f-428a-959d-a6fff831c4c3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/43621a1c6b0248e495fc2bca4d989d1c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:57.106096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1844-209f-428a-959d-a6fff831c4c3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=43621a1c6b0248e495fc2bca4d989d1c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:57.109006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1844-209f-428a-959d-a6fff831c4c3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:57.114821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:57.121855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734019a-a972-46b4-b6b2-2b10731a55f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:57.125438 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2345/4712] 10.222.0.16 () {58 vars in 1291 bytes} [Mon Aug 29 15:46:57 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/43621a1c6b0248e495fc2bca4d989d1c => generated 0 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 29 15:46:57.125703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1844-209f-428a-959d-a6fff831c4c3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:57.128524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734019a-a972-46b4-b6b2-2b10731a55f5 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:57.149793 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2368/4713] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:46:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:57.150881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734019a-a972-46b4-b6b2-2b10731a55f5 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:57.188735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:57.218076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734019a-a972-46b4-b6b2-2b10731a55f5 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:57.260279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cebd5-5620-497e-9427-106246d1085e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:57.261077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cebd5-5620-497e-9427-106246d1085e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:57.261244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cebd5-5620-497e-9427-106246d1085e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:57.261962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cebd5-5620-497e-9427-106246d1085e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/43621a1c6b0248e495fc2bca4d989d1c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:57.262165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cebd5-5620-497e-9427-106246d1085e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=43621a1c6b0248e495fc2bca4d989d1c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:57.263237 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-266cebd5-5620-497e-9427-106246d1085e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:57.263237 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:57.263237 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:57.264190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cebd5-5620-497e-9427-106246d1085e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:57.376741 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2369/4714] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Aug 29 15:46:57 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/43621a1c6b0248e495fc2bca4d989d1c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:57.378414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cebd5-5620-497e-9427-106246d1085e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:57.398053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cebd5-5620-497e-9427-106246d1085e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:57.421041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1844-209f-428a-959d-a6fff831c4c3 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:57.444893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3626b-7a97-44fc-8f07-435b45029cc6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:57.446063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610b7fd-b004-4ebf-8312-f4bf170cce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:57.448600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610b7fd-b004-4ebf-8312-f4bf170cce2f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:57.450466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610b7fd-b004-4ebf-8312-f4bf170cce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:57.450980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610b7fd-b004-4ebf-8312-f4bf170cce2f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:57.451888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610b7fd-b004-4ebf-8312-f4bf170cce2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:57.455459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610b7fd-b004-4ebf-8312-f4bf170cce2f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:57.458289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3626b-7a97-44fc-8f07-435b45029cc6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:57.458629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3626b-7a97-44fc-8f07-435b45029cc6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:57.461523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3626b-7a97-44fc-8f07-435b45029cc6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:57.462492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3626b-7a97-44fc-8f07-435b45029cc6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:57.468359 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-31a3626b-7a97-44fc-8f07-435b45029cc6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:57.468359 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:57.468359 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:57.470467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3626b-7a97-44fc-8f07-435b45029cc6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:57.502246 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2370/4715] 10.222.0.16 () {58 vars in 1191 bytes} [Mon Aug 29 15:46:57 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:57.503546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3626b-7a97-44fc-8f07-435b45029cc6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:57.528234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3626b-7a97-44fc-8f07-435b45029cc6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:57.557260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f12205-1a2a-4f35-b178-5e0347a7f3e6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:57.558895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f12205-1a2a-4f35-b178-5e0347a7f3e6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:57.559659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f12205-1a2a-4f35-b178-5e0347a7f3e6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:57.560490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f12205-1a2a-4f35-b178-5e0347a7f3e6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/43621a1c6b0248e495fc2bca4d989d1c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:57.565200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f12205-1a2a-4f35-b178-5e0347a7f3e6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=43621a1c6b0248e495fc2bca4d989d1c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:57.572308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f12205-1a2a-4f35-b178-5e0347a7f3e6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:57.594238 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2346/4716] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:57 2022] POST /identity/v3/projects => generated 387 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:57.595561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610b7fd-b004-4ebf-8312-f4bf170cce2f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-06f12205-1a2a-4f35-b178-5e0347a7f3e6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Could not find Endpoint Group: 43621a1c6b0248e495fc2bca4d989d1c.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 43621a1c6b0248e495fc2bca4d989d1c. Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Aug 29 15:46:57.613781 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Aug 29 15:46:57.617266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Aug 29 15:46:57.617266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Aug 29 15:46:57.617266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Aug 29 15:46:57.617266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Aug 29 15:46:57.617266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 43621a1c6b0248e495fc2bca4d989d1c. Aug 29 15:46:57.617266 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:46:57.623998 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2371/4717] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Aug 29 15:46:57 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/43621a1c6b0248e495fc2bca4d989d1c => generated 120 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:46:57.629714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f12205-1a2a-4f35-b178-5e0347a7f3e6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:57.652725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f12205-1a2a-4f35-b178-5e0347a7f3e6 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:57.830106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610b7fd-b004-4ebf-8312-f4bf170cce2f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:57.860317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c974420-9558-40bd-aecf-e057528fc1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:57.861070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c974420-9558-40bd-aecf-e057528fc1de admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:57.861410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c974420-9558-40bd-aecf-e057528fc1de admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:57.861732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c974420-9558-40bd-aecf-e057528fc1de admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:57.862728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c974420-9558-40bd-aecf-e057528fc1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:57.871090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c974420-9558-40bd-aecf-e057528fc1de admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:57.896513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea3218-3988-4ad2-b1fa-d3066a38a95c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:57.897028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea3218-3988-4ad2-b1fa-d3066a38a95c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:57.908803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea3218-3988-4ad2-b1fa-d3066a38a95c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:57.909027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea3218-3988-4ad2-b1fa-d3066a38a95c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/services/6fcb0492455743eda336fffb2ac6ee20` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:57.909869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea3218-3988-4ad2-b1fa-d3066a38a95c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6fcb0492455743eda336fffb2ac6ee20)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:57.911010 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-e2ea3218-3988-4ad2-b1fa-d3066a38a95c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:57.911010 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:57.911010 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:57.911984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea3218-3988-4ad2-b1fa-d3066a38a95c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:57.970924 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2347/4718] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:46:57 2022] POST /identity/v3/users => generated 294 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:57.972637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c974420-9558-40bd-aecf-e057528fc1de admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.012909 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2372/4719] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:57 2022] DELETE /identity/v3/services/6fcb0492455743eda336fffb2ac6ee20 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:58.028970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea3218-3988-4ad2-b1fa-d3066a38a95c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.033870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c974420-9558-40bd-aecf-e057528fc1de admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.107961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2067e-2437-4f98-a41f-d091ff368986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.109409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2067e-2437-4f98-a41f-d091ff368986 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.110124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2067e-2437-4f98-a41f-d091ff368986 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.110666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2067e-2437-4f98-a41f-d091ff368986 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.111630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2067e-2437-4f98-a41f-d091ff368986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.114742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2067e-2437-4f98-a41f-d091ff368986 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.126451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea3218-3988-4ad2-b1fa-d3066a38a95c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.140703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621eae-7a55-433e-835c-0253d2652ef1 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.141959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621eae-7a55-433e-835c-0253d2652ef1 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.142524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621eae-7a55-433e-835c-0253d2652ef1 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.142800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621eae-7a55-433e-835c-0253d2652ef1 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.143870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621eae-7a55-433e-835c-0253d2652ef1 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.152141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621eae-7a55-433e-835c-0253d2652ef1 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.159730 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2348/4720] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:58.161672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2067e-2437-4f98-a41f-d091ff368986 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.199741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2067e-2437-4f98-a41f-d091ff368986 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.209264 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2373/4721] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:58 2022] POST /identity/v3/services => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:58.212139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621eae-7a55-433e-835c-0253d2652ef1 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.263325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddeef0-671f-4d75-b92e-eb535d482f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.264448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddeef0-671f-4d75-b92e-eb535d482f91 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.265020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddeef0-671f-4d75-b92e-eb535d482f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.265789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddeef0-671f-4d75-b92e-eb535d482f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.267206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddeef0-671f-4d75-b92e-eb535d482f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.270080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddeef0-671f-4d75-b92e-eb535d482f91 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.299912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621eae-7a55-433e-835c-0253d2652ef1 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.312822 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2349/4722] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:46:58.318537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddeef0-671f-4d75-b92e-eb535d482f91 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.326560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed2f92-cb99-4351-837f-be7744f4000f tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.328005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed2f92-cb99-4351-837f-be7744f4000f tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.328297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed2f92-cb99-4351-837f-be7744f4000f tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.328703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed2f92-cb99-4351-837f-be7744f4000f tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.329844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed2f92-cb99-4351-837f-be7744f4000f tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.331812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed2f92-cb99-4351-837f-be7744f4000f tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.343178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddeef0-671f-4d75-b92e-eb535d482f91 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.357188 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2374/4723] 10.222.0.16 () {60 vars in 1213 bytes} [Mon Aug 29 15:46:58 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:58.360451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed2f92-cb99-4351-837f-be7744f4000f tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.374693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaea09-b359-4b92-81b2-2c221ce94726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.375402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaea09-b359-4b92-81b2-2c221ce94726 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.375686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaea09-b359-4b92-81b2-2c221ce94726 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.375966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaea09-b359-4b92-81b2-2c221ce94726 admin admin] PATH_INFO: `/v3/projects/0bb60215a30c4b99913482d0b09c4b87/users/1eac9c9ce0cf4c55803cd55f47fcb37c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.407177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed2f92-cb99-4351-837f-be7744f4000f tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.428127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540da51d-a113-4312-9841-571ceeb4df1e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.428979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da51d-a113-4312-9841-571ceeb4df1e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.429322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da51d-a113-4312-9841-571ceeb4df1e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.431756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da51d-a113-4312-9841-571ceeb4df1e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.432889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540da51d-a113-4312-9841-571ceeb4df1e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.441806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540da51d-a113-4312-9841-571ceeb4df1e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.443034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaea09-b359-4b92-81b2-2c221ce94726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bb60215a30c4b99913482d0b09c4b87, user_id=1eac9c9ce0cf4c55803cd55f47fcb37c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.491558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaea09-b359-4b92-81b2-2c221ce94726 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.512574 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2375/4724] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:46:58 2022] POST /identity/v3/services => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:46:58.521785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540da51d-a113-4312-9841-571ceeb4df1e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.560021 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2350/4725] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:46:58 2022] PUT /identity/v3/projects/0bb60215a30c4b99913482d0b09c4b87/users/1eac9c9ce0cf4c55803cd55f47fcb37c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:58.562548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceaff2-18e0-45a8-8206-862f4f7a7a20 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.562852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceaff2-18e0-45a8-8206-862f4f7a7a20 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.569002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceaff2-18e0-45a8-8206-862f4f7a7a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.625614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540da51d-a113-4312-9841-571ceeb4df1e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.668573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f1ceaff2-18e0-45a8-8206-862f4f7a7a20 None None] MFA Rules not processed for user `1eac9c9ce0cf4c55803cd55f47fcb37c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:46:58.673977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f1ceaff2-18e0-45a8-8206-862f4f7a7a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:58.752799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:58.781080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:58.784327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eab81-25c5-49b6-8c36-dfb4ebbc9d8e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.796436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eab81-25c5-49b6-8c36-dfb4ebbc9d8e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.797879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eab81-25c5-49b6-8c36-dfb4ebbc9d8e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.800159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eab81-25c5-49b6-8c36-dfb4ebbc9d8e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/51af43e2b2d5484b9e4c26c1e1f36775` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.801689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eab81-25c5-49b6-8c36-dfb4ebbc9d8e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=51af43e2b2d5484b9e4c26c1e1f36775)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.805709 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-2b2eab81-25c5-49b6-8c36-dfb4ebbc9d8e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:58.805709 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:46:58.805709 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:46:58.807032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eab81-25c5-49b6-8c36-dfb4ebbc9d8e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.854255 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2376/4726] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Aug 29 15:46:58 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/51af43e2b2d5484b9e4c26c1e1f36775 => generated 336 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:46:58.859144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eab81-25c5-49b6-8c36-dfb4ebbc9d8e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:58.908067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eab81-25c5-49b6-8c36-dfb4ebbc9d8e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:58.916512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9a093-89b5-4a94-bc9c-f5f8adbd0224 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:58.917373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9a093-89b5-4a94-bc9c-f5f8adbd0224 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:58.918001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9a093-89b5-4a94-bc9c-f5f8adbd0224 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:58.918657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9a093-89b5-4a94-bc9c-f5f8adbd0224 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/services/940f85c3eba14b838b84414396757ec9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:58.919838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9a093-89b5-4a94-bc9c-f5f8adbd0224 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:delete_service(service_id=940f85c3eba14b838b84414396757ec9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:58.923321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9a093-89b5-4a94-bc9c-f5f8adbd0224 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:58.990441 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2377/4727] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:58 2022] DELETE /identity/v3/services/940f85c3eba14b838b84414396757ec9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:58.995905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9a093-89b5-4a94-bc9c-f5f8adbd0224 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:59.060575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9a093-89b5-4a94-bc9c-f5f8adbd0224 tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:59.072603 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2351/4728] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3531 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:46:59.080771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fd410-002a-4b2c-bd51-0a159c59daed tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:59.081636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fd410-002a-4b2c-bd51-0a159c59daed tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.081779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fd410-002a-4b2c-bd51-0a159c59daed tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.082008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fd410-002a-4b2c-bd51-0a159c59daed tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/51af43e2b2d5484b9e4c26c1e1f36775` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.082621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fd410-002a-4b2c-bd51-0a159c59daed tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=51af43e2b2d5484b9e4c26c1e1f36775)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:59.083275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ceaff2-18e0-45a8-8206-862f4f7a7a20 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:59.084339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fd410-002a-4b2c-bd51-0a159c59daed tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:59.085229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f1ceaff2-18e0-45a8-8206-862f4f7a7a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:59.108056 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2378/4729] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Aug 29 15:46:58 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/51af43e2b2d5484b9e4c26c1e1f36775 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:59.109730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fd410-002a-4b2c-bd51-0a159c59daed tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:59.126657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fd410-002a-4b2c-bd51-0a159c59daed tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:59.150074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f99e5-6682-4b9b-a213-b88698de74bf tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:59.150911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f99e5-6682-4b9b-a213-b88698de74bf tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.151622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f99e5-6682-4b9b-a213-b88698de74bf tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.151921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f99e5-6682-4b9b-a213-b88698de74bf tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/services/f8666e2792aa4a78af2121a8d705269c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.152919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f99e5-6682-4b9b-a213-b88698de74bf tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f8666e2792aa4a78af2121a8d705269c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:59.155039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f99e5-6682-4b9b-a213-b88698de74bf tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:59.249571 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2379/4730] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:59 2022] DELETE /identity/v3/services/f8666e2792aa4a78af2121a8d705269c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:46:59.254194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f99e5-6682-4b9b-a213-b88698de74bf tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:59.341236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ceaff2-18e0-45a8-8206-862f4f7a7a20 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:59.355202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f99e5-6682-4b9b-a213-b88698de74bf tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:59.385291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fe1cb-5fb5-44e5-a787-87779ab0ba7c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:59.386229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fe1cb-5fb5-44e5-a787-87779ab0ba7c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.386593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fe1cb-5fb5-44e5-a787-87779ab0ba7c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.386861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fe1cb-5fb5-44e5-a787-87779ab0ba7c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/6fcc0ee4f9d941358c23369cacbe6c70` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.389172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fe1cb-5fb5-44e5-a787-87779ab0ba7c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=6fcc0ee4f9d941358c23369cacbe6c70)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:59.398521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fe1cb-5fb5-44e5-a787-87779ab0ba7c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:59.412577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad9d4e-9f6b-4921-b1dc-f16670420487 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:59.413263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9d4e-9f6b-4921-b1dc-f16670420487 service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.413577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9d4e-9f6b-4921-b1dc-f16670420487 service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.413855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9d4e-9f6b-4921-b1dc-f16670420487 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.424858 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2380/4731] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Aug 29 15:46:59 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/6fcc0ee4f9d941358c23369cacbe6c70 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:59.427569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fe1cb-5fb5-44e5-a787-87779ab0ba7c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:59.436179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c69fe1cb-5fb5-44e5-a787-87779ab0ba7c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:59.692424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad9d4e-9f6b-4921-b1dc-f16670420487 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:59.693978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad9d4e-9f6b-4921-b1dc-f16670420487 service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:59.761077 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2352/4732] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:59 2022] GET /identity/v3/auth/tokens => generated 3462 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:59.762877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad9d4e-9f6b-4921-b1dc-f16670420487 service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:46:59.801907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fe1cb-5fb5-44e5-a787-87779ab0ba7c tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:59.822648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad9d4e-9f6b-4921-b1dc-f16670420487 service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:46:59.832399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f580f-987b-4c56-b4bd-eadf2d3b1086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:59.851516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f580f-987b-4c56-b4bd-eadf2d3b1086 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.852320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f580f-987b-4c56-b4bd-eadf2d3b1086 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.853985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f580f-987b-4c56-b4bd-eadf2d3b1086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.861152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-743f580f-987b-4c56-b4bd-eadf2d3b1086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:46:59.884249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74c58c-6d9e-4384-a271-3912fbbe421e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2715aa6d5604c86a2c938e17ee03860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:46:59.885121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74c58c-6d9e-4384-a271-3912fbbe421e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:46:59.885759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74c58c-6d9e-4384-a271-3912fbbe421e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:46:59.886231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74c58c-6d9e-4384-a271-3912fbbe421e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] PATH_INFO: `/v3/services/29d68405c387425186050341723f4683` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:46:59.891103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74c58c-6d9e-4384-a271-3912fbbe421e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorizing `identity:delete_service(service_id=29d68405c387425186050341723f4683)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:59.892214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f580f-987b-4c56-b4bd-eadf2d3b1086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:46:59.893549 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-6b74c58c-6d9e-4384-a271-3912fbbe421e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:46:59.893549 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:46:59.893549 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:46:59.894341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f580f-987b-4c56-b4bd-eadf2d3b1086 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:59.895442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74c58c-6d9e-4384-a271-3912fbbe421e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:46:59.932434 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2381/4733] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:46:59 2022] GET /identity/v3/auth/tokens => generated 3505 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:46:59.970590 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2353/4734] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:59 2022] DELETE /identity/v3/services/29d68405c387425186050341723f4683 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:46:59.972203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f580f-987b-4c56-b4bd-eadf2d3b1086 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:00.059970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:00.172188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f580f-987b-4c56-b4bd-eadf2d3b1086 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:00.202431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8e879-ade8-4548-a050-7ef958071dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:00.207527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8e879-ade8-4548-a050-7ef958071dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.208857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8e879-ade8-4548-a050-7ef958071dab admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.210546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8e879-ade8-4548-a050-7ef958071dab admin admin] PATH_INFO: `/v3/users/d4087b27edca4716b8d1fd95e9ff88cc` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.213066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8e879-ade8-4548-a050-7ef958071dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4087b27edca4716b8d1fd95e9ff88cc)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:00.217758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8e879-ade8-4548-a050-7ef958071dab admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:00.359230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-52e8e879-ade8-4548-a050-7ef958071dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4087b27edca4716b8d1fd95e9ff88cc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:00.360132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-52e8e879-ade8-4548-a050-7ef958071dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4087b27edca4716b8d1fd95e9ff88cc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:00.386855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-52e8e879-ade8-4548-a050-7ef958071dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4087b27edca4716b8d1fd95e9ff88cc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:00.388414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-52e8e879-ade8-4548-a050-7ef958071dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4087b27edca4716b8d1fd95e9ff88cc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:00.400509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-52e8e879-ade8-4548-a050-7ef958071dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4087b27edca4716b8d1fd95e9ff88cc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:00.421698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74c58c-6d9e-4384-a271-3912fbbe421e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:00.424239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6b74c58c-6d9e-4384-a271-3912fbbe421e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:00.450202 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2382/4735] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:46:59 2022] DELETE /identity/v3/users/d4087b27edca4716b8d1fd95e9ff88cc => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:00.455316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d029-6340-40d5-beb6-027049f8546e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.455775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d029-6340-40d5-beb6-027049f8546e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.456208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d029-6340-40d5-beb6-027049f8546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.458630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74c58c-6d9e-4384-a271-3912fbbe421e tempest-EndPointGroupsTest-1080375031 tempest-EndPointGroupsTest-1080375031-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:00.491494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:00.507572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2219d029-6340-40d5-beb6-027049f8546e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:00.516262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2219d029-6340-40d5-beb6-027049f8546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:00.643216 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2383/4736] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:00.659677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847855f9-8357-4de7-a5dc-d34e9dedac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:00.660598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847855f9-8357-4de7-a5dc-d34e9dedac42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.660917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847855f9-8357-4de7-a5dc-d34e9dedac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.661198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847855f9-8357-4de7-a5dc-d34e9dedac42 admin admin] PATH_INFO: `/v3/users/35fe2ed2bcd144a98496f558309bdffa` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:00.666342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847855f9-8357-4de7-a5dc-d34e9dedac42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35fe2ed2bcd144a98496f558309bdffa)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:00.668624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847855f9-8357-4de7-a5dc-d34e9dedac42 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:00.721864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219d029-6340-40d5-beb6-027049f8546e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:00.724690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2219d029-6340-40d5-beb6-027049f8546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:00.824001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-847855f9-8357-4de7-a5dc-d34e9dedac42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35fe2ed2bcd144a98496f558309bdffa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:00.824880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-847855f9-8357-4de7-a5dc-d34e9dedac42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35fe2ed2bcd144a98496f558309bdffa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:00.866169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:00.866291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-847855f9-8357-4de7-a5dc-d34e9dedac42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35fe2ed2bcd144a98496f558309bdffa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:00.881818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-847855f9-8357-4de7-a5dc-d34e9dedac42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35fe2ed2bcd144a98496f558309bdffa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:00.902693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-847855f9-8357-4de7-a5dc-d34e9dedac42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35fe2ed2bcd144a98496f558309bdffa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:00.949038 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2354/4737] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:00 2022] DELETE /identity/v3/users/35fe2ed2bcd144a98496f558309bdffa => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:00.951019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915610a-cb3d-436b-beb5-50c8862e2cda None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:00.951019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915610a-cb3d-436b-beb5-50c8862e2cda None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:00.956366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915610a-cb3d-436b-beb5-50c8862e2cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:01.018476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219d029-6340-40d5-beb6-027049f8546e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:01.091687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7915610a-cb3d-436b-beb5-50c8862e2cda None None] MFA Rules not processed for user `dc8f7bc05b984ea0a3d96aea8a65d139`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:01.092939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7915610a-cb3d-436b-beb5-50c8862e2cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:01.203085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafed188-7682-473a-b233-50927f30184d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:01.203895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafed188-7682-473a-b233-50927f30184d service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:01.203895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafed188-7682-473a-b233-50927f30184d service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:01.203895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafed188-7682-473a-b233-50927f30184d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:01.213757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fafed188-7682-473a-b233-50927f30184d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:01.326893 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2355/4738] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:01.338909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4671e93-61cd-49a3-9dfb-16ccc69e651e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:01.339196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4671e93-61cd-49a3-9dfb-16ccc69e651e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:01.339478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4671e93-61cd-49a3-9dfb-16ccc69e651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:01.412101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f4671e93-61cd-49a3-9dfb-16ccc69e651e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:01.418954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f4671e93-61cd-49a3-9dfb-16ccc69e651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:01.447464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafed188-7682-473a-b233-50927f30184d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:01.449733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafed188-7682-473a-b233-50927f30184d service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:01.456040 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2356/4739] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:01.459192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4671e93-61cd-49a3-9dfb-16ccc69e651e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:01.463975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f4671e93-61cd-49a3-9dfb-16ccc69e651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:01.482732 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2384/4740] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:01.496478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:01.614734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafed188-7682-473a-b233-50927f30184d service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:01.617372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fafed188-7682-473a-b233-50927f30184d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:01.652964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafed188-7682-473a-b233-50927f30184d service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:01.666442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc09f6-805f-4302-ac82-5cb3f39df910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:01.667092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc09f6-805f-4302-ac82-5cb3f39df910 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:01.667354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc09f6-805f-4302-ac82-5cb3f39df910 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:01.667912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc09f6-805f-4302-ac82-5cb3f39df910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:01.690508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc09f6-805f-4302-ac82-5cb3f39df910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:01.691971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc09f6-805f-4302-ac82-5cb3f39df910 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:01.702122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4671e93-61cd-49a3-9dfb-16ccc69e651e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:01.715479 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2385/4741] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:01.716191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ab07c-55d4-4196-838e-dc0c5a2ff013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:01.717532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ab07c-55d4-4196-838e-dc0c5a2ff013 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:01.717819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ab07c-55d4-4196-838e-dc0c5a2ff013 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:01.718103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ab07c-55d4-4196-838e-dc0c5a2ff013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:01.729528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ab07c-55d4-4196-838e-dc0c5a2ff013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:01.731255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ab07c-55d4-4196-838e-dc0c5a2ff013 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:01.743389 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2357/4742] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:02.799420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc09f6-805f-4302-ac82-5cb3f39df910 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:02.801506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7fdc09f6-805f-4302-ac82-5cb3f39df910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:02.839193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc09f6-805f-4302-ac82-5cb3f39df910 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:02.859985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:02.863430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:02.866656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:02.866808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] PATH_INFO: `/v3/projects/916d53803c3f42d9a1701efc5b7557dc` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:02.874580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916d53803c3f42d9a1701efc5b7557dc)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:02.884056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:02.992384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916d53803c3f42d9a1701efc5b7557dc', 'request_id': 'req-1013db7f-da8b-42f0-9ab5-41a128944091'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.012236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916d53803c3f42d9a1701efc5b7557dc', 'request_id': 'req-1013db7f-da8b-42f0-9ab5-41a128944091'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.032021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916d53803c3f42d9a1701efc5b7557dc', 'request_id': 'req-1013db7f-da8b-42f0-9ab5-41a128944091'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.043449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:03.059757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] The token cache is being invalidate because project 916d53803c3f42d9a1701efc5b7557dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:03.060154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.062881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.066736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ab07c-55d4-4196-838e-dc0c5a2ff013 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:03.068306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bc5ab07c-55d4-4196-838e-dc0c5a2ff013 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:03.076986 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2386/4743] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:02 2022] DELETE /identity/v3/projects/916d53803c3f42d9a1701efc5b7557dc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:03.079473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:03.086258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:03.108196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ab07c-55d4-4196-838e-dc0c5a2ff013 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:03.360159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:03.363508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013db7f-da8b-42f0-9ab5-41a128944091 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:03.364441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:03.364967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:03.365679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] PATH_INFO: `/v3/projects/94a1cd3e65f14f16ba1718eecacecc5d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:03.368678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a1cd3e65f14f16ba1718eecacecc5d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:03.371301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:03.381084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:03.382158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:03.382549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:03.382926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] PATH_INFO: `/v3/users/1eac9c9ce0cf4c55803cd55f47fcb37c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:03.385285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eac9c9ce0cf4c55803cd55f47fcb37c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:03.387401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:03.510845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a1cd3e65f14f16ba1718eecacecc5d', 'request_id': 'req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.522011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eac9c9ce0cf4c55803cd55f47fcb37c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.524993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eac9c9ce0cf4c55803cd55f47fcb37c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.538494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a1cd3e65f14f16ba1718eecacecc5d', 'request_id': 'req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.565295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a1cd3e65f14f16ba1718eecacecc5d', 'request_id': 'req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.580854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eac9c9ce0cf4c55803cd55f47fcb37c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.583038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eac9c9ce0cf4c55803cd55f47fcb37c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.603272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eac9c9ce0cf4c55803cd55f47fcb37c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.609452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] The token cache is being invalidate because project 94a1cd3e65f14f16ba1718eecacecc5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:03.609764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.610444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:03.614882 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2358/4744] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:03 2022] DELETE /identity/v3/projects/94a1cd3e65f14f16ba1718eecacecc5d => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:03.616704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:03.621842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:03.642739 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2387/4745] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:03 2022] DELETE /identity/v3/users/1eac9c9ce0cf4c55803cd55f47fcb37c => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:03.795351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:03.911807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f6c6d-8e1b-40df-8453-50d2ea94b9b9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:04.079711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad3e58-9063-452f-8a04-ccceea44fa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:04.080277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad3e58-9063-452f-8a04-ccceea44fa1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:04.080564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad3e58-9063-452f-8a04-ccceea44fa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:04.080842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad3e58-9063-452f-8a04-ccceea44fa1a admin admin] PATH_INFO: `/v3/users/f2715aa6d5604c86a2c938e17ee03860` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:04.082172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad3e58-9063-452f-8a04-ccceea44fa1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2715aa6d5604c86a2c938e17ee03860)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:04.084692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad3e58-9063-452f-8a04-ccceea44fa1a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:04.190330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ddad3e58-9063-452f-8a04-ccceea44fa1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2715aa6d5604c86a2c938e17ee03860'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:04.191062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ddad3e58-9063-452f-8a04-ccceea44fa1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2715aa6d5604c86a2c938e17ee03860'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:04.221605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ddad3e58-9063-452f-8a04-ccceea44fa1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2715aa6d5604c86a2c938e17ee03860'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:04.233837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ddad3e58-9063-452f-8a04-ccceea44fa1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2715aa6d5604c86a2c938e17ee03860'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:04.250544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ddad3e58-9063-452f-8a04-ccceea44fa1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2715aa6d5604c86a2c938e17ee03860'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:04.263857 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2359/4746] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:03 2022] DELETE /identity/v3/users/f2715aa6d5604c86a2c938e17ee03860 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:04.871504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:04.874802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:04.903686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde0248-d1e9-44d0-882e-f981c2053b21 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:05.092345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:05.093216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.093793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.094183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] PATH_INFO: `/v3/projects/0bb60215a30c4b99913482d0b09c4b87` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.096383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bb60215a30c4b99913482d0b09c4b87)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:05.099231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:05.154547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:05.274133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bb60215a30c4b99913482d0b09c4b87', 'request_id': 'req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.291211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bb60215a30c4b99913482d0b09c4b87', 'request_id': 'req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.315847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bb60215a30c4b99913482d0b09c4b87', 'request_id': 'req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.346054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] The token cache is being invalidate because project 0bb60215a30c4b99913482d0b09c4b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:05.346345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.349736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cdad85b0-bc10-4fdd-9860-ba247eecaf0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:05.363817 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2388/4747] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:04 2022] DELETE /identity/v3/projects/0bb60215a30c4b99913482d0b09c4b87 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:05.365526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfabf36-b3f2-4208-854b-54ec63105757 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.367062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfabf36-b3f2-4208-854b-54ec63105757 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.367574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfabf36-b3f2-4208-854b-54ec63105757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.405829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-acfabf36-b3f2-4208-854b-54ec63105757 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:05.409839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-acfabf36-b3f2-4208-854b-54ec63105757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:05.529730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:05.559679 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2360/4748] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:05.568470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1341-cec6-4806-bf7f-a2483a5edb61 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.568588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1341-cec6-4806-bf7f-a2483a5edb61 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.568773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1341-cec6-4806-bf7f-a2483a5edb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.615912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b1fb1341-cec6-4806-bf7f-a2483a5edb61 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:05.618480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b1fb1341-cec6-4806-bf7f-a2483a5edb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:05.635317 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2389/4749] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:05.639976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfabf36-b3f2-4208-854b-54ec63105757 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:05.653971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfabf36-b3f2-4208-854b-54ec63105757 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:05.668875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e4fee-c03d-44a9-aa29-8446fd8c3daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:05.669540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4fee-c03d-44a9-aa29-8446fd8c3daa admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.669821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4fee-c03d-44a9-aa29-8446fd8c3daa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.670095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4fee-c03d-44a9-aa29-8446fd8c3daa admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.670758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e4fee-c03d-44a9-aa29-8446fd8c3daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:05.671058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e4fee-c03d-44a9-aa29-8446fd8c3daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:05.672981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e4fee-c03d-44a9-aa29-8446fd8c3daa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:05.705093 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2361/4750] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:05.709412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1341-cec6-4806-bf7f-a2483a5edb61 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:05.728146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1341-cec6-4806-bf7f-a2483a5edb61 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:05.744503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36901f27-4acf-4b45-bb8d-25149b9f4941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:05.745110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36901f27-4acf-4b45-bb8d-25149b9f4941 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.745403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36901f27-4acf-4b45-bb8d-25149b9f4941 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.745682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36901f27-4acf-4b45-bb8d-25149b9f4941 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.746327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36901f27-4acf-4b45-bb8d-25149b9f4941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:05.748258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36901f27-4acf-4b45-bb8d-25149b9f4941 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:05.805000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e4fee-c03d-44a9-aa29-8446fd8c3daa admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:05.811595 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2390/4751] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:05 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:05.819755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e4fee-c03d-44a9-aa29-8446fd8c3daa admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:05.961573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3702fad-b325-4af4-8ba9-af88dc254416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:05.962184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702fad-b325-4af4-8ba9-af88dc254416 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:05.962459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702fad-b325-4af4-8ba9-af88dc254416 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:05.962731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702fad-b325-4af4-8ba9-af88dc254416 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:05.963373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3702fad-b325-4af4-8ba9-af88dc254416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:05.965318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3702fad-b325-4af4-8ba9-af88dc254416 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:06.013064 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2362/4752] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:05 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:06.017985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36901f27-4acf-4b45-bb8d-25149b9f4941 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:06.030480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36901f27-4acf-4b45-bb8d-25149b9f4941 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:06.051122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddab222-ed66-4593-b4a2-0b0d470072b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:06.051840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddab222-ed66-4593-b4a2-0b0d470072b6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:06.052037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddab222-ed66-4593-b4a2-0b0d470072b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:06.052282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddab222-ed66-4593-b4a2-0b0d470072b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:06.053017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddab222-ed66-4593-b4a2-0b0d470072b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:06.055112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddab222-ed66-4593-b4a2-0b0d470072b6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:06.086079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3702fad-b325-4af4-8ba9-af88dc254416 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:06.097265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3702fad-b325-4af4-8ba9-af88dc254416 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:06.098014 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2391/4753] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:06.115786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b83657-0920-46c9-8f75-7df8e3701b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:06.117132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b83657-0920-46c9-8f75-7df8e3701b28 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:06.117435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b83657-0920-46c9-8f75-7df8e3701b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:06.117729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b83657-0920-46c9-8f75-7df8e3701b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:06.118376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b83657-0920-46c9-8f75-7df8e3701b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:06.119997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b83657-0920-46c9-8f75-7df8e3701b28 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:06.152253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddab222-ed66-4593-b4a2-0b0d470072b6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:06.163588 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2363/4754] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:47:06.168224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddab222-ed66-4593-b4a2-0b0d470072b6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:06.175293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7fad0-fe86-4bb1-b68d-b4920bc2a6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:06.175982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fad0-fe86-4bb1-b68d-b4920bc2a6db admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:06.176259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fad0-fe86-4bb1-b68d-b4920bc2a6db admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:06.176533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fad0-fe86-4bb1-b68d-b4920bc2a6db admin admin] PATH_INFO: `/v3/projects/f88a4d6fd86047e6987815072c70473c/users/2d7c6d992c064c2e801afdb0e478c32f/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:06.194887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7fad0-fe86-4bb1-b68d-b4920bc2a6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f88a4d6fd86047e6987815072c70473c, user_id=2d7c6d992c064c2e801afdb0e478c32f, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:06.197849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7fad0-fe86-4bb1-b68d-b4920bc2a6db admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:06.231657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3622e-35cd-4f00-b71e-f7e6c9e673bb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:06.231992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3622e-35cd-4f00-b71e-f7e6c9e673bb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:06.232209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3622e-35cd-4f00-b71e-f7e6c9e673bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:06.234947 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2392/4755] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:06 2022] PUT /identity/v3/projects/f88a4d6fd86047e6987815072c70473c/users/2d7c6d992c064c2e801afdb0e478c32f/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:06.296423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2ac3622e-35cd-4f00-b71e-f7e6c9e673bb None None] MFA Rules not processed for user `2d7c6d992c064c2e801afdb0e478c32f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:06.299588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2ac3622e-35cd-4f00-b71e-f7e6c9e673bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:06.491808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7fad0-fe86-4bb1-b68d-b4920bc2a6db admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:06.494550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-02d7fad0-fe86-4bb1-b68d-b4920bc2a6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:06.498687 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2364/4756] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:06.570488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3622e-35cd-4f00-b71e-f7e6c9e673bb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:06.572677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2ac3622e-35cd-4f00-b71e-f7e6c9e673bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:06.691295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7fad0-fe86-4bb1-b68d-b4920bc2a6db admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:06.710569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735122a-f0d3-455a-a745-f3c112edddd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:06.711248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735122a-f0d3-455a-a745-f3c112edddd0 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:06.711532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735122a-f0d3-455a-a745-f3c112edddd0 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:06.711809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735122a-f0d3-455a-a745-f3c112edddd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:06.730928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:06.731359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735122a-f0d3-455a-a745-f3c112edddd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:06.733951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735122a-f0d3-455a-a745-f3c112edddd0 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:06.761997 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2393/4757] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:06.774189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3622e-35cd-4f00-b71e-f7e6c9e673bb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:06.780554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:06.781236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:06.781713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:06.782001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] PATH_INFO: `/v3/projects/e613ff2ac7ae46fe9e644f7bc3efafb3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:06.784362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e613ff2ac7ae46fe9e644f7bc3efafb3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:06.786394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:06.965613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'request_id': 'req-35930bc2-9a13-4d96-bfed-370460b8c12a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:06.982266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'request_id': 'req-35930bc2-9a13-4d96-bfed-370460b8c12a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:07.000638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e613ff2ac7ae46fe9e644f7bc3efafb3', 'request_id': 'req-35930bc2-9a13-4d96-bfed-370460b8c12a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:07.083066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] The token cache is being invalidate because project e613ff2ac7ae46fe9e644f7bc3efafb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:07.083066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:07.086190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-35930bc2-9a13-4d96-bfed-370460b8c12a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:07.100805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822265b7-3122-4b9a-badf-946b47eca46a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:07.101350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822265b7-3122-4b9a-badf-946b47eca46a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:07.101484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822265b7-3122-4b9a-badf-946b47eca46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:07.104407 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2365/4758] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:06 2022] DELETE /identity/v3/projects/e613ff2ac7ae46fe9e644f7bc3efafb3 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:07.154833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-822265b7-3122-4b9a-badf-946b47eca46a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:07.160280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-822265b7-3122-4b9a-badf-946b47eca46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:07.204227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f0ed-1973-4404-8d79-ade3796ee8dd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:07.204517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f0ed-1973-4404-8d79-ade3796ee8dd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:07.204823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f0ed-1973-4404-8d79-ade3796ee8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:07.227299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:07.276930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5898f0ed-1973-4404-8d79-ade3796ee8dd None None] MFA Rules not processed for user `dc8f7bc05b984ea0a3d96aea8a65d139`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:07.282088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5898f0ed-1973-4404-8d79-ade3796ee8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:07.326436 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2394/4759] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:07.334781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8345d24-6dcf-4c28-9cd1-6077737bc2bf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:07.335152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8345d24-6dcf-4c28-9cd1-6077737bc2bf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:07.335598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8345d24-6dcf-4c28-9cd1-6077737bc2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:07.358972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f8345d24-6dcf-4c28-9cd1-6077737bc2bf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:07.360211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f8345d24-6dcf-4c28-9cd1-6077737bc2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:07.376841 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2395/4760] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:07.379245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8345d24-6dcf-4c28-9cd1-6077737bc2bf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:07.396220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8345d24-6dcf-4c28-9cd1-6077737bc2bf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:07.410731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260e4cf-c447-4d99-b681-8db2ca840c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:07.425489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e4cf-c447-4d99-b681-8db2ca840c83 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:07.426151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e4cf-c447-4d99-b681-8db2ca840c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:07.426544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e4cf-c447-4d99-b681-8db2ca840c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:07.427513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260e4cf-c447-4d99-b681-8db2ca840c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:07.427919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260e4cf-c447-4d99-b681-8db2ca840c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:07.430414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260e4cf-c447-4d99-b681-8db2ca840c83 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:07.481061 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2396/4761] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:07.483711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260e4cf-c447-4d99-b681-8db2ca840c83 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:07.507943 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2366/4762] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:07.526244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260e4cf-c447-4d99-b681-8db2ca840c83 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:07.542297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f0e5f-fed8-4c22-8713-516cdabce66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:07.543985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f0e5f-fed8-4c22-8713-516cdabce66e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:07.544495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f0e5f-fed8-4c22-8713-516cdabce66e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:07.545001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f0e5f-fed8-4c22-8713-516cdabce66e admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:07.546227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f0e5f-fed8-4c22-8713-516cdabce66e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:07.549289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f0e5f-fed8-4c22-8713-516cdabce66e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:07.661807 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2397/4763] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:07 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:07.663221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898f0ed-1973-4404-8d79-ade3796ee8dd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:07.677465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898f0ed-1973-4404-8d79-ade3796ee8dd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:07.814610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dc3e5-85cc-43dd-bd34-7d459128d1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:07.815504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dc3e5-85cc-43dd-bd34-7d459128d1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:07.815950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dc3e5-85cc-43dd-bd34-7d459128d1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:07.816385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dc3e5-85cc-43dd-bd34-7d459128d1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:07.817232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dc3e5-85cc-43dd-bd34-7d459128d1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:07.819990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dc3e5-85cc-43dd-bd34-7d459128d1c2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:07.887760 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2367/4764] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:07 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:07.887989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f0e5f-fed8-4c22-8713-516cdabce66e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:07.931593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f0e5f-fed8-4c22-8713-516cdabce66e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:07.939461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054d9ec-d42a-4f60-b109-6013733229e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:07.940215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054d9ec-d42a-4f60-b109-6013733229e3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:07.940556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054d9ec-d42a-4f60-b109-6013733229e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:07.941108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054d9ec-d42a-4f60-b109-6013733229e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:07.941973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054d9ec-d42a-4f60-b109-6013733229e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:07.945041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054d9ec-d42a-4f60-b109-6013733229e3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:07.966071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dc3e5-85cc-43dd-bd34-7d459128d1c2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:07.973608 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2398/4765] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:07.990348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dc3e5-85cc-43dd-bd34-7d459128d1c2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:08.000943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aa769-1299-46e4-899b-b8d74219664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:08.000943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aa769-1299-46e4-899b-b8d74219664a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:08.000943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aa769-1299-46e4-899b-b8d74219664a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:08.000943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aa769-1299-46e4-899b-b8d74219664a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:08.001480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aa769-1299-46e4-899b-b8d74219664a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:08.001480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aa769-1299-46e4-899b-b8d74219664a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:08.023252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054d9ec-d42a-4f60-b109-6013733229e3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:08.049008 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2368/4766] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:08.054555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054d9ec-d42a-4f60-b109-6013733229e3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:08.063257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06e54-d208-403f-9387-5fddad5d5235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:08.064182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e54-d208-403f-9387-5fddad5d5235 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:08.065211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e54-d208-403f-9387-5fddad5d5235 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:08.065528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e54-d208-403f-9387-5fddad5d5235 admin admin] PATH_INFO: `/v3/projects/e31c8467bbe04544829c486cc0421016/users/2bc7af59d6d04867a43d12eb76d535a7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:08.109271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06e54-d208-403f-9387-5fddad5d5235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31c8467bbe04544829c486cc0421016, user_id=2bc7af59d6d04867a43d12eb76d535a7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:08.116694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06e54-d208-403f-9387-5fddad5d5235 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:08.141781 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2399/4767] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:08 2022] PUT /identity/v3/projects/e31c8467bbe04544829c486cc0421016/users/2bc7af59d6d04867a43d12eb76d535a7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:08.154671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185240c8-ca23-4011-add0-23852a6680b1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:08.155980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185240c8-ca23-4011-add0-23852a6680b1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:08.156278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185240c8-ca23-4011-add0-23852a6680b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:08.166054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:08.200767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-185240c8-ca23-4011-add0-23852a6680b1 None None] MFA Rules not processed for user `2bc7af59d6d04867a43d12eb76d535a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:08.202123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-185240c8-ca23-4011-add0-23852a6680b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:08.372623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06e54-d208-403f-9387-5fddad5d5235 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:08.374782 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2369/4768] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:08.401272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185240c8-ca23-4011-add0-23852a6680b1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:08.402039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-185240c8-ca23-4011-add0-23852a6680b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:08.562834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06e54-d208-403f-9387-5fddad5d5235 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:08.578545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1e4e-0586-4037-888a-e4cb453e9945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:08.578545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1e4e-0586-4037-888a-e4cb453e9945 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:08.578545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1e4e-0586-4037-888a-e4cb453e9945 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:08.579030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1e4e-0586-4037-888a-e4cb453e9945 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:08.579723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b1e4e-0586-4037-888a-e4cb453e9945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:08.581759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b1e4e-0586-4037-888a-e4cb453e9945 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:08.595311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185240c8-ca23-4011-add0-23852a6680b1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:08.607957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faddf07-491d-4780-82ea-72a6347f941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:08.608716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faddf07-491d-4780-82ea-72a6347f941f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:08.609087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faddf07-491d-4780-82ea-72a6347f941f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:08.609454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faddf07-491d-4780-82ea-72a6347f941f admin admin] PATH_INFO: `/v3/users/2d7c6d992c064c2e801afdb0e478c32f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:08.610888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faddf07-491d-4780-82ea-72a6347f941f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7c6d992c064c2e801afdb0e478c32f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:08.612917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faddf07-491d-4780-82ea-72a6347f941f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:08.641114 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2400/4769] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:08 2022] POST /identity/v3/projects => generated 369 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:08.645987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1e4e-0586-4037-888a-e4cb453e9945 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:08.719220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9faddf07-491d-4780-82ea-72a6347f941f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7c6d992c064c2e801afdb0e478c32f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:08.721550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9faddf07-491d-4780-82ea-72a6347f941f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7c6d992c064c2e801afdb0e478c32f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:08.768759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9faddf07-491d-4780-82ea-72a6347f941f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7c6d992c064c2e801afdb0e478c32f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:08.783580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9faddf07-491d-4780-82ea-72a6347f941f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7c6d992c064c2e801afdb0e478c32f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:08.783906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:08.804644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9faddf07-491d-4780-82ea-72a6347f941f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7c6d992c064c2e801afdb0e478c32f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:08.819838 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2370/4770] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:08 2022] DELETE /identity/v3/users/2d7c6d992c064c2e801afdb0e478c32f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:08.824381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2b54c-128b-4636-94a3-2dbb17a9d1f7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:08.829622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2b54c-128b-4636-94a3-2dbb17a9d1f7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:08.830033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2b54c-128b-4636-94a3-2dbb17a9d1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:08.838760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1e4e-0586-4037-888a-e4cb453e9945 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:08.914109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5ca2b54c-128b-4636-94a3-2dbb17a9d1f7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:08.920103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5ca2b54c-128b-4636-94a3-2dbb17a9d1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:08.931590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:09.010110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfd59d-c455-4a1b-8e45-5fcce98599fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:09.010798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfd59d-c455-4a1b-8e45-5fcce98599fb admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.011083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfd59d-c455-4a1b-8e45-5fcce98599fb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.011356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfd59d-c455-4a1b-8e45-5fcce98599fb admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.011996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfd59d-c455-4a1b-8e45-5fcce98599fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:09.014603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfd59d-c455-4a1b-8e45-5fcce98599fb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:09.060082 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2401/4771] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:08 2022] POST /identity/v3/users => generated 291 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:09.064280 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2371/4772] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:09.065431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfd59d-c455-4a1b-8e45-5fcce98599fb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:09.075611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2b54c-128b-4636-94a3-2dbb17a9d1f7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:09.077673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5ca2b54c-128b-4636-94a3-2dbb17a9d1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:09.079789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-53bfd59d-c455-4a1b-8e45-5fcce98599fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:09.104714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfd59d-c455-4a1b-8e45-5fcce98599fb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:09.116792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cde8c-7715-4a29-9302-be3ce95993c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:09.119575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cde8c-7715-4a29-9302-be3ce95993c0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.119883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cde8c-7715-4a29-9302-be3ce95993c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.120164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cde8c-7715-4a29-9302-be3ce95993c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.120830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cde8c-7715-4a29-9302-be3ce95993c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:09.122475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cde8c-7715-4a29-9302-be3ce95993c0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:09.149729 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2402/4773] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:09.154901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cde8c-7715-4a29-9302-be3ce95993c0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:09.179845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cde8c-7715-4a29-9302-be3ce95993c0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:09.192013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bf27e-d747-4b78-acfe-448e3eb32b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:09.193727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf27e-d747-4b78-acfe-448e3eb32b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.194058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf27e-d747-4b78-acfe-448e3eb32b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.194339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf27e-d747-4b78-acfe-448e3eb32b9e admin admin] PATH_INFO: `/v3/projects/fcee167db48246fc9cb44ed636d43055/users/58c187d319e24398a5fa8bce4287e0a3/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.226155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2b54c-128b-4636-94a3-2dbb17a9d1f7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:09.235267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef681bf-9321-47c5-b731-e95ab3eae0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:09.236210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef681bf-9321-47c5-b731-e95ab3eae0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.236971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bf27e-d747-4b78-acfe-448e3eb32b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcee167db48246fc9cb44ed636d43055, user_id=58c187d319e24398a5fa8bce4287e0a3, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:09.239855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef681bf-9321-47c5-b731-e95ab3eae0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.240221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef681bf-9321-47c5-b731-e95ab3eae0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.242700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bf27e-d747-4b78-acfe-448e3eb32b9e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:09.258654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef681bf-9321-47c5-b731-e95ab3eae0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:09.260405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef681bf-9321-47c5-b731-e95ab3eae0e0 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:09.266432 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2403/4774] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:09 2022] PUT /identity/v3/projects/fcee167db48246fc9cb44ed636d43055/users/58c187d319e24398a5fa8bce4287e0a3/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:09.271590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bf27e-d747-4b78-acfe-448e3eb32b9e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:09.290009 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2372/4775] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:09.467632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bf27e-d747-4b78-acfe-448e3eb32b9e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:09.496150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d4ebe-a24f-4c20-b1d2-a504284ee230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:09.496798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4ebe-a24f-4c20-b1d2-a504284ee230 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.497085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4ebe-a24f-4c20-b1d2-a504284ee230 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.497363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4ebe-a24f-4c20-b1d2-a504284ee230 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.498057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d4ebe-a24f-4c20-b1d2-a504284ee230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:09.499712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d4ebe-a24f-4c20-b1d2-a504284ee230 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:09.514655 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2404/4776] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:47:09.518922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef681bf-9321-47c5-b731-e95ab3eae0e0 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:09.530651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef681bf-9321-47c5-b731-e95ab3eae0e0 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:09.561327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1023ad-3601-45e4-b015-9c458166ae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:09.562186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1023ad-3601-45e4-b015-9c458166ae69 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.563634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1023ad-3601-45e4-b015-9c458166ae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.563934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1023ad-3601-45e4-b015-9c458166ae69 admin admin] PATH_INFO: `/v3/projects/fcee167db48246fc9cb44ed636d43055/users/58c187d319e24398a5fa8bce4287e0a3/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.575448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1023ad-3601-45e4-b015-9c458166ae69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcee167db48246fc9cb44ed636d43055, user_id=58c187d319e24398a5fa8bce4287e0a3, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:09.578547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1023ad-3601-45e4-b015-9c458166ae69 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:09.606996 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2373/4777] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:09 2022] PUT /identity/v3/projects/fcee167db48246fc9cb44ed636d43055/users/58c187d319e24398a5fa8bce4287e0a3/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:09.620889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e092c-655b-4825-a208-08ba89a6c15d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.621291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e092c-655b-4825-a208-08ba89a6c15d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.621627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e092c-655b-4825-a208-08ba89a6c15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.716947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8c9e092c-655b-4825-a208-08ba89a6c15d None None] MFA Rules not processed for user `58c187d319e24398a5fa8bce4287e0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:09.722018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8c9e092c-655b-4825-a208-08ba89a6c15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:09.869296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:09.956691 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2405/4778] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:09.961322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1023ad-3601-45e4-b015-9c458166ae69 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:09.987123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1023ad-3601-45e4-b015-9c458166ae69 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:09.993176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08b8cb-34b3-44b5-bc9d-fa2495862216 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:09.997179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08b8cb-34b3-44b5-bc9d-fa2495862216 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:09.997550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08b8cb-34b3-44b5-bc9d-fa2495862216 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:09.997837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08b8cb-34b3-44b5-bc9d-fa2495862216 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:09.998555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08b8cb-34b3-44b5-bc9d-fa2495862216 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.000204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08b8cb-34b3-44b5-bc9d-fa2495862216 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.046774 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2374/4779] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:09 2022] POST /identity/v3/services => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:10.051269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e092c-655b-4825-a208-08ba89a6c15d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.065906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e092c-655b-4825-a208-08ba89a6c15d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.102915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72319e77-347f-4637-b259-bce9492b1179 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.103537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72319e77-347f-4637-b259-bce9492b1179 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.103817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72319e77-347f-4637-b259-bce9492b1179 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.104097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72319e77-347f-4637-b259-bce9492b1179 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.104873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72319e77-347f-4637-b259-bce9492b1179 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.106137 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-72319e77-347f-4637-b259-bce9492b1179 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:10.106137 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:10.106137 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:10.107199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72319e77-347f-4637-b259-bce9492b1179 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.152625 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-72319e77-347f-4637-b259-bce9492b1179 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1241967841. To ensure interoperability, identifiers should be a valid uuid. Aug 29 15:47:10.152625 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 15:47:10.152625 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:10.220851 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2406/4780] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:47:10 2022] POST /identity/v3/endpoints => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:10.227116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08b8cb-34b3-44b5-bc9d-fa2495862216 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.246637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08b8cb-34b3-44b5-bc9d-fa2495862216 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.270728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcf423-fafd-4bcf-90f6-9ab0b22b8b17 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.271479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcf423-fafd-4bcf-90f6-9ab0b22b8b17 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.271772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcf423-fafd-4bcf-90f6-9ab0b22b8b17 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.272088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcf423-fafd-4bcf-90f6-9ab0b22b8b17 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/regions/tempest-region-1241967841` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.272697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcf423-fafd-4bcf-90f6-9ab0b22b8b17 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1241967841)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.275620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcf423-fafd-4bcf-90f6-9ab0b22b8b17 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.278901 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2375/4781] 10.222.0.16 () {58 vars in 1206 bytes} [Mon Aug 29 15:47:10 2022] GET /identity/v3/regions/tempest-region-1241967841 => generated 180 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:10.282728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72319e77-347f-4637-b259-bce9492b1179 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.301666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72319e77-347f-4637-b259-bce9492b1179 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.318328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece00fe-e77c-4f45-8c17-d2c5abe3d4ab tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.321527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece00fe-e77c-4f45-8c17-d2c5abe3d4ab tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.321824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece00fe-e77c-4f45-8c17-d2c5abe3d4ab tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.323358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece00fe-e77c-4f45-8c17-d2c5abe3d4ab tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.324576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece00fe-e77c-4f45-8c17-d2c5abe3d4ab tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.330508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece00fe-e77c-4f45-8c17-d2c5abe3d4ab tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.370156 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2407/4782] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:10 2022] POST /identity/v3/services => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:10.374282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcf423-fafd-4bcf-90f6-9ab0b22b8b17 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.390216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcf423-fafd-4bcf-90f6-9ab0b22b8b17 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.439530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6649f-64b6-46ac-a624-421df9c321e7 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.439530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6649f-64b6-46ac-a624-421df9c321e7 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.439530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6649f-64b6-46ac-a624-421df9c321e7 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.439855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6649f-64b6-46ac-a624-421df9c321e7 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.441436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6649f-64b6-46ac-a624-421df9c321e7 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.445298 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-09e6649f-64b6-46ac-a624-421df9c321e7 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:10.445298 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:10.445298 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:10.446721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6649f-64b6-46ac-a624-421df9c321e7 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.503379 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-09e6649f-64b6-46ac-a624-421df9c321e7 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1082259326. To ensure interoperability, identifiers should be a valid uuid. Aug 29 15:47:10.503379 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 15:47:10.503379 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:10.584021 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2376/4783] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:47:10 2022] POST /identity/v3/endpoints => generated 362 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:10.586859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece00fe-e77c-4f45-8c17-d2c5abe3d4ab tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.602743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece00fe-e77c-4f45-8c17-d2c5abe3d4ab tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.642817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a95d3f-cc2e-45b9-ab84-b8e7279f637e tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.643476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95d3f-cc2e-45b9-ab84-b8e7279f637e tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.643761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95d3f-cc2e-45b9-ab84-b8e7279f637e tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.644334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95d3f-cc2e-45b9-ab84-b8e7279f637e tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/regions/tempest-region-1082259326` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.644629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a95d3f-cc2e-45b9-ab84-b8e7279f637e tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1082259326)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.645743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a95d3f-cc2e-45b9-ab84-b8e7279f637e tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.652422 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2408/4784] 10.222.0.16 () {58 vars in 1206 bytes} [Mon Aug 29 15:47:10 2022] GET /identity/v3/regions/tempest-region-1082259326 => generated 180 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:10.654339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6649f-64b6-46ac-a624-421df9c321e7 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.675963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6649f-64b6-46ac-a624-421df9c321e7 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.702009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c3199-8d0c-4bc1-97dc-b0f125105845 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.704149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3199-8d0c-4bc1-97dc-b0f125105845 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.704585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3199-8d0c-4bc1-97dc-b0f125105845 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.705699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3199-8d0c-4bc1-97dc-b0f125105845 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.706607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c3199-8d0c-4bc1-97dc-b0f125105845 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.714420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c3199-8d0c-4bc1-97dc-b0f125105845 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.766171 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-d93c3199-8d0c-4bc1-97dc-b0f125105845 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-518102173. To ensure interoperability, identifiers should be a valid uuid. Aug 29 15:47:10.766171 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 15:47:10.766171 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:10.785188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:10.833443 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2377/4785] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:47:10 2022] POST /identity/v3/endpoints => generated 358 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:10.836608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a95d3f-cc2e-45b9-ab84-b8e7279f637e tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.848046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a95d3f-cc2e-45b9-ab84-b8e7279f637e tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.890629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4594f4-2241-4a8c-a970-8d0c296325bb tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.893207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4594f4-2241-4a8c-a970-8d0c296325bb tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.894299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4594f4-2241-4a8c-a970-8d0c296325bb tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.895097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4594f4-2241-4a8c-a970-8d0c296325bb tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/regions/tempest-region-518102173` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.897345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4594f4-2241-4a8c-a970-8d0c296325bb tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-518102173)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.898686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4594f4-2241-4a8c-a970-8d0c296325bb tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.908407 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2409/4786] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Aug 29 15:47:10 2022] GET /identity/v3/regions/tempest-region-518102173 => generated 178 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:10.909956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c3199-8d0c-4bc1-97dc-b0f125105845 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.943591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4594f4-2241-4a8c-a970-8d0c296325bb tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:10.950249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5d4594f4-2241-4a8c-a970-8d0c296325bb tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:10.955190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c3199-8d0c-4bc1-97dc-b0f125105845 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:10.962096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4902b-7ab5-486f-b4a9-56be72c87078 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:10.963117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4902b-7ab5-486f-b4a9-56be72c87078 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:10.963117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4902b-7ab5-486f-b4a9-56be72c87078 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:10.963339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4902b-7ab5-486f-b4a9-56be72c87078 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:10.965097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4902b-7ab5-486f-b4a9-56be72c87078 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:10.966668 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-bdc4902b-7ab5-486f-b4a9-56be72c87078 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:10.966668 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:10.966668 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:10.968898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4902b-7ab5-486f-b4a9-56be72c87078 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:10.993538 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2378/4787] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Aug 29 15:47:10 2022] GET /identity/v3/endpoints => generated 4395 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:11.007113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4902b-7ab5-486f-b4a9-56be72c87078 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.041105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4902b-7ab5-486f-b4a9-56be72c87078 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.049429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26f755-ae4b-4fe2-9b07-fd94706cd4d4 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.050422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26f755-ae4b-4fe2-9b07-fd94706cd4d4 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.050862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26f755-ae4b-4fe2-9b07-fd94706cd4d4 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.051844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26f755-ae4b-4fe2-9b07-fd94706cd4d4 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints/ba55aecca8f3448e94f505939bf70d1b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.066160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26f755-ae4b-4fe2-9b07-fd94706cd4d4 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=ba55aecca8f3448e94f505939bf70d1b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.067481 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-ff26f755-ae4b-4fe2-9b07-fd94706cd4d4 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:11.067481 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:11.067481 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:11.068778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26f755-ae4b-4fe2-9b07-fd94706cd4d4 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.072802 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2379/4788] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:11 2022] GET /identity/v3/endpoints/ba55aecca8f3448e94f505939bf70d1b => generated 358 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:11.082202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26f755-ae4b-4fe2-9b07-fd94706cd4d4 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.100944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26f755-ae4b-4fe2-9b07-fd94706cd4d4 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.110001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea87b0-230c-4fe5-80af-205e01314ab0 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.112462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea87b0-230c-4fe5-80af-205e01314ab0 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.112922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea87b0-230c-4fe5-80af-205e01314ab0 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.113974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea87b0-230c-4fe5-80af-205e01314ab0 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints/ba55aecca8f3448e94f505939bf70d1b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.115484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea87b0-230c-4fe5-80af-205e01314ab0 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ba55aecca8f3448e94f505939bf70d1b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.118445 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-80ea87b0-230c-4fe5-80af-205e01314ab0 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:11.118445 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:11.118445 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:11.120370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea87b0-230c-4fe5-80af-205e01314ab0 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.136303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-80ea87b0-230c-4fe5-80af-205e01314ab0 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ba55aecca8f3448e94f505939bf70d1b', 'request_id': 'req-80ea87b0-230c-4fe5-80af-205e01314ab0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:11.160746 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2380/4789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:11 2022] DELETE /identity/v3/endpoints/ba55aecca8f3448e94f505939bf70d1b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:11.167110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea87b0-230c-4fe5-80af-205e01314ab0 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.208797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea87b0-230c-4fe5-80af-205e01314ab0 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.215517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4594f4-2241-4a8c-a970-8d0c296325bb tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.217084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72b6b3-1692-40f9-9b34-007a060ba69f tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.218075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72b6b3-1692-40f9-9b34-007a060ba69f tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.218604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72b6b3-1692-40f9-9b34-007a060ba69f tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.219065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72b6b3-1692-40f9-9b34-007a060ba69f tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.220822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72b6b3-1692-40f9-9b34-007a060ba69f tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.238251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72b6b3-1692-40f9-9b34-007a060ba69f tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.256092 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2381/4790] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Aug 29 15:47:11 2022] GET /identity/v3/endpoints => generated 4050 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:11.264560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72b6b3-1692-40f9-9b34-007a060ba69f tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.266359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.267237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.267679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.268111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] PATH_INFO: `/v3/projects/f88a4d6fd86047e6987815072c70473c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.270314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f88a4d6fd86047e6987815072c70473c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.276489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.292966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72b6b3-1692-40f9-9b34-007a060ba69f tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.305575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e6a0c-b5b7-4804-91bc-659273b838e1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.306336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e6a0c-b5b7-4804-91bc-659273b838e1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.306687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e6a0c-b5b7-4804-91bc-659273b838e1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.307039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e6a0c-b5b7-4804-91bc-659273b838e1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints/ba55aecca8f3448e94f505939bf70d1b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.320735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e6a0c-b5b7-4804-91bc-659273b838e1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-584e6a0c-b5b7-4804-91bc-659273b838e1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Could not find endpoint: ba55aecca8f3448e94f505939bf70d1b.: keystone.exception.EndpointNotFound: Could not find endpoint: ba55aecca8f3448e94f505939bf70d1b. Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._iter().one() Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._only_one_row( Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:11.338806 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: ba55aecca8f3448e94f505939bf70d1b. Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:11.340199 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:47:11.341421 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: ba55aecca8f3448e94f505939bf70d1b. Aug 29 15:47:11.342632 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:11.347462 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2382/4791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:11 2022] DELETE /identity/v3/endpoints/ba55aecca8f3448e94f505939bf70d1b => generated 114 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:47:11.348543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e6a0c-b5b7-4804-91bc-659273b838e1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.350523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:11.372214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e6a0c-b5b7-4804-91bc-659273b838e1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.408140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f88a4d6fd86047e6987815072c70473c', 'request_id': 'req-d8fe404a-05fa-4ba4-b4a7-02088661ae85'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:11.432449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f88a4d6fd86047e6987815072c70473c', 'request_id': 'req-d8fe404a-05fa-4ba4-b4a7-02088661ae85'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:11.447391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f88a4d6fd86047e6987815072c70473c', 'request_id': 'req-d8fe404a-05fa-4ba4-b4a7-02088661ae85'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:11.457130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77012a8f-7b3c-4d27-ab39-4e484f94b8c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.458195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77012a8f-7b3c-4d27-ab39-4e484f94b8c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.459376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77012a8f-7b3c-4d27-ab39-4e484f94b8c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.460567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77012a8f-7b3c-4d27-ab39-4e484f94b8c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/regions/tempest-region-518102173` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.461170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77012a8f-7b3c-4d27-ab39-4e484f94b8c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-518102173)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.462780 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-77012a8f-7b3c-4d27-ab39-4e484f94b8c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:11.462780 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:11.462780 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:11.463723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77012a8f-7b3c-4d27-ab39-4e484f94b8c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.471987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] The token cache is being invalidate because project f88a4d6fd86047e6987815072c70473c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:11.472281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:11.474019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d8fe404a-05fa-4ba4-b4a7-02088661ae85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:11.481806 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2410/4792] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:10 2022] DELETE /identity/v3/projects/f88a4d6fd86047e6987815072c70473c => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:11.483541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2399eb-86d0-416e-b78e-eb7eccc532a4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.483962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2399eb-86d0-416e-b78e-eb7eccc532a4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.484289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2399eb-86d0-416e-b78e-eb7eccc532a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.524865 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2383/4793] 10.222.0.16 () {58 vars in 1206 bytes} [Mon Aug 29 15:47:11 2022] DELETE /identity/v3/regions/tempest-region-518102173 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:11.530455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77012a8f-7b3c-4d27-ab39-4e484f94b8c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.541105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-77012a8f-7b3c-4d27-ab39-4e484f94b8c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:11.549768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4b2399eb-86d0-416e-b78e-eb7eccc532a4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:11.553211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4b2399eb-86d0-416e-b78e-eb7eccc532a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:11.614070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77012a8f-7b3c-4d27-ab39-4e484f94b8c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.639432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf1ecf-7bd1-4304-ab0f-b583221c2fd3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.642251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1ecf-7bd1-4304-ab0f-b583221c2fd3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.642830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1ecf-7bd1-4304-ab0f-b583221c2fd3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.643728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1ecf-7bd1-4304-ab0f-b583221c2fd3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.644697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf1ecf-7bd1-4304-ab0f-b583221c2fd3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.646836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf1ecf-7bd1-4304-ab0f-b583221c2fd3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.660119 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2384/4794] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Aug 29 15:47:11 2022] GET /identity/v3/endpoints => generated 4050 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:11.661901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf1ecf-7bd1-4304-ab0f-b583221c2fd3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.692437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf1ecf-7bd1-4304-ab0f-b583221c2fd3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.702139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cddbd-dd68-4115-ba16-8fb83580ef6b tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.703011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cddbd-dd68-4115-ba16-8fb83580ef6b tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.703307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cddbd-dd68-4115-ba16-8fb83580ef6b tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.704368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cddbd-dd68-4115-ba16-8fb83580ef6b tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.704368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cddbd-dd68-4115-ba16-8fb83580ef6b tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Adding query filter params (service_id=43cf70d041a446cdbdac08716ffef56b) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:11.704686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cddbd-dd68-4115-ba16-8fb83580ef6b tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.707291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cddbd-dd68-4115-ba16-8fb83580ef6b tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.725754 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2385/4795] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:47:11 2022] GET /identity/v3/endpoints?service_id=43cf70d041a446cdbdac08716ffef56b => generated 503 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:11.728158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cddbd-dd68-4115-ba16-8fb83580ef6b tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.741976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cddbd-dd68-4115-ba16-8fb83580ef6b tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.747232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081ea35-6443-4327-ac4b-fc28e27af624 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.748452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081ea35-6443-4327-ac4b-fc28e27af624 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.748695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081ea35-6443-4327-ac4b-fc28e27af624 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.749039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081ea35-6443-4327-ac4b-fc28e27af624 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.749747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081ea35-6443-4327-ac4b-fc28e27af624 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Adding query filter params (service_id=80e71600b9a148548f4df4cbd8fb830e) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:11.750684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081ea35-6443-4327-ac4b-fc28e27af624 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.752727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081ea35-6443-4327-ac4b-fc28e27af624 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.765802 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2411/4796] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3871 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:11.772006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c888-79b9-45e0-8ac6-7582b63a08df None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.772311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c888-79b9-45e0-8ac6-7582b63a08df None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.772949 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2386/4797] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:47:11 2022] GET /identity/v3/endpoints?service_id=80e71600b9a148548f4df4cbd8fb830e => generated 504 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:11.773857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c888-79b9-45e0-8ac6-7582b63a08df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.778165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081ea35-6443-4327-ac4b-fc28e27af624 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.790597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081ea35-6443-4327-ac4b-fc28e27af624 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.799292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e804f-02fb-4066-ad53-1c97946d0972 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.800067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e804f-02fb-4066-ad53-1c97946d0972 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.800444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e804f-02fb-4066-ad53-1c97946d0972 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.800846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e804f-02fb-4066-ad53-1c97946d0972 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.802377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e804f-02fb-4066-ad53-1c97946d0972 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:11.802805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e804f-02fb-4066-ad53-1c97946d0972 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.805416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e804f-02fb-4066-ad53-1c97946d0972 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.817433 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2387/4798] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Aug 29 15:47:11 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:47:11.826122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e804f-02fb-4066-ad53-1c97946d0972 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.857017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e804f-02fb-4066-ad53-1c97946d0972 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.874377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0e523-8444-41a9-a1c2-7e70e4d033b1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.875594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0e523-8444-41a9-a1c2-7e70e4d033b1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.876292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0e523-8444-41a9-a1c2-7e70e4d033b1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.876689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0e523-8444-41a9-a1c2-7e70e4d033b1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.877487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0e523-8444-41a9-a1c2-7e70e4d033b1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:11.877897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0e523-8444-41a9-a1c2-7e70e4d033b1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.880768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3f84c888-79b9-45e0-8ac6-7582b63a08df None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:11.883465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0e523-8444-41a9-a1c2-7e70e4d033b1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.889424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3f84c888-79b9-45e0-8ac6-7582b63a08df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:11.908484 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2388/4799] 10.222.0.16 () {58 vars in 1171 bytes} [Mon Aug 29 15:47:11 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:11.909563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0e523-8444-41a9-a1c2-7e70e4d033b1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.931126 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2412/4800] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3871 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:11.932796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84c888-79b9-45e0-8ac6-7582b63a08df None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:11.935153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0e523-8444-41a9-a1c2-7e70e4d033b1 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.961303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84c888-79b9-45e0-8ac6-7582b63a08df None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:11.965622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e24aef-73c0-4b4d-98bd-6750307e3665 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.966586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24aef-73c0-4b4d-98bd-6750307e3665 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.967030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24aef-73c0-4b4d-98bd-6750307e3665 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.967444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24aef-73c0-4b4d-98bd-6750307e3665 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.968448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e24aef-73c0-4b4d-98bd-6750307e3665 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.970087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e24aef-73c0-4b4d-98bd-6750307e3665 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.971950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568807a-1e38-4d95-9809-751e7096ea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:11.972565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568807a-1e38-4d95-9809-751e7096ea40 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:11.972843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568807a-1e38-4d95-9809-751e7096ea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:11.980108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568807a-1e38-4d95-9809-751e7096ea40 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:11.981283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568807a-1e38-4d95-9809-751e7096ea40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:11.981644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568807a-1e38-4d95-9809-751e7096ea40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:11.983289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568807a-1e38-4d95-9809-751e7096ea40 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:11.993827 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2389/4801] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:11 2022] POST /identity/v3/services => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:12.000879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e24aef-73c0-4b4d-98bd-6750307e3665 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:12.017920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:12.033694 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2413/4802] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:12.035869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568807a-1e38-4d95-9809-751e7096ea40 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:12.055485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568807a-1e38-4d95-9809-751e7096ea40 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:12.056690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e24aef-73c0-4b4d-98bd-6750307e3665 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:12.065214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12de9-aff6-4955-868b-a9079081d5f9 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:12.070452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12de9-aff6-4955-868b-a9079081d5f9 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:12.071051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12de9-aff6-4955-868b-a9079081d5f9 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:12.071346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12de9-aff6-4955-868b-a9079081d5f9 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:12.072706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12de9-aff6-4955-868b-a9079081d5f9 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:12.074734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12de9-aff6-4955-868b-a9079081d5f9 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:12.108651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d25bd-499c-4600-8473-97106df0db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:12.109265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d25bd-499c-4600-8473-97106df0db05 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:12.109568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d25bd-499c-4600-8473-97106df0db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:12.109839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d25bd-499c-4600-8473-97106df0db05 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:12.110229 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-0ab12de9-aff6-4955-868b-a9079081d5f9 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-562708375. To ensure interoperability, identifiers should be a valid uuid. Aug 29 15:47:12.110229 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 15:47:12.110229 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:12.110529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d25bd-499c-4600-8473-97106df0db05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:12.112665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d25bd-499c-4600-8473-97106df0db05 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:12.148317 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2390/4803] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:47:11 2022] POST /identity/v3/endpoints => generated 358 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:12.151375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12de9-aff6-4955-868b-a9079081d5f9 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:12.174398 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2414/4804] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:12 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:12.176099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d25bd-499c-4600-8473-97106df0db05 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:12.240074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12de9-aff6-4955-868b-a9079081d5f9 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:12.257896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:12.277235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d25bd-499c-4600-8473-97106df0db05 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:12.326960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743a693-19e9-43fc-a97f-f5ad99e9207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:12.337462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743a693-19e9-43fc-a97f-f5ad99e9207f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:12.338141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743a693-19e9-43fc-a97f-f5ad99e9207f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:12.338633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743a693-19e9-43fc-a97f-f5ad99e9207f admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:12.339518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743a693-19e9-43fc-a97f-f5ad99e9207f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:12.341794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743a693-19e9-43fc-a97f-f5ad99e9207f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:12.379299 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2415/4805] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:12 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:12.389679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743a693-19e9-43fc-a97f-f5ad99e9207f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:12.427496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743a693-19e9-43fc-a97f-f5ad99e9207f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:12.441329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54eedb-2df0-49d3-8bbd-0620a724aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:12.442379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54eedb-2df0-49d3-8bbd-0620a724aca0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:12.444853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54eedb-2df0-49d3-8bbd-0620a724aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:12.445405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54eedb-2df0-49d3-8bbd-0620a724aca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:12.446812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54eedb-2df0-49d3-8bbd-0620a724aca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:12.451505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54eedb-2df0-49d3-8bbd-0620a724aca0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:12.474552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6720f-d6ec-4c56-b568-1ad413bb90a3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:12.477715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6720f-d6ec-4c56-b568-1ad413bb90a3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:12.481002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6720f-d6ec-4c56-b568-1ad413bb90a3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:12.481755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6720f-d6ec-4c56-b568-1ad413bb90a3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/regions/tempest-region-562708375` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:12.482835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6720f-d6ec-4c56-b568-1ad413bb90a3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-562708375)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:12.484425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6720f-d6ec-4c56-b568-1ad413bb90a3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:12.485484 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2416/4806] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:12.491436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54eedb-2df0-49d3-8bbd-0620a724aca0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:12.495395 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2391/4807] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Aug 29 15:47:12 2022] GET /identity/v3/regions/tempest-region-562708375 => generated 178 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:12.503018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6720f-d6ec-4c56-b568-1ad413bb90a3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:12.533668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54eedb-2df0-49d3-8bbd-0620a724aca0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:12.543378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6720f-d6ec-4c56-b568-1ad413bb90a3 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:12.549341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b5294-1460-4c48-8893-d81f3bb8635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:12.552319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b5294-1460-4c48-8893-d81f3bb8635a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:12.555065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b5294-1460-4c48-8893-d81f3bb8635a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:12.555994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b5294-1460-4c48-8893-d81f3bb8635a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:12.558108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b5294-1460-4c48-8893-d81f3bb8635a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:12.563320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b5134-32e3-4631-87d6-301e441a0048 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:12.564212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b5294-1460-4c48-8893-d81f3bb8635a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:12.565604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5134-32e3-4631-87d6-301e441a0048 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:12.567315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5134-32e3-4631-87d6-301e441a0048 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:12.567761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5134-32e3-4631-87d6-301e441a0048 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints/e9830f111ddf4bcbb9351477d052f4da` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:12.585754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b5134-32e3-4631-87d6-301e441a0048 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=e9830f111ddf4bcbb9351477d052f4da)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:12.587176 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-505b5134-32e3-4631-87d6-301e441a0048 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:12.587176 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:12.587176 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:12.598717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b5134-32e3-4631-87d6-301e441a0048 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:12.606875 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2417/4808] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:12.607968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b5294-1460-4c48-8893-d81f3bb8635a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:12.636977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b5294-1460-4c48-8893-d81f3bb8635a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:12.649118 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-505b5134-32e3-4631-87d6-301e441a0048 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1091446675. To ensure interoperability, identifiers should be a valid uuid. Aug 29 15:47:12.649118 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 15:47:12.649118 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:12.653053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ea543-a66c-4259-979e-72a0fa10b0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:12.655707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ea543-a66c-4259-979e-72a0fa10b0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:12.655707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ea543-a66c-4259-979e-72a0fa10b0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:12.657534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ea543-a66c-4259-979e-72a0fa10b0e0 admin admin] PATH_INFO: `/v3/projects/d8b23ecc8561440ea6e187dbfe3b03bf/users/ce41c9e6b76941ed993ded0ca4798c68/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:12.697209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ea543-a66c-4259-979e-72a0fa10b0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b23ecc8561440ea6e187dbfe3b03bf, user_id=ce41c9e6b76941ed993ded0ca4798c68, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:12.704388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ea543-a66c-4259-979e-72a0fa10b0e0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:12.742319 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2392/4809] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Aug 29 15:47:12 2022] PATCH /identity/v3/endpoints/e9830f111ddf4bcbb9351477d052f4da => generated 363 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:12.743303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b5134-32e3-4631-87d6-301e441a0048 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:12.752848 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2418/4810] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:12 2022] PUT /identity/v3/projects/d8b23ecc8561440ea6e187dbfe3b03bf/users/ce41c9e6b76941ed993ded0ca4798c68/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:12.860025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606415a-721b-490a-8a76-c35fd1a2b5e2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:12.860378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606415a-721b-490a-8a76-c35fd1a2b5e2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:12.860590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606415a-721b-490a-8a76-c35fd1a2b5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:12.873668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b5134-32e3-4631-87d6-301e441a0048 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:12.938717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a606415a-721b-490a-8a76-c35fd1a2b5e2 None None] MFA Rules not processed for user `ce41c9e6b76941ed993ded0ca4798c68`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:12.942583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a606415a-721b-490a-8a76-c35fd1a2b5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:13.148598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de15fb-2ede-46b0-b1ff-bfdf5e2247de tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:13.152806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de15fb-2ede-46b0-b1ff-bfdf5e2247de tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:13.153540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de15fb-2ede-46b0-b1ff-bfdf5e2247de tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:13.155839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de15fb-2ede-46b0-b1ff-bfdf5e2247de tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/regions/tempest-region-1091446675` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:13.157250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de15fb-2ede-46b0-b1ff-bfdf5e2247de tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1091446675)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:13.163370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de15fb-2ede-46b0-b1ff-bfdf5e2247de tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:13.176212 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2393/4811] 10.222.0.16 () {58 vars in 1206 bytes} [Mon Aug 29 15:47:12 2022] GET /identity/v3/regions/tempest-region-1091446675 => generated 180 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:13.182595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de15fb-2ede-46b0-b1ff-bfdf5e2247de tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:13.208177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:13.236358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de15fb-2ede-46b0-b1ff-bfdf5e2247de tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:13.280849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecc3f-448a-419f-9bd8-030725e92ed6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:13.282380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecc3f-448a-419f-9bd8-030725e92ed6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:13.282863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecc3f-448a-419f-9bd8-030725e92ed6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:13.283643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecc3f-448a-419f-9bd8-030725e92ed6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints/e9830f111ddf4bcbb9351477d052f4da` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:13.307874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ecc3f-448a-419f-9bd8-030725e92ed6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e9830f111ddf4bcbb9351477d052f4da)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:13.309893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ecc3f-448a-419f-9bd8-030725e92ed6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:13.339376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-296ecc3f-448a-419f-9bd8-030725e92ed6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e9830f111ddf4bcbb9351477d052f4da', 'request_id': 'req-296ecc3f-448a-419f-9bd8-030725e92ed6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:13.349644 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2419/4812] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:12 2022] POST /identity/v3/auth/tokens => generated 4029 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:13.353054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606415a-721b-490a-8a76-c35fd1a2b5e2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:13.376915 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2394/4813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:13 2022] DELETE /identity/v3/endpoints/e9830f111ddf4bcbb9351477d052f4da => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:13.380898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecc3f-448a-419f-9bd8-030725e92ed6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:13.445725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecc3f-448a-419f-9bd8-030725e92ed6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:13.489909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f45a7e-6a73-41c2-a178-f5488dcc5882 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:13.491405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f45a7e-6a73-41c2-a178-f5488dcc5882 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:13.491838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f45a7e-6a73-41c2-a178-f5488dcc5882 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:13.492409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f45a7e-6a73-41c2-a178-f5488dcc5882 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/regions/tempest-region-1091446675` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:13.493584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f45a7e-6a73-41c2-a178-f5488dcc5882 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1091446675)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:13.495414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f45a7e-6a73-41c2-a178-f5488dcc5882 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:13.545904 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2395/4814] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Aug 29 15:47:13 2022] DELETE /identity/v3/regions/tempest-region-1091446675 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:13.551545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f45a7e-6a73-41c2-a178-f5488dcc5882 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:13.554602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606415a-721b-490a-8a76-c35fd1a2b5e2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:13.594198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85520e-8e4f-4806-9662-f7217ba9f63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:13.595331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85520e-8e4f-4806-9662-f7217ba9f63f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:13.596044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85520e-8e4f-4806-9662-f7217ba9f63f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:13.596595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85520e-8e4f-4806-9662-f7217ba9f63f admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:13.600285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85520e-8e4f-4806-9662-f7217ba9f63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:13.601220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f45a7e-6a73-41c2-a178-f5488dcc5882 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:13.608398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85520e-8e4f-4806-9662-f7217ba9f63f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:13.608726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cce91-b760-4079-b3f0-433133ef6aac tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:13.609356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cce91-b760-4079-b3f0-433133ef6aac tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:13.609692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cce91-b760-4079-b3f0-433133ef6aac tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:13.609978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cce91-b760-4079-b3f0-433133ef6aac tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/regions/tempest-region-562708375` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:13.610585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cce91-b760-4079-b3f0-433133ef6aac tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-562708375)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:13.612270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cce91-b760-4079-b3f0-433133ef6aac tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:13.628250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:13.677409 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2420/4815] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:13 2022] POST /identity/v3/projects => generated 389 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:13.683477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85520e-8e4f-4806-9662-f7217ba9f63f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:13.715971 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2396/4816] 10.222.0.16 () {58 vars in 1206 bytes} [Mon Aug 29 15:47:13 2022] DELETE /identity/v3/regions/tempest-region-562708375 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:13.724241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cce91-b760-4079-b3f0-433133ef6aac tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:13.784628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cce91-b760-4079-b3f0-433133ef6aac tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:13.983931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85520e-8e4f-4806-9662-f7217ba9f63f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:14.003397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a7401-3397-4e67-bd3d-9a40512f9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:14.004024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a7401-3397-4e67-bd3d-9a40512f9c1d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:14.004298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a7401-3397-4e67-bd3d-9a40512f9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:14.004566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a7401-3397-4e67-bd3d-9a40512f9c1d admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:14.005196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a7401-3397-4e67-bd3d-9a40512f9c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:14.008085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a7401-3397-4e67-bd3d-9a40512f9c1d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:14.079380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a6cb2-380d-40fe-b330-85d19d041474 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:14.083441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6cb2-380d-40fe-b330-85d19d041474 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:14.083441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6cb2-380d-40fe-b330-85d19d041474 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:14.083441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6cb2-380d-40fe-b330-85d19d041474 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/services/37682ee24b3b41e4bdc7c66e1df2645b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:14.083441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a6cb2-380d-40fe-b330-85d19d041474 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_service(service_id=37682ee24b3b41e4bdc7c66e1df2645b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:14.087475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a6cb2-380d-40fe-b330-85d19d041474 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:14.102044 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2421/4817] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:13 2022] POST /identity/v3/users => generated 301 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:14.107656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a7401-3397-4e67-bd3d-9a40512f9c1d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:14.151615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a7401-3397-4e67-bd3d-9a40512f9c1d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:14.163710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d31377-de80-43a1-88e7-90a3953f4efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:14.164782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d31377-de80-43a1-88e7-90a3953f4efe admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:14.165371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d31377-de80-43a1-88e7-90a3953f4efe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:14.166014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d31377-de80-43a1-88e7-90a3953f4efe admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:14.167335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d31377-de80-43a1-88e7-90a3953f4efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:14.170318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d31377-de80-43a1-88e7-90a3953f4efe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:14.203013 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2397/4818] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:13 2022] DELETE /identity/v3/services/37682ee24b3b41e4bdc7c66e1df2645b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:14.204506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a6cb2-380d-40fe-b330-85d19d041474 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:14.207454 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2422/4819] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:14.228168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d31377-de80-43a1-88e7-90a3953f4efe admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:14.252589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d31377-de80-43a1-88e7-90a3953f4efe admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:14.334319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a6cb2-380d-40fe-b330-85d19d041474 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:14.354474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaca39-8d79-4a52-a019-ac26f13b3e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:14.361875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaca39-8d79-4a52-a019-ac26f13b3e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:14.362170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaca39-8d79-4a52-a019-ac26f13b3e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:14.362515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaca39-8d79-4a52-a019-ac26f13b3e04 admin admin] PATH_INFO: `/v3/projects/b2a0499d0289420f9b18ee5d2476dfee/users/5567df08436c40af9f78d58b4acf6e2d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:14.366627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dba660-a3f5-40bc-8185-8b1e7c38fbd6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:14.379911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba660-a3f5-40bc-8185-8b1e7c38fbd6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:14.380285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba660-a3f5-40bc-8185-8b1e7c38fbd6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:14.380562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba660-a3f5-40bc-8185-8b1e7c38fbd6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints/7ec6f3a769914db8b384f1d4b8373ad8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:14.424607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dba660-a3f5-40bc-8185-8b1e7c38fbd6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7ec6f3a769914db8b384f1d4b8373ad8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:14.428712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dba660-a3f5-40bc-8185-8b1e7c38fbd6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:14.451092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3dba660-a3f5-40bc-8185-8b1e7c38fbd6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7ec6f3a769914db8b384f1d4b8373ad8', 'request_id': 'req-c3dba660-a3f5-40bc-8185-8b1e7c38fbd6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:14.465011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaca39-8d79-4a52-a019-ac26f13b3e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a0499d0289420f9b18ee5d2476dfee, user_id=5567df08436c40af9f78d58b4acf6e2d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:14.470027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaca39-8d79-4a52-a019-ac26f13b3e04 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:14.494222 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2398/4820] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:14 2022] DELETE /identity/v3/endpoints/7ec6f3a769914db8b384f1d4b8373ad8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:14.529976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dba660-a3f5-40bc-8185-8b1e7c38fbd6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:14.549573 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2423/4821] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:14 2022] PUT /identity/v3/projects/b2a0499d0289420f9b18ee5d2476dfee/users/5567df08436c40af9f78d58b4acf6e2d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:14.551087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaca39-8d79-4a52-a019-ac26f13b3e04 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:14.623876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dba660-a3f5-40bc-8185-8b1e7c38fbd6 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:14.637795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:14.796019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaca39-8d79-4a52-a019-ac26f13b3e04 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:14.804285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ae44f-43be-47d3-9ec3-3e71227913fa tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:14.807068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ae44f-43be-47d3-9ec3-3e71227913fa tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:14.807868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ae44f-43be-47d3-9ec3-3e71227913fa tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:14.808290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ae44f-43be-47d3-9ec3-3e71227913fa tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/regions/tempest-region-1082259326` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:14.809801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ae44f-43be-47d3-9ec3-3e71227913fa tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1082259326)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:14.813047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ae44f-43be-47d3-9ec3-3e71227913fa tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:14.835965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00959afa-a563-4e26-b8e1-340b8c973484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:14.837206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00959afa-a563-4e26-b8e1-340b8c973484 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:14.837206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00959afa-a563-4e26-b8e1-340b8c973484 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:14.837519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00959afa-a563-4e26-b8e1-340b8c973484 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:14.838324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00959afa-a563-4e26-b8e1-340b8c973484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:14.841695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00959afa-a563-4e26-b8e1-340b8c973484 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:14.872125 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2399/4822] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Aug 29 15:47:14 2022] DELETE /identity/v3/regions/tempest-region-1082259326 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:14.873046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ae44f-43be-47d3-9ec3-3e71227913fa tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:14.877080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a92ae44f-43be-47d3-9ec3-3e71227913fa tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:14.886083 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2424/4823] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:14.887036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00959afa-a563-4e26-b8e1-340b8c973484 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:14.900085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00959afa-a563-4e26-b8e1-340b8c973484 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:14.909497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:14.935662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdd707-95b0-4a04-acab-4bc527d24f12 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:14.936310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdd707-95b0-4a04-acab-4bc527d24f12 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:14.936588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdd707-95b0-4a04-acab-4bc527d24f12 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:14.937004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdd707-95b0-4a04-acab-4bc527d24f12 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/services/80e71600b9a148548f4df4cbd8fb830e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:14.937698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdd707-95b0-4a04-acab-4bc527d24f12 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_service(service_id=80e71600b9a148548f4df4cbd8fb830e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:14.939356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdd707-95b0-4a04-acab-4bc527d24f12 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:14.983198 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2425/4824] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:14 2022] DELETE /identity/v3/services/80e71600b9a148548f4df4cbd8fb830e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:14.986628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdd707-95b0-4a04-acab-4bc527d24f12 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:15.025010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdd707-95b0-4a04-acab-4bc527d24f12 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:15.032763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b185b-6e3a-49de-a1bd-87f71f263623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:15.033593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b185b-6e3a-49de-a1bd-87f71f263623 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:15.034116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b185b-6e3a-49de-a1bd-87f71f263623 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:15.034468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b185b-6e3a-49de-a1bd-87f71f263623 admin admin] PATH_INFO: `/v3/projects/b2a0499d0289420f9b18ee5d2476dfee/users/5567df08436c40af9f78d58b4acf6e2d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:15.037350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b185b-6e3a-49de-a1bd-87f71f263623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a0499d0289420f9b18ee5d2476dfee, user_id=5567df08436c40af9f78d58b4acf6e2d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:15.041770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b185b-6e3a-49de-a1bd-87f71f263623 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:15.072413 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2426/4825] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:14 2022] PUT /identity/v3/projects/b2a0499d0289420f9b18ee5d2476dfee/users/5567df08436c40af9f78d58b4acf6e2d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:15.072413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b185b-6e3a-49de-a1bd-87f71f263623 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:15.079482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ae44f-43be-47d3-9ec3-3e71227913fa tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:15.261195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b185b-6e3a-49de-a1bd-87f71f263623 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:15.284937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f570ae-81e0-4a4c-a7a2-8cd25fb669c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:15.288324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f570ae-81e0-4a4c-a7a2-8cd25fb669c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:15.288324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f570ae-81e0-4a4c-a7a2-8cd25fb669c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:15.288324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f570ae-81e0-4a4c-a7a2-8cd25fb669c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/endpoints/3c5aa72d660f4f9da78368e030e27e30` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:15.323581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f570ae-81e0-4a4c-a7a2-8cd25fb669c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=3c5aa72d660f4f9da78368e030e27e30)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:15.324624 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-a4f570ae-81e0-4a4c-a7a2-8cd25fb669c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:15.324624 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:15.324624 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:15.325887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f570ae-81e0-4a4c-a7a2-8cd25fb669c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:15.359665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a4f570ae-81e0-4a4c-a7a2-8cd25fb669c8 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '3c5aa72d660f4f9da78368e030e27e30', 'request_id': 'req-a4f570ae-81e0-4a4c-a7a2-8cd25fb669c8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:15.390081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78496b-92ab-4b28-9cc1-93e58ea43851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:15.392085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78496b-92ab-4b28-9cc1-93e58ea43851 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:15.398163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78496b-92ab-4b28-9cc1-93e58ea43851 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:15.398842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78496b-92ab-4b28-9cc1-93e58ea43851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:15.408011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7d78496b-92ab-4b28-9cc1-93e58ea43851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:15.409946 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2427/4826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:15 2022] DELETE /identity/v3/endpoints/3c5aa72d660f4f9da78368e030e27e30 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:15.412237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f0dc-1634-4a81-99b6-c7de70640cd6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:15.417935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f0dc-1634-4a81-99b6-c7de70640cd6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:15.418441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f0dc-1634-4a81-99b6-c7de70640cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:15.463783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78496b-92ab-4b28-9cc1-93e58ea43851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:15.469716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78496b-92ab-4b28-9cc1-93e58ea43851 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:15.498250 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2400/4827] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:14 2022] GET /identity/v3/auth/tokens => generated 3687 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:15.499512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78496b-92ab-4b28-9cc1-93e58ea43851 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:15.515108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:15.532146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f837f0dc-1634-4a81-99b6-c7de70640cd6 None None] MFA Rules not processed for user `5567df08436c40af9f78d58b4acf6e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:15.533585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78496b-92ab-4b28-9cc1-93e58ea43851 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:15.537306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f837f0dc-1634-4a81-99b6-c7de70640cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:15.567331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95887c5-12f7-4a5c-91cb-cfbe7e684f26 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:15.567986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95887c5-12f7-4a5c-91cb-cfbe7e684f26 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:15.568274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95887c5-12f7-4a5c-91cb-cfbe7e684f26 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:15.568556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95887c5-12f7-4a5c-91cb-cfbe7e684f26 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/regions/tempest-region-1241967841` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:15.570043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95887c5-12f7-4a5c-91cb-cfbe7e684f26 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1241967841)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:15.572018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95887c5-12f7-4a5c-91cb-cfbe7e684f26 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:15.598729 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-b95887c5-12f7-4a5c-91cb-cfbe7e684f26 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1241967841. To ensure interoperability, identifiers should be a valid uuid. Aug 29 15:47:15.598729 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 15:47:15.598729 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:15.611114 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2401/4828] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Aug 29 15:47:15 2022] DELETE /identity/v3/regions/tempest-region-1241967841 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:15.612581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95887c5-12f7-4a5c-91cb-cfbe7e684f26 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:15.673163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95887c5-12f7-4a5c-91cb-cfbe7e684f26 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:15.682522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26491b45-7880-4ce2-9d89-8e2b140e3a53 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c187d319e24398a5fa8bce4287e0a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcee167db48246fc9cb44ed636d43055', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:15.683700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26491b45-7880-4ce2-9d89-8e2b140e3a53 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:15.684150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26491b45-7880-4ce2-9d89-8e2b140e3a53 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:15.684595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26491b45-7880-4ce2-9d89-8e2b140e3a53 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] PATH_INFO: `/v3/services/43cf70d041a446cdbdac08716ffef56b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:15.686067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26491b45-7880-4ce2-9d89-8e2b140e3a53 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorizing `identity:delete_service(service_id=43cf70d041a446cdbdac08716ffef56b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:15.688778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26491b45-7880-4ce2-9d89-8e2b140e3a53 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:15.739810 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2428/4829] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:15.753605 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2402/4830] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:15 2022] DELETE /identity/v3/services/43cf70d041a446cdbdac08716ffef56b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:15.758441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f0dc-1634-4a81-99b6-c7de70640cd6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:15.758988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26491b45-7880-4ce2-9d89-8e2b140e3a53 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:15.761115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-26491b45-7880-4ce2-9d89-8e2b140e3a53 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:15.761809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f837f0dc-1634-4a81-99b6-c7de70640cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:15.780589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:15.889512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f0dc-1634-4a81-99b6-c7de70640cd6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:15.906910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26491b45-7880-4ce2-9d89-8e2b140e3a53 tempest-EndPointsTestJSON-937715199 tempest-EndPointsTestJSON-937715199-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:15.916062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dacfdf-a443-404d-a0e5-c99e24200da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:15.918012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dacfdf-a443-404d-a0e5-c99e24200da9 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:15.920403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dacfdf-a443-404d-a0e5-c99e24200da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:15.920865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dacfdf-a443-404d-a0e5-c99e24200da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:15.922347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:15.926218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:15.926699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:15.927742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] PATH_INFO: `/v3/users/2bc7af59d6d04867a43d12eb76d535a7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:15.931040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc7af59d6d04867a43d12eb76d535a7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:15.941179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:16.059928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc7af59d6d04867a43d12eb76d535a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:16.060827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc7af59d6d04867a43d12eb76d535a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:16.067570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dacfdf-a443-404d-a0e5-c99e24200da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:16.069951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dacfdf-a443-404d-a0e5-c99e24200da9 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:16.092443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc7af59d6d04867a43d12eb76d535a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:16.107293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc7af59d6d04867a43d12eb76d535a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:16.115344 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2429/4831] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:16.120771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc7af59d6d04867a43d12eb76d535a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:16.130308 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2403/4832] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:15 2022] DELETE /identity/v3/users/2bc7af59d6d04867a43d12eb76d535a7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:16.137234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4933ef-d0d7-49b6-876e-22a981fb7f16 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:16.138014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4933ef-d0d7-49b6-876e-22a981fb7f16 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:16.138528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4933ef-d0d7-49b6-876e-22a981fb7f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:16.165205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5c4933ef-d0d7-49b6-876e-22a981fb7f16 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:16.168465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5c4933ef-d0d7-49b6-876e-22a981fb7f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:16.284204 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2430/4833] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:16.308456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:16.310129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:16.381848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:16.589482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21651-ce8b-49a1-ba3a-9384c8d6e557 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:16.600045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481dbf0-1ab8-46fd-9ecc-cb4ad2478478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:16.600703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481dbf0-1ab8-46fd-9ecc-cb4ad2478478 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:16.601053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481dbf0-1ab8-46fd-9ecc-cb4ad2478478 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:16.601287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481dbf0-1ab8-46fd-9ecc-cb4ad2478478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:16.638967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481dbf0-1ab8-46fd-9ecc-cb4ad2478478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:16.640505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481dbf0-1ab8-46fd-9ecc-cb4ad2478478 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:16.693134 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2404/4834] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:18.604439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4933ef-d0d7-49b6-876e-22a981fb7f16 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:18.607037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5c4933ef-d0d7-49b6-876e-22a981fb7f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:18.645115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4933ef-d0d7-49b6-876e-22a981fb7f16 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:18.650590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481dbf0-1ab8-46fd-9ecc-cb4ad2478478 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:18.652116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a481dbf0-1ab8-46fd-9ecc-cb4ad2478478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:18.661439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:18.662395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:18.663160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:18.666280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] PATH_INFO: `/v3/projects/e31c8467bbe04544829c486cc0421016` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:18.668591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31c8467bbe04544829c486cc0421016)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:18.671802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:18.805902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:18.861739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31c8467bbe04544829c486cc0421016', 'request_id': 'req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:18.889465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31c8467bbe04544829c486cc0421016', 'request_id': 'req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:18.918160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31c8467bbe04544829c486cc0421016', 'request_id': 'req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:18.962222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] The token cache is being invalidate because project e31c8467bbe04544829c486cc0421016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:18.962724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:18.963851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:18.966577 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2431/4835] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:18 2022] DELETE /identity/v3/projects/e31c8467bbe04544829c486cc0421016 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:18.972636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:18.974625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481dbf0-1ab8-46fd-9ecc-cb4ad2478478 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:18.983502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:19.175796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedafa5b-1e1f-414a-8d85-3b9a900c1c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:19.176738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedafa5b-1e1f-414a-8d85-3b9a900c1c36 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:19.177040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedafa5b-1e1f-414a-8d85-3b9a900c1c36 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:19.177373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedafa5b-1e1f-414a-8d85-3b9a900c1c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:19.182866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fedafa5b-1e1f-414a-8d85-3b9a900c1c36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:19.222068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedafa5b-1e1f-414a-8d85-3b9a900c1c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:19.225972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedafa5b-1e1f-414a-8d85-3b9a900c1c36 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:19.237458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bf1fa-ca12-4f0a-aaaf-1c82e774f8fb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:19.269547 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2405/4836] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:47:19.270166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8c206-6981-4537-8e3f-55a56e308f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:19.271548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8c206-6981-4537-8e3f-55a56e308f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:19.272332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8c206-6981-4537-8e3f-55a56e308f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:19.273055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8c206-6981-4537-8e3f-55a56e308f58 admin admin] PATH_INFO: `/v3/users/58c187d319e24398a5fa8bce4287e0a3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:19.277948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8c206-6981-4537-8e3f-55a56e308f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c187d319e24398a5fa8bce4287e0a3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:19.280649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8c206-6981-4537-8e3f-55a56e308f58 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:19.361788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9da8c206-6981-4537-8e3f-55a56e308f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c187d319e24398a5fa8bce4287e0a3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:19.362733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9da8c206-6981-4537-8e3f-55a56e308f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c187d319e24398a5fa8bce4287e0a3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:19.391551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9da8c206-6981-4537-8e3f-55a56e308f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c187d319e24398a5fa8bce4287e0a3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:19.393047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9da8c206-6981-4537-8e3f-55a56e308f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c187d319e24398a5fa8bce4287e0a3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:19.424242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9da8c206-6981-4537-8e3f-55a56e308f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c187d319e24398a5fa8bce4287e0a3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:19.460451 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2432/4837] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:18 2022] DELETE /identity/v3/users/58c187d319e24398a5fa8bce4287e0a3 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:20.252020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedafa5b-1e1f-414a-8d85-3b9a900c1c36 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:20.302357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedafa5b-1e1f-414a-8d85-3b9a900c1c36 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:20.463070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:20.552258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:20.559256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:20.559550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:20.559852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] PATH_INFO: `/v3/projects/fcee167db48246fc9cb44ed636d43055` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:20.561272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcee167db48246fc9cb44ed636d43055)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:20.563564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:20.809537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcee167db48246fc9cb44ed636d43055', 'request_id': 'req-cda56624-1778-48df-8236-4c9f728212ef'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:20.822392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcee167db48246fc9cb44ed636d43055', 'request_id': 'req-cda56624-1778-48df-8236-4c9f728212ef'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:20.861614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcee167db48246fc9cb44ed636d43055', 'request_id': 'req-cda56624-1778-48df-8236-4c9f728212ef'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:20.903756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] The token cache is being invalidate because project fcee167db48246fc9cb44ed636d43055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:20.904288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:20.906548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cda56624-1778-48df-8236-4c9f728212ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:20.914953 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2406/4838] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:20 2022] DELETE /identity/v3/projects/fcee167db48246fc9cb44ed636d43055 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:20.919145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d35ae-e26d-4cc7-ad1c-bf19586b60e0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:20.919921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d35ae-e26d-4cc7-ad1c-bf19586b60e0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:20.920069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d35ae-e26d-4cc7-ad1c-bf19586b60e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:20.992441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-156d35ae-e26d-4cc7-ad1c-bf19586b60e0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:21.014789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-156d35ae-e26d-4cc7-ad1c-bf19586b60e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:21.105431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:21.160213 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2433/4839] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:21.170815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef22a8-e212-444a-9bd6-35f3ff6edb77 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:21.171106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef22a8-e212-444a-9bd6-35f3ff6edb77 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:21.171389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef22a8-e212-444a-9bd6-35f3ff6edb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:21.271709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fdef22a8-e212-444a-9bd6-35f3ff6edb77 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:21.278457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fdef22a8-e212-444a-9bd6-35f3ff6edb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:21.309561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2407/4840] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:21.315878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d35ae-e26d-4cc7-ad1c-bf19586b60e0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:21.333173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d35ae-e26d-4cc7-ad1c-bf19586b60e0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:21.339044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de957faf-f767-4ec5-b6e4-60e7260d50db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:21.339850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de957faf-f767-4ec5-b6e4-60e7260d50db admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:21.340229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de957faf-f767-4ec5-b6e4-60e7260d50db admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:21.340601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de957faf-f767-4ec5-b6e4-60e7260d50db admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:21.341364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de957faf-f767-4ec5-b6e4-60e7260d50db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:21.341807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de957faf-f767-4ec5-b6e4-60e7260d50db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:21.343547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de957faf-f767-4ec5-b6e4-60e7260d50db admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:21.374127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef22a8-e212-444a-9bd6-35f3ff6edb77 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:21.379106 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2434/4841] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:21.396076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef22a8-e212-444a-9bd6-35f3ff6edb77 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:21.415395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a7352-960e-4bb5-b333-277e1adbe24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:21.416359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a7352-960e-4bb5-b333-277e1adbe24d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:21.416828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a7352-960e-4bb5-b333-277e1adbe24d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:21.417279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a7352-960e-4bb5-b333-277e1adbe24d admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:21.418373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a7352-960e-4bb5-b333-277e1adbe24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:21.426420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a7352-960e-4bb5-b333-277e1adbe24d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:21.588799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de957faf-f767-4ec5-b6e4-60e7260d50db admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:21.598313 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2408/4842] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:21 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:21.610919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de957faf-f767-4ec5-b6e4-60e7260d50db admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:21.769811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da174c2c-9518-4779-83b3-e27474d0f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:21.770723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da174c2c-9518-4779-83b3-e27474d0f469 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:21.772709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da174c2c-9518-4779-83b3-e27474d0f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:21.773121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da174c2c-9518-4779-83b3-e27474d0f469 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:21.773960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da174c2c-9518-4779-83b3-e27474d0f469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:21.780974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da174c2c-9518-4779-83b3-e27474d0f469 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:21.884704 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2435/4843] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:21 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:21.889624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a7352-960e-4bb5-b333-277e1adbe24d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:21.925136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a7352-960e-4bb5-b333-277e1adbe24d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:21.942424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605c65c-84a8-4b11-8489-22422826b074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:21.943676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605c65c-84a8-4b11-8489-22422826b074 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:21.944370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605c65c-84a8-4b11-8489-22422826b074 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:21.944913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605c65c-84a8-4b11-8489-22422826b074 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:21.945996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605c65c-84a8-4b11-8489-22422826b074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:21.947954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605c65c-84a8-4b11-8489-22422826b074 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:21.982599 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2409/4844] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:21.983476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da174c2c-9518-4779-83b3-e27474d0f469 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:22.033704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da174c2c-9518-4779-83b3-e27474d0f469 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:22.065955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ffc45-97cc-4b17-9a47-6f240007ad88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:22.066527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ffc45-97cc-4b17-9a47-6f240007ad88 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:22.066866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ffc45-97cc-4b17-9a47-6f240007ad88 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:22.067152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ffc45-97cc-4b17-9a47-6f240007ad88 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:22.067820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ffc45-97cc-4b17-9a47-6f240007ad88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:22.085449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ffc45-97cc-4b17-9a47-6f240007ad88 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:22.129560 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2436/4845] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:22.134325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605c65c-84a8-4b11-8489-22422826b074 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:22.150667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605c65c-84a8-4b11-8489-22422826b074 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:22.170892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b234e-2c5a-4ede-88db-a151e2196270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:22.174535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b234e-2c5a-4ede-88db-a151e2196270 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:22.178706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b234e-2c5a-4ede-88db-a151e2196270 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:22.179412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b234e-2c5a-4ede-88db-a151e2196270 admin admin] PATH_INFO: `/v3/projects/b52f6808f82f49a39ea7fdf4a82baf6c/users/f1d98f358ae04fc9b794fd69331d4663/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:22.263624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b234e-2c5a-4ede-88db-a151e2196270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52f6808f82f49a39ea7fdf4a82baf6c, user_id=f1d98f358ae04fc9b794fd69331d4663, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:22.269794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b234e-2c5a-4ede-88db-a151e2196270 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:22.327721 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2410/4846] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:22 2022] PUT /identity/v3/projects/b52f6808f82f49a39ea7fdf4a82baf6c/users/f1d98f358ae04fc9b794fd69331d4663/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:22.329571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e2f67-b206-46d5-8fac-692a518aa480 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:22.329866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e2f67-b206-46d5-8fac-692a518aa480 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:22.330147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e2f67-b206-46d5-8fac-692a518aa480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:22.457101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d35e2f67-b206-46d5-8fac-692a518aa480 None None] MFA Rules not processed for user `f1d98f358ae04fc9b794fd69331d4663`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:22.464804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d35e2f67-b206-46d5-8fac-692a518aa480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:22.744153 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2437/4847] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:22.750438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b234e-2c5a-4ede-88db-a151e2196270 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:22.967178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:23.020679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b234e-2c5a-4ede-88db-a151e2196270 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:23.033947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a314c-a545-48f7-acaa-18208ee5a9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:23.034671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a314c-a545-48f7-acaa-18208ee5a9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:23.035020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a314c-a545-48f7-acaa-18208ee5a9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:23.038016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a314c-a545-48f7-acaa-18208ee5a9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:23.038973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a314c-a545-48f7-acaa-18208ee5a9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:23.041149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a314c-a545-48f7-acaa-18208ee5a9f3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:23.096544 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2411/4848] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:22 2022] POST /identity/v3/projects => generated 387 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:23.101627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e2f67-b206-46d5-8fac-692a518aa480 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:23.120710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e2f67-b206-46d5-8fac-692a518aa480 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:23.260576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:23.291675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3b5e5-bbc3-46f4-a0f5-d15bd376e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:23.293146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b5e5-bbc3-46f4-a0f5-d15bd376e97e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:23.293864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b5e5-bbc3-46f4-a0f5-d15bd376e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:23.294718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b5e5-bbc3-46f4-a0f5-d15bd376e97e admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:23.295897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3b5e5-bbc3-46f4-a0f5-d15bd376e97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:23.300201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3b5e5-bbc3-46f4-a0f5-d15bd376e97e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:23.351059 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2438/4849] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:23 2022] POST /identity/v3/users => generated 300 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:23.351876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a314c-a545-48f7-acaa-18208ee5a9f3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:23.367110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a314c-a545-48f7-acaa-18208ee5a9f3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:23.383311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3eb38-50fc-4133-b9e0-4a04c5ca1cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:23.389745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3eb38-50fc-4133-b9e0-4a04c5ca1cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:23.390041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3eb38-50fc-4133-b9e0-4a04c5ca1cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:23.390524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3eb38-50fc-4133-b9e0-4a04c5ca1cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:23.391386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3eb38-50fc-4133-b9e0-4a04c5ca1cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:23.393226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3eb38-50fc-4133-b9e0-4a04c5ca1cc3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:23.436043 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2412/4850] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:23.442135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3b5e5-bbc3-46f4-a0f5-d15bd376e97e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:23.460842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3b5e5-bbc3-46f4-a0f5-d15bd376e97e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:23.472019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda2423-4ced-4535-8643-04e08dd4bc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:23.474715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda2423-4ced-4535-8643-04e08dd4bc88 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:23.476192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda2423-4ced-4535-8643-04e08dd4bc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:23.476945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda2423-4ced-4535-8643-04e08dd4bc88 admin admin] PATH_INFO: `/v3/projects/fd3235b48fc246478dedce0707ab2670/users/e797531db3ca40d68cf39e9ca9b192dd/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:23.529185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda2423-4ced-4535-8643-04e08dd4bc88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd3235b48fc246478dedce0707ab2670, user_id=e797531db3ca40d68cf39e9ca9b192dd, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:23.544152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda2423-4ced-4535-8643-04e08dd4bc88 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:23.583787 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2439/4851] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:23 2022] PUT /identity/v3/projects/fd3235b48fc246478dedce0707ab2670/users/e797531db3ca40d68cf39e9ca9b192dd/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:23.588913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3eb38-50fc-4133-b9e0-4a04c5ca1cc3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:23.606450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3eb38-50fc-4133-b9e0-4a04c5ca1cc3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:23.889129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07429042-8605-4329-8961-9f9a09039117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:23.890127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07429042-8605-4329-8961-9f9a09039117 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:23.892285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07429042-8605-4329-8961-9f9a09039117 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:23.892708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07429042-8605-4329-8961-9f9a09039117 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:23.898862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07429042-8605-4329-8961-9f9a09039117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:23.903995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07429042-8605-4329-8961-9f9a09039117 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:23.957225 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2413/4852] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:47:23.959052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda2423-4ced-4535-8643-04e08dd4bc88 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:23.979252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda2423-4ced-4535-8643-04e08dd4bc88 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:24.009656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5027cb-ed7e-4ea2-9a18-6abd61c7b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:24.010352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5027cb-ed7e-4ea2-9a18-6abd61c7b412 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:24.010635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5027cb-ed7e-4ea2-9a18-6abd61c7b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:24.010914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5027cb-ed7e-4ea2-9a18-6abd61c7b412 admin admin] PATH_INFO: `/v3/projects/fd3235b48fc246478dedce0707ab2670/users/e797531db3ca40d68cf39e9ca9b192dd/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:24.023502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5027cb-ed7e-4ea2-9a18-6abd61c7b412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd3235b48fc246478dedce0707ab2670, user_id=e797531db3ca40d68cf39e9ca9b192dd, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:24.026633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5027cb-ed7e-4ea2-9a18-6abd61c7b412 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:24.084489 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2440/4853] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:23 2022] PUT /identity/v3/projects/fd3235b48fc246478dedce0707ab2670/users/e797531db3ca40d68cf39e9ca9b192dd/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:24.099388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037100fc-3246-4c4d-a776-738eb99f0181 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:24.099791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037100fc-3246-4c4d-a776-738eb99f0181 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:24.100122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037100fc-3246-4c4d-a776-738eb99f0181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:24.165642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-037100fc-3246-4c4d-a776-738eb99f0181 None None] MFA Rules not processed for user `e797531db3ca40d68cf39e9ca9b192dd`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:24.168500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-037100fc-3246-4c4d-a776-738eb99f0181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:24.185764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d4a21-f2a0-41ca-8f75-97a9bb12c186 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:24.186234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d4a21-f2a0-41ca-8f75-97a9bb12c186 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:24.186318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d4a21-f2a0-41ca-8f75-97a9bb12c186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:24.248963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-918d4a21-f2a0-41ca-8f75-97a9bb12c186 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:24.252138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-918d4a21-f2a0-41ca-8f75-97a9bb12c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:24.472378 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2414/4854] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:24.478255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037100fc-3246-4c4d-a776-738eb99f0181 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:24.522240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037100fc-3246-4c4d-a776-738eb99f0181 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:24.523021 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2441/4855] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:24.543140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d4a21-f2a0-41ca-8f75-97a9bb12c186 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:24.546602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b4785-277b-46fd-a675-4e76ee420a59 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:24.546813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-918d4a21-f2a0-41ca-8f75-97a9bb12c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:24.547541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b4785-277b-46fd-a675-4e76ee420a59 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:24.547831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b4785-277b-46fd-a675-4e76ee420a59 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:24.548212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b4785-277b-46fd-a675-4e76ee420a59 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:24.548890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b4785-277b-46fd-a675-4e76ee420a59 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:24.550721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b4785-277b-46fd-a675-4e76ee420a59 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:24.577158 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2415/4856] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:24 2022] POST /identity/v3/services => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:24.579038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b4785-277b-46fd-a675-4e76ee420a59 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:24.639800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b4785-277b-46fd-a675-4e76ee420a59 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:24.651245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc39d8c-ca57-44c4-814f-1b46f32facd5 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:24.654321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc39d8c-ca57-44c4-814f-1b46f32facd5 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:24.655667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc39d8c-ca57-44c4-814f-1b46f32facd5 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:24.655983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc39d8c-ca57-44c4-814f-1b46f32facd5 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:24.656741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc39d8c-ca57-44c4-814f-1b46f32facd5 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:24.665278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc39d8c-ca57-44c4-814f-1b46f32facd5 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-bcc39d8c-ca57-44c4-814f-1b46f32facd5 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: On instance['enabled']: Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: On instance['enabled']: Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: 'False' Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise error Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application 'False' Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.691530 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 15:47:24.693225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 15:47:24.699866 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 15:47:24.699866 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 15:47:24.699866 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.699866 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:24.699866 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:24.699866 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.699866 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 15:47:24.699866 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application 'False' Aug 29 15:47:24.699866 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.699866 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2416/4857] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:47:24 2022] POST /identity/v3/endpoints => generated 283 bytes in 115 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 15:47:24.700690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc39d8c-ca57-44c4-814f-1b46f32facd5 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:24.736311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc39d8c-ca57-44c4-814f-1b46f32facd5 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:24.753490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8e2cf-a842-4934-8127-d425b30ba41b tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:24.754566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e2cf-a842-4934-8127-d425b30ba41b tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:24.755149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e2cf-a842-4934-8127-d425b30ba41b tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:24.755783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e2cf-a842-4934-8127-d425b30ba41b tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:24.756773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8e2cf-a842-4934-8127-d425b30ba41b tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:24.758857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8e2cf-a842-4934-8127-d425b30ba41b tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:24.766804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d4a21-f2a0-41ca-8f75-97a9bb12c186 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-11f8e2cf-a842-4934-8127-d425b30ba41b tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: On instance['enabled']: Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: On instance['enabled']: Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: 'True' Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise error Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application 'True' Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.775462 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 15:47:24.777221 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 15:47:24.778315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 15:47:24.778315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 15:47:24.778315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.778315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:24.778315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:24.778315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.778315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 15:47:24.778315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application 'True' Aug 29 15:47:24.778315 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:24.790332 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2417/4858] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:47:24 2022] POST /identity/v3/endpoints => generated 281 bytes in 90 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 15:47:24.791625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8e2cf-a842-4934-8127-d425b30ba41b tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:24.812874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10ccc3-46ac-4221-9abb-33857c8da4eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:24.813489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8e2cf-a842-4934-8127-d425b30ba41b tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:24.813698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10ccc3-46ac-4221-9abb-33857c8da4eb service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:24.813849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10ccc3-46ac-4221-9abb-33857c8da4eb service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:24.816509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10ccc3-46ac-4221-9abb-33857c8da4eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:24.831072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5d04d-8b14-449d-a6c4-7637f08ab278 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:24.831924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5d04d-8b14-449d-a6c4-7637f08ab278 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:24.832337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5d04d-8b14-449d-a6c4-7637f08ab278 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:24.832751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5d04d-8b14-449d-a6c4-7637f08ab278 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:24.833649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5d04d-8b14-449d-a6c4-7637f08ab278 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:24.836222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5d04d-8b14-449d-a6c4-7637f08ab278 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:24.838904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10ccc3-46ac-4221-9abb-33857c8da4eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:24.840904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10ccc3-46ac-4221-9abb-33857c8da4eb service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:24.855154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:24.866164 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2442/4859] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:47:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:47:24.878868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:24.890622 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-1cd5d04d-8b14-449d-a6c4-7637f08ab278 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1139217521. To ensure interoperability, identifiers should be a valid uuid. Aug 29 15:47:24.890622 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 15:47:24.890622 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:25.007536 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2418/4860] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:47:24 2022] POST /identity/v3/endpoints => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:25.012966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10ccc3-46ac-4221-9abb-33857c8da4eb service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:25.031034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10ccc3-46ac-4221-9abb-33857c8da4eb service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:25.074369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc32d9-d475-424e-8110-4c5342c5e3c8 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:25.075616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc32d9-d475-424e-8110-4c5342c5e3c8 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:25.077853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc32d9-d475-424e-8110-4c5342c5e3c8 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:25.078632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc32d9-d475-424e-8110-4c5342c5e3c8 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/regions/tempest-region-1139217521` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:25.079885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc32d9-d475-424e-8110-4c5342c5e3c8 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1139217521)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:25.083211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc32d9-d475-424e-8110-4c5342c5e3c8 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:25.086935 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2443/4861] 10.222.0.16 () {58 vars in 1206 bytes} [Mon Aug 29 15:47:25 2022] GET /identity/v3/regions/tempest-region-1139217521 => generated 180 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:25.091686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5d04d-8b14-449d-a6c4-7637f08ab278 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:25.111045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5d04d-8b14-449d-a6c4-7637f08ab278 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:25.130133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3927-4af8-488b-8d28-59a515f9494c tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:25.131487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3927-4af8-488b-8d28-59a515f9494c tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:25.131884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3927-4af8-488b-8d28-59a515f9494c tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:25.132341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3927-4af8-488b-8d28-59a515f9494c tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/endpoints/af41546e97a045408153fb3c6ba1e790` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:25.150167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f3927-4af8-488b-8d28-59a515f9494c tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=af41546e97a045408153fb3c6ba1e790)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:25.152156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f3927-4af8-488b-8d28-59a515f9494c tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-a44f3927-4af8-488b-8d28-59a515f9494c tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: On instance['enabled']: Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: On instance['enabled']: Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: 'False' Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise error Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application 'False' Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:25.171069 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 15:47:25.172699 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 15:47:25.173701 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 15:47:25.173701 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 29 15:47:25.173701 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:25.173701 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:25.173701 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:25.173701 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:25.173701 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 15:47:25.173701 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application 'False' Aug 29 15:47:25.173701 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:25.180817 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2419/4862] 10.222.0.16 () {60 vars in 1255 bytes} [Mon Aug 29 15:47:25 2022] PATCH /identity/v3/endpoints/af41546e97a045408153fb3c6ba1e790 => generated 283 bytes in 90 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 29 15:47:25.186370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc32d9-d475-424e-8110-4c5342c5e3c8 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:25.223977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc32d9-d475-424e-8110-4c5342c5e3c8 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:25.233184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8172c-5953-4033-85d5-3397c66b95dc tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:25.234376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8172c-5953-4033-85d5-3397c66b95dc tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:25.234839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8172c-5953-4033-85d5-3397c66b95dc tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:25.235286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8172c-5953-4033-85d5-3397c66b95dc tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/endpoints/af41546e97a045408153fb3c6ba1e790` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:25.237376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8172c-5953-4033-85d5-3397c66b95dc tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=af41546e97a045408153fb3c6ba1e790)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:25.239508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8172c-5953-4033-85d5-3397c66b95dc tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:25.295841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a2d8172c-5953-4033-85d5-3397c66b95dc tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'af41546e97a045408153fb3c6ba1e790', 'request_id': 'req-a2d8172c-5953-4033-85d5-3397c66b95dc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:25.313508 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2444/4863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:25 2022] DELETE /identity/v3/endpoints/af41546e97a045408153fb3c6ba1e790 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:25.317615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3927-4af8-488b-8d28-59a515f9494c tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:25.338360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3927-4af8-488b-8d28-59a515f9494c tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:25.371789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29af315-a546-4588-918f-803ea20af02a tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:25.373626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29af315-a546-4588-918f-803ea20af02a tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:25.374266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29af315-a546-4588-918f-803ea20af02a tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:25.374838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29af315-a546-4588-918f-803ea20af02a tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/regions/tempest-region-1139217521` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:25.376012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29af315-a546-4588-918f-803ea20af02a tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1139217521)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:25.379577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29af315-a546-4588-918f-803ea20af02a tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:25.423816 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2420/4864] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Aug 29 15:47:25 2022] DELETE /identity/v3/regions/tempest-region-1139217521 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:25.430591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8172c-5953-4033-85d5-3397c66b95dc tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:25.456341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8172c-5953-4033-85d5-3397c66b95dc tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:25.498777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47574aa8-ef6e-4e29-bc2c-6e90b07eb62f tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:25.500667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47574aa8-ef6e-4e29-bc2c-6e90b07eb62f tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:25.501230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47574aa8-ef6e-4e29-bc2c-6e90b07eb62f tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:25.501799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47574aa8-ef6e-4e29-bc2c-6e90b07eb62f tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:25.502900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47574aa8-ef6e-4e29-bc2c-6e90b07eb62f tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:25.508873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47574aa8-ef6e-4e29-bc2c-6e90b07eb62f tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:25.572755 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-47574aa8-ef6e-4e29-bc2c-6e90b07eb62f tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-499201741. To ensure interoperability, identifiers should be a valid uuid. Aug 29 15:47:25.572755 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 15:47:25.572755 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:25.641173 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2445/4865] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Aug 29 15:47:25 2022] POST /identity/v3/endpoints => generated 359 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:25.643189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29af315-a546-4588-918f-803ea20af02a tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:25.667814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29af315-a546-4588-918f-803ea20af02a tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:25.714235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0a542-7978-4eef-ad5b-5a15356bad6d tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:25.714959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a542-7978-4eef-ad5b-5a15356bad6d tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:25.715243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a542-7978-4eef-ad5b-5a15356bad6d tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:25.715516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a542-7978-4eef-ad5b-5a15356bad6d tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/regions/tempest-region-499201741` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:25.716426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0a542-7978-4eef-ad5b-5a15356bad6d tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-499201741)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:25.717734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0a542-7978-4eef-ad5b-5a15356bad6d tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:25.723362 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2421/4866] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Aug 29 15:47:25 2022] GET /identity/v3/regions/tempest-region-499201741 => generated 178 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:25.724467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47574aa8-ef6e-4e29-bc2c-6e90b07eb62f tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:25.741894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47574aa8-ef6e-4e29-bc2c-6e90b07eb62f tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:25.769953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57191e6e-665f-46e9-a63f-1ac0f776cd62 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:25.770982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57191e6e-665f-46e9-a63f-1ac0f776cd62 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:25.771329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57191e6e-665f-46e9-a63f-1ac0f776cd62 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:25.771646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57191e6e-665f-46e9-a63f-1ac0f776cd62 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/endpoints/b7da7eebc92a4bd9b5f521294c7d822e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:25.793268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57191e6e-665f-46e9-a63f-1ac0f776cd62 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=b7da7eebc92a4bd9b5f521294c7d822e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:25.818365 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-57191e6e-665f-46e9-a63f-1ac0f776cd62 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:25.818365 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:25.818365 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:25.819804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57191e6e-665f-46e9-a63f-1ac0f776cd62 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-57191e6e-665f-46e9-a63f-1ac0f776cd62 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: On instance['enabled']: Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: On instance['enabled']: Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: 'True' Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise error Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application 'True' Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:47:25.845849 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 15:47:25.847484 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 15:47:25.848514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 15:47:25.848514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 29 15:47:25.848514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:47:25.848514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 29 15:47:25.848514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 29 15:47:25.848514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:47:25.848514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application On instance['enabled']: Aug 29 15:47:25.848514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application 'True' Aug 29 15:47:25.848514 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:47:25.853545 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2446/4867] 10.222.0.16 () {60 vars in 1255 bytes} [Mon Aug 29 15:47:25 2022] PATCH /identity/v3/endpoints/b7da7eebc92a4bd9b5f521294c7d822e => generated 281 bytes in 127 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 15:47:25.854934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0a542-7978-4eef-ad5b-5a15356bad6d tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:25.868645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0a542-7978-4eef-ad5b-5a15356bad6d tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:25.880664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553252f4-2c4e-4f22-8f65-bf65cbec8ac4 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:25.884881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553252f4-2c4e-4f22-8f65-bf65cbec8ac4 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:25.885619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553252f4-2c4e-4f22-8f65-bf65cbec8ac4 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:25.887339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553252f4-2c4e-4f22-8f65-bf65cbec8ac4 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/endpoints/b7da7eebc92a4bd9b5f521294c7d822e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:25.890446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553252f4-2c4e-4f22-8f65-bf65cbec8ac4 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=b7da7eebc92a4bd9b5f521294c7d822e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:25.893403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553252f4-2c4e-4f22-8f65-bf65cbec8ac4 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:25.905238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-553252f4-2c4e-4f22-8f65-bf65cbec8ac4 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'b7da7eebc92a4bd9b5f521294c7d822e', 'request_id': 'req-553252f4-2c4e-4f22-8f65-bf65cbec8ac4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:25.955245 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2422/4868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:25 2022] DELETE /identity/v3/endpoints/b7da7eebc92a4bd9b5f521294c7d822e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:25.955520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57191e6e-665f-46e9-a63f-1ac0f776cd62 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:25.987154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57191e6e-665f-46e9-a63f-1ac0f776cd62 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:26.015085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bb97b-284e-4cfb-8d86-574d8aa32573 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:26.016330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bb97b-284e-4cfb-8d86-574d8aa32573 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:26.016961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bb97b-284e-4cfb-8d86-574d8aa32573 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:26.017324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bb97b-284e-4cfb-8d86-574d8aa32573 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/regions/tempest-region-499201741` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:26.018388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bb97b-284e-4cfb-8d86-574d8aa32573 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-499201741)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:26.022175 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-dc9bb97b-284e-4cfb-8d86-574d8aa32573 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:26.022175 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:26.022175 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:26.023574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bb97b-284e-4cfb-8d86-574d8aa32573 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:26.111393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553252f4-2c4e-4f22-8f65-bf65cbec8ac4 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:26.119542 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2447/4869] 10.222.0.16 () {58 vars in 1206 bytes} [Mon Aug 29 15:47:25 2022] DELETE /identity/v3/regions/tempest-region-499201741 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:26.127543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bb97b-284e-4cfb-8d86-574d8aa32573 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:26.133963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc9bb97b-284e-4cfb-8d86-574d8aa32573 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:26.134802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553252f4-2c4e-4f22-8f65-bf65cbec8ac4 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:26.180291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22933cc8-fd90-4388-b30a-dedcad560b50 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e797531db3ca40d68cf39e9ca9b192dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd3235b48fc246478dedce0707ab2670', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:26.181155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22933cc8-fd90-4388-b30a-dedcad560b50 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:26.181643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22933cc8-fd90-4388-b30a-dedcad560b50 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:26.182033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22933cc8-fd90-4388-b30a-dedcad560b50 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] PATH_INFO: `/v3/services/bb7ad7a7ef39449e90de6562b78e449e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:26.182738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22933cc8-fd90-4388-b30a-dedcad560b50 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bb7ad7a7ef39449e90de6562b78e449e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:26.187551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22933cc8-fd90-4388-b30a-dedcad560b50 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:26.259292 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2423/4870] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:26 2022] DELETE /identity/v3/services/bb7ad7a7ef39449e90de6562b78e449e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:26.263619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22933cc8-fd90-4388-b30a-dedcad560b50 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:26.412984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bb97b-284e-4cfb-8d86-574d8aa32573 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:26.444809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e962f2-1ae8-4d97-ac0a-fabd21d8ea1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:26.445496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e962f2-1ae8-4d97-ac0a-fabd21d8ea1b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:26.445774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e962f2-1ae8-4d97-ac0a-fabd21d8ea1b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:26.446573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e962f2-1ae8-4d97-ac0a-fabd21d8ea1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:26.454908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-73e962f2-1ae8-4d97-ac0a-fabd21d8ea1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:26.502899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22933cc8-fd90-4388-b30a-dedcad560b50 tempest-EndpointsNegativeTestJSON-1890784442 tempest-EndpointsNegativeTestJSON-1890784442-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:26.516870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb1cc-1d6b-4e7a-ac3b-b3a15fd36a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:26.518079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb1cc-1d6b-4e7a-ac3b-b3a15fd36a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:26.519592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb1cc-1d6b-4e7a-ac3b-b3a15fd36a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:26.519943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb1cc-1d6b-4e7a-ac3b-b3a15fd36a6c admin admin] PATH_INFO: `/v3/users/f1d98f358ae04fc9b794fd69331d4663` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:26.526022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bb1cc-1d6b-4e7a-ac3b-b3a15fd36a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d98f358ae04fc9b794fd69331d4663)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:26.528569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bb1cc-1d6b-4e7a-ac3b-b3a15fd36a6c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:26.582994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:26.623100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:26.648704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e962f2-1ae8-4d97-ac0a-fabd21d8ea1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:26.654852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e962f2-1ae8-4d97-ac0a-fabd21d8ea1b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:26.679304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-566bb1cc-1d6b-4e7a-ac3b-b3a15fd36a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d98f358ae04fc9b794fd69331d4663'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:26.680156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-566bb1cc-1d6b-4e7a-ac3b-b3a15fd36a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d98f358ae04fc9b794fd69331d4663'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:26.700505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-566bb1cc-1d6b-4e7a-ac3b-b3a15fd36a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d98f358ae04fc9b794fd69331d4663'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:26.717094 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2448/4871] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:26 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:26.719759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-566bb1cc-1d6b-4e7a-ac3b-b3a15fd36a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d98f358ae04fc9b794fd69331d4663'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:26.743990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-566bb1cc-1d6b-4e7a-ac3b-b3a15fd36a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d98f358ae04fc9b794fd69331d4663'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:26.763172 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2424/4872] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:26 2022] DELETE /identity/v3/users/f1d98f358ae04fc9b794fd69331d4663 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:26.771616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b921ea-e94d-44ac-98d5-84a4e3ff325c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:26.772840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b921ea-e94d-44ac-98d5-84a4e3ff325c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:26.773574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b921ea-e94d-44ac-98d5-84a4e3ff325c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:26.823558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b8b921ea-e94d-44ac-98d5-84a4e3ff325c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:26.826611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b8b921ea-e94d-44ac-98d5-84a4e3ff325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:27.066573 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2449/4873] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:27.075973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133cbd0-67d1-4d44-810c-98952b97aa12 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:27.076440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133cbd0-67d1-4d44-810c-98952b97aa12 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:27.076890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133cbd0-67d1-4d44-810c-98952b97aa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:27.096682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b921ea-e94d-44ac-98d5-84a4e3ff325c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:27.098710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b8b921ea-e94d-44ac-98d5-84a4e3ff325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:27.147142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3133cbd0-67d1-4d44-810c-98952b97aa12 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:27.152021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3133cbd0-67d1-4d44-810c-98952b97aa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:27.290562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b921ea-e94d-44ac-98d5-84a4e3ff325c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:27.301090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c249b04-d2ba-4e94-bd4d-8eab103a26ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:27.301760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c249b04-d2ba-4e94-bd4d-8eab103a26ee service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:27.305330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c249b04-d2ba-4e94-bd4d-8eab103a26ee service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:27.305872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c249b04-d2ba-4e94-bd4d-8eab103a26ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:27.333625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c249b04-d2ba-4e94-bd4d-8eab103a26ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:27.337329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c249b04-d2ba-4e94-bd4d-8eab103a26ee service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:27.346391 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2425/4874] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:47:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:27.370040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133cbd0-67d1-4d44-810c-98952b97aa12 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:27.371164 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2450/4875] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:47:27.371961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3133cbd0-67d1-4d44-810c-98952b97aa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:27.592229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133cbd0-67d1-4d44-810c-98952b97aa12 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:27.600390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30838e-0832-4f94-b01c-093925eeb93d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:27.601070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30838e-0832-4f94-b01c-093925eeb93d service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:27.601353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30838e-0832-4f94-b01c-093925eeb93d service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:27.601675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30838e-0832-4f94-b01c-093925eeb93d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:27.626288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30838e-0832-4f94-b01c-093925eeb93d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:27.629033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30838e-0832-4f94-b01c-093925eeb93d service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:27.657840 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2426/4876] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:47:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:47:28.398095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ffd15-a2f0-4a1e-88b0-675418067b2e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:28.398640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ffd15-a2f0-4a1e-88b0-675418067b2e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:28.398910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ffd15-a2f0-4a1e-88b0-675418067b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:28.451699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0a2ffd15-a2f0-4a1e-88b0-675418067b2e None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:28.453521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0a2ffd15-a2f0-4a1e-88b0-675418067b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:28.484224 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2451/4877] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:28.505746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30838e-0832-4f94-b01c-093925eeb93d service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:28.524980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30838e-0832-4f94-b01c-093925eeb93d service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:28.532747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919e1f6-421f-4dd6-bffb-09a764619331 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:28.544861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919e1f6-421f-4dd6-bffb-09a764619331 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:28.545323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919e1f6-421f-4dd6-bffb-09a764619331 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:28.545814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919e1f6-421f-4dd6-bffb-09a764619331 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:28.557976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919e1f6-421f-4dd6-bffb-09a764619331 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:28.561334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919e1f6-421f-4dd6-bffb-09a764619331 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:28.571588 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2427/4878] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:47:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:28.976023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ffd15-a2f0-4a1e-88b0-675418067b2e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:28.978197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0a2ffd15-a2f0-4a1e-88b0-675418067b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:29.203470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:29.205162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919e1f6-421f-4dd6-bffb-09a764619331 service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:29.207049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6919e1f6-421f-4dd6-bffb-09a764619331 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:29.235363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919e1f6-421f-4dd6-bffb-09a764619331 service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:29.255852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:29.259394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:29.260481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:29.262005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] PATH_INFO: `/v3/projects/b52f6808f82f49a39ea7fdf4a82baf6c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:29.265288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ffd15-a2f0-4a1e-88b0-675418067b2e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:29.268897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52f6808f82f49a39ea7fdf4a82baf6c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:29.274969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:29.281469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:29.283314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1f81e-8c64-4ee4-b1ae-d3fa0c8497c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:29.284356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1f81e-8c64-4ee4-b1ae-d3fa0c8497c7 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:29.284829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1f81e-8c64-4ee4-b1ae-d3fa0c8497c7 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:29.285342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1f81e-8c64-4ee4-b1ae-d3fa0c8497c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:29.288947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-26c1f81e-8c64-4ee4-b1ae-d3fa0c8497c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:29.406257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52f6808f82f49a39ea7fdf4a82baf6c', 'request_id': 'req-8dd0a254-89b5-482d-8895-34b5064ff4c0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.422503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52f6808f82f49a39ea7fdf4a82baf6c', 'request_id': 'req-8dd0a254-89b5-482d-8895-34b5064ff4c0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.457322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1f81e-8c64-4ee4-b1ae-d3fa0c8497c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:29.460629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52f6808f82f49a39ea7fdf4a82baf6c', 'request_id': 'req-8dd0a254-89b5-482d-8895-34b5064ff4c0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.466412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1f81e-8c64-4ee4-b1ae-d3fa0c8497c7 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:29.491421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] The token cache is being invalidate because project b52f6808f82f49a39ea7fdf4a82baf6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:29.493808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.497152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.505015 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2428/4879] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:29 2022] DELETE /identity/v3/projects/b52f6808f82f49a39ea7fdf4a82baf6c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:29.512610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:29.518387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:29.532588 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2452/4880] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:47:29.699021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1f81e-8c64-4ee4-b1ae-d3fa0c8497c7 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:29.700591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-26c1f81e-8c64-4ee4-b1ae-d3fa0c8497c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:29.728765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1f81e-8c64-4ee4-b1ae-d3fa0c8497c7 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:29.765681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0a254-89b5-482d-8895-34b5064ff4c0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:29.774078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:29.777077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:29.777077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:29.777077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] PATH_INFO: `/v3/users/e797531db3ca40d68cf39e9ca9b192dd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:29.777077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e797531db3ca40d68cf39e9ca9b192dd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:29.780917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:29.892616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c34b4-e1e5-459b-b6bb-efa6a7ca1a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:29.893628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c34b4-e1e5-459b-b6bb-efa6a7ca1a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:29.894008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c34b4-e1e5-459b-b6bb-efa6a7ca1a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:29.894606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c34b4-e1e5-459b-b6bb-efa6a7ca1a19 admin admin] PATH_INFO: `/v3/users/3dd53cf1dd3343d989e650620d853c0c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:29.897369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c34b4-e1e5-459b-b6bb-efa6a7ca1a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd53cf1dd3343d989e650620d853c0c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:29.901042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c34b4-e1e5-459b-b6bb-efa6a7ca1a19 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:29.950068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e797531db3ca40d68cf39e9ca9b192dd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.951351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e797531db3ca40d68cf39e9ca9b192dd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:29.987149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e797531db3ca40d68cf39e9ca9b192dd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:30.005917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e797531db3ca40d68cf39e9ca9b192dd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:30.025096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e797531db3ca40d68cf39e9ca9b192dd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:30.034470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-872c34b4-e1e5-459b-b6bb-efa6a7ca1a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd53cf1dd3343d989e650620d853c0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:30.038724 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2429/4881] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:29 2022] DELETE /identity/v3/users/e797531db3ca40d68cf39e9ca9b192dd => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:30.039026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-872c34b4-e1e5-459b-b6bb-efa6a7ca1a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd53cf1dd3343d989e650620d853c0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:30.074528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-872c34b4-e1e5-459b-b6bb-efa6a7ca1a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd53cf1dd3343d989e650620d853c0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:30.075866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-872c34b4-e1e5-459b-b6bb-efa6a7ca1a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd53cf1dd3343d989e650620d853c0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:30.096046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-872c34b4-e1e5-459b-b6bb-efa6a7ca1a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd53cf1dd3343d989e650620d853c0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:30.119620 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2453/4882] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:29 2022] DELETE /identity/v3/users/3dd53cf1dd3343d989e650620d853c0c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:30.870521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:30.872035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:30.887819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:31.020198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03eace0-0f47-4291-b34f-39f1c7a9224e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:31.109423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:31.110030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:31.110350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:31.110685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] PATH_INFO: `/v3/projects/c694100bb1f945b79ae0010754b82add` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:31.113950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c694100bb1f945b79ae0010754b82add)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:31.116923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:31.220736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c694100bb1f945b79ae0010754b82add', 'request_id': 'req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:31.236684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c694100bb1f945b79ae0010754b82add', 'request_id': 'req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:31.256646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c694100bb1f945b79ae0010754b82add', 'request_id': 'req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:31.276357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] The token cache is being invalidate because project c694100bb1f945b79ae0010754b82add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:31.277112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:31.278046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bf6b5f0e-3b49-42d1-ae38-ae56fe6eb363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:31.281970 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2430/4883] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:30 2022] DELETE /identity/v3/projects/c694100bb1f945b79ae0010754b82add => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:31.289218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1a92-76de-4702-91d5-d1ce2398fa05 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:31.289810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1a92-76de-4702-91d5-d1ce2398fa05 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:31.289810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1a92-76de-4702-91d5-d1ce2398fa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:31.306999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:31.324756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6ebc1a92-76de-4702-91d5-d1ce2398fa05 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:31.326033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6ebc1a92-76de-4702-91d5-d1ce2398fa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:31.419354 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2454/4884] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:31.427151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf6af3-6697-4e5b-99e4-2a610cc321e0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:31.427494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf6af3-6697-4e5b-99e4-2a610cc321e0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:31.428240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf6af3-6697-4e5b-99e4-2a610cc321e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:31.461615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3dcf6af3-6697-4e5b-99e4-2a610cc321e0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:31.463862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3dcf6af3-6697-4e5b-99e4-2a610cc321e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:31.479037 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2431/4885] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:31.480308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc1a92-76de-4702-91d5-d1ce2398fa05 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:31.493367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc1a92-76de-4702-91d5-d1ce2398fa05 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:31.516617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f047c68-8298-4d2a-ab24-433482f08dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:31.518778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f047c68-8298-4d2a-ab24-433482f08dad admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:31.519834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f047c68-8298-4d2a-ab24-433482f08dad admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:31.522253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f047c68-8298-4d2a-ab24-433482f08dad admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:31.523261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f047c68-8298-4d2a-ab24-433482f08dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:31.524675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f047c68-8298-4d2a-ab24-433482f08dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:31.530203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f047c68-8298-4d2a-ab24-433482f08dad admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:31.557011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf6af3-6697-4e5b-99e4-2a610cc321e0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:31.571718 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2455/4886] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:31.572133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf6af3-6697-4e5b-99e4-2a610cc321e0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:31.586501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40c544-e66d-474b-b091-1d72e1c73ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:31.588848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40c544-e66d-474b-b091-1d72e1c73ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:31.589179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40c544-e66d-474b-b091-1d72e1c73ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:31.589493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40c544-e66d-474b-b091-1d72e1c73ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:31.590160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40c544-e66d-474b-b091-1d72e1c73ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:31.596085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40c544-e66d-474b-b091-1d72e1c73ed7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:31.652481 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2432/4887] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:31 2022] POST /identity/v3/projects => generated 401 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:31.656628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f047c68-8298-4d2a-ab24-433482f08dad admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:31.669961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f047c68-8298-4d2a-ab24-433482f08dad admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:31.778631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd6dce-4a88-4a96-84a4-bcda682f4508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:31.779511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd6dce-4a88-4a96-84a4-bcda682f4508 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:31.779899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd6dce-4a88-4a96-84a4-bcda682f4508 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:31.780247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd6dce-4a88-4a96-84a4-bcda682f4508 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:31.781019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd6dce-4a88-4a96-84a4-bcda682f4508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:31.783327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd6dce-4a88-4a96-84a4-bcda682f4508 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:31.818445 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2456/4888] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:31 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:31.823328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40c544-e66d-474b-b091-1d72e1c73ed7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:31.850774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40c544-e66d-474b-b091-1d72e1c73ed7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:31.861891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f15eb-f591-4f4c-90be-6815afafe6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:31.862904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f15eb-f591-4f4c-90be-6815afafe6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:31.863379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f15eb-f591-4f4c-90be-6815afafe6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:31.863865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f15eb-f591-4f4c-90be-6815afafe6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:31.864746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f15eb-f591-4f4c-90be-6815afafe6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:31.868176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f15eb-f591-4f4c-90be-6815afafe6d8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:31.880008 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2433/4889] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:31.884102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd6dce-4a88-4a96-84a4-bcda682f4508 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:31.896237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd6dce-4a88-4a96-84a4-bcda682f4508 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:31.903914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c4032-db77-4bd2-a7ce-7402affe3173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:31.905085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c4032-db77-4bd2-a7ce-7402affe3173 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:31.905871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c4032-db77-4bd2-a7ce-7402affe3173 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:31.906440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c4032-db77-4bd2-a7ce-7402affe3173 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:31.907388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c4032-db77-4bd2-a7ce-7402affe3173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:31.909559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c4032-db77-4bd2-a7ce-7402affe3173 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:31.929086 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2457/4890] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:31.931327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f15eb-f591-4f4c-90be-6815afafe6d8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:31.943285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f15eb-f591-4f4c-90be-6815afafe6d8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:31.948481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5f9e8-560a-4798-a1f2-f2d81fb17053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:31.949168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5f9e8-560a-4798-a1f2-f2d81fb17053 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:31.949631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5f9e8-560a-4798-a1f2-f2d81fb17053 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:31.949910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5f9e8-560a-4798-a1f2-f2d81fb17053 admin admin] PATH_INFO: `/v3/projects/510cb6ab411e46d2a152bc8a5fc0b52d/users/d344a7e304164507b31c4caf871561aa/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:31.953604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:31.975102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5f9e8-560a-4798-a1f2-f2d81fb17053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510cb6ab411e46d2a152bc8a5fc0b52d, user_id=d344a7e304164507b31c4caf871561aa, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:31.985964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5f9e8-560a-4798-a1f2-f2d81fb17053 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:32.003184 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2434/4891] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:31 2022] PUT /identity/v3/projects/510cb6ab411e46d2a152bc8a5fc0b52d/users/d344a7e304164507b31c4caf871561aa/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:32.014800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4b0fc-fa45-439c-b009-abeb998241bc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:32.015088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4b0fc-fa45-439c-b009-abeb998241bc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:32.015520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4b0fc-fa45-439c-b009-abeb998241bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:32.081819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-95b4b0fc-fa45-439c-b009-abeb998241bc None None] MFA Rules not processed for user `d344a7e304164507b31c4caf871561aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:32.083009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-95b4b0fc-fa45-439c-b009-abeb998241bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:32.182500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:32.198926 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2458/4892] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:32.220221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5f9e8-560a-4798-a1f2-f2d81fb17053 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:32.223805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7bb5f9e8-560a-4798-a1f2-f2d81fb17053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:32.347205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5f9e8-560a-4798-a1f2-f2d81fb17053 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:32.352581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:32.353230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:32.353543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:32.353826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] PATH_INFO: `/v3/projects/fd3235b48fc246478dedce0707ab2670` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:32.354988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd3235b48fc246478dedce0707ab2670)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:32.356919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:32.389885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4b0fc-fa45-439c-b009-abeb998241bc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:32.404015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4b0fc-fa45-439c-b009-abeb998241bc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:32.412275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a4fc8-09d0-48af-ad9f-a89241e4efa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:32.413267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a4fc8-09d0-48af-ad9f-a89241e4efa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:32.414365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a4fc8-09d0-48af-ad9f-a89241e4efa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:32.415127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a4fc8-09d0-48af-ad9f-a89241e4efa4 admin admin] PATH_INFO: `/v3/users/d344a7e304164507b31c4caf871561aa` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:32.416967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a4fc8-09d0-48af-ad9f-a89241e4efa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d344a7e304164507b31c4caf871561aa)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:32.420204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a4fc8-09d0-48af-ad9f-a89241e4efa4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:32.440400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd3235b48fc246478dedce0707ab2670', 'request_id': 'req-fd716b2a-3465-4613-b3a0-77ad11a6d9af'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:32.447305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd3235b48fc246478dedce0707ab2670', 'request_id': 'req-fd716b2a-3465-4613-b3a0-77ad11a6d9af'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:32.456051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd3235b48fc246478dedce0707ab2670', 'request_id': 'req-fd716b2a-3465-4613-b3a0-77ad11a6d9af'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:32.481186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] The token cache is being invalidate because project fd3235b48fc246478dedce0707ab2670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:32.482043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:32.484576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fd716b2a-3465-4613-b3a0-77ad11a6d9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:32.486974 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2435/4893] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:32 2022] DELETE /identity/v3/projects/fd3235b48fc246478dedce0707ab2670 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:32.493048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e9de-4ec8-4410-b264-8b71d7a41909 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:32.493449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e9de-4ec8-4410-b264-8b71d7a41909 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:32.493868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e9de-4ec8-4410-b264-8b71d7a41909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:32.506826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-999a4fc8-09d0-48af-ad9f-a89241e4efa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd344a7e304164507b31c4caf871561aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:32.507867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-999a4fc8-09d0-48af-ad9f-a89241e4efa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd344a7e304164507b31c4caf871561aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:32.524513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-999a4fc8-09d0-48af-ad9f-a89241e4efa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd344a7e304164507b31c4caf871561aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:32.525925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-999a4fc8-09d0-48af-ad9f-a89241e4efa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd344a7e304164507b31c4caf871561aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:32.531970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0ed9e9de-4ec8-4410-b264-8b71d7a41909 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:32.533613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0ed9e9de-4ec8-4410-b264-8b71d7a41909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:32.535416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-999a4fc8-09d0-48af-ad9f-a89241e4efa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd344a7e304164507b31c4caf871561aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:32.554860 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2459/4894] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:32 2022] DELETE /identity/v3/users/d344a7e304164507b31c4caf871561aa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:32.560099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c324f-18ba-4809-901e-bbfefc35019f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:32.561264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c324f-18ba-4809-901e-bbfefc35019f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:32.561830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c324f-18ba-4809-901e-bbfefc35019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:32.624474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-692c324f-18ba-4809-901e-bbfefc35019f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:32.626212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-692c324f-18ba-4809-901e-bbfefc35019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:32.668729 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2436/4895] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:32.679025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3b42f-9024-4a9e-a511-807f4f43ca16 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:32.679320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3b42f-9024-4a9e-a511-807f4f43ca16 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:32.680094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3b42f-9024-4a9e-a511-807f4f43ca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:32.715377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-67d3b42f-9024-4a9e-a511-807f4f43ca16 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:32.716640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-67d3b42f-9024-4a9e-a511-807f4f43ca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:32.736822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:32.745067 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2460/4896] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:32.765554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c324f-18ba-4809-901e-bbfefc35019f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:32.767104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-692c324f-18ba-4809-901e-bbfefc35019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:32.857918 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2437/4897] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:32.861514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c324f-18ba-4809-901e-bbfefc35019f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:32.868093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3b42f-9024-4a9e-a511-807f4f43ca16 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:32.873123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089a4c-b6b0-4fc9-b30f-faa23421dfe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:32.873849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089a4c-b6b0-4fc9-b30f-faa23421dfe5 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:32.874200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089a4c-b6b0-4fc9-b30f-faa23421dfe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:32.874475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089a4c-b6b0-4fc9-b30f-faa23421dfe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:32.878242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3b42f-9024-4a9e-a511-807f4f43ca16 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:32.890721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba2458-f62c-4378-9ca4-07331ad2d158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:32.891393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba2458-f62c-4378-9ca4-07331ad2d158 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:32.891867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba2458-f62c-4378-9ca4-07331ad2d158 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:32.892975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22089a4c-b6b0-4fc9-b30f-faa23421dfe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:32.893123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba2458-f62c-4378-9ca4-07331ad2d158 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:32.893927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba2458-f62c-4378-9ca4-07331ad2d158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:32.894039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba2458-f62c-4378-9ca4-07331ad2d158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:32.894529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22089a4c-b6b0-4fc9-b30f-faa23421dfe5 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:32.895810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba2458-f62c-4378-9ca4-07331ad2d158 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:32.919879 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2461/4898] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:32.920970 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2438/4899] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:47:32.922428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089a4c-b6b0-4fc9-b30f-faa23421dfe5 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:32.940710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089a4c-b6b0-4fc9-b30f-faa23421dfe5 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:32.964277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f5e94-e856-4242-9628-89e04977643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:32.967149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5e94-e856-4242-9628-89e04977643d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:32.970705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5e94-e856-4242-9628-89e04977643d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:32.971928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5e94-e856-4242-9628-89e04977643d admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:32.974234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f5e94-e856-4242-9628-89e04977643d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:32.979356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f5e94-e856-4242-9628-89e04977643d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:33.012545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:33.065077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba2458-f62c-4378-9ca4-07331ad2d158 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:33.072325 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2462/4900] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:32 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:33.073067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba2458-f62c-4378-9ca4-07331ad2d158 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:33.164824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20139e6a-8d0e-4620-8136-c0e8cfd5a8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:33.166988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20139e6a-8d0e-4620-8136-c0e8cfd5a8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:33.167327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20139e6a-8d0e-4620-8136-c0e8cfd5a8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:33.167909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20139e6a-8d0e-4620-8136-c0e8cfd5a8d7 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:33.168720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20139e6a-8d0e-4620-8136-c0e8cfd5a8d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:33.172575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20139e6a-8d0e-4620-8136-c0e8cfd5a8d7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:33.212984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f5e94-e856-4242-9628-89e04977643d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:33.214404 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2439/4901] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:33 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:33.235151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f5e94-e856-4242-9628-89e04977643d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:33.243844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24398424-df08-4bed-8602-fdaadd90fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:33.244708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398424-df08-4bed-8602-fdaadd90fcbc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:33.245356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398424-df08-4bed-8602-fdaadd90fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:33.245937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398424-df08-4bed-8602-fdaadd90fcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:33.246814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24398424-df08-4bed-8602-fdaadd90fcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:33.249255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24398424-df08-4bed-8602-fdaadd90fcbc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:33.267769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20139e6a-8d0e-4620-8136-c0e8cfd5a8d7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:33.270378 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2463/4902] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:33.286228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20139e6a-8d0e-4620-8136-c0e8cfd5a8d7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:33.293119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706a814-5ec8-4b4c-a83b-a2f16ab37777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:33.294027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706a814-5ec8-4b4c-a83b-a2f16ab37777 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:33.294027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706a814-5ec8-4b4c-a83b-a2f16ab37777 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:33.294322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706a814-5ec8-4b4c-a83b-a2f16ab37777 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:33.295236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706a814-5ec8-4b4c-a83b-a2f16ab37777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:33.299194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706a814-5ec8-4b4c-a83b-a2f16ab37777 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:33.320253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24398424-df08-4bed-8602-fdaadd90fcbc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:33.322689 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2440/4903] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:33.335334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24398424-df08-4bed-8602-fdaadd90fcbc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:33.341778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb30c2c-e797-42f6-a10f-866c5e738e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:33.342514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30c2c-e797-42f6-a10f-866c5e738e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:33.342933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30c2c-e797-42f6-a10f-866c5e738e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:33.343263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30c2c-e797-42f6-a10f-866c5e738e67 admin admin] PATH_INFO: `/v3/projects/c4c55425876345859e8b201594240602/users/9d5d0e42622842e6939c837b081dd170/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:33.365523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb30c2c-e797-42f6-a10f-866c5e738e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c55425876345859e8b201594240602, user_id=9d5d0e42622842e6939c837b081dd170, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:33.368521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb30c2c-e797-42f6-a10f-866c5e738e67 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:33.416847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e9ab2-eb58-466a-8e03-baa407cffd10 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:33.417537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e9ab2-eb58-466a-8e03-baa407cffd10 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:33.418280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e9ab2-eb58-466a-8e03-baa407cffd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:33.418429 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2464/4904] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:33 2022] PUT /identity/v3/projects/c4c55425876345859e8b201594240602/users/9d5d0e42622842e6939c837b081dd170/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:33.467315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f44e9ab2-eb58-466a-8e03-baa407cffd10 None None] MFA Rules not processed for user `9d5d0e42622842e6939c837b081dd170`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:33.469124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f44e9ab2-eb58-466a-8e03-baa407cffd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:33.562441 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2441/4905] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:33.566624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb30c2c-e797-42f6-a10f-866c5e738e67 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:33.650558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb30c2c-e797-42f6-a10f-866c5e738e67 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:33.657326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d3208-d983-4ae6-a3b0-59287901df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:33.657596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d3208-d983-4ae6-a3b0-59287901df78 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:33.657859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d3208-d983-4ae6-a3b0-59287901df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:33.658210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d3208-d983-4ae6-a3b0-59287901df78 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:33.659464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d3208-d983-4ae6-a3b0-59287901df78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:33.661511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d3208-d983-4ae6-a3b0-59287901df78 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:33.715375 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2465/4906] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:33 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:33.717291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e9ab2-eb58-466a-8e03-baa407cffd10 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:33.734744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e9ab2-eb58-466a-8e03-baa407cffd10 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:33.742843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:33.807773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e7ff6-ffac-4bc6-b249-e7d9bdf06ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:33.809247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e7ff6-ffac-4bc6-b249-e7d9bdf06ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:33.809247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e7ff6-ffac-4bc6-b249-e7d9bdf06ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:33.809247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e7ff6-ffac-4bc6-b249-e7d9bdf06ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:33.809652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e7ff6-ffac-4bc6-b249-e7d9bdf06ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:33.812869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e7ff6-ffac-4bc6-b249-e7d9bdf06ec6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:33.839857 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2442/4907] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:33 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:33.843448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d3208-d983-4ae6-a3b0-59287901df78 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:33.854387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d3208-d983-4ae6-a3b0-59287901df78 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:33.860115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba4ac4-1142-4384-a82a-be099e11e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:33.860865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba4ac4-1142-4384-a82a-be099e11e7ce admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:33.861424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba4ac4-1142-4384-a82a-be099e11e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:33.861556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba4ac4-1142-4384-a82a-be099e11e7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:33.862281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba4ac4-1142-4384-a82a-be099e11e7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:33.863979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba4ac4-1142-4384-a82a-be099e11e7ce admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:33.877993 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2466/4908] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:47:33.882493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e7ff6-ffac-4bc6-b249-e7d9bdf06ec6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:33.894727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e7ff6-ffac-4bc6-b249-e7d9bdf06ec6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:33.900731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7348ff8-99df-4544-95b5-406abcd82d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:33.901640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7348ff8-99df-4544-95b5-406abcd82d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:33.902038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7348ff8-99df-4544-95b5-406abcd82d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:33.902407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7348ff8-99df-4544-95b5-406abcd82d7f admin admin] PATH_INFO: `/v3/projects/9ee48b02ac9c49b1b2bbef38c4546142/users/f1e09a83964a44ac89bceaf43e28015c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:33.919172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7348ff8-99df-4544-95b5-406abcd82d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee48b02ac9c49b1b2bbef38c4546142, user_id=f1e09a83964a44ac89bceaf43e28015c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:33.922559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7348ff8-99df-4544-95b5-406abcd82d7f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:33.943239 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2443/4909] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:33 2022] PUT /identity/v3/projects/9ee48b02ac9c49b1b2bbef38c4546142/users/f1e09a83964a44ac89bceaf43e28015c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:33.952312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba4ac4-1142-4384-a82a-be099e11e7ce admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:33.981909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba4ac4-1142-4384-a82a-be099e11e7ce admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:34.068608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca61f83-2544-483e-bb1f-0b38023f2d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:34.069512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca61f83-2544-483e-bb1f-0b38023f2d42 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:34.069791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca61f83-2544-483e-bb1f-0b38023f2d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:34.070455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca61f83-2544-483e-bb1f-0b38023f2d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:34.071698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca61f83-2544-483e-bb1f-0b38023f2d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:34.076106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca61f83-2544-483e-bb1f-0b38023f2d42 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:34.092311 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2467/4910] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:34.096279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7348ff8-99df-4544-95b5-406abcd82d7f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:34.120777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7348ff8-99df-4544-95b5-406abcd82d7f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:34.130753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9de31-4ced-435c-a9c1-b193abbd8b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:34.131661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9de31-4ced-435c-a9c1-b193abbd8b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:34.132559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9de31-4ced-435c-a9c1-b193abbd8b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:34.132999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9de31-4ced-435c-a9c1-b193abbd8b82 admin admin] PATH_INFO: `/v3/projects/9ee48b02ac9c49b1b2bbef38c4546142/users/f1e09a83964a44ac89bceaf43e28015c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:34.135222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9de31-4ced-435c-a9c1-b193abbd8b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee48b02ac9c49b1b2bbef38c4546142, user_id=f1e09a83964a44ac89bceaf43e28015c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:34.138078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9de31-4ced-435c-a9c1-b193abbd8b82 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:34.171570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075f9cf-dde9-4f38-b79a-b3d920376063 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:34.171861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075f9cf-dde9-4f38-b79a-b3d920376063 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:34.172143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075f9cf-dde9-4f38-b79a-b3d920376063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:34.175493 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2444/4911] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:34 2022] PUT /identity/v3/projects/9ee48b02ac9c49b1b2bbef38c4546142/users/f1e09a83964a44ac89bceaf43e28015c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:34.243489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7075f9cf-dde9-4f38-b79a-b3d920376063 None None] MFA Rules not processed for user `f1e09a83964a44ac89bceaf43e28015c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:34.244810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7075f9cf-dde9-4f38-b79a-b3d920376063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:34.279923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:34.414375 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2468/4912] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:34.419247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9de31-4ced-435c-a9c1-b193abbd8b82 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:34.432956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9de31-4ced-435c-a9c1-b193abbd8b82 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:34.453970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183d943-b80c-4857-8fe1-dae230dfd130 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:34.454674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d943-b80c-4857-8fe1-dae230dfd130 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:34.455055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d943-b80c-4857-8fe1-dae230dfd130 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:34.455705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d943-b80c-4857-8fe1-dae230dfd130 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:34.456403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183d943-b80c-4857-8fe1-dae230dfd130 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:34.458634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183d943-b80c-4857-8fe1-dae230dfd130 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:34.500908 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2445/4913] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:47:34 2022] POST /identity/v3/services => generated 241 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:34.511037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075f9cf-dde9-4f38-b79a-b3d920376063 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:34.523788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075f9cf-dde9-4f38-b79a-b3d920376063 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:34.563895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dd5e1-0883-4616-ad01-8d3faeff4c1c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:34.564673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dd5e1-0883-4616-ad01-8d3faeff4c1c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:34.564956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dd5e1-0883-4616-ad01-8d3faeff4c1c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:34.565340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dd5e1-0883-4616-ad01-8d3faeff4c1c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services/bad415ecd063416b8bca6420c85d179d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:34.565961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dd5e1-0883-4616-ad01-8d3faeff4c1c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bad415ecd063416b8bca6420c85d179d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:34.568223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dd5e1-0883-4616-ad01-8d3faeff4c1c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:34.606276 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2469/4914] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:34 2022] DELETE /identity/v3/services/bad415ecd063416b8bca6420c85d179d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:34.607914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183d943-b80c-4857-8fe1-dae230dfd130 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:34.621525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183d943-b80c-4857-8fe1-dae230dfd130 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:34.642571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093c75a-d03a-43cc-98dc-68b2a59763d4 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:34.643685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c75a-d03a-43cc-98dc-68b2a59763d4 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:34.644329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c75a-d03a-43cc-98dc-68b2a59763d4 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:34.644828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c75a-d03a-43cc-98dc-68b2a59763d4 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:34.646182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093c75a-d03a-43cc-98dc-68b2a59763d4 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:34.648523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093c75a-d03a-43cc-98dc-68b2a59763d4 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:34.673882 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2446/4915] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:34 2022] POST /identity/v3/services => generated 289 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:34.675122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dd5e1-0883-4616-ad01-8d3faeff4c1c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:34.691476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dd5e1-0883-4616-ad01-8d3faeff4c1c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:34.724761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12575500-863a-418d-af8d-1a07c7884e5b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:34.745942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12575500-863a-418d-af8d-1a07c7884e5b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:34.747203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12575500-863a-418d-af8d-1a07c7884e5b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:34.747707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12575500-863a-418d-af8d-1a07c7884e5b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services/4122ebeafdb54abc9289e25f3e93f73c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:34.753444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12575500-863a-418d-af8d-1a07c7884e5b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:update_service(service_id=4122ebeafdb54abc9289e25f3e93f73c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:34.760801 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-12575500-863a-418d-af8d-1a07c7884e5b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:34.760801 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:34.760801 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:34.763058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12575500-863a-418d-af8d-1a07c7884e5b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:34.811740 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2470/4916] 10.222.0.16 () {60 vars in 1252 bytes} [Mon Aug 29 15:47:34 2022] PATCH /identity/v3/services/4122ebeafdb54abc9289e25f3e93f73c => generated 282 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:34.818323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093c75a-d03a-43cc-98dc-68b2a59763d4 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:34.837029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093c75a-d03a-43cc-98dc-68b2a59763d4 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:34.864421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f97c5-4e0b-4663-96a3-fdbc9b834e8b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:34.865141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f97c5-4e0b-4663-96a3-fdbc9b834e8b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:34.865982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f97c5-4e0b-4663-96a3-fdbc9b834e8b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:34.866458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f97c5-4e0b-4663-96a3-fdbc9b834e8b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services/4122ebeafdb54abc9289e25f3e93f73c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:34.867067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f97c5-4e0b-4663-96a3-fdbc9b834e8b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:get_service(service_id=4122ebeafdb54abc9289e25f3e93f73c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:34.868479 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-a47f97c5-4e0b-4663-96a3-fdbc9b834e8b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:34.868479 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:34.868479 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:34.869559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f97c5-4e0b-4663-96a3-fdbc9b834e8b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:34.880498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2447/4917] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:47:34 2022] GET /identity/v3/services/4122ebeafdb54abc9289e25f3e93f73c => generated 282 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:34.881454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12575500-863a-418d-af8d-1a07c7884e5b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:34.894287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12575500-863a-418d-af8d-1a07c7884e5b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:34.900752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4173e2c-cf92-4e68-9e17-4d9e9f486678 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:34.901562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4173e2c-cf92-4e68-9e17-4d9e9f486678 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:34.901912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4173e2c-cf92-4e68-9e17-4d9e9f486678 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:34.902372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4173e2c-cf92-4e68-9e17-4d9e9f486678 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services/4122ebeafdb54abc9289e25f3e93f73c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:34.903026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4173e2c-cf92-4e68-9e17-4d9e9f486678 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4122ebeafdb54abc9289e25f3e93f73c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:34.904708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4173e2c-cf92-4e68-9e17-4d9e9f486678 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:34.957511 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2471/4918] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:34 2022] DELETE /identity/v3/services/4122ebeafdb54abc9289e25f3e93f73c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:34.961706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f97c5-4e0b-4663-96a3-fdbc9b834e8b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:34.973294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f97c5-4e0b-4663-96a3-fdbc9b834e8b tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.023937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83704fc5-4299-4bea-b476-2e5aced216b5 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.025005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83704fc5-4299-4bea-b476-2e5aced216b5 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.025592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83704fc5-4299-4bea-b476-2e5aced216b5 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.026092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83704fc5-4299-4bea-b476-2e5aced216b5 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services/4122ebeafdb54abc9289e25f3e93f73c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.026930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83704fc5-4299-4bea-b476-2e5aced216b5 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:get_service(service_id=4122ebeafdb54abc9289e25f3e93f73c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.028838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83704fc5-4299-4bea-b476-2e5aced216b5 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-83704fc5-4299-4bea-b476-2e5aced216b5 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Could not find service: 4122ebeafdb54abc9289e25f3e93f73c.: keystone.exception.ServiceNotFound: Could not find service: 4122ebeafdb54abc9289e25f3e93f73c. Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 4122ebeafdb54abc9289e25f3e93f73c. Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:35.058652 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:47:35.059890 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 4122ebeafdb54abc9289e25f3e93f73c. Aug 29 15:47:35.061072 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:35.069538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4173e2c-cf92-4e68-9e17-4d9e9f486678 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:35.069795 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2448/4919] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:47:34 2022] GET /identity/v3/services/4122ebeafdb54abc9289e25f3e93f73c => generated 113 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:47:35.088151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4173e2c-cf92-4e68-9e17-4d9e9f486678 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.093721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce84da-79e3-4202-aa9d-7c254434b99c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.094480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce84da-79e3-4202-aa9d-7c254434b99c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.094920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce84da-79e3-4202-aa9d-7c254434b99c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.095301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce84da-79e3-4202-aa9d-7c254434b99c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.096106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce84da-79e3-4202-aa9d-7c254434b99c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.097918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce84da-79e3-4202-aa9d-7c254434b99c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.122494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83704fc5-4299-4bea-b476-2e5aced216b5 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:35.132391 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2472/4920] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:35 2022] POST /identity/v3/services => generated 274 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:35.136629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83704fc5-4299-4bea-b476-2e5aced216b5 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.163615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a926dd-5d90-4b73-a37d-495511df2a1d tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.164643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a926dd-5d90-4b73-a37d-495511df2a1d tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.165478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a926dd-5d90-4b73-a37d-495511df2a1d tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.165478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a926dd-5d90-4b73-a37d-495511df2a1d tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.166255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a926dd-5d90-4b73-a37d-495511df2a1d tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.170638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a926dd-5d90-4b73-a37d-495511df2a1d tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.171861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce84da-79e3-4202-aa9d-7c254434b99c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:35.173937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-81ce84da-79e3-4202-aa9d-7c254434b99c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:35.216880 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2449/4921] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:35 2022] POST /identity/v3/services => generated 275 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:35.218460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a926dd-5d90-4b73-a37d-495511df2a1d tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:35.268003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a926dd-5d90-4b73-a37d-495511df2a1d tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.281397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcec9e-927b-4ef7-bd95-73e310da91e1 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.285134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcec9e-927b-4ef7-bd95-73e310da91e1 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.285677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcec9e-927b-4ef7-bd95-73e310da91e1 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.286562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcec9e-927b-4ef7-bd95-73e310da91e1 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.289043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcec9e-927b-4ef7-bd95-73e310da91e1 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.291184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcec9e-927b-4ef7-bd95-73e310da91e1 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.328535 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2450/4922] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:35 2022] POST /identity/v3/services => generated 274 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:35.330600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcec9e-927b-4ef7-bd95-73e310da91e1 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:35.356966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:35.378192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce84da-79e3-4202-aa9d-7c254434b99c tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.388142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcec9e-927b-4ef7-bd95-73e310da91e1 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.410014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebe7cd-4f41-420d-929c-5673b6b4f73e tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.410769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebe7cd-4f41-420d-929c-5673b6b4f73e tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.411238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebe7cd-4f41-420d-929c-5673b6b4f73e tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.413452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebe7cd-4f41-420d-929c-5673b6b4f73e tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.415238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebe7cd-4f41-420d-929c-5673b6b4f73e tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.418820 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-ddebe7cd-4f41-420d-929c-5673b6b4f73e tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:35.418820 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:35.418820 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:35.421952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebe7cd-4f41-420d-929c-5673b6b4f73e tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.424506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.426216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.428469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.429069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] PATH_INFO: `/v3/projects/510cb6ab411e46d2a152bc8a5fc0b52d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.431854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510cb6ab411e46d2a152bc8a5fc0b52d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.438683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.445861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:35.447489 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2451/4923] 10.222.0.16 () {58 vars in 1131 bytes} [Mon Aug 29 15:47:35 2022] GET /identity/v3/services => generated 2978 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:35.448251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebe7cd-4f41-420d-929c-5673b6b4f73e tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:35.476125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebe7cd-4f41-420d-929c-5673b6b4f73e tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.489474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85067c8-1cc6-4a6f-ba27-1ea7372784cc tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.490138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85067c8-1cc6-4a6f-ba27-1ea7372784cc tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.490428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85067c8-1cc6-4a6f-ba27-1ea7372784cc tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.490760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85067c8-1cc6-4a6f-ba27-1ea7372784cc tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.491413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85067c8-1cc6-4a6f-ba27-1ea7372784cc tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-853049290) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:35.491716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85067c8-1cc6-4a6f-ba27-1ea7372784cc tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.496877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85067c8-1cc6-4a6f-ba27-1ea7372784cc tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.516541 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2452/4924] 10.222.0.16 () {58 vars in 1220 bytes} [Mon Aug 29 15:47:35 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-853049290 => generated 416 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:35.517561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85067c8-1cc6-4a6f-ba27-1ea7372784cc tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:35.545712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510cb6ab411e46d2a152bc8a5fc0b52d', 'request_id': 'req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:35.549967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85067c8-1cc6-4a6f-ba27-1ea7372784cc tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.553019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510cb6ab411e46d2a152bc8a5fc0b52d', 'request_id': 'req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:35.562488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510cb6ab411e46d2a152bc8a5fc0b52d', 'request_id': 'req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:35.579637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] The token cache is being invalidate because project 510cb6ab411e46d2a152bc8a5fc0b52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:35.580342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:35.581167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-21a4ad1b-8da2-406b-9a8c-aa740e126fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:35.589532 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2473/4925] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:35 2022] DELETE /identity/v3/projects/510cb6ab411e46d2a152bc8a5fc0b52d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:35.592562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650dffa-ad50-4a3d-b634-8303eec44a01 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.592856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650dffa-ad50-4a3d-b634-8303eec44a01 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.593184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650dffa-ad50-4a3d-b634-8303eec44a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.625673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9650dffa-ad50-4a3d-b634-8303eec44a01 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:35.626821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9650dffa-ad50-4a3d-b634-8303eec44a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:35.699714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce65e0-0e0f-4cbb-8ea9-509f8226f7e2 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.702480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce65e0-0e0f-4cbb-8ea9-509f8226f7e2 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.702879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce65e0-0e0f-4cbb-8ea9-509f8226f7e2 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.703405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce65e0-0e0f-4cbb-8ea9-509f8226f7e2 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.704166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce65e0-0e0f-4cbb-8ea9-509f8226f7e2 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2088476067) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:35.705494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce65e0-0e0f-4cbb-8ea9-509f8226f7e2 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.707260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce65e0-0e0f-4cbb-8ea9-509f8226f7e2 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.724380 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2453/4926] 10.222.0.16 () {58 vars in 1222 bytes} [Mon Aug 29 15:47:35 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2088476067 => generated 418 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:35.729923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce65e0-0e0f-4cbb-8ea9-509f8226f7e2 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:35.732878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-94ce65e0-0e0f-4cbb-8ea9-509f8226f7e2 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:35.773295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce65e0-0e0f-4cbb-8ea9-509f8226f7e2 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.785844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a9ea7-a21c-4b44-9c2b-9c31ebb47b95 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.788400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a9ea7-a21c-4b44-9c2b-9c31ebb47b95 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.788802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a9ea7-a21c-4b44-9c2b-9c31ebb47b95 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.789879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a9ea7-a21c-4b44-9c2b-9c31ebb47b95 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.790805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a9ea7-a21c-4b44-9c2b-9c31ebb47b95 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1954194630) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:35.793105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a9ea7-a21c-4b44-9c2b-9c31ebb47b95 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.797508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a9ea7-a21c-4b44-9c2b-9c31ebb47b95 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.804081 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2474/4927] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:35 2022] POST /identity/v3/auth/tokens => generated 3741 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:35.811772 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2454/4928] 10.222.0.16 () {58 vars in 1222 bytes} [Mon Aug 29 15:47:35 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1954194630 => generated 417 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:47:35.812756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a9ea7-a21c-4b44-9c2b-9c31ebb47b95 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:35.812879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8879300-bb57-4c19-9212-4696430f87ac None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.813445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8879300-bb57-4c19-9212-4696430f87ac None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.813737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8879300-bb57-4c19-9212-4696430f87ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.827791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a9ea7-a21c-4b44-9c2b-9c31ebb47b95 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.834724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5fae6-069d-474e-98c8-30df68af5057 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.835436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5fae6-069d-474e-98c8-30df68af5057 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.835719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5fae6-069d-474e-98c8-30df68af5057 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.835993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5fae6-069d-474e-98c8-30df68af5057 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services/4c09583bd8894899b4cedf8da68b418a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.837279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5fae6-069d-474e-98c8-30df68af5057 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4c09583bd8894899b4cedf8da68b418a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.839389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5fae6-069d-474e-98c8-30df68af5057 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.845769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f8879300-bb57-4c19-9212-4696430f87ac None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:35.847355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f8879300-bb57-4c19-9212-4696430f87ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:35.886259 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2455/4929] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:35 2022] DELETE /identity/v3/services/4c09583bd8894899b4cedf8da68b418a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:35.887330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5fae6-069d-474e-98c8-30df68af5057 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:35.943190 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2475/4930] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:35 2022] POST /identity/v3/auth/tokens => generated 3574 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:35.944132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5fae6-069d-474e-98c8-30df68af5057 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.945481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8879300-bb57-4c19-9212-4696430f87ac None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:35.957424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8879300-bb57-4c19-9212-4696430f87ac None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:35.963569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fca67-5c6f-4506-9ba0-be49132285e0 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.964217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fca67-5c6f-4506-9ba0-be49132285e0 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.964555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fca67-5c6f-4506-9ba0-be49132285e0 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.964870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fca67-5c6f-4506-9ba0-be49132285e0 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services/9af3eefda0f44c698141731b13768af2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.965453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fca67-5c6f-4506-9ba0-be49132285e0 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9af3eefda0f44c698141731b13768af2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.967298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fca67-5c6f-4506-9ba0-be49132285e0 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.972190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2f2d-918b-4f71-9d8a-9ce6992b2186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:35.972833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2f2d-918b-4f71-9d8a-9ce6992b2186 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:35.973117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2f2d-918b-4f71-9d8a-9ce6992b2186 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:35.973562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2f2d-918b-4f71-9d8a-9ce6992b2186 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:35.974358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e2f2d-918b-4f71-9d8a-9ce6992b2186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:35.974756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e2f2d-918b-4f71-9d8a-9ce6992b2186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:35.976425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e2f2d-918b-4f71-9d8a-9ce6992b2186 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:35.998953 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2476/4931] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:36.001873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2f2d-918b-4f71-9d8a-9ce6992b2186 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:36.010628 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2456/4932] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:35 2022] DELETE /identity/v3/services/9af3eefda0f44c698141731b13768af2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:36.014765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fca67-5c6f-4506-9ba0-be49132285e0 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:36.028449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2f2d-918b-4f71-9d8a-9ce6992b2186 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:36.077744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e5905-2205-4e74-8145-01aa299da999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:36.078400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5905-2205-4e74-8145-01aa299da999 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:36.078693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5905-2205-4e74-8145-01aa299da999 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:36.078975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5905-2205-4e74-8145-01aa299da999 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:36.079638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e5905-2205-4e74-8145-01aa299da999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:36.082718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e5905-2205-4e74-8145-01aa299da999 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:36.103194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fca67-5c6f-4506-9ba0-be49132285e0 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:36.128370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd5d0d-4deb-4ec3-a40e-423921579472 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e09a83964a44ac89bceaf43e28015c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee48b02ac9c49b1b2bbef38c4546142', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:36.129503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd5d0d-4deb-4ec3-a40e-423921579472 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:36.131676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd5d0d-4deb-4ec3-a40e-423921579472 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:36.132186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd5d0d-4deb-4ec3-a40e-423921579472 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] PATH_INFO: `/v3/services/5d08e2baf6aa4d2ba3c4ec17bc953c80` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:36.133019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd5d0d-4deb-4ec3-a40e-423921579472 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5d08e2baf6aa4d2ba3c4ec17bc953c80)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:36.134912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd5d0d-4deb-4ec3-a40e-423921579472 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:36.144236 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2477/4933] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:36 2022] POST /identity/v3/projects => generated 359 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:36.145833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e5905-2205-4e74-8145-01aa299da999 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:36.185620 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2457/4934] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:36 2022] DELETE /identity/v3/services/5d08e2baf6aa4d2ba3c4ec17bc953c80 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:36.192321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd5d0d-4deb-4ec3-a40e-423921579472 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:36.195061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a3dd5d0d-4deb-4ec3-a40e-423921579472 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:36.208164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:36.231296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd5d0d-4deb-4ec3-a40e-423921579472 tempest-ServicesTestJSON-1960788917 tempest-ServicesTestJSON-1960788917-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:36.261482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e5905-2205-4e74-8145-01aa299da999 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:36.273775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ef445-5fc3-400c-bf05-03f25f1fe0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:36.274410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef445-5fc3-400c-bf05-03f25f1fe0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:36.274696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef445-5fc3-400c-bf05-03f25f1fe0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:36.274973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef445-5fc3-400c-bf05-03f25f1fe0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:36.276355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ef445-5fc3-400c-bf05-03f25f1fe0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:36.278828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ef445-5fc3-400c-bf05-03f25f1fe0c7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:36.299532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:36.317443 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2478/4935] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:36 2022] POST /identity/v3/users => generated 280 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:36.320639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ef445-5fc3-400c-bf05-03f25f1fe0c7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:36.338348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ef445-5fc3-400c-bf05-03f25f1fe0c7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:36.346441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9c2ec-0285-41b1-8dc9-5cfd63827d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:36.347261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9c2ec-0285-41b1-8dc9-5cfd63827d1b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:36.347607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9c2ec-0285-41b1-8dc9-5cfd63827d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:36.348031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9c2ec-0285-41b1-8dc9-5cfd63827d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:36.348841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9c2ec-0285-41b1-8dc9-5cfd63827d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:36.351003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40625ab-521c-4727-a83c-fbfd672eaac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:36.351307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9c2ec-0285-41b1-8dc9-5cfd63827d1b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:36.352985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40625ab-521c-4727-a83c-fbfd672eaac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:36.353683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40625ab-521c-4727-a83c-fbfd672eaac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:36.355106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40625ab-521c-4727-a83c-fbfd672eaac8 admin admin] PATH_INFO: `/v3/users/9d5d0e42622842e6939c837b081dd170` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:36.356650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40625ab-521c-4727-a83c-fbfd672eaac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5d0e42622842e6939c837b081dd170)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:36.359406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40625ab-521c-4727-a83c-fbfd672eaac8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:36.372474 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2479/4936] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:36.373669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9c2ec-0285-41b1-8dc9-5cfd63827d1b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:36.389836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9c2ec-0285-41b1-8dc9-5cfd63827d1b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:36.396711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8c5fa-3961-4de6-bd7c-5e2b1af3f628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:36.397420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8c5fa-3961-4de6-bd7c-5e2b1af3f628 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:36.397870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8c5fa-3961-4de6-bd7c-5e2b1af3f628 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:36.398143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8c5fa-3961-4de6-bd7c-5e2b1af3f628 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:36.399241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8c5fa-3961-4de6-bd7c-5e2b1af3f628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:36.401610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8c5fa-3961-4de6-bd7c-5e2b1af3f628 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:36.422784 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2480/4937] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:36.424149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8c5fa-3961-4de6-bd7c-5e2b1af3f628 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:36.431299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f40625ab-521c-4727-a83c-fbfd672eaac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5d0e42622842e6939c837b081dd170'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:36.432525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f40625ab-521c-4727-a83c-fbfd672eaac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5d0e42622842e6939c837b081dd170'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:36.438850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8c5fa-3961-4de6-bd7c-5e2b1af3f628 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:36.444938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69171cb2-3c3e-42b4-9be0-61fc1d21ed2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:36.446757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69171cb2-3c3e-42b4-9be0-61fc1d21ed2a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:36.447091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69171cb2-3c3e-42b4-9be0-61fc1d21ed2a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:36.447313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69171cb2-3c3e-42b4-9be0-61fc1d21ed2a admin admin] PATH_INFO: `/v3/projects/fbc71472f8624b789dd198f1614a9b9e/users/66fba2e8dd844a03abbe9b55c40d9d81/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:36.451296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f40625ab-521c-4727-a83c-fbfd672eaac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5d0e42622842e6939c837b081dd170'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:36.462862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f40625ab-521c-4727-a83c-fbfd672eaac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5d0e42622842e6939c837b081dd170'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:36.472620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69171cb2-3c3e-42b4-9be0-61fc1d21ed2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc71472f8624b789dd198f1614a9b9e, user_id=66fba2e8dd844a03abbe9b55c40d9d81, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:36.476916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69171cb2-3c3e-42b4-9be0-61fc1d21ed2a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:36.484770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f40625ab-521c-4727-a83c-fbfd672eaac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5d0e42622842e6939c837b081dd170'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:36.497333 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2481/4938] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:36 2022] PUT /identity/v3/projects/fbc71472f8624b789dd198f1614a9b9e/users/66fba2e8dd844a03abbe9b55c40d9d81/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:36.508264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87c18c-8c8a-4beb-bbf2-10c8496951e2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:36.508602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87c18c-8c8a-4beb-bbf2-10c8496951e2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:36.508824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87c18c-8c8a-4beb-bbf2-10c8496951e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:36.516686 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2458/4939] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:36 2022] DELETE /identity/v3/users/9d5d0e42622842e6939c837b081dd170 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:36.522043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58742d-9bbf-4c69-86d2-71026ff1a139 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:36.522332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58742d-9bbf-4c69-86d2-71026ff1a139 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:36.522607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58742d-9bbf-4c69-86d2-71026ff1a139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:36.570234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6e87c18c-8c8a-4beb-bbf2-10c8496951e2 None None] MFA Rules not processed for user `66fba2e8dd844a03abbe9b55c40d9d81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:36.571582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6e87c18c-8c8a-4beb-bbf2-10c8496951e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:36.574941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8d58742d-9bbf-4c69-86d2-71026ff1a139 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:36.576304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8d58742d-9bbf-4c69-86d2-71026ff1a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:36.682126 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2459/4940] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:36.715577 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2482/4941] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:36.740799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58742d-9bbf-4c69-86d2-71026ff1a139 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:36.742753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8d58742d-9bbf-4c69-86d2-71026ff1a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:36.873247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:36.902599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58742d-9bbf-4c69-86d2-71026ff1a139 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:36.910244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ed7f9-ecf6-4e86-bef3-a4f4d3ac0f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:36.911011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ed7f9-ecf6-4e86-bef3-a4f4d3ac0f4f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:36.911363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ed7f9-ecf6-4e86-bef3-a4f4d3ac0f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:36.911737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ed7f9-ecf6-4e86-bef3-a4f4d3ac0f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:36.933083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ed7f9-ecf6-4e86-bef3-a4f4d3ac0f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:36.937168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ed7f9-ecf6-4e86-bef3-a4f4d3ac0f4f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:36.961248 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2460/4942] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:37.396525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87c18c-8c8a-4beb-bbf2-10c8496951e2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:37.402629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6e87c18c-8c8a-4beb-bbf2-10c8496951e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:37.430572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87c18c-8c8a-4beb-bbf2-10c8496951e2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:37.445602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:37.447067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:37.448829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:37.449721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] PATH_INFO: `/v3/users/66fba2e8dd844a03abbe9b55c40d9d81` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:37.455998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66fba2e8dd844a03abbe9b55c40d9d81)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:37.462749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:37.589008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66fba2e8dd844a03abbe9b55c40d9d81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:37.602610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66fba2e8dd844a03abbe9b55c40d9d81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:37.623262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:37.646045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66fba2e8dd844a03abbe9b55c40d9d81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:37.647998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66fba2e8dd844a03abbe9b55c40d9d81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:37.662626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66fba2e8dd844a03abbe9b55c40d9d81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:37.725139 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2483/4943] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:37 2022] DELETE /identity/v3/users/66fba2e8dd844a03abbe9b55c40d9d81 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:37.729668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d4ef-3324-4e83-a4e6-bbf2fa383502 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:37.730244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d4ef-3324-4e83-a4e6-bbf2fa383502 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:37.730244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d4ef-3324-4e83-a4e6-bbf2fa383502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:37.788297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7536d4ef-3324-4e83-a4e6-bbf2fa383502 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:37.789756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7536d4ef-3324-4e83-a4e6-bbf2fa383502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:37.882658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:37.884279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:37.950661 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2461/4944] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:38.012260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536d4ef-3324-4e83-a4e6-bbf2fa383502 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:38.014111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7536d4ef-3324-4e83-a4e6-bbf2fa383502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:38.019803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d22ad-2bb2-4b3c-82f2-443956d74689 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:38.047054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b872a29-f87f-4ab9-a9c7-c087d013719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:38.047981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b872a29-f87f-4ab9-a9c7-c087d013719f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:38.048477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b872a29-f87f-4ab9-a9c7-c087d013719f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:38.049092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b872a29-f87f-4ab9-a9c7-c087d013719f admin admin] PATH_INFO: `/v3/users/ce41c9e6b76941ed993ded0ca4798c68` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:38.052673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b872a29-f87f-4ab9-a9c7-c087d013719f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce41c9e6b76941ed993ded0ca4798c68)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:38.055925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b872a29-f87f-4ab9-a9c7-c087d013719f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:38.167868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5b872a29-f87f-4ab9-a9c7-c087d013719f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce41c9e6b76941ed993ded0ca4798c68'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.173002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5b872a29-f87f-4ab9-a9c7-c087d013719f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce41c9e6b76941ed993ded0ca4798c68'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.181937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536d4ef-3324-4e83-a4e6-bbf2fa383502 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:38.190097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bce568-0423-441d-9582-3e512979b2e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:38.191566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bce568-0423-441d-9582-3e512979b2e6 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:38.192013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bce568-0423-441d-9582-3e512979b2e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:38.192458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bce568-0423-441d-9582-3e512979b2e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:38.196250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f7bce568-0423-441d-9582-3e512979b2e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:38.204127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5b872a29-f87f-4ab9-a9c7-c087d013719f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce41c9e6b76941ed993ded0ca4798c68'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.204983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5b872a29-f87f-4ab9-a9c7-c087d013719f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce41c9e6b76941ed993ded0ca4798c68'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.217916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5b872a29-f87f-4ab9-a9c7-c087d013719f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce41c9e6b76941ed993ded0ca4798c68'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.220444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bce568-0423-441d-9582-3e512979b2e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:38.224222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bce568-0423-441d-9582-3e512979b2e6 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:38.248850 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2462/4945] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:47:38.249768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bce568-0423-441d-9582-3e512979b2e6 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:38.251393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f7bce568-0423-441d-9582-3e512979b2e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:38.273162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bce568-0423-441d-9582-3e512979b2e6 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:38.281922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:38.282803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:38.283124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:38.283607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] PATH_INFO: `/v3/projects/c4c55425876345859e8b201594240602` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:38.285882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c55425876345859e8b201594240602)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:38.289268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:38.289916 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2484/4946] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:37 2022] DELETE /identity/v3/users/ce41c9e6b76941ed993ded0ca4798c68 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:38.298181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74ad34-edca-4130-9a68-384abab47d19 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:38.305272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74ad34-edca-4130-9a68-384abab47d19 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:38.305996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74ad34-edca-4130-9a68-384abab47d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:38.338289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1f74ad34-edca-4130-9a68-384abab47d19 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:38.343195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1f74ad34-edca-4130-9a68-384abab47d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:38.388619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c55425876345859e8b201594240602', 'request_id': 'req-bc23146a-476e-485d-b2b9-cbf0377f15b4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.404093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c55425876345859e8b201594240602', 'request_id': 'req-bc23146a-476e-485d-b2b9-cbf0377f15b4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.416937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c55425876345859e8b201594240602', 'request_id': 'req-bc23146a-476e-485d-b2b9-cbf0377f15b4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.438943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:38.447877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] The token cache is being invalidate because project c4c55425876345859e8b201594240602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:38.448590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.452750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.455860 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2463/4947] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:38 2022] DELETE /identity/v3/projects/c4c55425876345859e8b201594240602 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:38.462521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:38.464456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:38.465565 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2485/4948] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:38.511757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:38.570269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74ad34-edca-4130-9a68-384abab47d19 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:38.573180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1f74ad34-edca-4130-9a68-384abab47d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:38.709546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23146a-476e-485d-b2b9-cbf0377f15b4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:38.728471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac794a0d-c83c-41f6-974b-5347a06bd133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:38.729531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac794a0d-c83c-41f6-974b-5347a06bd133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:38.730804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac794a0d-c83c-41f6-974b-5347a06bd133 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:38.731662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac794a0d-c83c-41f6-974b-5347a06bd133 admin admin] PATH_INFO: `/v3/users/f1e09a83964a44ac89bceaf43e28015c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:38.735497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac794a0d-c83c-41f6-974b-5347a06bd133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e09a83964a44ac89bceaf43e28015c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:38.745145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac794a0d-c83c-41f6-974b-5347a06bd133 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:38.894628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74ad34-edca-4130-9a68-384abab47d19 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:38.897946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ac794a0d-c83c-41f6-974b-5347a06bd133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e09a83964a44ac89bceaf43e28015c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.899459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ac794a0d-c83c-41f6-974b-5347a06bd133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e09a83964a44ac89bceaf43e28015c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.941759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ac794a0d-c83c-41f6-974b-5347a06bd133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e09a83964a44ac89bceaf43e28015c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.960049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ac794a0d-c83c-41f6-974b-5347a06bd133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e09a83964a44ac89bceaf43e28015c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.979010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ac794a0d-c83c-41f6-974b-5347a06bd133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e09a83964a44ac89bceaf43e28015c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:38.994561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2464/4949] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:38 2022] DELETE /identity/v3/users/f1e09a83964a44ac89bceaf43e28015c => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:39.000690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8c1c9-1988-43d0-97a4-30974adc5f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:39.001674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c1c9-1988-43d0-97a4-30974adc5f2b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:39.002142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c1c9-1988-43d0-97a4-30974adc5f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:39.002424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c1c9-1988-43d0-97a4-30974adc5f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:39.006398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-60c8c1c9-1988-43d0-97a4-30974adc5f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:39.022400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c1c9-1988-43d0-97a4-30974adc5f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:39.024034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c1c9-1988-43d0-97a4-30974adc5f2b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:39.038839 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2486/4950] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:47:39.504241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db869a2b-f05d-4580-bad3-e462aad9c6e2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:39.504529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db869a2b-f05d-4580-bad3-e462aad9c6e2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:39.504805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db869a2b-f05d-4580-bad3-e462aad9c6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:39.551172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-db869a2b-f05d-4580-bad3-e462aad9c6e2 None None] MFA Rules not processed for user `a68002795ce541338b30129e6dbb0fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:39.554091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db869a2b-f05d-4580-bad3-e462aad9c6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:39.783413 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2465/4951] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:40.047599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8c1c9-1988-43d0-97a4-30974adc5f2b service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:40.050236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-60c8c1c9-1988-43d0-97a4-30974adc5f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:40.084357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8c1c9-1988-43d0-97a4-30974adc5f2b service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:40.306478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db869a2b-f05d-4580-bad3-e462aad9c6e2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:40.307989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db869a2b-f05d-4580-bad3-e462aad9c6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:40.323052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:40.327159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:40.327597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:40.328052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] PATH_INFO: `/v3/projects/d8b23ecc8561440ea6e187dbfe3b03bf` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:40.338398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b23ecc8561440ea6e187dbfe3b03bf)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:40.365247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:40.375286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db869a2b-f05d-4580-bad3-e462aad9c6e2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:40.392308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:40.393272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:40.393747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:40.394194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] PATH_INFO: `/v3/projects/9ee48b02ac9c49b1b2bbef38c4546142` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:40.397814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee48b02ac9c49b1b2bbef38c4546142)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:40.400493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:40.485676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:40.549930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b23ecc8561440ea6e187dbfe3b03bf', 'request_id': 'req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.561981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b23ecc8561440ea6e187dbfe3b03bf', 'request_id': 'req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.564339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee48b02ac9c49b1b2bbef38c4546142', 'request_id': 'req-c6a1b670-d290-4aa5-8cb3-258addca23a8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.565855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:40.578234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b23ecc8561440ea6e187dbfe3b03bf', 'request_id': 'req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.579587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee48b02ac9c49b1b2bbef38c4546142', 'request_id': 'req-c6a1b670-d290-4aa5-8cb3-258addca23a8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.593695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee48b02ac9c49b1b2bbef38c4546142', 'request_id': 'req-c6a1b670-d290-4aa5-8cb3-258addca23a8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.603384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] The token cache is being invalidate because project d8b23ecc8561440ea6e187dbfe3b03bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:40.604118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.605632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.609453 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2487/4952] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:40 2022] DELETE /identity/v3/projects/d8b23ecc8561440ea6e187dbfe3b03bf => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:40.613001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:40.615206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:40.622258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] The token cache is being invalidate because project 9ee48b02ac9c49b1b2bbef38c4546142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:40.622556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.623665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.625888 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2466/4953] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:40 2022] DELETE /identity/v3/projects/9ee48b02ac9c49b1b2bbef38c4546142 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:40.631748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:40.637440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:40.784078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e8c6a-5c3f-40dc-9eab-57f1dbd56529 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:40.787699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b670-d290-4aa5-8cb3-258addca23a8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:40.792396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:40.793654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:40.794174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:40.794808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] PATH_INFO: `/v3/projects/fbc71472f8624b789dd198f1614a9b9e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:40.796244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc71472f8624b789dd198f1614a9b9e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:40.799463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:40.800014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cc7e2-5e87-4d57-9ba2-abd1e2ccddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:40.801224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cc7e2-5e87-4d57-9ba2-abd1e2ccddbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:40.801832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cc7e2-5e87-4d57-9ba2-abd1e2ccddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:40.802573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cc7e2-5e87-4d57-9ba2-abd1e2ccddbc admin admin] PATH_INFO: `/v3/users/5567df08436c40af9f78d58b4acf6e2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:40.805784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927cc7e2-5e87-4d57-9ba2-abd1e2ccddbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5567df08436c40af9f78d58b4acf6e2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:40.811045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927cc7e2-5e87-4d57-9ba2-abd1e2ccddbc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:40.866149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc71472f8624b789dd198f1614a9b9e', 'request_id': 'req-86d244b6-9e4a-461e-8470-7e0b1fdad750'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.876379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc71472f8624b789dd198f1614a9b9e', 'request_id': 'req-86d244b6-9e4a-461e-8470-7e0b1fdad750'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.889111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc71472f8624b789dd198f1614a9b9e', 'request_id': 'req-86d244b6-9e4a-461e-8470-7e0b1fdad750'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.914840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] The token cache is being invalidate because project fbc71472f8624b789dd198f1614a9b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:40.915141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.915883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-86d244b6-9e4a-461e-8470-7e0b1fdad750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.918012 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2488/4954] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:40 2022] DELETE /identity/v3/projects/fbc71472f8624b789dd198f1614a9b9e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:40.919235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c197-bc01-4fc7-8ba9-56c1b8ca638c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:40.919524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c197-bc01-4fc7-8ba9-56c1b8ca638c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:40.919797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c197-bc01-4fc7-8ba9-56c1b8ca638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:40.956840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-927cc7e2-5e87-4d57-9ba2-abd1e2ccddbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5567df08436c40af9f78d58b4acf6e2d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.960268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-927cc7e2-5e87-4d57-9ba2-abd1e2ccddbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5567df08436c40af9f78d58b4acf6e2d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:40.964835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2c45c197-bc01-4fc7-8ba9-56c1b8ca638c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:40.966321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2c45c197-bc01-4fc7-8ba9-56c1b8ca638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:41.010809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-927cc7e2-5e87-4d57-9ba2-abd1e2ccddbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5567df08436c40af9f78d58b4acf6e2d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:41.029589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-927cc7e2-5e87-4d57-9ba2-abd1e2ccddbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5567df08436c40af9f78d58b4acf6e2d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:41.057660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-927cc7e2-5e87-4d57-9ba2-abd1e2ccddbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5567df08436c40af9f78d58b4acf6e2d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:41.085361 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2467/4955] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:40 2022] DELETE /identity/v3/users/5567df08436c40af9f78d58b4acf6e2d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:41.091929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2814-4c1e-49bf-b5f0-ee265fa4aaf3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:41.092925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2814-4c1e-49bf-b5f0-ee265fa4aaf3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:41.094182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2814-4c1e-49bf-b5f0-ee265fa4aaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:41.097699 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2489/4956] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:41.114947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5bf8d-c925-4e93-adae-d5e119c803d4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:41.115849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5bf8d-c925-4e93-adae-d5e119c803d4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:41.116273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5bf8d-c925-4e93-adae-d5e119c803d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:41.138692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-870c2814-4c1e-49bf-b5f0-ee265fa4aaf3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:41.142802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-870c2814-4c1e-49bf-b5f0-ee265fa4aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:41.150865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-90a5bf8d-c925-4e93-adae-d5e119c803d4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:41.152358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-90a5bf8d-c925-4e93-adae-d5e119c803d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:41.178957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:41.210610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:41.340922 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2490/4957] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:41.343007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5bf8d-c925-4e93-adae-d5e119c803d4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:41.358764 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2468/4958] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:41.366488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5bf8d-c925-4e93-adae-d5e119c803d4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:41.374121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801518-9c79-4198-bd28-37c1117e0bb9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:41.374729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801518-9c79-4198-bd28-37c1117e0bb9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:41.375426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801518-9c79-4198-bd28-37c1117e0bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:41.387014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a564-3349-4d66-b052-c6ccdeedbb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:41.387698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a564-3349-4d66-b052-c6ccdeedbb45 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:41.388147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a564-3349-4d66-b052-c6ccdeedbb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:41.390800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a564-3349-4d66-b052-c6ccdeedbb45 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:41.391945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4a564-3349-4d66-b052-c6ccdeedbb45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:41.392341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4a564-3349-4d66-b052-c6ccdeedbb45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:41.397775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4a564-3349-4d66-b052-c6ccdeedbb45 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:41.412039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-54801518-9c79-4198-bd28-37c1117e0bb9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:41.415258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-54801518-9c79-4198-bd28-37c1117e0bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:41.441158 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2469/4959] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:41.448534 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2491/4960] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:41.450149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a564-3349-4d66-b052-c6ccdeedbb45 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:41.454216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54801518-9c79-4198-bd28-37c1117e0bb9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:41.482620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54801518-9c79-4198-bd28-37c1117e0bb9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:41.495602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a564-3349-4d66-b052-c6ccdeedbb45 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:41.497762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74a45-9858-428c-8155-bf860990248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:41.499221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74a45-9858-428c-8155-bf860990248d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:41.499792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74a45-9858-428c-8155-bf860990248d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:41.500377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74a45-9858-428c-8155-bf860990248d admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:41.501341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74a45-9858-428c-8155-bf860990248d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:41.501882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74a45-9858-428c-8155-bf860990248d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:41.503888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74a45-9858-428c-8155-bf860990248d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:41.515602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c71ec-96f4-438b-ae4b-ba95f6fd13f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:41.517029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c71ec-96f4-438b-ae4b-ba95f6fd13f6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:41.519601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c71ec-96f4-438b-ae4b-ba95f6fd13f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:41.520268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c71ec-96f4-438b-ae4b-ba95f6fd13f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:41.532952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c71ec-96f4-438b-ae4b-ba95f6fd13f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:41.546731 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2470/4961] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:41.547692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c71ec-96f4-438b-ae4b-ba95f6fd13f6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:41.550482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74a45-9858-428c-8155-bf860990248d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:41.596003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74a45-9858-428c-8155-bf860990248d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:41.603973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b68d6-1aa1-4aa2-915b-6dad3a720c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:41.604968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b68d6-1aa1-4aa2-915b-6dad3a720c30 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:41.605487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b68d6-1aa1-4aa2-915b-6dad3a720c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:41.606014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b68d6-1aa1-4aa2-915b-6dad3a720c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:41.606763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b68d6-1aa1-4aa2-915b-6dad3a720c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:41.609649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b68d6-1aa1-4aa2-915b-6dad3a720c30 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:41.644262 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2492/4962] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:41 2022] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:41.647305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c71ec-96f4-438b-ae4b-ba95f6fd13f6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:41.673717 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2471/4963] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:41 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:41.676456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b68d6-1aa1-4aa2-915b-6dad3a720c30 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:41.879514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c71ec-96f4-438b-ae4b-ba95f6fd13f6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:41.968904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b68d6-1aa1-4aa2-915b-6dad3a720c30 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:41.983043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f71f3-3069-44fe-b9d3-fde1bf130582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:41.984327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f71f3-3069-44fe-b9d3-fde1bf130582 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:41.984964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f71f3-3069-44fe-b9d3-fde1bf130582 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:41.997956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f71f3-3069-44fe-b9d3-fde1bf130582 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:42.001770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f71f3-3069-44fe-b9d3-fde1bf130582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:42.007517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f71f3-3069-44fe-b9d3-fde1bf130582 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:42.102282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e51fb-4c71-4f97-95ca-e8da8c44849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:42.103462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e51fb-4c71-4f97-95ca-e8da8c44849c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:42.103897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e51fb-4c71-4f97-95ca-e8da8c44849c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:42.104448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e51fb-4c71-4f97-95ca-e8da8c44849c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:42.105346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e51fb-4c71-4f97-95ca-e8da8c44849c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:42.107325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e51fb-4c71-4f97-95ca-e8da8c44849c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:42.112387 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2472/4964] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:41 2022] POST /identity/v3/users => generated 295 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:42.123224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f71f3-3069-44fe-b9d3-fde1bf130582 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:42.195227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f71f3-3069-44fe-b9d3-fde1bf130582 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:42.201629 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2493/4965] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:41 2022] POST /identity/v3/users => generated 284 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:42.202841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e51fb-4c71-4f97-95ca-e8da8c44849c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:42.212648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc1f1-d233-4663-8eaf-09aeb0e94c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:42.213347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc1f1-d233-4663-8eaf-09aeb0e94c11 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:42.215140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc1f1-d233-4663-8eaf-09aeb0e94c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:42.215671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc1f1-d233-4663-8eaf-09aeb0e94c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:42.216936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cc1f1-d233-4663-8eaf-09aeb0e94c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:42.220026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cc1f1-d233-4663-8eaf-09aeb0e94c11 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:42.247983 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2473/4966] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:42.249533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc1f1-d233-4663-8eaf-09aeb0e94c11 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:42.262472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e51fb-4c71-4f97-95ca-e8da8c44849c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:42.284327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc1f1-d233-4663-8eaf-09aeb0e94c11 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:42.291867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d3bfc-9cd4-49aa-b439-31b40e05a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:42.292148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357e2e-7b6b-4ec0-8442-29415b3d699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:42.292513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d3bfc-9cd4-49aa-b439-31b40e05a901 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:42.293099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357e2e-7b6b-4ec0-8442-29415b3d699e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:42.293210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d3bfc-9cd4-49aa-b439-31b40e05a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:42.293471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d3bfc-9cd4-49aa-b439-31b40e05a901 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:42.293597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357e2e-7b6b-4ec0-8442-29415b3d699e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:42.294085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357e2e-7b6b-4ec0-8442-29415b3d699e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:42.294473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d3bfc-9cd4-49aa-b439-31b40e05a901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:42.295206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f357e2e-7b6b-4ec0-8442-29415b3d699e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:42.296137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d3bfc-9cd4-49aa-b439-31b40e05a901 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:42.298144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f357e2e-7b6b-4ec0-8442-29415b3d699e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:42.329659 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2474/4967] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:42.330718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d3bfc-9cd4-49aa-b439-31b40e05a901 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:42.336051 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2494/4968] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:42.338448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357e2e-7b6b-4ec0-8442-29415b3d699e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:42.356739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d3bfc-9cd4-49aa-b439-31b40e05a901 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:42.368709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badbf99-741b-4340-afc4-8c3a0255a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:42.369428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badbf99-741b-4340-afc4-8c3a0255a9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:42.369706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badbf99-741b-4340-afc4-8c3a0255a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:42.369990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badbf99-741b-4340-afc4-8c3a0255a9e3 admin admin] PATH_INFO: `/v3/projects/49a8c4e37a954cee9abfce818c914fc9/users/6227f00a5b5244128f2abf50ab143da3/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:42.375159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357e2e-7b6b-4ec0-8442-29415b3d699e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:42.390212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1cd74-2c46-47c6-b947-52b2ce33fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:42.390884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1cd74-2c46-47c6-b947-52b2ce33fdae admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:42.391916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1cd74-2c46-47c6-b947-52b2ce33fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:42.392207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1cd74-2c46-47c6-b947-52b2ce33fdae admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:42.392891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1cd74-2c46-47c6-b947-52b2ce33fdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:42.397350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1cd74-2c46-47c6-b947-52b2ce33fdae admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:42.400854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:42.421921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badbf99-741b-4340-afc4-8c3a0255a9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a8c4e37a954cee9abfce818c914fc9, user_id=6227f00a5b5244128f2abf50ab143da3, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:42.425758 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2495/4969] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:42.428600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badbf99-741b-4340-afc4-8c3a0255a9e3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:42.433466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1cd74-2c46-47c6-b947-52b2ce33fdae admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:42.454933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1cd74-2c46-47c6-b947-52b2ce33fdae admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:42.462830 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2475/4970] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:42 2022] PUT /identity/v3/projects/49a8c4e37a954cee9abfce818c914fc9/users/6227f00a5b5244128f2abf50ab143da3/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:42.481633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581923d1-9713-40c5-9329-73cefdd0a11f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:42.483364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581923d1-9713-40c5-9329-73cefdd0a11f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:42.485573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581923d1-9713-40c5-9329-73cefdd0a11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:42.543060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-581923d1-9713-40c5-9329-73cefdd0a11f None None] MFA Rules not processed for user `6227f00a5b5244128f2abf50ab143da3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:42.544372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-581923d1-9713-40c5-9329-73cefdd0a11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:42.573704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:42.620673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b79fc-19eb-4e8e-ba5b-306cb6a70ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:42.621785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b79fc-19eb-4e8e-ba5b-306cb6a70ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:42.622308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b79fc-19eb-4e8e-ba5b-306cb6a70ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:42.622808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b79fc-19eb-4e8e-ba5b-306cb6a70ff7 admin admin] PATH_INFO: `/v3/projects/843eed73f05b40b08776fa0bbdea4c97/users/98b8736d32c540168ce804b4e4a551f7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:42.651244 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2476/4971] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:42.656313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581923d1-9713-40c5-9329-73cefdd0a11f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:42.665622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b79fc-19eb-4e8e-ba5b-306cb6a70ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843eed73f05b40b08776fa0bbdea4c97, user_id=98b8736d32c540168ce804b4e4a551f7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:42.669215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b79fc-19eb-4e8e-ba5b-306cb6a70ff7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:42.697340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581923d1-9713-40c5-9329-73cefdd0a11f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:42.702112 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2496/4972] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:42 2022] PUT /identity/v3/projects/843eed73f05b40b08776fa0bbdea4c97/users/98b8736d32c540168ce804b4e4a551f7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:42.818913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3af6-a480-4728-8295-f7407d927ab6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:42.819271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3af6-a480-4728-8295-f7407d927ab6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:42.819585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3af6-a480-4728-8295-f7407d927ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:42.839389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cdc3e-8efa-4121-b94a-9e15f9dcb27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:42.841151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdc3e-8efa-4121-b94a-9e15f9dcb27d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:42.841458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdc3e-8efa-4121-b94a-9e15f9dcb27d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:42.841739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdc3e-8efa-4121-b94a-9e15f9dcb27d admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:42.842407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cdc3e-8efa-4121-b94a-9e15f9dcb27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:42.852827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cdc3e-8efa-4121-b94a-9e15f9dcb27d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:42.882237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9cfc3af6-a480-4728-8295-f7407d927ab6 None None] MFA Rules not processed for user `98b8736d32c540168ce804b4e4a551f7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:42.883804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9cfc3af6-a480-4728-8295-f7407d927ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:42.922684 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2477/4973] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:42 2022] POST /identity/v3/projects => generated 389 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:42.924755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cdc3e-8efa-4121-b94a-9e15f9dcb27d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.045224 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2497/4974] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:43.050760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc3af6-a480-4728-8295-f7407d927ab6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.077810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc3af6-a480-4728-8295-f7407d927ab6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:43.085074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3950c-6d21-4568-8c0b-3ed3a8531d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:43.085810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3950c-6d21-4568-8c0b-3ed3a8531d72 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.086088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3950c-6d21-4568-8c0b-3ed3a8531d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.086353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3950c-6d21-4568-8c0b-3ed3a8531d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.098136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3950c-6d21-4568-8c0b-3ed3a8531d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:43.098485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cdc3e-8efa-4121-b94a-9e15f9dcb27d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:43.102675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3950c-6d21-4568-8c0b-3ed3a8531d72 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:43.106436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f2ef6-f352-46ae-9380-31979d41115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:43.106875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f2ef6-f352-46ae-9380-31979d41115a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.107572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f2ef6-f352-46ae-9380-31979d41115a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.107988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f2ef6-f352-46ae-9380-31979d41115a admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.108656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f2ef6-f352-46ae-9380-31979d41115a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:43.113704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f2ef6-f352-46ae-9380-31979d41115a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:43.143494 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2478/4975] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:42 2022] POST /identity/v3/users => generated 301 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:43.144842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f2ef6-f352-46ae-9380-31979d41115a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.159490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f2ef6-f352-46ae-9380-31979d41115a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:43.166361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8e8ff-0c78-451c-a02d-4bc7be762cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:43.167000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e8ff-0c78-451c-a02d-4bc7be762cbf admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.167284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e8ff-0c78-451c-a02d-4bc7be762cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.167920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e8ff-0c78-451c-a02d-4bc7be762cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.168471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8e8ff-0c78-451c-a02d-4bc7be762cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:43.170127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8e8ff-0c78-451c-a02d-4bc7be762cbf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:43.187516 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2479/4976] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:43.188448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8e8ff-0c78-451c-a02d-4bc7be762cbf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.201849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8e8ff-0c78-451c-a02d-4bc7be762cbf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:43.210092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94aa33-b347-4e1d-a3f1-a73ffb6a757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:43.210943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94aa33-b347-4e1d-a3f1-a73ffb6a757c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.211409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94aa33-b347-4e1d-a3f1-a73ffb6a757c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.211702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94aa33-b347-4e1d-a3f1-a73ffb6a757c admin admin] PATH_INFO: `/v3/projects/7b493260992f4d3891e30fb396e39fbf/users/8aa8cb35550f45279e3f3186a7fcd27d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.241196 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2498/4977] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:43 2022] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:43.242911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3950c-6d21-4568-8c0b-3ed3a8531d72 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.259047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94aa33-b347-4e1d-a3f1-a73ffb6a757c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b493260992f4d3891e30fb396e39fbf, user_id=8aa8cb35550f45279e3f3186a7fcd27d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:43.273461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94aa33-b347-4e1d-a3f1-a73ffb6a757c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:43.287461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:43.293766 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2480/4978] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:43 2022] PUT /identity/v3/projects/7b493260992f4d3891e30fb396e39fbf/users/8aa8cb35550f45279e3f3186a7fcd27d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:43.298399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94aa33-b347-4e1d-a3f1-a73ffb6a757c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.316569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:43.335357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3950c-6d21-4568-8c0b-3ed3a8531d72 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:43.425147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94aa33-b347-4e1d-a3f1-a73ffb6a757c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:43.440633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688e5cd-64a6-4375-9b69-32cf50709ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:43.441800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688e5cd-64a6-4375-9b69-32cf50709ada admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.442144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688e5cd-64a6-4375-9b69-32cf50709ada admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.442523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688e5cd-64a6-4375-9b69-32cf50709ada admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.444118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688e5cd-64a6-4375-9b69-32cf50709ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:43.446097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688e5cd-64a6-4375-9b69-32cf50709ada admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:43.466953 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2481/4979] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:47:43.468428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688e5cd-64a6-4375-9b69-32cf50709ada admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.473514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46f715-bd10-48f4-b987-516cf9590f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:43.474402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46f715-bd10-48f4-b987-516cf9590f4b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.475515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46f715-bd10-48f4-b987-516cf9590f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.475953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46f715-bd10-48f4-b987-516cf9590f4b admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.490623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46f715-bd10-48f4-b987-516cf9590f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:43.494078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688e5cd-64a6-4375-9b69-32cf50709ada admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:43.496320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46f715-bd10-48f4-b987-516cf9590f4b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:43.501544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887bb52-7ce0-4b5e-b965-3d5aae3c39ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:43.503996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887bb52-7ce0-4b5e-b965-3d5aae3c39ba admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.504460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887bb52-7ce0-4b5e-b965-3d5aae3c39ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.504944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887bb52-7ce0-4b5e-b965-3d5aae3c39ba admin admin] PATH_INFO: `/v3/projects/7b493260992f4d3891e30fb396e39fbf/users/8aa8cb35550f45279e3f3186a7fcd27d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.509358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887bb52-7ce0-4b5e-b965-3d5aae3c39ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b493260992f4d3891e30fb396e39fbf, user_id=8aa8cb35550f45279e3f3186a7fcd27d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:43.513296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887bb52-7ce0-4b5e-b965-3d5aae3c39ba admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:43.537506 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2482/4980] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:43 2022] PUT /identity/v3/projects/7b493260992f4d3891e30fb396e39fbf/users/8aa8cb35550f45279e3f3186a7fcd27d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:43.554899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d806be-b85d-42af-ac0d-2e87d4741305 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.554899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d806be-b85d-42af-ac0d-2e87d4741305 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.554899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d806be-b85d-42af-ac0d-2e87d4741305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.566730 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2499/4981] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:43 2022] POST /identity/v3/users => generated 290 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:43.570717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46f715-bd10-48f4-b987-516cf9590f4b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.588032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46f715-bd10-48f4-b987-516cf9590f4b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:43.593980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c8d806be-b85d-42af-ac0d-2e87d4741305 None None] MFA Rules not processed for user `8aa8cb35550f45279e3f3186a7fcd27d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:43.595573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c8d806be-b85d-42af-ac0d-2e87d4741305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:43.714021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8cd67-bb3d-424e-8ffd-2ce49d17495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:43.714321 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2483/4982] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:43 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:43.714736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8cd67-bb3d-424e-8ffd-2ce49d17495a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.714931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8cd67-bb3d-424e-8ffd-2ce49d17495a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.715215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8cd67-bb3d-424e-8ffd-2ce49d17495a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.716029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8cd67-bb3d-424e-8ffd-2ce49d17495a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:43.718269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8cd67-bb3d-424e-8ffd-2ce49d17495a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:43.719192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d806be-b85d-42af-ac0d-2e87d4741305 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.730232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d806be-b85d-42af-ac0d-2e87d4741305 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:43.735924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0c91f-4941-42e2-9f5a-09eff667d385 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:43.736137 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2500/4983] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:43.736609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0c91f-4941-42e2-9f5a-09eff667d385 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.736839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0c91f-4941-42e2-9f5a-09eff667d385 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.737094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0c91f-4941-42e2-9f5a-09eff667d385 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.737921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0c91f-4941-42e2-9f5a-09eff667d385 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:43.739064 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-50d0c91f-4941-42e2-9f5a-09eff667d385 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:43.739064 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:43.739064 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:43.740490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0c91f-4941-42e2-9f5a-09eff667d385 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:43.741094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8cd67-bb3d-424e-8ffd-2ce49d17495a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.766089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8cd67-bb3d-424e-8ffd-2ce49d17495a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:43.772462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c69a17-8409-4ccc-9aa7-ef04ff4265c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:43.773553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c69a17-8409-4ccc-9aa7-ef04ff4265c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.773949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c69a17-8409-4ccc-9aa7-ef04ff4265c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.774328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c69a17-8409-4ccc-9aa7-ef04ff4265c6 admin admin] PATH_INFO: `/v3/projects/73be3d75dc6c442c9be4ed7e3b9d4d05/users/9db9d0a82b66468cafd788d275abe138/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.795581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c69a17-8409-4ccc-9aa7-ef04ff4265c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73be3d75dc6c442c9be4ed7e3b9d4d05, user_id=9db9d0a82b66468cafd788d275abe138, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:43.798609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c69a17-8409-4ccc-9aa7-ef04ff4265c6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:43.800644 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2484/4984] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:47:43 2022] POST /identity/v3/domains => generated 276 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:47:43.802185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0c91f-4941-42e2-9f5a-09eff667d385 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.805555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-50d0c91f-4941-42e2-9f5a-09eff667d385 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:43.818373 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2501/4985] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:43 2022] PUT /identity/v3/projects/73be3d75dc6c442c9be4ed7e3b9d4d05/users/9db9d0a82b66468cafd788d275abe138/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:43.819574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c69a17-8409-4ccc-9aa7-ef04ff4265c6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:43.931510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:43.940365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c69a17-8409-4ccc-9aa7-ef04ff4265c6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:43.949685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d42412-b79b-4413-adf6-e7be9a20ddd1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:43.950524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d42412-b79b-4413-adf6-e7be9a20ddd1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:43.950992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d42412-b79b-4413-adf6-e7be9a20ddd1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:43.951280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d42412-b79b-4413-adf6-e7be9a20ddd1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:43.954433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d42412-b79b-4413-adf6-e7be9a20ddd1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=8c4ca67105964dd7aaae94ff39c3ade2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:43.968468 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-20d42412-b79b-4413-adf6-e7be9a20ddd1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:43.968468 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:43.968468 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:43.969732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d42412-b79b-4413-adf6-e7be9a20ddd1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:43.973272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:43.992882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0c91f-4941-42e2-9f5a-09eff667d385 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.107089 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2502/4986] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:47:43 2022] PUT /identity/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config => generated 138 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:44.110327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d42412-b79b-4413-adf6-e7be9a20ddd1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.124371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.125147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.125558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.125912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] PATH_INFO: `/v3/projects/b2a0499d0289420f9b18ee5d2476dfee` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.133798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a0499d0289420f9b18ee5d2476dfee)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:44.135854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:44.226611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a0499d0289420f9b18ee5d2476dfee', 'request_id': 'req-62412338-baeb-48a5-95a5-577428f72dd7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:44.232587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a0499d0289420f9b18ee5d2476dfee', 'request_id': 'req-62412338-baeb-48a5-95a5-577428f72dd7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:44.240441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d42412-b79b-4413-adf6-e7be9a20ddd1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.244192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a0499d0289420f9b18ee5d2476dfee', 'request_id': 'req-62412338-baeb-48a5-95a5-577428f72dd7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:44.261691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] The token cache is being invalidate because project b2a0499d0289420f9b18ee5d2476dfee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:44.262248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:44.263173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:44.271792 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2485/4987] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:43 2022] DELETE /identity/v3/projects/b2a0499d0289420f9b18ee5d2476dfee => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:44.271792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.276403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:44.345280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61369ab-e02c-4beb-9a59-fbc4b52ad6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.346903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61369ab-e02c-4beb-9a59-fbc4b52ad6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.347915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61369ab-e02c-4beb-9a59-fbc4b52ad6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.348600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61369ab-e02c-4beb-9a59-fbc4b52ad6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.350219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61369ab-e02c-4beb-9a59-fbc4b52ad6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:44.352444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61369ab-e02c-4beb-9a59-fbc4b52ad6d3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:44.372555 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2503/4988] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:44.374417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ecf53-6a0f-4b9f-8fbb-9eafc640931f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.374703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ecf53-6a0f-4b9f-8fbb-9eafc640931f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.375421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ecf53-6a0f-4b9f-8fbb-9eafc640931f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.401193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-441ecf53-6a0f-4b9f-8fbb-9eafc640931f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:44.404341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-441ecf53-6a0f-4b9f-8fbb-9eafc640931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:44.421740 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2504/4989] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:44.424585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ecf53-6a0f-4b9f-8fbb-9eafc640931f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.431531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-441ecf53-6a0f-4b9f-8fbb-9eafc640931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:44.440291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62412338-baeb-48a5-95a5-577428f72dd7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.456254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a6905-1822-4e4f-ae3b-d61b6fb580f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.457325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a6905-1822-4e4f-ae3b-d61b6fb580f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.457647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a6905-1822-4e4f-ae3b-d61b6fb580f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.457932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a6905-1822-4e4f-ae3b-d61b6fb580f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.459998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a6905-1822-4e4f-ae3b-d61b6fb580f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8c4ca67105964dd7aaae94ff39c3ade2, group=identity)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:44.461046 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-d29a6905-1822-4e4f-ae3b-d61b6fb580f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:44.461046 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:44.461046 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:44.461986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a6905-1822-4e4f-ae3b-d61b6fb580f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:44.466014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ecf53-6a0f-4b9f-8fbb-9eafc640931f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.476080 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2486/4990] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:47:44 2022] GET /identity/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config/identity => generated 45 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:44.481660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb849b4-f91e-4c36-ab09-3bf948ceefdd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.481932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb849b4-f91e-4c36-ab09-3bf948ceefdd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.482285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb849b4-f91e-4c36-ab09-3bf948ceefdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.487277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5a743-696e-431a-ab6b-958dcddb1f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.487277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5a743-696e-431a-ab6b-958dcddb1f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.487277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5a743-696e-431a-ab6b-958dcddb1f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.487864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5a743-696e-431a-ab6b-958dcddb1f7a admin admin] PATH_INFO: `/v3/projects/73be3d75dc6c442c9be4ed7e3b9d4d05/users/9db9d0a82b66468cafd788d275abe138/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.491725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5a743-696e-431a-ab6b-958dcddb1f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73be3d75dc6c442c9be4ed7e3b9d4d05, user_id=9db9d0a82b66468cafd788d275abe138, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:44.495937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5a743-696e-431a-ab6b-958dcddb1f7a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:44.524155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-deb849b4-f91e-4c36-ab09-3bf948ceefdd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:44.525657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-deb849b4-f91e-4c36-ab09-3bf948ceefdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:44.529660 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2505/4991] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:44 2022] PUT /identity/v3/projects/73be3d75dc6c442c9be4ed7e3b9d4d05/users/9db9d0a82b66468cafd788d275abe138/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:44.530559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5a743-696e-431a-ab6b-958dcddb1f7a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.587649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:44.636081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:44.652300 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2487/4992] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:44.653720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d643746-8cc4-4dc8-856d-342c8682712c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.654011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d643746-8cc4-4dc8-856d-342c8682712c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.654289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d643746-8cc4-4dc8-856d-342c8682712c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.661833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5a743-696e-431a-ab6b-958dcddb1f7a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.672448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3d04e-d6b3-4b29-9638-757b40afc9dd tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.673138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3d04e-d6b3-4b29-9638-757b40afc9dd tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.673440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3d04e-d6b3-4b29-9638-757b40afc9dd tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.673719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3d04e-d6b3-4b29-9638-757b40afc9dd tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config/identity/driver` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.675243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3d04e-d6b3-4b29-9638-757b40afc9dd tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8c4ca67105964dd7aaae94ff39c3ade2, group=identity, option=driver)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:44.676275 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-6cf3d04e-d6b3-4b29-9638-757b40afc9dd tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:44.676275 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:44.676275 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:44.677179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3d04e-d6b3-4b29-9638-757b40afc9dd tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:44.697856 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2506/4993] 10.222.0.16 () {58 vars in 1296 bytes} [Mon Aug 29 15:47:44 2022] GET /identity/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config/identity/driver => generated 31 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:44.700393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3d04e-d6b3-4b29-9638-757b40afc9dd tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.706815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4d643746-8cc4-4dc8-856d-342c8682712c None None] MFA Rules not processed for user `9db9d0a82b66468cafd788d275abe138`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:44.708045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4d643746-8cc4-4dc8-856d-342c8682712c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:44.722282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3d04e-d6b3-4b29-9638-757b40afc9dd tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.735106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb04eb3-6347-4fb1-906b-a8d3089c278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.735727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04eb3-6347-4fb1-906b-a8d3089c278a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.736009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04eb3-6347-4fb1-906b-a8d3089c278a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.736695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04eb3-6347-4fb1-906b-a8d3089c278a admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.737375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb04eb3-6347-4fb1-906b-a8d3089c278a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:44.737728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb04eb3-6347-4fb1-906b-a8d3089c278a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:44.739331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb04eb3-6347-4fb1-906b-a8d3089c278a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:44.770195 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2507/4994] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:44.772120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb04eb3-6347-4fb1-906b-a8d3089c278a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.793068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb04eb3-6347-4fb1-906b-a8d3089c278a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.801785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21d40-b289-4c6e-8407-7f65efc94726 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.802682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21d40-b289-4c6e-8407-7f65efc94726 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.802968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21d40-b289-4c6e-8407-7f65efc94726 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.803244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21d40-b289-4c6e-8407-7f65efc94726 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config/ldap` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.805482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21d40-b289-4c6e-8407-7f65efc94726 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8c4ca67105964dd7aaae94ff39c3ade2, group=ldap)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:44.808841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21d40-b289-4c6e-8407-7f65efc94726 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:44.817300 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2508/4995] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:47:44 2022] GET /identity/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config/ldap => generated 106 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:44.819015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21d40-b289-4c6e-8407-7f65efc94726 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.836284 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2488/4996] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:44.836766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21d40-b289-4c6e-8407-7f65efc94726 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.837989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d643746-8cc4-4dc8-856d-342c8682712c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.848920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762095f4-6992-44ba-93ef-f38dca157602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.850303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762095f4-6992-44ba-93ef-f38dca157602 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.851100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d643746-8cc4-4dc8-856d-342c8682712c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.851514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762095f4-6992-44ba-93ef-f38dca157602 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.852180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762095f4-6992-44ba-93ef-f38dca157602 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.853442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762095f4-6992-44ba-93ef-f38dca157602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:44.856655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762095f4-6992-44ba-93ef-f38dca157602 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:44.858492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eaf7f-f443-4b85-9d43-9b089ad2f305 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.859534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eaf7f-f443-4b85-9d43-9b089ad2f305 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.860163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eaf7f-f443-4b85-9d43-9b089ad2f305 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.860590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eaf7f-f443-4b85-9d43-9b089ad2f305 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config/ldap/url` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.862096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eaf7f-f443-4b85-9d43-9b089ad2f305 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8c4ca67105964dd7aaae94ff39c3ade2, group=ldap, option=url)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:44.863938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eaf7f-f443-4b85-9d43-9b089ad2f305 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:44.872370 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2489/4997] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:47:44 2022] GET /identity/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config/ldap/url => generated 46 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:44.874040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eaf7f-f443-4b85-9d43-9b089ad2f305 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.887441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eaf7f-f443-4b85-9d43-9b089ad2f305 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:44.912537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90096ff3-d5fc-48f6-8fbe-eba6fe063f11 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:44.916672 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2509/4998] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:44 2022] POST /identity/v3/projects => generated 399 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:44.916854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90096ff3-d5fc-48f6-8fbe-eba6fe063f11 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:44.916854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90096ff3-d5fc-48f6-8fbe-eba6fe063f11 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:44.919731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762095f4-6992-44ba-93ef-f38dca157602 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:44.919953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90096ff3-d5fc-48f6-8fbe-eba6fe063f11 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:44.931194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90096ff3-d5fc-48f6-8fbe-eba6fe063f11 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:44.938302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90096ff3-d5fc-48f6-8fbe-eba6fe063f11 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:45.036431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762095f4-6992-44ba-93ef-f38dca157602 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:45.049679 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2490/4999] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:44 2022] POST /identity/v3/projects => generated 358 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:45.056069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90096ff3-d5fc-48f6-8fbe-eba6fe063f11 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:45.196335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90096ff3-d5fc-48f6-8fbe-eba6fe063f11 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:45.205414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84254e7-f753-4a6e-82c6-3f76b61c34c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:45.206334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84254e7-f753-4a6e-82c6-3f76b61c34c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.206628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84254e7-f753-4a6e-82c6-3f76b61c34c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.207051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84254e7-f753-4a6e-82c6-3f76b61c34c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config/ldap/user_tree_dn` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.208692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84254e7-f753-4a6e-82c6-3f76b61c34c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8c4ca67105964dd7aaae94ff39c3ade2, group=ldap, option=user_tree_dn)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:45.210741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84254e7-f753-4a6e-82c6-3f76b61c34c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:45.212524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666b727-b006-4478-94f9-c5daabae5edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:45.213338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666b727-b006-4478-94f9-c5daabae5edb admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.213827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666b727-b006-4478-94f9-c5daabae5edb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.214303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666b727-b006-4478-94f9-c5daabae5edb admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.215099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666b727-b006-4478-94f9-c5daabae5edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:45.219620 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2510/5000] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Aug 29 15:47:44 2022] GET /identity/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config/ldap/user_tree_dn => generated 63 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:45.219620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84254e7-f753-4a6e-82c6-3f76b61c34c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:45.222288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666b727-b006-4478-94f9-c5daabae5edb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:45.259087 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2491/5001] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:45 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:45.262606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666b727-b006-4478-94f9-c5daabae5edb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:45.270444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3666b727-b006-4478-94f9-c5daabae5edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:45.298459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666b727-b006-4478-94f9-c5daabae5edb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:45.308565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:45.309238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.309599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.311460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] PATH_INFO: `/v3/users/a6a8462ae5f54157b3e4d6bd2467cd84` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.313922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a8462ae5f54157b3e4d6bd2467cd84)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:45.318332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:45.360229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:45.367599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:45.400091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84254e7-f753-4a6e-82c6-3f76b61c34c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:45.415090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d9f02-33db-42be-90b0-31874ef49c1f tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:45.416143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9f02-33db-42be-90b0-31874ef49c1f tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.417516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9f02-33db-42be-90b0-31874ef49c1f tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.418156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9f02-33db-42be-90b0-31874ef49c1f tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.420652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d9f02-33db-42be-90b0-31874ef49c1f tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:45.426309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d9f02-33db-42be-90b0-31874ef49c1f tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:45.459262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a8462ae5f54157b3e4d6bd2467cd84'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:45.463373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a8462ae5f54157b3e4d6bd2467cd84'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:45.494345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a8462ae5f54157b3e4d6bd2467cd84'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:45.497424 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2511/5002] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:45 2022] POST /identity/v3/users => generated 373 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:45.507550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d9f02-33db-42be-90b0-31874ef49c1f tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:45.518278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a8462ae5f54157b3e4d6bd2467cd84'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:45.532914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d9f02-33db-42be-90b0-31874ef49c1f tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:45.533189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a8462ae5f54157b3e4d6bd2467cd84'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:45.551356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bbba2-35b8-4ecb-b6f6-91fecea4d0e5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:45.552047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bbba2-35b8-4ecb-b6f6-91fecea4d0e5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.552402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bbba2-35b8-4ecb-b6f6-91fecea4d0e5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.553175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bbba2-35b8-4ecb-b6f6-91fecea4d0e5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.553803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bbba2-35b8-4ecb-b6f6-91fecea4d0e5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8c4ca67105964dd7aaae94ff39c3ade2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:45.558891 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2492/5003] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:45 2022] DELETE /identity/v3/users/a6a8462ae5f54157b3e4d6bd2467cd84 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:45.559189 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-e91bbba2-35b8-4ecb-b6f6-91fecea4d0e5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:45.559189 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:45.559189 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:45.559189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bbba2-35b8-4ecb-b6f6-91fecea4d0e5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:45.559756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:45.559756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:45.569964 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2512/5004] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:47:45 2022] DELETE /identity/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2/config => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:45.571082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bbba2-35b8-4ecb-b6f6-91fecea4d0e5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:45.573535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e91bbba2-35b8-4ecb-b6f6-91fecea4d0e5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:45.601955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bbba2-35b8-4ecb-b6f6-91fecea4d0e5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:45.700537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bfa49-5622-45dc-be9f-2640aa76fd69 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:45.701266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bfa49-5622-45dc-be9f-2640aa76fd69 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.705934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bfa49-5622-45dc-be9f-2640aa76fd69 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.705934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bfa49-5622-45dc-be9f-2640aa76fd69 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/c3426f065b39436e8ffa22bff2b8dbaa` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.759894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bfa49-5622-45dc-be9f-2640aa76fd69 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:get_user(user_id=c3426f065b39436e8ffa22bff2b8dbaa)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:45.764767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bfa49-5622-45dc-be9f-2640aa76fd69 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:45.768265 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2513/5005] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:47:45 2022] GET /identity/v3/users/c3426f065b39436e8ffa22bff2b8dbaa => generated 373 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:45.771638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf14b41-5896-4332-a924-f9249aeb9fd3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.774876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf14b41-5896-4332-a924-f9249aeb9fd3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.775369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf14b41-5896-4332-a924-f9249aeb9fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.804795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe43d3-1e61-4bdc-a5fe-82796e40f768 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:45.811080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a356f-7adb-42fd-be0b-7ee3cf93ead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:45.812315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a356f-7adb-42fd-be0b-7ee3cf93ead6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.813355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a356f-7adb-42fd-be0b-7ee3cf93ead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.813355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a356f-7adb-42fd-be0b-7ee3cf93ead6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.814099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a356f-7adb-42fd-be0b-7ee3cf93ead6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:45.816282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a356f-7adb-42fd-be0b-7ee3cf93ead6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:45.823115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cdf14b41-5896-4332-a924-f9249aeb9fd3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:45.824701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cdf14b41-5896-4332-a924-f9249aeb9fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:45.847274 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2493/5006] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:45.847274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a356f-7adb-42fd-be0b-7ee3cf93ead6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:45.864620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fe9a356f-7adb-42fd-be0b-7ee3cf93ead6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:45.865621 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2514/5007] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:45.866832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf14b41-5896-4332-a924-f9249aeb9fd3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:45.890658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf14b41-5896-4332-a924-f9249aeb9fd3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:45.903253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:45.904421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:45.905020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:45.905753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/c3426f065b39436e8ffa22bff2b8dbaa` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:45.909242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c3426f065b39436e8ffa22bff2b8dbaa)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:45.911487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:46.014191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a356f-7adb-42fd-be0b-7ee3cf93ead6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:46.021812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:46.022343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3426f065b39436e8ffa22bff2b8dbaa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.022520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.022844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.023359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.023505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3426f065b39436e8ffa22bff2b8dbaa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.025037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8c4ca67105964dd7aaae94ff39c3ade2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:46.026365 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:46.026365 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:46.026365 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:46.027527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:46.058889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3426f065b39436e8ffa22bff2b8dbaa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.059763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3426f065b39436e8ffa22bff2b8dbaa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.067130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.068263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.074804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3426f065b39436e8ffa22bff2b8dbaa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.081018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:46.112679 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2515/5008] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:45 2022] DELETE /identity/v3/users/c3426f065b39436e8ffa22bff2b8dbaa => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:46.114232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:46.116784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:46.116920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.118387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.125321 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2494/5009] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:47:45 2022] PATCH /identity/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2 => generated 277 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:46.130171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:46.136890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:46.158897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:46.208954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e5e5b-03ec-4e30-bd05-60bf3ceee6b2 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:46.214940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ac25f-ba9f-4f25-9b3d-93ab47705d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:46.215939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ac25f-ba9f-4f25-9b3d-93ab47705d18 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.216229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ac25f-ba9f-4f25-9b3d-93ab47705d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.216509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ac25f-ba9f-4f25-9b3d-93ab47705d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.217755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ac25f-ba9f-4f25-9b3d-93ab47705d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:46.220234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ac25f-ba9f-4f25-9b3d-93ab47705d18 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:46.250950 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2516/5010] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:46.250950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ac25f-ba9f-4f25-9b3d-93ab47705d18 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:46.251339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1d4ac25f-ba9f-4f25-9b3d-93ab47705d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:46.288432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f2dce-80c6-4d28-854c-308d03e0db44 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:46.402613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ac25f-ba9f-4f25-9b3d-93ab47705d18 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:46.414603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:46.416327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.416636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.418536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects/31ebfaee1f954f3093ca7e410239e963` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.421720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:delete_project(project_id=31ebfaee1f954f3093ca7e410239e963)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:46.423881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:46.437941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aa0bf-db5a-4971-ab9c-0d2f632ae536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:46.439110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa0bf-db5a-4971-ab9c-0d2f632ae536 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.441213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa0bf-db5a-4971-ab9c-0d2f632ae536 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.441654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa0bf-db5a-4971-ab9c-0d2f632ae536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.446843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ed3aa0bf-db5a-4971-ab9c-0d2f632ae536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:46.478335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa0bf-db5a-4971-ab9c-0d2f632ae536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:46.480268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa0bf-db5a-4971-ab9c-0d2f632ae536 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:46.514319 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2495/5011] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:46.514538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aa0bf-db5a-4971-ab9c-0d2f632ae536 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:46.515984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ed3aa0bf-db5a-4971-ab9c-0d2f632ae536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:46.549291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ebfaee1f954f3093ca7e410239e963', 'request_id': 'req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.570439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ebfaee1f954f3093ca7e410239e963', 'request_id': 'req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.598668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ebfaee1f954f3093ca7e410239e963', 'request_id': 'req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.627097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] The token cache is being invalidate because project 31ebfaee1f954f3093ca7e410239e963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:46.628135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.629307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.632414 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2517/5012] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:46 2022] DELETE /identity/v3/projects/31ebfaee1f954f3093ca7e410239e963 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:46.636341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:46.641293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:46.720118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aa0bf-db5a-4971-ab9c-0d2f632ae536 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:46.771720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:46.802191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcca4c-64cf-4a91-94d2-d9fc7a0c2c38 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:46.814375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833b41-3ed5-40da-8a86-609b3fe8fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:46.815510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833b41-3ed5-40da-8a86-609b3fe8fb76 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.815988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833b41-3ed5-40da-8a86-609b3fe8fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.816534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833b41-3ed5-40da-8a86-609b3fe8fb76 admin admin] PATH_INFO: `/v3/projects/edf4b0f22e58420b9458a8799e3a5900/users/2d93304862cb4e0a97256daac1bc6d98/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.817286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:UPDATE=1,keystone:SELECT=99 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:46.837141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:46.838104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:46.838229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:46.838548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:46.848465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7833b41-3ed5-40da-8a86-609b3fe8fb76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf4b0f22e58420b9458a8799e3a5900, user_id=2d93304862cb4e0a97256daac1bc6d98, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:46.855355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7833b41-3ed5-40da-8a86-609b3fe8fb76 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:46.880461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8c4ca67105964dd7aaae94ff39c3ade2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:46.884340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:46.899982 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2518/5013] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:46 2022] PUT /identity/v3/projects/edf4b0f22e58420b9458a8799e3a5900/users/2d93304862cb4e0a97256daac1bc6d98/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:46.901556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833b41-3ed5-40da-8a86-609b3fe8fb76 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:46.916559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d7833b41-3ed5-40da-8a86-609b3fe8fb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:46.969346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:46.991516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:47.027637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833b41-3ed5-40da-8a86-609b3fe8fb76 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:47.033713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8fa10-f1ad-4b9a-9f17-9fc674bc9786 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:47.034439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8fa10-f1ad-4b9a-9f17-9fc674bc9786 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:47.034792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8fa10-f1ad-4b9a-9f17-9fc674bc9786 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:47.035199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8fa10-f1ad-4b9a-9f17-9fc674bc9786 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:47.036011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8fa10-f1ad-4b9a-9f17-9fc674bc9786 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:47.039559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8fa10-f1ad-4b9a-9f17-9fc674bc9786 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:47.076150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2', 'request_id': 'req-432422fd-ddfb-4e60-ac93-276fc4e4d86c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:47.091973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2', 'request_id': 'req-432422fd-ddfb-4e60-ac93-276fc4e4d86c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:47.095167 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2519/5014] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:46 2022] POST /identity/v3/projects => generated 360 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:47.096701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc918-2ef3-4087-9f8c-813c08d0e04b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:47.096987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc918-2ef3-4087-9f8c-813c08d0e04b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:47.097259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc918-2ef3-4087-9f8c-813c08d0e04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:47.108806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2', 'request_id': 'req-432422fd-ddfb-4e60-ac93-276fc4e4d86c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:47.141049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] The token cache is being invalidate because project 8c4ca67105964dd7aaae94ff39c3ade2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:47.141346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:47.142051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:47.160355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2', 'request_id': 'req-432422fd-ddfb-4e60-ac93-276fc4e4d86c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:47.160811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a02dc918-2ef3-4087-9f8c-813c08d0e04b None None] MFA Rules not processed for user `2d93304862cb4e0a97256daac1bc6d98`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:47.161086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2', 'request_id': 'req-432422fd-ddfb-4e60-ac93-276fc4e4d86c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:47.162278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8c4ca67105964dd7aaae94ff39c3ade2', 'request_id': 'req-432422fd-ddfb-4e60-ac93-276fc4e4d86c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:47.167215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a02dc918-2ef3-4087-9f8c-813c08d0e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:47.182740 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2496/5015] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:47:46 2022] DELETE /identity/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:47.183619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:47.186094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:47.332252 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2520/5016] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:47.334623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dc918-2ef3-4087-9f8c-813c08d0e04b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:47.336727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a02dc918-2ef3-4087-9f8c-813c08d0e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:47.343081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432422fd-ddfb-4e60-ac93-276fc4e4d86c tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:47.409142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:47.444146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b521-ed56-4139-a20f-5cfb47426795 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:47.445830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b521-ed56-4139-a20f-5cfb47426795 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:47.447857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b521-ed56-4139-a20f-5cfb47426795 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:47.448622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b521-ed56-4139-a20f-5cfb47426795 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:47.452788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425b521-ed56-4139-a20f-5cfb47426795 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:47.468957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425b521-ed56-4139-a20f-5cfb47426795 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:47.486306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:47.528056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dc918-2ef3-4087-9f8c-813c08d0e04b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:47.539901 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2497/5017] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:47 2022] POST /identity/v3/users => generated 417 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:47.542041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b747303-30a2-4b04-8363-d2017c2d35d7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:47.542224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b521-ed56-4139-a20f-5cfb47426795 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:47.542927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b747303-30a2-4b04-8363-d2017c2d35d7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:47.543227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b747303-30a2-4b04-8363-d2017c2d35d7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:47.543731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b747303-30a2-4b04-8363-d2017c2d35d7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:47.544426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b747303-30a2-4b04-8363-d2017c2d35d7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:47.544562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f425b521-ed56-4139-a20f-5cfb47426795 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:47.546374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b747303-30a2-4b04-8363-d2017c2d35d7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:47.574763 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2521/5018] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:47:47 2022] POST /identity/v3/domains => generated 275 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:47.574763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b747303-30a2-4b04-8363-d2017c2d35d7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:47.681555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b747303-30a2-4b04-8363-d2017c2d35d7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:47.693566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21892f7-5f85-49fe-ac51-06d4d5da3c08 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:47.693566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21892f7-5f85-49fe-ac51-06d4d5da3c08 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:47.693566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21892f7-5f85-49fe-ac51-06d4d5da3c08 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:47.693961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21892f7-5f85-49fe-ac51-06d4d5da3c08 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:47.694143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21892f7-5f85-49fe-ac51-06d4d5da3c08 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:47.695807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21892f7-5f85-49fe-ac51-06d4d5da3c08 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:47.705319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b521-ed56-4139-a20f-5cfb47426795 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:47.719438 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2522/5019] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:47:47 2022] POST /identity/v3/roles => generated 240 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:47.720831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21892f7-5f85-49fe-ac51-06d4d5da3c08 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:47.808163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077f1fd-a924-453e-bce1-3c3fb861ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:47.809562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f1fd-a924-453e-bce1-3c3fb861ee95 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:47.809847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f1fd-a924-453e-bce1-3c3fb861ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:47.810121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f1fd-a924-453e-bce1-3c3fb861ee95 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:47.811503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077f1fd-a924-453e-bce1-3c3fb861ee95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:47.813786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077f1fd-a924-453e-bce1-3c3fb861ee95 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:47.861350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21892f7-5f85-49fe-ac51-06d4d5da3c08 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:47.867559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720049-dfe9-41f7-812b-ab0529190ece tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:47.868278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720049-dfe9-41f7-812b-ab0529190ece tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:47.868557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720049-dfe9-41f7-812b-ab0529190ece tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:47.879061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720049-dfe9-41f7-812b-ab0529190ece tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:47.881517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f720049-dfe9-41f7-812b-ab0529190ece tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=f7fc9ee9a4154436bb4c237488be2119)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:47.882753 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2498/5020] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:47 2022] POST /identity/v3/projects => generated 397 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:47.883701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077f1fd-a924-453e-bce1-3c3fb861ee95 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:47.885726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4077f1fd-a924-453e-bce1-3c3fb861ee95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:47.897498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f720049-dfe9-41f7-812b-ab0529190ece tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:47.984655 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2523/5021] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:47:47 2022] PUT /identity/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config => generated 138 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:47.984655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720049-dfe9-41f7-812b-ab0529190ece tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:47.996928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720049-dfe9-41f7-812b-ab0529190ece tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.063510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077f1fd-a924-453e-bce1-3c3fb861ee95 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.075030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.076583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.077104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.077622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] PATH_INFO: `/v3/projects/59eb77f8e051424fa47cd048e02154db` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.080350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59eb77f8e051424fa47cd048e02154db)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.083607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.085818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:48.088378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:48.109953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807346-7c3d-41a0-84e1-b7d849d45144 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.110727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807346-7c3d-41a0-84e1-b7d849d45144 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.111077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807346-7c3d-41a0-84e1-b7d849d45144 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.111444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807346-7c3d-41a0-84e1-b7d849d45144 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/ee21e783f3434be390b0e6affa101854` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.133079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c807346-7c3d-41a0-84e1-b7d849d45144 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:get_user(user_id=ee21e783f3434be390b0e6affa101854)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.135635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c807346-7c3d-41a0-84e1-b7d849d45144 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.140899 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2524/5022] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:47:47 2022] GET /identity/v3/users/ee21e783f3434be390b0e6affa101854 => generated 417 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:48.142161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807346-7c3d-41a0-84e1-b7d849d45144 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.154841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807346-7c3d-41a0-84e1-b7d849d45144 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.158265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59eb77f8e051424fa47cd048e02154db', 'request_id': 'req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:48.165886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59eb77f8e051424fa47cd048e02154db', 'request_id': 'req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:48.180032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59eb77f8e051424fa47cd048e02154db', 'request_id': 'req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:48.194610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] The token cache is being invalidate because project 59eb77f8e051424fa47cd048e02154db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:48.194894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:48.195765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:48.199422 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2499/5023] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:47 2022] DELETE /identity/v3/projects/59eb77f8e051424fa47cd048e02154db => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:48.200882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.202710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:48.282192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1e180-9ad6-4504-bb3b-26e26d2572a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.282192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1e180-9ad6-4504-bb3b-26e26d2572a0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.282192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1e180-9ad6-4504-bb3b-26e26d2572a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.282192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1e180-9ad6-4504-bb3b-26e26d2572a0 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.283122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1e180-9ad6-4504-bb3b-26e26d2572a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.283122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1e180-9ad6-4504-bb3b-26e26d2572a0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.339712 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2525/5024] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:48 2022] POST /identity/v3/users => generated 305 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:48.339712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1e180-9ad6-4504-bb3b-26e26d2572a0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.340410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-03d1e180-9ad6-4504-bb3b-26e26d2572a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:48.359015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5fa6b-9d0f-4e5d-8ac0-302bebe8a306 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.366933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90627df-eda9-4863-b4ae-f7fe25516d86 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.367738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90627df-eda9-4863-b4ae-f7fe25516d86 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.368121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90627df-eda9-4863-b4ae-f7fe25516d86 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.368768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90627df-eda9-4863-b4ae-f7fe25516d86 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.369719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90627df-eda9-4863-b4ae-f7fe25516d86 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=f7fc9ee9a4154436bb4c237488be2119)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.370933 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-f90627df-eda9-4863-b4ae-f7fe25516d86 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:48.370933 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:48.370933 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:48.372221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90627df-eda9-4863-b4ae-f7fe25516d86 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.414721 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2500/5025] 10.222.0.16 () {60 vars in 1271 bytes} [Mon Aug 29 15:47:48 2022] PATCH /identity/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config => generated 140 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:48.418367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29d82-f914-4b1d-b97a-a5c6023c9953 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.419397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29d82-f914-4b1d-b97a-a5c6023c9953 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.421042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29d82-f914-4b1d-b97a-a5c6023c9953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.446977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-74c29d82-f914-4b1d-b97a-a5c6023c9953 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:48.448539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-74c29d82-f914-4b1d-b97a-a5c6023c9953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:48.456181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1e180-9ad6-4504-bb3b-26e26d2572a0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.459508 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2501/5026] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:48.460861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c29d82-f914-4b1d-b97a-a5c6023c9953 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.462540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d711c-106e-400d-aa41-8f4a2add4e51 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.463450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d711c-106e-400d-aa41-8f4a2add4e51 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.463615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-74c29d82-f914-4b1d-b97a-a5c6023c9953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:48.464062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d711c-106e-400d-aa41-8f4a2add4e51 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.464499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d711c-106e-400d-aa41-8f4a2add4e51 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/roles/b37b8d1b528c49b19cbc4ed54c82fa02` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.466377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d711c-106e-400d-aa41-8f4a2add4e51 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:get_role(role_id=b37b8d1b528c49b19cbc4ed54c82fa02)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.469043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d711c-106e-400d-aa41-8f4a2add4e51 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.471386 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2526/5027] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:47:48 2022] GET /identity/v3/roles/b37b8d1b528c49b19cbc4ed54c82fa02 => generated 240 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:48.472355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d711c-106e-400d-aa41-8f4a2add4e51 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.479735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c29d82-f914-4b1d-b97a-a5c6023c9953 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.487404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721d723-5bf5-4447-bc3f-9f4537c6f13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.487756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d711c-106e-400d-aa41-8f4a2add4e51 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.488853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721d723-5bf5-4447-bc3f-9f4537c6f13c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.490644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721d723-5bf5-4447-bc3f-9f4537c6f13c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.491177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721d723-5bf5-4447-bc3f-9f4537c6f13c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.492382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721d723-5bf5-4447-bc3f-9f4537c6f13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.494486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721d723-5bf5-4447-bc3f-9f4537c6f13c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.495325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3012d-3369-45ab-832d-fda691f54d0d tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.496160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3012d-3369-45ab-832d-fda691f54d0d tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.496879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3012d-3369-45ab-832d-fda691f54d0d tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.497341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3012d-3369-45ab-832d-fda691f54d0d tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.499698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3012d-3369-45ab-832d-fda691f54d0d tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f7fc9ee9a4154436bb4c237488be2119)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.502002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3012d-3369-45ab-832d-fda691f54d0d tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.512354 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2502/5028] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:48 2022] GET /identity/v3/roles => generated 1651 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:48.512354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b5513-ea23-431d-90bd-65254d39397b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.512354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b5513-ea23-431d-90bd-65254d39397b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.512354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b5513-ea23-431d-90bd-65254d39397b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.519517 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2527/5029] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:47:48 2022] GET /identity/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config => generated 140 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:48.521060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3012d-3369-45ab-832d-fda691f54d0d tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.541189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3012d-3369-45ab-832d-fda691f54d0d tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.548712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ce1b5513-ea23-431d-90bd-65254d39397b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:48.549515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002df26-e14d-401a-a863-0dc866298452 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.550211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ce1b5513-ea23-431d-90bd-65254d39397b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:48.550561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002df26-e14d-401a-a863-0dc866298452 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.551003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002df26-e14d-401a-a863-0dc866298452 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.551557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002df26-e14d-401a-a863-0dc866298452 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.552431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002df26-e14d-401a-a863-0dc866298452 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.555959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002df26-e14d-401a-a863-0dc866298452 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.561333 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2503/5030] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:48.562682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b5513-ea23-431d-90bd-65254d39397b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.577345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b5513-ea23-431d-90bd-65254d39397b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.583581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f3e29-dfe0-4bbf-b15a-9de43ed9a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.585310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f3e29-dfe0-4bbf-b15a-9de43ed9a614 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.585779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f3e29-dfe0-4bbf-b15a-9de43ed9a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.586280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f3e29-dfe0-4bbf-b15a-9de43ed9a614 admin admin] PATH_INFO: `/v3/projects/cdd3c10f4ce04e8cbdfb1853f6468bcf/users/cfb2c16acc6d42caa9cd4cd6c7f4836a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.626511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f3e29-dfe0-4bbf-b15a-9de43ed9a614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd3c10f4ce04e8cbdfb1853f6468bcf, user_id=cfb2c16acc6d42caa9cd4cd6c7f4836a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.629084 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2528/5031] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:48 2022] POST /identity/v3/projects => generated 359 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:48.630286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002df26-e14d-401a-a863-0dc866298452 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.634448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f3e29-dfe0-4bbf-b15a-9de43ed9a614 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.663920 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2504/5032] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:48 2022] PUT /identity/v3/projects/cdd3c10f4ce04e8cbdfb1853f6468bcf/users/cfb2c16acc6d42caa9cd4cd6c7f4836a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:48.663920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f3e29-dfe0-4bbf-b15a-9de43ed9a614 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.689350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=82,keystone:DELETE=13,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:48.747539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:48.763217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f3e29-dfe0-4bbf-b15a-9de43ed9a614 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.775199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234c2eb-90ae-45c2-9fa5-107f037100d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.776415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c2eb-90ae-45c2-9fa5-107f037100d6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.777314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c2eb-90ae-45c2-9fa5-107f037100d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.777655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c2eb-90ae-45c2-9fa5-107f037100d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.778328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234c2eb-90ae-45c2-9fa5-107f037100d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:47:48.778633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234c2eb-90ae-45c2-9fa5-107f037100d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.780378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234c2eb-90ae-45c2-9fa5-107f037100d6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.786011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002df26-e14d-401a-a863-0dc866298452 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.802224 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2505/5033] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:48.802224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234c2eb-90ae-45c2-9fa5-107f037100d6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.871930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babc060-a804-4b28-a0c7-7ecc97e1a38a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.872610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc060-a804-4b28-a0c7-7ecc97e1a38a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.872962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc060-a804-4b28-a0c7-7ecc97e1a38a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.873876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc060-a804-4b28-a0c7-7ecc97e1a38a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.874030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babc060-a804-4b28-a0c7-7ecc97e1a38a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f7fc9ee9a4154436bb4c237488be2119)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.875885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babc060-a804-4b28-a0c7-7ecc97e1a38a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.886990 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2529/5034] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:47:48 2022] DELETE /identity/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:48.888362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6299c-09be-4c19-a1db-2cde99ea4bba None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.888653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6299c-09be-4c19-a1db-2cde99ea4bba None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.888930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6299c-09be-4c19-a1db-2cde99ea4bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.890786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234c2eb-90ae-45c2-9fa5-107f037100d6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.898063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6cdd5-c6ef-4b4d-90b9-67140ceb3a85 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.899738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6cdd5-c6ef-4b4d-90b9-67140ceb3a85 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.900104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6cdd5-c6ef-4b4d-90b9-67140ceb3a85 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.900594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6cdd5-c6ef-4b4d-90b9-67140ceb3a85 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects/138d36a3eae448fc912f5fd8c18cc91a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.902212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6cdd5-c6ef-4b4d-90b9-67140ceb3a85 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:get_project(project_id=138d36a3eae448fc912f5fd8c18cc91a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.905199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6cdd5-c6ef-4b4d-90b9-67140ceb3a85 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.907537 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2506/5035] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:47:48 2022] GET /identity/v3/projects/138d36a3eae448fc912f5fd8c18cc91a => generated 359 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:48.908605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6cdd5-c6ef-4b4d-90b9-67140ceb3a85 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.914067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-18d6299c-09be-4c19-a1db-2cde99ea4bba None None] MFA Rules not processed for user `f70ee130e8e74db88b9b7ffd16ed1bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:48.916066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-18d6299c-09be-4c19-a1db-2cde99ea4bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:48.923680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6cdd5-c6ef-4b4d-90b9-67140ceb3a85 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.929976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeec12-2f1a-499b-b273-a48409905bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.930891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeec12-2f1a-499b-b273-a48409905bee admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.931516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeec12-2f1a-499b-b273-a48409905bee admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.932181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeec12-2f1a-499b-b273-a48409905bee admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.933203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeec12-2f1a-499b-b273-a48409905bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.935046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeec12-2f1a-499b-b273-a48409905bee admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.947668 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2507/5036] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:48 2022] GET /identity/v3/roles => generated 1651 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:48.948895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeec12-2f1a-499b-b273-a48409905bee admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:48.960444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeec12-2f1a-499b-b273-a48409905bee admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:48.967099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697f29e-6e60-4c1a-9d56-932a2fe3b47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:48.967859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697f29e-6e60-4c1a-9d56-932a2fe3b47b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:48.968013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697f29e-6e60-4c1a-9d56-932a2fe3b47b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:48.968295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697f29e-6e60-4c1a-9d56-932a2fe3b47b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:48.968939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697f29e-6e60-4c1a-9d56-932a2fe3b47b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:48.970912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697f29e-6e60-4c1a-9d56-932a2fe3b47b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:48.995575 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2530/5037] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:48.996604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6299c-09be-4c19-a1db-2cde99ea4bba None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.006955 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2508/5038] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:48 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:49.006955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697f29e-6e60-4c1a-9d56-932a2fe3b47b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.015979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6299c-09be-4c19-a1db-2cde99ea4bba None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.091026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65896fc3-a399-4ccc-924a-c87e39f2cdbc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.091698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65896fc3-a399-4ccc-924a-c87e39f2cdbc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.092092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65896fc3-a399-4ccc-924a-c87e39f2cdbc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.092395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65896fc3-a399-4ccc-924a-c87e39f2cdbc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.093834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65896fc3-a399-4ccc-924a-c87e39f2cdbc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f7fc9ee9a4154436bb4c237488be2119)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:49.095630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65896fc3-a399-4ccc-924a-c87e39f2cdbc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:49.098814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697f29e-6e60-4c1a-9d56-932a2fe3b47b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.105877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a840b-5b22-4e23-966a-688850f1db18 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.106843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a840b-5b22-4e23-966a-688850f1db18 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.107291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a840b-5b22-4e23-966a-688850f1db18 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-65896fc3-a399-4ccc-924a-c87e39f2cdbc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Could not find any options in domain configuration for domain f7fc9ee9a4154436bb4c237488be2119.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain f7fc9ee9a4154436bb4c237488be2119. Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 29 15:47:49.107656 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 29 15:47:49.108756 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 29 15:47:49.108756 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 29 15:47:49.108756 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:47:49.108756 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:47:49.108756 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 29 15:47:49.108756 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 29 15:47:49.108756 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain f7fc9ee9a4154436bb4c237488be2119. Aug 29 15:47:49.108756 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:47:49.109521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a840b-5b22-4e23-966a-688850f1db18 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects/138d36a3eae448fc912f5fd8c18cc91a/users/ee21e783f3434be390b0e6affa101854/roles/b37b8d1b528c49b19cbc4ed54c82fa02` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.111385 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2531/5039] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:47:48 2022] GET /identity/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config => generated 151 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:47:49.112388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65896fc3-a399-4ccc-924a-c87e39f2cdbc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.112780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a840b-5b22-4e23-966a-688850f1db18 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_grant(project_id=138d36a3eae448fc912f5fd8c18cc91a, user_id=ee21e783f3434be390b0e6affa101854, role_id=b37b8d1b528c49b19cbc4ed54c82fa02)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:49.116622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a840b-5b22-4e23-966a-688850f1db18 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:49.137015 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2509/5040] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:49 2022] PUT /identity/v3/projects/138d36a3eae448fc912f5fd8c18cc91a/users/ee21e783f3434be390b0e6affa101854/roles/b37b8d1b528c49b19cbc4ed54c82fa02 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:49.139332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a840b-5b22-4e23-966a-688850f1db18 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.152129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:49.164428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:49.229212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65896fc3-a399-4ccc-924a-c87e39f2cdbc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.248032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a840b-5b22-4e23-966a-688850f1db18 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.258383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dfbac-7c85-43c7-966e-dabd9d8df08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.259804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dfbac-7c85-43c7-966e-dabd9d8df08e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.260560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dfbac-7c85-43c7-966e-dabd9d8df08e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.262395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dfbac-7c85-43c7-966e-dabd9d8df08e admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.264085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dfbac-7c85-43c7-966e-dabd9d8df08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:49.268544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dfbac-7c85-43c7-966e-dabd9d8df08e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:49.304593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8003-b166-4c8f-8535-ab5f77d201c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.305276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8003-b166-4c8f-8535-ab5f77d201c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.305798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8003-b166-4c8f-8535-ab5f77d201c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.306079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8003-b166-4c8f-8535-ab5f77d201c0 admin admin] PATH_INFO: `/v3/projects/cdd3c10f4ce04e8cbdfb1853f6468bcf/users/cfb2c16acc6d42caa9cd4cd6c7f4836a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.308297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd8003-b166-4c8f-8535-ab5f77d201c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd3c10f4ce04e8cbdfb1853f6468bcf, user_id=cfb2c16acc6d42caa9cd4cd6c7f4836a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:49.311637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd8003-b166-4c8f-8535-ab5f77d201c0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:49.317914 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2510/5041] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:49 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:49.319322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dfbac-7c85-43c7-966e-dabd9d8df08e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.339065 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2532/5042] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:49 2022] PUT /identity/v3/projects/cdd3c10f4ce04e8cbdfb1853f6468bcf/users/cfb2c16acc6d42caa9cd4cd6c7f4836a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:49.341873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8003-b166-4c8f-8535-ab5f77d201c0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.403775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dfbac-7c85-43c7-966e-dabd9d8df08e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.433582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8003-b166-4c8f-8535-ab5f77d201c0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.439404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ca0c-0e36-4735-b224-f6c8cb7a964a tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.440170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ca0c-0e36-4735-b224-f6c8cb7a964a tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.440531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ca0c-0e36-4735-b224-f6c8cb7a964a tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.441201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ca0c-0e36-4735-b224-f6c8cb7a964a tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.442110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703ca0c-0e36-4735-b224-f6c8cb7a964a tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:49.444158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703ca0c-0e36-4735-b224-f6c8cb7a964a tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:49.498548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a982103-b3bd-4e64-b2a0-76192e7256c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.502074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a982103-b3bd-4e64-b2a0-76192e7256c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.502074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a982103-b3bd-4e64-b2a0-76192e7256c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.502074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a982103-b3bd-4e64-b2a0-76192e7256c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.502074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a982103-b3bd-4e64-b2a0-76192e7256c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f7fc9ee9a4154436bb4c237488be2119)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:49.502493 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-2a982103-b3bd-4e64-b2a0-76192e7256c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:49.502493 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:49.502493 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:49.503100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a982103-b3bd-4e64-b2a0-76192e7256c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:49.503964 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2533/5043] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:49 2022] POST /identity/v3/projects => generated 359 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:49.505414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ca0c-0e36-4735-b224-f6c8cb7a964a tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.516653 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2511/5044] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:47:49 2022] DELETE /identity/v3/domains/f7fc9ee9a4154436bb4c237488be2119/config => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:49.517909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0cce0-2125-4743-9381-bdd751a1a5d2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.518197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0cce0-2125-4743-9381-bdd751a1a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.518471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0cce0-2125-4743-9381-bdd751a1a5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.555662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9ad0cce0-2125-4743-9381-bdd751a1a5d2 None None] MFA Rules not processed for user `cfb2c16acc6d42caa9cd4cd6c7f4836a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:49.556970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9ad0cce0-2125-4743-9381-bdd751a1a5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:49.575103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:49.594955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ca0c-0e36-4735-b224-f6c8cb7a964a tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.601518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59dfc7-dde4-48e3-b9f3-a784a83e45cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.602879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59dfc7-dde4-48e3-b9f3-a784a83e45cc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.603177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59dfc7-dde4-48e3-b9f3-a784a83e45cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.603455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59dfc7-dde4-48e3-b9f3-a784a83e45cc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.604121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:49.604434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59dfc7-dde4-48e3-b9f3-a784a83e45cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:49.606871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59dfc7-dde4-48e3-b9f3-a784a83e45cc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:49.624478 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2534/5045] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:49 2022] GET /identity/v3/roles => generated 1651 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:49.624478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59dfc7-dde4-48e3-b9f3-a784a83e45cc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.639548 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2512/5046] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:49 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:49.646540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0cce0-2125-4743-9381-bdd751a1a5d2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.712064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59dfc7-dde4-48e3-b9f3-a784a83e45cc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.719449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2a5b-3878-4414-bbd1-7f8243e69de0 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.719449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2a5b-3878-4414-bbd1-7f8243e69de0 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.720013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2a5b-3878-4414-bbd1-7f8243e69de0 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.720199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2a5b-3878-4414-bbd1-7f8243e69de0 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects/d2d6f248aa1d43e5b9db1f42ab0e4d5b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.721837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b2a5b-3878-4414-bbd1-7f8243e69de0 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:get_project(project_id=d2d6f248aa1d43e5b9db1f42ab0e4d5b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:49.725493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b2a5b-3878-4414-bbd1-7f8243e69de0 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:49.727944 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2535/5047] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:47:49 2022] GET /identity/v3/projects/d2d6f248aa1d43e5b9db1f42ab0e4d5b => generated 359 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:49.729076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2a5b-3878-4414-bbd1-7f8243e69de0 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.731051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-709b2a5b-3878-4414-bbd1-7f8243e69de0 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:49.734593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0cce0-2125-4743-9381-bdd751a1a5d2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.740165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.741298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.742364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.742814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/f7fc9ee9a4154436bb4c237488be2119` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.744637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f7fc9ee9a4154436bb4c237488be2119)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:49.746971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:49.811511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:49.812493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:49.822625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2a5b-3878-4414-bbd1-7f8243e69de0 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.875234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:49.876249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:49.879735 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2513/5048] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:47:49 2022] PATCH /identity/v3/domains/f7fc9ee9a4154436bb4c237488be2119 => generated 276 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:49.881363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.884452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:49.890587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cad916-9036-49f2-afef-41f27a737bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.891216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad916-9036-49f2-afef-41f27a737bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.894142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad916-9036-49f2-afef-41f27a737bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.897746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad916-9036-49f2-afef-41f27a737bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.900128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-26cad916-9036-49f2-afef-41f27a737bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:49.915758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cad916-9036-49f2-afef-41f27a737bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:49.917598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cad916-9036-49f2-afef-41f27a737bc9 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:49.929060 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2536/5049] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:49.930334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cad916-9036-49f2-afef-41f27a737bc9 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:49.932057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-26cad916-9036-49f2-afef-41f27a737bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:49.946444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cad916-9036-49f2-afef-41f27a737bc9 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.950643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e435-44c4-4cea-8407-0732ae6a18c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.951185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e435-44c4-4cea-8407-0732ae6a18c6 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.951472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e435-44c4-4cea-8407-0732ae6a18c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.951751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e435-44c4-4cea-8407-0732ae6a18c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.954176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8165e435-44c4-4cea-8407-0732ae6a18c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:49.987428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e82a4-f8ea-4497-9b9a-cdd016d5eeeb tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:49.993823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b887df-08ea-4cf5-b88d-62b030579977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:49.994576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b887df-08ea-4cf5-b88d-62b030579977 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:49.995013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b887df-08ea-4cf5-b88d-62b030579977 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:49.995386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b887df-08ea-4cf5-b88d-62b030579977 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:49.996686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b887df-08ea-4cf5-b88d-62b030579977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:49.999087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b887df-08ea-4cf5-b88d-62b030579977 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:50.006649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:50.018832 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2514/5050] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:47:49 2022] GET /identity/v3/roles => generated 1651 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:50.018832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b887df-08ea-4cf5-b88d-62b030579977 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:50.018832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a1b887df-08ea-4cf5-b88d-62b030579977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:50.023045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165e435-44c4-4cea-8407-0732ae6a18c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:50.024514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165e435-44c4-4cea-8407-0732ae6a18c6 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:50.035131 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2537/5051] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:50.036326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e435-44c4-4cea-8407-0732ae6a18c6 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:50.037822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8165e435-44c4-4cea-8407-0732ae6a18c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:50.099272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:50.129768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b887df-08ea-4cf5-b88d-62b030579977 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:50.136971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6302351-788b-469a-ae9a-d51828973953 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:50.137887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302351-788b-469a-ae9a-d51828973953 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:50.138316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302351-788b-469a-ae9a-d51828973953 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:50.138699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302351-788b-469a-ae9a-d51828973953 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects/d2d6f248aa1d43e5b9db1f42ab0e4d5b/users/ee21e783f3434be390b0e6affa101854/roles/b37b8d1b528c49b19cbc4ed54c82fa02` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:50.141132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6302351-788b-469a-ae9a-d51828973953 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d2d6f248aa1d43e5b9db1f42ab0e4d5b, user_id=ee21e783f3434be390b0e6affa101854, role_id=b37b8d1b528c49b19cbc4ed54c82fa02)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:50.145661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6302351-788b-469a-ae9a-d51828973953 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:50.176958 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2515/5052] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:50 2022] PUT /identity/v3/projects/d2d6f248aa1d43e5b9db1f42ab0e4d5b/users/ee21e783f3434be390b0e6affa101854/roles/b37b8d1b528c49b19cbc4ed54c82fa02 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:50.176958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6302351-788b-469a-ae9a-d51828973953 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:50.181511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e435-44c4-4cea-8407-0732ae6a18c6 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:50.301762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:50.303403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:50.304072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:50.304592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/f7fc9ee9a4154436bb4c237488be2119` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:50.304754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6302351-788b-469a-ae9a-d51828973953 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:50.310659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf3cb6-434e-4f24-a168-584f8a5a21b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:50.311432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3cb6-434e-4f24-a168-584f8a5a21b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:50.311784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3cb6-434e-4f24-a168-584f8a5a21b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:50.312129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3cb6-434e-4f24-a168-584f8a5a21b5 admin admin] PATH_INFO: `/v3/projects/1992525ac2df4ba695aa60e808703806/users/cc3f3d49a2f6431e9a006aa324911803/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:50.320917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f7fc9ee9a4154436bb4c237488be2119)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:50.324141 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:50.324141 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:50.324141 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:50.325671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:50.335520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf3cb6-434e-4f24-a168-584f8a5a21b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1992525ac2df4ba695aa60e808703806, user_id=cc3f3d49a2f6431e9a006aa324911803, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:50.339468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf3cb6-434e-4f24-a168-584f8a5a21b5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:50.360400 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2516/5053] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:47:50 2022] PUT /identity/v3/projects/1992525ac2df4ba695aa60e808703806/users/cc3f3d49a2f6431e9a006aa324911803/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:50.361647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf3cb6-434e-4f24-a168-584f8a5a21b5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:50.381118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:50.453045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:50.537581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf3cb6-434e-4f24-a168-584f8a5a21b5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:50.549539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d603a9a-2e1f-4e14-91b9-168221971e42 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:50.550528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d603a9a-2e1f-4e14-91b9-168221971e42 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:50.550911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d603a9a-2e1f-4e14-91b9-168221971e42 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:50.551391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d603a9a-2e1f-4e14-91b9-168221971e42 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/ee21e783f3434be390b0e6affa101854/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:50.556871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d603a9a-2e1f-4e14-91b9-168221971e42 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=ee21e783f3434be390b0e6affa101854)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:50.559260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d603a9a-2e1f-4e14-91b9-168221971e42 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:50.605945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119', 'request_id': 'req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:50.632550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119', 'request_id': 'req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:50.643533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119', 'request_id': 'req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:50.645191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:50.661125 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2517/5054] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:47:50 2022] GET /identity/v3/users/ee21e783f3434be390b0e6affa101854/projects => generated 842 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:50.665947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11a90d-cb0f-4728-874d-05ed08b25460 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:50.666236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11a90d-cb0f-4728-874d-05ed08b25460 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:50.666514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11a90d-cb0f-4728-874d-05ed08b25460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:50.672196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] The token cache is being invalidate because project f7fc9ee9a4154436bb4c237488be2119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:50.672597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:50.674423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:50.734728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119', 'request_id': 'req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:50.735809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119', 'request_id': 'req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:50.736710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f7fc9ee9a4154436bb4c237488be2119', 'request_id': 'req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:50.761920 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2538/5055] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:47:50 2022] DELETE /identity/v3/domains/f7fc9ee9a4154436bb4c237488be2119 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:50.763327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:50.769705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:50.776799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9f11a90d-cb0f-4728-874d-05ed08b25460 None None] MFA Rules not processed for user `cc3f3d49a2f6431e9a006aa324911803`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:50.778137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9f11a90d-cb0f-4728-874d-05ed08b25460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:50.809655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:50.929224 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2518/5056] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:50.930477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11a90d-cb0f-4728-874d-05ed08b25460 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:50.931980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9f11a90d-cb0f-4728-874d-05ed08b25460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:50.968698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cd1cd-aeea-496c-84c5-d441f2e6c1b2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:50.988338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:50.989244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:50.989812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:50.990289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects/d2d6f248aa1d43e5b9db1f42ab0e4d5b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:50.991886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d2d6f248aa1d43e5b9db1f42ab0e4d5b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:50.994277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:51.149211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11a90d-cb0f-4728-874d-05ed08b25460 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:51.159230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d6f248aa1d43e5b9db1f42ab0e4d5b', 'request_id': 'req-16a9155d-583f-4d09-8c34-c5d179dd43c1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:51.177365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d6f248aa1d43e5b9db1f42ab0e4d5b', 'request_id': 'req-16a9155d-583f-4d09-8c34-c5d179dd43c1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:51.191051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d6f248aa1d43e5b9db1f42ab0e4d5b', 'request_id': 'req-16a9155d-583f-4d09-8c34-c5d179dd43c1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:51.221462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] The token cache is being invalidate because project d2d6f248aa1d43e5b9db1f42ab0e4d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:51.221764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:51.222682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:51.228028 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2539/5057] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:50 2022] DELETE /identity/v3/projects/d2d6f248aa1d43e5b9db1f42ab0e4d5b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:51.231434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:51.234983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:51.258916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a8741-517e-496f-bfba-876e48c5b3bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:51.259557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a8741-517e-496f-bfba-876e48c5b3bf service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:51.259845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a8741-517e-496f-bfba-876e48c5b3bf service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:51.260163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a8741-517e-496f-bfba-876e48c5b3bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:51.262003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-509a8741-517e-496f-bfba-876e48c5b3bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:51.358672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9155d-583f-4d09-8c34-c5d179dd43c1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:51.366598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:51.369661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8a5b5-6493-4f40-9b3b-e0407f80bcff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:51.372131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8a5b5-6493-4f40-9b3b-e0407f80bcff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:51.373494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8a5b5-6493-4f40-9b3b-e0407f80bcff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:51.374131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8a5b5-6493-4f40-9b3b-e0407f80bcff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:51.375954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8a5b5-6493-4f40-9b3b-e0407f80bcff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:51.379499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8a5b5-6493-4f40-9b3b-e0407f80bcff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:51.389516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:51.418622 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2540/5058] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:47:51 2022] POST /identity/v3/domains => generated 277 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:51.420674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8a5b5-6493-4f40-9b3b-e0407f80bcff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:51.426703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-54f8a5b5-6493-4f40-9b3b-e0407f80bcff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:51.444179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a8741-517e-496f-bfba-876e48c5b3bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:51.446181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a8741-517e-496f-bfba-876e48c5b3bf service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:51.475449 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2519/5059] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:50 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:51.476770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a8741-517e-496f-bfba-876e48c5b3bf service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:51.481318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-509a8741-517e-496f-bfba-876e48c5b3bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:51.556268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8a5b5-6493-4f40-9b3b-e0407f80bcff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:51.563339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80898c1-6dc6-4ac8-bb67-24c6c6c622b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:51.563975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80898c1-6dc6-4ac8-bb67-24c6c6c622b9 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:51.564875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80898c1-6dc6-4ac8-bb67-24c6c6c622b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:51.565150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80898c1-6dc6-4ac8-bb67-24c6c6c622b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:51.582809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b80898c1-6dc6-4ac8-bb67-24c6c6c622b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:51.643492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a8741-517e-496f-bfba-876e48c5b3bf service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:51.706664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80898c1-6dc6-4ac8-bb67-24c6c6c622b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:51.712138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80898c1-6dc6-4ac8-bb67-24c6c6c622b9 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:51.741495 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2541/5060] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:51.744355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80898c1-6dc6-4ac8-bb67-24c6c6c622b9 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:51.790056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:51.790744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:51.791031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:51.791532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects/138d36a3eae448fc912f5fd8c18cc91a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:51.795211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:delete_project(project_id=138d36a3eae448fc912f5fd8c18cc91a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:51.799416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:51.898110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80898c1-6dc6-4ac8-bb67-24c6c6c622b9 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:51.913308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138d36a3eae448fc912f5fd8c18cc91a', 'request_id': 'req-b564ccd3-266c-4a96-a4c1-11af86fe021b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:51.930512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138d36a3eae448fc912f5fd8c18cc91a', 'request_id': 'req-b564ccd3-266c-4a96-a4c1-11af86fe021b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:51.942763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138d36a3eae448fc912f5fd8c18cc91a', 'request_id': 'req-b564ccd3-266c-4a96-a4c1-11af86fe021b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:51.971506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] The token cache is being invalidate because project 138d36a3eae448fc912f5fd8c18cc91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:51.971867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:51.972869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:51.975461 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2520/5061] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:51 2022] DELETE /identity/v3/projects/138d36a3eae448fc912f5fd8c18cc91a => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:51.979529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:51.981368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:52.003649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:52.045437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:52.079201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4446b-e26f-42f3-931b-e63ce3c855c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:52.082323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4446b-e26f-42f3-931b-e63ce3c855c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:52.082608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4446b-e26f-42f3-931b-e63ce3c855c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:52.089656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4446b-e26f-42f3-931b-e63ce3c855c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/943ac644e9f94001ac4a04b347f68877/config` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:52.090095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4446b-e26f-42f3-931b-e63ce3c855c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=943ac644e9f94001ac4a04b347f68877)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:52.095953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4446b-e26f-42f3-931b-e63ce3c855c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:52.119093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564ccd3-266c-4a96-a4c1-11af86fe021b tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:52.139558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:52.140463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:52.144916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:52.145317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/roles/b37b8d1b528c49b19cbc4ed54c82fa02` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:52.147964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b37b8d1b528c49b19cbc4ed54c82fa02)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:52.149984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:52.170732 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2542/5062] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:47:51 2022] PUT /identity/v3/domains/943ac644e9f94001ac4a04b347f68877/config => generated 138 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:52.174865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4446b-e26f-42f3-931b-e63ce3c855c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:52.176917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9ef4446b-e26f-42f3-931b-e63ce3c855c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:52.190317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4446b-e26f-42f3-931b-e63ce3c855c1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:52.197359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3bf3d-4e91-4e8a-8486-92922157d4d3 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:52.198169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3bf3d-4e91-4e8a-8486-92922157d4d3 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:52.198463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3bf3d-4e91-4e8a-8486-92922157d4d3 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:52.198791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3bf3d-4e91-4e8a-8486-92922157d4d3 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:52.199977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3bf3d-4e91-4e8a-8486-92922157d4d3 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=943ac644e9f94001ac4a04b347f68877, group=identity)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:52.201706 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-4ff3bf3d-4e91-4e8a-8486-92922157d4d3 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:52.201706 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:52.201706 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:52.202692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3bf3d-4e91-4e8a-8486-92922157d4d3 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:52.204509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invalidating the token cache because role b37b8d1b528c49b19cbc4ed54c82fa02 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:52.205121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.206019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.209186 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2521/5063] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:51 2022] DELETE /identity/v3/roles/b37b8d1b528c49b19cbc4ed54c82fa02 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:52.213537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:52.215464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:52.250508 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2543/5064] 10.222.0.16 () {60 vars in 1297 bytes} [Mon Aug 29 15:47:52 2022] PATCH /identity/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity => generated 176 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:47:52.251580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3bf3d-4e91-4e8a-8486-92922157d4d3 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:52.257366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4ff3bf3d-4e91-4e8a-8486-92922157d4d3 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:52.279497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3bf3d-4e91-4e8a-8486-92922157d4d3 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:52.332430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a687fd0-8c2a-4632-b266-f12b316bb73c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:52.344423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:52.345154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:52.345373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:52.345868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/ee21e783f3434be390b0e6affa101854` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:52.348490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ee21e783f3434be390b0e6affa101854)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:52.358955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:52.448954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fad23-d51b-46b2-91ed-70c3e5d9e6ff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:52.451311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fad23-d51b-46b2-91ed-70c3e5d9e6ff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:52.451609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fad23-d51b-46b2-91ed-70c3e5d9e6ff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:52.452820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fad23-d51b-46b2-91ed-70c3e5d9e6ff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity/driver` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:52.453535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fad23-d51b-46b2-91ed-70c3e5d9e6ff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=943ac644e9f94001ac4a04b347f68877, group=identity, option=driver)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:52.460406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fad23-d51b-46b2-91ed-70c3e5d9e6ff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:52.473952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee21e783f3434be390b0e6affa101854'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.476437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee21e783f3434be390b0e6affa101854'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.518466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee21e783f3434be390b0e6affa101854'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.522787 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2544/5065] 10.222.0.16 () {60 vars in 1318 bytes} [Mon Aug 29 15:47:52 2022] PATCH /identity/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity/driver => generated 176 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:52.523935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fad23-d51b-46b2-91ed-70c3e5d9e6ff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:52.547974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee21e783f3434be390b0e6affa101854'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.551065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fad23-d51b-46b2-91ed-70c3e5d9e6ff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:52.557650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90e65e-f95e-4ac5-bc3e-1e632c5ea4fe tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:52.558308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90e65e-f95e-4ac5-bc3e-1e632c5ea4fe tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:52.558598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90e65e-f95e-4ac5-bc3e-1e632c5ea4fe tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:52.558870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90e65e-f95e-4ac5-bc3e-1e632c5ea4fe tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity/driver` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:52.560654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90e65e-f95e-4ac5-bc3e-1e632c5ea4fe tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=943ac644e9f94001ac4a04b347f68877, group=identity, option=driver)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:52.561260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90e65e-f95e-4ac5-bc3e-1e632c5ea4fe tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:52.574628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee21e783f3434be390b0e6affa101854'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.579595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:52.588502 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2545/5066] 10.222.0.16 () {58 vars in 1299 bytes} [Mon Aug 29 15:47:52 2022] DELETE /identity/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity/driver => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:52.590935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90e65e-f95e-4ac5-bc3e-1e632c5ea4fe tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:52.593019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3f90e65e-f95e-4ac5-bc3e-1e632c5ea4fe tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:52.596950 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2522/5067] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:52 2022] DELETE /identity/v3/users/ee21e783f3434be390b0e6affa101854 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:52.598246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:52.601935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:52.609844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90e65e-f95e-4ac5-bc3e-1e632c5ea4fe tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:52.732446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163183d-79a8-4928-8a0d-928fcca16e25 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:52.735513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:52.747131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:52.748438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:52.748827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:52.749313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects/75de8a37e8d54ebc9f3619c3537330e4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:52.750800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b3169-97ce-4328-a809-36af0bb251ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:52.750954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:delete_project(project_id=75de8a37e8d54ebc9f3619c3537330e4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:52.751473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b3169-97ce-4328-a809-36af0bb251ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:52.751759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b3169-97ce-4328-a809-36af0bb251ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:52.752039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b3169-97ce-4328-a809-36af0bb251ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity/driver` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:52.753844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:52.767987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b3169-97ce-4328-a809-36af0bb251ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=943ac644e9f94001ac4a04b347f68877, group=identity, option=driver)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:52.773147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b3169-97ce-4328-a809-36af0bb251ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-b11b3169-97ce-4328-a809-36af0bb251ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Could not find option driver in group identity in domain configuration for domain 943ac644e9f94001ac4a04b347f68877.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 943ac644e9f94001ac4a04b347f68877. Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:52.806935 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 29 15:47:52.808035 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 29 15:47:52.808035 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 29 15:47:52.808035 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 29 15:47:52.808035 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:47:52.808035 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:47:52.808035 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 29 15:47:52.808035 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 29 15:47:52.808035 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 943ac644e9f94001ac4a04b347f68877. Aug 29 15:47:52.808035 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:47:52.813086 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2546/5068] 10.222.0.16 () {58 vars in 1296 bytes} [Mon Aug 29 15:47:52 2022] GET /identity/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity/driver => generated 171 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:47:52.813604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b3169-97ce-4328-a809-36af0bb251ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:52.857288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b3169-97ce-4328-a809-36af0bb251ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:52.880092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75de8a37e8d54ebc9f3619c3537330e4', 'request_id': 'req-f6af894a-0321-4807-99b8-25fcf41f4662'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.894985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75de8a37e8d54ebc9f3619c3537330e4', 'request_id': 'req-f6af894a-0321-4807-99b8-25fcf41f4662'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.908244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75de8a37e8d54ebc9f3619c3537330e4', 'request_id': 'req-f6af894a-0321-4807-99b8-25fcf41f4662'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.929881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] The token cache is being invalidate because project 75de8a37e8d54ebc9f3619c3537330e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:52.931473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.932631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:52.936351 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2523/5069] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:52 2022] DELETE /identity/v3/projects/75de8a37e8d54ebc9f3619c3537330e4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:52.941635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:52.944232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:52.957974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac282f-3ca7-4600-a4b1-fd917a11d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:52.958844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac282f-3ca7-4600-a4b1-fd917a11d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:52.959886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac282f-3ca7-4600-a4b1-fd917a11d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:52.960295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac282f-3ca7-4600-a4b1-fd917a11d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:52.961008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac282f-3ca7-4600-a4b1-fd917a11d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=943ac644e9f94001ac4a04b347f68877, group=identity)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:52.962766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac282f-3ca7-4600-a4b1-fd917a11d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:52.987024 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2547/5070] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Aug 29 15:47:52 2022] DELETE /identity/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:52.988093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac282f-3ca7-4600-a4b1-fd917a11d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:52.990771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4eac282f-3ca7-4600-a4b1-fd917a11d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:53.005049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac282f-3ca7-4600-a4b1-fd917a11d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:53.011160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad7feb-4b1c-4846-b0ba-73447e65f3c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:53.011910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7feb-4b1c-4846-b0ba-73447e65f3c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.012320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7feb-4b1c-4846-b0ba-73447e65f3c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.012702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7feb-4b1c-4846-b0ba-73447e65f3c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.015057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad7feb-4b1c-4846-b0ba-73447e65f3c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=943ac644e9f94001ac4a04b347f68877, group=identity)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:53.017130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad7feb-4b1c-4846-b0ba-73447e65f3c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-5fad7feb-4b1c-4846-b0ba-73447e65f3c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Could not find group identity in domain configuration for domain 943ac644e9f94001ac4a04b347f68877.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 943ac644e9f94001ac4a04b347f68877. Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:53.027706 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 29 15:47:53.028681 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 29 15:47:53.028681 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 29 15:47:53.028681 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 29 15:47:53.028681 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:47:53.028681 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:47:53.028681 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 29 15:47:53.028681 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 29 15:47:53.028681 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 943ac644e9f94001ac4a04b347f68877. Aug 29 15:47:53.028681 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:47:53.033309 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2548/5071] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Aug 29 15:47:52 2022] GET /identity/v3/domains/943ac644e9f94001ac4a04b347f68877/config/identity => generated 154 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:47:53.034315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad7feb-4b1c-4846-b0ba-73447e65f3c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:53.051754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad7feb-4b1c-4846-b0ba-73447e65f3c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:53.065523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e218565-d04f-4a1e-80f6-eb6331ce4ac8 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:53.066591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e218565-d04f-4a1e-80f6-eb6331ce4ac8 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.067077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e218565-d04f-4a1e-80f6-eb6331ce4ac8 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.069063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e218565-d04f-4a1e-80f6-eb6331ce4ac8 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/943ac644e9f94001ac4a04b347f68877/config` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.071437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e218565-d04f-4a1e-80f6-eb6331ce4ac8 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=943ac644e9f94001ac4a04b347f68877)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:53.075398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e218565-d04f-4a1e-80f6-eb6331ce4ac8 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:53.078663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af894a-0321-4807-99b8-25fcf41f4662 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:53.088050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3ff08-de98-4abf-9790-0695a195a678 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:53.089535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3ff08-de98-4abf-9790-0695a195a678 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.090288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3ff08-de98-4abf-9790-0695a195a678 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.092291 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2549/5072] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:47:53 2022] DELETE /identity/v3/domains/943ac644e9f94001ac4a04b347f68877/config => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:53.092878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3ff08-de98-4abf-9790-0695a195a678 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/98b8736d32c540168ce804b4e4a551f7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.094958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3ff08-de98-4abf-9790-0695a195a678 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:update_user(user_id=98b8736d32c540168ce804b4e4a551f7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:53.096441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e218565-d04f-4a1e-80f6-eb6331ce4ac8 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:53.097610 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-e1f3ff08-de98-4abf-9790-0695a195a678 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:53.097610 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:53.097610 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:53.104785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3ff08-de98-4abf-9790-0695a195a678 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:53.111113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e218565-d04f-4a1e-80f6-eb6331ce4ac8 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:53.132399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:53.133333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.133858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.134500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/943ac644e9f94001ac4a04b347f68877` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.137015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=943ac644e9f94001ac4a04b347f68877)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:53.139086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:53.175395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '943ac644e9f94001ac4a04b347f68877'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.176159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '943ac644e9f94001ac4a04b347f68877'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.178935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1f3ff08-de98-4abf-9790-0695a195a678 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '98b8736d32c540168ce804b4e4a551f7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.194734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1f3ff08-de98-4abf-9790-0695a195a678 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invalidating the token cache because user 98b8736d32c540168ce804b4e4a551f7 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:53.195055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1f3ff08-de98-4abf-9790-0695a195a678 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.195670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1f3ff08-de98-4abf-9790-0695a195a678 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.200307 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2524/5073] 10.222.0.16 () {60 vars in 1243 bytes} [Mon Aug 29 15:47:52 2022] PATCH /identity/v3/users/98b8736d32c540168ce804b4e4a551f7 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:53.202199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71209-ef54-4c98-8ff2-23cd3abb65cc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.202492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71209-ef54-4c98-8ff2-23cd3abb65cc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.202773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71209-ef54-4c98-8ff2-23cd3abb65cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.209260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '943ac644e9f94001ac4a04b347f68877'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.209990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '943ac644e9f94001ac4a04b347f68877'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.215309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:53.216432 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2550/5074] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:47:53 2022] PATCH /identity/v3/domains/943ac644e9f94001ac4a04b347f68877 => generated 278 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:53.217649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:53.219476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:53.273278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7be71209-ef54-4c98-8ff2-23cd3abb65cc None None] MFA Rules not processed for user `98b8736d32c540168ce804b4e4a551f7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:53.280669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7be71209-ef54-4c98-8ff2-23cd3abb65cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:53.298734 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2525/5075] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:53 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:47:53.300561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be71209-ef54-4c98-8ff2-23cd3abb65cc None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:53.302750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7be71209-ef54-4c98-8ff2-23cd3abb65cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:53.307202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf269b-3076-461e-9cb0-11ff89240132 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:53.312707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:53.313812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.314103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.314379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/943ac644e9f94001ac4a04b347f68877` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.329977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=943ac644e9f94001ac4a04b347f68877)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:53.331489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:53.347933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:53.367861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '943ac644e9f94001ac4a04b347f68877'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.381970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '943ac644e9f94001ac4a04b347f68877'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.466484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943ac644e9f94001ac4a04b347f68877', 'request_id': 'req-dee7151c-05b3-4823-99f7-00f297d1ffa1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.493218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943ac644e9f94001ac4a04b347f68877', 'request_id': 'req-dee7151c-05b3-4823-99f7-00f297d1ffa1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.528913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943ac644e9f94001ac4a04b347f68877', 'request_id': 'req-dee7151c-05b3-4823-99f7-00f297d1ffa1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.559723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be71209-ef54-4c98-8ff2-23cd3abb65cc None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:53.571892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] The token cache is being invalidate because project 943ac644e9f94001ac4a04b347f68877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:53.571892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.573620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.625015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '943ac644e9f94001ac4a04b347f68877', 'request_id': 'req-dee7151c-05b3-4823-99f7-00f297d1ffa1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.628895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '943ac644e9f94001ac4a04b347f68877', 'request_id': 'req-dee7151c-05b3-4823-99f7-00f297d1ffa1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.631082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '943ac644e9f94001ac4a04b347f68877', 'request_id': 'req-dee7151c-05b3-4823-99f7-00f297d1ffa1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.653373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:53.655946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.656539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.656992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/98b8736d32c540168ce804b4e4a551f7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.657435 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2551/5076] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:47:53 2022] DELETE /identity/v3/domains/943ac644e9f94001ac4a04b347f68877 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:53.662407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:53.665008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:update_user(user_id=98b8736d32c540168ce804b4e4a551f7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:53.665921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:53.667638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:53.737246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '98b8736d32c540168ce804b4e4a551f7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.750992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invalidating the token cache because user 98b8736d32c540168ce804b4e4a551f7 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:53.751296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.751942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.754118 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2526/5077] 10.222.0.16 () {60 vars in 1243 bytes} [Mon Aug 29 15:47:53 2022] PATCH /identity/v3/users/98b8736d32c540168ce804b4e4a551f7 => generated 297 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:47:53.759257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:53.760804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:53.790795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527ab9f-483d-4f5f-91d5-139e36f8ba52 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:53.808166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48821d-32a0-4da5-98b1-09631fc1a4d1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:53.809177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48821d-32a0-4da5-98b1-09631fc1a4d1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.809935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48821d-32a0-4da5-98b1-09631fc1a4d1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.810227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48821d-32a0-4da5-98b1-09631fc1a4d1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/98b8736d32c540168ce804b4e4a551f7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.827022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7151c-05b3-4823-99f7-00f297d1ffa1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:53.832885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48821d-32a0-4da5-98b1-09631fc1a4d1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:update_user(user_id=98b8736d32c540168ce804b4e4a551f7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:53.836727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48821d-32a0-4da5-98b1-09631fc1a4d1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:53.838757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba82ec6-64e2-4159-a6df-cdbf635d776e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:53.839562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba82ec6-64e2-4159-a6df-cdbf635d776e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.839852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba82ec6-64e2-4159-a6df-cdbf635d776e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.840130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba82ec6-64e2-4159-a6df-cdbf635d776e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.840806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba82ec6-64e2-4159-a6df-cdbf635d776e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:53.841972 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-8ba82ec6-64e2-4159-a6df-cdbf635d776e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:53.841972 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:53.841972 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:53.843962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba82ec6-64e2-4159-a6df-cdbf635d776e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:53.855894 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2552/5078] 10.222.0.16 () {58 vars in 1173 bytes} [Mon Aug 29 15:47:53 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:53.871389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba82ec6-64e2-4159-a6df-cdbf635d776e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:53.877090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8ba82ec6-64e2-4159-a6df-cdbf635d776e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:53.884139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c48821d-32a0-4da5-98b1-09631fc1a4d1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '98b8736d32c540168ce804b4e4a551f7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.894990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c48821d-32a0-4da5-98b1-09631fc1a4d1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invalidating the token cache because user 98b8736d32c540168ce804b4e4a551f7 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:53.896668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c48821d-32a0-4da5-98b1-09631fc1a4d1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.897756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c48821d-32a0-4da5-98b1-09631fc1a4d1 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:53.902373 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2527/5079] 10.222.0.16 () {60 vars in 1243 bytes} [Mon Aug 29 15:47:53 2022] PATCH /identity/v3/users/98b8736d32c540168ce804b4e4a551f7 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:53.906939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758c0d6-5b6b-47b9-9f22-93e05a2a1069 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.909029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758c0d6-5b6b-47b9-9f22-93e05a2a1069 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.909421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758c0d6-5b6b-47b9-9f22-93e05a2a1069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.929283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba82ec6-64e2-4159-a6df-cdbf635d776e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:53.954000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bbf42-0936-421b-99c7-5836acc6db7a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:53.954904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bbf42-0936-421b-99c7-5836acc6db7a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.955014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bbf42-0936-421b-99c7-5836acc6db7a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.955310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bbf42-0936-421b-99c7-5836acc6db7a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.955821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bbf42-0936-421b-99c7-5836acc6db7a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:53.957616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e758c0d6-5b6b-47b9-9f22-93e05a2a1069 None None] MFA Rules not processed for user `98b8736d32c540168ce804b4e4a551f7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:53.958150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bbf42-0936-421b-99c7-5836acc6db7a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:53.959047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e758c0d6-5b6b-47b9-9f22-93e05a2a1069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:53.966396 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2528/5080] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:53 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:47:53.967481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758c0d6-5b6b-47b9-9f22-93e05a2a1069 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:53.970500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e758c0d6-5b6b-47b9-9f22-93e05a2a1069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:53.977803 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2553/5081] 10.222.0.16 () {58 vars in 1200 bytes} [Mon Aug 29 15:47:53 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:53.978749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bbf42-0936-421b-99c7-5836acc6db7a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:53.982502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e60bbf42-0936-421b-99c7-5836acc6db7a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:53.990900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758c0d6-5b6b-47b9-9f22-93e05a2a1069 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:53.997670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be603a-b219-4419-9bce-effec46b216f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:53.998349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be603a-b219-4419-9bce-effec46b216f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:53.998634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be603a-b219-4419-9bce-effec46b216f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:53.998915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be603a-b219-4419-9bce-effec46b216f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:53.999531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be603a-b219-4419-9bce-effec46b216f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.000796 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-17be603a-b219-4419-9bce-effec46b216f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:54.000796 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:47:54.000796 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:47:54.001865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be603a-b219-4419-9bce-effec46b216f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.006884 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2529/5082] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:47:53 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.009233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be603a-b219-4419-9bce-effec46b216f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.017140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:54.019176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bbf42-0936-421b-99c7-5836acc6db7a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.022197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be603a-b219-4419-9bce-effec46b216f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.032369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca2f6-9941-4795-8d13-27c7f31518c5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.033148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca2f6-9941-4795-8d13-27c7f31518c5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.033584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca2f6-9941-4795-8d13-27c7f31518c5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.033725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.034181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca2f6-9941-4795-8d13-27c7f31518c5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.034323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.034603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.035190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/98b8736d32c540168ce804b4e4a551f7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.035621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ca2f6-9941-4795-8d13-27c7f31518c5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.038158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ca2f6-9941-4795-8d13-27c7f31518c5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.038286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:update_user(user_id=98b8736d32c540168ce804b4e4a551f7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.039336 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:47:54.039336 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:47:54.039336 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:47:54.042566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.043613 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2530/5083] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 15:47:54.044448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca2f6-9941-4795-8d13-27c7f31518c5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.057579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca2f6-9941-4795-8d13-27c7f31518c5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.063051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c8316-10fe-4f80-a1a8-67ad99a1af47 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.063846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8316-10fe-4f80-a1a8-67ad99a1af47 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.064130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8316-10fe-4f80-a1a8-67ad99a1af47 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.064555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8316-10fe-4f80-a1a8-67ad99a1af47 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.066771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c8316-10fe-4f80-a1a8-67ad99a1af47 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.068587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c8316-10fe-4f80-a1a8-67ad99a1af47 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.078798 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2531/5084] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:47:54.079882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c8316-10fe-4f80-a1a8-67ad99a1af47 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.092382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c8316-10fe-4f80-a1a8-67ad99a1af47 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.104110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b437d-167c-4701-82c0-7084cdf398f4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.104880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b437d-167c-4701-82c0-7084cdf398f4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.105167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b437d-167c-4701-82c0-7084cdf398f4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.105543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b437d-167c-4701-82c0-7084cdf398f4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.106688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b437d-167c-4701-82c0-7084cdf398f4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.109319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b437d-167c-4701-82c0-7084cdf398f4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.114196 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2532/5085] 10.222.0.16 () {58 vars in 1200 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.116370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b437d-167c-4701-82c0-7084cdf398f4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.121005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '98b8736d32c540168ce804b4e4a551f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:54.131463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b437d-167c-4701-82c0-7084cdf398f4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.132435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invalidating the token cache because user 98b8736d32c540168ce804b4e4a551f7 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:54.132760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:54.134110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:54.139893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e4ba5-6068-4558-bc60-74d986b1104b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.140850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4ba5-6068-4558-bc60-74d986b1104b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.141687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4ba5-6068-4558-bc60-74d986b1104b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.141958 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2554/5086] 10.222.0.16 () {60 vars in 1243 bytes} [Mon Aug 29 15:47:53 2022] PATCH /identity/v3/users/98b8736d32c540168ce804b4e4a551f7 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:54.142317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e4ba5-6068-4558-bc60-74d986b1104b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.142887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.143278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e4ba5-6068-4558-bc60-74d986b1104b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.145152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e4ba5-6068-4558-bc60-74d986b1104b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.147896 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2533/5087] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.151173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:54.154144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e4ba5-6068-4558-bc60-74d986b1104b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.156274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b54e4ba5-6068-4558-bc60-74d986b1104b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:54.174262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e4ba5-6068-4558-bc60-74d986b1104b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.174483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7ddd0-c13b-442a-ae8a-0b62708f1800 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.184598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8173939-407c-4cdd-9c2c-d108afc6e5f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.185749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173939-407c-4cdd-9c2c-d108afc6e5f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.186221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173939-407c-4cdd-9c2c-d108afc6e5f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.186780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8173939-407c-4cdd-9c2c-d108afc6e5f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.187260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083e432-16bf-4917-984f-b8c0422e853d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.187881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083e432-16bf-4917-984f-b8c0422e853d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.188142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8173939-407c-4cdd-9c2c-d108afc6e5f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.188270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083e432-16bf-4917-984f-b8c0422e853d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.188442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083e432-16bf-4917-984f-b8c0422e853d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.189073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083e432-16bf-4917-984f-b8c0422e853d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.190546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8173939-407c-4cdd-9c2c-d108afc6e5f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.191177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083e432-16bf-4917-984f-b8c0422e853d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.196746 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2534/5088] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.199049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8173939-407c-4cdd-9c2c-d108afc6e5f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.213201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8173939-407c-4cdd-9c2c-d108afc6e5f0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.220428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa285fd-85e8-4b5d-821b-82fd3ad954fa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.221358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa285fd-85e8-4b5d-821b-82fd3ad954fa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.221944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa285fd-85e8-4b5d-821b-82fd3ad954fa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.223091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa285fd-85e8-4b5d-821b-82fd3ad954fa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.224098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa285fd-85e8-4b5d-821b-82fd3ad954fa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.226630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa285fd-85e8-4b5d-821b-82fd3ad954fa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.232223 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2535/5089] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.234141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa285fd-85e8-4b5d-821b-82fd3ad954fa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.260035 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2555/5090] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:47:54 2022] POST /identity/v3/users => generated 264 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:54.261452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083e432-16bf-4917-984f-b8c0422e853d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.266594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa285fd-85e8-4b5d-821b-82fd3ad954fa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.274791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86fa44-eda9-451e-b67a-37d489da16d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.275601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=80,keystone:DELETE=13,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:54.277095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fa44-eda9-451e-b67a-37d489da16d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.277650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fa44-eda9-451e-b67a-37d489da16d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.278765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fa44-eda9-451e-b67a-37d489da16d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.279919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86fa44-eda9-451e-b67a-37d489da16d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.280476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083e432-16bf-4917-984f-b8c0422e853d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.286094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86fa44-eda9-451e-b67a-37d489da16d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.302864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a192cb-f90c-418b-8e89-75eeeb476a53 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.303757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a192cb-f90c-418b-8e89-75eeeb476a53 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.304216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a192cb-f90c-418b-8e89-75eeeb476a53 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.304898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a192cb-f90c-418b-8e89-75eeeb476a53 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/2bf6957fdc2e43588a95d1d6a2a11680/password` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.318200 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2536/5091] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.319176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86fa44-eda9-451e-b67a-37d489da16d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.341495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86fa44-eda9-451e-b67a-37d489da16d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.347713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eafa08-d831-4c0e-9b53-5a8a6533a4b4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.348595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eafa08-d831-4c0e-9b53-5a8a6533a4b4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.348886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eafa08-d831-4c0e-9b53-5a8a6533a4b4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.350006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eafa08-d831-4c0e-9b53-5a8a6533a4b4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.350780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eafa08-d831-4c0e-9b53-5a8a6533a4b4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.352593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eafa08-d831-4c0e-9b53-5a8a6533a4b4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.358337 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2537/5092] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.359166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eafa08-d831-4c0e-9b53-5a8a6533a4b4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.372124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eafa08-d831-4c0e-9b53-5a8a6533a4b4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.377843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f58dd-952b-4fe3-b21e-c1e603373bdf tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.379891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f58dd-952b-4fe3-b21e-c1e603373bdf tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.379891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f58dd-952b-4fe3-b21e-c1e603373bdf tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.379891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f58dd-952b-4fe3-b21e-c1e603373bdf tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.380239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f58dd-952b-4fe3-b21e-c1e603373bdf tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.381838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f58dd-952b-4fe3-b21e-c1e603373bdf tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.386815 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2538/5093] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.388369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f58dd-952b-4fe3-b21e-c1e603373bdf tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.401186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f58dd-952b-4fe3-b21e-c1e603373bdf tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.406635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a576c-8c26-4332-a61a-0bef7c271583 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.407299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a576c-8c26-4332-a61a-0bef7c271583 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.426686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a576c-8c26-4332-a61a-0bef7c271583 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.426980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a576c-8c26-4332-a61a-0bef7c271583 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.428207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a576c-8c26-4332-a61a-0bef7c271583 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.434375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a576c-8c26-4332-a61a-0bef7c271583 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.443411 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2539/5094] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.445620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a576c-8c26-4332-a61a-0bef7c271583 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.462239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a576c-8c26-4332-a61a-0bef7c271583 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.468343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d4459-0e65-4301-90e4-1ab99886465a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.469090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d4459-0e65-4301-90e4-1ab99886465a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.469578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d4459-0e65-4301-90e4-1ab99886465a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.469908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d4459-0e65-4301-90e4-1ab99886465a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.470515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d4459-0e65-4301-90e4-1ab99886465a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.471404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-87a192cb-f90c-418b-8e89-75eeeb476a53 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2bf6957fdc2e43588a95d1d6a2a11680'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:54.473027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d4459-0e65-4301-90e4-1ab99886465a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.479641 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2540/5095] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.480707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d4459-0e65-4301-90e4-1ab99886465a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.496826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d4459-0e65-4301-90e4-1ab99886465a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.499469 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2556/5096] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:47:54 2022] POST /identity/v3/users/2bf6957fdc2e43588a95d1d6a2a11680/password => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:54.505616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0115b48-ad57-48d1-8439-af0d9f930ea7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.507095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115b48-ad57-48d1-8439-af0d9f930ea7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.507429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115b48-ad57-48d1-8439-af0d9f930ea7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.507767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115b48-ad57-48d1-8439-af0d9f930ea7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.508550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0115b48-ad57-48d1-8439-af0d9f930ea7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.540736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0115b48-ad57-48d1-8439-af0d9f930ea7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.551946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a192cb-f90c-418b-8e89-75eeeb476a53 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.553949 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2541/5097] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.582936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a192cb-f90c-418b-8e89-75eeeb476a53 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.599057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf359a-24cc-48ec-b836-dedd934fba27 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.599908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf359a-24cc-48ec-b836-dedd934fba27 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.600212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf359a-24cc-48ec-b836-dedd934fba27 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.600495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf359a-24cc-48ec-b836-dedd934fba27 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.601662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf359a-24cc-48ec-b836-dedd934fba27 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.608860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf359a-24cc-48ec-b836-dedd934fba27 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.613410 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2557/5098] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.614668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0115b48-ad57-48d1-8439-af0d9f930ea7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.636537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0115b48-ad57-48d1-8439-af0d9f930ea7 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.650072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0a154-1ec6-485b-8da3-1cefc4e9456f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.651136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0a154-1ec6-485b-8da3-1cefc4e9456f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.651590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0a154-1ec6-485b-8da3-1cefc4e9456f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.652136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0a154-1ec6-485b-8da3-1cefc4e9456f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.652961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0a154-1ec6-485b-8da3-1cefc4e9456f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.654960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0a154-1ec6-485b-8da3-1cefc4e9456f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.660561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2542/5099] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.661213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf359a-24cc-48ec-b836-dedd934fba27 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.681712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf359a-24cc-48ec-b836-dedd934fba27 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.695275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6fd08-49bd-4dda-bf18-a79e65a034cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.695975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6fd08-49bd-4dda-bf18-a79e65a034cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.696266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6fd08-49bd-4dda-bf18-a79e65a034cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.696550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6fd08-49bd-4dda-bf18-a79e65a034cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.697178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6fd08-49bd-4dda-bf18-a79e65a034cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.698883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6fd08-49bd-4dda-bf18-a79e65a034cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.700327 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2558/5100] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.705491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0a154-1ec6-485b-8da3-1cefc4e9456f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.729526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0a154-1ec6-485b-8da3-1cefc4e9456f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.753661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371abefb-5fc1-4904-b52b-9b2bedfd9a29 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.753661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371abefb-5fc1-4904-b52b-9b2bedfd9a29 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.753661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371abefb-5fc1-4904-b52b-9b2bedfd9a29 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.754358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371abefb-5fc1-4904-b52b-9b2bedfd9a29 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.754358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371abefb-5fc1-4904-b52b-9b2bedfd9a29 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.761402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371abefb-5fc1-4904-b52b-9b2bedfd9a29 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.769202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6fd08-49bd-4dda-bf18-a79e65a034cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.772319 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2543/5101] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.784165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6fd08-49bd-4dda-bf18-a79e65a034cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.791060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b227b31-b840-4bee-99f6-b48e308c2490 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.791794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b227b31-b840-4bee-99f6-b48e308c2490 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.792082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b227b31-b840-4bee-99f6-b48e308c2490 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.792429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b227b31-b840-4bee-99f6-b48e308c2490 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.793644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b227b31-b840-4bee-99f6-b48e308c2490 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.795651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b227b31-b840-4bee-99f6-b48e308c2490 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.801414 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2559/5102] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.804421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371abefb-5fc1-4904-b52b-9b2bedfd9a29 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.830611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371abefb-5fc1-4904-b52b-9b2bedfd9a29 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.855894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7b69a-f07b-4549-aad9-37b0cfd1e4d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.856941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7b69a-f07b-4549-aad9-37b0cfd1e4d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.858104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7b69a-f07b-4549-aad9-37b0cfd1e4d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.858584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7b69a-f07b-4549-aad9-37b0cfd1e4d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.859427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7b69a-f07b-4549-aad9-37b0cfd1e4d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.861251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7b69a-f07b-4549-aad9-37b0cfd1e4d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.862712 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2544/5103] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.869874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b227b31-b840-4bee-99f6-b48e308c2490 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.885300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b227b31-b840-4bee-99f6-b48e308c2490 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.901952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39204-ca01-44b2-b240-e489583df360 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.902838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39204-ca01-44b2-b240-e489583df360 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.903129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39204-ca01-44b2-b240-e489583df360 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.903496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39204-ca01-44b2-b240-e489583df360 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.904107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e39204-ca01-44b2-b240-e489583df360 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.906085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e39204-ca01-44b2-b240-e489583df360 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.911037 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2560/5104] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.912186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7b69a-f07b-4549-aad9-37b0cfd1e4d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.935250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7b69a-f07b-4549-aad9-37b0cfd1e4d4 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.961452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcf3bd-1c21-47f0-b4f4-6052a88eb352 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.961452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf3bd-1c21-47f0-b4f4-6052a88eb352 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.961452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf3bd-1c21-47f0-b4f4-6052a88eb352 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.961977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf3bd-1c21-47f0-b4f4-6052a88eb352 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.961977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcf3bd-1c21-47f0-b4f4-6052a88eb352 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:54.971523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcf3bd-1c21-47f0-b4f4-6052a88eb352 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:54.971779 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2545/5105] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:54.975948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39204-ca01-44b2-b240-e489583df360 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:54.990286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39204-ca01-44b2-b240-e489583df360 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:54.996767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d59fff-b81f-426a-bb0e-0c8da11e1b4a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:54.997746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d59fff-b81f-426a-bb0e-0c8da11e1b4a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:54.998668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d59fff-b81f-426a-bb0e-0c8da11e1b4a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:54.999111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d59fff-b81f-426a-bb0e-0c8da11e1b4a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:54.999718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d59fff-b81f-426a-bb0e-0c8da11e1b4a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.002213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d59fff-b81f-426a-bb0e-0c8da11e1b4a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.007366 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2561/5106] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:47:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.009977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcf3bd-1c21-47f0-b4f4-6052a88eb352 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.032001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcf3bd-1c21-47f0-b4f4-6052a88eb352 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.043128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c570d2-5977-40bd-bf72-43b4aa28b65b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.044388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c570d2-5977-40bd-bf72-43b4aa28b65b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.044934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c570d2-5977-40bd-bf72-43b4aa28b65b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.046192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c570d2-5977-40bd-bf72-43b4aa28b65b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.047385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c570d2-5977-40bd-bf72-43b4aa28b65b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.050957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c570d2-5977-40bd-bf72-43b4aa28b65b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.057195 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2546/5107] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.059373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d59fff-b81f-426a-bb0e-0c8da11e1b4a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.088464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d59fff-b81f-426a-bb0e-0c8da11e1b4a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.102343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72a57b-c868-434f-ab49-72f20dccdbd5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.103412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72a57b-c868-434f-ab49-72f20dccdbd5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.105475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72a57b-c868-434f-ab49-72f20dccdbd5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.107045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72a57b-c868-434f-ab49-72f20dccdbd5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.110708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72a57b-c868-434f-ab49-72f20dccdbd5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.115873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72a57b-c868-434f-ab49-72f20dccdbd5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.122423 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2562/5108] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.124452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c570d2-5977-40bd-bf72-43b4aa28b65b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.162354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c570d2-5977-40bd-bf72-43b4aa28b65b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.174746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e1ca6-9b92-40e3-b78e-cecf8a65aff6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.175523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e1ca6-9b92-40e3-b78e-cecf8a65aff6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.175794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e1ca6-9b92-40e3-b78e-cecf8a65aff6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.176255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e1ca6-9b92-40e3-b78e-cecf8a65aff6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.179000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e1ca6-9b92-40e3-b78e-cecf8a65aff6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.183045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e1ca6-9b92-40e3-b78e-cecf8a65aff6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.188925 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2547/5109] 10.222.0.16 () {58 vars in 1290 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.191812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72a57b-c868-434f-ab49-72f20dccdbd5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.211200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72a57b-c868-434f-ab49-72f20dccdbd5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.221406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c6d93-3cd0-42e3-b4cc-d20240fde05a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.222637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c6d93-3cd0-42e3-b4cc-d20240fde05a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.223178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c6d93-3cd0-42e3-b4cc-d20240fde05a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.226085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c6d93-3cd0-42e3-b4cc-d20240fde05a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.227473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c6d93-3cd0-42e3-b4cc-d20240fde05a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.231000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c6d93-3cd0-42e3-b4cc-d20240fde05a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.236370 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2563/5110] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.238591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e1ca6-9b92-40e3-b78e-cecf8a65aff6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.263834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e1ca6-9b92-40e3-b78e-cecf8a65aff6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.274221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e982291-9294-4d95-99f8-d37a6cf7ee6f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.277992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e982291-9294-4d95-99f8-d37a6cf7ee6f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.278279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e982291-9294-4d95-99f8-d37a6cf7ee6f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.278564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e982291-9294-4d95-99f8-d37a6cf7ee6f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.279433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e982291-9294-4d95-99f8-d37a6cf7ee6f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.281712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e982291-9294-4d95-99f8-d37a6cf7ee6f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.283062 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2548/5111] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.288609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c6d93-3cd0-42e3-b4cc-d20240fde05a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.311777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c6d93-3cd0-42e3-b4cc-d20240fde05a tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.320616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d7eea-35ce-430d-acdb-660657814e26 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.322615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d7eea-35ce-430d-acdb-660657814e26 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.323301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d7eea-35ce-430d-acdb-660657814e26 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.324014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d7eea-35ce-430d-acdb-660657814e26 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.326152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d7eea-35ce-430d-acdb-660657814e26 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.330877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d7eea-35ce-430d-acdb-660657814e26 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.335145 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2564/5112] 10.222.0.16 () {58 vars in 1308 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.338315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e982291-9294-4d95-99f8-d37a6cf7ee6f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.355580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e982291-9294-4d95-99f8-d37a6cf7ee6f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.361602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536b8c4-abc4-4838-972c-d8ec7fbaf759 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.362320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536b8c4-abc4-4838-972c-d8ec7fbaf759 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.363672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536b8c4-abc4-4838-972c-d8ec7fbaf759 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.363960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536b8c4-abc4-4838-972c-d8ec7fbaf759 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.364678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536b8c4-abc4-4838-972c-d8ec7fbaf759 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.366947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536b8c4-abc4-4838-972c-d8ec7fbaf759 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.368357 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2549/5113] 10.222.0.16 () {58 vars in 1290 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.373032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d7eea-35ce-430d-acdb-660657814e26 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.392862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d7eea-35ce-430d-acdb-660657814e26 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.403777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd19d54-4e62-4de4-9624-a5669a1b6ace tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.405323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd19d54-4e62-4de4-9624-a5669a1b6ace tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.406806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd19d54-4e62-4de4-9624-a5669a1b6ace tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.407768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd19d54-4e62-4de4-9624-a5669a1b6ace tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.410117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd19d54-4e62-4de4-9624-a5669a1b6ace tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.415353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd19d54-4e62-4de4-9624-a5669a1b6ace tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.421931 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2565/5114] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.424869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536b8c4-abc4-4838-972c-d8ec7fbaf759 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.440091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536b8c4-abc4-4838-972c-d8ec7fbaf759 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.448240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d40ca2-4ac3-46d9-8223-aff289efd1c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.449032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d40ca2-4ac3-46d9-8223-aff289efd1c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.449414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d40ca2-4ac3-46d9-8223-aff289efd1c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.449745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d40ca2-4ac3-46d9-8223-aff289efd1c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.450994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d40ca2-4ac3-46d9-8223-aff289efd1c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.452843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d40ca2-4ac3-46d9-8223-aff289efd1c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.460375 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2550/5115] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.461845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd19d54-4e62-4de4-9624-a5669a1b6ace tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.477931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd19d54-4e62-4de4-9624-a5669a1b6ace tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.484577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab3c48-00aa-4e26-bd22-2adb3e2894cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.485772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab3c48-00aa-4e26-bd22-2adb3e2894cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.486211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab3c48-00aa-4e26-bd22-2adb3e2894cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.486672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab3c48-00aa-4e26-bd22-2adb3e2894cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.487547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab3c48-00aa-4e26-bd22-2adb3e2894cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.489302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab3c48-00aa-4e26-bd22-2adb3e2894cc tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.495019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d40ca2-4ac3-46d9-8223-aff289efd1c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.523990 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2566/5116] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.528348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82b2d-02dc-41fb-84a8-196cdf2d5e23 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.528849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82b2d-02dc-41fb-84a8-196cdf2d5e23 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.531812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82b2d-02dc-41fb-84a8-196cdf2d5e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.555818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d40ca2-4ac3-46d9-8223-aff289efd1c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.567965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bffff-0703-4f72-8029-e0fa3fe324a1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.569281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bffff-0703-4f72-8029-e0fa3fe324a1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.571641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bffff-0703-4f72-8029-e0fa3fe324a1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.571986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bffff-0703-4f72-8029-e0fa3fe324a1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.572608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bffff-0703-4f72-8029-e0fa3fe324a1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.577025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bffff-0703-4f72-8029-e0fa3fe324a1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.580002 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2551/5117] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.582564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-16f82b2d-02dc-41fb-84a8-196cdf2d5e23 None None] MFA Rules not processed for user `2bf6957fdc2e43588a95d1d6a2a11680`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:55.584721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-16f82b2d-02dc-41fb-84a8-196cdf2d5e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:55.586604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bffff-0703-4f72-8029-e0fa3fe324a1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.589807 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2567/5118] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:55 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:47:55.595081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f82b2d-02dc-41fb-84a8-196cdf2d5e23 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.607447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bffff-0703-4f72-8029-e0fa3fe324a1 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.619184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f82b2d-02dc-41fb-84a8-196cdf2d5e23 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.626510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861816a7-db1e-4c67-95a0-6a089bcf4296 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.627241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861816a7-db1e-4c67-95a0-6a089bcf4296 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.627582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861816a7-db1e-4c67-95a0-6a089bcf4296 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.627865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861816a7-db1e-4c67-95a0-6a089bcf4296 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.628512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861816a7-db1e-4c67-95a0-6a089bcf4296 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.629970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53864ccb-329a-41a6-983f-ceaf9502d34c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.630420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861816a7-db1e-4c67-95a0-6a089bcf4296 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.630651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53864ccb-329a-41a6-983f-ceaf9502d34c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.630904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53864ccb-329a-41a6-983f-ceaf9502d34c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.631177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53864ccb-329a-41a6-983f-ceaf9502d34c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.632734 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2552/5119] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.637178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861816a7-db1e-4c67-95a0-6a089bcf4296 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.648500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53864ccb-329a-41a6-983f-ceaf9502d34c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.654483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861816a7-db1e-4c67-95a0-6a089bcf4296 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.655231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53864ccb-329a-41a6-983f-ceaf9502d34c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.662581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cead1-ab84-4f1c-a3ea-53cdcba054f9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.664450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cead1-ab84-4f1c-a3ea-53cdcba054f9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.664733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cead1-ab84-4f1c-a3ea-53cdcba054f9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.665016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cead1-ab84-4f1c-a3ea-53cdcba054f9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.666104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cead1-ab84-4f1c-a3ea-53cdcba054f9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.668201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cead1-ab84-4f1c-a3ea-53cdcba054f9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.672839 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2568/5120] 10.222.0.16 () {56 vars in 1263 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:55.676901 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2553/5121] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.680472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cead1-ab84-4f1c-a3ea-53cdcba054f9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.680720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53864ccb-329a-41a6-983f-ceaf9502d34c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.694202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cead1-ab84-4f1c-a3ea-53cdcba054f9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.700406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53864ccb-329a-41a6-983f-ceaf9502d34c tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.717828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbf533-0c3b-40a0-b174-4d4f6a110454 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.718519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbf533-0c3b-40a0-b174-4d4f6a110454 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.718921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbf533-0c3b-40a0-b174-4d4f6a110454 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.719173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbf533-0c3b-40a0-b174-4d4f6a110454 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.719768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbf533-0c3b-40a0-b174-4d4f6a110454 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.722096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbf533-0c3b-40a0-b174-4d4f6a110454 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.723594 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2554/5122] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.728399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbf533-0c3b-40a0-b174-4d4f6a110454 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.739634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.740297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.740579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.740853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/2bf6957fdc2e43588a95d1d6a2a11680` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.742109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2bf6957fdc2e43588a95d1d6a2a11680)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.744045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.767604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbf533-0c3b-40a0-b174-4d4f6a110454 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.780454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53386972-7914-444b-8a3a-2da2651c6b63 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.781336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386972-7914-444b-8a3a-2da2651c6b63 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.781871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386972-7914-444b-8a3a-2da2651c6b63 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.782315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386972-7914-444b-8a3a-2da2651c6b63 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.783233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53386972-7914-444b-8a3a-2da2651c6b63 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.785315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53386972-7914-444b-8a3a-2da2651c6b63 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.787249 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2555/5123] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.792500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53386972-7914-444b-8a3a-2da2651c6b63 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.807128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53386972-7914-444b-8a3a-2da2651c6b63 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.814593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323f935-20ba-434e-93b9-b9e676c2d1ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.815508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323f935-20ba-434e-93b9-b9e676c2d1ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.816094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323f935-20ba-434e-93b9-b9e676c2d1ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.816554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323f935-20ba-434e-93b9-b9e676c2d1ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.817302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323f935-20ba-434e-93b9-b9e676c2d1ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.820729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323f935-20ba-434e-93b9-b9e676c2d1ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.822550 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2556/5124] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.832181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323f935-20ba-434e-93b9-b9e676c2d1ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.861022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323f935-20ba-434e-93b9-b9e676c2d1ad tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.866931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5609a-46e5-421c-b348-d7fbc38618c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.867911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5609a-46e5-421c-b348-d7fbc38618c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.868432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5609a-46e5-421c-b348-d7fbc38618c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.869034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5609a-46e5-421c-b348-d7fbc38618c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.871045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5609a-46e5-421c-b348-d7fbc38618c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.879276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5609a-46e5-421c-b348-d7fbc38618c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.882927 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2557/5125] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.893300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5609a-46e5-421c-b348-d7fbc38618c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.910719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf6957fdc2e43588a95d1d6a2a11680'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:55.913034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf6957fdc2e43588a95d1d6a2a11680'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:55.926674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5609a-46e5-421c-b348-d7fbc38618c0 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:55.946967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce777a-cb5a-4792-9f35-91f1642ec85b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:55.949560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce777a-cb5a-4792-9f35-91f1642ec85b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:55.949778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce777a-cb5a-4792-9f35-91f1642ec85b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:55.951141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce777a-cb5a-4792-9f35-91f1642ec85b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:55.951879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce777a-cb5a-4792-9f35-91f1642ec85b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:55.955370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce777a-cb5a-4792-9f35-91f1642ec85b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:55.956073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf6957fdc2e43588a95d1d6a2a11680'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:55.956999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf6957fdc2e43588a95d1d6a2a11680'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:55.964024 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2558/5126] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:55.971021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce777a-cb5a-4792-9f35-91f1642ec85b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:55.976370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e1ce777a-cb5a-4792-9f35-91f1642ec85b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:55.983725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf6957fdc2e43588a95d1d6a2a11680'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:56.014356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce777a-cb5a-4792-9f35-91f1642ec85b tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.015400 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2569/5127] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:55 2022] DELETE /identity/v3/users/2bf6957fdc2e43588a95d1d6a2a11680 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:56.023894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.025923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:56.128723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=11 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:56.215020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768ba08-f343-4f3d-8a8b-f65d11eecdff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.218038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ba08-f343-4f3d-8a8b-f65d11eecdff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.218341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ba08-f343-4f3d-8a8b-f65d11eecdff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.219267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ba08-f343-4f3d-8a8b-f65d11eecdff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.219900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768ba08-f343-4f3d-8a8b-f65d11eecdff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.227879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768ba08-f343-4f3d-8a8b-f65d11eecdff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.234429 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2559/5128] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:47:55 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:56.235563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768ba08-f343-4f3d-8a8b-f65d11eecdff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.248458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41f9ad-3485-4bfb-8732-52eaa6268b8d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.257732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768ba08-f343-4f3d-8a8b-f65d11eecdff tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.261630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e44f63-6ded-4898-901b-f07918648a17 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.262797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e44f63-6ded-4898-901b-f07918648a17 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.263418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e44f63-6ded-4898-901b-f07918648a17 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.263418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e44f63-6ded-4898-901b-f07918648a17 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.264180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e44f63-6ded-4898-901b-f07918648a17 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.269545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e44f63-6ded-4898-901b-f07918648a17 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.273167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6178c5-d053-4250-8d05-8bdfd2c9dee9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.273872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6178c5-d053-4250-8d05-8bdfd2c9dee9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.274159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6178c5-d053-4250-8d05-8bdfd2c9dee9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.274447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6178c5-d053-4250-8d05-8bdfd2c9dee9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.278013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6178c5-d053-4250-8d05-8bdfd2c9dee9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.282055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6178c5-d053-4250-8d05-8bdfd2c9dee9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.288305 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2560/5129] 10.222.0.16 () {58 vars in 1212 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:56.289689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6178c5-d053-4250-8d05-8bdfd2c9dee9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.319317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6178c5-d053-4250-8d05-8bdfd2c9dee9 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.332966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a7d26-6268-42a4-8e7b-1a7507c990ef tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.335005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a7d26-6268-42a4-8e7b-1a7507c990ef tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.336615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a7d26-6268-42a4-8e7b-1a7507c990ef tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.336942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a7d26-6268-42a4-8e7b-1a7507c990ef tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.337679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a7d26-6268-42a4-8e7b-1a7507c990ef tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.339775 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2570/5130] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:47:56 2022] POST /identity/v3/users => generated 367 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:56.342556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a7d26-6268-42a4-8e7b-1a7507c990ef tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.344999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e44f63-6ded-4898-901b-f07918648a17 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.361413 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2561/5131] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:56.363093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a7d26-6268-42a4-8e7b-1a7507c990ef tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.387064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e44f63-6ded-4898-901b-f07918648a17 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.391464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a7d26-6268-42a4-8e7b-1a7507c990ef tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.398579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af605e5-4831-41e0-84ea-9930463923ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.399359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af605e5-4831-41e0-84ea-9930463923ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.399758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af605e5-4831-41e0-84ea-9930463923ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.400143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af605e5-4831-41e0-84ea-9930463923ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.400948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af605e5-4831-41e0-84ea-9930463923ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.401904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23817d6-27aa-441c-8809-b7109e464655 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.402843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af605e5-4831-41e0-84ea-9930463923ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.403071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23817d6-27aa-441c-8809-b7109e464655 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.403479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23817d6-27aa-441c-8809-b7109e464655 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.403640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23817d6-27aa-441c-8809-b7109e464655 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.404885 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2562/5132] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:56.405760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23817d6-27aa-441c-8809-b7109e464655 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.408279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23817d6-27aa-441c-8809-b7109e464655 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.409319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af605e5-4831-41e0-84ea-9930463923ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.425952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af605e5-4831-41e0-84ea-9930463923ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.440715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d34933-62d6-46cc-82f6-913128d947aa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.441570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d34933-62d6-46cc-82f6-913128d947aa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.441964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d34933-62d6-46cc-82f6-913128d947aa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.442355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d34933-62d6-46cc-82f6-913128d947aa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.443617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d34933-62d6-46cc-82f6-913128d947aa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.446386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d34933-62d6-46cc-82f6-913128d947aa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.448477 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2563/5133] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:56.454536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d34933-62d6-46cc-82f6-913128d947aa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.472207 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2571/5134] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:47:56 2022] POST /identity/v3/projects => generated 358 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:47:56.473366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23817d6-27aa-441c-8809-b7109e464655 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.475851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d34933-62d6-46cc-82f6-913128d947aa tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.538599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:56.638945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18994811-e3db-49ce-a5cb-29f79a8dc24e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.639555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18994811-e3db-49ce-a5cb-29f79a8dc24e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.639844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18994811-e3db-49ce-a5cb-29f79a8dc24e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.640143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18994811-e3db-49ce-a5cb-29f79a8dc24e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.640944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18994811-e3db-49ce-a5cb-29f79a8dc24e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.643887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18994811-e3db-49ce-a5cb-29f79a8dc24e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.645106 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2564/5135] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:56.652647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18994811-e3db-49ce-a5cb-29f79a8dc24e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.673515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23817d6-27aa-441c-8809-b7109e464655 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.675138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18994811-e3db-49ce-a5cb-29f79a8dc24e tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.690020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c40bab-9c9c-411b-9b3c-8e9888ae25c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.690564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab26df-f507-48d0-bda3-afb6f06cc247 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.690852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40bab-9c9c-411b-9b3c-8e9888ae25c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.691204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40bab-9c9c-411b-9b3c-8e9888ae25c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.691494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40bab-9c9c-411b-9b3c-8e9888ae25c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.692102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c40bab-9c9c-411b-9b3c-8e9888ae25c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.692672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab26df-f507-48d0-bda3-afb6f06cc247 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.693150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab26df-f507-48d0-bda3-afb6f06cc247 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.693655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab26df-f507-48d0-bda3-afb6f06cc247 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/1c3aacd890344e2a951509db5c9d84b3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.696382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c40bab-9c9c-411b-9b3c-8e9888ae25c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.705380 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2565/5136] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:56.706346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c40bab-9c9c-411b-9b3c-8e9888ae25c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.731080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab26df-f507-48d0-bda3-afb6f06cc247 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:update_user(user_id=1c3aacd890344e2a951509db5c9d84b3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.733044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c40bab-9c9c-411b-9b3c-8e9888ae25c6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.738395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab26df-f507-48d0-bda3-afb6f06cc247 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.747074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8653b-cb2e-4139-94a8-27026398a665 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.747817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8653b-cb2e-4139-94a8-27026398a665 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.748103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8653b-cb2e-4139-94a8-27026398a665 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.748388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8653b-cb2e-4139-94a8-27026398a665 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.749756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8653b-cb2e-4139-94a8-27026398a665 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.754237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8653b-cb2e-4139-94a8-27026398a665 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.763721 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2566/5137] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:56.765997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8653b-cb2e-4139-94a8-27026398a665 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.790605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8653b-cb2e-4139-94a8-27026398a665 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.803894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e64886-d8aa-4668-9d1a-33896e7579ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.807930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64886-d8aa-4668-9d1a-33896e7579ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.808221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64886-d8aa-4668-9d1a-33896e7579ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.808616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64886-d8aa-4668-9d1a-33896e7579ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.809416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e64886-d8aa-4668-9d1a-33896e7579ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.811040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e64886-d8aa-4668-9d1a-33896e7579ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.819288 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2567/5138] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:56.819829 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2572/5139] 10.222.0.16 () {60 vars in 1244 bytes} [Mon Aug 29 15:47:56 2022] PATCH /identity/v3/users/1c3aacd890344e2a951509db5c9d84b3 => generated 523 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:47:56.821155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab26df-f507-48d0-bda3-afb6f06cc247 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.824198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e64886-d8aa-4668-9d1a-33896e7579ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.836619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab26df-f507-48d0-bda3-afb6f06cc247 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.850342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebda13-579c-48ed-a6f8-216855ef4d64 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.851863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e64886-d8aa-4668-9d1a-33896e7579ca tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.852528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda13-579c-48ed-a6f8-216855ef4d64 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.852869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda13-579c-48ed-a6f8-216855ef4d64 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.854289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda13-579c-48ed-a6f8-216855ef4d64 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/1c3aacd890344e2a951509db5c9d84b3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.865174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802dc61-dd86-49c1-9514-4032178994b6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.870706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802dc61-dd86-49c1-9514-4032178994b6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.871101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802dc61-dd86-49c1-9514-4032178994b6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.871434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802dc61-dd86-49c1-9514-4032178994b6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.872128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802dc61-dd86-49c1-9514-4032178994b6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.875356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802dc61-dd86-49c1-9514-4032178994b6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.876785 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2568/5140] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:56.883078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802dc61-dd86-49c1-9514-4032178994b6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.896896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebda13-579c-48ed-a6f8-216855ef4d64 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:get_user(user_id=1c3aacd890344e2a951509db5c9d84b3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.901223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebda13-579c-48ed-a6f8-216855ef4d64 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.903720 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2573/5141] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/users/1c3aacd890344e2a951509db5c9d84b3 => generated 389 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:47:56.909458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebda13-579c-48ed-a6f8-216855ef4d64 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.913443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802dc61-dd86-49c1-9514-4032178994b6 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.930021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8923b9-5ada-4655-a2a5-4b7fa4dd21f5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.931168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8923b9-5ada-4655-a2a5-4b7fa4dd21f5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.931485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8923b9-5ada-4655-a2a5-4b7fa4dd21f5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.931942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8923b9-5ada-4655-a2a5-4b7fa4dd21f5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.933194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8923b9-5ada-4655-a2a5-4b7fa4dd21f5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.938550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8923b9-5ada-4655-a2a5-4b7fa4dd21f5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.939656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebda13-579c-48ed-a6f8-216855ef4d64 tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.941806 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2569/5142] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 29 15:47:56.944423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8923b9-5ada-4655-a2a5-4b7fa4dd21f5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.951845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.952585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.952898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.953168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/projects/2ac9b49ab9ed4403b0abce7dc07171be` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.954490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2ac9b49ab9ed4403b0abce7dc07171be)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.956833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.959933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8923b9-5ada-4655-a2a5-4b7fa4dd21f5 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.964798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbfce6-ba79-4121-842e-b9b33a0bf5e2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.965477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbfce6-ba79-4121-842e-b9b33a0bf5e2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.965762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbfce6-ba79-4121-842e-b9b33a0bf5e2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.966039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbfce6-ba79-4121-842e-b9b33a0bf5e2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:56.966655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbfce6-ba79-4121-842e-b9b33a0bf5e2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:56.969022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbfce6-ba79-4121-842e-b9b33a0bf5e2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:56.976498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2570/5143] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Aug 29 15:47:56 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:47:56.976498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbfce6-ba79-4121-842e-b9b33a0bf5e2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:56.987870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbfce6-ba79-4121-842e-b9b33a0bf5e2 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:56.994327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cda3b2-d246-48cd-bc7b-6c09dbab4338 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:56.995080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cda3b2-d246-48cd-bc7b-6c09dbab4338 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:56.995424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cda3b2-d246-48cd-bc7b-6c09dbab4338 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:56.995789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cda3b2-d246-48cd-bc7b-6c09dbab4338 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/943ac644e9f94001ac4a04b347f68877` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:57.004892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cda3b2-d246-48cd-bc7b-6c09dbab4338 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-c3cda3b2-d246-48cd-bc7b-6c09dbab4338 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Could not find domain: 943ac644e9f94001ac4a04b347f68877.: keystone.exception.DomainNotFound: Could not find domain: 943ac644e9f94001ac4a04b347f68877. Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 943ac644e9f94001ac4a04b347f68877. Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:57.014681 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:47:57.015962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:47:57.017164 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 943ac644e9f94001ac4a04b347f68877. Aug 29 15:47:57.018483 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:57.022642 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2571/5144] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:47:56 2022] PATCH /identity/v3/domains/943ac644e9f94001ac4a04b347f68877 => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:47:57.024289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cda3b2-d246-48cd-bc7b-6c09dbab4338 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:57.050712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:UPDATE=2,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:57.054520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cda3b2-d246-48cd-bc7b-6c09dbab4338 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:57.080519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac9b49ab9ed4403b0abce7dc07171be', 'request_id': 'req-3657824a-c448-4450-99a3-7ff7c6a76d5d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.096224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac9b49ab9ed4403b0abce7dc07171be', 'request_id': 'req-3657824a-c448-4450-99a3-7ff7c6a76d5d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.122757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac9b49ab9ed4403b0abce7dc07171be', 'request_id': 'req-3657824a-c448-4450-99a3-7ff7c6a76d5d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.148561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] The token cache is being invalidate because project 2ac9b49ab9ed4403b0abce7dc07171be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:47:57.149613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.151159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.157262 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2574/5145] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:56 2022] DELETE /identity/v3/projects/2ac9b49ab9ed4403b0abce7dc07171be => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:57.160899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:57.165980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:57.196663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3427ee3-95cd-4f05-8dd0-6dcb49e1ac04 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:57.197084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427ee3-95cd-4f05-8dd0-6dcb49e1ac04 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:57.197422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427ee3-95cd-4f05-8dd0-6dcb49e1ac04 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:57.197651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427ee3-95cd-4f05-8dd0-6dcb49e1ac04 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/f7fc9ee9a4154436bb4c237488be2119` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:57.214678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3427ee3-95cd-4f05-8dd0-6dcb49e1ac04 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-f3427ee3-95cd-4f05-8dd0-6dcb49e1ac04 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Could not find domain: f7fc9ee9a4154436bb4c237488be2119.: keystone.exception.DomainNotFound: Could not find domain: f7fc9ee9a4154436bb4c237488be2119. Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f7fc9ee9a4154436bb4c237488be2119. Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:57.234671 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:47:57.235773 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:47:57.236789 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f7fc9ee9a4154436bb4c237488be2119. Aug 29 15:47:57.237843 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:57.237843 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2572/5146] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:47:57 2022] PATCH /identity/v3/domains/f7fc9ee9a4154436bb4c237488be2119 => generated 112 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:47:57.240766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3427ee3-95cd-4f05-8dd0-6dcb49e1ac04 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:57.258626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f3427ee3-95cd-4f05-8dd0-6dcb49e1ac04 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:57.288162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3427ee3-95cd-4f05-8dd0-6dcb49e1ac04 tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:57.301040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783aa08-4533-4c1e-96e7-2c294362d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa8cb35550f45279e3f3186a7fcd27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b493260992f4d3891e30fb396e39fbf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:57.301726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783aa08-4533-4c1e-96e7-2c294362d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:57.302061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783aa08-4533-4c1e-96e7-2c294362d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:57.303781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783aa08-4533-4c1e-96e7-2c294362d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] PATH_INFO: `/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:57.320943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783aa08-4533-4c1e-96e7-2c294362d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:47:57.339986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657824a-c448-4450-99a3-7ff7c6a76d5d tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-6783aa08-4533-4c1e-96e7-2c294362d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Could not find domain: 8c4ca67105964dd7aaae94ff39c3ade2.: keystone.exception.DomainNotFound: Could not find domain: 8c4ca67105964dd7aaae94ff39c3ade2. Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8c4ca67105964dd7aaae94ff39c3ade2. Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:47:57.341344 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:47:57.342410 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:47:57.343403 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8c4ca67105964dd7aaae94ff39c3ade2. Aug 29 15:47:57.344491 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:47:57.344491 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2573/5147] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:47:57 2022] PATCH /identity/v3/domains/8c4ca67105964dd7aaae94ff39c3ade2 => generated 112 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 15:47:57.354618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783aa08-4533-4c1e-96e7-2c294362d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:57.358952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6783aa08-4533-4c1e-96e7-2c294362d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:57.369458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db9d0a82b66468cafd788d275abe138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:57.370661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:57.371904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:57.372830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] PATH_INFO: `/v3/users/1c3aacd890344e2a951509db5c9d84b3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:57.391864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1c3aacd890344e2a951509db5c9d84b3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:57.398078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:57.556102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3aacd890344e2a951509db5c9d84b3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.557546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3aacd890344e2a951509db5c9d84b3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.566411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783aa08-4533-4c1e-96e7-2c294362d82f tempest-DomainConfigurationTestJSON-544821689 tempest-DomainConfigurationTestJSON-544821689-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:57.585028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7201e-0bbd-4f17-bfbc-f4c9db1f4464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:57.587087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7201e-0bbd-4f17-bfbc-f4c9db1f4464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:57.589019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7201e-0bbd-4f17-bfbc-f4c9db1f4464 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:57.589506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7201e-0bbd-4f17-bfbc-f4c9db1f4464 admin admin] PATH_INFO: `/v3/users/6227f00a5b5244128f2abf50ab143da3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:57.595849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7201e-0bbd-4f17-bfbc-f4c9db1f4464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6227f00a5b5244128f2abf50ab143da3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:57.599855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7201e-0bbd-4f17-bfbc-f4c9db1f4464 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:57.606613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3aacd890344e2a951509db5c9d84b3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.608374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3aacd890344e2a951509db5c9d84b3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.635009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3aacd890344e2a951509db5c9d84b3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.688060 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2575/5148] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:57 2022] DELETE /identity/v3/users/1c3aacd890344e2a951509db5c9d84b3 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:57.689251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:57.691572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:57.701480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:57.768388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0bf7201e-0bbd-4f17-bfbc-f4c9db1f4464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6227f00a5b5244128f2abf50ab143da3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.769341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0bf7201e-0bbd-4f17-bfbc-f4c9db1f4464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6227f00a5b5244128f2abf50ab143da3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.799463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0bf7201e-0bbd-4f17-bfbc-f4c9db1f4464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6227f00a5b5244128f2abf50ab143da3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.815803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0bf7201e-0bbd-4f17-bfbc-f4c9db1f4464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6227f00a5b5244128f2abf50ab143da3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.826079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0bf7201e-0bbd-4f17-bfbc-f4c9db1f4464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6227f00a5b5244128f2abf50ab143da3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:57.841352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:57.841903 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2574/5149] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:57 2022] DELETE /identity/v3/users/6227f00a5b5244128f2abf50ab143da3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:47:57.848877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363b563-78df-4320-9419-3eaac29b8fe0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:57.851277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363b563-78df-4320-9419-3eaac29b8fe0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:57.853483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363b563-78df-4320-9419-3eaac29b8fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:57.883956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e4ab8-ba1b-4f54-8b51-48df1891a6fa tempest-UsersV3TestJSON-1738884938 tempest-UsersV3TestJSON-1738884938-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:57.928286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a363b563-78df-4320-9419-3eaac29b8fe0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:57.931229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a363b563-78df-4320-9419-3eaac29b8fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:57.995627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eaca3-c81d-4f1c-9a46-5bc87b347441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:57.996615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eaca3-c81d-4f1c-9a46-5bc87b347441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:57.997003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eaca3-c81d-4f1c-9a46-5bc87b347441 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:57.999981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eaca3-c81d-4f1c-9a46-5bc87b347441 admin admin] PATH_INFO: `/v3/users/98b8736d32c540168ce804b4e4a551f7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:58.047191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eaca3-c81d-4f1c-9a46-5bc87b347441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b8736d32c540168ce804b4e4a551f7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:58.049604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eaca3-c81d-4f1c-9a46-5bc87b347441 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:58.126546 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2575/5150] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:47:58.149113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363b563-78df-4320-9419-3eaac29b8fe0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:58.151933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a363b563-78df-4320-9419-3eaac29b8fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:58.163161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f33eaca3-c81d-4f1c-9a46-5bc87b347441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b8736d32c540168ce804b4e4a551f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:58.164067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f33eaca3-c81d-4f1c-9a46-5bc87b347441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b8736d32c540168ce804b4e4a551f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:58.217334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f33eaca3-c81d-4f1c-9a46-5bc87b347441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b8736d32c540168ce804b4e4a551f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:58.221722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f33eaca3-c81d-4f1c-9a46-5bc87b347441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b8736d32c540168ce804b4e4a551f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:58.251364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f33eaca3-c81d-4f1c-9a46-5bc87b347441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b8736d32c540168ce804b4e4a551f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:47:58.289517 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2576/5151] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:47:57 2022] DELETE /identity/v3/users/98b8736d32c540168ce804b4e4a551f7 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:47:58.294352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b9e4-9348-433f-8b71-f25259250202 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:58.295150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b9e4-9348-433f-8b71-f25259250202 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:58.296066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b9e4-9348-433f-8b71-f25259250202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:58.325015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363b563-78df-4320-9419-3eaac29b8fe0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:58.345172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b307b9e4-9348-433f-8b71-f25259250202 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:47:58.348666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b307b9e4-9348-433f-8b71-f25259250202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:58.452606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420eafb-3eaf-42f5-a632-4a163413f291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:58.455756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420eafb-3eaf-42f5-a632-4a163413f291 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:58.456184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420eafb-3eaf-42f5-a632-4a163413f291 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:58.456479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420eafb-3eaf-42f5-a632-4a163413f291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:58.465272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9420eafb-3eaf-42f5-a632-4a163413f291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:58.486944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:58.510499 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2577/5152] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:47:58.628891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307b9e4-9348-433f-8b71-f25259250202 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:47:58.631492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b307b9e4-9348-433f-8b71-f25259250202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:47:58.642771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420eafb-3eaf-42f5-a632-4a163413f291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:58.644302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420eafb-3eaf-42f5-a632-4a163413f291 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:58.652076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:58.659342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307b9e4-9348-433f-8b71-f25259250202 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:47:58.667178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e6b80-2214-4ca0-b6d3-42e132e28ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:47:58.668446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e6b80-2214-4ca0-b6d3-42e132e28ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:47:58.668889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e6b80-2214-4ca0-b6d3-42e132e28ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:47:58.670707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e6b80-2214-4ca0-b6d3-42e132e28ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:47:58.684786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e6b80-2214-4ca0-b6d3-42e132e28ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:47:58.687789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e6b80-2214-4ca0-b6d3-42e132e28ba2 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:47:58.693597 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2576/5153] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:58.740908 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2578/5154] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:00.610219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420eafb-3eaf-42f5-a632-4a163413f291 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:00.612000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9420eafb-3eaf-42f5-a632-4a163413f291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:00.646369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420eafb-3eaf-42f5-a632-4a163413f291 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:00.668902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:00.669802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:00.670094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:00.670536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] PATH_INFO: `/v3/projects/843eed73f05b40b08776fa0bbdea4c97` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:00.673166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843eed73f05b40b08776fa0bbdea4c97)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:00.675255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:00.815558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843eed73f05b40b08776fa0bbdea4c97', 'request_id': 'req-39a57402-b008-4dba-932f-b1a50130adc2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:00.825154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843eed73f05b40b08776fa0bbdea4c97', 'request_id': 'req-39a57402-b008-4dba-932f-b1a50130adc2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:00.827782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e6b80-2214-4ca0-b6d3-42e132e28ba2 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:00.829997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-114e6b80-2214-4ca0-b6d3-42e132e28ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:00.838048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843eed73f05b40b08776fa0bbdea4c97', 'request_id': 'req-39a57402-b008-4dba-932f-b1a50130adc2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:00.854633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e6b80-2214-4ca0-b6d3-42e132e28ba2 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:00.858793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] The token cache is being invalidate because project 843eed73f05b40b08776fa0bbdea4c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:00.859099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:00.861898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:00.865558 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2577/5155] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:00 2022] DELETE /identity/v3/projects/843eed73f05b40b08776fa0bbdea4c97 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:00.869466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:00.872792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:01.080564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:01.081297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:01.081673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:01.081961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] PATH_INFO: `/v3/projects/49a8c4e37a954cee9abfce818c914fc9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:01.083452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a8c4e37a954cee9abfce818c914fc9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:01.085497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:01.137491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a57402-b008-4dba-932f-b1a50130adc2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:01.159102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:01.163019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:01.163509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:01.165114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] PATH_INFO: `/v3/users/9db9d0a82b66468cafd788d275abe138` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:01.170423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db9d0a82b66468cafd788d275abe138)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:01.178929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:01.216599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a8c4e37a954cee9abfce818c914fc9', 'request_id': 'req-29d7ef43-b764-43a1-8afb-733a64de2aac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:01.236274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a8c4e37a954cee9abfce818c914fc9', 'request_id': 'req-29d7ef43-b764-43a1-8afb-733a64de2aac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:01.259741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a8c4e37a954cee9abfce818c914fc9', 'request_id': 'req-29d7ef43-b764-43a1-8afb-733a64de2aac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:01.272036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:01.296904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] The token cache is being invalidate because project 49a8c4e37a954cee9abfce818c914fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:01.297266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:01.300490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:01.302925 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2579/5156] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:00 2022] DELETE /identity/v3/projects/49a8c4e37a954cee9abfce818c914fc9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:01.315026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:01.319254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db9d0a82b66468cafd788d275abe138'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:01.320196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:01.320455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db9d0a82b66468cafd788d275abe138'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:01.362367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db9d0a82b66468cafd788d275abe138'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:01.388765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db9d0a82b66468cafd788d275abe138'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:01.405177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db9d0a82b66468cafd788d275abe138'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:01.420713 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2578/5157] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:00 2022] DELETE /identity/v3/users/9db9d0a82b66468cafd788d275abe138 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:01.550918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7ef43-b764-43a1-8afb-733a64de2aac admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:01.620709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:01.709108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d6b2d-7ef4-4841-ac6b-bd9affa294b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:01.710963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6b2d-7ef4-4841-ac6b-bd9affa294b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:01.711494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6b2d-7ef4-4841-ac6b-bd9affa294b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:01.712472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6b2d-7ef4-4841-ac6b-bd9affa294b1 admin admin] PATH_INFO: `/v3/users/8aa8cb35550f45279e3f3186a7fcd27d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:01.745920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d6b2d-7ef4-4841-ac6b-bd9affa294b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aa8cb35550f45279e3f3186a7fcd27d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:01.765374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d6b2d-7ef4-4841-ac6b-bd9affa294b1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:01.978208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee5d6b2d-7ef4-4841-ac6b-bd9affa294b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aa8cb35550f45279e3f3186a7fcd27d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:01.979326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee5d6b2d-7ef4-4841-ac6b-bd9affa294b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aa8cb35550f45279e3f3186a7fcd27d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:02.009624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee5d6b2d-7ef4-4841-ac6b-bd9affa294b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aa8cb35550f45279e3f3186a7fcd27d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:02.011051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee5d6b2d-7ef4-4841-ac6b-bd9affa294b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aa8cb35550f45279e3f3186a7fcd27d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:02.027221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ee5d6b2d-7ef4-4841-ac6b-bd9affa294b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aa8cb35550f45279e3f3186a7fcd27d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:02.058393 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2580/5158] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:01 2022] DELETE /identity/v3/users/8aa8cb35550f45279e3f3186a7fcd27d => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:02.342537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:02.345479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:02.392584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6474c-3a0f-4aa4-9a1f-6f42ec878624 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:02.538449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:02.540325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:02.540783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:02.541342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] PATH_INFO: `/v3/projects/73be3d75dc6c442c9be4ed7e3b9d4d05` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:02.546267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73be3d75dc6c442c9be4ed7e3b9d4d05)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:02.549520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:02.631466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'request_id': 'req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:02.644899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'request_id': 'req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:02.658590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73be3d75dc6c442c9be4ed7e3b9d4d05', 'request_id': 'req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:02.691504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] The token cache is being invalidate because project 73be3d75dc6c442c9be4ed7e3b9d4d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:02.692237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:02.707285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eea1618c-7fcc-4a83-a6c6-28cad840d8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:02.713778 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2579/5159] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:02 2022] DELETE /identity/v3/projects/73be3d75dc6c442c9be4ed7e3b9d4d05 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:02.714746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35d314-d64c-4f3f-8b38-a9fb018ac607 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:02.715042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35d314-d64c-4f3f-8b38-a9fb018ac607 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:02.715357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35d314-d64c-4f3f-8b38-a9fb018ac607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:02.758653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6c35d314-d64c-4f3f-8b38-a9fb018ac607 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:02.759900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6c35d314-d64c-4f3f-8b38-a9fb018ac607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:02.899949 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2581/5160] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:02.906497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef06549-510e-4f32-9320-ae3c341882f5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:02.907167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef06549-510e-4f32-9320-ae3c341882f5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:02.908393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef06549-510e-4f32-9320-ae3c341882f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:02.994716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cef06549-510e-4f32-9320-ae3c341882f5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:02.998011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cef06549-510e-4f32-9320-ae3c341882f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:03.023450 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2580/5161] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:03.028286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35d314-d64c-4f3f-8b38-a9fb018ac607 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:03.041855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35d314-d64c-4f3f-8b38-a9fb018ac607 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:03.061152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f85cf-fb2c-4a4a-a9f4-ba30e83cbdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:03.061832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f85cf-fb2c-4a4a-a9f4-ba30e83cbdac admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:03.062151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f85cf-fb2c-4a4a-a9f4-ba30e83cbdac admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:03.062424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f85cf-fb2c-4a4a-a9f4-ba30e83cbdac admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:03.063101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f85cf-fb2c-4a4a-a9f4-ba30e83cbdac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:03.063984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f85cf-fb2c-4a4a-a9f4-ba30e83cbdac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:03.065097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f85cf-fb2c-4a4a-a9f4-ba30e83cbdac admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:03.094149 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2582/5162] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:03.094726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef06549-510e-4f32-9320-ae3c341882f5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:03.109483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef06549-510e-4f32-9320-ae3c341882f5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:03.122074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efdac8-3620-43ef-a25e-5110b64c7afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:03.122705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efdac8-3620-43ef-a25e-5110b64c7afa admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:03.122981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efdac8-3620-43ef-a25e-5110b64c7afa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:03.123263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efdac8-3620-43ef-a25e-5110b64c7afa admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:03.123896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efdac8-3620-43ef-a25e-5110b64c7afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:03.125877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efdac8-3620-43ef-a25e-5110b64c7afa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:03.193613 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2581/5163] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:03 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:03.194918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f85cf-fb2c-4a4a-a9f4-ba30e83cbdac admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:03.206642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f85cf-fb2c-4a4a-a9f4-ba30e83cbdac admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:03.286064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efdac8-3620-43ef-a25e-5110b64c7afa admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:03.293083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-03efdac8-3620-43ef-a25e-5110b64c7afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:03.314620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:03.318255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:03.374784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa476-07d8-4209-87d9-270b191ad62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:03.375464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa476-07d8-4209-87d9-270b191ad62e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:03.375990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa476-07d8-4209-87d9-270b191ad62e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:03.376312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa476-07d8-4209-87d9-270b191ad62e admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:03.377027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaa476-07d8-4209-87d9-270b191ad62e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:03.384004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaa476-07d8-4209-87d9-270b191ad62e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:03.451100 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2583/5164] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:03 2022] POST /identity/v3/users => generated 303 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:03.455423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa476-07d8-4209-87d9-270b191ad62e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:03.534550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa476-07d8-4209-87d9-270b191ad62e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:03.547172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067592d-f012-404e-859b-f11ca116f775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:03.547800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067592d-f012-404e-859b-f11ca116f775 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:03.548090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067592d-f012-404e-859b-f11ca116f775 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:03.548379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067592d-f012-404e-859b-f11ca116f775 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:03.549065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067592d-f012-404e-859b-f11ca116f775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:03.553122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067592d-f012-404e-859b-f11ca116f775 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:03.563356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efdac8-3620-43ef-a25e-5110b64c7afa admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:03.570808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:03.576068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:03.576342 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2584/5165] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:03.576502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:03.576502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] PATH_INFO: `/v3/projects/7b493260992f4d3891e30fb396e39fbf` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:03.577703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067592d-f012-404e-859b-f11ca116f775 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:03.578633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b493260992f4d3891e30fb396e39fbf)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:03.582378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:03.602352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067592d-f012-404e-859b-f11ca116f775 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:03.627142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66937145-ee63-47eb-acd7-6bdcdf684a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:03.627982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66937145-ee63-47eb-acd7-6bdcdf684a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:03.628407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66937145-ee63-47eb-acd7-6bdcdf684a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:03.628523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66937145-ee63-47eb-acd7-6bdcdf684a4a admin admin] PATH_INFO: `/v3/projects/ccf25f1442f44688a2d1208ff857410e/users/f8a94ad124d04f0082acddb25858961e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:03.686150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66937145-ee63-47eb-acd7-6bdcdf684a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf25f1442f44688a2d1208ff857410e, user_id=f8a94ad124d04f0082acddb25858961e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:03.698649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66937145-ee63-47eb-acd7-6bdcdf684a4a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:03.721579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b493260992f4d3891e30fb396e39fbf', 'request_id': 'req-de500d1f-d156-4e4d-8e57-768fc13e1b1e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:03.735161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b493260992f4d3891e30fb396e39fbf', 'request_id': 'req-de500d1f-d156-4e4d-8e57-768fc13e1b1e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:03.736740 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2585/5166] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:03 2022] PUT /identity/v3/projects/ccf25f1442f44688a2d1208ff857410e/users/f8a94ad124d04f0082acddb25858961e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:03.742591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66937145-ee63-47eb-acd7-6bdcdf684a4a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:03.752517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b493260992f4d3891e30fb396e39fbf', 'request_id': 'req-de500d1f-d156-4e4d-8e57-768fc13e1b1e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:03.771180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] The token cache is being invalidate because project 7b493260992f4d3891e30fb396e39fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:03.771813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:03.772802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de500d1f-d156-4e4d-8e57-768fc13e1b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:03.792102 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2582/5167] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:03 2022] DELETE /identity/v3/projects/7b493260992f4d3891e30fb396e39fbf => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:03.795510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86cd4-fe4a-4e22-b8f6-d599cd79f13d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:03.798478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86cd4-fe4a-4e22-b8f6-d599cd79f13d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:03.799017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86cd4-fe4a-4e22-b8f6-d599cd79f13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:03.862379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9dd86cd4-fe4a-4e22-b8f6-d599cd79f13d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:03.866797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66937145-ee63-47eb-acd7-6bdcdf684a4a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:03.872919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b25479-e7a7-4fe0-b796-c109f0d65a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:03.873746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25479-e7a7-4fe0-b796-c109f0d65a67 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:03.874091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25479-e7a7-4fe0-b796-c109f0d65a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:03.874248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9dd86cd4-fe4a-4e22-b8f6-d599cd79f13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:03.874476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25479-e7a7-4fe0-b796-c109f0d65a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:03.875220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b25479-e7a7-4fe0-b796-c109f0d65a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:03.879057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b25479-e7a7-4fe0-b796-c109f0d65a67 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:03.897213 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2586/5168] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:03.903422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b25479-e7a7-4fe0-b796-c109f0d65a67 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:03.914233 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2583/5169] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:03.914592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-90b25479-e7a7-4fe0-b796-c109f0d65a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:03.918384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43da9d-7d81-4efc-b633-29456fca0773 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:03.918904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43da9d-7d81-4efc-b633-29456fca0773 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:03.919378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43da9d-7d81-4efc-b633-29456fca0773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:03.931299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b25479-e7a7-4fe0-b796-c109f0d65a67 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:03.938755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519feee-9f4a-4680-9e1b-745f42e3bdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:03.939670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519feee-9f4a-4680-9e1b-745f42e3bdfa admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:03.940049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519feee-9f4a-4680-9e1b-745f42e3bdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:03.940586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519feee-9f4a-4680-9e1b-745f42e3bdfa admin admin] PATH_INFO: `/v3/projects/ccf25f1442f44688a2d1208ff857410e/users/f8a94ad124d04f0082acddb25858961e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:03.943195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519feee-9f4a-4680-9e1b-745f42e3bdfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf25f1442f44688a2d1208ff857410e, user_id=f8a94ad124d04f0082acddb25858961e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:03.947903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519feee-9f4a-4680-9e1b-745f42e3bdfa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:03.968539 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2587/5170] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:03 2022] PUT /identity/v3/projects/ccf25f1442f44688a2d1208ff857410e/users/f8a94ad124d04f0082acddb25858961e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:03.983622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1a43da9d-7d81-4efc-b633-29456fca0773 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:03.983925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1a43da9d-7d81-4efc-b633-29456fca0773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:03.988895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7188b5-7697-465f-a955-4a370f7f8ed9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:03.989589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7188b5-7697-465f-a955-4a370f7f8ed9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:03.990204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7188b5-7697-465f-a955-4a370f7f8ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:04.088114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6f7188b5-7697-465f-a955-4a370f7f8ed9 None None] MFA Rules not processed for user `f8a94ad124d04f0082acddb25858961e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:04.089197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6f7188b5-7697-465f-a955-4a370f7f8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:04.160981 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2584/5171] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:04.162281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43da9d-7d81-4efc-b633-29456fca0773 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:04.184538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43da9d-7d81-4efc-b633-29456fca0773 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:04.206456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb1a3a-aeee-4982-99a5-5fa804b8a84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:04.207921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb1a3a-aeee-4982-99a5-5fa804b8a84c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:04.209667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb1a3a-aeee-4982-99a5-5fa804b8a84c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:04.209965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb1a3a-aeee-4982-99a5-5fa804b8a84c admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:04.212328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb1a3a-aeee-4982-99a5-5fa804b8a84c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:04.212638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb1a3a-aeee-4982-99a5-5fa804b8a84c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:04.217941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb1a3a-aeee-4982-99a5-5fa804b8a84c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:04.252399 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2585/5172] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:04.254777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb1a3a-aeee-4982-99a5-5fa804b8a84c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:04.273174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb1a3a-aeee-4982-99a5-5fa804b8a84c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:04.292422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877457fd-a208-4181-aecc-d33dcbc5299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:04.293532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877457fd-a208-4181-aecc-d33dcbc5299e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:04.293814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877457fd-a208-4181-aecc-d33dcbc5299e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:04.294120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877457fd-a208-4181-aecc-d33dcbc5299e admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:04.294791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877457fd-a208-4181-aecc-d33dcbc5299e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:04.296969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877457fd-a208-4181-aecc-d33dcbc5299e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:04.301589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:04.314822 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2588/5173] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:04.315667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7188b5-7697-465f-a955-4a370f7f8ed9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:04.346889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7188b5-7697-465f-a955-4a370f7f8ed9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:04.352239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:04.361418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749dabb-2b2e-4aba-99ee-682a33433217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:04.362078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749dabb-2b2e-4aba-99ee-682a33433217 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:04.362362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749dabb-2b2e-4aba-99ee-682a33433217 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:04.362668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749dabb-2b2e-4aba-99ee-682a33433217 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:04.363350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749dabb-2b2e-4aba-99ee-682a33433217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:04.372306 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2586/5174] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:04 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:04.372516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749dabb-2b2e-4aba-99ee-682a33433217 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:04.381923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877457fd-a208-4181-aecc-d33dcbc5299e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:04.439418 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2589/5175] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:04 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:04.440526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749dabb-2b2e-4aba-99ee-682a33433217 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:04.608043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749dabb-2b2e-4aba-99ee-682a33433217 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:04.621630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122bcee-ee1b-4488-9a00-2c0165d31a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:04.622301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122bcee-ee1b-4488-9a00-2c0165d31a6c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:04.622643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122bcee-ee1b-4488-9a00-2c0165d31a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:04.622998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122bcee-ee1b-4488-9a00-2c0165d31a6c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:04.623844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122bcee-ee1b-4488-9a00-2c0165d31a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:04.628432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122bcee-ee1b-4488-9a00-2c0165d31a6c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:04.657106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877457fd-a208-4181-aecc-d33dcbc5299e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:04.673069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a20a1-44fd-4007-bfe5-4fce37ad00bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:04.674141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a20a1-44fd-4007-bfe5-4fce37ad00bc admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:04.674637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a20a1-44fd-4007-bfe5-4fce37ad00bc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:04.675127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a20a1-44fd-4007-bfe5-4fce37ad00bc admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:04.675989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a20a1-44fd-4007-bfe5-4fce37ad00bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:04.681860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a20a1-44fd-4007-bfe5-4fce37ad00bc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:04.706012 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2590/5176] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:04 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:04.707296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122bcee-ee1b-4488-9a00-2c0165d31a6c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:04.734289 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2587/5177] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:04 2022] POST /identity/v3/users => generated 284 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:04.735400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a20a1-44fd-4007-bfe5-4fce37ad00bc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:04.738801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122bcee-ee1b-4488-9a00-2c0165d31a6c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:04.747084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7a17b-9017-4dc9-a2f3-8bdb9e35c815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:04.748578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7a17b-9017-4dc9-a2f3-8bdb9e35c815 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:04.749175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7a17b-9017-4dc9-a2f3-8bdb9e35c815 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:04.751792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7a17b-9017-4dc9-a2f3-8bdb9e35c815 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:04.759919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a20a1-44fd-4007-bfe5-4fce37ad00bc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:04.765063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7a17b-9017-4dc9-a2f3-8bdb9e35c815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:04.768800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7a17b-9017-4dc9-a2f3-8bdb9e35c815 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:04.776708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d1fda-9b0b-49ec-9ef2-5361a97f23ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:04.777729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1fda-9b0b-49ec-9ef2-5361a97f23ef admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:04.778126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1fda-9b0b-49ec-9ef2-5361a97f23ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:04.778541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1fda-9b0b-49ec-9ef2-5361a97f23ef admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:04.779314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d1fda-9b0b-49ec-9ef2-5361a97f23ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:04.784004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d1fda-9b0b-49ec-9ef2-5361a97f23ef admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:04.809194 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2591/5178] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:04.810718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7a17b-9017-4dc9-a2f3-8bdb9e35c815 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:04.822578 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2588/5179] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:04.826446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d1fda-9b0b-49ec-9ef2-5361a97f23ef admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:04.834452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7a17b-9017-4dc9-a2f3-8bdb9e35c815 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:04.851952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b8c04-31b6-4d4e-8bd6-29590f3703c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:04.853576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b8c04-31b6-4d4e-8bd6-29590f3703c8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:04.854311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d1fda-9b0b-49ec-9ef2-5361a97f23ef admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:04.860580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b8c04-31b6-4d4e-8bd6-29590f3703c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:04.860748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9297641-ff36-424b-8bc3-8a1443a4630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:04.861459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9297641-ff36-424b-8bc3-8a1443a4630b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:04.861810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9297641-ff36-424b-8bc3-8a1443a4630b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:04.861951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b8c04-31b6-4d4e-8bd6-29590f3703c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:04.862217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9297641-ff36-424b-8bc3-8a1443a4630b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:04.862941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9297641-ff36-424b-8bc3-8a1443a4630b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:04.863554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b8c04-31b6-4d4e-8bd6-29590f3703c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:04.866368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b8c04-31b6-4d4e-8bd6-29590f3703c8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:04.867205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9297641-ff36-424b-8bc3-8a1443a4630b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:04.889854 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2592/5180] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:04.897741 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2589/5181] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:04.899520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9297641-ff36-424b-8bc3-8a1443a4630b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:04.900284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b8c04-31b6-4d4e-8bd6-29590f3703c8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:04.935198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9297641-ff36-424b-8bc3-8a1443a4630b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:04.936265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b8c04-31b6-4d4e-8bd6-29590f3703c8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:04.952695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c36a5-6406-4eef-874c-4a7ce6215b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:04.954446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c36a5-6406-4eef-874c-4a7ce6215b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:04.956640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c36a5-6406-4eef-874c-4a7ce6215b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:04.958808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c36a5-6406-4eef-874c-4a7ce6215b52 admin admin] PATH_INFO: `/v3/projects/141bd780b64a4eb888ac431f39cd5862/users/526b18c5ee1f42d5ba2a86d7193bca01/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:04.965163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8299db4-8840-4efd-bac1-d960ac890391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:04.965163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8299db4-8840-4efd-bac1-d960ac890391 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:04.965163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8299db4-8840-4efd-bac1-d960ac890391 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:04.965163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8299db4-8840-4efd-bac1-d960ac890391 admin admin] PATH_INFO: `/v3/projects/8538bdcfeb0944408c41f8a8ef262e21/users/951b888293b5438593cecec25a5aa4d4/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:05.006437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c36a5-6406-4eef-874c-4a7ce6215b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141bd780b64a4eb888ac431f39cd5862, user_id=526b18c5ee1f42d5ba2a86d7193bca01, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:05.009827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8299db4-8840-4efd-bac1-d960ac890391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8538bdcfeb0944408c41f8a8ef262e21, user_id=951b888293b5438593cecec25a5aa4d4, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:05.012549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8299db4-8840-4efd-bac1-d960ac890391 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:05.013800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c36a5-6406-4eef-874c-4a7ce6215b52 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:05.066446 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2590/5183] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:04 2022] PUT /identity/v3/projects/8538bdcfeb0944408c41f8a8ef262e21/users/951b888293b5438593cecec25a5aa4d4/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:05.071575 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2593/5183] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:04 2022] PUT /identity/v3/projects/141bd780b64a4eb888ac431f39cd5862/users/526b18c5ee1f42d5ba2a86d7193bca01/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:05.082119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0321e-c651-4adc-aaff-f436340350fb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:05.082405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0321e-c651-4adc-aaff-f436340350fb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:05.083104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaee1e-ba29-4d98-ae54-50c2a470ef7b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:05.083500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaee1e-ba29-4d98-ae54-50c2a470ef7b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:05.083895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaee1e-ba29-4d98-ae54-50c2a470ef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:05.084936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0321e-c651-4adc-aaff-f436340350fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:05.142438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4ffaee1e-ba29-4d98-ae54-50c2a470ef7b None None] MFA Rules not processed for user `951b888293b5438593cecec25a5aa4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:05.144649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4ffaee1e-ba29-4d98-ae54-50c2a470ef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:05.160672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-22b0321e-c651-4adc-aaff-f436340350fb None None] MFA Rules not processed for user `526b18c5ee1f42d5ba2a86d7193bca01`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:05.162518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-22b0321e-c651-4adc-aaff-f436340350fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:05.245362 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2594/5184] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:05.246664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaee1e-ba29-4d98-ae54-50c2a470ef7b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:05.273141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:05.313667 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2591/5185] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:05.323445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0321e-c651-4adc-aaff-f436340350fb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:05.327467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-22b0321e-c651-4adc-aaff-f436340350fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:05.447105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaee1e-ba29-4d98-ae54-50c2a470ef7b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:05.456640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c59400-7129-40d0-affc-5e8fc9f4a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:05.457829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59400-7129-40d0-affc-5e8fc9f4a429 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:05.458314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59400-7129-40d0-affc-5e8fc9f4a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:05.458752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59400-7129-40d0-affc-5e8fc9f4a429 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:05.459776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c59400-7129-40d0-affc-5e8fc9f4a429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:05.462112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c59400-7129-40d0-affc-5e8fc9f4a429 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:05.488580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:05.514973 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2595/5186] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:05 2022] POST /identity/v3/projects => generated 369 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:05.519101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c59400-7129-40d0-affc-5e8fc9f4a429 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:05.603680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0321e-c651-4adc-aaff-f436340350fb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:05.711714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c59400-7129-40d0-affc-5e8fc9f4a429 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:05.730265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b827-a22c-47be-83dd-015d6ce6a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:05.732868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b827-a22c-47be-83dd-015d6ce6a50d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:05.732868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b827-a22c-47be-83dd-015d6ce6a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:05.733114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b827-a22c-47be-83dd-015d6ce6a50d admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:05.733687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389b827-a22c-47be-83dd-015d6ce6a50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:05.745032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd03b10-f7b8-4f73-a06f-3e9f3bb9bc30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:05.746496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03b10-f7b8-4f73-a06f-3e9f3bb9bc30 service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:05.747045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03b10-f7b8-4f73-a06f-3e9f3bb9bc30 service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:05.749730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03b10-f7b8-4f73-a06f-3e9f3bb9bc30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:05.754604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389b827-a22c-47be-83dd-015d6ce6a50d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:05.807746 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2596/5187] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:05 2022] POST /identity/v3/users => generated 291 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:05.811832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b827-a22c-47be-83dd-015d6ce6a50d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:05.840730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b827-a22c-47be-83dd-015d6ce6a50d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:05.853485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c932b7c-74cd-4d55-933d-d6f031361894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:05.854615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932b7c-74cd-4d55-933d-d6f031361894 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:05.854959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932b7c-74cd-4d55-933d-d6f031361894 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:05.855691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932b7c-74cd-4d55-933d-d6f031361894 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:05.858285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c932b7c-74cd-4d55-933d-d6f031361894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:05.863714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c932b7c-74cd-4d55-933d-d6f031361894 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:05.889048 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2597/5188] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:05.893836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c932b7c-74cd-4d55-933d-d6f031361894 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:05.924294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c932b7c-74cd-4d55-933d-d6f031361894 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:05.941784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574e06d-0cf8-40c8-a79c-289414a17f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:05.942903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574e06d-0cf8-40c8-a79c-289414a17f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:05.943282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574e06d-0cf8-40c8-a79c-289414a17f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:05.943656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574e06d-0cf8-40c8-a79c-289414a17f14 admin admin] PATH_INFO: `/v3/projects/3c58a244acf240d4a9e77b3617a35c7a/users/ffee879ef7b341d3940bda388dfaac9c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:05.983898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574e06d-0cf8-40c8-a79c-289414a17f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c58a244acf240d4a9e77b3617a35c7a, user_id=ffee879ef7b341d3940bda388dfaac9c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:05.990391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574e06d-0cf8-40c8-a79c-289414a17f14 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:06.005781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd03b10-f7b8-4f73-a06f-3e9f3bb9bc30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:06.008652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd03b10-f7b8-4f73-a06f-3e9f3bb9bc30 service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:06.021413 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2598/5189] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:05 2022] PUT /identity/v3/projects/3c58a244acf240d4a9e77b3617a35c7a/users/ffee879ef7b341d3940bda388dfaac9c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:06.027507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574e06d-0cf8-40c8-a79c-289414a17f14 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:06.073929 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2592/5190] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:48:06.208693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:06.241992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574e06d-0cf8-40c8-a79c-289414a17f14 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:06.248409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dbdd1-39ed-4a17-a0ea-0117e15c277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:06.249228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dbdd1-39ed-4a17-a0ea-0117e15c277f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.249671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dbdd1-39ed-4a17-a0ea-0117e15c277f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.250730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dbdd1-39ed-4a17-a0ea-0117e15c277f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.251964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dbdd1-39ed-4a17-a0ea-0117e15c277f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:06.256119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dbdd1-39ed-4a17-a0ea-0117e15c277f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:06.271566 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2599/5191] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:06.277699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd03b10-f7b8-4f73-a06f-3e9f3bb9bc30 service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:06.330441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd03b10-f7b8-4f73-a06f-3e9f3bb9bc30 service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:06.362565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15916ed2-2659-4c0b-a7c2-e7edc729b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:06.363676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15916ed2-2659-4c0b-a7c2-e7edc729b03f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.364143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15916ed2-2659-4c0b-a7c2-e7edc729b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.364642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15916ed2-2659-4c0b-a7c2-e7edc729b03f admin admin] PATH_INFO: `/v3/projects/3c58a244acf240d4a9e77b3617a35c7a/users/ffee879ef7b341d3940bda388dfaac9c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.375615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15916ed2-2659-4c0b-a7c2-e7edc729b03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c58a244acf240d4a9e77b3617a35c7a, user_id=ffee879ef7b341d3940bda388dfaac9c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:06.381256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15916ed2-2659-4c0b-a7c2-e7edc729b03f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:06.435464 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2593/5192] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:06 2022] PUT /identity/v3/projects/3c58a244acf240d4a9e77b3617a35c7a/users/ffee879ef7b341d3940bda388dfaac9c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:06.455059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a21fa-7dcd-4ecc-b8cb-50a4a1dd3244 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.455528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a21fa-7dcd-4ecc-b8cb-50a4a1dd3244 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.455937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a21fa-7dcd-4ecc-b8cb-50a4a1dd3244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.529179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-777a21fa-7dcd-4ecc-b8cb-50a4a1dd3244 None None] MFA Rules not processed for user `ffee879ef7b341d3940bda388dfaac9c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:06.532686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-777a21fa-7dcd-4ecc-b8cb-50a4a1dd3244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:06.728650 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2600/5193] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:06.733227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15916ed2-2659-4c0b-a7c2-e7edc729b03f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:06.750321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15916ed2-2659-4c0b-a7c2-e7edc729b03f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:06.761461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ed1be-d8a4-4976-b41c-3011dc63e741 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:06.762258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed1be-d8a4-4976-b41c-3011dc63e741 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.762653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed1be-d8a4-4976-b41c-3011dc63e741 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.763198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed1be-d8a4-4976-b41c-3011dc63e741 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:06.764135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ed1be-d8a4-4976-b41c-3011dc63e741 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:06.766131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ed1be-d8a4-4976-b41c-3011dc63e741 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:06.846428 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2594/5194] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:48:06 2022] POST /identity/v3/domains => generated 277 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:06.850812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a21fa-7dcd-4ecc-b8cb-50a4a1dd3244 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:06.865284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a21fa-7dcd-4ecc-b8cb-50a4a1dd3244 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:06.998406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f7d60-6bd8-44db-ad69-604e633063de tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:06.999053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f7d60-6bd8-44db-ad69-604e633063de tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:06.999379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f7d60-6bd8-44db-ad69-604e633063de tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:06.999727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f7d60-6bd8-44db-ad69-604e633063de tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:07.000367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f7d60-6bd8-44db-ad69-604e633063de tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:07.002540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f7d60-6bd8-44db-ad69-604e633063de tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:07.064296 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2601/5195] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:06 2022] POST /identity/v3/groups => generated 281 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:07.068867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ed1be-d8a4-4976-b41c-3011dc63e741 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:07.086374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ed1be-d8a4-4976-b41c-3011dc63e741 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:07.106289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c2cad-87b5-4d91-95fd-807b8febefae tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:07.106956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c2cad-87b5-4d91-95fd-807b8febefae tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:07.107299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c2cad-87b5-4d91-95fd-807b8febefae tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:07.107753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c2cad-87b5-4d91-95fd-807b8febefae tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/2e3e65bece604893a95b9167609d2d34` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:07.118822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c2cad-87b5-4d91-95fd-807b8febefae tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:update_group(group_id=2e3e65bece604893a95b9167609d2d34)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:07.120004 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-723c2cad-87b5-4d91-95fd-807b8febefae tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:48:07.120004 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:48:07.120004 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:48:07.121519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c2cad-87b5-4d91-95fd-807b8febefae tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:07.156579 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2595/5196] 10.222.0.16 () {60 vars in 1247 bytes} [Mon Aug 29 15:48:07 2022] PATCH /identity/v3/groups/2e3e65bece604893a95b9167609d2d34 => generated 291 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:07.160751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f7d60-6bd8-44db-ad69-604e633063de tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:07.175098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f7d60-6bd8-44db-ad69-604e633063de tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:07.189965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c8310-2816-43df-a4e3-b67a16732262 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:07.190957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8310-2816-43df-a4e3-b67a16732262 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:07.191087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8310-2816-43df-a4e3-b67a16732262 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:07.191275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8310-2816-43df-a4e3-b67a16732262 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/2e3e65bece604893a95b9167609d2d34` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:07.202399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c8310-2816-43df-a4e3-b67a16732262 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:get_group(group_id=2e3e65bece604893a95b9167609d2d34)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:07.203465 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-232c8310-2816-43df-a4e3-b67a16732262 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:48:07.203465 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:48:07.203465 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:48:07.204693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c8310-2816-43df-a4e3-b67a16732262 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:07.211441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c2cad-87b5-4d91-95fd-807b8febefae tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:07.218451 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2602/5197] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:07 2022] GET /identity/v3/groups/2e3e65bece604893a95b9167609d2d34 => generated 291 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:07.227202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c2cad-87b5-4d91-95fd-807b8febefae tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:07.241997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7243e32-fa30-4eff-91c5-2be6ac70f54b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:07.242787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7243e32-fa30-4eff-91c5-2be6ac70f54b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:07.243079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7243e32-fa30-4eff-91c5-2be6ac70f54b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:07.243380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7243e32-fa30-4eff-91c5-2be6ac70f54b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/2e3e65bece604893a95b9167609d2d34` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:07.249115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7243e32-fa30-4eff-91c5-2be6ac70f54b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:update_group(group_id=2e3e65bece604893a95b9167609d2d34)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:07.251288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7243e32-fa30-4eff-91c5-2be6ac70f54b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:07.285759 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2596/5198] 10.222.0.16 () {60 vars in 1246 bytes} [Mon Aug 29 15:48:07 2022] PATCH /identity/v3/groups/2e3e65bece604893a95b9167609d2d34 => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:48:07.290972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c8310-2816-43df-a4e3-b67a16732262 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:07.303498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c8310-2816-43df-a4e3-b67a16732262 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:07.314304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c539b3-a287-4352-8661-a264a62f28fd tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:07.314729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c539b3-a287-4352-8661-a264a62f28fd tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:07.317034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c539b3-a287-4352-8661-a264a62f28fd tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:07.317306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c539b3-a287-4352-8661-a264a62f28fd tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/2e3e65bece604893a95b9167609d2d34` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:07.354070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c539b3-a287-4352-8661-a264a62f28fd tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2e3e65bece604893a95b9167609d2d34)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:07.354070 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-86c539b3-a287-4352-8661-a264a62f28fd tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:48:07.354070 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:48:07.354070 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:48:07.354070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c539b3-a287-4352-8661-a264a62f28fd tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:07.517328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:07.585828 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2603/5199] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:48:07 2022] DELETE /identity/v3/groups/2e3e65bece604893a95b9167609d2d34 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:07.591167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7243e32-fa30-4eff-91c5-2be6ac70f54b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:07.618781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7243e32-fa30-4eff-91c5-2be6ac70f54b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:07.663051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:UPDATE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:07.719411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83205cd-fdf3-4a20-92d4-5c6863b535ab tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:07.720632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83205cd-fdf3-4a20-92d4-5c6863b535ab tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:07.721082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83205cd-fdf3-4a20-92d4-5c6863b535ab tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:07.721606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83205cd-fdf3-4a20-92d4-5c6863b535ab tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:07.722423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83205cd-fdf3-4a20-92d4-5c6863b535ab tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:07.724753 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-e83205cd-fdf3-4a20-92d4-5c6863b535ab tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:48:07.724753 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:48:07.724753 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:48:07.726395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83205cd-fdf3-4a20-92d4-5c6863b535ab tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:07.751613 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2597/5200] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:07 2022] POST /identity/v3/groups => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:07.760943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c539b3-a287-4352-8661-a264a62f28fd tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:07.778378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c539b3-a287-4352-8661-a264a62f28fd tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:07.787321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd093c92-ca74-4628-b2bd-1911b465dec2 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:07.788882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd093c92-ca74-4628-b2bd-1911b465dec2 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:07.789379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd093c92-ca74-4628-b2bd-1911b465dec2 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:07.790970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd093c92-ca74-4628-b2bd-1911b465dec2 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:07.792771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd093c92-ca74-4628-b2bd-1911b465dec2 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:07.797773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd093c92-ca74-4628-b2bd-1911b465dec2 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:07.845243 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2604/5201] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:07 2022] POST /identity/v3/users => generated 323 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:07.851143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83205cd-fdf3-4a20-92d4-5c6863b535ab tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:07.868869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83205cd-fdf3-4a20-92d4-5c6863b535ab tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:07.878246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b6c57-2ace-4e39-b1ea-e791d84b1216 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:07.884952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b6c57-2ace-4e39-b1ea-e791d84b1216 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:07.885335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b6c57-2ace-4e39-b1ea-e791d84b1216 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:07.885667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b6c57-2ace-4e39-b1ea-e791d84b1216 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18/users/8b724ece0d5e4413b7f17d08dffcc4e7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:07.896245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd093c92-ca74-4628-b2bd-1911b465dec2 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:07.996395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b6c57-2ace-4e39-b1ea-e791d84b1216 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=003c115ef81246ffa27e0053f557ca18, user_id=8b724ece0d5e4413b7f17d08dffcc4e7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:08.002860 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-058b6c57-2ace-4e39-b1ea-e791d84b1216 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:48:08.002860 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:48:08.002860 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:48:08.011926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b6c57-2ace-4e39-b1ea-e791d84b1216 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:08.022185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd093c92-ca74-4628-b2bd-1911b465dec2 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:08.033547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e81c8-7505-49eb-b045-db4eef7d1a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:08.034510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e81c8-7505-49eb-b045-db4eef7d1a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:08.034913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e81c8-7505-49eb-b045-db4eef7d1a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:08.035252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e81c8-7505-49eb-b045-db4eef7d1a0f admin admin] PATH_INFO: `/v3/users/f8a94ad124d04f0082acddb25858961e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:08.041686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e81c8-7505-49eb-b045-db4eef7d1a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a94ad124d04f0082acddb25858961e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:08.048365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e81c8-7505-49eb-b045-db4eef7d1a0f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:08.063513 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2598/5202] 10.222.0.16 () {60 vars in 1360 bytes} [Mon Aug 29 15:48:07 2022] PUT /identity/v3/groups/003c115ef81246ffa27e0053f557ca18/users/8b724ece0d5e4413b7f17d08dffcc4e7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:08.072269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b6c57-2ace-4e39-b1ea-e791d84b1216 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:08.181708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-396e81c8-7505-49eb-b045-db4eef7d1a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a94ad124d04f0082acddb25858961e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:08.183026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-396e81c8-7505-49eb-b045-db4eef7d1a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a94ad124d04f0082acddb25858961e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:08.214969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-396e81c8-7505-49eb-b045-db4eef7d1a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a94ad124d04f0082acddb25858961e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:08.216784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-396e81c8-7505-49eb-b045-db4eef7d1a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a94ad124d04f0082acddb25858961e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:08.235411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-396e81c8-7505-49eb-b045-db4eef7d1a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a94ad124d04f0082acddb25858961e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:08.252013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b6c57-2ace-4e39-b1ea-e791d84b1216 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:08.263311 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2605/5203] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:07 2022] DELETE /identity/v3/users/f8a94ad124d04f0082acddb25858961e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:08.264984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d731d52-95ba-43ee-83ae-dc10367ae8ce tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:08.266347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d731d52-95ba-43ee-83ae-dc10367ae8ce tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:08.268075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a900288-aac4-47e0-a8d2-bbe7460a96d2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:08.268361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a900288-aac4-47e0-a8d2-bbe7460a96d2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:08.268693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a900288-aac4-47e0-a8d2-bbe7460a96d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:08.269571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d731d52-95ba-43ee-83ae-dc10367ae8ce tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:08.269879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d731d52-95ba-43ee-83ae-dc10367ae8ce tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:08.270575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d731d52-95ba-43ee-83ae-dc10367ae8ce tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:08.275090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d731d52-95ba-43ee-83ae-dc10367ae8ce tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:08.308103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3a900288-aac4-47e0-a8d2-bbe7460a96d2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:08.312084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3a900288-aac4-47e0-a8d2-bbe7460a96d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:08.324017 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2599/5204] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:08 2022] POST /identity/v3/users => generated 321 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:08.326449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d731d52-95ba-43ee-83ae-dc10367ae8ce tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:08.331573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9d731d52-95ba-43ee-83ae-dc10367ae8ce tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:08.355886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d731d52-95ba-43ee-83ae-dc10367ae8ce tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:08.451093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:08.489631 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2606/5205] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:08.521763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a900288-aac4-47e0-a8d2-bbe7460a96d2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:08.524107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3a900288-aac4-47e0-a8d2-bbe7460a96d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:08.603600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cd75a-3c2b-43db-a5e2-cb4df835e126 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:08.605065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd75a-3c2b-43db-a5e2-cb4df835e126 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:08.605840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd75a-3c2b-43db-a5e2-cb4df835e126 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:08.609024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd75a-3c2b-43db-a5e2-cb4df835e126 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18/users/538adecaea09438bb2ae340094d79f31` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:08.691904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cd75a-3c2b-43db-a5e2-cb4df835e126 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=003c115ef81246ffa27e0053f557ca18, user_id=538adecaea09438bb2ae340094d79f31)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:08.696418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cd75a-3c2b-43db-a5e2-cb4df835e126 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:08.708902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:08.781163 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2600/5206] 10.222.0.16 () {60 vars in 1360 bytes} [Mon Aug 29 15:48:08 2022] PUT /identity/v3/groups/003c115ef81246ffa27e0053f557ca18/users/538adecaea09438bb2ae340094d79f31 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:08.786415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a900288-aac4-47e0-a8d2-bbe7460a96d2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:08.791138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cd75a-3c2b-43db-a5e2-cb4df835e126 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:08.934954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543b5be-c446-438a-bcb9-13f2f420ebac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:08.936181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543b5be-c446-438a-bcb9-13f2f420ebac service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:08.936648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543b5be-c446-438a-bcb9-13f2f420ebac service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:08.951422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543b5be-c446-438a-bcb9-13f2f420ebac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:09.047660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cd75a-3c2b-43db-a5e2-cb4df835e126 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:09.068581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538aa9a-8a31-4b27-b1dd-53809515cdf5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:09.069745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538aa9a-8a31-4b27-b1dd-53809515cdf5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:09.070428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538aa9a-8a31-4b27-b1dd-53809515cdf5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:09.070982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538aa9a-8a31-4b27-b1dd-53809515cdf5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:09.074920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538aa9a-8a31-4b27-b1dd-53809515cdf5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:09.081322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538aa9a-8a31-4b27-b1dd-53809515cdf5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:09.169585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543b5be-c446-438a-bcb9-13f2f420ebac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:09.171139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543b5be-c446-438a-bcb9-13f2f420ebac service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:09.171731 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2601/5207] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:08 2022] POST /identity/v3/users => generated 321 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:09.185909 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2607/5208] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:48:09.188372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538aa9a-8a31-4b27-b1dd-53809515cdf5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:09.233822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538aa9a-8a31-4b27-b1dd-53809515cdf5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:09.253056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1982411-8a4a-44e2-acb4-1b58cafcb541 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:09.253959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1982411-8a4a-44e2-acb4-1b58cafcb541 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:09.254246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1982411-8a4a-44e2-acb4-1b58cafcb541 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:09.254561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1982411-8a4a-44e2-acb4-1b58cafcb541 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18/users/590a1fb48aaa4e949739916a39df9bef` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:09.274421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1982411-8a4a-44e2-acb4-1b58cafcb541 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=003c115ef81246ffa27e0053f557ca18, user_id=590a1fb48aaa4e949739916a39df9bef)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:09.276710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1982411-8a4a-44e2-acb4-1b58cafcb541 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:09.322450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543b5be-c446-438a-bcb9-13f2f420ebac service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:09.323381 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2602/5209] 10.222.0.16 () {60 vars in 1360 bytes} [Mon Aug 29 15:48:09 2022] PUT /identity/v3/groups/003c115ef81246ffa27e0053f557ca18/users/590a1fb48aaa4e949739916a39df9bef => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:09.333914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543b5be-c446-438a-bcb9-13f2f420ebac service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:09.413716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5f9da-4070-4ecf-bb8a-f865dc91c093 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:09.414367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5f9da-4070-4ecf-bb8a-f865dc91c093 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:09.414680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5f9da-4070-4ecf-bb8a-f865dc91c093 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:09.414954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5f9da-4070-4ecf-bb8a-f865dc91c093 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:09.416790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5f9da-4070-4ecf-bb8a-f865dc91c093 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=003c115ef81246ffa27e0053f557ca18)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:09.418117 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-74d5f9da-4070-4ecf-bb8a-f865dc91c093 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:48:09.418117 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:48:09.418117 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:48:09.419388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5f9da-4070-4ecf-bb8a-f865dc91c093 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:09.422439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:09.461432 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2608/5210] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:48:09 2022] GET /identity/v3/groups/003c115ef81246ffa27e0053f557ca18/users => generated 1081 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:09.472188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1982411-8a4a-44e2-acb4-1b58cafcb541 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:09.498946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1982411-8a4a-44e2-acb4-1b58cafcb541 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:09.522166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bc175-ed9f-4033-bacd-f1181ada34c8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:09.523560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bc175-ed9f-4033-bacd-f1181ada34c8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:09.523560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bc175-ed9f-4033-bacd-f1181ada34c8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:09.523560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bc175-ed9f-4033-bacd-f1181ada34c8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18/users/8b724ece0d5e4413b7f17d08dffcc4e7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:09.528819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bc175-ed9f-4033-bacd-f1181ada34c8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=003c115ef81246ffa27e0053f557ca18, user_id=8b724ece0d5e4413b7f17d08dffcc4e7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:09.529912 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-318bc175-ed9f-4033-bacd-f1181ada34c8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:48:09.529912 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:48:09.529912 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:48:09.531554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bc175-ed9f-4033-bacd-f1181ada34c8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:09.590125 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2603/5211] 10.222.0.16 () {58 vars in 1342 bytes} [Mon Aug 29 15:48:09 2022] HEAD /identity/v3/groups/003c115ef81246ffa27e0053f557ca18/users/8b724ece0d5e4413b7f17d08dffcc4e7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:09.591597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5f9da-4070-4ecf-bb8a-f865dc91c093 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:09.608525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5f9da-4070-4ecf-bb8a-f865dc91c093 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:09.631832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a77f7-d849-4a4c-a08c-68e45b8d295e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:09.634011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a77f7-d849-4a4c-a08c-68e45b8d295e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:09.634011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a77f7-d849-4a4c-a08c-68e45b8d295e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:09.634287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a77f7-d849-4a4c-a08c-68e45b8d295e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18/users/8b724ece0d5e4413b7f17d08dffcc4e7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:09.642197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a77f7-d849-4a4c-a08c-68e45b8d295e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=003c115ef81246ffa27e0053f557ca18, user_id=8b724ece0d5e4413b7f17d08dffcc4e7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:09.644645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a77f7-d849-4a4c-a08c-68e45b8d295e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:09.665900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-469a77f7-d849-4a4c-a08c-68e45b8d295e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8b724ece0d5e4413b7f17d08dffcc4e7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:09.685811 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2609/5212] 10.222.0.16 () {58 vars in 1344 bytes} [Mon Aug 29 15:48:09 2022] DELETE /identity/v3/groups/003c115ef81246ffa27e0053f557ca18/users/8b724ece0d5e4413b7f17d08dffcc4e7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:09.691305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bc175-ed9f-4033-bacd-f1181ada34c8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:09.725084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bc175-ed9f-4033-bacd-f1181ada34c8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:09.951463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c9d43-919b-47ea-b74b-68f05c21dfd7 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:09.953717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c9d43-919b-47ea-b74b-68f05c21dfd7 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:09.954508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c9d43-919b-47ea-b74b-68f05c21dfd7 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:09.955005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c9d43-919b-47ea-b74b-68f05c21dfd7 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18/users/538adecaea09438bb2ae340094d79f31` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:09.958417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c9d43-919b-47ea-b74b-68f05c21dfd7 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=003c115ef81246ffa27e0053f557ca18, user_id=538adecaea09438bb2ae340094d79f31)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:09.961545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c9d43-919b-47ea-b74b-68f05c21dfd7 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:10.009212 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2604/5213] 10.222.0.16 () {58 vars in 1342 bytes} [Mon Aug 29 15:48:09 2022] HEAD /identity/v3/groups/003c115ef81246ffa27e0053f557ca18/users/538adecaea09438bb2ae340094d79f31 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:10.014184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a77f7-d849-4a4c-a08c-68e45b8d295e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:10.043871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a77f7-d849-4a4c-a08c-68e45b8d295e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:10.055070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a01d4-ff83-48d8-8902-1098f145e703 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:10.056049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a01d4-ff83-48d8-8902-1098f145e703 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:10.056486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a01d4-ff83-48d8-8902-1098f145e703 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:10.056843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a01d4-ff83-48d8-8902-1098f145e703 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18/users/538adecaea09438bb2ae340094d79f31` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:10.059144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a01d4-ff83-48d8-8902-1098f145e703 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=003c115ef81246ffa27e0053f557ca18, user_id=538adecaea09438bb2ae340094d79f31)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:10.063025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a01d4-ff83-48d8-8902-1098f145e703 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:10.075845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-295a01d4-ff83-48d8-8902-1098f145e703 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '538adecaea09438bb2ae340094d79f31'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.119215 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2610/5214] 10.222.0.16 () {58 vars in 1344 bytes} [Mon Aug 29 15:48:10 2022] DELETE /identity/v3/groups/003c115ef81246ffa27e0053f557ca18/users/538adecaea09438bb2ae340094d79f31 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:10.123475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c9d43-919b-47ea-b74b-68f05c21dfd7 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:10.139123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c9d43-919b-47ea-b74b-68f05c21dfd7 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:10.178624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:10.293578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca017e8-2dcb-4ee2-b5de-ec4dfcfc03a5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:10.294260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca017e8-2dcb-4ee2-b5de-ec4dfcfc03a5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:10.294544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca017e8-2dcb-4ee2-b5de-ec4dfcfc03a5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:10.294823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca017e8-2dcb-4ee2-b5de-ec4dfcfc03a5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18/users/590a1fb48aaa4e949739916a39df9bef` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:10.298077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca017e8-2dcb-4ee2-b5de-ec4dfcfc03a5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=003c115ef81246ffa27e0053f557ca18, user_id=590a1fb48aaa4e949739916a39df9bef)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:10.299855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca017e8-2dcb-4ee2-b5de-ec4dfcfc03a5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:10.328906 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2605/5215] 10.222.0.16 () {58 vars in 1342 bytes} [Mon Aug 29 15:48:10 2022] HEAD /identity/v3/groups/003c115ef81246ffa27e0053f557ca18/users/590a1fb48aaa4e949739916a39df9bef => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:10.334157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a01d4-ff83-48d8-8902-1098f145e703 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:10.354015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a01d4-ff83-48d8-8902-1098f145e703 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:10.376207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183d3f2-b60b-4737-b3fe-58792062b3d0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:10.381672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183d3f2-b60b-4737-b3fe-58792062b3d0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:10.382787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183d3f2-b60b-4737-b3fe-58792062b3d0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:10.383301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183d3f2-b60b-4737-b3fe-58792062b3d0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18/users/590a1fb48aaa4e949739916a39df9bef` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:10.387197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183d3f2-b60b-4737-b3fe-58792062b3d0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=003c115ef81246ffa27e0053f557ca18, user_id=590a1fb48aaa4e949739916a39df9bef)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:10.389860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183d3f2-b60b-4737-b3fe-58792062b3d0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:10.403165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9183d3f2-b60b-4737-b3fe-58792062b3d0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '590a1fb48aaa4e949739916a39df9bef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.426120 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2611/5216] 10.222.0.16 () {58 vars in 1344 bytes} [Mon Aug 29 15:48:10 2022] DELETE /identity/v3/groups/003c115ef81246ffa27e0053f557ca18/users/590a1fb48aaa4e949739916a39df9bef => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:10.430927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca017e8-2dcb-4ee2-b5de-ec4dfcfc03a5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:10.445924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca017e8-2dcb-4ee2-b5de-ec4dfcfc03a5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:10.661293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea8750-b3db-4564-a48c-3391d7b704c0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:10.663357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8750-b3db-4564-a48c-3391d7b704c0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:10.663646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8750-b3db-4564-a48c-3391d7b704c0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:10.663931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea8750-b3db-4564-a48c-3391d7b704c0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:10.666032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea8750-b3db-4564-a48c-3391d7b704c0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=003c115ef81246ffa27e0053f557ca18)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:10.669379 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-c9ea8750-b3db-4564-a48c-3391d7b704c0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:48:10.669379 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:48:10.669379 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:48:10.672711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea8750-b3db-4564-a48c-3391d7b704c0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:10.695958 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2606/5217] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:48:10 2022] GET /identity/v3/groups/003c115ef81246ffa27e0053f557ca18/users => generated 145 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:10.700818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183d3f2-b60b-4737-b3fe-58792062b3d0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:10.717534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183d3f2-b60b-4737-b3fe-58792062b3d0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:10.725333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:10.726518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:10.726941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:10.727344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/users/590a1fb48aaa4e949739916a39df9bef` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:10.728809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_user(user_id=590a1fb48aaa4e949739916a39df9bef)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:10.731369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:10.832551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590a1fb48aaa4e949739916a39df9bef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.833344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590a1fb48aaa4e949739916a39df9bef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.870715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590a1fb48aaa4e949739916a39df9bef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.871539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590a1fb48aaa4e949739916a39df9bef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.880691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590a1fb48aaa4e949739916a39df9bef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:10.911595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea8750-b3db-4564-a48c-3391d7b704c0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:10.913975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c9ea8750-b3db-4564-a48c-3391d7b704c0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:10.925498 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2612/5218] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:10 2022] DELETE /identity/v3/users/590a1fb48aaa4e949739916a39df9bef => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:10.945027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea8750-b3db-4564-a48c-3391d7b704c0 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:11.103396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:11.104227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:11.104512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:11.104790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/users/538adecaea09438bb2ae340094d79f31` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:11.106034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_user(user_id=538adecaea09438bb2ae340094d79f31)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:11.107976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:11.187350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:11.188662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:11.226989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538adecaea09438bb2ae340094d79f31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.228189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538adecaea09438bb2ae340094d79f31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.231869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:11.284433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538adecaea09438bb2ae340094d79f31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.311084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538adecaea09438bb2ae340094d79f31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.323979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538adecaea09438bb2ae340094d79f31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.329202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b63e3-01ee-4ed4-a23a-ebee6a90e248 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:11.333557 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2607/5219] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:10 2022] DELETE /identity/v3/users/538adecaea09438bb2ae340094d79f31 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:11.337011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:11.338915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:11.341770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:11.344457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:11.346286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:11.346286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] PATH_INFO: `/v3/projects/ccf25f1442f44688a2d1208ff857410e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:11.348454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf25f1442f44688a2d1208ff857410e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:11.351017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:11.360292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:11.447161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf25f1442f44688a2d1208ff857410e', 'request_id': 'req-9e43b172-e860-42bf-844d-172aa32cd5a0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.457328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47ab4b-d76c-42f6-8d11-9d659008f7be tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:11.458955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf25f1442f44688a2d1208ff857410e', 'request_id': 'req-9e43b172-e860-42bf-844d-172aa32cd5a0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.472089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf25f1442f44688a2d1208ff857410e', 'request_id': 'req-9e43b172-e860-42bf-844d-172aa32cd5a0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.488933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] The token cache is being invalidate because project ccf25f1442f44688a2d1208ff857410e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:11.489192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.490159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.492059 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2613/5220] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:11 2022] DELETE /identity/v3/projects/ccf25f1442f44688a2d1208ff857410e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:11.497108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:11.499827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:11.570061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:11.570732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:11.571019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:11.571355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/users/8b724ece0d5e4413b7f17d08dffcc4e7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:11.572727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8b724ece0d5e4413b7f17d08dffcc4e7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:11.574886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:11.641458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b724ece0d5e4413b7f17d08dffcc4e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.642757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b724ece0d5e4413b7f17d08dffcc4e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.646618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43b172-e860-42bf-844d-172aa32cd5a0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:11.655215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:11.656989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:11.657646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:11.658264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] PATH_INFO: `/v3/users/526b18c5ee1f42d5ba2a86d7193bca01` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:11.661772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b724ece0d5e4413b7f17d08dffcc4e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.663748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] RBAC: Authorizing `identity:delete_user(user_id=526b18c5ee1f42d5ba2a86d7193bca01)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:11.666988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:11.673509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b724ece0d5e4413b7f17d08dffcc4e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.680633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:11.686628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b724ece0d5e4413b7f17d08dffcc4e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.699342 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2608/5221] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:11 2022] DELETE /identity/v3/users/8b724ece0d5e4413b7f17d08dffcc4e7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:11.705346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:11.711946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:11.743290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526b18c5ee1f42d5ba2a86d7193bca01'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.744599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526b18c5ee1f42d5ba2a86d7193bca01'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.766943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526b18c5ee1f42d5ba2a86d7193bca01'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.767887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526b18c5ee1f42d5ba2a86d7193bca01'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.777014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526b18c5ee1f42d5ba2a86d7193bca01'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:11.800510 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2614/5222] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:11 2022] DELETE /identity/v3/users/526b18c5ee1f42d5ba2a86d7193bca01 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:11.820243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada49dfc-e850-4ccd-8ae2-dadce0fc4ba9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:11.907193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33136-8a74-4f7f-ba62-249418865c82 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:11.908026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33136-8a74-4f7f-ba62-249418865c82 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:11.908313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33136-8a74-4f7f-ba62-249418865c82 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:11.908642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33136-8a74-4f7f-ba62-249418865c82 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/003c115ef81246ffa27e0053f557ca18` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:11.910834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da33136-8a74-4f7f-ba62-249418865c82 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_group(group_id=003c115ef81246ffa27e0053f557ca18)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:11.913557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da33136-8a74-4f7f-ba62-249418865c82 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:11.973821 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2609/5223] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:48:11 2022] DELETE /identity/v3/groups/003c115ef81246ffa27e0053f557ca18 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:11.975528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:11.977128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:12.044990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1e924-adc4-4865-9e1d-43007b83636a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:12.073374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:12.194573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c79a7-0504-47e7-a0f1-63b54638a8a8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:12.195197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c79a7-0504-47e7-a0f1-63b54638a8a8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:12.195479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c79a7-0504-47e7-a0f1-63b54638a8a8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:12.195778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c79a7-0504-47e7-a0f1-63b54638a8a8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:12.196413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c79a7-0504-47e7-a0f1-63b54638a8a8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:12.198368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c79a7-0504-47e7-a0f1-63b54638a8a8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:12.232981 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2615/5224] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:11 2022] POST /identity/v3/groups => generated 324 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:12.237890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33136-8a74-4f7f-ba62-249418865c82 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:12.262397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33136-8a74-4f7f-ba62-249418865c82 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:12.273662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed4a2a-9bad-4761-ae4e-c438725e4048 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:12.275087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4a2a-9bad-4761-ae4e-c438725e4048 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:12.275551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4a2a-9bad-4761-ae4e-c438725e4048 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:12.276117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4a2a-9bad-4761-ae4e-c438725e4048 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:12.277480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed4a2a-9bad-4761-ae4e-c438725e4048 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:12.281272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed4a2a-9bad-4761-ae4e-c438725e4048 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:12.317105 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2610/5225] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:12 2022] POST /identity/v3/groups => generated 327 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:12.321436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c79a7-0504-47e7-a0f1-63b54638a8a8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:12.336561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c79a7-0504-47e7-a0f1-63b54638a8a8 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:12.350072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027395dd-cb0a-44e9-a7a6-6423109ddfba tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:12.351256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027395dd-cb0a-44e9-a7a6-6423109ddfba tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:12.351533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027395dd-cb0a-44e9-a7a6-6423109ddfba tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:12.351808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027395dd-cb0a-44e9-a7a6-6423109ddfba tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:12.352462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027395dd-cb0a-44e9-a7a6-6423109ddfba tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:12.354422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027395dd-cb0a-44e9-a7a6-6423109ddfba tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:12.377798 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2616/5226] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:12 2022] POST /identity/v3/groups => generated 326 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:48:12.381745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed4a2a-9bad-4761-ae4e-c438725e4048 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:12.393190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed4a2a-9bad-4761-ae4e-c438725e4048 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:12.398580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4debd9-cb13-4feb-9431-bdb294eeed5a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:12.399442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4debd9-cb13-4feb-9431-bdb294eeed5a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:12.399737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4debd9-cb13-4feb-9431-bdb294eeed5a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:12.400056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4debd9-cb13-4feb-9431-bdb294eeed5a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:12.400738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4debd9-cb13-4feb-9431-bdb294eeed5a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:12.401798 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-4b4debd9-cb13-4feb-9431-bdb294eeed5a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:48:12.401798 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:48:12.401798 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:48:12.403227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4debd9-cb13-4feb-9431-bdb294eeed5a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:12.415510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2611/5227] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Aug 29 15:48:12 2022] GET /identity/v3/groups => generated 1487 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:12.416190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027395dd-cb0a-44e9-a7a6-6423109ddfba tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:12.432716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027395dd-cb0a-44e9-a7a6-6423109ddfba tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:12.439619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa49ab-9189-4c08-9b60-c96f9833c6ef tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:12.441306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa49ab-9189-4c08-9b60-c96f9833c6ef tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:12.441988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa49ab-9189-4c08-9b60-c96f9833c6ef tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:12.443338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa49ab-9189-4c08-9b60-c96f9833c6ef tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/549be89cc53740db866f47b9a23fdd81` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:12.452735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa49ab-9189-4c08-9b60-c96f9833c6ef tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_group(group_id=549be89cc53740db866f47b9a23fdd81)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:12.455241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa49ab-9189-4c08-9b60-c96f9833c6ef tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:12.525023 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2617/5228] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:48:12 2022] DELETE /identity/v3/groups/549be89cc53740db866f47b9a23fdd81 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:12.528732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4debd9-cb13-4feb-9431-bdb294eeed5a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:12.542658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4debd9-cb13-4feb-9431-bdb294eeed5a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:12.620091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:12.741604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b5793-d9cf-4464-bbf9-f9128686b545 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:12.742879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b5793-d9cf-4464-bbf9-f9128686b545 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:12.743672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b5793-d9cf-4464-bbf9-f9128686b545 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:12.744435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b5793-d9cf-4464-bbf9-f9128686b545 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/d1b3364a702f49a788c6c059530969bd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:12.755495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b5793-d9cf-4464-bbf9-f9128686b545 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d1b3364a702f49a788c6c059530969bd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:12.760498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b5793-d9cf-4464-bbf9-f9128686b545 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:12.869513 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2612/5229] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:48:12 2022] DELETE /identity/v3/groups/d1b3364a702f49a788c6c059530969bd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:12.875129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa49ab-9189-4c08-9b60-c96f9833c6ef tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:12.893187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa49ab-9189-4c08-9b60-c96f9833c6ef tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:13.130720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361f365-ad08-4f95-9ca0-292067224090 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:13.136041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361f365-ad08-4f95-9ca0-292067224090 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:13.136690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361f365-ad08-4f95-9ca0-292067224090 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:13.137574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361f365-ad08-4f95-9ca0-292067224090 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/40df1cdec75947ada5cc26f949e28a94` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:13.158407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361f365-ad08-4f95-9ca0-292067224090 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_group(group_id=40df1cdec75947ada5cc26f949e28a94)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:13.164482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361f365-ad08-4f95-9ca0-292067224090 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:13.218128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b5793-d9cf-4464-bbf9-f9128686b545 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:13.220359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3c4b5793-d9cf-4464-bbf9-f9128686b545 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:13.336939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:13.372180 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2618/5230] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:48:12 2022] DELETE /identity/v3/groups/40df1cdec75947ada5cc26f949e28a94 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:13.377571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361f365-ad08-4f95-9ca0-292067224090 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:13.441097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b5793-d9cf-4464-bbf9-f9128686b545 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:13.557357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361f365-ad08-4f95-9ca0-292067224090 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:13.567061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1525e3b-2e7a-4caa-a933-a3847716dddc tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:13.568876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1525e3b-2e7a-4caa-a933-a3847716dddc tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:13.570658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1525e3b-2e7a-4caa-a933-a3847716dddc tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:13.571015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1525e3b-2e7a-4caa-a933-a3847716dddc tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:13.572417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1525e3b-2e7a-4caa-a933-a3847716dddc tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:13.573476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:13.574499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:13.575020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:13.575628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] PATH_INFO: `/v3/users/2d93304862cb4e0a97256daac1bc6d98` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:13.577281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1525e3b-2e7a-4caa-a933-a3847716dddc tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:13.577988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d93304862cb4e0a97256daac1bc6d98)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:13.580253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:13.628545 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2619/5231] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:13 2022] POST /identity/v3/users => generated 323 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:13.628545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1525e3b-2e7a-4caa-a933-a3847716dddc tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:13.629434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f1525e3b-2e7a-4caa-a933-a3847716dddc tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:13.664810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1525e3b-2e7a-4caa-a933-a3847716dddc tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:13.683342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:13.683687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:13.684356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:13.684638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:13.684922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] PATH_INFO: `/v3/projects/141bd780b64a4eb888ac431f39cd5862` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:13.688599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141bd780b64a4eb888ac431f39cd5862)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:13.693190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:13.698164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d93304862cb4e0a97256daac1bc6d98'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:13.698886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d93304862cb4e0a97256daac1bc6d98'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:13.730290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d93304862cb4e0a97256daac1bc6d98'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:13.745895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d93304862cb4e0a97256daac1bc6d98'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:13.761509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d93304862cb4e0a97256daac1bc6d98'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:13.778596 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2613/5232] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:13 2022] DELETE /identity/v3/users/2d93304862cb4e0a97256daac1bc6d98 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:13.785027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:13.795088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:13.820839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141bd780b64a4eb888ac431f39cd5862', 'request_id': 'req-1301f48e-8b2f-4818-b317-4be379f4ac47'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:13.831381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141bd780b64a4eb888ac431f39cd5862', 'request_id': 'req-1301f48e-8b2f-4818-b317-4be379f4ac47'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:13.843996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141bd780b64a4eb888ac431f39cd5862', 'request_id': 'req-1301f48e-8b2f-4818-b317-4be379f4ac47'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:13.859837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] The token cache is being invalidate because project 141bd780b64a4eb888ac431f39cd5862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:13.860690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:13.861528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1301f48e-8b2f-4818-b317-4be379f4ac47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:13.868020 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2620/5233] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:13 2022] DELETE /identity/v3/projects/141bd780b64a4eb888ac431f39cd5862 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:13.868020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458fdf5-105c-4b1b-8f53-0b4903375113 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:13.868020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458fdf5-105c-4b1b-8f53-0b4903375113 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:13.868020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458fdf5-105c-4b1b-8f53-0b4903375113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:13.931859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2458fdf5-105c-4b1b-8f53-0b4903375113 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:13.933986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2458fdf5-105c-4b1b-8f53-0b4903375113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:13.939842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d74afb-3628-48c0-bead-0527a188178e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:14.012005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4103f-fa27-4216-ae2e-8a1cc95de280 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:14.012921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4103f-fa27-4216-ae2e-8a1cc95de280 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.013478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4103f-fa27-4216-ae2e-8a1cc95de280 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.013869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4103f-fa27-4216-ae2e-8a1cc95de280 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.014988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4103f-fa27-4216-ae2e-8a1cc95de280 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:14.017226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4103f-fa27-4216-ae2e-8a1cc95de280 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:14.054104 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2614/5234] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:13 2022] POST /identity/v3/groups => generated 326 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:14.058692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bddc6-0657-4127-9ee2-9002031699fc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.066727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bddc6-0657-4127-9ee2-9002031699fc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.067215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bddc6-0657-4127-9ee2-9002031699fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.108495 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2621/5235] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:14.110026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458fdf5-105c-4b1b-8f53-0b4903375113 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:14.112161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2458fdf5-105c-4b1b-8f53-0b4903375113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:14.131557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458fdf5-105c-4b1b-8f53-0b4903375113 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:14.134554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-455bddc6-0657-4127-9ee2-9002031699fc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:14.136194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-455bddc6-0657-4127-9ee2-9002031699fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:14.141950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e92e69-215c-4899-96e0-ff356ba59d7e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:14.143361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e92e69-215c-4899-96e0-ff356ba59d7e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.144279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e92e69-215c-4899-96e0-ff356ba59d7e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.145216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e92e69-215c-4899-96e0-ff356ba59d7e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/bb11e53a910b4c43aa0800067e3f1cfe/users/65e085aa531f4b4f974bb53ff36eb734` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.148319 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2615/5236] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:14.149406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bddc6-0657-4127-9ee2-9002031699fc None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:14.151075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:14.152208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-455bddc6-0657-4127-9ee2-9002031699fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:14.194656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e92e69-215c-4899-96e0-ff356ba59d7e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bb11e53a910b4c43aa0800067e3f1cfe, user_id=65e085aa531f4b4f974bb53ff36eb734)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:14.197430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e92e69-215c-4899-96e0-ff356ba59d7e tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:14.243013 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2622/5237] 10.222.0.16 () {60 vars in 1360 bytes} [Mon Aug 29 15:48:14 2022] PUT /identity/v3/groups/bb11e53a910b4c43aa0800067e3f1cfe/users/65e085aa531f4b4f974bb53ff36eb734 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:14.247674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e81a53-2e39-4b5d-91b8-204f721b477f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.247968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e81a53-2e39-4b5d-91b8-204f721b477f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.248253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e81a53-2e39-4b5d-91b8-204f721b477f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.262862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bddc6-0657-4127-9ee2-9002031699fc None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:14.270004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:14.274829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-34e81a53-2e39-4b5d-91b8-204f721b477f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:14.276437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-34e81a53-2e39-4b5d-91b8-204f721b477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:14.364668 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2623/5238] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:14.365745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e81a53-2e39-4b5d-91b8-204f721b477f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:14.392444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3d6fa-583d-4fb5-a54d-7fba469a874a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:14.393217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d6fa-583d-4fb5-a54d-7fba469a874a service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.393556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d6fa-583d-4fb5-a54d-7fba469a874a service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.393883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d6fa-583d-4fb5-a54d-7fba469a874a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.406326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3d6fa-583d-4fb5-a54d-7fba469a874a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:14.407972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3d6fa-583d-4fb5-a54d-7fba469a874a service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:14.419587 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2616/5239] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:14.426303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3d6fa-583d-4fb5-a54d-7fba469a874a service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:14.449189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3d6fa-583d-4fb5-a54d-7fba469a874a service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:14.461695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46db4f-b4b7-497f-a7a9-f1e8859fbdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:14.462603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46db4f-b4b7-497f-a7a9-f1e8859fbdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.463406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46db4f-b4b7-497f-a7a9-f1e8859fbdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.463406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46db4f-b4b7-497f-a7a9-f1e8859fbdf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.464116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46db4f-b4b7-497f-a7a9-f1e8859fbdf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:14.464525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46db4f-b4b7-497f-a7a9-f1e8859fbdf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:14.466428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46db4f-b4b7-497f-a7a9-f1e8859fbdf3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:14.480681 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2617/5240] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:14.481670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e81a53-2e39-4b5d-91b8-204f721b477f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:14.485998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46db4f-b4b7-497f-a7a9-f1e8859fbdf3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:14.492909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648fb09-6bd6-47c4-8b4f-e07da6b09f62 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:14.493893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648fb09-6bd6-47c4-8b4f-e07da6b09f62 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.494180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648fb09-6bd6-47c4-8b4f-e07da6b09f62 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.494489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648fb09-6bd6-47c4-8b4f-e07da6b09f62 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.495100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648fb09-6bd6-47c4-8b4f-e07da6b09f62 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:14.497049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648fb09-6bd6-47c4-8b4f-e07da6b09f62 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:14.512546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46db4f-b4b7-497f-a7a9-f1e8859fbdf3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:14.525354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d259d-df3e-4954-b3b9-227b7f953d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:14.527259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d259d-df3e-4954-b3b9-227b7f953d06 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.527626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d259d-df3e-4954-b3b9-227b7f953d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.531490 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2624/5241] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:14 2022] POST /identity/v3/groups => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:14.531662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d259d-df3e-4954-b3b9-227b7f953d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.531662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d259d-df3e-4954-b3b9-227b7f953d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:14.532975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648fb09-6bd6-47c4-8b4f-e07da6b09f62 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:14.540028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d259d-df3e-4954-b3b9-227b7f953d06 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:14.566081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648fb09-6bd6-47c4-8b4f-e07da6b09f62 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:14.574438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1aee3-fa4c-4043-bd01-4a5ddbfb920a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:14.576616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1aee3-fa4c-4043-bd01-4a5ddbfb920a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.577425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1aee3-fa4c-4043-bd01-4a5ddbfb920a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.577999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1aee3-fa4c-4043-bd01-4a5ddbfb920a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/e00b81e1d16b4fcf8f80567012bc7fdf/users/65e085aa531f4b4f974bb53ff36eb734` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.593271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1aee3-fa4c-4043-bd01-4a5ddbfb920a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e00b81e1d16b4fcf8f80567012bc7fdf, user_id=65e085aa531f4b4f974bb53ff36eb734)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:14.595883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1aee3-fa4c-4043-bd01-4a5ddbfb920a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:14.611826 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2618/5242] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:14 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:14.613112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d259d-df3e-4954-b3b9-227b7f953d06 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:14.642256 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2625/5243] 10.222.0.16 () {60 vars in 1360 bytes} [Mon Aug 29 15:48:14 2022] PUT /identity/v3/groups/e00b81e1d16b4fcf8f80567012bc7fdf/users/65e085aa531f4b4f974bb53ff36eb734 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:14.647130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1aee3-fa4c-4043-bd01-4a5ddbfb920a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:14.725579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:14.727904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d259d-df3e-4954-b3b9-227b7f953d06 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:14.768826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1aee3-fa4c-4043-bd01-4a5ddbfb920a tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:14.778138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfbb45-3810-40c3-9ede-3f93dbdfacc9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:14.778882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfbb45-3810-40c3-9ede-3f93dbdfacc9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.779251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfbb45-3810-40c3-9ede-3f93dbdfacc9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.779903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfbb45-3810-40c3-9ede-3f93dbdfacc9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/users/65e085aa531f4b4f974bb53ff36eb734/groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.781444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfbb45-3810-40c3-9ede-3f93dbdfacc9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=65e085aa531f4b4f974bb53ff36eb734)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:14.784051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfbb45-3810-40c3-9ede-3f93dbdfacc9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:14.806035 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2626/5244] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:48:14 2022] GET /identity/v3/users/65e085aa531f4b4f974bb53ff36eb734/groups => generated 839 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:14.806998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfbb45-3810-40c3-9ede-3f93dbdfacc9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:14.811405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1cbfbb45-3810-40c3-9ede-3f93dbdfacc9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:14.857688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f3cfe-a375-4160-87cd-6a44a6e792e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:14.858374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f3cfe-a375-4160-87cd-6a44a6e792e2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.858954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f3cfe-a375-4160-87cd-6a44a6e792e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.859732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f3cfe-a375-4160-87cd-6a44a6e792e2 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.861530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f3cfe-a375-4160-87cd-6a44a6e792e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:14.866134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f3cfe-a375-4160-87cd-6a44a6e792e2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:14.904736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfbb45-3810-40c3-9ede-3f93dbdfacc9 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:14.917157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:14.917157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.917157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.917157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] PATH_INFO: `/v3/projects/edf4b0f22e58420b9458a8799e3a5900` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.917817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf4b0f22e58420b9458a8799e3a5900)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:14.917817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:14.930341 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2619/5245] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:14 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:14.931671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f3cfe-a375-4160-87cd-6a44a6e792e2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:14.952550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f3cfe-a375-4160-87cd-6a44a6e792e2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:14.964959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6a4da-1f2b-4a28-9bb0-88e6b48fdb88 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:14.965753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6a4da-1f2b-4a28-9bb0-88e6b48fdb88 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:14.966037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6a4da-1f2b-4a28-9bb0-88e6b48fdb88 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:14.966314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6a4da-1f2b-4a28-9bb0-88e6b48fdb88 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/e00b81e1d16b4fcf8f80567012bc7fdf` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:14.967809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6a4da-1f2b-4a28-9bb0-88e6b48fdb88 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e00b81e1d16b4fcf8f80567012bc7fdf)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:14.969903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6a4da-1f2b-4a28-9bb0-88e6b48fdb88 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:14.980033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:15.013111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf4b0f22e58420b9458a8799e3a5900', 'request_id': 'req-90d1d9c0-2733-473c-83ee-36cf68e2328b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.032124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf4b0f22e58420b9458a8799e3a5900', 'request_id': 'req-90d1d9c0-2733-473c-83ee-36cf68e2328b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.048694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf4b0f22e58420b9458a8799e3a5900', 'request_id': 'req-90d1d9c0-2733-473c-83ee-36cf68e2328b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.072980 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2620/5246] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:48:14 2022] DELETE /identity/v3/groups/e00b81e1d16b4fcf8f80567012bc7fdf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:15.074736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6a4da-1f2b-4a28-9bb0-88e6b48fdb88 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:15.084342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] The token cache is being invalidate because project edf4b0f22e58420b9458a8799e3a5900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:15.085380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.088599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.090938 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2627/5247] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:14 2022] DELETE /identity/v3/projects/edf4b0f22e58420b9458a8799e3a5900 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:15.097553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:15.104833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:15.171673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6a4da-1f2b-4a28-9bb0-88e6b48fdb88 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:15.178591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376d0b6-2215-4e28-9e60-8b8ca4bde966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:15.179553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d0b6-2215-4e28-9e60-8b8ca4bde966 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:15.179932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d0b6-2215-4e28-9e60-8b8ca4bde966 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:15.180665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d0b6-2215-4e28-9e60-8b8ca4bde966 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:15.181761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376d0b6-2215-4e28-9e60-8b8ca4bde966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:15.184462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376d0b6-2215-4e28-9e60-8b8ca4bde966 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:15.203027 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2621/5248] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:15.204746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376d0b6-2215-4e28-9e60-8b8ca4bde966 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:15.207178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0376d0b6-2215-4e28-9e60-8b8ca4bde966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:15.219304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1d9c0-2733-473c-83ee-36cf68e2328b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:15.225501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376d0b6-2215-4e28-9e60-8b8ca4bde966 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:15.228853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:15.233059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:15.234253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:15.234567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:15.234852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] PATH_INFO: `/v3/users/cfb2c16acc6d42caa9cd4cd6c7f4836a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:15.236097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb2c16acc6d42caa9cd4cd6c7f4836a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:15.238261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:15.313016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb2c16acc6d42caa9cd4cd6c7f4836a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.313831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb2c16acc6d42caa9cd4cd6c7f4836a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.314916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c64015-e61f-49b8-b619-7982ddb18979 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:15.315577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c64015-e61f-49b8-b619-7982ddb18979 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:15.315859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c64015-e61f-49b8-b619-7982ddb18979 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:15.316135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c64015-e61f-49b8-b619-7982ddb18979 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/groups/bb11e53a910b4c43aa0800067e3f1cfe` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:15.317983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c64015-e61f-49b8-b619-7982ddb18979 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bb11e53a910b4c43aa0800067e3f1cfe)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:15.320119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c64015-e61f-49b8-b619-7982ddb18979 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:15.331352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb2c16acc6d42caa9cd4cd6c7f4836a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.343024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb2c16acc6d42caa9cd4cd6c7f4836a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.355864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb2c16acc6d42caa9cd4cd6c7f4836a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.366463 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2622/5249] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:15 2022] DELETE /identity/v3/users/cfb2c16acc6d42caa9cd4cd6c7f4836a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:15.367452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:15.369014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:15.390450 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2628/5250] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:48:15 2022] DELETE /identity/v3/groups/bb11e53a910b4c43aa0800067e3f1cfe => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:15.395358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c64015-e61f-49b8-b619-7982ddb18979 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:15.399176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a9c64015-e61f-49b8-b619-7982ddb18979 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:15.412163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:15.490067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15217e-e731-40d6-b953-113f636ccc77 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:15.519679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c64015-e61f-49b8-b619-7982ddb18979 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:15.533805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:15.536886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:15.537804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:15.538089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/users/65e085aa531f4b4f974bb53ff36eb734` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:15.540823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_user(user_id=65e085aa531f4b4f974bb53ff36eb734)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:15.543069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:15.628268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebd9aa-b7e1-40aa-b593-3db2206e3902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:15.628959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebd9aa-b7e1-40aa-b593-3db2206e3902 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:15.629246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebd9aa-b7e1-40aa-b593-3db2206e3902 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:15.629602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebd9aa-b7e1-40aa-b593-3db2206e3902 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:15.631186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebd9aa-b7e1-40aa-b593-3db2206e3902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:15.633298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebd9aa-b7e1-40aa-b593-3db2206e3902 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:15.648188 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2623/5251] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:15.653935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e085aa531f4b4f974bb53ff36eb734'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.654687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebd9aa-b7e1-40aa-b593-3db2206e3902 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:15.655171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e085aa531f4b4f974bb53ff36eb734'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.657084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c3ebd9aa-b7e1-40aa-b593-3db2206e3902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:15.675907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebd9aa-b7e1-40aa-b593-3db2206e3902 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:15.680321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e085aa531f4b4f974bb53ff36eb734'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.682231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e085aa531f4b4f974bb53ff36eb734'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.684643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=13 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:15.699550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04d912-fe46-492d-bc77-057b2b55e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:15.700248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d912-fe46-492d-bc77-057b2b55e58b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:15.700674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d912-fe46-492d-bc77-057b2b55e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:15.701003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d912-fe46-492d-bc77-057b2b55e58b admin admin] PATH_INFO: `/v3/projects/acee2daa9a5b4e0ca9e89acd237f7407/users/7029ffda9cf14bd683c021beef9be7fd/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:15.705715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e085aa531f4b4f974bb53ff36eb734'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:15.729285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04d912-fe46-492d-bc77-057b2b55e58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=acee2daa9a5b4e0ca9e89acd237f7407, user_id=7029ffda9cf14bd683c021beef9be7fd, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:15.730942 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2629/5252] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:15 2022] DELETE /identity/v3/users/65e085aa531f4b4f974bb53ff36eb734 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:15.733438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04d912-fe46-492d-bc77-057b2b55e58b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:15.737933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:15.742306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:15.760449 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2624/5253] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:15 2022] PUT /identity/v3/projects/acee2daa9a5b4e0ca9e89acd237f7407/users/7029ffda9cf14bd683c021beef9be7fd/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:15.777177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7f02-a526-4271-b9ab-ad4bf29454f0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:15.777502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7f02-a526-4271-b9ab-ad4bf29454f0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:15.777816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7f02-a526-4271-b9ab-ad4bf29454f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:15.841782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-786d7f02-a526-4271-b9ab-ad4bf29454f0 None None] MFA Rules not processed for user `7029ffda9cf14bd683c021beef9be7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:15.842645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-786d7f02-a526-4271-b9ab-ad4bf29454f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:15.864781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9dbec-1673-4a4f-a3bf-26e75771b4e5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:15.943436 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2625/5254] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:15.944400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d7f02-a526-4271-b9ab-ad4bf29454f0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:15.945885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-786d7f02-a526-4271-b9ab-ad4bf29454f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:15.971619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:15.972815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:15.973207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:15.973598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/domains/04cb6b497cd040129e82796383918855` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:15.975510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=04cb6b497cd040129e82796383918855)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:15.977238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:16.015177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:16.035257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '04cb6b497cd040129e82796383918855'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.036785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '04cb6b497cd040129e82796383918855'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.063517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d7f02-a526-4271-b9ab-ad4bf29454f0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:16.099535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '04cb6b497cd040129e82796383918855'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.100093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '04cb6b497cd040129e82796383918855'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.106876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2630/5255] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:48:15 2022] PATCH /identity/v3/domains/04cb6b497cd040129e82796383918855 => generated 278 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:48:16.107881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:16.109418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:16.200146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:16.203046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:16.206594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:16.206954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:16.207341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] PATH_INFO: `/v3/projects/cdd3c10f4ce04e8cbdfb1853f6468bcf` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:16.212635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eac8f-4ed6-4274-8176-6453567a0bb5 tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:16.213424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd3c10f4ce04e8cbdfb1853f6468bcf)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:16.219460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:16.222457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97cf64-5779-4f73-89fc-44de45c67586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:16.223920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97cf64-5779-4f73-89fc-44de45c67586 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:16.224406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97cf64-5779-4f73-89fc-44de45c67586 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:16.225173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97cf64-5779-4f73-89fc-44de45c67586 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:16.228212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97cf64-5779-4f73-89fc-44de45c67586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:16.231744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97cf64-5779-4f73-89fc-44de45c67586 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:16.281172 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2631/5256] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:16 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:16.283742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97cf64-5779-4f73-89fc-44de45c67586 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:16.287942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9e97cf64-5779-4f73-89fc-44de45c67586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:16.338853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd3c10f4ce04e8cbdfb1853f6468bcf', 'request_id': 'req-8addd1af-9ae1-403d-af5d-28f1002fb507'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.359996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd3c10f4ce04e8cbdfb1853f6468bcf', 'request_id': 'req-8addd1af-9ae1-403d-af5d-28f1002fb507'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.372942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd3c10f4ce04e8cbdfb1853f6468bcf', 'request_id': 'req-8addd1af-9ae1-403d-af5d-28f1002fb507'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.391923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] The token cache is being invalidate because project cdd3c10f4ce04e8cbdfb1853f6468bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:16.392383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.394117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.396531 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2626/5257] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:15 2022] DELETE /identity/v3/projects/cdd3c10f4ce04e8cbdfb1853f6468bcf => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:16.401739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:16.403292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:16.480824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97cf64-5779-4f73-89fc-44de45c67586 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:16.497769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd1af-9ae1-403d-af5d-28f1002fb507 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:16.514188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce910e-26ef-478f-9774-780b429f4556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:16.514834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce910e-26ef-478f-9774-780b429f4556 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:16.515896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce910e-26ef-478f-9774-780b429f4556 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:16.516194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce910e-26ef-478f-9774-780b429f4556 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:16.517453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce910e-26ef-478f-9774-780b429f4556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:16.521324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce910e-26ef-478f-9774-780b429f4556 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:16.558270 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2627/5258] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:16 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:16.559787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01616e-1f56-407c-ac37-fd7c65c27585 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:16.560171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01616e-1f56-407c-ac37-fd7c65c27585 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:16.560521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01616e-1f56-407c-ac37-fd7c65c27585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:16.576003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffee879ef7b341d3940bda388dfaac9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c58a244acf240d4a9e77b3617a35c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:16.577652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:16.578939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:16.579395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] PATH_INFO: `/v3/domains/04cb6b497cd040129e82796383918855` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:16.581703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:16.595376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=04cb6b497cd040129e82796383918855)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:16.595600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ae01616e-1f56-407c-ac37-fd7c65c27585 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:16.596719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ae01616e-1f56-407c-ac37-fd7c65c27585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:16.597847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:16.618076 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2628/5259] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:16.619208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01616e-1f56-407c-ac37-fd7c65c27585 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:16.636110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01616e-1f56-407c-ac37-fd7c65c27585 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:16.641753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6547ba-4e66-4bee-bb6a-2d054d2e91be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:16.642388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6547ba-4e66-4bee-bb6a-2d054d2e91be admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:16.643225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6547ba-4e66-4bee-bb6a-2d054d2e91be admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:16.643225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6547ba-4e66-4bee-bb6a-2d054d2e91be admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:16.643579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6547ba-4e66-4bee-bb6a-2d054d2e91be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:16.646331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6547ba-4e66-4bee-bb6a-2d054d2e91be admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:16.646497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '04cb6b497cd040129e82796383918855'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.667724 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2629/5260] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:16.667724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2010be2-542a-41c7-b040-1b4120d2afff None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:16.667724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2010be2-542a-41c7-b040-1b4120d2afff None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:16.667724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2010be2-542a-41c7-b040-1b4120d2afff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:16.671851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '04cb6b497cd040129e82796383918855'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.706340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c2010be2-542a-41c7-b040-1b4120d2afff None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:16.708655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c2010be2-542a-41c7-b040-1b4120d2afff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:16.720170 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2630/5261] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:16.721151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2010be2-542a-41c7-b040-1b4120d2afff None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:16.737662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2010be2-542a-41c7-b040-1b4120d2afff None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:16.747093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944271f-7d39-49a1-8120-79851cf9a7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:16.748128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944271f-7d39-49a1-8120-79851cf9a7fd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:16.748549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944271f-7d39-49a1-8120-79851cf9a7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:16.748935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944271f-7d39-49a1-8120-79851cf9a7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:16.749661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944271f-7d39-49a1-8120-79851cf9a7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:16.752048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944271f-7d39-49a1-8120-79851cf9a7fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:16.777465 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2631/5262] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:16.777465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944271f-7d39-49a1-8120-79851cf9a7fd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:16.794918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944271f-7d39-49a1-8120-79851cf9a7fd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:16.809442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04cb6b497cd040129e82796383918855', 'request_id': 'req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.836327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04cb6b497cd040129e82796383918855', 'request_id': 'req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.847289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:16.856222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04cb6b497cd040129e82796383918855', 'request_id': 'req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.878695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] The token cache is being invalidate because project 04cb6b497cd040129e82796383918855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:16.878997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.883713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.909087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '04cb6b497cd040129e82796383918855', 'request_id': 'req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.912604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '04cb6b497cd040129e82796383918855', 'request_id': 'req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.918270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '04cb6b497cd040129e82796383918855', 'request_id': 'req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:16.936470 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2632/5263] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:48:16 2022] DELETE /identity/v3/domains/04cb6b497cd040129e82796383918855 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:16.938497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:16.946416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:17.002909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa008c9-38b8-4494-9354-bce7500db5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.003602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa008c9-38b8-4494-9354-bce7500db5ed admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.003894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa008c9-38b8-4494-9354-bce7500db5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.004173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa008c9-38b8-4494-9354-bce7500db5ed admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.004981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa008c9-38b8-4494-9354-bce7500db5ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:17.005275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa008c9-38b8-4494-9354-bce7500db5ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.006966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa008c9-38b8-4494-9354-bce7500db5ed admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.041344 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2632/5264] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:17.042449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa008c9-38b8-4494-9354-bce7500db5ed admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.049710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dfa008c9-38b8-4494-9354-bce7500db5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:17.069335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa008c9-38b8-4494-9354-bce7500db5ed admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.078994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7281adf-bf18-41fe-a9f7-d8f19fea31cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.079674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7281adf-bf18-41fe-a9f7-d8f19fea31cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.079956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7281adf-bf18-41fe-a9f7-d8f19fea31cd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.080236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7281adf-bf18-41fe-a9f7-d8f19fea31cd admin admin] PATH_INFO: `/v3/users/951b888293b5438593cecec25a5aa4d4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.082422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7281adf-bf18-41fe-a9f7-d8f19fea31cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=951b888293b5438593cecec25a5aa4d4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.088652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7281adf-bf18-41fe-a9f7-d8f19fea31cd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.113125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec1eaa-9258-4515-8bb3-9d6291217d5b tempest-GroupsV3TestJSON-1810063935 tempest-GroupsV3TestJSON-1810063935-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.127240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807c431-be14-4a28-9fa6-b8caf6dbf81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.128365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807c431-be14-4a28-9fa6-b8caf6dbf81a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.130323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807c431-be14-4a28-9fa6-b8caf6dbf81a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.131896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807c431-be14-4a28-9fa6-b8caf6dbf81a admin admin] PATH_INFO: `/v3/projects/df4c18843e0b48c6bf3eeae0d0307b89/users/5dbdf6ded2ec485e9fe21cf5e6527aa1/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.178497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807c431-be14-4a28-9fa6-b8caf6dbf81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4c18843e0b48c6bf3eeae0d0307b89, user_id=5dbdf6ded2ec485e9fe21cf5e6527aa1, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.181871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807c431-be14-4a28-9fa6-b8caf6dbf81a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.207547 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2633/5265] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:16 2022] PUT /identity/v3/projects/df4c18843e0b48c6bf3eeae0d0307b89/users/5dbdf6ded2ec485e9fe21cf5e6527aa1/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:17.211750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807c431-be14-4a28-9fa6-b8caf6dbf81a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.214384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c807c431-be14-4a28-9fa6-b8caf6dbf81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:17.233807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c7281adf-bf18-41fe-a9f7-d8f19fea31cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951b888293b5438593cecec25a5aa4d4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:17.235396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c7281adf-bf18-41fe-a9f7-d8f19fea31cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951b888293b5438593cecec25a5aa4d4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:17.263129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c7281adf-bf18-41fe-a9f7-d8f19fea31cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951b888293b5438593cecec25a5aa4d4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:17.285058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c7281adf-bf18-41fe-a9f7-d8f19fea31cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951b888293b5438593cecec25a5aa4d4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:17.308411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c7281adf-bf18-41fe-a9f7-d8f19fea31cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951b888293b5438593cecec25a5aa4d4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:17.336923 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2633/5266] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:17 2022] DELETE /identity/v3/users/951b888293b5438593cecec25a5aa4d4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:17.339017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3379ca-89a1-4561-ac14-ed9e66c93587 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.339914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3379ca-89a1-4561-ac14-ed9e66c93587 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.340483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3379ca-89a1-4561-ac14-ed9e66c93587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.379627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807c431-be14-4a28-9fa6-b8caf6dbf81a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.386468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0f3379ca-89a1-4561-ac14-ed9e66c93587 None None] MFA Rules not processed for user `5dbdf6ded2ec485e9fe21cf5e6527aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:17.388865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0f3379ca-89a1-4561-ac14-ed9e66c93587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:17.433175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:17.474046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:17.492656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34f722-ea5a-4885-b626-be748769ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.493733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f722-ea5a-4885-b626-be748769ff6e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.494193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f722-ea5a-4885-b626-be748769ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.494630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f722-ea5a-4885-b626-be748769ff6e admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.495476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34f722-ea5a-4885-b626-be748769ff6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.496938 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2634/5267] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:17.498625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34f722-ea5a-4885-b626-be748769ff6e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.513045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaff47-d3c5-46eb-9240-b5ba162ed9c3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.513534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaff47-d3c5-46eb-9240-b5ba162ed9c3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.513787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaff47-d3c5-46eb-9240-b5ba162ed9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.537162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7dfaff47-d3c5-46eb-9240-b5ba162ed9c3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:17.539594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7dfaff47-d3c5-46eb-9240-b5ba162ed9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:17.548283 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2634/5268] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:17 2022] POST /identity/v3/projects => generated 391 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:17.548283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34f722-ea5a-4885-b626-be748769ff6e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.548583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc34f722-ea5a-4885-b626-be748769ff6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:17.555970 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2635/5269] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:17.557259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaff47-d3c5-46eb-9240-b5ba162ed9c3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.565484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7dfaff47-d3c5-46eb-9240-b5ba162ed9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:17.581441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaff47-d3c5-46eb-9240-b5ba162ed9c3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.624787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34f722-ea5a-4885-b626-be748769ff6e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.630075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e0845-3b8a-4f9d-92c1-05095e0e3059 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.630934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0845-3b8a-4f9d-92c1-05095e0e3059 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.632496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0845-3b8a-4f9d-92c1-05095e0e3059 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.633497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0845-3b8a-4f9d-92c1-05095e0e3059 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.634916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-369e0845-3b8a-4f9d-92c1-05095e0e3059 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:17.674558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f115794-8ba9-4349-8af2-2e97b61d154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.675521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115794-8ba9-4349-8af2-2e97b61d154a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.675798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115794-8ba9-4349-8af2-2e97b61d154a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.676207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115794-8ba9-4349-8af2-2e97b61d154a admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.677576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f115794-8ba9-4349-8af2-2e97b61d154a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.681085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f115794-8ba9-4349-8af2-2e97b61d154a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.720659 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2636/5270] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:17 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:17.721716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f115794-8ba9-4349-8af2-2e97b61d154a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.724225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9f115794-8ba9-4349-8af2-2e97b61d154a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:17.739809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e0845-3b8a-4f9d-92c1-05095e0e3059 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.741987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e0845-3b8a-4f9d-92c1-05095e0e3059 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.755632 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2635/5271] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:17.756673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e0845-3b8a-4f9d-92c1-05095e0e3059 service glance] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.772250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e0845-3b8a-4f9d-92c1-05095e0e3059 service glance] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.779068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312976-ad40-423e-9c73-34aea5be3ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.779844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312976-ad40-423e-9c73-34aea5be3ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.780205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312976-ad40-423e-9c73-34aea5be3ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.781439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312976-ad40-423e-9c73-34aea5be3ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.782251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312976-ad40-423e-9c73-34aea5be3ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.783993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312976-ad40-423e-9c73-34aea5be3ff0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.804316 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2636/5272] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:17.808519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312976-ad40-423e-9c73-34aea5be3ff0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.830127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312976-ad40-423e-9c73-34aea5be3ff0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.830976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f115794-8ba9-4349-8af2-2e97b61d154a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.839661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3173a8-3065-4c51-8d6f-e2f122e9de1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.840327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3173a8-3065-4c51-8d6f-e2f122e9de1f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.840610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3173a8-3065-4c51-8d6f-e2f122e9de1f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.840891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3173a8-3065-4c51-8d6f-e2f122e9de1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.842532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addefa31-1390-4bbd-bcb3-7bd6e60e7382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.843429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addefa31-1390-4bbd-bcb3-7bd6e60e7382 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.843907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addefa31-1390-4bbd-bcb3-7bd6e60e7382 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.844241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addefa31-1390-4bbd-bcb3-7bd6e60e7382 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.844925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addefa31-1390-4bbd-bcb3-7bd6e60e7382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.853700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3173a8-3065-4c51-8d6f-e2f122e9de1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.855933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3173a8-3065-4c51-8d6f-e2f122e9de1f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.858861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addefa31-1390-4bbd-bcb3-7bd6e60e7382 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.891363 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2637/5273] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:17.907604 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2637/5274] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:17.907817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3173a8-3065-4c51-8d6f-e2f122e9de1f service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:17.926009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3173a8-3065-4c51-8d6f-e2f122e9de1f service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:17.940905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0b7bf-7d5a-4980-aedc-e3f1c8396bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:17.941755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0b7bf-7d5a-4980-aedc-e3f1c8396bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:17.942804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0b7bf-7d5a-4980-aedc-e3f1c8396bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:17.943158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0b7bf-7d5a-4980-aedc-e3f1c8396bdb admin admin] PATH_INFO: `/v3/projects/bc579d37e4b04bb1b8516a69a9aa60cb/users/517db0264ff84e848ed9c50cdda19a73/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:17.968486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0b7bf-7d5a-4980-aedc-e3f1c8396bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc579d37e4b04bb1b8516a69a9aa60cb, user_id=517db0264ff84e848ed9c50cdda19a73, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:17.974017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0b7bf-7d5a-4980-aedc-e3f1c8396bdb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:17.997879 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2638/5275] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:17 2022] PUT /identity/v3/projects/bc579d37e4b04bb1b8516a69a9aa60cb/users/517db0264ff84e848ed9c50cdda19a73/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:18.005796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5b3eb-e66f-4878-8af6-04126958eeeb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:18.006080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5b3eb-e66f-4878-8af6-04126958eeeb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:18.006368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5b3eb-e66f-4878-8af6-04126958eeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:18.059428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b38ff-3f2b-4c75-b530-2874f88f1b12 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:18.060008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b38ff-3f2b-4c75-b530-2874f88f1b12 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:18.060299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b38ff-3f2b-4c75-b530-2874f88f1b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:18.087430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b1c5b3eb-e66f-4878-8af6-04126958eeeb None None] MFA Rules not processed for user `517db0264ff84e848ed9c50cdda19a73`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:18.088775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b1c5b3eb-e66f-4878-8af6-04126958eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:18.097622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5c8b38ff-3f2b-4c75-b530-2874f88f1b12 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:18.103226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5c8b38ff-3f2b-4c75-b530-2874f88f1b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:18.189831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:18.276738 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2638/5276] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:18.286731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5b3eb-e66f-4878-8af6-04126958eeeb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:18.300391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:18.309053 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2639/5277] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:18.370276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b38ff-3f2b-4c75-b530-2874f88f1b12 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:18.372356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5c8b38ff-3f2b-4c75-b530-2874f88f1b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:18.452220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5b3eb-e66f-4878-8af6-04126958eeeb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:18.470857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909b73b-a6ce-4e68-a34b-0b9f54feb4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:18.472444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909b73b-a6ce-4e68-a34b-0b9f54feb4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:18.472444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909b73b-a6ce-4e68-a34b-0b9f54feb4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:18.472444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909b73b-a6ce-4e68-a34b-0b9f54feb4c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:18.472946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909b73b-a6ce-4e68-a34b-0b9f54feb4c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:18.475609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909b73b-a6ce-4e68-a34b-0b9f54feb4c0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:18.549960 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2639/5278] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:18 2022] POST /identity/v3/projects => generated 393 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:18.553739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909b73b-a6ce-4e68-a34b-0b9f54feb4c0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:18.630516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b38ff-3f2b-4c75-b530-2874f88f1b12 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:18.753237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909b73b-a6ce-4e68-a34b-0b9f54feb4c0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:18.768421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d92d-6576-44e8-962f-9c332089d075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:18.769332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d92d-6576-44e8-962f-9c332089d075 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:18.769730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d92d-6576-44e8-962f-9c332089d075 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:18.770095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d92d-6576-44e8-962f-9c332089d075 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:18.772867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764d92d-6576-44e8-962f-9c332089d075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:18.776823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764d92d-6576-44e8-962f-9c332089d075 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:18.833693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fa8ef-4e78-4633-a55a-f38fb7c5fe5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:18.834440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa8ef-4e78-4633-a55a-f38fb7c5fe5d service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:18.834646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa8ef-4e78-4633-a55a-f38fb7c5fe5d service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:18.834875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa8ef-4e78-4633-a55a-f38fb7c5fe5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:18.846789 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2640/5279] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:18 2022] POST /identity/v3/users => generated 303 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:18.849375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d92d-6576-44e8-962f-9c332089d075 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:18.870644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d92d-6576-44e8-962f-9c332089d075 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:18.876786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af7f6a-22dc-452d-8125-0fbb3bfa3d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:18.877540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af7f6a-22dc-452d-8125-0fbb3bfa3d07 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:18.877828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af7f6a-22dc-452d-8125-0fbb3bfa3d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:18.879315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af7f6a-22dc-452d-8125-0fbb3bfa3d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:18.880030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af7f6a-22dc-452d-8125-0fbb3bfa3d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:18.882593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af7f6a-22dc-452d-8125-0fbb3bfa3d07 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:18.904340 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2641/5280] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:18.913511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af7f6a-22dc-452d-8125-0fbb3bfa3d07 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:18.943020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af7f6a-22dc-452d-8125-0fbb3bfa3d07 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:18.949700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e56ee-775e-4da3-aa2f-a58520fd2c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:18.951401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e56ee-775e-4da3-aa2f-a58520fd2c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:18.951401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e56ee-775e-4da3-aa2f-a58520fd2c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:18.951401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e56ee-775e-4da3-aa2f-a58520fd2c80 admin admin] PATH_INFO: `/v3/projects/8b4de58c75b342f18b58dda3c6359ed1/users/99758effd8124854a18fba01fd94d55d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:18.974836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e56ee-775e-4da3-aa2f-a58520fd2c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4de58c75b342f18b58dda3c6359ed1, user_id=99758effd8124854a18fba01fd94d55d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:18.978202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e56ee-775e-4da3-aa2f-a58520fd2c80 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:18.987977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fa8ef-4e78-4633-a55a-f38fb7c5fe5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:18.990254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fa8ef-4e78-4633-a55a-f38fb7c5fe5d service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:18.997949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:19.001961 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2642/5281] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:18 2022] PUT /identity/v3/projects/8b4de58c75b342f18b58dda3c6359ed1/users/99758effd8124854a18fba01fd94d55d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:19.007057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e56ee-775e-4da3-aa2f-a58520fd2c80 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:19.018184 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2640/5282] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:48:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:19.101109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:19.141203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e56ee-775e-4da3-aa2f-a58520fd2c80 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:19.156277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469b41-89b9-4019-99c9-73195f4f1fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:19.157016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469b41-89b9-4019-99c9-73195f4f1fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:19.157297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469b41-89b9-4019-99c9-73195f4f1fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:19.157604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4469b41-89b9-4019-99c9-73195f4f1fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:19.159153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4469b41-89b9-4019-99c9-73195f4f1fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:19.163728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4469b41-89b9-4019-99c9-73195f4f1fc4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:19.190694 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2643/5283] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:48:19.194625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fa8ef-4e78-4633-a55a-f38fb7c5fe5d service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:19.209825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fa8ef-4e78-4633-a55a-f38fb7c5fe5d service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:19.215775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abf629-1735-4939-8cca-e412198a794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:19.217069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf629-1735-4939-8cca-e412198a794b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:19.218148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf629-1735-4939-8cca-e412198a794b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:19.219470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf629-1735-4939-8cca-e412198a794b admin admin] PATH_INFO: `/v3/projects/8b4de58c75b342f18b58dda3c6359ed1/users/99758effd8124854a18fba01fd94d55d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:19.224120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abf629-1735-4939-8cca-e412198a794b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4de58c75b342f18b58dda3c6359ed1, user_id=99758effd8124854a18fba01fd94d55d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:19.233707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abf629-1735-4939-8cca-e412198a794b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:19.248363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469b41-89b9-4019-99c9-73195f4f1fc4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:19.250449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e4469b41-89b9-4019-99c9-73195f4f1fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:19.274879 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2641/5284] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:19 2022] PUT /identity/v3/projects/8b4de58c75b342f18b58dda3c6359ed1/users/99758effd8124854a18fba01fd94d55d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:19.295897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4469b41-89b9-4019-99c9-73195f4f1fc4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:19.297250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee81e5-8d42-471f-9979-c35006ee3c76 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:19.298021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee81e5-8d42-471f-9979-c35006ee3c76 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:19.298913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee81e5-8d42-471f-9979-c35006ee3c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:19.374328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b2ee81e5-8d42-471f-9979-c35006ee3c76 None None] MFA Rules not processed for user `99758effd8124854a18fba01fd94d55d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:19.377815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b2ee81e5-8d42-471f-9979-c35006ee3c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:19.532628 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2642/5285] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:19.533631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee81e5-8d42-471f-9979-c35006ee3c76 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:19.544452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b2ee81e5-8d42-471f-9979-c35006ee3c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:19.557906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:19.558990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:19.559840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:19.560335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] PATH_INFO: `/v3/projects/8538bdcfeb0944408c41f8a8ef262e21` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:19.562410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8538bdcfeb0944408c41f8a8ef262e21)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:19.566547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:19.648538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8538bdcfeb0944408c41f8a8ef262e21', 'request_id': 'req-57087bbc-da09-4078-aecb-25b3b513945a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:19.649275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee81e5-8d42-471f-9979-c35006ee3c76 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:19.655851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8538bdcfeb0944408c41f8a8ef262e21', 'request_id': 'req-57087bbc-da09-4078-aecb-25b3b513945a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:19.671951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8538bdcfeb0944408c41f8a8ef262e21', 'request_id': 'req-57087bbc-da09-4078-aecb-25b3b513945a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:19.686810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] The token cache is being invalidate because project 8538bdcfeb0944408c41f8a8ef262e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:19.687108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:19.687785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:19.691590 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2644/5286] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:19 2022] DELETE /identity/v3/projects/8538bdcfeb0944408c41f8a8ef262e21 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:19.692886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:19.694351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:19.735516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a0972-eada-496a-a43b-5207dd305e11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:19.736947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a0972-eada-496a-a43b-5207dd305e11 service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:19.738035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a0972-eada-496a-a43b-5207dd305e11 service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:19.738516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a0972-eada-496a-a43b-5207dd305e11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:19.741573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-325a0972-eada-496a-a43b-5207dd305e11 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:19.799686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:19.803826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57087bbc-da09-4078-aecb-25b3b513945a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:19.814687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca616b06-8d32-487d-978b-b26c97369ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:19.815319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca616b06-8d32-487d-978b-b26c97369ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:19.815601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca616b06-8d32-487d-978b-b26c97369ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:19.815876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca616b06-8d32-487d-978b-b26c97369ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:19.821681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ca616b06-8d32-487d-978b-b26c97369ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:19.841664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a0972-eada-496a-a43b-5207dd305e11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:19.847636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a0972-eada-496a-a43b-5207dd305e11 service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:19.881654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:19.914154 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2643/5287] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:19.917272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a0972-eada-496a-a43b-5207dd305e11 service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:19.927215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-325a0972-eada-496a-a43b-5207dd305e11 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:19.986324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca616b06-8d32-487d-978b-b26c97369ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:19.987784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca616b06-8d32-487d-978b-b26c97369ab7 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:20.015222 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2645/5288] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:20.075660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db1297-8c20-47b3-b20c-6a1cb0f0ca57 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:20.075988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db1297-8c20-47b3-b20c-6a1cb0f0ca57 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:20.076236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db1297-8c20-47b3-b20c-6a1cb0f0ca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:20.103550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-48db1297-8c20-47b3-b20c-6a1cb0f0ca57 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:20.106709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-48db1297-8c20-47b3-b20c-6a1cb0f0ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:20.144213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a0972-eada-496a-a43b-5207dd305e11 service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:20.150593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:20.151421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:20.151806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:20.152187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] PATH_INFO: `/v3/users/ffee879ef7b341d3940bda388dfaac9c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:20.153730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffee879ef7b341d3940bda388dfaac9c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:20.156211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:20.201234 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2646/5289] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:20.221338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db1297-8c20-47b3-b20c-6a1cb0f0ca57 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:20.224630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-48db1297-8c20-47b3-b20c-6a1cb0f0ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:20.251104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffee879ef7b341d3940bda388dfaac9c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:20.252349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffee879ef7b341d3940bda388dfaac9c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:20.282182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffee879ef7b341d3940bda388dfaac9c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:20.300252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffee879ef7b341d3940bda388dfaac9c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:20.315406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffee879ef7b341d3940bda388dfaac9c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:20.326610 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2644/5290] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:19 2022] DELETE /identity/v3/users/ffee879ef7b341d3940bda388dfaac9c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:20.389959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db1297-8c20-47b3-b20c-6a1cb0f0ca57 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:20.532547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cac3b0-a365-46a4-9255-6dcc0613c25f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:20.540185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac3b0-a365-46a4-9255-6dcc0613c25f service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:20.545277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac3b0-a365-46a4-9255-6dcc0613c25f service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:20.546070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac3b0-a365-46a4-9255-6dcc0613c25f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:20.549968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-84cac3b0-a365-46a4-9255-6dcc0613c25f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:20.562496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:20.661163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cac3b0-a365-46a4-9255-6dcc0613c25f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:20.664124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cac3b0-a365-46a4-9255-6dcc0613c25f service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:20.674510 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2647/5291] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:48:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:20.840909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:20.843324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:20.946251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881496e-c3c7-4897-9f69-d12bbebb0c89 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:20.953127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:20.954209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:20.954708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:20.955201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] PATH_INFO: `/v3/users/7029ffda9cf14bd683c021beef9be7fd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:20.956937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=7029ffda9cf14bd683c021beef9be7fd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:20.960407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:20.968025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:21.068841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7029ffda9cf14bd683c021beef9be7fd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:21.069661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7029ffda9cf14bd683c021beef9be7fd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:21.090420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7029ffda9cf14bd683c021beef9be7fd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:21.135271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7029ffda9cf14bd683c021beef9be7fd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:21.160363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7029ffda9cf14bd683c021beef9be7fd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:21.190780 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2645/5292] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:20 2022] DELETE /identity/v3/users/7029ffda9cf14bd683c021beef9be7fd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:21.196091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24c00-aec2-4c52-8c64-86ab78f0f3d3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:21.196626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24c00-aec2-4c52-8c64-86ab78f0f3d3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:21.196732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24c00-aec2-4c52-8c64-86ab78f0f3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:21.232449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bda24c00-aec2-4c52-8c64-86ab78f0f3d3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:21.240493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:21.240493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:21.243612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bda24c00-aec2-4c52-8c64-86ab78f0f3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:21.391182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b3522-2990-4302-9157-9eaaadae28ac admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:21.405733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:21.409492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:21.412606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:21.413423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] PATH_INFO: `/v3/projects/3c58a244acf240d4a9e77b3617a35c7a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:21.416868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c58a244acf240d4a9e77b3617a35c7a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:21.421824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:21.423038 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2648/5293] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:21.455782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda24c00-aec2-4c52-8c64-86ab78f0f3d3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:21.457112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bda24c00-aec2-4c52-8c64-86ab78f0f3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:21.564248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c58a244acf240d4a9e77b3617a35c7a', 'request_id': 'req-454c923d-cb1f-4bbc-a891-ba38da716ecd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:21.575730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c58a244acf240d4a9e77b3617a35c7a', 'request_id': 'req-454c923d-cb1f-4bbc-a891-ba38da716ecd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:21.593664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c58a244acf240d4a9e77b3617a35c7a', 'request_id': 'req-454c923d-cb1f-4bbc-a891-ba38da716ecd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:21.617557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] The token cache is being invalidate because project 3c58a244acf240d4a9e77b3617a35c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:21.617845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:21.619373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda24c00-aec2-4c52-8c64-86ab78f0f3d3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:21.619968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-454c923d-cb1f-4bbc-a891-ba38da716ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:21.623791 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2646/5294] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:21 2022] DELETE /identity/v3/projects/3c58a244acf240d4a9e77b3617a35c7a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:21.629955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70ebc-6d89-4571-8ef5-aa32d4fc63dc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:21.630991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70ebc-6d89-4571-8ef5-aa32d4fc63dc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:21.631340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70ebc-6d89-4571-8ef5-aa32d4fc63dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:21.696243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4ab70ebc-6d89-4571-8ef5-aa32d4fc63dc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:21.699911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4ab70ebc-6d89-4571-8ef5-aa32d4fc63dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:21.710563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:21.731754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d79c30-b415-4bda-a5bb-1db9b3450e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:21.732400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d79c30-b415-4bda-a5bb-1db9b3450e8c service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:21.732685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d79c30-b415-4bda-a5bb-1db9b3450e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:21.732967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d79c30-b415-4bda-a5bb-1db9b3450e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:21.748660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a2d79c30-b415-4bda-a5bb-1db9b3450e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:21.801293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:21.871302 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2647/5295] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:21.873611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33959c-eff1-4d4d-9bec-593aaa90780b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:21.876953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33959c-eff1-4d4d-9bec-593aaa90780b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:21.877706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33959c-eff1-4d4d-9bec-593aaa90780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:21.906216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d79c30-b415-4bda-a5bb-1db9b3450e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:21.919607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d79c30-b415-4bda-a5bb-1db9b3450e8c service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:21.926353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7b33959c-eff1-4d4d-9bec-593aaa90780b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:21.927787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7b33959c-eff1-4d4d-9bec-593aaa90780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:21.932264 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2649/5296] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:48:21.953676 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2648/5297] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:21.958616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d79c30-b415-4bda-a5bb-1db9b3450e8c service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:21.976092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d79c30-b415-4bda-a5bb-1db9b3450e8c service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:21.984558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130da988-927e-4b28-aa02-91c4de135685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:21.985418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da988-927e-4b28-aa02-91c4de135685 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:21.985785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da988-927e-4b28-aa02-91c4de135685 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:21.986088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da988-927e-4b28-aa02-91c4de135685 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:21.986803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130da988-927e-4b28-aa02-91c4de135685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:21.988055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130da988-927e-4b28-aa02-91c4de135685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:21.990025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130da988-927e-4b28-aa02-91c4de135685 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:22.018857 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2650/5298] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:22.020326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33959c-eff1-4d4d-9bec-593aaa90780b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:22.055210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33959c-eff1-4d4d-9bec-593aaa90780b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:22.065738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c896fcb-bb28-4caa-a392-7e0de8211a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:22.066356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c896fcb-bb28-4caa-a392-7e0de8211a5f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:22.068391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c896fcb-bb28-4caa-a392-7e0de8211a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:22.068941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c896fcb-bb28-4caa-a392-7e0de8211a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:22.070315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c896fcb-bb28-4caa-a392-7e0de8211a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:22.081728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c896fcb-bb28-4caa-a392-7e0de8211a5f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:22.169756 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2649/5299] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:22 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:22.175232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130da988-927e-4b28-aa02-91c4de135685 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:22.191505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130da988-927e-4b28-aa02-91c4de135685 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:22.290117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01544c-686b-455a-bfa3-fa34dace3bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:22.292334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01544c-686b-455a-bfa3-fa34dace3bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:22.295240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01544c-686b-455a-bfa3-fa34dace3bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:22.295653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01544c-686b-455a-bfa3-fa34dace3bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:22.297333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01544c-686b-455a-bfa3-fa34dace3bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:22.302551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01544c-686b-455a-bfa3-fa34dace3bc1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:22.358894 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2651/5300] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:22 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:48:22.363089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c896fcb-bb28-4caa-a392-7e0de8211a5f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:22.381467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c896fcb-bb28-4caa-a392-7e0de8211a5f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:22.393111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd675bb-74c0-4d4b-850f-a82654ca1529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:22.394775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd675bb-74c0-4d4b-850f-a82654ca1529 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:22.395763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd675bb-74c0-4d4b-850f-a82654ca1529 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:22.396231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd675bb-74c0-4d4b-850f-a82654ca1529 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:22.397520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd675bb-74c0-4d4b-850f-a82654ca1529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:22.401093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd675bb-74c0-4d4b-850f-a82654ca1529 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:22.423645 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2650/5301] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:22.428705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01544c-686b-455a-bfa3-fa34dace3bc1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:22.443083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01544c-686b-455a-bfa3-fa34dace3bc1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:22.448665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9199b-7e91-4b8a-9374-306f10ad17af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:22.449551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9199b-7e91-4b8a-9374-306f10ad17af admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:22.449844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9199b-7e91-4b8a-9374-306f10ad17af admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:22.450121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9199b-7e91-4b8a-9374-306f10ad17af admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:22.450770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9199b-7e91-4b8a-9374-306f10ad17af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:22.452609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9199b-7e91-4b8a-9374-306f10ad17af admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:22.466187 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2652/5302] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:22.473122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd675bb-74c0-4d4b-850f-a82654ca1529 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:22.494293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd675bb-74c0-4d4b-850f-a82654ca1529 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:22.516874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e48dad-9c87-4841-a9ec-0bd1b2880b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:22.518091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e48dad-9c87-4841-a9ec-0bd1b2880b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:22.518569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e48dad-9c87-4841-a9ec-0bd1b2880b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:22.519088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e48dad-9c87-4841-a9ec-0bd1b2880b99 admin admin] PATH_INFO: `/v3/projects/7d667a2a076e426d8a9319548597ce2a/users/3a0cbdf852814c5a87a99871e8aaf5f8/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:22.563468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e48dad-9c87-4841-a9ec-0bd1b2880b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d667a2a076e426d8a9319548597ce2a, user_id=3a0cbdf852814c5a87a99871e8aaf5f8, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:22.566427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e48dad-9c87-4841-a9ec-0bd1b2880b99 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:22.603934 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2651/5303] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:22 2022] PUT /identity/v3/projects/7d667a2a076e426d8a9319548597ce2a/users/3a0cbdf852814c5a87a99871e8aaf5f8/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:22.621725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346127f-6882-49d3-832e-97e8c851d6c1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:22.622664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346127f-6882-49d3-832e-97e8c851d6c1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:22.623017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346127f-6882-49d3-832e-97e8c851d6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:22.664675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7346127f-6882-49d3-832e-97e8c851d6c1 None None] MFA Rules not processed for user `3a0cbdf852814c5a87a99871e8aaf5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:22.667463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7346127f-6882-49d3-832e-97e8c851d6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:22.793971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e48dad-9c87-4841-a9ec-0bd1b2880b99 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:22.797291 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2653/5304] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:22.877541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e48dad-9c87-4841-a9ec-0bd1b2880b99 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:22.884574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2d359-e233-4580-baaf-58c875da621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:22.885500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2d359-e233-4580-baaf-58c875da621a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:22.885944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2d359-e233-4580-baaf-58c875da621a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:22.886377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2d359-e233-4580-baaf-58c875da621a admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:22.887302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2d359-e233-4580-baaf-58c875da621a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:22.890775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2d359-e233-4580-baaf-58c875da621a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:22.937368 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2652/5305] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:22 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:22.938891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346127f-6882-49d3-832e-97e8c851d6c1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:22.954103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346127f-6882-49d3-832e-97e8c851d6c1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:22.967463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:23.042313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2d359-e233-4580-baaf-58c875da621a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:23.044543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ebc2d359-e233-4580-baaf-58c875da621a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:23.146129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:23.171852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539bc5-983b-41ef-bc5e-1bbef430047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:23.171852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539bc5-983b-41ef-bc5e-1bbef430047b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:23.171852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539bc5-983b-41ef-bc5e-1bbef430047b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:23.171852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539bc5-983b-41ef-bc5e-1bbef430047b admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:23.172646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3539bc5-983b-41ef-bc5e-1bbef430047b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:23.174768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3539bc5-983b-41ef-bc5e-1bbef430047b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:23.191432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2d359-e233-4580-baaf-58c875da621a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:23.205043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:23.206394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:23.207158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:23.208321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] PATH_INFO: `/v3/projects/acee2daa9a5b4e0ca9e89acd237f7407` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:23.210788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=acee2daa9a5b4e0ca9e89acd237f7407)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:23.215376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:23.221438 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2654/5306] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:22 2022] POST /identity/v3/users => generated 291 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:23.227134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539bc5-983b-41ef-bc5e-1bbef430047b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:23.247963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539bc5-983b-41ef-bc5e-1bbef430047b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:23.262959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca739-ecec-4200-93df-860dfe348c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:23.263640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca739-ecec-4200-93df-860dfe348c09 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:23.264045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca739-ecec-4200-93df-860dfe348c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:23.264668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca739-ecec-4200-93df-860dfe348c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:23.265534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cca739-ecec-4200-93df-860dfe348c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:23.267481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cca739-ecec-4200-93df-860dfe348c09 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:23.297560 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2655/5307] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:23.298979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca739-ecec-4200-93df-860dfe348c09 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:23.313569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca739-ecec-4200-93df-860dfe348c09 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:23.333680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d2029-b63f-40cc-b281-eb3e43e54538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:23.335991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d2029-b63f-40cc-b281-eb3e43e54538 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:23.336705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d2029-b63f-40cc-b281-eb3e43e54538 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:23.337778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d2029-b63f-40cc-b281-eb3e43e54538 admin admin] PATH_INFO: `/v3/projects/79429880296b4fd09c71c560142f1393/users/0d5effea28ef4e5292585de39bf0d090/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:23.369869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acee2daa9a5b4e0ca9e89acd237f7407', 'request_id': 'req-8a7c82f6-395b-44a2-bb27-5bae190ef94b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:23.380985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d2029-b63f-40cc-b281-eb3e43e54538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79429880296b4fd09c71c560142f1393, user_id=0d5effea28ef4e5292585de39bf0d090, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:23.383773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acee2daa9a5b4e0ca9e89acd237f7407', 'request_id': 'req-8a7c82f6-395b-44a2-bb27-5bae190ef94b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:23.393620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d2029-b63f-40cc-b281-eb3e43e54538 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:23.394348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acee2daa9a5b4e0ca9e89acd237f7407', 'request_id': 'req-8a7c82f6-395b-44a2-bb27-5bae190ef94b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:23.416390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] The token cache is being invalidate because project acee2daa9a5b4e0ca9e89acd237f7407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:23.416698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:23.425926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:23.430834 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2653/5309] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:23 2022] DELETE /identity/v3/projects/acee2daa9a5b4e0ca9e89acd237f7407 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:23.431827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:23.433150 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2656/5309] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:23 2022] PUT /identity/v3/projects/79429880296b4fd09c71c560142f1393/users/0d5effea28ef4e5292585de39bf0d090/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:23.433353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:23.435365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d2029-b63f-40cc-b281-eb3e43e54538 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:23.438716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-475d2029-b63f-40cc-b281-eb3e43e54538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:23.565678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c82f6-395b-44a2-bb27-5bae190ef94b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:23.608918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d2029-b63f-40cc-b281-eb3e43e54538 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:23.621514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc138b-35ac-41d2-a258-61d8849ede91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:23.622198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc138b-35ac-41d2-a258-61d8849ede91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:23.622478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc138b-35ac-41d2-a258-61d8849ede91 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:23.622753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc138b-35ac-41d2-a258-61d8849ede91 admin admin] PATH_INFO: `/v3/users/5dbdf6ded2ec485e9fe21cf5e6527aa1` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:23.624586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc138b-35ac-41d2-a258-61d8849ede91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dbdf6ded2ec485e9fe21cf5e6527aa1)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:23.626583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc138b-35ac-41d2-a258-61d8849ede91 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:23.735914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af1b27-fe5c-43ad-b023-a3d6c2750ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:23.740058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af1b27-fe5c-43ad-b023-a3d6c2750ebd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:23.740354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af1b27-fe5c-43ad-b023-a3d6c2750ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:23.740628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af1b27-fe5c-43ad-b023-a3d6c2750ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:23.741299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af1b27-fe5c-43ad-b023-a3d6c2750ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:23.742968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af1b27-fe5c-43ad-b023-a3d6c2750ebd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:23.802150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bbc138b-35ac-41d2-a258-61d8849ede91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dbdf6ded2ec485e9fe21cf5e6527aa1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:23.802392 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2654/5310] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:48:23.803511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af1b27-fe5c-43ad-b023-a3d6c2750ebd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:23.804771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bbc138b-35ac-41d2-a258-61d8849ede91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dbdf6ded2ec485e9fe21cf5e6527aa1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:23.808511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c8af1b27-fe5c-43ad-b023-a3d6c2750ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:23.853700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af1b27-fe5c-43ad-b023-a3d6c2750ebd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:23.858577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bbc138b-35ac-41d2-a258-61d8849ede91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dbdf6ded2ec485e9fe21cf5e6527aa1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:23.859867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bbc138b-35ac-41d2-a258-61d8849ede91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dbdf6ded2ec485e9fe21cf5e6527aa1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:23.861895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:23.870824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab2b7e-5aa0-43d3-8e58-09f307346cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:23.871724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab2b7e-5aa0-43d3-8e58-09f307346cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:23.873519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab2b7e-5aa0-43d3-8e58-09f307346cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:23.873967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab2b7e-5aa0-43d3-8e58-09f307346cc7 admin admin] PATH_INFO: `/v3/projects/79429880296b4fd09c71c560142f1393/users/0d5effea28ef4e5292585de39bf0d090/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:23.877667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab2b7e-5aa0-43d3-8e58-09f307346cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79429880296b4fd09c71c560142f1393, user_id=0d5effea28ef4e5292585de39bf0d090, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:23.879008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bbc138b-35ac-41d2-a258-61d8849ede91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dbdf6ded2ec485e9fe21cf5e6527aa1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:23.883611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab2b7e-5aa0-43d3-8e58-09f307346cc7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:23.887178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:23.906017 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2657/5311] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:23 2022] DELETE /identity/v3/users/5dbdf6ded2ec485e9fe21cf5e6527aa1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:23.909964 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2655/5312] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:23 2022] PUT /identity/v3/projects/79429880296b4fd09c71c560142f1393/users/0d5effea28ef4e5292585de39bf0d090/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:23.923205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc740fd-ee1c-4117-8605-aa81ac62261d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:23.923491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc740fd-ee1c-4117-8605-aa81ac62261d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:23.923768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc740fd-ee1c-4117-8605-aa81ac62261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:23.999405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6fc740fd-ee1c-4117-8605-aa81ac62261d None None] MFA Rules not processed for user `0d5effea28ef4e5292585de39bf0d090`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:24.000142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6fc740fd-ee1c-4117-8605-aa81ac62261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:24.144476 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2658/5313] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:24.145924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab2b7e-5aa0-43d3-8e58-09f307346cc7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:24.309503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab2b7e-5aa0-43d3-8e58-09f307346cc7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:24.323503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea2365-14b6-4315-8260-33a969d22406 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:24.324292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea2365-14b6-4315-8260-33a969d22406 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:24.324583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea2365-14b6-4315-8260-33a969d22406 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:24.324887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea2365-14b6-4315-8260-33a969d22406 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:24.325556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea2365-14b6-4315-8260-33a969d22406 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:24.327455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea2365-14b6-4315-8260-33a969d22406 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:24.404047 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2656/5314] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:24 2022] POST /identity/v3/projects => generated 359 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:24.408315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc740fd-ee1c-4117-8605-aa81ac62261d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:24.420197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc740fd-ee1c-4117-8605-aa81ac62261d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:24.564829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b367d-4ae0-479b-92c9-7a3e6adfcaae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:24.565574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b367d-4ae0-479b-92c9-7a3e6adfcaae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:24.565924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b367d-4ae0-479b-92c9-7a3e6adfcaae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:24.566265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b367d-4ae0-479b-92c9-7a3e6adfcaae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:24.567605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b367d-4ae0-479b-92c9-7a3e6adfcaae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:24.570173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b367d-4ae0-479b-92c9-7a3e6adfcaae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:24.609601 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2659/5315] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:24 2022] POST /identity/v3/users => generated 413 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:24.611244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea2365-14b6-4315-8260-33a969d22406 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:24.623984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea2365-14b6-4315-8260-33a969d22406 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:24.638231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda02b7-f238-4f8f-87cc-d9f8c06578c4 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:24.641537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda02b7-f238-4f8f-87cc-d9f8c06578c4 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:24.642095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda02b7-f238-4f8f-87cc-d9f8c06578c4 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:24.642599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda02b7-f238-4f8f-87cc-d9f8c06578c4 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/users/f2a76bac48df4ff9bdd6b7b55f75318a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:24.673082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda02b7-f238-4f8f-87cc-d9f8c06578c4 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:get_user(user_id=f2a76bac48df4ff9bdd6b7b55f75318a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:24.676789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda02b7-f238-4f8f-87cc-d9f8c06578c4 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:24.686621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b367d-4ae0-479b-92c9-7a3e6adfcaae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:24.697017 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2657/5316] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:48:24 2022] GET /identity/v3/users/f2a76bac48df4ff9bdd6b7b55f75318a => generated 413 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:48:24.703873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b367d-4ae0-479b-92c9-7a3e6adfcaae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:24.718431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:24.720335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:24.720602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:24.720934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/users/f2a76bac48df4ff9bdd6b7b55f75318a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:24.722639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f2a76bac48df4ff9bdd6b7b55f75318a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:24.725523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:24.811122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a76bac48df4ff9bdd6b7b55f75318a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:24.812011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a76bac48df4ff9bdd6b7b55f75318a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:24.827222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:24.839091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a76bac48df4ff9bdd6b7b55f75318a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:24.840813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a76bac48df4ff9bdd6b7b55f75318a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:24.856506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a76bac48df4ff9bdd6b7b55f75318a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:24.902252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda02b7-f238-4f8f-87cc-d9f8c06578c4 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:24.903951 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2660/5317] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:24 2022] DELETE /identity/v3/users/f2a76bac48df4ff9bdd6b7b55f75318a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:24.905593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9fda02b7-f238-4f8f-87cc-d9f8c06578c4 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:24.915591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:24.922802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:24.941214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda02b7-f238-4f8f-87cc-d9f8c06578c4 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.070630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc78db-cb9d-4be6-b773-f2bccc861a0e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.096826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.097787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.098053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.099058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] PATH_INFO: `/v3/projects/df4c18843e0b48c6bf3eeae0d0307b89` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.100391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4c18843e0b48c6bf3eeae0d0307b89)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.102627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.115428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.116078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.116369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.116653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/af74780e68bd4f3da39c908faacb715e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.118129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=af74780e68bd4f3da39c908faacb715e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.120154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.214050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4c18843e0b48c6bf3eeae0d0307b89', 'request_id': 'req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.228694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4c18843e0b48c6bf3eeae0d0307b89', 'request_id': 'req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.241046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af74780e68bd4f3da39c908faacb715e', 'request_id': 'req-3d7bf362-bd53-4462-ba89-57210364938e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.243025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4c18843e0b48c6bf3eeae0d0307b89', 'request_id': 'req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.253974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af74780e68bd4f3da39c908faacb715e', 'request_id': 'req-3d7bf362-bd53-4462-ba89-57210364938e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.269169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] The token cache is being invalidate because project df4c18843e0b48c6bf3eeae0d0307b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:25.269546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.269655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af74780e68bd4f3da39c908faacb715e', 'request_id': 'req-3d7bf362-bd53-4462-ba89-57210364938e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.270207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-52de4b50-dddb-45ee-9bfb-7eb6ea28b34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.271359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:25.272168 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2661/5318] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:24 2022] DELETE /identity/v3/projects/df4c18843e0b48c6bf3eeae0d0307b89 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:25.281131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea07cc-ece6-4c62-badb-9cfc2e772c74 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.281483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea07cc-ece6-4c62-badb-9cfc2e772c74 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.281766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea07cc-ece6-4c62-badb-9cfc2e772c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.308800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project af74780e68bd4f3da39c908faacb715e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:25.311302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.314425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.319959 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2658/5319] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:24 2022] DELETE /identity/v3/projects/af74780e68bd4f3da39c908faacb715e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:25.324619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.326189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:25.330521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fdea07cc-ece6-4c62-badb-9cfc2e772c74 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:25.332073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fdea07cc-ece6-4c62-badb-9cfc2e772c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:25.412431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bf362-bd53-4462-ba89-57210364938e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.417781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f453db6-a218-48d0-a047-2caccf42b466 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.419231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f453db6-a218-48d0-a047-2caccf42b466 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.419527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f453db6-a218-48d0-a047-2caccf42b466 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.419806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f453db6-a218-48d0-a047-2caccf42b466 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.420476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f453db6-a218-48d0-a047-2caccf42b466 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.422252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f453db6-a218-48d0-a047-2caccf42b466 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.443208 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2659/5320] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:25 2022] POST /identity/v3/projects => generated 348 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:48:25.444303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f453db6-a218-48d0-a047-2caccf42b466 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.448779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3f453db6-a218-48d0-a047-2caccf42b466 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:25.481576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:25.506912 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2662/5321] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:25.508847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea07cc-ece6-4c62-badb-9cfc2e772c74 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.543353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea07cc-ece6-4c62-badb-9cfc2e772c74 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.583344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f453db6-a218-48d0-a047-2caccf42b466 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.588602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.589267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.589431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.589686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] PATH_INFO: `/v3/users/517db0264ff84e848ed9c50cdda19a73` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.591987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517db0264ff84e848ed9c50cdda19a73)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.593029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.655789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517db0264ff84e848ed9c50cdda19a73'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.656781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517db0264ff84e848ed9c50cdda19a73'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.663231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537212e-88f8-4f4b-a143-3d132e03623c tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.664341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537212e-88f8-4f4b-a143-3d132e03623c tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.664798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537212e-88f8-4f4b-a143-3d132e03623c tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.665474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537212e-88f8-4f4b-a143-3d132e03623c tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.669095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537212e-88f8-4f4b-a143-3d132e03623c tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:25.669095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537212e-88f8-4f4b-a143-3d132e03623c tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.669801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537212e-88f8-4f4b-a143-3d132e03623c tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.677261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517db0264ff84e848ed9c50cdda19a73'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.686828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517db0264ff84e848ed9c50cdda19a73'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.694232 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2663/5322] 10.222.0.16 () {58 vars in 1160 bytes} [Mon Aug 29 15:48:25 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:25.695697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a4324-74c4-4f02-a90a-e75f3f1d121b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.696136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a4324-74c4-4f02-a90a-e75f3f1d121b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.696616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a4324-74c4-4f02-a90a-e75f3f1d121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.702519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517db0264ff84e848ed9c50cdda19a73'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:25.716501 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2660/5323] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:25 2022] DELETE /identity/v3/users/517db0264ff84e848ed9c50cdda19a73 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:25.720641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a49a4324-74c4-4f02-a90a-e75f3f1d121b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:25.720784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.722074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a49a4324-74c4-4f02-a90a-e75f3f1d121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:25.722220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:25.746226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:25.822608 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2664/5324] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:25.824140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29329-34c1-401f-96f3-dc5e29383110 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.824526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29329-34c1-401f-96f3-dc5e29383110 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.824888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29329-34c1-401f-96f3-dc5e29383110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.865632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9df29329-34c1-401f-96f3-dc5e29383110 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:25.865632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9df29329-34c1-401f-96f3-dc5e29383110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:25.880029 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2665/5325] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:25.881333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df29329-34c1-401f-96f3-dc5e29383110 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.882098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07223-0f34-426c-839c-c0a40272f5c2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.896589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ff062-c4a7-4508-a5e5-b88db9e6637e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.897515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ff062-c4a7-4508-a5e5-b88db9e6637e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.897515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ff062-c4a7-4508-a5e5-b88db9e6637e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.897782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ff062-c4a7-4508-a5e5-b88db9e6637e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.900580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df29329-34c1-401f-96f3-dc5e29383110 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.901448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ff062-c4a7-4508-a5e5-b88db9e6637e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.903087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ff062-c4a7-4508-a5e5-b88db9e6637e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.918768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bf705-c7ec-49d5-b335-c1e37000f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.919593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bf705-c7ec-49d5-b335-c1e37000f945 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.919883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bf705-c7ec-49d5-b335-c1e37000f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.920156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bf705-c7ec-49d5-b335-c1e37000f945 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.920915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bf705-c7ec-49d5-b335-c1e37000f945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:25.921222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bf705-c7ec-49d5-b335-c1e37000f945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.922951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bf705-c7ec-49d5-b335-c1e37000f945 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:25.942546 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2661/5326] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Aug 29 15:48:25 2022] GET /identity/v3/domains => generated 829 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:25.943556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ff062-c4a7-4508-a5e5-b88db9e6637e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.950901 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2666/5327] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:25.950901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bf705-c7ec-49d5-b335-c1e37000f945 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:25.951401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e09ff062-c4a7-4508-a5e5-b88db9e6637e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:25.968768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bf705-c7ec-49d5-b335-c1e37000f945 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:25.980136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:25.985216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:25.985504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:25.985787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/bbaaadc7e23b448990212165cda27ccf` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:25.988679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:update_project(project_id=bbaaadc7e23b448990212165cda27ccf)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:25.990247 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:48:25.990247 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:48:25.990247 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:48:25.990956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:26.005628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.006401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.076852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.077764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.080713 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2667/5328] 10.222.0.16 () {60 vars in 1252 bytes} [Mon Aug 29 15:48:25 2022] PATCH /identity/v3/projects/bbaaadc7e23b448990212165cda27ccf => generated 362 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:26.081644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:26.084038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:26.093034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ff062-c4a7-4508-a5e5-b88db9e6637e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:26.166098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:26.194240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bff5c-0bfc-4d61-a857-87747df420f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:26.194782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bff5c-0bfc-4d61-a857-87747df420f9 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:26.195061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bff5c-0bfc-4d61-a857-87747df420f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:26.195392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bff5c-0bfc-4d61-a857-87747df420f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:26.202666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-534bff5c-0bfc-4d61-a857-87747df420f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:26.221018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a9d7f-4d2d-4d7a-86c5-4444a4121093 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:26.227730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bff5c-0bfc-4d61-a857-87747df420f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:26.229302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bff5c-0bfc-4d61-a857-87747df420f9 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:26.243569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970a4fc-a6a5-4299-bbad-938409cf5a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:26.244893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970a4fc-a6a5-4299-bbad-938409cf5a28 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:26.245458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970a4fc-a6a5-4299-bbad-938409cf5a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:26.246031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970a4fc-a6a5-4299-bbad-938409cf5a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:26.246761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970a4fc-a6a5-4299-bbad-938409cf5a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:26.249121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970a4fc-a6a5-4299-bbad-938409cf5a28 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:26.258134 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2662/5329] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:26.258818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bff5c-0bfc-4d61-a857-87747df420f9 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:26.266566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-534bff5c-0bfc-4d61-a857-87747df420f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:26.306733 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2668/5330] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:26 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:26.306733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7102b-e651-40cd-8513-603c06f2fe5c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:26.306733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7102b-e651-40cd-8513-603c06f2fe5c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:26.306733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7102b-e651-40cd-8513-603c06f2fe5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:26.374797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-23a7102b-e651-40cd-8513-603c06f2fe5c None None] MFA Rules not processed for user `a68002795ce541338b30129e6dbb0fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:26.382881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-23a7102b-e651-40cd-8513-603c06f2fe5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:26.450534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bff5c-0bfc-4d61-a857-87747df420f9 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:26.455542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:26.535253 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2669/5331] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:26.538702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7102b-e651-40cd-8513-603c06f2fe5c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:26.640901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:26.641689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:26.641974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:26.642426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/bbaaadc7e23b448990212165cda27ccf` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:26.658586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bbaaadc7e23b448990212165cda27ccf)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:26.661117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:26.737306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.755792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.764738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7102b-e651-40cd-8513-603c06f2fe5c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:26.778102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea70c9-4942-4be1-a97d-45b1bed17f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:26.778797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea70c9-4942-4be1-a97d-45b1bed17f70 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:26.779221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea70c9-4942-4be1-a97d-45b1bed17f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:26.781049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea70c9-4942-4be1-a97d-45b1bed17f70 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:26.783352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea70c9-4942-4be1-a97d-45b1bed17f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:26.785422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea70c9-4942-4be1-a97d-45b1bed17f70 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:26.842487 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2670/5332] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:26 2022] POST /identity/v3/users => generated 291 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:26.847438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea70c9-4942-4be1-a97d-45b1bed17f70 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:26.869364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf', 'request_id': 'req-d4931169-b18b-4d3b-b92e-0aea42283633'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.871751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea70c9-4942-4be1-a97d-45b1bed17f70 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:26.876670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf', 'request_id': 'req-d4931169-b18b-4d3b-b92e-0aea42283633'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.889698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf', 'request_id': 'req-d4931169-b18b-4d3b-b92e-0aea42283633'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.918928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project bbaaadc7e23b448990212165cda27ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:26.919581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.929953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.939680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf', 'request_id': 'req-d4931169-b18b-4d3b-b92e-0aea42283633'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.940644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf', 'request_id': 'req-d4931169-b18b-4d3b-b92e-0aea42283633'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.943659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d4931169-b18b-4d3b-b92e-0aea42283633 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bbaaadc7e23b448990212165cda27ccf', 'request_id': 'req-d4931169-b18b-4d3b-b92e-0aea42283633'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:26.963099 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2663/5333] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:26 2022] DELETE /identity/v3/projects/bbaaadc7e23b448990212165cda27ccf => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:26.964389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af584ac1-aa19-4881-b693-22ce9db17efd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:26.964677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af584ac1-aa19-4881-b693-22ce9db17efd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:26.964961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af584ac1-aa19-4881-b693-22ce9db17efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:26.979036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d513894-4d3a-47a2-9769-473abc544b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:26.980004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d513894-4d3a-47a2-9769-473abc544b05 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:26.980301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d513894-4d3a-47a2-9769-473abc544b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:26.980580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d513894-4d3a-47a2-9769-473abc544b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:26.981323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d513894-4d3a-47a2-9769-473abc544b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:26.983102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d513894-4d3a-47a2-9769-473abc544b05 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:26.986128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:27.001356 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2671/5334] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:27.003091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d513894-4d3a-47a2-9769-473abc544b05 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:27.005782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7d513894-4d3a-47a2-9769-473abc544b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:27.018496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-af584ac1-aa19-4881-b693-22ce9db17efd None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:27.019721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-af584ac1-aa19-4881-b693-22ce9db17efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:27.086937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d513894-4d3a-47a2-9769-473abc544b05 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:27.092744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725f399-8837-497e-a4ba-5363d9fe728b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:27.093463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725f399-8837-497e-a4ba-5363d9fe728b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:27.093759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725f399-8837-497e-a4ba-5363d9fe728b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:27.094044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725f399-8837-497e-a4ba-5363d9fe728b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:27.094690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725f399-8837-497e-a4ba-5363d9fe728b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:27.097756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725f399-8837-497e-a4ba-5363d9fe728b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:27.101059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:27.126175 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2664/5335] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:48:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:27.127149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af584ac1-aa19-4881-b693-22ce9db17efd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:27.128772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-af584ac1-aa19-4881-b693-22ce9db17efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:27.142155 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2672/5336] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:27 2022] POST /identity/v3/projects => generated 360 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:27.143417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725f399-8837-497e-a4ba-5363d9fe728b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:27.146471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1725f399-8837-497e-a4ba-5363d9fe728b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:27.158902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af584ac1-aa19-4881-b693-22ce9db17efd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:27.237320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725f399-8837-497e-a4ba-5363d9fe728b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:27.243518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fc2e6-41b8-4883-a9ba-26fd9b7eaeee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:27.244584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fc2e6-41b8-4883-a9ba-26fd9b7eaeee service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:27.244584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fc2e6-41b8-4883-a9ba-26fd9b7eaeee service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:27.244970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fc2e6-41b8-4883-a9ba-26fd9b7eaeee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:27.272943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5188ae-01b7-4474-a648-b7f5d4e0f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:27.273690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5188ae-01b7-4474-a648-b7f5d4e0f3ee admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:27.273976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5188ae-01b7-4474-a648-b7f5d4e0f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:27.274247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5188ae-01b7-4474-a648-b7f5d4e0f3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:27.277513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5188ae-01b7-4474-a648-b7f5d4e0f3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:27.277513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5188ae-01b7-4474-a648-b7f5d4e0f3ee admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:27.292075 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2665/5337] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:27.293677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5188ae-01b7-4474-a648-b7f5d4e0f3ee admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:27.312273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fc2e6-41b8-4883-a9ba-26fd9b7eaeee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:27.314065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fc2e6-41b8-4883-a9ba-26fd9b7eaeee service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:27.327932 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2673/5338] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:48:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:27.328796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fc2e6-41b8-4883-a9ba-26fd9b7eaeee service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:27.341120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fc2e6-41b8-4883-a9ba-26fd9b7eaeee service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:27.348268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0e6df-40a7-40ec-a8cb-c339956085d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:27.349043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e6df-40a7-40ec-a8cb-c339956085d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:27.350835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e6df-40a7-40ec-a8cb-c339956085d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:27.350835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e6df-40a7-40ec-a8cb-c339956085d2 admin admin] PATH_INFO: `/v3/projects/e0afa18e24b741a79ef08e7adae1fd2d/users/6a35a2ed9cd244e69edfdf22f7dc24d2/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:27.367965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0e6df-40a7-40ec-a8cb-c339956085d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0afa18e24b741a79ef08e7adae1fd2d, user_id=6a35a2ed9cd244e69edfdf22f7dc24d2, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:27.370816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0e6df-40a7-40ec-a8cb-c339956085d2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:27.386325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:27.409438 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2674/5339] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:27 2022] PUT /identity/v3/projects/e0afa18e24b741a79ef08e7adae1fd2d/users/6a35a2ed9cd244e69edfdf22f7dc24d2/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:27.409692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5188ae-01b7-4474-a648-b7f5d4e0f3ee admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:27.413342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484d6f2-6ec6-4b7f-ad5f-b54e0cc3cdfb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:27.414221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484d6f2-6ec6-4b7f-ad5f-b54e0cc3cdfb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:27.414662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484d6f2-6ec6-4b7f-ad5f-b54e0cc3cdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:27.488213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f5070-d2e9-4f3e-b960-0e3e9df0c235 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:27.489070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f5070-d2e9-4f3e-b960-0e3e9df0c235 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:27.489534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f5070-d2e9-4f3e-b960-0e3e9df0c235 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:27.489912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f5070-d2e9-4f3e-b960-0e3e9df0c235 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/6c412999de7240f78472450bb6021e3a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:27.492812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6484d6f2-6ec6-4b7f-ad5f-b54e0cc3cdfb None None] MFA Rules not processed for user `6a35a2ed9cd244e69edfdf22f7dc24d2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:27.493324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f5070-d2e9-4f3e-b960-0e3e9df0c235 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c412999de7240f78472450bb6021e3a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:27.495755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f5070-d2e9-4f3e-b960-0e3e9df0c235 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:27.496618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6484d6f2-6ec6-4b7f-ad5f-b54e0cc3cdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:27.498128 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2666/5340] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:48:27 2022] GET /identity/v3/projects/6c412999de7240f78472450bb6021e3a => generated 360 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:27.508379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f5070-d2e9-4f3e-b960-0e3e9df0c235 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:27.519033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f5070-d2e9-4f3e-b960-0e3e9df0c235 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:27.526001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:27.526784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:27.527392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:27.527770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/6c412999de7240f78472450bb6021e3a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:27.529144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6c412999de7240f78472450bb6021e3a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:27.531761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:27.608847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:27.647309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c412999de7240f78472450bb6021e3a', 'request_id': 'req-1a6d4642-6912-45f8-95e5-eedfef50b5bc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:27.658605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c412999de7240f78472450bb6021e3a', 'request_id': 'req-1a6d4642-6912-45f8-95e5-eedfef50b5bc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:27.683508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c412999de7240f78472450bb6021e3a', 'request_id': 'req-1a6d4642-6912-45f8-95e5-eedfef50b5bc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:27.707291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project 6c412999de7240f78472450bb6021e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:27.707673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:27.708345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:27.710346 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2667/5341] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:27 2022] DELETE /identity/v3/projects/6c412999de7240f78472450bb6021e3a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:27.711143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:27.712727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:27.780273 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2675/5342] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:27.781607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484d6f2-6ec6-4b7f-ad5f-b54e0cc3cdfb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:27.783645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6484d6f2-6ec6-4b7f-ad5f-b54e0cc3cdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:27.935672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d4642-6912-45f8-95e5-eedfef50b5bc tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:27.953953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350894bc-3bdd-4989-be5e-2d10e8c555b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:27.955430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350894bc-3bdd-4989-be5e-2d10e8c555b7 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:27.956439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350894bc-3bdd-4989-be5e-2d10e8c555b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:27.959566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350894bc-3bdd-4989-be5e-2d10e8c555b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:27.963824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-350894bc-3bdd-4989-be5e-2d10e8c555b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:28.007068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350894bc-3bdd-4989-be5e-2d10e8c555b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:28.008819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350894bc-3bdd-4989-be5e-2d10e8c555b7 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:28.046279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484d6f2-6ec6-4b7f-ad5f-b54e0cc3cdfb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:28.067134 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2668/5343] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:28.075516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350894bc-3bdd-4989-be5e-2d10e8c555b7 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:28.080599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-350894bc-3bdd-4989-be5e-2d10e8c555b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:28.211537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:28.212822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:28.213316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:28.213835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] PATH_INFO: `/v3/projects/bc579d37e4b04bb1b8516a69a9aa60cb` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:28.215241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc579d37e4b04bb1b8516a69a9aa60cb)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:28.218121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:28.272843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350894bc-3bdd-4989-be5e-2d10e8c555b7 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:28.291702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c82674-decc-42f0-b88b-dd133cf04b21 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:28.293239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82674-decc-42f0-b88b-dd133cf04b21 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:28.293747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82674-decc-42f0-b88b-dd133cf04b21 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:28.294208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82674-decc-42f0-b88b-dd133cf04b21 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:28.295270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c82674-decc-42f0-b88b-dd133cf04b21 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:28.307995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c82674-decc-42f0-b88b-dd133cf04b21 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:28.339422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:28.356061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc579d37e4b04bb1b8516a69a9aa60cb', 'request_id': 'req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:28.396065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc579d37e4b04bb1b8516a69a9aa60cb', 'request_id': 'req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:28.420210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc579d37e4b04bb1b8516a69a9aa60cb', 'request_id': 'req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:28.423069 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2669/5344] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:28 2022] POST /identity/v3/projects => generated 361 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:28.427601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c82674-decc-42f0-b88b-dd133cf04b21 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:28.434168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a1c82674-decc-42f0-b88b-dd133cf04b21 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:28.459160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] The token cache is being invalidate because project bc579d37e4b04bb1b8516a69a9aa60cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:28.463104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:28.470099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:28.472561 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2676/5345] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:27 2022] DELETE /identity/v3/projects/bc579d37e4b04bb1b8516a69a9aa60cb => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:28.475321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:28.480851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:28.667176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:28.668928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ad3c9-4b55-471a-90f5-b001e358d1d1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:28.701182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c82674-decc-42f0-b88b-dd133cf04b21 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:28.714437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef171b6-59bd-4023-a372-4caeaa1458a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:28.715394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef171b6-59bd-4023-a372-4caeaa1458a0 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:28.715684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef171b6-59bd-4023-a372-4caeaa1458a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:28.715984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef171b6-59bd-4023-a372-4caeaa1458a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:28.722915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fef171b6-59bd-4023-a372-4caeaa1458a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:28.806760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994bf9d-8a4a-4d2e-a5cb-58167baaccd1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:28.808115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994bf9d-8a4a-4d2e-a5cb-58167baaccd1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:28.808624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994bf9d-8a4a-4d2e-a5cb-58167baaccd1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:28.809107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994bf9d-8a4a-4d2e-a5cb-58167baaccd1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/fa4c47de29e34a3898fe0729295cd6d3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:28.810928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994bf9d-8a4a-4d2e-a5cb-58167baaccd1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:get_project(project_id=fa4c47de29e34a3898fe0729295cd6d3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:28.814458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994bf9d-8a4a-4d2e-a5cb-58167baaccd1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:28.822382 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2677/5346] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:48:28 2022] GET /identity/v3/projects/fa4c47de29e34a3898fe0729295cd6d3 => generated 361 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:28.823586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994bf9d-8a4a-4d2e-a5cb-58167baaccd1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:28.829580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8994bf9d-8a4a-4d2e-a5cb-58167baaccd1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:28.880323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef171b6-59bd-4023-a372-4caeaa1458a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:28.882315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef171b6-59bd-4023-a372-4caeaa1458a0 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:28.936493 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2670/5347] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:28.940894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef171b6-59bd-4023-a372-4caeaa1458a0 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:28.989982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994bf9d-8a4a-4d2e-a5cb-58167baaccd1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:28.995213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef171b6-59bd-4023-a372-4caeaa1458a0 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:29.002014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:29.002831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:29.003565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:29.004154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] PATH_INFO: `/v3/users/99758effd8124854a18fba01fd94d55d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:29.008294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=99758effd8124854a18fba01fd94d55d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:29.015568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:29.033730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:29.034738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:29.036370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:29.036852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/fa4c47de29e34a3898fe0729295cd6d3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:29.048996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fa4c47de29e34a3898fe0729295cd6d3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:29.083215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:29.085720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:29.159922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99758effd8124854a18fba01fd94d55d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:29.164433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99758effd8124854a18fba01fd94d55d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:29.216002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99758effd8124854a18fba01fd94d55d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:29.223018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99758effd8124854a18fba01fd94d55d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:29.241436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99758effd8124854a18fba01fd94d55d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:29.264754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4c47de29e34a3898fe0729295cd6d3', 'request_id': 'req-7357cf12-a3d7-4f25-940c-651eb5dbdc91'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:29.268506 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2678/5348] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:28 2022] DELETE /identity/v3/users/99758effd8124854a18fba01fd94d55d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:29.286251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4c47de29e34a3898fe0729295cd6d3', 'request_id': 'req-7357cf12-a3d7-4f25-940c-651eb5dbdc91'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:29.313896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4c47de29e34a3898fe0729295cd6d3', 'request_id': 'req-7357cf12-a3d7-4f25-940c-651eb5dbdc91'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:29.350135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project fa4c47de29e34a3898fe0729295cd6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:29.350503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:29.356950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:29.362756 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2671/5349] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:28 2022] DELETE /identity/v3/projects/fa4c47de29e34a3898fe0729295cd6d3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:29.370651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:29.372224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:29.585438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d02e7-c85b-46d8-9c2c-cef2c61806ed admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:29.595156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f5531-fc97-48f8-aee7-509267528a41 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:29.596433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f5531-fc97-48f8-aee7-509267528a41 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:29.596776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f5531-fc97-48f8-aee7-509267528a41 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:29.597069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f5531-fc97-48f8-aee7-509267528a41 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:29.599765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f5531-fc97-48f8-aee7-509267528a41 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:29.604528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f5531-fc97-48f8-aee7-509267528a41 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:29.730033 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2679/5350] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:48:29 2022] POST /identity/v3/projects => generated 348 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:29.732629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:29.735151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:29.955255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357cf12-a3d7-4f25-940c-651eb5dbdc91 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:30.062030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:30.165627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc01b0-4ac3-4f61-ba0f-c5643421612a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:30.166318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc01b0-4ac3-4f61-ba0f-c5643421612a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:30.170485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc01b0-4ac3-4f61-ba0f-c5643421612a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:30.170804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc01b0-4ac3-4f61-ba0f-c5643421612a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/a22aee2f4c6f4973ba890a25e581217b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:30.174251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc01b0-4ac3-4f61-ba0f-c5643421612a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:get_project(project_id=a22aee2f4c6f4973ba890a25e581217b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:30.179026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc01b0-4ac3-4f61-ba0f-c5643421612a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:30.194852 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2672/5351] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:48:29 2022] GET /identity/v3/projects/a22aee2f4c6f4973ba890a25e581217b => generated 348 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:30.196723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f5531-fc97-48f8-aee7-509267528a41 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:30.215536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f5531-fc97-48f8-aee7-509267528a41 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:30.239627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:30.244310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:30.245026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:30.251752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/a22aee2f4c6f4973ba890a25e581217b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:30.256137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a22aee2f4c6f4973ba890a25e581217b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:30.259620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:30.439740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22aee2f4c6f4973ba890a25e581217b', 'request_id': 'req-1a5c7467-c6af-4680-b2e0-cec1e718080b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:30.465161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22aee2f4c6f4973ba890a25e581217b', 'request_id': 'req-1a5c7467-c6af-4680-b2e0-cec1e718080b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:30.502832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22aee2f4c6f4973ba890a25e581217b', 'request_id': 'req-1a5c7467-c6af-4680-b2e0-cec1e718080b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:30.517629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc01b0-4ac3-4f61-ba0f-c5643421612a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:30.520061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e3fc01b0-4ac3-4f61-ba0f-c5643421612a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:30.528425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project a22aee2f4c6f4973ba890a25e581217b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:30.528858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:30.530227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:30.538412 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2680/5352] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:30 2022] DELETE /identity/v3/projects/a22aee2f4c6f4973ba890a25e581217b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:30.546620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:30.550356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:30.568892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:30.698981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc01b0-4ac3-4f61-ba0f-c5643421612a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:30.767244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c7467-c6af-4680-b2e0-cec1e718080b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:30.786815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d8b36-3c0f-470f-98a4-c5c66a083879 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:30.787534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8b36-3c0f-470f-98a4-c5c66a083879 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:30.787991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8b36-3c0f-470f-98a4-c5c66a083879 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:30.788478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8b36-3c0f-470f-98a4-c5c66a083879 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:30.789969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d8b36-3c0f-470f-98a4-c5c66a083879 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:30.791860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d8b36-3c0f-470f-98a4-c5c66a083879 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:30.809907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:30.810982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:30.811544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:30.812078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] PATH_INFO: `/v3/projects/8b4de58c75b342f18b58dda3c6359ed1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:30.816017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4de58c75b342f18b58dda3c6359ed1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:30.819882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:30.846775 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2681/5353] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:48:30 2022] POST /identity/v3/domains => generated 275 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:30.851177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d8b36-3c0f-470f-98a4-c5c66a083879 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:30.979602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4de58c75b342f18b58dda3c6359ed1', 'request_id': 'req-f1df1175-f8a2-4ad2-aaca-0ca98726c233'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:30.991531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4de58c75b342f18b58dda3c6359ed1', 'request_id': 'req-f1df1175-f8a2-4ad2-aaca-0ca98726c233'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:31.000473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d8b36-3c0f-470f-98a4-c5c66a083879 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:31.004805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4de58c75b342f18b58dda3c6359ed1', 'request_id': 'req-f1df1175-f8a2-4ad2-aaca-0ca98726c233'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:31.039930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] The token cache is being invalidate because project 8b4de58c75b342f18b58dda3c6359ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:31.042091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:31.043396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f1df1175-f8a2-4ad2-aaca-0ca98726c233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:31.052445 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2673/5354] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:30 2022] DELETE /identity/v3/projects/8b4de58c75b342f18b58dda3c6359ed1 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:31.057416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29030045-ee0d-4aa8-bded-b7f4ae147412 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:31.057826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29030045-ee0d-4aa8-bded-b7f4ae147412 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:31.058206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29030045-ee0d-4aa8-bded-b7f4ae147412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:31.118439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-29030045-ee0d-4aa8-bded-b7f4ae147412 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:31.120792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-29030045-ee0d-4aa8-bded-b7f4ae147412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:31.136134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:31.173049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb0320-4cf3-481c-9cd5-98a02d74a7ae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:31.173715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb0320-4cf3-481c-9cd5-98a02d74a7ae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:31.174066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb0320-4cf3-481c-9cd5-98a02d74a7ae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:31.174408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb0320-4cf3-481c-9cd5-98a02d74a7ae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:31.176701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb0320-4cf3-481c-9cd5-98a02d74a7ae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:31.179393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb0320-4cf3-481c-9cd5-98a02d74a7ae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:31.271666 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2674/5355] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:31.273507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8e864-37fc-48d7-850a-6e9fb7b22b42 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:31.273938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8e864-37fc-48d7-850a-6e9fb7b22b42 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:31.274291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8e864-37fc-48d7-850a-6e9fb7b22b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:31.278694 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2682/5356] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:30 2022] POST /identity/v3/projects => generated 403 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:31.280403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb0320-4cf3-481c-9cd5-98a02d74a7ae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:31.290244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-29eb0320-4cf3-481c-9cd5-98a02d74a7ae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:31.321722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4bc8e864-37fc-48d7-850a-6e9fb7b22b42 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:31.325926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4bc8e864-37fc-48d7-850a-6e9fb7b22b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:31.355171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:31.450820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb0320-4cf3-481c-9cd5-98a02d74a7ae tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:31.466871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17d4ef-6ef6-498c-a1e2-43bf9f4091e9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:31.469800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17d4ef-6ef6-498c-a1e2-43bf9f4091e9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:31.472595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17d4ef-6ef6-498c-a1e2-43bf9f4091e9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:31.475224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17d4ef-6ef6-498c-a1e2-43bf9f4091e9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/9c066a4418a846f3b04330fc0735b3b4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:31.478148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17d4ef-6ef6-498c-a1e2-43bf9f4091e9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:get_project(project_id=9c066a4418a846f3b04330fc0735b3b4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:31.484598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17d4ef-6ef6-498c-a1e2-43bf9f4091e9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:31.491145 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2683/5357] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:48:31 2022] GET /identity/v3/projects/9c066a4418a846f3b04330fc0735b3b4 => generated 403 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:31.494063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17d4ef-6ef6-498c-a1e2-43bf9f4091e9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:31.533673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17d4ef-6ef6-498c-a1e2-43bf9f4091e9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:31.552800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:31.553489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:31.559383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:31.560820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/9c066a4418a846f3b04330fc0735b3b4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:31.565115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c066a4418a846f3b04330fc0735b3b4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:31.567664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:31.590363 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2675/5358] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:31.592384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8e864-37fc-48d7-850a-6e9fb7b22b42 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:31.625196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8e864-37fc-48d7-850a-6e9fb7b22b42 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:31.647538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1816f37-fec9-4e25-9281-437b660bea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:31.648104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816f37-fec9-4e25-9281-437b660bea03 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:31.648388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816f37-fec9-4e25-9281-437b660bea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:31.652995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816f37-fec9-4e25-9281-437b660bea03 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:31.653798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1816f37-fec9-4e25-9281-437b660bea03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:31.654112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1816f37-fec9-4e25-9281-437b660bea03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:31.659609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1816f37-fec9-4e25-9281-437b660bea03 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:31.716028 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2676/5359] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:31.726007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1816f37-fec9-4e25-9281-437b660bea03 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:31.764801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c066a4418a846f3b04330fc0735b3b4', 'request_id': 'req-becf77bc-144b-4981-8d9f-fcc85b364353'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:31.778892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1816f37-fec9-4e25-9281-437b660bea03 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:31.781346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c066a4418a846f3b04330fc0735b3b4', 'request_id': 'req-becf77bc-144b-4981-8d9f-fcc85b364353'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:31.805882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c066a4418a846f3b04330fc0735b3b4', 'request_id': 'req-becf77bc-144b-4981-8d9f-fcc85b364353'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:31.846908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project 9c066a4418a846f3b04330fc0735b3b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:31.847205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:31.850765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:31.855033 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2684/5360] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:31 2022] DELETE /identity/v3/projects/9c066a4418a846f3b04330fc0735b3b4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:31.862439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:31.883763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:31.980853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcefdc-9c0d-4ac2-91a5-31fd50d97c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:31.982708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcefdc-9c0d-4ac2-91a5-31fd50d97c5c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:31.982890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcefdc-9c0d-4ac2-91a5-31fd50d97c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:31.983093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcefdc-9c0d-4ac2-91a5-31fd50d97c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:31.984903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcefdc-9c0d-4ac2-91a5-31fd50d97c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:31.991026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcefdc-9c0d-4ac2-91a5-31fd50d97c5c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:32.058542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf77bc-144b-4981-8d9f-fcc85b364353 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:32.069275 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2677/5361] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:31 2022] POST /identity/v3/projects => generated 389 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:32.071436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcefdc-9c0d-4ac2-91a5-31fd50d97c5c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:32.078567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c2dcefdc-9c0d-4ac2-91a5-31fd50d97c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:32.160229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:32.205213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:32.221430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:32.223346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:32.223683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:32.224985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/domains/e75ede126c6a4d89b15a6531dc7c52f7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:32.229573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e75ede126c6a4d89b15a6531dc7c52f7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:32.231894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:32.286213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcefdc-9c0d-4ac2-91a5-31fd50d97c5c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:32.290202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.292680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.305632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051c4a-926c-4450-8674-93f398c1f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:32.306711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051c4a-926c-4450-8674-93f398c1f6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:32.308506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051c4a-926c-4450-8674-93f398c1f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:32.309110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051c4a-926c-4450-8674-93f398c1f6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:32.311609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e051c4a-926c-4450-8674-93f398c1f6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:32.317989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e051c4a-926c-4450-8674-93f398c1f6f7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:32.354103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.355458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.364811 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2685/5362] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:48:31 2022] PATCH /identity/v3/domains/e75ede126c6a4d89b15a6531dc7c52f7 => generated 276 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:32.371316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:32.374785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:32.393338 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2678/5363] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:32 2022] POST /identity/v3/users => generated 295 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:32.397424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051c4a-926c-4450-8674-93f398c1f6f7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:32.402331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1e051c4a-926c-4450-8674-93f398c1f6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:32.445996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051c4a-926c-4450-8674-93f398c1f6f7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:32.557623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d9bf9-3de9-4c10-8e1b-02f4c3829015 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:32.568965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:32.570420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:32.570935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:32.571379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/domains/e75ede126c6a4d89b15a6531dc7c52f7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:32.603466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e75ede126c6a4d89b15a6531dc7c52f7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:32.608777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:32.613142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd587060-5985-4ffb-a3d2-5bc7b83e25a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:32.614803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd587060-5985-4ffb-a3d2-5bc7b83e25a5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:32.615295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd587060-5985-4ffb-a3d2-5bc7b83e25a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:32.616028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd587060-5985-4ffb-a3d2-5bc7b83e25a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:32.619142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd587060-5985-4ffb-a3d2-5bc7b83e25a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:32.624494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd587060-5985-4ffb-a3d2-5bc7b83e25a5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:32.651771 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2679/5364] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:32.654382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd587060-5985-4ffb-a3d2-5bc7b83e25a5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:32.673365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.680039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd587060-5985-4ffb-a3d2-5bc7b83e25a5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:32.691645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e63a16-15f0-4456-89ff-49e6348f0f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:32.693759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63a16-15f0-4456-89ff-49e6348f0f65 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:32.694598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63a16-15f0-4456-89ff-49e6348f0f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:32.695046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63a16-15f0-4456-89ff-49e6348f0f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:32.697116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e63a16-15f0-4456-89ff-49e6348f0f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:32.701361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e63a16-15f0-4456-89ff-49e6348f0f65 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:32.702726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.736594 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2680/5365] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:32.739522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e63a16-15f0-4456-89ff-49e6348f0f65 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:32.765368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e63a16-15f0-4456-89ff-49e6348f0f65 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:32.804292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7', 'request_id': 'req-e4c8e068-16a6-4d90-8be6-227d20bf2299'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.822055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7', 'request_id': 'req-e4c8e068-16a6-4d90-8be6-227d20bf2299'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.846307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7', 'request_id': 'req-e4c8e068-16a6-4d90-8be6-227d20bf2299'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.914258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project e75ede126c6a4d89b15a6531dc7c52f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:32.914562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.917902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.944333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7', 'request_id': 'req-e4c8e068-16a6-4d90-8be6-227d20bf2299'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.946061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7', 'request_id': 'req-e4c8e068-16a6-4d90-8be6-227d20bf2299'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.947588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e75ede126c6a4d89b15a6531dc7c52f7', 'request_id': 'req-e4c8e068-16a6-4d90-8be6-227d20bf2299'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:32.960390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:32.987703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4eb38-1aca-4575-9cd3-903a54be6ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:32.989925 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2686/5366] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:48:32 2022] DELETE /identity/v3/domains/e75ede126c6a4d89b15a6531dc7c52f7 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:32.990756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4eb38-1aca-4575-9cd3-903a54be6ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:32.991302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4eb38-1aca-4575-9cd3-903a54be6ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:32.991795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4eb38-1aca-4575-9cd3-903a54be6ad5 admin admin] PATH_INFO: `/v3/projects/49e603b0139f44c588cebfcbe97f885e/users/84792a24f49441e39f0b832a551647d1/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:32.995240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:32.997884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:33.035197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4eb38-1aca-4575-9cd3-903a54be6ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e603b0139f44c588cebfcbe97f885e, user_id=84792a24f49441e39f0b832a551647d1, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:33.040637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4eb38-1aca-4575-9cd3-903a54be6ad5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:33.088455 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2681/5367] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:32 2022] PUT /identity/v3/projects/49e603b0139f44c588cebfcbe97f885e/users/84792a24f49441e39f0b832a551647d1/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:33.101471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d6227-1d6a-4faf-a818-46104ac6f4bb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:33.101471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d6227-1d6a-4faf-a818-46104ac6f4bb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:33.101837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d6227-1d6a-4faf-a818-46104ac6f4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:33.182895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-663d6227-1d6a-4faf-a818-46104ac6f4bb None None] MFA Rules not processed for user `84792a24f49441e39f0b832a551647d1`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:33.185044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-663d6227-1d6a-4faf-a818-46104ac6f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:33.204949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e068-16a6-4d90-8be6-227d20bf2299 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:33.214931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:33.435652 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2682/5368] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:33.466554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d6227-1d6a-4faf-a818-46104ac6f4bb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:33.468098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-663d6227-1d6a-4faf-a818-46104ac6f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:33.621761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d6227-1d6a-4faf-a818-46104ac6f4bb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:33.647012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54d20f-eb1a-44da-b466-d20142cb77cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:33.647742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54d20f-eb1a-44da-b466-d20142cb77cb service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:33.648111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54d20f-eb1a-44da-b466-d20142cb77cb service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:33.652942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54d20f-eb1a-44da-b466-d20142cb77cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:33.671221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54d20f-eb1a-44da-b466-d20142cb77cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:33.673632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54d20f-eb1a-44da-b466-d20142cb77cb service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:33.689701 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2683/5369] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:48:33.775679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5d5c4-92f7-45c6-b4f4-357ce7bf6cf9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:33.776243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d5c4-92f7-45c6-b4f4-357ce7bf6cf9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:33.776520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d5c4-92f7-45c6-b4f4-357ce7bf6cf9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:33.776793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d5c4-92f7-45c6-b4f4-357ce7bf6cf9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:33.777549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5d5c4-92f7-45c6-b4f4-357ce7bf6cf9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:33.779508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5d5c4-92f7-45c6-b4f4-357ce7bf6cf9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:33.790379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54d20f-eb1a-44da-b466-d20142cb77cb service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:33.792232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7b54d20f-eb1a-44da-b466-d20142cb77cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:33.828339 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2687/5370] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:48:32 2022] POST /identity/v3/domains => generated 275 bytes in 833 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:33.832288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5d5c4-92f7-45c6-b4f4-357ce7bf6cf9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:34.006197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54d20f-eb1a-44da-b466-d20142cb77cb service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:34.078854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5d5c4-92f7-45c6-b4f4-357ce7bf6cf9 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:34.084819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8141e-f220-44f8-9aa3-9d53c7a019b0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:34.085690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8141e-f220-44f8-9aa3-9d53c7a019b0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:34.086310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8141e-f220-44f8-9aa3-9d53c7a019b0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:34.086776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8141e-f220-44f8-9aa3-9d53c7a019b0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:34.087573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8141e-f220-44f8-9aa3-9d53c7a019b0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:34.090060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8141e-f220-44f8-9aa3-9d53c7a019b0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:34.173128 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2688/5371] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:33 2022] POST /identity/v3/projects => generated 410 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:34.174051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8141e-f220-44f8-9aa3-9d53c7a019b0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:34.225655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:34.319883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845edf5-e051-42b3-a3cc-97325e8d0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:34.320542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845edf5-e051-42b3-a3cc-97325e8d0f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:34.320824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845edf5-e051-42b3-a3cc-97325e8d0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:34.321101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845edf5-e051-42b3-a3cc-97325e8d0f69 admin admin] PATH_INFO: `/v3/users/84792a24f49441e39f0b832a551647d1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:34.331319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845edf5-e051-42b3-a3cc-97325e8d0f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84792a24f49441e39f0b832a551647d1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:34.334116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845edf5-e051-42b3-a3cc-97325e8d0f69 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:34.345202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:34.417754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8141e-f220-44f8-9aa3-9d53c7a019b0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:34.441631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4e30f-75df-479c-a229-70b0d8c01024 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:34.443118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4e30f-75df-479c-a229-70b0d8c01024 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:34.443495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4e30f-75df-479c-a229-70b0d8c01024 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:34.443870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4e30f-75df-479c-a229-70b0d8c01024 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:34.444640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4e30f-75df-479c-a229-70b0d8c01024 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:34.446699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4e30f-75df-479c-a229-70b0d8c01024 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:34.498330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b845edf5-e051-42b3-a3cc-97325e8d0f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84792a24f49441e39f0b832a551647d1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:34.499159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b845edf5-e051-42b3-a3cc-97325e8d0f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84792a24f49441e39f0b832a551647d1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:34.518323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b845edf5-e051-42b3-a3cc-97325e8d0f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84792a24f49441e39f0b832a551647d1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:34.543782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b845edf5-e051-42b3-a3cc-97325e8d0f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84792a24f49441e39f0b832a551647d1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:34.563377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b845edf5-e051-42b3-a3cc-97325e8d0f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84792a24f49441e39f0b832a551647d1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:34.567312 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2689/5372] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:34 2022] POST /identity/v3/projects => generated 405 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:34.571729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4e30f-75df-479c-a229-70b0d8c01024 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:34.586603 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2684/5373] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:33 2022] DELETE /identity/v3/users/84792a24f49441e39f0b832a551647d1 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:34.591267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a971c3-8f9d-4d10-a2dd-f3542bd29a0b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:34.591793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a971c3-8f9d-4d10-a2dd-f3542bd29a0b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:34.592369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a971c3-8f9d-4d10-a2dd-f3542bd29a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:34.647176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-60a971c3-8f9d-4d10-a2dd-f3542bd29a0b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:34.648450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-60a971c3-8f9d-4d10-a2dd-f3542bd29a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:34.814373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4e30f-75df-479c-a229-70b0d8c01024 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:34.889561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2685/5374] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:34.950409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a971c3-8f9d-4d10-a2dd-f3542bd29a0b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:34.952135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-60a971c3-8f9d-4d10-a2dd-f3542bd29a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:35.008738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:35.009417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:35.009728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:35.010010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/08eaf033a0684baa901b5e20750d2ff7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:35.018498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=08eaf033a0684baa901b5e20750d2ff7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:35.020691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:35.110047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a971c3-8f9d-4d10-a2dd-f3542bd29a0b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:35.127033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa92642-fd3b-4110-9dad-02a3decae11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:35.127834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa92642-fd3b-4110-9dad-02a3decae11c service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:35.128384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa92642-fd3b-4110-9dad-02a3decae11c service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:35.128887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa92642-fd3b-4110-9dad-02a3decae11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:35.147251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:35.158302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08eaf033a0684baa901b5e20750d2ff7', 'request_id': 'req-c2aebec2-7a37-4ed1-914c-d678e5098bb1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.163723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa92642-fd3b-4110-9dad-02a3decae11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:35.170038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08eaf033a0684baa901b5e20750d2ff7', 'request_id': 'req-c2aebec2-7a37-4ed1-914c-d678e5098bb1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.172521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa92642-fd3b-4110-9dad-02a3decae11c service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:35.185704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08eaf033a0684baa901b5e20750d2ff7', 'request_id': 'req-c2aebec2-7a37-4ed1-914c-d678e5098bb1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.199414 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2686/5375] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:35.210494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project 08eaf033a0684baa901b5e20750d2ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:35.211083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.211992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.214229 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2690/5376] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:34 2022] DELETE /identity/v3/projects/08eaf033a0684baa901b5e20750d2ff7 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:35.222527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa92642-fd3b-4110-9dad-02a3decae11c service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:35.224881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-afa92642-fd3b-4110-9dad-02a3decae11c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:35.260071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa92642-fd3b-4110-9dad-02a3decae11c service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:35.312405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:35.405756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:35.406455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:35.406739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:35.407157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/a1070ee18be8421ebc10addf21d3cb76` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:35.408494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a1070ee18be8421ebc10addf21d3cb76)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:35.414744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:35.514137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1070ee18be8421ebc10addf21d3cb76', 'request_id': 'req-e1e8a048-56ae-44be-9258-c8d76f80b65a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.525485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1070ee18be8421ebc10addf21d3cb76', 'request_id': 'req-e1e8a048-56ae-44be-9258-c8d76f80b65a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.540291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1070ee18be8421ebc10addf21d3cb76', 'request_id': 'req-e1e8a048-56ae-44be-9258-c8d76f80b65a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.571943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project a1070ee18be8421ebc10addf21d3cb76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:35.572240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.574534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.578328 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2687/5377] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:35 2022] DELETE /identity/v3/projects/a1070ee18be8421ebc10addf21d3cb76 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:35.583493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:35.585738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:35.626137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aebec2-7a37-4ed1-914c-d678e5098bb1 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:35.802271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:35.802271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:35.802271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:35.802702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/domains/f27efdab5ce241cf84d0a09bcc2621bc` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:35.802702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f27efdab5ce241cf84d0a09bcc2621bc)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:35.810329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:35.882261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.884341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.944638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.945265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:35.952224 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2691/5378] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:48:35 2022] PATCH /identity/v3/domains/f27efdab5ce241cf84d0a09bcc2621bc => generated 276 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:35.956324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:35.957945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:35.998683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8a048-56ae-44be-9258-c8d76f80b65a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:36.177270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:36.178358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:36.179022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:36.179022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/domains/f27efdab5ce241cf84d0a09bcc2621bc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:36.207129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f27efdab5ce241cf84d0a09bcc2621bc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:36.209031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:36.298140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:36.328744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:36.361687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:36.418342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc', 'request_id': 'req-de93f621-7947-4c1c-85c9-aa898a1e809b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:36.437536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc', 'request_id': 'req-de93f621-7947-4c1c-85c9-aa898a1e809b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:36.451165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc', 'request_id': 'req-de93f621-7947-4c1c-85c9-aa898a1e809b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:36.467431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project f27efdab5ce241cf84d0a09bcc2621bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:36.467728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:36.468418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:36.482982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc', 'request_id': 'req-de93f621-7947-4c1c-85c9-aa898a1e809b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:36.483847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc', 'request_id': 'req-de93f621-7947-4c1c-85c9-aa898a1e809b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:36.484516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f27efdab5ce241cf84d0a09bcc2621bc', 'request_id': 'req-de93f621-7947-4c1c-85c9-aa898a1e809b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:36.525508 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2688/5379] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:48:35 2022] DELETE /identity/v3/domains/f27efdab5ce241cf84d0a09bcc2621bc => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:36.530602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:36.532576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:36.572827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcdfa9-2889-4b5a-975b-4b99c045cc7e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:36.768644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2a2b9-82fe-4a56-a941-1fc1d95bb800 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:36.769654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2a2b9-82fe-4a56-a941-1fc1d95bb800 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:36.770885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2a2b9-82fe-4a56-a941-1fc1d95bb800 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:36.771760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2a2b9-82fe-4a56-a941-1fc1d95bb800 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:36.773769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2a2b9-82fe-4a56-a941-1fc1d95bb800 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:36.775922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2a2b9-82fe-4a56-a941-1fc1d95bb800 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:36.897163 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2692/5380] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:36 2022] POST /identity/v3/projects => generated 376 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:36.901825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:36.903486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:36.958597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93f621-7947-4c1c-85c9-aa898a1e809b tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:37.186098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183543d-1917-4c83-ba93-b18c015d5475 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:37.186863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183543d-1917-4c83-ba93-b18c015d5475 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:37.187073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183543d-1917-4c83-ba93-b18c015d5475 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:37.187938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183543d-1917-4c83-ba93-b18c015d5475 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/e75bd467569d4b08b68850dcc2a32c84` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:37.190366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183543d-1917-4c83-ba93-b18c015d5475 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:get_project(project_id=e75bd467569d4b08b68850dcc2a32c84)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:37.192616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183543d-1917-4c83-ba93-b18c015d5475 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:37.203150 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2689/5381] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:48:36 2022] GET /identity/v3/projects/e75bd467569d4b08b68850dcc2a32c84 => generated 376 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:37.206756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2a2b9-82fe-4a56-a941-1fc1d95bb800 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:37.225034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2a2b9-82fe-4a56-a941-1fc1d95bb800 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:37.245013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b29b0-f153-490e-8f47-3091bac2716e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:37.245849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b29b0-f153-490e-8f47-3091bac2716e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:37.246242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b29b0-f153-490e-8f47-3091bac2716e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:37.246625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b29b0-f153-490e-8f47-3091bac2716e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:37.247411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b29b0-f153-490e-8f47-3091bac2716e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:37.250243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b29b0-f153-490e-8f47-3091bac2716e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:37.338058 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2693/5382] 10.222.0.16 () {58 vars in 1131 bytes} [Mon Aug 29 15:48:37 2022] GET /identity/v3/projects => generated 6589 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:48:37.339222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183543d-1917-4c83-ba93-b18c015d5475 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:37.377450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183543d-1917-4c83-ba93-b18c015d5475 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:37.396775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:37.399578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:37.399902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:37.400348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/e75bd467569d4b08b68850dcc2a32c84` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:37.405554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e75bd467569d4b08b68850dcc2a32c84)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:37.415747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:37.607478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75bd467569d4b08b68850dcc2a32c84', 'request_id': 'req-ed456367-5b72-43ba-97c7-ed184e92b124'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:37.628628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75bd467569d4b08b68850dcc2a32c84', 'request_id': 'req-ed456367-5b72-43ba-97c7-ed184e92b124'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:37.651621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75bd467569d4b08b68850dcc2a32c84', 'request_id': 'req-ed456367-5b72-43ba-97c7-ed184e92b124'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:37.698908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project e75bd467569d4b08b68850dcc2a32c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:37.699210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:37.701809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:37.704273 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2690/5383] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:37 2022] DELETE /identity/v3/projects/e75bd467569d4b08b68850dcc2a32c84 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:37.710500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b29b0-f153-490e-8f47-3091bac2716e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:37.712978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f01b29b0-f153-490e-8f47-3091bac2716e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:37.764120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b29b0-f153-490e-8f47-3091bac2716e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:37.776649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:37.882510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:37.884000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:37.927047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:37.951890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe8024-ef6a-4787-8f39-7da7d232a3b6 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:37.954163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe8024-ef6a-4787-8f39-7da7d232a3b6 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:37.955964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe8024-ef6a-4787-8f39-7da7d232a3b6 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:37.958215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe8024-ef6a-4787-8f39-7da7d232a3b6 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:37.958932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe8024-ef6a-4787-8f39-7da7d232a3b6 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:37.966990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe8024-ef6a-4787-8f39-7da7d232a3b6 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:38.104976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed456367-5b72-43ba-97c7-ed184e92b124 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:38.111308 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2694/5384] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:48:37 2022] POST /identity/v3/projects => generated 346 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:38.113051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe8024-ef6a-4787-8f39-7da7d232a3b6 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:38.341033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe8024-ef6a-4787-8f39-7da7d232a3b6 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:38.359519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb10a2-e3c2-48d7-b75e-08c043437d5a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:38.364087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb10a2-e3c2-48d7-b75e-08c043437d5a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:38.364458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb10a2-e3c2-48d7-b75e-08c043437d5a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:38.364748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb10a2-e3c2-48d7-b75e-08c043437d5a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/d0deeb66fec04b40bb86426c6602cbfd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:38.373532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb10a2-e3c2-48d7-b75e-08c043437d5a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:update_project(project_id=d0deeb66fec04b40bb86426c6602cbfd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:38.374824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:38.380076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:38.380430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:38.380626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb10a2-e3c2-48d7-b75e-08c043437d5a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:38.380736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] PATH_INFO: `/v3/projects/49e603b0139f44c588cebfcbe97f885e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:38.383846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e603b0139f44c588cebfcbe97f885e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:38.391750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:38.472597 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2695/5385] 10.222.0.16 () {60 vars in 1252 bytes} [Mon Aug 29 15:48:38 2022] PATCH /identity/v3/projects/d0deeb66fec04b40bb86426c6602cbfd => generated 361 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:38.475718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb10a2-e3c2-48d7-b75e-08c043437d5a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:38.499612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb10a2-e3c2-48d7-b75e-08c043437d5a tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:38.510109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e207d-a0f9-42fe-85e9-f7b7a374233e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:38.510769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e207d-a0f9-42fe-85e9-f7b7a374233e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:38.511054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e207d-a0f9-42fe-85e9-f7b7a374233e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:38.511335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e207d-a0f9-42fe-85e9-f7b7a374233e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/d0deeb66fec04b40bb86426c6602cbfd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:38.562988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e207d-a0f9-42fe-85e9-f7b7a374233e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:get_project(project_id=d0deeb66fec04b40bb86426c6602cbfd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:38.565112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e207d-a0f9-42fe-85e9-f7b7a374233e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:38.583445 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2696/5386] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:48:38 2022] GET /identity/v3/projects/d0deeb66fec04b40bb86426c6602cbfd => generated 348 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:38.587477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e207d-a0f9-42fe-85e9-f7b7a374233e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:38.591576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e603b0139f44c588cebfcbe97f885e', 'request_id': 'req-087d4ebd-824f-4ff0-9897-49af208645d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.612979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e603b0139f44c588cebfcbe97f885e', 'request_id': 'req-087d4ebd-824f-4ff0-9897-49af208645d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.633029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e207d-a0f9-42fe-85e9-f7b7a374233e tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:38.638391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e603b0139f44c588cebfcbe97f885e', 'request_id': 'req-087d4ebd-824f-4ff0-9897-49af208645d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.684334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] The token cache is being invalidate because project 49e603b0139f44c588cebfcbe97f885e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:38.684778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.685965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-087d4ebd-824f-4ff0-9897-49af208645d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.690907 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2691/5387] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:37 2022] DELETE /identity/v3/projects/49e603b0139f44c588cebfcbe97f885e => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:38.694990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb6477-31bf-4b68-bd0f-a9629b2b3e2c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:38.694990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb6477-31bf-4b68-bd0f-a9629b2b3e2c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:38.694990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb6477-31bf-4b68-bd0f-a9629b2b3e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:38.765842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f0eb6477-31bf-4b68-bd0f-a9629b2b3e2c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:38.766951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f0eb6477-31bf-4b68-bd0f-a9629b2b3e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:38.787038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:38.802572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:38.804497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:38.805822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:38.806329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/d0deeb66fec04b40bb86426c6602cbfd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:38.808893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d0deeb66fec04b40bb86426c6602cbfd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:38.811433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:38.909700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0deeb66fec04b40bb86426c6602cbfd', 'request_id': 'req-9b2cdbae-5749-4776-ae27-cb6f30eb6486'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.921169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0deeb66fec04b40bb86426c6602cbfd', 'request_id': 'req-9b2cdbae-5749-4776-ae27-cb6f30eb6486'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.937831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0deeb66fec04b40bb86426c6602cbfd', 'request_id': 'req-9b2cdbae-5749-4776-ae27-cb6f30eb6486'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.960558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project d0deeb66fec04b40bb86426c6602cbfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:38.961215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.963225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:38.969772 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2697/5388] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:38 2022] DELETE /identity/v3/projects/d0deeb66fec04b40bb86426c6602cbfd => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:38.970685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:38.972516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:39.010722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:39.042488 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2692/5389] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:39.051969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8968260-843c-421d-9359-6cee9657e3fb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.052510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8968260-843c-421d-9359-6cee9657e3fb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.052951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8968260-843c-421d-9359-6cee9657e3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.091206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cdbae-5749-4776-ae27-cb6f30eb6486 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.095438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f8968260-843c-421d-9359-6cee9657e3fb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:39.097698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f8968260-843c-421d-9359-6cee9657e3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:39.118361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a162a04-572d-4138-b459-2bd531e4d1a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.119396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a162a04-572d-4138-b459-2bd531e4d1a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.120369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a162a04-572d-4138-b459-2bd531e4d1a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.120676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a162a04-572d-4138-b459-2bd531e4d1a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.121376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a162a04-572d-4138-b459-2bd531e4d1a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.123660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a162a04-572d-4138-b459-2bd531e4d1a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.187263 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2698/5390] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:38 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:39.197201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a162a04-572d-4138-b459-2bd531e4d1a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.239681 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2693/5391] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:39.245029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8968260-843c-421d-9359-6cee9657e3fb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.267452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8968260-843c-421d-9359-6cee9657e3fb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.353990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a162a04-572d-4138-b459-2bd531e4d1a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.362855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e5079-27af-4276-ad1a-e92567202fc7 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.366676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e5079-27af-4276-ad1a-e92567202fc7 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.367125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e5079-27af-4276-ad1a-e92567202fc7 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.367582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e5079-27af-4276-ad1a-e92567202fc7 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/e4385e980b0a4fe59e341e14cd4e01a2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.369818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e5079-27af-4276-ad1a-e92567202fc7 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:update_project(project_id=e4385e980b0a4fe59e341e14cd4e01a2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.374546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e5079-27af-4276-ad1a-e92567202fc7 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.399525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b729147-44a2-467e-a160-b1e249298e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.400161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b729147-44a2-467e-a160-b1e249298e54 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.400445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b729147-44a2-467e-a160-b1e249298e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.400728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b729147-44a2-467e-a160-b1e249298e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.401419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b729147-44a2-467e-a160-b1e249298e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:39.401720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b729147-44a2-467e-a160-b1e249298e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.404159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b729147-44a2-467e-a160-b1e249298e54 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.413232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:39.436771 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2694/5392] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:48:39.444502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b729147-44a2-467e-a160-b1e249298e54 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.471536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b729147-44a2-467e-a160-b1e249298e54 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.483733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c5ec3-75ab-4e0b-8bd5-a81a52e8cf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.484417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c5ec3-75ab-4e0b-8bd5-a81a52e8cf4d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.484707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c5ec3-75ab-4e0b-8bd5-a81a52e8cf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.485031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c5ec3-75ab-4e0b-8bd5-a81a52e8cf4d admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.485845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c5ec3-75ab-4e0b-8bd5-a81a52e8cf4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.488062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c5ec3-75ab-4e0b-8bd5-a81a52e8cf4d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.497133 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2699/5393] 10.222.0.16 () {60 vars in 1252 bytes} [Mon Aug 29 15:48:39 2022] PATCH /identity/v3/projects/e4385e980b0a4fe59e341e14cd4e01a2 => generated 373 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:39.501459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e5079-27af-4276-ad1a-e92567202fc7 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.512115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e5079-27af-4276-ad1a-e92567202fc7 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.517675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f895-b987-4258-836f-dddc2a6b0c23 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.518833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f895-b987-4258-836f-dddc2a6b0c23 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.519189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f895-b987-4258-836f-dddc2a6b0c23 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.519576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f895-b987-4258-836f-dddc2a6b0c23 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/e4385e980b0a4fe59e341e14cd4e01a2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.540940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f895-b987-4258-836f-dddc2a6b0c23 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:get_project(project_id=e4385e980b0a4fe59e341e14cd4e01a2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.544029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f895-b987-4258-836f-dddc2a6b0c23 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.550371 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2700/5394] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:48:39 2022] GET /identity/v3/projects/e4385e980b0a4fe59e341e14cd4e01a2 => generated 360 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:39.551637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f895-b987-4258-836f-dddc2a6b0c23 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.567780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f895-b987-4258-836f-dddc2a6b0c23 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.582258 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2695/5395] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:39 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:48:39.584371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c5ec3-75ab-4e0b-8bd5-a81a52e8cf4d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.668483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.669969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.670325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.670671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/e4385e980b0a4fe59e341e14cd4e01a2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.673195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e4385e980b0a4fe59e341e14cd4e01a2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.675575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.740380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4385e980b0a4fe59e341e14cd4e01a2', 'request_id': 'req-3f715b9c-15a5-4e66-877c-d335476c1494'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:39.748819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4385e980b0a4fe59e341e14cd4e01a2', 'request_id': 'req-3f715b9c-15a5-4e66-877c-d335476c1494'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:39.763743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4385e980b0a4fe59e341e14cd4e01a2', 'request_id': 'req-3f715b9c-15a5-4e66-877c-d335476c1494'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:39.779205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project e4385e980b0a4fe59e341e14cd4e01a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:39.779805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:39.781126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:39.788023 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2701/5396] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:39 2022] DELETE /identity/v3/projects/e4385e980b0a4fe59e341e14cd4e01a2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:39.789435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.791558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:39.863720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:39.888885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f715b9c-15a5-4e66-877c-d335476c1494 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.896134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc2909-4386-4351-b2d2-c30463387324 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:39.897854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc2909-4386-4351-b2d2-c30463387324 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:39.898228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc2909-4386-4351-b2d2-c30463387324 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:39.898706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc2909-4386-4351-b2d2-c30463387324 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:39.899925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc2909-4386-4351-b2d2-c30463387324 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:39.901971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc2909-4386-4351-b2d2-c30463387324 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:39.960914 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2702/5397] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:39 2022] POST /identity/v3/projects => generated 351 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:39.961568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c5ec3-75ab-4e0b-8bd5-a81a52e8cf4d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:39.963117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc2909-4386-4351-b2d2-c30463387324 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:39.990801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:40.143161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc2909-4386-4351-b2d2-c30463387324 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:40.159013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7a101-8d70-4fc9-87c7-42023f54e729 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:40.159671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7a101-8d70-4fc9-87c7-42023f54e729 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:40.159953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7a101-8d70-4fc9-87c7-42023f54e729 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:40.160234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7a101-8d70-4fc9-87c7-42023f54e729 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/fc32343358b7404494bd444f8fc82c3b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:40.161539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d222868-229f-43bc-b78d-6b28dba37482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:40.162290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222868-229f-43bc-b78d-6b28dba37482 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:40.162582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222868-229f-43bc-b78d-6b28dba37482 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:40.162894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222868-229f-43bc-b78d-6b28dba37482 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:40.163483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7a101-8d70-4fc9-87c7-42023f54e729 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:update_project(project_id=fc32343358b7404494bd444f8fc82c3b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:40.163615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d222868-229f-43bc-b78d-6b28dba37482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:40.166036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d222868-229f-43bc-b78d-6b28dba37482 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:40.166369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7a101-8d70-4fc9-87c7-42023f54e729 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:40.248718 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2703/5398] 10.222.0.16 () {60 vars in 1252 bytes} [Mon Aug 29 15:48:39 2022] PATCH /identity/v3/projects/fc32343358b7404494bd444f8fc82c3b => generated 366 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:48:40.249224 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2696/5399] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:39 2022] POST /identity/v3/users => generated 292 bytes in 665 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:40.253181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7a101-8d70-4fc9-87c7-42023f54e729 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:40.256325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d222868-229f-43bc-b78d-6b28dba37482 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:40.259574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-afa7a101-8d70-4fc9-87c7-42023f54e729 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:40.277170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d222868-229f-43bc-b78d-6b28dba37482 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:40.299671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708e0f3-4f8e-425f-9be7-8923c7858777 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:40.299671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708e0f3-4f8e-425f-9be7-8923c7858777 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:40.299671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708e0f3-4f8e-425f-9be7-8923c7858777 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:40.301146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708e0f3-4f8e-425f-9be7-8923c7858777 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/fc32343358b7404494bd444f8fc82c3b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:40.315580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7a101-8d70-4fc9-87c7-42023f54e729 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:40.321281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708e0f3-4f8e-425f-9be7-8923c7858777 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:get_project(project_id=fc32343358b7404494bd444f8fc82c3b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:40.326708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708e0f3-4f8e-425f-9be7-8923c7858777 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:40.331944 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2697/5400] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:48:40 2022] GET /identity/v3/projects/fc32343358b7404494bd444f8fc82c3b => generated 353 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:40.333809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708e0f3-4f8e-425f-9be7-8923c7858777 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:40.339185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7dc2a-6ef2-46ba-818f-395502172373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:40.340377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7dc2a-6ef2-46ba-818f-395502172373 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:40.342947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7dc2a-6ef2-46ba-818f-395502172373 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:40.343355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7dc2a-6ef2-46ba-818f-395502172373 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:40.344075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7dc2a-6ef2-46ba-818f-395502172373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:40.350447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7dc2a-6ef2-46ba-818f-395502172373 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:40.365485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708e0f3-4f8e-425f-9be7-8923c7858777 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:40.382277 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2704/5401] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:40.382752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7dc2a-6ef2-46ba-818f-395502172373 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:40.399477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:40.400493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:40.401745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:40.402508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/projects/fc32343358b7404494bd444f8fc82c3b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:40.407179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fc32343358b7404494bd444f8fc82c3b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:40.409952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7dc2a-6ef2-46ba-818f-395502172373 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:40.419615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:40.427786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487a6e0-3c6f-4258-a586-296221450c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:40.428568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487a6e0-3c6f-4258-a586-296221450c8a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:40.428851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487a6e0-3c6f-4258-a586-296221450c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:40.429125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487a6e0-3c6f-4258-a586-296221450c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:40.429872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487a6e0-3c6f-4258-a586-296221450c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:40.435446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487a6e0-3c6f-4258-a586-296221450c8a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:40.466681 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2705/5402] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:40.467811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487a6e0-3c6f-4258-a586-296221450c8a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:40.494805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487a6e0-3c6f-4258-a586-296221450c8a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:40.522797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4643f9c-18d1-4145-a0ff-80f9dc97693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:40.523483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4643f9c-18d1-4145-a0ff-80f9dc97693c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:40.523767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4643f9c-18d1-4145-a0ff-80f9dc97693c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:40.524046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4643f9c-18d1-4145-a0ff-80f9dc97693c admin admin] PATH_INFO: `/v3/projects/3c8eda6a5a6144a3954a78ddb6ab9795/users/45410de8653b425e94668fabfce136dc/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:40.570558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc32343358b7404494bd444f8fc82c3b', 'request_id': 'req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:40.573801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4643f9c-18d1-4145-a0ff-80f9dc97693c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8eda6a5a6144a3954a78ddb6ab9795, user_id=45410de8653b425e94668fabfce136dc, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:40.576504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4643f9c-18d1-4145-a0ff-80f9dc97693c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:40.593193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc32343358b7404494bd444f8fc82c3b', 'request_id': 'req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:40.612766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc32343358b7404494bd444f8fc82c3b', 'request_id': 'req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:40.617768 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2706/5403] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:40 2022] PUT /identity/v3/projects/3c8eda6a5a6144a3954a78ddb6ab9795/users/45410de8653b425e94668fabfce136dc/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:40.628409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4d9c0-6ea7-4602-81e8-0c85a1dd669e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:40.630853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4d9c0-6ea7-4602-81e8-0c85a1dd669e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:40.631143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4d9c0-6ea7-4602-81e8-0c85a1dd669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:40.642586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] The token cache is being invalidate because project fc32343358b7404494bd444f8fc82c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:40.643032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:40.644984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:40.647285 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2698/5404] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:40 2022] DELETE /identity/v3/projects/fc32343358b7404494bd444f8fc82c3b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:40.652393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:40.655995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:40.711906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a4e4d9c0-6ea7-4602-81e8-0c85a1dd669e None None] MFA Rules not processed for user `45410de8653b425e94668fabfce136dc`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:40.713352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a4e4d9c0-6ea7-4602-81e8-0c85a1dd669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:40.810781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaba8cb-bf9a-4cc5-9a92-02945b4275eb tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:40.850681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:40.903293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:40.923322 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2707/5405] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:40.952778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4d9c0-6ea7-4602-81e8-0c85a1dd669e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:40.955390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a4e4d9c0-6ea7-4602-81e8-0c85a1dd669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:40.966471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c128547-2cc9-46b6-8375-56f4cd26d456 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:40.967148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c128547-2cc9-46b6-8375-56f4cd26d456 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:40.967437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c128547-2cc9-46b6-8375-56f4cd26d456 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:40.967722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c128547-2cc9-46b6-8375-56f4cd26d456 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/domains/f27efdab5ce241cf84d0a09bcc2621bc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:40.981462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c128547-2cc9-46b6-8375-56f4cd26d456 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-3c128547-2cc9-46b6-8375-56f4cd26d456 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Could not find domain: f27efdab5ce241cf84d0a09bcc2621bc.: keystone.exception.DomainNotFound: Could not find domain: f27efdab5ce241cf84d0a09bcc2621bc. Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f27efdab5ce241cf84d0a09bcc2621bc. Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:48:40.990432 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:48:40.991705 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f27efdab5ce241cf84d0a09bcc2621bc. Aug 29 15:48:40.992763 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:48:41.004027 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2699/5406] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:48:40 2022] PATCH /identity/v3/domains/f27efdab5ce241cf84d0a09bcc2621bc => generated 112 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:48:41.007278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c128547-2cc9-46b6-8375-56f4cd26d456 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:41.033455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c128547-2cc9-46b6-8375-56f4cd26d456 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:41.054604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc414c2-8ce4-4768-9ec4-7e4cf60133a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d5effea28ef4e5292585de39bf0d090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79429880296b4fd09c71c560142f1393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:41.055702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc414c2-8ce4-4768-9ec4-7e4cf60133a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:41.056117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc414c2-8ce4-4768-9ec4-7e4cf60133a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:41.056501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc414c2-8ce4-4768-9ec4-7e4cf60133a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] PATH_INFO: `/v3/domains/e75ede126c6a4d89b15a6531dc7c52f7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:41.075416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc414c2-8ce4-4768-9ec4-7e4cf60133a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-3dc414c2-8ce4-4768-9ec4-7e4cf60133a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Could not find domain: e75ede126c6a4d89b15a6531dc7c52f7.: keystone.exception.DomainNotFound: Could not find domain: e75ede126c6a4d89b15a6531dc7c52f7. Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e75ede126c6a4d89b15a6531dc7c52f7. Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:48:41.088676 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:48:41.090057 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e75ede126c6a4d89b15a6531dc7c52f7. Aug 29 15:48:41.091129 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:48:41.095548 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2700/5407] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:48:41 2022] PATCH /identity/v3/domains/e75ede126c6a4d89b15a6531dc7c52f7 => generated 112 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:48:41.097107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc414c2-8ce4-4768-9ec4-7e4cf60133a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:41.104399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3dc414c2-8ce4-4768-9ec4-7e4cf60133a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:41.125519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4d9c0-6ea7-4602-81e8-0c85a1dd669e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:41.139925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6530a-d09b-4ae7-9dea-066558d4631d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:41.140927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6530a-d09b-4ae7-9dea-066558d4631d service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:41.141468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6530a-d09b-4ae7-9dea-066558d4631d service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:41.141938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6530a-d09b-4ae7-9dea-066558d4631d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:41.168472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6530a-d09b-4ae7-9dea-066558d4631d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:41.175250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6530a-d09b-4ae7-9dea-066558d4631d service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:41.227594 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2708/5408] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:48:41.297376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc414c2-8ce4-4768-9ec4-7e4cf60133a0 tempest-ProjectsTestJSON-2123150160 tempest-ProjectsTestJSON-2123150160-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:41.310091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab795c07-8943-472c-bc31-db596305ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:41.313254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab795c07-8943-472c-bc31-db596305ac08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:41.313814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab795c07-8943-472c-bc31-db596305ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:41.314303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab795c07-8943-472c-bc31-db596305ac08 admin admin] PATH_INFO: `/v3/users/3a0cbdf852814c5a87a99871e8aaf5f8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:41.317929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab795c07-8943-472c-bc31-db596305ac08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0cbdf852814c5a87a99871e8aaf5f8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:41.323691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab795c07-8943-472c-bc31-db596305ac08 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:41.384044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6530a-d09b-4ae7-9dea-066558d4631d service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:41.387293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-33d6530a-d09b-4ae7-9dea-066558d4631d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:41.426339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6530a-d09b-4ae7-9dea-066558d4631d service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:41.433484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ab795c07-8943-472c-bc31-db596305ac08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0cbdf852814c5a87a99871e8aaf5f8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:41.436537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ab795c07-8943-472c-bc31-db596305ac08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0cbdf852814c5a87a99871e8aaf5f8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:41.441730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f151c27-4d91-4113-b83f-17f4d1b636e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:41.443476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f151c27-4d91-4113-b83f-17f4d1b636e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:41.444706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f151c27-4d91-4113-b83f-17f4d1b636e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:41.445359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f151c27-4d91-4113-b83f-17f4d1b636e6 admin admin] PATH_INFO: `/v3/users/cc3f3d49a2f6431e9a006aa324911803` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:41.450937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f151c27-4d91-4113-b83f-17f4d1b636e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3f3d49a2f6431e9a006aa324911803)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:41.455782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f151c27-4d91-4113-b83f-17f4d1b636e6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:41.479332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ab795c07-8943-472c-bc31-db596305ac08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0cbdf852814c5a87a99871e8aaf5f8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:41.500830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ab795c07-8943-472c-bc31-db596305ac08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0cbdf852814c5a87a99871e8aaf5f8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:41.521350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ab795c07-8943-472c-bc31-db596305ac08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0cbdf852814c5a87a99871e8aaf5f8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:41.533898 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2701/5409] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:41 2022] DELETE /identity/v3/users/3a0cbdf852814c5a87a99871e8aaf5f8 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:41.539659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d6606-0d63-4b32-b712-04471af915b0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:41.540291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d6606-0d63-4b32-b712-04471af915b0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:41.544749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d6606-0d63-4b32-b712-04471af915b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:41.593663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8f151c27-4d91-4113-b83f-17f4d1b636e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3f3d49a2f6431e9a006aa324911803'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:41.595881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8f151c27-4d91-4113-b83f-17f4d1b636e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3f3d49a2f6431e9a006aa324911803'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:41.606016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2f6d6606-0d63-4b32-b712-04471af915b0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:41.609747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2f6d6606-0d63-4b32-b712-04471af915b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:41.628280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8f151c27-4d91-4113-b83f-17f4d1b636e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3f3d49a2f6431e9a006aa324911803'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:41.629705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8f151c27-4d91-4113-b83f-17f4d1b636e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3f3d49a2f6431e9a006aa324911803'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:41.651719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8f151c27-4d91-4113-b83f-17f4d1b636e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3f3d49a2f6431e9a006aa324911803'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:41.680611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:41.684678 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2709/5410] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:41 2022] DELETE /identity/v3/users/cc3f3d49a2f6431e9a006aa324911803 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:41.686839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f21f7-edfc-45b3-bcb2-90965528fe65 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:41.687269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f21f7-edfc-45b3-bcb2-90965528fe65 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:41.687553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f21f7-edfc-45b3-bcb2-90965528fe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:41.749246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-aa2f21f7-edfc-45b3-bcb2-90965528fe65 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:41.752950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-aa2f21f7-edfc-45b3-bcb2-90965528fe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:41.819431 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2702/5411] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:41.948126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d6606-0d63-4b32-b712-04471af915b0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:41.950480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2f6d6606-0d63-4b32-b712-04471af915b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:41.982806 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2710/5412] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:42.071096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d6606-0d63-4b32-b712-04471af915b0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:42.137371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5bf59-dff8-49aa-9a07-bc6ac2fa4a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:42.138549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5bf59-dff8-49aa-9a07-bc6ac2fa4a44 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:42.138835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5bf59-dff8-49aa-9a07-bc6ac2fa4a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:42.139110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5bf59-dff8-49aa-9a07-bc6ac2fa4a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:42.150573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f21f7-edfc-45b3-bcb2-90965528fe65 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:42.162187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5bf59-dff8-49aa-9a07-bc6ac2fa4a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:42.163718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5bf59-dff8-49aa-9a07-bc6ac2fa4a44 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:42.171149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f21f7-edfc-45b3-bcb2-90965528fe65 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:42.187450 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2703/5413] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:42.190097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d63b30-d9cc-466d-8833-8407b907a675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:42.191141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d63b30-d9cc-466d-8833-8407b907a675 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:42.197769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d63b30-d9cc-466d-8833-8407b907a675 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:42.198955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d63b30-d9cc-466d-8833-8407b907a675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:42.220646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d63b30-d9cc-466d-8833-8407b907a675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:42.224297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d63b30-d9cc-466d-8833-8407b907a675 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:42.252830 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2711/5414] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:48:42.862753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5bf59-dff8-49aa-9a07-bc6ac2fa4a44 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:42.866093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c4b5bf59-dff8-49aa-9a07-bc6ac2fa4a44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:42.885631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5bf59-dff8-49aa-9a07-bc6ac2fa4a44 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:42.906955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f2732-7e0c-4f96-8708-209caf12698b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:42.907526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f2732-7e0c-4f96-8708-209caf12698b service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:42.907808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f2732-7e0c-4f96-8708-209caf12698b service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:42.908194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f2732-7e0c-4f96-8708-209caf12698b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:42.911329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9b9f2732-7e0c-4f96-8708-209caf12698b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:42.942241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f2732-7e0c-4f96-8708-209caf12698b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:42.944343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f2732-7e0c-4f96-8708-209caf12698b service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:42.960834 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2704/5415] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:48:43.904469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d63b30-d9cc-466d-8833-8407b907a675 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:43.906043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-71d63b30-d9cc-466d-8833-8407b907a675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:43.917458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:43.934626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d63b30-d9cc-466d-8833-8407b907a675 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:43.966639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:43.967348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:43.967587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:43.967858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] PATH_INFO: `/v3/projects/1992525ac2df4ba695aa60e808703806` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:43.975554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=1992525ac2df4ba695aa60e808703806)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:43.977689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:44.187259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1992525ac2df4ba695aa60e808703806', 'request_id': 'req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:44.219293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1992525ac2df4ba695aa60e808703806', 'request_id': 'req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:44.247525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1992525ac2df4ba695aa60e808703806', 'request_id': 'req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:44.290529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] The token cache is being invalidate because project 1992525ac2df4ba695aa60e808703806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:44.291181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:44.293754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6eb70fe-7008-41ce-95fd-9c197a4bb0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:44.296686 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2712/5416] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:43 2022] DELETE /identity/v3/projects/1992525ac2df4ba695aa60e808703806 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:44.305043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79427b-0904-4653-89e9-26573503f7a9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:44.305611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79427b-0904-4653-89e9-26573503f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:44.305892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79427b-0904-4653-89e9-26573503f7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:44.413883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5e79427b-0904-4653-89e9-26573503f7a9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:44.415285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5e79427b-0904-4653-89e9-26573503f7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:44.667724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b0ce-d437-424a-9f05-870c3f450885 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:44.670640 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2705/5417] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:44.679334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b0ce-d437-424a-9f05-870c3f450885 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:44.679872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b0ce-d437-424a-9f05-870c3f450885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:44.785919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3182b0ce-d437-424a-9f05-870c3f450885 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:44.787447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3182b0ce-d437-424a-9f05-870c3f450885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:44.820399 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2713/5418] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:44.822334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79427b-0904-4653-89e9-26573503f7a9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:44.833555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79427b-0904-4653-89e9-26573503f7a9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:44.870133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49f84c-3348-4866-9ffe-f15ac9886031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:44.870776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f84c-3348-4866-9ffe-f15ac9886031 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:44.871054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f84c-3348-4866-9ffe-f15ac9886031 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:44.871329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f84c-3348-4866-9ffe-f15ac9886031 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:44.872167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49f84c-3348-4866-9ffe-f15ac9886031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:44.872474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49f84c-3348-4866-9ffe-f15ac9886031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:44.874777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49f84c-3348-4866-9ffe-f15ac9886031 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:44.909658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182b0ce-d437-424a-9f05-870c3f450885 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:44.910517 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2706/5419] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:44.929332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182b0ce-d437-424a-9f05-870c3f450885 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:44.954551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f91a4-1d31-4dae-88de-97a35cbf4135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:44.955541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f91a4-1d31-4dae-88de-97a35cbf4135 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:44.956202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f91a4-1d31-4dae-88de-97a35cbf4135 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:44.956858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f91a4-1d31-4dae-88de-97a35cbf4135 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:44.959340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f91a4-1d31-4dae-88de-97a35cbf4135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:44.966368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f91a4-1d31-4dae-88de-97a35cbf4135 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:45.058789 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2714/5420] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:44 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:48:45.062958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49f84c-3348-4866-9ffe-f15ac9886031 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:45.068650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:45.077379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49f84c-3348-4866-9ffe-f15ac9886031 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:45.222186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f91a4-1d31-4dae-88de-97a35cbf4135 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:45.224847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a48f91a4-1d31-4dae-88de-97a35cbf4135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:45.296221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aceb16-a38a-4871-b879-22005078ff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:45.297377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aceb16-a38a-4871-b879-22005078ff7e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:45.298083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aceb16-a38a-4871-b879-22005078ff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:45.298366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aceb16-a38a-4871-b879-22005078ff7e admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:45.299022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aceb16-a38a-4871-b879-22005078ff7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:45.303452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aceb16-a38a-4871-b879-22005078ff7e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:45.376130 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2707/5421] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:45 2022] POST /identity/v3/users => generated 292 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:45.377480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aceb16-a38a-4871-b879-22005078ff7e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:45.413515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aceb16-a38a-4871-b879-22005078ff7e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:45.418269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f91a4-1d31-4dae-88de-97a35cbf4135 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:45.431375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715e7d4-7215-4d13-8fcf-3d1e5f40f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:45.432015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715e7d4-7215-4d13-8fcf-3d1e5f40f666 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:45.432298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715e7d4-7215-4d13-8fcf-3d1e5f40f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:45.432577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715e7d4-7215-4d13-8fcf-3d1e5f40f666 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:45.433232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715e7d4-7215-4d13-8fcf-3d1e5f40f666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:45.433959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:45.434873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715e7d4-7215-4d13-8fcf-3d1e5f40f666 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:45.435141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:45.435644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:45.436245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] PATH_INFO: `/v3/projects/7d667a2a076e426d8a9319548597ce2a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:45.438932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d667a2a076e426d8a9319548597ce2a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:45.444915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:45.471532 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2708/5422] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:45.472539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715e7d4-7215-4d13-8fcf-3d1e5f40f666 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:45.496292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715e7d4-7215-4d13-8fcf-3d1e5f40f666 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:45.516401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae336-c971-40fd-97f8-73c1c80bdcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:45.517170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae336-c971-40fd-97f8-73c1c80bdcff admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:45.517471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae336-c971-40fd-97f8-73c1c80bdcff admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:45.517751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae336-c971-40fd-97f8-73c1c80bdcff admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:45.518404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ae336-c971-40fd-97f8-73c1c80bdcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:45.521127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ae336-c971-40fd-97f8-73c1c80bdcff admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:45.559387 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2709/5423] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:45.561004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae336-c971-40fd-97f8-73c1c80bdcff admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:45.588273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d667a2a076e426d8a9319548597ce2a', 'request_id': 'req-ce994b9d-e780-4f9a-9cca-93e99d7a089e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:45.600088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d667a2a076e426d8a9319548597ce2a', 'request_id': 'req-ce994b9d-e780-4f9a-9cca-93e99d7a089e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:45.601840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae336-c971-40fd-97f8-73c1c80bdcff admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:45.610426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:45.622182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d667a2a076e426d8a9319548597ce2a', 'request_id': 'req-ce994b9d-e780-4f9a-9cca-93e99d7a089e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:45.646311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] The token cache is being invalidate because project 7d667a2a076e426d8a9319548597ce2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:45.646665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:45.647536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:45.654190 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2715/5424] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:45 2022] DELETE /identity/v3/projects/7d667a2a076e426d8a9319548597ce2a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:45.656427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:45.659619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:45.841850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcb9a2-6381-482f-a644-7cfedef76cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:45.850760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcb9a2-6381-482f-a644-7cfedef76cde admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:45.851049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcb9a2-6381-482f-a644-7cfedef76cde admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:45.851343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcb9a2-6381-482f-a644-7cfedef76cde admin admin] PATH_INFO: `/v3/projects/a8622c7a8d9149999abd79de8469870f/users/080c5ab5d3014d33a745853ca9b2056b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:45.886031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce994b9d-e780-4f9a-9cca-93e99d7a089e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:45.899979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:45.902741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:45.906386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:45.906813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcb9a2-6381-482f-a644-7cfedef76cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8622c7a8d9149999abd79de8469870f, user_id=080c5ab5d3014d33a745853ca9b2056b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:45.907205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] PATH_INFO: `/v3/users/0d5effea28ef4e5292585de39bf0d090` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:45.910097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcb9a2-6381-482f-a644-7cfedef76cde admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:45.911819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5effea28ef4e5292585de39bf0d090)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:45.916407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:45.976102 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2710/5425] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:45 2022] PUT /identity/v3/projects/a8622c7a8d9149999abd79de8469870f/users/080c5ab5d3014d33a745853ca9b2056b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:45.977931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41002fe3-c4ca-406b-8cd9-5f80e559a982 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:45.978384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41002fe3-c4ca-406b-8cd9-5f80e559a982 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:45.978845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41002fe3-c4ca-406b-8cd9-5f80e559a982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:46.057835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5effea28ef4e5292585de39bf0d090'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:46.058690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5effea28ef4e5292585de39bf0d090'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:46.091983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5effea28ef4e5292585de39bf0d090'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:46.092891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5effea28ef4e5292585de39bf0d090'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:46.122176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5effea28ef4e5292585de39bf0d090'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:46.162383 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2716/5426] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:45 2022] DELETE /identity/v3/users/0d5effea28ef4e5292585de39bf0d090 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:46.440375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-41002fe3-c4ca-406b-8cd9-5f80e559a982 None None] MFA Rules not processed for user `080c5ab5d3014d33a745853ca9b2056b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:46.444170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-41002fe3-c4ca-406b-8cd9-5f80e559a982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:46.594308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:46.641280 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2711/5427] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 664 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:46.645695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:46.647350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:46.813299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a8b38-896f-4495-a720-cc87e5c7e068 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:46.828200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219dfe8-1274-4f00-8cfa-7562912e9714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:46.830287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219dfe8-1274-4f00-8cfa-7562912e9714 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:46.830915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219dfe8-1274-4f00-8cfa-7562912e9714 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:46.831461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219dfe8-1274-4f00-8cfa-7562912e9714 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:46.833155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219dfe8-1274-4f00-8cfa-7562912e9714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:46.836374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219dfe8-1274-4f00-8cfa-7562912e9714 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:46.852268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:46.920554 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2717/5428] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:46 2022] POST /identity/v3/projects => generated 383 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:46.924742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41002fe3-c4ca-406b-8cd9-5f80e559a982 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:46.945044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41002fe3-c4ca-406b-8cd9-5f80e559a982 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:47.040468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219dfe8-1274-4f00-8cfa-7562912e9714 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:47.042454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c219dfe8-1274-4f00-8cfa-7562912e9714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:47.215434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59983d00-dbe4-4fce-aa47-8f3e62b968a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:47.217176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983d00-dbe4-4fce-aa47-8f3e62b968a9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:47.218596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983d00-dbe4-4fce-aa47-8f3e62b968a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:47.218981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983d00-dbe4-4fce-aa47-8f3e62b968a9 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:47.219949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59983d00-dbe4-4fce-aa47-8f3e62b968a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:47.222724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59983d00-dbe4-4fce-aa47-8f3e62b968a9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:47.289861 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2712/5429] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:46 2022] POST /identity/v3/users => generated 298 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:47.292591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59983d00-dbe4-4fce-aa47-8f3e62b968a9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:47.327818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59983d00-dbe4-4fce-aa47-8f3e62b968a9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:47.352812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5905-6179-43bc-b452-1ada69731b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:47.355686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5905-6179-43bc-b452-1ada69731b8e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:47.356670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5905-6179-43bc-b452-1ada69731b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:47.357501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5905-6179-43bc-b452-1ada69731b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:47.360285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219dfe8-1274-4f00-8cfa-7562912e9714 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:47.361524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5905-6179-43bc-b452-1ada69731b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:47.365601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5905-6179-43bc-b452-1ada69731b8e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:47.384609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:47.385465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:47.386784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:47.387822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] PATH_INFO: `/v3/projects/79429880296b4fd09c71c560142f1393` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:47.393885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=79429880296b4fd09c71c560142f1393)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:47.396095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:47.414063 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2713/5430] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:47.415256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5905-6179-43bc-b452-1ada69731b8e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:47.464772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5905-6179-43bc-b452-1ada69731b8e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:47.484641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff258ad3-8f01-4dc3-b723-9241fa8c0ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:47.491259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258ad3-8f01-4dc3-b723-9241fa8c0ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:47.491472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258ad3-8f01-4dc3-b723-9241fa8c0ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:47.493568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258ad3-8f01-4dc3-b723-9241fa8c0ce8 admin admin] PATH_INFO: `/v3/projects/c8495fcddf8d46e5835414b072f1f3b8/users/32ec7005caf3413d9819edba1a66185a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:47.547955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff258ad3-8f01-4dc3-b723-9241fa8c0ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8495fcddf8d46e5835414b072f1f3b8, user_id=32ec7005caf3413d9819edba1a66185a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:47.559969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff258ad3-8f01-4dc3-b723-9241fa8c0ce8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:47.610165 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2714/5431] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:47 2022] PUT /identity/v3/projects/c8495fcddf8d46e5835414b072f1f3b8/users/32ec7005caf3413d9819edba1a66185a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:47.615368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff258ad3-8f01-4dc3-b723-9241fa8c0ce8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:47.640462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79429880296b4fd09c71c560142f1393', 'request_id': 'req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:47.670132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79429880296b4fd09c71c560142f1393', 'request_id': 'req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:47.690600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79429880296b4fd09c71c560142f1393', 'request_id': 'req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:47.743877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] The token cache is being invalidate because project 79429880296b4fd09c71c560142f1393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:47.755715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:47.760159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce6eb50c-b7ad-4dbc-a7ac-a999e2532e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:47.762479 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2718/5432] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:47 2022] DELETE /identity/v3/projects/79429880296b4fd09c71c560142f1393 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:47.769139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04961bc8-e082-4610-9a92-0e1e7e527a8a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:47.769638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04961bc8-e082-4610-9a92-0e1e7e527a8a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:47.770020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04961bc8-e082-4610-9a92-0e1e7e527a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:47.782590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff258ad3-8f01-4dc3-b723-9241fa8c0ce8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:47.804279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d13933-8595-417d-b4e0-5340dd1961a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:47.805764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d13933-8595-417d-b4e0-5340dd1961a9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:47.809823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d13933-8595-417d-b4e0-5340dd1961a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:47.810492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d13933-8595-417d-b4e0-5340dd1961a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:47.811420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d13933-8595-417d-b4e0-5340dd1961a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:47.813708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d13933-8595-417d-b4e0-5340dd1961a9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:47.847179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-04961bc8-e082-4610-9a92-0e1e7e527a8a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:47.849246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-04961bc8-e082-4610-9a92-0e1e7e527a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:47.854483 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2715/5433] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:47.856641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d13933-8595-417d-b4e0-5340dd1961a9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:47.868826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76d13933-8595-417d-b4e0-5340dd1961a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:47.884091 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2719/5434] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:47.892050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63848151-0eb2-41d0-9310-d1671dc5187f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:47.892343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63848151-0eb2-41d0-9310-d1671dc5187f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:47.892680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63848151-0eb2-41d0-9310-d1671dc5187f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:47.903491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d13933-8595-417d-b4e0-5340dd1961a9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:47.929764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76260c5e-7435-446f-9b25-cd78dc382dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:47.930448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76260c5e-7435-446f-9b25-cd78dc382dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:47.930724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76260c5e-7435-446f-9b25-cd78dc382dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:47.931002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76260c5e-7435-446f-9b25-cd78dc382dd0 admin admin] PATH_INFO: `/v3/projects/c8495fcddf8d46e5835414b072f1f3b8/users/32ec7005caf3413d9819edba1a66185a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:47.933216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76260c5e-7435-446f-9b25-cd78dc382dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8495fcddf8d46e5835414b072f1f3b8, user_id=32ec7005caf3413d9819edba1a66185a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:47.935923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76260c5e-7435-446f-9b25-cd78dc382dd0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:47.952720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-63848151-0eb2-41d0-9310-d1671dc5187f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:47.953980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-63848151-0eb2-41d0-9310-d1671dc5187f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:47.990114 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2716/5435] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:47 2022] PUT /identity/v3/projects/c8495fcddf8d46e5835414b072f1f3b8/users/32ec7005caf3413d9819edba1a66185a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:47.995850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31eaa-e48d-44e4-a44b-d94348591a4e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:47.996133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31eaa-e48d-44e4-a44b-d94348591a4e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:47.996628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe31eaa-e48d-44e4-a44b-d94348591a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:48.088157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cfe31eaa-e48d-44e4-a44b-d94348591a4e None None] MFA Rules not processed for user `32ec7005caf3413d9819edba1a66185a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:48.089426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cfe31eaa-e48d-44e4-a44b-d94348591a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:48.124940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:48.220460 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2720/5436] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:48.222030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63848151-0eb2-41d0-9310-d1671dc5187f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:48.266551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63848151-0eb2-41d0-9310-d1671dc5187f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:48.292629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c5a0a-61e4-48f1-9b84-da9f7686a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:48.294405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c5a0a-61e4-48f1-9b84-da9f7686a1eb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:48.294635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c5a0a-61e4-48f1-9b84-da9f7686a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:48.295281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c5a0a-61e4-48f1-9b84-da9f7686a1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:48.297628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c5a0a-61e4-48f1-9b84-da9f7686a1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:48.298366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c5a0a-61e4-48f1-9b84-da9f7686a1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:48.300174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c5a0a-61e4-48f1-9b84-da9f7686a1eb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:48.346783 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2721/5437] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:48.348167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c5a0a-61e4-48f1-9b84-da9f7686a1eb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:48.368577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:48.377354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c5a0a-61e4-48f1-9b84-da9f7686a1eb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:48.387394 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2717/5438] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:48.395764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedeff4-201a-4f60-a089-13af55cfb297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:48.396383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedeff4-201a-4f60-a089-13af55cfb297 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:48.396872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedeff4-201a-4f60-a089-13af55cfb297 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:48.397015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedeff4-201a-4f60-a089-13af55cfb297 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:48.397585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedeff4-201a-4f60-a089-13af55cfb297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:48.398993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe31eaa-e48d-44e4-a44b-d94348591a4e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:48.400454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cfe31eaa-e48d-44e4-a44b-d94348591a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:48.401756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedeff4-201a-4f60-a089-13af55cfb297 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:48.459382 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2722/5439] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:48 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:48.463864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedeff4-201a-4f60-a089-13af55cfb297 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:48.591331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe31eaa-e48d-44e4-a44b-d94348591a4e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:48.639787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedeff4-201a-4f60-a089-13af55cfb297 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:48.657031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea451e2f-a011-4e53-9475-051874e61f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:48.657690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451e2f-a011-4e53-9475-051874e61f4a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:48.657975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451e2f-a011-4e53-9475-051874e61f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:48.658618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451e2f-a011-4e53-9475-051874e61f4a admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:48.659278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea451e2f-a011-4e53-9475-051874e61f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:48.662072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea451e2f-a011-4e53-9475-051874e61f4a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:48.695748 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2723/5440] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:48 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:48.701123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea451e2f-a011-4e53-9475-051874e61f4a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:48.713275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea451e2f-a011-4e53-9475-051874e61f4a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:48.721131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba9dc9-4369-464a-bea9-8eefa25f529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:48.721867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9dc9-4369-464a-bea9-8eefa25f529a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:48.722153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9dc9-4369-464a-bea9-8eefa25f529a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:48.724746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9dc9-4369-464a-bea9-8eefa25f529a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:48.725492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba9dc9-4369-464a-bea9-8eefa25f529a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:48.727158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba9dc9-4369-464a-bea9-8eefa25f529a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:48.744451 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2724/5441] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:48.745465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba9dc9-4369-464a-bea9-8eefa25f529a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:48.759628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba9dc9-4369-464a-bea9-8eefa25f529a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:48.771508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c508-7f01-4654-9d06-90b012aaf606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:48.772151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c508-7f01-4654-9d06-90b012aaf606 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:48.772430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c508-7f01-4654-9d06-90b012aaf606 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:48.772703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c508-7f01-4654-9d06-90b012aaf606 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:48.773319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf6a4-a821-4729-9758-5c7775262ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:48.773550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707c508-7f01-4654-9d06-90b012aaf606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:48.774038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf6a4-a821-4729-9758-5c7775262ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:48.774317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf6a4-a821-4729-9758-5c7775262ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:48.774592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf6a4-a821-4729-9758-5c7775262ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:48.777939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707c508-7f01-4654-9d06-90b012aaf606 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:48.778256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-12fbf6a4-a821-4729-9758-5c7775262ed0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:48.810941 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2725/5442] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:48.812005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c508-7f01-4654-9d06-90b012aaf606 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:48.867269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c508-7f01-4654-9d06-90b012aaf606 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:48.907629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52665cb2-b8e2-4429-8329-4c9f6bcd5d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:48.908067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52665cb2-b8e2-4429-8329-4c9f6bcd5d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:48.908348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52665cb2-b8e2-4429-8329-4c9f6bcd5d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:48.908623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52665cb2-b8e2-4429-8329-4c9f6bcd5d63 admin admin] PATH_INFO: `/v3/projects/57890a8a89034fd5a3b3b085c69c869e/users/a4acf25129714c5d8787610da82e0dc7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:48.937822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52665cb2-b8e2-4429-8329-4c9f6bcd5d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57890a8a89034fd5a3b3b085c69c869e, user_id=a4acf25129714c5d8787610da82e0dc7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:48.940596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52665cb2-b8e2-4429-8329-4c9f6bcd5d63 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:48.972984 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2726/5443] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:48 2022] PUT /identity/v3/projects/57890a8a89034fd5a3b3b085c69c869e/users/a4acf25129714c5d8787610da82e0dc7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:48.983327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a012bd-7d11-45fc-942d-a0255ec88d59 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:48.983609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a012bd-7d11-45fc-942d-a0255ec88d59 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:48.984065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a012bd-7d11-45fc-942d-a0255ec88d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:49.012839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:49.017618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbf6a4-a821-4729-9758-5c7775262ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:49.019074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbf6a4-a821-4729-9758-5c7775262ed0 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:49.047520 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2718/5444] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:49.078612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e0a012bd-7d11-45fc-942d-a0255ec88d59 None None] MFA Rules not processed for user `a4acf25129714c5d8787610da82e0dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:49.088657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e0a012bd-7d11-45fc-942d-a0255ec88d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:49.323443 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2727/5445] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:49.328096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf6a4-a821-4729-9758-5c7775262ed0 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:49.528616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf6a4-a821-4729-9758-5c7775262ed0 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:49.542996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d894-707c-4f00-932c-11277a502024 tempest-DefaultDomainTestJSON-2116804781 tempest-DefaultDomainTestJSON-2116804781-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4acf25129714c5d8787610da82e0dc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57890a8a89034fd5a3b3b085c69c869e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:49.543935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d894-707c-4f00-932c-11277a502024 tempest-DefaultDomainTestJSON-2116804781 tempest-DefaultDomainTestJSON-2116804781-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:49.544210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d894-707c-4f00-932c-11277a502024 tempest-DefaultDomainTestJSON-2116804781 tempest-DefaultDomainTestJSON-2116804781-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:49.544509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d894-707c-4f00-932c-11277a502024 tempest-DefaultDomainTestJSON-2116804781 tempest-DefaultDomainTestJSON-2116804781-project] PATH_INFO: `/v3/domains/default` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:49.549332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6d894-707c-4f00-932c-11277a502024 tempest-DefaultDomainTestJSON-2116804781 tempest-DefaultDomainTestJSON-2116804781-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:49.551744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6d894-707c-4f00-932c-11277a502024 tempest-DefaultDomainTestJSON-2116804781 tempest-DefaultDomainTestJSON-2116804781-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:49.557236 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2719/5446] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Aug 29 15:48:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:49.561283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a012bd-7d11-45fc-942d-a0255ec88d59 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:49.592588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:49.790408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a012bd-7d11-45fc-942d-a0255ec88d59 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:49.804761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:49.809094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:49.810760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:49.812126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] PATH_INFO: `/v3/users/a4acf25129714c5d8787610da82e0dc7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:49.820042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4acf25129714c5d8787610da82e0dc7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:49.834936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:49.959100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4acf25129714c5d8787610da82e0dc7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:49.961049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4acf25129714c5d8787610da82e0dc7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:50.009247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4acf25129714c5d8787610da82e0dc7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:50.014434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4acf25129714c5d8787610da82e0dc7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:50.058971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4acf25129714c5d8787610da82e0dc7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:50.103058 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2728/5447] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:49 2022] DELETE /identity/v3/users/a4acf25129714c5d8787610da82e0dc7 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:50.108080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6b8d9-1e81-4545-98a7-5dabb1de8e3c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:50.110387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6b8d9-1e81-4545-98a7-5dabb1de8e3c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:50.111060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6b8d9-1e81-4545-98a7-5dabb1de8e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:50.166459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-09a6b8d9-1e81-4545-98a7-5dabb1de8e3c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:50.167475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-09a6b8d9-1e81-4545-98a7-5dabb1de8e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:50.326357 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2720/5448] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:50.354145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:50.358390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:50.715701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24304fb6-c5a4-480e-8497-3f895f8bd083 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:50.730934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fd77b-5856-426b-9db9-aa573dac7e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:50.736112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fd77b-5856-426b-9db9-aa573dac7e5e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:50.737996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fd77b-5856-426b-9db9-aa573dac7e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:50.738564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fd77b-5856-426b-9db9-aa573dac7e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:50.782257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fd77b-5856-426b-9db9-aa573dac7e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:50.789431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fd77b-5856-426b-9db9-aa573dac7e5e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:50.863164 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2729/5449] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:52.547906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6b8d9-1e81-4545-98a7-5dabb1de8e3c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:52.549338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-09a6b8d9-1e81-4545-98a7-5dabb1de8e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:52.588499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6b8d9-1e81-4545-98a7-5dabb1de8e3c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:52.605049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:52.608755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:52.609084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:52.609332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] PATH_INFO: `/v3/projects/57890a8a89034fd5a3b3b085c69c869e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:52.613412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=57890a8a89034fd5a3b3b085c69c869e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:52.626830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:52.811801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57890a8a89034fd5a3b3b085c69c869e', 'request_id': 'req-18f8ea7a-09cc-4310-a394-85976a1e2e5a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:52.832625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57890a8a89034fd5a3b3b085c69c869e', 'request_id': 'req-18f8ea7a-09cc-4310-a394-85976a1e2e5a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:52.851672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57890a8a89034fd5a3b3b085c69c869e', 'request_id': 'req-18f8ea7a-09cc-4310-a394-85976a1e2e5a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:52.925204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] The token cache is being invalidate because project 57890a8a89034fd5a3b3b085c69c869e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:48:52.926763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:52.928974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-18f8ea7a-09cc-4310-a394-85976a1e2e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:52.937103 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2721/5450] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:52 2022] DELETE /identity/v3/projects/57890a8a89034fd5a3b3b085c69c869e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:52.938854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180a3c-b017-4e29-9e54-a9842a4986d3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:52.939292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180a3c-b017-4e29-9e54-a9842a4986d3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:52.939409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180a3c-b017-4e29-9e54-a9842a4986d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:53.006004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-63180a3c-b017-4e29-9e54-a9842a4986d3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:53.007267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-63180a3c-b017-4e29-9e54-a9842a4986d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:53.202185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:53.450430 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2730/5451] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:53.455365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708dce-3a12-4eb8-afae-a3637aac92ac None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:53.455653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708dce-3a12-4eb8-afae-a3637aac92ac None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:53.455932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708dce-3a12-4eb8-afae-a3637aac92ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:53.529594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-39708dce-3a12-4eb8-afae-a3637aac92ac None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:53.530827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-39708dce-3a12-4eb8-afae-a3637aac92ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:53.576942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63180a3c-b017-4e29-9e54-a9842a4986d3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:53.591180 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2722/5452] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:48:53.598670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63180a3c-b017-4e29-9e54-a9842a4986d3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:53.642176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c4dc4-86b5-4449-a464-53dc65a7e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:53.643093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c4dc4-86b5-4449-a464-53dc65a7e703 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:53.643508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c4dc4-86b5-4449-a464-53dc65a7e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:53.643910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c4dc4-86b5-4449-a464-53dc65a7e703 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:53.645544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c4dc4-86b5-4449-a464-53dc65a7e703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:48:53.650553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c4dc4-86b5-4449-a464-53dc65a7e703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:53.653348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c4dc4-86b5-4449-a464-53dc65a7e703 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:53.735064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39708dce-3a12-4eb8-afae-a3637aac92ac None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:53.747756 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2731/5453] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:53.753050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39708dce-3a12-4eb8-afae-a3637aac92ac None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:53.786456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea6ad9-f75a-4225-9071-d14df151a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:53.787116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6ad9-f75a-4225-9071-d14df151a53b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:53.787399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6ad9-f75a-4225-9071-d14df151a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:53.787770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6ad9-f75a-4225-9071-d14df151a53b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:53.788348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea6ad9-f75a-4225-9071-d14df151a53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:53.807185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea6ad9-f75a-4225-9071-d14df151a53b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:53.934383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:53.982549 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2723/5454] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:48:53 2022] POST /identity/v3/projects => generated 371 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:48:53.987227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c4dc4-86b5-4449-a464-53dc65a7e703 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:54.024608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c4dc4-86b5-4449-a464-53dc65a7e703 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:54.204746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083876f-66c8-4429-b631-239836ef807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:54.205745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083876f-66c8-4429-b631-239836ef807c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:54.206210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083876f-66c8-4429-b631-239836ef807c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:54.206640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083876f-66c8-4429-b631-239836ef807c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:54.207512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083876f-66c8-4429-b631-239836ef807c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:54.213626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083876f-66c8-4429-b631-239836ef807c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:54.260302 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2732/5455] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:48:53 2022] POST /identity/v3/users => generated 286 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:54.265609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea6ad9-f75a-4225-9071-d14df151a53b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:54.279630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea6ad9-f75a-4225-9071-d14df151a53b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:54.311334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb236b1a-a915-4178-beb1-9cfd1bc4d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:54.311334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb236b1a-a915-4178-beb1-9cfd1bc4d9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:54.311334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb236b1a-a915-4178-beb1-9cfd1bc4d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:54.311655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb236b1a-a915-4178-beb1-9cfd1bc4d9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:54.319448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb236b1a-a915-4178-beb1-9cfd1bc4d9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:54.321097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb236b1a-a915-4178-beb1-9cfd1bc4d9f2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:54.376841 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2724/5456] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:48:54.377146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083876f-66c8-4429-b631-239836ef807c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:54.395899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083876f-66c8-4429-b631-239836ef807c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:54.414005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e91b8-c1ef-4bc8-ba6d-82909f46d09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:54.415793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e91b8-c1ef-4bc8-ba6d-82909f46d09b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:54.416246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e91b8-c1ef-4bc8-ba6d-82909f46d09b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:54.417796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e91b8-c1ef-4bc8-ba6d-82909f46d09b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:54.420606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e91b8-c1ef-4bc8-ba6d-82909f46d09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:54.427139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e91b8-c1ef-4bc8-ba6d-82909f46d09b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:54.464140 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2733/5457] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:48:54.469878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb236b1a-a915-4178-beb1-9cfd1bc4d9f2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:54.492138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb236b1a-a915-4178-beb1-9cfd1bc4d9f2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:54.506898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98f0d2-2d83-4c40-8e15-6f0193210a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:54.507604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98f0d2-2d83-4c40-8e15-6f0193210a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:54.507886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98f0d2-2d83-4c40-8e15-6f0193210a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:54.508164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98f0d2-2d83-4c40-8e15-6f0193210a4a admin admin] PATH_INFO: `/v3/projects/e0c60e1aa99f4b00a285b52255c89660/users/2f3c09483e51455ab21c0382bc264690/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:54.594552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98f0d2-2d83-4c40-8e15-6f0193210a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c60e1aa99f4b00a285b52255c89660, user_id=2f3c09483e51455ab21c0382bc264690, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:54.597167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98f0d2-2d83-4c40-8e15-6f0193210a4a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:54.654277 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2725/5458] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:48:54 2022] PUT /identity/v3/projects/e0c60e1aa99f4b00a285b52255c89660/users/2f3c09483e51455ab21c0382bc264690/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:54.675248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720cf1-3e4e-4e16-b540-e00a5e68fb72 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:54.675894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720cf1-3e4e-4e16-b540-e00a5e68fb72 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:54.676369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720cf1-3e4e-4e16-b540-e00a5e68fb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:54.798870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f3720cf1-3e4e-4e16-b540-e00a5e68fb72 None None] MFA Rules not processed for user `2f3c09483e51455ab21c0382bc264690`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:54.800014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f3720cf1-3e4e-4e16-b540-e00a5e68fb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:54.958771 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2734/5459] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:54.961155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98f0d2-2d83-4c40-8e15-6f0193210a4a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:54.981568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98f0d2-2d83-4c40-8e15-6f0193210a4a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:55.016889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad64ab1-4c33-49e2-8133-1d0fb94e2453 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:55.017669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64ab1-4c33-49e2-8133-1d0fb94e2453 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.017957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64ab1-4c33-49e2-8133-1d0fb94e2453 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.018237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64ab1-4c33-49e2-8133-1d0fb94e2453 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.019024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad64ab1-4c33-49e2-8133-1d0fb94e2453 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=2f3c09483e51455ab21c0382bc264690)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:55.021181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad64ab1-4c33-49e2-8133-1d0fb94e2453 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:55.116949 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2726/5460] 10.222.0.16 () {60 vars in 1299 bytes} [Mon Aug 29 15:48:54 2022] POST /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2 => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:55.121064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3720cf1-3e4e-4e16-b540-e00a5e68fb72 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:55.142405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3720cf1-3e4e-4e16-b540-e00a5e68fb72 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:55.162770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ad4d0-61f2-49f2-ab25-9bbc9d8598f7 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:55.163698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ad4d0-61f2-49f2-ab25-9bbc9d8598f7 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.164672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ad4d0-61f2-49f2-ab25-9bbc9d8598f7 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.165130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ad4d0-61f2-49f2-ab25-9bbc9d8598f7 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/583054a8e58f4e31af9fabcaa68a79d4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.169548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ad4d0-61f2-49f2-ab25-9bbc9d8598f7 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=2f3c09483e51455ab21c0382bc264690, credential_id=583054a8e58f4e31af9fabcaa68a79d4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:55.175855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ad4d0-61f2-49f2-ab25-9bbc9d8598f7 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:55.213725 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2735/5461] 10.222.0.16 () {58 vars in 1380 bytes} [Mon Aug 29 15:48:55 2022] DELETE /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/583054a8e58f4e31af9fabcaa68a79d4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:55.219997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad64ab1-4c33-49e2-8133-1d0fb94e2453 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:55.234024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad64ab1-4c33-49e2-8133-1d0fb94e2453 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:55.252566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a12a49-6adf-4007-88c4-d63fc335682b tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:55.253330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a12a49-6adf-4007-88c4-d63fc335682b tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.254142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a12a49-6adf-4007-88c4-d63fc335682b tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.254669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a12a49-6adf-4007-88c4-d63fc335682b tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.255462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a12a49-6adf-4007-88c4-d63fc335682b tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=2f3c09483e51455ab21c0382bc264690)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:55.262458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a12a49-6adf-4007-88c4-d63fc335682b tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:55.296285 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2727/5462] 10.222.0.16 () {60 vars in 1299 bytes} [Mon Aug 29 15:48:55 2022] POST /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2 => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:55.304901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ad4d0-61f2-49f2-ab25-9bbc9d8598f7 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:55.316105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ad4d0-61f2-49f2-ab25-9bbc9d8598f7 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:55.326886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d5828-2f3d-42b0-a192-451dda2e70cb tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:55.328038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d5828-2f3d-42b0-a192-451dda2e70cb tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.329790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d5828-2f3d-42b0-a192-451dda2e70cb tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.330258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d5828-2f3d-42b0-a192-451dda2e70cb tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/13181da19eee412f8a834df0e9fa510c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.336652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d5828-2f3d-42b0-a192-451dda2e70cb tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=2f3c09483e51455ab21c0382bc264690, credential_id=13181da19eee412f8a834df0e9fa510c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:55.342136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d5828-2f3d-42b0-a192-451dda2e70cb tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:55.369475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:55.376592 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2736/5463] 10.222.0.16 () {58 vars in 1380 bytes} [Mon Aug 29 15:48:55 2022] DELETE /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/13181da19eee412f8a834df0e9fa510c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:55.382976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a12a49-6adf-4007-88c4-d63fc335682b tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:55.397420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a12a49-6adf-4007-88c4-d63fc335682b tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:55.400656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d5828-2f3d-42b0-a192-451dda2e70cb tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:55.402725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5c3d5828-2f3d-42b0-a192-451dda2e70cb tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:55.421566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305571a1-6fe8-46fd-af57-8f7d4e8b6671 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:55.422469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305571a1-6fe8-46fd-af57-8f7d4e8b6671 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.426452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305571a1-6fe8-46fd-af57-8f7d4e8b6671 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.427786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305571a1-6fe8-46fd-af57-8f7d4e8b6671 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/13181da19eee412f8a834df0e9fa510c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-305571a1-6fe8-46fd-af57-8f7d4e8b6671 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Could not find credential: 52eab04e8a0b663a2811bc3a78e118abf6b9df648114a4ab048e45e80f672b67.: keystone.exception.CredentialNotFound: Could not find credential: 52eab04e8a0b663a2811bc3a78e118abf6b9df648114a4ab048e45e80f672b67. Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Aug 29 15:48:55.470544 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:48:55.471823 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 52eab04e8a0b663a2811bc3a78e118abf6b9df648114a4ab048e45e80f672b67. Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:48:55.473253 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2728/5464] 10.222.0.16 () {58 vars in 1377 bytes} [Mon Aug 29 15:48:55 2022] GET /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/13181da19eee412f8a834df0e9fa510c => generated 148 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:48:55.477224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305571a1-6fe8-46fd-af57-8f7d4e8b6671 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:55.510251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305571a1-6fe8-46fd-af57-8f7d4e8b6671 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:55.529651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662833c-393f-47b7-aa2d-1335cedc05bf tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:55.530309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662833c-393f-47b7-aa2d-1335cedc05bf tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.530596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662833c-393f-47b7-aa2d-1335cedc05bf tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.530874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662833c-393f-47b7-aa2d-1335cedc05bf tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.541003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662833c-393f-47b7-aa2d-1335cedc05bf tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=2f3c09483e51455ab21c0382bc264690)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:55.542628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662833c-393f-47b7-aa2d-1335cedc05bf tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:55.610856 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2729/5465] 10.222.0.16 () {60 vars in 1299 bytes} [Mon Aug 29 15:48:55 2022] POST /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2 => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:55.615721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662833c-393f-47b7-aa2d-1335cedc05bf tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:55.685193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662833c-393f-47b7-aa2d-1335cedc05bf tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:55.694158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b452eba-c869-4bfa-8ee7-0aa7e91bc989 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:55.696601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452eba-c869-4bfa-8ee7-0aa7e91bc989 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.697544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452eba-c869-4bfa-8ee7-0aa7e91bc989 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.698439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452eba-c869-4bfa-8ee7-0aa7e91bc989 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.700149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b452eba-c869-4bfa-8ee7-0aa7e91bc989 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=2f3c09483e51455ab21c0382bc264690)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:55.704054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b452eba-c869-4bfa-8ee7-0aa7e91bc989 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:55.755506 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2730/5466] 10.222.0.16 () {60 vars in 1299 bytes} [Mon Aug 29 15:48:55 2022] POST /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2 => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:55.757533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b452eba-c869-4bfa-8ee7-0aa7e91bc989 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:55.803161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b452eba-c869-4bfa-8ee7-0aa7e91bc989 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:55.825244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93049-0bc7-4925-a7a3-9c6962f4aea8 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:55.826800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93049-0bc7-4925-a7a3-9c6962f4aea8 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.828336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d5828-2f3d-42b0-a192-451dda2e70cb tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:55.829568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93049-0bc7-4925-a7a3-9c6962f4aea8 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.834636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93049-0bc7-4925-a7a3-9c6962f4aea8 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.836259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d93049-0bc7-4925-a7a3-9c6962f4aea8 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=2f3c09483e51455ab21c0382bc264690)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:55.842328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d93049-0bc7-4925-a7a3-9c6962f4aea8 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:55.849325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509b136-cd9b-4088-8204-d063bcfb8faf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:55.850055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b136-cd9b-4088-8204-d063bcfb8faf service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.850336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b136-cd9b-4088-8204-d063bcfb8faf service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.850605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b136-cd9b-4088-8204-d063bcfb8faf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.853017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3509b136-cd9b-4088-8204-d063bcfb8faf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:55.874648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509b136-cd9b-4088-8204-d063bcfb8faf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:55.876694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509b136-cd9b-4088-8204-d063bcfb8faf service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:55.886064 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2731/5467] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Aug 29 15:48:55 2022] GET /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2 => generated 865 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:55.904293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93049-0bc7-4925-a7a3-9c6962f4aea8 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:55.916307 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2737/5468] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:55.959803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93049-0bc7-4925-a7a3-9c6962f4aea8 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:55.974458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bd4ab-1fb0-449d-9a15-ad467fbdc677 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:55.975444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bd4ab-1fb0-449d-9a15-ad467fbdc677 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:55.975893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bd4ab-1fb0-449d-9a15-ad467fbdc677 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:55.976341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bd4ab-1fb0-449d-9a15-ad467fbdc677 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/57680574091940feb5b46bf6fdb54938` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:55.979289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bd4ab-1fb0-449d-9a15-ad467fbdc677 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=2f3c09483e51455ab21c0382bc264690, credential_id=57680574091940feb5b46bf6fdb54938)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:55.983539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bd4ab-1fb0-449d-9a15-ad467fbdc677 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:56.026685 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2732/5469] 10.222.0.16 () {58 vars in 1380 bytes} [Mon Aug 29 15:48:55 2022] DELETE /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/57680574091940feb5b46bf6fdb54938 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:56.032217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509b136-cd9b-4088-8204-d063bcfb8faf service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:56.053505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509b136-cd9b-4088-8204-d063bcfb8faf service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:56.086407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420de3a6-9bc6-4a44-9bbd-a9f51b479b33 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:56.087257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de3a6-9bc6-4a44-9bbd-a9f51b479b33 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:56.087540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de3a6-9bc6-4a44-9bbd-a9f51b479b33 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:56.087854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de3a6-9bc6-4a44-9bbd-a9f51b479b33 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/3eb275846be947adb2d5e038287001f9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:56.093273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420de3a6-9bc6-4a44-9bbd-a9f51b479b33 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=2f3c09483e51455ab21c0382bc264690, credential_id=3eb275846be947adb2d5e038287001f9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:56.117081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420de3a6-9bc6-4a44-9bbd-a9f51b479b33 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:56.207915 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2738/5470] 10.222.0.16 () {58 vars in 1380 bytes} [Mon Aug 29 15:48:56 2022] DELETE /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/3eb275846be947adb2d5e038287001f9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:56.213292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bd4ab-1fb0-449d-9a15-ad467fbdc677 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:56.247110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bd4ab-1fb0-449d-9a15-ad467fbdc677 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:56.271057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45c09b-bb5e-43b2-86a3-b51344a83c67 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:56.273898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c09b-bb5e-43b2-86a3-b51344a83c67 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:56.274370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c09b-bb5e-43b2-86a3-b51344a83c67 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:56.284328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c09b-bb5e-43b2-86a3-b51344a83c67 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:56.285848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45c09b-bb5e-43b2-86a3-b51344a83c67 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=2f3c09483e51455ab21c0382bc264690)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:56.287536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45c09b-bb5e-43b2-86a3-b51344a83c67 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:56.353367 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2733/5471] 10.222.0.16 () {60 vars in 1299 bytes} [Mon Aug 29 15:48:56 2022] POST /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2 => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:48:56.357634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420de3a6-9bc6-4a44-9bbd-a9f51b479b33 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:56.386551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420de3a6-9bc6-4a44-9bbd-a9f51b479b33 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:56.397715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a415cb-875d-4842-84ef-e73420fcd986 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:56.398395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a415cb-875d-4842-84ef-e73420fcd986 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:56.398691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a415cb-875d-4842-84ef-e73420fcd986 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:56.402613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a415cb-875d-4842-84ef-e73420fcd986 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/6d1708ec473d4e2cba6231ad8bab70ba` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:56.416378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a415cb-875d-4842-84ef-e73420fcd986 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=2f3c09483e51455ab21c0382bc264690, credential_id=6d1708ec473d4e2cba6231ad8bab70ba)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:56.427295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a415cb-875d-4842-84ef-e73420fcd986 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:56.446828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45c09b-bb5e-43b2-86a3-b51344a83c67 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:56.452956 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2739/5472] 10.222.0.16 () {58 vars in 1377 bytes} [Mon Aug 29 15:48:56 2022] GET /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/6d1708ec473d4e2cba6231ad8bab70ba => generated 367 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:48:56.461513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45c09b-bb5e-43b2-86a3-b51344a83c67 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:56.473911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc022b32-0f59-40d6-82fc-02caf9152a71 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f3c09483e51455ab21c0382bc264690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c60e1aa99f4b00a285b52255c89660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:56.475205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022b32-0f59-40d6-82fc-02caf9152a71 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:56.475657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022b32-0f59-40d6-82fc-02caf9152a71 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:56.476254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022b32-0f59-40d6-82fc-02caf9152a71 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/6d1708ec473d4e2cba6231ad8bab70ba` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:56.484172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc022b32-0f59-40d6-82fc-02caf9152a71 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=2f3c09483e51455ab21c0382bc264690, credential_id=6d1708ec473d4e2cba6231ad8bab70ba)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:56.486182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc022b32-0f59-40d6-82fc-02caf9152a71 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:56.526729 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2734/5473] 10.222.0.16 () {58 vars in 1380 bytes} [Mon Aug 29 15:48:56 2022] DELETE /identity/v3/users/2f3c09483e51455ab21c0382bc264690/credentials/OS-EC2/6d1708ec473d4e2cba6231ad8bab70ba => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:48:56.531380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a415cb-875d-4842-84ef-e73420fcd986 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:56.764671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a415cb-875d-4842-84ef-e73420fcd986 tempest-EC2CredentialsTest-390553214 tempest-EC2CredentialsTest-390553214-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:56.787869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:56.788773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:56.789062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:56.789334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] PATH_INFO: `/v3/users/2f3c09483e51455ab21c0382bc264690` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:56.795324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3c09483e51455ab21c0382bc264690)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:56.806081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:56.991558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3c09483e51455ab21c0382bc264690'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:56.992250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3c09483e51455ab21c0382bc264690'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:57.039860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:57.049557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3c09483e51455ab21c0382bc264690'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:57.051308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3c09483e51455ab21c0382bc264690'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:57.078284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3c09483e51455ab21c0382bc264690'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:48:57.115972 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2740/5474] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:48:56 2022] DELETE /identity/v3/users/2f3c09483e51455ab21c0382bc264690 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:48:57.120308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bcfe5-5bad-4c35-b891-1cd544b338fe None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:57.120854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bcfe5-5bad-4c35-b891-1cd544b338fe None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:57.120854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bcfe5-5bad-4c35-b891-1cd544b338fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:57.178250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-072bcfe5-5bad-4c35-b891-1cd544b338fe None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:48:57.181744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-072bcfe5-5bad-4c35-b891-1cd544b338fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:57.427301 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2735/5475] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:48:57.507536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:57.509786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:57.736527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b914-b735-4a32-9f3f-f21ea21fb0e7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:57.758105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc059e86-d572-46a7-bbcd-18443335ff6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:57.759252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc059e86-d572-46a7-bbcd-18443335ff6b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:57.759665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc059e86-d572-46a7-bbcd-18443335ff6b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:57.760056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc059e86-d572-46a7-bbcd-18443335ff6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:57.782996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc059e86-d572-46a7-bbcd-18443335ff6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:57.784797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc059e86-d572-46a7-bbcd-18443335ff6b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:57.820920 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2741/5476] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:48:58.273342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bcfe5-5bad-4c35-b891-1cd544b338fe None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:48:58.276897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-072bcfe5-5bad-4c35-b891-1cd544b338fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:58.338015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:58.627575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bcfe5-5bad-4c35-b891-1cd544b338fe None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:48:58.642658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4105abb-fdf3-487a-bdbf-bdd57b397597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:48:58.643527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105abb-fdf3-487a-bdbf-bdd57b397597 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:48:58.643806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105abb-fdf3-487a-bdbf-bdd57b397597 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:48:58.644081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105abb-fdf3-487a-bdbf-bdd57b397597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:48:58.648113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a4105abb-fdf3-487a-bdbf-bdd57b397597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:48:58.756620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4105abb-fdf3-487a-bdbf-bdd57b397597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:48:58.758111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4105abb-fdf3-487a-bdbf-bdd57b397597 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:48:58.770138 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2736/5477] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:48:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:00.340961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc059e86-d572-46a7-bbcd-18443335ff6b service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:00.343111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc059e86-d572-46a7-bbcd-18443335ff6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:00.527056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc059e86-d572-46a7-bbcd-18443335ff6b service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:00.533496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d376d-6f66-42bc-8f3a-318e3ed4576c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:00.534600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d376d-6f66-42bc-8f3a-318e3ed4576c service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:00.535686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d376d-6f66-42bc-8f3a-318e3ed4576c service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:00.536193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d376d-6f66-42bc-8f3a-318e3ed4576c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:00.539230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-670d376d-6f66-42bc-8f3a-318e3ed4576c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:00.567616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d376d-6f66-42bc-8f3a-318e3ed4576c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:00.569894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d376d-6f66-42bc-8f3a-318e3ed4576c service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:00.605765 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2742/5478] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:01.072283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4105abb-fdf3-487a-bdbf-bdd57b397597 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:01.079139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a4105abb-fdf3-487a-bdbf-bdd57b397597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:01.107184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4105abb-fdf3-487a-bdbf-bdd57b397597 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:01.113532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:01.114836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:01.115637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:01.116671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] PATH_INFO: `/v3/projects/e0c60e1aa99f4b00a285b52255c89660` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:01.119937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c60e1aa99f4b00a285b52255c89660)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:01.122284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:01.204934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c60e1aa99f4b00a285b52255c89660', 'request_id': 'req-f46f67bc-d44a-4f64-8941-1cca7f163a48'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:01.213521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c60e1aa99f4b00a285b52255c89660', 'request_id': 'req-f46f67bc-d44a-4f64-8941-1cca7f163a48'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:01.225942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c60e1aa99f4b00a285b52255c89660', 'request_id': 'req-f46f67bc-d44a-4f64-8941-1cca7f163a48'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:01.246720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] The token cache is being invalidate because project e0c60e1aa99f4b00a285b52255c89660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:01.247761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:01.250500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f46f67bc-d44a-4f64-8941-1cca7f163a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:01.259170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09d99-3527-4e4a-ac30-e08494ed7727 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:01.259867 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2737/5479] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:01 2022] DELETE /identity/v3/projects/e0c60e1aa99f4b00a285b52255c89660 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:01.260131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09d99-3527-4e4a-ac30-e08494ed7727 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:01.260627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09d99-3527-4e4a-ac30-e08494ed7727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:01.301105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-68a09d99-3527-4e4a-ac30-e08494ed7727 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:01.304197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-68a09d99-3527-4e4a-ac30-e08494ed7727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:01.523353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceb3c0-6b7a-4d2b-bf04-48a155655ff8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:01.528255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceb3c0-6b7a-4d2b-bf04-48a155655ff8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:01.530014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceb3c0-6b7a-4d2b-bf04-48a155655ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:01.552248 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2743/5480] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:01.623149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2fceb3c0-6b7a-4d2b-bf04-48a155655ff8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:01.637661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2fceb3c0-6b7a-4d2b-bf04-48a155655ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:01.681930 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2738/5481] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:01.687013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a09d99-3527-4e4a-ac30-e08494ed7727 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:01.715395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a09d99-3527-4e4a-ac30-e08494ed7727 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:01.739398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294222e5-6073-4991-8cdc-e7d9f131f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:01.740306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294222e5-6073-4991-8cdc-e7d9f131f6da admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:01.740772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294222e5-6073-4991-8cdc-e7d9f131f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:01.741230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294222e5-6073-4991-8cdc-e7d9f131f6da admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:01.742090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294222e5-6073-4991-8cdc-e7d9f131f6da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:01.745591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294222e5-6073-4991-8cdc-e7d9f131f6da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:01.754142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294222e5-6073-4991-8cdc-e7d9f131f6da admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:01.791171 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2744/5482] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:01.791940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:01.795875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fceb3c0-6b7a-4d2b-bf04-48a155655ff8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:01.810577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fceb3c0-6b7a-4d2b-bf04-48a155655ff8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:01.825651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab5eac-9532-46b4-9284-898de4270183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:01.826288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab5eac-9532-46b4-9284-898de4270183 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:01.826570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab5eac-9532-46b4-9284-898de4270183 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:01.826849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab5eac-9532-46b4-9284-898de4270183 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:01.831510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab5eac-9532-46b4-9284-898de4270183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:01.838298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab5eac-9532-46b4-9284-898de4270183 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:01.926411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294222e5-6073-4991-8cdc-e7d9f131f6da admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:01.926718 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2739/5483] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:01 2022] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:49:01.950079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294222e5-6073-4991-8cdc-e7d9f131f6da admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:02.196291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5409750-60f1-42c9-b122-fca032c52890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:02.196924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5409750-60f1-42c9-b122-fca032c52890 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:02.197492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5409750-60f1-42c9-b122-fca032c52890 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:02.199456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5409750-60f1-42c9-b122-fca032c52890 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:02.200186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5409750-60f1-42c9-b122-fca032c52890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:02.202351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5409750-60f1-42c9-b122-fca032c52890 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:02.266272 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2745/5484] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:01 2022] POST /identity/v3/users => generated 305 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:02.269255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab5eac-9532-46b4-9284-898de4270183 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:02.284563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab5eac-9532-46b4-9284-898de4270183 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:02.297267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecac42-2b03-4a9e-ad91-c3810c3971d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:02.300299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecac42-2b03-4a9e-ad91-c3810c3971d8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:02.303844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecac42-2b03-4a9e-ad91-c3810c3971d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:02.304277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecac42-2b03-4a9e-ad91-c3810c3971d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:02.307586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecac42-2b03-4a9e-ad91-c3810c3971d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:02.310578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecac42-2b03-4a9e-ad91-c3810c3971d8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:02.334272 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2740/5485] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:49:02.335620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5409750-60f1-42c9-b122-fca032c52890 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:02.352514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5409750-60f1-42c9-b122-fca032c52890 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:02.361167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebe8fb-7e91-4010-9fac-defb6010338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:02.362323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebe8fb-7e91-4010-9fac-defb6010338e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:02.362799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebe8fb-7e91-4010-9fac-defb6010338e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:02.363933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebe8fb-7e91-4010-9fac-defb6010338e admin admin] PATH_INFO: `/v3/projects/5ad571d8f14c44e985ff5c117a792bd1/users/1907989fb4b24d348d3f347526e2f894/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:02.412117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebe8fb-7e91-4010-9fac-defb6010338e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad571d8f14c44e985ff5c117a792bd1, user_id=1907989fb4b24d348d3f347526e2f894, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:02.417126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebe8fb-7e91-4010-9fac-defb6010338e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:02.457042 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2746/5486] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:02 2022] PUT /identity/v3/projects/5ad571d8f14c44e985ff5c117a792bd1/users/1907989fb4b24d348d3f347526e2f894/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:02.461044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecac42-2b03-4a9e-ad91-c3810c3971d8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:02.477266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:02.493776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecac42-2b03-4a9e-ad91-c3810c3971d8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:02.644982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c98774-bac5-43fa-ae21-575e275b7602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:02.645900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c98774-bac5-43fa-ae21-575e275b7602 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:02.646610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c98774-bac5-43fa-ae21-575e275b7602 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:02.646610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c98774-bac5-43fa-ae21-575e275b7602 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:02.647389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c98774-bac5-43fa-ae21-575e275b7602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:02.649525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c98774-bac5-43fa-ae21-575e275b7602 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:02.679542 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2741/5487] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:02.680605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebe8fb-7e91-4010-9fac-defb6010338e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:02.718409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebe8fb-7e91-4010-9fac-defb6010338e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:02.767895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54010548-7c84-450d-84d4-f29e737e66b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:02.770797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010548-7c84-450d-84d4-f29e737e66b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:02.771124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010548-7c84-450d-84d4-f29e737e66b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:02.771409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010548-7c84-450d-84d4-f29e737e66b7 admin admin] PATH_INFO: `/v3/projects/5ad571d8f14c44e985ff5c117a792bd1/users/1907989fb4b24d348d3f347526e2f894/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:02.780737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54010548-7c84-450d-84d4-f29e737e66b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad571d8f14c44e985ff5c117a792bd1, user_id=1907989fb4b24d348d3f347526e2f894, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:02.787279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54010548-7c84-450d-84d4-f29e737e66b7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:02.821451 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2747/5488] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:02 2022] PUT /identity/v3/projects/5ad571d8f14c44e985ff5c117a792bd1/users/1907989fb4b24d348d3f347526e2f894/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:02.842596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c22d08-d55b-49eb-8221-c1618f159937 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:02.843167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c22d08-d55b-49eb-8221-c1618f159937 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:02.843544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c22d08-d55b-49eb-8221-c1618f159937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:02.942379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-56c22d08-d55b-49eb-8221-c1618f159937 None None] MFA Rules not processed for user `1907989fb4b24d348d3f347526e2f894`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:02.944015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-56c22d08-d55b-49eb-8221-c1618f159937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:03.218888 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2742/5489] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:02 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:03.219401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54010548-7c84-450d-84d4-f29e737e66b7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:03.343830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54010548-7c84-450d-84d4-f29e737e66b7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:03.350753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281c7d6-3e05-469f-9b7a-4c4c77826735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:03.351969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281c7d6-3e05-469f-9b7a-4c4c77826735 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:03.352548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281c7d6-3e05-469f-9b7a-4c4c77826735 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:03.353078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281c7d6-3e05-469f-9b7a-4c4c77826735 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:03.354164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281c7d6-3e05-469f-9b7a-4c4c77826735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:03.356358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281c7d6-3e05-469f-9b7a-4c4c77826735 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:03.393665 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2748/5490] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:03 2022] POST /identity/v3/projects => generated 397 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:03.398450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c22d08-d55b-49eb-8221-c1618f159937 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:03.412283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c22d08-d55b-49eb-8221-c1618f159937 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:03.563380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157ffd1-9c11-4421-b339-29e63f44445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:03.565569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157ffd1-9c11-4421-b339-29e63f44445e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:03.568054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157ffd1-9c11-4421-b339-29e63f44445e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:03.568543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157ffd1-9c11-4421-b339-29e63f44445e admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:03.569416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157ffd1-9c11-4421-b339-29e63f44445e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:03.576457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157ffd1-9c11-4421-b339-29e63f44445e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:03.636542 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2743/5491] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:03 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:03.639575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281c7d6-3e05-469f-9b7a-4c4c77826735 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:03.665093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281c7d6-3e05-469f-9b7a-4c4c77826735 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:03.683092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1fa10-df9e-47ad-8650-86ae2c0e2716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:03.684502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1fa10-df9e-47ad-8650-86ae2c0e2716 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:03.685021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1fa10-df9e-47ad-8650-86ae2c0e2716 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:03.685572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1fa10-df9e-47ad-8650-86ae2c0e2716 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:03.686483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1fa10-df9e-47ad-8650-86ae2c0e2716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:03.688739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1fa10-df9e-47ad-8650-86ae2c0e2716 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:03.725472 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2749/5492] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:03.729716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157ffd1-9c11-4421-b339-29e63f44445e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:03.755518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157ffd1-9c11-4421-b339-29e63f44445e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:03.786721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a5c73-1bcb-4df8-9ae6-21ca27fb4524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:03.787377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5c73-1bcb-4df8-9ae6-21ca27fb4524 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:03.787875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5c73-1bcb-4df8-9ae6-21ca27fb4524 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:03.788160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5c73-1bcb-4df8-9ae6-21ca27fb4524 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:03.789760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a5c73-1bcb-4df8-9ae6-21ca27fb4524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:03.790883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a5c73-1bcb-4df8-9ae6-21ca27fb4524 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:03.830202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1fa10-df9e-47ad-8650-86ae2c0e2716 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:03.835958 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2744/5493] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:03.847726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1fa10-df9e-47ad-8650-86ae2c0e2716 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:03.870182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9561f38-5b4a-4676-a64e-9cf6c95b3e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:03.870884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9561f38-5b4a-4676-a64e-9cf6c95b3e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:03.871165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9561f38-5b4a-4676-a64e-9cf6c95b3e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:03.871485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9561f38-5b4a-4676-a64e-9cf6c95b3e7d admin admin] PATH_INFO: `/v3/projects/c9ef56e6791b4e5d8d57509ddf517ce5/users/283d906d0e9c4b34b6e852a4342df361/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:03.914446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9561f38-5b4a-4676-a64e-9cf6c95b3e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ef56e6791b4e5d8d57509ddf517ce5, user_id=283d906d0e9c4b34b6e852a4342df361, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:03.917169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9561f38-5b4a-4676-a64e-9cf6c95b3e7d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:03.955117 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2750/5494] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:03 2022] PUT /identity/v3/projects/c9ef56e6791b4e5d8d57509ddf517ce5/users/283d906d0e9c4b34b6e852a4342df361/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:03.965715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0c217-2940-4129-a5e8-fe9396f2d47f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:03.966001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0c217-2940-4129-a5e8-fe9396f2d47f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:03.966286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0c217-2940-4129-a5e8-fe9396f2d47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:03.974444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:04.028101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-98d0c217-2940-4129-a5e8-fe9396f2d47f None None] MFA Rules not processed for user `283d906d0e9c4b34b6e852a4342df361`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:04.029440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-98d0c217-2940-4129-a5e8-fe9396f2d47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:04.245531 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2745/5495] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:04.258598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9561f38-5b4a-4676-a64e-9cf6c95b3e7d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:04.260144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c9561f38-5b4a-4676-a64e-9cf6c95b3e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:04.266856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:04.498118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9561f38-5b4a-4676-a64e-9cf6c95b3e7d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:04.513247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089877d9-dad3-4a98-a12f-60136ac2acd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:04.515769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089877d9-dad3-4a98-a12f-60136ac2acd8 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:04.517760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089877d9-dad3-4a98-a12f-60136ac2acd8 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:04.518261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089877d9-dad3-4a98-a12f-60136ac2acd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:04.779655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089877d9-dad3-4a98-a12f-60136ac2acd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:04.781208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089877d9-dad3-4a98-a12f-60136ac2acd8 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:04.822430 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2751/5496] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:04 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:05.731223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0c217-2940-4129-a5e8-fe9396f2d47f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:05.949058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0c217-2940-4129-a5e8-fe9396f2d47f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:05.969649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:05.970415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:05.972852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:05.974213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] PATH_INFO: `/v3/users/1907989fb4b24d348d3f347526e2f894` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:05.977939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1907989fb4b24d348d3f347526e2f894)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:05.980742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:06.127581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1907989fb4b24d348d3f347526e2f894'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:06.131473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1907989fb4b24d348d3f347526e2f894'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:06.168929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1907989fb4b24d348d3f347526e2f894'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:06.186610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1907989fb4b24d348d3f347526e2f894'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:06.206266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1907989fb4b24d348d3f347526e2f894'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:06.233034 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2746/5497] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:05 2022] DELETE /identity/v3/users/1907989fb4b24d348d3f347526e2f894 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:06.237554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7790f04-abf5-4e0e-8a2f-32aaea64fc8e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:06.238178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7790f04-abf5-4e0e-8a2f-32aaea64fc8e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:06.238178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7790f04-abf5-4e0e-8a2f-32aaea64fc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:06.304618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c7790f04-abf5-4e0e-8a2f-32aaea64fc8e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:06.307076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c7790f04-abf5-4e0e-8a2f-32aaea64fc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:06.553541 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2752/5498] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:06.654687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:06.656722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:06.689778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:06.827027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da644b0-e6c6-47f0-b490-4ef66f7efd29 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:06.837446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94995296-5f76-4087-82c5-48dfe29ddacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:06.840978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94995296-5f76-4087-82c5-48dfe29ddacb service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:06.841613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94995296-5f76-4087-82c5-48dfe29ddacb service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:06.842230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94995296-5f76-4087-82c5-48dfe29ddacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:06.866858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94995296-5f76-4087-82c5-48dfe29ddacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:06.868843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94995296-5f76-4087-82c5-48dfe29ddacb service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:06.896694 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2747/5499] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:08.963519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7790f04-abf5-4e0e-8a2f-32aaea64fc8e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:08.965545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c7790f04-abf5-4e0e-8a2f-32aaea64fc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:08.990711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7790f04-abf5-4e0e-8a2f-32aaea64fc8e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:09.018826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:09.022427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:09.022734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:09.024187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] PATH_INFO: `/v3/projects/5ad571d8f14c44e985ff5c117a792bd1` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:09.028502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad571d8f14c44e985ff5c117a792bd1)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:09.036018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:09.178923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:09.182890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad571d8f14c44e985ff5c117a792bd1', 'request_id': 'req-748d816e-ffb0-4aa4-81d5-f4aca380e706'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:09.194055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad571d8f14c44e985ff5c117a792bd1', 'request_id': 'req-748d816e-ffb0-4aa4-81d5-f4aca380e706'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:09.218278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad571d8f14c44e985ff5c117a792bd1', 'request_id': 'req-748d816e-ffb0-4aa4-81d5-f4aca380e706'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:09.255875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] The token cache is being invalidate because project 5ad571d8f14c44e985ff5c117a792bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:09.256203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:09.257041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:09.258772 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2753/5500] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:08 2022] DELETE /identity/v3/projects/5ad571d8f14c44e985ff5c117a792bd1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:09.263020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94995296-5f76-4087-82c5-48dfe29ddacb service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:09.273905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94995296-5f76-4087-82c5-48dfe29ddacb service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:09.418852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:09.419572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:09.419769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:09.420042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] PATH_INFO: `/v3/users/283d906d0e9c4b34b6e852a4342df361` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:09.430362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=283d906d0e9c4b34b6e852a4342df361)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:09.432384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:09.594681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283d906d0e9c4b34b6e852a4342df361'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:09.596349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283d906d0e9c4b34b6e852a4342df361'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:09.652447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283d906d0e9c4b34b6e852a4342df361'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:09.667680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283d906d0e9c4b34b6e852a4342df361'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:09.684819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283d906d0e9c4b34b6e852a4342df361'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:09.711019 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2748/5501] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:09 2022] DELETE /identity/v3/users/283d906d0e9c4b34b6e852a4342df361 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:10.141111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:10.143227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:10.288430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d816e-ffb0-4aa4-81d5-f4aca380e706 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:10.426430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420da614-995b-4c1b-a4c0-36c7cd76e21c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:10.427302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da614-995b-4c1b-a4c0-36c7cd76e21c service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:10.427453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da614-995b-4c1b-a4c0-36c7cd76e21c service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:10.427653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da614-995b-4c1b-a4c0-36c7cd76e21c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:10.430076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-420da614-995b-4c1b-a4c0-36c7cd76e21c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:10.562850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:10.564369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:10.645376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420da614-995b-4c1b-a4c0-36c7cd76e21c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:10.646806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420da614-995b-4c1b-a4c0-36c7cd76e21c service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:10.670452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:10.675204 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2754/5502] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:10.776004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f17b-3412-4876-82fd-5aec07548b59 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:10.787631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:10.790347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:10.790546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:10.790811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] PATH_INFO: `/v3/projects/c9ef56e6791b4e5d8d57509ddf517ce5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:10.796839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ef56e6791b4e5d8d57509ddf517ce5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:10.804214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:10.909877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ef56e6791b4e5d8d57509ddf517ce5', 'request_id': 'req-48be1625-59b6-4463-88ad-42faf6b5cff1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:10.931829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ef56e6791b4e5d8d57509ddf517ce5', 'request_id': 'req-48be1625-59b6-4463-88ad-42faf6b5cff1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:10.946537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ef56e6791b4e5d8d57509ddf517ce5', 'request_id': 'req-48be1625-59b6-4463-88ad-42faf6b5cff1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:10.967282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] The token cache is being invalidate because project c9ef56e6791b4e5d8d57509ddf517ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:10.967566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:10.968271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:10.971079 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2749/5503] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:10 2022] DELETE /identity/v3/projects/c9ef56e6791b4e5d8d57509ddf517ce5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:10.977635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17186f-b9c6-4ef0-ac83-7f81bc0ab0ad None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:10.979731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17186f-b9c6-4ef0-ac83-7f81bc0ab0ad None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:10.980373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17186f-b9c6-4ef0-ac83-7f81bc0ab0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:11.004139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:11.008031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:11.055055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dc17186f-b9c6-4ef0-ac83-7f81bc0ab0ad None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:11.057324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc17186f-b9c6-4ef0-ac83-7f81bc0ab0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:11.169765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be1625-59b6-4463-88ad-42faf6b5cff1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:11.184679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae838d1d-1b00-454b-b05c-3ef4531f0b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:11.186160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae838d1d-1b00-454b-b05c-3ef4531f0b3b service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:11.186563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae838d1d-1b00-454b-b05c-3ef4531f0b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:11.186944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae838d1d-1b00-454b-b05c-3ef4531f0b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:11.191840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ae838d1d-1b00-454b-b05c-3ef4531f0b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:11.211718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae838d1d-1b00-454b-b05c-3ef4531f0b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:11.214807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae838d1d-1b00-454b-b05c-3ef4531f0b3b service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:11.229651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:11.239320 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2750/5504] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:11.241687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae838d1d-1b00-454b-b05c-3ef4531f0b3b service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:11.245631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ae838d1d-1b00-454b-b05c-3ef4531f0b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:11.305150 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2755/5505] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:11.311974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020522f-fe90-40cb-be3f-4880a8cc7906 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:11.312543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020522f-fe90-40cb-be3f-4880a8cc7906 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:11.312982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020522f-fe90-40cb-be3f-4880a8cc7906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:11.336562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5020522f-fe90-40cb-be3f-4880a8cc7906 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:11.338064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5020522f-fe90-40cb-be3f-4880a8cc7906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:11.351177 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2756/5506] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:11.352392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020522f-fe90-40cb-be3f-4880a8cc7906 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:11.367013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020522f-fe90-40cb-be3f-4880a8cc7906 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:11.378049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392b4ac-10aa-4eb9-800f-d7b6dd9daf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:11.379425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392b4ac-10aa-4eb9-800f-d7b6dd9daf26 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:11.379839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392b4ac-10aa-4eb9-800f-d7b6dd9daf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:11.380345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392b4ac-10aa-4eb9-800f-d7b6dd9daf26 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:11.381091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392b4ac-10aa-4eb9-800f-d7b6dd9daf26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:11.381489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392b4ac-10aa-4eb9-800f-d7b6dd9daf26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:11.383221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae838d1d-1b00-454b-b05c-3ef4531f0b3b service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:11.384441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392b4ac-10aa-4eb9-800f-d7b6dd9daf26 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:11.388643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:11.389075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:11.389357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:11.389671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] PATH_INFO: `/v3/users/45410de8653b425e94668fabfce136dc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:11.390977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45410de8653b425e94668fabfce136dc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:11.392921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:11.401211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:11.410566 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2757/5507] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:11.416186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392b4ac-10aa-4eb9-800f-d7b6dd9daf26 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:11.439241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392b4ac-10aa-4eb9-800f-d7b6dd9daf26 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:11.444675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528688-bdb2-4d77-be06-dd6aaead348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:11.445500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528688-bdb2-4d77-be06-dd6aaead348e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:11.445786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528688-bdb2-4d77-be06-dd6aaead348e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:11.446063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528688-bdb2-4d77-be06-dd6aaead348e admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:11.446757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43528688-bdb2-4d77-be06-dd6aaead348e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:11.448832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43528688-bdb2-4d77-be06-dd6aaead348e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:11.517593 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2758/5508] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:11 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:11.522469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528688-bdb2-4d77-be06-dd6aaead348e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:11.530759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45410de8653b425e94668fabfce136dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:11.542804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45410de8653b425e94668fabfce136dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:11.616726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45410de8653b425e94668fabfce136dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:11.661593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45410de8653b425e94668fabfce136dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:11.671590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45410de8653b425e94668fabfce136dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:11.683102 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2751/5509] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:11 2022] DELETE /identity/v3/users/45410de8653b425e94668fabfce136dc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:11.687176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:11.694020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:11.737531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528688-bdb2-4d77-be06-dd6aaead348e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:11.939879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61643-f140-4d64-9786-6d71d188d5d6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:11.947322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33044fd-df3e-43d1-bc97-e083ebba022c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:11.948088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33044fd-df3e-43d1-bc97-e083ebba022c service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:11.948638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33044fd-df3e-43d1-bc97-e083ebba022c service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:11.949006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33044fd-df3e-43d1-bc97-e083ebba022c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:11.954287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e33044fd-df3e-43d1-bc97-e083ebba022c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:12.002952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187583a2-67aa-4f0b-93c6-ab492f3d5ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:12.004459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187583a2-67aa-4f0b-93c6-ab492f3d5ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.004902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187583a2-67aa-4f0b-93c6-ab492f3d5ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.005366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187583a2-67aa-4f0b-93c6-ab492f3d5ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.014247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187583a2-67aa-4f0b-93c6-ab492f3d5ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:12.023332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187583a2-67aa-4f0b-93c6-ab492f3d5ca1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:12.082473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33044fd-df3e-43d1-bc97-e083ebba022c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:12.085292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33044fd-df3e-43d1-bc97-e083ebba022c service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:12.088998 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2759/5510] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:11 2022] POST /identity/v3/users => generated 284 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:12.094966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7963ad-7f9a-4c99-b898-6c3ab553cf27 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.095384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7963ad-7f9a-4c99-b898-6c3ab553cf27 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.095670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7963ad-7f9a-4c99-b898-6c3ab553cf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.100761 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2752/5511] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:12.102298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33044fd-df3e-43d1-bc97-e083ebba022c service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:12.104254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e33044fd-df3e-43d1-bc97-e083ebba022c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:12.122932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1a7963ad-7f9a-4c99-b898-6c3ab553cf27 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:12.123530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33044fd-df3e-43d1-bc97-e083ebba022c service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:12.124308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1a7963ad-7f9a-4c99-b898-6c3ab553cf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:12.130075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9e844-b51b-491b-81c4-639b7739a64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:12.130975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e844-b51b-491b-81c4-639b7739a64b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.131449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e844-b51b-491b-81c4-639b7739a64b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.131881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e844-b51b-491b-81c4-639b7739a64b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.133185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9e844-b51b-491b-81c4-639b7739a64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:12.135320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9e844-b51b-491b-81c4-639b7739a64b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:12.138489 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2760/5512] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:12.156036 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2753/5513] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:12.157879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7963ad-7f9a-4c99-b898-6c3ab553cf27 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:12.170894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7963ad-7f9a-4c99-b898-6c3ab553cf27 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:12.176779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5950a3a-df2e-400b-a399-cf32b2ce103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:12.177845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950a3a-df2e-400b-a399-cf32b2ce103f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.178266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950a3a-df2e-400b-a399-cf32b2ce103f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.179183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950a3a-df2e-400b-a399-cf32b2ce103f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.180003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5950a3a-df2e-400b-a399-cf32b2ce103f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:12.182582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5950a3a-df2e-400b-a399-cf32b2ce103f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:12.199403 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2761/5514] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:49:12.203831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9e844-b51b-491b-81c4-639b7739a64b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:12.213372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5950a3a-df2e-400b-a399-cf32b2ce103f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:12.224007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9e844-b51b-491b-81c4-639b7739a64b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:12.228169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5950a3a-df2e-400b-a399-cf32b2ce103f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:12.231690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa0a00-f1e5-4366-9fab-6c9260233825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:12.232468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453d28a-fd22-4cee-8586-3d8cd9926661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:12.233180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0a00-f1e5-4366-9fab-6c9260233825 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.233328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453d28a-fd22-4cee-8586-3d8cd9926661 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.233328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453d28a-fd22-4cee-8586-3d8cd9926661 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.233674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453d28a-fd22-4cee-8586-3d8cd9926661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.234069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0a00-f1e5-4366-9fab-6c9260233825 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.234491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0a00-f1e5-4366-9fab-6c9260233825 admin admin] PATH_INFO: `/v3/projects/3f8939a291d14da1b2ab54367ed64f2e/users/1ae97c1d81de4b2b9137424b794ba10d/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.245897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453d28a-fd22-4cee-8586-3d8cd9926661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:12.247846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453d28a-fd22-4cee-8586-3d8cd9926661 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:12.253177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:12.256157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:12.260801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa0a00-f1e5-4366-9fab-6c9260233825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8939a291d14da1b2ab54367ed64f2e, user_id=1ae97c1d81de4b2b9137424b794ba10d, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:12.262379 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2762/5515] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:12.264809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa0a00-f1e5-4366-9fab-6c9260233825 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:12.279357 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2754/5516] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:12 2022] PUT /identity/v3/projects/3f8939a291d14da1b2ab54367ed64f2e/users/1ae97c1d81de4b2b9137424b794ba10d/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:12.291538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8663081-23fe-4cdb-89e9-404a2e24edce None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.291990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8663081-23fe-4cdb-89e9-404a2e24edce None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.292273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8663081-23fe-4cdb-89e9-404a2e24edce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.327350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d8663081-23fe-4cdb-89e9-404a2e24edce None None] MFA Rules not processed for user `1ae97c1d81de4b2b9137424b794ba10d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:12.328565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d8663081-23fe-4cdb-89e9-404a2e24edce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:12.408468 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2763/5517] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:12.413524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa0a00-f1e5-4366-9fab-6c9260233825 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:12.489835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa0a00-f1e5-4366-9fab-6c9260233825 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:12.504816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6cef9-453c-4459-ab8c-e351d5ee1d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:12.505797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6cef9-453c-4459-ab8c-e351d5ee1d81 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.506242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6cef9-453c-4459-ab8c-e351d5ee1d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.506679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6cef9-453c-4459-ab8c-e351d5ee1d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.507768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6cef9-453c-4459-ab8c-e351d5ee1d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:12.512871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6cef9-453c-4459-ab8c-e351d5ee1d81 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:12.566189 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2755/5518] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:12 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:12.572035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8663081-23fe-4cdb-89e9-404a2e24edce None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:12.590917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8663081-23fe-4cdb-89e9-404a2e24edce None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:12.619486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6cef9-453c-4459-ab8c-e351d5ee1d81 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:12.624193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8fa6cef9-453c-4459-ab8c-e351d5ee1d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:12.687667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd16e-6520-4847-a6f5-f1ee28e5cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:12.688304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd16e-6520-4847-a6f5-f1ee28e5cd79 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.688646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd16e-6520-4847-a6f5-f1ee28e5cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.688922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd16e-6520-4847-a6f5-f1ee28e5cd79 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.691186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fd16e-6520-4847-a6f5-f1ee28e5cd79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:12.697263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fd16e-6520-4847-a6f5-f1ee28e5cd79 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:12.743082 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2764/5519] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:12 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:12.750479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd16e-6520-4847-a6f5-f1ee28e5cd79 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:12.761094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6cef9-453c-4459-ab8c-e351d5ee1d81 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:12.766823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:12.767540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.767826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.768673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] PATH_INFO: `/v3/users/550baba8a2304466962f501a027d7a82` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.770710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=550baba8a2304466962f501a027d7a82)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:12.772804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:12.788284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd16e-6520-4847-a6f5-f1ee28e5cd79 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:12.811710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cea95-3a38-4606-99c1-3b89be39e8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:12.826340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cea95-3a38-4606-99c1-3b89be39e8ae admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.827269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cea95-3a38-4606-99c1-3b89be39e8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.827431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cea95-3a38-4606-99c1-3b89be39e8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.828641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cea95-3a38-4606-99c1-3b89be39e8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:12.833291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cea95-3a38-4606-99c1-3b89be39e8ae admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:12.867406 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2765/5520] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:12.872735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cea95-3a38-4606-99c1-3b89be39e8ae admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:12.910647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550baba8a2304466962f501a027d7a82'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:12.911400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cea95-3a38-4606-99c1-3b89be39e8ae admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:12.912132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550baba8a2304466962f501a027d7a82'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:12.933796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22c7f1-136a-41e0-8624-92d432e0b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:12.935052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22c7f1-136a-41e0-8624-92d432e0b1bf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:12.935722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22c7f1-136a-41e0-8624-92d432e0b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:12.936659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22c7f1-136a-41e0-8624-92d432e0b1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:12.937912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22c7f1-136a-41e0-8624-92d432e0b1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:12.941367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22c7f1-136a-41e0-8624-92d432e0b1bf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:12.958691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550baba8a2304466962f501a027d7a82'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:12.975566 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2766/5521] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:49:12.982921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22c7f1-136a-41e0-8624-92d432e0b1bf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:12.999345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550baba8a2304466962f501a027d7a82'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.035011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:13.035976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22c7f1-136a-41e0-8624-92d432e0b1bf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:13.046000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550baba8a2304466962f501a027d7a82'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.057061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61591a66-85fe-4c8b-83bd-ce671e95e52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:13.059830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591a66-85fe-4c8b-83bd-ce671e95e52d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.063765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591a66-85fe-4c8b-83bd-ce671e95e52d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.072047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591a66-85fe-4c8b-83bd-ce671e95e52d admin admin] PATH_INFO: `/v3/projects/f1903b9ea5d34d4c9aba3dcc3b6a7000/users/25cd3f24b9974bcbba9d32557207b4a7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.133423 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2756/5522] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:12 2022] DELETE /identity/v3/users/550baba8a2304466962f501a027d7a82 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:13.134393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:13.145549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:13.189674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61591a66-85fe-4c8b-83bd-ce671e95e52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1903b9ea5d34d4c9aba3dcc3b6a7000, user_id=25cd3f24b9974bcbba9d32557207b4a7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:13.224371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61591a66-85fe-4c8b-83bd-ce671e95e52d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:13.282234 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2767/5523] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:12 2022] PUT /identity/v3/projects/f1903b9ea5d34d4c9aba3dcc3b6a7000/users/25cd3f24b9974bcbba9d32557207b4a7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:13.300318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e2de4-a735-4b00-a42c-3f6b6b9ea91d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.301001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e2de4-a735-4b00-a42c-3f6b6b9ea91d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.301463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e2de4-a735-4b00-a42c-3f6b6b9ea91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.459247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-730e2de4-a735-4b00-a42c-3f6b6b9ea91d None None] MFA Rules not processed for user `25cd3f24b9974bcbba9d32557207b4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:13.464508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-730e2de4-a735-4b00-a42c-3f6b6b9ea91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:13.512400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd2ad6-591f-4cd1-a0fd-4b145a6221f6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:13.597619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:13.648062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:13.648987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.651053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.651518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] PATH_INFO: `/v3/projects/3c8eda6a5a6144a3954a78ddb6ab9795` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.654265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8eda6a5a6144a3954a78ddb6ab9795)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:13.660154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:13.705421 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2768/5524] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:13.725854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e2de4-a735-4b00-a42c-3f6b6b9ea91d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:13.727614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-730e2de4-a735-4b00-a42c-3f6b6b9ea91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:13.811731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8eda6a5a6144a3954a78ddb6ab9795', 'request_id': 'req-66bead3f-07a5-4e01-8801-29fcdfff0926'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.832367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8eda6a5a6144a3954a78ddb6ab9795', 'request_id': 'req-66bead3f-07a5-4e01-8801-29fcdfff0926'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.851058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8eda6a5a6144a3954a78ddb6ab9795', 'request_id': 'req-66bead3f-07a5-4e01-8801-29fcdfff0926'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.887782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] The token cache is being invalidate because project 3c8eda6a5a6144a3954a78ddb6ab9795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:13.888308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.894633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-66bead3f-07a5-4e01-8801-29fcdfff0926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:13.895096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e2de4-a735-4b00-a42c-3f6b6b9ea91d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:13.900166 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2757/5525] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:13 2022] DELETE /identity/v3/projects/3c8eda6a5a6144a3954a78ddb6ab9795 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:13.905692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123dd57-4702-46b6-b99f-699459ee5730 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.906149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123dd57-4702-46b6-b99f-699459ee5730 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:13.906670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123dd57-4702-46b6-b99f-699459ee5730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:13.973841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d123dd57-4702-46b6-b99f-699459ee5730 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:13.975719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d123dd57-4702-46b6-b99f-699459ee5730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:13.995583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a155deb-7c29-4c56-96aa-548ee98a1067 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:13.997130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a155deb-7c29-4c56-96aa-548ee98a1067 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:13.997566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a155deb-7c29-4c56-96aa-548ee98a1067 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:14.000516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a155deb-7c29-4c56-96aa-548ee98a1067 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:14.006798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0a155deb-7c29-4c56-96aa-548ee98a1067 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:14.112284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:14.162996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a155deb-7c29-4c56-96aa-548ee98a1067 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:14.165344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a155deb-7c29-4c56-96aa-548ee98a1067 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:14.176455 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2769/5526] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:14.177782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a155deb-7c29-4c56-96aa-548ee98a1067 service glance] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:14.180065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0a155deb-7c29-4c56-96aa-548ee98a1067 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:14.216006 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2758/5527] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:14.224389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e8564-8f66-4125-8061-089da07ebedb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:14.224837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e8564-8f66-4125-8061-089da07ebedb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:14.225283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e8564-8f66-4125-8061-089da07ebedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:14.267155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:14.295256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f09e8564-8f66-4125-8061-089da07ebedb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:14.297766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f09e8564-8f66-4125-8061-089da07ebedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:14.345091 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2759/5528] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:14.346628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e8564-8f66-4125-8061-089da07ebedb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:14.374975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e8564-8f66-4125-8061-089da07ebedb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:14.380360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a155deb-7c29-4c56-96aa-548ee98a1067 service glance] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:14.395359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:14.396059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:14.396345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:14.396618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] PATH_INFO: `/v3/projects/948fbbd2c9974beb93713e4366834b28` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:14.403090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=948fbbd2c9974beb93713e4366834b28)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:14.403192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aec5af-aba4-485a-bc0f-df5570fe7bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:14.403803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aec5af-aba4-485a-bc0f-df5570fe7bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:14.404090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aec5af-aba4-485a-bc0f-df5570fe7bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:14.404437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aec5af-aba4-485a-bc0f-df5570fe7bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:14.405019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aec5af-aba4-485a-bc0f-df5570fe7bb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:14.405136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:14.405324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aec5af-aba4-485a-bc0f-df5570fe7bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:14.406966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aec5af-aba4-485a-bc0f-df5570fe7bb5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:14.446700 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2760/5529] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:14.450973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aec5af-aba4-485a-bc0f-df5570fe7bb5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:14.469812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aec5af-aba4-485a-bc0f-df5570fe7bb5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:14.478473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769dc03-3d00-4bfa-9ad6-9e142510511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:14.479126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769dc03-3d00-4bfa-9ad6-9e142510511b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:14.479434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769dc03-3d00-4bfa-9ad6-9e142510511b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:14.479739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769dc03-3d00-4bfa-9ad6-9e142510511b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:14.480431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769dc03-3d00-4bfa-9ad6-9e142510511b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:14.488726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769dc03-3d00-4bfa-9ad6-9e142510511b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:14.555207 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2761/5530] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:14 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:14.556341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769dc03-3d00-4bfa-9ad6-9e142510511b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:14.558411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5769dc03-3d00-4bfa-9ad6-9e142510511b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:14.574062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948fbbd2c9974beb93713e4366834b28', 'request_id': 'req-f495158a-df08-4e67-8d8c-f13980afd0c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:14.591129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948fbbd2c9974beb93713e4366834b28', 'request_id': 'req-f495158a-df08-4e67-8d8c-f13980afd0c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:14.611918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948fbbd2c9974beb93713e4366834b28', 'request_id': 'req-f495158a-df08-4e67-8d8c-f13980afd0c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:14.641791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] The token cache is being invalidate because project 948fbbd2c9974beb93713e4366834b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:14.642176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:14.645042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:14.649904 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2770/5531] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:14 2022] DELETE /identity/v3/projects/948fbbd2c9974beb93713e4366834b28 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:14.650742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:14.652905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:14.681828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769dc03-3d00-4bfa-9ad6-9e142510511b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:14.691511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec89669-e194-43b8-8951-5ddb6d75a9dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:14.694151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec89669-e194-43b8-8951-5ddb6d75a9dd service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:14.695938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec89669-e194-43b8-8951-5ddb6d75a9dd service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:14.696236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec89669-e194-43b8-8951-5ddb6d75a9dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:14.701568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5ec89669-e194-43b8-8951-5ddb6d75a9dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:14.838749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495158a-df08-4e67-8d8c-f13980afd0c9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:14.874376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec89669-e194-43b8-8951-5ddb6d75a9dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:14.876059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec89669-e194-43b8-8951-5ddb6d75a9dd service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:14.923044 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2762/5532] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:14.929659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec89669-e194-43b8-8951-5ddb6d75a9dd service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:14.931578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5ec89669-e194-43b8-8951-5ddb6d75a9dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:15.052105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:15.094067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec89669-e194-43b8-8951-5ddb6d75a9dd service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:15.101370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:15.102074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:15.103064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:15.103372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] PATH_INFO: `/v3/users/99a9d6160e024b39bd283af5e9321892` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:15.106364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a9d6160e024b39bd283af5e9321892)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:15.109254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:15.141179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd735638-70b9-4570-9afd-5c0fbdd98cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:15.142181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd735638-70b9-4570-9afd-5c0fbdd98cde admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:15.143293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd735638-70b9-4570-9afd-5c0fbdd98cde admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:15.146127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd735638-70b9-4570-9afd-5c0fbdd98cde admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:15.147225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd735638-70b9-4570-9afd-5c0fbdd98cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:15.149486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd735638-70b9-4570-9afd-5c0fbdd98cde admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:15.209553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a9d6160e024b39bd283af5e9321892'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:15.212741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a9d6160e024b39bd283af5e9321892'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:15.223175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:15.254768 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2771/5533] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:14 2022] POST /identity/v3/users => generated 294 bytes in 604 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:15.255282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a9d6160e024b39bd283af5e9321892'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:15.255841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd735638-70b9-4570-9afd-5c0fbdd98cde admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:15.270324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a9d6160e024b39bd283af5e9321892'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:15.286679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd735638-70b9-4570-9afd-5c0fbdd98cde admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:15.300884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a9d6160e024b39bd283af5e9321892'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:15.310819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557b02f-6333-4d96-8108-c3d76ed061a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:15.312216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b02f-6333-4d96-8108-c3d76ed061a6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:15.312216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b02f-6333-4d96-8108-c3d76ed061a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:15.312216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b02f-6333-4d96-8108-c3d76ed061a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:15.312914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557b02f-6333-4d96-8108-c3d76ed061a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:15.314748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557b02f-6333-4d96-8108-c3d76ed061a6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:15.330498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2763/5534] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:14 2022] DELETE /identity/v3/users/99a9d6160e024b39bd283af5e9321892 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:15.360442 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2772/5535] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:15.361629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:15.363789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:15.578879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98183785-5719-4252-b1cd-6c9dc057c54f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:15.586680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948a1e6-be62-4882-b31f-8dd82bef4a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:15.587674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948a1e6-be62-4882-b31f-8dd82bef4a21 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:15.587956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948a1e6-be62-4882-b31f-8dd82bef4a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:15.588258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948a1e6-be62-4882-b31f-8dd82bef4a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:15.589194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948a1e6-be62-4882-b31f-8dd82bef4a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:15.592138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948a1e6-be62-4882-b31f-8dd82bef4a21 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:15.642379 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2764/5536] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:15.649228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557b02f-6333-4d96-8108-c3d76ed061a6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:15.668515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557b02f-6333-4d96-8108-c3d76ed061a6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:15.686211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954915e-ffc9-40ed-89c3-f08de9b69d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:15.686975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954915e-ffc9-40ed-89c3-f08de9b69d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:15.687261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954915e-ffc9-40ed-89c3-f08de9b69d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:15.687577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954915e-ffc9-40ed-89c3-f08de9b69d66 admin admin] PATH_INFO: `/v3/projects/e93d2e45d1b349b0be5b59ff7a611af9/users/93f0fa8b8ee945ef858d4b855f5dec06/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:15.755285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954915e-ffc9-40ed-89c3-f08de9b69d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93d2e45d1b349b0be5b59ff7a611af9, user_id=93f0fa8b8ee945ef858d4b855f5dec06, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:15.759650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954915e-ffc9-40ed-89c3-f08de9b69d66 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:15.817438 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2773/5537] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:15 2022] PUT /identity/v3/projects/e93d2e45d1b349b0be5b59ff7a611af9/users/93f0fa8b8ee945ef858d4b855f5dec06/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:15.823776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7deeb0-fb83-475e-90d0-a0d71e010984 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:15.824626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7deeb0-fb83-475e-90d0-a0d71e010984 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:15.825090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7deeb0-fb83-475e-90d0-a0d71e010984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:15.903023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3f7deeb0-fb83-475e-90d0-a0d71e010984 None None] MFA Rules not processed for user `93f0fa8b8ee945ef858d4b855f5dec06`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:15.905632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3f7deeb0-fb83-475e-90d0-a0d71e010984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:16.122735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:16.168667 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2765/5538] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:16.180262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954915e-ffc9-40ed-89c3-f08de9b69d66 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:16.182660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9954915e-ffc9-40ed-89c3-f08de9b69d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:16.343541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954915e-ffc9-40ed-89c3-f08de9b69d66 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:16.350783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2aaa-922a-4c29-b9f7-d743bd96f16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:16.361965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2aaa-922a-4c29-b9f7-d743bd96f16a service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:16.364092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2aaa-922a-4c29-b9f7-d743bd96f16a service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:16.364401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2aaa-922a-4c29-b9f7-d743bd96f16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:16.369637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7deeb0-fb83-475e-90d0-a0d71e010984 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:16.371179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3f7deeb0-fb83-475e-90d0-a0d71e010984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:16.400922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c2aaa-922a-4c29-b9f7-d743bd96f16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:16.402424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c2aaa-922a-4c29-b9f7-d743bd96f16a service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:16.424133 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2774/5539] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:16.507909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7deeb0-fb83-475e-90d0-a0d71e010984 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:16.517736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:16.518733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:16.519773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:16.520304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] PATH_INFO: `/v3/projects/7bafdc5d341d4181a8155f4f9b3480cb` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:16.521823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bafdc5d341d4181a8155f4f9b3480cb)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:16.524633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:16.618661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bafdc5d341d4181a8155f4f9b3480cb', 'request_id': 'req-c6150f39-0b24-4493-bb07-b942cdc72844'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:16.629674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bafdc5d341d4181a8155f4f9b3480cb', 'request_id': 'req-c6150f39-0b24-4493-bb07-b942cdc72844'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:16.647991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bafdc5d341d4181a8155f4f9b3480cb', 'request_id': 'req-c6150f39-0b24-4493-bb07-b942cdc72844'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:16.670490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] The token cache is being invalidate because project 7bafdc5d341d4181a8155f4f9b3480cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:16.670919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:16.671993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6150f39-0b24-4493-bb07-b942cdc72844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:16.674038 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2766/5540] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:16 2022] DELETE /identity/v3/projects/7bafdc5d341d4181a8155f4f9b3480cb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:16.679898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894b14-546a-4fb1-899b-e84c7e15e883 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:16.680447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894b14-546a-4fb1-899b-e84c7e15e883 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:16.680447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894b14-546a-4fb1-899b-e84c7e15e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:16.719255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ce894b14-546a-4fb1-899b-e84c7e15e883 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:16.721546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ce894b14-546a-4fb1-899b-e84c7e15e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:16.848607 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2775/5541] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:16.856313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550a19-73c3-4762-b699-916255d2e71b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:16.856955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550a19-73c3-4762-b699-916255d2e71b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:16.856955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550a19-73c3-4762-b699-916255d2e71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:16.907196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ae550a19-73c3-4762-b699-916255d2e71b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:16.912795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ae550a19-73c3-4762-b699-916255d2e71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:16.934916 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2767/5542] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:16.938994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce894b14-546a-4fb1-899b-e84c7e15e883 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:16.954352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce894b14-546a-4fb1-899b-e84c7e15e883 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:16.969646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ffd68-ba38-47d4-9c3f-f251e664d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:16.970195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ffd68-ba38-47d4-9c3f-f251e664d0ac admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:16.970479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ffd68-ba38-47d4-9c3f-f251e664d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:16.970752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ffd68-ba38-47d4-9c3f-f251e664d0ac admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:16.971417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ffd68-ba38-47d4-9c3f-f251e664d0ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:16.971720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ffd68-ba38-47d4-9c3f-f251e664d0ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:16.974768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ffd68-ba38-47d4-9c3f-f251e664d0ac admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:17.003782 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2776/5543] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:17.005499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550a19-73c3-4762-b699-916255d2e71b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:17.035641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550a19-73c3-4762-b699-916255d2e71b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:17.055522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658de3f-c376-4642-85ad-c5518ce7d956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:17.056158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658de3f-c376-4642-85ad-c5518ce7d956 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:17.056630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658de3f-c376-4642-85ad-c5518ce7d956 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:17.057003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658de3f-c376-4642-85ad-c5518ce7d956 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:17.058313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658de3f-c376-4642-85ad-c5518ce7d956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:17.062853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658de3f-c376-4642-85ad-c5518ce7d956 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:17.155181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ffd68-ba38-47d4-9c3f-f251e664d0ac admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:17.155803 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2768/5544] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:17 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:17.171851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ffd68-ba38-47d4-9c3f-f251e664d0ac admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:17.271808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:17.284230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ac871-0aab-4150-81b4-4fa3216a4d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:17.286149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ac871-0aab-4150-81b4-4fa3216a4d22 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:17.286711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ac871-0aab-4150-81b4-4fa3216a4d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:17.287149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ac871-0aab-4150-81b4-4fa3216a4d22 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:17.288162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ac871-0aab-4150-81b4-4fa3216a4d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:17.290628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ac871-0aab-4150-81b4-4fa3216a4d22 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:17.331881 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2777/5545] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:17 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:49:17.334418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658de3f-c376-4642-85ad-c5518ce7d956 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:17.348744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658de3f-c376-4642-85ad-c5518ce7d956 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:17.360935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9d33-ccc5-422a-8451-06828e5074c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:17.361621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9d33-ccc5-422a-8451-06828e5074c7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:17.363041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9d33-ccc5-422a-8451-06828e5074c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:17.363331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9d33-ccc5-422a-8451-06828e5074c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:17.365163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9d33-ccc5-422a-8451-06828e5074c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:17.368922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9d33-ccc5-422a-8451-06828e5074c7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:17.402608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ac871-0aab-4150-81b4-4fa3216a4d22 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:17.408851 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2769/5546] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:17.411846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9d33-ccc5-422a-8451-06828e5074c7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:17.416329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ac871-0aab-4150-81b4-4fa3216a4d22 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:17.419139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4b6e9d33-ccc5-422a-8451-06828e5074c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:17.428721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13281dfe-fe42-4665-84ce-ae771a9afc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:17.429355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13281dfe-fe42-4665-84ce-ae771a9afc45 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:17.429663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13281dfe-fe42-4665-84ce-ae771a9afc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:17.429939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13281dfe-fe42-4665-84ce-ae771a9afc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:17.434755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13281dfe-fe42-4665-84ce-ae771a9afc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:17.437234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13281dfe-fe42-4665-84ce-ae771a9afc45 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:17.449780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9d33-ccc5-422a-8451-06828e5074c7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:17.466226 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2778/5547] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:17.467170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a07b2-b8cc-43b8-a4c4-b0f957ecae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:17.469328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13281dfe-fe42-4665-84ce-ae771a9afc45 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:17.469658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a07b2-b8cc-43b8-a4c4-b0f957ecae22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:17.470096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a07b2-b8cc-43b8-a4c4-b0f957ecae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:17.470999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a07b2-b8cc-43b8-a4c4-b0f957ecae22 admin admin] PATH_INFO: `/v3/users/1ae97c1d81de4b2b9137424b794ba10d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:17.475585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a07b2-b8cc-43b8-a4c4-b0f957ecae22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae97c1d81de4b2b9137424b794ba10d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:17.479937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a07b2-b8cc-43b8-a4c4-b0f957ecae22 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:17.491545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13281dfe-fe42-4665-84ce-ae771a9afc45 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:17.507536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd0114-ca09-4fe7-a75f-6787c93abcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:17.508580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0114-ca09-4fe7-a75f-6787c93abcc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:17.509275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0114-ca09-4fe7-a75f-6787c93abcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:17.509927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0114-ca09-4fe7-a75f-6787c93abcc2 admin admin] PATH_INFO: `/v3/projects/f9e9c8c3ae7e473083ac7aaf1758a8a6/users/e5bbef967a524d888007bb0fede478c9/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:17.540738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd0114-ca09-4fe7-a75f-6787c93abcc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e9c8c3ae7e473083ac7aaf1758a8a6, user_id=e5bbef967a524d888007bb0fede478c9, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:17.548108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd0114-ca09-4fe7-a75f-6787c93abcc2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:17.564564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:17.580379 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2779/5548] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:17 2022] PUT /identity/v3/projects/f9e9c8c3ae7e473083ac7aaf1758a8a6/users/e5bbef967a524d888007bb0fede478c9/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:17.582859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ac5b-d698-4ce1-bee3-f1b2c4dadba4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:17.583144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ac5b-d698-4ce1-bee3-f1b2c4dadba4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:17.583421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ac5b-d698-4ce1-bee3-f1b2c4dadba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:17.587166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0d9a07b2-b8cc-43b8-a4c4-b0f957ecae22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae97c1d81de4b2b9137424b794ba10d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:17.588259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0d9a07b2-b8cc-43b8-a4c4-b0f957ecae22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae97c1d81de4b2b9137424b794ba10d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:17.604524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0d9a07b2-b8cc-43b8-a4c4-b0f957ecae22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae97c1d81de4b2b9137424b794ba10d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:17.616834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0d9a07b2-b8cc-43b8-a4c4-b0f957ecae22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae97c1d81de4b2b9137424b794ba10d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:17.630117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0d9a07b2-b8cc-43b8-a4c4-b0f957ecae22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae97c1d81de4b2b9137424b794ba10d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:17.640817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e736ac5b-d698-4ce1-bee3-f1b2c4dadba4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:17.641896 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2770/5549] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:17 2022] DELETE /identity/v3/users/1ae97c1d81de4b2b9137424b794ba10d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:17.648173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b6ea-4b68-48a2-a997-2e44b0cf1f76 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:17.648737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b6ea-4b68-48a2-a997-2e44b0cf1f76 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:17.649324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b6ea-4b68-48a2-a997-2e44b0cf1f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:17.674616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e736ac5b-d698-4ce1-bee3-f1b2c4dadba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:17.681272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-27d9b6ea-4b68-48a2-a997-2e44b0cf1f76 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:17.683040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-27d9b6ea-4b68-48a2-a997-2e44b0cf1f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:17.863744 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2771/5550] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:17.888125 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2780/5551] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:17.927710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9b6ea-4b68-48a2-a997-2e44b0cf1f76 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:17.929332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-27d9b6ea-4b68-48a2-a997-2e44b0cf1f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:17.954222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736ac5b-d698-4ce1-bee3-f1b2c4dadba4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:17.956613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e736ac5b-d698-4ce1-bee3-f1b2c4dadba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:18.197488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9b6ea-4b68-48a2-a997-2e44b0cf1f76 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:18.204574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bebc90-b5f4-4e99-b128-5ad89b081e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:18.205305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bebc90-b5f4-4e99-b128-5ad89b081e05 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:18.209742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bebc90-b5f4-4e99-b128-5ad89b081e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:18.210141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bebc90-b5f4-4e99-b128-5ad89b081e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:18.222142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736ac5b-d698-4ce1-bee3-f1b2c4dadba4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:18.232655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e9494-60ff-4805-a630-9451fae959f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:18.232908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bebc90-b5f4-4e99-b128-5ad89b081e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:18.233337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e9494-60ff-4805-a630-9451fae959f5 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:18.234045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e9494-60ff-4805-a630-9451fae959f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:18.234045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e9494-60ff-4805-a630-9451fae959f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:18.236156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bebc90-b5f4-4e99-b128-5ad89b081e05 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:18.249920 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2772/5552] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:18.263015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e9494-60ff-4805-a630-9451fae959f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:18.264531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e9494-60ff-4805-a630-9451fae959f5 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:18.319336 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2781/5553] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:19.762803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bebc90-b5f4-4e99-b128-5ad89b081e05 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:19.764284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e0bebc90-b5f4-4e99-b128-5ad89b081e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:19.788014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bebc90-b5f4-4e99-b128-5ad89b081e05 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:19.803819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:19.804479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:19.804760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:19.805035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] PATH_INFO: `/v3/projects/3f8939a291d14da1b2ab54367ed64f2e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:19.806237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8939a291d14da1b2ab54367ed64f2e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:19.808174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:19.983143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8939a291d14da1b2ab54367ed64f2e', 'request_id': 'req-e5c56e60-1a57-4edd-b11a-7ea808474bc2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:19.986282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:19.996900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8939a291d14da1b2ab54367ed64f2e', 'request_id': 'req-e5c56e60-1a57-4edd-b11a-7ea808474bc2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.015812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8939a291d14da1b2ab54367ed64f2e', 'request_id': 'req-e5c56e60-1a57-4edd-b11a-7ea808474bc2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.049169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] The token cache is being invalidate because project 3f8939a291d14da1b2ab54367ed64f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:20.050621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.051883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e5c56e60-1a57-4edd-b11a-7ea808474bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.056613 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2773/5554] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:19 2022] DELETE /identity/v3/projects/3f8939a291d14da1b2ab54367ed64f2e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:20.061441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e9494-60ff-4805-a630-9451fae959f5 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:20.088485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e9494-60ff-4805-a630-9451fae959f5 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:20.272148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:20.304460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae40b3-8d61-4f96-bbf6-157f7d66369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:20.305128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae40b3-8d61-4f96-bbf6-157f7d66369a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:20.305412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae40b3-8d61-4f96-bbf6-157f7d66369a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:20.305704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae40b3-8d61-4f96-bbf6-157f7d66369a admin admin] PATH_INFO: `/v3/users/25cd3f24b9974bcbba9d32557207b4a7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:20.306965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae40b3-8d61-4f96-bbf6-157f7d66369a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25cd3f24b9974bcbba9d32557207b4a7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:20.309069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae40b3-8d61-4f96-bbf6-157f7d66369a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:20.438939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29ae40b3-8d61-4f96-bbf6-157f7d66369a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25cd3f24b9974bcbba9d32557207b4a7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.439984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29ae40b3-8d61-4f96-bbf6-157f7d66369a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25cd3f24b9974bcbba9d32557207b4a7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.482090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29ae40b3-8d61-4f96-bbf6-157f7d66369a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25cd3f24b9974bcbba9d32557207b4a7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.483939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29ae40b3-8d61-4f96-bbf6-157f7d66369a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25cd3f24b9974bcbba9d32557207b4a7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.511468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29ae40b3-8d61-4f96-bbf6-157f7d66369a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25cd3f24b9974bcbba9d32557207b4a7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:20.546521 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2782/5555] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:20 2022] DELETE /identity/v3/users/25cd3f24b9974bcbba9d32557207b4a7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:21.486785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539043e-9a20-449b-9dbb-5f15ce3f5492 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:21.487188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539043e-9a20-449b-9dbb-5f15ce3f5492 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:21.487529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539043e-9a20-449b-9dbb-5f15ce3f5492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:21.579123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3539043e-9a20-449b-9dbb-5f15ce3f5492 None None] MFA Rules not processed for user `e5bbef967a524d888007bb0fede478c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:21.580510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3539043e-9a20-449b-9dbb-5f15ce3f5492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:21.744402 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2774/5556] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:21.755745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b0964-049d-4d7c-a0dc-edc4db634280 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:21.758884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b0964-049d-4d7c-a0dc-edc4db634280 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:21.761537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b0964-049d-4d7c-a0dc-edc4db634280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:21.801244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4d7b0964-049d-4d7c-a0dc-edc4db634280 None None] MFA Rules not processed for user `e5bbef967a524d888007bb0fede478c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:21.815924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4d7b0964-049d-4d7c-a0dc-edc4db634280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:21.854118 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2783/5557] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:21.921726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca158fe5-94f1-47e8-b236-56b64ed76d5e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:21.922150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca158fe5-94f1-47e8-b236-56b64ed76d5e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:21.922284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca158fe5-94f1-47e8-b236-56b64ed76d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:21.951058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ca158fe5-94f1-47e8-b236-56b64ed76d5e None None] MFA Rules not processed for user `e5bbef967a524d888007bb0fede478c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:21.952438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ca158fe5-94f1-47e8-b236-56b64ed76d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:21.968157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b0964-049d-4d7c-a0dc-edc4db634280 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:21.969191 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2775/5558] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:21.969975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4d7b0964-049d-4d7c-a0dc-edc4db634280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:21.981069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca158fe5-94f1-47e8-b236-56b64ed76d5e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:21.982577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ca158fe5-94f1-47e8-b236-56b64ed76d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:22.124554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b0964-049d-4d7c-a0dc-edc4db634280 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:22.137283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:22.137974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.138332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.138530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] PATH_INFO: `/v3/projects/f1903b9ea5d34d4c9aba3dcc3b6a7000` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.144008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1903b9ea5d34d4c9aba3dcc3b6a7000)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:22.145998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:22.147208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca158fe5-94f1-47e8-b236-56b64ed76d5e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:22.165044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fc482-c459-49c1-8866-b1fe4ad10933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:22.166003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc482-c459-49c1-8866-b1fe4ad10933 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.166134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc482-c459-49c1-8866-b1fe4ad10933 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.166630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc482-c459-49c1-8866-b1fe4ad10933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.185381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fc482-c459-49c1-8866-b1fe4ad10933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:22.187381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fc482-c459-49c1-8866-b1fe4ad10933 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:22.206471 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2776/5559] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:22.265547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1903b9ea5d34d4c9aba3dcc3b6a7000', 'request_id': 'req-6744b877-b49c-4620-acd4-ca92c3312302'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:22.278290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1903b9ea5d34d4c9aba3dcc3b6a7000', 'request_id': 'req-6744b877-b49c-4620-acd4-ca92c3312302'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:22.291579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1903b9ea5d34d4c9aba3dcc3b6a7000', 'request_id': 'req-6744b877-b49c-4620-acd4-ca92c3312302'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:22.298734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:22.319291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] The token cache is being invalidate because project f1903b9ea5d34d4c9aba3dcc3b6a7000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:22.319806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:22.323907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6744b877-b49c-4620-acd4-ca92c3312302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:22.327566 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2784/5560] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:21 2022] DELETE /identity/v3/projects/f1903b9ea5d34d4c9aba3dcc3b6a7000 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:22.333051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3ec12-8948-4af7-a67c-1147f671f199 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.333337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3ec12-8948-4af7-a67c-1147f671f199 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.333663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3ec12-8948-4af7-a67c-1147f671f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.367484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f7f3ec12-8948-4af7-a67c-1147f671f199 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:22.369272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f7f3ec12-8948-4af7-a67c-1147f671f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:22.549571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:22.594850 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2777/5561] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:22.598175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ec59-b190-4304-9dba-2e0f3760aeba None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.598580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ec59-b190-4304-9dba-2e0f3760aeba None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.598959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ec59-b190-4304-9dba-2e0f3760aeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.657029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e3d1ec59-b190-4304-9dba-2e0f3760aeba None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:22.662699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e3d1ec59-b190-4304-9dba-2e0f3760aeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:22.690341 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2785/5562] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:22.692436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3ec12-8948-4af7-a67c-1147f671f199 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:22.719616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3ec12-8948-4af7-a67c-1147f671f199 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:22.735726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0b81-a362-4316-bfe3-1e122600dcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:22.736538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0b81-a362-4316-bfe3-1e122600dcbb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.737026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0b81-a362-4316-bfe3-1e122600dcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.737420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0b81-a362-4316-bfe3-1e122600dcbb admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.738259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de0b81-a362-4316-bfe3-1e122600dcbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:22.739972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de0b81-a362-4316-bfe3-1e122600dcbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:22.744588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de0b81-a362-4316-bfe3-1e122600dcbb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:22.815012 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2778/5563] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:22.817096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ec59-b190-4304-9dba-2e0f3760aeba None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:22.828815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ec59-b190-4304-9dba-2e0f3760aeba None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:22.842887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3c2ca-e251-48e8-9401-87007a2fd1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:22.843511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3c2ca-e251-48e8-9401-87007a2fd1af admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:22.843788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3c2ca-e251-48e8-9401-87007a2fd1af admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:22.844058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3c2ca-e251-48e8-9401-87007a2fd1af admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:22.844695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3c2ca-e251-48e8-9401-87007a2fd1af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:22.851223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3c2ca-e251-48e8-9401-87007a2fd1af admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:22.912657 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2786/5564] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:22 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:22.918215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0b81-a362-4316-bfe3-1e122600dcbb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:22.936301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0b81-a362-4316-bfe3-1e122600dcbb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:23.168100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649fb15-ee8f-47b4-bc7c-85001dbf209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:23.169775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649fb15-ee8f-47b4-bc7c-85001dbf209c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:23.170230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649fb15-ee8f-47b4-bc7c-85001dbf209c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:23.170725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649fb15-ee8f-47b4-bc7c-85001dbf209c admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:23.171649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649fb15-ee8f-47b4-bc7c-85001dbf209c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:23.182922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649fb15-ee8f-47b4-bc7c-85001dbf209c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:23.228950 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2779/5565] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:22 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:23.233329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3c2ca-e251-48e8-9401-87007a2fd1af admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:23.261071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3c2ca-e251-48e8-9401-87007a2fd1af admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:23.276454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c01e3a-97fa-4def-804a-855a36224cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:23.277087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c01e3a-97fa-4def-804a-855a36224cbd admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:23.277353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c01e3a-97fa-4def-804a-855a36224cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:23.277657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c01e3a-97fa-4def-804a-855a36224cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:23.278309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c01e3a-97fa-4def-804a-855a36224cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:23.284834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c01e3a-97fa-4def-804a-855a36224cbd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:23.335123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649fb15-ee8f-47b4-bc7c-85001dbf209c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:23.336167 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2787/5566] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:23.348495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c01e3a-97fa-4def-804a-855a36224cbd admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:23.351662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649fb15-ee8f-47b4-bc7c-85001dbf209c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:23.351849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-59c01e3a-97fa-4def-804a-855a36224cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:23.367925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8d720-4bdd-451c-b1cf-4a3c9fcd9ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:23.370312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8d720-4bdd-451c-b1cf-4a3c9fcd9ffb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:23.370658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8d720-4bdd-451c-b1cf-4a3c9fcd9ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:23.370948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8d720-4bdd-451c-b1cf-4a3c9fcd9ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:23.373230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8d720-4bdd-451c-b1cf-4a3c9fcd9ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:23.380044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8d720-4bdd-451c-b1cf-4a3c9fcd9ffb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:23.401922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c01e3a-97fa-4def-804a-855a36224cbd admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:23.418820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4274db5-9b49-4ca0-8181-4e2e1695894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:23.418820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274db5-9b49-4ca0-8181-4e2e1695894f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:23.419209 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2780/5567] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:23.419298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274db5-9b49-4ca0-8181-4e2e1695894f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:23.419298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274db5-9b49-4ca0-8181-4e2e1695894f admin admin] PATH_INFO: `/v3/users/080c5ab5d3014d33a745853ca9b2056b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:23.420134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4274db5-9b49-4ca0-8181-4e2e1695894f admin admin] RBAC: Authorizing `identity:delete_user(user_id=080c5ab5d3014d33a745853ca9b2056b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:23.420780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8d720-4bdd-451c-b1cf-4a3c9fcd9ffb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:23.422938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4274db5-9b49-4ca0-8181-4e2e1695894f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:23.451909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8d720-4bdd-451c-b1cf-4a3c9fcd9ffb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:23.464779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e8d8a-3b7d-4bce-bc5f-54a294b49f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:23.466703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8d8a-3b7d-4bce-bc5f-54a294b49f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:23.466997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8d8a-3b7d-4bce-bc5f-54a294b49f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:23.472035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8d8a-3b7d-4bce-bc5f-54a294b49f64 admin admin] PATH_INFO: `/v3/projects/52e20f3102564686a1ad5507633bee37/users/1da5be2ec43d46cc8ad6e29db660bf61/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:23.537809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e8d8a-3b7d-4bce-bc5f-54a294b49f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e20f3102564686a1ad5507633bee37, user_id=1da5be2ec43d46cc8ad6e29db660bf61, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:23.549621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e8d8a-3b7d-4bce-bc5f-54a294b49f64 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:23.575519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4274db5-9b49-4ca0-8181-4e2e1695894f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080c5ab5d3014d33a745853ca9b2056b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:23.577729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4274db5-9b49-4ca0-8181-4e2e1695894f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080c5ab5d3014d33a745853ca9b2056b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:23.599936 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2781/5568] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:23 2022] PUT /identity/v3/projects/52e20f3102564686a1ad5507633bee37/users/1da5be2ec43d46cc8ad6e29db660bf61/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:23.601844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498db41-73d7-4aee-938d-6e53125831f5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:23.602140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498db41-73d7-4aee-938d-6e53125831f5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:23.602420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498db41-73d7-4aee-938d-6e53125831f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:23.619312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4274db5-9b49-4ca0-8181-4e2e1695894f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080c5ab5d3014d33a745853ca9b2056b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:23.621051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4274db5-9b49-4ca0-8181-4e2e1695894f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080c5ab5d3014d33a745853ca9b2056b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:23.636285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4274db5-9b49-4ca0-8181-4e2e1695894f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080c5ab5d3014d33a745853ca9b2056b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:23.658449 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2788/5569] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:23 2022] DELETE /identity/v3/users/080c5ab5d3014d33a745853ca9b2056b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:23.663311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84668f-cd41-41c9-aa6e-bcf00465e81f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:23.663843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84668f-cd41-41c9-aa6e-bcf00465e81f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:23.665331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84668f-cd41-41c9-aa6e-bcf00465e81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:23.709296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7d84668f-cd41-41c9-aa6e-bcf00465e81f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:23.711147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7d84668f-cd41-41c9-aa6e-bcf00465e81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:23.711746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b498db41-73d7-4aee-938d-6e53125831f5 None None] MFA Rules not processed for user `1da5be2ec43d46cc8ad6e29db660bf61`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:23.712998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b498db41-73d7-4aee-938d-6e53125831f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:23.917876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2789/5570] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:23.950642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84668f-cd41-41c9-aa6e-bcf00465e81f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:23.952122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7d84668f-cd41-41c9-aa6e-bcf00465e81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:23.985791 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2782/5571] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:23.991159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498db41-73d7-4aee-938d-6e53125831f5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:23.993361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b498db41-73d7-4aee-938d-6e53125831f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:24.030747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498db41-73d7-4aee-938d-6e53125831f5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:24.064249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66973c5-417b-49c4-a773-67dece02539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:24.064949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:24.069133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66973c5-417b-49c4-a773-67dece02539f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.069480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66973c5-417b-49c4-a773-67dece02539f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.069776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66973c5-417b-49c4-a773-67dece02539f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:24.072497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66973c5-417b-49c4-a773-67dece02539f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:24.082729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66973c5-417b-49c4-a773-67dece02539f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:24.139266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:24.161915 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2783/5572] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:23 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:24.162772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7281e-935d-4611-af7b-5b87d4206d28 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.163069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7281e-935d-4611-af7b-5b87d4206d28 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.163356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7281e-935d-4611-af7b-5b87d4206d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:24.197853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84668f-cd41-41c9-aa6e-bcf00465e81f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:24.255141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fce7281e-935d-4611-af7b-5b87d4206d28 None None] MFA Rules not processed for user `e5bbef967a524d888007bb0fede478c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:24.256467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fce7281e-935d-4611-af7b-5b87d4206d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:24.394920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6dcb-09ab-47c0-8a72-0e28ead0f177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:24.395846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6dcb-09ab-47c0-8a72-0e28ead0f177 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.396129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6dcb-09ab-47c0-8a72-0e28ead0f177 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.396402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6dcb-09ab-47c0-8a72-0e28ead0f177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:24.482018 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2784/5573] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:24.483926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7281e-935d-4611-af7b-5b87d4206d28 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:24.588993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d6dcb-09ab-47c0-8a72-0e28ead0f177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:24.595215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d6dcb-09ab-47c0-8a72-0e28ead0f177 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:24.641121 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2790/5574] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:24.677911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7281e-935d-4611-af7b-5b87d4206d28 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:24.691599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3299d0b-a601-4681-a46d-97445b2d3134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:24.693688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3299d0b-a601-4681-a46d-97445b2d3134 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.694108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3299d0b-a601-4681-a46d-97445b2d3134 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.694535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3299d0b-a601-4681-a46d-97445b2d3134 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:24.695576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3299d0b-a601-4681-a46d-97445b2d3134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:24.701517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3299d0b-a601-4681-a46d-97445b2d3134 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:24.762062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6dcb-09ab-47c0-8a72-0e28ead0f177 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:24.763511 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2785/5575] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:24 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:24.783931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6dcb-09ab-47c0-8a72-0e28ead0f177 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:24.795623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a3075-aa76-4434-813c-eb1a3d42fe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:24.796193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3075-aa76-4434-813c-eb1a3d42fe3e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.797707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3075-aa76-4434-813c-eb1a3d42fe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.798318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3075-aa76-4434-813c-eb1a3d42fe3e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:24.801785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a3075-aa76-4434-813c-eb1a3d42fe3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:24.803511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a3075-aa76-4434-813c-eb1a3d42fe3e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:24.832613 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2791/5576] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:49:24.834533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3299d0b-a601-4681-a46d-97445b2d3134 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:24.851233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3299d0b-a601-4681-a46d-97445b2d3134 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:24.864458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9a198-a415-4279-8558-280943d8a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:24.871539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9a198-a415-4279-8558-280943d8a75a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.873265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9a198-a415-4279-8558-280943d8a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.890183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9a198-a415-4279-8558-280943d8a75a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:24.891780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9a198-a415-4279-8558-280943d8a75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:24.896890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9a198-a415-4279-8558-280943d8a75a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:24.935341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a3075-aa76-4434-813c-eb1a3d42fe3e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:24.935929 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2786/5577] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:24.962494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a3075-aa76-4434-813c-eb1a3d42fe3e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:24.982373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2a04f-5a12-4223-ad8d-2fa923d16b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:24.983146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a04f-5a12-4223-ad8d-2fa923d16b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:24.983435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a04f-5a12-4223-ad8d-2fa923d16b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:24.983737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a04f-5a12-4223-ad8d-2fa923d16b6a admin admin] PATH_INFO: `/v3/projects/e5ea451211924195b28e6c1edcc4a9a6/users/e5892bbf989148a7a5854f960302400f/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:25.022827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2a04f-5a12-4223-ad8d-2fa923d16b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ea451211924195b28e6c1edcc4a9a6, user_id=e5892bbf989148a7a5854f960302400f, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:25.032567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2a04f-5a12-4223-ad8d-2fa923d16b6a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:25.082994 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2792/5578] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:24 2022] PUT /identity/v3/projects/e5ea451211924195b28e6c1edcc4a9a6/users/e5892bbf989148a7a5854f960302400f/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:25.094430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66f16-6040-4503-9402-09bc10c83b0b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:25.095442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66f16-6040-4503-9402-09bc10c83b0b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:25.095809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66f16-6040-4503-9402-09bc10c83b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:25.200216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1ce66f16-6040-4503-9402-09bc10c83b0b None None] MFA Rules not processed for user `e5892bbf989148a7a5854f960302400f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:25.207682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1ce66f16-6040-4503-9402-09bc10c83b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:25.390971 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2787/5579] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:25.398619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2a04f-5a12-4223-ad8d-2fa923d16b6a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:25.400932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-73b2a04f-5a12-4223-ad8d-2fa923d16b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:25.450884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce66f16-6040-4503-9402-09bc10c83b0b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:25.452912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1ce66f16-6040-4503-9402-09bc10c83b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:25.489144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:25.620924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce66f16-6040-4503-9402-09bc10c83b0b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:25.643636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:25.644526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:25.644828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:25.645108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] PATH_INFO: `/v3/users/6a35a2ed9cd244e69edfdf22f7dc24d2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:25.649482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a35a2ed9cd244e69edfdf22f7dc24d2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:25.660108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:25.663148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2a04f-5a12-4223-ad8d-2fa923d16b6a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:25.676083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04449b-9fe6-4760-9f30-f5b9dc3b3b23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:25.676852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04449b-9fe6-4760-9f30-f5b9dc3b3b23 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:25.678403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04449b-9fe6-4760-9f30-f5b9dc3b3b23 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:25.678789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04449b-9fe6-4760-9f30-f5b9dc3b3b23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:25.697792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:25.781046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04449b-9fe6-4760-9f30-f5b9dc3b3b23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:25.784968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04449b-9fe6-4760-9f30-f5b9dc3b3b23 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:25.792170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a35a2ed9cd244e69edfdf22f7dc24d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:25.793196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a35a2ed9cd244e69edfdf22f7dc24d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:25.797711 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2793/5580] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:25.837244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a35a2ed9cd244e69edfdf22f7dc24d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:25.852308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a35a2ed9cd244e69edfdf22f7dc24d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:25.864640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a35a2ed9cd244e69edfdf22f7dc24d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:25.901418 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2788/5581] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:25 2022] DELETE /identity/v3/users/6a35a2ed9cd244e69edfdf22f7dc24d2 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:25.910782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49f6d3-5421-4778-a693-0c650ec01483 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:25.911196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49f6d3-5421-4778-a693-0c650ec01483 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:25.911599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49f6d3-5421-4778-a693-0c650ec01483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:25.985263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7f49f6d3-5421-4778-a693-0c650ec01483 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:25.998907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7f49f6d3-5421-4778-a693-0c650ec01483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:26.044928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:26.046910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:26.107112 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2794/5582] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:26.141956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49f6d3-5421-4778-a693-0c650ec01483 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:26.144427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7f49f6d3-5421-4778-a693-0c650ec01483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:26.168781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e08308-2ee0-4df9-a017-604cc382c42e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:26.199300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2b716-b74f-4a98-96e9-58de92c9947c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:26.200813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2b716-b74f-4a98-96e9-58de92c9947c service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:26.201545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2b716-b74f-4a98-96e9-58de92c9947c service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:26.202158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2b716-b74f-4a98-96e9-58de92c9947c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:26.211115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e3c2b716-b74f-4a98-96e9-58de92c9947c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:26.324302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:26.359335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2b716-b74f-4a98-96e9-58de92c9947c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:26.361168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2b716-b74f-4a98-96e9-58de92c9947c service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:26.399754 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2789/5583] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:26.401580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49f6d3-5421-4778-a693-0c650ec01483 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:26.411023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635524e-d166-4344-a3ec-3e8e2fbd00b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:26.412125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635524e-d166-4344-a3ec-3e8e2fbd00b1 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:26.412805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635524e-d166-4344-a3ec-3e8e2fbd00b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:26.413255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635524e-d166-4344-a3ec-3e8e2fbd00b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:26.430730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635524e-d166-4344-a3ec-3e8e2fbd00b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:26.433124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635524e-d166-4344-a3ec-3e8e2fbd00b1 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:26.452557 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2795/5584] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:27.054592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2b716-b74f-4a98-96e9-58de92c9947c service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:27.056873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e3c2b716-b74f-4a98-96e9-58de92c9947c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:27.087444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635524e-d166-4344-a3ec-3e8e2fbd00b1 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:27.089176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2b716-b74f-4a98-96e9-58de92c9947c service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:27.090450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b635524e-d166-4344-a3ec-3e8e2fbd00b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:27.106251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3c47e-6e51-4929-b60c-b25b499dd6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:27.107075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c47e-6e51-4929-b60c-b25b499dd6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:27.107465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c47e-6e51-4929-b60c-b25b499dd6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:27.107910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c47e-6e51-4929-b60c-b25b499dd6d2 admin admin] PATH_INFO: `/v3/users/1da5be2ec43d46cc8ad6e29db660bf61` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:27.110765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3c47e-6e51-4929-b60c-b25b499dd6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da5be2ec43d46cc8ad6e29db660bf61)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:27.116269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3c47e-6e51-4929-b60c-b25b499dd6d2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:27.181944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635524e-d166-4344-a3ec-3e8e2fbd00b1 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:27.209951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:27.214094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:27.217720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:27.218573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] PATH_INFO: `/v3/projects/a8622c7a8d9149999abd79de8469870f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:27.227811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8622c7a8d9149999abd79de8469870f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:27.233201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:27.250805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d2f3c47e-6e51-4929-b60c-b25b499dd6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da5be2ec43d46cc8ad6e29db660bf61'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:27.254153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d2f3c47e-6e51-4929-b60c-b25b499dd6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da5be2ec43d46cc8ad6e29db660bf61'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:27.298814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d2f3c47e-6e51-4929-b60c-b25b499dd6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da5be2ec43d46cc8ad6e29db660bf61'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:27.313701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d2f3c47e-6e51-4929-b60c-b25b499dd6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da5be2ec43d46cc8ad6e29db660bf61'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:27.334304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d2f3c47e-6e51-4929-b60c-b25b499dd6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da5be2ec43d46cc8ad6e29db660bf61'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:27.346525 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2790/5585] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:27 2022] DELETE /identity/v3/users/1da5be2ec43d46cc8ad6e29db660bf61 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:27.347857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ec931-f9be-4b9c-b175-3730ce5e64ca None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:27.348149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ec931-f9be-4b9c-b175-3730ce5e64ca None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:27.348432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ec931-f9be-4b9c-b175-3730ce5e64ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:27.380952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-629ec931-f9be-4b9c-b175-3730ce5e64ca None None] MFA Rules not processed for user `e5bbef967a524d888007bb0fede478c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:27.382131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-629ec931-f9be-4b9c-b175-3730ce5e64ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:27.408951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8622c7a8d9149999abd79de8469870f', 'request_id': 'req-36636e98-647b-4cef-ad27-6609932e8bd3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:27.411714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:27.450128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8622c7a8d9149999abd79de8469870f', 'request_id': 'req-36636e98-647b-4cef-ad27-6609932e8bd3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:27.478584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8622c7a8d9149999abd79de8469870f', 'request_id': 'req-36636e98-647b-4cef-ad27-6609932e8bd3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:27.502116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] The token cache is being invalidate because project a8622c7a8d9149999abd79de8469870f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:27.502369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:27.503591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-36636e98-647b-4cef-ad27-6609932e8bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:27.508391 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2796/5586] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:27 2022] DELETE /identity/v3/projects/a8622c7a8d9149999abd79de8469870f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:27.521836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b8463-0d17-4651-a4f5-b121abe05272 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:27.522169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b8463-0d17-4651-a4f5-b121abe05272 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:27.522599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b8463-0d17-4651-a4f5-b121abe05272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:27.562658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-157b8463-0d17-4651-a4f5-b121abe05272 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:27.564730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-157b8463-0d17-4651-a4f5-b121abe05272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:27.656749 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2791/5587] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:27.661072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ec931-f9be-4b9c-b175-3730ce5e64ca None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:27.665716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-629ec931-f9be-4b9c-b175-3730ce5e64ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:27.722677 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2797/5588] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:27.748089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b8463-0d17-4651-a4f5-b121abe05272 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:27.749617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-157b8463-0d17-4651-a4f5-b121abe05272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:27.941845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b8463-0d17-4651-a4f5-b121abe05272 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:27.945262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ec931-f9be-4b9c-b175-3730ce5e64ca None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:27.954687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431df3c2-c1ce-4ae4-ab1a-afd62122852f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:27.957679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df3c2-c1ce-4ae4-ab1a-afd62122852f service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:27.958181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df3c2-c1ce-4ae4-ab1a-afd62122852f service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:27.960824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df3c2-c1ce-4ae4-ab1a-afd62122852f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:27.976327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03354fe-94a2-4ce3-8e8e-63ff4c8b229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:27.985922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03354fe-94a2-4ce3-8e8e-63ff4c8b229d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:27.988853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03354fe-94a2-4ce3-8e8e-63ff4c8b229d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:27.990536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03354fe-94a2-4ce3-8e8e-63ff4c8b229d admin admin] PATH_INFO: `/v3/users/32ec7005caf3413d9819edba1a66185a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:27.997246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03354fe-94a2-4ce3-8e8e-63ff4c8b229d admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ec7005caf3413d9819edba1a66185a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:27.998117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431df3c2-c1ce-4ae4-ab1a-afd62122852f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:28.003650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431df3c2-c1ce-4ae4-ab1a-afd62122852f service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:28.004473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03354fe-94a2-4ce3-8e8e-63ff4c8b229d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:28.052328 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2798/5589] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:28.070473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:28.216994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d03354fe-94a2-4ce3-8e8e-63ff4c8b229d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ec7005caf3413d9819edba1a66185a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:28.220159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d03354fe-94a2-4ce3-8e8e-63ff4c8b229d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ec7005caf3413d9819edba1a66185a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:28.252408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d03354fe-94a2-4ce3-8e8e-63ff4c8b229d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ec7005caf3413d9819edba1a66185a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:28.266403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d03354fe-94a2-4ce3-8e8e-63ff4c8b229d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ec7005caf3413d9819edba1a66185a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:28.285198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d03354fe-94a2-4ce3-8e8e-63ff4c8b229d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ec7005caf3413d9819edba1a66185a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:28.306608 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2792/5590] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:27 2022] DELETE /identity/v3/users/32ec7005caf3413d9819edba1a66185a => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:28.600184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431df3c2-c1ce-4ae4-ab1a-afd62122852f service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:28.602079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-431df3c2-c1ce-4ae4-ab1a-afd62122852f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:28.631361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431df3c2-c1ce-4ae4-ab1a-afd62122852f service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:28.779434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:28.782851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:28.783347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:28.783646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] PATH_INFO: `/v3/projects/e0afa18e24b741a79ef08e7adae1fd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:28.788977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0afa18e24b741a79ef08e7adae1fd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:28.793022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:28.876822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:28.921821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0afa18e24b741a79ef08e7adae1fd2d', 'request_id': 'req-e8bf4082-2577-40b2-9339-225033e4a4aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:28.938893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0afa18e24b741a79ef08e7adae1fd2d', 'request_id': 'req-e8bf4082-2577-40b2-9339-225033e4a4aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:28.966758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0afa18e24b741a79ef08e7adae1fd2d', 'request_id': 'req-e8bf4082-2577-40b2-9339-225033e4a4aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:29.004513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] The token cache is being invalidate because project e0afa18e24b741a79ef08e7adae1fd2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:29.005625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:29.007485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8bf4082-2577-40b2-9339-225033e4a4aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:29.014892 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2799/5591] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:28 2022] DELETE /identity/v3/projects/e0afa18e24b741a79ef08e7adae1fd2d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:29.020029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea9b6d-9e95-487c-8d3f-48acb292b79e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:29.020321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea9b6d-9e95-487c-8d3f-48acb292b79e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:29.020605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea9b6d-9e95-487c-8d3f-48acb292b79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:29.060425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-17ea9b6d-9e95-487c-8d3f-48acb292b79e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:29.061698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-17ea9b6d-9e95-487c-8d3f-48acb292b79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:29.197525 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2793/5592] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:29.207778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90a636-c96f-44c8-bb9e-d97cd8a3b50f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:29.207939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90a636-c96f-44c8-bb9e-d97cd8a3b50f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:29.209636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90a636-c96f-44c8-bb9e-d97cd8a3b50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:29.273020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5d90a636-c96f-44c8-bb9e-d97cd8a3b50f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:29.279552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5d90a636-c96f-44c8-bb9e-d97cd8a3b50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:29.309604 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2800/5593] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:29.315418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea9b6d-9e95-487c-8d3f-48acb292b79e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:29.328031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea9b6d-9e95-487c-8d3f-48acb292b79e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:29.350034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb149c56-fdb0-4fd3-bbfc-58248d842e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:29.351499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb149c56-fdb0-4fd3-bbfc-58248d842e52 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:29.352767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb149c56-fdb0-4fd3-bbfc-58248d842e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:29.354240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb149c56-fdb0-4fd3-bbfc-58248d842e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:29.355168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb149c56-fdb0-4fd3-bbfc-58248d842e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:29.355955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb149c56-fdb0-4fd3-bbfc-58248d842e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:29.357882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb149c56-fdb0-4fd3-bbfc-58248d842e52 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:29.387585 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2794/5594] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:29.395056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90a636-c96f-44c8-bb9e-d97cd8a3b50f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:29.410807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90a636-c96f-44c8-bb9e-d97cd8a3b50f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:29.418684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da0b9f-5d45-4bc5-86be-7e37f03e82d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:29.419711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0b9f-5d45-4bc5-86be-7e37f03e82d5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:29.420034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0b9f-5d45-4bc5-86be-7e37f03e82d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:29.420552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0b9f-5d45-4bc5-86be-7e37f03e82d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:29.421200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da0b9f-5d45-4bc5-86be-7e37f03e82d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:29.423299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da0b9f-5d45-4bc5-86be-7e37f03e82d5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:29.472429 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2801/5595] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:29 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:29.476368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb149c56-fdb0-4fd3-bbfc-58248d842e52 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:29.486887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb149c56-fdb0-4fd3-bbfc-58248d842e52 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:29.582913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8f3c-1ab3-4306-885e-81bebe5b28fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:29.583850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8f3c-1ab3-4306-885e-81bebe5b28fd admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:29.585979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8f3c-1ab3-4306-885e-81bebe5b28fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:29.586839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8f3c-1ab3-4306-885e-81bebe5b28fd admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:29.588679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec8f3c-1ab3-4306-885e-81bebe5b28fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:29.591015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec8f3c-1ab3-4306-885e-81bebe5b28fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:29.618604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:29.629422 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2795/5596] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:29 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:29.633171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da0b9f-5d45-4bc5-86be-7e37f03e82d5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:29.648769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da0b9f-5d45-4bc5-86be-7e37f03e82d5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:29.657021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65e1a-0cfb-45ec-88c2-cce3a116f8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:29.658268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65e1a-0cfb-45ec-88c2-cce3a116f8ee admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:29.658805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65e1a-0cfb-45ec-88c2-cce3a116f8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:29.659534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65e1a-0cfb-45ec-88c2-cce3a116f8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:29.660947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e65e1a-0cfb-45ec-88c2-cce3a116f8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:29.663102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e65e1a-0cfb-45ec-88c2-cce3a116f8ee admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:29.691592 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2802/5597] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:29.696946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8f3c-1ab3-4306-885e-81bebe5b28fd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:29.733498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8f3c-1ab3-4306-885e-81bebe5b28fd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:29.754594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03d511-b080-4e83-9cd1-5df7455753da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:29.755436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03d511-b080-4e83-9cd1-5df7455753da admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:29.755790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03d511-b080-4e83-9cd1-5df7455753da admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:29.756362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03d511-b080-4e83-9cd1-5df7455753da admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:29.757350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03d511-b080-4e83-9cd1-5df7455753da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:29.763624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03d511-b080-4e83-9cd1-5df7455753da admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:29.769931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65e1a-0cfb-45ec-88c2-cce3a116f8ee admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:29.771965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-49e65e1a-0cfb-45ec-88c2-cce3a116f8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:29.808767 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2796/5598] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:29.809765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03d511-b080-4e83-9cd1-5df7455753da admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:29.816308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65e1a-0cfb-45ec-88c2-cce3a116f8ee admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:29.839038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03d511-b080-4e83-9cd1-5df7455753da admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:29.853816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:29.854387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a8152-984e-46ef-aaae-ec95be1b268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:29.855214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8152-984e-46ef-aaae-ec95be1b268d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:29.855500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8152-984e-46ef-aaae-ec95be1b268d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:29.855795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8152-984e-46ef-aaae-ec95be1b268d admin admin] PATH_INFO: `/v3/projects/11f5cd95c4d445f0b2f49d62d4b75655/users/e59eb282162c4bf9ac18297f64c39396/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:29.856544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:29.859108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:29.859958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] PATH_INFO: `/v3/projects/52e20f3102564686a1ad5507633bee37` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:29.864652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e20f3102564686a1ad5507633bee37)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:29.877593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:29.886798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a8152-984e-46ef-aaae-ec95be1b268d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f5cd95c4d445f0b2f49d62d4b75655, user_id=e59eb282162c4bf9ac18297f64c39396, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:29.889559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a8152-984e-46ef-aaae-ec95be1b268d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:29.917089 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2797/5599] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:29 2022] PUT /identity/v3/projects/11f5cd95c4d445f0b2f49d62d4b75655/users/e59eb282162c4bf9ac18297f64c39396/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:29.935983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032933b8-8852-4acb-b4d2-f89c9f49bc3c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:29.935983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032933b8-8852-4acb-b4d2-f89c9f49bc3c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:29.936392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032933b8-8852-4acb-b4d2-f89c9f49bc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:30.038525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-032933b8-8852-4acb-b4d2-f89c9f49bc3c None None] MFA Rules not processed for user `e59eb282162c4bf9ac18297f64c39396`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:30.039924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-032933b8-8852-4acb-b4d2-f89c9f49bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:30.059999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e20f3102564686a1ad5507633bee37', 'request_id': 'req-19434b42-dca9-408f-a370-1268eb77dce9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:30.064110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e20f3102564686a1ad5507633bee37', 'request_id': 'req-19434b42-dca9-408f-a370-1268eb77dce9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:30.090079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e20f3102564686a1ad5507633bee37', 'request_id': 'req-19434b42-dca9-408f-a370-1268eb77dce9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:30.116086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] The token cache is being invalidate because project 52e20f3102564686a1ad5507633bee37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:30.116592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:30.131549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:30.153873 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2803/5600] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:29 2022] DELETE /identity/v3/projects/52e20f3102564686a1ad5507633bee37 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:30.158712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:30.162256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:30.248163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:30.261545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19434b42-dca9-408f-a370-1268eb77dce9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:30.277976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:30.278869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:30.279363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:30.279811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] PATH_INFO: `/v3/users/e5892bbf989148a7a5854f960302400f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:30.282757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5892bbf989148a7a5854f960302400f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:30.283622 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2798/5601] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:30.291760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:30.335807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032933b8-8852-4acb-b4d2-f89c9f49bc3c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:30.337827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-032933b8-8852-4acb-b4d2-f89c9f49bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:30.362089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5892bbf989148a7a5854f960302400f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:30.363356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5892bbf989148a7a5854f960302400f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:30.377928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5892bbf989148a7a5854f960302400f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:30.378935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5892bbf989148a7a5854f960302400f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:30.387702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5892bbf989148a7a5854f960302400f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:30.413936 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2804/5602] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:30 2022] DELETE /identity/v3/users/e5892bbf989148a7a5854f960302400f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:30.484033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032933b8-8852-4acb-b4d2-f89c9f49bc3c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:30.623891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a45414-4a08-4799-8878-0bcb0442d522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:30.625417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:30.625598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a45414-4a08-4799-8878-0bcb0442d522 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:30.627168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:30.627699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a45414-4a08-4799-8878-0bcb0442d522 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:30.628779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a45414-4a08-4799-8878-0bcb0442d522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:30.635318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b6a45414-4a08-4799-8878-0bcb0442d522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:30.693701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:30.792143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a45414-4a08-4799-8878-0bcb0442d522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:30.794207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a45414-4a08-4799-8878-0bcb0442d522 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:30.822666 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2799/5603] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:30.837435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763dc09-4e54-44ed-b539-a86c4a2e5fe4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:30.855827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:30.856491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:30.856775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:30.857049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] PATH_INFO: `/v3/projects/c8495fcddf8d46e5835414b072f1f3b8` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:30.861446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a45414-4a08-4799-8878-0bcb0442d522 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:30.862776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8495fcddf8d46e5835414b072f1f3b8)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:30.862977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b6a45414-4a08-4799-8878-0bcb0442d522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:30.867457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:30.890538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a45414-4a08-4799-8878-0bcb0442d522 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:30.905368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82278aa8-f298-4d96-b022-2cf87331e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:30.906031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82278aa8-f298-4d96-b022-2cf87331e9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:30.906310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82278aa8-f298-4d96-b022-2cf87331e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:30.906581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82278aa8-f298-4d96-b022-2cf87331e9f5 admin admin] PATH_INFO: `/v3/users/e59eb282162c4bf9ac18297f64c39396` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:30.910489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82278aa8-f298-4d96-b022-2cf87331e9f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59eb282162c4bf9ac18297f64c39396)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:30.912427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82278aa8-f298-4d96-b022-2cf87331e9f5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:31.032786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82278aa8-f298-4d96-b022-2cf87331e9f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59eb282162c4bf9ac18297f64c39396'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:31.034172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82278aa8-f298-4d96-b022-2cf87331e9f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59eb282162c4bf9ac18297f64c39396'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:31.047921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8495fcddf8d46e5835414b072f1f3b8', 'request_id': 'req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:31.061015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8495fcddf8d46e5835414b072f1f3b8', 'request_id': 'req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:31.065152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82278aa8-f298-4d96-b022-2cf87331e9f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59eb282162c4bf9ac18297f64c39396'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:31.082155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8495fcddf8d46e5835414b072f1f3b8', 'request_id': 'req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:31.095533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82278aa8-f298-4d96-b022-2cf87331e9f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59eb282162c4bf9ac18297f64c39396'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:31.108070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82278aa8-f298-4d96-b022-2cf87331e9f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59eb282162c4bf9ac18297f64c39396'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:31.117797 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2800/5604] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:30 2022] DELETE /identity/v3/users/e59eb282162c4bf9ac18297f64c39396 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:31.124555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68b83-1323-4c40-96c4-92658670d53a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:31.124951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68b83-1323-4c40-96c4-92658670d53a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:31.125566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68b83-1323-4c40-96c4-92658670d53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:31.157490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1cb68b83-1323-4c40-96c4-92658670d53a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:31.157490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1cb68b83-1323-4c40-96c4-92658670d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:31.160590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] The token cache is being invalidate because project c8495fcddf8d46e5835414b072f1f3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:31.160909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:31.172807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-192a8eb9-2945-4e04-bbb2-afd1d5b5b977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:31.181087 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2805/5605] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:30 2022] DELETE /identity/v3/projects/c8495fcddf8d46e5835414b072f1f3b8 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:31.187227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33bf3-f37d-49a0-9fea-cd302fac4cd8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:31.189168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33bf3-f37d-49a0-9fea-cd302fac4cd8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:31.190054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33bf3-f37d-49a0-9fea-cd302fac4cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:31.221906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:31.249142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-edb33bf3-f37d-49a0-9fea-cd302fac4cd8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:31.254602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-edb33bf3-f37d-49a0-9fea-cd302fac4cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:31.311904 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2801/5606] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:31.333203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb68b83-1323-4c40-96c4-92658670d53a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:31.334803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1cb68b83-1323-4c40-96c4-92658670d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:31.524703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:31.578354 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2806/5607] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:31.580104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb413b81-4cf6-4d9f-8537-69b558fc4da2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:31.580599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb413b81-4cf6-4d9f-8537-69b558fc4da2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:31.580913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb413b81-4cf6-4d9f-8537-69b558fc4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:31.603755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb68b83-1323-4c40-96c4-92658670d53a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:31.608023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661d42c-315e-4b5c-8212-21e0cc5ed75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:31.608656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d42c-315e-4b5c-8212-21e0cc5ed75a service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:31.608987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d42c-315e-4b5c-8212-21e0cc5ed75a service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:31.609272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d42c-315e-4b5c-8212-21e0cc5ed75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:31.624039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661d42c-315e-4b5c-8212-21e0cc5ed75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:31.626242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661d42c-315e-4b5c-8212-21e0cc5ed75a service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:31.644250 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2802/5608] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:31.666652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bb413b81-4cf6-4d9f-8537-69b558fc4da2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:31.671057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bb413b81-4cf6-4d9f-8537-69b558fc4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:31.694921 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2807/5609] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:31.696674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661d42c-315e-4b5c-8212-21e0cc5ed75a service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:31.710306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661d42c-315e-4b5c-8212-21e0cc5ed75a service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:31.723232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3451a3a-0c1b-4e33-8f74-5392a392958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:31.724145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451a3a-0c1b-4e33-8f74-5392a392958b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:31.724580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451a3a-0c1b-4e33-8f74-5392a392958b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:31.724957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451a3a-0c1b-4e33-8f74-5392a392958b admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:31.725916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451a3a-0c1b-4e33-8f74-5392a392958b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:31.726331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451a3a-0c1b-4e33-8f74-5392a392958b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:31.728488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451a3a-0c1b-4e33-8f74-5392a392958b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:31.745510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2803/5610] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:49:31.749222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb413b81-4cf6-4d9f-8537-69b558fc4da2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:31.750130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3451a3a-0c1b-4e33-8f74-5392a392958b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:31.750763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bb413b81-4cf6-4d9f-8537-69b558fc4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:31.777720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb413b81-4cf6-4d9f-8537-69b558fc4da2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:31.796917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3451a3a-0c1b-4e33-8f74-5392a392958b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:31.803625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:31.804278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:31.804550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:31.805057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] PATH_INFO: `/v3/projects/e5ea451211924195b28e6c1edcc4a9a6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:31.807776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ea451211924195b28e6c1edcc4a9a6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:31.809863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf901c-d889-4666-90e4-c647d1941881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:31.810863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:31.812508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf901c-d889-4666-90e4-c647d1941881 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:31.812816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf901c-d889-4666-90e4-c647d1941881 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:31.813158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf901c-d889-4666-90e4-c647d1941881 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:31.815567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf901c-d889-4666-90e4-c647d1941881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:31.823410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf901c-d889-4666-90e4-c647d1941881 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:31.949578 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2804/5611] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:31 2022] POST /identity/v3/projects => generated 389 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:31.965141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf901c-d889-4666-90e4-c647d1941881 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:32.006796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ea451211924195b28e6c1edcc4a9a6', 'request_id': 'req-4b5c5b27-6005-474b-8f04-0b9f026c497c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:32.018111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ea451211924195b28e6c1edcc4a9a6', 'request_id': 'req-4b5c5b27-6005-474b-8f04-0b9f026c497c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:32.033047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ea451211924195b28e6c1edcc4a9a6', 'request_id': 'req-4b5c5b27-6005-474b-8f04-0b9f026c497c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:32.058367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] The token cache is being invalidate because project e5ea451211924195b28e6c1edcc4a9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:32.058663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:32.061443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b5c5b27-6005-474b-8f04-0b9f026c497c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:32.078379 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2808/5612] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:31 2022] DELETE /identity/v3/projects/e5ea451211924195b28e6c1edcc4a9a6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:32.080074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed41ce-dc89-4a70-a800-29b417173243 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.080366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed41ce-dc89-4a70-a800-29b417173243 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.080649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed41ce-dc89-4a70-a800-29b417173243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.127784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-89ed41ce-dc89-4a70-a800-29b417173243 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:32.129918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-89ed41ce-dc89-4a70-a800-29b417173243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:32.177323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf901c-d889-4666-90e4-c647d1941881 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:32.217929 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2809/5613] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:32.220221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca9ca8-3c70-4f70-aeeb-8608d1c946e7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.221197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca9ca8-3c70-4f70-aeeb-8608d1c946e7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.222308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca9ca8-3c70-4f70-aeeb-8608d1c946e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.251016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0bca9ca8-3c70-4f70-aeeb-8608d1c946e7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:32.251802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0bca9ca8-3c70-4f70-aeeb-8608d1c946e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:32.279421 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2810/5614] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:32.280313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca9ca8-3c70-4f70-aeeb-8608d1c946e7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:32.295316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12d7e1-e550-48f8-878b-1bf8bc8a55a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:32.295952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12d7e1-e550-48f8-878b-1bf8bc8a55a6 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.296301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12d7e1-e550-48f8-878b-1bf8bc8a55a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.296580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12d7e1-e550-48f8-878b-1bf8bc8a55a6 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.297230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12d7e1-e550-48f8-878b-1bf8bc8a55a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:32.299313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12d7e1-e550-48f8-878b-1bf8bc8a55a6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:32.301736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca9ca8-3c70-4f70-aeeb-8608d1c946e7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:32.333439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e227a-996d-425e-b917-afd4e8a3a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:32.335507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e227a-996d-425e-b917-afd4e8a3a0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.336042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e227a-996d-425e-b917-afd4e8a3a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.337805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e227a-996d-425e-b917-afd4e8a3a0d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.339665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e227a-996d-425e-b917-afd4e8a3a0d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:32.341641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e227a-996d-425e-b917-afd4e8a3a0d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:32.347885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e227a-996d-425e-b917-afd4e8a3a0d5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:32.349695 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2805/5615] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:31 2022] POST /identity/v3/users => generated 295 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:32.352759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12d7e1-e550-48f8-878b-1bf8bc8a55a6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:32.363279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ec12d7e1-e550-48f8-878b-1bf8bc8a55a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:32.388572 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2811/5616] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:32.389606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e227a-996d-425e-b917-afd4e8a3a0d5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:32.402139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:32.408030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12d7e1-e550-48f8-878b-1bf8bc8a55a6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:32.412413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e227a-996d-425e-b917-afd4e8a3a0d5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:32.421376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7489387-9841-414d-90c3-c33dd1c51017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:32.422028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7489387-9841-414d-90c3-c33dd1c51017 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.422312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7489387-9841-414d-90c3-c33dd1c51017 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.422592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7489387-9841-414d-90c3-c33dd1c51017 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.423253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7489387-9841-414d-90c3-c33dd1c51017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:32.425491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7489387-9841-414d-90c3-c33dd1c51017 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:32.427677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c6b62-1e24-4618-87e4-0a92841bc8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:32.428902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c6b62-1e24-4618-87e4-0a92841bc8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.430414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c6b62-1e24-4618-87e4-0a92841bc8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.431232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c6b62-1e24-4618-87e4-0a92841bc8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.433223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c6b62-1e24-4618-87e4-0a92841bc8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:32.438567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c6b62-1e24-4618-87e4-0a92841bc8e6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:32.472554 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2806/5617] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:32.473595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7489387-9841-414d-90c3-c33dd1c51017 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:32.491715 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2812/5618] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:32 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:32.493089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c6b62-1e24-4618-87e4-0a92841bc8e6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:32.510342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7489387-9841-414d-90c3-c33dd1c51017 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:32.602661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:32.645902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c6b62-1e24-4618-87e4-0a92841bc8e6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:32.651649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd983f-882f-47e8-9623-830fe9b887d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:32.652444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd983f-882f-47e8-9623-830fe9b887d9 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.652869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd983f-882f-47e8-9623-830fe9b887d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.653511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd983f-882f-47e8-9623-830fe9b887d9 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.653732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd983f-882f-47e8-9623-830fe9b887d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:32.655832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd983f-882f-47e8-9623-830fe9b887d9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:32.687405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a32840-6e58-4ab2-94cf-addcdb66cba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:32.688481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a32840-6e58-4ab2-94cf-addcdb66cba0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.688987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a32840-6e58-4ab2-94cf-addcdb66cba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.689541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a32840-6e58-4ab2-94cf-addcdb66cba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.690496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a32840-6e58-4ab2-94cf-addcdb66cba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:32.692587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a32840-6e58-4ab2-94cf-addcdb66cba0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:32.714376 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2813/5619] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:32 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:32.718543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd983f-882f-47e8-9623-830fe9b887d9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:32.722247 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2807/5620] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:32.723315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a32840-6e58-4ab2-94cf-addcdb66cba0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:32.736407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd983f-882f-47e8-9623-830fe9b887d9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:32.742783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd7e20-8e6e-45dc-8d0b-dcdfbc9bbb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:32.743470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd7e20-8e6e-45dc-8d0b-dcdfbc9bbb85 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.743811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd7e20-8e6e-45dc-8d0b-dcdfbc9bbb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.744117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd7e20-8e6e-45dc-8d0b-dcdfbc9bbb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.744833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd7e20-8e6e-45dc-8d0b-dcdfbc9bbb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:32.747155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd7e20-8e6e-45dc-8d0b-dcdfbc9bbb85 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:32.756946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a32840-6e58-4ab2-94cf-addcdb66cba0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:32.764263 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2814/5621] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:32.765185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd7e20-8e6e-45dc-8d0b-dcdfbc9bbb85 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:32.765637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db08ca3-5163-49f4-8771-0b3229e18a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:32.766333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db08ca3-5163-49f4-8771-0b3229e18a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.766620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db08ca3-5163-49f4-8771-0b3229e18a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.766901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db08ca3-5163-49f4-8771-0b3229e18a19 admin admin] PATH_INFO: `/v3/projects/ced388e38aad40398d800688ff4b78b2/users/7e20871df7914357812ed8897fc2c548/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.779010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd7e20-8e6e-45dc-8d0b-dcdfbc9bbb85 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:32.786212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6264c8-e420-4dc2-8353-c4f983d9e6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:32.787095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6264c8-e420-4dc2-8353-c4f983d9e6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.787381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6264c8-e420-4dc2-8353-c4f983d9e6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.787656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6264c8-e420-4dc2-8353-c4f983d9e6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.788315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6264c8-e420-4dc2-8353-c4f983d9e6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:32.791220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6264c8-e420-4dc2-8353-c4f983d9e6f1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:32.805164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db08ca3-5163-49f4-8771-0b3229e18a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced388e38aad40398d800688ff4b78b2, user_id=7e20871df7914357812ed8897fc2c548, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:32.807941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db08ca3-5163-49f4-8771-0b3229e18a19 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:32.809568 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2815/5622] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:32.811033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6264c8-e420-4dc2-8353-c4f983d9e6f1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:32.828752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6264c8-e420-4dc2-8353-c4f983d9e6f1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:32.829793 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2808/5623] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:32 2022] PUT /identity/v3/projects/ced388e38aad40398d800688ff4b78b2/users/7e20871df7914357812ed8897fc2c548/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:32.847427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79ee36-d17c-4a32-a39c-1baaae975fff None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.848060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79ee36-d17c-4a32-a39c-1baaae975fff None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.848525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79ee36-d17c-4a32-a39c-1baaae975fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:32.928047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fe79ee36-d17c-4a32-a39c-1baaae975fff None None] MFA Rules not processed for user `7e20871df7914357812ed8897fc2c548`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:32.929624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6fc92-c16d-413c-84cf-c04e51c2b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:32.930971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fe79ee36-d17c-4a32-a39c-1baaae975fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:32.931937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6fc92-c16d-413c-84cf-c04e51c2b7ab admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:32.932332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6fc92-c16d-413c-84cf-c04e51c2b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:32.932681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6fc92-c16d-413c-84cf-c04e51c2b7ab admin admin] PATH_INFO: `/v3/projects/7b639626c02b450db99dbb3cf2fee94e/users/0816a1d06e4849658c38e397fc256df7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:33.012714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6fc92-c16d-413c-84cf-c04e51c2b7ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b639626c02b450db99dbb3cf2fee94e, user_id=0816a1d06e4849658c38e397fc256df7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:33.025286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6fc92-c16d-413c-84cf-c04e51c2b7ab admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:33.065450 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2816/5624] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:32 2022] PUT /identity/v3/projects/7b639626c02b450db99dbb3cf2fee94e/users/0816a1d06e4849658c38e397fc256df7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:33.081710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ceb64-8555-4266-bc0d-2dcf97348d5c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:33.082618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ceb64-8555-4266-bc0d-2dcf97348d5c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:33.082909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ceb64-8555-4266-bc0d-2dcf97348d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:33.130724 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2809/5625] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:33.136767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79ee36-d17c-4a32-a39c-1baaae975fff None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:33.169221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-860ceb64-8555-4266-bc0d-2dcf97348d5c None None] MFA Rules not processed for user `0816a1d06e4849658c38e397fc256df7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:33.170655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-860ceb64-8555-4266-bc0d-2dcf97348d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:33.191917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79ee36-d17c-4a32-a39c-1baaae975fff None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:33.209863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:33.351423 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2817/5626] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:33.357461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ceb64-8555-4266-bc0d-2dcf97348d5c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:33.366169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-860ceb64-8555-4266-bc0d-2dcf97348d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:33.401959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2af3cd-d405-43f5-b7ae-cab1fcd3bb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:33.402617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2af3cd-d405-43f5-b7ae-cab1fcd3bb50 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:33.402900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2af3cd-d405-43f5-b7ae-cab1fcd3bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:33.403170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2af3cd-d405-43f5-b7ae-cab1fcd3bb50 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:33.403816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2af3cd-d405-43f5-b7ae-cab1fcd3bb50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:33.415952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2af3cd-d405-43f5-b7ae-cab1fcd3bb50 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:33.471780 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2810/5627] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:33 2022] POST /identity/v3/projects => generated 391 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:33.474143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2af3cd-d405-43f5-b7ae-cab1fcd3bb50 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:33.495298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ceb64-8555-4266-bc0d-2dcf97348d5c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:33.525869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:33.620529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2af3cd-d405-43f5-b7ae-cab1fcd3bb50 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:33.631095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be9ef7-dfb4-49ef-abd1-2e98e146fecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:33.632072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be9ef7-dfb4-49ef-abd1-2e98e146fecf service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:33.632512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be9ef7-dfb4-49ef-abd1-2e98e146fecf service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:33.632947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be9ef7-dfb4-49ef-abd1-2e98e146fecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:33.638271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b2be9ef7-dfb4-49ef-abd1-2e98e146fecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:33.643423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893eb1f-7704-482a-b0bb-cef20f9a0557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:33.645199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893eb1f-7704-482a-b0bb-cef20f9a0557 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:33.645199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893eb1f-7704-482a-b0bb-cef20f9a0557 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:33.645199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893eb1f-7704-482a-b0bb-cef20f9a0557 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:33.646128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893eb1f-7704-482a-b0bb-cef20f9a0557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:33.648176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893eb1f-7704-482a-b0bb-cef20f9a0557 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:33.716377 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2811/5628] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:33 2022] POST /identity/v3/projects => generated 371 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:33.716377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893eb1f-7704-482a-b0bb-cef20f9a0557 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:33.794230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:33.799133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be9ef7-dfb4-49ef-abd1-2e98e146fecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:33.801800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be9ef7-dfb4-49ef-abd1-2e98e146fecf service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:33.820454 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2818/5629] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:33.821343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be9ef7-dfb4-49ef-abd1-2e98e146fecf service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:33.822908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b2be9ef7-dfb4-49ef-abd1-2e98e146fecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:33.842642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be9ef7-dfb4-49ef-abd1-2e98e146fecf service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:33.866535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893eb1f-7704-482a-b0bb-cef20f9a0557 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:33.873236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8826b3-03f2-4ec8-b724-615f57b76c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:33.886007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8826b3-03f2-4ec8-b724-615f57b76c7a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:33.886679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8826b3-03f2-4ec8-b724-615f57b76c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:33.887202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8826b3-03f2-4ec8-b724-615f57b76c7a admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:33.888100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8826b3-03f2-4ec8-b724-615f57b76c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:33.890404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8826b3-03f2-4ec8-b724-615f57b76c7a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:33.931900 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2812/5630] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:33 2022] POST /identity/v3/users => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:33.931900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8826b3-03f2-4ec8-b724-615f57b76c7a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:33.945100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:33.946101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:33.946545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:33.947903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] PATH_INFO: `/v3/projects/11f5cd95c4d445f0b2f49d62d4b75655` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:33.949695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f5cd95c4d445f0b2f49d62d4b75655)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:33.952041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:33.954549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8826b3-03f2-4ec8-b724-615f57b76c7a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:33.970864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b886-7a99-4948-80ff-00c672d06c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:33.972169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b886-7a99-4948-80ff-00c672d06c27 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:33.972614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b886-7a99-4948-80ff-00c672d06c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:33.973133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b886-7a99-4948-80ff-00c672d06c27 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:33.974002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944b886-7a99-4948-80ff-00c672d06c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:33.976751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944b886-7a99-4948-80ff-00c672d06c27 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:34.022468 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2813/5631] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:33 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:34.025991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b886-7a99-4948-80ff-00c672d06c27 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:34.028422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f5cd95c4d445f0b2f49d62d4b75655', 'request_id': 'req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:34.042189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f5cd95c4d445f0b2f49d62d4b75655', 'request_id': 'req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:34.046561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b886-7a99-4948-80ff-00c672d06c27 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:34.055818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f5cd95c4d445f0b2f49d62d4b75655', 'request_id': 'req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:34.069896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] The token cache is being invalidate because project 11f5cd95c4d445f0b2f49d62d4b75655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:34.070276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:34.071058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:34.073944 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2819/5632] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:33 2022] DELETE /identity/v3/projects/11f5cd95c4d445f0b2f49d62d4b75655 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:34.074929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:34.076789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:34.204554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec3a3b-02f1-488e-9dc7-05ad3b43b167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:34.204554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec3a3b-02f1-488e-9dc7-05ad3b43b167 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.204554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec3a3b-02f1-488e-9dc7-05ad3b43b167 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.204554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec3a3b-02f1-488e-9dc7-05ad3b43b167 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.211382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec3a3b-02f1-488e-9dc7-05ad3b43b167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:34.213319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec3a3b-02f1-488e-9dc7-05ad3b43b167 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:34.243354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6c5d0-c91b-4477-9c4e-82103aa26ca4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:34.258250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4248d-6118-4830-b209-5872f03886aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:34.258787 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2814/5633] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:34.258944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4248d-6118-4830-b209-5872f03886aa admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.259196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4248d-6118-4830-b209-5872f03886aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.259478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4248d-6118-4830-b209-5872f03886aa admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.262056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211d01-ace8-40a9-995a-7b7faad537a0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.262413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211d01-ace8-40a9-995a-7b7faad537a0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.262774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211d01-ace8-40a9-995a-7b7faad537a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.267770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4248d-6118-4830-b209-5872f03886aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:34.270721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4248d-6118-4830-b209-5872f03886aa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:34.286628 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2820/5634] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:34.287791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4248d-6118-4830-b209-5872f03886aa admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:34.291345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-40a4248d-6118-4830-b209-5872f03886aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:34.303706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f7211d01-ace8-40a9-995a-7b7faad537a0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:34.305270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f7211d01-ace8-40a9-995a-7b7faad537a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:34.322506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4248d-6118-4830-b209-5872f03886aa admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:34.331788 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2815/5635] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:34.331788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7211d01-ace8-40a9-995a-7b7faad537a0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:34.336437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:34.342777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2c83e-fa96-4fcb-bcb7-726e36224b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:34.343465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2c83e-fa96-4fcb-bcb7-726e36224b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.343858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2c83e-fa96-4fcb-bcb7-726e36224b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.344046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2c83e-fa96-4fcb-bcb7-726e36224b2e admin admin] PATH_INFO: `/v3/projects/fd23f6632d574f9a9ac440ba32432ea4/users/a81662a53090400b93f48c718d557fd9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.351480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7211d01-ace8-40a9-995a-7b7faad537a0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:34.358292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50c1c5-e665-4aa4-9eee-c3f349f761f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:34.359253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c1c5-e665-4aa4-9eee-c3f349f761f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.359753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c1c5-e665-4aa4-9eee-c3f349f761f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.360237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c1c5-e665-4aa4-9eee-c3f349f761f9 admin admin] PATH_INFO: `/v3/projects/3a2d12ff9bb44c3eade1853b707c7bbb/users/f6173e3b7178447f996a35873127fd2a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.385337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2c83e-fa96-4fcb-bcb7-726e36224b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd23f6632d574f9a9ac440ba32432ea4, user_id=a81662a53090400b93f48c718d557fd9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:34.387661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50c1c5-e665-4aa4-9eee-c3f349f761f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2d12ff9bb44c3eade1853b707c7bbb, user_id=f6173e3b7178447f996a35873127fd2a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:34.388125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2c83e-fa96-4fcb-bcb7-726e36224b2e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:34.397110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50c1c5-e665-4aa4-9eee-c3f349f761f9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:34.407738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:34.425477 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2821/5636] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:34 2022] PUT /identity/v3/projects/fd23f6632d574f9a9ac440ba32432ea4/users/a81662a53090400b93f48c718d557fd9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:34.427570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8490104-136b-45dd-9824-614f59787f91 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.428055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8490104-136b-45dd-9824-614f59787f91 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.428576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8490104-136b-45dd-9824-614f59787f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.429302 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2816/5637] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:34 2022] PUT /identity/v3/projects/3a2d12ff9bb44c3eade1853b707c7bbb/users/f6173e3b7178447f996a35873127fd2a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:34.430122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50c1c5-e665-4aa4-9eee-c3f349f761f9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:34.485589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a8490104-136b-45dd-9824-614f59787f91 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:34.487559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a8490104-136b-45dd-9824-614f59787f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:34.582955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50c1c5-e665-4aa4-9eee-c3f349f761f9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:34.589521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62fd91-9e52-4b03-9075-b8cb3ab9b3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:34.590298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62fd91-9e52-4b03-9075-b8cb3ab9b3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.590581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62fd91-9e52-4b03-9075-b8cb3ab9b3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.590949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62fd91-9e52-4b03-9075-b8cb3ab9b3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.591603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62fd91-9e52-4b03-9075-b8cb3ab9b3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:34.593474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62fd91-9e52-4b03-9075-b8cb3ab9b3a4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:34.605156 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2822/5638] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:34.609609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8490104-136b-45dd-9824-614f59787f91 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:34.609878 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2817/5639] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:34.611007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62fd91-9e52-4b03-9075-b8cb3ab9b3a4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:34.623148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62fd91-9e52-4b03-9075-b8cb3ab9b3a4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:34.630606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5480a-6eaf-479e-b6d4-3f4b88315254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:34.632067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5480a-6eaf-479e-b6d4-3f4b88315254 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.632571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5480a-6eaf-479e-b6d4-3f4b88315254 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.634392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5480a-6eaf-479e-b6d4-3f4b88315254 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.636009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5480a-6eaf-479e-b6d4-3f4b88315254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:34.636943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5480a-6eaf-479e-b6d4-3f4b88315254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:34.640194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5480a-6eaf-479e-b6d4-3f4b88315254 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:34.641209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8490104-136b-45dd-9824-614f59787f91 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:34.660888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b2504-acdc-48f0-ad45-b1e0e427e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:34.661580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2504-acdc-48f0-ad45-b1e0e427e486 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.662000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2504-acdc-48f0-ad45-b1e0e427e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.662286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2504-acdc-48f0-ad45-b1e0e427e486 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.662954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b2504-acdc-48f0-ad45-b1e0e427e486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:34.664586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b2504-acdc-48f0-ad45-b1e0e427e486 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:34.666300 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2818/5640] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:34.667771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5480a-6eaf-479e-b6d4-3f4b88315254 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:34.682391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5480a-6eaf-479e-b6d4-3f4b88315254 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:34.688958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760e690-5a20-4d58-8535-1661c23efb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:34.691222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760e690-5a20-4d58-8535-1661c23efb4b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.691584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760e690-5a20-4d58-8535-1661c23efb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.691878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760e690-5a20-4d58-8535-1661c23efb4b admin admin] PATH_INFO: `/v3/projects/fd23f6632d574f9a9ac440ba32432ea4/users/a81662a53090400b93f48c718d557fd9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.694646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760e690-5a20-4d58-8535-1661c23efb4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd23f6632d574f9a9ac440ba32432ea4, user_id=a81662a53090400b93f48c718d557fd9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:34.697724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760e690-5a20-4d58-8535-1661c23efb4b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:34.700466 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2823/5641] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:34.702932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b2504-acdc-48f0-ad45-b1e0e427e486 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:34.720206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b2504-acdc-48f0-ad45-b1e0e427e486 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:34.733422 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2819/5642] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:34 2022] PUT /identity/v3/projects/fd23f6632d574f9a9ac440ba32432ea4/users/a81662a53090400b93f48c718d557fd9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:34.733422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760e690-5a20-4d58-8535-1661c23efb4b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:34.863712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb1dd2-16bc-4edb-b3c3-94b1c6aa77aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:34.864407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb1dd2-16bc-4edb-b3c3-94b1c6aa77aa admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.864762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb1dd2-16bc-4edb-b3c3-94b1c6aa77aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.865112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb1dd2-16bc-4edb-b3c3-94b1c6aa77aa admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.865934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb1dd2-16bc-4edb-b3c3-94b1c6aa77aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:34.874166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb1dd2-16bc-4edb-b3c3-94b1c6aa77aa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:34.932361 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2824/5643] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:34 2022] POST /identity/v3/projects => generated 357 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:34.939456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5302-c7b0-45a1-a53e-c4aa08f426a8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:34.939706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5302-c7b0-45a1-a53e-c4aa08f426a8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:34.942029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5302-c7b0-45a1-a53e-c4aa08f426a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:34.949212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760e690-5a20-4d58-8535-1661c23efb4b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:35.023283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-32ba5302-c7b0-45a1-a53e-c4aa08f426a8 None None] MFA Rules not processed for user `a81662a53090400b93f48c718d557fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:35.027567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-32ba5302-c7b0-45a1-a53e-c4aa08f426a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:35.134815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:35.168146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39f992-6845-4799-9576-7e0ddc7b5494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:35.169315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39f992-6845-4799-9576-7e0ddc7b5494 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:35.186414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39f992-6845-4799-9576-7e0ddc7b5494 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:35.186414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39f992-6845-4799-9576-7e0ddc7b5494 admin admin] PATH_INFO: `/v3/projects/3a2d12ff9bb44c3eade1853b707c7bbb/users/f6173e3b7178447f996a35873127fd2a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:35.198231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39f992-6845-4799-9576-7e0ddc7b5494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2d12ff9bb44c3eade1853b707c7bbb, user_id=f6173e3b7178447f996a35873127fd2a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:35.207402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39f992-6845-4799-9576-7e0ddc7b5494 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:35.246852 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2820/5644] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:34 2022] PUT /identity/v3/projects/3a2d12ff9bb44c3eade1853b707c7bbb/users/f6173e3b7178447f996a35873127fd2a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:35.247474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39f992-6845-4799-9576-7e0ddc7b5494 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:35.277825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:35.303162 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2825/5645] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:35.304031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d4c7-18e5-45fd-91ba-db53136ccc8e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:35.304394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d4c7-18e5-45fd-91ba-db53136ccc8e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:35.304748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d4c7-18e5-45fd-91ba-db53136ccc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:35.376138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c607d4c7-18e5-45fd-91ba-db53136ccc8e None None] MFA Rules not processed for user `f6173e3b7178447f996a35873127fd2a`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:35.377412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c607d4c7-18e5-45fd-91ba-db53136ccc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:35.396423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39f992-6845-4799-9576-7e0ddc7b5494 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:35.410707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e1c6e-db73-422f-bba9-1eae42287a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:35.412241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e1c6e-db73-422f-bba9-1eae42287a8c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:35.412641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e1c6e-db73-422f-bba9-1eae42287a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:35.413049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e1c6e-db73-422f-bba9-1eae42287a8c admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:35.413862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e1c6e-db73-422f-bba9-1eae42287a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:35.416096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e1c6e-db73-422f-bba9-1eae42287a8c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:35.462173 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2821/5646] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:35 2022] POST /identity/v3/users => generated 279 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:35.462173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e1c6e-db73-422f-bba9-1eae42287a8c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:35.464609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-486e1c6e-db73-422f-bba9-1eae42287a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:35.543719 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2826/5647] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:35.544505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607d4c7-18e5-45fd-91ba-db53136ccc8e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:35.566589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607d4c7-18e5-45fd-91ba-db53136ccc8e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:35.576285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246118c-bc69-4806-8b06-914b5fae9f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:35.578368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246118c-bc69-4806-8b06-914b5fae9f88 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:35.578768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246118c-bc69-4806-8b06-914b5fae9f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:35.579252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246118c-bc69-4806-8b06-914b5fae9f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:35.581653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246118c-bc69-4806-8b06-914b5fae9f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:35.583491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246118c-bc69-4806-8b06-914b5fae9f88 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:35.611136 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2827/5648] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:35.611718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246118c-bc69-4806-8b06-914b5fae9f88 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:35.628264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e1c6e-db73-422f-bba9-1eae42287a8c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:35.638084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246118c-bc69-4806-8b06-914b5fae9f88 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:35.645424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352b5a8-fda7-46bf-baf2-fc5be843a573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:35.646491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352b5a8-fda7-46bf-baf2-fc5be843a573 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:35.646895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352b5a8-fda7-46bf-baf2-fc5be843a573 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:35.648078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352b5a8-fda7-46bf-baf2-fc5be843a573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:35.654046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94e7c4-6d50-43e8-a29d-17057322d8b4 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6173e3b7178447f996a35873127fd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2d12ff9bb44c3eade1853b707c7bbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:35.654666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94e7c4-6d50-43e8-a29d-17057322d8b4 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:35.655076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94e7c4-6d50-43e8-a29d-17057322d8b4 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:35.655361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94e7c4-6d50-43e8-a29d-17057322d8b4 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:35.656037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94e7c4-6d50-43e8-a29d-17057322d8b4 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:35.659560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94e7c4-6d50-43e8-a29d-17057322d8b4 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:35.661416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94e7c4-6d50-43e8-a29d-17057322d8b4 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:35.693245 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2828/5649] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:35.694258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94e7c4-6d50-43e8-a29d-17057322d8b4 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:35.718188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94e7c4-6d50-43e8-a29d-17057322d8b4 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:35.724314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d49e8-19e0-4417-a143-2aee8db77ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:35.725172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d49e8-19e0-4417-a143-2aee8db77ffc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:35.725495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d49e8-19e0-4417-a143-2aee8db77ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:35.725823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d49e8-19e0-4417-a143-2aee8db77ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:35.726577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d49e8-19e0-4417-a143-2aee8db77ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:35.731058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d49e8-19e0-4417-a143-2aee8db77ffc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:35.746677 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2829/5650] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:35.746677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d49e8-19e0-4417-a143-2aee8db77ffc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:35.762068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d49e8-19e0-4417-a143-2aee8db77ffc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:35.773076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5666c-09c9-4a23-ad8a-9617ec4c1dc0 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6173e3b7178447f996a35873127fd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2d12ff9bb44c3eade1853b707c7bbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:35.774199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5666c-09c9-4a23-ad8a-9617ec4c1dc0 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:35.774709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5666c-09c9-4a23-ad8a-9617ec4c1dc0 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:35.775200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5666c-09c9-4a23-ad8a-9617ec4c1dc0 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:35.776092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5666c-09c9-4a23-ad8a-9617ec4c1dc0 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:35.780255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5666c-09c9-4a23-ad8a-9617ec4c1dc0 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:35.780399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352b5a8-fda7-46bf-baf2-fc5be843a573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:35.781987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352b5a8-fda7-46bf-baf2-fc5be843a573 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:35.823456 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2822/5651] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:35.824348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352b5a8-fda7-46bf-baf2-fc5be843a573 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:35.839115 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2830/5652] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:35 2022] POST /identity/v3/projects => generated 348 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:35.841852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5666c-09c9-4a23-ad8a-9617ec4c1dc0 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:35.882382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352b5a8-fda7-46bf-baf2-fc5be843a573 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:35.949926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5666c-09c9-4a23-ad8a-9617ec4c1dc0 tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:35.955884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5f4d8-9b82-41ae-ac98-eb84a622548d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6173e3b7178447f996a35873127fd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2d12ff9bb44c3eade1853b707c7bbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:35.956592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5f4d8-9b82-41ae-ac98-eb84a622548d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:35.957202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5f4d8-9b82-41ae-ac98-eb84a622548d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:35.957587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5f4d8-9b82-41ae-ac98-eb84a622548d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:35.959577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5f4d8-9b82-41ae-ac98-eb84a622548d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:35.959972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5f4d8-9b82-41ae-ac98-eb84a622548d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:35.964663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5f4d8-9b82-41ae-ac98-eb84a622548d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:35.967953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:35.984485 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2831/5653] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:35.985788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5f4d8-9b82-41ae-ac98-eb84a622548d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:35.988345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-12c5f4d8-9b82-41ae-ac98-eb84a622548d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:36.016516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa0c56-615e-4866-8712-dd0549126d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:36.017204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0c56-615e-4866-8712-dd0549126d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:36.017516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0c56-615e-4866-8712-dd0549126d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:36.017792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0c56-615e-4866-8712-dd0549126d44 admin admin] PATH_INFO: `/v3/projects/3d1d0e7a1d5a479da5658abdf730658e/users/3924c8a60d89443b9375c643c270e81c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:36.042010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa0c56-615e-4866-8712-dd0549126d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1d0e7a1d5a479da5658abdf730658e, user_id=3924c8a60d89443b9375c643c270e81c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:36.045111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:36.045842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa0c56-615e-4866-8712-dd0549126d44 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:36.108020 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2823/5654] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:35 2022] PUT /identity/v3/projects/3d1d0e7a1d5a479da5658abdf730658e/users/3924c8a60d89443b9375c643c270e81c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:36.108989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa0c56-615e-4866-8712-dd0549126d44 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:36.114201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a1fa0c56-615e-4866-8712-dd0549126d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:36.159877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5f4d8-9b82-41ae-ac98-eb84a622548d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:36.263407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa0c56-615e-4866-8712-dd0549126d44 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:36.279931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fc936-878b-415b-a36e-471f3d4a0c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:36.281310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fc936-878b-415b-a36e-471f3d4a0c4f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:36.281647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fc936-878b-415b-a36e-471f3d4a0c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:36.281897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fc936-878b-415b-a36e-471f3d4a0c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:36.316279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2b3be-7625-4500-a162-022a8c867a38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:36.317177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2b3be-7625-4500-a162-022a8c867a38 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:36.317715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2b3be-7625-4500-a162-022a8c867a38 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:36.318076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2b3be-7625-4500-a162-022a8c867a38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:36.321579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-28e2b3be-7625-4500-a162-022a8c867a38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:36.403344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fc936-878b-415b-a36e-471f3d4a0c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:36.405486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fc936-878b-415b-a36e-471f3d4a0c4f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:36.423048 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2824/5655] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:36.425299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e98a1-43f4-42da-bbd4-e0e6aff4e6c8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:36.425932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e98a1-43f4-42da-bbd4-e0e6aff4e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:36.426537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e98a1-43f4-42da-bbd4-e0e6aff4e6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:36.435985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2b3be-7625-4500-a162-022a8c867a38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:36.438187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2b3be-7625-4500-a162-022a8c867a38 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:36.453792 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2832/5656] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:36.469995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-286e98a1-43f4-42da-bbd4-e0e6aff4e6c8 None None] MFA Rules not processed for user `3924c8a60d89443b9375c643c270e81c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:36.472305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-286e98a1-43f4-42da-bbd4-e0e6aff4e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:36.638664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:36.680501 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2825/5657] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:36.725702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2b3be-7625-4500-a162-022a8c867a38 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:36.727659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-28e2b3be-7625-4500-a162-022a8c867a38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:36.748170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2b3be-7625-4500-a162-022a8c867a38 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:36.759329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28511e-6806-4a08-b4e8-adabc2b7331e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:36.759963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28511e-6806-4a08-b4e8-adabc2b7331e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:36.760246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28511e-6806-4a08-b4e8-adabc2b7331e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:36.760522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28511e-6806-4a08-b4e8-adabc2b7331e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:36.779417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28511e-6806-4a08-b4e8-adabc2b7331e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:36.780883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28511e-6806-4a08-b4e8-adabc2b7331e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:36.804523 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2833/5658] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:38.409664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85bb73-cd6f-4eb8-84c8-20c6425e7eca None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:38.409664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85bb73-cd6f-4eb8-84c8-20c6425e7eca None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:38.409664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85bb73-cd6f-4eb8-84c8-20c6425e7eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:38.438789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-be85bb73-cd6f-4eb8-84c8-20c6425e7eca None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:38.440030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-be85bb73-cd6f-4eb8-84c8-20c6425e7eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:38.567412 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2826/5659] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:49:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:38.645735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28511e-6806-4a08-b4e8-adabc2b7331e service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:38.647674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3e28511e-6806-4a08-b4e8-adabc2b7331e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:38.726824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28511e-6806-4a08-b4e8-adabc2b7331e service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:38.743442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ae787-7615-4f21-908b-840c0cf0dcad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:38.744161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ae787-7615-4f21-908b-840c0cf0dcad service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:38.744511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ae787-7615-4f21-908b-840c0cf0dcad service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:38.744859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ae787-7615-4f21-908b-840c0cf0dcad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:38.754828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ae787-7615-4f21-908b-840c0cf0dcad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:38.756687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ae787-7615-4f21-908b-840c0cf0dcad service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:38.766763 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2834/5660] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:49:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:45.675198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85bb73-cd6f-4eb8-84c8-20c6425e7eca None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:45.818092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85bb73-cd6f-4eb8-84c8-20c6425e7eca None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:45.823537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:45.824568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:45.825079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:45.825609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] PATH_INFO: `/v3/users/7e20871df7914357812ed8897fc2c548` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:45.827082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e20871df7914357812ed8897fc2c548)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:45.829278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:45.918775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e20871df7914357812ed8897fc2c548'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:45.920347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e20871df7914357812ed8897fc2c548'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:45.952677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e20871df7914357812ed8897fc2c548'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:45.968773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e20871df7914357812ed8897fc2c548'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:45.989010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e20871df7914357812ed8897fc2c548'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:46.006346 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2827/5661] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:45 2022] DELETE /identity/v3/users/7e20871df7914357812ed8897fc2c548 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:46.010355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17daac-1ce2-4a97-b498-97bc1efe2af9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:46.011200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17daac-1ce2-4a97-b498-97bc1efe2af9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:46.011630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17daac-1ce2-4a97-b498-97bc1efe2af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:46.038053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:46.057520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2a17daac-1ce2-4a97-b498-97bc1efe2af9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:46.059847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2a17daac-1ce2-4a97-b498-97bc1efe2af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:46.274252 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2835/5662] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:46.344784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:46.346694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:46.391832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:46.523169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf578d-c10c-4d0c-bd0b-4ae76c785b74 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:46.550747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea95ec-27f8-4a41-a713-82b51c783ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:46.551382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea95ec-27f8-4a41-a713-82b51c783ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:46.551663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea95ec-27f8-4a41-a713-82b51c783ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:46.551941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea95ec-27f8-4a41-a713-82b51c783ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:46.570909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea95ec-27f8-4a41-a713-82b51c783ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:46.572381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea95ec-27f8-4a41-a713-82b51c783ca5 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:46.596181 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2828/5663] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:47.649656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17daac-1ce2-4a97-b498-97bc1efe2af9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:47.652172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2a17daac-1ce2-4a97-b498-97bc1efe2af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:47.906234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17daac-1ce2-4a97-b498-97bc1efe2af9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:47.922134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6173e3b7178447f996a35873127fd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2d12ff9bb44c3eade1853b707c7bbb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:47.923240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:47.923787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:47.924298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] PATH_INFO: `/v3/projects/8825de873ecf4453af7c9805e313aeef` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:47.926286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8825de873ecf4453af7c9805e313aeef)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:47.939659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.042531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8825de873ecf4453af7c9805e313aeef', 'request_id': 'req-70678d9c-9e1f-424e-8707-35ca9548dc3d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.109761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8825de873ecf4453af7c9805e313aeef', 'request_id': 'req-70678d9c-9e1f-424e-8707-35ca9548dc3d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.147740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8825de873ecf4453af7c9805e313aeef', 'request_id': 'req-70678d9c-9e1f-424e-8707-35ca9548dc3d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.191388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] The token cache is being invalidate because project 8825de873ecf4453af7c9805e313aeef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:48.191388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.193660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.198477 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2836/5664] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:47 2022] DELETE /identity/v3/projects/8825de873ecf4453af7c9805e313aeef => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:48.199844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bec96-df47-45b3-a804-58c1089bf1be None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.204111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bec96-df47-45b3-a804-58c1089bf1be None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.204437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.205048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bec96-df47-45b3-a804-58c1089bf1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.209025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.248011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-468bec96-df47-45b3-a804-58c1089bf1be None None] MFA Rules not processed for user `f70ee130e8e74db88b9b7ffd16ed1bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:48.251506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-468bec96-df47-45b3-a804-58c1089bf1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.351088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:48.404502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70678d9c-9e1f-424e-8707-35ca9548dc3d tempest-QuotasNegativeTest-334002008 tempest-QuotasNegativeTest-334002008-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.412419 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2829/5665] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:48.413639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bec96-df47-45b3-a804-58c1089bf1be None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.418347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.419183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-468bec96-df47-45b3-a804-58c1089bf1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.419315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.419518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.419792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] PATH_INFO: `/v3/users/0816a1d06e4849658c38e397fc256df7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.420982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0816a1d06e4849658c38e397fc256df7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:48.422949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.450010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bec96-df47-45b3-a804-58c1089bf1be None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.464165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.466527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.466818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.467099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] PATH_INFO: `/v3/projects/ced388e38aad40398d800688ff4b78b2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.470831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced388e38aad40398d800688ff4b78b2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:48.478482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:48.572809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0816a1d06e4849658c38e397fc256df7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.577451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0816a1d06e4849658c38e397fc256df7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.615875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0816a1d06e4849658c38e397fc256df7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.622492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0816a1d06e4849658c38e397fc256df7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.655775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0816a1d06e4849658c38e397fc256df7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.676838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced388e38aad40398d800688ff4b78b2', 'request_id': 'req-3160d76f-f7f7-4316-8363-9b60286d3dba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.689521 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2837/5666] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:48 2022] DELETE /identity/v3/users/0816a1d06e4849658c38e397fc256df7 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:48.691681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced388e38aad40398d800688ff4b78b2', 'request_id': 'req-3160d76f-f7f7-4316-8363-9b60286d3dba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.693214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.695210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.705588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced388e38aad40398d800688ff4b78b2', 'request_id': 'req-3160d76f-f7f7-4316-8363-9b60286d3dba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.736486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] The token cache is being invalidate because project ced388e38aad40398d800688ff4b78b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:48.737618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.738494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3160d76f-f7f7-4316-8363-9b60286d3dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:48.744536 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2830/5667] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:48 2022] DELETE /identity/v3/projects/ced388e38aad40398d800688ff4b78b2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:48.748191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad56cb-a1e7-472a-bb32-c7ae8bbc2d43 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.749278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad56cb-a1e7-472a-bb32-c7ae8bbc2d43 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.750032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad56cb-a1e7-472a-bb32-c7ae8bbc2d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.799750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-53ad56cb-a1e7-472a-bb32-c7ae8bbc2d43 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:48.805691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-53ad56cb-a1e7-472a-bb32-c7ae8bbc2d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.879846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb7728-b1ca-42b0-b83c-1bf1afb13dc8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:48.889867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4ea63-4066-4410-828f-892060b2f064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:48.891322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4ea63-4066-4410-828f-892060b2f064 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:48.891615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4ea63-4066-4410-828f-892060b2f064 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:48.891971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4ea63-4066-4410-828f-892060b2f064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:48.894392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-63a4ea63-4066-4410-828f-892060b2f064 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:48.931716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:48.995069 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2831/5668] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:48.995069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad56cb-a1e7-472a-bb32-c7ae8bbc2d43 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:48.997283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-53ad56cb-a1e7-472a-bb32-c7ae8bbc2d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:49.007660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:49.012582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4ea63-4066-4410-828f-892060b2f064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:49.023490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad56cb-a1e7-472a-bb32-c7ae8bbc2d43 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:49.043868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4ea63-4066-4410-828f-892060b2f064 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:49.060803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:49.060803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:49.060803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:49.060803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] PATH_INFO: `/v3/users/a81662a53090400b93f48c718d557fd9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:49.061974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81662a53090400b93f48c718d557fd9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:49.061974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:49.062179 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2838/5669] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:49.062179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4ea63-4066-4410-828f-892060b2f064 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:49.064557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-63a4ea63-4066-4410-828f-892060b2f064 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:49.210970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81662a53090400b93f48c718d557fd9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:49.213747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81662a53090400b93f48c718d557fd9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:49.221599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4ea63-4066-4410-828f-892060b2f064 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:49.228936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7e5cc-a952-481f-becc-941c1168bd95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:49.229804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e5cc-a952-481f-becc-941c1168bd95 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:49.230376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e5cc-a952-481f-becc-941c1168bd95 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:49.230719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e5cc-a952-481f-becc-941c1168bd95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:49.245412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7e5cc-a952-481f-becc-941c1168bd95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:49.247671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7e5cc-a952-481f-becc-941c1168bd95 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:49.275259 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2839/5670] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:49.297140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81662a53090400b93f48c718d557fd9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:49.316511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81662a53090400b93f48c718d557fd9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:49.336948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81662a53090400b93f48c718d557fd9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:49.361893 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2832/5671] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:48 2022] DELETE /identity/v3/users/a81662a53090400b93f48c718d557fd9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:51.505031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7e5cc-a952-481f-becc-941c1168bd95 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:51.508232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7ab7e5cc-a952-481f-becc-941c1168bd95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:51.534055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7e5cc-a952-481f-becc-941c1168bd95 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:51.690759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:51.694467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:51.694883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:51.695240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] PATH_INFO: `/v3/projects/7b639626c02b450db99dbb3cf2fee94e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:51.698460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b639626c02b450db99dbb3cf2fee94e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:51.717995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:51.837987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b639626c02b450db99dbb3cf2fee94e', 'request_id': 'req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:51.848956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b639626c02b450db99dbb3cf2fee94e', 'request_id': 'req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:51.866625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:51.875070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:51.883438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b639626c02b450db99dbb3cf2fee94e', 'request_id': 'req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:51.913891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] The token cache is being invalidate because project 7b639626c02b450db99dbb3cf2fee94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:51.915167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:51.917790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:51.927703 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2840/5672] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:51 2022] DELETE /identity/v3/projects/7b639626c02b450db99dbb3cf2fee94e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:51.928768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:51.932180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:51.939049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce6900-7f19-4055-823b-0ed54feb9abb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:52.003951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:52.071744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:52.072022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80b0ce-08a4-4ebb-8195-e52587ff8ea5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:52.072868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:52.073316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:52.074786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] PATH_INFO: `/v3/projects/fd23f6632d574f9a9ac440ba32432ea4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:52.077148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd23f6632d574f9a9ac440ba32432ea4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:52.081153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:52.081997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf44af-6d31-4259-bb95-436061faf06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:52.082738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf44af-6d31-4259-bb95-436061faf06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:52.083977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf44af-6d31-4259-bb95-436061faf06f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:52.084341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf44af-6d31-4259-bb95-436061faf06f admin admin] PATH_INFO: `/v3/users/f6173e3b7178447f996a35873127fd2a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:52.087674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf44af-6d31-4259-bb95-436061faf06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6173e3b7178447f996a35873127fd2a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:52.092168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf44af-6d31-4259-bb95-436061faf06f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:52.185581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd23f6632d574f9a9ac440ba32432ea4', 'request_id': 'req-29e5b525-2bfd-4ef8-bf3b-7d4304438608'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:52.192961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd23f6632d574f9a9ac440ba32432ea4', 'request_id': 'req-29e5b525-2bfd-4ef8-bf3b-7d4304438608'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:52.196245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:52.207931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6bf44af-6d31-4259-bb95-436061faf06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6173e3b7178447f996a35873127fd2a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:52.209027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd23f6632d574f9a9ac440ba32432ea4', 'request_id': 'req-29e5b525-2bfd-4ef8-bf3b-7d4304438608'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:52.209522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6bf44af-6d31-4259-bb95-436061faf06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6173e3b7178447f996a35873127fd2a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:52.246855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] The token cache is being invalidate because project fd23f6632d574f9a9ac440ba32432ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:52.254946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:52.257729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29e5b525-2bfd-4ef8-bf3b-7d4304438608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:52.259688 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2833/5673] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:51 2022] DELETE /identity/v3/projects/fd23f6632d574f9a9ac440ba32432ea4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:52.265847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb815bc-27a4-4e87-8000-7ccdbce9363e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:52.266322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb815bc-27a4-4e87-8000-7ccdbce9363e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:52.266747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb815bc-27a4-4e87-8000-7ccdbce9363e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:52.267257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6bf44af-6d31-4259-bb95-436061faf06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6173e3b7178447f996a35873127fd2a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:52.268324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6bf44af-6d31-4259-bb95-436061faf06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6173e3b7178447f996a35873127fd2a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:52.277771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6bf44af-6d31-4259-bb95-436061faf06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6173e3b7178447f996a35873127fd2a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:52.304277 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2841/5674] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:51 2022] DELETE /identity/v3/users/f6173e3b7178447f996a35873127fd2a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:52.318338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-eeb815bc-27a4-4e87-8000-7ccdbce9363e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:52.319998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-eeb815bc-27a4-4e87-8000-7ccdbce9363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:52.424266 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2834/5675] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:52.425864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18edb2-8867-4acd-b802-46c8b7182328 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:52.426307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18edb2-8867-4acd-b802-46c8b7182328 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:52.426800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18edb2-8867-4acd-b802-46c8b7182328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:52.475320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ef18edb2-8867-4acd-b802-46c8b7182328 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:52.477938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ef18edb2-8867-4acd-b802-46c8b7182328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:52.513442 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2842/5676] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:52.516020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb815bc-27a4-4e87-8000-7ccdbce9363e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:52.530931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb815bc-27a4-4e87-8000-7ccdbce9363e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:52.541454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4587600-ef9e-4d74-af15-8e6a2f43a3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:52.542317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587600-ef9e-4d74-af15-8e6a2f43a3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:52.544346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587600-ef9e-4d74-af15-8e6a2f43a3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:52.544670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587600-ef9e-4d74-af15-8e6a2f43a3e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:52.546140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4587600-ef9e-4d74-af15-8e6a2f43a3e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:52.546560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4587600-ef9e-4d74-af15-8e6a2f43a3e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:52.549014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4587600-ef9e-4d74-af15-8e6a2f43a3e3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:52.572654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18edb2-8867-4acd-b802-46c8b7182328 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:52.581848 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2835/5677] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:52.586531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18edb2-8867-4acd-b802-46c8b7182328 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:52.595776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16684aae-d771-4bd6-be6a-8f2622e8a498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:52.597252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16684aae-d771-4bd6-be6a-8f2622e8a498 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:52.597572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16684aae-d771-4bd6-be6a-8f2622e8a498 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:52.598738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16684aae-d771-4bd6-be6a-8f2622e8a498 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:52.598738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16684aae-d771-4bd6-be6a-8f2622e8a498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:52.602767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16684aae-d771-4bd6-be6a-8f2622e8a498 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:52.662985 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2843/5678] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:52 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:52.667748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4587600-ef9e-4d74-af15-8e6a2f43a3e3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:52.682588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4587600-ef9e-4d74-af15-8e6a2f43a3e3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:52.797114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9ff80-37fb-4977-86cc-a20b08d4d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:52.798001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9ff80-37fb-4977-86cc-a20b08d4d66d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:52.798350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9ff80-37fb-4977-86cc-a20b08d4d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:52.798723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9ff80-37fb-4977-86cc-a20b08d4d66d admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:52.799517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9ff80-37fb-4977-86cc-a20b08d4d66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:52.802043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9ff80-37fb-4977-86cc-a20b08d4d66d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:52.841678 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2836/5679] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:52 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:52.842443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16684aae-d771-4bd6-be6a-8f2622e8a498 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:52.858581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16684aae-d771-4bd6-be6a-8f2622e8a498 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:52.867053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3332b6f-44d2-4c24-b00b-074655e3c442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:52.867892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3332b6f-44d2-4c24-b00b-074655e3c442 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:52.869095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3332b6f-44d2-4c24-b00b-074655e3c442 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:52.870594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3332b6f-44d2-4c24-b00b-074655e3c442 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:52.871457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3332b6f-44d2-4c24-b00b-074655e3c442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:52.873291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3332b6f-44d2-4c24-b00b-074655e3c442 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:52.893906 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2844/5680] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:52.899470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9ff80-37fb-4977-86cc-a20b08d4d66d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:52.920129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9ff80-37fb-4977-86cc-a20b08d4d66d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:52.927300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064aeb7-8f7d-4460-8aef-28ec711957ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:52.928253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064aeb7-8f7d-4460-8aef-28ec711957ea admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:52.929736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064aeb7-8f7d-4460-8aef-28ec711957ea admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:52.930280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064aeb7-8f7d-4460-8aef-28ec711957ea admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:52.931141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064aeb7-8f7d-4460-8aef-28ec711957ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:52.934020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064aeb7-8f7d-4460-8aef-28ec711957ea admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:52.957464 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2837/5681] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:49:52.961681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3332b6f-44d2-4c24-b00b-074655e3c442 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:52.975894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3332b6f-44d2-4c24-b00b-074655e3c442 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:52.982469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bcb51-d1c1-4ddc-8b0c-a1d4d38b74f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:52.983438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcb51-d1c1-4ddc-8b0c-a1d4d38b74f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:52.983913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcb51-d1c1-4ddc-8b0c-a1d4d38b74f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:52.984387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcb51-d1c1-4ddc-8b0c-a1d4d38b74f0 admin admin] PATH_INFO: `/v3/projects/347eae93590f4d2c9124b7dd28490f4d/users/69167c0e64a545489f7d950995d68824/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:53.006800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bcb51-d1c1-4ddc-8b0c-a1d4d38b74f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=347eae93590f4d2c9124b7dd28490f4d, user_id=69167c0e64a545489f7d950995d68824, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:53.011321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bcb51-d1c1-4ddc-8b0c-a1d4d38b74f0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:53.033582 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2845/5682] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:52 2022] PUT /identity/v3/projects/347eae93590f4d2c9124b7dd28490f4d/users/69167c0e64a545489f7d950995d68824/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:53.047710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d251052-c4f3-47dc-abc8-b39942e78eb0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:53.048894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d251052-c4f3-47dc-abc8-b39942e78eb0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:53.049213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d251052-c4f3-47dc-abc8-b39942e78eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:53.132413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7d251052-c4f3-47dc-abc8-b39942e78eb0 None None] MFA Rules not processed for user `69167c0e64a545489f7d950995d68824`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:53.137159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7d251052-c4f3-47dc-abc8-b39942e78eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:53.226980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bcb51-d1c1-4ddc-8b0c-a1d4d38b74f0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:53.228926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cb6bcb51-d1c1-4ddc-8b0c-a1d4d38b74f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:53.262218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:53.314121 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2838/5683] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:53.333655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d251052-c4f3-47dc-abc8-b39942e78eb0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:53.335662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7d251052-c4f3-47dc-abc8-b39942e78eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:53.356049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:53.407665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bcb51-d1c1-4ddc-8b0c-a1d4d38b74f0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:53.420021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:53.420881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:53.421124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:53.421547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] PATH_INFO: `/v3/projects/3a2d12ff9bb44c3eade1853b707c7bbb` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:53.426951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2d12ff9bb44c3eade1853b707c7bbb)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:53.430677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:53.469503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d251052-c4f3-47dc-abc8-b39942e78eb0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:53.479703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea0e3e-78ab-475c-adc2-04b06fbc2ec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:53.481297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea0e3e-78ab-475c-adc2-04b06fbc2ec8 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:53.481770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea0e3e-78ab-475c-adc2-04b06fbc2ec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:53.482284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea0e3e-78ab-475c-adc2-04b06fbc2ec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:53.508194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea0e3e-78ab-475c-adc2-04b06fbc2ec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:53.510123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea0e3e-78ab-475c-adc2-04b06fbc2ec8 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:53.511968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2d12ff9bb44c3eade1853b707c7bbb', 'request_id': 'req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.519941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2d12ff9bb44c3eade1853b707c7bbb', 'request_id': 'req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.524742 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2839/5684] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:53.539917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2d12ff9bb44c3eade1853b707c7bbb', 'request_id': 'req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.555433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea0e3e-78ab-475c-adc2-04b06fbc2ec8 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:53.559371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] The token cache is being invalidate because project 3a2d12ff9bb44c3eade1853b707c7bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:53.559738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.561262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-af22abe6-f551-4a6b-bd0b-1c5b5db7229d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.563565 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2846/5685] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:53 2022] DELETE /identity/v3/projects/3a2d12ff9bb44c3eade1853b707c7bbb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:49:53.568959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0a1db-f831-47b9-ae65-a2a64cd2949c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:53.568959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0a1db-f831-47b9-ae65-a2a64cd2949c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:53.569253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0a1db-f831-47b9-ae65-a2a64cd2949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:53.577281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea0e3e-78ab-475c-adc2-04b06fbc2ec8 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:53.597193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-16f0a1db-f831-47b9-ae65-a2a64cd2949c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:53.597824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-16f0a1db-f831-47b9-ae65-a2a64cd2949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:53.706502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:53.707568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:53.708034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:53.708414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] PATH_INFO: `/v3/users/69167c0e64a545489f7d950995d68824` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:53.709853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69167c0e64a545489f7d950995d68824)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:53.712078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:53.785026 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2847/5686] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:53.852476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69167c0e64a545489f7d950995d68824'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.853597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69167c0e64a545489f7d950995d68824'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.887333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69167c0e64a545489f7d950995d68824'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.904355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9adb-93a9-442d-b813-da04fbe6a9eb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:53.904589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9adb-93a9-442d-b813-da04fbe6a9eb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:53.906021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9adb-93a9-442d-b813-da04fbe6a9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:53.913632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69167c0e64a545489f7d950995d68824'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.945559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a64b9adb-93a9-442d-b813-da04fbe6a9eb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:53.946982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69167c0e64a545489f7d950995d68824'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:53.947844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a64b9adb-93a9-442d-b813-da04fbe6a9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:53.954195 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2840/5687] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:53 2022] DELETE /identity/v3/users/69167c0e64a545489f7d950995d68824 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:53.955768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:53.957634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:53.963452 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2848/5688] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:53.964761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb6941-4713-4806-ad11-ce76458b2294 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:53.965042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb6941-4713-4806-ad11-ce76458b2294 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:53.965314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb6941-4713-4806-ad11-ce76458b2294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:53.974339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:54.010217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-23bb6941-4713-4806-ad11-ce76458b2294 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:54.012538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-23bb6941-4713-4806-ad11-ce76458b2294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:54.068786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681909b-58e4-4a30-8018-9edba30f6200 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:54.074597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:54.075419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:54.075945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:54.076237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] PATH_INFO: `/v3/users/93f0fa8b8ee945ef858d4b855f5dec06` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:54.078220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f0fa8b8ee945ef858d4b855f5dec06)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:54.082821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:54.121305 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2849/5689] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:54.129282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb6941-4713-4806-ad11-ce76458b2294 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:54.168137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb6941-4713-4806-ad11-ce76458b2294 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:54.178449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef14bcf-32be-471a-baf8-7570e4619c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:54.179097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14bcf-32be-471a-baf8-7570e4619c4a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:54.179381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14bcf-32be-471a-baf8-7570e4619c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:54.179801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14bcf-32be-471a-baf8-7570e4619c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:54.181956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef14bcf-32be-471a-baf8-7570e4619c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:54.182323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef14bcf-32be-471a-baf8-7570e4619c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:54.185218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef14bcf-32be-471a-baf8-7570e4619c4a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:54.191932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:54.212237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f0fa8b8ee945ef858d4b855f5dec06'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:54.214055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f0fa8b8ee945ef858d4b855f5dec06'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:54.225542 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2850/5690] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:54.225823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef14bcf-32be-471a-baf8-7570e4619c4a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:54.243775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cef14bcf-32be-471a-baf8-7570e4619c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:54.254076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f0fa8b8ee945ef858d4b855f5dec06'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:54.273578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f0fa8b8ee945ef858d4b855f5dec06'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:54.295065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f0fa8b8ee945ef858d4b855f5dec06'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:54.317690 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2841/5691] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:53 2022] DELETE /identity/v3/users/93f0fa8b8ee945ef858d4b855f5dec06 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:54.317690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:54.318543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:54.437024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef14bcf-32be-471a-baf8-7570e4619c4a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:54.479110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef26d5-cf10-4139-9177-e59f4cafef61 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:54.485344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beb1ac-2040-47e8-ab69-44bfd3bb5c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:54.486139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb1ac-2040-47e8-ab69-44bfd3bb5c48 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:54.486641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb1ac-2040-47e8-ab69-44bfd3bb5c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:54.487865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb1ac-2040-47e8-ab69-44bfd3bb5c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:54.488259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88beb1ac-2040-47e8-ab69-44bfd3bb5c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:54.490450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88beb1ac-2040-47e8-ab69-44bfd3bb5c48 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:54.552238 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2842/5692] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:54 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:54.553977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682126b3-31b5-4057-ac70-01ef430780c3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:54.554279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682126b3-31b5-4057-ac70-01ef430780c3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:54.554559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682126b3-31b5-4057-ac70-01ef430780c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:54.558483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8965f-eca2-4563-ab2c-f75dc40cf4ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:54.559258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8965f-eca2-4563-ab2c-f75dc40cf4ec service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:54.559641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8965f-eca2-4563-ab2c-f75dc40cf4ec service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:54.560017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8965f-eca2-4563-ab2c-f75dc40cf4ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:54.562146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-45e8965f-eca2-4563-ab2c-f75dc40cf4ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:54.578989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8965f-eca2-4563-ab2c-f75dc40cf4ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:54.580515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8965f-eca2-4563-ab2c-f75dc40cf4ec service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:54.589437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-682126b3-31b5-4057-ac70-01ef430780c3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:54.590672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-682126b3-31b5-4057-ac70-01ef430780c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:54.603152 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2851/5693] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:54.605551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:54.605782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8965f-eca2-4563-ab2c-f75dc40cf4ec service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:54.624396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8965f-eca2-4563-ab2c-f75dc40cf4ec service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:54.747492 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2843/5694] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:54.763593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682126b3-31b5-4057-ac70-01ef430780c3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:54.765220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-682126b3-31b5-4057-ac70-01ef430780c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:54.891141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d2899-aec0-4edb-a844-50ada097eff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:54.892392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d2899-aec0-4edb-a844-50ada097eff1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:54.893605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d2899-aec0-4edb-a844-50ada097eff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:54.894061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d2899-aec0-4edb-a844-50ada097eff1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:54.896104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d2899-aec0-4edb-a844-50ada097eff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:54.900430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d2899-aec0-4edb-a844-50ada097eff1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:54.949723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682126b3-31b5-4057-ac70-01ef430780c3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:54.965018 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2852/5695] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:54 2022] POST /identity/v3/users => generated 283 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:54.968603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93be19-c1dd-41a1-98d3-6afdb2cc6a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:54.969529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93be19-c1dd-41a1-98d3-6afdb2cc6a94 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:54.969678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d2899-aec0-4edb-a844-50ada097eff1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:54.969872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93be19-c1dd-41a1-98d3-6afdb2cc6a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:54.970083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93be19-c1dd-41a1-98d3-6afdb2cc6a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:54.992292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93be19-c1dd-41a1-98d3-6afdb2cc6a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:54.993874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93be19-c1dd-41a1-98d3-6afdb2cc6a94 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.000341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d2899-aec0-4edb-a844-50ada097eff1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.006924 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2844/5696] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:55.010018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8fa6d-36e2-4160-8504-aa6c4b6a8162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.011829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8fa6d-36e2-4160-8504-aa6c4b6a8162 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.012295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8fa6d-36e2-4160-8504-aa6c4b6a8162 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.012745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8fa6d-36e2-4160-8504-aa6c4b6a8162 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.014531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8fa6d-36e2-4160-8504-aa6c4b6a8162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.017612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8fa6d-36e2-4160-8504-aa6c4b6a8162 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.049738 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2853/5697] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:55.051787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93be19-c1dd-41a1-98d3-6afdb2cc6a94 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.071178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93be19-c1dd-41a1-98d3-6afdb2cc6a94 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.077969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658c08c-c24a-49df-acf7-e2e6aab94bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.078896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658c08c-c24a-49df-acf7-e2e6aab94bff admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.080319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658c08c-c24a-49df-acf7-e2e6aab94bff admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.082322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658c08c-c24a-49df-acf7-e2e6aab94bff admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.083375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658c08c-c24a-49df-acf7-e2e6aab94bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.086171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658c08c-c24a-49df-acf7-e2e6aab94bff admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.102371 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2845/5698] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:55.115843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8fa6d-36e2-4160-8504-aa6c4b6a8162 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.134596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8fa6d-36e2-4160-8504-aa6c4b6a8162 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.139997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c543-936c-4550-9a98-869f1e41481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.140684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c543-936c-4550-9a98-869f1e41481e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.140969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c543-936c-4550-9a98-869f1e41481e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.141324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c543-936c-4550-9a98-869f1e41481e admin admin] PATH_INFO: `/v3/projects/41abb68593f749d6b6d2191070aa9535/users/a55b488412984cafbedd4b22c1b263b1/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.161298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62c543-936c-4550-9a98-869f1e41481e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41abb68593f749d6b6d2191070aa9535, user_id=a55b488412984cafbedd4b22c1b263b1, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.165073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62c543-936c-4550-9a98-869f1e41481e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.184329 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2854/5699] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:55 2022] PUT /identity/v3/projects/41abb68593f749d6b6d2191070aa9535/users/a55b488412984cafbedd4b22c1b263b1/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:55.192694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f29c5-b514-47af-9a21-e7408391e53d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.192978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f29c5-b514-47af-9a21-e7408391e53d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.193254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f29c5-b514-47af-9a21-e7408391e53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.228505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4c7f29c5-b514-47af-9a21-e7408391e53d None None] MFA Rules not processed for user `a55b488412984cafbedd4b22c1b263b1`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:55.229848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4c7f29c5-b514-47af-9a21-e7408391e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:55.327305 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2846/5700] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:55.332411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c543-936c-4550-9a98-869f1e41481e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.357451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:55.380774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f29c5-b514-47af-9a21-e7408391e53d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.382827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4c7f29c5-b514-47af-9a21-e7408391e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:55.476498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:55.534047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c543-936c-4550-9a98-869f1e41481e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.550729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843342ed-9ad7-4507-94d2-c00f63e644a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.551820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843342ed-9ad7-4507-94d2-c00f63e644a3 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.552250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843342ed-9ad7-4507-94d2-c00f63e644a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.552534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f29c5-b514-47af-9a21-e7408391e53d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.552910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843342ed-9ad7-4507-94d2-c00f63e644a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.553767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843342ed-9ad7-4507-94d2-c00f63e644a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.556758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843342ed-9ad7-4507-94d2-c00f63e644a3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.562240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.563036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.563519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.563894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] PATH_INFO: `/v3/projects/347eae93590f4d2c9124b7dd28490f4d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.568221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=347eae93590f4d2c9124b7dd28490f4d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.573763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.618461 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2855/5701] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:55 2022] POST /identity/v3/projects => generated 365 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:55.618461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843342ed-9ad7-4507-94d2-c00f63e644a3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.619048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-843342ed-9ad7-4507-94d2-c00f63e644a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:55.680875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347eae93590f4d2c9124b7dd28490f4d', 'request_id': 'req-7a823212-3cbd-419d-9f86-5542599cfc4b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.693595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347eae93590f4d2c9124b7dd28490f4d', 'request_id': 'req-7a823212-3cbd-419d-9f86-5542599cfc4b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.708541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347eae93590f4d2c9124b7dd28490f4d', 'request_id': 'req-7a823212-3cbd-419d-9f86-5542599cfc4b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.724157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843342ed-9ad7-4507-94d2-c00f63e644a3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.726186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] The token cache is being invalidate because project 347eae93590f4d2c9124b7dd28490f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:55.726774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.727741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.730198 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2847/5702] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:55 2022] DELETE /identity/v3/projects/347eae93590f4d2c9124b7dd28490f4d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:55.731298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:55.740230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:55.868267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.870479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.871932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.872914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] PATH_INFO: `/v3/projects/e93d2e45d1b349b0be5b59ff7a611af9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.875037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93d2e45d1b349b0be5b59ff7a611af9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.878734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.885881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823212-3cbd-419d-9f86-5542599cfc4b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:55.893015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663b98e-8335-4e3e-bb25-c4adeaafeaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:55.893778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b98e-8335-4e3e-bb25-c4adeaafeaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.894198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b98e-8335-4e3e-bb25-c4adeaafeaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.894488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b98e-8335-4e3e-bb25-c4adeaafeaf7 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.895294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663b98e-8335-4e3e-bb25-c4adeaafeaf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:55.897470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663b98e-8335-4e3e-bb25-c4adeaafeaf7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:55.941575 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2848/5703] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:55 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:55.944082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135521-a14d-4510-8250-679d536182c2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:55.947055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135521-a14d-4510-8250-679d536182c2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:55.947358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135521-a14d-4510-8250-679d536182c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:55.979292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:55.989349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93d2e45d1b349b0be5b59ff7a611af9', 'request_id': 'req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.998894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93d2e45d1b349b0be5b59ff7a611af9', 'request_id': 'req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:55.999056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-76135521-a14d-4510-8250-679d536182c2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:56.000306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76135521-a14d-4510-8250-679d536182c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:56.013127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93d2e45d1b349b0be5b59ff7a611af9', 'request_id': 'req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:56.028004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] The token cache is being invalidate because project e93d2e45d1b349b0be5b59ff7a611af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:49:56.028637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:56.029640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:56.035752 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2856/5704] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:55 2022] DELETE /identity/v3/projects/e93d2e45d1b349b0be5b59ff7a611af9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:56.036741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.038229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:56.144172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:56.177482 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2849/5705] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:56.179190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929b53-f6f4-410b-8f16-c4b86199855f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.179527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929b53-f6f4-410b-8f16-c4b86199855f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.179812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929b53-f6f4-410b-8f16-c4b86199855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.194669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85e8f0-ee4d-4c7d-a3fa-459ec7ffded3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:56.206933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023c1cf-f33f-4e55-a0c4-47570233de40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:56.208085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023c1cf-f33f-4e55-a0c4-47570233de40 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.208595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023c1cf-f33f-4e55-a0c4-47570233de40 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.208798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-90929b53-f6f4-410b-8f16-c4b86199855f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:56.209090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023c1cf-f33f-4e55-a0c4-47570233de40 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.210098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-90929b53-f6f4-410b-8f16-c4b86199855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:56.210327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023c1cf-f33f-4e55-a0c4-47570233de40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:56.215475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023c1cf-f33f-4e55-a0c4-47570233de40 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:56.220061 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2850/5706] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:56.222245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e78eb-ad26-4887-967c-bf3568ad8e37 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.222768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e78eb-ad26-4887-967c-bf3568ad8e37 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.223059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e78eb-ad26-4887-967c-bf3568ad8e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.287494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ff5e78eb-ad26-4887-967c-bf3568ad8e37 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:56.289534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ff5e78eb-ad26-4887-967c-bf3568ad8e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:56.295894 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2857/5707] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:56.304011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc7c58-447f-4d5f-95c4-cc8c38056f82 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.304471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc7c58-447f-4d5f-95c4-cc8c38056f82 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.304941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc7c58-447f-4d5f-95c4-cc8c38056f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.318579 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2851/5708] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:56.320823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e78eb-ad26-4887-967c-bf3568ad8e37 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.363905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e78eb-ad26-4887-967c-bf3568ad8e37 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:56.395589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cddc7c58-447f-4d5f-95c4-cc8c38056f82 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:56.397088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaaea5-af75-4619-b24b-4b28c2ff45e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:56.400684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cddc7c58-447f-4d5f-95c4-cc8c38056f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:56.403122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaaea5-af75-4619-b24b-4b28c2ff45e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.403122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaaea5-af75-4619-b24b-4b28c2ff45e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.403122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaaea5-af75-4619-b24b-4b28c2ff45e4 admin admin] PATH_INFO: `/v3/projects/d0d472336dc349dcba5338b4dbb83031/users/1ee2a53ba43649489e770aae0938dbd8/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.422121 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2858/5709] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:56.423346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc7c58-447f-4d5f-95c4-cc8c38056f82 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.437085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc7c58-447f-4d5f-95c4-cc8c38056f82 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:56.441264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaaea5-af75-4619-b24b-4b28c2ff45e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d472336dc349dcba5338b4dbb83031, user_id=1ee2a53ba43649489e770aae0938dbd8, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:56.444423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaaea5-af75-4619-b24b-4b28c2ff45e4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:56.458006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1dcf-42d0-43a3-b373-67b81668c6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:56.462111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1dcf-42d0-43a3-b373-67b81668c6fc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.462585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1dcf-42d0-43a3-b373-67b81668c6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.463023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1dcf-42d0-43a3-b373-67b81668c6fc admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.464458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a1dcf-42d0-43a3-b373-67b81668c6fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:56.464939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a1dcf-42d0-43a3-b373-67b81668c6fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:56.468140 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2852/5710] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:56 2022] PUT /identity/v3/projects/d0d472336dc349dcba5338b4dbb83031/users/1ee2a53ba43649489e770aae0938dbd8/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:56.468140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaaea5-af75-4619-b24b-4b28c2ff45e4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.475112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a1dcf-42d0-43a3-b373-67b81668c6fc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:56.503132 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2859/5711] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:56.504518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1dcf-42d0-43a3-b373-67b81668c6fc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.516256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1dcf-42d0-43a3-b373-67b81668c6fc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:56.636792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202fa24-9e97-41a0-8164-138f39466a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:56.638711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202fa24-9e97-41a0-8164-138f39466a2f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.639262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202fa24-9e97-41a0-8164-138f39466a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.639735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202fa24-9e97-41a0-8164-138f39466a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.640602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202fa24-9e97-41a0-8164-138f39466a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:56.642471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202fa24-9e97-41a0-8164-138f39466a2f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:56.643640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaaea5-af75-4619-b24b-4b28c2ff45e4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:56.649998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ec876-1b27-4608-8e49-00bbf7d778cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:56.650628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec876-1b27-4608-8e49-00bbf7d778cb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.650911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec876-1b27-4608-8e49-00bbf7d778cb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.662771 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2860/5712] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:56.662771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202fa24-9e97-41a0-8164-138f39466a2f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.667866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec876-1b27-4608-8e49-00bbf7d778cb admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.670242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ec876-1b27-4608-8e49-00bbf7d778cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:49:56.670644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ec876-1b27-4608-8e49-00bbf7d778cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:56.672387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ec876-1b27-4608-8e49-00bbf7d778cb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:56.675351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202fa24-9e97-41a0-8164-138f39466a2f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:56.690369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7b844-c5d9-4d8f-96c2-10207a459a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:56.690369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7b844-c5d9-4d8f-96c2-10207a459a67 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.690369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7b844-c5d9-4d8f-96c2-10207a459a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.690369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7b844-c5d9-4d8f-96c2-10207a459a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.690836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7b844-c5d9-4d8f-96c2-10207a459a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:56.690836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7b844-c5d9-4d8f-96c2-10207a459a67 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:56.704090 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2853/5713] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:49:56.706187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ec876-1b27-4608-8e49-00bbf7d778cb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.723292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ec876-1b27-4608-8e49-00bbf7d778cb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:56.728671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305547cd-9066-473e-bd0e-abc2d5308dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:56.729356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305547cd-9066-473e-bd0e-abc2d5308dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.729671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305547cd-9066-473e-bd0e-abc2d5308dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.730023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305547cd-9066-473e-bd0e-abc2d5308dc8 admin admin] PATH_INFO: `/v3/projects/d0d472336dc349dcba5338b4dbb83031/users/1ee2a53ba43649489e770aae0938dbd8/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.733659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305547cd-9066-473e-bd0e-abc2d5308dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d472336dc349dcba5338b4dbb83031, user_id=1ee2a53ba43649489e770aae0938dbd8, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:56.734634 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2861/5714] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:56 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:56.735474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305547cd-9066-473e-bd0e-abc2d5308dc8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:56.736324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7b844-c5d9-4d8f-96c2-10207a459a67 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.761266 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2854/5715] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:56 2022] PUT /identity/v3/projects/d0d472336dc349dcba5338b4dbb83031/users/1ee2a53ba43649489e770aae0938dbd8/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:56.761266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305547cd-9066-473e-bd0e-abc2d5308dc8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:56.777676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:56.835946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7b844-c5d9-4d8f-96c2-10207a459a67 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:56.850136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305547cd-9066-473e-bd0e-abc2d5308dc8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:56.855230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215b49f-2880-4bc2-a00e-43c269ffc26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:56.855910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215b49f-2880-4bc2-a00e-43c269ffc26f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.856365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215b49f-2880-4bc2-a00e-43c269ffc26f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.856796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215b49f-2880-4bc2-a00e-43c269ffc26f admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.857488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215b49f-2880-4bc2-a00e-43c269ffc26f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:56.859463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215b49f-2880-4bc2-a00e-43c269ffc26f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:56.888498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2855/5716] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:56 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:56.890226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a992b-041c-4a22-83a7-e1d52599630c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.890652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a992b-041c-4a22-83a7-e1d52599630c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.890938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a992b-041c-4a22-83a7-e1d52599630c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.904112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d55760-92c0-4709-8470-5c027f9ad396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:56.904892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d55760-92c0-4709-8470-5c027f9ad396 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:56.905270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d55760-92c0-4709-8470-5c027f9ad396 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:56.905671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d55760-92c0-4709-8470-5c027f9ad396 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:56.906407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d55760-92c0-4709-8470-5c027f9ad396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:56.908657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d55760-92c0-4709-8470-5c027f9ad396 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:56.925212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6b9a992b-041c-4a22-83a7-e1d52599630c None None] MFA Rules not processed for user `1ee2a53ba43649489e770aae0938dbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:56.926495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6b9a992b-041c-4a22-83a7-e1d52599630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:56.948836 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2862/5717] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:49:56 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:56.949609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:56.949751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d55760-92c0-4709-8470-5c027f9ad396 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:57.007345 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2856/5718] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:57.008789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a992b-041c-4a22-83a7-e1d52599630c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:57.028350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d55760-92c0-4709-8470-5c027f9ad396 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.028625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a992b-041c-4a22-83a7-e1d52599630c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.033804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e9161-1f95-4496-a206-c850be705023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.034266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce77222-e9bd-4ddf-9c6c-b7402f87a379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.034702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e9161-1f95-4496-a206-c850be705023 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.035182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e9161-1f95-4496-a206-c850be705023 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.035562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e9161-1f95-4496-a206-c850be705023 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.036329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e9161-1f95-4496-a206-c850be705023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.037355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce77222-e9bd-4ddf-9c6c-b7402f87a379 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.037711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce77222-e9bd-4ddf-9c6c-b7402f87a379 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.038000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce77222-e9bd-4ddf-9c6c-b7402f87a379 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.038408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e9161-1f95-4496-a206-c850be705023 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.038865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce77222-e9bd-4ddf-9c6c-b7402f87a379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.041437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce77222-e9bd-4ddf-9c6c-b7402f87a379 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.053657 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2863/5719] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:57.053657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e9161-1f95-4496-a206-c850be705023 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:57.053657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d13e9161-1f95-4496-a206-c850be705023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:57.069439 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2857/5720] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:49:57 2022] POST /identity/v3/users => generated 292 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:49:57.069675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce77222-e9bd-4ddf-9c6c-b7402f87a379 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:57.089630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce77222-e9bd-4ddf-9c6c-b7402f87a379 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.094735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698fe0f-1719-4b86-a835-6fd50a8e6d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.095857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698fe0f-1719-4b86-a835-6fd50a8e6d79 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.096131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698fe0f-1719-4b86-a835-6fd50a8e6d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.096433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698fe0f-1719-4b86-a835-6fd50a8e6d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.097075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698fe0f-1719-4b86-a835-6fd50a8e6d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.098705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698fe0f-1719-4b86-a835-6fd50a8e6d79 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.110827 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2858/5721] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:57.112781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698fe0f-1719-4b86-a835-6fd50a8e6d79 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:57.122383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:57.126620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698fe0f-1719-4b86-a835-6fd50a8e6d79 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.127150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e9161-1f95-4496-a206-c850be705023 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.134341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957b277-ecdc-4f65-ad67-375339b62a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.134514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e8c7-d976-4257-a599-30e61eaa4c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.134967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e8c7-d976-4257-a599-30e61eaa4c9c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.135388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e8c7-d976-4257-a599-30e61eaa4c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.135509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b277-ecdc-4f65-ad67-375339b62a61 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.135701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e8c7-d976-4257-a599-30e61eaa4c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.135819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b277-ecdc-4f65-ad67-375339b62a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.136012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b277-ecdc-4f65-ad67-375339b62a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.136317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930e8c7-d976-4257-a599-30e61eaa4c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.138019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930e8c7-d976-4257-a599-30e61eaa4c9c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.151720 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2859/5722] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:57.151720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e8c7-d976-4257-a599-30e61eaa4c9c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:57.161779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e8c7-d976-4257-a599-30e61eaa4c9c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.179736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a09aa-6493-49c0-83ce-2ef71ad99838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.180761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a09aa-6493-49c0-83ce-2ef71ad99838 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.180916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a09aa-6493-49c0-83ce-2ef71ad99838 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.181185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a09aa-6493-49c0-83ce-2ef71ad99838 admin admin] PATH_INFO: `/v3/projects/c4ebdb2c3c634900aebd9afb156974b6/users/0a2b13f770e54d888d61a25a55615e9c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.200159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a09aa-6493-49c0-83ce-2ef71ad99838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ebdb2c3c634900aebd9afb156974b6, user_id=0a2b13f770e54d888d61a25a55615e9c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.205245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a09aa-6493-49c0-83ce-2ef71ad99838 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.239637 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2860/5723] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:57 2022] PUT /identity/v3/projects/c4ebdb2c3c634900aebd9afb156974b6/users/0a2b13f770e54d888d61a25a55615e9c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:57.239637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a09aa-6493-49c0-83ce-2ef71ad99838 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:57.254326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957b277-ecdc-4f65-ad67-375339b62a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.256483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957b277-ecdc-4f65-ad67-375339b62a61 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.279502 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2864/5724] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:57.281613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f768ee-fc81-43de-8a48-2352a03b0e30 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.282135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f768ee-fc81-43de-8a48-2352a03b0e30 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.282655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f768ee-fc81-43de-8a48-2352a03b0e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.331329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a09aa-6493-49c0-83ce-2ef71ad99838 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.333782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-77f768ee-fc81-43de-8a48-2352a03b0e30 None None] MFA Rules not processed for user `0a2b13f770e54d888d61a25a55615e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:57.336871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff9c97-edb3-4f38-92dd-338b11e4c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.337222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-77f768ee-fc81-43de-8a48-2352a03b0e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:57.337590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff9c97-edb3-4f38-92dd-338b11e4c9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.337869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff9c97-edb3-4f38-92dd-338b11e4c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.338143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff9c97-edb3-4f38-92dd-338b11e4c9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.338789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff9c97-edb3-4f38-92dd-338b11e4c9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.340580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff9c97-edb3-4f38-92dd-338b11e4c9b4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.357943 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2861/5725] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:49:57.360301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff9c97-edb3-4f38-92dd-338b11e4c9b4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:57.387930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff9c97-edb3-4f38-92dd-338b11e4c9b4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.400338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9c4da-ca2c-4382-9934-0a3a18f211f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.401290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9c4da-ca2c-4382-9934-0a3a18f211f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.401664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9c4da-ca2c-4382-9934-0a3a18f211f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.402163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9c4da-ca2c-4382-9934-0a3a18f211f5 admin admin] PATH_INFO: `/v3/projects/718960eefb3e4919889cd10861437589/users/22abb3dd634744ce91df955ce82680a9/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.438947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9c4da-ca2c-4382-9934-0a3a18f211f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=718960eefb3e4919889cd10861437589, user_id=22abb3dd634744ce91df955ce82680a9, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.439365 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2865/5726] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:57.443762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9c4da-ca2c-4382-9934-0a3a18f211f5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.452497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f768ee-fc81-43de-8a48-2352a03b0e30 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:57.454171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-77f768ee-fc81-43de-8a48-2352a03b0e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:57.465511 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2862/5727] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:49:57 2022] PUT /identity/v3/projects/718960eefb3e4919889cd10861437589/users/22abb3dd634744ce91df955ce82680a9/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:57.478299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18481fc-efd2-4b26-b50e-56117ce82964 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.478590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18481fc-efd2-4b26-b50e-56117ce82964 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.479204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18481fc-efd2-4b26-b50e-56117ce82964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.529027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d18481fc-efd2-4b26-b50e-56117ce82964 None None] MFA Rules not processed for user `22abb3dd634744ce91df955ce82680a9`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:57.531225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d18481fc-efd2-4b26-b50e-56117ce82964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:57.545708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f768ee-fc81-43de-8a48-2352a03b0e30 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.554306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:57.607713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:57.617964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53764d1-da86-417e-8d39-f1c175345e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.618587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53764d1-da86-417e-8d39-f1c175345e28 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.619337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53764d1-da86-417e-8d39-f1c175345e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.619814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53764d1-da86-417e-8d39-f1c175345e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.644250 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2863/5728] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:49:57.686932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18481fc-efd2-4b26-b50e-56117ce82964 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:57.688370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d18481fc-efd2-4b26-b50e-56117ce82964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:57.690761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53764d1-da86-417e-8d39-f1c175345e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.692907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53764d1-da86-417e-8d39-f1c175345e28 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.707423 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2866/5729] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:57.796288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18481fc-efd2-4b26-b50e-56117ce82964 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:57.800330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c55324-35be-45ad-9bc3-843af82cb115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:57.801470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c55324-35be-45ad-9bc3-843af82cb115 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:57.801470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c55324-35be-45ad-9bc3-843af82cb115 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:57.801693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c55324-35be-45ad-9bc3-843af82cb115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:57.812195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c55324-35be-45ad-9bc3-843af82cb115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:57.814131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c55324-35be-45ad-9bc3-843af82cb115 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:57.825451 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2864/5730] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:58.823831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53764d1-da86-417e-8d39-f1c175345e28 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:58.984483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53764d1-da86-417e-8d39-f1c175345e28 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:58.991550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:58.993178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:58.993866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:58.995951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] PATH_INFO: `/v3/users/22abb3dd634744ce91df955ce82680a9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:59.001240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22abb3dd634744ce91df955ce82680a9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:59.005206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:59.092167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22abb3dd634744ce91df955ce82680a9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:59.095573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22abb3dd634744ce91df955ce82680a9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:59.131492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22abb3dd634744ce91df955ce82680a9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:59.132419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22abb3dd634744ce91df955ce82680a9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:59.146625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22abb3dd634744ce91df955ce82680a9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:49:59.171944 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2867/5731] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:49:58 2022] DELETE /identity/v3/users/22abb3dd634744ce91df955ce82680a9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:49:59.176843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aab67e-f405-4f82-b23d-6f663fb5421f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:59.177512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aab67e-f405-4f82-b23d-6f663fb5421f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:59.177512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aab67e-f405-4f82-b23d-6f663fb5421f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:59.264230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-92aab67e-f405-4f82-b23d-6f663fb5421f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:49:59.272285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-92aab67e-f405-4f82-b23d-6f663fb5421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:59.403206 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2865/5732] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:49:59.432212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:49:59.433690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:49:59.456417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:59.505713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c721f3-39ad-48ea-9edb-13316d187719 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:49:59.510936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc0da4-158c-4347-a7d7-e18d826391c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:49:59.511762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc0da4-158c-4347-a7d7-e18d826391c1 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:49:59.512042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc0da4-158c-4347-a7d7-e18d826391c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:49:59.512845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc0da4-158c-4347-a7d7-e18d826391c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:49:59.525565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc0da4-158c-4347-a7d7-e18d826391c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:49:59.527498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc0da4-158c-4347-a7d7-e18d826391c1 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:49:59.539503 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2868/5733] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:00.465696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aab67e-f405-4f82-b23d-6f663fb5421f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:00.467282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-92aab67e-f405-4f82-b23d-6f663fb5421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:00.525774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aab67e-f405-4f82-b23d-6f663fb5421f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:00.548750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:00.550133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:00.552092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:00.552609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] PATH_INFO: `/v3/projects/718960eefb3e4919889cd10861437589` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:00.557562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=718960eefb3e4919889cd10861437589)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:00.559524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:00.703142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:00.706661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718960eefb3e4919889cd10861437589', 'request_id': 'req-7474218b-9588-4489-aca9-1c1ff85273d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:00.726819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718960eefb3e4919889cd10861437589', 'request_id': 'req-7474218b-9588-4489-aca9-1c1ff85273d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:00.741748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718960eefb3e4919889cd10861437589', 'request_id': 'req-7474218b-9588-4489-aca9-1c1ff85273d2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:00.779901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] The token cache is being invalidate because project 718960eefb3e4919889cd10861437589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:00.780293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:00.791126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7474218b-9588-4489-aca9-1c1ff85273d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:00.798486 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2866/5734] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:00 2022] DELETE /identity/v3/projects/718960eefb3e4919889cd10861437589 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:00.802981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b307b6-65e6-4e8e-ad43-676d59cf31f9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:00.803496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b307b6-65e6-4e8e-ad43-676d59cf31f9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:00.803713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b307b6-65e6-4e8e-ad43-676d59cf31f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:00.859026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-15b307b6-65e6-4e8e-ad43-676d59cf31f9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:00.860826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-15b307b6-65e6-4e8e-ad43-676d59cf31f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:00.980112 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2869/5735] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:00.980726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff5574-0a33-4233-ba4f-f6cea43d11a0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:00.981020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff5574-0a33-4233-ba4f-f6cea43d11a0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:00.981300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff5574-0a33-4233-ba4f-f6cea43d11a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.028539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-deff5574-0a33-4233-ba4f-f6cea43d11a0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:01.030449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-deff5574-0a33-4233-ba4f-f6cea43d11a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:01.042991 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2867/5736] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:01.047723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b307b6-65e6-4e8e-ad43-676d59cf31f9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:01.062008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b307b6-65e6-4e8e-ad43-676d59cf31f9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:01.068667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e2571-d083-4498-8ff6-c2a79d3bbe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:01.069195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2571-d083-4498-8ff6-c2a79d3bbe78 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.069549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2571-d083-4498-8ff6-c2a79d3bbe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.069828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2571-d083-4498-8ff6-c2a79d3bbe78 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.070577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e2571-d083-4498-8ff6-c2a79d3bbe78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:01.070887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e2571-d083-4498-8ff6-c2a79d3bbe78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:01.073043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e2571-d083-4498-8ff6-c2a79d3bbe78 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:01.095727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff5574-0a33-4233-ba4f-f6cea43d11a0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:01.096446 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2870/5737] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:01.110417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff5574-0a33-4233-ba4f-f6cea43d11a0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:01.123090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651d496-0934-471a-8635-4b9f983cc188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:01.124629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651d496-0934-471a-8635-4b9f983cc188 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.125132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651d496-0934-471a-8635-4b9f983cc188 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.125888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651d496-0934-471a-8635-4b9f983cc188 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.126772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651d496-0934-471a-8635-4b9f983cc188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:01.129800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651d496-0934-471a-8635-4b9f983cc188 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:01.172238 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2868/5738] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:01 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:01.176098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e2571-d083-4498-8ff6-c2a79d3bbe78 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:01.190806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e2571-d083-4498-8ff6-c2a79d3bbe78 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:01.344011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438824f-02d8-48e9-9678-e68f8aed480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:01.344635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438824f-02d8-48e9-9678-e68f8aed480a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.344920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438824f-02d8-48e9-9678-e68f8aed480a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.345190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438824f-02d8-48e9-9678-e68f8aed480a admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.346420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438824f-02d8-48e9-9678-e68f8aed480a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:01.348363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438824f-02d8-48e9-9678-e68f8aed480a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:01.374240 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2871/5739] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:01 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:01.378399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651d496-0934-471a-8635-4b9f983cc188 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:01.393286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651d496-0934-471a-8635-4b9f983cc188 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:01.399573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83076c5-8948-4a65-9914-4f6d800e65d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:01.401488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438824f-02d8-48e9-9678-e68f8aed480a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:01.404216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d438824f-02d8-48e9-9678-e68f8aed480a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:01.407960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83076c5-8948-4a65-9914-4f6d800e65d2 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.411473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83076c5-8948-4a65-9914-4f6d800e65d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.413364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83076c5-8948-4a65-9914-4f6d800e65d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.414301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83076c5-8948-4a65-9914-4f6d800e65d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:01.419091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83076c5-8948-4a65-9914-4f6d800e65d2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:01.429697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438824f-02d8-48e9-9678-e68f8aed480a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:01.438001 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2869/5740] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:50:01.442915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83076c5-8948-4a65-9914-4f6d800e65d2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:01.443840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a0971-30b6-4b9d-aab6-aa8b81cd14e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:01.444800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a0971-30b6-4b9d-aab6-aa8b81cd14e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.445299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a0971-30b6-4b9d-aab6-aa8b81cd14e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.445813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a0971-30b6-4b9d-aab6-aa8b81cd14e2 admin admin] PATH_INFO: `/v3/users/3924c8a60d89443b9375c643c270e81c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.447720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a0971-30b6-4b9d-aab6-aa8b81cd14e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3924c8a60d89443b9375c643c270e81c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:01.457265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a0971-30b6-4b9d-aab6-aa8b81cd14e2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:01.468459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83076c5-8948-4a65-9914-4f6d800e65d2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:01.485505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cc36c-0b01-44c1-a321-2b83fbff69fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:01.486562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc36c-0b01-44c1-a321-2b83fbff69fa admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.487061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc36c-0b01-44c1-a321-2b83fbff69fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.487580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc36c-0b01-44c1-a321-2b83fbff69fa admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.488456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cc36c-0b01-44c1-a321-2b83fbff69fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:01.490347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cc36c-0b01-44c1-a321-2b83fbff69fa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:01.520507 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2870/5741] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:01.527050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:01.528047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cc36c-0b01-44c1-a321-2b83fbff69fa admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:01.560780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cc36c-0b01-44c1-a321-2b83fbff69fa admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:01.574025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8c0ea-ba7d-4663-bb3d-559795070a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:01.574298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-397a0971-30b6-4b9d-aab6-aa8b81cd14e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3924c8a60d89443b9375c643c270e81c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:01.575189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-397a0971-30b6-4b9d-aab6-aa8b81cd14e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3924c8a60d89443b9375c643c270e81c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:01.575701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8c0ea-ba7d-4663-bb3d-559795070a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.577315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8c0ea-ba7d-4663-bb3d-559795070a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.577700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8c0ea-ba7d-4663-bb3d-559795070a9d admin admin] PATH_INFO: `/v3/projects/6122e581164e40398a09a83ef36b8340/users/b4a7d8cd1f3e4ce2814bbd37dada2130/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.605743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-397a0971-30b6-4b9d-aab6-aa8b81cd14e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3924c8a60d89443b9375c643c270e81c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:01.606657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-397a0971-30b6-4b9d-aab6-aa8b81cd14e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3924c8a60d89443b9375c643c270e81c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:01.621427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8c0ea-ba7d-4663-bb3d-559795070a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6122e581164e40398a09a83ef36b8340, user_id=b4a7d8cd1f3e4ce2814bbd37dada2130, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:01.625520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-397a0971-30b6-4b9d-aab6-aa8b81cd14e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3924c8a60d89443b9375c643c270e81c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:01.627849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8c0ea-ba7d-4663-bb3d-559795070a9d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:01.655679 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2872/5742] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:01 2022] DELETE /identity/v3/users/3924c8a60d89443b9375c643c270e81c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:01.656839 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2871/5743] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:01 2022] PUT /identity/v3/projects/6122e581164e40398a09a83ef36b8340/users/b4a7d8cd1f3e4ce2814bbd37dada2130/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:01.667537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5865b26-467c-4be0-bb2c-e49ac90270e3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.667845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5865b26-467c-4be0-bb2c-e49ac90270e3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.668098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5865b26-467c-4be0-bb2c-e49ac90270e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.671494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421468ea-2c1b-4489-a01a-301867607253 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.671854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421468ea-2c1b-4489-a01a-301867607253 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.672221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421468ea-2c1b-4489-a01a-301867607253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:01.695357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a5865b26-467c-4be0-bb2c-e49ac90270e3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:01.699778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a5865b26-467c-4be0-bb2c-e49ac90270e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:01.731828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-421468ea-2c1b-4489-a01a-301867607253 None None] MFA Rules not processed for user `b4a7d8cd1f3e4ce2814bbd37dada2130`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:01.737765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-421468ea-2c1b-4489-a01a-301867607253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:01.839275 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2873/5744] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:01.855643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5865b26-467c-4be0-bb2c-e49ac90270e3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:01.857225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a5865b26-467c-4be0-bb2c-e49ac90270e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:01.912317 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2872/5745] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:01.918851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421468ea-2c1b-4489-a01a-301867607253 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:01.923652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-421468ea-2c1b-4489-a01a-301867607253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:01.992504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5865b26-467c-4be0-bb2c-e49ac90270e3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:01.997482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a366398-bde6-42cc-9704-2705ca4fc139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:01.998206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366398-bde6-42cc-9704-2705ca4fc139 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:01.998551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366398-bde6-42cc-9704-2705ca4fc139 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:01.998832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366398-bde6-42cc-9704-2705ca4fc139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:02.011145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a366398-bde6-42cc-9704-2705ca4fc139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:02.013002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a366398-bde6-42cc-9704-2705ca4fc139 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:02.031785 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2874/5746] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:50:02.130841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421468ea-2c1b-4489-a01a-301867607253 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:02.140516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322af502-7a00-4b7b-b79b-975c69b17606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:02.141156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322af502-7a00-4b7b-b79b-975c69b17606 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:02.141465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322af502-7a00-4b7b-b79b-975c69b17606 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:02.141753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322af502-7a00-4b7b-b79b-975c69b17606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:02.152486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:02.175935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322af502-7a00-4b7b-b79b-975c69b17606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:02.180589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322af502-7a00-4b7b-b79b-975c69b17606 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:02.208577 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2873/5747] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:02.594510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a366398-bde6-42cc-9704-2705ca4fc139 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:02.602533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a366398-bde6-42cc-9704-2705ca4fc139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:02.671701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a366398-bde6-42cc-9704-2705ca4fc139 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:02.679010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:02.680921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:02.681445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:02.682411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] PATH_INFO: `/v3/projects/3d1d0e7a1d5a479da5658abdf730658e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:02.686804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1d0e7a1d5a479da5658abdf730658e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:02.693189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:02.852874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:02.860201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1d0e7a1d5a479da5658abdf730658e', 'request_id': 'req-eb077c66-0138-4a4c-ac6c-5389c236f744'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:02.885973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1d0e7a1d5a479da5658abdf730658e', 'request_id': 'req-eb077c66-0138-4a4c-ac6c-5389c236f744'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:02.897549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1d0e7a1d5a479da5658abdf730658e', 'request_id': 'req-eb077c66-0138-4a4c-ac6c-5389c236f744'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:02.911643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] The token cache is being invalidate because project 3d1d0e7a1d5a479da5658abdf730658e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:02.912446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:02.913324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-eb077c66-0138-4a4c-ac6c-5389c236f744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:02.915205 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2875/5748] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:02 2022] DELETE /identity/v3/projects/3d1d0e7a1d5a479da5658abdf730658e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:02.920744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b500-4abf-448c-b031-5c191465a1c0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:02.921241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b500-4abf-448c-b031-5c191465a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:02.922209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b500-4abf-448c-b031-5c191465a1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:02.956945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f677b500-4abf-448c-b031-5c191465a1c0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:02.958436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f677b500-4abf-448c-b031-5c191465a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:03.091474 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2874/5749] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:03.093826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82429-20de-4ef7-80b9-acd44ad41de2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.094947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82429-20de-4ef7-80b9-acd44ad41de2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.095437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82429-20de-4ef7-80b9-acd44ad41de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.144361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8aa82429-20de-4ef7-80b9-acd44ad41de2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:03.145903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8aa82429-20de-4ef7-80b9-acd44ad41de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:03.163673 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2876/5750] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:03.165754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677b500-4abf-448c-b031-5c191465a1c0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:03.181822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677b500-4abf-448c-b031-5c191465a1c0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:03.194086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4bbb-fd94-4246-9b2f-77295c563a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:03.194724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4bbb-fd94-4246-9b2f-77295c563a5a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.195016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4bbb-fd94-4246-9b2f-77295c563a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.195285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4bbb-fd94-4246-9b2f-77295c563a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.195955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4bbb-fd94-4246-9b2f-77295c563a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:03.196262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4bbb-fd94-4246-9b2f-77295c563a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:03.197922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4bbb-fd94-4246-9b2f-77295c563a5a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:03.247336 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2875/5751] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:50:03.254148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa82429-20de-4ef7-80b9-acd44ad41de2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:03.269198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa82429-20de-4ef7-80b9-acd44ad41de2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:03.275816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2326032-93ea-4d1f-aed6-9040f2d54ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:03.276879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2326032-93ea-4d1f-aed6-9040f2d54ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.277341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2326032-93ea-4d1f-aed6-9040f2d54ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.277906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2326032-93ea-4d1f-aed6-9040f2d54ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.279094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2326032-93ea-4d1f-aed6-9040f2d54ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:03.281698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2326032-93ea-4d1f-aed6-9040f2d54ac5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:03.320565 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2877/5752] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:03 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:03.325173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4bbb-fd94-4246-9b2f-77295c563a5a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:03.341690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4bbb-fd94-4246-9b2f-77295c563a5a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:03.452731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa4546-7f6a-427d-a54f-0bf165fb0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:03.453498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa4546-7f6a-427d-a54f-0bf165fb0861 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.453880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa4546-7f6a-427d-a54f-0bf165fb0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.454587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa4546-7f6a-427d-a54f-0bf165fb0861 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.456118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa4546-7f6a-427d-a54f-0bf165fb0861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:03.458540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa4546-7f6a-427d-a54f-0bf165fb0861 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:03.489742 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2876/5753] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:03 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:03.493594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2326032-93ea-4d1f-aed6-9040f2d54ac5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:03.515911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2326032-93ea-4d1f-aed6-9040f2d54ac5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:03.525800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf2157-ffb8-4cdc-85d1-2865974661d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:03.526761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf2157-ffb8-4cdc-85d1-2865974661d0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.527534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf2157-ffb8-4cdc-85d1-2865974661d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.528341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf2157-ffb8-4cdc-85d1-2865974661d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.529299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf2157-ffb8-4cdc-85d1-2865974661d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:03.531185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf2157-ffb8-4cdc-85d1-2865974661d0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:03.546159 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2878/5754] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:03.550000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa4546-7f6a-427d-a54f-0bf165fb0861 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:03.563113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa4546-7f6a-427d-a54f-0bf165fb0861 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:03.575017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1646d7-84ee-46a3-bd50-fa566d4fa7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:03.575659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1646d7-84ee-46a3-bd50-fa566d4fa7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.575946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1646d7-84ee-46a3-bd50-fa566d4fa7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.576227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1646d7-84ee-46a3-bd50-fa566d4fa7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.576892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1646d7-84ee-46a3-bd50-fa566d4fa7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:03.587042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1646d7-84ee-46a3-bd50-fa566d4fa7b3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:03.613900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf2157-ffb8-4cdc-85d1-2865974661d0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:03.614130 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2877/5755] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:50:03.631008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf2157-ffb8-4cdc-85d1-2865974661d0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:03.640887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cd837-6540-4ef2-8fd9-28bd2568055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:03.641932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cd837-6540-4ef2-8fd9-28bd2568055e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.642398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cd837-6540-4ef2-8fd9-28bd2568055e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.643469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cd837-6540-4ef2-8fd9-28bd2568055e admin admin] PATH_INFO: `/v3/projects/998ca20cb423454a86c5591f9f807f3e/users/bac706cea4d1407ba205ebeaa0fd884c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.689305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cd837-6540-4ef2-8fd9-28bd2568055e admin admin] RBAC: Authorizing `identity:create_grant(project_id=998ca20cb423454a86c5591f9f807f3e, user_id=bac706cea4d1407ba205ebeaa0fd884c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:03.692845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cd837-6540-4ef2-8fd9-28bd2568055e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:03.726691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bb0a0-dbb5-4ea2-a3d5-b84719ff45d4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:03.727558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bb0a0-dbb5-4ea2-a3d5-b84719ff45d4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:03.728362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bb0a0-dbb5-4ea2-a3d5-b84719ff45d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:03.749552 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2879/5756] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:03 2022] PUT /identity/v3/projects/998ca20cb423454a86c5591f9f807f3e/users/bac706cea4d1407ba205ebeaa0fd884c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:03.796492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f14bb0a0-dbb5-4ea2-a3d5-b84719ff45d4 None None] MFA Rules not processed for user `bac706cea4d1407ba205ebeaa0fd884c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:03.801013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f14bb0a0-dbb5-4ea2-a3d5-b84719ff45d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:03.932497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:03.953966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cd837-6540-4ef2-8fd9-28bd2568055e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:03.956688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-da5cd837-6540-4ef2-8fd9-28bd2568055e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:03.971738 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2878/5757] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:04.000551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bb0a0-dbb5-4ea2-a3d5-b84719ff45d4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:04.003765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f14bb0a0-dbb5-4ea2-a3d5-b84719ff45d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:04.048955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cd837-6540-4ef2-8fd9-28bd2568055e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.054766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fe06b-9695-4ac9-a51b-7a5586dbe3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.056217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fe06b-9695-4ac9-a51b-7a5586dbe3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.056697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fe06b-9695-4ac9-a51b-7a5586dbe3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.057174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fe06b-9695-4ac9-a51b-7a5586dbe3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.059698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ae7fe06b-9695-4ac9-a51b-7a5586dbe3b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:04.138431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bb0a0-dbb5-4ea2-a3d5-b84719ff45d4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.148912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da6413-df61-4186-b7f0-769a4c27a7ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.149141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da6413-df61-4186-b7f0-769a4c27a7ce service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.149412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da6413-df61-4186-b7f0-769a4c27a7ce service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.149719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da6413-df61-4186-b7f0-769a4c27a7ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.165848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da6413-df61-4186-b7f0-769a4c27a7ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:04.167350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da6413-df61-4186-b7f0-769a4c27a7ce service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:04.180555 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2879/5758] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:50:04.194110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da6413-df61-4186-b7f0-769a4c27a7ce service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:04.203179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fe06b-9695-4ac9-a51b-7a5586dbe3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:04.204761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fe06b-9695-4ac9-a51b-7a5586dbe3b3 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:04.242294 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2880/5759] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:04.279820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54611f0a-414d-4c64-83a7-bfa352a13e6c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.280470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54611f0a-414d-4c64-83a7-bfa352a13e6c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.281008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54611f0a-414d-4c64-83a7-bfa352a13e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.320128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-54611f0a-414d-4c64-83a7-bfa352a13e6c None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:04.325361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-54611f0a-414d-4c64-83a7-bfa352a13e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:04.357725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da6413-df61-4186-b7f0-769a4c27a7ce service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.371510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01939e09-98c7-4dce-8aaf-8554da86a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.372189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939e09-98c7-4dce-8aaf-8554da86a257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.373660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939e09-98c7-4dce-8aaf-8554da86a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.373660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939e09-98c7-4dce-8aaf-8554da86a257 admin admin] PATH_INFO: `/v3/users/bac706cea4d1407ba205ebeaa0fd884c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.378176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01939e09-98c7-4dce-8aaf-8554da86a257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac706cea4d1407ba205ebeaa0fd884c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:04.382164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:04.384283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01939e09-98c7-4dce-8aaf-8554da86a257 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:04.474250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-01939e09-98c7-4dce-8aaf-8554da86a257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac706cea4d1407ba205ebeaa0fd884c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:04.475008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-01939e09-98c7-4dce-8aaf-8554da86a257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac706cea4d1407ba205ebeaa0fd884c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:04.478411 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2881/5760] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:04.493728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54611f0a-414d-4c64-83a7-bfa352a13e6c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:04.495691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-54611f0a-414d-4c64-83a7-bfa352a13e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:04.500375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-01939e09-98c7-4dce-8aaf-8554da86a257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac706cea4d1407ba205ebeaa0fd884c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:04.516714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-01939e09-98c7-4dce-8aaf-8554da86a257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac706cea4d1407ba205ebeaa0fd884c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:04.528264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-01939e09-98c7-4dce-8aaf-8554da86a257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac706cea4d1407ba205ebeaa0fd884c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:04.541928 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2880/5761] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:04 2022] DELETE /identity/v3/users/bac706cea4d1407ba205ebeaa0fd884c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:04.544337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66279c96-88b1-4f76-9e98-ecfbe200c52c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.545263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66279c96-88b1-4f76-9e98-ecfbe200c52c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.545263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66279c96-88b1-4f76-9e98-ecfbe200c52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.577105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-66279c96-88b1-4f76-9e98-ecfbe200c52c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:04.578564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-66279c96-88b1-4f76-9e98-ecfbe200c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:04.596809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:04.714603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54611f0a-414d-4c64-83a7-bfa352a13e6c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.737652 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2881/5762] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:04.844366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66279c96-88b1-4f76-9e98-ecfbe200c52c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:04.846512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-66279c96-88b1-4f76-9e98-ecfbe200c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:04.863827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aaa1e-0629-4849-b67d-7e4f56987fdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.864592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aaa1e-0629-4849-b67d-7e4f56987fdf service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.866824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aaa1e-0629-4849-b67d-7e4f56987fdf service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.867244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aaa1e-0629-4849-b67d-7e4f56987fdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:04.872785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-281aaa1e-0629-4849-b67d-7e4f56987fdf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:04.985119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66279c96-88b1-4f76-9e98-ecfbe200c52c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:04.995955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01590feb-3509-442b-a1ce-6e0488b9c9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:04.996097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01590feb-3509-442b-a1ce-6e0488b9c9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:04.996369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01590feb-3509-442b-a1ce-6e0488b9c9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:04.996763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01590feb-3509-442b-a1ce-6e0488b9c9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:05.020113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01590feb-3509-442b-a1ce-6e0488b9c9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:05.021642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01590feb-3509-442b-a1ce-6e0488b9c9d1 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:05.047947 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2882/5763] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:50:05.077069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281aaa1e-0629-4849-b67d-7e4f56987fdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:05.082099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281aaa1e-0629-4849-b67d-7e4f56987fdf service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:05.104918 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2882/5764] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:50:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:50:06.341085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01590feb-3509-442b-a1ce-6e0488b9c9d1 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:06.343680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-01590feb-3509-442b-a1ce-6e0488b9c9d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:06.366107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01590feb-3509-442b-a1ce-6e0488b9c9d1 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:06.390253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:06.391450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.392230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.393060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] PATH_INFO: `/v3/projects/998ca20cb423454a86c5591f9f807f3e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.394906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998ca20cb423454a86c5591f9f807f3e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:06.400055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:06.579387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998ca20cb423454a86c5591f9f807f3e', 'request_id': 'req-e36ca7b1-3168-4585-9e80-732ce0984969'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:06.587237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998ca20cb423454a86c5591f9f807f3e', 'request_id': 'req-e36ca7b1-3168-4585-9e80-732ce0984969'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:06.598375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998ca20cb423454a86c5591f9f807f3e', 'request_id': 'req-e36ca7b1-3168-4585-9e80-732ce0984969'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:06.615538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] The token cache is being invalidate because project 998ca20cb423454a86c5591f9f807f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:06.615781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:06.616492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:06.622495 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2883/5765] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:06 2022] DELETE /identity/v3/projects/998ca20cb423454a86c5591f9f807f3e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:06.624413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a7f67-0830-4d98-b270-bb27e15e90b8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.624944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a7f67-0830-4d98-b270-bb27e15e90b8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.625306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a7f67-0830-4d98-b270-bb27e15e90b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.680295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-433a7f67-0830-4d98-b270-bb27e15e90b8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:06.681692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-433a7f67-0830-4d98-b270-bb27e15e90b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:06.713073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:06.806324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:06.808799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:06.854527 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2883/5766] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:06.862672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e77ff-4466-4ed5-a18a-0786202b54de None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.863209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e77ff-4466-4ed5-a18a-0786202b54de None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.863670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e77ff-4466-4ed5-a18a-0786202b54de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.927721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-149e77ff-4466-4ed5-a18a-0786202b54de None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:06.930315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-149e77ff-4466-4ed5-a18a-0786202b54de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:06.931991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:06.946770 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2884/5767] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:06.948463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e77ff-4466-4ed5-a18a-0786202b54de None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:06.962830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e77ff-4466-4ed5-a18a-0786202b54de None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:06.971912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aca67c-5f1d-49f5-acac-e63243f6d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:06.973365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aca67c-5f1d-49f5-acac-e63243f6d37d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:06.974061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aca67c-5f1d-49f5-acac-e63243f6d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:06.974572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aca67c-5f1d-49f5-acac-e63243f6d37d admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:06.975715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aca67c-5f1d-49f5-acac-e63243f6d37d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:06.977128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aca67c-5f1d-49f5-acac-e63243f6d37d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:06.979597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aca67c-5f1d-49f5-acac-e63243f6d37d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:06.990185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ca7b1-3168-4585-9e80-732ce0984969 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.005871 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2885/5768] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:07.006260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879344e-121e-4be7-b258-9956348704a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.008207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879344e-121e-4be7-b258-9956348704a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.008517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879344e-121e-4be7-b258-9956348704a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.008988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879344e-121e-4be7-b258-9956348704a5 admin admin] PATH_INFO: `/v3/users/a55b488412984cafbedd4b22c1b263b1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.009587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aca67c-5f1d-49f5-acac-e63243f6d37d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.010197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879344e-121e-4be7-b258-9956348704a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55b488412984cafbedd4b22c1b263b1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.012154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879344e-121e-4be7-b258-9956348704a5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.034448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aca67c-5f1d-49f5-acac-e63243f6d37d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.081444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f63d4-85ce-4440-aef9-2432c17d54d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.082114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f63d4-85ce-4440-aef9-2432c17d54d5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.082383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f63d4-85ce-4440-aef9-2432c17d54d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.082886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f63d4-85ce-4440-aef9-2432c17d54d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.083762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f63d4-85ce-4440-aef9-2432c17d54d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.086704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f63d4-85ce-4440-aef9-2432c17d54d5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.134088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c879344e-121e-4be7-b258-9956348704a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55b488412984cafbedd4b22c1b263b1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:07.136030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c879344e-121e-4be7-b258-9956348704a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55b488412984cafbedd4b22c1b263b1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:07.149301 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2886/5769] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:07 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:07.151331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f63d4-85ce-4440-aef9-2432c17d54d5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.174618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c879344e-121e-4be7-b258-9956348704a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55b488412984cafbedd4b22c1b263b1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:07.202378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c879344e-121e-4be7-b258-9956348704a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55b488412984cafbedd4b22c1b263b1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:07.241750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c879344e-121e-4be7-b258-9956348704a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55b488412984cafbedd4b22c1b263b1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:07.275380 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2884/5770] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:06 2022] DELETE /identity/v3/users/a55b488412984cafbedd4b22c1b263b1 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:07.276906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666e22f-57d4-40e5-a9ce-ed3b6208a8f5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.277194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666e22f-57d4-40e5-a9ce-ed3b6208a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.280814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666e22f-57d4-40e5-a9ce-ed3b6208a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.321748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f63d4-85ce-4440-aef9-2432c17d54d5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.330956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f666e22f-57d4-40e5-a9ce-ed3b6208a8f5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:07.332368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f666e22f-57d4-40e5-a9ce-ed3b6208a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:07.467926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70061a-0b84-462e-9b2c-5389eed0e30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.469101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70061a-0b84-462e-9b2c-5389eed0e30f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.469676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70061a-0b84-462e-9b2c-5389eed0e30f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.473066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70061a-0b84-462e-9b2c-5389eed0e30f admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.474434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70061a-0b84-462e-9b2c-5389eed0e30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.475352 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2885/5771] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:07.477609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70061a-0b84-462e-9b2c-5389eed0e30f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.505762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666e22f-57d4-40e5-a9ce-ed3b6208a8f5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.505762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f666e22f-57d4-40e5-a9ce-ed3b6208a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:07.548444 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2887/5772] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:07 2022] POST /identity/v3/users => generated 293 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:07.549955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70061a-0b84-462e-9b2c-5389eed0e30f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.555896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1f70061a-0b84-462e-9b2c-5389eed0e30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:07.589090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70061a-0b84-462e-9b2c-5389eed0e30f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.595484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1398c-6fe3-4f27-a1e3-3dbd8ba327c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.596789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1398c-6fe3-4f27-a1e3-3dbd8ba327c7 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.597193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1398c-6fe3-4f27-a1e3-3dbd8ba327c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.597635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1398c-6fe3-4f27-a1e3-3dbd8ba327c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.598394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1398c-6fe3-4f27-a1e3-3dbd8ba327c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.600353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1398c-6fe3-4f27-a1e3-3dbd8ba327c7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.610924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:07.633077 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2888/5773] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:07.635069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1398c-6fe3-4f27-a1e3-3dbd8ba327c7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.661430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1398c-6fe3-4f27-a1e3-3dbd8ba327c7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.675622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e208158-3eba-4195-8254-88aefe091983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.676693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e208158-3eba-4195-8254-88aefe091983 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.677194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e208158-3eba-4195-8254-88aefe091983 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.677454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e208158-3eba-4195-8254-88aefe091983 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.678248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e208158-3eba-4195-8254-88aefe091983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.680225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e208158-3eba-4195-8254-88aefe091983 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.697490 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2889/5774] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:07.699942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e208158-3eba-4195-8254-88aefe091983 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.708362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666e22f-57d4-40e5-a9ce-ed3b6208a8f5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.712908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e208158-3eba-4195-8254-88aefe091983 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:07.721664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8c777-ea26-44e2-bfc6-9f8d6f2a4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.722639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8c777-ea26-44e2-bfc6-9f8d6f2a4bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.722928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8c777-ea26-44e2-bfc6-9f8d6f2a4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.725365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8c777-ea26-44e2-bfc6-9f8d6f2a4bbd admin admin] PATH_INFO: `/v3/projects/8aeb6b8ee0d54ba18108a4e7cd5b06c0/users/5566ec646ae448ad86ba3a35b3a3ce3e/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.725823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b77378-3747-49ba-97a3-a8b46bf6fde5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:07.726689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b77378-3747-49ba-97a3-a8b46bf6fde5 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.727385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b77378-3747-49ba-97a3-a8b46bf6fde5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.727868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b77378-3747-49ba-97a3-a8b46bf6fde5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.770331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8c777-ea26-44e2-bfc6-9f8d6f2a4bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aeb6b8ee0d54ba18108a4e7cd5b06c0, user_id=5566ec646ae448ad86ba3a35b3a3ce3e, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.774281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8c777-ea26-44e2-bfc6-9f8d6f2a4bbd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.782372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b77378-3747-49ba-97a3-a8b46bf6fde5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:07.784655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b77378-3747-49ba-97a3-a8b46bf6fde5 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:07.808540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:07.809955 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2890/5775] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:07 2022] PUT /identity/v3/projects/8aeb6b8ee0d54ba18108a4e7cd5b06c0/users/5566ec646ae448ad86ba3a35b3a3ce3e/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:07.819469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61489ad-ebce-43f5-b702-d545fd408de2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:07.819973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61489ad-ebce-43f5-b702-d545fd408de2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:07.820415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61489ad-ebce-43f5-b702-d545fd408de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:07.834238 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2886/5776] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:50:07.888190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f61489ad-ebce-43f5-b702-d545fd408de2 None None] MFA Rules not processed for user `5566ec646ae448ad86ba3a35b3a3ce3e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:07.890763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f61489ad-ebce-43f5-b702-d545fd408de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:07.987114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b77378-3747-49ba-97a3-a8b46bf6fde5 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:07.987792 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2891/5777] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:08.003385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b77378-3747-49ba-97a3-a8b46bf6fde5 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.189588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ff600-7e31-4de4-bed8-592c132c962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.191258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ff600-7e31-4de4-bed8-592c132c962d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.191654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ff600-7e31-4de4-bed8-592c132c962d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.192219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ff600-7e31-4de4-bed8-592c132c962d admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.193755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ff600-7e31-4de4-bed8-592c132c962d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.199308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ff600-7e31-4de4-bed8-592c132c962d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.257748 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2887/5778] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:07 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:08.264143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61489ad-ebce-43f5-b702-d545fd408de2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.294669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61489ad-ebce-43f5-b702-d545fd408de2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.490339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f54a6-9e7a-4d97-a213-e545c4b68869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.491057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f54a6-9e7a-4d97-a213-e545c4b68869 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.491344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f54a6-9e7a-4d97-a213-e545c4b68869 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.491618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f54a6-9e7a-4d97-a213-e545c4b68869 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.492269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f54a6-9e7a-4d97-a213-e545c4b68869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.494290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f54a6-9e7a-4d97-a213-e545c4b68869 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.537194 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2892/5779] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:08 2022] POST /identity/v3/users => generated 300 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:08.545424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ff600-7e31-4de4-bed8-592c132c962d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.559792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ff600-7e31-4de4-bed8-592c132c962d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.578924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b069b-c22f-4b64-8c7a-4468a571c553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.579746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b069b-c22f-4b64-8c7a-4468a571c553 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.580700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b069b-c22f-4b64-8c7a-4468a571c553 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.583282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b069b-c22f-4b64-8c7a-4468a571c553 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.584138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b069b-c22f-4b64-8c7a-4468a571c553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.588381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b069b-c22f-4b64-8c7a-4468a571c553 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.620589 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2888/5780] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:08.624937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f54a6-9e7a-4d97-a213-e545c4b68869 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.640297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f54a6-9e7a-4d97-a213-e545c4b68869 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.653085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc647ff8-d734-47c0-bdd1-a4fd82f19f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.653814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc647ff8-d734-47c0-bdd1-a4fd82f19f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.654100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc647ff8-d734-47c0-bdd1-a4fd82f19f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.654439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc647ff8-d734-47c0-bdd1-a4fd82f19f4e admin admin] PATH_INFO: `/v3/projects/9130150aee7c4fc3a435bc92dc51ed7a/users/237115b302aa4552b05f8232e216df1e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.690836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc647ff8-d734-47c0-bdd1-a4fd82f19f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9130150aee7c4fc3a435bc92dc51ed7a, user_id=237115b302aa4552b05f8232e216df1e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.694427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc647ff8-d734-47c0-bdd1-a4fd82f19f4e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.720100 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2893/5781] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:08 2022] PUT /identity/v3/projects/9130150aee7c4fc3a435bc92dc51ed7a/users/237115b302aa4552b05f8232e216df1e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:08.723806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b069b-c22f-4b64-8c7a-4468a571c553 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.738681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b069b-c22f-4b64-8c7a-4468a571c553 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.901054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6224b2b-4471-4a91-990e-06b9e858331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.901329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224b2b-4471-4a91-990e-06b9e858331d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.901746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224b2b-4471-4a91-990e-06b9e858331d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.902121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224b2b-4471-4a91-990e-06b9e858331d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.904407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6224b2b-4471-4a91-990e-06b9e858331d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.909646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6224b2b-4471-4a91-990e-06b9e858331d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:08.942390 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2889/5782] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:50:08.947727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc647ff8-d734-47c0-bdd1-a4fd82f19f4e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:08.967906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc647ff8-d734-47c0-bdd1-a4fd82f19f4e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:08.980058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051edb4d-484c-4d1a-a53a-f21c59072af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:08.980991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edb4d-484c-4d1a-a53a-f21c59072af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:08.982122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edb4d-484c-4d1a-a53a-f21c59072af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:08.983088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edb4d-484c-4d1a-a53a-f21c59072af0 admin admin] PATH_INFO: `/v3/projects/9130150aee7c4fc3a435bc92dc51ed7a/users/237115b302aa4552b05f8232e216df1e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:08.988251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051edb4d-484c-4d1a-a53a-f21c59072af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9130150aee7c4fc3a435bc92dc51ed7a, user_id=237115b302aa4552b05f8232e216df1e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:08.994683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051edb4d-484c-4d1a-a53a-f21c59072af0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:09.019773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6224b2b-4471-4a91-990e-06b9e858331d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:09.023928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a6224b2b-4471-4a91-990e-06b9e858331d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:09.036433 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2894/5783] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:08 2022] PUT /identity/v3/projects/9130150aee7c4fc3a435bc92dc51ed7a/users/237115b302aa4552b05f8232e216df1e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:09.047845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6be0-2bcb-4502-9052-6292f57a03a7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:09.048233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6be0-2bcb-4502-9052-6292f57a03a7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:09.048610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6be0-2bcb-4502-9052-6292f57a03a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:09.053625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6224b2b-4471-4a91-990e-06b9e858331d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:09.096610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:09.149558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b08d6be0-2bcb-4502-9052-6292f57a03a7 None None] MFA Rules not processed for user `237115b302aa4552b05f8232e216df1e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:09.154927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b08d6be0-2bcb-4502-9052-6292f57a03a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:09.296032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:09.302012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:09.302306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:09.302719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] PATH_INFO: `/v3/projects/41abb68593f749d6b6d2191070aa9535` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:09.319743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=41abb68593f749d6b6d2191070aa9535)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:09.331930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:09.383007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:09.468432 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2895/5784] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:09.473950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6be0-2bcb-4502-9052-6292f57a03a7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:09.476107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b08d6be0-2bcb-4502-9052-6292f57a03a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:09.498371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41abb68593f749d6b6d2191070aa9535', 'request_id': 'req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:09.531016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41abb68593f749d6b6d2191070aa9535', 'request_id': 'req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:09.563539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41abb68593f749d6b6d2191070aa9535', 'request_id': 'req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:09.615566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] The token cache is being invalidate because project 41abb68593f749d6b6d2191070aa9535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:09.616268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:09.620756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:09.624547 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2890/5785] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:09 2022] DELETE /identity/v3/projects/41abb68593f749d6b6d2191070aa9535 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:09.631516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:09.634054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:09.650609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6be0-2bcb-4502-9052-6292f57a03a7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:09.770879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6e79-fef1-4492-b940-2eb2961bacc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:09.771817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6e79-fef1-4492-b940-2eb2961bacc3 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:09.772056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6e79-fef1-4492-b940-2eb2961bacc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:09.772333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6e79-fef1-4492-b940-2eb2961bacc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:09.779000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-711f6e79-fef1-4492-b940-2eb2961bacc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:09.815105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e1d41-8d4f-4dd9-bba6-8b02e32fee5a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:09.824337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5273374-888c-4521-8b7f-8660de42e071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:09.825282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5273374-888c-4521-8b7f-8660de42e071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:09.826744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5273374-888c-4521-8b7f-8660de42e071 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:09.827322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5273374-888c-4521-8b7f-8660de42e071 admin admin] PATH_INFO: `/v3/users/1ee2a53ba43649489e770aae0938dbd8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:09.828934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5273374-888c-4521-8b7f-8660de42e071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee2a53ba43649489e770aae0938dbd8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:09.831726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5273374-888c-4521-8b7f-8660de42e071 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:09.904700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f6e79-fef1-4492-b940-2eb2961bacc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:09.906550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f6e79-fef1-4492-b940-2eb2961bacc3 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:09.911688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:09.926547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d5273374-888c-4521-8b7f-8660de42e071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee2a53ba43649489e770aae0938dbd8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:09.927338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d5273374-888c-4521-8b7f-8660de42e071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee2a53ba43649489e770aae0938dbd8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:09.933145 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2896/5786] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:50:09.972262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d5273374-888c-4521-8b7f-8660de42e071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee2a53ba43649489e770aae0938dbd8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:09.986749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d5273374-888c-4521-8b7f-8660de42e071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee2a53ba43649489e770aae0938dbd8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.009375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6e79-fef1-4492-b940-2eb2961bacc3 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:10.011236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-711f6e79-fef1-4492-b940-2eb2961bacc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:10.016599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d5273374-888c-4521-8b7f-8660de42e071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee2a53ba43649489e770aae0938dbd8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.040732 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2891/5787] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:09 2022] DELETE /identity/v3/users/1ee2a53ba43649489e770aae0938dbd8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:10.040978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6e79-fef1-4492-b940-2eb2961bacc3 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:10.173613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:10.174901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:10.175183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:10.175455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] PATH_INFO: `/v3/users/5566ec646ae448ad86ba3a35b3a3ce3e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:10.180569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5566ec646ae448ad86ba3a35b3a3ce3e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:10.182770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:10.278494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5566ec646ae448ad86ba3a35b3a3ce3e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.281665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5566ec646ae448ad86ba3a35b3a3ce3e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.307769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5566ec646ae448ad86ba3a35b3a3ce3e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.310691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5566ec646ae448ad86ba3a35b3a3ce3e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.326344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5566ec646ae448ad86ba3a35b3a3ce3e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:10.364363 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2897/5788] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:10 2022] DELETE /identity/v3/users/5566ec646ae448ad86ba3a35b3a3ce3e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:10.369153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a86f2f-76fd-44cd-9b96-4d1f0a55add1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:10.369551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a86f2f-76fd-44cd-9b96-4d1f0a55add1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:10.369860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a86f2f-76fd-44cd-9b96-4d1f0a55add1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:10.420615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-18a86f2f-76fd-44cd-9b96-4d1f0a55add1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:10.422750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-18a86f2f-76fd-44cd-9b96-4d1f0a55add1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:10.449300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:10.598163 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2892/5789] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:10.645822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:10.647888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:10.791582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715e1a1-575a-48d9-823c-2cbc37e9bc02 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:10.803251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62353c9d-3877-4725-823f-0e2b584ecc56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:10.803892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62353c9d-3877-4725-823f-0e2b584ecc56 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:10.804176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62353c9d-3877-4725-823f-0e2b584ecc56 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:10.804452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62353c9d-3877-4725-823f-0e2b584ecc56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:10.827428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62353c9d-3877-4725-823f-0e2b584ecc56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:10.831838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62353c9d-3877-4725-823f-0e2b584ecc56 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:10.857860 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2898/5790] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:11.569459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a86f2f-76fd-44cd-9b96-4d1f0a55add1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:11.572745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-18a86f2f-76fd-44cd-9b96-4d1f0a55add1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:11.604180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a86f2f-76fd-44cd-9b96-4d1f0a55add1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:11.613754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:11.618701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:11.618854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62353c9d-3877-4725-823f-0e2b584ecc56 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:11.619382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:11.619882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] PATH_INFO: `/v3/projects/8aeb6b8ee0d54ba18108a4e7cd5b06c0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.620411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-62353c9d-3877-4725-823f-0e2b584ecc56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:11.622317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aeb6b8ee0d54ba18108a4e7cd5b06c0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:11.624818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:11.652385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62353c9d-3877-4725-823f-0e2b584ecc56 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:11.657493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:11.658681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:11.658960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:11.665772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] PATH_INFO: `/v3/projects/d0d472336dc349dcba5338b4dbb83031` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.667420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d472336dc349dcba5338b4dbb83031)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:11.671025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:11.730837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:11.754243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aeb6b8ee0d54ba18108a4e7cd5b06c0', 'request_id': 'req-2c28d8e5-a2d8-40c5-a516-badb70d27085'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.766192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aeb6b8ee0d54ba18108a4e7cd5b06c0', 'request_id': 'req-2c28d8e5-a2d8-40c5-a516-badb70d27085'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.777509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aeb6b8ee0d54ba18108a4e7cd5b06c0', 'request_id': 'req-2c28d8e5-a2d8-40c5-a516-badb70d27085'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.797726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] The token cache is being invalidate because project 8aeb6b8ee0d54ba18108a4e7cd5b06c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:11.798034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.800108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.800565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d472336dc349dcba5338b4dbb83031', 'request_id': 'req-02f8e630-3b59-46fc-a7a8-998a34117869'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.801810 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2893/5791] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:11 2022] DELETE /identity/v3/projects/8aeb6b8ee0d54ba18108a4e7cd5b06c0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:11.808487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:11.811560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:11.815308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d472336dc349dcba5338b4dbb83031', 'request_id': 'req-02f8e630-3b59-46fc-a7a8-998a34117869'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.829024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d472336dc349dcba5338b4dbb83031', 'request_id': 'req-02f8e630-3b59-46fc-a7a8-998a34117869'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.863262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] The token cache is being invalidate because project d0d472336dc349dcba5338b4dbb83031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:11.864114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.865189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02f8e630-3b59-46fc-a7a8-998a34117869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:11.872601 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2899/5792] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:11 2022] DELETE /identity/v3/projects/d0d472336dc349dcba5338b4dbb83031 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:11.878334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2d129-3e75-4b33-b983-e02cdee1d7b9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:11.878997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2d129-3e75-4b33-b983-e02cdee1d7b9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:11.879553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2d129-3e75-4b33-b983-e02cdee1d7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:11.932845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-70e2d129-3e75-4b33-b983-e02cdee1d7b9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:11.934215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-70e2d129-3e75-4b33-b983-e02cdee1d7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:11.957648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28d8e5-a2d8-40c5-a516-badb70d27085 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:12.087669 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2900/5793] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:12.096384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4f32f-e224-4723-93fc-3411d2f69e55 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.096675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4f32f-e224-4723-93fc-3411d2f69e55 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.096960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4f32f-e224-4723-93fc-3411d2f69e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.101889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:12.121988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a3d4f32f-e224-4723-93fc-3411d2f69e55 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:12.123079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a3d4f32f-e224-4723-93fc-3411d2f69e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:12.128655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:12.129349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.129998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.130406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] PATH_INFO: `/v3/users/237115b302aa4552b05f8232e216df1e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.131507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237115b302aa4552b05f8232e216df1e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:12.135639 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2901/5794] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:12.136832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:12.139376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4f32f-e224-4723-93fc-3411d2f69e55 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:12.167727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4f32f-e224-4723-93fc-3411d2f69e55 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:12.190422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f6c32-4c5e-489b-be83-71bb5135be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:12.191557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f6c32-4c5e-489b-be83-71bb5135be57 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.192018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f6c32-4c5e-489b-be83-71bb5135be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.192465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f6c32-4c5e-489b-be83-71bb5135be57 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.195452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f6c32-4c5e-489b-be83-71bb5135be57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:12.196136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f6c32-4c5e-489b-be83-71bb5135be57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:12.201915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f6c32-4c5e-489b-be83-71bb5135be57 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:12.231040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237115b302aa4552b05f8232e216df1e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:12.236509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237115b302aa4552b05f8232e216df1e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:12.250602 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2902/5795] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:12.256110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f6c32-4c5e-489b-be83-71bb5135be57 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:12.263723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237115b302aa4552b05f8232e216df1e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:12.271972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f6c32-4c5e-489b-be83-71bb5135be57 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:12.274439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237115b302aa4552b05f8232e216df1e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:12.289600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519fb68-487e-45b9-acc0-1164667d8c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:12.290268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237115b302aa4552b05f8232e216df1e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:12.290393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519fb68-487e-45b9-acc0-1164667d8c1f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.290676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519fb68-487e-45b9-acc0-1164667d8c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.290959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519fb68-487e-45b9-acc0-1164667d8c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.291607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519fb68-487e-45b9-acc0-1164667d8c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:12.296260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519fb68-487e-45b9-acc0-1164667d8c1f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:12.308405 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2894/5796] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:11 2022] DELETE /identity/v3/users/237115b302aa4552b05f8232e216df1e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:12.382681 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2903/5797] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:12 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:12.387568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:12.389195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:12.531652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8f237-08ad-45c1-92c1-05dffd8eaba5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:12.723737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148795-8bce-459d-8697-b60766396624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:12.724429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148795-8bce-459d-8697-b60766396624 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.724643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148795-8bce-459d-8697-b60766396624 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.724920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148795-8bce-459d-8697-b60766396624 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.725612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148795-8bce-459d-8697-b60766396624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:12.727607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148795-8bce-459d-8697-b60766396624 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:12.800673 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2895/5798] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:12 2022] POST /identity/v3/users => generated 287 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:12.805433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519fb68-487e-45b9-acc0-1164667d8c1f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:12.829111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519fb68-487e-45b9-acc0-1164667d8c1f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:12.842213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8d5bd-80ca-4742-b517-49c69e78ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:12.843331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8d5bd-80ca-4742-b517-49c69e78ac22 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.844431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8d5bd-80ca-4742-b517-49c69e78ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.845744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8d5bd-80ca-4742-b517-49c69e78ac22 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.846706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8d5bd-80ca-4742-b517-49c69e78ac22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:12.849092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8d5bd-80ca-4742-b517-49c69e78ac22 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:12.875306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148795-8bce-459d-8697-b60766396624 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:12.887437 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2904/5799] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:50:12.897847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148795-8bce-459d-8697-b60766396624 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:12.905054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43361dd9-ff28-4407-ae2b-3b077d562998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:12.906003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361dd9-ff28-4407-ae2b-3b077d562998 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.906296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361dd9-ff28-4407-ae2b-3b077d562998 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.906579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43361dd9-ff28-4407-ae2b-3b077d562998 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:12.907428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43361dd9-ff28-4407-ae2b-3b077d562998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:12.909129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43361dd9-ff28-4407-ae2b-3b077d562998 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:12.910744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:12.929482 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2896/5800] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:12.934240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8d5bd-80ca-4742-b517-49c69e78ac22 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:12.951785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8d5bd-80ca-4742-b517-49c69e78ac22 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:12.966834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef0afd-9dee-46a4-bfb1-526fd6b91dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:12.967628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef0afd-9dee-46a4-bfb1-526fd6b91dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:12.967979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef0afd-9dee-46a4-bfb1-526fd6b91dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:12.968327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef0afd-9dee-46a4-bfb1-526fd6b91dbf admin admin] PATH_INFO: `/v3/projects/891f88a19d80450780329e4118e8cd55/users/506b961b2bae48feb60ec7e3458e277e/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.019242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef0afd-9dee-46a4-bfb1-526fd6b91dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=891f88a19d80450780329e4118e8cd55, user_id=506b961b2bae48feb60ec7e3458e277e, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.022217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef0afd-9dee-46a4-bfb1-526fd6b91dbf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.058164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3243be9-633c-42ab-8029-67518f7e7181 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.058448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3243be9-633c-42ab-8029-67518f7e7181 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.058732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3243be9-633c-42ab-8029-67518f7e7181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.061480 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2905/5801] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:12 2022] PUT /identity/v3/projects/891f88a19d80450780329e4118e8cd55/users/506b961b2bae48feb60ec7e3458e277e/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:50:13.139707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a3243be9-633c-42ab-8029-67518f7e7181 None None] MFA Rules not processed for user `506b961b2bae48feb60ec7e3458e277e`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:13.147965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a3243be9-633c-42ab-8029-67518f7e7181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:13.229377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef0afd-9dee-46a4-bfb1-526fd6b91dbf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.231524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1cef0afd-9dee-46a4-bfb1-526fd6b91dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:13.310772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:13.347726 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2897/5802] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:13.371272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3243be9-633c-42ab-8029-67518f7e7181 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.374314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a3243be9-633c-42ab-8029-67518f7e7181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:13.426591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef0afd-9dee-46a4-bfb1-526fd6b91dbf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.434546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.435788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.436176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.436556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] PATH_INFO: `/v3/projects/9130150aee7c4fc3a435bc92dc51ed7a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.438003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9130150aee7c4fc3a435bc92dc51ed7a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.440988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.532963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3243be9-633c-42ab-8029-67518f7e7181 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.539126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9f476-d321-4a9e-a178-17bee1f06aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.540072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9f476-d321-4a9e-a178-17bee1f06aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.540680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9f476-d321-4a9e-a178-17bee1f06aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.540805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9f476-d321-4a9e-a178-17bee1f06aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.559390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9f476-d321-4a9e-a178-17bee1f06aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.561210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9f476-d321-4a9e-a178-17bee1f06aa2 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.574002 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2898/5803] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:13.581127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9130150aee7c4fc3a435bc92dc51ed7a', 'request_id': 'req-fa16f061-a41f-400c-848b-6f68aae1fffa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:13.592611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9130150aee7c4fc3a435bc92dc51ed7a', 'request_id': 'req-fa16f061-a41f-400c-848b-6f68aae1fffa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:13.608116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9130150aee7c4fc3a435bc92dc51ed7a', 'request_id': 'req-fa16f061-a41f-400c-848b-6f68aae1fffa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:13.628747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] The token cache is being invalidate because project 9130150aee7c4fc3a435bc92dc51ed7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:13.629063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:13.631416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fa16f061-a41f-400c-848b-6f68aae1fffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:13.634541 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2906/5804] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:13 2022] DELETE /identity/v3/projects/9130150aee7c4fc3a435bc92dc51ed7a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:13.639827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf62801-9de1-43d3-941a-8caf12a60b72 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.640232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf62801-9de1-43d3-941a-8caf12a60b72 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.640618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf62801-9de1-43d3-941a-8caf12a60b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.679704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-aaf62801-9de1-43d3-941a-8caf12a60b72 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:13.681020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aaf62801-9de1-43d3-941a-8caf12a60b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:13.850752 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2899/5805] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:13.852028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7792761-216b-4ef9-aef7-a3ce066c96dc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.852442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7792761-216b-4ef9-aef7-a3ce066c96dc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.852562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7792761-216b-4ef9-aef7-a3ce066c96dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.875869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c7792761-216b-4ef9-aef7-a3ce066c96dc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:13.877898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c7792761-216b-4ef9-aef7-a3ce066c96dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:13.888607 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2907/5806] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:13.894041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf62801-9de1-43d3-941a-8caf12a60b72 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.904773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf62801-9de1-43d3-941a-8caf12a60b72 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.911362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866929b-3673-4937-aff2-1278314b03b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.912678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866929b-3673-4937-aff2-1278314b03b6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.913180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866929b-3673-4937-aff2-1278314b03b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.913900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866929b-3673-4937-aff2-1278314b03b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.915106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866929b-3673-4937-aff2-1278314b03b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:13.915576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866929b-3673-4937-aff2-1278314b03b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.918536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866929b-3673-4937-aff2-1278314b03b6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.940988 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2900/5807] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:13.942062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7792761-216b-4ef9-aef7-a3ce066c96dc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:13.952034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7792761-216b-4ef9-aef7-a3ce066c96dc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:13.957835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613a0e8-b5e0-4d69-a922-842f8320e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:13.958857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613a0e8-b5e0-4d69-a922-842f8320e388 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:13.959329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613a0e8-b5e0-4d69-a922-842f8320e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:13.959767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613a0e8-b5e0-4d69-a922-842f8320e388 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:13.960582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613a0e8-b5e0-4d69-a922-842f8320e388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:13.963160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613a0e8-b5e0-4d69-a922-842f8320e388 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:13.997089 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2908/5808] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:13 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:50:14.002457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866929b-3673-4937-aff2-1278314b03b6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.014193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866929b-3673-4937-aff2-1278314b03b6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.036853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:14.098828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076b9a7-08a0-414c-ac6a-90c0dfc14317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.099613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076b9a7-08a0-414c-ac6a-90c0dfc14317 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.100367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076b9a7-08a0-414c-ac6a-90c0dfc14317 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.100367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076b9a7-08a0-414c-ac6a-90c0dfc14317 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.101262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076b9a7-08a0-414c-ac6a-90c0dfc14317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.103436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076b9a7-08a0-414c-ac6a-90c0dfc14317 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.132989 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2901/5809] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:14 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:14.134782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613a0e8-b5e0-4d69-a922-842f8320e388 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.146915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613a0e8-b5e0-4d69-a922-842f8320e388 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.152034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf91d-d0ea-40dc-9529-e585e3ada9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.152648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf91d-d0ea-40dc-9529-e585e3ada9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.153105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf91d-d0ea-40dc-9529-e585e3ada9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.153401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf91d-d0ea-40dc-9529-e585e3ada9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.154055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecf91d-d0ea-40dc-9529-e585e3ada9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.155897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecf91d-d0ea-40dc-9529-e585e3ada9a3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.166699 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2909/5810] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:14.171541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076b9a7-08a0-414c-ac6a-90c0dfc14317 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.183062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076b9a7-08a0-414c-ac6a-90c0dfc14317 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.188827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03223ba9-33a6-40fb-9b4b-2a2158cc64db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.190308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223ba9-33a6-40fb-9b4b-2a2158cc64db admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.190874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223ba9-33a6-40fb-9b4b-2a2158cc64db admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.191251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223ba9-33a6-40fb-9b4b-2a2158cc64db admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.192333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03223ba9-33a6-40fb-9b4b-2a2158cc64db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.195249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03223ba9-33a6-40fb-9b4b-2a2158cc64db admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.212994 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2902/5811] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:14.214682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf91d-d0ea-40dc-9529-e585e3ada9a3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.226121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf91d-d0ea-40dc-9529-e585e3ada9a3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.232051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d47231-f8d8-4c29-8273-8ddaa76550af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.232873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47231-f8d8-4c29-8273-8ddaa76550af admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.233255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47231-f8d8-4c29-8273-8ddaa76550af admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.233659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47231-f8d8-4c29-8273-8ddaa76550af admin admin] PATH_INFO: `/v3/projects/d2ec7a2255ae40d2a100eed4ee87e4ff/users/95cc01953349460bac6b6e8472a8f4af/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.252914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d47231-f8d8-4c29-8273-8ddaa76550af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ec7a2255ae40d2a100eed4ee87e4ff, user_id=95cc01953349460bac6b6e8472a8f4af, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.255942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d47231-f8d8-4c29-8273-8ddaa76550af admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.277449 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2910/5812] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:14 2022] PUT /identity/v3/projects/d2ec7a2255ae40d2a100eed4ee87e4ff/users/95cc01953349460bac6b6e8472a8f4af/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:14.282943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69713-0e18-4293-b7c0-c537a8120947 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.283396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69713-0e18-4293-b7c0-c537a8120947 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.283775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69713-0e18-4293-b7c0-c537a8120947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.320987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-92a69713-0e18-4293-b7c0-c537a8120947 None None] MFA Rules not processed for user `95cc01953349460bac6b6e8472a8f4af`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:14.322329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-92a69713-0e18-4293-b7c0-c537a8120947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:14.419552 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2903/5813] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:14.428528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d47231-f8d8-4c29-8273-8ddaa76550af admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.489003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:14.500849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d47231-f8d8-4c29-8273-8ddaa76550af admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.514155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb3f26-f5ab-486b-884b-0b82c9c781e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.514783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3f26-f5ab-486b-884b-0b82c9c781e5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.515064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3f26-f5ab-486b-884b-0b82c9c781e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.515339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3f26-f5ab-486b-884b-0b82c9c781e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.515986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb3f26-f5ab-486b-884b-0b82c9c781e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.517978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb3f26-f5ab-486b-884b-0b82c9c781e5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.560700 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2911/5814] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:14 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:14.564868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a69713-0e18-4293-b7c0-c537a8120947 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.584884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a69713-0e18-4293-b7c0-c537a8120947 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.740769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fcd67-1a7a-4890-8745-22722494cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.742725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fcd67-1a7a-4890-8745-22722494cb90 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.743503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fcd67-1a7a-4890-8745-22722494cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.743748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fcd67-1a7a-4890-8745-22722494cb90 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.744437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fcd67-1a7a-4890-8745-22722494cb90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.751493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fcd67-1a7a-4890-8745-22722494cb90 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.810607 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2904/5815] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:14 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:14.814442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb3f26-f5ab-486b-884b-0b82c9c781e5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.827503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb3f26-f5ab-486b-884b-0b82c9c781e5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.849693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10137926-e8db-4c17-adb5-9a556fe9845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.850808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10137926-e8db-4c17-adb5-9a556fe9845d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.850808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10137926-e8db-4c17-adb5-9a556fe9845d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.850808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10137926-e8db-4c17-adb5-9a556fe9845d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.851490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10137926-e8db-4c17-adb5-9a556fe9845d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.853098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10137926-e8db-4c17-adb5-9a556fe9845d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.865755 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2912/5816] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:14.869670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fcd67-1a7a-4890-8745-22722494cb90 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.883949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fcd67-1a7a-4890-8745-22722494cb90 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:14.889614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844efd10-a600-4459-b212-45329e2a6379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:14.890296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844efd10-a600-4459-b212-45329e2a6379 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:14.890940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844efd10-a600-4459-b212-45329e2a6379 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:14.891413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844efd10-a600-4459-b212-45329e2a6379 admin admin] PATH_INFO: `/v3/projects/2cc34df3ec1a4b528b0cbd586902b22e/users/74c39c5cde2e4767a0484e658c107f2c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:14.912357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:14.919715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844efd10-a600-4459-b212-45329e2a6379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc34df3ec1a4b528b0cbd586902b22e, user_id=74c39c5cde2e4767a0484e658c107f2c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:14.924544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844efd10-a600-4459-b212-45329e2a6379 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:14.956133 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2905/5817] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:14 2022] PUT /identity/v3/projects/2cc34df3ec1a4b528b0cbd586902b22e/users/74c39c5cde2e4767a0484e658c107f2c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:14.959841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10137926-e8db-4c17-adb5-9a556fe9845d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:14.970481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10137926-e8db-4c17-adb5-9a556fe9845d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:15.035518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec73519-03d6-4f5d-9a5a-9e761a6dc296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:15.036439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec73519-03d6-4f5d-9a5a-9e761a6dc296 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:15.036914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec73519-03d6-4f5d-9a5a-9e761a6dc296 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:15.037451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec73519-03d6-4f5d-9a5a-9e761a6dc296 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:15.038292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec73519-03d6-4f5d-9a5a-9e761a6dc296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:15.040115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec73519-03d6-4f5d-9a5a-9e761a6dc296 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:15.051601 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2913/5818] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:15.055543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844efd10-a600-4459-b212-45329e2a6379 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:15.087515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844efd10-a600-4459-b212-45329e2a6379 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:15.110286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985df10-ae79-49fa-a34d-d70e2d22289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:15.113231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985df10-ae79-49fa-a34d-d70e2d22289b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:15.115288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985df10-ae79-49fa-a34d-d70e2d22289b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:15.116363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985df10-ae79-49fa-a34d-d70e2d22289b admin admin] PATH_INFO: `/v3/projects/2cc34df3ec1a4b528b0cbd586902b22e/users/74c39c5cde2e4767a0484e658c107f2c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:15.122485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985df10-ae79-49fa-a34d-d70e2d22289b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc34df3ec1a4b528b0cbd586902b22e, user_id=74c39c5cde2e4767a0484e658c107f2c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:15.128306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985df10-ae79-49fa-a34d-d70e2d22289b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:15.166085 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2906/5819] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:15 2022] PUT /identity/v3/projects/2cc34df3ec1a4b528b0cbd586902b22e/users/74c39c5cde2e4767a0484e658c107f2c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:15.167673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221dfc-a841-462b-adb0-1d5977796445 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:15.167985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221dfc-a841-462b-adb0-1d5977796445 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:15.168262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221dfc-a841-462b-adb0-1d5977796445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:15.227361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-41221dfc-a841-462b-adb0-1d5977796445 None None] MFA Rules not processed for user `74c39c5cde2e4767a0484e658c107f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:15.231559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-41221dfc-a841-462b-adb0-1d5977796445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:15.452223 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2914/5820] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:15.461111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985df10-ae79-49fa-a34d-d70e2d22289b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:15.462928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1985df10-ae79-49fa-a34d-d70e2d22289b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:15.596910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985df10-ae79-49fa-a34d-d70e2d22289b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:15.609066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b68557-1c8d-4ddc-a55d-f72d673edada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:15.611696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b68557-1c8d-4ddc-a55d-f72d673edada service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:15.612173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b68557-1c8d-4ddc-a55d-f72d673edada service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:15.612471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b68557-1c8d-4ddc-a55d-f72d673edada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:15.642272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b68557-1c8d-4ddc-a55d-f72d673edada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:15.645253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b68557-1c8d-4ddc-a55d-f72d673edada service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:15.684455 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2907/5821] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:15.891643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41221dfc-a841-462b-adb0-1d5977796445 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:15.894286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-41221dfc-a841-462b-adb0-1d5977796445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:15.938740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41221dfc-a841-462b-adb0-1d5977796445 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:15.943112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02d01f-64f3-41f6-922a-f789701cf1cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:15.943919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d01f-64f3-41f6-922a-f789701cf1cf service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:15.944364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d01f-64f3-41f6-922a-f789701cf1cf service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:15.944893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d01f-64f3-41f6-922a-f789701cf1cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:15.998098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:16.019368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02d01f-64f3-41f6-922a-f789701cf1cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:16.020954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02d01f-64f3-41f6-922a-f789701cf1cf service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:16.033433 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2915/5822] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:23.873094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b68557-1c8d-4ddc-a55d-f72d673edada service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:24.014919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b68557-1c8d-4ddc-a55d-f72d673edada service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:24.023299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:24.024090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.024577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.024861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] PATH_INFO: `/v3/users/95cc01953349460bac6b6e8472a8f4af` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.026444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95cc01953349460bac6b6e8472a8f4af)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:24.028664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:24.137322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95cc01953349460bac6b6e8472a8f4af'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:24.138147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95cc01953349460bac6b6e8472a8f4af'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:24.154585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95cc01953349460bac6b6e8472a8f4af'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:24.183423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95cc01953349460bac6b6e8472a8f4af'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:24.196758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95cc01953349460bac6b6e8472a8f4af'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:24.200420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:24.230661 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2908/5823] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:23 2022] DELETE /identity/v3/users/95cc01953349460bac6b6e8472a8f4af => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:24.231632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117aedf-7a69-4e8d-96cf-43ebf5972ed3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.232095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117aedf-7a69-4e8d-96cf-43ebf5972ed3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.232199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117aedf-7a69-4e8d-96cf-43ebf5972ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.274253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c117aedf-7a69-4e8d-96cf-43ebf5972ed3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:24.276504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c117aedf-7a69-4e8d-96cf-43ebf5972ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:24.454671 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2916/5824] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:24.472981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:24.474874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:24.602982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e44ad-6e5e-4c5c-9653-3208a6abe9c8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:24.608184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c2cd5-81a0-4713-ae47-e75d7569279b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:24.609678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2cd5-81a0-4713-ae47-e75d7569279b service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:24.609678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2cd5-81a0-4713-ae47-e75d7569279b service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:24.609678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2cd5-81a0-4713-ae47-e75d7569279b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:24.624596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c2cd5-81a0-4713-ae47-e75d7569279b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:24.626754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c2cd5-81a0-4713-ae47-e75d7569279b service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:24.641177 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2909/5825] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:25.929432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117aedf-7a69-4e8d-96cf-43ebf5972ed3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:25.931288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c117aedf-7a69-4e8d-96cf-43ebf5972ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:25.965719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117aedf-7a69-4e8d-96cf-43ebf5972ed3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:25.980950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:25.983059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:25.983538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:25.984089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] PATH_INFO: `/v3/projects/d2ec7a2255ae40d2a100eed4ee87e4ff` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:25.986562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ec7a2255ae40d2a100eed4ee87e4ff)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:25.988742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:26.098679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ec7a2255ae40d2a100eed4ee87e4ff', 'request_id': 'req-667a9b94-4c08-4212-a802-4c4741c4b7b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.106444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ec7a2255ae40d2a100eed4ee87e4ff', 'request_id': 'req-667a9b94-4c08-4212-a802-4c4741c4b7b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.121003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ec7a2255ae40d2a100eed4ee87e4ff', 'request_id': 'req-667a9b94-4c08-4212-a802-4c4741c4b7b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.149960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] The token cache is being invalidate because project d2ec7a2255ae40d2a100eed4ee87e4ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:26.150442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.152173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.155987 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2917/5826] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:25 2022] DELETE /identity/v3/projects/d2ec7a2255ae40d2a100eed4ee87e4ff => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:26.161704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c2cd5-81a0-4713-ae47-e75d7569279b service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:26.192493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c2cd5-81a0-4713-ae47-e75d7569279b service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:26.394997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:26.395667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:26.395948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:26.396230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] PATH_INFO: `/v3/users/74c39c5cde2e4767a0484e658c107f2c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:26.397474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c39c5cde2e4767a0484e658c107f2c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:26.399436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:26.486948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c39c5cde2e4767a0484e658c107f2c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.488128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c39c5cde2e4767a0484e658c107f2c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.515550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c39c5cde2e4767a0484e658c107f2c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.527690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c39c5cde2e4767a0484e658c107f2c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.541360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c39c5cde2e4767a0484e658c107f2c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:26.552050 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2910/5827] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:26 2022] DELETE /identity/v3/users/74c39c5cde2e4767a0484e658c107f2c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:27.155867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:27.158795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:27.296355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9b94-4c08-4212-a802-4c4741c4b7b5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:27.311108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:27.334943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:27.337698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:27.402528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:27.437845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded1886-a8c6-406c-97c5-daabe2816a7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:27.438455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded1886-a8c6-406c-97c5-daabe2816a7f service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.438744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded1886-a8c6-406c-97c5-daabe2816a7f service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.439559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded1886-a8c6-406c-97c5-daabe2816a7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.442822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-aded1886-a8c6-406c-97c5-daabe2816a7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:27.479373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded1886-a8c6-406c-97c5-daabe2816a7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:27.482960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded1886-a8c6-406c-97c5-daabe2816a7f service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:27.515886 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2918/5828] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:27.628996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42207d-6b30-44c2-8cd0-81ba54208994 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:27.649835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:27.650601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.650784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.651047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] PATH_INFO: `/v3/projects/2cc34df3ec1a4b528b0cbd586902b22e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.652233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc34df3ec1a4b528b0cbd586902b22e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:27.654279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:27.766971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc34df3ec1a4b528b0cbd586902b22e', 'request_id': 'req-09e1c258-a55f-4276-9d47-e60d98730b36'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:27.780890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc34df3ec1a4b528b0cbd586902b22e', 'request_id': 'req-09e1c258-a55f-4276-9d47-e60d98730b36'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:27.791677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc34df3ec1a4b528b0cbd586902b22e', 'request_id': 'req-09e1c258-a55f-4276-9d47-e60d98730b36'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:27.806707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] The token cache is being invalidate because project 2cc34df3ec1a4b528b0cbd586902b22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:27.807582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:27.808538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-09e1c258-a55f-4276-9d47-e60d98730b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:27.811162 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2911/5829] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:27 2022] DELETE /identity/v3/projects/2cc34df3ec1a4b528b0cbd586902b22e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:27.816137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e316-3c1e-4af5-ae97-503601657985 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.816881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e316-3c1e-4af5-ae97-503601657985 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.817427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e316-3c1e-4af5-ae97-503601657985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:27.842348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e6c2e316-3c1e-4af5-ae97-503601657985 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:27.844144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e6c2e316-3c1e-4af5-ae97-503601657985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:27.966891 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2919/5830] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:27.979215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0bca-f4cb-4c38-b5f2-ac6014611546 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:27.979215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0bca-f4cb-4c38-b5f2-ac6014611546 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:27.979215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0bca-f4cb-4c38-b5f2-ac6014611546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.015477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c01d0bca-f4cb-4c38-b5f2-ac6014611546 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:28.016847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c01d0bca-f4cb-4c38-b5f2-ac6014611546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:28.029318 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2912/5831] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:28.034213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e316-3c1e-4af5-ae97-503601657985 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:28.044939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e316-3c1e-4af5-ae97-503601657985 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:28.050897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6ab65-3293-4da4-8c46-c38bef4e93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:28.051642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ab65-3293-4da4-8c46-c38bef4e93bf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:28.052000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ab65-3293-4da4-8c46-c38bef4e93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:28.052350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6ab65-3293-4da4-8c46-c38bef4e93bf admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.053104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6ab65-3293-4da4-8c46-c38bef4e93bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:28.053494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6ab65-3293-4da4-8c46-c38bef4e93bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:28.055408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6ab65-3293-4da4-8c46-c38bef4e93bf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:28.092206 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2920/5832] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:28.094468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0bca-f4cb-4c38-b5f2-ac6014611546 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:28.107196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0bca-f4cb-4c38-b5f2-ac6014611546 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:28.113557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762aa0e6-2407-4a7c-baa0-c7057b8eb3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:28.114199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aa0e6-2407-4a7c-baa0-c7057b8eb3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:28.114496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aa0e6-2407-4a7c-baa0-c7057b8eb3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:28.114770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aa0e6-2407-4a7c-baa0-c7057b8eb3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.115494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762aa0e6-2407-4a7c-baa0-c7057b8eb3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:28.117692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762aa0e6-2407-4a7c-baa0-c7057b8eb3e5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:28.171084 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2913/5833] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:28 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:28.171882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6ab65-3293-4da4-8c46-c38bef4e93bf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:28.184589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6ab65-3293-4da4-8c46-c38bef4e93bf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:28.269192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec3663-e78e-485f-bcde-475b1e4261b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:28.270149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec3663-e78e-485f-bcde-475b1e4261b4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:28.270674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec3663-e78e-485f-bcde-475b1e4261b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:28.271157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec3663-e78e-485f-bcde-475b1e4261b4 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.271997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec3663-e78e-485f-bcde-475b1e4261b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:28.274252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec3663-e78e-485f-bcde-475b1e4261b4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:28.322716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762aa0e6-2407-4a7c-baa0-c7057b8eb3e5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:28.322957 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2921/5834] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:28 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:50:28.350960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762aa0e6-2407-4a7c-baa0-c7057b8eb3e5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:28.363192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14883-94ca-492c-99de-ea7dfa5d724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:28.367114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14883-94ca-492c-99de-ea7dfa5d724a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:28.367378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14883-94ca-492c-99de-ea7dfa5d724a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:28.368624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14883-94ca-492c-99de-ea7dfa5d724a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.369597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c14883-94ca-492c-99de-ea7dfa5d724a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:28.372263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c14883-94ca-492c-99de-ea7dfa5d724a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:28.394431 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2914/5835] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:28.395881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec3663-e78e-485f-bcde-475b1e4261b4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:28.412557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec3663-e78e-485f-bcde-475b1e4261b4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:28.460608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26652664-b463-410b-992c-963aba449d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:28.460608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652664-b463-410b-992c-963aba449d79 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:28.460608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652664-b463-410b-992c-963aba449d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:28.460608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652664-b463-410b-992c-963aba449d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.461079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26652664-b463-410b-992c-963aba449d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:28.462204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26652664-b463-410b-992c-963aba449d79 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:28.491566 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2922/5836] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:28.493372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14883-94ca-492c-99de-ea7dfa5d724a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:28.513826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14883-94ca-492c-99de-ea7dfa5d724a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:28.520767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db0ac8-7792-4465-85a2-437a0f75b708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:28.522247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db0ac8-7792-4465-85a2-437a0f75b708 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:28.522756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db0ac8-7792-4465-85a2-437a0f75b708 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:28.523420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db0ac8-7792-4465-85a2-437a0f75b708 admin admin] PATH_INFO: `/v3/projects/a5215cf1f5fd46cc81acf784ebf077f5/users/675e2a5429e4411e976ea6433fc70a6c/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.561420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db0ac8-7792-4465-85a2-437a0f75b708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5215cf1f5fd46cc81acf784ebf077f5, user_id=675e2a5429e4411e976ea6433fc70a6c, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:28.574457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db0ac8-7792-4465-85a2-437a0f75b708 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:28.611402 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2915/5837] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:28 2022] PUT /identity/v3/projects/a5215cf1f5fd46cc81acf784ebf077f5/users/675e2a5429e4411e976ea6433fc70a6c/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:28.614471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec3c92-5fcf-4b51-b661-99e6db853c63 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:28.614471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec3c92-5fcf-4b51-b661-99e6db853c63 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:28.614471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec3c92-5fcf-4b51-b661-99e6db853c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:28.646188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:28.681966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f6ec3c92-5fcf-4b51-b661-99e6db853c63 None None] MFA Rules not processed for user `675e2a5429e4411e976ea6433fc70a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:28.684436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f6ec3c92-5fcf-4b51-b661-99e6db853c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:29.004257 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2923/5838] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:29.016394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db0ac8-7792-4465-85a2-437a0f75b708 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:29.020093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-19db0ac8-7792-4465-85a2-437a0f75b708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:29.178431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:29.191192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db0ac8-7792-4465-85a2-437a0f75b708 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:29.209333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae0af5-b0ef-4728-aa3c-c70003372d27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:29.210958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0af5-b0ef-4728-aa3c-c70003372d27 service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:29.210958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0af5-b0ef-4728-aa3c-c70003372d27 service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:29.210958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0af5-b0ef-4728-aa3c-c70003372d27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:29.237323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae0af5-b0ef-4728-aa3c-c70003372d27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:29.241525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae0af5-b0ef-4728-aa3c-c70003372d27 service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:29.266198 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2916/5839] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:38.971034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=28 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:39.123018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec3c92-5fcf-4b51-b661-99e6db853c63 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:39.124558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f6ec3c92-5fcf-4b51-b661-99e6db853c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:39.265347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:39.349154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec3c92-5fcf-4b51-b661-99e6db853c63 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:39.355400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489be91-9b34-4349-86d8-b3c958910ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:39.370405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489be91-9b34-4349-86d8-b3c958910ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:39.370782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489be91-9b34-4349-86d8-b3c958910ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:39.371127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489be91-9b34-4349-86d8-b3c958910ff1 admin admin] PATH_INFO: `/v3/users/e5bbef967a524d888007bb0fede478c9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:39.389419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489be91-9b34-4349-86d8-b3c958910ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5bbef967a524d888007bb0fede478c9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:39.397272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489be91-9b34-4349-86d8-b3c958910ff1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:39.518172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f489be91-9b34-4349-86d8-b3c958910ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5bbef967a524d888007bb0fede478c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:39.519155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f489be91-9b34-4349-86d8-b3c958910ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5bbef967a524d888007bb0fede478c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:39.546440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f489be91-9b34-4349-86d8-b3c958910ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5bbef967a524d888007bb0fede478c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:39.547458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f489be91-9b34-4349-86d8-b3c958910ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5bbef967a524d888007bb0fede478c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:39.558228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f489be91-9b34-4349-86d8-b3c958910ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5bbef967a524d888007bb0fede478c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:39.589592 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2924/5840] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:39 2022] DELETE /identity/v3/users/e5bbef967a524d888007bb0fede478c9 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:39.853814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae0af5-b0ef-4728-aa3c-c70003372d27 service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:39.874242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae0af5-b0ef-4728-aa3c-c70003372d27 service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:40.038421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:40.041141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:40.044544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:40.045853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] PATH_INFO: `/v3/projects/f9e9c8c3ae7e473083ac7aaf1758a8a6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:40.051987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e9c8c3ae7e473083ac7aaf1758a8a6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:40.066952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:40.123221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14445f8-c8ba-4c66-99f7-5379d1aa6f8e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:40.125106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14445f8-c8ba-4c66-99f7-5379d1aa6f8e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:40.125608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14445f8-c8ba-4c66-99f7-5379d1aa6f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:40.182434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e14445f8-c8ba-4c66-99f7-5379d1aa6f8e None None] MFA Rules not processed for user `a68002795ce541338b30129e6dbb0fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:40.185634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e14445f8-c8ba-4c66-99f7-5379d1aa6f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:40.265680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'request_id': 'req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:40.306159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'request_id': 'req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:40.332487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e9c8c3ae7e473083ac7aaf1758a8a6', 'request_id': 'req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:40.379761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] The token cache is being invalidate because project f9e9c8c3ae7e473083ac7aaf1758a8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:40.380072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:40.387367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d2adaf6-8cc2-4eca-9871-c5f47abfaa08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:40.393122 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2917/5841] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:39 2022] DELETE /identity/v3/projects/f9e9c8c3ae7e473083ac7aaf1758a8a6 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:40.409341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10c44-e739-456c-937f-0ce648454d8b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:40.411113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10c44-e739-456c-937f-0ce648454d8b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:40.411656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10c44-e739-456c-937f-0ce648454d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:40.420383 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2925/5842] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:40.481012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-94a10c44-e739-456c-937f-0ce648454d8b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:40.483280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-94a10c44-e739-456c-937f-0ce648454d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:40.677090 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2918/5843] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:40.685412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619a70-6b97-4a1b-acea-b88fefc9f0f4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:40.685698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619a70-6b97-4a1b-acea-b88fefc9f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:40.685981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619a70-6b97-4a1b-acea-b88fefc9f0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:40.750213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d8619a70-6b97-4a1b-acea-b88fefc9f0f4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:40.755201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d8619a70-6b97-4a1b-acea-b88fefc9f0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:40.782719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a10c44-e739-456c-937f-0ce648454d8b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:40.786293 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2926/5844] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:40.799386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a10c44-e739-456c-937f-0ce648454d8b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:40.814637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d28c7-e416-4153-a7f9-76ca0690894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:40.815486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d28c7-e416-4153-a7f9-76ca0690894c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:40.815862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d28c7-e416-4153-a7f9-76ca0690894c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:40.816459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d28c7-e416-4153-a7f9-76ca0690894c admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:40.817210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d28c7-e416-4153-a7f9-76ca0690894c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:40.818118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d28c7-e416-4153-a7f9-76ca0690894c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:40.820026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d28c7-e416-4153-a7f9-76ca0690894c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:40.836204 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2919/5845] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:40.840537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619a70-6b97-4a1b-acea-b88fefc9f0f4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:40.865416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619a70-6b97-4a1b-acea-b88fefc9f0f4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:40.889919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61578a8e-e63e-44d1-a374-fa42b2c6c223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:40.890279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578a8e-e63e-44d1-a374-fa42b2c6c223 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:40.890573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578a8e-e63e-44d1-a374-fa42b2c6c223 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:40.890866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578a8e-e63e-44d1-a374-fa42b2c6c223 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:40.891533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61578a8e-e63e-44d1-a374-fa42b2c6c223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:40.898293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61578a8e-e63e-44d1-a374-fa42b2c6c223 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:40.949783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:40.985448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d28c7-e416-4153-a7f9-76ca0690894c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:41.003147 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2927/5846] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:40 2022] POST /identity/v3/projects => generated 395 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:41.015091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d28c7-e416-4153-a7f9-76ca0690894c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:41.052659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:41.259251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781b365-3c95-4d89-afad-7bfc06f086e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:41.260714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781b365-3c95-4d89-afad-7bfc06f086e2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:41.263530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781b365-3c95-4d89-afad-7bfc06f086e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:41.263921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781b365-3c95-4d89-afad-7bfc06f086e2 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:41.264658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781b365-3c95-4d89-afad-7bfc06f086e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:41.267305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781b365-3c95-4d89-afad-7bfc06f086e2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:41.329137 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2920/5847] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:40 2022] POST /identity/v3/users => generated 298 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:41.332495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61578a8e-e63e-44d1-a374-fa42b2c6c223 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:41.347242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61578a8e-e63e-44d1-a374-fa42b2c6c223 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:41.381101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a9b99-658d-4a1c-b916-5cce50052680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:41.381963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a9b99-658d-4a1c-b916-5cce50052680 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:41.382260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a9b99-658d-4a1c-b916-5cce50052680 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:41.383973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a9b99-658d-4a1c-b916-5cce50052680 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:41.383973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a9b99-658d-4a1c-b916-5cce50052680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:41.388958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a9b99-658d-4a1c-b916-5cce50052680 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:41.415384 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2928/5848] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:41.420876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781b365-3c95-4d89-afad-7bfc06f086e2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:41.437176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781b365-3c95-4d89-afad-7bfc06f086e2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:41.444252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe331a3-5cf3-4d75-9cd0-4fbca6e11eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:41.444895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe331a3-5cf3-4d75-9cd0-4fbca6e11eed admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:41.445185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe331a3-5cf3-4d75-9cd0-4fbca6e11eed admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:41.445666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe331a3-5cf3-4d75-9cd0-4fbca6e11eed admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:41.446379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe331a3-5cf3-4d75-9cd0-4fbca6e11eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:41.448119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe331a3-5cf3-4d75-9cd0-4fbca6e11eed admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:41.474920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a9b99-658d-4a1c-b916-5cce50052680 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:41.485788 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2921/5849] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:41.490197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a9b99-658d-4a1c-b916-5cce50052680 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:41.505254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3588-679c-44be-867f-badeea448518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:41.510725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3588-679c-44be-867f-badeea448518 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:41.511123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3588-679c-44be-867f-badeea448518 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:41.512292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3588-679c-44be-867f-badeea448518 admin admin] PATH_INFO: `/v3/projects/11a5a735158847d7904ccd9d22d46402/users/27efc2ddfa5243fea19c5b059350ebd3/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:41.539425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a3588-679c-44be-867f-badeea448518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a5a735158847d7904ccd9d22d46402, user_id=27efc2ddfa5243fea19c5b059350ebd3, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:41.543498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a3588-679c-44be-867f-badeea448518 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:41.567235 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2929/5850] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:41 2022] PUT /identity/v3/projects/11a5a735158847d7904ccd9d22d46402/users/27efc2ddfa5243fea19c5b059350ebd3/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:41.580287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025704ad-7f91-4e91-9f34-3b87a8149d4c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:41.580595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025704ad-7f91-4e91-9f34-3b87a8149d4c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:41.580951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025704ad-7f91-4e91-9f34-3b87a8149d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:41.615095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-025704ad-7f91-4e91-9f34-3b87a8149d4c None None] MFA Rules not processed for user `27efc2ddfa5243fea19c5b059350ebd3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:41.616769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-025704ad-7f91-4e91-9f34-3b87a8149d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:41.720970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9b3d7-bac8-40a3-b79a-1dc7d4648437 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:41.721770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9b3d7-bac8-40a3-b79a-1dc7d4648437 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:41.722188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9b3d7-bac8-40a3-b79a-1dc7d4648437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:41.730215 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2922/5851] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:41.750268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e1c9b3d7-bac8-40a3-b79a-1dc7d4648437 None None] MFA Rules not processed for user `27efc2ddfa5243fea19c5b059350ebd3`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:41.760812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e1c9b3d7-bac8-40a3-b79a-1dc7d4648437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:41.778745 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2930/5852] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:41.940413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025704ad-7f91-4e91-9f34-3b87a8149d4c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:41.941941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-025704ad-7f91-4e91-9f34-3b87a8149d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:42.096959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025704ad-7f91-4e91-9f34-3b87a8149d4c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:42.104056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068fb2e-9d99-4dde-83a8-7f83c0d3cb6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:42.104902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068fb2e-9d99-4dde-83a8-7f83c0d3cb6d service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:42.105318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068fb2e-9d99-4dde-83a8-7f83c0d3cb6d service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:42.105837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068fb2e-9d99-4dde-83a8-7f83c0d3cb6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:42.128458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068fb2e-9d99-4dde-83a8-7f83c0d3cb6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:42.130561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068fb2e-9d99-4dde-83a8-7f83c0d3cb6d service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:42.146586 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2923/5853] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:42.182424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a12ed0-de12-484a-8437-5dfde4b1a3de None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:42.182905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a12ed0-de12-484a-8437-5dfde4b1a3de None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:42.183281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a12ed0-de12-484a-8437-5dfde4b1a3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:42.215073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-96a12ed0-de12-484a-8437-5dfde4b1a3de None None] MFA Rules not processed for user `27efc2ddfa5243fea19c5b059350ebd3`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:42.216866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-96a12ed0-de12-484a-8437-5dfde4b1a3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:42.261487 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2931/5854] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:42.323737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae071-25dc-4eda-904e-1b17f0ba2f10 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:42.324214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae071-25dc-4eda-904e-1b17f0ba2f10 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:42.324872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae071-25dc-4eda-904e-1b17f0ba2f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:42.445580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-199ae071-25dc-4eda-904e-1b17f0ba2f10 None None] MFA Rules not processed for user `27efc2ddfa5243fea19c5b059350ebd3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:42.447105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-199ae071-25dc-4eda-904e-1b17f0ba2f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:42.481161 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2924/5855] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:42.519479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14af84-51b3-4ce7-97d0-efceb21cb792 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:42.519978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14af84-51b3-4ce7-97d0-efceb21cb792 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:42.520342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14af84-51b3-4ce7-97d0-efceb21cb792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:42.576724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-db14af84-51b3-4ce7-97d0-efceb21cb792 None None] MFA Rules not processed for user `27efc2ddfa5243fea19c5b059350ebd3`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:42.579225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-db14af84-51b3-4ce7-97d0-efceb21cb792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:42.593848 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2932/5856] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:42.637664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace55e2a-87f7-46f7-85fb-a5035eafe139 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:42.638385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace55e2a-87f7-46f7-85fb-a5035eafe139 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:42.638893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace55e2a-87f7-46f7-85fb-a5035eafe139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:42.652717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:42.681887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ace55e2a-87f7-46f7-85fb-a5035eafe139 None None] MFA Rules not processed for user `27efc2ddfa5243fea19c5b059350ebd3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:42.685309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ace55e2a-87f7-46f7-85fb-a5035eafe139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:42.713630 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2925/5857] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:42.758226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14af84-51b3-4ce7-97d0-efceb21cb792 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:42.960386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14af84-51b3-4ce7-97d0-efceb21cb792 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:42.976145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:42.977718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:42.979190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:42.980240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] PATH_INFO: `/v3/users/27efc2ddfa5243fea19c5b059350ebd3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:42.984179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27efc2ddfa5243fea19c5b059350ebd3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:42.989825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:43.123339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27efc2ddfa5243fea19c5b059350ebd3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:43.130382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27efc2ddfa5243fea19c5b059350ebd3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:43.152794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27efc2ddfa5243fea19c5b059350ebd3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:43.153576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27efc2ddfa5243fea19c5b059350ebd3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:43.167515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27efc2ddfa5243fea19c5b059350ebd3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:43.190804 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2933/5858] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:42 2022] DELETE /identity/v3/users/27efc2ddfa5243fea19c5b059350ebd3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:43.195650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af092b9a-4a38-4265-b875-e0c3dd14b633 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:43.195931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af092b9a-4a38-4265-b875-e0c3dd14b633 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:43.196248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af092b9a-4a38-4265-b875-e0c3dd14b633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:43.278175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-af092b9a-4a38-4265-b875-e0c3dd14b633 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:43.285690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-af092b9a-4a38-4265-b875-e0c3dd14b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:43.488105 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2926/5859] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:43.509707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:43.511147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:43.560434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:43.635717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aadff-c442-48be-bd03-367274aeb2c7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:43.651159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271036d7-800f-4af4-b7ad-5cfcb7d56e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:43.652574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271036d7-800f-4af4-b7ad-5cfcb7d56e67 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:43.653051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271036d7-800f-4af4-b7ad-5cfcb7d56e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:43.653593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271036d7-800f-4af4-b7ad-5cfcb7d56e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:43.682697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271036d7-800f-4af4-b7ad-5cfcb7d56e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:43.684179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271036d7-800f-4af4-b7ad-5cfcb7d56e67 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:43.727786 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2934/5860] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:44.866686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af092b9a-4a38-4265-b875-e0c3dd14b633 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:44.868382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-af092b9a-4a38-4265-b875-e0c3dd14b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:44.911836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af092b9a-4a38-4265-b875-e0c3dd14b633 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:44.965245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:44.970153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:44.970447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:44.976129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] PATH_INFO: `/v3/projects/11a5a735158847d7904ccd9d22d46402` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:44.987477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a5a735158847d7904ccd9d22d46402)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:44.987617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:45.125031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a5a735158847d7904ccd9d22d46402', 'request_id': 'req-50e35f64-3625-4773-a36e-b120b0e0afd4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:45.148209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a5a735158847d7904ccd9d22d46402', 'request_id': 'req-50e35f64-3625-4773-a36e-b120b0e0afd4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:45.157838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a5a735158847d7904ccd9d22d46402', 'request_id': 'req-50e35f64-3625-4773-a36e-b120b0e0afd4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:45.181430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] The token cache is being invalidate because project 11a5a735158847d7904ccd9d22d46402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:45.182146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:45.183472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-50e35f64-3625-4773-a36e-b120b0e0afd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:45.200893 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2927/5861] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:44 2022] DELETE /identity/v3/projects/11a5a735158847d7904ccd9d22d46402 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:45.202586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005430-ba02-4bd1-acaa-6a0970a5b459 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:45.203391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005430-ba02-4bd1-acaa-6a0970a5b459 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:45.203827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005430-ba02-4bd1-acaa-6a0970a5b459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:45.263294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d1005430-ba02-4bd1-acaa-6a0970a5b459 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:45.264755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d1005430-ba02-4bd1-acaa-6a0970a5b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:45.413363 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2935/5862] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:45.427324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74637ba-cda4-49b4-9b7f-f0876a5eb914 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:45.428296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74637ba-cda4-49b4-9b7f-f0876a5eb914 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:45.428722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74637ba-cda4-49b4-9b7f-f0876a5eb914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:45.470571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c74637ba-cda4-49b4-9b7f-f0876a5eb914 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:45.472203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c74637ba-cda4-49b4-9b7f-f0876a5eb914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:45.491407 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2928/5863] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:45.496284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005430-ba02-4bd1-acaa-6a0970a5b459 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:45.514894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005430-ba02-4bd1-acaa-6a0970a5b459 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:45.540445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4d03e-052c-4bad-9aeb-5ae25b2fc9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:45.545884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4d03e-052c-4bad-9aeb-5ae25b2fc9dc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:45.549240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4d03e-052c-4bad-9aeb-5ae25b2fc9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:45.550522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4d03e-052c-4bad-9aeb-5ae25b2fc9dc admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:45.562438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4d03e-052c-4bad-9aeb-5ae25b2fc9dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:45.562806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4d03e-052c-4bad-9aeb-5ae25b2fc9dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:45.571156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4d03e-052c-4bad-9aeb-5ae25b2fc9dc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:45.631095 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2936/5864] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:50:45.637583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74637ba-cda4-49b4-9b7f-f0876a5eb914 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:45.674417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74637ba-cda4-49b4-9b7f-f0876a5eb914 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:45.680545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac19f-1d66-44b3-9df6-5c80fdcdc75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:45.681622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac19f-1d66-44b3-9df6-5c80fdcdc75c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:45.682027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac19f-1d66-44b3-9df6-5c80fdcdc75c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:45.682411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac19f-1d66-44b3-9df6-5c80fdcdc75c admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:45.683159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ac19f-1d66-44b3-9df6-5c80fdcdc75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:45.685262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ac19f-1d66-44b3-9df6-5c80fdcdc75c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:45.751182 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2929/5865] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:45 2022] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:45.755135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4d03e-052c-4bad-9aeb-5ae25b2fc9dc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:45.778024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4d03e-052c-4bad-9aeb-5ae25b2fc9dc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:45.960244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fb31c-fe83-4d35-859a-a90a79cce12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:45.960982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fb31c-fe83-4d35-859a-a90a79cce12c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:45.961141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fb31c-fe83-4d35-859a-a90a79cce12c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:45.961463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fb31c-fe83-4d35-859a-a90a79cce12c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:45.962074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fb31c-fe83-4d35-859a-a90a79cce12c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:45.964337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fb31c-fe83-4d35-859a-a90a79cce12c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:46.010116 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2937/5866] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:45 2022] POST /identity/v3/users => generated 300 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:46.014068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac19f-1d66-44b3-9df6-5c80fdcdc75c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:46.029240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac19f-1d66-44b3-9df6-5c80fdcdc75c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:46.046083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf164cb-0f2d-4a08-b13d-1c1d6baa194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:46.046722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf164cb-0f2d-4a08-b13d-1c1d6baa194b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:46.047002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf164cb-0f2d-4a08-b13d-1c1d6baa194b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:46.047279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf164cb-0f2d-4a08-b13d-1c1d6baa194b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:46.057701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf164cb-0f2d-4a08-b13d-1c1d6baa194b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:46.064335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf164cb-0f2d-4a08-b13d-1c1d6baa194b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:46.099922 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2930/5867] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:46.104095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fb31c-fe83-4d35-859a-a90a79cce12c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:46.121344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fb31c-fe83-4d35-859a-a90a79cce12c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:46.147016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72c7da-af54-479c-bbd8-c102214fbafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:46.147641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72c7da-af54-479c-bbd8-c102214fbafc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:46.147925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72c7da-af54-479c-bbd8-c102214fbafc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:46.148264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72c7da-af54-479c-bbd8-c102214fbafc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:46.148925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72c7da-af54-479c-bbd8-c102214fbafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:46.150649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72c7da-af54-479c-bbd8-c102214fbafc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:46.168007 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2938/5868] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:46.172810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf164cb-0f2d-4a08-b13d-1c1d6baa194b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:46.188394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf164cb-0f2d-4a08-b13d-1c1d6baa194b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:46.200395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4426bdd-6237-44c9-b040-c7bc93296155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:46.201152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4426bdd-6237-44c9-b040-c7bc93296155 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:46.201967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4426bdd-6237-44c9-b040-c7bc93296155 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:46.202266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4426bdd-6237-44c9-b040-c7bc93296155 admin admin] PATH_INFO: `/v3/projects/571cec2b4f7f48a0ac319b4f44319935/users/9b302183018f4d44b7cfbd8b1b6c1cc6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:46.254181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4426bdd-6237-44c9-b040-c7bc93296155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=571cec2b4f7f48a0ac319b4f44319935, user_id=9b302183018f4d44b7cfbd8b1b6c1cc6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:46.265837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4426bdd-6237-44c9-b040-c7bc93296155 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:46.309995 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2931/5869] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:46 2022] PUT /identity/v3/projects/571cec2b4f7f48a0ac319b4f44319935/users/9b302183018f4d44b7cfbd8b1b6c1cc6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:46.315311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f871-c38f-40e1-8d0e-eb0ef65736d5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:46.315751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f871-c38f-40e1-8d0e-eb0ef65736d5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:46.315840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f871-c38f-40e1-8d0e-eb0ef65736d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:46.378495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0f82f871-c38f-40e1-8d0e-eb0ef65736d5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:46.379766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0f82f871-c38f-40e1-8d0e-eb0ef65736d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:46.513018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:46.626321 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2939/5870] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:46.671128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4426bdd-6237-44c9-b040-c7bc93296155 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:46.673420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a4426bdd-6237-44c9-b040-c7bc93296155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:46.718746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:46.828028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4426bdd-6237-44c9-b040-c7bc93296155 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:46.848466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f20fc-a888-46ee-9471-66a51b1acb1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:46.848880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f20fc-a888-46ee-9471-66a51b1acb1f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:46.849277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f20fc-a888-46ee-9471-66a51b1acb1f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:46.849696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f20fc-a888-46ee-9471-66a51b1acb1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:46.895451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f20fc-a888-46ee-9471-66a51b1acb1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:46.897176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f20fc-a888-46ee-9471-66a51b1acb1f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:46.943701 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2932/5871] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:54.438197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f871-c38f-40e1-8d0e-eb0ef65736d5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:54.441239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0f82f871-c38f-40e1-8d0e-eb0ef65736d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:54.457361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f871-c38f-40e1-8d0e-eb0ef65736d5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:54.466139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:54.467459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:54.467975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:54.468760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] PATH_INFO: `/v3/users/0a2b13f770e54d888d61a25a55615e9c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:54.470436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2b13f770e54d888d61a25a55615e9c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:54.472870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:54.544773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2b13f770e54d888d61a25a55615e9c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:54.545905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2b13f770e54d888d61a25a55615e9c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:54.565640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2b13f770e54d888d61a25a55615e9c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:54.566801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2b13f770e54d888d61a25a55615e9c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:54.579976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2b13f770e54d888d61a25a55615e9c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:54.601672 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2940/5872] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:50:54 2022] DELETE /identity/v3/users/0a2b13f770e54d888d61a25a55615e9c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:54.606426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4a534-63f6-4fd1-a0a1-ea0f0c328fde None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:54.606974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4a534-63f6-4fd1-a0a1-ea0f0c328fde None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:54.607286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4a534-63f6-4fd1-a0a1-ea0f0c328fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:54.665730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-55b4a534-63f6-4fd1-a0a1-ea0f0c328fde None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:54.668164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-55b4a534-63f6-4fd1-a0a1-ea0f0c328fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:54.783350 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2933/5873] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:50:54.814350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:54.816895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:55.018367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fedf94-e17f-4dc6-aa02-60fef7fa3e2c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:55.034355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee11b7-8080-4fe0-9f35-b4660bb6b96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:55.034992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee11b7-8080-4fe0-9f35-b4660bb6b96b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:55.037245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee11b7-8080-4fe0-9f35-b4660bb6b96b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:55.037590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee11b7-8080-4fe0-9f35-b4660bb6b96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:55.093163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee11b7-8080-4fe0-9f35-b4660bb6b96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:55.099910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee11b7-8080-4fe0-9f35-b4660bb6b96b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:55.128931 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2941/5874] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:50:56.900506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4a534-63f6-4fd1-a0a1-ea0f0c328fde None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:56.902276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-55b4a534-63f6-4fd1-a0a1-ea0f0c328fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:56.927813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4a534-63f6-4fd1-a0a1-ea0f0c328fde None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:56.955256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:56.956093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:56.956645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:56.957032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] PATH_INFO: `/v3/projects/c4ebdb2c3c634900aebd9afb156974b6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:56.962278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ebdb2c3c634900aebd9afb156974b6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:56.968122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:57.132508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ebdb2c3c634900aebd9afb156974b6', 'request_id': 'req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:57.145323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ebdb2c3c634900aebd9afb156974b6', 'request_id': 'req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:57.177858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ebdb2c3c634900aebd9afb156974b6', 'request_id': 'req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:57.218663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] The token cache is being invalidate because project c4ebdb2c3c634900aebd9afb156974b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:50:57.219142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:57.220395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34a2d7ed-0291-48fb-8f1a-1285d88b8fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:50:57.222990 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2934/5875] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:50:56 2022] DELETE /identity/v3/projects/c4ebdb2c3c634900aebd9afb156974b6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:57.227915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15479df-4e5a-46fb-9bbe-7c75f612b88b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.228478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15479df-4e5a-46fb-9bbe-7c75f612b88b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.228478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15479df-4e5a-46fb-9bbe-7c75f612b88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.299341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b15479df-4e5a-46fb-9bbe-7c75f612b88b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:57.300898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b15479df-4e5a-46fb-9bbe-7c75f612b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:57.426739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:57.488632 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2942/5876] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:57.489815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81927cf9-5652-422e-9e05-ca443949f837 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.490107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81927cf9-5652-422e-9e05-ca443949f837 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.490389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81927cf9-5652-422e-9e05-ca443949f837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.547052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-81927cf9-5652-422e-9e05-ca443949f837 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:57.550530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-81927cf9-5652-422e-9e05-ca443949f837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:57.574982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15479df-4e5a-46fb-9bbe-7c75f612b88b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:57.590695 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2935/5877] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:57.592004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15479df-4e5a-46fb-9bbe-7c75f612b88b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:57.603947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef171-8826-4ca4-b75f-d5cdfa1051ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:57.604661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef171-8826-4ca4-b75f-d5cdfa1051ed admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.604853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef171-8826-4ca4-b75f-d5cdfa1051ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.605134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef171-8826-4ca4-b75f-d5cdfa1051ed admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.607781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ef171-8826-4ca4-b75f-d5cdfa1051ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:50:57.608496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ef171-8826-4ca4-b75f-d5cdfa1051ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:57.613444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ef171-8826-4ca4-b75f-d5cdfa1051ed admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:57.650202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81927cf9-5652-422e-9e05-ca443949f837 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:57.654788 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2943/5878] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:50:57.666056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81927cf9-5652-422e-9e05-ca443949f837 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:57.679273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676c1a4-88ce-4ae2-a84f-c30f401a0f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:57.680067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676c1a4-88ce-4ae2-a84f-c30f401a0f6f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.680356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676c1a4-88ce-4ae2-a84f-c30f401a0f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.680638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676c1a4-88ce-4ae2-a84f-c30f401a0f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.681295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676c1a4-88ce-4ae2-a84f-c30f401a0f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:57.683290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676c1a4-88ce-4ae2-a84f-c30f401a0f6f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:57.751146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef171-8826-4ca4-b75f-d5cdfa1051ed admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:57.752072 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2936/5879] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:50:57 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:57.774713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef171-8826-4ca4-b75f-d5cdfa1051ed admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:57.938707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e9f42-5c0c-4091-b540-b4a318db65f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:57.939789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e9f42-5c0c-4091-b540-b4a318db65f4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:57.942700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e9f42-5c0c-4091-b540-b4a318db65f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:57.943186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e9f42-5c0c-4091-b540-b4a318db65f4 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:57.944106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e9f42-5c0c-4091-b540-b4a318db65f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:57.947144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e9f42-5c0c-4091-b540-b4a318db65f4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:57.980449 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2944/5880] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:50:57 2022] POST /identity/v3/users => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:50:57.984259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676c1a4-88ce-4ae2-a84f-c30f401a0f6f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:58.015305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676c1a4-88ce-4ae2-a84f-c30f401a0f6f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:58.040440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce12ccc-402b-4110-9576-36e4edfea5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:58.041380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12ccc-402b-4110-9576-36e4edfea5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:58.043513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12ccc-402b-4110-9576-36e4edfea5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:58.044329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12ccc-402b-4110-9576-36e4edfea5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:58.047727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce12ccc-402b-4110-9576-36e4edfea5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:58.103656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce12ccc-402b-4110-9576-36e4edfea5b6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:58.137149 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2937/5881] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:58.137748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e9f42-5c0c-4091-b540-b4a318db65f4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:58.163964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e9f42-5c0c-4091-b540-b4a318db65f4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:58.183232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ee027-75cb-40ff-a457-83b7a7ac83ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:58.188036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ee027-75cb-40ff-a457-83b7a7ac83ea admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:58.191032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ee027-75cb-40ff-a457-83b7a7ac83ea admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:58.191330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ee027-75cb-40ff-a457-83b7a7ac83ea admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:58.192067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ee027-75cb-40ff-a457-83b7a7ac83ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:58.214165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ee027-75cb-40ff-a457-83b7a7ac83ea admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:58.299408 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2945/5882] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:50:58.301763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce12ccc-402b-4110-9576-36e4edfea5b6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:58.309901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:58.319464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce12ccc-402b-4110-9576-36e4edfea5b6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:58.342451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2b744-f48a-4513-8b33-e611c3c68ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:58.348388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2b744-f48a-4513-8b33-e611c3c68ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:58.349598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2b744-f48a-4513-8b33-e611c3c68ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:58.351796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2b744-f48a-4513-8b33-e611c3c68ea4 admin admin] PATH_INFO: `/v3/projects/498da6929a874ba9821828caa3743d2a/users/0eaa7f83c41e418d9687c2ae7e9199d5/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:58.440032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2b744-f48a-4513-8b33-e611c3c68ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498da6929a874ba9821828caa3743d2a, user_id=0eaa7f83c41e418d9687c2ae7e9199d5, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:58.467275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2b744-f48a-4513-8b33-e611c3c68ea4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:58.516087 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2938/5883] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:50:58 2022] PUT /identity/v3/projects/498da6929a874ba9821828caa3743d2a/users/0eaa7f83c41e418d9687c2ae7e9199d5/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:50:58.525929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879207d-5ae0-48fb-83aa-cd7d966e1f1d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:58.526221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879207d-5ae0-48fb-83aa-cd7d966e1f1d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:58.526501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879207d-5ae0-48fb-83aa-cd7d966e1f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:58.621344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8879207d-5ae0-48fb-83aa-cd7d966e1f1d None None] MFA Rules not processed for user `0eaa7f83c41e418d9687c2ae7e9199d5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:50:58.629106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8879207d-5ae0-48fb-83aa-cd7d966e1f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:58.975322 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2946/5884] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:50:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:50:59.041956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2b744-f48a-4513-8b33-e611c3c68ea4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:50:59.043851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-02d2b744-f48a-4513-8b33-e611c3c68ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:50:59.280870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2b744-f48a-4513-8b33-e611c3c68ea4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:50:59.298466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e2dae-4079-4c97-aa36-f0ee0689e980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:50:59.299309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e2dae-4079-4c97-aa36-f0ee0689e980 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:50:59.299760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e2dae-4079-4c97-aa36-f0ee0689e980 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:50:59.300219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e2dae-4079-4c97-aa36-f0ee0689e980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:50:59.324920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e2dae-4079-4c97-aa36-f0ee0689e980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:50:59.326670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e2dae-4079-4c97-aa36-f0ee0689e980 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:50:59.361029 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2939/5885] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:50:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:00.474367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879207d-5ae0-48fb-83aa-cd7d966e1f1d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:00.476355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8879207d-5ae0-48fb-83aa-cd7d966e1f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:00.623949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:00.687448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879207d-5ae0-48fb-83aa-cd7d966e1f1d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:00.724446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36729d1e-1782-4384-be6d-5da527b77ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:00.725413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36729d1e-1782-4384-be6d-5da527b77ddc service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:00.725899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36729d1e-1782-4384-be6d-5da527b77ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:00.726351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36729d1e-1782-4384-be6d-5da527b77ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:00.731953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-36729d1e-1782-4384-be6d-5da527b77ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:00.979189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e2dae-4079-4c97-aa36-f0ee0689e980 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:00.982236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b67e2dae-4079-4c97-aa36-f0ee0689e980 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:01.012283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e2dae-4079-4c97-aa36-f0ee0689e980 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:01.036612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39365f9-ddc9-4d41-b013-eb9dbc0f3cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:01.043945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39365f9-ddc9-4d41-b013-eb9dbc0f3cfe service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:01.045644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39365f9-ddc9-4d41-b013-eb9dbc0f3cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:01.046299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39365f9-ddc9-4d41-b013-eb9dbc0f3cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:01.065273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f39365f9-ddc9-4d41-b013-eb9dbc0f3cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:01.072951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36729d1e-1782-4384-be6d-5da527b77ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:01.080943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36729d1e-1782-4384-be6d-5da527b77ddc service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:01.123504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39365f9-ddc9-4d41-b013-eb9dbc0f3cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:01.125304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39365f9-ddc9-4d41-b013-eb9dbc0f3cfe service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:01.137004 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2947/5886] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:01.200696 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2940/5887] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:51:10.683275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256dd3-e144-4253-b50e-75dd4c7d03e6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:10.683904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256dd3-e144-4253-b50e-75dd4c7d03e6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:10.684142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256dd3-e144-4253-b50e-75dd4c7d03e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:10.727090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-33256dd3-e144-4253-b50e-75dd4c7d03e6 None None] MFA Rules not processed for user `a68002795ce541338b30129e6dbb0fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:10.732558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-33256dd3-e144-4253-b50e-75dd4c7d03e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:10.892717 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2948/5888] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:51:11.110939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39365f9-ddc9-4d41-b013-eb9dbc0f3cfe service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:11.289607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39365f9-ddc9-4d41-b013-eb9dbc0f3cfe service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:11.301923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:11.304190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:11.304836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:11.306409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] PATH_INFO: `/v3/users/0eaa7f83c41e418d9687c2ae7e9199d5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:11.311140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eaa7f83c41e418d9687c2ae7e9199d5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:11.316695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:11.439830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaa7f83c41e418d9687c2ae7e9199d5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:11.444399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaa7f83c41e418d9687c2ae7e9199d5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:11.485007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaa7f83c41e418d9687c2ae7e9199d5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:11.517249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaa7f83c41e418d9687c2ae7e9199d5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:11.519673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:11.552955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaa7f83c41e418d9687c2ae7e9199d5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:11.571742 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2941/5889] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:11 2022] DELETE /identity/v3/users/0eaa7f83c41e418d9687c2ae7e9199d5 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:11.572523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71b1c4-3e3d-4fe9-a8f4-037f0947e40d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:11.572826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71b1c4-3e3d-4fe9-a8f4-037f0947e40d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:11.573118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71b1c4-3e3d-4fe9-a8f4-037f0947e40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:11.623075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1d71b1c4-3e3d-4fe9-a8f4-037f0947e40d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:11.629376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1d71b1c4-3e3d-4fe9-a8f4-037f0947e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:11.850651 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2949/5890] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:51:12.058489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:12.060213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:12.184453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734b6c2-f506-49d5-ad03-45e532066681 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:12.198754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5451df7-377c-47ff-a74d-761ca0938df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:12.199717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5451df7-377c-47ff-a74d-761ca0938df6 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:12.200144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5451df7-377c-47ff-a74d-761ca0938df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:12.200569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5451df7-377c-47ff-a74d-761ca0938df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:12.240675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5451df7-377c-47ff-a74d-761ca0938df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:12.242623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5451df7-377c-47ff-a74d-761ca0938df6 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:12.267583 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2942/5891] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:13.146079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4b939-ac16-460d-beb1-30d2cd2309d4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:13.146716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4b939-ac16-460d-beb1-30d2cd2309d4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:13.147033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4b939-ac16-460d-beb1-30d2cd2309d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:13.228623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a7d4b939-ac16-460d-beb1-30d2cd2309d4 None None] MFA Rules not processed for user `9b302183018f4d44b7cfbd8b1b6c1cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:13.233210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a7d4b939-ac16-460d-beb1-30d2cd2309d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:13.277596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:13.430734 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2950/5892] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:13 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:13.436642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647297a-5650-4821-b50b-677312e2800d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:13.439324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647297a-5650-4821-b50b-677312e2800d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:13.439972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647297a-5650-4821-b50b-677312e2800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:13.494653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4647297a-5650-4821-b50b-677312e2800d None None] MFA Rules not processed for user `9b302183018f4d44b7cfbd8b1b6c1cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:13.496346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4647297a-5650-4821-b50b-677312e2800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:13.517282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4b939-ac16-460d-beb1-30d2cd2309d4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:13.519716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a7d4b939-ac16-460d-beb1-30d2cd2309d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:13.528459 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2943/5893] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:13 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:51:13.677741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4b939-ac16-460d-beb1-30d2cd2309d4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:13.691387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55089885-d036-44de-aa85-8f74c3a29e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:13.694629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089885-d036-44de-aa85-8f74c3a29e89 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:13.695138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089885-d036-44de-aa85-8f74c3a29e89 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:13.698283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089885-d036-44de-aa85-8f74c3a29e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:13.717274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55089885-d036-44de-aa85-8f74c3a29e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:13.719788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55089885-d036-44de-aa85-8f74c3a29e89 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:13.743155 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2951/5894] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:51:14.159450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd507bc-d2fc-462b-ad8d-93cb7e171b2a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:14.160228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd507bc-d2fc-462b-ad8d-93cb7e171b2a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:14.160707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd507bc-d2fc-462b-ad8d-93cb7e171b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:14.223441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1bd507bc-d2fc-462b-ad8d-93cb7e171b2a None None] MFA Rules not processed for user `dc8f7bc05b984ea0a3d96aea8a65d139`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:14.226082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1bd507bc-d2fc-462b-ad8d-93cb7e171b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:14.460346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55089885-d036-44de-aa85-8f74c3a29e89 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:14.461977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-55089885-d036-44de-aa85-8f74c3a29e89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:14.474941 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2944/5895] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:14.506818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55089885-d036-44de-aa85-8f74c3a29e89 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:14.534558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:14.535263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:14.535511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:14.535790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] PATH_INFO: `/v3/projects/498da6929a874ba9821828caa3743d2a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:14.539468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] RBAC: Authorizing `identity:delete_project(project_id=498da6929a874ba9821828caa3743d2a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:14.541587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:14.754066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498da6929a874ba9821828caa3743d2a', 'request_id': 'req-605408df-c0a1-48ac-9fb0-db8d440612da'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:14.786480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498da6929a874ba9821828caa3743d2a', 'request_id': 'req-605408df-c0a1-48ac-9fb0-db8d440612da'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:14.807763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498da6929a874ba9821828caa3743d2a', 'request_id': 'req-605408df-c0a1-48ac-9fb0-db8d440612da'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:14.828747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] The token cache is being invalidate because project 498da6929a874ba9821828caa3743d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:14.828978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:14.833963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-605408df-c0a1-48ac-9fb0-db8d440612da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:14.845873 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2952/5896] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:14 2022] DELETE /identity/v3/projects/498da6929a874ba9821828caa3743d2a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:51:14.849879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ff278-b40b-44a2-a53f-fa618f8268f4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:14.850421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ff278-b40b-44a2-a53f-fa618f8268f4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:14.850862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ff278-b40b-44a2-a53f-fa618f8268f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:14.900377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-542ff278-b40b-44a2-a53f-fa618f8268f4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:14.905333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-542ff278-b40b-44a2-a53f-fa618f8268f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:15.191630 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2945/5897] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:15.201268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fb17c-87ff-4840-b27c-8c04b3ca9b43 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:15.201739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fb17c-87ff-4840-b27c-8c04b3ca9b43 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:15.202204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fb17c-87ff-4840-b27c-8c04b3ca9b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:15.246298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e77fb17c-87ff-4840-b27c-8c04b3ca9b43 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:15.247739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e77fb17c-87ff-4840-b27c-8c04b3ca9b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:15.275214 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2953/5898] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:15.279766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ff278-b40b-44a2-a53f-fa618f8268f4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:15.332809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ff278-b40b-44a2-a53f-fa618f8268f4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:15.353562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737fdc8-41f4-4a23-8e43-82ed97351da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:15.354202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737fdc8-41f4-4a23-8e43-82ed97351da9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:15.354492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737fdc8-41f4-4a23-8e43-82ed97351da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:15.354793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737fdc8-41f4-4a23-8e43-82ed97351da9 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:15.355643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737fdc8-41f4-4a23-8e43-82ed97351da9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:51:15.355990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737fdc8-41f4-4a23-8e43-82ed97351da9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:15.359154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737fdc8-41f4-4a23-8e43-82ed97351da9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:15.395649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fb17c-87ff-4840-b27c-8c04b3ca9b43 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:15.402274 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2946/5899] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:15.410738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fb17c-87ff-4840-b27c-8c04b3ca9b43 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:15.422645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c447267-f220-4aae-b695-f6a86f58e2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:15.423343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c447267-f220-4aae-b695-f6a86f58e2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:15.423529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c447267-f220-4aae-b695-f6a86f58e2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:15.423807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c447267-f220-4aae-b695-f6a86f58e2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:15.424751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c447267-f220-4aae-b695-f6a86f58e2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:15.426718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c447267-f220-4aae-b695-f6a86f58e2f1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:15.461215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:15.486400 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2954/5900] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:15 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:15.490286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737fdc8-41f4-4a23-8e43-82ed97351da9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:15.515239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737fdc8-41f4-4a23-8e43-82ed97351da9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:15.522828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:15.801280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d32eb-f772-482f-a8d0-63e588324f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:15.802473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d32eb-f772-482f-a8d0-63e588324f29 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:15.802993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d32eb-f772-482f-a8d0-63e588324f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:15.804031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d32eb-f772-482f-a8d0-63e588324f29 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:15.805650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d32eb-f772-482f-a8d0-63e588324f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:15.813568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d32eb-f772-482f-a8d0-63e588324f29 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:15.881510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2947/5901] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:15 2022] POST /identity/v3/users => generated 288 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:51:15.882419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c447267-f220-4aae-b695-f6a86f58e2f1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:15.895559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c447267-f220-4aae-b695-f6a86f58e2f1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:15.933448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b22eb-fd91-4ea8-afe0-caae69a40310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:15.934089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b22eb-fd91-4ea8-afe0-caae69a40310 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:15.941604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b22eb-fd91-4ea8-afe0-caae69a40310 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:15.941938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b22eb-fd91-4ea8-afe0-caae69a40310 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:15.942645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b22eb-fd91-4ea8-afe0-caae69a40310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:15.950408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b22eb-fd91-4ea8-afe0-caae69a40310 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:15.989107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d32eb-f772-482f-a8d0-63e588324f29 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:15.999536 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2955/5902] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:51:16.005805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d32eb-f772-482f-a8d0-63e588324f29 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:16.020366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba0b55-8081-403d-85f3-0f80f73687eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:16.021188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba0b55-8081-403d-85f3-0f80f73687eb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:16.022795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba0b55-8081-403d-85f3-0f80f73687eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:16.023264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba0b55-8081-403d-85f3-0f80f73687eb admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:16.024657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba0b55-8081-403d-85f3-0f80f73687eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:16.026854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba0b55-8081-403d-85f3-0f80f73687eb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:16.118489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b22eb-fd91-4ea8-afe0-caae69a40310 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:16.144241 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2948/5903] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:16.146091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b22eb-fd91-4ea8-afe0-caae69a40310 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:16.171263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d50d0-61c3-4d70-a12a-23339d2e7e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:16.171971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d50d0-61c3-4d70-a12a-23339d2e7e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:16.172311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d50d0-61c3-4d70-a12a-23339d2e7e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:16.173129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d50d0-61c3-4d70-a12a-23339d2e7e17 admin admin] PATH_INFO: `/v3/projects/804640be3d914beb89aef4ae1e87e919/users/666f75dceef04987bb1cc38590a8d607/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:16.230292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d50d0-61c3-4d70-a12a-23339d2e7e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=804640be3d914beb89aef4ae1e87e919, user_id=666f75dceef04987bb1cc38590a8d607, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:16.244910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d50d0-61c3-4d70-a12a-23339d2e7e17 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:16.301465 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2956/5904] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:16 2022] PUT /identity/v3/projects/804640be3d914beb89aef4ae1e87e919/users/666f75dceef04987bb1cc38590a8d607/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:16.312217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f71edd-da21-4458-9cf6-8d99bfc99fc7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:16.312563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f71edd-da21-4458-9cf6-8d99bfc99fc7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:16.312755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f71edd-da21-4458-9cf6-8d99bfc99fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:16.416569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b7f71edd-da21-4458-9cf6-8d99bfc99fc7 None None] MFA Rules not processed for user `666f75dceef04987bb1cc38590a8d607`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:16.417921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b7f71edd-da21-4458-9cf6-8d99bfc99fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:16.652814 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2949/5905] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:16.664439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d50d0-61c3-4d70-a12a-23339d2e7e17 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:16.667066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-603d50d0-61c3-4d70-a12a-23339d2e7e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:16.844223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d50d0-61c3-4d70-a12a-23339d2e7e17 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:16.860758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7a14e-6085-4455-a851-838b0d9014ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:16.863006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7a14e-6085-4455-a851-838b0d9014ee service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:16.864272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7a14e-6085-4455-a851-838b0d9014ee service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:16.864820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7a14e-6085-4455-a851-838b0d9014ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:16.897721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7a14e-6085-4455-a851-838b0d9014ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:16.900137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7a14e-6085-4455-a851-838b0d9014ee service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:16.959997 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2957/5906] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:51:21.378597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f71edd-da21-4458-9cf6-8d99bfc99fc7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:21.382112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b7f71edd-da21-4458-9cf6-8d99bfc99fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:21.631670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f71edd-da21-4458-9cf6-8d99bfc99fc7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:21.641461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:21.642370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:21.642843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:21.643293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] PATH_INFO: `/v3/users/675e2a5429e4411e976ea6433fc70a6c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:21.644703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=675e2a5429e4411e976ea6433fc70a6c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:21.647432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:21.702995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:21.781320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675e2a5429e4411e976ea6433fc70a6c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:21.782657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675e2a5429e4411e976ea6433fc70a6c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:21.812515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675e2a5429e4411e976ea6433fc70a6c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:21.831685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675e2a5429e4411e976ea6433fc70a6c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:21.842217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675e2a5429e4411e976ea6433fc70a6c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:21.860895 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2950/5907] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:21 2022] DELETE /identity/v3/users/675e2a5429e4411e976ea6433fc70a6c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:21.865643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf66f6-1fec-42fc-88b5-216c913a9e50 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:21.866231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf66f6-1fec-42fc-88b5-216c913a9e50 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:21.866540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf66f6-1fec-42fc-88b5-216c913a9e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:21.927373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-adaf66f6-1fec-42fc-88b5-216c913a9e50 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:21.929340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-adaf66f6-1fec-42fc-88b5-216c913a9e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:22.109858 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2958/5908] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:22.177740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:22.179266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:22.393340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc239d-f9f1-4441-b3a9-ccd04cec7d3a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:22.406606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e861404-eb9f-4185-98eb-daed17a2a7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:22.411555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861404-eb9f-4185-98eb-daed17a2a7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:22.412084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861404-eb9f-4185-98eb-daed17a2a7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:22.412797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861404-eb9f-4185-98eb-daed17a2a7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:22.450311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861404-eb9f-4185-98eb-daed17a2a7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:22.459706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861404-eb9f-4185-98eb-daed17a2a7a6 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:22.486377 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2951/5909] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:24.953097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf66f6-1fec-42fc-88b5-216c913a9e50 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:24.955140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-adaf66f6-1fec-42fc-88b5-216c913a9e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:24.990358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf66f6-1fec-42fc-88b5-216c913a9e50 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:25.012852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:25.013534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:25.013837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:25.014099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] PATH_INFO: `/v3/projects/a5215cf1f5fd46cc81acf784ebf077f5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:25.022266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5215cf1f5fd46cc81acf784ebf077f5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:25.024436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:25.161475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5215cf1f5fd46cc81acf784ebf077f5', 'request_id': 'req-e8129ef0-131a-4834-a07a-bb8d124a7d87'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:25.168520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5215cf1f5fd46cc81acf784ebf077f5', 'request_id': 'req-e8129ef0-131a-4834-a07a-bb8d124a7d87'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:25.184301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:25.192238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5215cf1f5fd46cc81acf784ebf077f5', 'request_id': 'req-e8129ef0-131a-4834-a07a-bb8d124a7d87'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:25.220722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] The token cache is being invalidate because project a5215cf1f5fd46cc81acf784ebf077f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:25.221201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:25.222082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8129ef0-131a-4834-a07a-bb8d124a7d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:25.241489 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2959/5910] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:24 2022] DELETE /identity/v3/projects/a5215cf1f5fd46cc81acf784ebf077f5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:25.243024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02350f5-d462-41dd-ac0f-6dcc2fe6c939 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:25.243876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02350f5-d462-41dd-ac0f-6dcc2fe6c939 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:25.244326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02350f5-d462-41dd-ac0f-6dcc2fe6c939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:25.303621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a02350f5-d462-41dd-ac0f-6dcc2fe6c939 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:25.305920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a02350f5-d462-41dd-ac0f-6dcc2fe6c939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:25.451800 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2952/5911] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:25.461573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea60ab-e83f-480d-b9b5-ece81337046c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:25.461862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea60ab-e83f-480d-b9b5-ece81337046c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:25.461987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea60ab-e83f-480d-b9b5-ece81337046c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:25.486604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a3ea60ab-e83f-480d-b9b5-ece81337046c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:25.489403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a3ea60ab-e83f-480d-b9b5-ece81337046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:25.504729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02350f5-d462-41dd-ac0f-6dcc2fe6c939 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:25.512583 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2960/5912] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:25.517653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02350f5-d462-41dd-ac0f-6dcc2fe6c939 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:25.522802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe3b26-cabd-40e7-9b5f-e7bc862b161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:25.523884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe3b26-cabd-40e7-9b5f-e7bc862b161a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:25.524337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe3b26-cabd-40e7-9b5f-e7bc862b161a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:25.525055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe3b26-cabd-40e7-9b5f-e7bc862b161a admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:25.525924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe3b26-cabd-40e7-9b5f-e7bc862b161a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:51:25.526406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe3b26-cabd-40e7-9b5f-e7bc862b161a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:25.528368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe3b26-cabd-40e7-9b5f-e7bc862b161a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:25.556246 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2953/5913] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:25.560824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea60ab-e83f-480d-b9b5-ece81337046c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:25.573287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea60ab-e83f-480d-b9b5-ece81337046c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:25.583697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3317d1-3d3c-45d8-a581-e56aef81d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:25.587446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3317d1-3d3c-45d8-a581-e56aef81d0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:25.587951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3317d1-3d3c-45d8-a581-e56aef81d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:25.588424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3317d1-3d3c-45d8-a581-e56aef81d0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:25.590039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3317d1-3d3c-45d8-a581-e56aef81d0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:25.592366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3317d1-3d3c-45d8-a581-e56aef81d0f1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:25.633099 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2961/5914] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:25 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:25.636923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe3b26-cabd-40e7-9b5f-e7bc862b161a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:25.650531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe3b26-cabd-40e7-9b5f-e7bc862b161a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:25.689184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:25.773154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521ce6-6249-46fe-800d-50636e1ad77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:25.774450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521ce6-6249-46fe-800d-50636e1ad77e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:25.775001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521ce6-6249-46fe-800d-50636e1ad77e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:25.775880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521ce6-6249-46fe-800d-50636e1ad77e admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:25.776564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78521ce6-6249-46fe-800d-50636e1ad77e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:25.781101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78521ce6-6249-46fe-800d-50636e1ad77e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:25.839011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3317d1-3d3c-45d8-a581-e56aef81d0f1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:25.841820 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2954/5915] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:25 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:25.854875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3317d1-3d3c-45d8-a581-e56aef81d0f1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:25.870107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e71e5-85df-456a-abc6-c0e2a8cfb0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:25.870872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e71e5-85df-456a-abc6-c0e2a8cfb0ba admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:25.871569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e71e5-85df-456a-abc6-c0e2a8cfb0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:25.871569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e71e5-85df-456a-abc6-c0e2a8cfb0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:25.873108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e71e5-85df-456a-abc6-c0e2a8cfb0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:25.878880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e71e5-85df-456a-abc6-c0e2a8cfb0ba admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:25.908966 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2962/5916] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:25.911357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521ce6-6249-46fe-800d-50636e1ad77e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:25.933618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521ce6-6249-46fe-800d-50636e1ad77e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:25.944985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa99c3-66f0-4679-8a2f-5e87dd64c5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:25.946060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa99c3-66f0-4679-8a2f-5e87dd64c5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:25.946341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa99c3-66f0-4679-8a2f-5e87dd64c5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:25.946625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa99c3-66f0-4679-8a2f-5e87dd64c5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:25.947282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa99c3-66f0-4679-8a2f-5e87dd64c5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:25.948900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa99c3-66f0-4679-8a2f-5e87dd64c5d1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:25.990568 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2955/5917] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:25.994755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e71e5-85df-456a-abc6-c0e2a8cfb0ba admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:26.015087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e71e5-85df-456a-abc6-c0e2a8cfb0ba admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:26.029539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b92f5-8cfe-4fc0-a24c-6854908eb92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:26.030445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b92f5-8cfe-4fc0-a24c-6854908eb92b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:26.030737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b92f5-8cfe-4fc0-a24c-6854908eb92b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:26.031017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b92f5-8cfe-4fc0-a24c-6854908eb92b admin admin] PATH_INFO: `/v3/projects/b32f641cce874014bd2b8d7185490d60/users/98d51b5afa72481d87bc9e9caba54db8/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:26.126954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b92f5-8cfe-4fc0-a24c-6854908eb92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32f641cce874014bd2b8d7185490d60, user_id=98d51b5afa72481d87bc9e9caba54db8, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:26.132016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b92f5-8cfe-4fc0-a24c-6854908eb92b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:26.186575 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2963/5918] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:25 2022] PUT /identity/v3/projects/b32f641cce874014bd2b8d7185490d60/users/98d51b5afa72481d87bc9e9caba54db8/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:26.190113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94924c-e94b-4b02-acb6-6926d6add41d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:26.190638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94924c-e94b-4b02-acb6-6926d6add41d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:26.191101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94924c-e94b-4b02-acb6-6926d6add41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:26.247965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-bd94924c-e94b-4b02-acb6-6926d6add41d None None] MFA Rules not processed for user `98d51b5afa72481d87bc9e9caba54db8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:26.252603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bd94924c-e94b-4b02-acb6-6926d6add41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:26.376952 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2956/5919] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:26.389086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b92f5-8cfe-4fc0-a24c-6854908eb92b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:26.396926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b81b92f5-8cfe-4fc0-a24c-6854908eb92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:26.505118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94924c-e94b-4b02-acb6-6926d6add41d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:26.508880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bd94924c-e94b-4b02-acb6-6926d6add41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:26.581112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b92f5-8cfe-4fc0-a24c-6854908eb92b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:26.588474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6c5d-36af-4581-9c76-b0af169e4115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:26.589153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6c5d-36af-4581-9c76-b0af169e4115 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:26.589465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6c5d-36af-4581-9c76-b0af169e4115 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:26.589749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6c5d-36af-4581-9c76-b0af169e4115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:26.616917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6c5d-36af-4581-9c76-b0af169e4115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:26.619469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6c5d-36af-4581-9c76-b0af169e4115 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:26.655912 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2964/5920] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:26.711535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94924c-e94b-4b02-acb6-6926d6add41d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:26.720297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9bb8b-6f96-440a-ad28-8cbabbb0880d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:26.721061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9bb8b-6f96-440a-ad28-8cbabbb0880d service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:26.721479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9bb8b-6f96-440a-ad28-8cbabbb0880d service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:26.721862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9bb8b-6f96-440a-ad28-8cbabbb0880d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:26.725295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c4e9bb8b-6f96-440a-ad28-8cbabbb0880d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:26.755882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9bb8b-6f96-440a-ad28-8cbabbb0880d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:26.757573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9bb8b-6f96-440a-ad28-8cbabbb0880d service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:26.774536 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2957/5921] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:51:36.636310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=57,keystone:DELETE=2,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:36.771989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:43.699689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6c5d-36af-4581-9c76-b0af169e4115 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:43.888708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6c5d-36af-4581-9c76-b0af169e4115 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:43.901947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:43.902634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:43.902930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:43.906870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] PATH_INFO: `/v3/users/98d51b5afa72481d87bc9e9caba54db8` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:43.910323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d51b5afa72481d87bc9e9caba54db8)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:43.917567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:44.056400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d51b5afa72481d87bc9e9caba54db8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.059854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d51b5afa72481d87bc9e9caba54db8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.097850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d51b5afa72481d87bc9e9caba54db8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.100372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d51b5afa72481d87bc9e9caba54db8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.127621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d51b5afa72481d87bc9e9caba54db8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:44.160315 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2965/5922] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:43 2022] DELETE /identity/v3/users/98d51b5afa72481d87bc9e9caba54db8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:44.164678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0388a2b-1756-4c13-abcb-28f374ab295a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:44.165601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0388a2b-1756-4c13-abcb-28f374ab295a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:44.166123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0388a2b-1756-4c13-abcb-28f374ab295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:44.242325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b0388a2b-1756-4c13-abcb-28f374ab295a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:44.248213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b0388a2b-1756-4c13-abcb-28f374ab295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:44.488007 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2958/5923] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:44.558108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:44.560224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:44.728953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cdb66-e4df-4d57-addd-27d15b878c00 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:44.741753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f62056-831b-4765-bb3a-c7d35b8cb4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:44.741753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f62056-831b-4765-bb3a-c7d35b8cb4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:44.744116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f62056-831b-4765-bb3a-c7d35b8cb4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:44.744413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f62056-831b-4765-bb3a-c7d35b8cb4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:44.784710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f62056-831b-4765-bb3a-c7d35b8cb4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:44.787420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f62056-831b-4765-bb3a-c7d35b8cb4d2 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:44.816933 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2966/5924] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:45.556813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9ac08-3663-4b30-b760-a1b0b25665e7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:45.557288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9ac08-3663-4b30-b760-a1b0b25665e7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:45.557809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9ac08-3663-4b30-b760-a1b0b25665e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:45.600899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-24e9ac08-3663-4b30-b760-a1b0b25665e7 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:45.611049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-24e9ac08-3663-4b30-b760-a1b0b25665e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:45.807428 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2959/5925] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:51:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:45.909168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f62056-831b-4765-bb3a-c7d35b8cb4d2 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:45.911277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f2f62056-831b-4765-bb3a-c7d35b8cb4d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:46.012950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:46.166816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f62056-831b-4765-bb3a-c7d35b8cb4d2 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:46.185417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1712a-8ac7-46ea-97ef-11c70238c98d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:46.186962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1712a-8ac7-46ea-97ef-11c70238c98d service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:46.187472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1712a-8ac7-46ea-97ef-11c70238c98d service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:46.187917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1712a-8ac7-46ea-97ef-11c70238c98d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:46.208734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1712a-8ac7-46ea-97ef-11c70238c98d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:46.210727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1712a-8ac7-46ea-97ef-11c70238c98d service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:46.297201 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2967/5926] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:51:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:47.799770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9ac08-3663-4b30-b760-a1b0b25665e7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:47.802586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-24e9ac08-3663-4b30-b760-a1b0b25665e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:47.831426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9ac08-3663-4b30-b760-a1b0b25665e7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:47.845879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:47.847066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:47.848902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:47.849979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] PATH_INFO: `/v3/users/666f75dceef04987bb1cc38590a8d607` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:47.854452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=666f75dceef04987bb1cc38590a8d607)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:47.857906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:48.003135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666f75dceef04987bb1cc38590a8d607'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:48.004529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666f75dceef04987bb1cc38590a8d607'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:48.035129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666f75dceef04987bb1cc38590a8d607'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:48.051687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666f75dceef04987bb1cc38590a8d607'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:48.069106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666f75dceef04987bb1cc38590a8d607'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:48.082564 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2960/5927] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:47 2022] DELETE /identity/v3/users/666f75dceef04987bb1cc38590a8d607 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:48.087075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca6fcb-947e-48a2-b111-a9e0cc6d5cf0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:48.088336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca6fcb-947e-48a2-b111-a9e0cc6d5cf0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:48.091896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca6fcb-947e-48a2-b111-a9e0cc6d5cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:48.150198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-88ca6fcb-947e-48a2-b111-a9e0cc6d5cf0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:48.154507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-88ca6fcb-947e-48a2-b111-a9e0cc6d5cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:48.368754 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2968/5928] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:48.442848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:48.444487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:48.533966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:48.631356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2c67a-e17e-4ef2-a00d-0222f7cc2e69 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:48.647100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8e6f-c8b1-48a2-bd24-106bce95b12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:48.648085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8e6f-c8b1-48a2-bd24-106bce95b12b service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:48.648663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8e6f-c8b1-48a2-bd24-106bce95b12b service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:48.649105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8e6f-c8b1-48a2-bd24-106bce95b12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:48.690458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d8e6f-c8b1-48a2-bd24-106bce95b12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:48.708942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d8e6f-c8b1-48a2-bd24-106bce95b12b service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:48.724876 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2961/5929] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:48.939161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca6fcb-947e-48a2-b111-a9e0cc6d5cf0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:48.940780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-88ca6fcb-947e-48a2-b111-a9e0cc6d5cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:48.974580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca6fcb-947e-48a2-b111-a9e0cc6d5cf0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:49.005733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:49.006402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:49.006684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:49.006955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] PATH_INFO: `/v3/projects/b32f641cce874014bd2b8d7185490d60` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:49.015003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b32f641cce874014bd2b8d7185490d60)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:49.022092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:49.158011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b32f641cce874014bd2b8d7185490d60', 'request_id': 'req-980be192-a804-4bdf-a5f1-c4f5106dd70f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.177313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b32f641cce874014bd2b8d7185490d60', 'request_id': 'req-980be192-a804-4bdf-a5f1-c4f5106dd70f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.212108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b32f641cce874014bd2b8d7185490d60', 'request_id': 'req-980be192-a804-4bdf-a5f1-c4f5106dd70f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.267496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] The token cache is being invalidate because project b32f641cce874014bd2b8d7185490d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:49.268402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.270397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-980be192-a804-4bdf-a5f1-c4f5106dd70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:49.279889 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2969/5930] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:48 2022] DELETE /identity/v3/projects/b32f641cce874014bd2b8d7185490d60 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:49.281325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdbe5e-8708-4c9e-8149-7ba86aa391d7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:49.281839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdbe5e-8708-4c9e-8149-7ba86aa391d7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:49.281957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdbe5e-8708-4c9e-8149-7ba86aa391d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:49.352226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a4bdbe5e-8708-4c9e-8149-7ba86aa391d7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:49.357038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a4bdbe5e-8708-4c9e-8149-7ba86aa391d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:49.655510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2962/5931] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:49.662724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6141e-e5d5-455d-a647-f4cf29aaf768 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:49.663546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6141e-e5d5-455d-a647-f4cf29aaf768 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:49.664239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6141e-e5d5-455d-a647-f4cf29aaf768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:49.768708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-65e6141e-e5d5-455d-a647-f4cf29aaf768 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:49.777060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-65e6141e-e5d5-455d-a647-f4cf29aaf768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:49.817360 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2970/5932] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:49.822006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdbe5e-8708-4c9e-8149-7ba86aa391d7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:49.837995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdbe5e-8708-4c9e-8149-7ba86aa391d7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:49.850656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db95983-f3b9-44a4-9599-57b85243d4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:49.853372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db95983-f3b9-44a4-9599-57b85243d4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:49.854093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db95983-f3b9-44a4-9599-57b85243d4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:49.855666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db95983-f3b9-44a4-9599-57b85243d4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:49.856748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db95983-f3b9-44a4-9599-57b85243d4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:51:49.857850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db95983-f3b9-44a4-9599-57b85243d4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:49.861286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db95983-f3b9-44a4-9599-57b85243d4b0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:49.904701 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2963/5933] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:49.910847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6141e-e5d5-455d-a647-f4cf29aaf768 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:49.924006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6141e-e5d5-455d-a647-f4cf29aaf768 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:49.940190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38473d7-a098-45cd-aa0c-c09141f0dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:49.940825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38473d7-a098-45cd-aa0c-c09141f0dcda admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:49.941103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38473d7-a098-45cd-aa0c-c09141f0dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:49.941372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38473d7-a098-45cd-aa0c-c09141f0dcda admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:49.943287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38473d7-a098-45cd-aa0c-c09141f0dcda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:49.945701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38473d7-a098-45cd-aa0c-c09141f0dcda admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:50.055901 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2971/5934] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:49 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:50.057283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db95983-f3b9-44a4-9599-57b85243d4b0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:50.078643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db95983-f3b9-44a4-9599-57b85243d4b0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:50.425723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed89d9-d12c-443b-a0eb-831478a0343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:50.426441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed89d9-d12c-443b-a0eb-831478a0343b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:50.426644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed89d9-d12c-443b-a0eb-831478a0343b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:50.426919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed89d9-d12c-443b-a0eb-831478a0343b admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:50.427572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed89d9-d12c-443b-a0eb-831478a0343b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:50.435801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed89d9-d12c-443b-a0eb-831478a0343b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:50.525223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38473d7-a098-45cd-aa0c-c09141f0dcda admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:50.525870 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2964/5935] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:50 2022] POST /identity/v3/users => generated 287 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:50.555976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38473d7-a098-45cd-aa0c-c09141f0dcda admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:50.578881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76029390-f2f2-4a01-b22a-30217a9d15ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:50.579527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76029390-f2f2-4a01-b22a-30217a9d15ca admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:50.579807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76029390-f2f2-4a01-b22a-30217a9d15ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:50.580096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76029390-f2f2-4a01-b22a-30217a9d15ca admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:50.580778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76029390-f2f2-4a01-b22a-30217a9d15ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:50.586256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76029390-f2f2-4a01-b22a-30217a9d15ca admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:50.591912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:50.642166 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2972/5936] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:51:50.642927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed89d9-d12c-443b-a0eb-831478a0343b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:50.662428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed89d9-d12c-443b-a0eb-831478a0343b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:50.684046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49bb71-475e-4c12-8308-7c6bc9b4f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:50.685087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49bb71-475e-4c12-8308-7c6bc9b4f0aa admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:50.685376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49bb71-475e-4c12-8308-7c6bc9b4f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:50.685678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49bb71-475e-4c12-8308-7c6bc9b4f0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:50.686346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49bb71-475e-4c12-8308-7c6bc9b4f0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:50.695814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49bb71-475e-4c12-8308-7c6bc9b4f0aa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:50.737715 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2965/5937] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:51:50.739551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76029390-f2f2-4a01-b22a-30217a9d15ca admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:50.801114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76029390-f2f2-4a01-b22a-30217a9d15ca admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:50.827359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2f018-990c-4843-b2ba-ad0a67d29883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:50.830484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2f018-990c-4843-b2ba-ad0a67d29883 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:50.835355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2f018-990c-4843-b2ba-ad0a67d29883 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:50.835778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2f018-990c-4843-b2ba-ad0a67d29883 admin admin] PATH_INFO: `/v3/projects/34f6ee06b7ae4aa88617346af66f49c3/users/a11972eed2e847b49ecd614734eee0ca/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:50.934856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2f018-990c-4843-b2ba-ad0a67d29883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f6ee06b7ae4aa88617346af66f49c3, user_id=a11972eed2e847b49ecd614734eee0ca, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:50.937858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2f018-990c-4843-b2ba-ad0a67d29883 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:50.982925 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2973/5938] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:50 2022] PUT /identity/v3/projects/34f6ee06b7ae4aa88617346af66f49c3/users/a11972eed2e847b49ecd614734eee0ca/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:50.994063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86fc6d-8a60-4459-83c7-b2558d403033 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:50.994878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86fc6d-8a60-4459-83c7-b2558d403033 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:50.995343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86fc6d-8a60-4459-83c7-b2558d403033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:51.090740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fe86fc6d-8a60-4459-83c7-b2558d403033 None None] MFA Rules not processed for user `a11972eed2e847b49ecd614734eee0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:51.096191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fe86fc6d-8a60-4459-83c7-b2558d403033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:51.158518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:51.373064 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2966/5939] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:51.385695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2f018-990c-4843-b2ba-ad0a67d29883 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:51.387778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1db2f018-990c-4843-b2ba-ad0a67d29883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:51.530381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2f018-990c-4843-b2ba-ad0a67d29883 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:51.538089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104835b-5235-44a2-aa9d-82164e8aad52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:51.539089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104835b-5235-44a2-aa9d-82164e8aad52 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:51.541055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104835b-5235-44a2-aa9d-82164e8aad52 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:51.542644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104835b-5235-44a2-aa9d-82164e8aad52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:51.565262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104835b-5235-44a2-aa9d-82164e8aad52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:51.566963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104835b-5235-44a2-aa9d-82164e8aad52 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:51.596464 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2974/5940] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:51.635843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86fc6d-8a60-4459-83c7-b2558d403033 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:51.854635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86fc6d-8a60-4459-83c7-b2558d403033 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:51.872634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1c997-3575-4fe0-a495-68a2085987fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:51.873310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1c997-3575-4fe0-a495-68a2085987fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:51.873616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1c997-3575-4fe0-a495-68a2085987fc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:51.873895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1c997-3575-4fe0-a495-68a2085987fc admin admin] PATH_INFO: `/v3/users/a11972eed2e847b49ecd614734eee0ca` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:51.877253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1c997-3575-4fe0-a495-68a2085987fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11972eed2e847b49ecd614734eee0ca)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:51.880293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1c997-3575-4fe0-a495-68a2085987fc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:51.987786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104835b-5235-44a2-aa9d-82164e8aad52 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:51.989109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1104835b-5235-44a2-aa9d-82164e8aad52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:51.998214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-afb1c997-3575-4fe0-a495-68a2085987fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11972eed2e847b49ecd614734eee0ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.001648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-afb1c997-3575-4fe0-a495-68a2085987fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11972eed2e847b49ecd614734eee0ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.027395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104835b-5235-44a2-aa9d-82164e8aad52 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:52.037679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-afb1c997-3575-4fe0-a495-68a2085987fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11972eed2e847b49ecd614734eee0ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.042428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:52.043117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:52.043524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:52.045471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] PATH_INFO: `/v3/projects/804640be3d914beb89aef4ae1e87e919` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:52.047161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=804640be3d914beb89aef4ae1e87e919)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:52.049338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:52.052405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-afb1c997-3575-4fe0-a495-68a2085987fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11972eed2e847b49ecd614734eee0ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.074570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-afb1c997-3575-4fe0-a495-68a2085987fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11972eed2e847b49ecd614734eee0ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.095875 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2967/5941] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:51:51 2022] DELETE /identity/v3/users/a11972eed2e847b49ecd614734eee0ca => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:52.097615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f1bf-519c-4c72-b6bd-c6be01b7c2aa None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:52.097909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f1bf-519c-4c72-b6bd-c6be01b7c2aa None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:52.098186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0f1bf-519c-4c72-b6bd-c6be01b7c2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:52.165448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-83a0f1bf-519c-4c72-b6bd-c6be01b7c2aa None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:52.166557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-83a0f1bf-519c-4c72-b6bd-c6be01b7c2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:52.214808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804640be3d914beb89aef4ae1e87e919', 'request_id': 'req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.252982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804640be3d914beb89aef4ae1e87e919', 'request_id': 'req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.294978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804640be3d914beb89aef4ae1e87e919', 'request_id': 'req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.336573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] The token cache is being invalidate because project 804640be3d914beb89aef4ae1e87e919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:52.337009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.338756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:52.340890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3d49c91f-fd8f-4110-a4b9-9ba30d6d6b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:52.352335 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2975/5942] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:51 2022] DELETE /identity/v3/projects/804640be3d914beb89aef4ae1e87e919 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:52.357141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae674c-ce87-45eb-a99d-9f807ac8ad28 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:52.357447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae674c-ce87-45eb-a99d-9f807ac8ad28 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:52.357727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae674c-ce87-45eb-a99d-9f807ac8ad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:52.398774 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2968/5943] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:52.418445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f1bf-519c-4c72-b6bd-c6be01b7c2aa None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:52.420512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-83a0f1bf-519c-4c72-b6bd-c6be01b7c2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:52.443135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5bae674c-ce87-45eb-a99d-9f807ac8ad28 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:52.445279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5bae674c-ce87-45eb-a99d-9f807ac8ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:52.454960 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2976/5944] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:52.463610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db029de-c03a-421c-9133-af7c52e90a71 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:52.464020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db029de-c03a-421c-9133-af7c52e90a71 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:52.464401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db029de-c03a-421c-9133-af7c52e90a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:52.508907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9db029de-c03a-421c-9133-af7c52e90a71 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:52.510334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9db029de-c03a-421c-9133-af7c52e90a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:52.533744 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2977/5945] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:51:52.538343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db029de-c03a-421c-9133-af7c52e90a71 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:52.562827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0f1bf-519c-4c72-b6bd-c6be01b7c2aa None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:52.564130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db029de-c03a-421c-9133-af7c52e90a71 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:52.572860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2396e-3cc4-4931-8d80-0f71f44ed9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:52.575263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2396e-3cc4-4931-8d80-0f71f44ed9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:52.575550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2396e-3cc4-4931-8d80-0f71f44ed9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:52.575829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2396e-3cc4-4931-8d80-0f71f44ed9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:52.587221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80810928-4769-4a31-9bde-a9972bf0735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:52.587837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80810928-4769-4a31-9bde-a9972bf0735a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:52.588113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80810928-4769-4a31-9bde-a9972bf0735a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:52.588384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80810928-4769-4a31-9bde-a9972bf0735a admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:52.589034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80810928-4769-4a31-9bde-a9972bf0735a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:51:52.589551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80810928-4769-4a31-9bde-a9972bf0735a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:52.590884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2396e-3cc4-4931-8d80-0f71f44ed9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:52.592357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2396e-3cc4-4931-8d80-0f71f44ed9b5 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:52.593107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80810928-4769-4a31-9bde-a9972bf0735a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:52.615359 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2969/5946] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:52.643852 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2978/5947] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:51:52.650521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2396e-3cc4-4931-8d80-0f71f44ed9b5 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:52.666221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2396e-3cc4-4931-8d80-0f71f44ed9b5 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:52.696872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa9063-f5bd-4dd2-8145-b79e18bc1be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:52.698867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9063-f5bd-4dd2-8145-b79e18bc1be9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:52.698867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9063-f5bd-4dd2-8145-b79e18bc1be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:52.698867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9063-f5bd-4dd2-8145-b79e18bc1be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:52.698867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa9063-f5bd-4dd2-8145-b79e18bc1be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:52.716387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa9063-f5bd-4dd2-8145-b79e18bc1be9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:52.791637 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2970/5948] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:51:52 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:52.796000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80810928-4769-4a31-9bde-a9972bf0735a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:52.823060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80810928-4769-4a31-9bde-a9972bf0735a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:52.954328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:53.034109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256c2dd-98a7-45f3-9b65-16454bc1fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:53.034849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256c2dd-98a7-45f3-9b65-16454bc1fcc9 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:53.035196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256c2dd-98a7-45f3-9b65-16454bc1fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:53.035550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256c2dd-98a7-45f3-9b65-16454bc1fcc9 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:53.036268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256c2dd-98a7-45f3-9b65-16454bc1fcc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:53.038815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256c2dd-98a7-45f3-9b65-16454bc1fcc9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:53.109858 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2979/5949] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:51:52 2022] POST /identity/v3/users => generated 295 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:51:53.118574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa9063-f5bd-4dd2-8145-b79e18bc1be9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:53.140767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa9063-f5bd-4dd2-8145-b79e18bc1be9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:53.155492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39141e-ffbd-4cbe-bb67-d32f9fa56786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:53.157118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39141e-ffbd-4cbe-bb67-d32f9fa56786 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:53.159059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39141e-ffbd-4cbe-bb67-d32f9fa56786 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:53.159469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39141e-ffbd-4cbe-bb67-d32f9fa56786 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:53.160283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39141e-ffbd-4cbe-bb67-d32f9fa56786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:53.165198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39141e-ffbd-4cbe-bb67-d32f9fa56786 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:53.205915 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2971/5950] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:51:53.210576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256c2dd-98a7-45f3-9b65-16454bc1fcc9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:53.228175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256c2dd-98a7-45f3-9b65-16454bc1fcc9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:53.242420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf428a-c748-4c36-bfdf-73b35ce04f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:53.243075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf428a-c748-4c36-bfdf-73b35ce04f88 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:53.243355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf428a-c748-4c36-bfdf-73b35ce04f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:53.243629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf428a-c748-4c36-bfdf-73b35ce04f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:53.244291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf428a-c748-4c36-bfdf-73b35ce04f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:53.253608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf428a-c748-4c36-bfdf-73b35ce04f88 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:53.281694 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2980/5951] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:51:53.286102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39141e-ffbd-4cbe-bb67-d32f9fa56786 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:53.309867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39141e-ffbd-4cbe-bb67-d32f9fa56786 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:53.329564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8066adb-804e-488a-801a-02c9c95c73ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:53.336243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8066adb-804e-488a-801a-02c9c95c73ee admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:53.337497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8066adb-804e-488a-801a-02c9c95c73ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:53.343609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8066adb-804e-488a-801a-02c9c95c73ee admin admin] PATH_INFO: `/v3/projects/4bbd42d6f3cd4a93b60f1e1c573cd306/users/df8156d4bf0545a295a2b9562a5aebb6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:53.384088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8066adb-804e-488a-801a-02c9c95c73ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bbd42d6f3cd4a93b60f1e1c573cd306, user_id=df8156d4bf0545a295a2b9562a5aebb6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:53.387584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8066adb-804e-488a-801a-02c9c95c73ee admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:53.421142 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2972/5952] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:51:53 2022] PUT /identity/v3/projects/4bbd42d6f3cd4a93b60f1e1c573cd306/users/df8156d4bf0545a295a2b9562a5aebb6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:51:53.431985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440418-5dc6-44fb-9960-39b80fe123b2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:53.431985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440418-5dc6-44fb-9960-39b80fe123b2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:53.432243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440418-5dc6-44fb-9960-39b80fe123b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:53.522436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-54440418-5dc6-44fb-9960-39b80fe123b2 None None] MFA Rules not processed for user `df8156d4bf0545a295a2b9562a5aebb6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:51:53.523687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-54440418-5dc6-44fb-9960-39b80fe123b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:53.819179 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2981/5953] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:51:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:51:53.830190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8066adb-804e-488a-801a-02c9c95c73ee admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:53.832134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d8066adb-804e-488a-801a-02c9c95c73ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:54.004225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8066adb-804e-488a-801a-02c9c95c73ee admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:54.012288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b1777-0a93-4d2a-b5f6-a386fa416231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:54.012910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1777-0a93-4d2a-b5f6-a386fa416231 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:54.013192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1777-0a93-4d2a-b5f6-a386fa416231 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:54.013497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1777-0a93-4d2a-b5f6-a386fa416231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:54.039186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b1777-0a93-4d2a-b5f6-a386fa416231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:54.040355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b1777-0a93-4d2a-b5f6-a386fa416231 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:54.072474 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2973/5954] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:51:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:51:55.100117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54440418-5dc6-44fb-9960-39b80fe123b2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:51:55.101939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-54440418-5dc6-44fb-9960-39b80fe123b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:51:55.319621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54440418-5dc6-44fb-9960-39b80fe123b2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:51:55.337216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:51:55.340180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:51:55.340932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:51:55.343649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] PATH_INFO: `/v3/projects/34f6ee06b7ae4aa88617346af66f49c3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:51:55.352001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f6ee06b7ae4aa88617346af66f49c3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:51:55.382657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:51:55.528971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:55.548654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f6ee06b7ae4aa88617346af66f49c3', 'request_id': 'req-4893484b-bd85-48a4-8392-969508b72182'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:55.565614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f6ee06b7ae4aa88617346af66f49c3', 'request_id': 'req-4893484b-bd85-48a4-8392-969508b72182'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:55.586079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f6ee06b7ae4aa88617346af66f49c3', 'request_id': 'req-4893484b-bd85-48a4-8392-969508b72182'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:55.606884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] The token cache is being invalidate because project 34f6ee06b7ae4aa88617346af66f49c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:51:55.607547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:55.609757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:51:55.612597 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2982/5955] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:51:55 2022] DELETE /identity/v3/projects/34f6ee06b7ae4aa88617346af66f49c3 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:02.634805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b1777-0a93-4d2a-b5f6-a386fa416231 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:02.636350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ed4b1777-0a93-4d2a-b5f6-a386fa416231 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:02.669451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b1777-0a93-4d2a-b5f6-a386fa416231 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:02.763574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:02.871358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9742a-365b-487c-bdf5-fd94a9d07d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:02.873118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9742a-365b-487c-bdf5-fd94a9d07d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:02.874112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9742a-365b-487c-bdf5-fd94a9d07d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:02.876858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9742a-365b-487c-bdf5-fd94a9d07d1f admin admin] PATH_INFO: `/v3/users/9b302183018f4d44b7cfbd8b1b6c1cc6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:02.880079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9742a-365b-487c-bdf5-fd94a9d07d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b302183018f4d44b7cfbd8b1b6c1cc6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:02.889299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9742a-365b-487c-bdf5-fd94a9d07d1f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:02.992642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ba9742a-365b-487c-bdf5-fd94a9d07d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b302183018f4d44b7cfbd8b1b6c1cc6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:02.994713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ba9742a-365b-487c-bdf5-fd94a9d07d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b302183018f4d44b7cfbd8b1b6c1cc6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:03.024525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ba9742a-365b-487c-bdf5-fd94a9d07d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b302183018f4d44b7cfbd8b1b6c1cc6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:03.048775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ba9742a-365b-487c-bdf5-fd94a9d07d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b302183018f4d44b7cfbd8b1b6c1cc6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:03.073226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ba9742a-365b-487c-bdf5-fd94a9d07d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b302183018f4d44b7cfbd8b1b6c1cc6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:03.096583 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2974/5956] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:02 2022] DELETE /identity/v3/users/9b302183018f4d44b7cfbd8b1b6c1cc6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:04.147852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:04.150431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:04.178762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893484b-bd85-48a4-8392-969508b72182 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:04.403224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:04.403884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:04.404163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:04.404436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] PATH_INFO: `/v3/projects/571cec2b4f7f48a0ac319b4f44319935` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:04.406962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=571cec2b4f7f48a0ac319b4f44319935)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:04.408888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:04.601726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '571cec2b4f7f48a0ac319b4f44319935', 'request_id': 'req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:04.619958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '571cec2b4f7f48a0ac319b4f44319935', 'request_id': 'req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:04.646859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '571cec2b4f7f48a0ac319b4f44319935', 'request_id': 'req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:04.688762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] The token cache is being invalidate because project 571cec2b4f7f48a0ac319b4f44319935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:04.689064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:04.691028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c939d9e5-276b-44da-8cb1-4b5a43cd83f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:04.693806 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2983/5957] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:04 2022] DELETE /identity/v3/projects/571cec2b4f7f48a0ac319b4f44319935 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:04.699790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0bb65-8d0d-496c-aabf-29aea996c6bf None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:04.700635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0bb65-8d0d-496c-aabf-29aea996c6bf None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:04.701101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0bb65-8d0d-496c-aabf-29aea996c6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:04.753846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-94b0bb65-8d0d-496c-aabf-29aea996c6bf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:04.755592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-94b0bb65-8d0d-496c-aabf-29aea996c6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:04.909126 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2975/5958] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:52:04.917992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808d320-4976-49f6-9493-9f6b906cad01 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:04.918279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808d320-4976-49f6-9493-9f6b906cad01 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:04.918555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808d320-4976-49f6-9493-9f6b906cad01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:04.998386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9808d320-4976-49f6-9493-9f6b906cad01 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:05.002039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9808d320-4976-49f6-9493-9f6b906cad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:05.026097 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2984/5959] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:52:05.028780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0bb65-8d0d-496c-aabf-29aea996c6bf None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.053849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0bb65-8d0d-496c-aabf-29aea996c6bf None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.059216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975a62-22d7-458b-86a5-1c1ffa6feb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.060381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975a62-22d7-458b-86a5-1c1ffa6feb02 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.060962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975a62-22d7-458b-86a5-1c1ffa6feb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.061440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975a62-22d7-458b-86a5-1c1ffa6feb02 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.062818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3975a62-22d7-458b-86a5-1c1ffa6feb02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:05.063381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3975a62-22d7-458b-86a5-1c1ffa6feb02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.072069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3975a62-22d7-458b-86a5-1c1ffa6feb02 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.095078 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2976/5960] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:52:05.099954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808d320-4976-49f6-9493-9f6b906cad01 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.112186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808d320-4976-49f6-9493-9f6b906cad01 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.123898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db296e-b631-4de7-ab2b-58063d6cf72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.128974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db296e-b631-4de7-ab2b-58063d6cf72d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.129262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db296e-b631-4de7-ab2b-58063d6cf72d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.132169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db296e-b631-4de7-ab2b-58063d6cf72d admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.134457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db296e-b631-4de7-ab2b-58063d6cf72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.142282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db296e-b631-4de7-ab2b-58063d6cf72d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.253219 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2985/5961] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:05 2022] POST /identity/v3/projects => generated 395 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:05.255186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975a62-22d7-458b-86a5-1c1ffa6feb02 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.267314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975a62-22d7-458b-86a5-1c1ffa6feb02 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.320714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:05.400857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db296e-b631-4de7-ab2b-58063d6cf72d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.403024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-45db296e-b631-4de7-ab2b-58063d6cf72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:05.434274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b9276-3f59-4ece-a441-b35fbd799d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.435073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b9276-3f59-4ece-a441-b35fbd799d42 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.435457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b9276-3f59-4ece-a441-b35fbd799d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.435851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b9276-3f59-4ece-a441-b35fbd799d42 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.436632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b9276-3f59-4ece-a441-b35fbd799d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.443336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b9276-3f59-4ece-a441-b35fbd799d42 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.495022 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2977/5962] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:05 2022] POST /identity/v3/users => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:05.505680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b9276-3f59-4ece-a441-b35fbd799d42 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.556628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:05.558848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b9276-3f59-4ece-a441-b35fbd799d42 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.581688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114a55e-2fd2-43bb-aea3-645aead7a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.582950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114a55e-2fd2-43bb-aea3-645aead7a807 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.583484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114a55e-2fd2-43bb-aea3-645aead7a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.583992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114a55e-2fd2-43bb-aea3-645aead7a807 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.586362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114a55e-2fd2-43bb-aea3-645aead7a807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.589768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114a55e-2fd2-43bb-aea3-645aead7a807 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.606212 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2978/5963] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:52:05.610738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114a55e-2fd2-43bb-aea3-645aead7a807 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.636295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114a55e-2fd2-43bb-aea3-645aead7a807 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.672513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eddcc-8775-440a-b8ed-5ecf7b5f9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.673156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eddcc-8775-440a-b8ed-5ecf7b5f9a3b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.673499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eddcc-8775-440a-b8ed-5ecf7b5f9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.673782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eddcc-8775-440a-b8ed-5ecf7b5f9a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.675745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76eddcc-8775-440a-b8ed-5ecf7b5f9a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.680778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76eddcc-8775-440a-b8ed-5ecf7b5f9a3b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.713823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db296e-b631-4de7-ab2b-58063d6cf72d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.730388 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2979/5964] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:05.731383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eddcc-8775-440a-b8ed-5ecf7b5f9a3b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:05.734579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb2b2b-6343-4d52-ad5a-a265510696df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.735232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb2b2b-6343-4d52-ad5a-a265510696df service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.735511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb2b2b-6343-4d52-ad5a-a265510696df service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.735780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb2b2b-6343-4d52-ad5a-a265510696df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.764924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-36cb2b2b-6343-4d52-ad5a-a265510696df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:05.775287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eddcc-8775-440a-b8ed-5ecf7b5f9a3b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:05.790527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb2b2b-6343-4d52-ad5a-a265510696df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.792070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb2b2b-6343-4d52-ad5a-a265510696df service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.794550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385f09c-50c2-4fa8-a752-7787c532e220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:05.795504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385f09c-50c2-4fa8-a752-7787c532e220 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.795787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385f09c-50c2-4fa8-a752-7787c532e220 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.798263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385f09c-50c2-4fa8-a752-7787c532e220 admin admin] PATH_INFO: `/v3/projects/2e9c174d274442a592b9306e146ff891/users/eaaf3b2473a141efbb1a2904ade04d34/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.841720 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2986/5965] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:05.869728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385f09c-50c2-4fa8-a752-7787c532e220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9c174d274442a592b9306e146ff891, user_id=eaaf3b2473a141efbb1a2904ade04d34, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:05.878412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385f09c-50c2-4fa8-a752-7787c532e220 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:05.936497 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2980/5966] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:05 2022] PUT /identity/v3/projects/2e9c174d274442a592b9306e146ff891/users/eaaf3b2473a141efbb1a2904ade04d34/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:05.939278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253e7f4-4f49-417d-b540-8c636de0496a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:05.939750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253e7f4-4f49-417d-b540-8c636de0496a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:05.940295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253e7f4-4f49-417d-b540-8c636de0496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:05.998718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0253e7f4-4f49-417d-b540-8c636de0496a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:06.001943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0253e7f4-4f49-417d-b540-8c636de0496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:06.136090 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2987/5967] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:52:06.148588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385f09c-50c2-4fa8-a752-7787c532e220 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:06.150618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9385f09c-50c2-4fa8-a752-7787c532e220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:06.325589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385f09c-50c2-4fa8-a752-7787c532e220 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:06.339301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1027b-303d-4bae-9209-97203a5e4908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:06.339963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1027b-303d-4bae-9209-97203a5e4908 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:06.340244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1027b-303d-4bae-9209-97203a5e4908 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:06.340521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1027b-303d-4bae-9209-97203a5e4908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:06.374109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1027b-303d-4bae-9209-97203a5e4908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:06.376690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1027b-303d-4bae-9209-97203a5e4908 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:06.407381 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2981/5968] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:07.133841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253e7f4-4f49-417d-b540-8c636de0496a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:07.155579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253e7f4-4f49-417d-b540-8c636de0496a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:07.185531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687afae6-2627-4e6c-8aa7-b8c4411c0d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:07.186180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687afae6-2627-4e6c-8aa7-b8c4411c0d9a service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:07.186464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687afae6-2627-4e6c-8aa7-b8c4411c0d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:07.191895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687afae6-2627-4e6c-8aa7-b8c4411c0d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:07.201025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-687afae6-2627-4e6c-8aa7-b8c4411c0d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:07.299055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687afae6-2627-4e6c-8aa7-b8c4411c0d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:07.307672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687afae6-2627-4e6c-8aa7-b8c4411c0d9a service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:07.340876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2988/5969] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:16.398165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=61,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:17.321118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=45 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:19.402760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1027b-303d-4bae-9209-97203a5e4908 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:19.404465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1dc1027b-303d-4bae-9209-97203a5e4908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:19.649591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1027b-303d-4bae-9209-97203a5e4908 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:19.665439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ffdb1-92f9-40c8-aa88-c39879e4ce6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:19.667835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ffdb1-92f9-40c8-aa88-c39879e4ce6d service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:19.668073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ffdb1-92f9-40c8-aa88-c39879e4ce6d service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:19.672037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ffdb1-92f9-40c8-aa88-c39879e4ce6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:19.677450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5e0ffdb1-92f9-40c8-aa88-c39879e4ce6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:19.825254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ffdb1-92f9-40c8-aa88-c39879e4ce6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:19.829051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ffdb1-92f9-40c8-aa88-c39879e4ce6d service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:19.854587 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2982/5970] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:23.136591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687afae6-2627-4e6c-8aa7-b8c4411c0d9a service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:23.149978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-687afae6-2627-4e6c-8aa7-b8c4411c0d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:23.168653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687afae6-2627-4e6c-8aa7-b8c4411c0d9a service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:23.175475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b3346-61e9-420b-8cee-a9dceb32fac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:23.176823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b3346-61e9-420b-8cee-a9dceb32fac7 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:23.177578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b3346-61e9-420b-8cee-a9dceb32fac7 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:23.178290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b3346-61e9-420b-8cee-a9dceb32fac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:23.181374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc5b3346-61e9-420b-8cee-a9dceb32fac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:23.210899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b3346-61e9-420b-8cee-a9dceb32fac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:23.213750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b3346-61e9-420b-8cee-a9dceb32fac7 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:23.231225 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2989/5971] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:25.462313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ffdb1-92f9-40c8-aa88-c39879e4ce6d service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:25.463850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5e0ffdb1-92f9-40c8-aa88-c39879e4ce6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:25.660808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ffdb1-92f9-40c8-aa88-c39879e4ce6d service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:25.676789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b50c1b-5a87-4df8-84fa-94dbcf3c843e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:25.678387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b50c1b-5a87-4df8-84fa-94dbcf3c843e service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:25.678896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b50c1b-5a87-4df8-84fa-94dbcf3c843e service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:25.679284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b50c1b-5a87-4df8-84fa-94dbcf3c843e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:25.681703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b3346-61e9-420b-8cee-a9dceb32fac7 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:25.684678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc5b3346-61e9-420b-8cee-a9dceb32fac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:25.686192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-66b50c1b-5a87-4df8-84fa-94dbcf3c843e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:25.715160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b50c1b-5a87-4df8-84fa-94dbcf3c843e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:25.720170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b50c1b-5a87-4df8-84fa-94dbcf3c843e service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:25.720585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b3346-61e9-420b-8cee-a9dceb32fac7 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:25.735369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118e344-b8ba-44d9-9205-a843b48f719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:25.736411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118e344-b8ba-44d9-9205-a843b48f719c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:25.737910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118e344-b8ba-44d9-9205-a843b48f719c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:25.738925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118e344-b8ba-44d9-9205-a843b48f719c admin admin] PATH_INFO: `/v3/users/f70ee130e8e74db88b9b7ffd16ed1bd5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:25.746034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118e344-b8ba-44d9-9205-a843b48f719c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70ee130e8e74db88b9b7ffd16ed1bd5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:25.746612 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2983/5972] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:25.777518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118e344-b8ba-44d9-9205-a843b48f719c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:25.929767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b118e344-b8ba-44d9-9205-a843b48f719c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70ee130e8e74db88b9b7ffd16ed1bd5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:25.932970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b118e344-b8ba-44d9-9205-a843b48f719c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70ee130e8e74db88b9b7ffd16ed1bd5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:26.001480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b118e344-b8ba-44d9-9205-a843b48f719c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70ee130e8e74db88b9b7ffd16ed1bd5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:26.005773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b118e344-b8ba-44d9-9205-a843b48f719c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70ee130e8e74db88b9b7ffd16ed1bd5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:26.030615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b118e344-b8ba-44d9-9205-a843b48f719c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70ee130e8e74db88b9b7ffd16ed1bd5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:26.069235 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2990/5973] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:25 2022] DELETE /identity/v3/users/f70ee130e8e74db88b9b7ffd16ed1bd5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:26.130111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20040252-c4c3-48cd-a3f9-ca91831fc456 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:26.130461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20040252-c4c3-48cd-a3f9-ca91831fc456 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:26.130884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20040252-c4c3-48cd-a3f9-ca91831fc456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:26.199175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-20040252-c4c3-48cd-a3f9-ca91831fc456 None None] MFA Rules not processed for user `eaaf3b2473a141efbb1a2904ade04d34`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:26.200389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-20040252-c4c3-48cd-a3f9-ca91831fc456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:26.230507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:26.324898 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2984/5974] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:26.338381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209aa7-907a-4184-a56e-3c1ee8a36359 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:26.338887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209aa7-907a-4184-a56e-3c1ee8a36359 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:26.339334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209aa7-907a-4184-a56e-3c1ee8a36359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:26.367675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0e209aa7-907a-4184-a56e-3c1ee8a36359 None None] MFA Rules not processed for user `eaaf3b2473a141efbb1a2904ade04d34`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:26.369164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0e209aa7-907a-4184-a56e-3c1ee8a36359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:26.384456 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2991/5975] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:26.406399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20040252-c4c3-48cd-a3f9-ca91831fc456 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:26.409270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-20040252-c4c3-48cd-a3f9-ca91831fc456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:26.654840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20040252-c4c3-48cd-a3f9-ca91831fc456 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:26.670097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c130-2966-4495-924e-3349a08c6e04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:26.673030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c130-2966-4495-924e-3349a08c6e04 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:26.674044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c130-2966-4495-924e-3349a08c6e04 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:26.674044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c130-2966-4495-924e-3349a08c6e04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:26.711937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016c130-2966-4495-924e-3349a08c6e04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:26.716716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016c130-2966-4495-924e-3349a08c6e04 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:26.761618 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2985/5976] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:26 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:27.468757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209aa7-907a-4184-a56e-3c1ee8a36359 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:27.470897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0e209aa7-907a-4184-a56e-3c1ee8a36359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:27.676269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209aa7-907a-4184-a56e-3c1ee8a36359 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:27.700666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:27.701412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:27.701784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:27.703100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] PATH_INFO: `/v3/projects/10b20946b0cd4fc3b2289200eb839230` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:27.712378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b20946b0cd4fc3b2289200eb839230)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:27.714916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:27.844378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b20946b0cd4fc3b2289200eb839230', 'request_id': 'req-be56622b-3ee8-419f-a808-6e7b79f8d6b7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:27.859787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b20946b0cd4fc3b2289200eb839230', 'request_id': 'req-be56622b-3ee8-419f-a808-6e7b79f8d6b7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:27.862016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:27.892216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b20946b0cd4fc3b2289200eb839230', 'request_id': 'req-be56622b-3ee8-419f-a808-6e7b79f8d6b7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:27.915592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] The token cache is being invalidate because project 10b20946b0cd4fc3b2289200eb839230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:27.916304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:27.917609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be56622b-3ee8-419f-a808-6e7b79f8d6b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:27.928547 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2992/5977] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:27 2022] DELETE /identity/v3/projects/10b20946b0cd4fc3b2289200eb839230 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:27.932752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed952bd-38bf-4c22-9e83-0edcb46dd870 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:27.933484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed952bd-38bf-4c22-9e83-0edcb46dd870 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:27.935000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed952bd-38bf-4c22-9e83-0edcb46dd870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:28.015305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1ed952bd-38bf-4c22-9e83-0edcb46dd870 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:28.017694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1ed952bd-38bf-4c22-9e83-0edcb46dd870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:28.327556 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2986/5978] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:28.341019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb5be-dac4-46d7-8699-63a192809cef None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:28.341892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb5be-dac4-46d7-8699-63a192809cef None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:28.343200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcb5be-dac4-46d7-8699-63a192809cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:28.404494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-34fcb5be-dac4-46d7-8699-63a192809cef None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:28.410964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-34fcb5be-dac4-46d7-8699-63a192809cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:28.450876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2993/5979] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:28.452904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed952bd-38bf-4c22-9e83-0edcb46dd870 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:28.472631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed952bd-38bf-4c22-9e83-0edcb46dd870 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:28.483493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2af26f-115f-4571-8a1c-52e1ffeaf96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:28.486894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2af26f-115f-4571-8a1c-52e1ffeaf96d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:28.487411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2af26f-115f-4571-8a1c-52e1ffeaf96d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:28.487873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2af26f-115f-4571-8a1c-52e1ffeaf96d admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:28.490251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2af26f-115f-4571-8a1c-52e1ffeaf96d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:28.490767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2af26f-115f-4571-8a1c-52e1ffeaf96d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:28.497610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2af26f-115f-4571-8a1c-52e1ffeaf96d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:28.579625 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2987/5980] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:52:28.584350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcb5be-dac4-46d7-8699-63a192809cef None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:28.595658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcb5be-dac4-46d7-8699-63a192809cef None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:28.622569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe6c10-85c0-4a3b-9432-f29a0586f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:28.623197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6c10-85c0-4a3b-9432-f29a0586f29a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:28.623536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6c10-85c0-4a3b-9432-f29a0586f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:28.624058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6c10-85c0-4a3b-9432-f29a0586f29a admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:28.625047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe6c10-85c0-4a3b-9432-f29a0586f29a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:28.627430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe6c10-85c0-4a3b-9432-f29a0586f29a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:28.713286 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2994/5981] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:28 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:28.717630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2af26f-115f-4571-8a1c-52e1ffeaf96d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:28.740074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2af26f-115f-4571-8a1c-52e1ffeaf96d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:28.825784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:28.909017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632015d-0c27-4cb5-9433-aa83f09f754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:28.909855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632015d-0c27-4cb5-9433-aa83f09f754f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:28.910143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632015d-0c27-4cb5-9433-aa83f09f754f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:28.910421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632015d-0c27-4cb5-9433-aa83f09f754f admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:28.911643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632015d-0c27-4cb5-9433-aa83f09f754f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:28.914813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632015d-0c27-4cb5-9433-aa83f09f754f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:28.955884 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2988/5982] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:28 2022] POST /identity/v3/users => generated 284 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:28.958822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe6c10-85c0-4a3b-9432-f29a0586f29a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:28.976547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe6c10-85c0-4a3b-9432-f29a0586f29a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:28.985037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7719b02-134e-4edc-8407-eed049637236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:29.009613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7719b02-134e-4edc-8407-eed049637236 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:29.010087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7719b02-134e-4edc-8407-eed049637236 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:29.011290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7719b02-134e-4edc-8407-eed049637236 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:29.012363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7719b02-134e-4edc-8407-eed049637236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:29.017752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7719b02-134e-4edc-8407-eed049637236 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:29.046651 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2995/5983] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:52:29.050659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632015d-0c27-4cb5-9433-aa83f09f754f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:29.066447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632015d-0c27-4cb5-9433-aa83f09f754f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:29.082170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4b866-9a5f-4f8d-afa3-e9658310e1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:29.085450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4b866-9a5f-4f8d-afa3-e9658310e1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:29.085948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4b866-9a5f-4f8d-afa3-e9658310e1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:29.086841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4b866-9a5f-4f8d-afa3-e9658310e1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:29.088365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4b866-9a5f-4f8d-afa3-e9658310e1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:29.090603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4b866-9a5f-4f8d-afa3-e9658310e1a2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:29.130140 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2989/5984] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:29.131730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7719b02-134e-4edc-8407-eed049637236 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:29.149185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7719b02-134e-4edc-8407-eed049637236 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:29.170309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90924d-9f68-4945-999d-64d1162bb243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:29.171096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90924d-9f68-4945-999d-64d1162bb243 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:29.171385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90924d-9f68-4945-999d-64d1162bb243 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:29.171669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90924d-9f68-4945-999d-64d1162bb243 admin admin] PATH_INFO: `/v3/projects/6bb72778b3ce4c95b83fcd328ddaed9a/users/a8da04cfd0774f62bdfde05d8b99b542/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:29.241669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90924d-9f68-4945-999d-64d1162bb243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb72778b3ce4c95b83fcd328ddaed9a, user_id=a8da04cfd0774f62bdfde05d8b99b542, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:29.271770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90924d-9f68-4945-999d-64d1162bb243 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:29.299967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4b866-9a5f-4f8d-afa3-e9658310e1a2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:29.302628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-75e4b866-9a5f-4f8d-afa3-e9658310e1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:29.339883 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2996/5985] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:29 2022] PUT /identity/v3/projects/6bb72778b3ce4c95b83fcd328ddaed9a/users/a8da04cfd0774f62bdfde05d8b99b542/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:29.350050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd34fbd-95d2-495b-a2b8-4b7334eabdfd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:29.350445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd34fbd-95d2-495b-a2b8-4b7334eabdfd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:29.350931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd34fbd-95d2-495b-a2b8-4b7334eabdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:29.443212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dfd34fbd-95d2-495b-a2b8-4b7334eabdfd None None] MFA Rules not processed for user `a8da04cfd0774f62bdfde05d8b99b542`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:29.444696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dfd34fbd-95d2-495b-a2b8-4b7334eabdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:29.562128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4b866-9a5f-4f8d-afa3-e9658310e1a2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:29.664307 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2997/5986] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:29.674311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd34fbd-95d2-495b-a2b8-4b7334eabdfd None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:29.681159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dfd34fbd-95d2-495b-a2b8-4b7334eabdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:29.749719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528940d-c3cb-4b20-8cf3-881926972991 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:29.750824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528940d-c3cb-4b20-8cf3-881926972991 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:29.751280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528940d-c3cb-4b20-8cf3-881926972991 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:29.751725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528940d-c3cb-4b20-8cf3-881926972991 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:29.759224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d528940d-c3cb-4b20-8cf3-881926972991 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:29.796871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528940d-c3cb-4b20-8cf3-881926972991 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:29.798746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528940d-c3cb-4b20-8cf3-881926972991 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:29.847462 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2990/5987] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:29.869850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd34fbd-95d2-495b-a2b8-4b7334eabdfd None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:29.876936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d56138-9f00-4de8-b254-07d93c9ce450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:29.892564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d56138-9f00-4de8-b254-07d93c9ce450 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:29.893022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d56138-9f00-4de8-b254-07d93c9ce450 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:29.893605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d56138-9f00-4de8-b254-07d93c9ce450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:29.916824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d56138-9f00-4de8-b254-07d93c9ce450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:29.918512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d56138-9f00-4de8-b254-07d93c9ce450 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:29.957883 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2998/5988] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:32.575882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528940d-c3cb-4b20-8cf3-881926972991 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:32.577380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d528940d-c3cb-4b20-8cf3-881926972991 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:32.715277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:32.773790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528940d-c3cb-4b20-8cf3-881926972991 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:32.786313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:32.786974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:32.787253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:32.787529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] PATH_INFO: `/v3/users/df8156d4bf0545a295a2b9562a5aebb6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:32.788699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8156d4bf0545a295a2b9562a5aebb6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:32.790670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:32.883027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8156d4bf0545a295a2b9562a5aebb6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:32.883865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8156d4bf0545a295a2b9562a5aebb6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:32.922385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8156d4bf0545a295a2b9562a5aebb6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:32.938098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8156d4bf0545a295a2b9562a5aebb6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:32.969122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8156d4bf0545a295a2b9562a5aebb6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:32.978962 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2991/5989] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:32 2022] DELETE /identity/v3/users/df8156d4bf0545a295a2b9562a5aebb6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:32.983273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe885-7e03-4f10-88c8-25d8174e391f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:32.983785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe885-7e03-4f10-88c8-25d8174e391f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:32.983936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe885-7e03-4f10-88c8-25d8174e391f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:33.062422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-406fe885-7e03-4f10-88c8-25d8174e391f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:33.064167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-406fe885-7e03-4f10-88c8-25d8174e391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:33.081452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:33.203171 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 2999/5990] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:33.273225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:33.275267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:33.439721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a59d04-4138-42cf-a0af-92b8e9a72d2f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:33.447555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6f665-4e1e-4d62-abae-be14150080f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:33.448675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6f665-4e1e-4d62-abae-be14150080f8 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:33.449276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6f665-4e1e-4d62-abae-be14150080f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:33.449690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6f665-4e1e-4d62-abae-be14150080f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:33.483311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6f665-4e1e-4d62-abae-be14150080f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:33.485317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6f665-4e1e-4d62-abae-be14150080f8 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:33.507014 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2992/5991] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:35.919403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fe885-7e03-4f10-88c8-25d8174e391f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:35.922872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-406fe885-7e03-4f10-88c8-25d8174e391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:35.942503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fe885-7e03-4f10-88c8-25d8174e391f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:35.949284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:35.950693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:35.951265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:35.951838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] PATH_INFO: `/v3/projects/4bbd42d6f3cd4a93b60f1e1c573cd306` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:35.954457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bbd42d6f3cd4a93b60f1e1c573cd306)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:35.957957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:36.098016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bbd42d6f3cd4a93b60f1e1c573cd306', 'request_id': 'req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:36.115149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bbd42d6f3cd4a93b60f1e1c573cd306', 'request_id': 'req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:36.145845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bbd42d6f3cd4a93b60f1e1c573cd306', 'request_id': 'req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:36.214579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] The token cache is being invalidate because project 4bbd42d6f3cd4a93b60f1e1c573cd306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:52:36.216554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:36.217508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-54b75bc9-a18f-445b-a5fb-be8c4b83ae19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:36.223115 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3000/5992] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:52:35 2022] DELETE /identity/v3/projects/4bbd42d6f3cd4a93b60f1e1c573cd306 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:36.228965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc42b-2313-4a3d-ad59-146e39bf2ff7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:36.229651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc42b-2313-4a3d-ad59-146e39bf2ff7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:36.229651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc42b-2313-4a3d-ad59-146e39bf2ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:36.289687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-79adc42b-2313-4a3d-ad59-146e39bf2ff7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:36.291036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-79adc42b-2313-4a3d-ad59-146e39bf2ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:36.403148 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2993/5993] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:36.412714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681b01-ef54-4823-92e2-1e75e4f34b9c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:36.413273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681b01-ef54-4823-92e2-1e75e4f34b9c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:36.414451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681b01-ef54-4823-92e2-1e75e4f34b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:36.440370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-81681b01-ef54-4823-92e2-1e75e4f34b9c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:36.442059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-81681b01-ef54-4823-92e2-1e75e4f34b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:36.453164 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3001/5994] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:36.463164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adc42b-2313-4a3d-ad59-146e39bf2ff7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:36.471295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:36.494604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adc42b-2313-4a3d-ad59-146e39bf2ff7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:36.522620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779823eb-9091-4761-85cd-d522706f38eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:36.524601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779823eb-9091-4761-85cd-d522706f38eb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:36.525734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779823eb-9091-4761-85cd-d522706f38eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:36.528550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779823eb-9091-4761-85cd-d522706f38eb admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:36.528931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779823eb-9091-4761-85cd-d522706f38eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:52:36.530573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779823eb-9091-4761-85cd-d522706f38eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:36.542299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779823eb-9091-4761-85cd-d522706f38eb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:36.576953 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2994/5995] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:52:36.578441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81681b01-ef54-4823-92e2-1e75e4f34b9c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:36.595390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81681b01-ef54-4823-92e2-1e75e4f34b9c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:36.624848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f79270-ebd3-4a94-9572-cfd3b8153cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:36.626145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79270-ebd3-4a94-9572-cfd3b8153cbb admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:36.626737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79270-ebd3-4a94-9572-cfd3b8153cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:36.627320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79270-ebd3-4a94-9572-cfd3b8153cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:36.628034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f79270-ebd3-4a94-9572-cfd3b8153cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:36.631436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f79270-ebd3-4a94-9572-cfd3b8153cbb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:36.783868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384d83-9b0e-46be-b88f-8e2091a1a7db None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:36.788488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384d83-9b0e-46be-b88f-8e2091a1a7db None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:36.789106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384d83-9b0e-46be-b88f-8e2091a1a7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:36.793851 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3002/5996] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:52:36 2022] POST /identity/v3/projects => generated 393 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:52:36.795383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f79270-ebd3-4a94-9572-cfd3b8153cbb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:36.848737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e8384d83-9b0e-46be-b88f-8e2091a1a7db None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:36.850294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e8384d83-9b0e-46be-b88f-8e2091a1a7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:36.954035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f79270-ebd3-4a94-9572-cfd3b8153cbb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:36.966045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7dd4-ac5c-4ce7-bdc6-fb8fd3e4b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:36.966677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7dd4-ac5c-4ce7-bdc6-fb8fd3e4b0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:36.967976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7dd4-ac5c-4ce7-bdc6-fb8fd3e4b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:36.968489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7dd4-ac5c-4ce7-bdc6-fb8fd3e4b0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:36.977652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c7dd4-ac5c-4ce7-bdc6-fb8fd3e4b0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:36.979659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c7dd4-ac5c-4ce7-bdc6-fb8fd3e4b0e4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:37.002240 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2995/5997] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:52:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:37.003611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8384d83-9b0e-46be-b88f-8e2091a1a7db None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:37.007062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:37.007917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e8384d83-9b0e-46be-b88f-8e2091a1a7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:37.033773 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3003/5998] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:52:36 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:52:37.037700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7dd4-ac5c-4ce7-bdc6-fb8fd3e4b0e4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:37.061505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7dd4-ac5c-4ce7-bdc6-fb8fd3e4b0e4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:37.085446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746a87-d08b-4376-8eeb-0f0af7958194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:37.086121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746a87-d08b-4376-8eeb-0f0af7958194 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.086478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746a87-d08b-4376-8eeb-0f0af7958194 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.086953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746a87-d08b-4376-8eeb-0f0af7958194 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.088124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9746a87-d08b-4376-8eeb-0f0af7958194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:37.089874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9746a87-d08b-4376-8eeb-0f0af7958194 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:37.125184 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3004/5999] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:52:37.129200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746a87-d08b-4376-8eeb-0f0af7958194 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:37.174393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746a87-d08b-4376-8eeb-0f0af7958194 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:37.187472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f7817-acaf-4a9e-b9ae-dfb08fbc2b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:37.188113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f7817-acaf-4a9e-b9ae-dfb08fbc2b4a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.188399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f7817-acaf-4a9e-b9ae-dfb08fbc2b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.188677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f7817-acaf-4a9e-b9ae-dfb08fbc2b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.189336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f7817-acaf-4a9e-b9ae-dfb08fbc2b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:37.197851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f7817-acaf-4a9e-b9ae-dfb08fbc2b4a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:37.209333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8384d83-9b0e-46be-b88f-8e2091a1a7db None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:37.227607 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3005/6000] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:52:37.229237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f7817-acaf-4a9e-b9ae-dfb08fbc2b4a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:37.229591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dd496-7671-45da-b0e0-01b2661d7e1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:37.231065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dd496-7671-45da-b0e0-01b2661d7e1c service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.232546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dd496-7671-45da-b0e0-01b2661d7e1c service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.235999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dd496-7671-45da-b0e0-01b2661d7e1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.260579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f7817-acaf-4a9e-b9ae-dfb08fbc2b4a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:37.262484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dd496-7671-45da-b0e0-01b2661d7e1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:37.265179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dd496-7671-45da-b0e0-01b2661d7e1c service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:37.274268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5b927-6d0a-491e-87dc-a2ccaefed61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:37.274966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b927-6d0a-491e-87dc-a2ccaefed61a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.275461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b927-6d0a-491e-87dc-a2ccaefed61a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.275677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b927-6d0a-491e-87dc-a2ccaefed61a admin admin] PATH_INFO: `/v3/projects/dade809f50304164ac7a0b1f52ce8dd7/users/94fe0dfd4dcb468f9f24ea2e8802a194/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.305818 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2996/6001] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:37.331376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5b927-6d0a-491e-87dc-a2ccaefed61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dade809f50304164ac7a0b1f52ce8dd7, user_id=94fe0dfd4dcb468f9f24ea2e8802a194, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:37.334577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5b927-6d0a-491e-87dc-a2ccaefed61a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:37.362818 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3006/6002] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:52:37 2022] PUT /identity/v3/projects/dade809f50304164ac7a0b1f52ce8dd7/users/94fe0dfd4dcb468f9f24ea2e8802a194/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:37.373359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0084c45-82be-4a1c-9740-80e72331394f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:37.373702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0084c45-82be-4a1c-9740-80e72331394f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:37.373987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0084c45-82be-4a1c-9740-80e72331394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:37.550290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a0084c45-82be-4a1c-9740-80e72331394f None None] MFA Rules not processed for user `94fe0dfd4dcb468f9f24ea2e8802a194`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:37.551548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a0084c45-82be-4a1c-9740-80e72331394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:37.806972 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2997/6003] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:37.822549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5b927-6d0a-491e-87dc-a2ccaefed61a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:37.824481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-98c5b927-6d0a-491e-87dc-a2ccaefed61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:38.165007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5b927-6d0a-491e-87dc-a2ccaefed61a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:38.202607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c09752-7d96-429c-ae0d-0fca402834d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:38.206185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09752-7d96-429c-ae0d-0fca402834d9 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:38.211012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09752-7d96-429c-ae0d-0fca402834d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:38.211862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09752-7d96-429c-ae0d-0fca402834d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:38.242909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c09752-7d96-429c-ae0d-0fca402834d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:38.245097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c09752-7d96-429c-ae0d-0fca402834d9 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:38.257133 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3007/6004] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:39.899696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0084c45-82be-4a1c-9740-80e72331394f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:39.901611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a0084c45-82be-4a1c-9740-80e72331394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:39.937071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:40.125294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0084c45-82be-4a1c-9740-80e72331394f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:40.150485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282d9b6-46f8-48f3-8a42-1d0a0204c1be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:40.151396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282d9b6-46f8-48f3-8a42-1d0a0204c1be service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:40.151850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282d9b6-46f8-48f3-8a42-1d0a0204c1be service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:40.152284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282d9b6-46f8-48f3-8a42-1d0a0204c1be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:40.155282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e282d9b6-46f8-48f3-8a42-1d0a0204c1be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:40.217977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282d9b6-46f8-48f3-8a42-1d0a0204c1be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:40.254215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282d9b6-46f8-48f3-8a42-1d0a0204c1be service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:40.321017 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2998/6005] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:52:48.252314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=48,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:50.294107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=28 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:56.248894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c09752-7d96-429c-ae0d-0fca402834d9 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:56.599839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c09752-7d96-429c-ae0d-0fca402834d9 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:56.612898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:56.614025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:56.614545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:56.615045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] PATH_INFO: `/v3/users/94fe0dfd4dcb468f9f24ea2e8802a194` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:56.616546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fe0dfd4dcb468f9f24ea2e8802a194)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:56.619113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:56.754557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fe0dfd4dcb468f9f24ea2e8802a194'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:56.760726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fe0dfd4dcb468f9f24ea2e8802a194'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:56.792721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fe0dfd4dcb468f9f24ea2e8802a194'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:56.793912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fe0dfd4dcb468f9f24ea2e8802a194'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:56.822777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fe0dfd4dcb468f9f24ea2e8802a194'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:52:56.886862 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3008/6006] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:52:56 2022] DELETE /identity/v3/users/94fe0dfd4dcb468f9f24ea2e8802a194 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:52:56.888627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103249a-93c0-46f8-a72a-7663d0d4ba56 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:56.890137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103249a-93c0-46f8-a72a-7663d0d4ba56 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:56.890648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103249a-93c0-46f8-a72a-7663d0d4ba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:56.970906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9103249a-93c0-46f8-a72a-7663d0d4ba56 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:52:56.979878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9103249a-93c0-46f8-a72a-7663d0d4ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:57.267459 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 2999/6007] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:52:57.405188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:52:57.406998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:52:57.610543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3bb7d-09b0-4d65-be4c-b84f06ef6fe4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:52:57.615328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc52d4b-7e1c-44c1-be7d-f1d821863e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:52:57.617858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc52d4b-7e1c-44c1-be7d-f1d821863e46 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:52:57.618388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc52d4b-7e1c-44c1-be7d-f1d821863e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:52:57.618830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc52d4b-7e1c-44c1-be7d-f1d821863e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:52:57.640823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc52d4b-7e1c-44c1-be7d-f1d821863e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:52:57.642810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc52d4b-7e1c-44c1-be7d-f1d821863e46 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:52:57.676261 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3009/6008] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:00.273695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103249a-93c0-46f8-a72a-7663d0d4ba56 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:00.275167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9103249a-93c0-46f8-a72a-7663d0d4ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:00.296436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103249a-93c0-46f8-a72a-7663d0d4ba56 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:00.328977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:00.329674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:00.329959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:00.330240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] PATH_INFO: `/v3/projects/dade809f50304164ac7a0b1f52ce8dd7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:00.334257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dade809f50304164ac7a0b1f52ce8dd7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:00.336220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:00.494697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dade809f50304164ac7a0b1f52ce8dd7', 'request_id': 'req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:00.510098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dade809f50304164ac7a0b1f52ce8dd7', 'request_id': 'req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:00.528237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dade809f50304164ac7a0b1f52ce8dd7', 'request_id': 'req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:00.557576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] The token cache is being invalidate because project dade809f50304164ac7a0b1f52ce8dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:00.557878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:00.558553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cc30aca8-6fd2-4352-a2f0-0a8e61a24acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:00.565195 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3000/6009] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:00 2022] DELETE /identity/v3/projects/dade809f50304164ac7a0b1f52ce8dd7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:00.566915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7f88-3e21-4632-887c-10bb8dd7dae9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:00.567753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7f88-3e21-4632-887c-10bb8dd7dae9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:00.568302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7f88-3e21-4632-887c-10bb8dd7dae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:00.604581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-05ae7f88-3e21-4632-887c-10bb8dd7dae9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:00.606043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-05ae7f88-3e21-4632-887c-10bb8dd7dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:00.671258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:00.791255 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3010/6010] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:00.799230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c66fe-2cd1-4525-8e5f-2a0b23e6d01d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:00.799797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c66fe-2cd1-4525-8e5f-2a0b23e6d01d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:00.800260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c66fe-2cd1-4525-8e5f-2a0b23e6d01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:00.845417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4c3c66fe-2cd1-4525-8e5f-2a0b23e6d01d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:00.848542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4c3c66fe-2cd1-4525-8e5f-2a0b23e6d01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:00.874919 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3001/6011] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:00.882984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae7f88-3e21-4632-887c-10bb8dd7dae9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:00.907186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae7f88-3e21-4632-887c-10bb8dd7dae9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:00.920614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72718bd6-a586-4b78-b896-95aa5f6b5823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:00.921738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72718bd6-a586-4b78-b896-95aa5f6b5823 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:00.922254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72718bd6-a586-4b78-b896-95aa5f6b5823 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:00.922792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72718bd6-a586-4b78-b896-95aa5f6b5823 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:00.923815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72718bd6-a586-4b78-b896-95aa5f6b5823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:00.924341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72718bd6-a586-4b78-b896-95aa5f6b5823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:00.926852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72718bd6-a586-4b78-b896-95aa5f6b5823 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:00.943765 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3011/6012] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:00.948231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c66fe-2cd1-4525-8e5f-2a0b23e6d01d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:00.961982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c66fe-2cd1-4525-8e5f-2a0b23e6d01d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:00.976261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fec9d-9976-4e4b-aaba-64f816dfe130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:00.977636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fec9d-9976-4e4b-aaba-64f816dfe130 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:00.978173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fec9d-9976-4e4b-aaba-64f816dfe130 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:00.978675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fec9d-9976-4e4b-aaba-64f816dfe130 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:00.980388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fec9d-9976-4e4b-aaba-64f816dfe130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:00.983254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fec9d-9976-4e4b-aaba-64f816dfe130 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:01.048954 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3002/6013] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:00 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:01.049711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72718bd6-a586-4b78-b896-95aa5f6b5823 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:01.064338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72718bd6-a586-4b78-b896-95aa5f6b5823 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:01.314677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7067577-ed16-4a5e-a3d3-472beced463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:01.316098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7067577-ed16-4a5e-a3d3-472beced463e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:01.316539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7067577-ed16-4a5e-a3d3-472beced463e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:01.317013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7067577-ed16-4a5e-a3d3-472beced463e admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:01.320869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7067577-ed16-4a5e-a3d3-472beced463e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:01.328472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7067577-ed16-4a5e-a3d3-472beced463e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:01.400573 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3012/6014] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:01 2022] POST /identity/v3/users => generated 289 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:01.405238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fec9d-9976-4e4b-aaba-64f816dfe130 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:01.429020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fec9d-9976-4e4b-aaba-64f816dfe130 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:01.441969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a9f2e-9c90-4bca-930d-5b363cf1ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:01.442901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a9f2e-9c90-4bca-930d-5b363cf1ad2b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:01.444470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a9f2e-9c90-4bca-930d-5b363cf1ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:01.444933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a9f2e-9c90-4bca-930d-5b363cf1ad2b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:01.446889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a9f2e-9c90-4bca-930d-5b363cf1ad2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:01.451603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a9f2e-9c90-4bca-930d-5b363cf1ad2b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:01.485562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7067577-ed16-4a5e-a3d3-472beced463e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:01.502456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7067577-ed16-4a5e-a3d3-472beced463e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:01.502862 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3003/6015] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:01.539532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a01ad-0a7e-472b-9a76-7678abfff4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:01.542906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a01ad-0a7e-472b-9a76-7678abfff4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:01.542906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a01ad-0a7e-472b-9a76-7678abfff4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:01.543173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a01ad-0a7e-472b-9a76-7678abfff4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:01.543858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a01ad-0a7e-472b-9a76-7678abfff4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:01.551478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a01ad-0a7e-472b-9a76-7678abfff4a0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:01.585110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a9f2e-9c90-4bca-930d-5b363cf1ad2b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:01.595761 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3013/6016] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:01.598243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a9f2e-9c90-4bca-930d-5b363cf1ad2b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:01.615833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e8754-4325-4484-8646-ba0a741be00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:01.618955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e8754-4325-4484-8646-ba0a741be00d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:01.619512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e8754-4325-4484-8646-ba0a741be00d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:01.620346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e8754-4325-4484-8646-ba0a741be00d admin admin] PATH_INFO: `/v3/projects/40c8dfe3aa504903b706c3fb65a8211e/users/fd4769547d9c4863b66db8c1eff4f8bb/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:01.679703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e8754-4325-4484-8646-ba0a741be00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c8dfe3aa504903b706c3fb65a8211e, user_id=fd4769547d9c4863b66db8c1eff4f8bb, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:01.694516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e8754-4325-4484-8646-ba0a741be00d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:01.745365 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3004/6017] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:01 2022] PUT /identity/v3/projects/40c8dfe3aa504903b706c3fb65a8211e/users/fd4769547d9c4863b66db8c1eff4f8bb/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:01.751292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5c3e-9cd3-41f6-a98e-4be3c9ea16dc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:01.751567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5c3e-9cd3-41f6-a98e-4be3c9ea16dc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:01.754371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5c3e-9cd3-41f6-a98e-4be3c9ea16dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:01.798156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0d7a5c3e-9cd3-41f6-a98e-4be3c9ea16dc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:01.802273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0d7a5c3e-9cd3-41f6-a98e-4be3c9ea16dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:02.168064 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3014/6018] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:02.555745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e8754-4325-4484-8646-ba0a741be00d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:02.558550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-425e8754-4325-4484-8646-ba0a741be00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:02.615332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:02.724416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e8754-4325-4484-8646-ba0a741be00d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:02.730868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e414dd-3430-4162-afa8-6f2a8cd6f68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:02.731582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e414dd-3430-4162-afa8-6f2a8cd6f68b service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:02.731874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e414dd-3430-4162-afa8-6f2a8cd6f68b service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:02.732159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e414dd-3430-4162-afa8-6f2a8cd6f68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:02.770633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e414dd-3430-4162-afa8-6f2a8cd6f68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:02.772141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e414dd-3430-4162-afa8-6f2a8cd6f68b service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:02.793008 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3005/6019] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:03.251958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a5c3e-9cd3-41f6-a98e-4be3c9ea16dc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:03.253634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0d7a5c3e-9cd3-41f6-a98e-4be3c9ea16dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:03.277829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a5c3e-9cd3-41f6-a98e-4be3c9ea16dc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:03.285668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:03.286326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:03.286606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:03.287029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] PATH_INFO: `/v3/users/a8da04cfd0774f62bdfde05d8b99b542` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:03.288416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8da04cfd0774f62bdfde05d8b99b542)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:03.294173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:03.399851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:03.471873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8da04cfd0774f62bdfde05d8b99b542'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:03.476600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8da04cfd0774f62bdfde05d8b99b542'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:03.550156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8da04cfd0774f62bdfde05d8b99b542'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:03.580910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8da04cfd0774f62bdfde05d8b99b542'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:03.619292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8da04cfd0774f62bdfde05d8b99b542'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:03.743694 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3015/6020] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:03 2022] DELETE /identity/v3/users/a8da04cfd0774f62bdfde05d8b99b542 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:03.748333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5ac8-f927-4331-bb42-db4692386488 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:03.749234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5ac8-f927-4331-bb42-db4692386488 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:03.749775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5ac8-f927-4331-bb42-db4692386488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:03.810323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3e8b5ac8-f927-4331-bb42-db4692386488 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:03.825881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3e8b5ac8-f927-4331-bb42-db4692386488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:04.148742 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3006/6021] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:04.176937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:04.179352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:04.429282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7571e-a2c9-4ae9-ada1-527d14c42eb8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:04.438487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819e21a-ceb4-41d7-a6d3-aedf662b455f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:04.440391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819e21a-ceb4-41d7-a6d3-aedf662b455f service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:04.441640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819e21a-ceb4-41d7-a6d3-aedf662b455f service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:04.441941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819e21a-ceb4-41d7-a6d3-aedf662b455f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:04.471681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819e21a-ceb4-41d7-a6d3-aedf662b455f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:04.473657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819e21a-ceb4-41d7-a6d3-aedf662b455f service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:04.496732 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3016/6022] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:04.557106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fcb89-3f41-47dc-9ee6-52ef1b99afac None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:04.557412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fcb89-3f41-47dc-9ee6-52ef1b99afac None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:04.557715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fcb89-3f41-47dc-9ee6-52ef1b99afac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:04.617466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cb0fcb89-3f41-47dc-9ee6-52ef1b99afac None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:04.618725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cb0fcb89-3f41-47dc-9ee6-52ef1b99afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:04.785451 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3007/6023] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:53:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:04.836976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819e21a-ceb4-41d7-a6d3-aedf662b455f service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:04.838445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4819e21a-ceb4-41d7-a6d3-aedf662b455f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:05.063078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819e21a-ceb4-41d7-a6d3-aedf662b455f service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:05.084251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed989c3c-18ea-4005-9025-5948a6da977f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:05.084886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989c3c-18ea-4005-9025-5948a6da977f service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:05.085167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989c3c-18ea-4005-9025-5948a6da977f service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:05.085463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989c3c-18ea-4005-9025-5948a6da977f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:05.120106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed989c3c-18ea-4005-9025-5948a6da977f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:05.121759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed989c3c-18ea-4005-9025-5948a6da977f service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:05.158598 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3017/6024] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:53:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:05.324194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2423763-c830-4998-807e-59e2f008e980 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:05.324485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2423763-c830-4998-807e-59e2f008e980 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:05.324767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2423763-c830-4998-807e-59e2f008e980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:05.404556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f2423763-c830-4998-807e-59e2f008e980 None None] MFA Rules not processed for user `fd4769547d9c4863b66db8c1eff4f8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:05.405852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f2423763-c830-4998-807e-59e2f008e980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:05.627021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:05.657313 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3008/6025] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:05.658288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed989c3c-18ea-4005-9025-5948a6da977f service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:05.660265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ed989c3c-18ea-4005-9025-5948a6da977f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:05.686970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed989c3c-18ea-4005-9025-5948a6da977f service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:05.713046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3ec74-1e95-4a9d-9984-9666addc9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:05.714126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ec74-1e95-4a9d-9984-9666addc9827 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:05.714656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ec74-1e95-4a9d-9984-9666addc9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:05.715182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ec74-1e95-4a9d-9984-9666addc9827 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:05.716042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3ec74-1e95-4a9d-9984-9666addc9827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:05.723728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3ec74-1e95-4a9d-9984-9666addc9827 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:05.825486 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3018/6026] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:05 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:05.829906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2423763-c830-4998-807e-59e2f008e980 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:05.848579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2423763-c830-4998-807e-59e2f008e980 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:06.092233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33247-a09a-4db0-ba76-c09cf2eff043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:06.092718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33247-a09a-4db0-ba76-c09cf2eff043 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:06.093068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33247-a09a-4db0-ba76-c09cf2eff043 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:06.093277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33247-a09a-4db0-ba76-c09cf2eff043 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:06.098351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c33247-a09a-4db0-ba76-c09cf2eff043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:06.100357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c33247-a09a-4db0-ba76-c09cf2eff043 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:06.154830 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3009/6027] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:05 2022] POST /identity/v3/users => generated 295 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:06.159052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3ec74-1e95-4a9d-9984-9666addc9827 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:06.183072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3ec74-1e95-4a9d-9984-9666addc9827 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:06.205168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4fe9-eda8-4e31-aad9-6fce8d72bcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:06.206885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4fe9-eda8-4e31-aad9-6fce8d72bcdc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:06.207451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4fe9-eda8-4e31-aad9-6fce8d72bcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:06.207920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4fe9-eda8-4e31-aad9-6fce8d72bcdc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:06.209188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4fe9-eda8-4e31-aad9-6fce8d72bcdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:06.212359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4fe9-eda8-4e31-aad9-6fce8d72bcdc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:06.219575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:06.238983 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3019/6028] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:06.239809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33247-a09a-4db0-ba76-c09cf2eff043 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:06.253128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33247-a09a-4db0-ba76-c09cf2eff043 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:06.272052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ceb6a-760d-42c0-a92a-917980ed165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:06.273005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ceb6a-760d-42c0-a92a-917980ed165a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:06.273512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ceb6a-760d-42c0-a92a-917980ed165a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:06.273967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ceb6a-760d-42c0-a92a-917980ed165a admin admin] PATH_INFO: `/v3/projects/7239953e77ef49329cf43f2bd49d9e06/users/d935ac8758d54f35bd955a095782668a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:06.309298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ceb6a-760d-42c0-a92a-917980ed165a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7239953e77ef49329cf43f2bd49d9e06, user_id=d935ac8758d54f35bd955a095782668a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:06.312576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ceb6a-760d-42c0-a92a-917980ed165a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:06.344650 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3010/6029] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:06 2022] PUT /identity/v3/projects/7239953e77ef49329cf43f2bd49d9e06/users/d935ac8758d54f35bd955a095782668a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:06.349004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4fe9-eda8-4e31-aad9-6fce8d72bcdc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:06.378608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4fe9-eda8-4e31-aad9-6fce8d72bcdc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:06.514135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96a813-0db6-461c-8a2e-163fe7a89054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:06.515019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96a813-0db6-461c-8a2e-163fe7a89054 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:06.515367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96a813-0db6-461c-8a2e-163fe7a89054 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:06.515647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96a813-0db6-461c-8a2e-163fe7a89054 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:06.516731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96a813-0db6-461c-8a2e-163fe7a89054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:06.518413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96a813-0db6-461c-8a2e-163fe7a89054 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:06.540121 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3020/6030] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:06.540648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ceb6a-760d-42c0-a92a-917980ed165a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:06.556924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ceb6a-760d-42c0-a92a-917980ed165a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:06.582088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bd8dc-8da8-4415-a061-0101a8140c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:06.582790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bd8dc-8da8-4415-a061-0101a8140c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:06.583072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bd8dc-8da8-4415-a061-0101a8140c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:06.583572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bd8dc-8da8-4415-a061-0101a8140c93 admin admin] PATH_INFO: `/v3/projects/7239953e77ef49329cf43f2bd49d9e06/users/d935ac8758d54f35bd955a095782668a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:06.586608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bd8dc-8da8-4415-a061-0101a8140c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7239953e77ef49329cf43f2bd49d9e06, user_id=d935ac8758d54f35bd955a095782668a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:06.589517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bd8dc-8da8-4415-a061-0101a8140c93 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:06.604387 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3011/6031] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:06 2022] PUT /identity/v3/projects/7239953e77ef49329cf43f2bd49d9e06/users/d935ac8758d54f35bd955a095782668a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:06.781943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96a813-0db6-461c-8a2e-163fe7a89054 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:06.784007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cd96a813-0db6-461c-8a2e-163fe7a89054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:06.810210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96a813-0db6-461c-8a2e-163fe7a89054 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:06.989859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:06.990745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:06.991342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:06.992139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] PATH_INFO: `/v3/projects/6bb72778b3ce4c95b83fcd328ddaed9a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:06.994979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bb72778b3ce4c95b83fcd328ddaed9a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:07.002152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:07.100382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bb72778b3ce4c95b83fcd328ddaed9a', 'request_id': 'req-2324a6ad-4890-459a-b9dd-a335d9219463'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:07.110786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bb72778b3ce4c95b83fcd328ddaed9a', 'request_id': 'req-2324a6ad-4890-459a-b9dd-a335d9219463'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:07.127363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bb72778b3ce4c95b83fcd328ddaed9a', 'request_id': 'req-2324a6ad-4890-459a-b9dd-a335d9219463'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:07.159060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] The token cache is being invalidate because project 6bb72778b3ce4c95b83fcd328ddaed9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:07.159354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:07.161400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2324a6ad-4890-459a-b9dd-a335d9219463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:07.163250 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3021/6032] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:06 2022] DELETE /identity/v3/projects/6bb72778b3ce4c95b83fcd328ddaed9a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:07.168756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed75dd-d686-4805-ad83-536e8ab984b5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:07.171384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed75dd-d686-4805-ad83-536e8ab984b5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:07.171918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed75dd-d686-4805-ad83-536e8ab984b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:07.273994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0eed75dd-d686-4805-ad83-536e8ab984b5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:07.278293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0eed75dd-d686-4805-ad83-536e8ab984b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:07.408240 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3012/6033] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:07.416757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234333b-074c-4fd3-aab4-6e404a6d239d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:07.417153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234333b-074c-4fd3-aab4-6e404a6d239d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:07.417492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234333b-074c-4fd3-aab4-6e404a6d239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:07.456640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1234333b-074c-4fd3-aab4-6e404a6d239d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:07.458081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1234333b-074c-4fd3-aab4-6e404a6d239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:07.474639 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3022/6034] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:07.475982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed75dd-d686-4805-ad83-536e8ab984b5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:07.493765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed75dd-d686-4805-ad83-536e8ab984b5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:07.522380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbd031-5bfb-4e49-bc6a-c30d0bee6777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:07.524352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbd031-5bfb-4e49-bc6a-c30d0bee6777 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:07.524638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbd031-5bfb-4e49-bc6a-c30d0bee6777 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:07.525216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbd031-5bfb-4e49-bc6a-c30d0bee6777 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:07.527842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbd031-5bfb-4e49-bc6a-c30d0bee6777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:07.528156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbd031-5bfb-4e49-bc6a-c30d0bee6777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:07.529882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbd031-5bfb-4e49-bc6a-c30d0bee6777 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:07.560043 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3013/6035] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:07.564641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234333b-074c-4fd3-aab4-6e404a6d239d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:07.588412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234333b-074c-4fd3-aab4-6e404a6d239d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:07.606603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727dd86-2693-4351-be14-3918b454296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:07.608049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727dd86-2693-4351-be14-3918b454296f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:07.608996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727dd86-2693-4351-be14-3918b454296f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:07.608996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727dd86-2693-4351-be14-3918b454296f admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:07.610222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727dd86-2693-4351-be14-3918b454296f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:07.624613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727dd86-2693-4351-be14-3918b454296f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:07.692078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:07.703922 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3023/6036] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:07 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:07.707671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbd031-5bfb-4e49-bc6a-c30d0bee6777 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:07.725105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbd031-5bfb-4e49-bc6a-c30d0bee6777 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:07.832195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:07.944319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17929021-3236-4642-bcb3-076b7a3fbe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:07.946056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17929021-3236-4642-bcb3-076b7a3fbe44 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:07.946477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17929021-3236-4642-bcb3-076b7a3fbe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:07.947120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17929021-3236-4642-bcb3-076b7a3fbe44 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:07.948499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17929021-3236-4642-bcb3-076b7a3fbe44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:07.952851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17929021-3236-4642-bcb3-076b7a3fbe44 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:08.071517 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3014/6037] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:07 2022] POST /identity/v3/users => generated 287 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:08.127942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727dd86-2693-4351-be14-3918b454296f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:08.213780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727dd86-2693-4351-be14-3918b454296f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:08.238260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd937b-3569-480b-b2c1-3ff58894fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:08.239648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd937b-3569-480b-b2c1-3ff58894fe5a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:08.239939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd937b-3569-480b-b2c1-3ff58894fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:08.240494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd937b-3569-480b-b2c1-3ff58894fe5a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:08.241821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd937b-3569-480b-b2c1-3ff58894fe5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:08.247579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd937b-3569-480b-b2c1-3ff58894fe5a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:08.269455 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3024/6038] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:08.277570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17929021-3236-4642-bcb3-076b7a3fbe44 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:08.328269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17929021-3236-4642-bcb3-076b7a3fbe44 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:08.339367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204ccfb-b583-4e78-b528-aa57e3533250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:08.340814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204ccfb-b583-4e78-b528-aa57e3533250 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:08.341362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204ccfb-b583-4e78-b528-aa57e3533250 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:08.342610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204ccfb-b583-4e78-b528-aa57e3533250 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:08.344442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204ccfb-b583-4e78-b528-aa57e3533250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:08.348014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204ccfb-b583-4e78-b528-aa57e3533250 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:08.386101 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3015/6039] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:08.388066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd937b-3569-480b-b2c1-3ff58894fe5a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:08.406572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd937b-3569-480b-b2c1-3ff58894fe5a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:08.429921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86af73-0c68-4c3c-bdd8-8a006ebb0bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:08.431366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86af73-0c68-4c3c-bdd8-8a006ebb0bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:08.431726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86af73-0c68-4c3c-bdd8-8a006ebb0bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:08.432180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86af73-0c68-4c3c-bdd8-8a006ebb0bf5 admin admin] PATH_INFO: `/v3/projects/912759d94bb94f538d9c26344fd358e5/users/3cff49ac81154056860c4d1e0bb4c5ef/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:08.478342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86af73-0c68-4c3c-bdd8-8a006ebb0bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=912759d94bb94f538d9c26344fd358e5, user_id=3cff49ac81154056860c4d1e0bb4c5ef, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:08.481454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86af73-0c68-4c3c-bdd8-8a006ebb0bf5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:08.513056 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3025/6040] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:08 2022] PUT /identity/v3/projects/912759d94bb94f538d9c26344fd358e5/users/3cff49ac81154056860c4d1e0bb4c5ef/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:08.527890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141577d-49f8-4b9b-8de3-ab2d4f7f3b0d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:08.528338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141577d-49f8-4b9b-8de3-ab2d4f7f3b0d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:08.528669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141577d-49f8-4b9b-8de3-ab2d4f7f3b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:08.641318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5141577d-49f8-4b9b-8de3-ab2d4f7f3b0d None None] MFA Rules not processed for user `3cff49ac81154056860c4d1e0bb4c5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:08.643606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5141577d-49f8-4b9b-8de3-ab2d4f7f3b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:08.857250 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3016/6041] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:08.857541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86af73-0c68-4c3c-bdd8-8a006ebb0bf5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:08.857541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cf86af73-0c68-4c3c-bdd8-8a006ebb0bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:09.094947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86af73-0c68-4c3c-bdd8-8a006ebb0bf5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:09.106285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12079ab3-6fb6-4449-a2aa-c6ae2e20d13d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:09.110331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12079ab3-6fb6-4449-a2aa-c6ae2e20d13d service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:09.110870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12079ab3-6fb6-4449-a2aa-c6ae2e20d13d service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:09.111310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12079ab3-6fb6-4449-a2aa-c6ae2e20d13d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:09.120068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-12079ab3-6fb6-4449-a2aa-c6ae2e20d13d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:09.155987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12079ab3-6fb6-4449-a2aa-c6ae2e20d13d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:09.157646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12079ab3-6fb6-4449-a2aa-c6ae2e20d13d service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:09.175336 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3026/6042] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:09.342079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141577d-49f8-4b9b-8de3-ab2d4f7f3b0d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:09.343798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5141577d-49f8-4b9b-8de3-ab2d4f7f3b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:09.547367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f096931-0b18-46c0-9891-f730cc94a565 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:09.547697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f096931-0b18-46c0-9891-f730cc94a565 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:09.547948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f096931-0b18-46c0-9891-f730cc94a565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:09.584882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141577d-49f8-4b9b-8de3-ab2d4f7f3b0d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:09.625333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3f881-42f0-4aa7-a658-9f5168ebde25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:09.629802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f881-42f0-4aa7-a658-9f5168ebde25 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:09.630385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f881-42f0-4aa7-a658-9f5168ebde25 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:09.630834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f881-42f0-4aa7-a658-9f5168ebde25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:09.659422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5f096931-0b18-46c0-9891-f730cc94a565 None None] MFA Rules not processed for user `d935ac8758d54f35bd955a095782668a`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:09.660750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5f096931-0b18-46c0-9891-f730cc94a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:09.667787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3f881-42f0-4aa7-a658-9f5168ebde25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:09.669429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3f881-42f0-4aa7-a658-9f5168ebde25 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:09.689714 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3017/6043] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:09.815657 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3027/6044] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:10.008054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf97b3-b1c8-4690-a771-8ac5450b0bcb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:10.008638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf97b3-b1c8-4690-a771-8ac5450b0bcb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:10.009016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf97b3-b1c8-4690-a771-8ac5450b0bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:10.055028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-46cf97b3-b1c8-4690-a771-8ac5450b0bcb None None] MFA Rules not processed for user `fd4769547d9c4863b66db8c1eff4f8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:10.057573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-46cf97b3-b1c8-4690-a771-8ac5450b0bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:10.132648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:10.193856 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3018/6045] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:10.326641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f096931-0b18-46c0-9891-f730cc94a565 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:10.377573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f096931-0b18-46c0-9891-f730cc94a565 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:10.393560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8426cfb-836d-407a-9650-76b0aeb77355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:10.394372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8426cfb-836d-407a-9650-76b0aeb77355 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:10.394793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8426cfb-836d-407a-9650-76b0aeb77355 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:10.395264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8426cfb-836d-407a-9650-76b0aeb77355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:10.398114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c8426cfb-836d-407a-9650-76b0aeb77355 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:10.419151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8426cfb-836d-407a-9650-76b0aeb77355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:10.422288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8426cfb-836d-407a-9650-76b0aeb77355 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:10.439497 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3028/6046] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:11.235395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf97b3-b1c8-4690-a771-8ac5450b0bcb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:11.238431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-46cf97b3-b1c8-4690-a771-8ac5450b0bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:11.501208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf97b3-b1c8-4690-a771-8ac5450b0bcb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:11.510126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d784b-0850-4e8e-8748-94629987d74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:11.514101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d784b-0850-4e8e-8748-94629987d74c service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:11.514871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d784b-0850-4e8e-8748-94629987d74c service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:11.515380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d784b-0850-4e8e-8748-94629987d74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:11.520859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-143d784b-0850-4e8e-8748-94629987d74c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:11.560369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d784b-0850-4e8e-8748-94629987d74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:11.563342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d784b-0850-4e8e-8748-94629987d74c service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:11.589773 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3019/6047] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:11.937185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8426cfb-836d-407a-9650-76b0aeb77355 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:11.997023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:12.085998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8426cfb-836d-407a-9650-76b0aeb77355 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:12.102344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:12.103323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:12.103812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:12.104277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] PATH_INFO: `/v3/users/3cff49ac81154056860c4d1e0bb4c5ef` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:12.108663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cff49ac81154056860c4d1e0bb4c5ef)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:12.111991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:12.227154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cff49ac81154056860c4d1e0bb4c5ef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:12.227877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cff49ac81154056860c4d1e0bb4c5ef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:12.260102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cff49ac81154056860c4d1e0bb4c5ef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:12.260701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cff49ac81154056860c4d1e0bb4c5ef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:12.289518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cff49ac81154056860c4d1e0bb4c5ef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:12.321959 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3029/6048] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:11 2022] DELETE /identity/v3/users/3cff49ac81154056860c4d1e0bb4c5ef => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:12.328189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814ab57-0f8c-44f6-b874-cc9cf34c8841 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:12.331801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814ab57-0f8c-44f6-b874-cc9cf34c8841 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:12.332207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814ab57-0f8c-44f6-b874-cc9cf34c8841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:12.407651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b814ab57-0f8c-44f6-b874-cc9cf34c8841 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:12.410144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b814ab57-0f8c-44f6-b874-cc9cf34c8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:12.642898 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3020/6049] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:12.763832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:12.766106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:12.873868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10396aee-32bf-4324-bbca-815343c0e7ae admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:12.887333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de9274-a0a0-4a56-9d36-1761c4618a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:12.888038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9274-a0a0-4a56-9d36-1761c4618a08 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:12.888686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9274-a0a0-4a56-9d36-1761c4618a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:12.889353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9274-a0a0-4a56-9d36-1761c4618a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:12.917185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de9274-a0a0-4a56-9d36-1761c4618a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:12.923398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de9274-a0a0-4a56-9d36-1761c4618a08 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:12.948279 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3030/6050] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:14.587569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814ab57-0f8c-44f6-b874-cc9cf34c8841 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:14.588583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de9274-a0a0-4a56-9d36-1761c4618a08 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:14.590298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b814ab57-0f8c-44f6-b874-cc9cf34c8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:14.590913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f2de9274-a0a0-4a56-9d36-1761c4618a08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:14.616020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de9274-a0a0-4a56-9d36-1761c4618a08 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:14.627502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:14.628525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:14.628784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:14.629062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] PATH_INFO: `/v3/projects/912759d94bb94f538d9c26344fd358e5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:14.631179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=912759d94bb94f538d9c26344fd358e5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:14.633870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:14.711870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:14.737855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814ab57-0f8c-44f6-b874-cc9cf34c8841 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:14.744790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '912759d94bb94f538d9c26344fd358e5', 'request_id': 'req-77928bd9-2572-476b-a663-ee5ded300aa5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:14.754510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '912759d94bb94f538d9c26344fd358e5', 'request_id': 'req-77928bd9-2572-476b-a663-ee5ded300aa5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:14.762590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:14.764517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '912759d94bb94f538d9c26344fd358e5', 'request_id': 'req-77928bd9-2572-476b-a663-ee5ded300aa5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:14.781801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] The token cache is being invalidate because project 912759d94bb94f538d9c26344fd358e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:14.782142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:14.782739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-77928bd9-2572-476b-a663-ee5ded300aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:14.784555 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3031/6051] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:14 2022] DELETE /identity/v3/projects/912759d94bb94f538d9c26344fd358e5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:14.793618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91a5e-ab2c-47af-b184-1848f4970792 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:14.794458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91a5e-ab2c-47af-b184-1848f4970792 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:14.795226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91a5e-ab2c-47af-b184-1848f4970792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:14.843913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-14f91a5e-ab2c-47af-b184-1848f4970792 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:14.845372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-14f91a5e-ab2c-47af-b184-1848f4970792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:14.852802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a420af8-105f-4cc8-9e93-0f92b813d127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:14.853829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a420af8-105f-4cc8-9e93-0f92b813d127 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:14.854278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a420af8-105f-4cc8-9e93-0f92b813d127 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:14.854882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a420af8-105f-4cc8-9e93-0f92b813d127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:14.858356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4a420af8-105f-4cc8-9e93-0f92b813d127 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:14.877136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a420af8-105f-4cc8-9e93-0f92b813d127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:14.885529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a420af8-105f-4cc8-9e93-0f92b813d127 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:14.904712 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3021/6052] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:14.941470 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3032/6053] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:14.949344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2d0e0-5cb2-4b0e-8a48-1dabb66f464a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:14.949725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2d0e0-5cb2-4b0e-8a48-1dabb66f464a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:14.949954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2d0e0-5cb2-4b0e-8a48-1dabb66f464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:14.994603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-72f2d0e0-5cb2-4b0e-8a48-1dabb66f464a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:14.996603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72f2d0e0-5cb2-4b0e-8a48-1dabb66f464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:15.020915 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3022/6054] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:15.022715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f91a5e-ab2c-47af-b184-1848f4970792 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:15.041633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f91a5e-ab2c-47af-b184-1848f4970792 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:15.048926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd2a19-af83-4731-9acf-9f41a5d82085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:15.050665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd2a19-af83-4731-9acf-9f41a5d82085 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:15.051175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd2a19-af83-4731-9acf-9f41a5d82085 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:15.051671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd2a19-af83-4731-9acf-9f41a5d82085 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:15.052546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd2a19-af83-4731-9acf-9f41a5d82085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:15.053062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd2a19-af83-4731-9acf-9f41a5d82085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:15.055032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd2a19-af83-4731-9acf-9f41a5d82085 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:15.072218 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3033/6055] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:15.076628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2d0e0-5cb2-4b0e-8a48-1dabb66f464a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:15.097821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2d0e0-5cb2-4b0e-8a48-1dabb66f464a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:15.109628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2948b02-4bb7-4ab6-b86e-8099e8bd592f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:15.110266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2948b02-4bb7-4ab6-b86e-8099e8bd592f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:15.110730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2948b02-4bb7-4ab6-b86e-8099e8bd592f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:15.111019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2948b02-4bb7-4ab6-b86e-8099e8bd592f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:15.111739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2948b02-4bb7-4ab6-b86e-8099e8bd592f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:15.113726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2948b02-4bb7-4ab6-b86e-8099e8bd592f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:15.193081 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3023/6056] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:15 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:15.196905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd2a19-af83-4731-9acf-9f41a5d82085 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:15.213456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd2a19-af83-4731-9acf-9f41a5d82085 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:15.321840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e9ca6-dec4-4687-adad-9d09df53af53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:15.322563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e9ca6-dec4-4687-adad-9d09df53af53 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:15.323035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e9ca6-dec4-4687-adad-9d09df53af53 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:15.324481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e9ca6-dec4-4687-adad-9d09df53af53 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:15.324709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e9ca6-dec4-4687-adad-9d09df53af53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:15.328294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e9ca6-dec4-4687-adad-9d09df53af53 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:15.366233 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3034/6057] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:15 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:15.367841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2948b02-4bb7-4ab6-b86e-8099e8bd592f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:15.386066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2948b02-4bb7-4ab6-b86e-8099e8bd592f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:15.398222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f3d51-684f-42f6-a1a4-e36b89b267c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:15.398887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f3d51-684f-42f6-a1a4-e36b89b267c9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:15.399374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f3d51-684f-42f6-a1a4-e36b89b267c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:15.400806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f3d51-684f-42f6-a1a4-e36b89b267c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:15.400806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f3d51-684f-42f6-a1a4-e36b89b267c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:15.402289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f3d51-684f-42f6-a1a4-e36b89b267c9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:15.420252 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3024/6058] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:53:15.422371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e9ca6-dec4-4687-adad-9d09df53af53 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:15.439718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e9ca6-dec4-4687-adad-9d09df53af53 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:15.445051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab46d9f-857b-4457-b46c-d644364da110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:15.445704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46d9f-857b-4457-b46c-d644364da110 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:15.446053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46d9f-857b-4457-b46c-d644364da110 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:15.446234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46d9f-857b-4457-b46c-d644364da110 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:15.447595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab46d9f-857b-4457-b46c-d644364da110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:15.448542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab46d9f-857b-4457-b46c-d644364da110 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:15.464832 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3035/6059] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:15.469257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f3d51-684f-42f6-a1a4-e36b89b267c9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:15.481426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f3d51-684f-42f6-a1a4-e36b89b267c9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:15.487767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be848a-3071-4bfe-90cf-5f8809b46eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:15.488692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be848a-3071-4bfe-90cf-5f8809b46eca admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:15.489097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be848a-3071-4bfe-90cf-5f8809b46eca admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:15.489472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be848a-3071-4bfe-90cf-5f8809b46eca admin admin] PATH_INFO: `/v3/projects/8b63ea4e2f774da4b58e8f9dd9a5ba3e/users/c87e0b5576b6485ba2d8768c8d79d95a/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:15.511477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be848a-3071-4bfe-90cf-5f8809b46eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b63ea4e2f774da4b58e8f9dd9a5ba3e, user_id=c87e0b5576b6485ba2d8768c8d79d95a, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:15.518502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be848a-3071-4bfe-90cf-5f8809b46eca admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:15.544116 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3025/6060] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:15 2022] PUT /identity/v3/projects/8b63ea4e2f774da4b58e8f9dd9a5ba3e/users/c87e0b5576b6485ba2d8768c8d79d95a/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:15.559882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9bef6-3e39-4572-9d91-901de054ae0e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:15.560683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9bef6-3e39-4572-9d91-901de054ae0e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:15.561236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9bef6-3e39-4572-9d91-901de054ae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:15.620696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-82b9bef6-3e39-4572-9d91-901de054ae0e None None] MFA Rules not processed for user `c87e0b5576b6485ba2d8768c8d79d95a`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:15.622148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-82b9bef6-3e39-4572-9d91-901de054ae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:15.657105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:15.751420 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3036/6061] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:15.755086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be848a-3071-4bfe-90cf-5f8809b46eca admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:15.999705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be848a-3071-4bfe-90cf-5f8809b46eca admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:16.010881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f05d8-036b-4184-8f01-85708f44b8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:16.013019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f05d8-036b-4184-8f01-85708f44b8eb admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:16.013656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f05d8-036b-4184-8f01-85708f44b8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:16.014319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f05d8-036b-4184-8f01-85708f44b8eb admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:16.015619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f05d8-036b-4184-8f01-85708f44b8eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:16.022553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f05d8-036b-4184-8f01-85708f44b8eb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:16.131135 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3026/6062] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:15 2022] POST /identity/v3/projects => generated 375 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:16.133956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9bef6-3e39-4572-9d91-901de054ae0e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:16.150687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9bef6-3e39-4572-9d91-901de054ae0e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:16.315496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12765a1-0b38-41ad-846b-04909476bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:16.316274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12765a1-0b38-41ad-846b-04909476bc77 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:16.316608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12765a1-0b38-41ad-846b-04909476bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:16.316890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12765a1-0b38-41ad-846b-04909476bc77 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:16.318876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12765a1-0b38-41ad-846b-04909476bc77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:16.323121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12765a1-0b38-41ad-846b-04909476bc77 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:16.401522 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3037/6063] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:16 2022] POST /identity/v3/users => generated 294 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:16.405152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f05d8-036b-4184-8f01-85708f44b8eb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:16.441227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f05d8-036b-4184-8f01-85708f44b8eb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:16.461250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ce98-0969-4a7a-ae0e-1ea7e403e3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:16.462036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ce98-0969-4a7a-ae0e-1ea7e403e3fa admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:16.462224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ce98-0969-4a7a-ae0e-1ea7e403e3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:16.462471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ce98-0969-4a7a-ae0e-1ea7e403e3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:16.463140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ce98-0969-4a7a-ae0e-1ea7e403e3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:16.477036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ce98-0969-4a7a-ae0e-1ea7e403e3fa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:16.517690 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3027/6064] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:16.522521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12765a1-0b38-41ad-846b-04909476bc77 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:16.541171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12765a1-0b38-41ad-846b-04909476bc77 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:16.551382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72152dd8-73b0-463f-9718-4a8b62dbced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:16.552137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72152dd8-73b0-463f-9718-4a8b62dbced4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:16.552488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72152dd8-73b0-463f-9718-4a8b62dbced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:16.552768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72152dd8-73b0-463f-9718-4a8b62dbced4 admin admin] PATH_INFO: `/v3/projects/be68c9ebf50e4346a34cd4c981957979/users/99d3252338e34305b42cc19bf9396aca/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:16.592995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72152dd8-73b0-463f-9718-4a8b62dbced4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be68c9ebf50e4346a34cd4c981957979, user_id=99d3252338e34305b42cc19bf9396aca, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:16.597312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72152dd8-73b0-463f-9718-4a8b62dbced4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:16.642230 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3038/6065] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:16 2022] PUT /identity/v3/projects/be68c9ebf50e4346a34cd4c981957979/users/99d3252338e34305b42cc19bf9396aca/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:16.648093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ce98-0969-4a7a-ae0e-1ea7e403e3fa admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:16.671570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ce98-0969-4a7a-ae0e-1ea7e403e3fa admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:16.707018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:16.854237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1019b-f3ff-4ee0-8fb8-e987f553d6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:16.855761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1019b-f3ff-4ee0-8fb8-e987f553d6dd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:16.856315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1019b-f3ff-4ee0-8fb8-e987f553d6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:16.856828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1019b-f3ff-4ee0-8fb8-e987f553d6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:16.858107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1019b-f3ff-4ee0-8fb8-e987f553d6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:16.860223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1019b-f3ff-4ee0-8fb8-e987f553d6dd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:16.877729 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3028/6066] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:53:16.882096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72152dd8-73b0-463f-9718-4a8b62dbced4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:16.896576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72152dd8-73b0-463f-9718-4a8b62dbced4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:16.905541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71234f0c-d98d-4e77-8bcc-9f46209b21f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:16.906400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71234f0c-d98d-4e77-8bcc-9f46209b21f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:16.906796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71234f0c-d98d-4e77-8bcc-9f46209b21f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:16.907210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71234f0c-d98d-4e77-8bcc-9f46209b21f8 admin admin] PATH_INFO: `/v3/projects/be68c9ebf50e4346a34cd4c981957979/users/99d3252338e34305b42cc19bf9396aca/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:16.909722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71234f0c-d98d-4e77-8bcc-9f46209b21f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be68c9ebf50e4346a34cd4c981957979, user_id=99d3252338e34305b42cc19bf9396aca, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:16.914571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71234f0c-d98d-4e77-8bcc-9f46209b21f8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:16.956232 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3039/6067] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:16 2022] PUT /identity/v3/projects/be68c9ebf50e4346a34cd4c981957979/users/99d3252338e34305b42cc19bf9396aca/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:16.961019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4c8cb-745c-4721-9198-a1d526c9873d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:16.961331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4c8cb-745c-4721-9198-a1d526c9873d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:16.962353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4c8cb-745c-4721-9198-a1d526c9873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:17.032418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-88c4c8cb-745c-4721-9198-a1d526c9873d None None] MFA Rules not processed for user `99d3252338e34305b42cc19bf9396aca`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:17.040068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-88c4c8cb-745c-4721-9198-a1d526c9873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:17.149797 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3029/6068] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:17.154762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71234f0c-d98d-4e77-8bcc-9f46209b21f8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:17.178219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71234f0c-d98d-4e77-8bcc-9f46209b21f8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:17.187267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51912b13-690d-4957-acaf-0e8abfce7106 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d3252338e34305b42cc19bf9396aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be68c9ebf50e4346a34cd4c981957979', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:17.188205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51912b13-690d-4957-acaf-0e8abfce7106 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:17.188648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51912b13-690d-4957-acaf-0e8abfce7106 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:17.189130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51912b13-690d-4957-acaf-0e8abfce7106 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:17.190134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51912b13-690d-4957-acaf-0e8abfce7106 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:17.192807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51912b13-690d-4957-acaf-0e8abfce7106 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:17.237173 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3040/6069] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:53:17 2022] POST /identity/v3/domains => generated 245 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:17.241331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4c8cb-745c-4721-9198-a1d526c9873d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:17.253983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4c8cb-745c-4721-9198-a1d526c9873d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:17.435037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a076c7b-5010-489d-a42b-7bbc3f659535 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d3252338e34305b42cc19bf9396aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be68c9ebf50e4346a34cd4c981957979', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:17.439854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a076c7b-5010-489d-a42b-7bbc3f659535 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:17.440761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a076c7b-5010-489d-a42b-7bbc3f659535 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:17.441071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a076c7b-5010-489d-a42b-7bbc3f659535 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:17.442709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a076c7b-5010-489d-a42b-7bbc3f659535 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:17.447159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a076c7b-5010-489d-a42b-7bbc3f659535 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:17.501214 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3030/6070] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:17 2022] POST /identity/v3/projects => generated 410 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:17.509896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51912b13-690d-4957-acaf-0e8abfce7106 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:17.530808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51912b13-690d-4957-acaf-0e8abfce7106 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:17.617337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bd337-f143-4efd-ac7b-3d256273cf0e tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d3252338e34305b42cc19bf9396aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be68c9ebf50e4346a34cd4c981957979', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:17.617989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bd337-f143-4efd-ac7b-3d256273cf0e tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:17.618892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bd337-f143-4efd-ac7b-3d256273cf0e tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:17.618892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bd337-f143-4efd-ac7b-3d256273cf0e tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:17.619183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bd337-f143-4efd-ac7b-3d256273cf0e tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:17.621649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bd337-f143-4efd-ac7b-3d256273cf0e tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:17.634545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:17.650487 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3041/6071] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:17 2022] POST /identity/v3/users => generated 347 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:17.654826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a076c7b-5010-489d-a42b-7bbc3f659535 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:17.666027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a076c7b-5010-489d-a42b-7bbc3f659535 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:17.673495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500d6dd-1351-48d3-bd35-b48078316c10 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d3252338e34305b42cc19bf9396aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be68c9ebf50e4346a34cd4c981957979', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:17.673495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500d6dd-1351-48d3-bd35-b48078316c10 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:17.673495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500d6dd-1351-48d3-bd35-b48078316c10 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:17.673898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500d6dd-1351-48d3-bd35-b48078316c10 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:17.673898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500d6dd-1351-48d3-bd35-b48078316c10 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:17.675530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500d6dd-1351-48d3-bd35-b48078316c10 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:17.682565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:17.695076 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3031/6072] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:53:17.696288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bd337-f143-4efd-ac7b-3d256273cf0e tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:17.711366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bd337-f143-4efd-ac7b-3d256273cf0e tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:17.724650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2927887-6551-4103-b8a5-4070327b16c7 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d3252338e34305b42cc19bf9396aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be68c9ebf50e4346a34cd4c981957979', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:17.725326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927887-6551-4103-b8a5-4070327b16c7 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:17.725697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927887-6551-4103-b8a5-4070327b16c7 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:17.725914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927887-6551-4103-b8a5-4070327b16c7 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] PATH_INFO: `/v3/projects/9eadd7bb98e54d05b2994df8f7870bde/users/9f9ee2b868724da99bd333578df71e3a/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:17.754630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2927887-6551-4103-b8a5-4070327b16c7 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9eadd7bb98e54d05b2994df8f7870bde, user_id=9f9ee2b868724da99bd333578df71e3a, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:17.757441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2927887-6551-4103-b8a5-4070327b16c7 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:17.774764 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3042/6073] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:17 2022] PUT /identity/v3/projects/9eadd7bb98e54d05b2994df8f7870bde/users/9f9ee2b868724da99bd333578df71e3a/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:17.779774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80e5c-78e3-4729-89bd-64fd2bcc305a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:17.780095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80e5c-78e3-4729-89bd-64fd2bcc305a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:17.780339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80e5c-78e3-4729-89bd-64fd2bcc305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:17.944999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c8c80e5c-78e3-4729-89bd-64fd2bcc305a None None] MFA Rules not processed for user `9f9ee2b868724da99bd333578df71e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:17.948247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c8c80e5c-78e3-4729-89bd-64fd2bcc305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:17.989913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c95cd-ee0c-449b-80cc-c55845409ace None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:17.990520 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3032/6074] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:17 2022] POST /identity/v3/auth/tokens => generated 3360 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:17.991072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c95cd-ee0c-449b-80cc-c55845409ace None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:17.991357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c95cd-ee0c-449b-80cc-c55845409ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:18.032471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cd5c95cd-ee0c-449b-80cc-c55845409ace None None] MFA Rules not processed for user `9f9ee2b868724da99bd333578df71e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:18.037307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cd5c95cd-ee0c-449b-80cc-c55845409ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:18.057615 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3043/6075] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:17 2022] POST /identity/v3/auth/tokens => generated 3360 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:18.058923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c80e5c-78e3-4729-89bd-64fd2bcc305a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:18.090226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c80e5c-78e3-4729-89bd-64fd2bcc305a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:18.102788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437bc96-82c7-43f6-9f4a-20d53410f912 tempest-test_project-2090025266 tempest-user-816582881] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f9ee2b868724da99bd333578df71e3a', 'user_domain_id': '59fb78f149ae4a4392ce9e878d4631d4', 'system_scope': None, 'project_id': '9eadd7bb98e54d05b2994df8f7870bde', 'project_domain_id': '59fb78f149ae4a4392ce9e878d4631d4', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:18.103424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437bc96-82c7-43f6-9f4a-20d53410f912 tempest-test_project-2090025266 tempest-user-816582881] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:18.103707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437bc96-82c7-43f6-9f4a-20d53410f912 tempest-test_project-2090025266 tempest-user-816582881] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:18.103987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437bc96-82c7-43f6-9f4a-20d53410f912 tempest-test_project-2090025266 tempest-user-816582881] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:18.130937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437bc96-82c7-43f6-9f4a-20d53410f912 tempest-test_project-2090025266 tempest-user-816582881] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:18.133554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437bc96-82c7-43f6-9f4a-20d53410f912 tempest-test_project-2090025266 tempest-user-816582881] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:18.163884 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3033/6076] 10.222.0.16 () {56 vars in 1284 bytes} [Mon Aug 29 15:53:18 2022] GET /identity/v3/auth/tokens => generated 3360 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:18.168198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c95cd-ee0c-449b-80cc-c55845409ace None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:18.388453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c95cd-ee0c-449b-80cc-c55845409ace None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:18.408438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d3252338e34305b42cc19bf9396aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be68c9ebf50e4346a34cd4c981957979', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:18.409144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:18.409507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:18.410527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] PATH_INFO: `/v3/users/9f9ee2b868724da99bd333578df71e3a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:18.411335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9f9ee2b868724da99bd333578df71e3a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:18.413548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:18.537999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9ee2b868724da99bd333578df71e3a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:18.542896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9ee2b868724da99bd333578df71e3a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:18.583360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9ee2b868724da99bd333578df71e3a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:18.586415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9ee2b868724da99bd333578df71e3a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:18.601584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9ee2b868724da99bd333578df71e3a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:18.621103 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3044/6077] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:18 2022] DELETE /identity/v3/users/9f9ee2b868724da99bd333578df71e3a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:18.626472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437bc96-82c7-43f6-9f4a-20d53410f912 tempest-test_project-2090025266 tempest-user-816582881] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:18.644534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437bc96-82c7-43f6-9f4a-20d53410f912 tempest-test_project-2090025266 tempest-user-816582881] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:18.747800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d3252338e34305b42cc19bf9396aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be68c9ebf50e4346a34cd4c981957979', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:18.749229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:18.750281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:18.750593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] PATH_INFO: `/v3/projects/9eadd7bb98e54d05b2994df8f7870bde` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:18.752709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9eadd7bb98e54d05b2994df8f7870bde)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:18.757597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:18.870504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eadd7bb98e54d05b2994df8f7870bde', 'request_id': 'req-01977e22-24f6-40a7-9eaf-615f0272cae5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:18.882328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eadd7bb98e54d05b2994df8f7870bde', 'request_id': 'req-01977e22-24f6-40a7-9eaf-615f0272cae5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:18.884886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:18.902016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eadd7bb98e54d05b2994df8f7870bde', 'request_id': 'req-01977e22-24f6-40a7-9eaf-615f0272cae5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:18.929825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] The token cache is being invalidate because project 9eadd7bb98e54d05b2994df8f7870bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:18.930213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:18.931521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:18.933697 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3034/6078] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:18 2022] DELETE /identity/v3/projects/9eadd7bb98e54d05b2994df8f7870bde => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:18.938510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:18.942644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:18.970397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5df7-8232-46c0-948b-9beb4c9a3fae tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:19.064540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:19.103462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d3252338e34305b42cc19bf9396aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be68c9ebf50e4346a34cd4c981957979', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:19.104129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:19.104414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:19.104694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] PATH_INFO: `/v3/domains/59fb78f149ae4a4392ce9e878d4631d4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:19.106010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=59fb78f149ae4a4392ce9e878d4631d4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:19.107768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:19.161495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.162765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.216811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.217775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.223615 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3045/6079] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:53:18 2022] PATCH /identity/v3/domains/59fb78f149ae4a4392ce9e878d4631d4 => generated 246 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:19.227626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:19.229684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:19.279356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01977e22-24f6-40a7-9eaf-615f0272cae5 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:19.443991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d3252338e34305b42cc19bf9396aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be68c9ebf50e4346a34cd4c981957979', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:19.444825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:19.445243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:19.445640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] PATH_INFO: `/v3/domains/59fb78f149ae4a4392ce9e878d4631d4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:19.485016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=59fb78f149ae4a4392ce9e878d4631d4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:19.487473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:19.542674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.558128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.634914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4', 'request_id': 'req-74ba68a1-d2f0-4246-8235-6f46580f4924'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.663150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4', 'request_id': 'req-74ba68a1-d2f0-4246-8235-6f46580f4924'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.687392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4', 'request_id': 'req-74ba68a1-d2f0-4246-8235-6f46580f4924'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.726990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] The token cache is being invalidate because project 59fb78f149ae4a4392ce9e878d4631d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:19.727418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.729819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.763525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4', 'request_id': 'req-74ba68a1-d2f0-4246-8235-6f46580f4924'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.764726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4', 'request_id': 'req-74ba68a1-d2f0-4246-8235-6f46580f4924'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.765665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74ba68a1-d2f0-4246-8235-6f46580f4924 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '59fb78f149ae4a4392ce9e878d4631d4', 'request_id': 'req-74ba68a1-d2f0-4246-8235-6f46580f4924'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:19.782860 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3035/6080] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:53:19 2022] DELETE /identity/v3/domains/59fb78f149ae4a4392ce9e878d4631d4 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:19.788211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:19.790460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:19.974468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594786d-98d9-47dd-98a4-12007b92acc1 tempest-TestDefaultProjectId-108083258 tempest-TestDefaultProjectId-108083258-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:20.152144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:20.155541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:20.156847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:20.157546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] PATH_INFO: `/v3/users/c87e0b5576b6485ba2d8768c8d79d95a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:20.160866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87e0b5576b6485ba2d8768c8d79d95a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:20.164769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:20.281699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87e0b5576b6485ba2d8768c8d79d95a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:20.282526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87e0b5576b6485ba2d8768c8d79d95a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:20.295026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:20.310534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87e0b5576b6485ba2d8768c8d79d95a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:20.311509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87e0b5576b6485ba2d8768c8d79d95a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:20.321712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87e0b5576b6485ba2d8768c8d79d95a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:20.372286 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3046/6081] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:19 2022] DELETE /identity/v3/users/c87e0b5576b6485ba2d8768c8d79d95a => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:20.377779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7d6a7-8e98-4880-a522-f5b13ff0f4e2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:20.379600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7d6a7-8e98-4880-a522-f5b13ff0f4e2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:20.380144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7d6a7-8e98-4880-a522-f5b13ff0f4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:20.407330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-53e7d6a7-8e98-4880-a522-f5b13ff0f4e2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:20.408957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-53e7d6a7-8e98-4880-a522-f5b13ff0f4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:20.431438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:20.509719 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3036/6082] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:20.547133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:20.548773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:20.674037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396e7b1-106b-4d6f-bb97-c3888dbe4f32 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:20.681884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700a4b3-53c1-4e5c-b7cf-b50e98a8b296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:20.682533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700a4b3-53c1-4e5c-b7cf-b50e98a8b296 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:20.682817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700a4b3-53c1-4e5c-b7cf-b50e98a8b296 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:20.687265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700a4b3-53c1-4e5c-b7cf-b50e98a8b296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:20.709255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700a4b3-53c1-4e5c-b7cf-b50e98a8b296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:20.711764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700a4b3-53c1-4e5c-b7cf-b50e98a8b296 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:20.736570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7d6a7-8e98-4880-a522-f5b13ff0f4e2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:20.738136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-53e7d6a7-8e98-4880-a522-f5b13ff0f4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:20.751446 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3047/6083] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:20.850360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7d6a7-8e98-4880-a522-f5b13ff0f4e2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:20.874277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cd983-8ff0-4c93-b518-48b45e7daf0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:20.875734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd983-8ff0-4c93-b518-48b45e7daf0c service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:20.876715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd983-8ff0-4c93-b518-48b45e7daf0c service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:20.878092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd983-8ff0-4c93-b518-48b45e7daf0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:20.882058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-946cd983-8ff0-4c93-b518-48b45e7daf0c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:20.998408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cd983-8ff0-4c93-b518-48b45e7daf0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:21.000515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cd983-8ff0-4c93-b518-48b45e7daf0c service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:21.030056 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3037/6084] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:53:21.161614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700a4b3-53c1-4e5c-b7cf-b50e98a8b296 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:21.163674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3700a4b3-53c1-4e5c-b7cf-b50e98a8b296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:21.189812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700a4b3-53c1-4e5c-b7cf-b50e98a8b296 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:21.194458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a253e4-8268-470f-8337-8c46cc350d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:21.195314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a253e4-8268-470f-8337-8c46cc350d8e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:21.195844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a253e4-8268-470f-8337-8c46cc350d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:21.196362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a253e4-8268-470f-8337-8c46cc350d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:21.201863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a6a253e4-8268-470f-8337-8c46cc350d8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:21.231777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a253e4-8268-470f-8337-8c46cc350d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:21.234382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a253e4-8268-470f-8337-8c46cc350d8e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:21.256542 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3048/6085] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:21.578795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cd983-8ff0-4c93-b518-48b45e7daf0c service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:21.596832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cd983-8ff0-4c93-b518-48b45e7daf0c service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:21.604011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd5a6c-e108-471b-aee9-d21a1bc01f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:21.604682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd5a6c-e108-471b-aee9-d21a1bc01f62 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:21.604972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd5a6c-e108-471b-aee9-d21a1bc01f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:21.605302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd5a6c-e108-471b-aee9-d21a1bc01f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:21.608440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-00fd5a6c-e108-471b-aee9-d21a1bc01f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:21.672040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd5a6c-e108-471b-aee9-d21a1bc01f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:21.673479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd5a6c-e108-471b-aee9-d21a1bc01f62 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:21.734114 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3038/6086] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:21.986170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a253e4-8268-470f-8337-8c46cc350d8e service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:21.987916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a6a253e4-8268-470f-8337-8c46cc350d8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:22.020606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a253e4-8268-470f-8337-8c46cc350d8e service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:22.036515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:22.037689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:22.038170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:22.038642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] PATH_INFO: `/v3/projects/8b63ea4e2f774da4b58e8f9dd9a5ba3e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:22.040376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b63ea4e2f774da4b58e8f9dd9a5ba3e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:22.044988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:22.118232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b63ea4e2f774da4b58e8f9dd9a5ba3e', 'request_id': 'req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:22.142822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b63ea4e2f774da4b58e8f9dd9a5ba3e', 'request_id': 'req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:22.154391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b63ea4e2f774da4b58e8f9dd9a5ba3e', 'request_id': 'req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:22.170913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] The token cache is being invalidate because project 8b63ea4e2f774da4b58e8f9dd9a5ba3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:22.172289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:22.174325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:22.177828 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3049/6087] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:21 2022] DELETE /identity/v3/projects/8b63ea4e2f774da4b58e8f9dd9a5ba3e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:22.181791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd5a6c-e108-471b-aee9-d21a1bc01f62 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:22.220766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd5a6c-e108-471b-aee9-d21a1bc01f62 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:22.445984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:22.485829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a278a25-2fc0-4cc2-aec7-044eb1511498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:22.487159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a278a25-2fc0-4cc2-aec7-044eb1511498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:22.488687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a278a25-2fc0-4cc2-aec7-044eb1511498 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:22.490751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a278a25-2fc0-4cc2-aec7-044eb1511498 admin admin] PATH_INFO: `/v3/users/99d3252338e34305b42cc19bf9396aca` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:22.499113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a278a25-2fc0-4cc2-aec7-044eb1511498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d3252338e34305b42cc19bf9396aca)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:22.502122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a278a25-2fc0-4cc2-aec7-044eb1511498 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:22.651546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6a278a25-2fc0-4cc2-aec7-044eb1511498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d3252338e34305b42cc19bf9396aca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:22.652618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6a278a25-2fc0-4cc2-aec7-044eb1511498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d3252338e34305b42cc19bf9396aca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:22.686532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6a278a25-2fc0-4cc2-aec7-044eb1511498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d3252338e34305b42cc19bf9396aca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:22.710711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6a278a25-2fc0-4cc2-aec7-044eb1511498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d3252338e34305b42cc19bf9396aca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:22.727828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6a278a25-2fc0-4cc2-aec7-044eb1511498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d3252338e34305b42cc19bf9396aca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:22.752604 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3039/6088] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:22 2022] DELETE /identity/v3/users/99d3252338e34305b42cc19bf9396aca => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:23.454006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:23.455472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:23.482042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fc1a9-c9cd-4239-bd82-b9e26e03fe6f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:23.624740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:23.644432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:23.645635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:23.646217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:23.647084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] PATH_INFO: `/v3/projects/be68c9ebf50e4346a34cd4c981957979` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:23.648842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be68c9ebf50e4346a34cd4c981957979)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:23.651016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:23.796886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be68c9ebf50e4346a34cd4c981957979', 'request_id': 'req-8c3698fd-9516-4bea-a484-18dee2430db0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:23.818071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be68c9ebf50e4346a34cd4c981957979', 'request_id': 'req-8c3698fd-9516-4bea-a484-18dee2430db0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:23.833025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be68c9ebf50e4346a34cd4c981957979', 'request_id': 'req-8c3698fd-9516-4bea-a484-18dee2430db0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:23.870909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] The token cache is being invalidate because project be68c9ebf50e4346a34cd4c981957979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:23.871227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:23.875094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8c3698fd-9516-4bea-a484-18dee2430db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:23.883654 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3050/6089] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:23 2022] DELETE /identity/v3/projects/be68c9ebf50e4346a34cd4c981957979 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:23.889369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6402d-d4e4-4e3e-bf9e-45be6a3220ed None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:23.891217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6402d-d4e4-4e3e-bf9e-45be6a3220ed None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:23.891501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6402d-d4e4-4e3e-bf9e-45be6a3220ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:23.932135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c8b6402d-d4e4-4e3e-bf9e-45be6a3220ed None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:23.941715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c8b6402d-d4e4-4e3e-bf9e-45be6a3220ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:24.061453 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3040/6090] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:24.069028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23913b1e-8a66-419c-8e03-36dccf076b0a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:24.069597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23913b1e-8a66-419c-8e03-36dccf076b0a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:24.070183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23913b1e-8a66-419c-8e03-36dccf076b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:24.112199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-23913b1e-8a66-419c-8e03-36dccf076b0a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:24.113730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-23913b1e-8a66-419c-8e03-36dccf076b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:24.132941 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3051/6091] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:24.140810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6402d-d4e4-4e3e-bf9e-45be6a3220ed None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:24.194016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6402d-d4e4-4e3e-bf9e-45be6a3220ed None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:24.208505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1370f-71ff-468a-88b3-7f5f5feda030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:24.209286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1370f-71ff-468a-88b3-7f5f5feda030 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:24.209689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1370f-71ff-468a-88b3-7f5f5feda030 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:24.210843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1370f-71ff-468a-88b3-7f5f5feda030 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:24.211746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1370f-71ff-468a-88b3-7f5f5feda030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:24.212208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1370f-71ff-468a-88b3-7f5f5feda030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:24.215196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1370f-71ff-468a-88b3-7f5f5feda030 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:24.237430 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3041/6092] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:24.241153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23913b1e-8a66-419c-8e03-36dccf076b0a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:24.251929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23913b1e-8a66-419c-8e03-36dccf076b0a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:24.257470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a81567-79b4-474c-b645-5705e78e78db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:24.258366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a81567-79b4-474c-b645-5705e78e78db admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:24.258809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a81567-79b4-474c-b645-5705e78e78db admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:24.259258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a81567-79b4-474c-b645-5705e78e78db admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:24.260232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a81567-79b4-474c-b645-5705e78e78db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:24.262510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a81567-79b4-474c-b645-5705e78e78db admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:24.304603 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3052/6093] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:24 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:24.308960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1370f-71ff-468a-88b3-7f5f5feda030 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:24.321719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1370f-71ff-468a-88b3-7f5f5feda030 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:24.406789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1981a-188d-460b-9278-7765ea0f5d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:24.407746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1981a-188d-460b-9278-7765ea0f5d57 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:24.408186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1981a-188d-460b-9278-7765ea0f5d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:24.408728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1981a-188d-460b-9278-7765ea0f5d57 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:24.410018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1981a-188d-460b-9278-7765ea0f5d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:24.412425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1981a-188d-460b-9278-7765ea0f5d57 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:24.422857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:24.448258 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3042/6094] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:24 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:24.448627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a81567-79b4-474c-b645-5705e78e78db admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:24.464981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a81567-79b4-474c-b645-5705e78e78db admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:24.472246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa8aeb-639f-42c5-9a65-fdcf46f51ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:24.473339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa8aeb-639f-42c5-9a65-fdcf46f51ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:24.473733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa8aeb-639f-42c5-9a65-fdcf46f51ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:24.474075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa8aeb-639f-42c5-9a65-fdcf46f51ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:24.474793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa8aeb-639f-42c5-9a65-fdcf46f51ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:24.476468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa8aeb-639f-42c5-9a65-fdcf46f51ad4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:24.492172 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3053/6095] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:53:24.496175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1981a-188d-460b-9278-7765ea0f5d57 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:24.510207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1981a-188d-460b-9278-7765ea0f5d57 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:24.540568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755009a0-05cf-4742-9817-78469274f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:24.541338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755009a0-05cf-4742-9817-78469274f1df admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:24.542173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755009a0-05cf-4742-9817-78469274f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:24.542329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755009a0-05cf-4742-9817-78469274f1df admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:24.544280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755009a0-05cf-4742-9817-78469274f1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:24.549720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755009a0-05cf-4742-9817-78469274f1df admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:24.578330 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3043/6096] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:53:24.583383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa8aeb-639f-42c5-9a65-fdcf46f51ad4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:24.598706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa8aeb-639f-42c5-9a65-fdcf46f51ad4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:24.609562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f2479-6f46-471d-b62a-ad70f3d6f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:24.610501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f2479-6f46-471d-b62a-ad70f3d6f547 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:24.610996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f2479-6f46-471d-b62a-ad70f3d6f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:24.611478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f2479-6f46-471d-b62a-ad70f3d6f547 admin admin] PATH_INFO: `/v3/projects/9119637714574544bf1935bc6474b437/users/b14653953d024f4a8e190aedeafb4f2d/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:24.631546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f2479-6f46-471d-b62a-ad70f3d6f547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9119637714574544bf1935bc6474b437, user_id=b14653953d024f4a8e190aedeafb4f2d, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:24.635096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f2479-6f46-471d-b62a-ad70f3d6f547 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:24.652948 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3054/6097] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:24 2022] PUT /identity/v3/projects/9119637714574544bf1935bc6474b437/users/b14653953d024f4a8e190aedeafb4f2d/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:24.664584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78569911-c1cf-432f-b77f-5cc275819b57 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:24.664942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78569911-c1cf-432f-b77f-5cc275819b57 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:24.665138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78569911-c1cf-432f-b77f-5cc275819b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:24.706371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-78569911-c1cf-432f-b77f-5cc275819b57 None None] MFA Rules not processed for user `b14653953d024f4a8e190aedeafb4f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:24.708046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-78569911-c1cf-432f-b77f-5cc275819b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:24.808170 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3044/6098] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:24.813574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f2479-6f46-471d-b62a-ad70f3d6f547 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:24.909170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f2479-6f46-471d-b62a-ad70f3d6f547 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:24.935075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687bdfb-4443-4ff9-9bf9-97ea79ba3864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:24.937065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687bdfb-4443-4ff9-9bf9-97ea79ba3864 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:24.937664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687bdfb-4443-4ff9-9bf9-97ea79ba3864 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:24.938812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687bdfb-4443-4ff9-9bf9-97ea79ba3864 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:24.939646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687bdfb-4443-4ff9-9bf9-97ea79ba3864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:24.942251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687bdfb-4443-4ff9-9bf9-97ea79ba3864 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:24.985733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:24.999083 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3055/6099] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:24 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:25.002925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78569911-c1cf-432f-b77f-5cc275819b57 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:25.021613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78569911-c1cf-432f-b77f-5cc275819b57 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:25.144074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa662892-7eab-4bae-a375-e38a2352d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:25.147237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa662892-7eab-4bae-a375-e38a2352d978 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:25.148051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa662892-7eab-4bae-a375-e38a2352d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:25.148580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa662892-7eab-4bae-a375-e38a2352d978 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:25.149813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa662892-7eab-4bae-a375-e38a2352d978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:25.152385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa662892-7eab-4bae-a375-e38a2352d978 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:25.194534 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3045/6100] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:25 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:25.195917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687bdfb-4443-4ff9-9bf9-97ea79ba3864 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:25.213567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687bdfb-4443-4ff9-9bf9-97ea79ba3864 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:25.234508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b609-7010-4700-a051-276a954e1cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:25.235903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b609-7010-4700-a051-276a954e1cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:25.236184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b609-7010-4700-a051-276a954e1cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:25.236586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b609-7010-4700-a051-276a954e1cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:25.237154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b609-7010-4700-a051-276a954e1cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:25.238845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b609-7010-4700-a051-276a954e1cd9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:25.272746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa662892-7eab-4bae-a375-e38a2352d978 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:25.291211 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3056/6101] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:25.298244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa662892-7eab-4bae-a375-e38a2352d978 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:25.312746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5382ba-4e1e-43fa-acd9-11100dca843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:25.313927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5382ba-4e1e-43fa-acd9-11100dca843a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:25.314212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5382ba-4e1e-43fa-acd9-11100dca843a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:25.314934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5382ba-4e1e-43fa-acd9-11100dca843a admin admin] PATH_INFO: `/v3/projects/29d0615ee1ae40a08bef8cfbd28556a6/users/b338d36dcfc841daa5781656bd37ed40/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:25.346349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5382ba-4e1e-43fa-acd9-11100dca843a admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d0615ee1ae40a08bef8cfbd28556a6, user_id=b338d36dcfc841daa5781656bd37ed40, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:25.349958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5382ba-4e1e-43fa-acd9-11100dca843a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:25.380908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b609-7010-4700-a051-276a954e1cd9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:25.381810 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3046/6102] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:25 2022] PUT /identity/v3/projects/29d0615ee1ae40a08bef8cfbd28556a6/users/b338d36dcfc841daa5781656bd37ed40/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:25.397362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b609-7010-4700-a051-276a954e1cd9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:25.507264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ecd13-5f8b-45e0-afaf-84267f355f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:25.507936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ecd13-5f8b-45e0-afaf-84267f355f70 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:25.508161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ecd13-5f8b-45e0-afaf-84267f355f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:25.508431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ecd13-5f8b-45e0-afaf-84267f355f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:25.509085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ecd13-5f8b-45e0-afaf-84267f355f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:25.510770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ecd13-5f8b-45e0-afaf-84267f355f70 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:25.536133 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3057/6103] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:25.540149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5382ba-4e1e-43fa-acd9-11100dca843a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:25.598406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5382ba-4e1e-43fa-acd9-11100dca843a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:25.607991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f561f-1361-4d47-93cc-953018c6a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:25.609620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f561f-1361-4d47-93cc-953018c6a2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:25.610233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f561f-1361-4d47-93cc-953018c6a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:25.610839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f561f-1361-4d47-93cc-953018c6a2f2 admin admin] PATH_INFO: `/v3/projects/29d0615ee1ae40a08bef8cfbd28556a6/users/b338d36dcfc841daa5781656bd37ed40/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:25.628833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f561f-1361-4d47-93cc-953018c6a2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d0615ee1ae40a08bef8cfbd28556a6, user_id=b338d36dcfc841daa5781656bd37ed40, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:25.643340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f561f-1361-4d47-93cc-953018c6a2f2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:25.680567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42554ba2-b00f-445d-96b0-cecce07717d5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:25.680848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42554ba2-b00f-445d-96b0-cecce07717d5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:25.681113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42554ba2-b00f-445d-96b0-cecce07717d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:25.683795 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3047/6104] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:25 2022] PUT /identity/v3/projects/29d0615ee1ae40a08bef8cfbd28556a6/users/b338d36dcfc841daa5781656bd37ed40/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:25.736609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-42554ba2-b00f-445d-96b0-cecce07717d5 None None] MFA Rules not processed for user `b338d36dcfc841daa5781656bd37ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:25.737987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-42554ba2-b00f-445d-96b0-cecce07717d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:25.893099 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3058/6105] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:25.894557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f561f-1361-4d47-93cc-953018c6a2f2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:25.909781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f561f-1361-4d47-93cc-953018c6a2f2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:25.924249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebd056-3e3c-43b4-baa4-9c02b21cc56a tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:25.924905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebd056-3e3c-43b4-baa4-9c02b21cc56a tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:25.925191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebd056-3e3c-43b4-baa4-9c02b21cc56a tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:25.925822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebd056-3e3c-43b4-baa4-9c02b21cc56a tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:25.926515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebd056-3e3c-43b4-baa4-9c02b21cc56a tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:25.931330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebd056-3e3c-43b4-baa4-9c02b21cc56a tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-65ebd056-3e3c-43b4-baa4-9c02b21cc56a tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invalid input for field 'name': '' is too short Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: Failed validating 'minLength' in schema['properties']['name']: Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: On instance['name']: Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: Failed validating 'minLength' in schema['properties']['name']: Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: On instance['name']: Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: '' Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise error Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application On instance['name']: Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application '' Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:25.947419 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 15:53:25.949541 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 15:53:25.951574 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 15:53:25.951574 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 29 15:53:25.951574 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:25.951574 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 29 15:53:25.951574 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:53:25.951574 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:25.951574 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application On instance['name']: Aug 29 15:53:25.951574 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application '' Aug 29 15:53:25.951574 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:25.962435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42554ba2-b00f-445d-96b0-cecce07717d5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:25.962667 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3048/6106] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:53:25 2022] POST /identity/v3/domains => generated 283 bytes in 68 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 15:53:25.978538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42554ba2-b00f-445d-96b0-cecce07717d5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:25.998741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d5727-ac9b-47b6-a3a9-eb5fed8185ee tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:25.999386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5727-ac9b-47b6-a3a9-eb5fed8185ee tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:26.000521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5727-ac9b-47b6-a3a9-eb5fed8185ee tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:26.000521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5727-ac9b-47b6-a3a9-eb5fed8185ee tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:26.000784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d5727-ac9b-47b6-a3a9-eb5fed8185ee tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:26.002384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d5727-ac9b-47b6-a3a9-eb5fed8185ee tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-128d5727-ac9b-47b6-a3a9-eb5fed8185ee tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: Failed validating 'maxLength' in schema['properties']['name']: Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: On instance['name']: Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: Failed validating 'maxLength' in schema['properties']['name']: Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: On instance['name']: Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise error Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:53:26.022852 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application On instance['name']: Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 29 15:53:26.024858 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application On instance['name']: Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:26.027082 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3059/6107] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:53:25 2022] POST /identity/v3/domains => generated 412 bytes in 62 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 29 15:53:26.032223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebd056-3e3c-43b4-baa4-9c02b21cc56a tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:26.056044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebd056-3e3c-43b4-baa4-9c02b21cc56a tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:26.065699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a62373-aa3a-4118-8d26-1daf990dd65d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:26.066681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62373-aa3a-4118-8d26-1daf990dd65d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:26.067163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62373-aa3a-4118-8d26-1daf990dd65d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:26.067607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62373-aa3a-4118-8d26-1daf990dd65d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:26.068473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a62373-aa3a-4118-8d26-1daf990dd65d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:26.070450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a62373-aa3a-4118-8d26-1daf990dd65d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:26.103976 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3049/6108] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:53:26 2022] POST /identity/v3/domains => generated 277 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:26.104182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d5727-ac9b-47b6-a3a9-eb5fed8185ee tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:26.124210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d5727-ac9b-47b6-a3a9-eb5fed8185ee tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:26.222610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59624-503d-42cc-8469-b413b69b51cd tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:26.223478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59624-503d-42cc-8469-b413b69b51cd tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:26.225314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59624-503d-42cc-8469-b413b69b51cd tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:26.225761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59624-503d-42cc-8469-b413b69b51cd tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains/ab2b6d89e23d41d496a32d4f5fa96046` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:26.235869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:26.241873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d59624-503d-42cc-8469-b413b69b51cd tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ab2b6d89e23d41d496a32d4f5fa96046)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:26.243976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d59624-503d-42cc-8469-b413b69b51cd tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-95d59624-503d-42cc-8469-b413b69b51cd tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Aug 29 15:53:26.269536 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Aug 29 15:53:26.270923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:53:26.270923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:53:26.270923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Aug 29 15:53:26.270923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Aug 29 15:53:26.270923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Aug 29 15:53:26.270923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 29 15:53:26.270923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 29 15:53:26.270923 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:26.277995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a62373-aa3a-4118-8d26-1daf990dd65d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:26.279876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3060/6109] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:53:26 2022] DELETE /identity/v3/domains/ab2b6d89e23d41d496a32d4f5fa96046 => generated 120 bytes in 175 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 29 15:53:26.287230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:26.302729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a62373-aa3a-4118-8d26-1daf990dd65d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:26.314994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:26.316247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:26.316752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:26.317128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains/ab2b6d89e23d41d496a32d4f5fa96046` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:26.320139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ab2b6d89e23d41d496a32d4f5fa96046)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:26.327935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:26.362619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.364747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.406235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.406941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.414909 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3050/6110] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:53:26 2022] PATCH /identity/v3/domains/ab2b6d89e23d41d496a32d4f5fa96046 => generated 278 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:53:26.418735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59624-503d-42cc-8469-b413b69b51cd tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:26.424888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-95d59624-503d-42cc-8469-b413b69b51cd tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:26.449817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59624-503d-42cc-8469-b413b69b51cd tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:26.578877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:26.579605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:26.579872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:26.580071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains/ab2b6d89e23d41d496a32d4f5fa96046` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:26.602862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ab2b6d89e23d41d496a32d4f5fa96046)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:26.604787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:26.646665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.660895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.722203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046', 'request_id': 'req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.735709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046', 'request_id': 'req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.751798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046', 'request_id': 'req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.785805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] The token cache is being invalidate because project ab2b6d89e23d41d496a32d4f5fa96046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:26.786286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.789517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.823587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046', 'request_id': 'req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.841700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046', 'request_id': 'req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.841700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ab2b6d89e23d41d496a32d4f5fa96046', 'request_id': 'req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:26.856234 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3061/6111] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:53:26 2022] DELETE /identity/v3/domains/ab2b6d89e23d41d496a32d4f5fa96046 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:26.863191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:26.884819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9bfa5-24a5-4b9b-be10-9fae5a3b04f8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:27.022465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d2b89-a90a-455e-aa72-c2c8a4e84cd0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:27.023141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2b89-a90a-455e-aa72-c2c8a4e84cd0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:27.023429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2b89-a90a-455e-aa72-c2c8a4e84cd0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:27.023712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2b89-a90a-455e-aa72-c2c8a4e84cd0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains/90f9333c86bc4aae9fcfaf48084232cf` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:27.035534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d2b89-a90a-455e-aa72-c2c8a4e84cd0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-843d2b89-a90a-455e-aa72-c2c8a4e84cd0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Could not find domain: 90f9333c86bc4aae9fcfaf48084232cf.: keystone.exception.DomainNotFound: Could not find domain: 90f9333c86bc4aae9fcfaf48084232cf. Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 90f9333c86bc4aae9fcfaf48084232cf. Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:53:27.042546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:53:27.044068 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:53:27.046282 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 90f9333c86bc4aae9fcfaf48084232cf. Aug 29 15:53:27.047745 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:27.055087 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3051/6112] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:53:26 2022] DELETE /identity/v3/domains/90f9333c86bc4aae9fcfaf48084232cf => generated 112 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:53:27.056151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:27.057893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:27.074833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500092e9-8167-4db4-9c41-2e9e2e9bd3a4 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:27.081195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0745f9a-af46-4ea5-863e-624b1803acc0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:27.081803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0745f9a-af46-4ea5-863e-624b1803acc0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:27.082179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0745f9a-af46-4ea5-863e-624b1803acc0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:27.082985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0745f9a-af46-4ea5-863e-624b1803acc0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:27.083764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0745f9a-af46-4ea5-863e-624b1803acc0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:27.085751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0745f9a-af46-4ea5-863e-624b1803acc0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:27.122183 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3062/6113] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:53:27 2022] POST /identity/v3/domains => generated 252 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:27.126684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d2b89-a90a-455e-aa72-c2c8a4e84cd0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:27.139245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d2b89-a90a-455e-aa72-c2c8a4e84cd0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:27.221027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04667735-5a21-4794-bf19-ca16372bcc8f tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:27.222078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04667735-5a21-4794-bf19-ca16372bcc8f tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:27.222825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04667735-5a21-4794-bf19-ca16372bcc8f tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:27.223316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04667735-5a21-4794-bf19-ca16372bcc8f tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:27.225620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04667735-5a21-4794-bf19-ca16372bcc8f tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:27.228833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04667735-5a21-4794-bf19-ca16372bcc8f tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:27.241192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.sql.core [None req-04667735-5a21-4794-bf19-ca16372bcc8f tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-202530933' for key 'project.ixu_project_name_domain_id'") Aug 29 15:53:27.241192 n-d-854882-3 devstack@keystone.service[89680]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 15:53:27.241192 n-d-854882-3 devstack@keystone.service[89680]: [parameters: {'id': 'c32d18705bf8440583e59a91a9dc14da', 'name': 'tempest-domain-dup-202530933', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 29 15:53:27.241192 n-d-854882-3 devstack@keystone.service[89680]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89680) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-04667735-5a21-4794-bf19-ca16372bcc8f tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-202530933.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-202530933. Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:53:27.278445 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result.read() Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-202530933' for key 'project.ixu_project_name_domain_id'") Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 15:53:27.280309 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application yield resource Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise self.value Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application session.commit() Aug 29 15:53:27.285200 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.session.flush() Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application compat.raise_( Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:53:27.288680 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 15:53:27.291067 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application result.read() Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:53:27.292536 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-202530933' for key 'project.ixu_project_name_domain_id'") Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [parameters: {'id': 'c32d18705bf8440583e59a91a9dc14da', 'name': 'tempest-domain-dup-202530933', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:27.296146 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-202530933. Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:53:27.300054 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-202530933. Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:53:27.301886 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3052/6114] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:53:27 2022] POST /identity/v3/domains => generated 211 bytes in 157 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:53:27.303203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0745f9a-af46-4ea5-863e-624b1803acc0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:27.337898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0745f9a-af46-4ea5-863e-624b1803acc0 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:27.354244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:27.366165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:27.366743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:27.367194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains/87f84aeb069d4ffaa005f4ee5c3712e4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:27.397320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:27.410484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=87f84aeb069d4ffaa005f4ee5c3712e4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:27.415313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:27.512086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:27.530333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:27.594698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:27.596113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:27.604056 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3063/6115] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:53:27 2022] PATCH /identity/v3/domains/87f84aeb069d4ffaa005f4ee5c3712e4 => generated 253 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:27.606935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04667735-5a21-4794-bf19-ca16372bcc8f tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:27.610142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-04667735-5a21-4794-bf19-ca16372bcc8f tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:27.649525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04667735-5a21-4794-bf19-ca16372bcc8f tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:27.789075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:27.811587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:27.814446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:27.815222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:27.816159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains/87f84aeb069d4ffaa005f4ee5c3712e4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:27.838996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=87f84aeb069d4ffaa005f4ee5c3712e4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:27.842392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:27.943046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:27.981702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.102850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4', 'request_id': 'req-d3562dee-df79-4dbe-987e-26d3d74feb4d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.122571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4', 'request_id': 'req-d3562dee-df79-4dbe-987e-26d3d74feb4d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.145437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4', 'request_id': 'req-d3562dee-df79-4dbe-987e-26d3d74feb4d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.179100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] The token cache is being invalidate because project 87f84aeb069d4ffaa005f4ee5c3712e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:28.179856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.182797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.204508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4', 'request_id': 'req-d3562dee-df79-4dbe-987e-26d3d74feb4d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.206058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4', 'request_id': 'req-d3562dee-df79-4dbe-987e-26d3d74feb4d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.208567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '87f84aeb069d4ffaa005f4ee5c3712e4', 'request_id': 'req-d3562dee-df79-4dbe-987e-26d3d74feb4d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.256749 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3053/6116] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:53:27 2022] DELETE /identity/v3/domains/87f84aeb069d4ffaa005f4ee5c3712e4 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:28.262326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:28.290339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc28f8-8da6-4235-8dd2-db100832cbd8 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:28.472030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b60569-5fc2-4a32-a6a1-7cb6bc8b7648 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b338d36dcfc841daa5781656bd37ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29d0615ee1ae40a08bef8cfbd28556a6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:28.472821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b60569-5fc2-4a32-a6a1-7cb6bc8b7648 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:28.473111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b60569-5fc2-4a32-a6a1-7cb6bc8b7648 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:28.474045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b60569-5fc2-4a32-a6a1-7cb6bc8b7648 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] PATH_INFO: `/v3/domains/ab2b6d89e23d41d496a32d4f5fa96046` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:28.507260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b60569-5fc2-4a32-a6a1-7cb6bc8b7648 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-75b60569-5fc2-4a32-a6a1-7cb6bc8b7648 tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Could not find domain: ab2b6d89e23d41d496a32d4f5fa96046.: keystone.exception.DomainNotFound: Could not find domain: ab2b6d89e23d41d496a32d4f5fa96046. Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ab2b6d89e23d41d496a32d4f5fa96046. Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:53:28.519182 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:53:28.520522 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:53:28.522211 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ab2b6d89e23d41d496a32d4f5fa96046. Aug 29 15:53:28.523534 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:28.529611 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3064/6117] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:53:28 2022] PATCH /identity/v3/domains/ab2b6d89e23d41d496a32d4f5fa96046 => generated 112 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:53:28.543917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:28.546287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:28.724155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3562dee-df79-4dbe-987e-26d3d74feb4d tempest-DomainsNegativeTestJSON-185540463 tempest-DomainsNegativeTestJSON-185540463-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:28.730534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:28.731622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:28.732208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:28.733278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] PATH_INFO: `/v3/users/b14653953d024f4a8e190aedeafb4f2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:28.735388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14653953d024f4a8e190aedeafb4f2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:28.738565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:28.887331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:28.910676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14653953d024f4a8e190aedeafb4f2d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.911422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14653953d024f4a8e190aedeafb4f2d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.954494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14653953d024f4a8e190aedeafb4f2d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.965014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14653953d024f4a8e190aedeafb4f2d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.983693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14653953d024f4a8e190aedeafb4f2d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:28.998942 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3054/6118] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:28 2022] DELETE /identity/v3/users/b14653953d024f4a8e190aedeafb4f2d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:29.001462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f6666-7155-4a18-9fc2-8e2df5ecf203 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:29.002172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f6666-7155-4a18-9fc2-8e2df5ecf203 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:29.002172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f6666-7155-4a18-9fc2-8e2df5ecf203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:29.032415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-267f6666-7155-4a18-9fc2-8e2df5ecf203 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:29.035234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-267f6666-7155-4a18-9fc2-8e2df5ecf203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:29.231560 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3065/6119] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:29.260928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:29.264478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:29.357074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f51e4d-d4d4-4f52-af9e-f06619951403 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:29.362161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527be902-39eb-492b-b4b8-578739e6e1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:29.362802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527be902-39eb-492b-b4b8-578739e6e1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:29.363081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527be902-39eb-492b-b4b8-578739e6e1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:29.363589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527be902-39eb-492b-b4b8-578739e6e1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:29.376135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527be902-39eb-492b-b4b8-578739e6e1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:29.377981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527be902-39eb-492b-b4b8-578739e6e1d1 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:29.392320 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3055/6120] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:30.844575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f6666-7155-4a18-9fc2-8e2df5ecf203 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:30.847904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-267f6666-7155-4a18-9fc2-8e2df5ecf203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:30.870010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f6666-7155-4a18-9fc2-8e2df5ecf203 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:30.880324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:30.881439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:30.881916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:30.882777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] PATH_INFO: `/v3/projects/9119637714574544bf1935bc6474b437` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:30.884947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9119637714574544bf1935bc6474b437)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:30.925790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:30.998043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd44a6c-ff86-4422-8501-a798c6522977 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:30.998760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd44a6c-ff86-4422-8501-a798c6522977 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:30.998986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd44a6c-ff86-4422-8501-a798c6522977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:31.034752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4cd44a6c-ff86-4422-8501-a798c6522977 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:31.038647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4cd44a6c-ff86-4422-8501-a798c6522977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:31.046433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9119637714574544bf1935bc6474b437', 'request_id': 'req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:31.055332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9119637714574544bf1935bc6474b437', 'request_id': 'req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:31.062204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:31.075791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9119637714574544bf1935bc6474b437', 'request_id': 'req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:31.094878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] The token cache is being invalidate because project 9119637714574544bf1935bc6474b437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:31.095461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:31.096916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:31.099674 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3066/6121] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:30 2022] DELETE /identity/v3/projects/9119637714574544bf1935bc6474b437 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:31.103760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:31.105462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:31.151895 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3056/6122] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:53:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:31.172348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd44a6c-ff86-4422-8501-a798c6522977 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:31.174067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4cd44a6c-ff86-4422-8501-a798c6522977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:31.213620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00eda-ba9d-4caa-826e-f8874f3eaa16 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:31.220459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:31.221234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:31.221701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:31.222129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] PATH_INFO: `/v3/users/b338d36dcfc841daa5781656bd37ed40` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:31.231367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b338d36dcfc841daa5781656bd37ed40)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:31.234168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:31.313781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:31.321679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b338d36dcfc841daa5781656bd37ed40'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:31.322558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b338d36dcfc841daa5781656bd37ed40'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:31.325882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd44a6c-ff86-4422-8501-a798c6522977 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:31.337264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88c2d2-d843-4109-bf15-e7dd1e31448a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:31.339607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88c2d2-d843-4109-bf15-e7dd1e31448a service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:31.340776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88c2d2-d843-4109-bf15-e7dd1e31448a service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:31.342445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88c2d2-d843-4109-bf15-e7dd1e31448a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:31.342609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b338d36dcfc841daa5781656bd37ed40'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:31.343914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b338d36dcfc841daa5781656bd37ed40'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:31.346700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2f88c2d2-d843-4109-bf15-e7dd1e31448a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:31.353347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b338d36dcfc841daa5781656bd37ed40'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:31.374103 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3067/6123] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:31 2022] DELETE /identity/v3/users/b338d36dcfc841daa5781656bd37ed40 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:31.374846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88c2d2-d843-4109-bf15-e7dd1e31448a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:31.376556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88c2d2-d843-4109-bf15-e7dd1e31448a service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:31.386419 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3057/6124] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:53:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:34.640613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:34.643354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:34.831861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734a626-adf8-4136-8b68-5fc55c4f1e0f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:34.847892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:34.848558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:34.849229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:34.849229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] PATH_INFO: `/v3/projects/29d0615ee1ae40a08bef8cfbd28556a6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:34.858211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29d0615ee1ae40a08bef8cfbd28556a6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:34.860174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:34.878264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:34.960224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d0615ee1ae40a08bef8cfbd28556a6', 'request_id': 'req-1ffe85b4-5a69-466d-9a16-609ba434ae1b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:34.981534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d0615ee1ae40a08bef8cfbd28556a6', 'request_id': 'req-1ffe85b4-5a69-466d-9a16-609ba434ae1b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:34.997793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d0615ee1ae40a08bef8cfbd28556a6', 'request_id': 'req-1ffe85b4-5a69-466d-9a16-609ba434ae1b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:35.024594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] The token cache is being invalidate because project 29d0615ee1ae40a08bef8cfbd28556a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:35.024957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:35.025748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ffe85b4-5a69-466d-9a16-609ba434ae1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:35.027295 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3068/6125] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:34 2022] DELETE /identity/v3/projects/29d0615ee1ae40a08bef8cfbd28556a6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:35.033990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f161-106f-4b4b-892e-cce90f103f9f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:35.035823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f161-106f-4b4b-892e-cce90f103f9f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:35.036329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f161-106f-4b4b-892e-cce90f103f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:35.070318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-55c1f161-106f-4b4b-892e-cce90f103f9f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:35.086790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-55c1f161-106f-4b4b-892e-cce90f103f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:35.246953 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3058/6126] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:35.255397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f58fa-5ecb-422d-acf0-b71c48da2fc7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:35.255846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f58fa-5ecb-422d-acf0-b71c48da2fc7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:35.255964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f58fa-5ecb-422d-acf0-b71c48da2fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:35.319087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8b5f58fa-5ecb-422d-acf0-b71c48da2fc7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:35.323809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8b5f58fa-5ecb-422d-acf0-b71c48da2fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:35.362754 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3069/6127] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:35.367314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f161-106f-4b4b-892e-cce90f103f9f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:35.390603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f161-106f-4b4b-892e-cce90f103f9f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:35.414634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f1d23-8d2c-4897-a872-ac3e855f5432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:35.415662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f1d23-8d2c-4897-a872-ac3e855f5432 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:35.416143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f1d23-8d2c-4897-a872-ac3e855f5432 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:35.416649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f1d23-8d2c-4897-a872-ac3e855f5432 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:35.417531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f1d23-8d2c-4897-a872-ac3e855f5432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:35.417925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f1d23-8d2c-4897-a872-ac3e855f5432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:35.420814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f1d23-8d2c-4897-a872-ac3e855f5432 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:35.439672 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3059/6128] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:35.441359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f58fa-5ecb-422d-acf0-b71c48da2fc7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:35.458846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f58fa-5ecb-422d-acf0-b71c48da2fc7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:35.466354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c69c6-f582-4f88-8a2e-88f3ad57b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:35.467139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c69c6-f582-4f88-8a2e-88f3ad57b23b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:35.467423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c69c6-f582-4f88-8a2e-88f3ad57b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:35.467699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c69c6-f582-4f88-8a2e-88f3ad57b23b admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:35.468420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c69c6-f582-4f88-8a2e-88f3ad57b23b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:35.470572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c69c6-f582-4f88-8a2e-88f3ad57b23b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:35.540302 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3070/6129] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:35 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:35.541889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f1d23-8d2c-4897-a872-ac3e855f5432 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:35.566512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f1d23-8d2c-4897-a872-ac3e855f5432 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:35.695516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3595da-7d13-467c-9fce-8e04f82b3621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:35.696366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3595da-7d13-467c-9fce-8e04f82b3621 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:35.696909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3595da-7d13-467c-9fce-8e04f82b3621 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:35.697216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3595da-7d13-467c-9fce-8e04f82b3621 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:35.699001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3595da-7d13-467c-9fce-8e04f82b3621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:35.702192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3595da-7d13-467c-9fce-8e04f82b3621 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:35.747889 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3060/6130] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:35 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:35.748695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c69c6-f582-4f88-8a2e-88f3ad57b23b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:35.759672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c69c6-f582-4f88-8a2e-88f3ad57b23b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:35.784891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a0e01-3040-4042-969f-c0fa69c69d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:35.785643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a0e01-3040-4042-969f-c0fa69c69d71 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:35.785920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a0e01-3040-4042-969f-c0fa69c69d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:35.786363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a0e01-3040-4042-969f-c0fa69c69d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:35.786828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a0e01-3040-4042-969f-c0fa69c69d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:35.788829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a0e01-3040-4042-969f-c0fa69c69d71 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:35.822987 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3071/6131] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:35.825333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3595da-7d13-467c-9fce-8e04f82b3621 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:35.854523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3595da-7d13-467c-9fce-8e04f82b3621 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:35.871288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e336f87-a139-42d8-876d-5e73ae412bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:35.871976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e336f87-a139-42d8-876d-5e73ae412bda admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:35.872307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e336f87-a139-42d8-876d-5e73ae412bda admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:35.872587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e336f87-a139-42d8-876d-5e73ae412bda admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:35.873763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e336f87-a139-42d8-876d-5e73ae412bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:35.875843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e336f87-a139-42d8-876d-5e73ae412bda admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:35.903025 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3061/6132] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:35.905975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a0e01-3040-4042-969f-c0fa69c69d71 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:35.929325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a0e01-3040-4042-969f-c0fa69c69d71 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:35.939557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa84d5d-959f-4768-a43f-89529b309e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:35.942477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa84d5d-959f-4768-a43f-89529b309e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:35.944363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa84d5d-959f-4768-a43f-89529b309e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:35.945853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa84d5d-959f-4768-a43f-89529b309e45 admin admin] PATH_INFO: `/v3/projects/6286da6468f9403597833c5244a2a351/users/c995d83693ec480e98b2166d74cf4152/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:35.972890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa84d5d-959f-4768-a43f-89529b309e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6286da6468f9403597833c5244a2a351, user_id=c995d83693ec480e98b2166d74cf4152, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:35.977082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa84d5d-959f-4768-a43f-89529b309e45 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:36.009439 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3072/6133] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:35 2022] PUT /identity/v3/projects/6286da6468f9403597833c5244a2a351/users/c995d83693ec480e98b2166d74cf4152/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:36.015914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe48d-cfa9-4265-ae29-02534389a38a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:36.016247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe48d-cfa9-4265-ae29-02534389a38a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:36.016666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe48d-cfa9-4265-ae29-02534389a38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:36.091383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6b8fe48d-cfa9-4265-ae29-02534389a38a None None] MFA Rules not processed for user `c995d83693ec480e98b2166d74cf4152`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:36.094497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6b8fe48d-cfa9-4265-ae29-02534389a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:36.221517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:36.271091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa84d5d-959f-4768-a43f-89529b309e45 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:36.271904 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3062/6134] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:36.439644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa84d5d-959f-4768-a43f-89529b309e45 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:36.459042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91da27-6142-4e19-b66a-1826e0fa1398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:36.460906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91da27-6142-4e19-b66a-1826e0fa1398 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:36.460906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91da27-6142-4e19-b66a-1826e0fa1398 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:36.461349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91da27-6142-4e19-b66a-1826e0fa1398 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:36.462199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91da27-6142-4e19-b66a-1826e0fa1398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:36.464565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91da27-6142-4e19-b66a-1826e0fa1398 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:36.539819 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3073/6135] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:36 2022] POST /identity/v3/projects => generated 367 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:36.540066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe48d-cfa9-4265-ae29-02534389a38a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:36.555094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe48d-cfa9-4265-ae29-02534389a38a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:36.685773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbc571-f342-4957-806d-aba709615cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:36.686646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbc571-f342-4957-806d-aba709615cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:36.687040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbc571-f342-4957-806d-aba709615cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:36.687545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbc571-f342-4957-806d-aba709615cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:36.688222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbc571-f342-4957-806d-aba709615cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:36.690320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbc571-f342-4957-806d-aba709615cc2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:36.737782 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3063/6136] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:36 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:36.741104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91da27-6142-4e19-b66a-1826e0fa1398 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:36.761824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91da27-6142-4e19-b66a-1826e0fa1398 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:36.774016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbd909-7609-42ca-ba7a-f061d9af7b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:36.777441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbd909-7609-42ca-ba7a-f061d9af7b25 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:36.779630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbd909-7609-42ca-ba7a-f061d9af7b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:36.780331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbd909-7609-42ca-ba7a-f061d9af7b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:36.783168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbd909-7609-42ca-ba7a-f061d9af7b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:36.788220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbd909-7609-42ca-ba7a-f061d9af7b25 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:36.836785 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3074/6137] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:36.840221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbc571-f342-4957-806d-aba709615cc2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:36.857241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbc571-f342-4957-806d-aba709615cc2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:36.874366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a04149-e260-43ba-93aa-4d35d00d5a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:36.875173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a04149-e260-43ba-93aa-4d35d00d5a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:36.875527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a04149-e260-43ba-93aa-4d35d00d5a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:36.875884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a04149-e260-43ba-93aa-4d35d00d5a35 admin admin] PATH_INFO: `/v3/projects/d335a57e91ff461bbe7c81684b81368e/users/49ecf7083edc432bbaa45c077e340c37/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:36.914283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a04149-e260-43ba-93aa-4d35d00d5a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d335a57e91ff461bbe7c81684b81368e, user_id=49ecf7083edc432bbaa45c077e340c37, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:36.917091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a04149-e260-43ba-93aa-4d35d00d5a35 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:36.973696 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3064/6138] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:36 2022] PUT /identity/v3/projects/d335a57e91ff461bbe7c81684b81368e/users/49ecf7083edc432bbaa45c077e340c37/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:36.979099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbd909-7609-42ca-ba7a-f061d9af7b25 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:36.988616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:37.004340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbd909-7609-42ca-ba7a-f061d9af7b25 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:37.186211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc8d21-fe1c-4265-b526-ae88cce3540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:37.187562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8d21-fe1c-4265-b526-ae88cce3540c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:37.187855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8d21-fe1c-4265-b526-ae88cce3540c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:37.188191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8d21-fe1c-4265-b526-ae88cce3540c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:37.188961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc8d21-fe1c-4265-b526-ae88cce3540c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:37.190815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc8d21-fe1c-4265-b526-ae88cce3540c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:37.209466 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3075/6139] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:37.211033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a04149-e260-43ba-93aa-4d35d00d5a35 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:37.225206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a04149-e260-43ba-93aa-4d35d00d5a35 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:37.251634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a7b03-1115-4f44-9884-fc31d17aa2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:37.252327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a7b03-1115-4f44-9884-fc31d17aa2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:37.252605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a7b03-1115-4f44-9884-fc31d17aa2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:37.252882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a7b03-1115-4f44-9884-fc31d17aa2f5 admin admin] PATH_INFO: `/v3/projects/d335a57e91ff461bbe7c81684b81368e/users/49ecf7083edc432bbaa45c077e340c37/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:37.258029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a7b03-1115-4f44-9884-fc31d17aa2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d335a57e91ff461bbe7c81684b81368e, user_id=49ecf7083edc432bbaa45c077e340c37, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:37.260732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a7b03-1115-4f44-9884-fc31d17aa2f5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:37.318964 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3065/6140] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:37 2022] PUT /identity/v3/projects/d335a57e91ff461bbe7c81684b81368e/users/49ecf7083edc432bbaa45c077e340c37/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:37.330376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6602f51-35bf-4844-814f-698a74873396 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:37.330851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6602f51-35bf-4844-814f-698a74873396 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:37.331156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6602f51-35bf-4844-814f-698a74873396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:37.424692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d6602f51-35bf-4844-814f-698a74873396 None None] MFA Rules not processed for user `49ecf7083edc432bbaa45c077e340c37`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:37.428938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d6602f51-35bf-4844-814f-698a74873396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:37.674553 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3076/6141] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:53:37.680215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a7b03-1115-4f44-9884-fc31d17aa2f5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:37.718728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a7b03-1115-4f44-9884-fc31d17aa2f5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:37.727101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f311e-02af-4322-b695-d15ebfba5810 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:37.728695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f311e-02af-4322-b695-d15ebfba5810 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:37.729241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f311e-02af-4322-b695-d15ebfba5810 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:37.729942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f311e-02af-4322-b695-d15ebfba5810 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:37.735009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f311e-02af-4322-b695-d15ebfba5810 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:37.737507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f311e-02af-4322-b695-d15ebfba5810 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:37.778314 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3066/6142] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:53:37 2022] POST /identity/v3/domains => generated 276 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:37.779914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6602f51-35bf-4844-814f-698a74873396 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:37.792759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6602f51-35bf-4844-814f-698a74873396 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:37.913499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a3fe5-ef66-4e02-9a55-796151b06efd tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:37.916013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a3fe5-ef66-4e02-9a55-796151b06efd tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:37.917906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a3fe5-ef66-4e02-9a55-796151b06efd tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:37.918543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a3fe5-ef66-4e02-9a55-796151b06efd tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:37.920506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a3fe5-ef66-4e02-9a55-796151b06efd tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:37.923293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a3fe5-ef66-4e02-9a55-796151b06efd tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:38.042348 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3077/6143] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:37 2022] POST /identity/v3/projects => generated 401 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:38.043225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f311e-02af-4322-b695-d15ebfba5810 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:38.060523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f311e-02af-4322-b695-d15ebfba5810 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:38.272059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935092d8-1af7-4956-a14d-9ede73dbeed1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:38.272843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935092d8-1af7-4956-a14d-9ede73dbeed1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:38.273122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935092d8-1af7-4956-a14d-9ede73dbeed1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:38.273447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935092d8-1af7-4956-a14d-9ede73dbeed1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/groups` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:38.274212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935092d8-1af7-4956-a14d-9ede73dbeed1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:38.296646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935092d8-1af7-4956-a14d-9ede73dbeed1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:38.350678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a3fe5-ef66-4e02-9a55-796151b06efd tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:38.357336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:38.359207 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3067/6144] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:53:38 2022] POST /identity/v3/groups => generated 302 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:38.380284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a3fe5-ef66-4e02-9a55-796151b06efd tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:38.409782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592acf74-7085-4042-8b02-1a9ae8c1a0f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:38.422113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592acf74-7085-4042-8b02-1a9ae8c1a0f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:38.424337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592acf74-7085-4042-8b02-1a9ae8c1a0f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:38.426345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592acf74-7085-4042-8b02-1a9ae8c1a0f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:38.431512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592acf74-7085-4042-8b02-1a9ae8c1a0f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:38.435310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592acf74-7085-4042-8b02-1a9ae8c1a0f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:38.486137 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3078/6145] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:38 2022] POST /identity/v3/users => generated 445 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:38.486976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935092d8-1af7-4956-a14d-9ede73dbeed1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:38.507103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935092d8-1af7-4956-a14d-9ede73dbeed1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:38.528337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a48544-550a-4e6c-a8ad-0a0580dd8b95 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:38.540472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48544-550a-4e6c-a8ad-0a0580dd8b95 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:38.540840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48544-550a-4e6c-a8ad-0a0580dd8b95 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:38.541127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48544-550a-4e6c-a8ad-0a0580dd8b95 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:38.541897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a48544-550a-4e6c-a8ad-0a0580dd8b95 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:38.543545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a48544-550a-4e6c-a8ad-0a0580dd8b95 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:38.596642 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3068/6146] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:53:38 2022] POST /identity/v3/roles => generated 240 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:38.602942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592acf74-7085-4042-8b02-1a9ae8c1a0f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:38.621708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592acf74-7085-4042-8b02-1a9ae8c1a0f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:38.644096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf22cb4-ccc5-4470-9c68-5dc3fbe1bf0b tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:38.644866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf22cb4-ccc5-4470-9c68-5dc3fbe1bf0b tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:38.645237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf22cb4-ccc5-4470-9c68-5dc3fbe1bf0b tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:38.645635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf22cb4-ccc5-4470-9c68-5dc3fbe1bf0b tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/6a7dcf7fc0c1464e85b8c75a19ca7a3a/inherited_to_projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:38.657544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf22cb4-ccc5-4470-9c68-5dc3fbe1bf0b tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e9755a529c1c4e87872b02b745040690, group_id=67d85ff9506f43a39a4eaa9678f6cd12, role_id=6a7dcf7fc0c1464e85b8c75a19ca7a3a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:38.664208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf22cb4-ccc5-4470-9c68-5dc3fbe1bf0b tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:38.693649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a48544-550a-4e6c-a8ad-0a0580dd8b95 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:38.695002 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3079/6147] 10.222.0.16 () {60 vars in 1585 bytes} [Mon Aug 29 15:53:38 2022] PUT /identity/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/6a7dcf7fc0c1464e85b8c75a19ca7a3a/inherited_to_projects => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:38.707013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a48544-550a-4e6c-a8ad-0a0580dd8b95 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:38.714172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:38.836080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65986-06ec-490d-9339-7bf6c8cc385f tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:38.836788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65986-06ec-490d-9339-7bf6c8cc385f tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:38.837068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65986-06ec-490d-9339-7bf6c8cc385f tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:38.837347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65986-06ec-490d-9339-7bf6c8cc385f tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/6a7dcf7fc0c1464e85b8c75a19ca7a3a/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:38.839599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65986-06ec-490d-9339-7bf6c8cc385f tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:check_grant(project_id=e9755a529c1c4e87872b02b745040690, group_id=67d85ff9506f43a39a4eaa9678f6cd12, role_id=6a7dcf7fc0c1464e85b8c75a19ca7a3a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:38.843935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65986-06ec-490d-9339-7bf6c8cc385f tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:38.870372 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3069/6148] 10.222.0.16 () {58 vars in 1567 bytes} [Mon Aug 29 15:53:38 2022] HEAD /identity/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/6a7dcf7fc0c1464e85b8c75a19ca7a3a/inherited_to_projects => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:38.872173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf22cb4-ccc5-4470-9c68-5dc3fbe1bf0b tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:38.883812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf22cb4-ccc5-4470-9c68-5dc3fbe1bf0b tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:38.899475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4493792-4f93-49cf-9a3b-261343c36299 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:38.900181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4493792-4f93-49cf-9a3b-261343c36299 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:38.903039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4493792-4f93-49cf-9a3b-261343c36299 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:38.904171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4493792-4f93-49cf-9a3b-261343c36299 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/6a7dcf7fc0c1464e85b8c75a19ca7a3a/inherited_to_projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:38.911788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4493792-4f93-49cf-9a3b-261343c36299 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e9755a529c1c4e87872b02b745040690, group_id=67d85ff9506f43a39a4eaa9678f6cd12, role_id=6a7dcf7fc0c1464e85b8c75a19ca7a3a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:38.921808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4493792-4f93-49cf-9a3b-261343c36299 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:38.944877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4493792-4f93-49cf-9a3b-261343c36299 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role 6a7dcf7fc0c1464e85b8c75a19ca7a3a was removed from group 67d85ff9506f43a39a4eaa9678f6cd12 on project e9755a529c1c4e87872b02b745040690. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:38.945217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4493792-4f93-49cf-9a3b-261343c36299 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:38.947428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e4493792-4f93-49cf-9a3b-261343c36299 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:38.987370 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3080/6149] 10.222.0.16 () {58 vars in 1569 bytes} [Mon Aug 29 15:53:38 2022] DELETE /identity/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/6a7dcf7fc0c1464e85b8c75a19ca7a3a/inherited_to_projects => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:38.992835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65986-06ec-490d-9339-7bf6c8cc385f tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:38.994562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-32d65986-06ec-490d-9339-7bf6c8cc385f tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:39.039884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65986-06ec-490d-9339-7bf6c8cc385f tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:39.179003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:39.179664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:39.179945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:39.180232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles/6a7dcf7fc0c1464e85b8c75a19ca7a3a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:39.181848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6a7dcf7fc0c1464e85b8c75a19ca7a3a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:39.183458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:39.290983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role 6a7dcf7fc0c1464e85b8c75a19ca7a3a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:39.291956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:39.294125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:39.318610 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3070/6150] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:38 2022] DELETE /identity/v3/roles/6a7dcf7fc0c1464e85b8c75a19ca7a3a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:39.327098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4493792-4f93-49cf-9a3b-261343c36299 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:39.353149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4493792-4f93-49cf-9a3b-261343c36299 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:39.572895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c94f4-5aa2-49cf-b3d4-ce66ca32ef5e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:39.579394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c94f4-5aa2-49cf-b3d4-ce66ca32ef5e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:39.580937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c94f4-5aa2-49cf-b3d4-ce66ca32ef5e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:39.581436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c94f4-5aa2-49cf-b3d4-ce66ca32ef5e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:39.587572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c94f4-5aa2-49cf-b3d4-ce66ca32ef5e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:39.593936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c94f4-5aa2-49cf-b3d4-ce66ca32ef5e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:39.632531 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3081/6151] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:53:39 2022] POST /identity/v3/roles => generated 240 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:39.636265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:39.638620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:39.678791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2796f-70d9-4ea9-8935-a9c6f3d06742 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:39.717056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8958b2-b83c-4561-82a0-af6c6a90dfd4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:39.720327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8958b2-b83c-4561-82a0-af6c6a90dfd4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:39.731042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8958b2-b83c-4561-82a0-af6c6a90dfd4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:39.731042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8958b2-b83c-4561-82a0-af6c6a90dfd4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/95c7db1f24c54d81ac12ce2ba945db5c/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:39.837110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8958b2-b83c-4561-82a0-af6c6a90dfd4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e9755a529c1c4e87872b02b745040690, user_id=d21fda410e7a4b3d8ce43ce66991e51c, role_id=95c7db1f24c54d81ac12ce2ba945db5c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:39.839844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8958b2-b83c-4561-82a0-af6c6a90dfd4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:39.893758 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3071/6152] 10.222.0.16 () {60 vars in 1582 bytes} [Mon Aug 29 15:53:39 2022] PUT /identity/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/95c7db1f24c54d81ac12ce2ba945db5c/inherited_to_projects => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:39.894970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c94f4-5aa2-49cf-b3d4-ce66ca32ef5e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:39.912842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c94f4-5aa2-49cf-b3d4-ce66ca32ef5e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:40.145160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767ba15-5b99-422d-877a-1a5b1d9091b7 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:40.150496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ba15-5b99-422d-877a-1a5b1d9091b7 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:40.150808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ba15-5b99-422d-877a-1a5b1d9091b7 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:40.152382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ba15-5b99-422d-877a-1a5b1d9091b7 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/95c7db1f24c54d81ac12ce2ba945db5c/inherited_to_projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:40.163342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767ba15-5b99-422d-877a-1a5b1d9091b7 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:check_grant(project_id=e9755a529c1c4e87872b02b745040690, user_id=d21fda410e7a4b3d8ce43ce66991e51c, role_id=95c7db1f24c54d81ac12ce2ba945db5c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:40.170489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767ba15-5b99-422d-877a-1a5b1d9091b7 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:40.192967 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3082/6153] 10.222.0.16 () {58 vars in 1564 bytes} [Mon Aug 29 15:53:39 2022] HEAD /identity/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/95c7db1f24c54d81ac12ce2ba945db5c/inherited_to_projects => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:40.197931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8958b2-b83c-4561-82a0-af6c6a90dfd4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:40.222705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8958b2-b83c-4561-82a0-af6c6a90dfd4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:40.229238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16013543-c07d-4ab2-8dd2-653e9453d363 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:40.230666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16013543-c07d-4ab2-8dd2-653e9453d363 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:40.231312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16013543-c07d-4ab2-8dd2-653e9453d363 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:40.233046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16013543-c07d-4ab2-8dd2-653e9453d363 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/95c7db1f24c54d81ac12ce2ba945db5c/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:40.238444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16013543-c07d-4ab2-8dd2-653e9453d363 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e9755a529c1c4e87872b02b745040690, user_id=d21fda410e7a4b3d8ce43ce66991e51c, role_id=95c7db1f24c54d81ac12ce2ba945db5c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:40.246594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16013543-c07d-4ab2-8dd2-653e9453d363 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:40.270286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-16013543-c07d-4ab2-8dd2-653e9453d363 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role 95c7db1f24c54d81ac12ce2ba945db5c was removed from user d21fda410e7a4b3d8ce43ce66991e51c on project e9755a529c1c4e87872b02b745040690. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:40.272245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-16013543-c07d-4ab2-8dd2-653e9453d363 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:40.273237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-16013543-c07d-4ab2-8dd2-653e9453d363 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:40.335055 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3072/6154] 10.222.0.16 () {58 vars in 1566 bytes} [Mon Aug 29 15:53:40 2022] DELETE /identity/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/95c7db1f24c54d81ac12ce2ba945db5c/inherited_to_projects => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:40.339081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767ba15-5b99-422d-877a-1a5b1d9091b7 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:40.342169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9767ba15-5b99-422d-877a-1a5b1d9091b7 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:40.362272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767ba15-5b99-422d-877a-1a5b1d9091b7 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:40.450543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:40.637435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:40.640736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:40.641241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:40.642273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles/95c7db1f24c54d81ac12ce2ba945db5c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:40.645278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_role(role_id=95c7db1f24c54d81ac12ce2ba945db5c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:40.651517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:40.741685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role 95c7db1f24c54d81ac12ce2ba945db5c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:40.742538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:40.743550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:40.747177 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3083/6155] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:40 2022] DELETE /identity/v3/roles/95c7db1f24c54d81ac12ce2ba945db5c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:40.752523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16013543-c07d-4ab2-8dd2-653e9453d363 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:40.783646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:40.823997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16013543-c07d-4ab2-8dd2-653e9453d363 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:41.009112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac3689-941e-4785-baae-e5a1ab9938b5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:41.010942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac3689-941e-4785-baae-e5a1ab9938b5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:41.011113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac3689-941e-4785-baae-e5a1ab9938b5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:41.011649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac3689-941e-4785-baae-e5a1ab9938b5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:41.012624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac3689-941e-4785-baae-e5a1ab9938b5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:41.015334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac3689-941e-4785-baae-e5a1ab9938b5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:41.037360 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3073/6156] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:53:40 2022] POST /identity/v3/roles => generated 239 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:41.041694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:41.046574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:41.058376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac3689-941e-4785-baae-e5a1ab9938b5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:41.066400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-25ac3689-941e-4785-baae-e5a1ab9938b5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:41.102373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac3689-941e-4785-baae-e5a1ab9938b5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:41.121845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54df7fe-a0ad-4a25-95b1-7f0b5195c0c5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:41.124493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54df7fe-a0ad-4a25-95b1-7f0b5195c0c5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:41.124493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54df7fe-a0ad-4a25-95b1-7f0b5195c0c5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:41.126030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54df7fe-a0ad-4a25-95b1-7f0b5195c0c5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/95501653a06b4da3950addf07427efa2/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:41.132772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54df7fe-a0ad-4a25-95b1-7f0b5195c0c5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=44d0be676cdb4cdc8ada517754c6f08a, group_id=67d85ff9506f43a39a4eaa9678f6cd12, role_id=95501653a06b4da3950addf07427efa2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:41.138894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54df7fe-a0ad-4a25-95b1-7f0b5195c0c5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:41.173496 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3074/6157] 10.222.0.16 () {60 vars in 1582 bytes} [Mon Aug 29 15:53:41 2022] PUT /identity/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/95501653a06b4da3950addf07427efa2/inherited_to_projects => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:41.178580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54df7fe-a0ad-4a25-95b1-7f0b5195c0c5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:41.340044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13692dda-c6f7-45c6-8c0c-dd7daf492068 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:41.482128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54df7fe-a0ad-4a25-95b1-7f0b5195c0c5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:41.493498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00650536-f68a-4bf5-bdba-cc5bb4e4f422 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:41.494279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00650536-f68a-4bf5-bdba-cc5bb4e4f422 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:41.495097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00650536-f68a-4bf5-bdba-cc5bb4e4f422 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:41.495486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00650536-f68a-4bf5-bdba-cc5bb4e4f422 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:41.499128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00650536-f68a-4bf5-bdba-cc5bb4e4f422 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=44d0be676cdb4cdc8ada517754c6f08a, group_id=67d85ff9506f43a39a4eaa9678f6cd12)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:41.502093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00650536-f68a-4bf5-bdba-cc5bb4e4f422 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:41.520448 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3075/6158] 10.222.0.16 () {58 vars in 1464 bytes} [Mon Aug 29 15:53:41 2022] GET /identity/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/inherited_to_projects => generated 447 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:41.526544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00650536-f68a-4bf5-bdba-cc5bb4e4f422 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:41.532260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ca37e-076c-4232-9cd5-e037e1145d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:41.532744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ca37e-076c-4232-9cd5-e037e1145d52 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:41.533136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ca37e-076c-4232-9cd5-e037e1145d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:41.534556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ca37e-076c-4232-9cd5-e037e1145d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:41.541645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-371ca37e-076c-4232-9cd5-e037e1145d52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:41.574098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00650536-f68a-4bf5-bdba-cc5bb4e4f422 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:41.601466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201002e2-5af4-4662-8b7b-541b39081d62 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:41.604920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201002e2-5af4-4662-8b7b-541b39081d62 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:41.606628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201002e2-5af4-4662-8b7b-541b39081d62 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:41.609317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201002e2-5af4-4662-8b7b-541b39081d62 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/95501653a06b4da3950addf07427efa2/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:41.616739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201002e2-5af4-4662-8b7b-541b39081d62 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=44d0be676cdb4cdc8ada517754c6f08a, group_id=67d85ff9506f43a39a4eaa9678f6cd12, role_id=95501653a06b4da3950addf07427efa2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:41.625404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201002e2-5af4-4662-8b7b-541b39081d62 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:41.643006 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3076/6159] 10.222.0.16 () {58 vars in 1564 bytes} [Mon Aug 29 15:53:41 2022] HEAD /identity/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/95501653a06b4da3950addf07427efa2/inherited_to_projects => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:41.648613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201002e2-5af4-4662-8b7b-541b39081d62 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:41.661792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:41.682707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201002e2-5af4-4662-8b7b-541b39081d62 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:41.697933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:41.699329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:41.701417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:41.701835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/95501653a06b4da3950addf07427efa2/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:41.714604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=44d0be676cdb4cdc8ada517754c6f08a, group_id=67d85ff9506f43a39a4eaa9678f6cd12, role_id=95501653a06b4da3950addf07427efa2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:41.719459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:41.734611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role 95501653a06b4da3950addf07427efa2 was removed from group 67d85ff9506f43a39a4eaa9678f6cd12 on domain 44d0be676cdb4cdc8ada517754c6f08a. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:41.735153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:41.737037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:41.760099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ca37e-076c-4232-9cd5-e037e1145d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:41.761980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ca37e-076c-4232-9cd5-e037e1145d52 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:41.788118 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3084/6161] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:53:41.788399 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3077/6161] 10.222.0.16 () {58 vars in 1566 bytes} [Mon Aug 29 15:53:41 2022] DELETE /identity/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/groups/67d85ff9506f43a39a4eaa9678f6cd12/roles/95501653a06b4da3950addf07427efa2/inherited_to_projects => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:41.792250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ca37e-076c-4232-9cd5-e037e1145d52 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:41.817579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ca37e-076c-4232-9cd5-e037e1145d52 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:41.968813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:41.973637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:41.974025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:41.974346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles/95501653a06b4da3950addf07427efa2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:41.976222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_role(role_id=95501653a06b4da3950addf07427efa2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:41.978097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:42.057693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role 95501653a06b4da3950addf07427efa2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:42.058461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:42.058666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:42.064533 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3085/6162] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:41 2022] DELETE /identity/v3/roles/95501653a06b4da3950addf07427efa2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:42.070037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:42.071824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:42.100648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282e3ba-a10e-4b16-b97b-a974b7ca2343 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:42.205717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:42.271481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa1ceb-fd5f-4c53-aee1-4a7a282367c8 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:42.272392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa1ceb-fd5f-4c53-aee1-4a7a282367c8 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:42.272776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa1ceb-fd5f-4c53-aee1-4a7a282367c8 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:42.273102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa1ceb-fd5f-4c53-aee1-4a7a282367c8 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:42.273853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa1ceb-fd5f-4c53-aee1-4a7a282367c8 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:42.280356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa1ceb-fd5f-4c53-aee1-4a7a282367c8 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:42.313106 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3078/6163] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:53:42 2022] POST /identity/v3/roles => generated 240 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:42.323226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:42.340754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:42.360411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7634d62-0be1-4611-896a-81e1472f2095 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:42.368071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e66761-d999-4a75-8ec9-cdcf694e6ea6 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:42.368991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e66761-d999-4a75-8ec9-cdcf694e6ea6 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:42.369339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e66761-d999-4a75-8ec9-cdcf694e6ea6 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:42.381782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e66761-d999-4a75-8ec9-cdcf694e6ea6 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/c86ece473737490ea4743c98a07f8ebe/inherited_to_projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:42.389940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e66761-d999-4a75-8ec9-cdcf694e6ea6 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=44d0be676cdb4cdc8ada517754c6f08a, user_id=d21fda410e7a4b3d8ce43ce66991e51c, role_id=c86ece473737490ea4743c98a07f8ebe)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:42.393574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e66761-d999-4a75-8ec9-cdcf694e6ea6 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:42.430310 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3086/6164] 10.222.0.16 () {60 vars in 1579 bytes} [Mon Aug 29 15:53:42 2022] PUT /identity/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/c86ece473737490ea4743c98a07f8ebe/inherited_to_projects => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:42.434270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa1ceb-fd5f-4c53-aee1-4a7a282367c8 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:42.455062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa1ceb-fd5f-4c53-aee1-4a7a282367c8 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:42.615553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66770ff5-09fb-46a0-9f55-e3ab8e08e0aa tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:42.616309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66770ff5-09fb-46a0-9f55-e3ab8e08e0aa tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:42.616850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66770ff5-09fb-46a0-9f55-e3ab8e08e0aa tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:42.616850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66770ff5-09fb-46a0-9f55-e3ab8e08e0aa tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:42.620131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66770ff5-09fb-46a0-9f55-e3ab8e08e0aa tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=44d0be676cdb4cdc8ada517754c6f08a, user_id=d21fda410e7a4b3d8ce43ce66991e51c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:42.623582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66770ff5-09fb-46a0-9f55-e3ab8e08e0aa tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:42.675547 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3079/6165] 10.222.0.16 () {58 vars in 1461 bytes} [Mon Aug 29 15:53:42 2022] GET /identity/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/inherited_to_projects => generated 447 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:42.677067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e66761-d999-4a75-8ec9-cdcf694e6ea6 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:42.713524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e66761-d999-4a75-8ec9-cdcf694e6ea6 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:42.744214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad726d81-1337-4df8-b587-f5b42b0cfcad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:42.744962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad726d81-1337-4df8-b587-f5b42b0cfcad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `HEAD` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:42.745247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad726d81-1337-4df8-b587-f5b42b0cfcad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:42.745546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad726d81-1337-4df8-b587-f5b42b0cfcad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/c86ece473737490ea4743c98a07f8ebe/inherited_to_projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:42.766217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad726d81-1337-4df8-b587-f5b42b0cfcad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=44d0be676cdb4cdc8ada517754c6f08a, user_id=d21fda410e7a4b3d8ce43ce66991e51c, role_id=c86ece473737490ea4743c98a07f8ebe)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:42.783067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad726d81-1337-4df8-b587-f5b42b0cfcad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:42.812690 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3087/6166] 10.222.0.16 () {58 vars in 1561 bytes} [Mon Aug 29 15:53:42 2022] HEAD /identity/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/c86ece473737490ea4743c98a07f8ebe/inherited_to_projects => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:42.816931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66770ff5-09fb-46a0-9f55-e3ab8e08e0aa tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:42.845122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66770ff5-09fb-46a0-9f55-e3ab8e08e0aa tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:42.856501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62867f-7f4e-47db-bf05-a3356a1d8c35 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:42.857657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62867f-7f4e-47db-bf05-a3356a1d8c35 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:42.858131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62867f-7f4e-47db-bf05-a3356a1d8c35 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:42.858611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62867f-7f4e-47db-bf05-a3356a1d8c35 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/c86ece473737490ea4743c98a07f8ebe/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:42.866162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62867f-7f4e-47db-bf05-a3356a1d8c35 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=44d0be676cdb4cdc8ada517754c6f08a, user_id=d21fda410e7a4b3d8ce43ce66991e51c, role_id=c86ece473737490ea4743c98a07f8ebe)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:42.873048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62867f-7f4e-47db-bf05-a3356a1d8c35 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:42.907836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d62867f-7f4e-47db-bf05-a3356a1d8c35 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role c86ece473737490ea4743c98a07f8ebe was removed from user d21fda410e7a4b3d8ce43ce66991e51c on domain 44d0be676cdb4cdc8ada517754c6f08a. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:42.908516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d62867f-7f4e-47db-bf05-a3356a1d8c35 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:42.909767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d62867f-7f4e-47db-bf05-a3356a1d8c35 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:42.957285 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3080/6167] 10.222.0.16 () {58 vars in 1563 bytes} [Mon Aug 29 15:53:42 2022] DELETE /identity/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/c86ece473737490ea4743c98a07f8ebe/inherited_to_projects => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:42.961858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad726d81-1337-4df8-b587-f5b42b0cfcad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:42.963938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ad726d81-1337-4df8-b587-f5b42b0cfcad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:42.986609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad726d81-1337-4df8-b587-f5b42b0cfcad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:43.109287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:43.110555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:43.110844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:43.112484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles/c86ece473737490ea4743c98a07f8ebe` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:43.123496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c86ece473737490ea4743c98a07f8ebe)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:43.126649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:43.152574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:43.287893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role c86ece473737490ea4743c98a07f8ebe has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:43.288320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:43.291618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:43.293503 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3088/6168] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:42 2022] DELETE /identity/v3/roles/c86ece473737490ea4743c98a07f8ebe => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:43.299611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62867f-7f4e-47db-bf05-a3356a1d8c35 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:43.356071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62867f-7f4e-47db-bf05-a3356a1d8c35 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:43.713889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ec0d7-211e-49c5-a415-49c9352fffa1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:43.717648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ec0d7-211e-49c5-a415-49c9352fffa1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:43.718381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ec0d7-211e-49c5-a415-49c9352fffa1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:43.729970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ec0d7-211e-49c5-a415-49c9352fffa1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:43.730764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ec0d7-211e-49c5-a415-49c9352fffa1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:43.732645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ec0d7-211e-49c5-a415-49c9352fffa1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:43.798470 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3081/6169] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:53:43 2022] POST /identity/v3/roles => generated 238 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:43.804914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:43.807383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:43.853356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85d7b3-4137-4414-b788-d2979aa94500 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:43.884836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aece70-9b24-41cb-906e-9d1f15b9a5ad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:43.886007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aece70-9b24-41cb-906e-9d1f15b9a5ad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:43.886612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aece70-9b24-41cb-906e-9d1f15b9a5ad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:43.894172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aece70-9b24-41cb-906e-9d1f15b9a5ad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:43.895473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aece70-9b24-41cb-906e-9d1f15b9a5ad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:43.900810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aece70-9b24-41cb-906e-9d1f15b9a5ad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:44.148991 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3089/6170] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:43 2022] POST /identity/v3/projects => generated 410 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:44.152109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ec0d7-211e-49c5-a415-49c9352fffa1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:44.181203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ec0d7-211e-49c5-a415-49c9352fffa1 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:44.315001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:44.345150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c131b-852d-4374-9287-2304f91205b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:44.347487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c131b-852d-4374-9287-2304f91205b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:44.355084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c131b-852d-4374-9287-2304f91205b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:44.355524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c131b-852d-4374-9287-2304f91205b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/d36b3ad5ac91405880ac8babd91f8af8/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:44.360515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c131b-852d-4374-9287-2304f91205b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=44d0be676cdb4cdc8ada517754c6f08a, user_id=d21fda410e7a4b3d8ce43ce66991e51c, role_id=d36b3ad5ac91405880ac8babd91f8af8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:44.364651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c131b-852d-4374-9287-2304f91205b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:44.388151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aece70-9b24-41cb-906e-9d1f15b9a5ad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:44.394945 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3082/6171] 10.222.0.16 () {60 vars in 1579 bytes} [Mon Aug 29 15:53:44 2022] PUT /identity/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/d36b3ad5ac91405880ac8babd91f8af8/inherited_to_projects => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:44.395223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c8aece70-9b24-41cb-906e-9d1f15b9a5ad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:44.396359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c131b-852d-4374-9287-2304f91205b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:44.524866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aece70-9b24-41cb-906e-9d1f15b9a5ad tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:44.586376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c131b-852d-4374-9287-2304f91205b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:44.597763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3cd2d-4374-4712-afa2-8edadc8edc20 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:44.598843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3cd2d-4374-4712-afa2-8edadc8edc20 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:44.599353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3cd2d-4374-4712-afa2-8edadc8edc20 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:44.599856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3cd2d-4374-4712-afa2-8edadc8edc20 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:44.601620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3cd2d-4374-4712-afa2-8edadc8edc20 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Adding query filter params (scope.project.id=e9755a529c1c4e87872b02b745040690, user.id=d21fda410e7a4b3d8ce43ce66991e51c) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:44.602251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3cd2d-4374-4712-afa2-8edadc8edc20 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:44.608638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3cd2d-4374-4712-afa2-8edadc8edc20 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:44.666145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee21e2-6900-4833-ad3d-f4e16cdb4f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:44.667531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee21e2-6900-4833-ad3d-f4e16cdb4f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:44.668024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee21e2-6900-4833-ad3d-f4e16cdb4f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:44.668479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee21e2-6900-4833-ad3d-f4e16cdb4f30 admin admin] PATH_INFO: `/v3/users/b4a7d8cd1f3e4ce2814bbd37dada2130` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:44.670558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee21e2-6900-4833-ad3d-f4e16cdb4f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a7d8cd1f3e4ce2814bbd37dada2130)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:44.673417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee21e2-6900-4833-ad3d-f4e16cdb4f30 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:44.738739 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3083/6172] 10.222.0.16 () {58 vars in 1356 bytes} [Mon Aug 29 15:53:44 2022] GET /identity/v3/role_assignments?scope.project.id=e9755a529c1c4e87872b02b745040690&user.id=d21fda410e7a4b3d8ce43ce66991e51c&effective => generated 648 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:44.739831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3cd2d-4374-4712-afa2-8edadc8edc20 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:44.753823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-44ee21e2-6900-4833-ad3d-f4e16cdb4f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a7d8cd1f3e4ce2814bbd37dada2130'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:44.753823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-44ee21e2-6900-4833-ad3d-f4e16cdb4f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a7d8cd1f3e4ce2814bbd37dada2130'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:44.754216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3cd2d-4374-4712-afa2-8edadc8edc20 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:44.766612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dabc4-1945-42d4-8151-6960ef7826b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:44.766612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dabc4-1945-42d4-8151-6960ef7826b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:44.766612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dabc4-1945-42d4-8151-6960ef7826b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:44.767369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dabc4-1945-42d4-8151-6960ef7826b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:44.767369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dabc4-1945-42d4-8151-6960ef7826b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Adding query filter params (scope.project.id=1edd776bb46847989d53a3600d3d957d, user.id=d21fda410e7a4b3d8ce43ce66991e51c) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:44.767369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dabc4-1945-42d4-8151-6960ef7826b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:44.767369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dabc4-1945-42d4-8151-6960ef7826b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:44.786275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:44.790817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-44ee21e2-6900-4833-ad3d-f4e16cdb4f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a7d8cd1f3e4ce2814bbd37dada2130'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:44.794923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-44ee21e2-6900-4833-ad3d-f4e16cdb4f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a7d8cd1f3e4ce2814bbd37dada2130'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:44.808459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-44ee21e2-6900-4833-ad3d-f4e16cdb4f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a7d8cd1f3e4ce2814bbd37dada2130'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:44.831169 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3090/6173] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:44 2022] DELETE /identity/v3/users/b4a7d8cd1f3e4ce2814bbd37dada2130 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:44.832801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632d53e-2226-4f28-b439-9d737e837878 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:44.833638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632d53e-2226-4f28-b439-9d737e837878 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:44.834202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632d53e-2226-4f28-b439-9d737e837878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:44.858424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0632d53e-2226-4f28-b439-9d737e837878 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:44.860055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0632d53e-2226-4f28-b439-9d737e837878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:44.877642 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3084/6174] 10.222.0.16 () {58 vars in 1356 bytes} [Mon Aug 29 15:53:44 2022] GET /identity/v3/role_assignments?scope.project.id=1edd776bb46847989d53a3600d3d957d&user.id=d21fda410e7a4b3d8ce43ce66991e51c&effective => generated 648 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:44.879372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dabc4-1945-42d4-8151-6960ef7826b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:44.882876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3f6dabc4-1945-42d4-8151-6960ef7826b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:44.909206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dabc4-1945-42d4-8151-6960ef7826b9 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:44.948284 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3091/6175] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:44.985494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:45.010248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632d53e-2226-4f28-b439-9d737e837878 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:45.010814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:45.011520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:45.011808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:45.012277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0632d53e-2226-4f28-b439-9d737e837878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:45.012483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/d36b3ad5ac91405880ac8babd91f8af8/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:45.016450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=44d0be676cdb4cdc8ada517754c6f08a, user_id=d21fda410e7a4b3d8ce43ce66991e51c, role_id=d36b3ad5ac91405880ac8babd91f8af8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:45.020181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:45.027781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role d36b3ad5ac91405880ac8babd91f8af8 was removed from user d21fda410e7a4b3d8ce43ce66991e51c on domain 44d0be676cdb4cdc8ada517754c6f08a. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:45.028336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:45.030518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:45.050161 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3085/6176] 10.222.0.16 () {58 vars in 1563 bytes} [Mon Aug 29 15:53:44 2022] DELETE /identity/v3/OS-INHERIT/domains/44d0be676cdb4cdc8ada517754c6f08a/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/d36b3ad5ac91405880ac8babd91f8af8/inherited_to_projects => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:45.065013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:45.066524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:45.108338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632d53e-2226-4f28-b439-9d737e837878 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:45.226292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ad737-6e16-4f98-b103-210b19adbb40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:45.227017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ad737-6e16-4f98-b103-210b19adbb40 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:45.227378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ad737-6e16-4f98-b103-210b19adbb40 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:45.227725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ad737-6e16-4f98-b103-210b19adbb40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:45.229819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2d3ad737-6e16-4f98-b103-210b19adbb40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:45.238640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed97d04-0969-4a24-9e19-331d1954e107 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:45.248977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f5041-89ee-4e74-b317-c6db7b1714e5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:45.249942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f5041-89ee-4e74-b317-c6db7b1714e5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:45.250423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f5041-89ee-4e74-b317-c6db7b1714e5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:45.250995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f5041-89ee-4e74-b317-c6db7b1714e5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:45.252025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f5041-89ee-4e74-b317-c6db7b1714e5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Adding query filter params (scope.project.id=e9755a529c1c4e87872b02b745040690, user.id=d21fda410e7a4b3d8ce43ce66991e51c) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:45.252516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f5041-89ee-4e74-b317-c6db7b1714e5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:45.255411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f5041-89ee-4e74-b317-c6db7b1714e5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:45.329489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:45.360843 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3086/6177] 10.222.0.16 () {58 vars in 1356 bytes} [Mon Aug 29 15:53:45 2022] GET /identity/v3/role_assignments?scope.project.id=e9755a529c1c4e87872b02b745040690&user.id=d21fda410e7a4b3d8ce43ce66991e51c&effective => generated 228 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:45.362326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f5041-89ee-4e74-b317-c6db7b1714e5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:45.365232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ad737-6e16-4f98-b103-210b19adbb40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:45.367808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ad737-6e16-4f98-b103-210b19adbb40 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:45.378588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f5041-89ee-4e74-b317-c6db7b1714e5 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:45.384574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dfff2-d695-45c0-834a-fbbf2a556238 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:45.385439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dfff2-d695-45c0-834a-fbbf2a556238 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:45.385739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dfff2-d695-45c0-834a-fbbf2a556238 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:45.386089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dfff2-d695-45c0-834a-fbbf2a556238 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:45.386793 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3092/6178] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:45.386944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dfff2-d695-45c0-834a-fbbf2a556238 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Adding query filter params (scope.project.id=1edd776bb46847989d53a3600d3d957d, user.id=d21fda410e7a4b3d8ce43ce66991e51c) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:45.387331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dfff2-d695-45c0-834a-fbbf2a556238 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:45.389462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dfff2-d695-45c0-834a-fbbf2a556238 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:45.455158 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3087/6179] 10.222.0.16 () {58 vars in 1356 bytes} [Mon Aug 29 15:53:45 2022] GET /identity/v3/role_assignments?scope.project.id=1edd776bb46847989d53a3600d3d957d&user.id=d21fda410e7a4b3d8ce43ce66991e51c&effective => generated 228 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:45.464358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ad737-6e16-4f98-b103-210b19adbb40 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:45.490322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ad737-6e16-4f98-b103-210b19adbb40 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:45.496333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:45.497640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:45.497938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:45.498219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/projects/1edd776bb46847989d53a3600d3d957d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:45.499428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1edd776bb46847989d53a3600d3d957d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:45.501624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:45.552784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dfff2-d695-45c0-834a-fbbf2a556238 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:45.554913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b20dfff2-d695-45c0-834a-fbbf2a556238 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:45.576486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dfff2-d695-45c0-834a-fbbf2a556238 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:45.581284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1edd776bb46847989d53a3600d3d957d', 'request_id': 'req-ce72faa8-8942-47d4-a0ab-8074c1b4310c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:45.594836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1edd776bb46847989d53a3600d3d957d', 'request_id': 'req-ce72faa8-8942-47d4-a0ab-8074c1b4310c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:45.612986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1edd776bb46847989d53a3600d3d957d', 'request_id': 'req-ce72faa8-8942-47d4-a0ab-8074c1b4310c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:45.632414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] The token cache is being invalidate because project 1edd776bb46847989d53a3600d3d957d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:45.632687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:45.633844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:45.642018 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3093/6180] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:45 2022] DELETE /identity/v3/projects/1edd776bb46847989d53a3600d3d957d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:45.643030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:45.651710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:45.668702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:45.688500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98de1c-dcc2-4a9f-b808-522186e41421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:45.689135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98de1c-dcc2-4a9f-b808-522186e41421 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:45.689430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98de1c-dcc2-4a9f-b808-522186e41421 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:45.689734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98de1c-dcc2-4a9f-b808-522186e41421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:45.695899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1b98de1c-dcc2-4a9f-b808-522186e41421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:45.719157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98de1c-dcc2-4a9f-b808-522186e41421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:45.720675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98de1c-dcc2-4a9f-b808-522186e41421 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:45.747479 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3088/6181] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:53:45.824481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72faa8-8942-47d4-a0ab-8074c1b4310c tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:45.831110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:45.831833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:45.832119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:45.832397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles/d36b3ad5ac91405880ac8babd91f8af8` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:45.835322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d36b3ad5ac91405880ac8babd91f8af8)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:45.837176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:45.888511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role d36b3ad5ac91405880ac8babd91f8af8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:45.888942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:45.890012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:45.897943 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3094/6182] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:45 2022] DELETE /identity/v3/roles/d36b3ad5ac91405880ac8babd91f8af8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:45.898260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98de1c-dcc2-4a9f-b808-522186e41421 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:45.922555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98de1c-dcc2-4a9f-b808-522186e41421 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:46.037507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a732fae-78f6-420d-bfb6-3b4e22b7ac33 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:46.038703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a732fae-78f6-420d-bfb6-3b4e22b7ac33 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:46.039234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a732fae-78f6-420d-bfb6-3b4e22b7ac33 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:46.039842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a732fae-78f6-420d-bfb6-3b4e22b7ac33 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:46.041566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a732fae-78f6-420d-bfb6-3b4e22b7ac33 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:46.044777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a732fae-78f6-420d-bfb6-3b4e22b7ac33 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:46.078455 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3089/6183] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:53:45 2022] POST /identity/v3/roles => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:46.084271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:46.086704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:46.144387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a729f47-fe80-4768-8987-aa3632180efc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:46.144387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620202c-0a8e-4059-bdd7-ebd5b56d3cbf tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:46.144387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620202c-0a8e-4059-bdd7-ebd5b56d3cbf tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:46.145580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620202c-0a8e-4059-bdd7-ebd5b56d3cbf tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:46.145580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620202c-0a8e-4059-bdd7-ebd5b56d3cbf tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:46.145580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620202c-0a8e-4059-bdd7-ebd5b56d3cbf tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:46.147740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620202c-0a8e-4059-bdd7-ebd5b56d3cbf tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:46.212045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a732fae-78f6-420d-bfb6-3b4e22b7ac33 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:46.223654 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3095/6184] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:46 2022] POST /identity/v3/projects => generated 409 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:46.226705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a732fae-78f6-420d-bfb6-3b4e22b7ac33 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:46.347553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e61d0-d20c-45b8-9a5c-26ed56f8cd14 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:46.348267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e61d0-d20c-45b8-9a5c-26ed56f8cd14 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:46.348955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e61d0-d20c-45b8-9a5c-26ed56f8cd14 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:46.348955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e61d0-d20c-45b8-9a5c-26ed56f8cd14 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/7b05c93d9a854fe48066e6f0cd50349d/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:46.356735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e61d0-d20c-45b8-9a5c-26ed56f8cd14 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e9755a529c1c4e87872b02b745040690, user_id=d21fda410e7a4b3d8ce43ce66991e51c, role_id=7b05c93d9a854fe48066e6f0cd50349d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:46.360882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e61d0-d20c-45b8-9a5c-26ed56f8cd14 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:46.394111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620202c-0a8e-4059-bdd7-ebd5b56d3cbf tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:46.395968 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3090/6185] 10.222.0.16 () {60 vars in 1582 bytes} [Mon Aug 29 15:53:46 2022] PUT /identity/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/7b05c93d9a854fe48066e6f0cd50349d/inherited_to_projects => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:46.407514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620202c-0a8e-4059-bdd7-ebd5b56d3cbf tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:46.416172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:46.511097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7544c-42e0-4f0c-8713-d529a44f54b3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:46.511731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7544c-42e0-4f0c-8713-d529a44f54b3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:46.512018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7544c-42e0-4f0c-8713-d529a44f54b3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:46.512299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7544c-42e0-4f0c-8713-d529a44f54b3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:46.513654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7544c-42e0-4f0c-8713-d529a44f54b3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Adding query filter params (scope.project.id=3b0c8a4a95074da38463093ca47ba812, user.id=d21fda410e7a4b3d8ce43ce66991e51c) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:46.513969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7544c-42e0-4f0c-8713-d529a44f54b3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:46.515912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7544c-42e0-4f0c-8713-d529a44f54b3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:46.600468 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3096/6186] 10.222.0.16 () {58 vars in 1356 bytes} [Mon Aug 29 15:53:46 2022] GET /identity/v3/role_assignments?scope.project.id=3b0c8a4a95074da38463093ca47ba812&user.id=d21fda410e7a4b3d8ce43ce66991e51c&effective => generated 649 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:46.604265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e61d0-d20c-45b8-9a5c-26ed56f8cd14 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:46.616070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e61d0-d20c-45b8-9a5c-26ed56f8cd14 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:46.622269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:46.622966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:46.623253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:46.623540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/7b05c93d9a854fe48066e6f0cd50349d/inherited_to_projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:46.626502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e9755a529c1c4e87872b02b745040690, user_id=d21fda410e7a4b3d8ce43ce66991e51c, role_id=7b05c93d9a854fe48066e6f0cd50349d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:46.629468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:46.637337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role 7b05c93d9a854fe48066e6f0cd50349d was removed from user d21fda410e7a4b3d8ce43ce66991e51c on project e9755a529c1c4e87872b02b745040690. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:46.637696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:46.638545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:46.671373 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3091/6187] 10.222.0.16 () {58 vars in 1566 bytes} [Mon Aug 29 15:53:46 2022] DELETE /identity/v3/OS-INHERIT/projects/e9755a529c1c4e87872b02b745040690/users/d21fda410e7a4b3d8ce43ce66991e51c/roles/7b05c93d9a854fe48066e6f0cd50349d/inherited_to_projects => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:46.676661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7544c-42e0-4f0c-8713-d529a44f54b3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:46.679753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-65c7544c-42e0-4f0c-8713-d529a44f54b3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:46.698208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:46.699010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:46.710389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7544c-42e0-4f0c-8713-d529a44f54b3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:46.897122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:46.911516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f998d-0c3a-468e-8f80-392d3dd222d3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:46.912064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f998d-0c3a-468e-8f80-392d3dd222d3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:46.912314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f998d-0c3a-468e-8f80-392d3dd222d3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:46.912560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f998d-0c3a-468e-8f80-392d3dd222d3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:46.913300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f998d-0c3a-468e-8f80-392d3dd222d3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Adding query filter params (scope.project.id=3b0c8a4a95074da38463093ca47ba812, user.id=d21fda410e7a4b3d8ce43ce66991e51c) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:46.913632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f998d-0c3a-468e-8f80-392d3dd222d3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:46.915510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f998d-0c3a-468e-8f80-392d3dd222d3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:46.926463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25fd5-dc4e-4b06-b96c-9fc26ec94c99 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:46.936326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:46.938224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:46.944558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:46.945325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] PATH_INFO: `/v3/projects/6122e581164e40398a09a83ef36b8340` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:46.947211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6122e581164e40398a09a83ef36b8340)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:46.950770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:47.023544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6122e581164e40398a09a83ef36b8340', 'request_id': 'req-b17a5686-bb50-41ce-bb80-d0416940cc09'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.033836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6122e581164e40398a09a83ef36b8340', 'request_id': 'req-b17a5686-bb50-41ce-bb80-d0416940cc09'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.044449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6122e581164e40398a09a83ef36b8340', 'request_id': 'req-b17a5686-bb50-41ce-bb80-d0416940cc09'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.050163 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3097/6188] 10.222.0.16 () {58 vars in 1356 bytes} [Mon Aug 29 15:53:46 2022] GET /identity/v3/role_assignments?scope.project.id=3b0c8a4a95074da38463093ca47ba812&user.id=d21fda410e7a4b3d8ce43ce66991e51c&effective => generated 228 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:47.057162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f998d-0c3a-468e-8f80-392d3dd222d3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:47.063451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] The token cache is being invalidate because project 6122e581164e40398a09a83ef36b8340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:47.063993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.064896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b17a5686-bb50-41ce-bb80-d0416940cc09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.067869 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3092/6189] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:46 2022] DELETE /identity/v3/projects/6122e581164e40398a09a83ef36b8340 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:47.072452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746198a-6024-4ba0-b79a-62e00c03d29a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:47.073339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746198a-6024-4ba0-b79a-62e00c03d29a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:47.073847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746198a-6024-4ba0-b79a-62e00c03d29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:47.088300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f998d-0c3a-468e-8f80-392d3dd222d3 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:47.107385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5746198a-6024-4ba0-b79a-62e00c03d29a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:47.110539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5746198a-6024-4ba0-b79a-62e00c03d29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:47.121807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:47.207456 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3093/6190] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:53:47.210300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6f41f-a0a6-419c-b663-505177fa96c0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:47.211157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6f41f-a0a6-419c-b663-505177fa96c0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:47.211690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6f41f-a0a6-419c-b663-505177fa96c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:47.222302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:47.222811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:47.223100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:47.223374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/projects/3b0c8a4a95074da38463093ca47ba812` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:47.226380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3b0c8a4a95074da38463093ca47ba812)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:47.228399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:47.241756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-84f6f41f-a0a6-419c-b663-505177fa96c0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:47.243647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-84f6f41f-a0a6-419c-b663-505177fa96c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:47.259914 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3094/6191] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:47.261334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6f41f-a0a6-419c-b663-505177fa96c0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:47.272630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6f41f-a0a6-419c-b663-505177fa96c0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:47.278538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e078f-5d88-4fe4-9078-fc2bc48ddf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:47.279432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e078f-5d88-4fe4-9078-fc2bc48ddf35 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:47.280185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e078f-5d88-4fe4-9078-fc2bc48ddf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:47.280660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e078f-5d88-4fe4-9078-fc2bc48ddf35 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:47.281989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e078f-5d88-4fe4-9078-fc2bc48ddf35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:47.282519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e078f-5d88-4fe4-9078-fc2bc48ddf35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:47.284314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e078f-5d88-4fe4-9078-fc2bc48ddf35 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:47.304356 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3095/6192] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:47.307256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e078f-5d88-4fe4-9078-fc2bc48ddf35 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:47.322419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e078f-5d88-4fe4-9078-fc2bc48ddf35 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:47.344297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0c8a4a95074da38463093ca47ba812', 'request_id': 'req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.359526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0c8a4a95074da38463093ca47ba812', 'request_id': 'req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.371358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0c8a4a95074da38463093ca47ba812', 'request_id': 'req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.393902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] The token cache is being invalidate because project 3b0c8a4a95074da38463093ca47ba812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:47.394237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.394907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.396881 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3098/6193] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:47 2022] DELETE /identity/v3/projects/3b0c8a4a95074da38463093ca47ba812 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:47.401970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:47.404026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885bb26-b030-4421-8c89-5abad5f0a7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:47.404743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885bb26-b030-4421-8c89-5abad5f0a7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:47.405095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885bb26-b030-4421-8c89-5abad5f0a7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:47.405458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885bb26-b030-4421-8c89-5abad5f0a7a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:47.406404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885bb26-b030-4421-8c89-5abad5f0a7a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:47.406503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:47.408570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885bb26-b030-4421-8c89-5abad5f0a7a4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:47.427488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:47.450746 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3096/6194] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:47 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:47.451833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885bb26-b030-4421-8c89-5abad5f0a7a4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:47.454287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c885bb26-b030-4421-8c89-5abad5f0a7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:47.547054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885bb26-b030-4421-8c89-5abad5f0a7a4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:47.553067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fd8c6-19ef-4ed7-8dcf-aefd97b023a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:47.553832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd8c6-19ef-4ed7-8dcf-aefd97b023a3 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:47.554227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd8c6-19ef-4ed7-8dcf-aefd97b023a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:47.554670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd8c6-19ef-4ed7-8dcf-aefd97b023a3 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:47.555697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fd8c6-19ef-4ed7-8dcf-aefd97b023a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:47.558523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fd8c6-19ef-4ed7-8dcf-aefd97b023a3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:47.571193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceffa01-a1f6-453c-91f3-e2aff31a11f4 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:47.590854 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3097/6195] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:47 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:47.593059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fd8c6-19ef-4ed7-8dcf-aefd97b023a3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:47.607575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fd8c6-19ef-4ed7-8dcf-aefd97b023a3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:47.613750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7974aa-9df1-497a-aa44-d146b8c90c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:47.614489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7974aa-9df1-497a-aa44-d146b8c90c8a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:47.614886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7974aa-9df1-497a-aa44-d146b8c90c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:47.615880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7974aa-9df1-497a-aa44-d146b8c90c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:47.616676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7974aa-9df1-497a-aa44-d146b8c90c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:47.618983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7974aa-9df1-497a-aa44-d146b8c90c8a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:47.635979 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3098/6196] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:47 2022] GET /identity/v3/roles => generated 1651 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:47.637172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7974aa-9df1-497a-aa44-d146b8c90c8a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:47.650131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7974aa-9df1-497a-aa44-d146b8c90c8a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:47.657173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687047fb-36a7-45a8-a3ff-0300651850fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:47.657849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687047fb-36a7-45a8-a3ff-0300651850fd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:47.658186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687047fb-36a7-45a8-a3ff-0300651850fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:47.658470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687047fb-36a7-45a8-a3ff-0300651850fd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:47.659126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687047fb-36a7-45a8-a3ff-0300651850fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:47.660873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687047fb-36a7-45a8-a3ff-0300651850fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:47.678072 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3099/6197] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:47 2022] GET /identity/v3/roles => generated 1651 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:47.682801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687047fb-36a7-45a8-a3ff-0300651850fd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:47.696800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:47.698140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687047fb-36a7-45a8-a3ff-0300651850fd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:47.707730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323401-e23e-4ffe-ac3f-096945389025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:47.708671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323401-e23e-4ffe-ac3f-096945389025 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:47.710688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323401-e23e-4ffe-ac3f-096945389025 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:47.711096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323401-e23e-4ffe-ac3f-096945389025 admin admin] PATH_INFO: `/v3/projects/a2d8cbfa11b24f63b7b53fa38a81b0e6/users/709f78570a1b40c4b36590940b6edea4/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:47.712840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:47.713546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:47.726004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:47.726685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/roles/7b05c93d9a854fe48066e6f0cd50349d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:47.728750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7b05c93d9a854fe48066e6f0cd50349d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:47.730430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:47.743179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a323401-e23e-4ffe-ac3f-096945389025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d8cbfa11b24f63b7b53fa38a81b0e6, user_id=709f78570a1b40c4b36590940b6edea4, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:47.746304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a323401-e23e-4ffe-ac3f-096945389025 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:47.777827 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3100/6198] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:47 2022] PUT /identity/v3/projects/a2d8cbfa11b24f63b7b53fa38a81b0e6/users/709f78570a1b40c4b36590940b6edea4/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:47.791166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ba8a-94d5-4c0e-8938-a845927d1d20 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:47.791890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ba8a-94d5-4c0e-8938-a845927d1d20 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:47.792366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ba8a-94d5-4c0e-8938-a845927d1d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:47.844491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invalidating the token cache because role 7b05c93d9a854fe48066e6f0cd50349d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:47.844830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.845711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:47.847599 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3099/6199] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:47 2022] DELETE /identity/v3/roles/7b05c93d9a854fe48066e6f0cd50349d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:47.853000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:47.854501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:47.874057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8275ba8a-94d5-4c0e-8938-a845927d1d20 None None] MFA Rules not processed for user `709f78570a1b40c4b36590940b6edea4`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:47.877826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8275ba8a-94d5-4c0e-8938-a845927d1d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:48.026881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b11b5-4865-45df-a42d-b79fbf64fccc tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:48.038978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:48.041418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:48.042304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:48.044183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/users/d21fda410e7a4b3d8ce43ce66991e51c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:48.048840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d21fda410e7a4b3d8ce43ce66991e51c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:48.053909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:48.064515 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3101/6200] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:53:48.135881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275ba8a-94d5-4c0e-8938-a845927d1d20 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:48.139517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8275ba8a-94d5-4c0e-8938-a845927d1d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:48.172149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21fda410e7a4b3d8ce43ce66991e51c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:48.175005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21fda410e7a4b3d8ce43ce66991e51c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:48.206779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21fda410e7a4b3d8ce43ce66991e51c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:48.208362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21fda410e7a4b3d8ce43ce66991e51c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:48.218467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21fda410e7a4b3d8ce43ce66991e51c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:48.229583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:48.268860 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3100/6201] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:47 2022] DELETE /identity/v3/users/d21fda410e7a4b3d8ce43ce66991e51c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:48.271169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:48.274281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:48.323436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275ba8a-94d5-4c0e-8938-a845927d1d20 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:48.353377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:48.391905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a44e2-ae4f-48bf-b8da-c4cd493169d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:48.392547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a44e2-ae4f-48bf-b8da-c4cd493169d1 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:48.392831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a44e2-ae4f-48bf-b8da-c4cd493169d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:48.393107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a44e2-ae4f-48bf-b8da-c4cd493169d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:48.395040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-544a44e2-ae4f-48bf-b8da-c4cd493169d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:48.422012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5ecb9-58e4-4a8f-baed-fadd07783d4e tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:48.429106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebce98-e2b4-4b88-9458-515e3077bc78 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:48.429999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebce98-e2b4-4b88-9458-515e3077bc78 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:48.430430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebce98-e2b4-4b88-9458-515e3077bc78 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:48.430848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebce98-e2b4-4b88-9458-515e3077bc78 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/groups/67d85ff9506f43a39a4eaa9678f6cd12` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:48.432471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebce98-e2b4-4b88-9458-515e3077bc78 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_group(group_id=67d85ff9506f43a39a4eaa9678f6cd12)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:48.435453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebce98-e2b4-4b88-9458-515e3077bc78 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:48.468625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a44e2-ae4f-48bf-b8da-c4cd493169d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:48.471488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a44e2-ae4f-48bf-b8da-c4cd493169d1 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:48.483608 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3102/6202] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:48.509314 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3101/6203] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:53:48 2022] DELETE /identity/v3/groups/67d85ff9506f43a39a4eaa9678f6cd12 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:48.510535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a44e2-ae4f-48bf-b8da-c4cd493169d1 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:48.523388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a44e2-ae4f-48bf-b8da-c4cd493169d1 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:48.660104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:48.660892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:48.661304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:48.661712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/projects/e9755a529c1c4e87872b02b745040690` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:48.662979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e9755a529c1c4e87872b02b745040690)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:48.665350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:48.721221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:48.735776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9755a529c1c4e87872b02b745040690', 'request_id': 'req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:48.745803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9755a529c1c4e87872b02b745040690', 'request_id': 'req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:48.760442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9755a529c1c4e87872b02b745040690', 'request_id': 'req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:48.779493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] The token cache is being invalidate because project e9755a529c1c4e87872b02b745040690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:48.779815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:48.780670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:48.785480 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3103/6204] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:48 2022] DELETE /identity/v3/projects/e9755a529c1c4e87872b02b745040690 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:48.788794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebce98-e2b4-4b88-9458-515e3077bc78 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:48.792369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c6ebce98-e2b4-4b88-9458-515e3077bc78 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:48.838756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebce98-e2b4-4b88-9458-515e3077bc78 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:48.957821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:48.958935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:48.959369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:48.959908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/domains/44d0be676cdb4cdc8ada517754c6f08a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:48.962536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=44d0be676cdb4cdc8ada517754c6f08a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:48.964363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:49.007184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.008858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.047803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.048638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.052102 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3102/6205] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:53:48 2022] PATCH /identity/v3/domains/44d0be676cdb4cdc8ada517754c6f08a => generated 277 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:53:49.056232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:49.072697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b703a2a-a6f7-4e17-9dc2-4a686d9a8997 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:49.150303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49ecf7083edc432bbaa45c077e340c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd335a57e91ff461bbe7c81684b81368e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:49.151596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:49.152214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:49.152635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] PATH_INFO: `/v3/domains/44d0be676cdb4cdc8ada517754c6f08a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:49.171797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=44d0be676cdb4cdc8ada517754c6f08a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:49.174086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:49.207343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.221479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.325554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a', 'request_id': 'req-6ee1fd01-4376-4608-85dc-3f78c8afdc67'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.336435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a', 'request_id': 'req-6ee1fd01-4376-4608-85dc-3f78c8afdc67'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.352425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a', 'request_id': 'req-6ee1fd01-4376-4608-85dc-3f78c8afdc67'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.385622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] The token cache is being invalidate because project 44d0be676cdb4cdc8ada517754c6f08a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:49.386279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.387158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.400407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a', 'request_id': 'req-6ee1fd01-4376-4608-85dc-3f78c8afdc67'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.401882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a', 'request_id': 'req-6ee1fd01-4376-4608-85dc-3f78c8afdc67'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.402846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ee1fd01-4376-4608-85dc-3f78c8afdc67 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '44d0be676cdb4cdc8ada517754c6f08a', 'request_id': 'req-6ee1fd01-4376-4608-85dc-3f78c8afdc67'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.416041 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3104/6206] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:53:49 2022] DELETE /identity/v3/domains/44d0be676cdb4cdc8ada517754c6f08a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:49.420253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:49.422019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:49.517177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbcdcd-a371-47c1-a7ac-7a43340c6f57 tempest-InheritsV3TestJSON-9071483 tempest-InheritsV3TestJSON-9071483-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:49.525026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:49.636199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:49.638960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:49.638960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:49.638960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] PATH_INFO: `/v3/users/c995d83693ec480e98b2166d74cf4152` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:49.638960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c995d83693ec480e98b2166d74cf4152)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:49.640997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:49.749201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c995d83693ec480e98b2166d74cf4152'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.750153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c995d83693ec480e98b2166d74cf4152'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.777374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c995d83693ec480e98b2166d74cf4152'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.779271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c995d83693ec480e98b2166d74cf4152'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.795490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c995d83693ec480e98b2166d74cf4152'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:49.817976 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3103/6207] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:49 2022] DELETE /identity/v3/users/c995d83693ec480e98b2166d74cf4152 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:49.825868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835e82e-90d9-4b75-ba01-2f101f8cae03 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:49.826401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835e82e-90d9-4b75-ba01-2f101f8cae03 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:49.826818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835e82e-90d9-4b75-ba01-2f101f8cae03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:49.839654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:49.868463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6835e82e-90d9-4b75-ba01-2f101f8cae03 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:49.873914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6835e82e-90d9-4b75-ba01-2f101f8cae03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:49.970455 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3105/6208] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:49.982562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:49.984939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:50.087987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11ec18-1772-4e06-916f-399180d21f5e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:50.092621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dec30-a579-45dc-a075-3cc1461ec8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:50.093923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dec30-a579-45dc-a075-3cc1461ec8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:50.094212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dec30-a579-45dc-a075-3cc1461ec8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:50.094539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dec30-a579-45dc-a075-3cc1461ec8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:50.106233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dec30-a579-45dc-a075-3cc1461ec8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:50.122016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dec30-a579-45dc-a075-3cc1461ec8b8 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:50.145173 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3104/6209] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:53:50.989331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835e82e-90d9-4b75-ba01-2f101f8cae03 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:50.990953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6835e82e-90d9-4b75-ba01-2f101f8cae03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:51.017655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835e82e-90d9-4b75-ba01-2f101f8cae03 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:51.027406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:51.029378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:51.030447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:51.031316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] PATH_INFO: `/v3/projects/6286da6468f9403597833c5244a2a351` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:51.032980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6286da6468f9403597833c5244a2a351)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:51.043009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:51.150415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6286da6468f9403597833c5244a2a351', 'request_id': 'req-319ee596-860b-4a3c-8f2b-b32c93ce9441'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.159018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6286da6468f9403597833c5244a2a351', 'request_id': 'req-319ee596-860b-4a3c-8f2b-b32c93ce9441'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.174421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6286da6468f9403597833c5244a2a351', 'request_id': 'req-319ee596-860b-4a3c-8f2b-b32c93ce9441'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.192472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] The token cache is being invalidate because project 6286da6468f9403597833c5244a2a351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:51.192818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.193912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.195836 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3106/6210] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:50 2022] DELETE /identity/v3/projects/6286da6468f9403597833c5244a2a351 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:51.199890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dec30-a579-45dc-a075-3cc1461ec8b8 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:51.213021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dec30-a579-45dc-a075-3cc1461ec8b8 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:51.280388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:51.353068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b22bae-a52b-4bb3-bbd0-a1fe6666e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:51.353773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b22bae-a52b-4bb3-bbd0-a1fe6666e5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:51.354060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b22bae-a52b-4bb3-bbd0-a1fe6666e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:51.354338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b22bae-a52b-4bb3-bbd0-a1fe6666e5e6 admin admin] PATH_INFO: `/v3/users/49ecf7083edc432bbaa45c077e340c37` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:51.355546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b22bae-a52b-4bb3-bbd0-a1fe6666e5e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ecf7083edc432bbaa45c077e340c37)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:51.368891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b22bae-a52b-4bb3-bbd0-a1fe6666e5e6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:51.463754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-26b22bae-a52b-4bb3-bbd0-a1fe6666e5e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ecf7083edc432bbaa45c077e340c37'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.464508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-26b22bae-a52b-4bb3-bbd0-a1fe6666e5e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ecf7083edc432bbaa45c077e340c37'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.492717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-26b22bae-a52b-4bb3-bbd0-a1fe6666e5e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ecf7083edc432bbaa45c077e340c37'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.493521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-26b22bae-a52b-4bb3-bbd0-a1fe6666e5e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ecf7083edc432bbaa45c077e340c37'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.511860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-26b22bae-a52b-4bb3-bbd0-a1fe6666e5e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ecf7083edc432bbaa45c077e340c37'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:51.544815 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3105/6211] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:51 2022] DELETE /identity/v3/users/49ecf7083edc432bbaa45c077e340c37 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:52.665088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:52.666594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:52.687323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ee596-860b-4a3c-8f2b-b32c93ce9441 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:52.780657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:52.781802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:52.782121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:52.782653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] PATH_INFO: `/v3/projects/d335a57e91ff461bbe7c81684b81368e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:52.784991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d335a57e91ff461bbe7c81684b81368e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:52.787023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:52.864224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:52.888905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd335a57e91ff461bbe7c81684b81368e', 'request_id': 'req-fde97678-31c4-44d9-b44f-dce792785ef4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:52.901800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd335a57e91ff461bbe7c81684b81368e', 'request_id': 'req-fde97678-31c4-44d9-b44f-dce792785ef4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:52.924414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd335a57e91ff461bbe7c81684b81368e', 'request_id': 'req-fde97678-31c4-44d9-b44f-dce792785ef4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:52.967009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] The token cache is being invalidate because project d335a57e91ff461bbe7c81684b81368e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:52.967321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:52.968252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fde97678-31c4-44d9-b44f-dce792785ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:52.973074 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3107/6212] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:52 2022] DELETE /identity/v3/projects/d335a57e91ff461bbe7c81684b81368e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:52.975751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa13ef-63c3-4a50-b7f4-95cd2661f835 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:52.976388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa13ef-63c3-4a50-b7f4-95cd2661f835 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:52.976388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa13ef-63c3-4a50-b7f4-95cd2661f835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.025121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b7fa13ef-63c3-4a50-b7f4-95cd2661f835 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:53.029254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b7fa13ef-63c3-4a50-b7f4-95cd2661f835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:53.181014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47d0d7-5879-459d-889a-ae03931a5a55 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.181436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47d0d7-5879-459d-889a-ae03931a5a55 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.181596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47d0d7-5879-459d-889a-ae03931a5a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.182101 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3106/6213] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:53.222920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9d47d0d7-5879-459d-889a-ae03931a5a55 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:53.224486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9d47d0d7-5879-459d-889a-ae03931a5a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:53.236657 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3108/6214] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:53.240689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa13ef-63c3-4a50-b7f4-95cd2661f835 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:53.252289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa13ef-63c3-4a50-b7f4-95cd2661f835 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:53.261935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d57c2-e056-4a14-a19b-93bad5a2f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:53.263665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d57c2-e056-4a14-a19b-93bad5a2f55f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.264348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d57c2-e056-4a14-a19b-93bad5a2f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.264770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d57c2-e056-4a14-a19b-93bad5a2f55f admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.265826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d57c2-e056-4a14-a19b-93bad5a2f55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:53.266133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d57c2-e056-4a14-a19b-93bad5a2f55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:53.268513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d57c2-e056-4a14-a19b-93bad5a2f55f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:53.292103 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3107/6215] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:53.297818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47d0d7-5879-459d-889a-ae03931a5a55 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:53.306450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d57c2-e056-4a14-a19b-93bad5a2f55f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:53.310488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b00d57c2-e056-4a14-a19b-93bad5a2f55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:53.311639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47d0d7-5879-459d-889a-ae03931a5a55 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:53.318311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318f2f0-85db-4e21-a0c3-d439a68cb6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:53.319080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318f2f0-85db-4e21-a0c3-d439a68cb6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.319501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318f2f0-85db-4e21-a0c3-d439a68cb6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.319936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318f2f0-85db-4e21-a0c3-d439a68cb6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.321351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318f2f0-85db-4e21-a0c3-d439a68cb6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:53.324628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318f2f0-85db-4e21-a0c3-d439a68cb6a8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:53.335578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d57c2-e056-4a14-a19b-93bad5a2f55f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:53.343771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e924b45-0f36-4e14-b867-e80834b0605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:53.344716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e924b45-0f36-4e14-b867-e80834b0605d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.345595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e924b45-0f36-4e14-b867-e80834b0605d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.346174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e924b45-0f36-4e14-b867-e80834b0605d admin admin] PATH_INFO: `/v3/users/a68002795ce541338b30129e6dbb0fb6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.349457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e924b45-0f36-4e14-b867-e80834b0605d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68002795ce541338b30129e6dbb0fb6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:53.352588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e924b45-0f36-4e14-b867-e80834b0605d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:53.407430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:53.430943 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3109/6216] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:53 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:53.431669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3e924b45-0f36-4e14-b867-e80834b0605d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68002795ce541338b30129e6dbb0fb6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:53.432395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3e924b45-0f36-4e14-b867-e80834b0605d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68002795ce541338b30129e6dbb0fb6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:53.436451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318f2f0-85db-4e21-a0c3-d439a68cb6a8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:53.441806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b318f2f0-85db-4e21-a0c3-d439a68cb6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:53.448792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3e924b45-0f36-4e14-b867-e80834b0605d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68002795ce541338b30129e6dbb0fb6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:53.449735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3e924b45-0f36-4e14-b867-e80834b0605d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68002795ce541338b30129e6dbb0fb6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:53.459068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3e924b45-0f36-4e14-b867-e80834b0605d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68002795ce541338b30129e6dbb0fb6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:53.501965 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3108/6217] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:53 2022] DELETE /identity/v3/users/a68002795ce541338b30129e6dbb0fb6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:53.616769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318f2f0-85db-4e21-a0c3-d439a68cb6a8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:53.684217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab090c21-0ac3-47e1-8160-cc3c65e38728 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.684976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab090c21-0ac3-47e1-8160-cc3c65e38728 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.685491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab090c21-0ac3-47e1-8160-cc3c65e38728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.798037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ab090c21-0ac3-47e1-8160-cc3c65e38728 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:53.799359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ab090c21-0ac3-47e1-8160-cc3c65e38728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:53.805741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bf3dc-3f2c-464d-a62d-33782604c3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:53.808132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf3dc-3f2c-464d-a62d-33782604c3df admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.808497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf3dc-3f2c-464d-a62d-33782604c3df admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.808859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf3dc-3f2c-464d-a62d-33782604c3df admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.814230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bf3dc-3f2c-464d-a62d-33782604c3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:53.820756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bf3dc-3f2c-464d-a62d-33782604c3df admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:53.897825 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3110/6218] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:53 2022] POST /identity/v3/users => generated 293 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:53.899000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bf3dc-3f2c-464d-a62d-33782604c3df admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:53.933257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bf3dc-3f2c-464d-a62d-33782604c3df admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:53.955033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8c09b-b45a-46b7-ba57-24a73625160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:53.955855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8c09b-b45a-46b7-ba57-24a73625160c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:53.956223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8c09b-b45a-46b7-ba57-24a73625160c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:53.956806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8c09b-b45a-46b7-ba57-24a73625160c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:53.957675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8c09b-b45a-46b7-ba57-24a73625160c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:53.963042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8c09b-b45a-46b7-ba57-24a73625160c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:54.001700 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3111/6219] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:54.005290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8c09b-b45a-46b7-ba57-24a73625160c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:54.035692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8c09b-b45a-46b7-ba57-24a73625160c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:54.050072 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3109/6220] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:53:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:53:54.063595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23f8ca-4eb6-4541-92a5-b182c9156a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:54.064237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23f8ca-4eb6-4541-92a5-b182c9156a16 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:54.064520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23f8ca-4eb6-4541-92a5-b182c9156a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:54.066381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23f8ca-4eb6-4541-92a5-b182c9156a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:54.067066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23f8ca-4eb6-4541-92a5-b182c9156a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:54.068692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23f8ca-4eb6-4541-92a5-b182c9156a16 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:54.087562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab090c21-0ac3-47e1-8160-cc3c65e38728 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:54.090395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ab090c21-0ac3-47e1-8160-cc3c65e38728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:54.134989 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3112/6221] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:54.139641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23f8ca-4eb6-4541-92a5-b182c9156a16 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:54.162561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:54.170304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23f8ca-4eb6-4541-92a5-b182c9156a16 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:54.190938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0196f-01e9-4058-b316-8d5e48baf59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:54.192772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0196f-01e9-4058-b316-8d5e48baf59e admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:54.193123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0196f-01e9-4058-b316-8d5e48baf59e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:54.194712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0196f-01e9-4058-b316-8d5e48baf59e admin admin] PATH_INFO: `/v3/projects/36516015012649b28594fc9f6cca6a0e/users/c9fc3c4af933454a888e72c87ecaa684/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:54.221639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0196f-01e9-4058-b316-8d5e48baf59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36516015012649b28594fc9f6cca6a0e, user_id=c9fc3c4af933454a888e72c87ecaa684, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:54.224357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0196f-01e9-4058-b316-8d5e48baf59e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:54.252500 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3113/6222] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:54 2022] PUT /identity/v3/projects/36516015012649b28594fc9f6cca6a0e/users/c9fc3c4af933454a888e72c87ecaa684/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:54.253838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0196f-01e9-4058-b316-8d5e48baf59e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:54.255679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-10e0196f-01e9-4058-b316-8d5e48baf59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:54.338087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab090c21-0ac3-47e1-8160-cc3c65e38728 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:54.397487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0196f-01e9-4058-b316-8d5e48baf59e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:54.409980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:54.411124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:54.411244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:54.411646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] PATH_INFO: `/v3/projects/2c147d42182146409a91f2e0359f2e98` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:54.417510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c147d42182146409a91f2e0359f2e98)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:54.420428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:54.461473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:54.491891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5994a5-e6e8-49cc-849f-9b0685b9d2f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:54.495972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5994a5-e6e8-49cc-849f-9b0685b9d2f3 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:54.497791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5994a5-e6e8-49cc-849f-9b0685b9d2f3 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:54.509582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5994a5-e6e8-49cc-849f-9b0685b9d2f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:54.549582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c147d42182146409a91f2e0359f2e98', 'request_id': 'req-f141ca84-1220-4342-8557-edb645bd26d5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:54.567046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c147d42182146409a91f2e0359f2e98', 'request_id': 'req-f141ca84-1220-4342-8557-edb645bd26d5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:54.593525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c147d42182146409a91f2e0359f2e98', 'request_id': 'req-f141ca84-1220-4342-8557-edb645bd26d5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:54.617023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] The token cache is being invalidate because project 2c147d42182146409a91f2e0359f2e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:54.617829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:54.618641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f141ca84-1220-4342-8557-edb645bd26d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:54.622469 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3114/6223] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:54 2022] DELETE /identity/v3/projects/2c147d42182146409a91f2e0359f2e98 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:54.630798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38c07f-420a-43f9-a5b3-0e3c7be0c91f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:54.631638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38c07f-420a-43f9-a5b3-0e3c7be0c91f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:54.632830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38c07f-420a-43f9-a5b3-0e3c7be0c91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:54.696581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5994a5-e6e8-49cc-849f-9b0685b9d2f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:54.698250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5994a5-e6e8-49cc-849f-9b0685b9d2f3 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:54.713845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1d38c07f-420a-43f9-a5b3-0e3c7be0c91f None None] MFA Rules not processed for user `c9fc3c4af933454a888e72c87ecaa684`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:54.714932 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3110/6224] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:53:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:54.718882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7029-bfb3-49f5-8803-4901ae2020c3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:54.719313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7029-bfb3-49f5-8803-4901ae2020c3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:54.719430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7029-bfb3-49f5-8803-4901ae2020c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:54.735187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1d38c07f-420a-43f9-a5b3-0e3c7be0c91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:54.768941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-be4c7029-bfb3-49f5-8803-4901ae2020c3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:54.770187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-be4c7029-bfb3-49f5-8803-4901ae2020c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:54.847959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:54.858516 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3115/6225] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:54.864141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38c07f-420a-43f9-a5b3-0e3c7be0c91f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:54.869399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1d38c07f-420a-43f9-a5b3-0e3c7be0c91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:54.963214 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3111/6226] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:54.974538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da457c6-642a-48a6-8313-bd8340fd7fda None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:54.974921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da457c6-642a-48a6-8313-bd8340fd7fda None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:54.975382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da457c6-642a-48a6-8313-bd8340fd7fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.038647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4da457c6-642a-48a6-8313-bd8340fd7fda None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:55.039889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4da457c6-642a-48a6-8313-bd8340fd7fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:55.065894 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3112/6227] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:55.069628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38c07f-420a-43f9-a5b3-0e3c7be0c91f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:55.069777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da457c6-642a-48a6-8313-bd8340fd7fda None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:55.080090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182a6f0-1aff-46c1-9d49-c87c717d7331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:55.080818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182a6f0-1aff-46c1-9d49-c87c717d7331 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:55.081098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182a6f0-1aff-46c1-9d49-c87c717d7331 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:55.081374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182a6f0-1aff-46c1-9d49-c87c717d7331 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.082217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182a6f0-1aff-46c1-9d49-c87c717d7331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:55.088092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182a6f0-1aff-46c1-9d49-c87c717d7331 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:55.094010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da457c6-642a-48a6-8313-bd8340fd7fda None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:55.108431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc232-2ba9-4361-b95d-68e85c6a7a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:55.109060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc232-2ba9-4361-b95d-68e85c6a7a9d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:55.109336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc232-2ba9-4361-b95d-68e85c6a7a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:55.109648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc232-2ba9-4361-b95d-68e85c6a7a9d admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.110592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcc232-2ba9-4361-b95d-68e85c6a7a9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:53:55.110699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcc232-2ba9-4361-b95d-68e85c6a7a9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:55.112324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcc232-2ba9-4361-b95d-68e85c6a7a9d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:55.141458 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3113/6228] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:53:55.146930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc232-2ba9-4361-b95d-68e85c6a7a9d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:55.164721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc232-2ba9-4361-b95d-68e85c6a7a9d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:55.171684 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3116/6229] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:54 2022] POST /identity/v3/projects => generated 385 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:55.177191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182a6f0-1aff-46c1-9d49-c87c717d7331 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:55.178316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334a708-cd68-4e26-a5eb-a40f9bdcaad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:55.179268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334a708-cd68-4e26-a5eb-a40f9bdcaad2 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:55.180420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334a708-cd68-4e26-a5eb-a40f9bdcaad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:55.215017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334a708-cd68-4e26-a5eb-a40f9bdcaad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.224857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334a708-cd68-4e26-a5eb-a40f9bdcaad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:55.228993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334a708-cd68-4e26-a5eb-a40f9bdcaad2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:55.281461 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3114/6230] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:55 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:55.285613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334a708-cd68-4e26-a5eb-a40f9bdcaad2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:55.355791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182a6f0-1aff-46c1-9d49-c87c717d7331 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:55.432474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:55.444166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334a708-cd68-4e26-a5eb-a40f9bdcaad2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:55.455312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8332b07-d63e-459d-b894-eb7fb8bcc501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:55.455938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332b07-d63e-459d-b894-eb7fb8bcc501 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:55.456219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332b07-d63e-459d-b894-eb7fb8bcc501 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:55.456491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332b07-d63e-459d-b894-eb7fb8bcc501 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.457128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8332b07-d63e-459d-b894-eb7fb8bcc501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:55.459125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8332b07-d63e-459d-b894-eb7fb8bcc501 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:55.480281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9e6bf-bd4a-4bcb-a6a2-dd7a69a83726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:55.480938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9e6bf-bd4a-4bcb-a6a2-dd7a69a83726 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:55.481799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9e6bf-bd4a-4bcb-a6a2-dd7a69a83726 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:55.482091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9e6bf-bd4a-4bcb-a6a2-dd7a69a83726 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.482763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9e6bf-bd4a-4bcb-a6a2-dd7a69a83726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:55.488772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9e6bf-bd4a-4bcb-a6a2-dd7a69a83726 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:55.510594 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3115/6231] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:55 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:55.514770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8332b07-d63e-459d-b894-eb7fb8bcc501 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:55.547928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8332b07-d63e-459d-b894-eb7fb8bcc501 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:55.553053 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3117/6232] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:53:55 2022] POST /identity/v3/users => generated 299 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:53:55.554355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9e6bf-bd4a-4bcb-a6a2-dd7a69a83726 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:55.575874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b482d-a5e9-4753-b340-dbb1653f8c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:55.576504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b482d-a5e9-4753-b340-dbb1653f8c8b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:55.576784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b482d-a5e9-4753-b340-dbb1653f8c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:55.577055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b482d-a5e9-4753-b340-dbb1653f8c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.577737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b482d-a5e9-4753-b340-dbb1653f8c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:55.579344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b482d-a5e9-4753-b340-dbb1653f8c8b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:55.587398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9e6bf-bd4a-4bcb-a6a2-dd7a69a83726 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:55.600988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b4459-4daa-4fcd-acd9-2dfb5813edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:55.602451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b4459-4daa-4fcd-acd9-2dfb5813edde admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:55.602755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b4459-4daa-4fcd-acd9-2dfb5813edde admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:55.603586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b4459-4daa-4fcd-acd9-2dfb5813edde admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.604966 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3116/6233] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:53:55.605510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b4459-4daa-4fcd-acd9-2dfb5813edde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:55.607824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b4459-4daa-4fcd-acd9-2dfb5813edde admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:55.609622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b482d-a5e9-4753-b340-dbb1653f8c8b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:55.641420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b482d-a5e9-4753-b340-dbb1653f8c8b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:55.641603 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3118/6234] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:55.648991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a15c2c-3b43-4744-9b84-b86c03d55bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:55.648991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15c2c-3b43-4744-9b84-b86c03d55bed admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:55.648991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15c2c-3b43-4744-9b84-b86c03d55bed admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:55.648991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15c2c-3b43-4744-9b84-b86c03d55bed admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.650592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b4459-4daa-4fcd-acd9-2dfb5813edde admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:55.657870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a15c2c-3b43-4744-9b84-b86c03d55bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:55.664590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a15c2c-3b43-4744-9b84-b86c03d55bed admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:55.683942 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3117/6235] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:53:55.684088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b4459-4daa-4fcd-acd9-2dfb5813edde admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:55.689562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a15c2c-3b43-4744-9b84-b86c03d55bed admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:55.698795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d544cc-f7d3-4232-9ca9-3fae4074fb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:55.699549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d544cc-f7d3-4232-9ca9-3fae4074fb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:55.699836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d544cc-f7d3-4232-9ca9-3fae4074fb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:55.700810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d544cc-f7d3-4232-9ca9-3fae4074fb63 admin admin] PATH_INFO: `/v3/projects/f0b0e80460d14031a49fb9f2476c974a/users/cb90dafabb694b1aa1d9791cac1ecfe9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.705336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a15c2c-3b43-4744-9b84-b86c03d55bed admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:55.715650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4835e84-0ab9-4ef8-b1da-b434ae09ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:55.716665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835e84-0ab9-4ef8-b1da-b434ae09ac7e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:55.717880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835e84-0ab9-4ef8-b1da-b434ae09ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:55.718933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835e84-0ab9-4ef8-b1da-b434ae09ac7e admin admin] PATH_INFO: `/v3/projects/1000fe730f2e4cce8f941050ea854b34/users/bdbaa320cf0e46b79579f858aac51192/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.729040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:55.738814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d544cc-f7d3-4232-9ca9-3fae4074fb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b0e80460d14031a49fb9f2476c974a, user_id=cb90dafabb694b1aa1d9791cac1ecfe9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:55.747313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d544cc-f7d3-4232-9ca9-3fae4074fb63 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:55.784463 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3119/6236] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:55 2022] PUT /identity/v3/projects/f0b0e80460d14031a49fb9f2476c974a/users/cb90dafabb694b1aa1d9791cac1ecfe9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:55.788286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d544cc-f7d3-4232-9ca9-3fae4074fb63 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:55.792653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4835e84-0ab9-4ef8-b1da-b434ae09ac7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1000fe730f2e4cce8f941050ea854b34, user_id=bdbaa320cf0e46b79579f858aac51192, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:55.802098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4835e84-0ab9-4ef8-b1da-b434ae09ac7e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:55.850707 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3118/6237] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:55 2022] PUT /identity/v3/projects/1000fe730f2e4cce8f941050ea854b34/users/bdbaa320cf0e46b79579f858aac51192/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:55.853935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ee4a7-422f-45ad-a925-bae576485501 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:55.854461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ee4a7-422f-45ad-a925-bae576485501 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:55.858101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ee4a7-422f-45ad-a925-bae576485501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:55.928471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2c0ee4a7-422f-45ad-a925-bae576485501 None None] MFA Rules not processed for user `bdbaa320cf0e46b79579f858aac51192`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:55.940085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2c0ee4a7-422f-45ad-a925-bae576485501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:55.977729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d544cc-f7d3-4232-9ca9-3fae4074fb63 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:56.109164 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3119/6238] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:56.111173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2418cc-1a47-450b-b037-0d39508ab1f5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:56.111567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2418cc-1a47-450b-b037-0d39508ab1f5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:56.112380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2418cc-1a47-450b-b037-0d39508ab1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:56.135275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0678-bfbc-4754-939f-095c9768d72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:56.136454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0678-bfbc-4754-939f-095c9768d72e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:56.136979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0678-bfbc-4754-939f-095c9768d72e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:56.137718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0678-bfbc-4754-939f-095c9768d72e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:56.139106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf0678-bfbc-4754-939f-095c9768d72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:56.141590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0c2418cc-1a47-450b-b037-0d39508ab1f5 None None] MFA Rules not processed for user `bdbaa320cf0e46b79579f858aac51192`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:56.141780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf0678-bfbc-4754-939f-095c9768d72e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:56.142977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0c2418cc-1a47-450b-b037-0d39508ab1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:56.151085 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3120/6239] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:56.159702 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3120/6240] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:53:56.163492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2418cc-1a47-450b-b037-0d39508ab1f5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:56.166632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0678-bfbc-4754-939f-095c9768d72e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:56.171966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-63cf0678-bfbc-4754-939f-095c9768d72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:56.189281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2418cc-1a47-450b-b037-0d39508ab1f5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:56.203593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ebd7a-6670-416b-999f-e22af0e31418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:56.204515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ebd7a-6670-416b-999f-e22af0e31418 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:56.205630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ebd7a-6670-416b-999f-e22af0e31418 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:56.205976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ebd7a-6670-416b-999f-e22af0e31418 admin admin] PATH_INFO: `/v3/projects/f0b0e80460d14031a49fb9f2476c974a/users/cb90dafabb694b1aa1d9791cac1ecfe9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:56.217876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ebd7a-6670-416b-999f-e22af0e31418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b0e80460d14031a49fb9f2476c974a, user_id=cb90dafabb694b1aa1d9791cac1ecfe9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:56.222656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ebd7a-6670-416b-999f-e22af0e31418 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:56.250107 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3121/6241] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:53:56 2022] PUT /identity/v3/projects/f0b0e80460d14031a49fb9f2476c974a/users/cb90dafabb694b1aa1d9791cac1ecfe9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:56.260922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385025e-51d7-4980-bb33-55dc75dccaef None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:56.261215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385025e-51d7-4980-bb33-55dc75dccaef None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:56.261518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385025e-51d7-4980-bb33-55dc75dccaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:56.324928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e385025e-51d7-4980-bb33-55dc75dccaef None None] MFA Rules not processed for user `cb90dafabb694b1aa1d9791cac1ecfe9`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:56.326208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e385025e-51d7-4980-bb33-55dc75dccaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:56.388936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0678-bfbc-4754-939f-095c9768d72e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:56.441715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:56.486040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:56.507818 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3122/6242] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:56.512740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385025e-51d7-4980-bb33-55dc75dccaef None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:56.537603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385025e-51d7-4980-bb33-55dc75dccaef None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:56.554325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae877ec-1e54-4461-9996-9b3dd6ac3157 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb90dafabb694b1aa1d9791cac1ecfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0e80460d14031a49fb9f2476c974a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:56.554962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae877ec-1e54-4461-9996-9b3dd6ac3157 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:56.555248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae877ec-1e54-4461-9996-9b3dd6ac3157 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:56.555904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae877ec-1e54-4461-9996-9b3dd6ac3157 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:56.556280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae877ec-1e54-4461-9996-9b3dd6ac3157 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:56.558297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae877ec-1e54-4461-9996-9b3dd6ac3157 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:56.577604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f02c1-3785-42e5-9cae-cde700a0b9b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:56.578364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f02c1-3785-42e5-9cae-cde700a0b9b7 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:56.578664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f02c1-3785-42e5-9cae-cde700a0b9b7 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:56.578969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f02c1-3785-42e5-9cae-cde700a0b9b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:56.648123 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3123/6243] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:53:56 2022] POST /identity/v3/projects => generated 359 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:53:56.649441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae877ec-1e54-4461-9996-9b3dd6ac3157 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:56.744693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f02c1-3785-42e5-9cae-cde700a0b9b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:56.750315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f02c1-3785-42e5-9cae-cde700a0b9b7 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:56.776647 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3121/6244] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:53:56.795360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae877ec-1e54-4461-9996-9b3dd6ac3157 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:56.808425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07e8e3-7120-45b5-8536-b9b554850c54 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb90dafabb694b1aa1d9791cac1ecfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0e80460d14031a49fb9f2476c974a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:56.809095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e8e3-7120-45b5-8536-b9b554850c54 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:56.809435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e8e3-7120-45b5-8536-b9b554850c54 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:56.809716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e8e3-7120-45b5-8536-b9b554850c54 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] PATH_INFO: `/v3/projects/055546a99d884d538c7bd805e2827cd2/tags/tempest-tag-372696563` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:56.811225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07e8e3-7120-45b5-8536-b9b554850c54 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=055546a99d884d538c7bd805e2827cd2, value=tempest-tag-372696563)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:56.813879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07e8e3-7120-45b5-8536-b9b554850c54 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:56.824799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f02c1-3785-42e5-9cae-cde700a0b9b7 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:56.828130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-af2f02c1-3785-42e5-9cae-cde700a0b9b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:56.933360 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-5a07e8e3-7120-45b5-8536-b9b554850c54 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-372696563. To ensure interoperability, identifiers should be a valid uuid. Aug 29 15:53:56.933360 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 15:53:56.933360 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:53:56.953012 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3124/6245] 10.222.0.16 () {60 vars in 1330 bytes} [Mon Aug 29 15:53:56 2022] PUT /identity/v3/projects/055546a99d884d538c7bd805e2827cd2/tags/tempest-tag-372696563 => generated 0 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Aug 29 15:53:56.954038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07e8e3-7120-45b5-8536-b9b554850c54 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:56.956461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5a07e8e3-7120-45b5-8536-b9b554850c54 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:57.006603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f02c1-3785-42e5-9cae-cde700a0b9b7 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:57.085420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07e8e3-7120-45b5-8536-b9b554850c54 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:57.095763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca64bc-edd0-4e80-96d7-6bfc4956dcb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:57.097209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca64bc-edd0-4e80-96d7-6bfc4956dcb2 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:57.097544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca64bc-edd0-4e80-96d7-6bfc4956dcb2 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:57.097827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca64bc-edd0-4e80-96d7-6bfc4956dcb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:57.102717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2dca64bc-edd0-4e80-96d7-6bfc4956dcb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:57.131323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca64bc-edd0-4e80-96d7-6bfc4956dcb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:57.141317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca64bc-edd0-4e80-96d7-6bfc4956dcb2 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:57.169341 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3125/6246] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:53:57.170704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca64bc-edd0-4e80-96d7-6bfc4956dcb2 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:57.190929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:57.208000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8a1b8-326f-4457-b1d3-069674669625 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:57.208792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8a1b8-326f-4457-b1d3-069674669625 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:57.213203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8a1b8-326f-4457-b1d3-069674669625 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:57.213663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8a1b8-326f-4457-b1d3-069674669625 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:57.214092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca64bc-edd0-4e80-96d7-6bfc4956dcb2 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:57.220303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97da89-61f6-4f41-96c6-ffa3ed1dab63 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb90dafabb694b1aa1d9791cac1ecfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0e80460d14031a49fb9f2476c974a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:57.220967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97da89-61f6-4f41-96c6-ffa3ed1dab63 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:57.221936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97da89-61f6-4f41-96c6-ffa3ed1dab63 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:57.222229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97da89-61f6-4f41-96c6-ffa3ed1dab63 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] PATH_INFO: `/v3/projects/055546a99d884d538c7bd805e2827cd2/tags/tempest-tag-372696563` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:57.246366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8a1b8-326f-4457-b1d3-069674669625 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:57.249295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8a1b8-326f-4457-b1d3-069674669625 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:57.258071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97da89-61f6-4f41-96c6-ffa3ed1dab63 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=055546a99d884d538c7bd805e2827cd2, value=tempest-tag-372696563)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:57.264472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97da89-61f6-4f41-96c6-ffa3ed1dab63 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:57.278222 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3122/6247] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:53:57.279534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:57.295225 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3126/6248] 10.222.0.16 () {58 vars in 1311 bytes} [Mon Aug 29 15:53:57 2022] GET /identity/v3/projects/055546a99d884d538c7bd805e2827cd2/tags/tempest-tag-372696563 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:57.309179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8a1b8-326f-4457-b1d3-069674669625 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:57.326027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8a1b8-326f-4457-b1d3-069674669625 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:57.338121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a4d9b-658b-4ade-9021-38fccdcf47b1 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb90dafabb694b1aa1d9791cac1ecfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0e80460d14031a49fb9f2476c974a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:57.338785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a4d9b-658b-4ade-9021-38fccdcf47b1 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:57.340121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a4d9b-658b-4ade-9021-38fccdcf47b1 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:57.340121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a4d9b-658b-4ade-9021-38fccdcf47b1 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] PATH_INFO: `/v3/projects/055546a99d884d538c7bd805e2827cd2/tags` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:57.342246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a4d9b-658b-4ade-9021-38fccdcf47b1 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=055546a99d884d538c7bd805e2827cd2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:57.344405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a4d9b-658b-4ade-9021-38fccdcf47b1 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:57.466025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97da89-61f6-4f41-96c6-ffa3ed1dab63 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:57.475029 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3123/6249] 10.222.0.16 () {60 vars in 1265 bytes} [Mon Aug 29 15:53:57 2022] PUT /identity/v3/projects/055546a99d884d538c7bd805e2827cd2/tags => generated 140 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:57.490342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97da89-61f6-4f41-96c6-ffa3ed1dab63 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:57.509569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb89b3-0b00-4a7f-a67f-a2131bcff7c7 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb90dafabb694b1aa1d9791cac1ecfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0e80460d14031a49fb9f2476c974a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:57.510382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb89b3-0b00-4a7f-a67f-a2131bcff7c7 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:57.511020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb89b3-0b00-4a7f-a67f-a2131bcff7c7 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:57.511317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb89b3-0b00-4a7f-a67f-a2131bcff7c7 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] PATH_INFO: `/v3/projects/055546a99d884d538c7bd805e2827cd2/tags` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:57.552667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb89b3-0b00-4a7f-a67f-a2131bcff7c7 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=055546a99d884d538c7bd805e2827cd2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:57.555238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb89b3-0b00-4a7f-a67f-a2131bcff7c7 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:57.601898 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3127/6250] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:53:57 2022] GET /identity/v3/projects/055546a99d884d538c7bd805e2827cd2/tags => generated 140 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:53:57.602968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a4d9b-658b-4ade-9021-38fccdcf47b1 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:57.615023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a4d9b-658b-4ade-9021-38fccdcf47b1 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:57.636429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcaf3-68d9-4cb3-a2af-8f27e7374d56 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb90dafabb694b1aa1d9791cac1ecfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0e80460d14031a49fb9f2476c974a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:57.637122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcaf3-68d9-4cb3-a2af-8f27e7374d56 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:57.637475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcaf3-68d9-4cb3-a2af-8f27e7374d56 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:57.637763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcaf3-68d9-4cb3-a2af-8f27e7374d56 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] PATH_INFO: `/v3/projects/055546a99d884d538c7bd805e2827cd2/tags/tempest-tag-633244388` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:57.645576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bcaf3-68d9-4cb3-a2af-8f27e7374d56 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=055546a99d884d538c7bd805e2827cd2, value=tempest-tag-633244388)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:57.651984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bcaf3-68d9-4cb3-a2af-8f27e7374d56 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:57.736999 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-236bcaf3-68d9-4cb3-a2af-8f27e7374d56 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-633244388. To ensure interoperability, identifiers should be a valid uuid. Aug 29 15:53:57.736999 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 29 15:53:57.736999 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:53:57.743090 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3124/6251] 10.222.0.16 () {58 vars in 1314 bytes} [Mon Aug 29 15:53:57 2022] DELETE /identity/v3/projects/055546a99d884d538c7bd805e2827cd2/tags/tempest-tag-633244388 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:53:57.747767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb89b3-0b00-4a7f-a67f-a2131bcff7c7 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:57.765457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb89b3-0b00-4a7f-a67f-a2131bcff7c7 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:57.773278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d388f63-1006-4763-b240-fdcbc66214b9 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb90dafabb694b1aa1d9791cac1ecfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0e80460d14031a49fb9f2476c974a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:57.773996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d388f63-1006-4763-b240-fdcbc66214b9 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:57.774282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d388f63-1006-4763-b240-fdcbc66214b9 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:57.774564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d388f63-1006-4763-b240-fdcbc66214b9 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] PATH_INFO: `/v3/projects/055546a99d884d538c7bd805e2827cd2/tags/tempest-tag-633244388` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:57.793540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d388f63-1006-4763-b240-fdcbc66214b9 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=055546a99d884d538c7bd805e2827cd2, value=tempest-tag-633244388)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:57.796595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d388f63-1006-4763-b240-fdcbc66214b9 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-9d388f63-1006-4763-b240-fdcbc66214b9 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Could not find project tag: tempest-tag-633244388.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-633244388. Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Aug 29 15:53:57.828249 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Aug 29 15:53:57.829268 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:53:57.829268 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:53:57.829268 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Aug 29 15:53:57.829268 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Aug 29 15:53:57.829268 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-633244388. Aug 29 15:53:57.829268 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:53:57.842844 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3128/6252] 10.222.0.16 () {58 vars in 1311 bytes} [Mon Aug 29 15:53:57 2022] GET /identity/v3/projects/055546a99d884d538c7bd805e2827cd2/tags/tempest-tag-633244388 => generated 106 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:53:57.847229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcaf3-68d9-4cb3-a2af-8f27e7374d56 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:57.858766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcaf3-68d9-4cb3-a2af-8f27e7374d56 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:57.864396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ebfa9-883d-47f7-ac99-e314ef38424e tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb90dafabb694b1aa1d9791cac1ecfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0e80460d14031a49fb9f2476c974a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:57.865223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ebfa9-883d-47f7-ac99-e314ef38424e tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:57.865612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ebfa9-883d-47f7-ac99-e314ef38424e tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:57.866004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ebfa9-883d-47f7-ac99-e314ef38424e tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] PATH_INFO: `/v3/projects/055546a99d884d538c7bd805e2827cd2/tags` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:57.867292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ebfa9-883d-47f7-ac99-e314ef38424e tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=055546a99d884d538c7bd805e2827cd2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:57.869682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ebfa9-883d-47f7-ac99-e314ef38424e tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:57.939847 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3125/6253] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Aug 29 15:53:57 2022] DELETE /identity/v3/projects/055546a99d884d538c7bd805e2827cd2/tags => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:57.943931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d388f63-1006-4763-b240-fdcbc66214b9 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:57.959178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d388f63-1006-4763-b240-fdcbc66214b9 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:57.968263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6e833-5025-4e22-b382-7657d6a92839 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb90dafabb694b1aa1d9791cac1ecfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0e80460d14031a49fb9f2476c974a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:57.968996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e833-5025-4e22-b382-7657d6a92839 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:57.969356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e833-5025-4e22-b382-7657d6a92839 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:57.970682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e833-5025-4e22-b382-7657d6a92839 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] PATH_INFO: `/v3/projects/055546a99d884d538c7bd805e2827cd2/tags` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:57.990359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6e833-5025-4e22-b382-7657d6a92839 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=055546a99d884d538c7bd805e2827cd2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:57.993209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6e833-5025-4e22-b382-7657d6a92839 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:58.011396 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3129/6254] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Aug 29 15:53:57 2022] GET /identity/v3/projects/055546a99d884d538c7bd805e2827cd2/tags => generated 66 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 29 15:53:58.015313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ebfa9-883d-47f7-ac99-e314ef38424e tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:58.031801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ebfa9-883d-47f7-ac99-e314ef38424e tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:58.041008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb90dafabb694b1aa1d9791cac1ecfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0e80460d14031a49fb9f2476c974a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:58.042138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:58.042836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:58.045169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] PATH_INFO: `/v3/projects/055546a99d884d538c7bd805e2827cd2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:58.047677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorizing `identity:delete_project(project_id=055546a99d884d538c7bd805e2827cd2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:58.050340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:58.118357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055546a99d884d538c7bd805e2827cd2', 'request_id': 'req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.127062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055546a99d884d538c7bd805e2827cd2', 'request_id': 'req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.138009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055546a99d884d538c7bd805e2827cd2', 'request_id': 'req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.158468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] The token cache is being invalidate because project 055546a99d884d538c7bd805e2827cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:53:58.158811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.159738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c4e83dfb-c1a5-4664-ac74-cd5bcd78f3f2 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.166602 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3126/6255] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:53:58 2022] DELETE /identity/v3/projects/055546a99d884d538c7bd805e2827cd2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:58.167913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6e833-5025-4e22-b382-7657d6a92839 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:58.169737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-05a6e833-5025-4e22-b382-7657d6a92839 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:58.370253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6e833-5025-4e22-b382-7657d6a92839 tempest-IdentityV3ProjectTagsTest-855556792 tempest-IdentityV3ProjectTagsTest-855556792-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:58.553325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:58.554084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:58.554538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:58.554538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] PATH_INFO: `/v3/users/c9fc3c4af933454a888e72c87ecaa684` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:58.556544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fc3c4af933454a888e72c87ecaa684)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:58.558306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:58.714555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:58.723200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fc3c4af933454a888e72c87ecaa684'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.724191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fc3c4af933454a888e72c87ecaa684'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.744212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fc3c4af933454a888e72c87ecaa684'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.746228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fc3c4af933454a888e72c87ecaa684'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.773988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fc3c4af933454a888e72c87ecaa684'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:53:58.807183 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3130/6256] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:53:58 2022] DELETE /identity/v3/users/c9fc3c4af933454a888e72c87ecaa684 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:53:58.812148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab583d-d158-44f7-807a-a1064607338e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:58.812538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab583d-d158-44f7-807a-a1064607338e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:58.812918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab583d-d158-44f7-807a-a1064607338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:58.862036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-32ab583d-d158-44f7-807a-a1064607338e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:53:58.863601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-32ab583d-d158-44f7-807a-a1064607338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:58.870254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:58.933915 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3127/6257] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:53:58.945420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:53:58.946914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:53:59.022733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881988-d37f-488d-a90b-54ec6b0a02be admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:53:59.027107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ce36e-22f4-4e47-a32d-877b3500de40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:53:59.027740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce36e-22f4-4e47-a32d-877b3500de40 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:53:59.028152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce36e-22f4-4e47-a32d-877b3500de40 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:53:59.028500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ce36e-22f4-4e47-a32d-877b3500de40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:53:59.041636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ce36e-22f4-4e47-a32d-877b3500de40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:53:59.041636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ce36e-22f4-4e47-a32d-877b3500de40 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:53:59.064575 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3131/6258] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:00.472872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab583d-d158-44f7-807a-a1064607338e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:00.475460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-32ab583d-d158-44f7-807a-a1064607338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:00.499489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab583d-d158-44f7-807a-a1064607338e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:00.514708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:00.515649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:00.516159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:00.517151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] PATH_INFO: `/v3/projects/36516015012649b28594fc9f6cca6a0e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:00.520237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=36516015012649b28594fc9f6cca6a0e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:00.525019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:00.636655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36516015012649b28594fc9f6cca6a0e', 'request_id': 'req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:00.654164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36516015012649b28594fc9f6cca6a0e', 'request_id': 'req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:00.673938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36516015012649b28594fc9f6cca6a0e', 'request_id': 'req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:00.699988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] The token cache is being invalidate because project 36516015012649b28594fc9f6cca6a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:00.700289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:00.701067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:00.703144 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3128/6259] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:00 2022] DELETE /identity/v3/projects/36516015012649b28594fc9f6cca6a0e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:00.707957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ce36e-22f4-4e47-a32d-877b3500de40 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:00.726607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ce36e-22f4-4e47-a32d-877b3500de40 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:00.888039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccb79b-3721-4bce-a883-f26961bda5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:00.888852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccb79b-3721-4bce-a883-f26961bda5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:00.889174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccb79b-3721-4bce-a883-f26961bda5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:00.889476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccb79b-3721-4bce-a883-f26961bda5d4 admin admin] PATH_INFO: `/v3/users/cb90dafabb694b1aa1d9791cac1ecfe9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:00.892167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccb79b-3721-4bce-a883-f26961bda5d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb90dafabb694b1aa1d9791cac1ecfe9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:00.895127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccb79b-3721-4bce-a883-f26961bda5d4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:01.030617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5ccb79b-3721-4bce-a883-f26961bda5d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb90dafabb694b1aa1d9791cac1ecfe9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:01.031424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5ccb79b-3721-4bce-a883-f26961bda5d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb90dafabb694b1aa1d9791cac1ecfe9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:01.080104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:01.095043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5ccb79b-3721-4bce-a883-f26961bda5d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb90dafabb694b1aa1d9791cac1ecfe9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:01.099582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5ccb79b-3721-4bce-a883-f26961bda5d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb90dafabb694b1aa1d9791cac1ecfe9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:01.112142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c5ccb79b-3721-4bce-a883-f26961bda5d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb90dafabb694b1aa1d9791cac1ecfe9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:01.138338 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3132/6260] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:00 2022] DELETE /identity/v3/users/cb90dafabb694b1aa1d9791cac1ecfe9 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:03.123849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:03.125754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:03.162926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf39c0-6501-46bd-b14e-0a94d20c51cb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:03.360423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:03.361237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:03.361835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:03.362301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] PATH_INFO: `/v3/projects/f0b0e80460d14031a49fb9f2476c974a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:03.363705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b0e80460d14031a49fb9f2476c974a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:03.366003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:03.428751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:03.451798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b0e80460d14031a49fb9f2476c974a', 'request_id': 'req-f9e67268-2541-476c-971a-f0745a5ad97d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:03.454267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b0e80460d14031a49fb9f2476c974a', 'request_id': 'req-f9e67268-2541-476c-971a-f0745a5ad97d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:03.465594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b0e80460d14031a49fb9f2476c974a', 'request_id': 'req-f9e67268-2541-476c-971a-f0745a5ad97d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:03.483719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] The token cache is being invalidate because project f0b0e80460d14031a49fb9f2476c974a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:03.484020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:03.484857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f9e67268-2541-476c-971a-f0745a5ad97d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:03.491030 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3129/6261] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:03 2022] DELETE /identity/v3/projects/f0b0e80460d14031a49fb9f2476c974a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:03.492967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ee85f-4fce-493b-9baf-125fd7adfbd5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:03.493491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ee85f-4fce-493b-9baf-125fd7adfbd5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:03.493728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ee85f-4fce-493b-9baf-125fd7adfbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:03.523311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-941ee85f-4fce-493b-9baf-125fd7adfbd5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:03.524788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-941ee85f-4fce-493b-9baf-125fd7adfbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:03.604649 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3133/6262] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:03.613842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d075547-8468-425b-8324-2abe04b18b18 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:03.614092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d075547-8468-425b-8324-2abe04b18b18 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:03.614378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d075547-8468-425b-8324-2abe04b18b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:03.636990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4d075547-8468-425b-8324-2abe04b18b18 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:03.638484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4d075547-8468-425b-8324-2abe04b18b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:03.660781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ee85f-4fce-493b-9baf-125fd7adfbd5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:03.660874 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3130/6263] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:03.673214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ee85f-4fce-493b-9baf-125fd7adfbd5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:03.679350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46017216-b28f-46cf-b725-655c62238c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:03.680090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46017216-b28f-46cf-b725-655c62238c6f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:03.680476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46017216-b28f-46cf-b725-655c62238c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:03.680851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46017216-b28f-46cf-b725-655c62238c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:03.681678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46017216-b28f-46cf-b725-655c62238c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:03.682080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46017216-b28f-46cf-b725-655c62238c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:03.683941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46017216-b28f-46cf-b725-655c62238c6f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:03.707476 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3134/6264] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:54:03.711315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d075547-8468-425b-8324-2abe04b18b18 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:03.721919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d075547-8468-425b-8324-2abe04b18b18 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:03.728228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec523d-c9d9-44a6-9493-808e295c43ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:03.728228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec523d-c9d9-44a6-9493-808e295c43ac admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:03.728487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec523d-c9d9-44a6-9493-808e295c43ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:03.728588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec523d-c9d9-44a6-9493-808e295c43ac admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:03.729236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec523d-c9d9-44a6-9493-808e295c43ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:03.731848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec523d-c9d9-44a6-9493-808e295c43ac admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:03.766733 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3131/6265] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:03 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:03.767939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46017216-b28f-46cf-b725-655c62238c6f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:03.780614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46017216-b28f-46cf-b725-655c62238c6f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:03.863804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937488e-7247-4ccf-83f6-9d7da4b76037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:03.864441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937488e-7247-4ccf-83f6-9d7da4b76037 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:03.864730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937488e-7247-4ccf-83f6-9d7da4b76037 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:03.865010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937488e-7247-4ccf-83f6-9d7da4b76037 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:03.865731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937488e-7247-4ccf-83f6-9d7da4b76037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:03.868019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937488e-7247-4ccf-83f6-9d7da4b76037 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:03.904643 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3135/6266] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:03 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:03.906387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec523d-c9d9-44a6-9493-808e295c43ac admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:03.922495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec523d-c9d9-44a6-9493-808e295c43ac admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:03.928685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612f2e-fd46-47e1-a50e-eca614e6de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:03.929621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612f2e-fd46-47e1-a50e-eca614e6de07 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:03.930087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612f2e-fd46-47e1-a50e-eca614e6de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:03.930537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612f2e-fd46-47e1-a50e-eca614e6de07 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:03.931362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612f2e-fd46-47e1-a50e-eca614e6de07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:03.933283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612f2e-fd46-47e1-a50e-eca614e6de07 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:03.946308 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3132/6267] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:03.950373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937488e-7247-4ccf-83f6-9d7da4b76037 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:03.969939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937488e-7247-4ccf-83f6-9d7da4b76037 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:03.975744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0544e2-b835-4822-8991-3b7957f9d665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:03.976446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0544e2-b835-4822-8991-3b7957f9d665 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:03.976724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0544e2-b835-4822-8991-3b7957f9d665 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:03.977879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0544e2-b835-4822-8991-3b7957f9d665 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:03.978542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0544e2-b835-4822-8991-3b7957f9d665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:03.980494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0544e2-b835-4822-8991-3b7957f9d665 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:04.002433 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3136/6268] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:04.003642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612f2e-fd46-47e1-a50e-eca614e6de07 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:04.015606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612f2e-fd46-47e1-a50e-eca614e6de07 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:04.023994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a3a84-2175-4777-bc3d-c8f24794f64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:04.024230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a3a84-2175-4777-bc3d-c8f24794f64e admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:04.024393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a3a84-2175-4777-bc3d-c8f24794f64e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:04.024707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a3a84-2175-4777-bc3d-c8f24794f64e admin admin] PATH_INFO: `/v3/projects/654d20f989ed40269e465948258024a8/users/a5a60ef5d440466a8384a32ae719b6b4/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:04.061668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a3a84-2175-4777-bc3d-c8f24794f64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=654d20f989ed40269e465948258024a8, user_id=a5a60ef5d440466a8384a32ae719b6b4, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:04.068027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a3a84-2175-4777-bc3d-c8f24794f64e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:04.114413 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3133/6269] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:04 2022] PUT /identity/v3/projects/654d20f989ed40269e465948258024a8/users/a5a60ef5d440466a8384a32ae719b6b4/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:04.118887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eee67-f028-483b-acf4-ea30f106be72 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:04.119050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eee67-f028-483b-acf4-ea30f106be72 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:04.119614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eee67-f028-483b-acf4-ea30f106be72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:04.199607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-345eee67-f028-483b-acf4-ea30f106be72 None None] MFA Rules not processed for user `a5a60ef5d440466a8384a32ae719b6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:04.201364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-345eee67-f028-483b-acf4-ea30f106be72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:04.308956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:04.410881 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3137/6270] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:04.417070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a3a84-2175-4777-bc3d-c8f24794f64e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:04.558290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a3a84-2175-4777-bc3d-c8f24794f64e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:04.583713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c528538-44e7-42b7-ae11-00fbbedca9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:04.584524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c528538-44e7-42b7-ae11-00fbbedca9fd admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:04.584813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c528538-44e7-42b7-ae11-00fbbedca9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:04.585152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c528538-44e7-42b7-ae11-00fbbedca9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:04.585839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c528538-44e7-42b7-ae11-00fbbedca9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:04.590288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c528538-44e7-42b7-ae11-00fbbedca9fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:04.651949 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3134/6271] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:04 2022] POST /identity/v3/projects => generated 369 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:04.656263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eee67-f028-483b-acf4-ea30f106be72 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:04.683878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eee67-f028-483b-acf4-ea30f106be72 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:04.742237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c528538-44e7-42b7-ae11-00fbbedca9fd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:04.745037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7c528538-44e7-42b7-ae11-00fbbedca9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:04.823419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ed080-e341-4873-a79d-663f7267fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:04.824079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed080-e341-4873-a79d-663f7267fe4a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:04.824419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed080-e341-4873-a79d-663f7267fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:04.824896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed080-e341-4873-a79d-663f7267fe4a admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:04.825718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ed080-e341-4873-a79d-663f7267fe4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:04.827614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ed080-e341-4873-a79d-663f7267fe4a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:04.859775 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3138/6272] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:04 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:04.862733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ed080-e341-4873-a79d-663f7267fe4a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:04.884044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ed080-e341-4873-a79d-663f7267fe4a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:04.896825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd6d15-f830-48ec-a15f-a850bf33a440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:04.897570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd6d15-f830-48ec-a15f-a850bf33a440 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:04.897860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd6d15-f830-48ec-a15f-a850bf33a440 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:04.900367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd6d15-f830-48ec-a15f-a850bf33a440 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:04.901234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd6d15-f830-48ec-a15f-a850bf33a440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:04.904386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd6d15-f830-48ec-a15f-a850bf33a440 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:04.909372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:04.939371 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3139/6273] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:04.944068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd6d15-f830-48ec-a15f-a850bf33a440 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:04.958549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c528538-44e7-42b7-ae11-00fbbedca9fd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:04.974224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd6d15-f830-48ec-a15f-a850bf33a440 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:04.975936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:04.976616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:04.977001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:04.979112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] PATH_INFO: `/v3/users/fd4769547d9c4863b66db8c1eff4f8bb` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:04.981412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4769547d9c4863b66db8c1eff4f8bb)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:04.987263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:04.990880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62865cd8-ca33-4481-9e48-2bd7f5f133e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:04.991722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865cd8-ca33-4481-9e48-2bd7f5f133e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:04.992012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865cd8-ca33-4481-9e48-2bd7f5f133e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:04.992352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865cd8-ca33-4481-9e48-2bd7f5f133e9 admin admin] PATH_INFO: `/v3/projects/431138ed680a49adb2cf53f3cb84286e/users/c78ebb9e20654852a43abfc530633f4e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:05.031525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62865cd8-ca33-4481-9e48-2bd7f5f133e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431138ed680a49adb2cf53f3cb84286e, user_id=c78ebb9e20654852a43abfc530633f4e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:05.038857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62865cd8-ca33-4481-9e48-2bd7f5f133e9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:05.066166 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3140/6274] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:04 2022] PUT /identity/v3/projects/431138ed680a49adb2cf53f3cb84286e/users/c78ebb9e20654852a43abfc530633f4e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:05.066166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62865cd8-ca33-4481-9e48-2bd7f5f133e9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:05.107452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4769547d9c4863b66db8c1eff4f8bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:05.108604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4769547d9c4863b66db8c1eff4f8bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:05.134325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4769547d9c4863b66db8c1eff4f8bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:05.150391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4769547d9c4863b66db8c1eff4f8bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:05.160909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4769547d9c4863b66db8c1eff4f8bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:05.176474 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3135/6275] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:04 2022] DELETE /identity/v3/users/fd4769547d9c4863b66db8c1eff4f8bb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:05.249114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62865cd8-ca33-4481-9e48-2bd7f5f133e9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:05.344982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:05.412924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ec51b-bec3-43d6-b319-0bfbaf4f88fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:05.414041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec51b-bec3-43d6-b319-0bfbaf4f88fb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:05.414850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec51b-bec3-43d6-b319-0bfbaf4f88fb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:05.415261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec51b-bec3-43d6-b319-0bfbaf4f88fb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:05.417179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ec51b-bec3-43d6-b319-0bfbaf4f88fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:05.427908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ec51b-bec3-43d6-b319-0bfbaf4f88fb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:05.460116 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3141/6276] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:05.462934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:05.465001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:05.492280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d55b-370c-42b0-afcc-d74daeb5835b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:05.509322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc501f-695a-44b8-95ec-1721efb0173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:05.510367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc501f-695a-44b8-95ec-1721efb0173d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:05.510831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc501f-695a-44b8-95ec-1721efb0173d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:05.511305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc501f-695a-44b8-95ec-1721efb0173d admin admin] PATH_INFO: `/v3/projects/431138ed680a49adb2cf53f3cb84286e/users/c78ebb9e20654852a43abfc530633f4e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:05.515161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc501f-695a-44b8-95ec-1721efb0173d admin admin] RBAC: Authorizing `identity:create_grant(project_id=431138ed680a49adb2cf53f3cb84286e, user_id=c78ebb9e20654852a43abfc530633f4e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:05.518125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc501f-695a-44b8-95ec-1721efb0173d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:05.560599 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3136/6277] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:05 2022] PUT /identity/v3/projects/431138ed680a49adb2cf53f3cb84286e/users/c78ebb9e20654852a43abfc530633f4e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:05.562793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7ae31-0bc6-4f5e-b96c-d850c900b05a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:05.563083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7ae31-0bc6-4f5e-b96c-d850c900b05a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:05.563363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7ae31-0bc6-4f5e-b96c-d850c900b05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:05.643885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-36b7ae31-0bc6-4f5e-b96c-d850c900b05a None None] MFA Rules not processed for user `c78ebb9e20654852a43abfc530633f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:05.647491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-36b7ae31-0bc6-4f5e-b96c-d850c900b05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:05.774480 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3142/6278] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:05.780037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc501f-695a-44b8-95ec-1721efb0173d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:05.913762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc501f-695a-44b8-95ec-1721efb0173d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:05.923022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905d27b-3ba5-4509-9e32-345d6653fded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:05.923921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905d27b-3ba5-4509-9e32-345d6653fded admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:05.925436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905d27b-3ba5-4509-9e32-345d6653fded admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:05.925831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905d27b-3ba5-4509-9e32-345d6653fded admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:05.926981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905d27b-3ba5-4509-9e32-345d6653fded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:05.929190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905d27b-3ba5-4509-9e32-345d6653fded admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:05.971008 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3137/6279] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:05 2022] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:05.974857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7ae31-0bc6-4f5e-b96c-d850c900b05a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:05.993681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7ae31-0bc6-4f5e-b96c-d850c900b05a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:06.010110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905d27b-3ba5-4509-9e32-345d6653fded admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:06.012386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c905d27b-3ba5-4509-9e32-345d6653fded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:06.073373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:06.151652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905d27b-3ba5-4509-9e32-345d6653fded admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:06.167156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b9053-3249-4bda-8510-8042e5f226a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:06.167156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b9053-3249-4bda-8510-8042e5f226a4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:06.167156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b9053-3249-4bda-8510-8042e5f226a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:06.167394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b9053-3249-4bda-8510-8042e5f226a4 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:06.168122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b9053-3249-4bda-8510-8042e5f226a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:06.169765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:06.170434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:06.171348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:06.171637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] PATH_INFO: `/v3/projects/40c8dfe3aa504903b706c3fb65a8211e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:06.174767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c8dfe3aa504903b706c3fb65a8211e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:06.175491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b9053-3249-4bda-8510-8042e5f226a4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:06.176721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:06.239406 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3143/6280] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:05 2022] POST /identity/v3/users => generated 284 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:06.243337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b9053-3249-4bda-8510-8042e5f226a4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:06.269012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b9053-3249-4bda-8510-8042e5f226a4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:06.281937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344b8fc-457e-4a57-8686-2bed141562dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:06.282584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344b8fc-457e-4a57-8686-2bed141562dc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:06.298264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344b8fc-457e-4a57-8686-2bed141562dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:06.299582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344b8fc-457e-4a57-8686-2bed141562dc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:06.300364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344b8fc-457e-4a57-8686-2bed141562dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:06.303144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344b8fc-457e-4a57-8686-2bed141562dc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:06.330371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c8dfe3aa504903b706c3fb65a8211e', 'request_id': 'req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:06.335693 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3144/6281] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:06.340078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344b8fc-457e-4a57-8686-2bed141562dc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:06.341928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c8dfe3aa504903b706c3fb65a8211e', 'request_id': 'req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:06.353612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c8dfe3aa504903b706c3fb65a8211e', 'request_id': 'req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:06.358580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344b8fc-457e-4a57-8686-2bed141562dc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:06.383271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] The token cache is being invalidate because project 40c8dfe3aa504903b706c3fb65a8211e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:06.383602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:06.385142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:06.389997 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3138/6282] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:06 2022] DELETE /identity/v3/projects/40c8dfe3aa504903b706c3fb65a8211e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:06.391763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:06.393490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:06.470822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:06.515935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e16e13-b04d-4e78-9cee-217f8f3fcbb5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:06.520477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a338d-914d-4726-bc22-199409a75681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:06.522400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a338d-914d-4726-bc22-199409a75681 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:06.524055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a338d-914d-4726-bc22-199409a75681 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:06.525039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a338d-914d-4726-bc22-199409a75681 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:06.526321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:06.526551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a338d-914d-4726-bc22-199409a75681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:06.527521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:06.528345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:06.528836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] PATH_INFO: `/v3/users/d935ac8758d54f35bd955a095782668a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:06.530512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d935ac8758d54f35bd955a095782668a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:06.532406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a338d-914d-4726-bc22-199409a75681 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:06.533196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:06.554225 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3145/6283] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:06.558841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a338d-914d-4726-bc22-199409a75681 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:06.561456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8a1a338d-914d-4726-bc22-199409a75681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:06.576597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a338d-914d-4726-bc22-199409a75681 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:06.583101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fdbbb-9817-4cce-b942-18c8adf9c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:06.584514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fdbbb-9817-4cce-b942-18c8adf9c596 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:06.584922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fdbbb-9817-4cce-b942-18c8adf9c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:06.585302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fdbbb-9817-4cce-b942-18c8adf9c596 admin admin] PATH_INFO: `/v3/projects/8f87a0aed27c4e54b105d97ace68cf9a/users/adbab3d6a7e841008a870b747a802919/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:06.608086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fdbbb-9817-4cce-b942-18c8adf9c596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f87a0aed27c4e54b105d97ace68cf9a, user_id=adbab3d6a7e841008a870b747a802919, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:06.611627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fdbbb-9817-4cce-b942-18c8adf9c596 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:06.633570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd935ac8758d54f35bd955a095782668a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:06.634550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd935ac8758d54f35bd955a095782668a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:06.640279 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3146/6284] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:06 2022] PUT /identity/v3/projects/8f87a0aed27c4e54b105d97ace68cf9a/users/adbab3d6a7e841008a870b747a802919/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:06.650438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c0d7d-51ae-4f86-ac90-84910e6df8b0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:06.650725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c0d7d-51ae-4f86-ac90-84910e6df8b0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:06.650992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c0d7d-51ae-4f86-ac90-84910e6df8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:06.653877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd935ac8758d54f35bd955a095782668a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:06.659833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:06.664839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd935ac8758d54f35bd955a095782668a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:06.680709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd935ac8758d54f35bd955a095782668a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:06.690408 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3139/6285] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:06 2022] DELETE /identity/v3/users/d935ac8758d54f35bd955a095782668a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:06.720455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-611c0d7d-51ae-4f86-ac90-84910e6df8b0 None None] MFA Rules not processed for user `adbab3d6a7e841008a870b747a802919`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:06.722268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-611c0d7d-51ae-4f86-ac90-84910e6df8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:06.848804 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3147/6286] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:06.852956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:06.856609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:06.976353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c0d7d-51ae-4f86-ac90-84910e6df8b0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:06.978079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-611c0d7d-51ae-4f86-ac90-84910e6df8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:07.001053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e60c-6459-49f9-bd21-49be8ef2c8f3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:07.041840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99db83-f797-4982-9a52-76c81f081118 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:07.044917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99db83-f797-4982-9a52-76c81f081118 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:07.049596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99db83-f797-4982-9a52-76c81f081118 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:07.050156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99db83-f797-4982-9a52-76c81f081118 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:07.053214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99db83-f797-4982-9a52-76c81f081118 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:07.056604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99db83-f797-4982-9a52-76c81f081118 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:07.086188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c0d7d-51ae-4f86-ac90-84910e6df8b0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:07.095611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:07.096264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:07.096549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:07.096828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] PATH_INFO: `/v3/projects/7239953e77ef49329cf43f2bd49d9e06` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:07.098039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7239953e77ef49329cf43f2bd49d9e06)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:07.098656 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3140/6287] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:54:06 2022] POST /identity/v3/domains => generated 275 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:07.099661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99db83-f797-4982-9a52-76c81f081118 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:07.100672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:07.101765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ef99db83-f797-4982-9a52-76c81f081118 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:07.173625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:07.207739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7239953e77ef49329cf43f2bd49d9e06', 'request_id': 'req-15e39274-64df-427c-a5a8-a308400f669b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.218848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7239953e77ef49329cf43f2bd49d9e06', 'request_id': 'req-15e39274-64df-427c-a5a8-a308400f669b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.241823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99db83-f797-4982-9a52-76c81f081118 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:07.249000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7239953e77ef49329cf43f2bd49d9e06', 'request_id': 'req-15e39274-64df-427c-a5a8-a308400f669b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.272348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] The token cache is being invalidate because project 7239953e77ef49329cf43f2bd49d9e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:07.272906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.274600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:07.294013 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3148/6288] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:06 2022] DELETE /identity/v3/projects/7239953e77ef49329cf43f2bd49d9e06 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:07.295239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:07.328052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:07.431969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da0306-e7d5-46c3-afcf-db18b9dac8ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:07.433053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da0306-e7d5-46c3-afcf-db18b9dac8ea service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:07.433505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da0306-e7d5-46c3-afcf-db18b9dac8ea service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:07.433793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da0306-e7d5-46c3-afcf-db18b9dac8ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:07.448460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b0da0306-e7d5-46c3-afcf-db18b9dac8ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:07.486990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da0306-e7d5-46c3-afcf-db18b9dac8ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:07.493371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da0306-e7d5-46c3-afcf-db18b9dac8ea service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:07.528937 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3141/6289] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:07.548775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e39274-64df-427c-a5a8-a308400f669b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:07.558414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d583-c89c-401e-8ade-b9f9e3b0c37d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:07.560324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d583-c89c-401e-8ade-b9f9e3b0c37d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:07.560899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d583-c89c-401e-8ade-b9f9e3b0c37d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:07.562036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d583-c89c-401e-8ade-b9f9e3b0c37d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:07.562979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2d583-c89c-401e-8ade-b9f9e3b0c37d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:07.567142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2d583-c89c-401e-8ade-b9f9e3b0c37d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:07.598812 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3149/6290] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:54:07 2022] POST /identity/v3/roles => generated 240 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:07.603275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da0306-e7d5-46c3-afcf-db18b9dac8ea service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:07.619808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da0306-e7d5-46c3-afcf-db18b9dac8ea service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:07.639942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a12ca-0b47-4685-bb7c-957bf28b59fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:07.640650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a12ca-0b47-4685-bb7c-957bf28b59fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:07.640939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a12ca-0b47-4685-bb7c-957bf28b59fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:07.641223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a12ca-0b47-4685-bb7c-957bf28b59fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/551db7932a994ca687dca4d0ae35c53a/users/adbab3d6a7e841008a870b747a802919/roles/88ba8dc4691940a0bc55b14fcf6a5cfc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:07.658460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:07.666513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a12ca-0b47-4685-bb7c-957bf28b59fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=551db7932a994ca687dca4d0ae35c53a, user_id=adbab3d6a7e841008a870b747a802919, role_id=88ba8dc4691940a0bc55b14fcf6a5cfc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:07.683890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a12ca-0b47-4685-bb7c-957bf28b59fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:07.714407 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3142/6291] 10.222.0.16 () {60 vars in 1480 bytes} [Mon Aug 29 15:54:07 2022] PUT /identity/v3/domains/551db7932a994ca687dca4d0ae35c53a/users/adbab3d6a7e841008a870b747a802919/roles/88ba8dc4691940a0bc55b14fcf6a5cfc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:07.718673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d583-c89c-401e-8ade-b9f9e3b0c37d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:07.730354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d583-c89c-401e-8ade-b9f9e3b0c37d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:07.826463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6f055-d8a0-494f-b7f4-6f179b0f13cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:07.827303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f055-d8a0-494f-b7f4-6f179b0f13cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:07.827890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f055-d8a0-494f-b7f4-6f179b0f13cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:07.828288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f055-d8a0-494f-b7f4-6f179b0f13cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:07.830330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6f055-d8a0-494f-b7f4-6f179b0f13cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:07.832505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6f055-d8a0-494f-b7f4-6f179b0f13cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:07.860486 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3150/6292] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:54:07 2022] POST /identity/v3/domains => generated 274 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:07.862905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a12ca-0b47-4685-bb7c-957bf28b59fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:07.883958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a12ca-0b47-4685-bb7c-957bf28b59fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:07.960237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd1ddc-a5b9-47a6-8a00-afd3d1e4a303 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:07.960996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1ddc-a5b9-47a6-8a00-afd3d1e4a303 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:07.961346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1ddc-a5b9-47a6-8a00-afd3d1e4a303 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:07.961807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1ddc-a5b9-47a6-8a00-afd3d1e4a303 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:07.962583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd1ddc-a5b9-47a6-8a00-afd3d1e4a303 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:07.964252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd1ddc-a5b9-47a6-8a00-afd3d1e4a303 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:07.982986 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3143/6293] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:54:07 2022] POST /identity/v3/roles => generated 239 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:07.986891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6f055-d8a0-494f-b7f4-6f179b0f13cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:07.999503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6f055-d8a0-494f-b7f4-6f179b0f13cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:08.004610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b5f2-1609-4cae-8a9f-ba79c0d6389c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:08.005450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b5f2-1609-4cae-8a9f-ba79c0d6389c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:08.005743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b5f2-1609-4cae-8a9f-ba79c0d6389c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:08.006170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b5f2-1609-4cae-8a9f-ba79c0d6389c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:08.006925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b5f2-1609-4cae-8a9f-ba79c0d6389c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:08.009122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b5f2-1609-4cae-8a9f-ba79c0d6389c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:08.058601 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3151/6294] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:54:07 2022] POST /identity/v3/groups => generated 326 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:08.064095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd1ddc-a5b9-47a6-8a00-afd3d1e4a303 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:08.076757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd1ddc-a5b9-47a6-8a00-afd3d1e4a303 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:08.081730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f8bb9-ca03-4493-b8a7-fce0f14e4a60 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:08.082454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8bb9-ca03-4493-b8a7-fce0f14e4a60 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:08.082752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8bb9-ca03-4493-b8a7-fce0f14e4a60 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:08.083131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8bb9-ca03-4493-b8a7-fce0f14e4a60 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/groups/6489185f34f44df699779f39c5c89fc2/users/adbab3d6a7e841008a870b747a802919` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:08.090955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f8bb9-ca03-4493-b8a7-fce0f14e4a60 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6489185f34f44df699779f39c5c89fc2, user_id=adbab3d6a7e841008a870b747a802919)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:08.093017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f8bb9-ca03-4493-b8a7-fce0f14e4a60 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:08.129751 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3144/6295] 10.222.0.16 () {60 vars in 1360 bytes} [Mon Aug 29 15:54:08 2022] PUT /identity/v3/groups/6489185f34f44df699779f39c5c89fc2/users/adbab3d6a7e841008a870b747a802919 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:08.135588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b5f2-1609-4cae-8a9f-ba79c0d6389c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:08.150774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b5f2-1609-4cae-8a9f-ba79c0d6389c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:08.212477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:08.276670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320b811-e72d-47da-ab68-1b550cb26570 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:08.277416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320b811-e72d-47da-ab68-1b550cb26570 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:08.278251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320b811-e72d-47da-ab68-1b550cb26570 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:08.278640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320b811-e72d-47da-ab68-1b550cb26570 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/ed8bf9f7cf8741f3a64a383ca5513b4a/groups/6489185f34f44df699779f39c5c89fc2/roles/ad65c19d068b4fc3b2f992ef834f6515` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:08.287531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320b811-e72d-47da-ab68-1b550cb26570 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ed8bf9f7cf8741f3a64a383ca5513b4a, group_id=6489185f34f44df699779f39c5c89fc2, role_id=ad65c19d068b4fc3b2f992ef834f6515)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:08.290304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320b811-e72d-47da-ab68-1b550cb26570 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:08.325046 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3152/6296] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:08 2022] PUT /identity/v3/domains/ed8bf9f7cf8741f3a64a383ca5513b4a/groups/6489185f34f44df699779f39c5c89fc2/roles/ad65c19d068b4fc3b2f992ef834f6515 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:08.330909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f8bb9-ca03-4493-b8a7-fce0f14e4a60 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:08.345673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f8bb9-ca03-4493-b8a7-fce0f14e4a60 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:08.466880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702260a-dfe4-4573-bbad-d7ed5a151498 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:08.468714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702260a-dfe4-4573-bbad-d7ed5a151498 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:08.469568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702260a-dfe4-4573-bbad-d7ed5a151498 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:08.470073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702260a-dfe4-4573-bbad-d7ed5a151498 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:08.473075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702260a-dfe4-4573-bbad-d7ed5a151498 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:08.482654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702260a-dfe4-4573-bbad-d7ed5a151498 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:08.511586 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3145/6297] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:54:08 2022] POST /identity/v3/domains => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:08.515650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320b811-e72d-47da-ab68-1b550cb26570 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:08.538799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320b811-e72d-47da-ab68-1b550cb26570 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:08.666856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2aa1c-adfa-4e5c-b265-a4c6786de360 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:08.667518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2aa1c-adfa-4e5c-b265-a4c6786de360 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:08.669963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2aa1c-adfa-4e5c-b265-a4c6786de360 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:08.670277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2aa1c-adfa-4e5c-b265-a4c6786de360 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:08.673590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2aa1c-adfa-4e5c-b265-a4c6786de360 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:08.675597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2aa1c-adfa-4e5c-b265-a4c6786de360 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:08.700441 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3153/6298] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:54:08 2022] POST /identity/v3/roles => generated 239 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:08.700661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702260a-dfe4-4573-bbad-d7ed5a151498 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:08.716511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702260a-dfe4-4573-bbad-d7ed5a151498 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:08.724217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadedd4-720b-4ace-be0b-b5a1616ab530 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:08.725186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadedd4-720b-4ace-be0b-b5a1616ab530 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:08.725926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadedd4-720b-4ace-be0b-b5a1616ab530 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:08.726377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadedd4-720b-4ace-be0b-b5a1616ab530 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/82db8300850545b39d8ef2dfb567cbd4/users/adbab3d6a7e841008a870b747a802919/roles/1ea8381767774a088c69113810d2fd2a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:08.751197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eadedd4-720b-4ace-be0b-b5a1616ab530 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=82db8300850545b39d8ef2dfb567cbd4, user_id=adbab3d6a7e841008a870b747a802919, role_id=1ea8381767774a088c69113810d2fd2a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:08.759466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eadedd4-720b-4ace-be0b-b5a1616ab530 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:08.795457 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3146/6299] 10.222.0.16 () {60 vars in 1480 bytes} [Mon Aug 29 15:54:08 2022] PUT /identity/v3/domains/82db8300850545b39d8ef2dfb567cbd4/users/adbab3d6a7e841008a870b747a802919/roles/1ea8381767774a088c69113810d2fd2a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:08.800081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2aa1c-adfa-4e5c-b265-a4c6786de360 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:08.818297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2aa1c-adfa-4e5c-b265-a4c6786de360 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:08.903722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970f569-6a83-4fc0-b2cf-51fe90d3b8fb tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:08.904405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f569-6a83-4fc0-b2cf-51fe90d3b8fb tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:08.904405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f569-6a83-4fc0-b2cf-51fe90d3b8fb tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:08.904607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f569-6a83-4fc0-b2cf-51fe90d3b8fb tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:08.905692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970f569-6a83-4fc0-b2cf-51fe90d3b8fb tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:08.908611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970f569-6a83-4fc0-b2cf-51fe90d3b8fb tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:08.935123 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3154/6300] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:54:08 2022] POST /identity/v3/domains => generated 276 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:08.938465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadedd4-720b-4ace-be0b-b5a1616ab530 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:08.951004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadedd4-720b-4ace-be0b-b5a1616ab530 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:08.988056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:09.031031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59322fc2-4f34-46da-9a3f-16b2557d5c5a tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:09.032083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322fc2-4f34-46da-9a3f-16b2557d5c5a tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:09.032365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322fc2-4f34-46da-9a3f-16b2557d5c5a tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:09.032644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322fc2-4f34-46da-9a3f-16b2557d5c5a tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:09.033328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59322fc2-4f34-46da-9a3f-16b2557d5c5a tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:09.034980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59322fc2-4f34-46da-9a3f-16b2557d5c5a tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:09.105872 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3147/6301] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:54:08 2022] POST /identity/v3/roles => generated 239 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:09.107462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970f569-6a83-4fc0-b2cf-51fe90d3b8fb tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:09.118026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970f569-6a83-4fc0-b2cf-51fe90d3b8fb tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:09.123461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caee6cf-af05-4b53-802e-450ad8405f6f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:09.124878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee6cf-af05-4b53-802e-450ad8405f6f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:09.124878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee6cf-af05-4b53-802e-450ad8405f6f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:09.124878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee6cf-af05-4b53-802e-450ad8405f6f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:09.125267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caee6cf-af05-4b53-802e-450ad8405f6f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:09.127486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caee6cf-af05-4b53-802e-450ad8405f6f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:09.165872 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3155/6302] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:54:09 2022] POST /identity/v3/groups => generated 327 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:09.176757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59322fc2-4f34-46da-9a3f-16b2557d5c5a tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:09.190592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59322fc2-4f34-46da-9a3f-16b2557d5c5a tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:09.197090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc58a7-789b-498e-abad-f4166fa9a8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:09.197809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc58a7-789b-498e-abad-f4166fa9a8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:09.198172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc58a7-789b-498e-abad-f4166fa9a8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:09.198460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc58a7-789b-498e-abad-f4166fa9a8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/groups/616f330af3dd4aa4ba28577637dbb748/users/adbab3d6a7e841008a870b747a802919` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:09.209329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc58a7-789b-498e-abad-f4166fa9a8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=616f330af3dd4aa4ba28577637dbb748, user_id=adbab3d6a7e841008a870b747a802919)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:09.211658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc58a7-789b-498e-abad-f4166fa9a8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:09.247820 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3148/6303] 10.222.0.16 () {60 vars in 1360 bytes} [Mon Aug 29 15:54:09 2022] PUT /identity/v3/groups/616f330af3dd4aa4ba28577637dbb748/users/adbab3d6a7e841008a870b747a802919 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:09.253019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caee6cf-af05-4b53-802e-450ad8405f6f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:09.283204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caee6cf-af05-4b53-802e-450ad8405f6f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:09.351171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:09.398206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1a76f-8e4e-45e8-b7f0-af847ca5385e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:09.403105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1a76f-8e4e-45e8-b7f0-af847ca5385e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:09.403425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1a76f-8e4e-45e8-b7f0-af847ca5385e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:09.403815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1a76f-8e4e-45e8-b7f0-af847ca5385e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/41c0c4e4fda342c0a98abce313e8d723/groups/616f330af3dd4aa4ba28577637dbb748/roles/2517dac1f7c54bfaad11bd29ef206418` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:09.408889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1a76f-8e4e-45e8-b7f0-af847ca5385e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=41c0c4e4fda342c0a98abce313e8d723, group_id=616f330af3dd4aa4ba28577637dbb748, role_id=2517dac1f7c54bfaad11bd29ef206418)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:09.412374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1a76f-8e4e-45e8-b7f0-af847ca5385e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:09.444371 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3156/6304] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:09 2022] PUT /identity/v3/domains/41c0c4e4fda342c0a98abce313e8d723/groups/616f330af3dd4aa4ba28577637dbb748/roles/2517dac1f7c54bfaad11bd29ef206418 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:09.450418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc58a7-789b-498e-abad-f4166fa9a8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:09.454398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c0dc58a7-789b-498e-abad-f4166fa9a8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:09.611859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc58a7-789b-498e-abad-f4166fa9a8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:09.769598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:09.788349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67409f5-5ecc-4564-8af0-efbb42fd8bfc tempest-TokensV3TestJSON-128821746 tempest-TokensV3TestJSON-128821746-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbab3d6a7e841008a870b747a802919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f87a0aed27c4e54b105d97ace68cf9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:09.789117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67409f5-5ecc-4564-8af0-efbb42fd8bfc tempest-TokensV3TestJSON-128821746 tempest-TokensV3TestJSON-128821746-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:09.789439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67409f5-5ecc-4564-8af0-efbb42fd8bfc tempest-TokensV3TestJSON-128821746 tempest-TokensV3TestJSON-128821746-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:09.789717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67409f5-5ecc-4564-8af0-efbb42fd8bfc tempest-TokensV3TestJSON-128821746 tempest-TokensV3TestJSON-128821746-project] PATH_INFO: `/v3/auth/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:09.790479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67409f5-5ecc-4564-8af0-efbb42fd8bfc tempest-TokensV3TestJSON-128821746 tempest-TokensV3TestJSON-128821746-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:09.791581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67409f5-5ecc-4564-8af0-efbb42fd8bfc tempest-TokensV3TestJSON-128821746 tempest-TokensV3TestJSON-128821746-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:09.922113 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3149/6305] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:54:09 2022] GET /identity/v3/auth/domains => generated 1168 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:09.926284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1a76f-8e4e-45e8-b7f0-af847ca5385e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:10.046568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1a76f-8e4e-45e8-b7f0-af847ca5385e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:10.052502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495e37-b9e0-46e8-82a5-c796add6451e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:10.053482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495e37-b9e0-46e8-82a5-c796add6451e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:10.053947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495e37-b9e0-46e8-82a5-c796add6451e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:10.054327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495e37-b9e0-46e8-82a5-c796add6451e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/41c0c4e4fda342c0a98abce313e8d723/groups/616f330af3dd4aa4ba28577637dbb748/roles/2517dac1f7c54bfaad11bd29ef206418` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:10.057746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f495e37-b9e0-46e8-82a5-c796add6451e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=41c0c4e4fda342c0a98abce313e8d723, group_id=616f330af3dd4aa4ba28577637dbb748, role_id=2517dac1f7c54bfaad11bd29ef206418)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:10.061103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f495e37-b9e0-46e8-82a5-c796add6451e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:10.072890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7f495e37-b9e0-46e8-82a5-c796add6451e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invalidating the token cache because role 2517dac1f7c54bfaad11bd29ef206418 was removed from group 616f330af3dd4aa4ba28577637dbb748 on domain 41c0c4e4fda342c0a98abce313e8d723. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:10.073497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7f495e37-b9e0-46e8-82a5-c796add6451e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.074422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7f495e37-b9e0-46e8-82a5-c796add6451e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.108199 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3157/6306] 10.222.0.16 () {58 vars in 1467 bytes} [Mon Aug 29 15:54:09 2022] DELETE /identity/v3/domains/41c0c4e4fda342c0a98abce313e8d723/groups/616f330af3dd4aa4ba28577637dbb748/roles/2517dac1f7c54bfaad11bd29ef206418 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:10.112992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67409f5-5ecc-4564-8af0-efbb42fd8bfc tempest-TokensV3TestJSON-128821746 tempest-TokensV3TestJSON-128821746-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:10.115095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a67409f5-5ecc-4564-8af0-efbb42fd8bfc tempest-TokensV3TestJSON-128821746 tempest-TokensV3TestJSON-128821746-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:10.144690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67409f5-5ecc-4564-8af0-efbb42fd8bfc tempest-TokensV3TestJSON-128821746 tempest-TokensV3TestJSON-128821746-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:10.285628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3faaab-c599-4f7e-854e-4eb19da698fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:10.286415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3faaab-c599-4f7e-854e-4eb19da698fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:10.286705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3faaab-c599-4f7e-854e-4eb19da698fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:10.286988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3faaab-c599-4f7e-854e-4eb19da698fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/groups/616f330af3dd4aa4ba28577637dbb748/users/adbab3d6a7e841008a870b747a802919` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:10.293698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3faaab-c599-4f7e-854e-4eb19da698fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=616f330af3dd4aa4ba28577637dbb748, user_id=adbab3d6a7e841008a870b747a802919)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:10.294655 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-2c3faaab-c599-4f7e-854e-4eb19da698fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:54:10.294655 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:54:10.294655 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:54:10.297147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3faaab-c599-4f7e-854e-4eb19da698fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:10.313842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c3faaab-c599-4f7e-854e-4eb19da698fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'adbab3d6a7e841008a870b747a802919'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.364192 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3150/6307] 10.222.0.16 () {58 vars in 1344 bytes} [Mon Aug 29 15:54:10 2022] DELETE /identity/v3/groups/616f330af3dd4aa4ba28577637dbb748/users/adbab3d6a7e841008a870b747a802919 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:10.368665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495e37-b9e0-46e8-82a5-c796add6451e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:10.382928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495e37-b9e0-46e8-82a5-c796add6451e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:10.543008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dbae7-c9d4-4201-9803-55c7506d304c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:10.543683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dbae7-c9d4-4201-9803-55c7506d304c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:10.543991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dbae7-c9d4-4201-9803-55c7506d304c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:10.544370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dbae7-c9d4-4201-9803-55c7506d304c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/groups/616f330af3dd4aa4ba28577637dbb748` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:10.553255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52dbae7-c9d4-4201-9803-55c7506d304c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_group(group_id=616f330af3dd4aa4ba28577637dbb748)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:10.558664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52dbae7-c9d4-4201-9803-55c7506d304c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:10.657732 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3158/6308] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:54:10 2022] DELETE /identity/v3/groups/616f330af3dd4aa4ba28577637dbb748 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:10.662618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3faaab-c599-4f7e-854e-4eb19da698fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:10.678840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3faaab-c599-4f7e-854e-4eb19da698fe tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:10.719822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dbae7-c9d4-4201-9803-55c7506d304c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:10.723091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c52dbae7-c9d4-4201-9803-55c7506d304c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:10.768787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:10.790156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:10.790787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:10.791274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:10.791735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/roles/2517dac1f7c54bfaad11bd29ef206418` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:10.794513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2517dac1f7c54bfaad11bd29ef206418)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:10.796486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:10.816995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:10.844801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dbae7-c9d4-4201-9803-55c7506d304c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:10.846913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invalidating the token cache because role 2517dac1f7c54bfaad11bd29ef206418 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:10.847211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.847921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.849942 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3151/6309] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:10 2022] DELETE /identity/v3/roles/2517dac1f7c54bfaad11bd29ef206418 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:10.854815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:10.855471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:10.855755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:10.856453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:10.856802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] PATH_INFO: `/v3/users/eaaf3b2473a141efbb1a2904ade04d34` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:10.857947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaaf3b2473a141efbb1a2904ade04d34)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:10.858992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:10.859907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:10.933643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaaf3b2473a141efbb1a2904ade04d34'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.935844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaaf3b2473a141efbb1a2904ade04d34'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.945244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f46716-f2a6-437c-8200-cee62c5c6bfa tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:10.951148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:10.951822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:10.952128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:10.952441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/41c0c4e4fda342c0a98abce313e8d723` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:10.953776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=41c0c4e4fda342c0a98abce313e8d723)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:10.954223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaaf3b2473a141efbb1a2904ade04d34'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.955078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaaf3b2473a141efbb1a2904ade04d34'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.956791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:10.966398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaaf3b2473a141efbb1a2904ade04d34'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.980603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.981884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:10.984970 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3159/6310] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:10 2022] DELETE /identity/v3/users/eaaf3b2473a141efbb1a2904ade04d34 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:11.016013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.016890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.020214 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3152/6311] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:10 2022] PATCH /identity/v3/domains/41c0c4e4fda342c0a98abce313e8d723 => generated 277 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:11.024684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:11.026647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:11.126164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5cb6f-8c96-44f3-9ee5-8b5049b8b486 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:11.132150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:11.132920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:11.133266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:11.133643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/41c0c4e4fda342c0a98abce313e8d723` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:11.158294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=41c0c4e4fda342c0a98abce313e8d723)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:11.160262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:11.202459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:11.208425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:11.214842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.250258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.254120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:11.323148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723', 'request_id': 'req-81920877-0709-4df7-a48d-f9a7f6a863c6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.331607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723', 'request_id': 'req-81920877-0709-4df7-a48d-f9a7f6a863c6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.340099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcb79b-b4b2-432d-8659-ce74c4bc0b49 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:11.343558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723', 'request_id': 'req-81920877-0709-4df7-a48d-f9a7f6a863c6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.372619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] The token cache is being invalidate because project 41c0c4e4fda342c0a98abce313e8d723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:11.372988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.373945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.397833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723', 'request_id': 'req-81920877-0709-4df7-a48d-f9a7f6a863c6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.398003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723', 'request_id': 'req-81920877-0709-4df7-a48d-f9a7f6a863c6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.404332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '41c0c4e4fda342c0a98abce313e8d723', 'request_id': 'req-81920877-0709-4df7-a48d-f9a7f6a863c6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.420862 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3160/6312] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:54:11 2022] DELETE /identity/v3/domains/41c0c4e4fda342c0a98abce313e8d723 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:11.428251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:11.430834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:11.452991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:11.453248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:11.454395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:11.454680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] PATH_INFO: `/v3/projects/2e9c174d274442a592b9306e146ff891` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:11.457858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9c174d274442a592b9306e146ff891)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:11.460792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:11.463950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:11.564406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81920877-0709-4df7-a48d-f9a7f6a863c6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:11.564591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9c174d274442a592b9306e146ff891', 'request_id': 'req-2047933a-5917-4c92-9886-a93edf656a58'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.587958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9c174d274442a592b9306e146ff891', 'request_id': 'req-2047933a-5917-4c92-9886-a93edf656a58'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.602046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9c174d274442a592b9306e146ff891', 'request_id': 'req-2047933a-5917-4c92-9886-a93edf656a58'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.631581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] The token cache is being invalidate because project 2e9c174d274442a592b9306e146ff891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:11.631886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.633702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2047933a-5917-4c92-9886-a93edf656a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.637941 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3153/6313] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:11 2022] DELETE /identity/v3/projects/2e9c174d274442a592b9306e146ff891 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:11.642728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1753a-c42b-406d-85d0-ad9e3224ff9e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:11.643015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1753a-c42b-406d-85d0-ad9e3224ff9e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:11.643293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1753a-c42b-406d-85d0-ad9e3224ff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:11.669987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7bd1753a-c42b-406d-85d0-ad9e3224ff9e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:11.671570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7bd1753a-c42b-406d-85d0-ad9e3224ff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:11.676301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:11.678216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:11.678566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:11.678852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/82db8300850545b39d8ef2dfb567cbd4/users/adbab3d6a7e841008a870b747a802919/roles/1ea8381767774a088c69113810d2fd2a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:11.686810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=82db8300850545b39d8ef2dfb567cbd4, user_id=adbab3d6a7e841008a870b747a802919, role_id=1ea8381767774a088c69113810d2fd2a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:11.689656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:11.696784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invalidating the token cache because role 1ea8381767774a088c69113810d2fd2a was removed from user adbab3d6a7e841008a870b747a802919 on domain 82db8300850545b39d8ef2dfb567cbd4. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:11.696784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.698257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.731398 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3161/6314] 10.222.0.16 () {58 vars in 1464 bytes} [Mon Aug 29 15:54:11 2022] DELETE /identity/v3/domains/82db8300850545b39d8ef2dfb567cbd4/users/adbab3d6a7e841008a870b747a802919/roles/1ea8381767774a088c69113810d2fd2a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:11.735760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:11.737289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:11.753272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:11.774510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3154/6315] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:11.776983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba47d01-e055-4d5d-84c7-8e20402ea376 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:11.778519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba47d01-e055-4d5d-84c7-8e20402ea376 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:11.779013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba47d01-e055-4d5d-84c7-8e20402ea376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:11.814203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0ba47d01-e055-4d5d-84c7-8e20402ea376 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:11.816289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0ba47d01-e055-4d5d-84c7-8e20402ea376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:11.835740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0baa4-94e6-4f2b-a359-979cff2e401c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:11.842263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:11.843782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:11.843782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:11.843782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/roles/1ea8381767774a088c69113810d2fd2a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:11.845867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1ea8381767774a088c69113810d2fd2a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:11.847980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:11.904014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invalidating the token cache because role 1ea8381767774a088c69113810d2fd2a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:11.904470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.906541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:11.910346 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3162/6316] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:11 2022] DELETE /identity/v3/roles/1ea8381767774a088c69113810d2fd2a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:11.914805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:11.917546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:11.948761 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3155/6317] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:11.953848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba47d01-e055-4d5d-84c7-8e20402ea376 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:11.967070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba47d01-e055-4d5d-84c7-8e20402ea376 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.011820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:12.034072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7b000-4a2b-41bb-8eeb-e412bb01d32f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.046444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.047126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.047439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.047746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/82db8300850545b39d8ef2dfb567cbd4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.049625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=82db8300850545b39d8ef2dfb567cbd4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.051584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.085707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dfc86-344a-4944-9736-3c16095c6ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.086697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dfc86-344a-4944-9736-3c16095c6ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.087117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dfc86-344a-4944-9736-3c16095c6ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.087588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dfc86-344a-4944-9736-3c16095c6ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.089313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dfc86-344a-4944-9736-3c16095c6ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:12.090023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dfc86-344a-4944-9736-3c16095c6ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.091570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.092184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dfc86-344a-4944-9736-3c16095c6ba7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.092332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.107135 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3156/6318] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:12.112610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dfc86-344a-4944-9736-3c16095c6ba7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.115233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d43dfc86-344a-4944-9736-3c16095c6ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:12.126421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.127716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.131320 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3163/6319] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:11 2022] PATCH /identity/v3/domains/82db8300850545b39d8ef2dfb567cbd4 => generated 276 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:12.134382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dfc86-344a-4944-9736-3c16095c6ba7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.135642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.138090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:12.240662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:12.272413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9289e8-f757-45e9-b71b-b5de8969743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.273068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9289e8-f757-45e9-b71b-b5de8969743b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.275978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9289e8-f757-45e9-b71b-b5de8969743b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.276750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9289e8-f757-45e9-b71b-b5de8969743b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.279516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9289e8-f757-45e9-b71b-b5de8969743b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.279678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0b63b-356a-454d-b203-66fdf273e0d3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.281979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9289e8-f757-45e9-b71b-b5de8969743b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.295300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.295554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.295850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.296994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/82db8300850545b39d8ef2dfb567cbd4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.323190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=82db8300850545b39d8ef2dfb567cbd4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.327748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.353718 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3157/6320] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:12 2022] POST /identity/v3/projects => generated 365 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:12.355413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9289e8-f757-45e9-b71b-b5de8969743b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.358279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0b9289e8-f757-45e9-b71b-b5de8969743b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:12.367517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.385902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.449256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9289e8-f757-45e9-b71b-b5de8969743b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.457930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4', 'request_id': 'req-6f62d3c1-aded-46a8-afdf-a55afa7b83df'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.467076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4', 'request_id': 'req-6f62d3c1-aded-46a8-afdf-a55afa7b83df'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.476944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4', 'request_id': 'req-6f62d3c1-aded-46a8-afdf-a55afa7b83df'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.491421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] The token cache is being invalidate because project 82db8300850545b39d8ef2dfb567cbd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:12.491722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.492665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.508991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4', 'request_id': 'req-6f62d3c1-aded-46a8-afdf-a55afa7b83df'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.511273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4', 'request_id': 'req-6f62d3c1-aded-46a8-afdf-a55afa7b83df'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.512357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '82db8300850545b39d8ef2dfb567cbd4', 'request_id': 'req-6f62d3c1-aded-46a8-afdf-a55afa7b83df'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.525284 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3164/6321] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:54:12 2022] DELETE /identity/v3/domains/82db8300850545b39d8ef2dfb567cbd4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:12.530333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.532104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:12.572600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:12.592120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276d3c4-30ab-46bc-83fe-147345d4c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.592676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d3c4-30ab-46bc-83fe-147345d4c2ef admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.592962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d3c4-30ab-46bc-83fe-147345d4c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.593242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d3c4-30ab-46bc-83fe-147345d4c2ef admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.597437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276d3c4-30ab-46bc-83fe-147345d4c2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.604064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276d3c4-30ab-46bc-83fe-147345d4c2ef admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.629106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62d3c1-aded-46a8-afdf-a55afa7b83df tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.635883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.636733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.637165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.637643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/ed8bf9f7cf8741f3a64a383ca5513b4a/groups/6489185f34f44df699779f39c5c89fc2/roles/ad65c19d068b4fc3b2f992ef834f6515` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.640122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ed8bf9f7cf8741f3a64a383ca5513b4a, group_id=6489185f34f44df699779f39c5c89fc2, role_id=ad65c19d068b4fc3b2f992ef834f6515)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.643190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.649399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invalidating the token cache because role ad65c19d068b4fc3b2f992ef834f6515 was removed from group 6489185f34f44df699779f39c5c89fc2 on domain ed8bf9f7cf8741f3a64a383ca5513b4a. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:12.649847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.650644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.651045 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3158/6322] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:12 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:12.655553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276d3c4-30ab-46bc-83fe-147345d4c2ef admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.657298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1276d3c4-30ab-46bc-83fe-147345d4c2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:12.671855 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3165/6323] 10.222.0.16 () {58 vars in 1467 bytes} [Mon Aug 29 15:54:12 2022] DELETE /identity/v3/domains/ed8bf9f7cf8741f3a64a383ca5513b4a/groups/6489185f34f44df699779f39c5c89fc2/roles/ad65c19d068b4fc3b2f992ef834f6515 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:12.672241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276d3c4-30ab-46bc-83fe-147345d4c2ef admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.675568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.676966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:12.688163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:12.745132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536665-b6fc-49e2-b9e6-8829346849d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.745790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536665-b6fc-49e2-b9e6-8829346849d7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.746074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536665-b6fc-49e2-b9e6-8829346849d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.746353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536665-b6fc-49e2-b9e6-8829346849d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.747213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536665-b6fc-49e2-b9e6-8829346849d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.748852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536665-b6fc-49e2-b9e6-8829346849d7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.756636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9e92-1770-4dff-b55a-18e9c3cff87d tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.761661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534df16-58c8-4565-9878-21b028c222bf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.762289 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3159/6324] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:12 2022] GET /identity/v3/roles => generated 1881 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:54:12.765522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534df16-58c8-4565-9878-21b028c222bf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.765816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534df16-58c8-4565-9878-21b028c222bf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.766018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536665-b6fc-49e2-b9e6-8829346849d7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.766128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534df16-58c8-4565-9878-21b028c222bf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/groups/6489185f34f44df699779f39c5c89fc2/users/adbab3d6a7e841008a870b747a802919` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.768004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534df16-58c8-4565-9878-21b028c222bf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6489185f34f44df699779f39c5c89fc2, user_id=adbab3d6a7e841008a870b747a802919)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.769991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534df16-58c8-4565-9878-21b028c222bf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.778915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536665-b6fc-49e2-b9e6-8829346849d7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.781282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6534df16-58c8-4565-9878-21b028c222bf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'adbab3d6a7e841008a870b747a802919'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:12.785985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eead55-d184-452f-bfef-d80efc5c0378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.786532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eead55-d184-452f-bfef-d80efc5c0378 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.786839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eead55-d184-452f-bfef-d80efc5c0378 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.787081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eead55-d184-452f-bfef-d80efc5c0378 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.787716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eead55-d184-452f-bfef-d80efc5c0378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.789349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eead55-d184-452f-bfef-d80efc5c0378 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.802122 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3166/6325] 10.222.0.16 () {58 vars in 1344 bytes} [Mon Aug 29 15:54:12 2022] DELETE /identity/v3/groups/6489185f34f44df699779f39c5c89fc2/users/adbab3d6a7e841008a870b747a802919 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:12.806569 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3160/6326] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:12 2022] GET /identity/v3/roles => generated 1881 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:54:12.807147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534df16-58c8-4565-9878-21b028c222bf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.807383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eead55-d184-452f-bfef-d80efc5c0378 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.818314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eead55-d184-452f-bfef-d80efc5c0378 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.887909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534df16-58c8-4565-9878-21b028c222bf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:12.889767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f827789-d596-4cd2-907d-0c24870af9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.890739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827789-d596-4cd2-907d-0c24870af9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.891562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827789-d596-4cd2-907d-0c24870af9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.892268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827789-d596-4cd2-907d-0c24870af9e3 admin admin] PATH_INFO: `/v3/projects/da746b18bda24573a98f42a731b9fd27/users/74602998065943c4a49a96d23ec0ce43/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.893442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b144-a7b7-46c0-ac8f-c018a63325a0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:12.894082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b144-a7b7-46c0-ac8f-c018a63325a0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.894371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b144-a7b7-46c0-ac8f-c018a63325a0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.894639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b144-a7b7-46c0-ac8f-c018a63325a0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/groups/6489185f34f44df699779f39c5c89fc2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.896026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9b144-a7b7-46c0-ac8f-c018a63325a0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6489185f34f44df699779f39c5c89fc2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.899003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9b144-a7b7-46c0-ac8f-c018a63325a0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.911150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f827789-d596-4cd2-907d-0c24870af9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da746b18bda24573a98f42a731b9fd27, user_id=74602998065943c4a49a96d23ec0ce43, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:12.914037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f827789-d596-4cd2-907d-0c24870af9e3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:12.934247 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3161/6327] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:12 2022] PUT /identity/v3/projects/da746b18bda24573a98f42a731b9fd27/users/74602998065943c4a49a96d23ec0ce43/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:12.939664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29489ba-60d5-40c8-b2d6-a0d61dc71416 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:12.940372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29489ba-60d5-40c8-b2d6-a0d61dc71416 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:12.940966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29489ba-60d5-40c8-b2d6-a0d61dc71416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:12.952683 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3167/6328] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:54:12 2022] DELETE /identity/v3/groups/6489185f34f44df699779f39c5c89fc2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:12.956533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b144-a7b7-46c0-ac8f-c018a63325a0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:12.985106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a29489ba-60d5-40c8-b2d6-a0d61dc71416 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:12.986687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a29489ba-60d5-40c8-b2d6-a0d61dc71416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:13.020696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:13.040459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b144-a7b7-46c0-ac8f-c018a63325a0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:13.054079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:13.054547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:13.054925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:13.055310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/roles/ad65c19d068b4fc3b2f992ef834f6515` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:13.058792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ad65c19d068b4fc3b2f992ef834f6515)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:13.060947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:13.077007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:13.096285 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3162/6329] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:13.106539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29489ba-60d5-40c8-b2d6-a0d61dc71416 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:13.108207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a29489ba-60d5-40c8-b2d6-a0d61dc71416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:13.127481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invalidating the token cache because role ad65c19d068b4fc3b2f992ef834f6515 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:13.127679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.129022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.132555 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3168/6330] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:12 2022] DELETE /identity/v3/roles/ad65c19d068b4fc3b2f992ef834f6515 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:13.136279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:13.138257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:13.177771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29489ba-60d5-40c8-b2d6-a0d61dc71416 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:13.221854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d529d0f-f016-4417-bf2e-964e17b45cda tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:13.228166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:13.228819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:13.229107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:13.229404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/ed8bf9f7cf8741f3a64a383ca5513b4a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:13.231410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ed8bf9f7cf8741f3a64a383ca5513b4a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:13.233368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:13.252952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62393802-9e4f-48aa-9afe-a6e065c3f488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:13.254072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62393802-9e4f-48aa-9afe-a6e065c3f488 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:13.255030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62393802-9e4f-48aa-9afe-a6e065c3f488 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:13.255643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62393802-9e4f-48aa-9afe-a6e065c3f488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:13.258345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.259086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.259730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-62393802-9e4f-48aa-9afe-a6e065c3f488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:13.296677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.297455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.303940 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3169/6331] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:13 2022] PATCH /identity/v3/domains/ed8bf9f7cf8741f3a64a383ca5513b4a => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:54:13.306582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:13.308397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:13.398122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62393802-9e4f-48aa-9afe-a6e065c3f488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:13.400260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62393802-9e4f-48aa-9afe-a6e065c3f488 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:13.415744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16331fbc-644e-4f2f-9cae-cb88600cb15e tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:13.424768 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3163/6332] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:54:13.432500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:13.433690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:13.434161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:13.434587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/ed8bf9f7cf8741f3a64a383ca5513b4a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:13.475167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ed8bf9f7cf8741f3a64a383ca5513b4a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:13.477739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:13.529452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:13.545054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.567871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.638924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a', 'request_id': 'req-502692cc-0936-4e15-ad0e-d69ef99bbe7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.652336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a', 'request_id': 'req-502692cc-0936-4e15-ad0e-d69ef99bbe7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.663728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a', 'request_id': 'req-502692cc-0936-4e15-ad0e-d69ef99bbe7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.685286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] The token cache is being invalidate because project ed8bf9f7cf8741f3a64a383ca5513b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:13.685684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.686620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.697071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a', 'request_id': 'req-502692cc-0936-4e15-ad0e-d69ef99bbe7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.697902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a', 'request_id': 'req-502692cc-0936-4e15-ad0e-d69ef99bbe7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.698526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ed8bf9f7cf8741f3a64a383ca5513b4a', 'request_id': 'req-502692cc-0936-4e15-ad0e-d69ef99bbe7c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.710286 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3170/6333] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:54:13 2022] DELETE /identity/v3/domains/ed8bf9f7cf8741f3a64a383ca5513b4a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:13.714620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62393802-9e4f-48aa-9afe-a6e065c3f488 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:13.730681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62393802-9e4f-48aa-9afe-a6e065c3f488 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:13.813443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:13.814125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:13.814409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:13.814684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/551db7932a994ca687dca4d0ae35c53a/users/adbab3d6a7e841008a870b747a802919/roles/88ba8dc4691940a0bc55b14fcf6a5cfc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:13.817341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=551db7932a994ca687dca4d0ae35c53a, user_id=adbab3d6a7e841008a870b747a802919, role_id=88ba8dc4691940a0bc55b14fcf6a5cfc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:13.819815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:13.824266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:13.830231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invalidating the token cache because role 88ba8dc4691940a0bc55b14fcf6a5cfc was removed from user adbab3d6a7e841008a870b747a802919 on domain 551db7932a994ca687dca4d0ae35c53a. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:13.830530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.831651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:13.849280 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3164/6334] 10.222.0.16 () {58 vars in 1464 bytes} [Mon Aug 29 15:54:13 2022] DELETE /identity/v3/domains/551db7932a994ca687dca4d0ae35c53a/users/adbab3d6a7e841008a870b747a802919/roles/88ba8dc4691940a0bc55b14fcf6a5cfc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:13.853325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:13.855255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:13.884664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502692cc-0936-4e15-ad0e-d69ef99bbe7c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:14.014131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:14.015275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:14.015573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:14.015885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/roles/88ba8dc4691940a0bc55b14fcf6a5cfc` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:14.019311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_role(role_id=88ba8dc4691940a0bc55b14fcf6a5cfc)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:14.021551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:14.066329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invalidating the token cache because role 88ba8dc4691940a0bc55b14fcf6a5cfc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:14.067030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.067518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.070150 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3171/6335] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:13 2022] DELETE /identity/v3/roles/88ba8dc4691940a0bc55b14fcf6a5cfc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:14.074257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:14.075770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:14.123076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ee55e-b565-4c9a-bc2e-1151aaa456cc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:14.217946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:14.219696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:14.221465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:14.221974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/551db7932a994ca687dca4d0ae35c53a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:14.223523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=551db7932a994ca687dca4d0ae35c53a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:14.225479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:14.267105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '551db7932a994ca687dca4d0ae35c53a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.269260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '551db7932a994ca687dca4d0ae35c53a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.341939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '551db7932a994ca687dca4d0ae35c53a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.344855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '551db7932a994ca687dca4d0ae35c53a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.350834 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3165/6336] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:14 2022] PATCH /identity/v3/domains/551db7932a994ca687dca4d0ae35c53a => generated 276 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:14.357670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:14.359121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:14.374675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deab578-1f52-4f86-b076-269d3180aec5 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:14.410779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:14.475495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:14.476298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:14.477195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:14.477195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/551db7932a994ca687dca4d0ae35c53a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:14.507731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=551db7932a994ca687dca4d0ae35c53a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:14.509586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:14.542552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '551db7932a994ca687dca4d0ae35c53a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.556237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '551db7932a994ca687dca4d0ae35c53a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.607776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '551db7932a994ca687dca4d0ae35c53a', 'request_id': 'req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.621652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '551db7932a994ca687dca4d0ae35c53a', 'request_id': 'req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.632274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '551db7932a994ca687dca4d0ae35c53a', 'request_id': 'req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.645737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] The token cache is being invalidate because project 551db7932a994ca687dca4d0ae35c53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:14.646225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.646999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.659997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '551db7932a994ca687dca4d0ae35c53a', 'request_id': 'req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.660457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '551db7932a994ca687dca4d0ae35c53a', 'request_id': 'req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.661089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '551db7932a994ca687dca4d0ae35c53a', 'request_id': 'req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:14.672017 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3172/6337] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:54:14 2022] DELETE /identity/v3/domains/551db7932a994ca687dca4d0ae35c53a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:14.677514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:14.678934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:14.696314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463d02f-d3b8-4fa7-aad6-4c7a5698b7d6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:14.776882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981f45e-69f6-48a3-87ae-ab0415edb8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:14.778488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981f45e-69f6-48a3-87ae-ab0415edb8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:14.779185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981f45e-69f6-48a3-87ae-ab0415edb8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:14.779672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981f45e-69f6-48a3-87ae-ab0415edb8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:14.782334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981f45e-69f6-48a3-87ae-ab0415edb8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:14.785753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981f45e-69f6-48a3-87ae-ab0415edb8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:14.803511 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3166/6338] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:14.807518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:14.809063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:14.826532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bac2e-c038-4498-8e56-3ef9881d0a1c tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:14.839443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7a99-cae5-4997-9cd9-bfc948105508 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:14.840252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7a99-cae5-4997-9cd9-bfc948105508 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:14.840538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7a99-cae5-4997-9cd9-bfc948105508 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:14.840811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7a99-cae5-4997-9cd9-bfc948105508 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/projects/654d20f989ed40269e465948258024a8/users/c78ebb9e20654852a43abfc530633f4e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:14.843137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7a99-cae5-4997-9cd9-bfc948105508 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_grant(project_id=654d20f989ed40269e465948258024a8, user_id=c78ebb9e20654852a43abfc530633f4e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:14.845821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7a99-cae5-4997-9cd9-bfc948105508 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:14.870507 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3173/6339] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:14 2022] PUT /identity/v3/projects/654d20f989ed40269e465948258024a8/users/c78ebb9e20654852a43abfc530633f4e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:14.875598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981f45e-69f6-48a3-87ae-ab0415edb8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:14.890217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981f45e-69f6-48a3-87ae-ab0415edb8ab tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:14.962989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:15.001216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725ac76-dc40-412d-b0c6-4f090d7c7c42 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:15.002068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ac76-dc40-412d-b0c6-4f090d7c7c42 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:15.002455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ac76-dc40-412d-b0c6-4f090d7c7c42 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:15.004901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ac76-dc40-412d-b0c6-4f090d7c7c42 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:15.005533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725ac76-dc40-412d-b0c6-4f090d7c7c42 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:15.006744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725ac76-dc40-412d-b0c6-4f090d7c7c42 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:15.098957 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3167/6340] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Aug 29 15:54:14 2022] GET /identity/v3/auth/projects => generated 826 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:15.102031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7a99-cae5-4997-9cd9-bfc948105508 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:15.129931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7a99-cae5-4997-9cd9-bfc948105508 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:15.139748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13a80-c4dd-4454-a1f9-8c0fc052b275 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:15.141364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13a80-c4dd-4454-a1f9-8c0fc052b275 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:15.141981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13a80-c4dd-4454-a1f9-8c0fc052b275 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:15.142719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13a80-c4dd-4454-a1f9-8c0fc052b275 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/projects/654d20f989ed40269e465948258024a8/users/c78ebb9e20654852a43abfc530633f4e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:15.146129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff13a80-c4dd-4454-a1f9-8c0fc052b275 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=654d20f989ed40269e465948258024a8, user_id=c78ebb9e20654852a43abfc530633f4e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:15.149537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff13a80-c4dd-4454-a1f9-8c0fc052b275 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:15.159091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ff13a80-c4dd-4454-a1f9-8c0fc052b275 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invalidating the token cache because role be89abac608f45a6921181bcc574f721 was removed from user c78ebb9e20654852a43abfc530633f4e on project 654d20f989ed40269e465948258024a8. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:15.159605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ff13a80-c4dd-4454-a1f9-8c0fc052b275 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:15.160802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1ff13a80-c4dd-4454-a1f9-8c0fc052b275 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:15.199406 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3174/6341] 10.222.0.16 () {58 vars in 1467 bytes} [Mon Aug 29 15:54:15 2022] DELETE /identity/v3/projects/654d20f989ed40269e465948258024a8/users/c78ebb9e20654852a43abfc530633f4e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:15.205633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725ac76-dc40-412d-b0c6-4f090d7c7c42 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:15.209347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8725ac76-dc40-412d-b0c6-4f090d7c7c42 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:15.227167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725ac76-dc40-412d-b0c6-4f090d7c7c42 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:15.326235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4258168-3d9e-4367-a6d9-d6da1d7a66bc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:15.327019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258168-3d9e-4367-a6d9-d6da1d7a66bc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:15.327315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258168-3d9e-4367-a6d9-d6da1d7a66bc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:15.327647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258168-3d9e-4367-a6d9-d6da1d7a66bc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:15.328331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4258168-3d9e-4367-a6d9-d6da1d7a66bc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:15.331053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4258168-3d9e-4367-a6d9-d6da1d7a66bc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:15.355000 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3168/6342] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:15 2022] POST /identity/v3/users => generated 321 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:15.359880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13a80-c4dd-4454-a1f9-8c0fc052b275 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:15.373833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13a80-c4dd-4454-a1f9-8c0fc052b275 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:15.380214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fc65e-e51e-45b3-a501-1f5d89aafcdc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:15.381076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fc65e-e51e-45b3-a501-1f5d89aafcdc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:15.381189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fc65e-e51e-45b3-a501-1f5d89aafcdc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:15.381520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fc65e-e51e-45b3-a501-1f5d89aafcdc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:15.382056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fc65e-e51e-45b3-a501-1f5d89aafcdc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:15.383959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fc65e-e51e-45b3-a501-1f5d89aafcdc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:15.420061 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3175/6343] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:15 2022] POST /identity/v3/projects => generated 362 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:15.424483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4258168-3d9e-4367-a6d9-d6da1d7a66bc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:15.437039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4258168-3d9e-4367-a6d9-d6da1d7a66bc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:15.522555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc89e1-cadc-4c90-9da1-8f7bb5ab96fd tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:15.523529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc89e1-cadc-4c90-9da1-8f7bb5ab96fd tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:15.524575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc89e1-cadc-4c90-9da1-8f7bb5ab96fd tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:15.525099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc89e1-cadc-4c90-9da1-8f7bb5ab96fd tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:15.528056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc89e1-cadc-4c90-9da1-8f7bb5ab96fd tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:15.535426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc89e1-cadc-4c90-9da1-8f7bb5ab96fd tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:15.580723 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3169/6344] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:15 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:15.583218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fc65e-e51e-45b3-a501-1f5d89aafcdc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:15.598522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fc65e-e51e-45b3-a501-1f5d89aafcdc tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:15.609578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:15.764834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821074e-b5f2-4bbc-a75f-45edb5cca9f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:15.769925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821074e-b5f2-4bbc-a75f-45edb5cca9f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:15.780054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821074e-b5f2-4bbc-a75f-45edb5cca9f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:15.780772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821074e-b5f2-4bbc-a75f-45edb5cca9f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:15.781723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821074e-b5f2-4bbc-a75f-45edb5cca9f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:15.793571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821074e-b5f2-4bbc-a75f-45edb5cca9f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:15.823300 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3176/6345] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:54:15 2022] POST /identity/v3/roles => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:15.828435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc89e1-cadc-4c90-9da1-8f7bb5ab96fd tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:15.844082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc89e1-cadc-4c90-9da1-8f7bb5ab96fd tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:15.857563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bd8ac-5f7e-4e43-8090-084585e401f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:15.858221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bd8ac-5f7e-4e43-8090-084585e401f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:15.858509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bd8ac-5f7e-4e43-8090-084585e401f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:15.858808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bd8ac-5f7e-4e43-8090-084585e401f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/projects/a2d53721e86b48ce9264f997a6bf89c3/users/1f8238943e2b4b51997abc2c5b33c18d/roles/55290a2bec8d49e8977dff7da4f9a74e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:15.904841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bd8ac-5f7e-4e43-8090-084585e401f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a2d53721e86b48ce9264f997a6bf89c3, user_id=1f8238943e2b4b51997abc2c5b33c18d, role_id=55290a2bec8d49e8977dff7da4f9a74e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:15.907595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bd8ac-5f7e-4e43-8090-084585e401f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:15.937929 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3170/6346] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:15 2022] PUT /identity/v3/projects/a2d53721e86b48ce9264f997a6bf89c3/users/1f8238943e2b4b51997abc2c5b33c18d/roles/55290a2bec8d49e8977dff7da4f9a74e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:15.939119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821074e-b5f2-4bbc-a75f-45edb5cca9f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:15.952506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821074e-b5f2-4bbc-a75f-45edb5cca9f4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:16.099833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcc03a-317a-48c7-ac0d-d5f14b7695b0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:16.100764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc03a-317a-48c7-ac0d-d5f14b7695b0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:16.101461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc03a-317a-48c7-ac0d-d5f14b7695b0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:16.101461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc03a-317a-48c7-ac0d-d5f14b7695b0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/projects/f2a5fa9b7a3f4eafa089c1fd7fe13920/users/1f8238943e2b4b51997abc2c5b33c18d/roles/55290a2bec8d49e8977dff7da4f9a74e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:16.103813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcc03a-317a-48c7-ac0d-d5f14b7695b0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f2a5fa9b7a3f4eafa089c1fd7fe13920, user_id=1f8238943e2b4b51997abc2c5b33c18d, role_id=55290a2bec8d49e8977dff7da4f9a74e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:16.107112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcc03a-317a-48c7-ac0d-d5f14b7695b0 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:16.136148 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3177/6347] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:15 2022] PUT /identity/v3/projects/f2a5fa9b7a3f4eafa089c1fd7fe13920/users/1f8238943e2b4b51997abc2c5b33c18d/roles/55290a2bec8d49e8977dff7da4f9a74e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:16.138522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad79e-e638-46fe-adb5-7efdf4cd3436 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:16.138794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad79e-e638-46fe-adb5-7efdf4cd3436 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:16.139084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad79e-e638-46fe-adb5-7efdf4cd3436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:16.149570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:16.200659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-359ad79e-e638-46fe-adb5-7efdf4cd3436 None None] MFA Rules not processed for user `1f8238943e2b4b51997abc2c5b33c18d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:16.202073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-359ad79e-e638-46fe-adb5-7efdf4cd3436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:16.205371 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3171/6348] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:16 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:54:16.211671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b9dab-a69d-4c90-ac9a-3be28eabd9ae None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:16.212694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b9dab-a69d-4c90-ac9a-3be28eabd9ae None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:16.212694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b9dab-a69d-4c90-ac9a-3be28eabd9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:16.230525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-022b9dab-a69d-4c90-ac9a-3be28eabd9ae None None] MFA Rules not processed for user `1f8238943e2b4b51997abc2c5b33c18d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:16.232243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-022b9dab-a69d-4c90-ac9a-3be28eabd9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:16.375706 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3178/6349] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:16 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 29 15:54:16.380938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad79e-e638-46fe-adb5-7efdf4cd3436 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:16.580518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad79e-e638-46fe-adb5-7efdf4cd3436 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:16.589535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ad2fc-b002-4d9b-a272-1b46698f6352 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:16.591074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad2fc-b002-4d9b-a272-1b46698f6352 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:16.591307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad2fc-b002-4d9b-a272-1b46698f6352 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:16.591509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad2fc-b002-4d9b-a272-1b46698f6352 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:16.603113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ad2fc-b002-4d9b-a272-1b46698f6352 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:16.605622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ad2fc-b002-4d9b-a272-1b46698f6352 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:16.641586 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3172/6350] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Aug 29 15:54:16 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:16.645747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb0a8-79e2-4817-8bd0-090b198f0df3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:16.646170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb0a8-79e2-4817-8bd0-090b198f0df3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:16.647005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb0a8-79e2-4817-8bd0-090b198f0df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:16.664881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-17dcb0a8-79e2-4817-8bd0-090b198f0df3 None None] MFA Rules not processed for user `1f8238943e2b4b51997abc2c5b33c18d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:16.666290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-17dcb0a8-79e2-4817-8bd0-090b198f0df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:16.768049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:16.827417 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3179/6351] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:16 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Aug 29 15:54:16.827663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ad2fc-b002-4d9b-a272-1b46698f6352 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:16.839606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ad2fc-b002-4d9b-a272-1b46698f6352 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:16.845275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:16.846263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:16.846698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:16.847134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/roles/55290a2bec8d49e8977dff7da4f9a74e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:16.848857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_role(role_id=55290a2bec8d49e8977dff7da4f9a74e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:16.850933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:16.920903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invalidating the token cache because role 55290a2bec8d49e8977dff7da4f9a74e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:16.921834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:16.922222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:16.925598 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3173/6352] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:16 2022] DELETE /identity/v3/roles/55290a2bec8d49e8977dff7da4f9a74e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:16.930150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcb0a8-79e2-4817-8bd0-090b198f0df3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:16.954780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcb0a8-79e2-4817-8bd0-090b198f0df3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:17.148603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:17.149636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:17.149925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:17.150324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/projects/f2a5fa9b7a3f4eafa089c1fd7fe13920` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:17.153906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f2a5fa9b7a3f4eafa089c1fd7fe13920)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:17.155729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:17.281205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a5fa9b7a3f4eafa089c1fd7fe13920', 'request_id': 'req-02098156-2552-4fb3-bc8b-e640d2d071b1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:17.292145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a5fa9b7a3f4eafa089c1fd7fe13920', 'request_id': 'req-02098156-2552-4fb3-bc8b-e640d2d071b1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:17.302287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a5fa9b7a3f4eafa089c1fd7fe13920', 'request_id': 'req-02098156-2552-4fb3-bc8b-e640d2d071b1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:17.326273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] The token cache is being invalidate because project f2a5fa9b7a3f4eafa089c1fd7fe13920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:17.326723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:17.327510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:17.330238 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3180/6353] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:16 2022] DELETE /identity/v3/projects/f2a5fa9b7a3f4eafa089c1fd7fe13920 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:17.333543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:17.335855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:17.354129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f163fa-679f-411c-a45e-a26756fca5cf tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:17.449224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dce3b-1d48-4ef1-97ee-4381423d668f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:17.450693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dce3b-1d48-4ef1-97ee-4381423d668f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:17.451015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dce3b-1d48-4ef1-97ee-4381423d668f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:17.451329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dce3b-1d48-4ef1-97ee-4381423d668f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/projects/f2a5fa9b7a3f4eafa089c1fd7fe13920` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:17.462847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dce3b-1d48-4ef1-97ee-4381423d668f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f2a5fa9b7a3f4eafa089c1fd7fe13920)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:17.465666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dce3b-1d48-4ef1-97ee-4381423d668f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-2a4dce3b-1d48-4ef1-97ee-4381423d668f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Could not find project: f2a5fa9b7a3f4eafa089c1fd7fe13920.: keystone.exception.ProjectNotFound: Could not find project: f2a5fa9b7a3f4eafa089c1fd7fe13920. Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 29 15:54:17.481208 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 29 15:54:17.482249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:17.482249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:17.482249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 29 15:54:17.482249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 29 15:54:17.482249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:54:17.482249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:54:17.482249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:54:17.482249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:54:17.482249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f2a5fa9b7a3f4eafa089c1fd7fe13920. Aug 29 15:54:17.482249 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:17.486189 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3174/6354] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:17 2022] DELETE /identity/v3/projects/f2a5fa9b7a3f4eafa089c1fd7fe13920 => generated 113 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:54:17.487011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:17.488771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:17.510936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02098156-2552-4fb3-bc8b-e640d2d071b1 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:17.520255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:17.521165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:17.521626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:17.522126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/projects/a2d53721e86b48ce9264f997a6bf89c3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:17.523545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2d53721e86b48ce9264f997a6bf89c3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:17.526351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:17.642670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d53721e86b48ce9264f997a6bf89c3', 'request_id': 'req-2ef0cecc-74db-40bb-931f-f252fe49bbc4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:17.654391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d53721e86b48ce9264f997a6bf89c3', 'request_id': 'req-2ef0cecc-74db-40bb-931f-f252fe49bbc4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:17.678449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d53721e86b48ce9264f997a6bf89c3', 'request_id': 'req-2ef0cecc-74db-40bb-931f-f252fe49bbc4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:17.691842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:17.698688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] The token cache is being invalidate because project a2d53721e86b48ce9264f997a6bf89c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:17.699713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:17.700700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:17.705180 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3181/6355] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:17 2022] DELETE /identity/v3/projects/a2d53721e86b48ce9264f997a6bf89c3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:17.709163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dce3b-1d48-4ef1-97ee-4381423d668f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:17.711997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2a4dce3b-1d48-4ef1-97ee-4381423d668f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:17.730606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dce3b-1d48-4ef1-97ee-4381423d668f tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:17.792938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:17.897954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:17.900702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:17.901167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:17.901631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/users/1f8238943e2b4b51997abc2c5b33c18d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:17.904820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1f8238943e2b4b51997abc2c5b33c18d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:17.907173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:17.995164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8238943e2b4b51997abc2c5b33c18d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:17.996128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8238943e2b4b51997abc2c5b33c18d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.010638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8238943e2b4b51997abc2c5b33c18d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.032073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8238943e2b4b51997abc2c5b33c18d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.045495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8238943e2b4b51997abc2c5b33c18d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.053819 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3175/6356] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:17 2022] DELETE /identity/v3/users/1f8238943e2b4b51997abc2c5b33c18d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:18.060264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:18.079414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0cecc-74db-40bb-931f-f252fe49bbc4 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:18.203509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a4741-007c-4cbc-b6ad-6fa55489d209 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:18.204385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a4741-007c-4cbc-b6ad-6fa55489d209 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:18.204673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a4741-007c-4cbc-b6ad-6fa55489d209 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:18.204947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a4741-007c-4cbc-b6ad-6fa55489d209 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/41c0c4e4fda342c0a98abce313e8d723` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:18.219547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a4741-007c-4cbc-b6ad-6fa55489d209 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-0d6a4741-007c-4cbc-b6ad-6fa55489d209 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Could not find domain: 41c0c4e4fda342c0a98abce313e8d723.: keystone.exception.DomainNotFound: Could not find domain: 41c0c4e4fda342c0a98abce313e8d723. Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 41c0c4e4fda342c0a98abce313e8d723. Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:18.225912 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:18.226983 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 41c0c4e4fda342c0a98abce313e8d723. Aug 29 15:54:18.227982 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:18.232091 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3182/6357] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:18 2022] PATCH /identity/v3/domains/41c0c4e4fda342c0a98abce313e8d723 => generated 112 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:54:18.236319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:18.237896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:18.263194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b62c45-4a4d-4f1f-99d6-60b66f11e187 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:18.271086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a28ca0-3af2-47ea-ab7c-8a1a521344f6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:18.272100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28ca0-3af2-47ea-ab7c-8a1a521344f6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:18.272388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28ca0-3af2-47ea-ab7c-8a1a521344f6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:18.272670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28ca0-3af2-47ea-ab7c-8a1a521344f6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/82db8300850545b39d8ef2dfb567cbd4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:18.281039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a28ca0-3af2-47ea-ab7c-8a1a521344f6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-83a28ca0-3af2-47ea-ab7c-8a1a521344f6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Could not find domain: 82db8300850545b39d8ef2dfb567cbd4.: keystone.exception.DomainNotFound: Could not find domain: 82db8300850545b39d8ef2dfb567cbd4. Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 82db8300850545b39d8ef2dfb567cbd4. Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:18.290332 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:18.291274 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 82db8300850545b39d8ef2dfb567cbd4. Aug 29 15:54:18.293970 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:18.299044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a4741-007c-4cbc-b6ad-6fa55489d209 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:18.307911 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3176/6358] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:18 2022] PATCH /identity/v3/domains/82db8300850545b39d8ef2dfb567cbd4 => generated 112 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:54:18.315656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a4741-007c-4cbc-b6ad-6fa55489d209 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:18.320769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47082c-4294-4e28-8d0f-1a90c310f4f3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:18.323927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47082c-4294-4e28-8d0f-1a90c310f4f3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:18.324217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47082c-4294-4e28-8d0f-1a90c310f4f3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:18.324548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47082c-4294-4e28-8d0f-1a90c310f4f3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/ed8bf9f7cf8741f3a64a383ca5513b4a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:18.342121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47082c-4294-4e28-8d0f-1a90c310f4f3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-bc47082c-4294-4e28-8d0f-1a90c310f4f3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Could not find domain: ed8bf9f7cf8741f3a64a383ca5513b4a.: keystone.exception.DomainNotFound: Could not find domain: ed8bf9f7cf8741f3a64a383ca5513b4a. Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ed8bf9f7cf8741f3a64a383ca5513b4a. Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:18.353817 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:18.354877 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ed8bf9f7cf8741f3a64a383ca5513b4a. Aug 29 15:54:18.357275 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:18.366659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a28ca0-3af2-47ea-ab7c-8a1a521344f6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:18.367761 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3183/6359] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:18 2022] PATCH /identity/v3/domains/ed8bf9f7cf8741f3a64a383ca5513b4a => generated 112 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:54:18.391571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a28ca0-3af2-47ea-ab7c-8a1a521344f6 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:18.398811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f939759-537c-46a4-be12-118ef62d9e39 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78ebb9e20654852a43abfc530633f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '431138ed680a49adb2cf53f3cb84286e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:18.400550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f939759-537c-46a4-be12-118ef62d9e39 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:18.401437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f939759-537c-46a4-be12-118ef62d9e39 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:18.401874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f939759-537c-46a4-be12-118ef62d9e39 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] PATH_INFO: `/v3/domains/551db7932a994ca687dca4d0ae35c53a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:18.412445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f939759-537c-46a4-be12-118ef62d9e39 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-1f939759-537c-46a4-be12-118ef62d9e39 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Could not find domain: 551db7932a994ca687dca4d0ae35c53a.: keystone.exception.DomainNotFound: Could not find domain: 551db7932a994ca687dca4d0ae35c53a. Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 551db7932a994ca687dca4d0ae35c53a. Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:18.421179 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:18.422213 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 551db7932a994ca687dca4d0ae35c53a. Aug 29 15:54:18.423126 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:18.425994 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3177/6360] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:18 2022] PATCH /identity/v3/domains/551db7932a994ca687dca4d0ae35c53a => generated 112 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 15:54:18.430416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47082c-4294-4e28-8d0f-1a90c310f4f3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:18.432604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bc47082c-4294-4e28-8d0f-1a90c310f4f3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:18.597437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47082c-4294-4e28-8d0f-1a90c310f4f3 tempest-TokensV3TestJSON-1548136441 tempest-TokensV3TestJSON-1548136441-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:18.608863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:18.609902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:18.610329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:18.611939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] PATH_INFO: `/v3/users/a5a60ef5d440466a8384a32ae719b6b4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:18.613255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a60ef5d440466a8384a32ae719b6b4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:18.619190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:18.717615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a60ef5d440466a8384a32ae719b6b4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.718433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a60ef5d440466a8384a32ae719b6b4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.736558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a60ef5d440466a8384a32ae719b6b4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.737334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a60ef5d440466a8384a32ae719b6b4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.743675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:18.747377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a60ef5d440466a8384a32ae719b6b4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:18.766558 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3184/6361] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:18 2022] DELETE /identity/v3/users/a5a60ef5d440466a8384a32ae719b6b4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:18.771709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95142f-cb56-41d8-bc42-537b7c389609 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:18.772006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95142f-cb56-41d8-bc42-537b7c389609 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:18.772291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95142f-cb56-41d8-bc42-537b7c389609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:18.800325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fc95142f-cb56-41d8-bc42-537b7c389609 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:18.802275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fc95142f-cb56-41d8-bc42-537b7c389609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:18.909673 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3178/6362] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:18.960313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:18.962162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:19.090504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8071-5059-4c5d-8d3c-c465e54da186 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:19.096818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39370471-a342-4622-8774-8fac0a6644b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:19.097698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370471-a342-4622-8774-8fac0a6644b1 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:19.098087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370471-a342-4622-8774-8fac0a6644b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:19.098512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370471-a342-4622-8774-8fac0a6644b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:19.115797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39370471-a342-4622-8774-8fac0a6644b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:19.118089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39370471-a342-4622-8774-8fac0a6644b1 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:19.136680 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3185/6363] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:54:19.846738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95142f-cb56-41d8-bc42-537b7c389609 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:19.849008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fc95142f-cb56-41d8-bc42-537b7c389609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:19.868731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95142f-cb56-41d8-bc42-537b7c389609 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:19.876312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:19.877896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:19.878182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:19.878588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] PATH_INFO: `/v3/projects/654d20f989ed40269e465948258024a8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:19.880528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=654d20f989ed40269e465948258024a8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:19.884064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:19.985765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:20.026021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654d20f989ed40269e465948258024a8', 'request_id': 'req-f48ba5c3-2376-4360-ab49-57606366b349'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:20.043310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654d20f989ed40269e465948258024a8', 'request_id': 'req-f48ba5c3-2376-4360-ab49-57606366b349'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:20.071492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654d20f989ed40269e465948258024a8', 'request_id': 'req-f48ba5c3-2376-4360-ab49-57606366b349'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:20.100165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] The token cache is being invalidate because project 654d20f989ed40269e465948258024a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:20.100548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:20.101983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:20.108200 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3179/6364] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:19 2022] DELETE /identity/v3/projects/654d20f989ed40269e465948258024a8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:20.108990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39370471-a342-4622-8774-8fac0a6644b1 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:20.126077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39370471-a342-4622-8774-8fac0a6644b1 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:20.285129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:20.286007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:20.286571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:20.286958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] PATH_INFO: `/v3/users/c78ebb9e20654852a43abfc530633f4e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:20.288454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78ebb9e20654852a43abfc530633f4e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:20.291671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:20.444418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78ebb9e20654852a43abfc530633f4e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:20.445352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78ebb9e20654852a43abfc530633f4e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:20.471610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78ebb9e20654852a43abfc530633f4e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:20.472511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78ebb9e20654852a43abfc530633f4e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:20.482943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78ebb9e20654852a43abfc530633f4e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:20.507256 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3186/6365] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:20 2022] DELETE /identity/v3/users/c78ebb9e20654852a43abfc530633f4e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:21.256320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:21.257849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:21.282278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba5c3-2376-4360-ab49-57606366b349 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:21.392376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:21.393041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:21.393325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:21.393632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] PATH_INFO: `/v3/projects/431138ed680a49adb2cf53f3cb84286e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:21.394813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431138ed680a49adb2cf53f3cb84286e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:21.397755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:21.518324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431138ed680a49adb2cf53f3cb84286e', 'request_id': 'req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:21.539208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431138ed680a49adb2cf53f3cb84286e', 'request_id': 'req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:21.558370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431138ed680a49adb2cf53f3cb84286e', 'request_id': 'req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:21.586918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] The token cache is being invalidate because project 431138ed680a49adb2cf53f3cb84286e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:21.587210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:21.589898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:21.592308 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3180/6366] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:21 2022] DELETE /identity/v3/projects/431138ed680a49adb2cf53f3cb84286e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:21.597792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:21.599966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:21.619957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2184bc5-2a43-46b6-bc84-21371703c5c6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:21.636742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:21.773342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6a5d5-88b5-431d-99f8-d3aa8a71a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:21.774336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6a5d5-88b5-431d-99f8-d3aa8a71a40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:21.774788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6a5d5-88b5-431d-99f8-d3aa8a71a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:21.775220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6a5d5-88b5-431d-99f8-d3aa8a71a40a admin admin] PATH_INFO: `/v3/users/adbab3d6a7e841008a870b747a802919` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:21.778006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6a5d5-88b5-431d-99f8-d3aa8a71a40a admin admin] RBAC: Authorizing `identity:delete_user(user_id=adbab3d6a7e841008a870b747a802919)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:21.780295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6a5d5-88b5-431d-99f8-d3aa8a71a40a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:21.901594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-00a6a5d5-88b5-431d-99f8-d3aa8a71a40a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adbab3d6a7e841008a870b747a802919'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:21.903595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-00a6a5d5-88b5-431d-99f8-d3aa8a71a40a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adbab3d6a7e841008a870b747a802919'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:21.955339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-00a6a5d5-88b5-431d-99f8-d3aa8a71a40a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adbab3d6a7e841008a870b747a802919'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:21.956695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-00a6a5d5-88b5-431d-99f8-d3aa8a71a40a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adbab3d6a7e841008a870b747a802919'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:21.967431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-00a6a5d5-88b5-431d-99f8-d3aa8a71a40a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adbab3d6a7e841008a870b747a802919'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:22.001998 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3187/6367] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:21 2022] DELETE /identity/v3/users/adbab3d6a7e841008a870b747a802919 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:23.148592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:23.161360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:23.180759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce6eb1-4010-4593-84e8-fb1e00e2e3c3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:23.329359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:23.358774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:23.360725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:23.361078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:23.361831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] PATH_INFO: `/v3/projects/8f87a0aed27c4e54b105d97ace68cf9a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:23.363720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f87a0aed27c4e54b105d97ace68cf9a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:23.368460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:23.517897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f87a0aed27c4e54b105d97ace68cf9a', 'request_id': 'req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:23.537711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f87a0aed27c4e54b105d97ace68cf9a', 'request_id': 'req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:23.569797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f87a0aed27c4e54b105d97ace68cf9a', 'request_id': 'req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:23.633706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] The token cache is being invalidate because project 8f87a0aed27c4e54b105d97ace68cf9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:23.634049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:23.636946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c723dc6-0179-4faf-8c6a-e596f6c0f9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:23.645286 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3181/6368] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:23 2022] DELETE /identity/v3/projects/8f87a0aed27c4e54b105d97ace68cf9a => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:23.647246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982c77-a6ec-473d-9f8c-4b3275009470 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:23.647703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982c77-a6ec-473d-9f8c-4b3275009470 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:23.647786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982c77-a6ec-473d-9f8c-4b3275009470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:23.761263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b9982c77-a6ec-473d-9f8c-4b3275009470 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:23.762793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b9982c77-a6ec-473d-9f8c-4b3275009470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:23.908139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:23.943846 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3188/6369] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:23.951095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68b4e-74de-46a7-9e4d-abe873a60a2e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:23.951377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68b4e-74de-46a7-9e4d-abe873a60a2e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:23.951652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68b4e-74de-46a7-9e4d-abe873a60a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:23.985333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-aff68b4e-74de-46a7-9e4d-abe873a60a2e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:23.986630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aff68b4e-74de-46a7-9e4d-abe873a60a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:24.025607 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3182/6370] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:24.030017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9982c77-a6ec-473d-9f8c-4b3275009470 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.053693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9982c77-a6ec-473d-9f8c-4b3275009470 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.065568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b0b44-d37c-42ab-b0c6-4d6477ce1943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.066723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0b44-d37c-42ab-b0c6-4d6477ce1943 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.067148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0b44-d37c-42ab-b0c6-4d6477ce1943 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.067582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0b44-d37c-42ab-b0c6-4d6477ce1943 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.068469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b0b44-d37c-42ab-b0c6-4d6477ce1943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:24.068964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b0b44-d37c-42ab-b0c6-4d6477ce1943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.071067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b0b44-d37c-42ab-b0c6-4d6477ce1943 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.093191 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3189/6371] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:24.094420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff68b4e-74de-46a7-9e4d-abe873a60a2e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.106542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff68b4e-74de-46a7-9e4d-abe873a60a2e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.112484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d6800-220e-4cb3-bfbc-a14e3f94ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.113105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6800-220e-4cb3-bfbc-a14e3f94ed06 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.113403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6800-220e-4cb3-bfbc-a14e3f94ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.113675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d6800-220e-4cb3-bfbc-a14e3f94ed06 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.114725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d6800-220e-4cb3-bfbc-a14e3f94ed06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.123312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d6800-220e-4cb3-bfbc-a14e3f94ed06 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.216250 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3183/6372] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:24 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:24.216780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b0b44-d37c-42ab-b0c6-4d6477ce1943 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.232739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b0b44-d37c-42ab-b0c6-4d6477ce1943 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.380577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1cf3-8250-4296-a0f8-0cd489094409 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.383267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1cf3-8250-4296-a0f8-0cd489094409 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.383606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1cf3-8250-4296-a0f8-0cd489094409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.394867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7451f-a0fc-4765-a3b7-cc5909301867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.395616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7451f-a0fc-4765-a3b7-cc5909301867 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.396000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7451f-a0fc-4765-a3b7-cc5909301867 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.396400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7451f-a0fc-4765-a3b7-cc5909301867 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.397232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7451f-a0fc-4765-a3b7-cc5909301867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.399684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7451f-a0fc-4765-a3b7-cc5909301867 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.433136 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3190/6373] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:24 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:24.436082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7451f-a0fc-4765-a3b7-cc5909301867 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.450223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7451f-a0fc-4765-a3b7-cc5909301867 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.456416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051b7e9-3635-4809-8c4f-ace50be087af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.457268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051b7e9-3635-4809-8c4f-ace50be087af admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.457680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051b7e9-3635-4809-8c4f-ace50be087af admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.458073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d1dc1cf3-8250-4296-a0f8-0cd489094409 None None] MFA Rules not processed for user `74602998065943c4a49a96d23ec0ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:24.458300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051b7e9-3635-4809-8c4f-ace50be087af admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.459224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051b7e9-3635-4809-8c4f-ace50be087af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.459889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d1dc1cf3-8250-4296-a0f8-0cd489094409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:24.462006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051b7e9-3635-4809-8c4f-ace50be087af admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.484291 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3191/6374] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:24.488449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051b7e9-3635-4809-8c4f-ace50be087af admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.517379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051b7e9-3635-4809-8c4f-ace50be087af admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.529844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e2bc8-11f7-403e-82fe-2cf273847ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.530476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e2bc8-11f7-403e-82fe-2cf273847ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.530757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e2bc8-11f7-403e-82fe-2cf273847ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.531033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e2bc8-11f7-403e-82fe-2cf273847ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.531685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e2bc8-11f7-403e-82fe-2cf273847ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.542363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e2bc8-11f7-403e-82fe-2cf273847ab5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.573776 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3192/6375] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:24.575303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e2bc8-11f7-403e-82fe-2cf273847ab5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.599089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e2bc8-11f7-403e-82fe-2cf273847ab5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:24.620998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae2b11-b871-4b67-ae83-fab57ab1a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:24.621931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae2b11-b871-4b67-ae83-fab57ab1a479 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.622219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae2b11-b871-4b67-ae83-fab57ab1a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.622496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae2b11-b871-4b67-ae83-fab57ab1a479 admin admin] PATH_INFO: `/v3/projects/f3ce8bfe7c344c40ac23935f7717bfa1/users/4c10480206a947be883388a11fa0ab13/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.658537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae2b11-b871-4b67-ae83-fab57ab1a479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ce8bfe7c344c40ac23935f7717bfa1, user_id=4c10480206a947be883388a11fa0ab13, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:24.661436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae2b11-b871-4b67-ae83-fab57ab1a479 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:24.676074 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3184/6376] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:24.691459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872dfa0-a292-49f3-9b2d-93c48c378feb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.693502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872dfa0-a292-49f3-9b2d-93c48c378feb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.693876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872dfa0-a292-49f3-9b2d-93c48c378feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.703958 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3193/6377] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:24 2022] PUT /identity/v3/projects/f3ce8bfe7c344c40ac23935f7717bfa1/users/4c10480206a947be883388a11fa0ab13/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:24.715070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae4bfb-b365-4fc8-9af5-e5ee4dc51a71 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:24.715356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae4bfb-b365-4fc8-9af5-e5ee4dc51a71 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:24.715635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae4bfb-b365-4fc8-9af5-e5ee4dc51a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:24.738296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8872dfa0-a292-49f3-9b2d-93c48c378feb None None] MFA Rules not processed for user `74602998065943c4a49a96d23ec0ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:24.742031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8872dfa0-a292-49f3-9b2d-93c48c378feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:24.775297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-51ae4bfb-b365-4fc8-9af5-e5ee4dc51a71 None None] MFA Rules not processed for user `4c10480206a947be883388a11fa0ab13`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:24.784378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-51ae4bfb-b365-4fc8-9af5-e5ee4dc51a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:24.816313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:24.880253 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3185/6378] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:24.880253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872dfa0-a292-49f3-9b2d-93c48c378feb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.880253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8872dfa0-a292-49f3-9b2d-93c48c378feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:24.911741 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3194/6379] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:24.918720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae4bfb-b365-4fc8-9af5-e5ee4dc51a71 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:24.920440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-51ae4bfb-b365-4fc8-9af5-e5ee4dc51a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:24.964510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:25.010808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872dfa0-a292-49f3-9b2d-93c48c378feb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:25.026029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dc010-70c4-4a30-af96-1b3a563c9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:25.026855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dc010-70c4-4a30-af96-1b3a563c9b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:25.027232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dc010-70c4-4a30-af96-1b3a563c9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:25.027642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dc010-70c4-4a30-af96-1b3a563c9b82 admin admin] PATH_INFO: `/v3/users/709f78570a1b40c4b36590940b6edea4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:25.029176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76dc010-70c4-4a30-af96-1b3a563c9b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=709f78570a1b40c4b36590940b6edea4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:25.031767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76dc010-70c4-4a30-af96-1b3a563c9b82 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:25.072296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae4bfb-b365-4fc8-9af5-e5ee4dc51a71 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:25.087845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755b719-01d5-4220-a30b-04d6c1755567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:25.088628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755b719-01d5-4220-a30b-04d6c1755567 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:25.089013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755b719-01d5-4220-a30b-04d6c1755567 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:25.091782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755b719-01d5-4220-a30b-04d6c1755567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:25.108113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755b719-01d5-4220-a30b-04d6c1755567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:25.112513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755b719-01d5-4220-a30b-04d6c1755567 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:25.131810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d76dc010-70c4-4a30-af96-1b3a563c9b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709f78570a1b40c4b36590940b6edea4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:25.133885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d76dc010-70c4-4a30-af96-1b3a563c9b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709f78570a1b40c4b36590940b6edea4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:25.139154 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3195/6380] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:25.140660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755b719-01d5-4220-a30b-04d6c1755567 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:25.153428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d76dc010-70c4-4a30-af96-1b3a563c9b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709f78570a1b40c4b36590940b6edea4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:25.162148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755b719-01d5-4220-a30b-04d6c1755567 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:25.176377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1fe3-2611-449d-a21c-57380da89728 tempest-IdentityCatalogTest-133783205 tempest-IdentityCatalogTest-133783205-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c10480206a947be883388a11fa0ab13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3ce8bfe7c344c40ac23935f7717bfa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:25.176377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1fe3-2611-449d-a21c-57380da89728 tempest-IdentityCatalogTest-133783205 tempest-IdentityCatalogTest-133783205-project] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:25.176377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1fe3-2611-449d-a21c-57380da89728 tempest-IdentityCatalogTest-133783205 tempest-IdentityCatalogTest-133783205-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:25.176641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1fe3-2611-449d-a21c-57380da89728 tempest-IdentityCatalogTest-133783205 tempest-IdentityCatalogTest-133783205-project] PATH_INFO: `/v3/auth/catalog` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:25.177839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e1fe3-2611-449d-a21c-57380da89728 tempest-IdentityCatalogTest-133783205 tempest-IdentityCatalogTest-133783205-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:25.179795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e1fe3-2611-449d-a21c-57380da89728 tempest-IdentityCatalogTest-133783205 tempest-IdentityCatalogTest-133783205-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:25.188666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d76dc010-70c4-4a30-af96-1b3a563c9b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709f78570a1b40c4b36590940b6edea4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:25.189999 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3196/6381] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Aug 29 15:54:25 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:25.191110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1fe3-2611-449d-a21c-57380da89728 tempest-IdentityCatalogTest-133783205 tempest-IdentityCatalogTest-133783205-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:25.199095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d76dc010-70c4-4a30-af96-1b3a563c9b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709f78570a1b40c4b36590940b6edea4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:25.210901 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3186/6382] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:24 2022] DELETE /identity/v3/users/709f78570a1b40c4b36590940b6edea4 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:25.213086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2a9e-9e96-4b59-8937-7ed8018b4c0d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:25.213519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2a9e-9e96-4b59-8937-7ed8018b4c0d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:25.213941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2a9e-9e96-4b59-8937-7ed8018b4c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:25.222283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1fe3-2611-449d-a21c-57380da89728 tempest-IdentityCatalogTest-133783205 tempest-IdentityCatalogTest-133783205-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:25.242889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-908d2a9e-9e96-4b59-8937-7ed8018b4c0d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:25.244005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-908d2a9e-9e96-4b59-8937-7ed8018b4c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:25.305319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964abe1d-cdb1-4924-bf7c-ce988954966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:25.306087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964abe1d-cdb1-4924-bf7c-ce988954966f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:25.306369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964abe1d-cdb1-4924-bf7c-ce988954966f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:25.306639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964abe1d-cdb1-4924-bf7c-ce988954966f admin admin] PATH_INFO: `/v3/users/4c10480206a947be883388a11fa0ab13` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:25.307876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964abe1d-cdb1-4924-bf7c-ce988954966f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c10480206a947be883388a11fa0ab13)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:25.310727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964abe1d-cdb1-4924-bf7c-ce988954966f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:25.375428 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3187/6383] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:25.379952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-964abe1d-cdb1-4924-bf7c-ce988954966f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c10480206a947be883388a11fa0ab13'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:25.382361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-964abe1d-cdb1-4924-bf7c-ce988954966f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c10480206a947be883388a11fa0ab13'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:25.385429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d2a9e-9e96-4b59-8937-7ed8018b4c0d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:25.386977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-908d2a9e-9e96-4b59-8937-7ed8018b4c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:25.391088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:25.399475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-964abe1d-cdb1-4924-bf7c-ce988954966f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c10480206a947be883388a11fa0ab13'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:25.400263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-964abe1d-cdb1-4924-bf7c-ce988954966f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c10480206a947be883388a11fa0ab13'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:25.414123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-964abe1d-cdb1-4924-bf7c-ce988954966f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c10480206a947be883388a11fa0ab13'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:25.435357 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3197/6384] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:25 2022] DELETE /identity/v3/users/4c10480206a947be883388a11fa0ab13 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:25.440202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecb79-e721-4023-b2f4-2ee701877189 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:25.441096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecb79-e721-4023-b2f4-2ee701877189 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:25.441483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecb79-e721-4023-b2f4-2ee701877189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:25.491441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e08ecb79-e721-4023-b2f4-2ee701877189 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:25.492714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e08ecb79-e721-4023-b2f4-2ee701877189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:25.510546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:25.587090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d2a9e-9e96-4b59-8937-7ed8018b4c0d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:25.640685 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3198/6385] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:25.651047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ecb79-e721-4023-b2f4-2ee701877189 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:25.653470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e08ecb79-e721-4023-b2f4-2ee701877189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:25.717483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469c0dd-f2a1-4b4e-8550-461815b706e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:25.718800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469c0dd-f2a1-4b4e-8550-461815b706e3 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:25.719081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469c0dd-f2a1-4b4e-8550-461815b706e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:25.719566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469c0dd-f2a1-4b4e-8550-461815b706e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:25.722274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2469c0dd-f2a1-4b4e-8550-461815b706e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:25.743935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469c0dd-f2a1-4b4e-8550-461815b706e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:25.745438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469c0dd-f2a1-4b4e-8550-461815b706e3 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:25.773617 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3188/6386] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:25.791055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ecb79-e721-4023-b2f4-2ee701877189 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:25.801437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15077c9-314b-4f9e-aab6-685cfa02e948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:25.802860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15077c9-314b-4f9e-aab6-685cfa02e948 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:25.803236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15077c9-314b-4f9e-aab6-685cfa02e948 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:25.812088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15077c9-314b-4f9e-aab6-685cfa02e948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:25.847218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15077c9-314b-4f9e-aab6-685cfa02e948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:25.849602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15077c9-314b-4f9e-aab6-685cfa02e948 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:25.871317 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3199/6387] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:54:26.329442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469c0dd-f2a1-4b4e-8550-461815b706e3 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:26.331357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2469c0dd-f2a1-4b4e-8550-461815b706e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:26.354697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469c0dd-f2a1-4b4e-8550-461815b706e3 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:26.360641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:26.361923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:26.363198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:26.363726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] PATH_INFO: `/v3/projects/a2d8cbfa11b24f63b7b53fa38a81b0e6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:26.365202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d8cbfa11b24f63b7b53fa38a81b0e6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:26.368153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:26.459490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d8cbfa11b24f63b7b53fa38a81b0e6', 'request_id': 'req-f126dfc6-1c3e-4d28-a833-88c9a9082c35'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:26.468348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d8cbfa11b24f63b7b53fa38a81b0e6', 'request_id': 'req-f126dfc6-1c3e-4d28-a833-88c9a9082c35'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:26.480517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d8cbfa11b24f63b7b53fa38a81b0e6', 'request_id': 'req-f126dfc6-1c3e-4d28-a833-88c9a9082c35'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:26.499231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] The token cache is being invalidate because project a2d8cbfa11b24f63b7b53fa38a81b0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:26.499827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:26.500675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f126dfc6-1c3e-4d28-a833-88c9a9082c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:26.504120 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3189/6388] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:26 2022] DELETE /identity/v3/projects/a2d8cbfa11b24f63b7b53fa38a81b0e6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:26.508421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ab22-59d4-41c6-bae9-787ace8eb5c8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:26.508990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ab22-59d4-41c6-bae9-787ace8eb5c8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:26.509479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ab22-59d4-41c6-bae9-787ace8eb5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:26.536570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8398ab22-59d4-41c6-bae9-787ace8eb5c8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:26.537960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8398ab22-59d4-41c6-bae9-787ace8eb5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:26.616400 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3200/6389] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:26.625742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaf85d-e3e8-4bbe-bb65-4e74d03e4cd9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:26.626034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaf85d-e3e8-4bbe-bb65-4e74d03e4cd9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:26.626313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaf85d-e3e8-4bbe-bb65-4e74d03e4cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:26.662717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c3aaf85d-e3e8-4bbe-bb65-4e74d03e4cd9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:26.666901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c3aaf85d-e3e8-4bbe-bb65-4e74d03e4cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:26.689451 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3190/6390] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:26.695347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398ab22-59d4-41c6-bae9-787ace8eb5c8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:26.712124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398ab22-59d4-41c6-bae9-787ace8eb5c8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:26.726123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecec9b1-1c13-47d5-ad9f-01bd997b50b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:26.727492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec9b1-1c13-47d5-ad9f-01bd997b50b1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:26.728164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec9b1-1c13-47d5-ad9f-01bd997b50b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:26.728754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecec9b1-1c13-47d5-ad9f-01bd997b50b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:26.730107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecec9b1-1c13-47d5-ad9f-01bd997b50b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:26.731374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecec9b1-1c13-47d5-ad9f-01bd997b50b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:26.733197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecec9b1-1c13-47d5-ad9f-01bd997b50b1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:26.770641 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3201/6391] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:26.775636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaf85d-e3e8-4bbe-bb65-4e74d03e4cd9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:26.791756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaf85d-e3e8-4bbe-bb65-4e74d03e4cd9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:26.820903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21456-3041-4b95-b933-6f5459a8f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:26.821592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21456-3041-4b95-b933-6f5459a8f2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:26.828326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21456-3041-4b95-b933-6f5459a8f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:26.831290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21456-3041-4b95-b933-6f5459a8f2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:26.843677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db21456-3041-4b95-b933-6f5459a8f2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:26.859379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db21456-3041-4b95-b933-6f5459a8f2d4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:26.873262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecec9b1-1c13-47d5-ad9f-01bd997b50b1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:26.876090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-eecec9b1-1c13-47d5-ad9f-01bd997b50b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:26.908227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecec9b1-1c13-47d5-ad9f-01bd997b50b1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:26.926509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:26.927170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:26.927453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:26.927732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] PATH_INFO: `/v3/projects/f3ce8bfe7c344c40ac23935f7717bfa1` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:26.930570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ce8bfe7c344c40ac23935f7717bfa1)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:26.932875 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3191/6392] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:26 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:26.934624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:26.940435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21456-3041-4b95-b933-6f5459a8f2d4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:26.949250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:27.040119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:27.049299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ce8bfe7c344c40ac23935f7717bfa1', 'request_id': 'req-1b090c8f-2bf3-47a7-97ec-8969fb93678d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:27.060424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ce8bfe7c344c40ac23935f7717bfa1', 'request_id': 'req-1b090c8f-2bf3-47a7-97ec-8969fb93678d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:27.072531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ce8bfe7c344c40ac23935f7717bfa1', 'request_id': 'req-1b090c8f-2bf3-47a7-97ec-8969fb93678d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:27.113416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] The token cache is being invalidate because project f3ce8bfe7c344c40ac23935f7717bfa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:27.113914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:27.114874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1b090c8f-2bf3-47a7-97ec-8969fb93678d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:27.117378 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3202/6393] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:26 2022] DELETE /identity/v3/projects/f3ce8bfe7c344c40ac23935f7717bfa1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:27.123467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea081c6-bdf7-40e4-aa72-082422618bea None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.123821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea081c6-bdf7-40e4-aa72-082422618bea None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.125239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea081c6-bdf7-40e4-aa72-082422618bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:27.145576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21456-3041-4b95-b933-6f5459a8f2d4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:27.167900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8ea081c6-bdf7-40e4-aa72-082422618bea None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:27.170522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8ea081c6-bdf7-40e4-aa72-082422618bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:27.249234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb97c3-1b97-4d21-b344-7129734cd68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:27.251077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb97c3-1b97-4d21-b344-7129734cd68c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.251361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb97c3-1b97-4d21-b344-7129734cd68c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.251635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb97c3-1b97-4d21-b344-7129734cd68c admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:27.252283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb97c3-1b97-4d21-b344-7129734cd68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:27.256507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb97c3-1b97-4d21-b344-7129734cd68c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:27.287880 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3192/6394] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:26 2022] POST /identity/v3/users => generated 289 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:27.291633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb97c3-1b97-4d21-b344-7129734cd68c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:27.294327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bcdb97c3-1b97-4d21-b344-7129734cd68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:27.295363 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3203/6395] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:27.297293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85430350-425a-4298-a6d8-5676b7bac3a0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.297630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85430350-425a-4298-a6d8-5676b7bac3a0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.297912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85430350-425a-4298-a6d8-5676b7bac3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:27.317850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb97c3-1b97-4d21-b344-7129734cd68c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:27.327300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-85430350-425a-4298-a6d8-5676b7bac3a0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:27.329434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-85430350-425a-4298-a6d8-5676b7bac3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:27.330357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a2c7f-2e49-42b5-b448-65900b0ccdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:27.332010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a2c7f-2e49-42b5-b448-65900b0ccdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.332797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a2c7f-2e49-42b5-b448-65900b0ccdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.333260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a2c7f-2e49-42b5-b448-65900b0ccdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:27.334495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a2c7f-2e49-42b5-b448-65900b0ccdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:27.337366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a2c7f-2e49-42b5-b448-65900b0ccdc3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:27.343295 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3204/6396] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:27.350289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85430350-425a-4298-a6d8-5676b7bac3a0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:27.363519 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3193/6397] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:27.364258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85430350-425a-4298-a6d8-5676b7bac3a0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:27.369471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de82a27-a444-4a6c-8d8d-2c95626e8a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:27.370361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de82a27-a444-4a6c-8d8d-2c95626e8a7d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.370706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de82a27-a444-4a6c-8d8d-2c95626e8a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.371067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de82a27-a444-4a6c-8d8d-2c95626e8a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:27.371972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de82a27-a444-4a6c-8d8d-2c95626e8a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:27.372337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de82a27-a444-4a6c-8d8d-2c95626e8a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:27.374047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de82a27-a444-4a6c-8d8d-2c95626e8a7d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:27.374795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a2c7f-2e49-42b5-b448-65900b0ccdc3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:27.390753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a2c7f-2e49-42b5-b448-65900b0ccdc3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:27.392536 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3205/6398] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:27.396628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de82a27-a444-4a6c-8d8d-2c95626e8a7d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:27.399800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4956a8-5b04-45f5-8689-b4f2c8bd9970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:27.400913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4956a8-5b04-45f5-8689-b4f2c8bd9970 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.402255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4956a8-5b04-45f5-8689-b4f2c8bd9970 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.404066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4956a8-5b04-45f5-8689-b4f2c8bd9970 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:27.405989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4956a8-5b04-45f5-8689-b4f2c8bd9970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:27.409049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4956a8-5b04-45f5-8689-b4f2c8bd9970 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:27.421643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de82a27-a444-4a6c-8d8d-2c95626e8a7d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:27.427079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b716ea-40b8-4307-8679-29c34c40dba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:27.427747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b716ea-40b8-4307-8679-29c34c40dba7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.428031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b716ea-40b8-4307-8679-29c34c40dba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.428309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b716ea-40b8-4307-8679-29c34c40dba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:27.429019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b716ea-40b8-4307-8679-29c34c40dba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:27.430200 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3194/6399] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:27.435264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4956a8-5b04-45f5-8689-b4f2c8bd9970 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:27.435923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b716ea-40b8-4307-8679-29c34c40dba7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:27.454714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4956a8-5b04-45f5-8689-b4f2c8bd9970 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:27.460348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cacda-efa6-4004-8002-4d49f9c7f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:27.463271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cacda-efa6-4004-8002-4d49f9c7f6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.463565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cacda-efa6-4004-8002-4d49f9c7f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.463849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cacda-efa6-4004-8002-4d49f9c7f6aa admin admin] PATH_INFO: `/v3/projects/d2394867bbb74625a3285245d7f79063/users/11ec2e70b55e443f83c7ee407ff67a25/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:27.505191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cacda-efa6-4004-8002-4d49f9c7f6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2394867bbb74625a3285245d7f79063, user_id=11ec2e70b55e443f83c7ee407ff67a25, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:27.513686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cacda-efa6-4004-8002-4d49f9c7f6aa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:27.514563 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3206/6400] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:27 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:27.515789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b716ea-40b8-4307-8679-29c34c40dba7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:27.566360 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3195/6401] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:27 2022] PUT /identity/v3/projects/d2394867bbb74625a3285245d7f79063/users/11ec2e70b55e443f83c7ee407ff67a25/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:27.568094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f17c-e42e-49a1-83c2-2cee74b60bb5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.568387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f17c-e42e-49a1-83c2-2cee74b60bb5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.569004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f17c-e42e-49a1-83c2-2cee74b60bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:27.608633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-09b3f17c-e42e-49a1-83c2-2cee74b60bb5 None None] MFA Rules not processed for user `11ec2e70b55e443f83c7ee407ff67a25`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:27.609925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-09b3f17c-e42e-49a1-83c2-2cee74b60bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:27.702833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b716ea-40b8-4307-8679-29c34c40dba7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:27.732215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:27.776938 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3196/6402] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:27.783832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3f17c-e42e-49a1-83c2-2cee74b60bb5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:27.786998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-09b3f17c-e42e-49a1-83c2-2cee74b60bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:27.798839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:27.867148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea63b1b-94fb-4982-ab41-78d238615a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:27.867667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63b1b-94fb-4982-ab41-78d238615a08 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.867956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63b1b-94fb-4982-ab41-78d238615a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.868345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63b1b-94fb-4982-ab41-78d238615a08 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:27.870201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea63b1b-94fb-4982-ab41-78d238615a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:27.877331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea63b1b-94fb-4982-ab41-78d238615a08 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:27.935738 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3207/6403] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:27 2022] POST /identity/v3/users => generated 287 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:27.938203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea63b1b-94fb-4982-ab41-78d238615a08 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:27.956001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea63b1b-94fb-4982-ab41-78d238615a08 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:27.969760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4fe8d-759e-46f0-87f9-d4857d9ac454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:27.971456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3f17c-e42e-49a1-83c2-2cee74b60bb5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:27.977458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4fe8d-759e-46f0-87f9-d4857d9ac454 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.977685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4fe8d-759e-46f0-87f9-d4857d9ac454 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.977971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4fe8d-759e-46f0-87f9-d4857d9ac454 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:27.978642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4fe8d-759e-46f0-87f9-d4857d9ac454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:27.980430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4fe8d-759e-46f0-87f9-d4857d9ac454 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:27.983466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff24f07-8e8d-4b04-a9a6-a7c6140c732d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:27.984103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff24f07-8e8d-4b04-a9a6-a7c6140c732d service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:27.984386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff24f07-8e8d-4b04-a9a6-a7c6140c732d service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:27.985473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff24f07-8e8d-4b04-a9a6-a7c6140c732d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:28.011562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff24f07-8e8d-4b04-a9a6-a7c6140c732d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:28.014079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff24f07-8e8d-4b04-a9a6-a7c6140c732d service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:28.026349 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3208/6404] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:28.031664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4fe8d-759e-46f0-87f9-d4857d9ac454 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:28.044825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4fe8d-759e-46f0-87f9-d4857d9ac454 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:28.048092 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3197/6405] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:28.051450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3416e9-66f8-48fb-9b46-fc5f5bc1cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:28.052133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3416e9-66f8-48fb-9b46-fc5f5bc1cc09 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:28.052578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3416e9-66f8-48fb-9b46-fc5f5bc1cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:28.052857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3416e9-66f8-48fb-9b46-fc5f5bc1cc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:28.053806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3416e9-66f8-48fb-9b46-fc5f5bc1cc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:28.055383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3416e9-66f8-48fb-9b46-fc5f5bc1cc09 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:28.071516 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3209/6406] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:54:28.075878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff24f07-8e8d-4b04-a9a6-a7c6140c732d service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:28.094620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff24f07-8e8d-4b04-a9a6-a7c6140c732d service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:28.117280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93161bd-3bcd-439e-ad6b-fa96a5b50466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:28.118124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93161bd-3bcd-439e-ad6b-fa96a5b50466 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:28.118497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93161bd-3bcd-439e-ad6b-fa96a5b50466 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:28.118908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93161bd-3bcd-439e-ad6b-fa96a5b50466 admin admin] PATH_INFO: `/v3/projects/0102789e989441c4a2afd8606cf1d3df/users/cb5d2954d5b340fa883d953beee08e81/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:28.170837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93161bd-3bcd-439e-ad6b-fa96a5b50466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0102789e989441c4a2afd8606cf1d3df, user_id=cb5d2954d5b340fa883d953beee08e81, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:28.173966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93161bd-3bcd-439e-ad6b-fa96a5b50466 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:28.223465 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3198/6407] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:28 2022] PUT /identity/v3/projects/0102789e989441c4a2afd8606cf1d3df/users/cb5d2954d5b340fa883d953beee08e81/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:28.244074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62b9b8-7bab-4faa-969a-efb1553dd65e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:28.244397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62b9b8-7bab-4faa-969a-efb1553dd65e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:28.244686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62b9b8-7bab-4faa-969a-efb1553dd65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:28.314645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dc62b9b8-7bab-4faa-969a-efb1553dd65e None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:28.317959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc62b9b8-7bab-4faa-969a-efb1553dd65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:28.549631 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3210/6408] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:28.555060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93161bd-3bcd-439e-ad6b-fa96a5b50466 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:28.572608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93161bd-3bcd-439e-ad6b-fa96a5b50466 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:28.578932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e98a66-b158-4311-ac80-4201040df092 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5d2954d5b340fa883d953beee08e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0102789e989441c4a2afd8606cf1d3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:28.579704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e98a66-b158-4311-ac80-4201040df092 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:28.579992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e98a66-b158-4311-ac80-4201040df092 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:28.580366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e98a66-b158-4311-ac80-4201040df092 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81/password` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:28.658294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a3e98a66-b158-4311-ac80-4201040df092 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:28.674896 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3199/6409] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:54:28 2022] POST /identity/v3/users/cb5d2954d5b340fa883d953beee08e81/password => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:29.680444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc08e9c-4864-4e2c-8b75-0ca5cd302467 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:29.680984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc08e9c-4864-4e2c-8b75-0ca5cd302467 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:29.680984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc08e9c-4864-4e2c-8b75-0ca5cd302467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:29.726373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1cc08e9c-4864-4e2c-8b75-0ca5cd302467 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:29.727622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1cc08e9c-4864-4e2c-8b75-0ca5cd302467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:29.737438 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3211/6410] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:29 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:29.741844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbef3c-2f09-46b8-b8fc-4665ab413d18 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:29.742651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbef3c-2f09-46b8-b8fc-4665ab413d18 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:29.743106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbef3c-2f09-46b8-b8fc-4665ab413d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:29.780173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-42fbef3c-2f09-46b8-b8fc-4665ab413d18 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:29.782123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42fbef3c-2f09-46b8-b8fc-4665ab413d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:29.801282 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3200/6411] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:29.804309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc08e9c-4864-4e2c-8b75-0ca5cd302467 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:29.824728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc08e9c-4864-4e2c-8b75-0ca5cd302467 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:29.846536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442084f4-ff39-4201-86ec-dfef332ab001 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5d2954d5b340fa883d953beee08e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0102789e989441c4a2afd8606cf1d3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:29.849307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442084f4-ff39-4201-86ec-dfef332ab001 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:29.849645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442084f4-ff39-4201-86ec-dfef332ab001 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:29.850288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442084f4-ff39-4201-86ec-dfef332ab001 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81/password` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-442084f4-ff39-4201-86ec-dfef332ab001 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:29.946214 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 29 15:54:29.947308 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:29.948319 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3212/6412] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:54:29 2022] POST /identity/v3/users/cb5d2954d5b340fa883d953beee08e81/password => generated 188 bytes in 144 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 15:54:29.951888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbef3c-2f09-46b8-b8fc-4665ab413d18 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:29.966164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbef3c-2f09-46b8-b8fc-4665ab413d18 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:29.971789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc834e-2d5f-41a9-ae3c-26522c7551dd tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5d2954d5b340fa883d953beee08e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0102789e989441c4a2afd8606cf1d3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:29.972539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc834e-2d5f-41a9-ae3c-26522c7551dd tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:29.972831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc834e-2d5f-41a9-ae3c-26522c7551dd tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:29.973114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc834e-2d5f-41a9-ae3c-26522c7551dd tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81/password` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-c6fc834e-2d5f-41a9-ae3c-26522c7551dd tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:30.042791 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 29 15:54:30.044349 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:30.047311 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3201/6413] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:54:29 2022] POST /identity/v3/users/cb5d2954d5b340fa883d953beee08e81/password => generated 188 bytes in 96 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 29 15:54:30.051864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442084f4-ff39-4201-86ec-dfef332ab001 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:30.067576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442084f4-ff39-4201-86ec-dfef332ab001 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:30.079763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5c2e-8e0a-4043-97f4-b76b6730cd1a tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5d2954d5b340fa883d953beee08e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0102789e989441c4a2afd8606cf1d3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:30.080584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5c2e-8e0a-4043-97f4-b76b6730cd1a tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:30.080989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5c2e-8e0a-4043-97f4-b76b6730cd1a tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:30.081372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5c2e-8e0a-4043-97f4-b76b6730cd1a tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81/password` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:30.148881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-214d5c2e-8e0a-4043-97f4-b76b6730cd1a tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:30.163477 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3213/6414] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:54:30 2022] POST /identity/v3/users/cb5d2954d5b340fa883d953beee08e81/password => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:31.167230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993a78b-0384-4558-9218-adb26a0b2e28 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:31.168595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993a78b-0384-4558-9218-adb26a0b2e28 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:31.169072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993a78b-0384-4558-9218-adb26a0b2e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:31.224483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c993a78b-0384-4558-9218-adb26a0b2e28 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:31.226834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c993a78b-0384-4558-9218-adb26a0b2e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:31.262365 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3202/6415] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:31 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:31.266480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabffd7-75b6-44f7-a6b0-36ef15d0c86b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:31.267229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabffd7-75b6-44f7-a6b0-36ef15d0c86b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:31.267229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabffd7-75b6-44f7-a6b0-36ef15d0c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:31.334514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-eaabffd7-75b6-44f7-a6b0-36ef15d0c86b None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:31.335749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-eaabffd7-75b6-44f7-a6b0-36ef15d0c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:31.354189 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3214/6416] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:31.358053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993a78b-0384-4558-9218-adb26a0b2e28 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:31.387303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993a78b-0384-4558-9218-adb26a0b2e28 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:31.394975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0aff1c-9499-4c8b-acd3-b2a02bd035d2 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5d2954d5b340fa883d953beee08e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0102789e989441c4a2afd8606cf1d3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:31.396172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aff1c-9499-4c8b-acd3-b2a02bd035d2 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:31.396631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aff1c-9499-4c8b-acd3-b2a02bd035d2 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:31.397108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aff1c-9499-4c8b-acd3-b2a02bd035d2 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81/password` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:31.521328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8c0aff1c-9499-4c8b-acd3-b2a02bd035d2 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:31.545800 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3203/6417] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:54:31 2022] POST /identity/v3/users/cb5d2954d5b340fa883d953beee08e81/password => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:32.549939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fc672-5586-4268-bf57-84dd8fddc0eb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:32.550353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fc672-5586-4268-bf57-84dd8fddc0eb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:32.550507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fc672-5586-4268-bf57-84dd8fddc0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:32.575849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9c4fc672-5586-4268-bf57-84dd8fddc0eb None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:32.577528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9c4fc672-5586-4268-bf57-84dd8fddc0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:32.582598 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3215/6418] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:32 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:54:32.587334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab053e3-9348-4bca-9005-152c9b4c9542 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:32.588087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab053e3-9348-4bca-9005-152c9b4c9542 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:32.588087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab053e3-9348-4bca-9005-152c9b4c9542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:32.615623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-eab053e3-9348-4bca-9005-152c9b4c9542 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:32.617037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-eab053e3-9348-4bca-9005-152c9b4c9542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:32.626696 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3204/6419] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:32.633719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fc672-5586-4268-bf57-84dd8fddc0eb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:32.655178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fc672-5586-4268-bf57-84dd8fddc0eb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:32.660451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197b1e5-0740-4ce0-b396-60236df5d564 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5d2954d5b340fa883d953beee08e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0102789e989441c4a2afd8606cf1d3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:32.661350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b1e5-0740-4ce0-b396-60236df5d564 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:32.661832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b1e5-0740-4ce0-b396-60236df5d564 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:32.662282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b1e5-0740-4ce0-b396-60236df5d564 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81/password` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:32.717080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:UPDATE=2,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:32.740484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d197b1e5-0740-4ce0-b396-60236df5d564 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:32.763765 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3216/6420] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:54:32 2022] POST /identity/v3/users/cb5d2954d5b340fa883d953beee08e81/password => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:33.768458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32535bab-ad49-4bc5-8080-428364257294 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:33.769007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32535bab-ad49-4bc5-8080-428364257294 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:33.769227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32535bab-ad49-4bc5-8080-428364257294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:33.805169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-32535bab-ad49-4bc5-8080-428364257294 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:33.806667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-32535bab-ad49-4bc5-8080-428364257294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:33.823338 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3205/6421] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:33 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:33.829087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c304-8bf8-4fbe-acf9-0a93931e65d8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:33.829612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c304-8bf8-4fbe-acf9-0a93931e65d8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:33.829692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c304-8bf8-4fbe-acf9-0a93931e65d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:33.858367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2522c304-8bf8-4fbe-acf9-0a93931e65d8 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:33.859601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2522c304-8bf8-4fbe-acf9-0a93931e65d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:33.880220 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3217/6422] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:33.884930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32535bab-ad49-4bc5-8080-428364257294 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:33.902829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32535bab-ad49-4bc5-8080-428364257294 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:33.909672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f8a11-815b-4087-8b03-75200147f943 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5d2954d5b340fa883d953beee08e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0102789e989441c4a2afd8606cf1d3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:33.910956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f8a11-815b-4087-8b03-75200147f943 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:33.912090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f8a11-815b-4087-8b03-75200147f943 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:33.912558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f8a11-815b-4087-8b03-75200147f943 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81/password` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:33.920416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:UPDATE=2,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:33.998405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9b4f8a11-815b-4087-8b03-75200147f943 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:34.012562 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3206/6423] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:54:33 2022] POST /identity/v3/users/cb5d2954d5b340fa883d953beee08e81/password => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:35.017914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae060-3a2b-47b6-aa5b-7085459eb755 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:35.019366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae060-3a2b-47b6-aa5b-7085459eb755 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:35.019899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae060-3a2b-47b6-aa5b-7085459eb755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:35.067323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-db1ae060-3a2b-47b6-aa5b-7085459eb755 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:35.068830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-db1ae060-3a2b-47b6-aa5b-7085459eb755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:35.076085 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3218/6424] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:35 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:36.079341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa587c-9438-45f3-b447-270a289596da None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:36.079799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa587c-9438-45f3-b447-270a289596da None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:36.079916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa587c-9438-45f3-b447-270a289596da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:36.102889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9efa587c-9438-45f3-b447-270a289596da None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:36.104218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9efa587c-9438-45f3-b447-270a289596da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:36.112398 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3207/6425] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:36.119272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c196c-e963-41e9-8c30-34f70242b28d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:36.120239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c196c-e963-41e9-8c30-34f70242b28d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:36.120524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c196c-e963-41e9-8c30-34f70242b28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:36.146350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-578c196c-e963-41e9-8c30-34f70242b28d None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:36.147783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-578c196c-e963-41e9-8c30-34f70242b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:36.151685 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3219/6426] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:36 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:36.159464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f166e1-545d-47ac-b35c-90fa6a13e5a8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:36.159735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f166e1-545d-47ac-b35c-90fa6a13e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:36.160009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f166e1-545d-47ac-b35c-90fa6a13e5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:36.301637 n-d-854882-3 devstack@keystone.service[89680]: WARNING keystone.server.flask.application [None req-51f166e1-545d-47ac-b35c-90fa6a13e5a8 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 15:54:36.303849 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3208/6427] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:36 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 145 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 29 15:54:36.308878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4dc4-2113-4188-9dcd-b21d1f4d4301 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:36.309206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4dc4-2113-4188-9dcd-b21d1f4d4301 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:36.309549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4dc4-2113-4188-9dcd-b21d1f4d4301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:36.423907 n-d-854882-3 devstack@keystone.service[89681]: WARNING keystone.server.flask.application [None req-eb9f4dc4-2113-4188-9dcd-b21d1f4d4301 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 15:54:36.425721 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3220/6428] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:36 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 118 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 29 15:54:36.430140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1a2a-47c2-47a5-815d-a5beb277a681 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:36.430430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1a2a-47c2-47a5-815d-a5beb277a681 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:36.430706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1a2a-47c2-47a5-815d-a5beb277a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:36.459172 n-d-854882-3 devstack@keystone.service[89680]: WARNING keystone.server.flask.application [None req-47ef1a2a-47c2-47a5-815d-a5beb277a681 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 15:54:36.461189 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3209/6429] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:36 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 32 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 29 15:54:37.451899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4dc4-2113-4188-9dcd-b21d1f4d4301 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:37.554075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4dc4-2113-4188-9dcd-b21d1f4d4301 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:37.560320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:37.561089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:37.561511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:37.561891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] PATH_INFO: `/v3/users/11ec2e70b55e443f83c7ee407ff67a25` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:37.563188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ec2e70b55e443f83c7ee407ff67a25)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:37.565457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:37.621750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ec2e70b55e443f83c7ee407ff67a25'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:37.622564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ec2e70b55e443f83c7ee407ff67a25'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:37.639503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ec2e70b55e443f83c7ee407ff67a25'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:37.640565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ec2e70b55e443f83c7ee407ff67a25'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:37.650801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ec2e70b55e443f83c7ee407ff67a25'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:37.678501 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3221/6430] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:37 2022] DELETE /identity/v3/users/11ec2e70b55e443f83c7ee407ff67a25 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:37.679231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a2a40-12e2-49d4-bebf-768c918d6ca3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:37.679689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a2a40-12e2-49d4-bebf-768c918d6ca3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:37.679845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a2a40-12e2-49d4-bebf-768c918d6ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:37.711619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d46a2a40-12e2-49d4-bebf-768c918d6ca3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:37.713920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d46a2a40-12e2-49d4-bebf-768c918d6ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:37.800009 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3210/6431] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:37.810132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:37.812743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:37.857723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=3,keystone:DELETE=12,keystone:SELECT=84,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:37.886967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a2a40-12e2-49d4-bebf-768c918d6ca3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:37.888578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d46a2a40-12e2-49d4-bebf-768c918d6ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:37.903407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a2a40-12e2-49d4-bebf-768c918d6ca3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:37.909242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255e4dd-9c64-4b2a-946b-6787f1b16560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:37.910382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e4dd-9c64-4b2a-946b-6787f1b16560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:37.911193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e4dd-9c64-4b2a-946b-6787f1b16560 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:37.912170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e4dd-9c64-4b2a-946b-6787f1b16560 admin admin] PATH_INFO: `/v3/users/506b961b2bae48feb60ec7e3458e277e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:37.913431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255e4dd-9c64-4b2a-946b-6787f1b16560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=506b961b2bae48feb60ec7e3458e277e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:37.914112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b65166-61b0-4133-922b-d37f3843e5d6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:37.915390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255e4dd-9c64-4b2a-946b-6787f1b16560 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:37.919207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ec7e-bcb1-4ef7-9452-13c7735515c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:37.920116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ec7e-bcb1-4ef7-9452-13c7735515c5 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:37.920500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ec7e-bcb1-4ef7-9452-13c7735515c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:37.920893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ec7e-bcb1-4ef7-9452-13c7735515c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:37.937726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61ec7e-bcb1-4ef7-9452-13c7735515c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:37.939465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61ec7e-bcb1-4ef7-9452-13c7735515c5 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:37.951711 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3222/6432] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:37.953682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ec7e-bcb1-4ef7-9452-13c7735515c5 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:37.955276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-db61ec7e-bcb1-4ef7-9452-13c7735515c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:37.969994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ec7e-bcb1-4ef7-9452-13c7735515c5 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:37.976165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b40001-bad2-44f0-b0a4-c3c116e7dbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:37.977197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b40001-bad2-44f0-b0a4-c3c116e7dbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:37.977703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b40001-bad2-44f0-b0a4-c3c116e7dbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:37.978303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b40001-bad2-44f0-b0a4-c3c116e7dbf9 admin admin] PATH_INFO: `/v3/users/bdbaa320cf0e46b79579f858aac51192` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:37.979743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b40001-bad2-44f0-b0a4-c3c116e7dbf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdbaa320cf0e46b79579f858aac51192)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:37.982284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b40001-bad2-44f0-b0a4-c3c116e7dbf9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:37.989266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1255e4dd-9c64-4b2a-946b-6787f1b16560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506b961b2bae48feb60ec7e3458e277e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:37.990068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1255e4dd-9c64-4b2a-946b-6787f1b16560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506b961b2bae48feb60ec7e3458e277e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.013665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1255e4dd-9c64-4b2a-946b-6787f1b16560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506b961b2bae48feb60ec7e3458e277e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.024006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1255e4dd-9c64-4b2a-946b-6787f1b16560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506b961b2bae48feb60ec7e3458e277e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.034473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1255e4dd-9c64-4b2a-946b-6787f1b16560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506b961b2bae48feb60ec7e3458e277e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.045549 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3211/6433] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:37 2022] DELETE /identity/v3/users/506b961b2bae48feb60ec7e3458e277e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:38.047418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c341b-2ef1-4b86-8430-d2e82e0e155d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:38.047751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c341b-2ef1-4b86-8430-d2e82e0e155d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:38.048705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c341b-2ef1-4b86-8430-d2e82e0e155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:38.069042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6b40001-bad2-44f0-b0a4-c3c116e7dbf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdbaa320cf0e46b79579f858aac51192'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.070463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6b40001-bad2-44f0-b0a4-c3c116e7dbf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdbaa320cf0e46b79579f858aac51192'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.088308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=83,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=12 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:38.105803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6b40001-bad2-44f0-b0a4-c3c116e7dbf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdbaa320cf0e46b79579f858aac51192'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.111415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6b40001-bad2-44f0-b0a4-c3c116e7dbf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdbaa320cf0e46b79579f858aac51192'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.113245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-034c341b-2ef1-4b86-8430-d2e82e0e155d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:38.120499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-034c341b-2ef1-4b86-8430-d2e82e0e155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:38.136166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6b40001-bad2-44f0-b0a4-c3c116e7dbf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdbaa320cf0e46b79579f858aac51192'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.165950 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3223/6434] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:37 2022] DELETE /identity/v3/users/bdbaa320cf0e46b79579f858aac51192 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:38.170894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453865bf-eaea-4551-b1de-7846aefe54b6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:38.171456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453865bf-eaea-4551-b1de-7846aefe54b6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:38.171743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453865bf-eaea-4551-b1de-7846aefe54b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:38.221887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-453865bf-eaea-4551-b1de-7846aefe54b6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:38.226022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-453865bf-eaea-4551-b1de-7846aefe54b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:38.241889 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3212/6435] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:38.255429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c341b-2ef1-4b86-8430-d2e82e0e155d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:38.258263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-034c341b-2ef1-4b86-8430-d2e82e0e155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:38.348170 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3224/6436] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:38.349715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453865bf-eaea-4551-b1de-7846aefe54b6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:38.351096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-453865bf-eaea-4551-b1de-7846aefe54b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:38.364608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453865bf-eaea-4551-b1de-7846aefe54b6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:38.369877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:38.370637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:38.370954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:38.371274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] PATH_INFO: `/v3/projects/d2394867bbb74625a3285245d7f79063` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:38.373904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2394867bbb74625a3285245d7f79063)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:38.375870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:38.377281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c341b-2ef1-4b86-8430-d2e82e0e155d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:38.425276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:38.443714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2394867bbb74625a3285245d7f79063', 'request_id': 'req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.452912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2394867bbb74625a3285245d7f79063', 'request_id': 'req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.453626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036abdf0-c633-4612-bcbc-9a83725e32c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:38.453744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abdf0-c633-4612-bcbc-9a83725e32c9 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:38.453959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abdf0-c633-4612-bcbc-9a83725e32c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:38.454231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abdf0-c633-4612-bcbc-9a83725e32c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:38.464576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2394867bbb74625a3285245d7f79063', 'request_id': 'req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.466851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abdf0-c633-4612-bcbc-9a83725e32c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:38.468600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abdf0-c633-4612-bcbc-9a83725e32c9 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:38.479676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] The token cache is being invalidate because project d2394867bbb74625a3285245d7f79063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:38.480343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.481833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.487418 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3225/6437] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:38 2022] DELETE /identity/v3/projects/d2394867bbb74625a3285245d7f79063 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:38.488489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:38.490825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:38.493468 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3213/6438] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:38.494942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55de0d-ffe0-4dcc-b3f6-290ffef926df None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:38.495231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55de0d-ffe0-4dcc-b3f6-290ffef926df None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:38.498229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55de0d-ffe0-4dcc-b3f6-290ffef926df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:38.548129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1f55de0d-ffe0-4dcc-b3f6-290ffef926df None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:38.551056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1f55de0d-ffe0-4dcc-b3f6-290ffef926df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:38.582303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc912ca1-cca5-4fa5-8de5-4734fa4a4c0d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:38.593212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be42804-6170-4969-aaf3-4fa69081845b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:38.594033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be42804-6170-4969-aaf3-4fa69081845b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:38.594422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be42804-6170-4969-aaf3-4fa69081845b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:38.594791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be42804-6170-4969-aaf3-4fa69081845b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:38.596727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7be42804-6170-4969-aaf3-4fa69081845b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:38.663760 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3214/6439] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:38.673288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a998f13-28ee-4b82-bc2b-5d69b4849d23 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:38.673780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a998f13-28ee-4b82-bc2b-5d69b4849d23 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:38.674169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a998f13-28ee-4b82-bc2b-5d69b4849d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:38.691533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:38.698019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be42804-6170-4969-aaf3-4fa69081845b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:38.699604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be42804-6170-4969-aaf3-4fa69081845b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:38.700711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2a998f13-28ee-4b82-bc2b-5d69b4849d23 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:38.702067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2a998f13-28ee-4b82-bc2b-5d69b4849d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:38.710802 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3226/6440] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:38.715505 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3215/6441] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:38.722888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be42804-6170-4969-aaf3-4fa69081845b service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:38.754390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be42804-6170-4969-aaf3-4fa69081845b service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:38.765084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a998f13-28ee-4b82-bc2b-5d69b4849d23 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:38.766254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7db3e3-db5e-4d2a-8758-c4dbfb110925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:38.766935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7db3e3-db5e-4d2a-8758-c4dbfb110925 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:38.767238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7db3e3-db5e-4d2a-8758-c4dbfb110925 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:38.767348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2a998f13-28ee-4b82-bc2b-5d69b4849d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:38.767528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7db3e3-db5e-4d2a-8758-c4dbfb110925 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:38.768306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7db3e3-db5e-4d2a-8758-c4dbfb110925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:38.768627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7db3e3-db5e-4d2a-8758-c4dbfb110925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:38.770975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7db3e3-db5e-4d2a-8758-c4dbfb110925 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:38.789528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a998f13-28ee-4b82-bc2b-5d69b4849d23 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:38.810960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:38.812351 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3227/6442] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:38.816716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7db3e3-db5e-4d2a-8758-c4dbfb110925 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:38.827200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:38.828533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:38.829675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] PATH_INFO: `/v3/projects/891f88a19d80450780329e4118e8cd55` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:38.831416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891f88a19d80450780329e4118e8cd55)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:38.835848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:38.842166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7db3e3-db5e-4d2a-8758-c4dbfb110925 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:38.849142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1145a-a210-4ca1-9152-dd2fe24a649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:38.850106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1145a-a210-4ca1-9152-dd2fe24a649b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:38.850400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1145a-a210-4ca1-9152-dd2fe24a649b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:38.850678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1145a-a210-4ca1-9152-dd2fe24a649b admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:38.851934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1145a-a210-4ca1-9152-dd2fe24a649b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:38.854671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1145a-a210-4ca1-9152-dd2fe24a649b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:38.893815 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3228/6443] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:38 2022] POST /identity/v3/projects => generated 357 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:38.897429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1145a-a210-4ca1-9152-dd2fe24a649b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:38.946117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891f88a19d80450780329e4118e8cd55', 'request_id': 'req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.957860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891f88a19d80450780329e4118e8cd55', 'request_id': 'req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.964568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:38.970202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891f88a19d80450780329e4118e8cd55', 'request_id': 'req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.994091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] The token cache is being invalidate because project 891f88a19d80450780329e4118e8cd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:38.994382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.995126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-be0cb3f9-b2b1-4b3a-bb58-4ebd2a11a052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:38.997753 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3216/6444] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:38 2022] DELETE /identity/v3/projects/891f88a19d80450780329e4118e8cd55 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:39.002826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093fd9-464d-4a84-a027-25d4b8571e26 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.003281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093fd9-464d-4a84-a027-25d4b8571e26 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.003704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093fd9-464d-4a84-a027-25d4b8571e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.006795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1145a-a210-4ca1-9152-dd2fe24a649b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.033795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-61093fd9-464d-4a84-a027-25d4b8571e26 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:39.035415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-61093fd9-464d-4a84-a027-25d4b8571e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:39.136020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca772-7470-4ee5-9d68-cf3496f428c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.136712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca772-7470-4ee5-9d68-cf3496f428c0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.136999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca772-7470-4ee5-9d68-cf3496f428c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.137674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca772-7470-4ee5-9d68-cf3496f428c0 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.137939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ca772-7470-4ee5-9d68-cf3496f428c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.139901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ca772-7470-4ee5-9d68-cf3496f428c0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.149001 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3217/6445] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:39.159568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669084-35a6-45ef-bf9e-10f6d15d09e5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.159865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669084-35a6-45ef-bf9e-10f6d15d09e5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.160222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669084-35a6-45ef-bf9e-10f6d15d09e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.183274 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3229/6446] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:38 2022] POST /identity/v3/users => generated 279 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:39.187730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca772-7470-4ee5-9d68-cf3496f428c0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.189165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4b1ca772-7470-4ee5-9d68-cf3496f428c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:39.204360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e5669084-35a6-45ef-bf9e-10f6d15d09e5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:39.205531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e5669084-35a6-45ef-bf9e-10f6d15d09e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:39.220166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca772-7470-4ee5-9d68-cf3496f428c0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.227488 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3218/6447] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:39.233098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5669084-35a6-45ef-bf9e-10f6d15d09e5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.247681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e984bb-52c7-4480-8c84-5166683c0480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.247681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e984bb-52c7-4480-8c84-5166683c0480 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.247681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e984bb-52c7-4480-8c84-5166683c0480 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.247681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e984bb-52c7-4480-8c84-5166683c0480 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.248167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e984bb-52c7-4480-8c84-5166683c0480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.256597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e984bb-52c7-4480-8c84-5166683c0480 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.264797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5669084-35a6-45ef-bf9e-10f6d15d09e5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.271613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c80f2-8a86-49fe-a498-1bf92b5c0574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.272414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c80f2-8a86-49fe-a498-1bf92b5c0574 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.272868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c80f2-8a86-49fe-a498-1bf92b5c0574 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.273309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c80f2-8a86-49fe-a498-1bf92b5c0574 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.274168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c80f2-8a86-49fe-a498-1bf92b5c0574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:39.274617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c80f2-8a86-49fe-a498-1bf92b5c0574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.276353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c80f2-8a86-49fe-a498-1bf92b5c0574 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.294099 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3219/6448] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:39.298900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c80f2-8a86-49fe-a498-1bf92b5c0574 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.309215 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3230/6449] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:54:39.310657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e984bb-52c7-4480-8c84-5166683c0480 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.317237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c80f2-8a86-49fe-a498-1bf92b5c0574 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.333327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e984bb-52c7-4480-8c84-5166683c0480 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.346457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b0089-af3a-43fb-9707-f22aacf697d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.347590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0089-af3a-43fb-9707-f22aacf697d2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.348089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0089-af3a-43fb-9707-f22aacf697d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.349994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde9216-1515-48a1-af5f-f37c5f0e3706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.350977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde9216-1515-48a1-af5f-f37c5f0e3706 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.351301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde9216-1515-48a1-af5f-f37c5f0e3706 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.351577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde9216-1515-48a1-af5f-f37c5f0e3706 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.352414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde9216-1515-48a1-af5f-f37c5f0e3706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.352706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0089-af3a-43fb-9707-f22aacf697d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.353954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde9216-1515-48a1-af5f-f37c5f0e3706 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.355743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b0089-af3a-43fb-9707-f22aacf697d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.361305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b0089-af3a-43fb-9707-f22aacf697d2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.379342 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3231/6450] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:39.380721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde9216-1515-48a1-af5f-f37c5f0e3706 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.384648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8fde9216-1515-48a1-af5f-f37c5f0e3706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:39.413000 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3220/6451] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:39 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:39.413131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde9216-1515-48a1-af5f-f37c5f0e3706 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.413223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b0089-af3a-43fb-9707-f22aacf697d2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.489231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.489231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.489231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.489231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] PATH_INFO: `/v3/projects/1000fe730f2e4cce8f941050ea854b34` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.489954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=1000fe730f2e4cce8f941050ea854b34)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.489954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.490126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:39.524185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b0089-af3a-43fb-9707-f22aacf697d2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.530813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764ea22-e671-425c-b02a-f171d6b275ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.531565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ea22-e671-425c-b02a-f171d6b275ac admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.531853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ea22-e671-425c-b02a-f171d6b275ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.532125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ea22-e671-425c-b02a-f171d6b275ac admin admin] PATH_INFO: `/v3/projects/a777161269d74a27b658499483fc593d/users/83bbfa5b89984301a13159a5a0f867bd/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.555869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1000fe730f2e4cce8f941050ea854b34', 'request_id': 'req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:39.557374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764ea22-e671-425c-b02a-f171d6b275ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a777161269d74a27b658499483fc593d, user_id=83bbfa5b89984301a13159a5a0f867bd, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.560365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764ea22-e671-425c-b02a-f171d6b275ac admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.563627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1000fe730f2e4cce8f941050ea854b34', 'request_id': 'req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:39.565673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:39.578027 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3221/6452] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:39 2022] PUT /identity/v3/projects/a777161269d74a27b658499483fc593d/users/83bbfa5b89984301a13159a5a0f867bd/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:39.578231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1000fe730f2e4cce8f941050ea854b34', 'request_id': 'req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:39.579850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764ea22-e671-425c-b02a-f171d6b275ac admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.603365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] The token cache is being invalidate because project 1000fe730f2e4cce8f941050ea854b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:39.604201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:39.604582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0fdfce79-b61c-48c7-8e1b-241f76f0b0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:39.606357 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3232/6453] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:39 2022] DELETE /identity/v3/projects/1000fe730f2e4cce8f941050ea854b34 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:39.607469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63362e49-156f-4256-b02a-aedec169be7f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.607756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63362e49-156f-4256-b02a-aedec169be7f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.608018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63362e49-156f-4256-b02a-aedec169be7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.640061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-63362e49-156f-4256-b02a-aedec169be7f None None] MFA Rules not processed for user `83bbfa5b89984301a13159a5a0f867bd`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:39.641626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-63362e49-156f-4256-b02a-aedec169be7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:39.657106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764ea22-e671-425c-b02a-f171d6b275ac admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.662205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be4e8c-995d-45f8-aa10-ea7bd9fc5da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.662818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4e8c-995d-45f8-aa10-ea7bd9fc5da8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.663098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4e8c-995d-45f8-aa10-ea7bd9fc5da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.663589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4e8c-995d-45f8-aa10-ea7bd9fc5da8 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.663996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be4e8c-995d-45f8-aa10-ea7bd9fc5da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.665949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be4e8c-995d-45f8-aa10-ea7bd9fc5da8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.689724 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3222/6454] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:39 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:39.691023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace0ba-65fb-4d6b-a913-4901c77afe53 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.691455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace0ba-65fb-4d6b-a913-4901c77afe53 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.691940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace0ba-65fb-4d6b-a913-4901c77afe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.713425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b8ace0ba-65fb-4d6b-a913-4901c77afe53 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:39.714584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b8ace0ba-65fb-4d6b-a913-4901c77afe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:39.721602 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3233/6455] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:39.728991 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3223/6456] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:39.728991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ace0ba-65fb-4d6b-a913-4901c77afe53 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.729257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63362e49-156f-4256-b02a-aedec169be7f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.730677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-63362e49-156f-4256-b02a-aedec169be7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:39.730836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b8ace0ba-65fb-4d6b-a913-4901c77afe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:39.744180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ace0ba-65fb-4d6b-a913-4901c77afe53 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.744767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63362e49-156f-4256-b02a-aedec169be7f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.749941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb8e5f-c7c2-4173-8cd7-8da0bc459398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.750160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7e9a5-8dda-4c3e-af1d-b4453104bcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.750689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8e5f-c7c2-4173-8cd7-8da0bc459398 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.751056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7e9a5-8dda-4c3e-af1d-b4453104bcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.751163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8e5f-c7c2-4173-8cd7-8da0bc459398 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.751456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8e5f-c7c2-4173-8cd7-8da0bc459398 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.751560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7e9a5-8dda-4c3e-af1d-b4453104bcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.751905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7e9a5-8dda-4c3e-af1d-b4453104bcd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.752266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb8e5f-c7c2-4173-8cd7-8da0bc459398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.752716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7e9a5-8dda-4c3e-af1d-b4453104bcd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.754014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb8e5f-c7c2-4173-8cd7-8da0bc459398 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.755009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7e9a5-8dda-4c3e-af1d-b4453104bcd2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.765433 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3234/6457] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:39.766916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14772f39-1727-480f-98e9-e5a6eba964c1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.767202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14772f39-1727-480f-98e9-e5a6eba964c1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.767557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14772f39-1727-480f-98e9-e5a6eba964c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.788195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-14772f39-1727-480f-98e9-e5a6eba964c1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:39.789475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-14772f39-1727-480f-98e9-e5a6eba964c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:39.791592 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3224/6458] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:39 2022] POST /identity/v3/projects => generated 357 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:39.792475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7e9a5-8dda-4c3e-af1d-b4453104bcd2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.862434 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3235/6459] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:39.862434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14772f39-1727-480f-98e9-e5a6eba964c1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.872853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14772f39-1727-480f-98e9-e5a6eba964c1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.873377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7e9a5-8dda-4c3e-af1d-b4453104bcd2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.877909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a8c99-1695-4022-9d9c-f0c5ea31fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.878583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a8c99-1695-4022-9d9c-f0c5ea31fdbc admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.878698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93501a75-81bc-4576-a8ca-515aa34ee784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.879000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a8c99-1695-4022-9d9c-f0c5ea31fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.879341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a8c99-1695-4022-9d9c-f0c5ea31fdbc admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.879723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93501a75-81bc-4576-a8ca-515aa34ee784 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.880076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93501a75-81bc-4576-a8ca-515aa34ee784 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.880370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a8c99-1695-4022-9d9c-f0c5ea31fdbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.880479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93501a75-81bc-4576-a8ca-515aa34ee784 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.881186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93501a75-81bc-4576-a8ca-515aa34ee784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.882519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a8c99-1695-4022-9d9c-f0c5ea31fdbc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.882937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93501a75-81bc-4576-a8ca-515aa34ee784 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.898115 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3225/6460] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:39.898115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93501a75-81bc-4576-a8ca-515aa34ee784 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.908858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93501a75-81bc-4576-a8ca-515aa34ee784 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.909302 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3236/6461] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:39 2022] POST /identity/v3/users => generated 285 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:39.910489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a8c99-1695-4022-9d9c-f0c5ea31fdbc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.917568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b9b2-b47e-48e4-9f6e-c6cf6535ee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.918047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b9b2-b47e-48e4-9f6e-c6cf6535ee36 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.918338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b9b2-b47e-48e4-9f6e-c6cf6535ee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.918616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b9b2-b47e-48e4-9f6e-c6cf6535ee36 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.919281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455b9b2-b47e-48e4-9f6e-c6cf6535ee36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:39.920356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455b9b2-b47e-48e4-9f6e-c6cf6535ee36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.921514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455b9b2-b47e-48e4-9f6e-c6cf6535ee36 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.925582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a8c99-1695-4022-9d9c-f0c5ea31fdbc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.932122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4a7db-9062-4146-bc02-3f18f8246502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.932997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4a7db-9062-4146-bc02-3f18f8246502 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.933992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4a7db-9062-4146-bc02-3f18f8246502 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.934448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4a7db-9062-4146-bc02-3f18f8246502 admin admin] PATH_INFO: `/v3/projects/cba3ac2153e8414c891b6cb13413e347/users/02866b8c4eca42a2bb55b4c60faf02ee/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.940075 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3226/6462] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:39.940075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b9b2-b47e-48e4-9f6e-c6cf6535ee36 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.951437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b9b2-b47e-48e4-9f6e-c6cf6535ee36 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:39.955043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4a7db-9062-4146-bc02-3f18f8246502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba3ac2153e8414c891b6cb13413e347, user_id=02866b8c4eca42a2bb55b4c60faf02ee, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.957043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2d5c1-14fd-4ad4-88d2-c6af502ca271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:39.957770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2d5c1-14fd-4ad4-88d2-c6af502ca271 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:39.958046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4a7db-9062-4146-bc02-3f18f8246502 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.958186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2d5c1-14fd-4ad4-88d2-c6af502ca271 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:39.958533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2d5c1-14fd-4ad4-88d2-c6af502ca271 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:39.959244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2d5c1-14fd-4ad4-88d2-c6af502ca271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:39.960894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2d5c1-14fd-4ad4-88d2-c6af502ca271 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:39.963602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:39.985439 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3227/6464] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:39.985439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2d5c1-14fd-4ad4-88d2-c6af502ca271 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.985722 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3237/6464] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:39 2022] PUT /identity/v3/projects/cba3ac2153e8414c891b6cb13413e347/users/02866b8c4eca42a2bb55b4c60faf02ee/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:39.985722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4a7db-9062-4146-bc02-3f18f8246502 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:39.996650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2d5c1-14fd-4ad4-88d2-c6af502ca271 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.008886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:40.057801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4a7db-9062-4146-bc02-3f18f8246502 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.060526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460e3f1-1e28-4ca9-b55a-7c80df520985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.061141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460e3f1-1e28-4ca9-b55a-7c80df520985 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.061450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460e3f1-1e28-4ca9-b55a-7c80df520985 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.061739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460e3f1-1e28-4ca9-b55a-7c80df520985 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.062376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460e3f1-1e28-4ca9-b55a-7c80df520985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.064252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59db30-2173-4b5b-9549-af76f642e64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.064514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460e3f1-1e28-4ca9-b55a-7c80df520985 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.065105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59db30-2173-4b5b-9549-af76f642e64b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.065516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59db30-2173-4b5b-9549-af76f642e64b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.065899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59db30-2173-4b5b-9549-af76f642e64b admin admin] PATH_INFO: `/v3/projects/ca11fbf398f64b11b799851df92e2f13/users/c251175dddbe452383824587e9c6260b/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.082116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59db30-2173-4b5b-9549-af76f642e64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca11fbf398f64b11b799851df92e2f13, user_id=c251175dddbe452383824587e9c6260b, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.085329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59db30-2173-4b5b-9549-af76f642e64b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.097788 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3228/6465] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:39 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:40.097788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c460853-e7ac-44b5-8177-3761606d293b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.097788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c460853-e7ac-44b5-8177-3761606d293b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.097788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c460853-e7ac-44b5-8177-3761606d293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.101763 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3238/6466] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:39 2022] PUT /identity/v3/projects/ca11fbf398f64b11b799851df92e2f13/users/c251175dddbe452383824587e9c6260b/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:40.105769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59db30-2173-4b5b-9549-af76f642e64b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.125577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4c460853-e7ac-44b5-8177-3761606d293b None None] MFA Rules not processed for user `02866b8c4eca42a2bb55b4c60faf02ee`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:40.126788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4c460853-e7ac-44b5-8177-3761606d293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:40.172302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59db30-2173-4b5b-9549-af76f642e64b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.177142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576c77a-0ec4-4580-b997-c7c2508c0f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.177855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576c77a-0ec4-4580-b997-c7c2508c0f7f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.178140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576c77a-0ec4-4580-b997-c7c2508c0f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.178419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576c77a-0ec4-4580-b997-c7c2508c0f7f admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.179078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576c77a-0ec4-4580-b997-c7c2508c0f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.181024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576c77a-0ec4-4580-b997-c7c2508c0f7f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.200232 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3229/6467] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:40 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:40.200232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c460853-e7ac-44b5-8177-3761606d293b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.214717 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3239/6468] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:40 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:40.214717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576c77a-0ec4-4580-b997-c7c2508c0f7f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.215452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c460853-e7ac-44b5-8177-3761606d293b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.219899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e8908-a6b8-4851-88ce-64aa0ec25012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.220772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8908-a6b8-4851-88ce-64aa0ec25012 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.221076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8908-a6b8-4851-88ce-64aa0ec25012 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.221606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8908-a6b8-4851-88ce-64aa0ec25012 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.222342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e8908-a6b8-4851-88ce-64aa0ec25012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.224046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e8908-a6b8-4851-88ce-64aa0ec25012 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.224897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576c77a-0ec4-4580-b997-c7c2508c0f7f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.229891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9daa4-5c7d-4ba1-81c7-432f3ce7b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.230700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9daa4-5c7d-4ba1-81c7-432f3ce7b934 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.231000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9daa4-5c7d-4ba1-81c7-432f3ce7b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.231261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9daa4-5c7d-4ba1-81c7-432f3ce7b934 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.232088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9daa4-5c7d-4ba1-81c7-432f3ce7b934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.234079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9daa4-5c7d-4ba1-81c7-432f3ce7b934 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.239462 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3230/6469] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:40.239462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e8908-a6b8-4851-88ce-64aa0ec25012 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.250331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e8908-a6b8-4851-88ce-64aa0ec25012 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.255895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f2000-6b91-4502-87c2-f81da2ae26dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.256597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f2000-6b91-4502-87c2-f81da2ae26dd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.256906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f2000-6b91-4502-87c2-f81da2ae26dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.257201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f2000-6b91-4502-87c2-f81da2ae26dd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.257945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f2000-6b91-4502-87c2-f81da2ae26dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.259703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f2000-6b91-4502-87c2-f81da2ae26dd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.272183 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3240/6470] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:40 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:40.272183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9daa4-5c7d-4ba1-81c7-432f3ce7b934 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.275901 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3231/6471] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:40.275901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f2000-6b91-4502-87c2-f81da2ae26dd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.286498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f2000-6b91-4502-87c2-f81da2ae26dd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.355623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9daa4-5c7d-4ba1-81c7-432f3ce7b934 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.362441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69c05f-c677-488a-996a-d977d7a64a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.363250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c05f-c677-488a-996a-d977d7a64a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.363390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:40.363634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c05f-c677-488a-996a-d977d7a64a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.363932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c05f-c677-488a-996a-d977d7a64a5e admin admin] PATH_INFO: `/v3/projects/ca11fbf398f64b11b799851df92e2f13/users/c251175dddbe452383824587e9c6260b/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.368351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69c05f-c677-488a-996a-d977d7a64a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca11fbf398f64b11b799851df92e2f13, user_id=c251175dddbe452383824587e9c6260b, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.371624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69c05f-c677-488a-996a-d977d7a64a5e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.373120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e5bc3-df51-413b-9f79-b6bea1f05867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.374040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e5bc3-df51-413b-9f79-b6bea1f05867 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.374665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e5bc3-df51-413b-9f79-b6bea1f05867 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.375210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e5bc3-df51-413b-9f79-b6bea1f05867 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.375932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e5bc3-df51-413b-9f79-b6bea1f05867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.378077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e5bc3-df51-413b-9f79-b6bea1f05867 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.385473 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3241/6472] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:40 2022] PUT /identity/v3/projects/ca11fbf398f64b11b799851df92e2f13/users/c251175dddbe452383824587e9c6260b/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:40.387929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69c05f-c677-488a-996a-d977d7a64a5e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.407222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:40.409131 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3232/6473] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:40 2022] POST /identity/v3/users => generated 309 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:40.410964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a18e8-24bd-4795-9e4f-6e404301702a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.411419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a18e8-24bd-4795-9e4f-6e404301702a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.412039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a18e8-24bd-4795-9e4f-6e404301702a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.451359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f96a18e8-24bd-4795-9e4f-6e404301702a None None] MFA Rules not processed for user `c251175dddbe452383824587e9c6260b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:40.453306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f96a18e8-24bd-4795-9e4f-6e404301702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:40.529758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69c05f-c677-488a-996a-d977d7a64a5e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.547626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da232042-3cfc-48f3-8108-d1c66c2deb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.548428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232042-3cfc-48f3-8108-d1c66c2deb0a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.548823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232042-3cfc-48f3-8108-d1c66c2deb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.549517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232042-3cfc-48f3-8108-d1c66c2deb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.550564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da232042-3cfc-48f3-8108-d1c66c2deb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.552760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da232042-3cfc-48f3-8108-d1c66c2deb0a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.568510 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3242/6474] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:40.569710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da232042-3cfc-48f3-8108-d1c66c2deb0a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.584115 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3233/6475] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:40.585320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a18e8-24bd-4795-9e4f-6e404301702a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.587011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da232042-3cfc-48f3-8108-d1c66c2deb0a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.592345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c154710-6fa2-41e7-9b09-f11e47ace352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.593335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c154710-6fa2-41e7-9b09-f11e47ace352 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.593602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c154710-6fa2-41e7-9b09-f11e47ace352 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.593858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c154710-6fa2-41e7-9b09-f11e47ace352 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.594585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c154710-6fa2-41e7-9b09-f11e47ace352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.596356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c154710-6fa2-41e7-9b09-f11e47ace352 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.598728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a18e8-24bd-4795-9e4f-6e404301702a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.605202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20a7e-d533-4344-a013-587c055e4d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.606492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20a7e-d533-4344-a013-587c055e4d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.606782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20a7e-d533-4344-a013-587c055e4d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.607062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20a7e-d533-4344-a013-587c055e4d65 admin admin] PATH_INFO: `/v3/projects/c2739a008e5d459c8357e7d4682ba550/users/f6ab6003ed7b4061931f76b6946e0597/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.611563 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3243/6476] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:40.611948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c154710-6fa2-41e7-9b09-f11e47ace352 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.621859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3c154710-6fa2-41e7-9b09-f11e47ace352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:40.635879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a20a7e-d533-4344-a013-587c055e4d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2739a008e5d459c8357e7d4682ba550, user_id=f6ab6003ed7b4061931f76b6946e0597, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.639168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a20a7e-d533-4344-a013-587c055e4d65 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.662393 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3234/6477] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:40 2022] PUT /identity/v3/projects/c2739a008e5d459c8357e7d4682ba550/users/f6ab6003ed7b4061931f76b6946e0597/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:40.663143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20a7e-d533-4344-a013-587c055e4d65 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.691026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c154710-6fa2-41e7-9b09-f11e47ace352 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.738192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20a7e-d533-4344-a013-587c055e4d65 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.743444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e022de-9e0d-4fea-96a0-df4088e2926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.744155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e022de-9e0d-4fea-96a0-df4088e2926b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.744535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e022de-9e0d-4fea-96a0-df4088e2926b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.744829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e022de-9e0d-4fea-96a0-df4088e2926b admin admin] PATH_INFO: `/v3/projects/46c6776362c6443185749551439cd240/users/d51c9dcad5894ac8b46c9f3d41f2f512/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.750772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8e39c-d300-4d0e-a0ba-5a89fdd71806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.751392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8e39c-d300-4d0e-a0ba-5a89fdd71806 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.751681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8e39c-d300-4d0e-a0ba-5a89fdd71806 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.751958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8e39c-d300-4d0e-a0ba-5a89fdd71806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.763271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e022de-9e0d-4fea-96a0-df4088e2926b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c6776362c6443185749551439cd240, user_id=d51c9dcad5894ac8b46c9f3d41f2f512, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.766119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e022de-9e0d-4fea-96a0-df4088e2926b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.782467 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3235/6478] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:40 2022] PUT /identity/v3/projects/46c6776362c6443185749551439cd240/users/d51c9dcad5894ac8b46c9f3d41f2f512/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:40.783879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69bfc-44f0-4db1-a5e3-3bc060a6ed0f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.784183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69bfc-44f0-4db1-a5e3-3bc060a6ed0f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.784458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69bfc-44f0-4db1-a5e3-3bc060a6ed0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.818178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3fa69bfc-44f0-4db1-a5e3-3bc060a6ed0f None None] MFA Rules not processed for user `f6ab6003ed7b4061931f76b6946e0597`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:40.819734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3fa69bfc-44f0-4db1-a5e3-3bc060a6ed0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:40.824280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:40.827566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8e39c-d300-4d0e-a0ba-5a89fdd71806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.829087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8e39c-d300-4d0e-a0ba-5a89fdd71806 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.833168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:40.841687 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3244/6479] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:40 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:40.844168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8e39c-d300-4d0e-a0ba-5a89fdd71806 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.856790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8e39c-d300-4d0e-a0ba-5a89fdd71806 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:40.908305 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3236/6480] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:40.919178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa69bfc-44f0-4db1-a5e3-3bc060a6ed0f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:40.921506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3fa69bfc-44f0-4db1-a5e3-3bc060a6ed0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:40.957801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab28ac-b249-490d-8926-45ce2cc04888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:40.958417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab28ac-b249-490d-8926-45ce2cc04888 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:40.958704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab28ac-b249-490d-8926-45ce2cc04888 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:40.959068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab28ac-b249-490d-8926-45ce2cc04888 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:40.959720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab28ac-b249-490d-8926-45ce2cc04888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:40.961327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab28ac-b249-490d-8926-45ce2cc04888 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:40.974065 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3245/6481] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:40.974979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab28ac-b249-490d-8926-45ce2cc04888 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:41.035268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa69bfc-44f0-4db1-a5e3-3bc060a6ed0f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:41.043802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab28ac-b249-490d-8926-45ce2cc04888 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:41.044215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a87d61-8d61-4d6a-a820-9a8777565803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:41.045048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87d61-8d61-4d6a-a820-9a8777565803 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.045481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87d61-8d61-4d6a-a820-9a8777565803 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.045960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87d61-8d61-4d6a-a820-9a8777565803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.048144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8465c7-8f1d-42f7-8919-a810affe523b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:41.048773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8465c7-8f1d-42f7-8919-a810affe523b service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.049056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8465c7-8f1d-42f7-8919-a810affe523b service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.049329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8465c7-8f1d-42f7-8919-a810affe523b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.057236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a87d61-8d61-4d6a-a820-9a8777565803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:41.059901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a87d61-8d61-4d6a-a820-9a8777565803 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:41.070338 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3237/6482] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:41.074428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a87d61-8d61-4d6a-a820-9a8777565803 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:41.089935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a87d61-8d61-4d6a-a820-9a8777565803 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:41.095234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0be3-4146-4f3b-a763-3c00e140cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:41.095913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0be3-4146-4f3b-a763-3c00e140cc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.096190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0be3-4146-4f3b-a763-3c00e140cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.096474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0be3-4146-4f3b-a763-3c00e140cc81 admin admin] PATH_INFO: `/v3/projects/46c6776362c6443185749551439cd240/users/d51c9dcad5894ac8b46c9f3d41f2f512/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.098746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba0be3-4146-4f3b-a763-3c00e140cc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c6776362c6443185749551439cd240, user_id=d51c9dcad5894ac8b46c9f3d41f2f512, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:41.101508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba0be3-4146-4f3b-a763-3c00e140cc81 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:41.117613 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3238/6483] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:41 2022] PUT /identity/v3/projects/46c6776362c6443185749551439cd240/users/d51c9dcad5894ac8b46c9f3d41f2f512/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:41.117613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece382a-f925-4f51-aa37-276b40dae863 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.117613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece382a-f925-4f51-aa37-276b40dae863 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.117613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece382a-f925-4f51-aa37-276b40dae863 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.117613 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3239/6484] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:54:41.124494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece382a-f925-4f51-aa37-276b40dae863 None None] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:54:41.126821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8465c7-8f1d-42f7-8919-a810affe523b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:41.128724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8465c7-8f1d-42f7-8919-a810affe523b service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:41.139470 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3246/6485] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:41.140699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63871-da90-4361-a20a-d103a0a73ac4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.140990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63871-da90-4361-a20a-d103a0a73ac4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.141269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63871-da90-4361-a20a-d103a0a73ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.175465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f9c63871-da90-4361-a20a-d103a0a73ac4 None None] MFA Rules not processed for user `d51c9dcad5894ac8b46c9f3d41f2f512`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:41.176732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f9c63871-da90-4361-a20a-d103a0a73ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:41.229882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:41.233314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece382a-f925-4f51-aa37-276b40dae863 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:41.242406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:41.284178 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3247/6486] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:41 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:41.297235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63871-da90-4361-a20a-d103a0a73ac4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:41.298675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f9c63871-da90-4361-a20a-d103a0a73ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:41.325858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece382a-f925-4f51-aa37-276b40dae863 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:41.330701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adbe0f-870a-4a1e-8d2d-eae425f2a528 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ab6003ed7b4061931f76b6946e0597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2739a008e5d459c8357e7d4682ba550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:41.333526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adbe0f-870a-4a1e-8d2d-eae425f2a528 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.334008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adbe0f-870a-4a1e-8d2d-eae425f2a528 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.334616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adbe0f-870a-4a1e-8d2d-eae425f2a528 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] PATH_INFO: `/v3/projects/c2739a008e5d459c8357e7d4682ba550` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.336034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adbe0f-870a-4a1e-8d2d-eae425f2a528 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: Authorizing `identity:get_project(project_id=c2739a008e5d459c8357e7d4682ba550)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:41.340581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adbe0f-870a-4a1e-8d2d-eae425f2a528 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:41.342875 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3240/6487] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:54:41 2022] GET /identity/v3/projects/c2739a008e5d459c8357e7d4682ba550 => generated 363 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:54:41.383505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e706a-c51a-45a0-8314-14493827c8fe None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.383793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e706a-c51a-45a0-8314-14493827c8fe None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.384070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e706a-c51a-45a0-8314-14493827c8fe None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.385782 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3241/6488] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:54:41.394117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e706a-c51a-45a0-8314-14493827c8fe None None] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:54:41.396438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-850e706a-c51a-45a0-8314-14493827c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:41.425401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e706a-c51a-45a0-8314-14493827c8fe None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:41.426384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63871-da90-4361-a20a-d103a0a73ac4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:41.433166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03103269-325c-4b85-9a08-b84f0c13ed09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:41.434326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03103269-325c-4b85-9a08-b84f0c13ed09 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.434627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03103269-325c-4b85-9a08-b84f0c13ed09 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.435275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03103269-325c-4b85-9a08-b84f0c13ed09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.436912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e706a-c51a-45a0-8314-14493827c8fe None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:41.443440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08162847-eca3-4cd4-bc36-35bafa8b65fa tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ab6003ed7b4061931f76b6946e0597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2739a008e5d459c8357e7d4682ba550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:41.444231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162847-eca3-4cd4-bc36-35bafa8b65fa tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.445068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162847-eca3-4cd4-bc36-35bafa8b65fa tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.445357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162847-eca3-4cd4-bc36-35bafa8b65fa tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] PATH_INFO: `/v3/projects/c2739a008e5d459c8357e7d4682ba550` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.447401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08162847-eca3-4cd4-bc36-35bafa8b65fa tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: Authorizing `identity:get_project(project_id=c2739a008e5d459c8357e7d4682ba550)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:41.449525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03103269-325c-4b85-9a08-b84f0c13ed09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:41.449696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08162847-eca3-4cd4-bc36-35bafa8b65fa tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:41.451273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03103269-325c-4b85-9a08-b84f0c13ed09 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:41.451933 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3242/6489] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:54:41 2022] GET /identity/v3/projects/c2739a008e5d459c8357e7d4682ba550 => generated 363 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:41.464168 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3248/6490] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:41 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:41.503156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297fed8-8a83-4ca3-a979-b2a0d33b6de3 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.503642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297fed8-8a83-4ca3-a979-b2a0d33b6de3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.504057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297fed8-8a83-4ca3-a979-b2a0d33b6de3 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.510764 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3243/6491] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:54:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:54:41.515949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03103269-325c-4b85-9a08-b84f0c13ed09 service cinder] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:54:41.532003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03103269-325c-4b85-9a08-b84f0c13ed09 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:41.549262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03103269-325c-4b85-9a08-b84f0c13ed09 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:41.554764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b34b5c-2954-42da-98bf-43f54ba26e81 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ab6003ed7b4061931f76b6946e0597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2739a008e5d459c8357e7d4682ba550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:41.555535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b34b5c-2954-42da-98bf-43f54ba26e81 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.555964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b34b5c-2954-42da-98bf-43f54ba26e81 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.556341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b34b5c-2954-42da-98bf-43f54ba26e81 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] PATH_INFO: `/v3/projects/c2739a008e5d459c8357e7d4682ba550` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.557803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b34b5c-2954-42da-98bf-43f54ba26e81 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: Authorizing `identity:get_project(project_id=c2739a008e5d459c8357e7d4682ba550)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:41.560149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b34b5c-2954-42da-98bf-43f54ba26e81 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:41.563234 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3249/6492] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:54:41 2022] GET /identity/v3/projects/c2739a008e5d459c8357e7d4682ba550 => generated 363 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:41.596634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575113-c0d2-4f80-900f-6d486acbded3 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.599051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575113-c0d2-4f80-900f-6d486acbded3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.599051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575113-c0d2-4f80-900f-6d486acbded3 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.600606 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3244/6493] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:54:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:54:41.607840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b34b5c-2954-42da-98bf-43f54ba26e81 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:54:41.632066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b34b5c-2954-42da-98bf-43f54ba26e81 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:41.647077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b34b5c-2954-42da-98bf-43f54ba26e81 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:41.649553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9575113-c0d2-4f80-900f-6d486acbded3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:41.653677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83994698-c15a-4ebe-a5c5-85649be62406 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ab6003ed7b4061931f76b6946e0597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2739a008e5d459c8357e7d4682ba550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:41.654649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994698-c15a-4ebe-a5c5-85649be62406 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.655103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994698-c15a-4ebe-a5c5-85649be62406 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.655527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994698-c15a-4ebe-a5c5-85649be62406 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] PATH_INFO: `/v3/projects/c2739a008e5d459c8357e7d4682ba550` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.656666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83994698-c15a-4ebe-a5c5-85649be62406 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: Authorizing `identity:get_project(project_id=c2739a008e5d459c8357e7d4682ba550)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:41.658870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83994698-c15a-4ebe-a5c5-85649be62406 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:41.660928 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3250/6494] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:54:41 2022] GET /identity/v3/projects/c2739a008e5d459c8357e7d4682ba550 => generated 363 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:41.704078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318c8dc-d8b0-4fbb-8247-bb9abcd40dd4 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.704403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318c8dc-d8b0-4fbb-8247-bb9abcd40dd4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.704672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318c8dc-d8b0-4fbb-8247-bb9abcd40dd4 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.706174 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3251/6495] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 15:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 15:54:41.711245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318c8dc-d8b0-4fbb-8247-bb9abcd40dd4 None None] Authenticating service token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 15:54:41.735530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318c8dc-d8b0-4fbb-8247-bb9abcd40dd4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:41.747019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9575113-c0d2-4f80-900f-6d486acbded3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:41.747551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318c8dc-d8b0-4fbb-8247-bb9abcd40dd4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:41.751796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda225ef-775e-45ef-b3e0-6715d99a3cd9 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6ab6003ed7b4061931f76b6946e0597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2739a008e5d459c8357e7d4682ba550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:41.752494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda225ef-775e-45ef-b3e0-6715d99a3cd9 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.752669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda225ef-775e-45ef-b3e0-6715d99a3cd9 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.752948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda225ef-775e-45ef-b3e0-6715d99a3cd9 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] PATH_INFO: `/v3/projects/c2739a008e5d459c8357e7d4682ba550` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.754054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a459d-eee6-48fd-9a8b-8ab3cda378c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:41.754243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda225ef-775e-45ef-b3e0-6715d99a3cd9 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: Authorizing `identity:get_project(project_id=c2739a008e5d459c8357e7d4682ba550)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:41.755293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a459d-eee6-48fd-9a8b-8ab3cda378c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.755917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a459d-eee6-48fd-9a8b-8ab3cda378c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.756227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda225ef-775e-45ef-b3e0-6715d99a3cd9 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:41.756597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a459d-eee6-48fd-9a8b-8ab3cda378c8 admin admin] PATH_INFO: `/v3/users/02866b8c4eca42a2bb55b4c60faf02ee` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.758069 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3252/6496] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 15:54:41 2022] GET /identity/v3/projects/c2739a008e5d459c8357e7d4682ba550 => generated 363 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:54:41.762085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a459d-eee6-48fd-9a8b-8ab3cda378c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02866b8c4eca42a2bb55b4c60faf02ee)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:41.769310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a459d-eee6-48fd-9a8b-8ab3cda378c8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:41.798231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda225ef-775e-45ef-b3e0-6715d99a3cd9 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:41.813115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda225ef-775e-45ef-b3e0-6715d99a3cd9 tempest-QuotasTestJSON-538761540 tempest-QuotasTestJSON-538761540-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:41.819524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233378a3-9eb1-4944-807e-2ce19d7e80ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:41.820449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233378a3-9eb1-4944-807e-2ce19d7e80ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.820904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233378a3-9eb1-4944-807e-2ce19d7e80ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.821514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233378a3-9eb1-4944-807e-2ce19d7e80ff admin admin] PATH_INFO: `/v3/users/f6ab6003ed7b4061931f76b6946e0597` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.823068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233378a3-9eb1-4944-807e-2ce19d7e80ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ab6003ed7b4061931f76b6946e0597)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:41.825556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233378a3-9eb1-4944-807e-2ce19d7e80ff admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:41.834669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e3a459d-eee6-48fd-9a8b-8ab3cda378c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02866b8c4eca42a2bb55b4c60faf02ee'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:41.841888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e3a459d-eee6-48fd-9a8b-8ab3cda378c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02866b8c4eca42a2bb55b4c60faf02ee'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:41.875480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e3a459d-eee6-48fd-9a8b-8ab3cda378c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02866b8c4eca42a2bb55b4c60faf02ee'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:41.884323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e3a459d-eee6-48fd-9a8b-8ab3cda378c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02866b8c4eca42a2bb55b4c60faf02ee'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:41.890494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-233378a3-9eb1-4944-807e-2ce19d7e80ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ab6003ed7b4061931f76b6946e0597'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:41.891255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-233378a3-9eb1-4944-807e-2ce19d7e80ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ab6003ed7b4061931f76b6946e0597'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:41.892558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e3a459d-eee6-48fd-9a8b-8ab3cda378c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02866b8c4eca42a2bb55b4c60faf02ee'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:41.899839 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3245/6497] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:41 2022] DELETE /identity/v3/users/02866b8c4eca42a2bb55b4c60faf02ee => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:41.900972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4edb03-1e59-4019-b76a-bf1f776fc3c7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.901509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4edb03-1e59-4019-b76a-bf1f776fc3c7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.901617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4edb03-1e59-4019-b76a-bf1f776fc3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.908564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-233378a3-9eb1-4944-807e-2ce19d7e80ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ab6003ed7b4061931f76b6946e0597'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:41.909292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-233378a3-9eb1-4944-807e-2ce19d7e80ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ab6003ed7b4061931f76b6946e0597'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:41.920124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-233378a3-9eb1-4944-807e-2ce19d7e80ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ab6003ed7b4061931f76b6946e0597'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:41.930296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ee4edb03-1e59-4019-b76a-bf1f776fc3c7 None None] MFA Rules not processed for user `74602998065943c4a49a96d23ec0ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:41.931749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ee4edb03-1e59-4019-b76a-bf1f776fc3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:41.937973 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3253/6498] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:41 2022] DELETE /identity/v3/users/f6ab6003ed7b4061931f76b6946e0597 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:41.939621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e2635-a14c-49c0-8245-43cba1a3bdbe None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.939912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e2635-a14c-49c0-8245-43cba1a3bdbe None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:41.940206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e2635-a14c-49c0-8245-43cba1a3bdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:41.947173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:41.965618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3b8e2635-a14c-49c0-8245-43cba1a3bdbe None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:41.966865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3b8e2635-a14c-49c0-8245-43cba1a3bdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:41.980125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:41.998273 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3246/6499] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:41.999625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f358f-07f6-45d2-9035-b782b7b15da6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:41.999822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f358f-07f6-45d2-9035-b782b7b15da6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:42.000108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f358f-07f6-45d2-9035-b782b7b15da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:42.029012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4a4f358f-07f6-45d2-9035-b782b7b15da6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:42.034735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4a4f358f-07f6-45d2-9035-b782b7b15da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:42.041542 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3254/6500] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:42.048447 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3247/6501] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:42.054017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e2635-a14c-49c0-8245-43cba1a3bdbe None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:42.059010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3b8e2635-a14c-49c0-8245-43cba1a3bdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:42.059487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f358f-07f6-45d2-9035-b782b7b15da6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:42.061112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4a4f358f-07f6-45d2-9035-b782b7b15da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:42.144210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e2635-a14c-49c0-8245-43cba1a3bdbe None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:42.151155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a838-1e1f-4a42-8dcd-729684bd932e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:42.151867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a838-1e1f-4a42-8dcd-729684bd932e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:42.153916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a838-1e1f-4a42-8dcd-729684bd932e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:42.154267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a838-1e1f-4a42-8dcd-729684bd932e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:42.155085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f358f-07f6-45d2-9035-b782b7b15da6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:42.159701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788142-47af-43bd-bd9c-cc898e21c10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:42.162684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788142-47af-43bd-bd9c-cc898e21c10c service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:42.163337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788142-47af-43bd-bd9c-cc898e21c10c service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:42.163687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788142-47af-43bd-bd9c-cc898e21c10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:42.164789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7a838-1e1f-4a42-8dcd-729684bd932e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:42.166338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7a838-1e1f-4a42-8dcd-729684bd932e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:42.178615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8788142-47af-43bd-bd9c-cc898e21c10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:42.180414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8788142-47af-43bd-bd9c-cc898e21c10c service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:42.181895 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3255/6502] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:42.193555 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3248/6503] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:54:42.576148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a838-1e1f-4a42-8dcd-729684bd932e service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:42.579737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a7c7a838-1e1f-4a42-8dcd-729684bd932e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:42.622019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a838-1e1f-4a42-8dcd-729684bd932e service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:42.658497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:42.659259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:42.659543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:42.661013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] PATH_INFO: `/v3/projects/c2739a008e5d459c8357e7d4682ba550` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:42.663284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2739a008e5d459c8357e7d4682ba550)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:42.670690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:42.798346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2739a008e5d459c8357e7d4682ba550', 'request_id': 'req-b66013ed-a23f-41ea-a4da-d75125edd511'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:42.808167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2739a008e5d459c8357e7d4682ba550', 'request_id': 'req-b66013ed-a23f-41ea-a4da-d75125edd511'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:42.819145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2739a008e5d459c8357e7d4682ba550', 'request_id': 'req-b66013ed-a23f-41ea-a4da-d75125edd511'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:42.834390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] The token cache is being invalidate because project c2739a008e5d459c8357e7d4682ba550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:42.834767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:42.835505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:42.841491 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3256/6504] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:42 2022] DELETE /identity/v3/projects/c2739a008e5d459c8357e7d4682ba550 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:42.844198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3d97-e922-412b-88c8-e9c146c157cc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:42.844703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3d97-e922-412b-88c8-e9c146c157cc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:42.844798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3d97-e922-412b-88c8-e9c146c157cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:42.871776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:42.874146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:42.877816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-33fa3d97-e922-412b-88c8-e9c146c157cc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:42.879163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-33fa3d97-e922-412b-88c8-e9c146c157cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:42.961632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:42.973573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66013ed-a23f-41ea-a4da-d75125edd511 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:42.980474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a968cc8-e706-4e1f-8c63-6418386eb0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:42.981942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968cc8-e706-4e1f-8c63-6418386eb0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:42.982417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968cc8-e706-4e1f-8c63-6418386eb0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:42.983136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968cc8-e706-4e1f-8c63-6418386eb0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:42.986284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a968cc8-e706-4e1f-8c63-6418386eb0d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:43.003137 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3249/6505] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:43.003137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3d97-e922-412b-88c8-e9c146c157cc None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:43.003137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-33fa3d97-e922-412b-88c8-e9c146c157cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:43.018402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3d97-e922-412b-88c8-e9c146c157cc None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:43.018967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a968cc8-e706-4e1f-8c63-6418386eb0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:43.020466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a968cc8-e706-4e1f-8c63-6418386eb0d9 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:43.034992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:43.035591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:43.035875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:43.036151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] PATH_INFO: `/v3/projects/cba3ac2153e8414c891b6cb13413e347` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:43.037450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba3ac2153e8414c891b6cb13413e347)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:43.039719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:43.045364 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3257/6506] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:43.047144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30862781-24b3-4808-ad43-1bcc3b8555a4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:43.047442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30862781-24b3-4808-ad43-1bcc3b8555a4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:43.047723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30862781-24b3-4808-ad43-1bcc3b8555a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:43.079976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-30862781-24b3-4808-ad43-1bcc3b8555a4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:43.083009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-30862781-24b3-4808-ad43-1bcc3b8555a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:43.103555 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3258/6507] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:43.109320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30862781-24b3-4808-ad43-1bcc3b8555a4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:43.131794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30862781-24b3-4808-ad43-1bcc3b8555a4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:43.149318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250d95a-522a-40c3-a853-0c3b0c48caa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:43.149973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250d95a-522a-40c3-a853-0c3b0c48caa5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:43.150256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250d95a-522a-40c3-a853-0c3b0c48caa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:43.150539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250d95a-522a-40c3-a853-0c3b0c48caa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:43.151207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250d95a-522a-40c3-a853-0c3b0c48caa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:43.151514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250d95a-522a-40c3-a853-0c3b0c48caa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:43.153812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250d95a-522a-40c3-a853-0c3b0c48caa5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:43.177128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba3ac2153e8414c891b6cb13413e347', 'request_id': 'req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:43.177341 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3259/6508] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:54:43.177341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250d95a-522a-40c3-a853-0c3b0c48caa5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:43.184856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a250d95a-522a-40c3-a853-0c3b0c48caa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:43.187632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:43.190332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba3ac2153e8414c891b6cb13413e347', 'request_id': 'req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:43.201659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba3ac2153e8414c891b6cb13413e347', 'request_id': 'req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:43.218797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] The token cache is being invalidate because project cba3ac2153e8414c891b6cb13413e347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:43.220337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:43.221838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:43.227145 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3250/6509] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:42 2022] DELETE /identity/v3/projects/cba3ac2153e8414c891b6cb13413e347 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:43.238783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:43.240386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:43.306479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250d95a-522a-40c3-a853-0c3b0c48caa5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:43.334386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a122-5341-43eb-82b9-7b4e1f7b9a50 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:43.344461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a99dfe-04f9-4185-b6ae-e53dc3c01ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:43.345093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99dfe-04f9-4185-b6ae-e53dc3c01ccb admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:43.345378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99dfe-04f9-4185-b6ae-e53dc3c01ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:43.345713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99dfe-04f9-4185-b6ae-e53dc3c01ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:43.346427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a99dfe-04f9-4185-b6ae-e53dc3c01ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:43.348424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a99dfe-04f9-4185-b6ae-e53dc3c01ccb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:43.388005 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3251/6510] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:43 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:43.389006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a99dfe-04f9-4185-b6ae-e53dc3c01ccb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:43.390786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72a99dfe-04f9-4185-b6ae-e53dc3c01ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:43.396670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5e625-fac8-4728-81ef-a2197581b09e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:43.397216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5e625-fac8-4728-81ef-a2197581b09e service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:43.397643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5e625-fac8-4728-81ef-a2197581b09e service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:43.398292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5e625-fac8-4728-81ef-a2197581b09e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:43.400761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-87d5e625-fac8-4728-81ef-a2197581b09e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:43.419181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5e625-fac8-4728-81ef-a2197581b09e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:43.420936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5e625-fac8-4728-81ef-a2197581b09e service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:43.448550 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3260/6511] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:43.450215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5e625-fac8-4728-81ef-a2197581b09e service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:43.474269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5e625-fac8-4728-81ef-a2197581b09e service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:43.549340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a99dfe-04f9-4185-b6ae-e53dc3c01ccb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:43.562711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3f22e-582b-4119-a68e-7c15f006e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:43.563824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3f22e-582b-4119-a68e-7c15f006e091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:43.564115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3f22e-582b-4119-a68e-7c15f006e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:43.564877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3f22e-582b-4119-a68e-7c15f006e091 admin admin] PATH_INFO: `/v3/users/d51c9dcad5894ac8b46c9f3d41f2f512` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:43.566128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3f22e-582b-4119-a68e-7c15f006e091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51c9dcad5894ac8b46c9f3d41f2f512)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:43.569708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3f22e-582b-4119-a68e-7c15f006e091 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:43.583424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28369a2f-0dd7-46d9-a5ec-ef6f280a6538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:43.584195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369a2f-0dd7-46d9-a5ec-ef6f280a6538 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:43.584653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369a2f-0dd7-46d9-a5ec-ef6f280a6538 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:43.585004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369a2f-0dd7-46d9-a5ec-ef6f280a6538 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:43.585773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28369a2f-0dd7-46d9-a5ec-ef6f280a6538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:43.587976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28369a2f-0dd7-46d9-a5ec-ef6f280a6538 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:43.598173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:43.616254 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3261/6512] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:43 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:43.617430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28369a2f-0dd7-46d9-a5ec-ef6f280a6538 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:43.619351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-28369a2f-0dd7-46d9-a5ec-ef6f280a6538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:43.634276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c8b3f22e-582b-4119-a68e-7c15f006e091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51c9dcad5894ac8b46c9f3d41f2f512'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:43.634997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c8b3f22e-582b-4119-a68e-7c15f006e091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51c9dcad5894ac8b46c9f3d41f2f512'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:43.651241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c8b3f22e-582b-4119-a68e-7c15f006e091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51c9dcad5894ac8b46c9f3d41f2f512'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:43.659697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c8b3f22e-582b-4119-a68e-7c15f006e091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51c9dcad5894ac8b46c9f3d41f2f512'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:43.661262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:43.671110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c8b3f22e-582b-4119-a68e-7c15f006e091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51c9dcad5894ac8b46c9f3d41f2f512'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:43.680864 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3252/6513] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:43 2022] DELETE /identity/v3/users/d51c9dcad5894ac8b46c9f3d41f2f512 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:43.682873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed2629-42df-4499-ad7f-aa11a54b30b9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:43.683167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed2629-42df-4499-ad7f-aa11a54b30b9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:43.684006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed2629-42df-4499-ad7f-aa11a54b30b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:43.705903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a6ed2629-42df-4499-ad7f-aa11a54b30b9 None None] MFA Rules not processed for user `74602998065943c4a49a96d23ec0ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:43.708813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a6ed2629-42df-4499-ad7f-aa11a54b30b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:43.710736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28369a2f-0dd7-46d9-a5ec-ef6f280a6538 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:43.807408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b32b3-d821-486f-97bd-7fa474802389 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:43.808087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b32b3-d821-486f-97bd-7fa474802389 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:43.809053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b32b3-d821-486f-97bd-7fa474802389 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:43.809333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b32b3-d821-486f-97bd-7fa474802389 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:43.811752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d44b32b3-d821-486f-97bd-7fa474802389 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:43.816540 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3253/6514] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:43.819702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed2629-42df-4499-ad7f-aa11a54b30b9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:43.823082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a6ed2629-42df-4499-ad7f-aa11a54b30b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:43.827113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b32b3-d821-486f-97bd-7fa474802389 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:43.828891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b32b3-d821-486f-97bd-7fa474802389 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:43.850959 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3262/6515] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:43.957492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed2629-42df-4499-ad7f-aa11a54b30b9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:43.965820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfa704-46f2-47b2-b029-2b6035af20ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:43.967077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfa704-46f2-47b2-b029-2b6035af20ea admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:43.967505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfa704-46f2-47b2-b029-2b6035af20ea admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:43.967884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfa704-46f2-47b2-b029-2b6035af20ea admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:43.970641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfa704-46f2-47b2-b029-2b6035af20ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:43.974044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfa704-46f2-47b2-b029-2b6035af20ea admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:43.990161 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3254/6516] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:43.995297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b32b3-d821-486f-97bd-7fa474802389 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:44.007603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b32b3-d821-486f-97bd-7fa474802389 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:44.013231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cd86d-eb8b-4717-bd26-5e44060c03f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:44.013982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cd86d-eb8b-4717-bd26-5e44060c03f4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:44.014333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cd86d-eb8b-4717-bd26-5e44060c03f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:44.014670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cd86d-eb8b-4717-bd26-5e44060c03f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:44.015376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cd86d-eb8b-4717-bd26-5e44060c03f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:44.017034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cd86d-eb8b-4717-bd26-5e44060c03f4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:44.027531 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3263/6517] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:44.032138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfa704-46f2-47b2-b029-2b6035af20ea admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:44.045919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfa704-46f2-47b2-b029-2b6035af20ea admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:44.052088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39db761-a971-43d1-97fc-bde1a79cbca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:44.052896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db761-a971-43d1-97fc-bde1a79cbca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:44.053282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db761-a971-43d1-97fc-bde1a79cbca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:44.053871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db761-a971-43d1-97fc-bde1a79cbca5 admin admin] PATH_INFO: `/v3/projects/afefc5b5767f4fa293c275420346fa64/users/8f49130151dd4f5cbf86577939726770/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:44.074468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39db761-a971-43d1-97fc-bde1a79cbca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afefc5b5767f4fa293c275420346fa64, user_id=8f49130151dd4f5cbf86577939726770, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:44.077951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39db761-a971-43d1-97fc-bde1a79cbca5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:44.098909 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3255/6518] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:44 2022] PUT /identity/v3/projects/afefc5b5767f4fa293c275420346fa64/users/8f49130151dd4f5cbf86577939726770/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:44.100603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e76cbb-0b7f-4d17-bbde-96dc44fae684 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:44.100892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e76cbb-0b7f-4d17-bbde-96dc44fae684 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:44.101239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e76cbb-0b7f-4d17-bbde-96dc44fae684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:44.124339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-05e76cbb-0b7f-4d17-bbde-96dc44fae684 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:44.125696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-05e76cbb-0b7f-4d17-bbde-96dc44fae684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:44.203135 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3264/6519] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:44.210395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39db761-a971-43d1-97fc-bde1a79cbca5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:44.212329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a39db761-a971-43d1-97fc-bde1a79cbca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:44.311697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39db761-a971-43d1-97fc-bde1a79cbca5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:44.328273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f9bee-0967-47be-a35e-53e02c4bffdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:44.328273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f9bee-0967-47be-a35e-53e02c4bffdd service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:44.328273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f9bee-0967-47be-a35e-53e02c4bffdd service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:44.328273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f9bee-0967-47be-a35e-53e02c4bffdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:44.344895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f9bee-0967-47be-a35e-53e02c4bffdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:44.346482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f9bee-0967-47be-a35e-53e02c4bffdd service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:44.358426 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3256/6520] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:44.461750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e76cbb-0b7f-4d17-bbde-96dc44fae684 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:44.463829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-05e76cbb-0b7f-4d17-bbde-96dc44fae684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:44.482711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e76cbb-0b7f-4d17-bbde-96dc44fae684 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:44.510317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:44.511460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:44.511958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:44.512463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] PATH_INFO: `/v3/projects/46c6776362c6443185749551439cd240` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:44.514589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c6776362c6443185749551439cd240)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:44.518342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:44.540515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:44.596076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c6776362c6443185749551439cd240', 'request_id': 'req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:44.604832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c6776362c6443185749551439cd240', 'request_id': 'req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:44.617067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c6776362c6443185749551439cd240', 'request_id': 'req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:44.638431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] The token cache is being invalidate because project 46c6776362c6443185749551439cd240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:44.638962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:44.640524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ae7eb8c-115d-45a3-8a1a-64db0ab29cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:44.646470 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3265/6521] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:44 2022] DELETE /identity/v3/projects/46c6776362c6443185749551439cd240 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:44.648200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe47792-6f85-47b1-9743-aa8d18cd50ca None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:44.648698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe47792-6f85-47b1-9743-aa8d18cd50ca None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:44.649075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe47792-6f85-47b1-9743-aa8d18cd50ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:44.681040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9fe47792-6f85-47b1-9743-aa8d18cd50ca None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:44.682765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9fe47792-6f85-47b1-9743-aa8d18cd50ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:44.688735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:44.791726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679b94a-bf44-452a-8047-dfb727e5f727 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:44.791830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679b94a-bf44-452a-8047-dfb727e5f727 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:44.792038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679b94a-bf44-452a-8047-dfb727e5f727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:44.801824 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3257/6522] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:44.803309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4886a-7b65-4df6-9393-4b40130a11de None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:44.803598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4886a-7b65-4df6-9393-4b40130a11de None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:44.803881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4886a-7b65-4df6-9393-4b40130a11de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:44.835425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a679b94a-bf44-452a-8047-dfb727e5f727 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:44.836815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a679b94a-bf44-452a-8047-dfb727e5f727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:44.853237 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3266/6523] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:44.854229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679b94a-bf44-452a-8047-dfb727e5f727 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:44.866070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679b94a-bf44-452a-8047-dfb727e5f727 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:44.874026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7f38b-c42b-4f5a-9d64-507da3f7b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:44.874797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7f38b-c42b-4f5a-9d64-507da3f7b649 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:44.875552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7f38b-c42b-4f5a-9d64-507da3f7b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:44.876247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7f38b-c42b-4f5a-9d64-507da3f7b649 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:44.882258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7f38b-c42b-4f5a-9d64-507da3f7b649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:44.883535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7f38b-c42b-4f5a-9d64-507da3f7b649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:44.888000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7f38b-c42b-4f5a-9d64-507da3f7b649 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:44.899929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cdc4886a-7b65-4df6-9393-4b40130a11de None None] MFA Rules not processed for user `8f49130151dd4f5cbf86577939726770`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:44.901223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cdc4886a-7b65-4df6-9393-4b40130a11de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:44.911387 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3267/6524] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:44.912817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7f38b-c42b-4f5a-9d64-507da3f7b649 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:44.928194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7f38b-c42b-4f5a-9d64-507da3f7b649 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:44.936940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07b334-dde0-49c3-8720-4f0b8466fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:44.937614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07b334-dde0-49c3-8720-4f0b8466fab8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:44.937966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07b334-dde0-49c3-8720-4f0b8466fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:44.938248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07b334-dde0-49c3-8720-4f0b8466fab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:44.939018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07b334-dde0-49c3-8720-4f0b8466fab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:44.941699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07b334-dde0-49c3-8720-4f0b8466fab8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:44.996663 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3268/6525] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:44 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:44.998139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07b334-dde0-49c3-8720-4f0b8466fab8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:45.020690 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3258/6526] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:45.031363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81fbe-bad4-4f90-a10a-4130d940ec4e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:45.031824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81fbe-bad4-4f90-a10a-4130d940ec4e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:45.032450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81fbe-bad4-4f90-a10a-4130d940ec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:45.055929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b2a81fbe-bad4-4f90-a10a-4130d940ec4e None None] MFA Rules not processed for user `8f49130151dd4f5cbf86577939726770`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:45.057247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b2a81fbe-bad4-4f90-a10a-4130d940ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:45.126314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07b334-dde0-49c3-8720-4f0b8466fab8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:45.138875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1d81c-4b3b-44ef-8210-41534797c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:45.139512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1d81c-4b3b-44ef-8210-41534797c924 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:45.141052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1d81c-4b3b-44ef-8210-41534797c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:45.142363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1d81c-4b3b-44ef-8210-41534797c924 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:45.143819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1d81c-4b3b-44ef-8210-41534797c924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:45.146635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1d81c-4b3b-44ef-8210-41534797c924 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:45.181516 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3259/6527] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:45.197671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a81fbe-bad4-4f90-a10a-4130d940ec4e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:45.201583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b2a81fbe-bad4-4f90-a10a-4130d940ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:45.204168 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3269/6528] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:44 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:45.211064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1d81c-4b3b-44ef-8210-41534797c924 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:45.237078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1d81c-4b3b-44ef-8210-41534797c924 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:45.253566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fbc51-71ab-480b-891f-3fe2b8f5ed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:45.259004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fbc51-71ab-480b-891f-3fe2b8f5ed73 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:45.259171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fbc51-71ab-480b-891f-3fe2b8f5ed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:45.259461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fbc51-71ab-480b-891f-3fe2b8f5ed73 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:45.260130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fbc51-71ab-480b-891f-3fe2b8f5ed73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:45.267717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fbc51-71ab-480b-891f-3fe2b8f5ed73 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:45.326684 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3270/6529] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:45.331425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fbc51-71ab-480b-891f-3fe2b8f5ed73 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:45.346416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fbc51-71ab-480b-891f-3fe2b8f5ed73 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:45.358383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5acc6b-ffc2-4a0c-9a7b-0bf9e148005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:45.359010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:45.359135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5acc6b-ffc2-4a0c-9a7b-0bf9e148005f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:45.359296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5acc6b-ffc2-4a0c-9a7b-0bf9e148005f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:45.359576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5acc6b-ffc2-4a0c-9a7b-0bf9e148005f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:45.361540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5acc6b-ffc2-4a0c-9a7b-0bf9e148005f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:45.363250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5acc6b-ffc2-4a0c-9a7b-0bf9e148005f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:45.379331 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3271/6530] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:45.380238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5acc6b-ffc2-4a0c-9a7b-0bf9e148005f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:45.392450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5acc6b-ffc2-4a0c-9a7b-0bf9e148005f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:45.397672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff146ad-ffbf-41e5-93bf-c8b7312b6b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:45.398474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff146ad-ffbf-41e5-93bf-c8b7312b6b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:45.398766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff146ad-ffbf-41e5-93bf-c8b7312b6b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:45.399104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff146ad-ffbf-41e5-93bf-c8b7312b6b61 admin admin] PATH_INFO: `/v3/projects/e97e0971c0f2471fae86f3b85593b5a4/users/9654324d5cab4ff99b493f30f25d9237/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:45.418366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff146ad-ffbf-41e5-93bf-c8b7312b6b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97e0971c0f2471fae86f3b85593b5a4, user_id=9654324d5cab4ff99b493f30f25d9237, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:45.421197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff146ad-ffbf-41e5-93bf-c8b7312b6b61 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:45.422883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a81fbe-bad4-4f90-a10a-4130d940ec4e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:45.435627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:45.441871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311be4e-8fc6-4e59-ae62-9a908298d22b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:45.442510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311be4e-8fc6-4e59-ae62-9a908298d22b service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:45.443117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311be4e-8fc6-4e59-ae62-9a908298d22b service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:45.443117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311be4e-8fc6-4e59-ae62-9a908298d22b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:45.451087 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3272/6531] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:45 2022] PUT /identity/v3/projects/e97e0971c0f2471fae86f3b85593b5a4/users/9654324d5cab4ff99b493f30f25d9237/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:45.463581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09c0a1-a16a-41fc-b238-167fa7c8031c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:45.463870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09c0a1-a16a-41fc-b238-167fa7c8031c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:45.464153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09c0a1-a16a-41fc-b238-167fa7c8031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:45.469078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311be4e-8fc6-4e59-ae62-9a908298d22b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:45.470682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311be4e-8fc6-4e59-ae62-9a908298d22b service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:45.508643 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3260/6532] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:54:45.542808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1d09c0a1-a16a-41fc-b238-167fa7c8031c None None] MFA Rules not processed for user `9654324d5cab4ff99b493f30f25d9237`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:45.544093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1d09c0a1-a16a-41fc-b238-167fa7c8031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:45.629980 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3273/6533] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:45.634710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311be4e-8fc6-4e59-ae62-9a908298d22b service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:45.645823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311be4e-8fc6-4e59-ae62-9a908298d22b service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:45.715040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d1002-2454-4530-97ad-3a59ab5e3794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:45.715693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1002-2454-4530-97ad-3a59ab5e3794 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:45.715980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1002-2454-4530-97ad-3a59ab5e3794 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:45.716385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1002-2454-4530-97ad-3a59ab5e3794 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:45.717538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d1002-2454-4530-97ad-3a59ab5e3794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:45.719015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d1002-2454-4530-97ad-3a59ab5e3794 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:45.757834 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3261/6534] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:45 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:45.759777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09c0a1-a16a-41fc-b238-167fa7c8031c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:45.771927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09c0a1-a16a-41fc-b238-167fa7c8031c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:45.840682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b8a34-0a7d-4ee4-a4fe-f72fcf43eabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:45.841404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b8a34-0a7d-4ee4-a4fe-f72fcf43eabf admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:45.841778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b8a34-0a7d-4ee4-a4fe-f72fcf43eabf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:45.842051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b8a34-0a7d-4ee4-a4fe-f72fcf43eabf admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:45.842715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b8a34-0a7d-4ee4-a4fe-f72fcf43eabf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:45.845831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b8a34-0a7d-4ee4-a4fe-f72fcf43eabf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:45.874001 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3274/6535] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:45 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:45.877622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d1002-2454-4530-97ad-3a59ab5e3794 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:45.890101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d1002-2454-4530-97ad-3a59ab5e3794 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:45.895368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d6e7a-1d7e-4214-9c81-0f15971401eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:45.896051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6e7a-1d7e-4214-9c81-0f15971401eb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:45.896335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6e7a-1d7e-4214-9c81-0f15971401eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:45.896666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6e7a-1d7e-4214-9c81-0f15971401eb admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:45.897487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d6e7a-1d7e-4214-9c81-0f15971401eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:45.899318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d6e7a-1d7e-4214-9c81-0f15971401eb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:45.917323 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3262/6536] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:45.919489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b8a34-0a7d-4ee4-a4fe-f72fcf43eabf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:45.931425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b8a34-0a7d-4ee4-a4fe-f72fcf43eabf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:45.937731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c9c1c-3555-4aed-b720-987539127911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:45.939198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c9c1c-3555-4aed-b720-987539127911 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:45.939478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c9c1c-3555-4aed-b720-987539127911 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:45.939753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c9c1c-3555-4aed-b720-987539127911 admin admin] PATH_INFO: `/v3/projects/2a291e838df142a0b36b8db0836a5160/users/9bffa09ff5994961abb90f615217bd81/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:45.960586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c9c1c-3555-4aed-b720-987539127911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a291e838df142a0b36b8db0836a5160, user_id=9bffa09ff5994961abb90f615217bd81, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:45.964150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c9c1c-3555-4aed-b720-987539127911 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:45.984061 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3275/6537] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:45 2022] PUT /identity/v3/projects/2a291e838df142a0b36b8db0836a5160/users/9bffa09ff5994961abb90f615217bd81/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:45.988285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d6e7a-1d7e-4214-9c81-0f15971401eb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:46.004844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d6e7a-1d7e-4214-9c81-0f15971401eb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:46.091326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574014e-f8f7-44dd-9d85-e0247c13946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:46.092908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574014e-f8f7-44dd-9d85-e0247c13946b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:46.093571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574014e-f8f7-44dd-9d85-e0247c13946b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:46.094035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574014e-f8f7-44dd-9d85-e0247c13946b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:46.095443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574014e-f8f7-44dd-9d85-e0247c13946b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:46.097273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574014e-f8f7-44dd-9d85-e0247c13946b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:46.112827 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3263/6538] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:46.114429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c9c1c-3555-4aed-b720-987539127911 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:46.127053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c9c1c-3555-4aed-b720-987539127911 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:46.139362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859682b3-97ed-4866-bcaa-09d5e4baeb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:46.139362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859682b3-97ed-4866-bcaa-09d5e4baeb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:46.139362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859682b3-97ed-4866-bcaa-09d5e4baeb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:46.139362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859682b3-97ed-4866-bcaa-09d5e4baeb63 admin admin] PATH_INFO: `/v3/projects/2a291e838df142a0b36b8db0836a5160/users/9bffa09ff5994961abb90f615217bd81/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:46.142439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859682b3-97ed-4866-bcaa-09d5e4baeb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a291e838df142a0b36b8db0836a5160, user_id=9bffa09ff5994961abb90f615217bd81, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:46.167342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859682b3-97ed-4866-bcaa-09d5e4baeb63 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:46.190661 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3276/6539] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:46 2022] PUT /identity/v3/projects/2a291e838df142a0b36b8db0836a5160/users/9bffa09ff5994961abb90f615217bd81/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:46.191679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104a21c-6753-418c-bff1-2e1332e6a0ab None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:46.191932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104a21c-6753-418c-bff1-2e1332e6a0ab None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:46.192218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104a21c-6753-418c-bff1-2e1332e6a0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:46.237365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a104a21c-6753-418c-bff1-2e1332e6a0ab None None] MFA Rules not processed for user `9bffa09ff5994961abb90f615217bd81`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:46.238858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a104a21c-6753-418c-bff1-2e1332e6a0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:46.282169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:46.355953 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3264/6540] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:46.364919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859682b3-97ed-4866-bcaa-09d5e4baeb63 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:46.366696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-859682b3-97ed-4866-bcaa-09d5e4baeb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:46.440260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:46.477293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859682b3-97ed-4866-bcaa-09d5e4baeb63 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:46.489508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45f9ab-a7f4-4950-972b-189466d7fe67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:46.490149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45f9ab-a7f4-4950-972b-189466d7fe67 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:46.490723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45f9ab-a7f4-4950-972b-189466d7fe67 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:46.490845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45f9ab-a7f4-4950-972b-189466d7fe67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:46.624826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104a21c-6753-418c-bff1-2e1332e6a0ab None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:46.626353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a104a21c-6753-418c-bff1-2e1332e6a0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:46.660626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45f9ab-a7f4-4950-972b-189466d7fe67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:46.665878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45f9ab-a7f4-4950-972b-189466d7fe67 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:46.710970 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3277/6541] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:46.796207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104a21c-6753-418c-bff1-2e1332e6a0ab None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:46.803761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:46.804678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:46.805104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:46.809765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] PATH_INFO: `/v3/users/8f49130151dd4f5cbf86577939726770` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:46.813633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f49130151dd4f5cbf86577939726770)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:46.818187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:46.914702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f49130151dd4f5cbf86577939726770'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:46.916613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f49130151dd4f5cbf86577939726770'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:46.935689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f49130151dd4f5cbf86577939726770'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:46.946701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f49130151dd4f5cbf86577939726770'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:46.958186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f49130151dd4f5cbf86577939726770'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:46.968161 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3265/6542] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:46 2022] DELETE /identity/v3/users/8f49130151dd4f5cbf86577939726770 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:47.476991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211efc-5942-4b4d-9f32-932a7bc100a8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:47.477280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211efc-5942-4b4d-9f32-932a7bc100a8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:47.477582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211efc-5942-4b4d-9f32-932a7bc100a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:47.603581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b4211efc-5942-4b4d-9f32-932a7bc100a8 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:47.604775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b4211efc-5942-4b4d-9f32-932a7bc100a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:47.618882 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3278/6543] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:47 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:47.622589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:47.624697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:47.738998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:47.770720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d9d9d-d60d-491e-9d04-edc666a55c20 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:47.781276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560b529-c4ba-4b38-b135-f61d40884837 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5d2954d5b340fa883d953beee08e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0102789e989441c4a2afd8606cf1d3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:47.782125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560b529-c4ba-4b38-b135-f61d40884837 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:47.783532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560b529-c4ba-4b38-b135-f61d40884837 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:47.783532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560b529-c4ba-4b38-b135-f61d40884837 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81/password` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:47.855402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a560b529-c4ba-4b38-b135-f61d40884837 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:47.868273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4211efc-5942-4b4d-9f32-932a7bc100a8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:47.870149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b4211efc-5942-4b4d-9f32-932a7bc100a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:47.874144 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3266/6544] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:54:47 2022] POST /identity/v3/users/cb5d2954d5b340fa883d953beee08e81/password => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:48.122017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4211efc-5942-4b4d-9f32-932a7bc100a8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:48.128356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:48.129077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:48.129421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:48.130148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] PATH_INFO: `/v3/projects/afefc5b5767f4fa293c275420346fa64` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:48.131655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afefc5b5767f4fa293c275420346fa64)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:48.133839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:48.272956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afefc5b5767f4fa293c275420346fa64', 'request_id': 'req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:48.283444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afefc5b5767f4fa293c275420346fa64', 'request_id': 'req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:48.303708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afefc5b5767f4fa293c275420346fa64', 'request_id': 'req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:48.352482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] The token cache is being invalidate because project afefc5b5767f4fa293c275420346fa64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:48.356396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:48.357179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ec4e6755-d8d7-4772-ba18-0ab7d5ca3131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:48.362838 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3279/6545] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:47 2022] DELETE /identity/v3/projects/afefc5b5767f4fa293c275420346fa64 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:48.376436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78935c-c57c-4452-b107-0d4ad126e656 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:48.376885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78935c-c57c-4452-b107-0d4ad126e656 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:48.377173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78935c-c57c-4452-b107-0d4ad126e656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:48.481618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fb78935c-c57c-4452-b107-0d4ad126e656 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:48.481618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fb78935c-c57c-4452-b107-0d4ad126e656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:48.594304 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3267/6546] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:48.604700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0ec26-c433-4ab3-8451-f7f59dba20b2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:48.605129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0ec26-c433-4ab3-8451-f7f59dba20b2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:48.605508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0ec26-c433-4ab3-8451-f7f59dba20b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:48.633848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:48.673077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-eda0ec26-c433-4ab3-8451-f7f59dba20b2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:48.675872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-eda0ec26-c433-4ab3-8451-f7f59dba20b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:48.700402 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3280/6547] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:48.705230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78935c-c57c-4452-b107-0d4ad126e656 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:48.719243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78935c-c57c-4452-b107-0d4ad126e656 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:48.736136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c24325-73d2-41c9-9352-a47083e18627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:48.736908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c24325-73d2-41c9-9352-a47083e18627 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:48.737289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c24325-73d2-41c9-9352-a47083e18627 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:48.737780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c24325-73d2-41c9-9352-a47083e18627 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:48.738675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c24325-73d2-41c9-9352-a47083e18627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:48.739078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c24325-73d2-41c9-9352-a47083e18627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:48.740839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c24325-73d2-41c9-9352-a47083e18627 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:48.771617 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3268/6548] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:54:48.776635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0ec26-c433-4ab3-8451-f7f59dba20b2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:48.790562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0ec26-c433-4ab3-8451-f7f59dba20b2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:48.809209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dee881-0564-442b-9046-3800cd345349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:48.817617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dee881-0564-442b-9046-3800cd345349 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:48.818239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dee881-0564-442b-9046-3800cd345349 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:48.819992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dee881-0564-442b-9046-3800cd345349 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:48.822936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dee881-0564-442b-9046-3800cd345349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:48.829899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dee881-0564-442b-9046-3800cd345349 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:48.889805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002b73d-c76e-45ea-a4fc-d118bcfc214d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:48.890177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002b73d-c76e-45ea-a4fc-d118bcfc214d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:48.890469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002b73d-c76e-45ea-a4fc-d118bcfc214d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:48.915334 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3281/6549] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:48 2022] POST /identity/v3/projects => generated 401 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:48.920627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dee881-0564-442b-9046-3800cd345349 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:48.922652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5002b73d-c76e-45ea-a4fc-d118bcfc214d None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:48.923888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5002b73d-c76e-45ea-a4fc-d118bcfc214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:48.928083 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3269/6550] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:48 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 15:54:48.933004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546f91f-0e66-4908-b403-2ca3b0bf89bb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:48.934085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546f91f-0e66-4908-b403-2ca3b0bf89bb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:48.937933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546f91f-0e66-4908-b403-2ca3b0bf89bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:48.944477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a546f91f-0e66-4908-b403-2ca3b0bf89bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-a546f91f-0e66-4908-b403-2ca3b0bf89bb None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 15:54:49.056138 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:49.057380 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 29 15:54:49.058962 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:49.061932 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3270/6551] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:48 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:54:49.065420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda8fe8-95d1-49c6-8973-b05c78e63483 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:49.065716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda8fe8-95d1-49c6-8973-b05c78e63483 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:49.065998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda8fe8-95d1-49c6-8973-b05c78e63483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:49.092995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dee881-0564-442b-9046-3800cd345349 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:49.113085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1af2-f388-4b55-858e-ecb3ba286c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:49.114325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1af2-f388-4b55-858e-ecb3ba286c66 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:49.114605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1af2-f388-4b55-858e-ecb3ba286c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:49.114883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1af2-f388-4b55-858e-ecb3ba286c66 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:49.115535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed1af2-f388-4b55-858e-ecb3ba286c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:49.117566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed1af2-f388-4b55-858e-ecb3ba286c66 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:49.160160 n-d-854882-3 devstack@keystone.service[89680]: WARNING keystone.server.flask.application [None req-9bda8fe8-95d1-49c6-8973-b05c78e63483 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 15:54:49.165433 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3271/6552] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:49 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 99 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 29 15:54:49.178774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317be2c7-af5f-4fbe-97f0-eb08e93f2ab9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:49.181175 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3282/6553] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:48 2022] POST /identity/v3/users => generated 301 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:49.184562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317be2c7-af5f-4fbe-97f0-eb08e93f2ab9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:49.184942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317be2c7-af5f-4fbe-97f0-eb08e93f2ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:49.185772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1af2-f388-4b55-858e-ecb3ba286c66 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:49.203320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1af2-f388-4b55-858e-ecb3ba286c66 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:49.227028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e4f02-84f2-4393-99a2-2efcce70d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:49.227672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e4f02-84f2-4393-99a2-2efcce70d75d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:49.227952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e4f02-84f2-4393-99a2-2efcce70d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:49.228230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e4f02-84f2-4393-99a2-2efcce70d75d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:49.228950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e4f02-84f2-4393-99a2-2efcce70d75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:49.233758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e4f02-84f2-4393-99a2-2efcce70d75d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:49.258362 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3283/6554] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:49.263802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e4f02-84f2-4393-99a2-2efcce70d75d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:49.265985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-317be2c7-af5f-4fbe-97f0-eb08e93f2ab9 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:49.267297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-317be2c7-af5f-4fbe-97f0-eb08e93f2ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:49.289862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e4f02-84f2-4393-99a2-2efcce70d75d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:49.290170 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3272/6555] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:49.291054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317be2c7-af5f-4fbe-97f0-eb08e93f2ab9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:49.303547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317be2c7-af5f-4fbe-97f0-eb08e93f2ab9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:49.305279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b203a0-931c-41d0-908a-e4f489c33cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:49.305897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b203a0-931c-41d0-908a-e4f489c33cfa admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:49.306283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b203a0-931c-41d0-908a-e4f489c33cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:49.306535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b203a0-931c-41d0-908a-e4f489c33cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:49.307075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b203a0-931c-41d0-908a-e4f489c33cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:49.309523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910a406-c194-4ac8-b3f1-e4ffa28de162 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5d2954d5b340fa883d953beee08e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0102789e989441c4a2afd8606cf1d3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:49.309797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b203a0-931c-41d0-908a-e4f489c33cfa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:49.310550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910a406-c194-4ac8-b3f1-e4ffa28de162 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:49.310950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910a406-c194-4ac8-b3f1-e4ffa28de162 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:49.311497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910a406-c194-4ac8-b3f1-e4ffa28de162 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81/password` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:49.324224 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3284/6556] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:49.340002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b203a0-931c-41d0-908a-e4f489c33cfa admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:49.342924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=93,keystone:UPDATE=3,keystone:INSERT=2,keystone:DELETE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:49.357649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b203a0-931c-41d0-908a-e4f489c33cfa admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:49.364620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20316aa-4cd2-4eee-b2a7-eb77f9ae3de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:49.365660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20316aa-4cd2-4eee-b2a7-eb77f9ae3de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:49.366169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20316aa-4cd2-4eee-b2a7-eb77f9ae3de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:49.366504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20316aa-4cd2-4eee-b2a7-eb77f9ae3de1 admin admin] PATH_INFO: `/v3/projects/2a55a4468fd2496797ccdddf1eb601fd/users/7d8c33c997f14ff3bde7151de6eb7955/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:49.391916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20316aa-4cd2-4eee-b2a7-eb77f9ae3de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a55a4468fd2496797ccdddf1eb601fd, user_id=7d8c33c997f14ff3bde7151de6eb7955, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:49.393166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0910a406-c194-4ac8-b3f1-e4ffa28de162 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:49.396207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20316aa-4cd2-4eee-b2a7-eb77f9ae3de1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:49.407199 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3273/6557] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:54:49 2022] POST /identity/v3/users/cb5d2954d5b340fa883d953beee08e81/password => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:49.415974 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3285/6558] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:49 2022] PUT /identity/v3/projects/2a55a4468fd2496797ccdddf1eb601fd/users/7d8c33c997f14ff3bde7151de6eb7955/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:49.428451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b4a14-4e61-4f6a-aa1d-99211eaa746f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:49.429334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b4a14-4e61-4f6a-aa1d-99211eaa746f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:49.429848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b4a14-4e61-4f6a-aa1d-99211eaa746f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:49.468300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d63b4a14-4e61-4f6a-aa1d-99211eaa746f None None] MFA Rules not processed for user `7d8c33c997f14ff3bde7151de6eb7955`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:49.470016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d63b4a14-4e61-4f6a-aa1d-99211eaa746f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:49.563610 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3274/6559] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:49.566847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20316aa-4cd2-4eee-b2a7-eb77f9ae3de1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:49.710532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20316aa-4cd2-4eee-b2a7-eb77f9ae3de1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:49.716327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802ad79-b9a2-434e-998b-ba8508c0f356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:49.716743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802ad79-b9a2-434e-998b-ba8508c0f356 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:49.717132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802ad79-b9a2-434e-998b-ba8508c0f356 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:49.717564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802ad79-b9a2-434e-998b-ba8508c0f356 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:49.718658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802ad79-b9a2-434e-998b-ba8508c0f356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:49.721456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802ad79-b9a2-434e-998b-ba8508c0f356 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:49.780604 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3286/6560] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:49 2022] POST /identity/v3/projects => generated 403 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:49.783518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b4a14-4e61-4f6a-aa1d-99211eaa746f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:49.797567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b4a14-4e61-4f6a-aa1d-99211eaa746f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:49.971098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38802f-6d71-44a1-b75e-674108850a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:49.972279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38802f-6d71-44a1-b75e-674108850a77 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:49.972678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38802f-6d71-44a1-b75e-674108850a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:49.973162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38802f-6d71-44a1-b75e-674108850a77 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:49.974659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38802f-6d71-44a1-b75e-674108850a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:49.977908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38802f-6d71-44a1-b75e-674108850a77 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:50.028239 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3275/6561] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:49 2022] POST /identity/v3/users => generated 308 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:50.029476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802ad79-b9a2-434e-998b-ba8508c0f356 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:50.036196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:50.045316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802ad79-b9a2-434e-998b-ba8508c0f356 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:50.050506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efa352-3fc3-4d8e-a5dd-6b94404fb8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:50.051179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa352-3fc3-4d8e-a5dd-6b94404fb8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:50.051928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa352-3fc3-4d8e-a5dd-6b94404fb8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:50.051928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa352-3fc3-4d8e-a5dd-6b94404fb8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:50.052511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efa352-3fc3-4d8e-a5dd-6b94404fb8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:50.054522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efa352-3fc3-4d8e-a5dd-6b94404fb8d9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:50.072580 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3287/6562] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:50.077648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38802f-6d71-44a1-b75e-674108850a77 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:50.091975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38802f-6d71-44a1-b75e-674108850a77 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:50.104111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fd4af-1dc0-4aa8-bd81-78688443480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:50.105196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd4af-1dc0-4aa8-bd81-78688443480b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:50.105196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd4af-1dc0-4aa8-bd81-78688443480b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:50.105571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd4af-1dc0-4aa8-bd81-78688443480b admin admin] PATH_INFO: `/v3/projects/73f1b1d7a49d4bb9a7a5b40c43094b8c/users/85202de6cb7b4c68b7b45796dd8a12f2/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:50.150572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fd4af-1dc0-4aa8-bd81-78688443480b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f1b1d7a49d4bb9a7a5b40c43094b8c, user_id=85202de6cb7b4c68b7b45796dd8a12f2, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:50.150904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efa352-3fc3-4d8e-a5dd-6b94404fb8d9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:50.152701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-14efa352-3fc3-4d8e-a5dd-6b94404fb8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:50.174174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fd4af-1dc0-4aa8-bd81-78688443480b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:50.181349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efa352-3fc3-4d8e-a5dd-6b94404fb8d9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:50.188425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba749b-bbee-4802-80ee-a989d7d08be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:50.189079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba749b-bbee-4802-80ee-a989d7d08be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:50.189362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba749b-bbee-4802-80ee-a989d7d08be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:50.189671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba749b-bbee-4802-80ee-a989d7d08be6 admin admin] PATH_INFO: `/v3/users/dc8f7bc05b984ea0a3d96aea8a65d139` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:50.194190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba749b-bbee-4802-80ee-a989d7d08be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8f7bc05b984ea0a3d96aea8a65d139)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:50.196141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba749b-bbee-4802-80ee-a989d7d08be6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:50.200011 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3276/6563] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:50 2022] PUT /identity/v3/projects/73f1b1d7a49d4bb9a7a5b40c43094b8c/users/85202de6cb7b4c68b7b45796dd8a12f2/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:50.204263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fd4af-1dc0-4aa8-bd81-78688443480b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:50.286641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=6,keystone:DELETE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:50.327904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b0ba749b-bbee-4802-80ee-a989d7d08be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8f7bc05b984ea0a3d96aea8a65d139'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:50.328740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b0ba749b-bbee-4802-80ee-a989d7d08be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8f7bc05b984ea0a3d96aea8a65d139'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:50.339703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fd4af-1dc0-4aa8-bd81-78688443480b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:50.353660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c756ac-6882-4f8d-b72e-2eae9a7a0292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:50.354337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c756ac-6882-4f8d-b72e-2eae9a7a0292 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:50.354624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c756ac-6882-4f8d-b72e-2eae9a7a0292 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:50.354902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c756ac-6882-4f8d-b72e-2eae9a7a0292 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:50.356103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c756ac-6882-4f8d-b72e-2eae9a7a0292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:50.357748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c756ac-6882-4f8d-b72e-2eae9a7a0292 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:50.365758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b0ba749b-bbee-4802-80ee-a989d7d08be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8f7bc05b984ea0a3d96aea8a65d139'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:50.366916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b0ba749b-bbee-4802-80ee-a989d7d08be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8f7bc05b984ea0a3d96aea8a65d139'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:50.376614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b0ba749b-bbee-4802-80ee-a989d7d08be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8f7bc05b984ea0a3d96aea8a65d139'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:50.390568 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3277/6564] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:54:50.394496 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3288/6565] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:50 2022] DELETE /identity/v3/users/dc8f7bc05b984ea0a3d96aea8a65d139 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:50.394757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c756ac-6882-4f8d-b72e-2eae9a7a0292 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:50.396535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-96c756ac-6882-4f8d-b72e-2eae9a7a0292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:50.417286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fbd9e-73b7-4712-aa9a-5fc912d920e7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:50.419304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fbd9e-73b7-4712-aa9a-5fc912d920e7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:50.419779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fbd9e-73b7-4712-aa9a-5fc912d920e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:50.428094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c756ac-6882-4f8d-b72e-2eae9a7a0292 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:50.465761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-139fbd9e-73b7-4712-aa9a-5fc912d920e7 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:50.469256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-139fbd9e-73b7-4712-aa9a-5fc912d920e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:50.480918 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3289/6566] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:50 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:50.486131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f9011-6b0e-4099-be79-933440d32887 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:50.488528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f9011-6b0e-4099-be79-933440d32887 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:50.488825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f9011-6b0e-4099-be79-933440d32887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:50.521515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a17f9011-6b0e-4099-be79-933440d32887 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:50.522245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a17f9011-6b0e-4099-be79-933440d32887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:50.581797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8191-2923-4f27-bd63-3d0a580f962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:50.582502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8191-2923-4f27-bd63-3d0a580f962c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:50.582784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8191-2923-4f27-bd63-3d0a580f962c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:50.583063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8191-2923-4f27-bd63-3d0a580f962c admin admin] PATH_INFO: `/v3/projects/73f1b1d7a49d4bb9a7a5b40c43094b8c/users/85202de6cb7b4c68b7b45796dd8a12f2/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:50.585169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8191-2923-4f27-bd63-3d0a580f962c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f1b1d7a49d4bb9a7a5b40c43094b8c, user_id=85202de6cb7b4c68b7b45796dd8a12f2, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:50.587960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8191-2923-4f27-bd63-3d0a580f962c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:50.618757 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3278/6567] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:50 2022] PUT /identity/v3/projects/73f1b1d7a49d4bb9a7a5b40c43094b8c/users/85202de6cb7b4c68b7b45796dd8a12f2/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:50.630390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304162a3-b0b2-4b59-a59c-791b2aef8350 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:50.630390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304162a3-b0b2-4b59-a59c-791b2aef8350 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:50.630698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304162a3-b0b2-4b59-a59c-791b2aef8350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:50.646725 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3290/6568] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:50.660015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f9011-6b0e-4099-be79-933440d32887 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:50.681030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f9011-6b0e-4099-be79-933440d32887 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:50.699539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-304162a3-b0b2-4b59-a59c-791b2aef8350 None None] MFA Rules not processed for user `85202de6cb7b4c68b7b45796dd8a12f2`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:50.701047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-304162a3-b0b2-4b59-a59c-791b2aef8350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:50.814347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc68e2-7217-47b6-a6b0-a4501dde15e4 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5d2954d5b340fa883d953beee08e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0102789e989441c4a2afd8606cf1d3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:50.814955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc68e2-7217-47b6-a6b0-a4501dde15e4 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:50.815365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc68e2-7217-47b6-a6b0-a4501dde15e4 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:50.815879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc68e2-7217-47b6-a6b0-a4501dde15e4 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81/password` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:50.832929 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3279/6569] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:50 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:50.838284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304162a3-b0b2-4b59-a59c-791b2aef8350 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:50.858660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:50.861164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304162a3-b0b2-4b59-a59c-791b2aef8350 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:50.896083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d30794-e11a-4e51-a0aa-f38a0639c8d2 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85202de6cb7b4c68b7b45796dd8a12f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73f1b1d7a49d4bb9a7a5b40c43094b8c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:50.898213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30794-e11a-4e51-a0aa-f38a0639c8d2 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:50.903480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30794-e11a-4e51-a0aa-f38a0639c8d2 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:50.904423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30794-e11a-4e51-a0aa-f38a0639c8d2 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:50.905701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d30794-e11a-4e51-a0aa-f38a0639c8d2 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:50.911849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d30794-e11a-4e51-a0aa-f38a0639c8d2 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:50.942509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1fc68e2-7217-47b6-a6b0-a4501dde15e4 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:50.946598 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3280/6570] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:54:50 2022] POST /identity/v3/roles => generated 239 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:50.947725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d30794-e11a-4e51-a0aa-f38a0639c8d2 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:50.950608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-38d30794-e11a-4e51-a0aa-f38a0639c8d2 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:50.965717 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3291/6571] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:54:50 2022] POST /identity/v3/users/cb5d2954d5b340fa883d953beee08e81/password => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:50.967845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc68e2-7217-47b6-a6b0-a4501dde15e4 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:50.991102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc68e2-7217-47b6-a6b0-a4501dde15e4 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:51.002529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa89a6-9d84-4495-890b-e6f78bc167bb tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85202de6cb7b4c68b7b45796dd8a12f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73f1b1d7a49d4bb9a7a5b40c43094b8c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:51.003237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa89a6-9d84-4495-890b-e6f78bc167bb tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.003521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa89a6-9d84-4495-890b-e6f78bc167bb tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.003804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa89a6-9d84-4495-890b-e6f78bc167bb tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] PATH_INFO: `/v3/projects/2a55a4468fd2496797ccdddf1eb601fd/users/7d8c33c997f14ff3bde7151de6eb7955/roles/b22efce687d647a09e135d1fbcb71864` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.006925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:51.013766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa89a6-9d84-4495-890b-e6f78bc167bb tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2a55a4468fd2496797ccdddf1eb601fd, user_id=7d8c33c997f14ff3bde7151de6eb7955, role_id=b22efce687d647a09e135d1fbcb71864)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:51.019426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa89a6-9d84-4495-890b-e6f78bc167bb tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:51.038898 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3292/6572] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:50 2022] PUT /identity/v3/projects/2a55a4468fd2496797ccdddf1eb601fd/users/7d8c33c997f14ff3bde7151de6eb7955/roles/b22efce687d647a09e135d1fbcb71864 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:51.044338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa89a6-9d84-4495-890b-e6f78bc167bb tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:51.047428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-50fa89a6-9d84-4495-890b-e6f78bc167bb tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:51.049870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d30794-e11a-4e51-a0aa-f38a0639c8d2 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:51.139757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:51.140953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.141460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.142096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] PATH_INFO: `/v3/projects/da6f1599da704dbc9ec86f3638638bba` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.143677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6f1599da704dbc9ec86f3638638bba)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:51.147854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:51.191081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa89a6-9d84-4495-890b-e6f78bc167bb tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:51.204833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100dd0e-d264-4257-9568-4d6b1c11a274 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8c33c997f14ff3bde7151de6eb7955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a55a4468fd2496797ccdddf1eb601fd', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-267539910', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:51.205949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100dd0e-d264-4257-9568-4d6b1c11a274 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.206661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100dd0e-d264-4257-9568-4d6b1c11a274 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.207464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100dd0e-d264-4257-9568-4d6b1c11a274 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] PATH_INFO: `/v3/users/7d8c33c997f14ff3bde7151de6eb7955/application_credentials` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.210051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100dd0e-d264-4257-9568-4d6b1c11a274 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] RBAC: Authorizing `identity:create_application_credential(user_id=7d8c33c997f14ff3bde7151de6eb7955)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:51.211572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100dd0e-d264-4257-9568-4d6b1c11a274 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:51.229605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6f1599da704dbc9ec86f3638638bba', 'request_id': 'req-98b6161a-579a-4d09-aa54-8269547c520f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:51.238300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6f1599da704dbc9ec86f3638638bba', 'request_id': 'req-98b6161a-579a-4d09-aa54-8269547c520f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:51.249778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6f1599da704dbc9ec86f3638638bba', 'request_id': 'req-98b6161a-579a-4d09-aa54-8269547c520f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:51.273803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] The token cache is being invalidate because project da6f1599da704dbc9ec86f3638638bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:51.274293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:51.275125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-98b6161a-579a-4d09-aa54-8269547c520f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:51.282922 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3281/6573] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:50 2022] DELETE /identity/v3/projects/da6f1599da704dbc9ec86f3638638bba => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:51.286541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b20021-bd7d-4fc6-860e-a35d6819ba62 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.286541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b20021-bd7d-4fc6-860e-a35d6819ba62 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.289706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b20021-bd7d-4fc6-860e-a35d6819ba62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.344092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f9b20021-bd7d-4fc6-860e-a35d6819ba62 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:51.345424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f9b20021-bd7d-4fc6-860e-a35d6819ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:51.352117 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3293/6574] 10.222.0.16 () {60 vars in 1315 bytes} [Mon Aug 29 15:54:51 2022] POST /identity/v3/users/7d8c33c997f14ff3bde7151de6eb7955/application_credentials => generated 659 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:51.357537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1a564-7da4-4e26-a107-c69d5d70cd66 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.358039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1a564-7da4-4e26-a107-c69d5d70cd66 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.358512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1a564-7da4-4e26-a107-c69d5d70cd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.408626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-32a1a564-7da4-4e26-a107-c69d5d70cd66 None None] MFA Rules not processed for user `7d8c33c997f14ff3bde7151de6eb7955`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:51.411226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-32a1a564-7da4-4e26-a107-c69d5d70cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:51.456669 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3282/6575] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:51.459690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e221f-bbe7-4917-8b3d-45905a2587ca None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.461865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e221f-bbe7-4917-8b3d-45905a2587ca None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.462152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e221f-bbe7-4917-8b3d-45905a2587ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.481895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:51.507895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-dd9e221f-bbe7-4917-8b3d-45905a2587ca None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:51.509115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dd9e221f-bbe7-4917-8b3d-45905a2587ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:51.518006 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3283/6576] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:51.522268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e221f-bbe7-4917-8b3d-45905a2587ca None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:51.533868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e221f-bbe7-4917-8b3d-45905a2587ca None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:51.539624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e20809-2bc0-4492-9b18-8d024e0e53eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:51.540539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e20809-2bc0-4492-9b18-8d024e0e53eb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.540918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e20809-2bc0-4492-9b18-8d024e0e53eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.541453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e20809-2bc0-4492-9b18-8d024e0e53eb admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.542273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e20809-2bc0-4492-9b18-8d024e0e53eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:51.542810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e20809-2bc0-4492-9b18-8d024e0e53eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:51.544892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e20809-2bc0-4492-9b18-8d024e0e53eb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:51.547060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:51.564414 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3284/6577] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:54:51.568444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e20809-2bc0-4492-9b18-8d024e0e53eb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:51.581378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e20809-2bc0-4492-9b18-8d024e0e53eb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:51.587438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafaf26-935f-4903-a947-aa7f7572850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:51.588289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafaf26-935f-4903-a947-aa7f7572850f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.588904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafaf26-935f-4903-a947-aa7f7572850f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.589288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafaf26-935f-4903-a947-aa7f7572850f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.590213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafaf26-935f-4903-a947-aa7f7572850f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:51.592849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafaf26-935f-4903-a947-aa7f7572850f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:51.600128 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3294/6578] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:51 2022] POST /identity/v3/auth/tokens => generated 3394 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 29 15:54:51.604839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1a564-7da4-4e26-a107-c69d5d70cd66 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:51.609741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-32a1a564-7da4-4e26-a107-c69d5d70cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:51.633745 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3285/6579] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:51 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:51.637974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafaf26-935f-4903-a947-aa7f7572850f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:51.708632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1a564-7da4-4e26-a107-c69d5d70cd66 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:51.761929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafaf26-935f-4903-a947-aa7f7572850f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:51.776180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d94ec-4bde-4ff2-af4d-75b767ab6563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:51.777475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d94ec-4bde-4ff2-af4d-75b767ab6563 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.779710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d94ec-4bde-4ff2-af4d-75b767ab6563 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.781434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a96c9-69bf-4fa3-aef2-c02246da6540 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8c33c997f14ff3bde7151de6eb7955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a55a4468fd2496797ccdddf1eb601fd', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-267539910', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:51.781964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d94ec-4bde-4ff2-af4d-75b767ab6563 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.782266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a96c9-69bf-4fa3-aef2-c02246da6540 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.782628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a96c9-69bf-4fa3-aef2-c02246da6540 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.782980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a96c9-69bf-4fa3-aef2-c02246da6540 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] PATH_INFO: `/v3/users/7d8c33c997f14ff3bde7151de6eb7955/application_credentials/4817de03c9c24e319bfcd6367befa55a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.783501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d94ec-4bde-4ff2-af4d-75b767ab6563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:51.784539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a96c9-69bf-4fa3-aef2-c02246da6540 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] RBAC: Authorizing `identity:delete_application_credential(user_id=7d8c33c997f14ff3bde7151de6eb7955, application_credential_id=4817de03c9c24e319bfcd6367befa55a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:51.786347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a96c9-69bf-4fa3-aef2-c02246da6540 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:51.787586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d94ec-4bde-4ff2-af4d-75b767ab6563 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:51.816264 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3295/6580] 10.222.0.16 () {58 vars in 1395 bytes} [Mon Aug 29 15:54:51 2022] DELETE /identity/v3/users/7d8c33c997f14ff3bde7151de6eb7955/application_credentials/4817de03c9c24e319bfcd6367befa55a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:51.820891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a96c9-69bf-4fa3-aef2-c02246da6540 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:51.824465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-935a96c9-69bf-4fa3-aef2-c02246da6540 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:51.833878 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3286/6581] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:51 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:51.838141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d94ec-4bde-4ff2-af4d-75b767ab6563 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:51.859791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d94ec-4bde-4ff2-af4d-75b767ab6563 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:51.871403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:51.877204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29153634-ec08-4206-991e-cde882837b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:51.878267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29153634-ec08-4206-991e-cde882837b77 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.878560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29153634-ec08-4206-991e-cde882837b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.878843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29153634-ec08-4206-991e-cde882837b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.879510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29153634-ec08-4206-991e-cde882837b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:51.884267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29153634-ec08-4206-991e-cde882837b77 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:51.913530 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3287/6582] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:51 2022] GET /identity/v3/roles => generated 1650 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:51.916131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a96c9-69bf-4fa3-aef2-c02246da6540 tempest-ApplicationCredentialsV3AdminTest-475742010 tempest-ApplicationCredentialsV3AdminTest-475742010-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:51.918213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29153634-ec08-4206-991e-cde882837b77 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:51.921983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85202de6cb7b4c68b7b45796dd8a12f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73f1b1d7a49d4bb9a7a5b40c43094b8c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:51.922737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.923126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.923704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] PATH_INFO: `/v3/roles/b22efce687d647a09e135d1fbcb71864` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.925743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b22efce687d647a09e135d1fbcb71864)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:51.928976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:51.930589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29153634-ec08-4206-991e-cde882837b77 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:51.944449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c255c4-ae9f-409c-b016-2efab974487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:51.945084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c255c4-ae9f-409c-b016-2efab974487d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.945373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c255c4-ae9f-409c-b016-2efab974487d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.945735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c255c4-ae9f-409c-b016-2efab974487d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.946512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c255c4-ae9f-409c-b016-2efab974487d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:51.948505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c255c4-ae9f-409c-b016-2efab974487d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:51.978178 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3288/6583] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:51 2022] GET /identity/v3/roles => generated 1650 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:54:51.986344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Invalidating the token cache because role b22efce687d647a09e135d1fbcb71864 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:51.986521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babfef-e002-43a5-907f-170fdb7b7800 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:51.986626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:51.986706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babfef-e002-43a5-907f-170fdb7b7800 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:51.986950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babfef-e002-43a5-907f-170fdb7b7800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:51.987519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:51.990377 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3296/6584] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:51 2022] DELETE /identity/v3/roles/b22efce687d647a09e135d1fbcb71864 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:51.991219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:51.994104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:52.043184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-25babfef-e002-43a5-907f-170fdb7b7800 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:52.044210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-25babfef-e002-43a5-907f-170fdb7b7800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:52.060938 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3289/6585] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:51 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:52.061849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25babfef-e002-43a5-907f-170fdb7b7800 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:52.063148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-25babfef-e002-43a5-907f-170fdb7b7800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:52.082345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975fb37-96df-4128-bc36-2e51856114e5 tempest-ApplicationCredentialsV3AdminTest-1842872023 tempest-ApplicationCredentialsV3AdminTest-1842872023-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:52.084255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25babfef-e002-43a5-907f-170fdb7b7800 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:52.089018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4d8ce-be6c-461e-970f-e8183464922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:52.089185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465af79d-40a7-4733-9404-31e4507193c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:52.090330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af79d-40a7-4733-9404-31e4507193c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:52.090613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af79d-40a7-4733-9404-31e4507193c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:52.090889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af79d-40a7-4733-9404-31e4507193c6 admin admin] PATH_INFO: `/v3/users/7d8c33c997f14ff3bde7151de6eb7955` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:52.091329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4d8ce-be6c-461e-970f-e8183464922d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:52.091831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4d8ce-be6c-461e-970f-e8183464922d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:52.092072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465af79d-40a7-4733-9404-31e4507193c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8c33c997f14ff3bde7151de6eb7955)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:52.092770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4d8ce-be6c-461e-970f-e8183464922d admin admin] PATH_INFO: `/v3/projects/176d574b0f5e45d7852c7758d0ac7b91/users/4d0b8591c8df4445845d673823d1e3bf/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:52.094194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465af79d-40a7-4733-9404-31e4507193c6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:52.157042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4d8ce-be6c-461e-970f-e8183464922d admin admin] RBAC: Authorizing `identity:create_grant(project_id=176d574b0f5e45d7852c7758d0ac7b91, user_id=4d0b8591c8df4445845d673823d1e3bf, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:52.157042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4d8ce-be6c-461e-970f-e8183464922d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:52.163171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-465af79d-40a7-4733-9404-31e4507193c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8c33c997f14ff3bde7151de6eb7955'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:52.163987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-465af79d-40a7-4733-9404-31e4507193c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8c33c997f14ff3bde7151de6eb7955'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:52.173658 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3297/6586] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:51 2022] PUT /identity/v3/projects/176d574b0f5e45d7852c7758d0ac7b91/users/4d0b8591c8df4445845d673823d1e3bf/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:52.189425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe753-b91a-422b-aaa7-310ce182ac33 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:52.189760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe753-b91a-422b-aaa7-310ce182ac33 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:52.190260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe753-b91a-422b-aaa7-310ce182ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:52.218160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-465af79d-40a7-4733-9404-31e4507193c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8c33c997f14ff3bde7151de6eb7955'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:52.220253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-71bbe753-b91a-422b-aaa7-310ce182ac33 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:52.221470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-71bbe753-b91a-422b-aaa7-310ce182ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:52.239658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-465af79d-40a7-4733-9404-31e4507193c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8c33c997f14ff3bde7151de6eb7955'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:52.259428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-465af79d-40a7-4733-9404-31e4507193c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8c33c997f14ff3bde7151de6eb7955'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:52.272698 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3290/6587] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:52 2022] DELETE /identity/v3/users/7d8c33c997f14ff3bde7151de6eb7955 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:52.278299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9734092-def1-42e4-a36d-09e07d0a69f7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:52.278790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9734092-def1-42e4-a36d-09e07d0a69f7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:52.279510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9734092-def1-42e4-a36d-09e07d0a69f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:52.382079 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3298/6588] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:52.384311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c8c5c-a306-4037-8d95-0c8c913affb7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:52.384607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c8c5c-a306-4037-8d95-0c8c913affb7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:52.384886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c8c5c-a306-4037-8d95-0c8c913affb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:52.422401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:52.438952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0a2c8c5c-a306-4037-8d95-0c8c913affb7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:52.440934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0a2c8c5c-a306-4037-8d95-0c8c913affb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:52.476894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:52.515666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c9734092-def1-42e4-a36d-09e07d0a69f7 None None] MFA Rules not processed for user `4d0b8591c8df4445845d673823d1e3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:52.516911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c9734092-def1-42e4-a36d-09e07d0a69f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:52.604647 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3299/6589] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:52.605356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c8c5c-a306-4037-8d95-0c8c913affb7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:52.673234 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3291/6590] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:52.678573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9734092-def1-42e4-a36d-09e07d0a69f7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:52.679988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c9734092-def1-42e4-a36d-09e07d0a69f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:52.735865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c8c5c-a306-4037-8d95-0c8c913affb7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:52.743274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecfc1a-086d-449b-93d0-18c7815a9412 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb5d2954d5b340fa883d953beee08e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0102789e989441c4a2afd8606cf1d3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:52.744282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecfc1a-086d-449b-93d0-18c7815a9412 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:52.744854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecfc1a-086d-449b-93d0-18c7815a9412 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:52.745345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecfc1a-086d-449b-93d0-18c7815a9412 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81/password` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:52.816451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9ecfc1a-086d-449b-93d0-18c7815a9412 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:52.828301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9734092-def1-42e4-a36d-09e07d0a69f7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:52.833869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1aa226-274b-447f-aa76-fa88da71224c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:52.834545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa226-274b-447f-aa76-fa88da71224c service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:52.835081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa226-274b-447f-aa76-fa88da71224c service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:52.835208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa226-274b-447f-aa76-fa88da71224c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:52.837708 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3300/6591] 10.222.0.16 () {60 vars in 1269 bytes} [Mon Aug 29 15:54:52 2022] POST /identity/v3/users/cb5d2954d5b340fa883d953beee08e81/password => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:52.840575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecfc1a-086d-449b-93d0-18c7815a9412 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:52.844008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c9ecfc1a-086d-449b-93d0-18c7815a9412 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:52.870531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1aa226-274b-447f-aa76-fa88da71224c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:52.874151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1aa226-274b-447f-aa76-fa88da71224c service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:52.877226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecfc1a-086d-449b-93d0-18c7815a9412 tempest-IdentityV3UsersTest-827647127 tempest-IdentityV3UsersTest-827647127-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:52.892018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1af55-0653-4d3f-89df-ba7166c376b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:52.892392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1af55-0653-4d3f-89df-ba7166c376b6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:52.893376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1af55-0653-4d3f-89df-ba7166c376b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:52.893376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1af55-0653-4d3f-89df-ba7166c376b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:52.895653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1af55-0653-4d3f-89df-ba7166c376b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:52.898543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1af55-0653-4d3f-89df-ba7166c376b6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:52.917402 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3292/6592] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:52.978135 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3301/6593] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:52 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:52.979687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1aa226-274b-447f-aa76-fa88da71224c service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:53.009094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1aa226-274b-447f-aa76-fa88da71224c service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:53.044911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1af55-0653-4d3f-89df-ba7166c376b6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:53.047895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-21e1af55-0653-4d3f-89df-ba7166c376b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:53.164177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f2a75-87f2-4f3c-ae98-0a66fb077bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:53.165096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f2a75-87f2-4f3c-ae98-0a66fb077bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.165882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f2a75-87f2-4f3c-ae98-0a66fb077bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.166389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f2a75-87f2-4f3c-ae98-0a66fb077bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.167256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f2a75-87f2-4f3c-ae98-0a66fb077bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:53.169255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1af55-0653-4d3f-89df-ba7166c376b6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:53.172247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f2a75-87f2-4f3c-ae98-0a66fb077bb3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:53.178235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3ab0-7e6b-42c4-9d08-160281b1b828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:53.178784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3ab0-7e6b-42c4-9d08-160281b1b828 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.179070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3ab0-7e6b-42c4-9d08-160281b1b828 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.179349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3ab0-7e6b-42c4-9d08-160281b1b828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.188049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-50ef3ab0-7e6b-42c4-9d08-160281b1b828 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:53.204421 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3293/6594] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:52 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:53.208388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f2a75-87f2-4f3c-ae98-0a66fb077bb3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:53.222848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f2a75-87f2-4f3c-ae98-0a66fb077bb3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:53.229417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814de063-c5ad-4d1c-8fcc-db38103bb3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:53.231155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814de063-c5ad-4d1c-8fcc-db38103bb3ff admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.231660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814de063-c5ad-4d1c-8fcc-db38103bb3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.232149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814de063-c5ad-4d1c-8fcc-db38103bb3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.233225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814de063-c5ad-4d1c-8fcc-db38103bb3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:53.235346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814de063-c5ad-4d1c-8fcc-db38103bb3ff admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:53.249909 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3294/6595] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:53.254641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814de063-c5ad-4d1c-8fcc-db38103bb3ff admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:53.267784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814de063-c5ad-4d1c-8fcc-db38103bb3ff admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:53.272893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fce12-f545-4b19-a21c-679f09db9c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:53.273717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fce12-f545-4b19-a21c-679f09db9c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.274001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fce12-f545-4b19-a21c-679f09db9c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.274279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fce12-f545-4b19-a21c-679f09db9c70 admin admin] PATH_INFO: `/v3/projects/5e2131fca0384681a37c41f9effed739/users/b452916e4e3f4e8d8f1eefb146a2b5de/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.279895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:53.289513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:53.299181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fce12-f545-4b19-a21c-679f09db9c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2131fca0384681a37c41f9effed739, user_id=b452916e4e3f4e8d8f1eefb146a2b5de, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:53.302727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fce12-f545-4b19-a21c-679f09db9c70 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:53.330177 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3295/6596] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:53 2022] PUT /identity/v3/projects/5e2131fca0384681a37c41f9effed739/users/b452916e4e3f4e8d8f1eefb146a2b5de/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:53.335366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fce12-f545-4b19-a21c-679f09db9c70 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:53.346334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef3ab0-7e6b-42c4-9d08-160281b1b828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:53.348033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef3ab0-7e6b-42c4-9d08-160281b1b828 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:53.369639 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3302/6597] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:53.399119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3ab0-7e6b-42c4-9d08-160281b1b828 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:53.400754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-50ef3ab0-7e6b-42c4-9d08-160281b1b828 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:53.436759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3ab0-7e6b-42c4-9d08-160281b1b828 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:53.448475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:53.449591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.450491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.450723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fce12-f545-4b19-a21c-679f09db9c70 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:53.450850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] PATH_INFO: `/v3/projects/2a55a4468fd2496797ccdddf1eb601fd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.460522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb6b9-3cd4-480c-ba82-5f143bc12e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:53.460791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a55a4468fd2496797ccdddf1eb601fd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:53.461181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb6b9-3cd4-480c-ba82-5f143bc12e7a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.461493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb6b9-3cd4-480c-ba82-5f143bc12e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.461778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb6b9-3cd4-480c-ba82-5f143bc12e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.462484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cb6b9-3cd4-480c-ba82-5f143bc12e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:53.462862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:53.467203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cb6b9-3cd4-480c-ba82-5f143bc12e7a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:53.482317 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3296/6598] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:53.486061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb6b9-3cd4-480c-ba82-5f143bc12e7a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:53.500218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb6b9-3cd4-480c-ba82-5f143bc12e7a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:53.508724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8174255-1639-47ec-ad96-c9255165062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:53.509609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8174255-1639-47ec-ad96-c9255165062a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.510254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8174255-1639-47ec-ad96-c9255165062a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.510537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8174255-1639-47ec-ad96-c9255165062a admin admin] PATH_INFO: `/v3/projects/5e2131fca0384681a37c41f9effed739/users/b452916e4e3f4e8d8f1eefb146a2b5de/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.512717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8174255-1639-47ec-ad96-c9255165062a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2131fca0384681a37c41f9effed739, user_id=b452916e4e3f4e8d8f1eefb146a2b5de, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:53.515569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8174255-1639-47ec-ad96-c9255165062a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:53.522709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a55a4468fd2496797ccdddf1eb601fd', 'request_id': 'req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:53.528740 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3297/6599] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:53 2022] PUT /identity/v3/projects/5e2131fca0384681a37c41f9effed739/users/b452916e4e3f4e8d8f1eefb146a2b5de/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:53.530556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a55a4468fd2496797ccdddf1eb601fd', 'request_id': 'req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:53.540056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c34de4-f48e-4114-9ffe-a98ec7495469 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.540316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c34de4-f48e-4114-9ffe-a98ec7495469 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.540592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c34de4-f48e-4114-9ffe-a98ec7495469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.543610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a55a4468fd2496797ccdddf1eb601fd', 'request_id': 'req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:53.556288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] The token cache is being invalidate because project 2a55a4468fd2496797ccdddf1eb601fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:53.556586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:53.557249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:53.559437 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3303/6600] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:53 2022] DELETE /identity/v3/projects/2a55a4468fd2496797ccdddf1eb601fd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:53.565644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:53.565644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:53.576871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c6c34de4-f48e-4114-9ffe-a98ec7495469 None None] MFA Rules not processed for user `b452916e4e3f4e8d8f1eefb146a2b5de`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:53.578673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c6c34de4-f48e-4114-9ffe-a98ec7495469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:53.644275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18c0bf-bebd-4257-aa6a-6eb99cc42f78 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:53.669047 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3298/6601] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:53.674351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c34de4-f48e-4114-9ffe-a98ec7495469 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:53.686428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c34de4-f48e-4114-9ffe-a98ec7495469 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:53.691850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa69e6-0edc-40c0-b58a-728e99c5597d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:53.692595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa69e6-0edc-40c0-b58a-728e99c5597d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.692978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa69e6-0edc-40c0-b58a-728e99c5597d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.693270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa69e6-0edc-40c0-b58a-728e99c5597d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.694066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa69e6-0edc-40c0-b58a-728e99c5597d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:53.695960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa69e6-0edc-40c0-b58a-728e99c5597d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:53.716746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17b95b-a3ca-467a-a3b0-66e270f160e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:53.717522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b95b-a3ca-467a-a3b0-66e270f160e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.717683 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3299/6602] 10.222.0.16 () {60 vars in 1150 bytes} [Mon Aug 29 15:54:53 2022] POST /identity/v3/domains => generated 275 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:53.717845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b95b-a3ca-467a-a3b0-66e270f160e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.718085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b95b-a3ca-467a-a3b0-66e270f160e1 admin admin] PATH_INFO: `/v3/users/85202de6cb7b4c68b7b45796dd8a12f2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.719232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17b95b-a3ca-467a-a3b0-66e270f160e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85202de6cb7b4c68b7b45796dd8a12f2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:53.719362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa69e6-0edc-40c0-b58a-728e99c5597d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:53.721700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17b95b-a3ca-467a-a3b0-66e270f160e1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:53.724376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:53.782733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:53.800097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa69e6-0edc-40c0-b58a-728e99c5597d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:53.805507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857ea7a-620b-46cd-b1fc-5c4d4cc6316d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:53.806180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857ea7a-620b-46cd-b1fc-5c4d4cc6316d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.806413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857ea7a-620b-46cd-b1fc-5c4d4cc6316d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.806689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857ea7a-620b-46cd-b1fc-5c4d4cc6316d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.807363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857ea7a-620b-46cd-b1fc-5c4d4cc6316d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:53.809553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857ea7a-620b-46cd-b1fc-5c4d4cc6316d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:53.816603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ad17b95b-a3ca-467a-a3b0-66e270f160e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85202de6cb7b4c68b7b45796dd8a12f2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:53.817433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ad17b95b-a3ca-467a-a3b0-66e270f160e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85202de6cb7b4c68b7b45796dd8a12f2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:53.831650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ad17b95b-a3ca-467a-a3b0-66e270f160e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85202de6cb7b4c68b7b45796dd8a12f2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:53.832428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ad17b95b-a3ca-467a-a3b0-66e270f160e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85202de6cb7b4c68b7b45796dd8a12f2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:53.836739 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3300/6603] 10.222.0.16 () {60 vars in 1150 bytes} [Mon Aug 29 15:54:53 2022] POST /identity/v3/domains => generated 276 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:53.837708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857ea7a-620b-46cd-b1fc-5c4d4cc6316d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:53.839625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f857ea7a-620b-46cd-b1fc-5c4d4cc6316d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:53.843744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ad17b95b-a3ca-467a-a3b0-66e270f160e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85202de6cb7b4c68b7b45796dd8a12f2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:53.859111 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3304/6604] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:53 2022] DELETE /identity/v3/users/85202de6cb7b4c68b7b45796dd8a12f2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:54:53.861021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf9c1-ab5b-41fd-979a-011b730b1b72 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.861021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf9c1-ab5b-41fd-979a-011b730b1b72 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.861244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf9c1-ab5b-41fd-979a-011b730b1b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.886873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-805cf9c1-ab5b-41fd-979a-011b730b1b72 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:53.888222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-805cf9c1-ab5b-41fd-979a-011b730b1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:53.892360 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3305/6605] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:53 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:53.916057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857ea7a-620b-46cd-b1fc-5c4d4cc6316d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:53.990830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cac12c-c4c1-4c0e-abfd-ec5cad04d6e7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:53.991571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cac12c-c4c1-4c0e-abfd-ec5cad04d6e7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:53.991935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cac12c-c4c1-4c0e-abfd-ec5cad04d6e7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:53.992207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cac12c-c4c1-4c0e-abfd-ec5cad04d6e7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:53.993023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cac12c-c4c1-4c0e-abfd-ec5cad04d6e7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:53.994677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cac12c-c4c1-4c0e-abfd-ec5cad04d6e7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:54.014912 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3301/6606] 10.222.0.16 () {60 vars in 1150 bytes} [Mon Aug 29 15:54:53 2022] POST /identity/v3/domains => generated 276 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:54.019414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cf9c1-ab5b-41fd-979a-011b730b1b72 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:54.101785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cf9c1-ab5b-41fd-979a-011b730b1b72 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:54.107172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c54a41-d709-42d3-83b9-c9144cbfef53 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:54.107733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c54a41-d709-42d3-83b9-c9144cbfef53 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:54.108469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c54a41-d709-42d3-83b9-c9144cbfef53 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:54.108469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c54a41-d709-42d3-83b9-c9144cbfef53 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:54.109147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c54a41-d709-42d3-83b9-c9144cbfef53 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:54.110798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c54a41-d709-42d3-83b9-c9144cbfef53 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:54.134689 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3306/6607] 10.222.0.16 () {60 vars in 1150 bytes} [Mon Aug 29 15:54:54 2022] POST /identity/v3/domains => generated 279 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:54.136122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cac12c-c4c1-4c0e-abfd-ec5cad04d6e7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:54.148187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cac12c-c4c1-4c0e-abfd-ec5cad04d6e7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:54.213046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:54.213747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:54.214104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:54.214291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c54a41-d709-42d3-83b9-c9144cbfef53 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:54.214745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/d1f409833f2c48fb8f4e5b6feecfa875` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:54.216392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a2c54a41-d709-42d3-83b9-c9144cbfef53 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:54.241501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d1f409833f2c48fb8f4e5b6feecfa875)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:54.243866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:54.281220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:54.297142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd1f409833f2c48fb8f4e5b6feecfa875'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.312857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd1f409833f2c48fb8f4e5b6feecfa875'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.321702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c54a41-d709-42d3-83b9-c9144cbfef53 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:54.327214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:54.327866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:54.328147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:54.328573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] PATH_INFO: `/v3/projects/73f1b1d7a49d4bb9a7a5b40c43094b8c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:54.329761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f1b1d7a49d4bb9a7a5b40c43094b8c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:54.331672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:54.346393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:54.370232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f409833f2c48fb8f4e5b6feecfa875', 'request_id': 'req-9a49b60a-9c05-46fc-86be-8ec352d5cccd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.376914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f409833f2c48fb8f4e5b6feecfa875', 'request_id': 'req-9a49b60a-9c05-46fc-86be-8ec352d5cccd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.385481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f409833f2c48fb8f4e5b6feecfa875', 'request_id': 'req-9a49b60a-9c05-46fc-86be-8ec352d5cccd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.388399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f1b1d7a49d4bb9a7a5b40c43094b8c', 'request_id': 'req-94426ead-aae9-48dc-9838-29fd4250ba42'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.395122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f1b1d7a49d4bb9a7a5b40c43094b8c', 'request_id': 'req-94426ead-aae9-48dc-9838-29fd4250ba42'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.402787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] The token cache is being invalidate because project d1f409833f2c48fb8f4e5b6feecfa875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:54.403298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.403962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.404075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f1b1d7a49d4bb9a7a5b40c43094b8c', 'request_id': 'req-94426ead-aae9-48dc-9838-29fd4250ba42'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.412591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd1f409833f2c48fb8f4e5b6feecfa875', 'request_id': 'req-9a49b60a-9c05-46fc-86be-8ec352d5cccd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.413805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd1f409833f2c48fb8f4e5b6feecfa875', 'request_id': 'req-9a49b60a-9c05-46fc-86be-8ec352d5cccd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.414440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd1f409833f2c48fb8f4e5b6feecfa875', 'request_id': 'req-9a49b60a-9c05-46fc-86be-8ec352d5cccd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.422280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] The token cache is being invalidate because project 73f1b1d7a49d4bb9a7a5b40c43094b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:54.422876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.424146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-94426ead-aae9-48dc-9838-29fd4250ba42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.425786 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3302/6608] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:54:54 2022] DELETE /identity/v3/domains/d1f409833f2c48fb8f4e5b6feecfa875 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:54.426434 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3307/6609] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:54 2022] DELETE /identity/v3/projects/73f1b1d7a49d4bb9a7a5b40c43094b8c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:54.431595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:54.432632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:54.435147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793ebf-2893-4e10-ae14-1f0db7f46f37 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:54.435848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793ebf-2893-4e10-ae14-1f0db7f46f37 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:54.436327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793ebf-2893-4e10-ae14-1f0db7f46f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:54.473568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a5793ebf-2893-4e10-ae14-1f0db7f46f37 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:54.476653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a5793ebf-2893-4e10-ae14-1f0db7f46f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:54.529878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49b60a-9c05-46fc-86be-8ec352d5cccd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:54.582554 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3308/6610] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:54.597718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9bcec-7bbd-4416-8b18-020b63876978 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:54.598735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9bcec-7bbd-4416-8b18-020b63876978 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:54.599492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9bcec-7bbd-4416-8b18-020b63876978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:54.626161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-12c9bcec-7bbd-4416-8b18-020b63876978 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:54.628972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97642983-fcb0-4f25-ad77-916fe4edacda tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:54.629641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97642983-fcb0-4f25-ad77-916fe4edacda tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:54.629931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97642983-fcb0-4f25-ad77-916fe4edacda tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:54.630214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97642983-fcb0-4f25-ad77-916fe4edacda tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:54.630882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97642983-fcb0-4f25-ad77-916fe4edacda tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:54.631684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-12c9bcec-7bbd-4416-8b18-020b63876978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:54.632485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97642983-fcb0-4f25-ad77-916fe4edacda tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:54.644704 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3309/6611] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:54:54.648674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9bcec-7bbd-4416-8b18-020b63876978 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:54.660367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9bcec-7bbd-4416-8b18-020b63876978 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:54.660580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:54.678811 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3303/6612] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:54:54 2022] POST /identity/v3/domains => generated 249 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:54.682794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97642983-fcb0-4f25-ad77-916fe4edacda tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:54.683402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ce346-fc00-47f1-acb5-294a44cdef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:54.684116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce346-fc00-47f1-acb5-294a44cdef21 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:54.684408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce346-fc00-47f1-acb5-294a44cdef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:54.684940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce346-fc00-47f1-acb5-294a44cdef21 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:54.685439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ce346-fc00-47f1-acb5-294a44cdef21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:54.685812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ce346-fc00-47f1-acb5-294a44cdef21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:54.686455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-97642983-fcb0-4f25-ad77-916fe4edacda tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:54.687344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ce346-fc00-47f1-acb5-294a44cdef21 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:54.709751 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3310/6613] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:54:54.724000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ce346-fc00-47f1-acb5-294a44cdef21 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:54.749167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ce346-fc00-47f1-acb5-294a44cdef21 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:54.819073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97642983-fcb0-4f25-ad77-916fe4edacda tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:54.823327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58d522-d7ce-41aa-9c1e-9d7459bf52e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:54.824609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58d522-d7ce-41aa-9c1e-9d7459bf52e1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:54.824941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58d522-d7ce-41aa-9c1e-9d7459bf52e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:54.825265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58d522-d7ce-41aa-9c1e-9d7459bf52e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:54.826062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58d522-d7ce-41aa-9c1e-9d7459bf52e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:54.828494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58d522-d7ce-41aa-9c1e-9d7459bf52e1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:54.835708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918d5ec-86a2-4e23-b552-4cf6f050b026 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:54.836370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918d5ec-86a2-4e23-b552-4cf6f050b026 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:54.836654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918d5ec-86a2-4e23-b552-4cf6f050b026 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:54.836934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918d5ec-86a2-4e23-b552-4cf6f050b026 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/5ab2cafbd236484bbc663209a0a9e4c3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:54.850349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918d5ec-86a2-4e23-b552-4cf6f050b026 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5ab2cafbd236484bbc663209a0a9e4c3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:54.852025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918d5ec-86a2-4e23-b552-4cf6f050b026 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:54.868649 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3311/6614] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:54 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:54.872667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58d522-d7ce-41aa-9c1e-9d7459bf52e1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:54.883950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:54.895629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e918d5ec-86a2-4e23-b552-4cf6f050b026 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.899486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e918d5ec-86a2-4e23-b552-4cf6f050b026 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.954839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e918d5ec-86a2-4e23-b552-4cf6f050b026 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.956140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e918d5ec-86a2-4e23-b552-4cf6f050b026 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:54.962751 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3304/6615] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:54 2022] PATCH /identity/v3/domains/5ab2cafbd236484bbc663209a0a9e4c3 => generated 250 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:54.962915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1b629-9f65-4c99-a1e3-5f3bd3b4ddd8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:54.963404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1b629-9f65-4c99-a1e3-5f3bd3b4ddd8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:54.963513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1b629-9f65-4c99-a1e3-5f3bd3b4ddd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.004074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-71f1b629-9f65-4c99-a1e3-5f3bd3b4ddd8 None None] MFA Rules not processed for user `cb5d2954d5b340fa883d953beee08e81`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:55.006434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-71f1b629-9f65-4c99-a1e3-5f3bd3b4ddd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.039363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58d522-d7ce-41aa-9c1e-9d7459bf52e1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:55.088588 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3305/6616] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:55.090830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1b629-9f65-4c99-a1e3-5f3bd3b4ddd8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:55.096171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-71f1b629-9f65-4c99-a1e3-5f3bd3b4ddd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.164415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c667afe-b1c3-4684-ae04-3d826466f1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:55.165052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c667afe-b1c3-4684-ae04-3d826466f1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.165370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c667afe-b1c3-4684-ae04-3d826466f1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.165804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c667afe-b1c3-4684-ae04-3d826466f1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.166450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c667afe-b1c3-4684-ae04-3d826466f1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:55.171642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c667afe-b1c3-4684-ae04-3d826466f1f3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:55.194234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1b629-9f65-4c99-a1e3-5f3bd3b4ddd8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:55.202503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:55.203423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.203992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.204451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/5ab2cafbd236484bbc663209a0a9e4c3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.208827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:55.212000 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3312/6617] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:54 2022] POST /identity/v3/users => generated 288 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:55.212920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c667afe-b1c3-4684-ae04-3d826466f1f3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:55.218356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8c667afe-b1c3-4684-ae04-3d826466f1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.226744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5ab2cafbd236484bbc663209a0a9e4c3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:55.228788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:55.232043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c667afe-b1c3-4684-ae04-3d826466f1f3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:55.237149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:55.238069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.238362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.238644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] PATH_INFO: `/v3/users/cb5d2954d5b340fa883d953beee08e81` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.239867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5d2954d5b340fa883d953beee08e81)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:55.241922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:55.260709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.273383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.304126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.305228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.322014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.323146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.333897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3', 'request_id': 'req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.340627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5d2954d5b340fa883d953beee08e81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.342855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3', 'request_id': 'req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.354623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3', 'request_id': 'req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.374721 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3313/6618] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:55 2022] DELETE /identity/v3/users/cb5d2954d5b340fa883d953beee08e81 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:55.375758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:55.379081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.381615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] The token cache is being invalidate because project 5ab2cafbd236484bbc663209a0a9e4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:55.382019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.382873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.394394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3', 'request_id': 'req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.395250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3', 'request_id': 'req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.395974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5ab2cafbd236484bbc663209a0a9e4c3', 'request_id': 'req-028ba1bf-6f9e-48d7-9c1d-7c14f6fa5f82'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:55.406327 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3306/6619] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:54:55 2022] DELETE /identity/v3/domains/5ab2cafbd236484bbc663209a0a9e4c3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:55.408196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80f4dd-f129-4070-8634-408e4a32938e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.409069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80f4dd-f129-4070-8634-408e4a32938e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.409069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80f4dd-f129-4070-8634-408e4a32938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.421167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:55.436152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fd80f4dd-f129-4070-8634-408e4a32938e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:55.437964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fd80f4dd-f129-4070-8634-408e4a32938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.494250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8086-31ee-4bbc-9e42-f3a7c132883b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:55.528004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea40ec-4c5d-4af3-824f-9b840ffbed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:55.529006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea40ec-4c5d-4af3-824f-9b840ffbed0b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.537255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea40ec-4c5d-4af3-824f-9b840ffbed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.537894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea40ec-4c5d-4af3-824f-9b840ffbed0b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.538820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea40ec-4c5d-4af3-824f-9b840ffbed0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:55.541021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea40ec-4c5d-4af3-824f-9b840ffbed0b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:55.586705 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3314/6620] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:55.588034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea40ec-4c5d-4af3-824f-9b840ffbed0b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:55.591852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-98ea40ec-4c5d-4af3-824f-9b840ffbed0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.606960 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3307/6621] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:55.607949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80f4dd-f129-4070-8634-408e4a32938e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:55.608840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fd80f4dd-f129-4070-8634-408e4a32938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.627739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80f4dd-f129-4070-8634-408e4a32938e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:55.635495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2aa18-165e-4d10-82d8-1b9c0196b449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:55.636926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2aa18-165e-4d10-82d8-1b9c0196b449 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.637824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2aa18-165e-4d10-82d8-1b9c0196b449 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.638174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2aa18-165e-4d10-82d8-1b9c0196b449 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.638900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2aa18-165e-4d10-82d8-1b9c0196b449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:55.640734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2aa18-165e-4d10-82d8-1b9c0196b449 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:55.663537 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3308/6622] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:55.664804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2aa18-165e-4d10-82d8-1b9c0196b449 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:55.667207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b3b2aa18-165e-4d10-82d8-1b9c0196b449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:55.714892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea40ec-4c5d-4af3-824f-9b840ffbed0b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:55.720164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:55.721095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd06be-758c-4d5d-8e9e-604d65ee969e tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:55.721778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd06be-758c-4d5d-8e9e-604d65ee969e tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.722116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd06be-758c-4d5d-8e9e-604d65ee969e tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.722399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd06be-758c-4d5d-8e9e-604d65ee969e tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.723977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd06be-758c-4d5d-8e9e-604d65ee969e tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:55.725723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd06be-758c-4d5d-8e9e-604d65ee969e tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:55.754635 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3315/6623] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:54:55 2022] POST /identity/v3/domains => generated 279 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:55.754635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd06be-758c-4d5d-8e9e-604d65ee969e tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:55.789122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2aa18-165e-4d10-82d8-1b9c0196b449 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:55.877449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd06be-758c-4d5d-8e9e-604d65ee969e tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:55.887990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3874a-6f94-407f-b65f-2af132c531dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:55.888784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3874a-6f94-407f-b65f-2af132c531dd service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.889147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3874a-6f94-407f-b65f-2af132c531dd service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.889483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3874a-6f94-407f-b65f-2af132c531dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.891528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65410412-dce4-47e7-bc92-bcecea2f8aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:55.892000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410412-dce4-47e7-bc92-bcecea2f8aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.893252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410412-dce4-47e7-bc92-bcecea2f8aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.893252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410412-dce4-47e7-bc92-bcecea2f8aa8 admin admin] PATH_INFO: `/v3/projects/5069ad3f042e41b2a01e0622ba471015/users/ec54d01ac0ce47cd87cd29c030b31d0a/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:55.906198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3874a-6f94-407f-b65f-2af132c531dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:55.906198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3874a-6f94-407f-b65f-2af132c531dd service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:55.922229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65410412-dce4-47e7-bc92-bcecea2f8aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5069ad3f042e41b2a01e0622ba471015, user_id=ec54d01ac0ce47cd87cd29c030b31d0a, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:55.925713 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3309/6624] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:55.926310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65410412-dce4-47e7-bc92-bcecea2f8aa8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:55.926896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3874a-6f94-407f-b65f-2af132c531dd service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:55.957776 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3316/6625] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:55 2022] PUT /identity/v3/projects/5069ad3f042e41b2a01e0622ba471015/users/ec54d01ac0ce47cd87cd29c030b31d0a/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:55.971857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fb3be-737e-4c5d-bdf6-0c2ed93e1c95 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:55.971857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fb3be-737e-4c5d-bdf6-0c2ed93e1c95 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:55.971857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fb3be-737e-4c5d-bdf6-0c2ed93e1c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.041864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-474fb3be-737e-4c5d-bdf6-0c2ed93e1c95 None None] MFA Rules not processed for user `ec54d01ac0ce47cd87cd29c030b31d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:56.044062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-474fb3be-737e-4c5d-bdf6-0c2ed93e1c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:56.081491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:56.089837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3874a-6f94-407f-b65f-2af132c531dd service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.156313 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3317/6626] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:56.160909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fb3be-737e-4c5d-bdf6-0c2ed93e1c95 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.170844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.171757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.172046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.172334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/467d3081386a4261a0e80793d6bfea4e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.183434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=467d3081386a4261a0e80793d6bfea4e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.185125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.209569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '467d3081386a4261a0e80793d6bfea4e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.211271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '467d3081386a4261a0e80793d6bfea4e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.226106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:56.248307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '467d3081386a4261a0e80793d6bfea4e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.248964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '467d3081386a4261a0e80793d6bfea4e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.249551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fb3be-737e-4c5d-bdf6-0c2ed93e1c95 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.252086 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3310/6627] 10.222.0.16 () {60 vars in 1250 bytes} [Mon Aug 29 15:54:55 2022] PATCH /identity/v3/domains/467d3081386a4261a0e80793d6bfea4e => generated 278 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:56.256768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.258572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:56.320430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f1a74-4593-428c-a821-2cc311bf2f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.321437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f1a74-4593-428c-a821-2cc311bf2f55 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.321996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f1a74-4593-428c-a821-2cc311bf2f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.322286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f1a74-4593-428c-a821-2cc311bf2f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.323320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f1a74-4593-428c-a821-2cc311bf2f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.326693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f1a74-4593-428c-a821-2cc311bf2f55 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.340004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75583b-90c4-4b40-8595-1e7fa95cae03 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.345144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d6fc7-8e6f-4a09-bb97-4cbe6e039beb tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.345887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d6fc7-8e6f-4a09-bb97-4cbe6e039beb tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.346237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d6fc7-8e6f-4a09-bb97-4cbe6e039beb tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.346585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d6fc7-8e6f-4a09-bb97-4cbe6e039beb tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/467d3081386a4261a0e80793d6bfea4e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.358932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d6fc7-8e6f-4a09-bb97-4cbe6e039beb tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=467d3081386a4261a0e80793d6bfea4e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.361695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d6fc7-8e6f-4a09-bb97-4cbe6e039beb tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.363886 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3311/6628] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:54:56 2022] GET /identity/v3/domains/467d3081386a4261a0e80793d6bfea4e => generated 278 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:54:56.368530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d6fc7-8e6f-4a09-bb97-4cbe6e039beb tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.377649 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3318/6629] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:56 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:56.378429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f1a74-4593-428c-a821-2cc311bf2f55 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.380917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-142f1a74-4593-428c-a821-2cc311bf2f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:56.382921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d6fc7-8e6f-4a09-bb97-4cbe6e039beb tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.435101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:56.450400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.451052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.451342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.451627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/467d3081386a4261a0e80793d6bfea4e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.452832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=467d3081386a4261a0e80793d6bfea4e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.453131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f1a74-4593-428c-a821-2cc311bf2f55 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.454469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.457896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.458520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.459448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.459730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] PATH_INFO: `/v3/projects/0102789e989441c4a2afd8606cf1d3df` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.460910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0102789e989441c4a2afd8606cf1d3df)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.462859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.481516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '467d3081386a4261a0e80793d6bfea4e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.491637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '467d3081386a4261a0e80793d6bfea4e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.510864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0102789e989441c4a2afd8606cf1d3df', 'request_id': 'req-12b3670c-0d96-483c-8283-39859df388e0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.517584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0102789e989441c4a2afd8606cf1d3df', 'request_id': 'req-12b3670c-0d96-483c-8283-39859df388e0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.525643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0102789e989441c4a2afd8606cf1d3df', 'request_id': 'req-12b3670c-0d96-483c-8283-39859df388e0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.538642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] The token cache is being invalidate because project 0102789e989441c4a2afd8606cf1d3df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:56.538896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.539563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.542011 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3319/6630] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:56 2022] DELETE /identity/v3/projects/0102789e989441c4a2afd8606cf1d3df => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:56.542920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.546277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:56.547783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467d3081386a4261a0e80793d6bfea4e', 'request_id': 'req-e194fa8f-38d6-4df8-908f-08df1bc8da1d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.555219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467d3081386a4261a0e80793d6bfea4e', 'request_id': 'req-e194fa8f-38d6-4df8-908f-08df1bc8da1d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.559610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:56.564184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467d3081386a4261a0e80793d6bfea4e', 'request_id': 'req-e194fa8f-38d6-4df8-908f-08df1bc8da1d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.579808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] The token cache is being invalidate because project 467d3081386a4261a0e80793d6bfea4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:56.591137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.591855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.604898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '467d3081386a4261a0e80793d6bfea4e', 'request_id': 'req-e194fa8f-38d6-4df8-908f-08df1bc8da1d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.605811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '467d3081386a4261a0e80793d6bfea4e', 'request_id': 'req-e194fa8f-38d6-4df8-908f-08df1bc8da1d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.606460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e194fa8f-38d6-4df8-908f-08df1bc8da1d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '467d3081386a4261a0e80793d6bfea4e', 'request_id': 'req-e194fa8f-38d6-4df8-908f-08df1bc8da1d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:56.615524 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3312/6631] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:54:56 2022] DELETE /identity/v3/domains/467d3081386a4261a0e80793d6bfea4e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:56.616783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113600c-5fd2-4c51-8f42-e4ead2fc109c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.617419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113600c-5fd2-4c51-8f42-e4ead2fc109c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.617693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113600c-5fd2-4c51-8f42-e4ead2fc109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.622753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3670c-0d96-483c-8283-39859df388e0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.639385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6113600c-5fd2-4c51-8f42-e4ead2fc109c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:56.640608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6113600c-5fd2-4c51-8f42-e4ead2fc109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:56.684838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d129a0a-a49d-464d-a526-397ec95f2395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.685521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d129a0a-a49d-464d-a526-397ec95f2395 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.685836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d129a0a-a49d-464d-a526-397ec95f2395 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.686107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d129a0a-a49d-464d-a526-397ec95f2395 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.686849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d129a0a-a49d-464d-a526-397ec95f2395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.688770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d129a0a-a49d-464d-a526-397ec95f2395 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.702578 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3313/6632] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:56.703554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113600c-5fd2-4c51-8f42-e4ead2fc109c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.706136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6113600c-5fd2-4c51-8f42-e4ead2fc109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:56.716166 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3320/6633] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:56 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:56.716166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724a38-083f-4923-b67b-cd38e9fe5018 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.716166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724a38-083f-4923-b67b-cd38e9fe5018 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.716166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724a38-083f-4923-b67b-cd38e9fe5018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.734466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ca724a38-083f-4923-b67b-cd38e9fe5018 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:56.735674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ca724a38-083f-4923-b67b-cd38e9fe5018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:56.743732 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3321/6634] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:56.744535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca724a38-083f-4923-b67b-cd38e9fe5018 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.746376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ca724a38-083f-4923-b67b-cd38e9fe5018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:56.757928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca724a38-083f-4923-b67b-cd38e9fe5018 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.763217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a397465-6d00-4cb5-8984-a323c6eadbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.763805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397465-6d00-4cb5-8984-a323c6eadbed admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.764085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397465-6d00-4cb5-8984-a323c6eadbed admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.764365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a397465-6d00-4cb5-8984-a323c6eadbed admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.764999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a397465-6d00-4cb5-8984-a323c6eadbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.766626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a397465-6d00-4cb5-8984-a323c6eadbed admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.768743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:56.780925 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3322/6635] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:56.781096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113600c-5fd2-4c51-8f42-e4ead2fc109c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.781180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a397465-6d00-4cb5-8984-a323c6eadbed admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.783861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b4139-aef3-4044-b3c7-9bb1be79cf9b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.784540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b4139-aef3-4044-b3c7-9bb1be79cf9b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.784724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b4139-aef3-4044-b3c7-9bb1be79cf9b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.785000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b4139-aef3-4044-b3c7-9bb1be79cf9b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.786562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b4139-aef3-4044-b3c7-9bb1be79cf9b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.787506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b4139-aef3-4044-b3c7-9bb1be79cf9b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.790038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a397465-6d00-4cb5-8984-a323c6eadbed admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.794772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4e640-0e6e-447c-a559-b51e7873902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.795365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4e640-0e6e-447c-a559-b51e7873902b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.795649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4e640-0e6e-447c-a559-b51e7873902b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.795924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4e640-0e6e-447c-a559-b51e7873902b admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.796822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4e640-0e6e-447c-a559-b51e7873902b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:56.797122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4e640-0e6e-447c-a559-b51e7873902b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.798895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4e640-0e6e-447c-a559-b51e7873902b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.804037 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3314/6636] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Aug 29 15:54:56 2022] GET /identity/v3/domains => generated 1345 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:56.804037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b4139-aef3-4044-b3c7-9bb1be79cf9b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.811921 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3323/6637] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:56.813435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4e640-0e6e-447c-a559-b51e7873902b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.813557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b4139-aef3-4044-b3c7-9bb1be79cf9b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.818725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a65f1-7d3f-4588-b534-63af771ad448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.819399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a65f1-7d3f-4588-b534-63af771ad448 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.819697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a65f1-7d3f-4588-b534-63af771ad448 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.819964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a65f1-7d3f-4588-b534-63af771ad448 admin admin] PATH_INFO: `/v3/projects/ab1bc4788acd4a4b8dab66f0486c6dac/users/497f34e0a8e7421291afe70463c56504/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.825718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4e640-0e6e-447c-a559-b51e7873902b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.831133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7e201-263d-4c5e-a19b-f6ac57c0af0a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.831519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7e201-263d-4c5e-a19b-f6ac57c0af0a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.831796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7e201-263d-4c5e-a19b-f6ac57c0af0a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.832154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7e201-263d-4c5e-a19b-f6ac57c0af0a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/467d3081386a4261a0e80793d6bfea4e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.836993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a65f1-7d3f-4588-b534-63af771ad448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1bc4788acd4a4b8dab66f0486c6dac, user_id=497f34e0a8e7421291afe70463c56504, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.839824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a65f1-7d3f-4588-b534-63af771ad448 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.840259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7e201-263d-4c5e-a19b-f6ac57c0af0a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-58b7e201-263d-4c5e-a19b-f6ac57c0af0a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Could not find domain: 467d3081386a4261a0e80793d6bfea4e.: keystone.exception.DomainNotFound: Could not find domain: 467d3081386a4261a0e80793d6bfea4e. Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 467d3081386a4261a0e80793d6bfea4e. Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:56.846130 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:56.849771 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 467d3081386a4261a0e80793d6bfea4e. Aug 29 15:54:56.850685 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:56.851746 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3324/6638] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:56 2022] PATCH /identity/v3/domains/467d3081386a4261a0e80793d6bfea4e => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:54:56.851746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7e201-263d-4c5e-a19b-f6ac57c0af0a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.855528 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3315/6639] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:56 2022] PUT /identity/v3/projects/ab1bc4788acd4a4b8dab66f0486c6dac/users/497f34e0a8e7421291afe70463c56504/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:56.856557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a65f1-7d3f-4588-b534-63af771ad448 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.864303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7e201-263d-4c5e-a19b-f6ac57c0af0a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.928736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:56.951274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d6ec4-ee9f-4645-8300-262ddf3fcbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.952013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d6ec4-ee9f-4645-8300-262ddf3fcbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.952390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d6ec4-ee9f-4645-8300-262ddf3fcbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.952667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d6ec4-ee9f-4645-8300-262ddf3fcbf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.953355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d6ec4-ee9f-4645-8300-262ddf3fcbf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.955818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d6ec4-ee9f-4645-8300-262ddf3fcbf3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.957093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a65f1-7d3f-4588-b534-63af771ad448 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:56.964551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78515c2e-2b32-4c42-a194-3b1085f545c0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:56.965576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515c2e-2b32-4c42-a194-3b1085f545c0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:56.965847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515c2e-2b32-4c42-a194-3b1085f545c0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:56.966119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515c2e-2b32-4c42-a194-3b1085f545c0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:56.967365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78515c2e-2b32-4c42-a194-3b1085f545c0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:56.969639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78515c2e-2b32-4c42-a194-3b1085f545c0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:56.989184 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3325/6640] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:56 2022] POST /identity/v3/projects => generated 361 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:56.990526 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3316/6641] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:54:56 2022] POST /identity/v3/domains => generated 276 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:56.990642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d6ec4-ee9f-4645-8300-262ddf3fcbf3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:56.994662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78515c2e-2b32-4c42-a194-3b1085f545c0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:57.105631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d6ec4-ee9f-4645-8300-262ddf3fcbf3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.138683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78515c2e-2b32-4c42-a194-3b1085f545c0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.153284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9f9fc-78af-43ae-ad50-d8e5e98cc71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:57.155932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9f9fc-78af-43ae-ad50-d8e5e98cc71d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.156435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9f9fc-78af-43ae-ad50-d8e5e98cc71d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.158753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9f9fc-78af-43ae-ad50-d8e5e98cc71d admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.159610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9f9fc-78af-43ae-ad50-d8e5e98cc71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:57.162427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9f9fc-78af-43ae-ad50-d8e5e98cc71d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:57.200490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8441597-e100-4c63-8ecb-f2f7459b6694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:57.201411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8441597-e100-4c63-8ecb-f2f7459b6694 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.201900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8441597-e100-4c63-8ecb-f2f7459b6694 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.202539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8441597-e100-4c63-8ecb-f2f7459b6694 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.203319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8441597-e100-4c63-8ecb-f2f7459b6694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:57.205469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8441597-e100-4c63-8ecb-f2f7459b6694 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:57.209435 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3317/6642] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:56 2022] POST /identity/v3/users => generated 281 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:54:57.210658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9f9fc-78af-43ae-ad50-d8e5e98cc71d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:57.225020 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3326/6643] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:57.225020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8441597-e100-4c63-8ecb-f2f7459b6694 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:57.233813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:57.239241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8441597-e100-4c63-8ecb-f2f7459b6694 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.265159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be551b98-40b6-4e2a-b06d-bd75b109a91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:57.266078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be551b98-40b6-4e2a-b06d-bd75b109a91f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.266373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be551b98-40b6-4e2a-b06d-bd75b109a91f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.266640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be551b98-40b6-4e2a-b06d-bd75b109a91f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.267286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be551b98-40b6-4e2a-b06d-bd75b109a91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:57.271393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be551b98-40b6-4e2a-b06d-bd75b109a91f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:57.296798 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3327/6644] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:57.299773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be551b98-40b6-4e2a-b06d-bd75b109a91f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:57.333583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be551b98-40b6-4e2a-b06d-bd75b109a91f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.350392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870938f-e49d-4b9e-96d1-6eb2d506c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:57.351113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870938f-e49d-4b9e-96d1-6eb2d506c560 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.351870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870938f-e49d-4b9e-96d1-6eb2d506c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.351870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870938f-e49d-4b9e-96d1-6eb2d506c560 admin admin] PATH_INFO: `/v3/projects/ab1bc4788acd4a4b8dab66f0486c6dac/users/497f34e0a8e7421291afe70463c56504/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.353969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870938f-e49d-4b9e-96d1-6eb2d506c560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1bc4788acd4a4b8dab66f0486c6dac, user_id=497f34e0a8e7421291afe70463c56504, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:57.357190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870938f-e49d-4b9e-96d1-6eb2d506c560 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:57.362600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9f9fc-78af-43ae-ad50-d8e5e98cc71d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.368317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d70a23-ad9b-4a9b-8b78-e7e547e529cd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:57.369159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70a23-ad9b-4a9b-8b78-e7e547e529cd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.369634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70a23-ad9b-4a9b-8b78-e7e547e529cd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.370271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70a23-ad9b-4a9b-8b78-e7e547e529cd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.371101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d70a23-ad9b-4a9b-8b78-e7e547e529cd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:57.373409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d70a23-ad9b-4a9b-8b78-e7e547e529cd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:57.381904 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3328/6645] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:57 2022] PUT /identity/v3/projects/ab1bc4788acd4a4b8dab66f0486c6dac/users/497f34e0a8e7421291afe70463c56504/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:57.383132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870938f-e49d-4b9e-96d1-6eb2d506c560 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:57.437468 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3318/6646] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:54:57 2022] POST /identity/v3/users => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:57.443238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63a2ab-4b94-482f-9e50-f8fc57f4b044 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.443446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63a2ab-4b94-482f-9e50-f8fc57f4b044 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.443832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63a2ab-4b94-482f-9e50-f8fc57f4b044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.479623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fc63a2ab-4b94-482f-9e50-f8fc57f4b044 None None] MFA Rules not processed for user `497f34e0a8e7421291afe70463c56504`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:57.481683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fc63a2ab-4b94-482f-9e50-f8fc57f4b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:57.484674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870938f-e49d-4b9e-96d1-6eb2d506c560 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.492094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb893d5-ed7c-42b0-b492-75373819da69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:57.492791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb893d5-ed7c-42b0-b492-75373819da69 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.493074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb893d5-ed7c-42b0-b492-75373819da69 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.493349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb893d5-ed7c-42b0-b492-75373819da69 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.494103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb893d5-ed7c-42b0-b492-75373819da69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:57.496484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb893d5-ed7c-42b0-b492-75373819da69 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:57.514323 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3329/6647] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:57.515009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb893d5-ed7c-42b0-b492-75373819da69 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:57.560146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:57.588955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb893d5-ed7c-42b0-b492-75373819da69 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.594724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02566d8c-a553-4974-a183-2f0ba31ff6d5 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:57.595461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566d8c-a553-4974-a183-2f0ba31ff6d5 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.595821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566d8c-a553-4974-a183-2f0ba31ff6d5 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.596171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566d8c-a553-4974-a183-2f0ba31ff6d5 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/groups` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.597015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02566d8c-a553-4974-a183-2f0ba31ff6d5 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:57.599708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02566d8c-a553-4974-a183-2f0ba31ff6d5 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:57.618942 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3319/6648] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:57.620101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63a2ab-4b94-482f-9e50-f8fc57f4b044 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:57.634185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63a2ab-4b94-482f-9e50-f8fc57f4b044 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.634687 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3330/6649] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Aug 29 15:54:57 2022] POST /identity/v3/groups => generated 322 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:57.635614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02566d8c-a553-4974-a183-2f0ba31ff6d5 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:57.642800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65feb3-42ef-4e44-8b37-b82fb3793d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:57.642800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65feb3-42ef-4e44-8b37-b82fb3793d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.643105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65feb3-42ef-4e44-8b37-b82fb3793d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.643340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65feb3-42ef-4e44-8b37-b82fb3793d8c admin admin] PATH_INFO: `/v3/projects/7d29265195ad4907ae4510bc6a00d39a/users/231a5b4a4347485c97c99313f159043b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.662422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02566d8c-a553-4974-a183-2f0ba31ff6d5 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.667144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65feb3-42ef-4e44-8b37-b82fb3793d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d29265195ad4907ae4510bc6a00d39a, user_id=231a5b4a4347485c97c99313f159043b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:57.670721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65feb3-42ef-4e44-8b37-b82fb3793d8c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:57.676264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5d3a5-11c7-458d-aec3-9abade29b7c6 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:57.677142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5d3a5-11c7-458d-aec3-9abade29b7c6 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.677591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5d3a5-11c7-458d-aec3-9abade29b7c6 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.677947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5d3a5-11c7-458d-aec3-9abade29b7c6 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.679068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5d3a5-11c7-458d-aec3-9abade29b7c6 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:57.680104 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-a0a5d3a5-11c7-458d-aec3-9abade29b7c6 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:54:57.680104 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:54:57.680104 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:54:57.680997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5d3a5-11c7-458d-aec3-9abade29b7c6 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:57.690622 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3320/6650] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:54:57 2022] PUT /identity/v3/projects/7d29265195ad4907ae4510bc6a00d39a/users/231a5b4a4347485c97c99313f159043b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:57.692823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65feb3-42ef-4e44-8b37-b82fb3793d8c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:57.713917 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3331/6651] 10.222.0.16 () {60 vars in 1185 bytes} [Mon Aug 29 15:54:57 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:57.716764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93056367-fcf9-4f03-a6ef-1fd9133d9866 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.718089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93056367-fcf9-4f03-a6ef-1fd9133d9866 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.718237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93056367-fcf9-4f03-a6ef-1fd9133d9866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.765372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-93056367-fcf9-4f03-a6ef-1fd9133d9866 None None] MFA Rules not processed for user `231a5b4a4347485c97c99313f159043b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:57.767877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-93056367-fcf9-4f03-a6ef-1fd9133d9866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:57.805036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65feb3-42ef-4e44-8b37-b82fb3793d8c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.810575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:57.811523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.811878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.812371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/08016f4c08c24b71977922944eb448d4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.813812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=08016f4c08c24b71977922944eb448d4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:57.815705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:57.838387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '08016f4c08c24b71977922944eb448d4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:57.839946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:57.840820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '08016f4c08c24b71977922944eb448d4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:57.867860 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3332/6652] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:57.868780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93056367-fcf9-4f03-a6ef-1fd9133d9866 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:57.870405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-93056367-fcf9-4f03-a6ef-1fd9133d9866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:57.878602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '08016f4c08c24b71977922944eb448d4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:57.880972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '08016f4c08c24b71977922944eb448d4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:57.883621 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3321/6653] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:57 2022] PATCH /identity/v3/domains/08016f4c08c24b71977922944eb448d4 => generated 277 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:57.884416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:57.885892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:57.949867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93056367-fcf9-4f03-a6ef-1fd9133d9866 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.974608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe2b64-ecc5-40e1-aa9e-56e1e252f371 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:57.981196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:57.982494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:57.982964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:57.983468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] PATH_INFO: `/v3/users/231a5b4a4347485c97c99313f159043b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:57.984885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231a5b4a4347485c97c99313f159043b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:57.987165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:58.012025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:58.017006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b87dd4-1bdb-41c8-abcf-5353a595dab8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:58.017333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87dd4-1bdb-41c8-abcf-5353a595dab8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:58.017655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87dd4-1bdb-41c8-abcf-5353a595dab8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:58.018071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87dd4-1bdb-41c8-abcf-5353a595dab8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4ce420d6e6d84a87979fb23bee5bb0f3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:58.019059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b87dd4-1bdb-41c8-abcf-5353a595dab8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=4ce420d6e6d84a87979fb23bee5bb0f3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:58.019829 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-40b87dd4-1bdb-41c8-abcf-5353a595dab8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:54:58.019829 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:54:58.019829 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:54:58.020724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b87dd4-1bdb-41c8-abcf-5353a595dab8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:58.034727 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3333/6654] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:54:57 2022] GET /identity/v3/OS-OAUTH1/consumers/4ce420d6e6d84a87979fb23bee5bb0f3 => generated 220 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:58.034727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b87dd4-1bdb-41c8-abcf-5353a595dab8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:58.036858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-40b87dd4-1bdb-41c8-abcf-5353a595dab8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:58.066701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231a5b4a4347485c97c99313f159043b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.067644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231a5b4a4347485c97c99313f159043b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.102726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231a5b4a4347485c97c99313f159043b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.119496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231a5b4a4347485c97c99313f159043b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.135287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b87dd4-1bdb-41c8-abcf-5353a595dab8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:58.139990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231a5b4a4347485c97c99313f159043b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.141140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:58.141837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:58.142125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:58.142405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/08016f4c08c24b71977922944eb448d4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:58.150769 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3322/6655] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:57 2022] DELETE /identity/v3/users/231a5b4a4347485c97c99313f159043b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:58.152262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:58.154802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:58.159670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=08016f4c08c24b71977922944eb448d4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:58.161901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:58.190589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '08016f4c08c24b71977922944eb448d4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.200199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:58.262878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8525f-a068-4418-90b3-bf6131dcea33 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:58.268622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c81f4-d1c9-4081-b689-11d66248bec8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:58.269633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c81f4-d1c9-4081-b689-11d66248bec8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:58.270015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c81f4-d1c9-4081-b689-11d66248bec8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:58.270358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c81f4-d1c9-4081-b689-11d66248bec8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4ce420d6e6d84a87979fb23bee5bb0f3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:58.271343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c81f4-d1c9-4081-b689-11d66248bec8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4ce420d6e6d84a87979fb23bee5bb0f3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:58.272974 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-8c2c81f4-d1c9-4081-b689-11d66248bec8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:54:58.272974 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:54:58.272974 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:54:58.273951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c81f4-d1c9-4081-b689-11d66248bec8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:58.274298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8c2c81f4-d1c9-4081-b689-11d66248bec8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invalidating token cache because consumer 4ce420d6e6d84a87979fb23bee5bb0f3 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:58.274652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8c2c81f4-d1c9-4081-b689-11d66248bec8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.275549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8c2c81f4-d1c9-4081-b689-11d66248bec8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.324263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8c2c81f4-d1c9-4081-b689-11d66248bec8 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4ce420d6e6d84a87979fb23bee5bb0f3', 'request_id': 'req-8c2c81f4-d1c9-4081-b689-11d66248bec8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.347742 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3323/6656] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:54:58 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4ce420d6e6d84a87979fb23bee5bb0f3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:58.349649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c064e-0218-4766-9794-f427af78b348 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:58.349946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c064e-0218-4766-9794-f427af78b348 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:58.350222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c064e-0218-4766-9794-f427af78b348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:58.360817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1c2cc2e64647a98c076e76e4e37362'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.363815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1c2cc2e64647a98c076e76e4e37362'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.381043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1c2cc2e64647a98c076e76e4e37362'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.382054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1c2cc2e64647a98c076e76e4e37362'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.391826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1c2cc2e64647a98c076e76e4e37362'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.393821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-187c064e-0218-4766-9794-f427af78b348 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:58.395210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-187c064e-0218-4766-9794-f427af78b348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:58.409989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '08016f4c08c24b71977922944eb448d4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.484575 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3324/6657] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:58.486986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c064e-0218-4766-9794-f427af78b348 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:58.496374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08016f4c08c24b71977922944eb448d4', 'request_id': 'req-e83efc4e-dd32-4433-a059-8e50b8445cb1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.497534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-187c064e-0218-4766-9794-f427af78b348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:58.524798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:58.536511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08016f4c08c24b71977922944eb448d4', 'request_id': 'req-e83efc4e-dd32-4433-a059-8e50b8445cb1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.549459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08016f4c08c24b71977922944eb448d4', 'request_id': 'req-e83efc4e-dd32-4433-a059-8e50b8445cb1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.585379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] The token cache is being invalidate because project 08016f4c08c24b71977922944eb448d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:58.585590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.590306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.600111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=75,keystone:DELETE=23,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:58.606706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '08016f4c08c24b71977922944eb448d4', 'request_id': 'req-e83efc4e-dd32-4433-a059-8e50b8445cb1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.608031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '08016f4c08c24b71977922944eb448d4', 'request_id': 'req-e83efc4e-dd32-4433-a059-8e50b8445cb1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.610941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '08016f4c08c24b71977922944eb448d4', 'request_id': 'req-e83efc4e-dd32-4433-a059-8e50b8445cb1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:58.634346 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3334/6658] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:54:58 2022] DELETE /identity/v3/domains/08016f4c08c24b71977922944eb448d4 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:58.637050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:58.639486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:58.679210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c064e-0218-4766-9794-f427af78b348 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:58.735592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83efc4e-dd32-4433-a059-8e50b8445cb1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:58.747065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee8148-b886-477a-926b-895b9d08e8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:58.747677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee8148-b886-477a-926b-895b9d08e8cb service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:58.747964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee8148-b886-477a-926b-895b9d08e8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:58.748236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee8148-b886-477a-926b-895b9d08e8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:58.762013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b9ee8148-b886-477a-926b-895b9d08e8cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:58.869904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e2a0d-f41c-4a55-8135-ea21373f7936 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:58.871452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2a0d-f41c-4a55-8135-ea21373f7936 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:58.872594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2a0d-f41c-4a55-8135-ea21373f7936 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:58.872961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2a0d-f41c-4a55-8135-ea21373f7936 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:58.873767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e2a0d-f41c-4a55-8135-ea21373f7936 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:58.876548 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-096e2a0d-f41c-4a55-8135-ea21373f7936 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:54:58.876548 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:54:58.876548 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:54:58.882509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e2a0d-f41c-4a55-8135-ea21373f7936 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:58.919154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee8148-b886-477a-926b-895b9d08e8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:58.920800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee8148-b886-477a-926b-895b9d08e8cb service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:58.924284 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3325/6659] 10.222.0.16 () {60 vars in 1185 bytes} [Mon Aug 29 15:54:58 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:58.925179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e2a0d-f41c-4a55-8135-ea21373f7936 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:58.929678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-096e2a0d-f41c-4a55-8135-ea21373f7936 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:58.935803 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3335/6660] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:54:58.937350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee8148-b886-477a-926b-895b9d08e8cb service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:58.938855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b9ee8148-b886-477a-926b-895b9d08e8cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:58.955812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee8148-b886-477a-926b-895b9d08e8cb service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:58.963633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3854-6df3-4b3f-8af3-1ff238071dfa tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:58.964794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3854-6df3-4b3f-8af3-1ff238071dfa tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:58.965074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3854-6df3-4b3f-8af3-1ff238071dfa tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:58.965367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3854-6df3-4b3f-8af3-1ff238071dfa tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bd788e803ac54491b841b01470051a98` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:58.966034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f3854-6df3-4b3f-8af3-1ff238071dfa tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=bd788e803ac54491b841b01470051a98)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:58.968587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f3854-6df3-4b3f-8af3-1ff238071dfa tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:58.975228 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3336/6661] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:54:58 2022] GET /identity/v3/OS-OAUTH1/consumers/bd788e803ac54491b841b01470051a98 => generated 220 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:58.980690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3854-6df3-4b3f-8af3-1ff238071dfa tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:58.992327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3854-6df3-4b3f-8af3-1ff238071dfa tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.007720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.008891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.009475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.009941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bd788e803ac54491b841b01470051a98` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.010807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=bd788e803ac54491b841b01470051a98)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.013591 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:54:59.013591 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:54:59.013591 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:54:59.015107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.015837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invalidating token cache because consumer bd788e803ac54491b841b01470051a98 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:59.016319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.017271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.041733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'bd788e803ac54491b841b01470051a98', 'request_id': 'req-3ec93868-f385-4f1d-9b95-ebc69d6aba77'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.044200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e2a0d-f41c-4a55-8135-ea21373f7936 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.051278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622591f6-443a-4b43-bf1e-b22e33f0f58a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.052259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622591f6-443a-4b43-bf1e-b22e33f0f58a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.052706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622591f6-443a-4b43-bf1e-b22e33f0f58a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.052891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622591f6-443a-4b43-bf1e-b22e33f0f58a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/08016f4c08c24b71977922944eb448d4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.065148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622591f6-443a-4b43-bf1e-b22e33f0f58a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=08016f4c08c24b71977922944eb448d4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.066382 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3337/6662] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:54:58 2022] DELETE /identity/v3/OS-OAUTH1/consumers/bd788e803ac54491b841b01470051a98 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:59.067353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622591f6-443a-4b43-bf1e-b22e33f0f58a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.070409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.072386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-622591f6-443a-4b43-bf1e-b22e33f0f58a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Could not find domain: 08016f4c08c24b71977922944eb448d4.: keystone.exception.DomainNotFound: Could not find domain: 08016f4c08c24b71977922944eb448d4. Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 08016f4c08c24b71977922944eb448d4. Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:59.088772 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:59.090238 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 08016f4c08c24b71977922944eb448d4. Aug 29 15:54:59.091225 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:59.092040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec93868-f385-4f1d-9b95-ebc69d6aba77 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.093893 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3326/6663] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:54:58 2022] GET /identity/v3/domains/08016f4c08c24b71977922944eb448d4 => generated 112 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:54:59.094760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622591f6-443a-4b43-bf1e-b22e33f0f58a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.096466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-622591f6-443a-4b43-bf1e-b22e33f0f58a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:59.100542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feda685-5e8b-4f83-822f-9968f834cf00 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.101336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feda685-5e8b-4f83-822f-9968f834cf00 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.101727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feda685-5e8b-4f83-822f-9968f834cf00 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.102011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feda685-5e8b-4f83-822f-9968f834cf00 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bd788e803ac54491b841b01470051a98` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.102616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feda685-5e8b-4f83-822f-9968f834cf00 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=bd788e803ac54491b841b01470051a98)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.104574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feda685-5e8b-4f83-822f-9968f834cf00 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.110700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622591f6-443a-4b43-bf1e-b22e33f0f58a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.117103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ff9b1-ee7c-461a-92f9-c60e33599a1a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.118389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ff9b1-ee7c-461a-92f9-c60e33599a1a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.118677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ff9b1-ee7c-461a-92f9-c60e33599a1a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.118953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ff9b1-ee7c-461a-92f9-c60e33599a1a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/users/cd1c2cc2e64647a98c076e76e4e37362` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-6feda685-5e8b-4f83-822f-9968f834cf00 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Aug 29 15:54:59.123925 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Aug 29 15:54:59.124990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Aug 29 15:54:59.124990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Aug 29 15:54:59.124990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Aug 29 15:54:59.124990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Aug 29 15:54:59.124990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 29 15:54:59.124990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 29 15:54:59.124990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 29 15:54:59.124990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 29 15:54:59.124990 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:59.132641 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3338/6664] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:54:59 2022] GET /identity/v3/OS-OAUTH1/consumers/bd788e803ac54491b841b01470051a98 => generated 74 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:54:59.132788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ff9b1-ee7c-461a-92f9-c60e33599a1a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:get_user(user_id=cd1c2cc2e64647a98c076e76e4e37362)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.132788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ff9b1-ee7c-461a-92f9-c60e33599a1a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.134418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feda685-5e8b-4f83-822f-9968f834cf00 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-4b5ff9b1-ee7c-461a-92f9-c60e33599a1a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Could not find user: cd1c2cc2e64647a98c076e76e4e37362.: keystone.exception.UserNotFound: Could not find user: cd1c2cc2e64647a98c076e76e4e37362. Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 15:54:59.147346 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:59.148502 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cd1c2cc2e64647a98c076e76e4e37362. Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:59.149748 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3327/6665] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:54:59 2022] GET /identity/v3/users/cd1c2cc2e64647a98c076e76e4e37362 => generated 110 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:54:59.152506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ff9b1-ee7c-461a-92f9-c60e33599a1a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.157025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feda685-5e8b-4f83-822f-9968f834cf00 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.163075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ff9b1-ee7c-461a-92f9-c60e33599a1a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.164100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.164736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.165027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.165331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bd788e803ac54491b841b01470051a98` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.169449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e1b41-a317-44f2-be46-9a80ceebabd0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.170098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e1b41-a317-44f2-be46-9a80ceebabd0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.170322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=bd788e803ac54491b841b01470051a98)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.170428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e1b41-a317-44f2-be46-9a80ceebabd0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.170642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e1b41-a317-44f2-be46-9a80ceebabd0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/groups/2bbc9bc5b20249a686377834b256ec15` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.173597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.173881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invalidating token cache because consumer bd788e803ac54491b841b01470051a98 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:59.174169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.177452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e1b41-a317-44f2-be46-9a80ceebabd0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:get_group(group_id=2bbc9bc5b20249a686377834b256ec15)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.178495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.178606 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-4d5e1b41-a317-44f2-be46-9a80ceebabd0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:54:59.178606 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:54:59.178606 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:54:59.179644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e1b41-a317-44f2-be46-9a80ceebabd0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Aug 29 15:54:59.200135 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:59.201133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:59.201133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Aug 29 15:54:59.201133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Aug 29 15:54:59.201133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Aug 29 15:54:59.201133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Aug 29 15:54:59.201133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Aug 29 15:54:59.201133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 29 15:54:59.201133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 29 15:54:59.201133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 29 15:54:59.201133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 29 15:54:59.201133 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:59.202241 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3339/6666] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:54:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/bd788e803ac54491b841b01470051a98 => generated 74 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-4d5e1b41-a317-44f2-be46-9a80ceebabd0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Could not find group: 2bbc9bc5b20249a686377834b256ec15.: keystone.exception.GroupNotFound: Could not find group: 2bbc9bc5b20249a686377834b256ec15. Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_group(group_id) Aug 29 15:54:59.203165 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:59.204026 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 2bbc9bc5b20249a686377834b256ec15. Aug 29 15:54:59.204979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:59.209153 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3328/6667] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:59 2022] GET /identity/v3/groups/2bbc9bc5b20249a686377834b256ec15 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 15:54:59.209379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.209379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:59.210981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e1b41-a317-44f2-be46-9a80ceebabd0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.214267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4d5e1b41-a317-44f2-be46-9a80ceebabd0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:59.224390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58827dfe-ffe5-4fc9-9b98-6b5afb01cb3b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.230872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bfe6e-1ff4-4460-971c-33a44aaff579 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.231612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bfe6e-1ff4-4460-971c-33a44aaff579 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.232111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bfe6e-1ff4-4460-971c-33a44aaff579 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.232530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bfe6e-1ff4-4460-971c-33a44aaff579 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.233282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bfe6e-1ff4-4460-971c-33a44aaff579 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.235374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bfe6e-1ff4-4460-971c-33a44aaff579 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.238708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e1b41-a317-44f2-be46-9a80ceebabd0 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.246796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1299-e5c9-424d-ac3f-1a61d34002a4 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.250811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1299-e5c9-424d-ac3f-1a61d34002a4 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.251152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1299-e5c9-424d-ac3f-1a61d34002a4 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.251439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1299-e5c9-424d-ac3f-1a61d34002a4 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/groups/2bbc9bc5b20249a686377834b256ec15` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.260877 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3340/6668] 10.222.0.16 () {60 vars in 1185 bytes} [Mon Aug 29 15:54:59 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:59.262093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef1299-e5c9-424d-ac3f-1a61d34002a4 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:54:59.265571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bfe6e-1ff4-4460-971c-33a44aaff579 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-78ef1299-e5c9-424d-ac3f-1a61d34002a4 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Could not find group: 2bbc9bc5b20249a686377834b256ec15.: keystone.exception.GroupNotFound: Could not find group: 2bbc9bc5b20249a686377834b256ec15. Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Aug 29 15:54:59.269714 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:59.271255 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 2bbc9bc5b20249a686377834b256ec15. Aug 29 15:54:59.272192 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:59.278245 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3329/6669] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:54:59 2022] DELETE /identity/v3/groups/2bbc9bc5b20249a686377834b256ec15 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 15:54:59.279640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1299-e5c9-424d-ac3f-1a61d34002a4 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.286812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bfe6e-1ff4-4460-971c-33a44aaff579 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.293844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1299-e5c9-424d-ac3f-1a61d34002a4 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.295277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd721a-f81d-428d-883d-e4ee6c6180a1 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.295922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd721a-f81d-428d-883d-e4ee6c6180a1 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.296221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd721a-f81d-428d-883d-e4ee6c6180a1 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.297185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd721a-f81d-428d-883d-e4ee6c6180a1 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.298367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd721a-f81d-428d-883d-e4ee6c6180a1 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.300282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc2e43-a3da-4920-8828-4c7fd08f395c tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.301522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2e43-a3da-4920-8828-4c7fd08f395c tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.302597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2e43-a3da-4920-8828-4c7fd08f395c tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.302822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2e43-a3da-4920-8828-4c7fd08f395c tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/users/cd1c2cc2e64647a98c076e76e4e37362` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.306093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd721a-f81d-428d-883d-e4ee6c6180a1 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.315643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc2e43-a3da-4920-8828-4c7fd08f395c tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cd1c2cc2e64647a98c076e76e4e37362)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.318157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc2e43-a3da-4920-8828-4c7fd08f395c tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.322609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:59.333849 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3341/6670] 10.222.0.16 () {60 vars in 1185 bytes} [Mon Aug 29 15:54:59 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:59.335237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd721a-f81d-428d-883d-e4ee6c6180a1 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-38bc2e43-a3da-4920-8828-4c7fd08f395c tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Could not find user: cd1c2cc2e64647a98c076e76e4e37362.: keystone.exception.UserNotFound: Could not find user: cd1c2cc2e64647a98c076e76e4e37362. Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Aug 29 15:54:59.338979 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:59.340474 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cd1c2cc2e64647a98c076e76e4e37362. Aug 29 15:54:59.348670 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:59.350167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-33bd721a-f81d-428d-883d-e4ee6c6180a1 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:59.350264 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3330/6671] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:54:59 2022] DELETE /identity/v3/users/cd1c2cc2e64647a98c076e76e4e37362 => generated 110 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:54:59.350264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc2e43-a3da-4920-8828-4c7fd08f395c tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.358450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd721a-f81d-428d-883d-e4ee6c6180a1 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.364750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.365500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.365851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.366204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] PATH_INFO: `/v3/projects/7d29265195ad4907ae4510bc6a00d39a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.367452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d29265195ad4907ae4510bc6a00d39a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.369534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.375946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc2e43-a3da-4920-8828-4c7fd08f395c tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.384247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f51d6b-436c-4af2-b2c3-80ac69071533 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.384954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51d6b-436c-4af2-b2c3-80ac69071533 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.385201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51d6b-436c-4af2-b2c3-80ac69071533 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.385527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f51d6b-436c-4af2-b2c3-80ac69071533 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.386139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f51d6b-436c-4af2-b2c3-80ac69071533 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.387164 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-80f51d6b-436c-4af2-b2c3-80ac69071533 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:54:59.387164 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:54:59.387164 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:54:59.388732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f51d6b-436c-4af2-b2c3-80ac69071533 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.390854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:59.396587 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3331/6672] 10.222.0.16 () {58 vars in 1164 bytes} [Mon Aug 29 15:54:59 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:59.396587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f51d6b-436c-4af2-b2c3-80ac69071533 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.410027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f51d6b-436c-4af2-b2c3-80ac69071533 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.415755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ef418-2e8f-464c-a93d-2a5f2320317a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.416592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ef418-2e8f-464c-a93d-2a5f2320317a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.417019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ef418-2e8f-464c-a93d-2a5f2320317a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.417950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ef418-2e8f-464c-a93d-2a5f2320317a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/08016f4c08c24b71977922944eb448d4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.428851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ef418-2e8f-464c-a93d-2a5f2320317a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-960ef418-2e8f-464c-a93d-2a5f2320317a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Could not find domain: 08016f4c08c24b71977922944eb448d4.: keystone.exception.DomainNotFound: Could not find domain: 08016f4c08c24b71977922944eb448d4. Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 08016f4c08c24b71977922944eb448d4. Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:59.434729 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:59.436002 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 08016f4c08c24b71977922944eb448d4. Aug 29 15:54:59.437454 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:54:59.438952 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3332/6673] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:59 2022] PATCH /identity/v3/domains/08016f4c08c24b71977922944eb448d4 => generated 112 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:54:59.438952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ef418-2e8f-464c-a93d-2a5f2320317a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.449104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d29265195ad4907ae4510bc6a00d39a', 'request_id': 'req-3b94937c-322a-451d-93db-093993dc3073'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.449574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ef418-2e8f-464c-a93d-2a5f2320317a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.456424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d29265195ad4907ae4510bc6a00d39a', 'request_id': 'req-3b94937c-322a-451d-93db-093993dc3073'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.467157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d29265195ad4907ae4510bc6a00d39a', 'request_id': 'req-3b94937c-322a-451d-93db-093993dc3073'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.480804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] The token cache is being invalidate because project 7d29265195ad4907ae4510bc6a00d39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:59.481237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.481960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.484978 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3342/6674] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:54:59 2022] DELETE /identity/v3/projects/7d29265195ad4907ae4510bc6a00d39a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:59.486235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.487768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:59.529822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb8efa-6595-4bd7-bc24-d8e81b2ad278 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.530628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb8efa-6595-4bd7-bc24-d8e81b2ad278 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.530924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb8efa-6595-4bd7-bc24-d8e81b2ad278 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.532235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb8efa-6595-4bd7-bc24-d8e81b2ad278 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9bab5275f9de4ebe81ebd42880c6586e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.532926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb8efa-6595-4bd7-bc24-d8e81b2ad278 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9bab5275f9de4ebe81ebd42880c6586e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.534787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb8efa-6595-4bd7-bc24-d8e81b2ad278 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.535080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2cdb8efa-6595-4bd7-bc24-d8e81b2ad278 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invalidating token cache because consumer 9bab5275f9de4ebe81ebd42880c6586e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:59.535569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2cdb8efa-6595-4bd7-bc24-d8e81b2ad278 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.536467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2cdb8efa-6595-4bd7-bc24-d8e81b2ad278 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.551254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2cdb8efa-6595-4bd7-bc24-d8e81b2ad278 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '9bab5275f9de4ebe81ebd42880c6586e', 'request_id': 'req-2cdb8efa-6595-4bd7-bc24-d8e81b2ad278'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.581089 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3333/6675] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:54:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9bab5275f9de4ebe81ebd42880c6586e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:59.583913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50781351-2d5f-47ee-9d32-9ec01dc8b4db None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.584346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50781351-2d5f-47ee-9d32-9ec01dc8b4db None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.584631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50781351-2d5f-47ee-9d32-9ec01dc8b4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.594323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94937c-322a-451d-93db-093993dc3073 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.601491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24510dff-df57-47b7-8680-a88f4d0dcab7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.602210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24510dff-df57-47b7-8680-a88f4d0dcab7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.602502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24510dff-df57-47b7-8680-a88f4d0dcab7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.602868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24510dff-df57-47b7-8680-a88f4d0dcab7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.608902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24510dff-df57-47b7-8680-a88f4d0dcab7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.609748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-50781351-2d5f-47ee-9d32-9ec01dc8b4db None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:59.610577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24510dff-df57-47b7-8680-a88f4d0dcab7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.611163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-50781351-2d5f-47ee-9d32-9ec01dc8b4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:59.624485 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3343/6676] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Aug 29 15:54:59 2022] GET /identity/v3/domains => generated 1345 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:59.625735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24510dff-df57-47b7-8680-a88f4d0dcab7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.629503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-24510dff-df57-47b7-8680-a88f4d0dcab7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:59.647137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24510dff-df57-47b7-8680-a88f4d0dcab7 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.652964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.653665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.654057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.654336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3149e354c8cc4907b5b7592ffb927ee2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.655194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=3149e354c8cc4907b5b7592ffb927ee2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.656797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.657076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invalidating token cache because consumer 3149e354c8cc4907b5b7592ffb927ee2 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:54:59.657358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.658091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.672282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '3149e354c8cc4907b5b7592ffb927ee2', 'request_id': 'req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:54:59.686665 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3344/6677] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:54:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/3149e354c8cc4907b5b7592ffb927ee2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:54:59.687526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.690493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:59.693538 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3334/6678] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:59.694843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50781351-2d5f-47ee-9d32-9ec01dc8b4db None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.696422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-50781351-2d5f-47ee-9d32-9ec01dc8b4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:59.704110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd3fac-34c2-4d77-9a43-4e5e07f50fc7 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.710161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4253-b0f7-4da9-bbb3-25fe9ef8512b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.710987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4253-b0f7-4da9-bbb3-25fe9ef8512b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.711349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4253-b0f7-4da9-bbb3-25fe9ef8512b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.711636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4253-b0f7-4da9-bbb3-25fe9ef8512b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.712296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a4253-b0f7-4da9-bbb3-25fe9ef8512b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:59.712603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a4253-b0f7-4da9-bbb3-25fe9ef8512b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.713898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50781351-2d5f-47ee-9d32-9ec01dc8b4db None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.715051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a4253-b0f7-4da9-bbb3-25fe9ef8512b tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.719338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52615bed-990c-436c-8ceb-f52ab8e66a04 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.720017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52615bed-990c-436c-8ceb-f52ab8e66a04 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.720372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52615bed-990c-436c-8ceb-f52ab8e66a04 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.720718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52615bed-990c-436c-8ceb-f52ab8e66a04 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.721526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52615bed-990c-436c-8ceb-f52ab8e66a04 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.723199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52615bed-990c-436c-8ceb-f52ab8e66a04 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.739719 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3345/6679] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:59 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:54:59.739719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aeef5-7a58-464c-b9f6-13df4f303a17 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.739719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aeef5-7a58-464c-b9f6-13df4f303a17 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.739719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aeef5-7a58-464c-b9f6-13df4f303a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.746024 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3335/6680] 10.222.0.16 () {60 vars in 1185 bytes} [Mon Aug 29 15:54:59 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:59.747142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52615bed-990c-436c-8ceb-f52ab8e66a04 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.762325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52615bed-990c-436c-8ceb-f52ab8e66a04 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.765443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1b4aeef5-7a58-464c-b9f6-13df4f303a17 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:54:59.766750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1b4aeef5-7a58-464c-b9f6-13df4f303a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:54:59.768121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070fbac-fe73-49da-b922-a63a3433d4d9 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.769639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070fbac-fe73-49da-b922-a63a3433d4d9 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.770281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070fbac-fe73-49da-b922-a63a3433d4d9 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.770850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070fbac-fe73-49da-b922-a63a3433d4d9 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.771689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070fbac-fe73-49da-b922-a63a3433d4d9 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-515048510) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:59.772187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070fbac-fe73-49da-b922-a63a3433d4d9 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.774034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070fbac-fe73-49da-b922-a63a3433d4d9 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.777174 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3346/6681] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:54:59.777938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4aeef5-7a58-464c-b9f6-13df4f303a17 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.789286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4aeef5-7a58-464c-b9f6-13df4f303a17 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.797107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393c1a5-bce2-4a28-92f2-b1f0eacaae96 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.797818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c1a5-bce2-4a28-92f2-b1f0eacaae96 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.798144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c1a5-bce2-4a28-92f2-b1f0eacaae96 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.798698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c1a5-bce2-4a28-92f2-b1f0eacaae96 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2e3bca9518924167b77019e8836eb5de` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.799418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393c1a5-bce2-4a28-92f2-b1f0eacaae96 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=2e3bca9518924167b77019e8836eb5de)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.800568 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-0393c1a5-bce2-4a28-92f2-b1f0eacaae96 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:54:59.800568 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:54:59.800568 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:54:59.806538 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3336/6682] 10.222.0.16 () {58 vars in 1197 bytes} [Mon Aug 29 15:54:59 2022] GET /identity/v3/domains?name=tempest-test_domain-515048510 => generated 406 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:59.806706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393c1a5-bce2-4a28-92f2-b1f0eacaae96 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.806787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070fbac-fe73-49da-b922-a63a3433d4d9 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.823105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070fbac-fe73-49da-b922-a63a3433d4d9 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.826147 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3347/6683] 10.222.0.16 () {60 vars in 1285 bytes} [Mon Aug 29 15:54:59 2022] PATCH /identity/v3/OS-OAUTH1/consumers/2e3bca9518924167b77019e8836eb5de => generated 221 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:59.827265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393c1a5-bce2-4a28-92f2-b1f0eacaae96 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.829953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1217a7e-e96b-49f7-be12-8e974247d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.830577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1217a7e-e96b-49f7-be12-8e974247d345 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.830860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1217a7e-e96b-49f7-be12-8e974247d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.831136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1217a7e-e96b-49f7-be12-8e974247d345 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.831788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1217a7e-e96b-49f7-be12-8e974247d345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:54:59.832088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1217a7e-e96b-49f7-be12-8e974247d345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.834112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1217a7e-e96b-49f7-be12-8e974247d345 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.843137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393c1a5-bce2-4a28-92f2-b1f0eacaae96 tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.848946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4bcd7-2d80-4b6c-840e-b96d0af2dbd1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.849889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bcd7-2d80-4b6c-840e-b96d0af2dbd1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.850265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bcd7-2d80-4b6c-840e-b96d0af2dbd1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.850617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bcd7-2d80-4b6c-840e-b96d0af2dbd1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/08016f4c08c24b71977922944eb448d4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.851589 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3337/6684] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:59.852761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1217a7e-e96b-49f7-be12-8e974247d345 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.864206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4bcd7-2d80-4b6c-840e-b96d0af2dbd1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-24e4bcd7-2d80-4b6c-840e-b96d0af2dbd1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Could not find domain: 08016f4c08c24b71977922944eb448d4.: keystone.exception.DomainNotFound: Could not find domain: 08016f4c08c24b71977922944eb448d4. Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 08016f4c08c24b71977922944eb448d4. Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:54:59.870201 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:54:59.871806 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 08016f4c08c24b71977922944eb448d4. Aug 29 15:54:59.872698 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:54:59.873908 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3348/6685] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:59 2022] PATCH /identity/v3/domains/08016f4c08c24b71977922944eb448d4 => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:54:59.873908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4bcd7-2d80-4b6c-840e-b96d0af2dbd1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.881109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1217a7e-e96b-49f7-be12-8e974247d345 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.887647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4bcd7-2d80-4b6c-840e-b96d0af2dbd1 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.888172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9457ed-55fb-45d0-8a45-2c416b67eeba tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.889240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9457ed-55fb-45d0-8a45-2c416b67eeba tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.889891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9457ed-55fb-45d0-8a45-2c416b67eeba tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.890322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9457ed-55fb-45d0-8a45-2c416b67eeba tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2e3bca9518924167b77019e8836eb5de` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.891079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9457ed-55fb-45d0-8a45-2c416b67eeba tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=2e3bca9518924167b77019e8836eb5de)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.892822 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-0c9457ed-55fb-45d0-8a45-2c416b67eeba tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:54:59.892822 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:54:59.892822 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:54:59.893367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaec2bf-988b-466c-8380-d6a68d4be694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:54:59.894152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec2bf-988b-466c-8380-d6a68d4be694 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:54:59.894540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec2bf-988b-466c-8380-d6a68d4be694 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:54:59.894882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec2bf-988b-466c-8380-d6a68d4be694 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:54:59.895030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9457ed-55fb-45d0-8a45-2c416b67eeba tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.895593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaec2bf-988b-466c-8380-d6a68d4be694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:54:59.897819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaec2bf-988b-466c-8380-d6a68d4be694 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:54:59.901192 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3338/6686] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Aug 29 15:54:59 2022] GET /identity/v3/OS-OAUTH1/consumers/2e3bca9518924167b77019e8836eb5de => generated 221 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:54:59.904988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9457ed-55fb-45d0-8a45-2c416b67eeba tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.925306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:59.943441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9457ed-55fb-45d0-8a45-2c416b67eeba tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:54:59.950866 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3349/6687] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:54:59 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:54:59.952630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaec2bf-988b-466c-8380-d6a68d4be694 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:54:59.964945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:00.061647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622eb9-2e02-440e-838d-bacf9abcaddd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:00.062740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622eb9-2e02-440e-838d-bacf9abcaddd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:00.063109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622eb9-2e02-440e-838d-bacf9abcaddd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:00.063733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622eb9-2e02-440e-838d-bacf9abcaddd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/61a68deb61c24d999effc2f3a7b43bec` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:00.081172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70622eb9-2e02-440e-838d-bacf9abcaddd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=61a68deb61c24d999effc2f3a7b43bec)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:00.083317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaec2bf-988b-466c-8380-d6a68d4be694 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:00.084233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70622eb9-2e02-440e-838d-bacf9abcaddd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:00.098754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f34e0a8e7421291afe70463c56504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:00.099457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:00.099753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:00.100063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2e3bca9518924167b77019e8836eb5de` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:00.100629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2e3bca9518924167b77019e8836eb5de)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:00.102297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:00.102577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invalidating token cache because consumer 2e3bca9518924167b77019e8836eb5de has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:00.102858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.105829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.123484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '2e3bca9518924167b77019e8836eb5de', 'request_id': 'req-8ab7c118-12e4-47ec-b086-871dea88224b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.147014 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3350/6688] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Aug 29 15:54:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2e3bca9518924167b77019e8836eb5de => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:00.150307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:00.151558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:00.191597 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3339/6689] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:54:59 2022] PATCH /identity/v3/domains/61a68deb61c24d999effc2f3a7b43bec => generated 276 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:00.192506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622eb9-2e02-440e-838d-bacf9abcaddd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:00.199021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-70622eb9-2e02-440e-838d-bacf9abcaddd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:00.267721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7c118-12e4-47ec-b086-871dea88224b tempest-OAUTHConsumersV3Test-552195972 tempest-OAUTHConsumersV3Test-552195972-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:00.272584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ee75e-62c3-4712-866a-b0ce774a4fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:00.273357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ee75e-62c3-4712-866a-b0ce774a4fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:00.273871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ee75e-62c3-4712-866a-b0ce774a4fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:00.274286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ee75e-62c3-4712-866a-b0ce774a4fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:00.275064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ee75e-62c3-4712-866a-b0ce774a4fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:00.282044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ee75e-62c3-4712-866a-b0ce774a4fb1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:00.334783 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3351/6690] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:00 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:00.336815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ee75e-62c3-4712-866a-b0ce774a4fb1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:00.339027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-491ee75e-62c3-4712-866a-b0ce774a4fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:00.363587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ee75e-62c3-4712-866a-b0ce774a4fb1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:00.370505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:00.372052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622eb9-2e02-440e-838d-bacf9abcaddd tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:00.372407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:00.372933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:00.373342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/61a68deb61c24d999effc2f3a7b43bec` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:00.388419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:00.389474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:00.389834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:00.390368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] PATH_INFO: `/v3/users/ec54d01ac0ce47cd87cd29c030b31d0a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:00.391752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec54d01ac0ce47cd87cd29c030b31d0a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:00.393307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=61a68deb61c24d999effc2f3a7b43bec)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:00.393924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:00.395487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:00.431825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '61a68deb61c24d999effc2f3a7b43bec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.447344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '61a68deb61c24d999effc2f3a7b43bec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.468674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec54d01ac0ce47cd87cd29c030b31d0a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.470135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec54d01ac0ce47cd87cd29c030b31d0a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.490597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec54d01ac0ce47cd87cd29c030b31d0a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.492521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:00.509896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec54d01ac0ce47cd87cd29c030b31d0a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.517285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a68deb61c24d999effc2f3a7b43bec', 'request_id': 'req-a1216b2c-edc0-4612-8e9a-73e16ac16740'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.519092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:00.525579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec54d01ac0ce47cd87cd29c030b31d0a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.539774 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3340/6691] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:00 2022] DELETE /identity/v3/users/ec54d01ac0ce47cd87cd29c030b31d0a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:00.539774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:00.539774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:00.540593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a68deb61c24d999effc2f3a7b43bec', 'request_id': 'req-a1216b2c-edc0-4612-8e9a-73e16ac16740'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.554265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a68deb61c24d999effc2f3a7b43bec', 'request_id': 'req-a1216b2c-edc0-4612-8e9a-73e16ac16740'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.568879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] The token cache is being invalidate because project 61a68deb61c24d999effc2f3a7b43bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:00.569177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.569873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.580970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '61a68deb61c24d999effc2f3a7b43bec', 'request_id': 'req-a1216b2c-edc0-4612-8e9a-73e16ac16740'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.582369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '61a68deb61c24d999effc2f3a7b43bec', 'request_id': 'req-a1216b2c-edc0-4612-8e9a-73e16ac16740'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.585605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1216b2c-edc0-4612-8e9a-73e16ac16740 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '61a68deb61c24d999effc2f3a7b43bec', 'request_id': 'req-a1216b2c-edc0-4612-8e9a-73e16ac16740'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.599873 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3352/6692] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:55:00 2022] DELETE /identity/v3/domains/61a68deb61c24d999effc2f3a7b43bec => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:00.599873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f234b-b32b-4972-ac6c-f272b22ffb95 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:00.599873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f234b-b32b-4972-ac6c-f272b22ffb95 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:00.599873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f234b-b32b-4972-ac6c-f272b22ffb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:00.634893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2d0f234b-b32b-4972-ac6c-f272b22ffb95 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:00.636312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2d0f234b-b32b-4972-ac6c-f272b22ffb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:00.662764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe10483-4efa-4c5e-9bcb-c742c0e741a9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:00.669336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ac178-b750-4597-ad29-2ce0c524028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:00.670061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac178-b750-4597-ad29-2ce0c524028e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:00.670751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac178-b750-4597-ad29-2ce0c524028e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:00.671039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac178-b750-4597-ad29-2ce0c524028e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:00.671962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ac178-b750-4597-ad29-2ce0c524028e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:00.674093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ac178-b750-4597-ad29-2ce0c524028e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:00.690824 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3341/6693] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:00.692039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ac178-b750-4597-ad29-2ce0c524028e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:00.694575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9e4ac178-b750-4597-ad29-2ce0c524028e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:00.726551 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3353/6694] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:00.727686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f234b-b32b-4972-ac6c-f272b22ffb95 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:00.736939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2d0f234b-b32b-4972-ac6c-f272b22ffb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:00.750450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f234b-b32b-4972-ac6c-f272b22ffb95 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:00.758819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa29e6-a0cd-4dd9-8f28-60ca9290d17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:00.759392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa29e6-a0cd-4dd9-8f28-60ca9290d17f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:00.759677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa29e6-a0cd-4dd9-8f28-60ca9290d17f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:00.759956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa29e6-a0cd-4dd9-8f28-60ca9290d17f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:00.760610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa29e6-a0cd-4dd9-8f28-60ca9290d17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:00.763961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa29e6-a0cd-4dd9-8f28-60ca9290d17f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:00.777918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ac178-b750-4597-ad29-2ce0c524028e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:00.781326 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3354/6695] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:00.782517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa29e6-a0cd-4dd9-8f28-60ca9290d17f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:00.784237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-acaa29e6-a0cd-4dd9-8f28-60ca9290d17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:00.787034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:00.787780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:00.788217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:00.788551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/42d70717a6a14a198f894fe2050a8170` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:00.801033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=42d70717a6a14a198f894fe2050a8170)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:00.802797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:00.826322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '42d70717a6a14a198f894fe2050a8170'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.827169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '42d70717a6a14a198f894fe2050a8170'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.852518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa29e6-a0cd-4dd9-8f28-60ca9290d17f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:00.853968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '42d70717a6a14a198f894fe2050a8170'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.854660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '42d70717a6a14a198f894fe2050a8170'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:00.860336 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3342/6696] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:55:00 2022] PATCH /identity/v3/domains/42d70717a6a14a198f894fe2050a8170 => generated 277 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:00.860336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:00.860336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:00.911308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:00.918749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81628cd8-b49a-4267-86ed-c61f1f8f7321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:00.919372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628cd8-b49a-4267-86ed-c61f1f8f7321 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:00.919492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:00.919659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628cd8-b49a-4267-86ed-c61f1f8f7321 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:00.920256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628cd8-b49a-4267-86ed-c61f1f8f7321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:00.923580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-81628cd8-b49a-4267-86ed-c61f1f8f7321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:00.939465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e2c8e-2adb-488a-979e-1ab817362e7a tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:00.945153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0271d-e8ad-4db8-9400-451ab2204986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:00.945853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0271d-e8ad-4db8-9400-451ab2204986 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:00.946141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0271d-e8ad-4db8-9400-451ab2204986 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:00.946422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0271d-e8ad-4db8-9400-451ab2204986 admin admin] PATH_INFO: `/v3/projects/195cb5aa04604258b6d081ab22be2f6a/users/da22efaea08d47cc9aecb5e1e92c26cc/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:00.962245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0271d-e8ad-4db8-9400-451ab2204986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195cb5aa04604258b6d081ab22be2f6a, user_id=da22efaea08d47cc9aecb5e1e92c26cc, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:00.965566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0271d-e8ad-4db8-9400-451ab2204986 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:00.979423 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3343/6697] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:00 2022] PUT /identity/v3/projects/195cb5aa04604258b6d081ab22be2f6a/users/da22efaea08d47cc9aecb5e1e92c26cc/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:00.980418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0271d-e8ad-4db8-9400-451ab2204986 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:00.982079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72e0271d-e8ad-4db8-9400-451ab2204986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:01.011587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81628cd8-b49a-4267-86ed-c61f1f8f7321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:01.013441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81628cd8-b49a-4267-86ed-c61f1f8f7321 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:01.025359 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3355/6698] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:01.032063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1435eb-a376-49dc-a9f2-f63e6a335b49 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:01.032701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1435eb-a376-49dc-a9f2-f63e6a335b49 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:01.032983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1435eb-a376-49dc-a9f2-f63e6a335b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:01.059622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0271d-e8ad-4db8-9400-451ab2204986 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:01.065607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:01.066455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:01.066842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:01.067202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/42d70717a6a14a198f894fe2050a8170` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:01.069698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0e1435eb-a376-49dc-a9f2-f63e6a335b49 None None] MFA Rules not processed for user `da22efaea08d47cc9aecb5e1e92c26cc`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:01.071241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0e1435eb-a376-49dc-a9f2-f63e6a335b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:01.082293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=42d70717a6a14a198f894fe2050a8170)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:01.084297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:01.126753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '42d70717a6a14a198f894fe2050a8170'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.142356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '42d70717a6a14a198f894fe2050a8170'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.210489 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3356/6699] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:01.219991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1435eb-a376-49dc-a9f2-f63e6a335b49 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:01.224427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d70717a6a14a198f894fe2050a8170', 'request_id': 'req-c759b763-f4bf-400e-90e6-473f431daa49'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.243436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d70717a6a14a198f894fe2050a8170', 'request_id': 'req-c759b763-f4bf-400e-90e6-473f431daa49'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.260051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d70717a6a14a198f894fe2050a8170', 'request_id': 'req-c759b763-f4bf-400e-90e6-473f431daa49'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.332809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] The token cache is being invalidate because project 42d70717a6a14a198f894fe2050a8170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:01.348149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.363613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.409564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '42d70717a6a14a198f894fe2050a8170', 'request_id': 'req-c759b763-f4bf-400e-90e6-473f431daa49'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.415264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '42d70717a6a14a198f894fe2050a8170', 'request_id': 'req-c759b763-f4bf-400e-90e6-473f431daa49'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.416896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '42d70717a6a14a198f894fe2050a8170', 'request_id': 'req-c759b763-f4bf-400e-90e6-473f431daa49'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.455484 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3344/6700] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:55:00 2022] DELETE /identity/v3/domains/42d70717a6a14a198f894fe2050a8170 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:01.456635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:01.458180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:01.471628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:01.489829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1435eb-a376-49dc-a9f2-f63e6a335b49 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:01.586490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:01.593706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759b763-f4bf-400e-90e6-473f431daa49 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:01.608193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:01.611159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:01.611159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:01.611159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/397d0f8f6c56413fa086b848d996849d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:01.642574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=397d0f8f6c56413fa086b848d996849d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:01.644373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:01.653363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e78f83-40f2-4d23-986f-d0854d074526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:01.654978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78f83-40f2-4d23-986f-d0854d074526 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:01.656483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78f83-40f2-4d23-986f-d0854d074526 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:01.656952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78f83-40f2-4d23-986f-d0854d074526 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:01.659244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e78f83-40f2-4d23-986f-d0854d074526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:01.666658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e78f83-40f2-4d23-986f-d0854d074526 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:01.691804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '397d0f8f6c56413fa086b848d996849d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.692797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '397d0f8f6c56413fa086b848d996849d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.740668 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3357/6701] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:01 2022] POST /identity/v3/projects => generated 369 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:01.742341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e78f83-40f2-4d23-986f-d0854d074526 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:01.746725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b1e78f83-40f2-4d23-986f-d0854d074526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:01.766347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '397d0f8f6c56413fa086b848d996849d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.768682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '397d0f8f6c56413fa086b848d996849d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:01.778686 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3345/6702] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:55:01 2022] PATCH /identity/v3/domains/397d0f8f6c56413fa086b848d996849d => generated 276 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:01.781534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:01.782944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:01.891640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e78f83-40f2-4d23-986f-d0854d074526 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:01.908224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:01.909256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:01.911502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:01.911794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] PATH_INFO: `/v3/projects/5069ad3f042e41b2a01e0622ba471015` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:01.914106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5069ad3f042e41b2a01e0622ba471015)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:01.924030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:01.951580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ea6d7-4159-49ea-a5b5-fe64e5385955 tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:01.966472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a5468-1a30-4ea1-9531-4a063ff253ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:01.967816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5468-1a30-4ea1-9531-4a063ff253ec admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:01.968104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5468-1a30-4ea1-9531-4a063ff253ec admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:01.968387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5468-1a30-4ea1-9531-4a063ff253ec admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:01.969038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a5468-1a30-4ea1-9531-4a063ff253ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:01.973264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a5468-1a30-4ea1-9531-4a063ff253ec admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:02.016434 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3346/6703] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:01 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:02.019169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a5468-1a30-4ea1-9531-4a063ff253ec admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:02.022413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8c0a5468-1a30-4ea1-9531-4a063ff253ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:02.062663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5069ad3f042e41b2a01e0622ba471015', 'request_id': 'req-d417efac-5411-4300-8e7e-5756f817c7ba'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.077898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5069ad3f042e41b2a01e0622ba471015', 'request_id': 'req-d417efac-5411-4300-8e7e-5756f817c7ba'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.092496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5069ad3f042e41b2a01e0622ba471015', 'request_id': 'req-d417efac-5411-4300-8e7e-5756f817c7ba'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.110715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] The token cache is being invalidate because project 5069ad3f042e41b2a01e0622ba471015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:02.114193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.115358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.121304 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3358/6704] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:01 2022] DELETE /identity/v3/projects/5069ad3f042e41b2a01e0622ba471015 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:02.123647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:02.125633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:02.154702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:02.175212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a5468-1a30-4ea1-9531-4a063ff253ec admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:02.206074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:02.241066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417efac-5411-4300-8e7e-5756f817c7ba admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:02.249971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021ce89-22f8-4fc8-a07f-2a05dabfdf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:02.251434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ce89-22f8-4fc8-a07f-2a05dabfdf50 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:02.251808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ce89-22f8-4fc8-a07f-2a05dabfdf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:02.252176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ce89-22f8-4fc8-a07f-2a05dabfdf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:02.252909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021ce89-22f8-4fc8-a07f-2a05dabfdf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:02.255416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021ce89-22f8-4fc8-a07f-2a05dabfdf50 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:02.258620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b452916e4e3f4e8d8f1eefb146a2b5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e2131fca0384681a37c41f9effed739', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:02.259762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:02.260148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:02.260530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] PATH_INFO: `/v3/domains/397d0f8f6c56413fa086b848d996849d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:02.275235 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3359/6705] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:02.275235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021ce89-22f8-4fc8-a07f-2a05dabfdf50 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:02.275559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=397d0f8f6c56413fa086b848d996849d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:02.275672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d021ce89-22f8-4fc8-a07f-2a05dabfdf50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:02.276333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:02.297091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021ce89-22f8-4fc8-a07f-2a05dabfdf50 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:02.303508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:02.304441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:02.304735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:02.305022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '397d0f8f6c56413fa086b848d996849d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.305147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] PATH_INFO: `/v3/users/497f34e0a8e7421291afe70463c56504` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:02.308394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] RBAC: Authorizing `identity:delete_user(user_id=497f34e0a8e7421291afe70463c56504)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:02.311030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:02.319438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '397d0f8f6c56413fa086b848d996849d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.369970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397d0f8f6c56413fa086b848d996849d', 'request_id': 'req-0c133295-74ec-4b0a-8ff9-c41327b1162d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.377038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397d0f8f6c56413fa086b848d996849d', 'request_id': 'req-0c133295-74ec-4b0a-8ff9-c41327b1162d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.383940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497f34e0a8e7421291afe70463c56504'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.384841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497f34e0a8e7421291afe70463c56504'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.387981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397d0f8f6c56413fa086b848d996849d', 'request_id': 'req-0c133295-74ec-4b0a-8ff9-c41327b1162d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.408540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497f34e0a8e7421291afe70463c56504'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.409124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497f34e0a8e7421291afe70463c56504'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.414338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] The token cache is being invalidate because project 397d0f8f6c56413fa086b848d996849d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:02.414942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.415743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.425343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '397d0f8f6c56413fa086b848d996849d', 'request_id': 'req-0c133295-74ec-4b0a-8ff9-c41327b1162d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.426200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '397d0f8f6c56413fa086b848d996849d', 'request_id': 'req-0c133295-74ec-4b0a-8ff9-c41327b1162d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.426826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '397d0f8f6c56413fa086b848d996849d', 'request_id': 'req-0c133295-74ec-4b0a-8ff9-c41327b1162d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.426983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497f34e0a8e7421291afe70463c56504'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.443352 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3347/6706] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:55:02 2022] DELETE /identity/v3/domains/397d0f8f6c56413fa086b848d996849d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:02.444414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:02.445935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:02.449015 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3360/6707] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:02 2022] DELETE /identity/v3/users/497f34e0a8e7421291afe70463c56504 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:02.450656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:02.453720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:02.500283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:02.543449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c133295-74ec-4b0a-8ff9-c41327b1162d tempest-DomainsTestJSON-374713774 tempest-DomainsTestJSON-374713774-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:02.610890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325442d-6716-44b9-a041-72c9a818903e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:02.621141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05343fb-41eb-47fe-9ad2-8465dc6d8a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:02.623597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05343fb-41eb-47fe-9ad2-8465dc6d8a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:02.624056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05343fb-41eb-47fe-9ad2-8465dc6d8a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:02.624335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05343fb-41eb-47fe-9ad2-8465dc6d8a9d admin admin] PATH_INFO: `/v3/users/4d0b8591c8df4445845d673823d1e3bf` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:02.629886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05343fb-41eb-47fe-9ad2-8465dc6d8a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0b8591c8df4445845d673823d1e3bf)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:02.633378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05343fb-41eb-47fe-9ad2-8465dc6d8a9d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:02.649120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b31a91-2372-4c55-8909-1ad2e0446e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:02.650347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b31a91-2372-4c55-8909-1ad2e0446e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:02.650863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b31a91-2372-4c55-8909-1ad2e0446e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:02.651420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b31a91-2372-4c55-8909-1ad2e0446e17 admin admin] PATH_INFO: `/v3/projects/f29da9832eaf411d866b40e000769a7e/users/8ab6548051884a2db9beec3daf497768/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:02.712822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b31a91-2372-4c55-8909-1ad2e0446e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29da9832eaf411d866b40e000769a7e, user_id=8ab6548051884a2db9beec3daf497768, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:02.716053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b31a91-2372-4c55-8909-1ad2e0446e17 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:02.774912 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3348/6708] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:02 2022] PUT /identity/v3/projects/f29da9832eaf411d866b40e000769a7e/users/8ab6548051884a2db9beec3daf497768/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:02.783192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b31a91-2372-4c55-8909-1ad2e0446e17 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:02.783906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d05343fb-41eb-47fe-9ad2-8465dc6d8a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0b8591c8df4445845d673823d1e3bf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.784610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d05343fb-41eb-47fe-9ad2-8465dc6d8a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0b8591c8df4445845d673823d1e3bf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.814366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:02.838379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d05343fb-41eb-47fe-9ad2-8465dc6d8a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0b8591c8df4445845d673823d1e3bf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.839691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d05343fb-41eb-47fe-9ad2-8465dc6d8a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0b8591c8df4445845d673823d1e3bf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.850448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d05343fb-41eb-47fe-9ad2-8465dc6d8a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0b8591c8df4445845d673823d1e3bf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:02.892821 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3361/6709] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:02 2022] DELETE /identity/v3/users/4d0b8591c8df4445845d673823d1e3bf => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:02.899390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa46d00-9dc3-4a9c-96ba-145def444fc4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:02.900910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa46d00-9dc3-4a9c-96ba-145def444fc4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:02.901196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa46d00-9dc3-4a9c-96ba-145def444fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:02.949863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2fa46d00-9dc3-4a9c-96ba-145def444fc4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:02.951876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2fa46d00-9dc3-4a9c-96ba-145def444fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:02.971226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b31a91-2372-4c55-8909-1ad2e0446e17 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.133118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d75d3b-a0e9-4b21-a9fa-2bb456ee0839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.133880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d75d3b-a0e9-4b21-a9fa-2bb456ee0839 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.134227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d75d3b-a0e9-4b21-a9fa-2bb456ee0839 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.134576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d75d3b-a0e9-4b21-a9fa-2bb456ee0839 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.135328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d75d3b-a0e9-4b21-a9fa-2bb456ee0839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.137127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d75d3b-a0e9-4b21-a9fa-2bb456ee0839 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.143098 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3362/6710] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:03.144430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa46d00-9dc3-4a9c-96ba-145def444fc4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.149325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2fa46d00-9dc3-4a9c-96ba-145def444fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:03.176594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa46d00-9dc3-4a9c-96ba-145def444fc4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.186806 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3349/6711] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:03.188551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d75d3b-a0e9-4b21-a9fa-2bb456ee0839 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.192420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-65d75d3b-a0e9-4b21-a9fa-2bb456ee0839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:03.197413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.198220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.198483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.198766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] PATH_INFO: `/v3/projects/ab1bc4788acd4a4b8dab66f0486c6dac` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.205006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab1bc4788acd4a4b8dab66f0486c6dac)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.207162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.241049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:03.360004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'request_id': 'req-8f9cd2d9-2963-46a4-b100-a098852e8bbd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:03.394819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'request_id': 'req-8f9cd2d9-2963-46a4-b100-a098852e8bbd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:03.412170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab1bc4788acd4a4b8dab66f0486c6dac', 'request_id': 'req-8f9cd2d9-2963-46a4-b100-a098852e8bbd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:03.436466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d75d3b-a0e9-4b21-a9fa-2bb456ee0839 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.441213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] The token cache is being invalidate because project ab1bc4788acd4a4b8dab66f0486c6dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:03.441719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:03.442710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:03.457979 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3363/6712] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:03 2022] DELETE /identity/v3/projects/ab1bc4788acd4a4b8dab66f0486c6dac => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:03.467772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.478064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:03.560165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a71db8-579f-4bef-ad45-f65a2ed25799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.561090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a71db8-579f-4bef-ad45-f65a2ed25799 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.561510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a71db8-579f-4bef-ad45-f65a2ed25799 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.561974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a71db8-579f-4bef-ad45-f65a2ed25799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.564418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-52a71db8-579f-4bef-ad45-f65a2ed25799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:03.575140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cd2d9-2963-46a4-b100-a098852e8bbd admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.581146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a71db8-579f-4bef-ad45-f65a2ed25799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.582026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d63b34-02b5-458e-acaa-b8c98b568720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.582717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d63b34-02b5-458e-acaa-b8c98b568720 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.583002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d63b34-02b5-458e-acaa-b8c98b568720 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.583405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d63b34-02b5-458e-acaa-b8c98b568720 admin admin] PATH_INFO: `/v3/projects/f29da9832eaf411d866b40e000769a7e/users/8ab6548051884a2db9beec3daf497768/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.584973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a71db8-579f-4bef-ad45-f65a2ed25799 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.585950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d63b34-02b5-458e-acaa-b8c98b568720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29da9832eaf411d866b40e000769a7e, user_id=8ab6548051884a2db9beec3daf497768, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.588774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d63b34-02b5-458e-acaa-b8c98b568720 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.593095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:03.598680 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3350/6713] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:03.601149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a778-fc5e-4758-96f6-eda69dc5e272 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.601523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a778-fc5e-4758-96f6-eda69dc5e272 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.601919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a778-fc5e-4758-96f6-eda69dc5e272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.625313 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3364/6714] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:03 2022] PUT /identity/v3/projects/f29da9832eaf411d866b40e000769a7e/users/8ab6548051884a2db9beec3daf497768/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:03.626969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110d9d9-d1f3-47a6-8088-eb1136d17328 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.627269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110d9d9-d1f3-47a6-8088-eb1136d17328 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.627843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110d9d9-d1f3-47a6-8088-eb1136d17328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.632914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-42a3a778-fc5e-4758-96f6-eda69dc5e272 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:03.634536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42a3a778-fc5e-4758-96f6-eda69dc5e272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:03.680062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8110d9d9-d1f3-47a6-8088-eb1136d17328 None None] MFA Rules not processed for user `8ab6548051884a2db9beec3daf497768`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:03.681445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8110d9d9-d1f3-47a6-8088-eb1136d17328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:03.757504 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3351/6715] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:03.766971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a6a83-7e6e-4fa0-8882-c5bc5f669ea5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.767285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a6a83-7e6e-4fa0-8882-c5bc5f669ea5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.767571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a6a83-7e6e-4fa0-8882-c5bc5f669ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.802003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6c5a6a83-7e6e-4fa0-8882-c5bc5f669ea5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:03.803809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6c5a6a83-7e6e-4fa0-8882-c5bc5f669ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:03.816012 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3352/6716] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:03.821037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a6a83-7e6e-4fa0-8882-c5bc5f669ea5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.840812 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3365/6717] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:03.841689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a6a83-7e6e-4fa0-8882-c5bc5f669ea5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.848595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9cc7f-2b9c-4c36-8f29-8423a49ee554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.849230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9cc7f-2b9c-4c36-8f29-8423a49ee554 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.849559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9cc7f-2b9c-4c36-8f29-8423a49ee554 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.849844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9cc7f-2b9c-4c36-8f29-8423a49ee554 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.850750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9cc7f-2b9c-4c36-8f29-8423a49ee554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:03.851064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9cc7f-2b9c-4c36-8f29-8423a49ee554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.851799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110d9d9-d1f3-47a6-8088-eb1136d17328 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.852686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9cc7f-2b9c-4c36-8f29-8423a49ee554 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.853347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8110d9d9-d1f3-47a6-8088-eb1136d17328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:03.883438 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3353/6718] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:03.888560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9cc7f-2b9c-4c36-8f29-8423a49ee554 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.907568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9cc7f-2b9c-4c36-8f29-8423a49ee554 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:03.913900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4ca04-7d00-4902-8127-1f49f9a27d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:03.914739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ca04-7d00-4902-8127-1f49f9a27d5f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:03.915242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ca04-7d00-4902-8127-1f49f9a27d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:03.915683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ca04-7d00-4902-8127-1f49f9a27d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:03.916489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4ca04-7d00-4902-8127-1f49f9a27d5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:03.919313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4ca04-7d00-4902-8127-1f49f9a27d5f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:03.967521 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3354/6719] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:03 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:03.971763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4ca04-7d00-4902-8127-1f49f9a27d5f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:03.982226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110d9d9-d1f3-47a6-8088-eb1136d17328 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:04.030577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:04.146549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4ca04-7d00-4902-8127-1f49f9a27d5f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:04.158032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aac3c2-685d-4f2b-a83d-e3145c4ce653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:04.159044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aac3c2-685d-4f2b-a83d-e3145c4ce653 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:04.160894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aac3c2-685d-4f2b-a83d-e3145c4ce653 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:04.161990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aac3c2-685d-4f2b-a83d-e3145c4ce653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:04.163743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4e190-e9c5-4b91-ad18-0e6f3153a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:04.165584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4e190-e9c5-4b91-ad18-0e6f3153a5ee admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:04.166226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4e190-e9c5-4b91-ad18-0e6f3153a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:04.166832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4e190-e9c5-4b91-ad18-0e6f3153a5ee admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:04.168444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4e190-e9c5-4b91-ad18-0e6f3153a5ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:04.174200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4e190-e9c5-4b91-ad18-0e6f3153a5ee admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:04.234796 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3355/6720] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:03 2022] POST /identity/v3/users => generated 284 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:04.239562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4e190-e9c5-4b91-ad18-0e6f3153a5ee admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:04.246569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-53d4e190-e9c5-4b91-ad18-0e6f3153a5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:04.276311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:04.285954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4e190-e9c5-4b91-ad18-0e6f3153a5ee admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:04.296788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:04.298389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:04.299499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:04.300002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] PATH_INFO: `/v3/projects/176d574b0f5e45d7852c7758d0ac7b91` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:04.301696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=176d574b0f5e45d7852c7758d0ac7b91)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:04.305141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:04.329991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aac3c2-685d-4f2b-a83d-e3145c4ce653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:04.331466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aac3c2-685d-4f2b-a83d-e3145c4ce653 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:04.354149 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3366/6721] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:04.356002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aac3c2-685d-4f2b-a83d-e3145c4ce653 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:04.381755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aac3c2-685d-4f2b-a83d-e3145c4ce653 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:04.390906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f0a09-af9c-480a-9883-b3aea73ed2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:04.391488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f0a09-af9c-480a-9883-b3aea73ed2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:04.391777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f0a09-af9c-480a-9883-b3aea73ed2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:04.392057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f0a09-af9c-480a-9883-b3aea73ed2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:04.392712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f0a09-af9c-480a-9883-b3aea73ed2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:04.394659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f0a09-af9c-480a-9883-b3aea73ed2d2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:04.422809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176d574b0f5e45d7852c7758d0ac7b91', 'request_id': 'req-82b6841b-e72c-4413-8148-3576a5527cbb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:04.427625 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3367/6722] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:04.430135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f0a09-af9c-480a-9883-b3aea73ed2d2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:04.437444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176d574b0f5e45d7852c7758d0ac7b91', 'request_id': 'req-82b6841b-e72c-4413-8148-3576a5527cbb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:04.447671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f0a09-af9c-480a-9883-b3aea73ed2d2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:04.457178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176d574b0f5e45d7852c7758d0ac7b91', 'request_id': 'req-82b6841b-e72c-4413-8148-3576a5527cbb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:04.480987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] The token cache is being invalidate because project 176d574b0f5e45d7852c7758d0ac7b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:04.481276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:04.483019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:04.488611 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3356/6723] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:04 2022] DELETE /identity/v3/projects/176d574b0f5e45d7852c7758d0ac7b91 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:04.489582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:04.494956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:04.615740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05791dde-35fc-4e6f-a86c-cd3dd343e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:04.616368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05791dde-35fc-4e6f-a86c-cd3dd343e24c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:04.616648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05791dde-35fc-4e6f-a86c-cd3dd343e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:04.616924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05791dde-35fc-4e6f-a86c-cd3dd343e24c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:04.617616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05791dde-35fc-4e6f-a86c-cd3dd343e24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:04.619371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05791dde-35fc-4e6f-a86c-cd3dd343e24c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:04.647113 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3368/6724] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:04.649602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48224d-18bd-4613-abd1-f20816dce3fe None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:04.650227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48224d-18bd-4613-abd1-f20816dce3fe None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:04.650578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48224d-18bd-4613-abd1-f20816dce3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:04.675259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8e48224d-18bd-4613-abd1-f20816dce3fe None None] MFA Rules not processed for user `74602998065943c4a49a96d23ec0ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:04.676705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8e48224d-18bd-4613-abd1-f20816dce3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:04.682930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6841b-e72c-4413-8148-3576a5527cbb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:04.692155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:04.692745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:04.693033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:04.693312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] PATH_INFO: `/v3/users/b452916e4e3f4e8d8f1eefb146a2b5de` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:04.694537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] RBAC: Authorizing `identity:delete_user(user_id=b452916e4e3f4e8d8f1eefb146a2b5de)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:04.696612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:04.750378 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3369/6725] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:04.751516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48224d-18bd-4613-abd1-f20816dce3fe None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:04.756467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8e48224d-18bd-4613-abd1-f20816dce3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:04.786732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48224d-18bd-4613-abd1-f20816dce3fe None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:04.794697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6398f-ecc3-45f0-8b0e-9363e0d3518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:04.795461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6398f-ecc3-45f0-8b0e-9363e0d3518c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:04.795855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6398f-ecc3-45f0-8b0e-9363e0d3518c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:04.796231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6398f-ecc3-45f0-8b0e-9363e0d3518c admin admin] PATH_INFO: `/v3/projects/c9b41a7132cd447abd152fb424f481e1/users/84eb692d593649a4b2e14896dca684d8/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:04.810747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:04.817694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b452916e4e3f4e8d8f1eefb146a2b5de'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:04.820096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b452916e4e3f4e8d8f1eefb146a2b5de'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:04.836172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6398f-ecc3-45f0-8b0e-9363e0d3518c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b41a7132cd447abd152fb424f481e1, user_id=84eb692d593649a4b2e14896dca684d8, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:04.839937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6398f-ecc3-45f0-8b0e-9363e0d3518c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:04.850382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b452916e4e3f4e8d8f1eefb146a2b5de'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:04.877610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b452916e4e3f4e8d8f1eefb146a2b5de'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:04.886847 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3370/6726] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:04 2022] PUT /identity/v3/projects/c9b41a7132cd447abd152fb424f481e1/users/84eb692d593649a4b2e14896dca684d8/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:04.898595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c117244-37f1-4ed4-9526-5c3ba37212ed None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:04.898885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c117244-37f1-4ed4-9526-5c3ba37212ed None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:04.899167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c117244-37f1-4ed4-9526-5c3ba37212ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:04.902233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b452916e4e3f4e8d8f1eefb146a2b5de'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:04.921926 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3357/6727] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:04 2022] DELETE /identity/v3/users/b452916e4e3f4e8d8f1eefb146a2b5de => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:04.957453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0c117244-37f1-4ed4-9526-5c3ba37212ed None None] MFA Rules not processed for user `84eb692d593649a4b2e14896dca684d8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:04.959107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0c117244-37f1-4ed4-9526-5c3ba37212ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:05.024085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:05.060038 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3371/6728] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:05.061230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:05.063526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:05.174918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf7e3c-cc77-48fd-91cf-17b9b797dbda admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:05.181322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7bca8-082c-412a-ad7f-86b0af15f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:05.182427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7bca8-082c-412a-ad7f-86b0af15f89b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:05.183698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7bca8-082c-412a-ad7f-86b0af15f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:05.184408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7bca8-082c-412a-ad7f-86b0af15f89b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:05.185369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7bca8-082c-412a-ad7f-86b0af15f89b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:05.187606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7bca8-082c-412a-ad7f-86b0af15f89b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:05.234867 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3358/6729] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:05 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:05.236330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c117244-37f1-4ed4-9526-5c3ba37212ed None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:05.270077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c117244-37f1-4ed4-9526-5c3ba37212ed None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:05.406796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c1128-4553-45c8-8b19-cd261add3ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:05.407512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c1128-4553-45c8-8b19-cd261add3ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:05.407850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c1128-4553-45c8-8b19-cd261add3ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:05.408199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c1128-4553-45c8-8b19-cd261add3ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:05.411562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c1128-4553-45c8-8b19-cd261add3ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:05.413642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c1128-4553-45c8-8b19-cd261add3ff5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:05.459758 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3372/6730] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:05 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:05.463657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7bca8-082c-412a-ad7f-86b0af15f89b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:05.485896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7bca8-082c-412a-ad7f-86b0af15f89b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:05.506455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d009150-7996-4e52-bd88-bf1280460cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:05.508252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d009150-7996-4e52-bd88-bf1280460cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:05.509180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d009150-7996-4e52-bd88-bf1280460cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:05.511057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d009150-7996-4e52-bd88-bf1280460cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:05.512327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d009150-7996-4e52-bd88-bf1280460cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:05.519958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d009150-7996-4e52-bd88-bf1280460cd3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:05.575424 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3359/6731] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:05.580927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c1128-4553-45c8-8b19-cd261add3ff5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:05.593735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c1128-4553-45c8-8b19-cd261add3ff5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:05.610795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf5a6e-2edb-4810-81b3-aeddc165c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:05.611589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf5a6e-2edb-4810-81b3-aeddc165c43b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:05.611972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf5a6e-2edb-4810-81b3-aeddc165c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:05.616370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf5a6e-2edb-4810-81b3-aeddc165c43b admin admin] PATH_INFO: `/v3/projects/5fe054ee1f3a4d549243bcafc37595ff/users/454c63036c9d46759dce85fac8e185ca/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:05.653492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf5a6e-2edb-4810-81b3-aeddc165c43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe054ee1f3a4d549243bcafc37595ff, user_id=454c63036c9d46759dce85fac8e185ca, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:05.656327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf5a6e-2edb-4810-81b3-aeddc165c43b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:05.684759 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3373/6732] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:05 2022] PUT /identity/v3/projects/5fe054ee1f3a4d549243bcafc37595ff/users/454c63036c9d46759dce85fac8e185ca/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:05.686161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d009150-7996-4e52-bd88-bf1280460cd3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:05.721486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d009150-7996-4e52-bd88-bf1280460cd3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:05.850361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdd211-a951-4776-bff7-befea990a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:05.851212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd211-a951-4776-bff7-befea990a335 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:05.851568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd211-a951-4776-bff7-befea990a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:05.851916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd211-a951-4776-bff7-befea990a335 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:05.852694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdd211-a951-4776-bff7-befea990a335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:05.854518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdd211-a951-4776-bff7-befea990a335 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:05.869756 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3360/6733] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:05.873649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf5a6e-2edb-4810-81b3-aeddc165c43b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:05.891110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf5a6e-2edb-4810-81b3-aeddc165c43b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:05.899169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b64953-3f7d-47bf-8d43-36c956dda203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:05.900080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64953-3f7d-47bf-8d43-36c956dda203 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:05.900476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64953-3f7d-47bf-8d43-36c956dda203 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:05.901156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64953-3f7d-47bf-8d43-36c956dda203 admin admin] PATH_INFO: `/v3/projects/5fe054ee1f3a4d549243bcafc37595ff/users/454c63036c9d46759dce85fac8e185ca/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:05.907838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdd211-a951-4776-bff7-befea990a335 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:05.908909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b64953-3f7d-47bf-8d43-36c956dda203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe054ee1f3a4d549243bcafc37595ff, user_id=454c63036c9d46759dce85fac8e185ca, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:05.909762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8acdd211-a951-4776-bff7-befea990a335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:05.918448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b64953-3f7d-47bf-8d43-36c956dda203 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:05.930154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdd211-a951-4776-bff7-befea990a335 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:05.999311 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3374/6734] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:05 2022] PUT /identity/v3/projects/5fe054ee1f3a4d549243bcafc37595ff/users/454c63036c9d46759dce85fac8e185ca/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:06.056856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:06.093948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db1b8d-69e3-49a9-88c4-7317aee4e4c7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:06.094616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db1b8d-69e3-49a9-88c4-7317aee4e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:06.094979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db1b8d-69e3-49a9-88c4-7317aee4e4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:06.108822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:06.109678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:06.110056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:06.110432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] PATH_INFO: `/v3/projects/5e2131fca0384681a37c41f9effed739` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:06.112515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2131fca0384681a37c41f9effed739)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:06.115061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:06.134209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-12db1b8d-69e3-49a9-88c4-7317aee4e4c7 None None] MFA Rules not processed for user `454c63036c9d46759dce85fac8e185ca`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:06.135784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-12db1b8d-69e3-49a9-88c4-7317aee4e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:06.261231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2131fca0384681a37c41f9effed739', 'request_id': 'req-85377d5b-5a6f-461f-b6a8-753a6f80d202'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:06.276710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2131fca0384681a37c41f9effed739', 'request_id': 'req-85377d5b-5a6f-461f-b6a8-753a6f80d202'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:06.278747 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3375/6735] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:06.283157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db1b8d-69e3-49a9-88c4-7317aee4e4c7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:06.289112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2131fca0384681a37c41f9effed739', 'request_id': 'req-85377d5b-5a6f-461f-b6a8-753a6f80d202'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:06.295381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db1b8d-69e3-49a9-88c4-7317aee4e4c7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:06.311203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] The token cache is being invalidate because project 5e2131fca0384681a37c41f9effed739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:06.312046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:06.312621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:06.313798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-85377d5b-5a6f-461f-b6a8-753a6f80d202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:06.317668 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3361/6736] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:05 2022] DELETE /identity/v3/projects/5e2131fca0384681a37c41f9effed739 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:06.325308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6e6aa-a904-445d-859d-0de5ab608493 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:06.327164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6e6aa-a904-445d-859d-0de5ab608493 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:06.327692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6e6aa-a904-445d-859d-0de5ab608493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:06.363187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5df6e6aa-a904-445d-859d-0de5ab608493 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:06.364971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5df6e6aa-a904-445d-859d-0de5ab608493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:06.424414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b059338-c4c5-465c-ba32-979a73bcedd7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:06.425491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059338-c4c5-465c-ba32-979a73bcedd7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:06.425790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059338-c4c5-465c-ba32-979a73bcedd7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:06.426074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059338-c4c5-465c-ba32-979a73bcedd7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:06.426748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b059338-c4c5-465c-ba32-979a73bcedd7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:06.427801 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-9b059338-c4c5-465c-ba32-979a73bcedd7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:55:06.427801 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:55:06.427801 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:55:06.428697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b059338-c4c5-465c-ba32-979a73bcedd7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:06.466681 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3376/6737] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:55:06 2022] POST /identity/v3/regions => generated 224 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:06.470239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b059338-c4c5-465c-ba32-979a73bcedd7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:06.472236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9b059338-c4c5-465c-ba32-979a73bcedd7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:06.514492 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3362/6738] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:06.523827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63585778-6b2e-42df-8a75-52b43fa02161 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:06.524196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63585778-6b2e-42df-8a75-52b43fa02161 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:06.524480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63585778-6b2e-42df-8a75-52b43fa02161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:06.549913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b059338-c4c5-465c-ba32-979a73bcedd7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:06.559890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-63585778-6b2e-42df-8a75-52b43fa02161 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:06.561482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521d342-54c9-40c8-a3ca-8af1e1889b29 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:06.562020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-63585778-6b2e-42df-8a75-52b43fa02161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:06.562321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521d342-54c9-40c8-a3ca-8af1e1889b29 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:06.562670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521d342-54c9-40c8-a3ca-8af1e1889b29 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:06.563018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521d342-54c9-40c8-a3ca-8af1e1889b29 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:06.563734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521d342-54c9-40c8-a3ca-8af1e1889b29 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:06.566671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521d342-54c9-40c8-a3ca-8af1e1889b29 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:06.574459 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3363/6739] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:06.578500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63585778-6b2e-42df-8a75-52b43fa02161 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:06.594195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63585778-6b2e-42df-8a75-52b43fa02161 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:06.600749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04f1ed-862a-4fe5-88a5-c93226063fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:06.602486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04f1ed-862a-4fe5-88a5-c93226063fdf admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:06.602870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04f1ed-862a-4fe5-88a5-c93226063fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:06.603545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04f1ed-862a-4fe5-88a5-c93226063fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:06.603908 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3377/6740] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:55:06 2022] POST /identity/v3/regions => generated 223 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:55:06.605375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04f1ed-862a-4fe5-88a5-c93226063fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:06.606029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04f1ed-862a-4fe5-88a5-c93226063fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:06.609570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04f1ed-862a-4fe5-88a5-c93226063fdf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:06.609727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521d342-54c9-40c8-a3ca-8af1e1889b29 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:06.627061 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3364/6741] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:06.631967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04f1ed-862a-4fe5-88a5-c93226063fdf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:06.650908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04f1ed-862a-4fe5-88a5-c93226063fdf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:06.656062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521d342-54c9-40c8-a3ca-8af1e1889b29 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:06.676995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b187e-1bee-46cc-98da-67c11e0afd8c tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:06.677886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b187e-1bee-46cc-98da-67c11e0afd8c tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:06.678321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b187e-1bee-46cc-98da-67c11e0afd8c tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:06.678760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b187e-1bee-46cc-98da-67c11e0afd8c tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions/ba0eb364-f0c1-4af6-ab28-fc9cc75adb19` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:06.679565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b187e-1bee-46cc-98da-67c11e0afd8c tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:create_region(region_id=ba0eb364-f0c1-4af6-ab28-fc9cc75adb19)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:06.684751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b187e-1bee-46cc-98da-67c11e0afd8c tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:06.702078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e118655-713c-4d36-b07e-1c9a6f06f405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:06.702769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e118655-713c-4d36-b07e-1c9a6f06f405 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:06.703056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e118655-713c-4d36-b07e-1c9a6f06f405 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:06.703343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e118655-713c-4d36-b07e-1c9a6f06f405 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:06.704139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e118655-713c-4d36-b07e-1c9a6f06f405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:06.710946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e118655-713c-4d36-b07e-1c9a6f06f405 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:06.735150 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3378/6742] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Aug 29 15:55:06 2022] PUT /identity/v3/regions/ba0eb364-f0c1-4af6-ab28-fc9cc75adb19 => generated 231 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:06.738842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b187e-1bee-46cc-98da-67c11e0afd8c tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:06.776118 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3365/6743] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:06 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:06.779101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e118655-713c-4d36-b07e-1c9a6f06f405 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:06.784488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:06.806861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b187e-1bee-46cc-98da-67c11e0afd8c tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:06.918317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4ba5d-1715-4e6c-9766-312420a2ec3f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:06.919871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4ba5d-1715-4e6c-9766-312420a2ec3f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:06.920405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4ba5d-1715-4e6c-9766-312420a2ec3f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:06.921129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4ba5d-1715-4e6c-9766-312420a2ec3f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions/ba0eb364-f0c1-4af6-ab28-fc9cc75adb19` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:06.922644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4ba5d-1715-4e6c-9766-312420a2ec3f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ba0eb364-f0c1-4af6-ab28-fc9cc75adb19)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:06.924799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4ba5d-1715-4e6c-9766-312420a2ec3f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:06.934823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e118655-713c-4d36-b07e-1c9a6f06f405 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:06.952273 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3379/6744] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Aug 29 15:55:06 2022] DELETE /identity/v3/regions/ba0eb364-f0c1-4af6-ab28-fc9cc75adb19 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:06.959100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4ba5d-1715-4e6c-9766-312420a2ec3f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:06.970276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf6b8f-1e0d-4ac1-8d95-6f03ed48fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:06.970912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf6b8f-1e0d-4ac1-8d95-6f03ed48fb33 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:06.971200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf6b8f-1e0d-4ac1-8d95-6f03ed48fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:06.971487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf6b8f-1e0d-4ac1-8d95-6f03ed48fb33 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:06.972129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf6b8f-1e0d-4ac1-8d95-6f03ed48fb33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:06.975151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf6b8f-1e0d-4ac1-8d95-6f03ed48fb33 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:06.994659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4ba5d-1715-4e6c-9766-312420a2ec3f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.006266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b98f0c-ce86-4720-bb65-f0afeae0b25a tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.008471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b98f0c-ce86-4720-bb65-f0afeae0b25a tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.008766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b98f0c-ce86-4720-bb65-f0afeae0b25a tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.009047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b98f0c-ce86-4720-bb65-f0afeae0b25a tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.013738 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3366/6745] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:06 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:07.013926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b98f0c-ce86-4720-bb65-f0afeae0b25a tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.013926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b98f0c-ce86-4720-bb65-f0afeae0b25a tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.014904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf6b8f-1e0d-4ac1-8d95-6f03ed48fb33 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.032463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf6b8f-1e0d-4ac1-8d95-6f03ed48fb33 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.069149 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3380/6746] 10.222.0.16 () {60 vars in 1150 bytes} [Mon Aug 29 15:55:06 2022] POST /identity/v3/regions => generated 254 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:07.069450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802934a-d49d-49e8-8cdc-b7a1f0fb86eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.069450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802934a-d49d-49e8-8cdc-b7a1f0fb86eb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.069450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802934a-d49d-49e8-8cdc-b7a1f0fb86eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.069450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802934a-d49d-49e8-8cdc-b7a1f0fb86eb admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.070320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b98f0c-ce86-4720-bb65-f0afeae0b25a tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.071750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802934a-d49d-49e8-8cdc-b7a1f0fb86eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.080973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802934a-d49d-49e8-8cdc-b7a1f0fb86eb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.081138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:07.107987 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3367/6747] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:55:07.110447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802934a-d49d-49e8-8cdc-b7a1f0fb86eb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.122508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b98f0c-ce86-4720-bb65-f0afeae0b25a tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.129644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802934a-d49d-49e8-8cdc-b7a1f0fb86eb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.133428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cc89e-acb1-4f3b-a875-d6c79c60b9b2 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.134023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cc89e-acb1-4f3b-a875-d6c79c60b9b2 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.134350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cc89e-acb1-4f3b-a875-d6c79c60b9b2 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.135171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cc89e-acb1-4f3b-a875-d6c79c60b9b2 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions/1f376c6b83684f2cb3c06cebf80c64b6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.135895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cc89e-acb1-4f3b-a875-d6c79c60b9b2 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:update_region(region_id=1f376c6b83684f2cb3c06cebf80c64b6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.137831 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-482cc89e-acb1-4f3b-a875-d6c79c60b9b2 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:55:07.137831 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:55:07.137831 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:55:07.138350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cc89e-acb1-4f3b-a875-d6c79c60b9b2 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.163077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1abbec-4e1a-42b5-95e9-2c452438eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.163738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1abbec-4e1a-42b5-95e9-2c452438eb74 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.163981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1abbec-4e1a-42b5-95e9-2c452438eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.164354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1abbec-4e1a-42b5-95e9-2c452438eb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.165015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1abbec-4e1a-42b5-95e9-2c452438eb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.167242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1abbec-4e1a-42b5-95e9-2c452438eb74 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.186990 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3381/6748] 10.222.0.16 () {60 vars in 1250 bytes} [Mon Aug 29 15:55:07 2022] PATCH /identity/v3/regions/1f376c6b83684f2cb3c06cebf80c64b6 => generated 254 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:55:07.187748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cc89e-acb1-4f3b-a875-d6c79c60b9b2 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.197804 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3368/6749] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:07.199749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1abbec-4e1a-42b5-95e9-2c452438eb74 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.224504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1abbec-4e1a-42b5-95e9-2c452438eb74 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.246005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cc89e-acb1-4f3b-a875-d6c79c60b9b2 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.253301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e1a59-204b-43cf-9ec6-2569558b1c3d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.254001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e1a59-204b-43cf-9ec6-2569558b1c3d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.254286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e1a59-204b-43cf-9ec6-2569558b1c3d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.254565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e1a59-204b-43cf-9ec6-2569558b1c3d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions/1f376c6b83684f2cb3c06cebf80c64b6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.255478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e1a59-204b-43cf-9ec6-2569558b1c3d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:get_region(region_id=1f376c6b83684f2cb3c06cebf80c64b6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.256680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e1a59-204b-43cf-9ec6-2569558b1c3d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.275977 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3382/6750] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:55:07 2022] GET /identity/v3/regions/1f376c6b83684f2cb3c06cebf80c64b6 => generated 254 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:07.276907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e1a59-204b-43cf-9ec6-2569558b1c3d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.286058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c74f9-90fc-4035-a841-126d9b6f8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.287912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c74f9-90fc-4035-a841-126d9b6f8241 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.288280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c74f9-90fc-4035-a841-126d9b6f8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.288669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c74f9-90fc-4035-a841-126d9b6f8241 admin admin] PATH_INFO: `/v3/projects/de08796ac142447098e5309065882160/users/1d6aea8c1b124f74a714fe43d8d476bb/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.303758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e1a59-204b-43cf-9ec6-2569558b1c3d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.327435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c74f9-90fc-4035-a841-126d9b6f8241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de08796ac142447098e5309065882160, user_id=1d6aea8c1b124f74a714fe43d8d476bb, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.330272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc17804-0408-41e8-9967-ac8258736ce7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.330566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c74f9-90fc-4035-a841-126d9b6f8241 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.330946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc17804-0408-41e8-9967-ac8258736ce7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.331251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc17804-0408-41e8-9967-ac8258736ce7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.331478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc17804-0408-41e8-9967-ac8258736ce7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions/1f376c6b83684f2cb3c06cebf80c64b6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.332076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc17804-0408-41e8-9967-ac8258736ce7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:delete_region(region_id=1f376c6b83684f2cb3c06cebf80c64b6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.333887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc17804-0408-41e8-9967-ac8258736ce7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.357721 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3369/6751] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:07 2022] PUT /identity/v3/projects/de08796ac142447098e5309065882160/users/1d6aea8c1b124f74a714fe43d8d476bb/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:07.370108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d072b0-13dd-469f-9ead-84d80a26bec1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.372663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d072b0-13dd-469f-9ead-84d80a26bec1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.372663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d072b0-13dd-469f-9ead-84d80a26bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.388970 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3383/6752] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:55:07 2022] DELETE /identity/v3/regions/1f376c6b83684f2cb3c06cebf80c64b6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:07.390705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc17804-0408-41e8-9967-ac8258736ce7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.435950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc17804-0408-41e8-9967-ac8258736ce7 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.472899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-45d072b0-13dd-469f-9ead-84d80a26bec1 None None] MFA Rules not processed for user `1d6aea8c1b124f74a714fe43d8d476bb`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:07.474623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-45d072b0-13dd-469f-9ead-84d80a26bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:07.520751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce56bf8-20af-49ab-970b-72a9382aed41 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.521378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56bf8-20af-49ab-970b-72a9382aed41 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.521709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56bf8-20af-49ab-970b-72a9382aed41 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.521978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56bf8-20af-49ab-970b-72a9382aed41 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.522630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce56bf8-20af-49ab-970b-72a9382aed41 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.523650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce56bf8-20af-49ab-970b-72a9382aed41 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.530950 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3384/6753] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Aug 29 15:55:07 2022] GET /identity/v3/regions => generated 669 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:55:07.534963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce56bf8-20af-49ab-970b-72a9382aed41 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.552429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce56bf8-20af-49ab-970b-72a9382aed41 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.567840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b2981-cbcd-481c-a3d6-8b9b400920d3 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.569004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2981-cbcd-481c-a3d6-8b9b400920d3 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.569352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2981-cbcd-481c-a3d6-8b9b400920d3 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.569739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2981-cbcd-481c-a3d6-8b9b400920d3 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions/1f376c6b83684f2cb3c06cebf80c64b6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.570412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b2981-cbcd-481c-a3d6-8b9b400920d3 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:delete_region(region_id=1f376c6b83684f2cb3c06cebf80c64b6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.573583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b2981-cbcd-481c-a3d6-8b9b400920d3 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-fb5b2981-cbcd-481c-a3d6-8b9b400920d3 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Could not find region: 1f376c6b83684f2cb3c06cebf80c64b6.: keystone.exception.RegionNotFound: Could not find region: 1f376c6b83684f2cb3c06cebf80c64b6. Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 1f376c6b83684f2cb3c06cebf80c64b6. Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:55:07.596695 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 1f376c6b83684f2cb3c06cebf80c64b6. Aug 29 15:55:07.597805 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:07.598742 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3385/6754] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:55:07 2022] DELETE /identity/v3/regions/1f376c6b83684f2cb3c06cebf80c64b6 => generated 112 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:55:07.608696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b2981-cbcd-481c-a3d6-8b9b400920d3 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.639640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b2981-cbcd-481c-a3d6-8b9b400920d3 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.650304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1d0ab-c973-4343-a2d9-e7d272787f7f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.651039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1d0ab-c973-4343-a2d9-e7d272787f7f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.651404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1d0ab-c973-4343-a2d9-e7d272787f7f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.651787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1d0ab-c973-4343-a2d9-e7d272787f7f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.652470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1d0ab-c973-4343-a2d9-e7d272787f7f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.655446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1d0ab-c973-4343-a2d9-e7d272787f7f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.693575 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3386/6755] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Aug 29 15:55:07 2022] GET /identity/v3/regions => generated 669 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:07.693575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1d0ab-c973-4343-a2d9-e7d272787f7f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.694209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:07.702286 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3370/6756] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:07.703694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1d0ab-c973-4343-a2d9-e7d272787f7f tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.704200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d072b0-13dd-469f-9ead-84d80a26bec1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.714508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795f207-ea10-44fd-b6b5-c2c0a5c7e8dd tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.715394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f207-ea10-44fd-b6b5-c2c0a5c7e8dd tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.715687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f207-ea10-44fd-b6b5-c2c0a5c7e8dd tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.715964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f207-ea10-44fd-b6b5-c2c0a5c7e8dd tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.716758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795f207-ea10-44fd-b6b5-c2c0a5c7e8dd tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.721485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795f207-ea10-44fd-b6b5-c2c0a5c7e8dd tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.770903 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3387/6757] 10.222.0.16 () {60 vars in 1150 bytes} [Mon Aug 29 15:55:07 2022] POST /identity/v3/regions => generated 254 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:55:07.774684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795f207-ea10-44fd-b6b5-c2c0a5c7e8dd tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.825594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795f207-ea10-44fd-b6b5-c2c0a5c7e8dd tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.828758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d072b0-13dd-469f-9ead-84d80a26bec1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.848077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8bfd4-3f3c-45bf-9640-ff0fd009decc tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.848714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8bfd4-3f3c-45bf-9640-ff0fd009decc tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.849000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8bfd4-3f3c-45bf-9640-ff0fd009decc tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.849447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8bfd4-3f3c-45bf-9640-ff0fd009decc tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.849951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8bfd4-3f3c-45bf-9640-ff0fd009decc tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Adding query filter params (parent_region_id=c3c1f8a2e7354f9ab509b2b2e58085c9) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:07.850258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8bfd4-3f3c-45bf-9640-ff0fd009decc tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.851362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8bfd4-3f3c-45bf-9640-ff0fd009decc tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.862893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e6595-1fe4-4418-8ef6-45df426c0629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.863262 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3388/6758] 10.222.0.16 () {58 vars in 1227 bytes} [Mon Aug 29 15:55:07 2022] GET /identity/v3/regions?parent_region_id=c3c1f8a2e7354f9ab509b2b2e58085c9 => generated 400 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:55:07.864821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e6595-1fe4-4418-8ef6-45df426c0629 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.865414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e6595-1fe4-4418-8ef6-45df426c0629 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.865900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e6595-1fe4-4418-8ef6-45df426c0629 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.866929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e6595-1fe4-4418-8ef6-45df426c0629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.867775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8bfd4-3f3c-45bf-9640-ff0fd009decc tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.871043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e6595-1fe4-4418-8ef6-45df426c0629 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.886880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8bfd4-3f3c-45bf-9640-ff0fd009decc tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:07.899295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4c58-2946-4b6e-bf8d-3b26023ec82d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:07.899937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4c58-2946-4b6e-bf8d-3b26023ec82d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:07.900220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4c58-2946-4b6e-bf8d-3b26023ec82d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:07.900495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4c58-2946-4b6e-bf8d-3b26023ec82d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions/1ae4c4f05dac472a89a64394b45a793f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:07.901089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd4c58-2946-4b6e-bf8d-3b26023ec82d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:delete_region(region_id=1ae4c4f05dac472a89a64394b45a793f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:07.905194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd4c58-2946-4b6e-bf8d-3b26023ec82d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:07.927896 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3371/6759] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:07 2022] POST /identity/v3/projects => generated 365 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:55:07.932328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e6595-1fe4-4418-8ef6-45df426c0629 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.949897 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3389/6760] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:55:07 2022] DELETE /identity/v3/regions/1ae4c4f05dac472a89a64394b45a793f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:07.955425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4c58-2946-4b6e-bf8d-3b26023ec82d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:07.972103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:07.990559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4c58-2946-4b6e-bf8d-3b26023ec82d tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:08.074224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e6595-1fe4-4418-8ef6-45df426c0629 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:08.113367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bc997-d11f-47b0-bb55-0661477957bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:08.115031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bc997-d11f-47b0-bb55-0661477957bb admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:08.116801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bc997-d11f-47b0-bb55-0661477957bb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:08.117241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bc997-d11f-47b0-bb55-0661477957bb admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:08.118083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bc997-d11f-47b0-bb55-0661477957bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:08.120628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bc997-d11f-47b0-bb55-0661477957bb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:08.142755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96928367-c797-4af0-85c3-1f1f5f8560e6 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:08.143524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96928367-c797-4af0-85c3-1f1f5f8560e6 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:08.143818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96928367-c797-4af0-85c3-1f1f5f8560e6 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:08.144641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96928367-c797-4af0-85c3-1f1f5f8560e6 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions/4e8a785367de4cffae05403e07223681` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:08.144987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96928367-c797-4af0-85c3-1f1f5f8560e6 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:delete_region(region_id=4e8a785367de4cffae05403e07223681)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:08.146822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96928367-c797-4af0-85c3-1f1f5f8560e6 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:08.161289 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3372/6761] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:07 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:08.162765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bc997-d11f-47b0-bb55-0661477957bb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:08.165192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cb5bc997-d11f-47b0-bb55-0661477957bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:08.179937 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3390/6762] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:55:07 2022] DELETE /identity/v3/regions/4e8a785367de4cffae05403e07223681 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:08.181125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96928367-c797-4af0-85c3-1f1f5f8560e6 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:08.183666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bc997-d11f-47b0-bb55-0661477957bb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:08.212689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:08.213885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:08.215854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96928367-c797-4af0-85c3-1f1f5f8560e6 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:08.216784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:08.217620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] PATH_INFO: `/v3/users/da22efaea08d47cc9aecb5e1e92c26cc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:08.218376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da22efaea08d47cc9aecb5e1e92c26cc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:08.220877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:08.229824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599b71d-30b2-49d0-980f-b26d8acad186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:08.230453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599b71d-30b2-49d0-980f-b26d8acad186 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:08.230736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599b71d-30b2-49d0-980f-b26d8acad186 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:08.231009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599b71d-30b2-49d0-980f-b26d8acad186 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:08.231664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599b71d-30b2-49d0-980f-b26d8acad186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:08.235057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599b71d-30b2-49d0-980f-b26d8acad186 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:08.262247 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3391/6763] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:08.263528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599b71d-30b2-49d0-980f-b26d8acad186 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:08.299521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599b71d-30b2-49d0-980f-b26d8acad186 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:08.315127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:08.316358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f0edc-c376-4102-a576-6ba5ba88a963 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c63036c9d46759dce85fac8e185ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe054ee1f3a4d549243bcafc37595ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:08.320091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f0edc-c376-4102-a576-6ba5ba88a963 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:08.321171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f0edc-c376-4102-a576-6ba5ba88a963 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:08.323122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f0edc-c376-4102-a576-6ba5ba88a963 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] PATH_INFO: `/v3/regions/c3c1f8a2e7354f9ab509b2b2e58085c9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:08.327141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f0edc-c376-4102-a576-6ba5ba88a963 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorizing `identity:delete_region(region_id=c3c1f8a2e7354f9ab509b2b2e58085c9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:08.333519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f0edc-c376-4102-a576-6ba5ba88a963 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:08.371598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da22efaea08d47cc9aecb5e1e92c26cc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:08.372606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da22efaea08d47cc9aecb5e1e92c26cc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:08.391174 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3392/6764] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:55:08 2022] DELETE /identity/v3/regions/c3c1f8a2e7354f9ab509b2b2e58085c9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:08.391789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f0edc-c376-4102-a576-6ba5ba88a963 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:08.409264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da22efaea08d47cc9aecb5e1e92c26cc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:08.426437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da22efaea08d47cc9aecb5e1e92c26cc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:08.450602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f0edc-c376-4102-a576-6ba5ba88a963 tempest-RegionsTestJSON-1990982795 tempest-RegionsTestJSON-1990982795-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:08.454448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da22efaea08d47cc9aecb5e1e92c26cc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:08.465529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cb898-2eed-4c9a-a766-4475c9675345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:08.466057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cb898-2eed-4c9a-a766-4475c9675345 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:08.466338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cb898-2eed-4c9a-a766-4475c9675345 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:08.466991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cb898-2eed-4c9a-a766-4475c9675345 admin admin] PATH_INFO: `/v3/projects/3cf63fbbdb964dafa10d72e1369fe4a4/users/2195842eae3b46c2b162c95387e3a48c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:08.472221 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3373/6765] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:08 2022] DELETE /identity/v3/users/da22efaea08d47cc9aecb5e1e92c26cc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:08.473233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:08.474690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:08.517701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cb898-2eed-4c9a-a766-4475c9675345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf63fbbdb964dafa10d72e1369fe4a4, user_id=2195842eae3b46c2b162c95387e3a48c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:08.522285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cb898-2eed-4c9a-a766-4475c9675345 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:08.561864 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3393/6766] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:08 2022] PUT /identity/v3/projects/3cf63fbbdb964dafa10d72e1369fe4a4/users/2195842eae3b46c2b162c95387e3a48c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:08.563342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa794bb-4d58-42dd-a443-a74c007297fe None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:08.563634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa794bb-4d58-42dd-a443-a74c007297fe None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:08.563915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa794bb-4d58-42dd-a443-a74c007297fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:08.590342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13f586-4c82-4c8b-85d0-805577a52d43 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:08.606384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2aa794bb-4d58-42dd-a443-a74c007297fe None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:08.607318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2aa794bb-4d58-42dd-a443-a74c007297fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:08.682098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:08.683869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:08.684071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:08.684451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] PATH_INFO: `/v3/users/84eb692d593649a4b2e14896dca684d8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:08.686060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84eb692d593649a4b2e14896dca684d8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:08.688819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:08.760070 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3394/6767] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:08.760070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa794bb-4d58-42dd-a443-a74c007297fe None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:08.763212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2aa794bb-4d58-42dd-a443-a74c007297fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:08.778250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84eb692d593649a4b2e14896dca684d8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:08.781115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84eb692d593649a4b2e14896dca684d8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:08.787337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa794bb-4d58-42dd-a443-a74c007297fe None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:08.792959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73736a26-cb65-4e8d-9208-699c57af7e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:08.794077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73736a26-cb65-4e8d-9208-699c57af7e50 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:08.794384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73736a26-cb65-4e8d-9208-699c57af7e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:08.794716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73736a26-cb65-4e8d-9208-699c57af7e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:08.795366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73736a26-cb65-4e8d-9208-699c57af7e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:08.797671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73736a26-cb65-4e8d-9208-699c57af7e50 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:08.800273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:08.802036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:08.807515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84eb692d593649a4b2e14896dca684d8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:08.816593 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3395/6768] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:08.817636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73736a26-cb65-4e8d-9208-699c57af7e50 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:08.819349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-73736a26-cb65-4e8d-9208-699c57af7e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:08.826434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84eb692d593649a4b2e14896dca684d8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:08.839824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84eb692d593649a4b2e14896dca684d8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:08.852415 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3374/6769] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:08 2022] DELETE /identity/v3/users/84eb692d593649a4b2e14896dca684d8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:08.856110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:08.857904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:08.946203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73736a26-cb65-4e8d-9208-699c57af7e50 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:08.978300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd85ad0-1582-473e-93f4-dbf8e7afc588 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:08.986447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa0cda-d802-4b44-bc47-9b57e425c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:08.987416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa0cda-d802-4b44-bc47-9b57e425c11f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:08.988078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa0cda-d802-4b44-bc47-9b57e425c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:08.988379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa0cda-d802-4b44-bc47-9b57e425c11f admin admin] PATH_INFO: `/v3/projects/3cf63fbbdb964dafa10d72e1369fe4a4/users/2195842eae3b46c2b162c95387e3a48c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:08.990729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa0cda-d802-4b44-bc47-9b57e425c11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf63fbbdb964dafa10d72e1369fe4a4, user_id=2195842eae3b46c2b162c95387e3a48c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:08.993643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa0cda-d802-4b44-bc47-9b57e425c11f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:09.013602 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3375/6770] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:08 2022] PUT /identity/v3/projects/3cf63fbbdb964dafa10d72e1369fe4a4/users/2195842eae3b46c2b162c95387e3a48c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:09.016672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2d384-d285-4c35-936d-563af52bb0fb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:09.016967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2d384-d285-4c35-936d-563af52bb0fb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:09.017247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2d384-d285-4c35-936d-563af52bb0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:09.041616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49093910-1852-4cb3-8e26-c4531b97064b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:09.042951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093910-1852-4cb3-8e26-c4531b97064b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:09.043401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093910-1852-4cb3-8e26-c4531b97064b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:09.043686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093910-1852-4cb3-8e26-c4531b97064b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:09.045515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-49093910-1852-4cb3-8e26-c4531b97064b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:09.054337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cad2d384-d285-4c35-936d-563af52bb0fb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:09.055893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cad2d384-d285-4c35-936d-563af52bb0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:09.092213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49093910-1852-4cb3-8e26-c4531b97064b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:09.093707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49093910-1852-4cb3-8e26-c4531b97064b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:09.117636 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3396/6771] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:09.118953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf26708-6529-4497-9961-cc68090d24cb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:09.119681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf26708-6529-4497-9961-cc68090d24cb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:09.119681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf26708-6529-4497-9961-cc68090d24cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:09.187349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bbf26708-6529-4497-9961-cc68090d24cb None None] MFA Rules not processed for user `2195842eae3b46c2b162c95387e3a48c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:09.188593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bbf26708-6529-4497-9961-cc68090d24cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:09.209713 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3376/6772] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:09.271869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2d384-d285-4c35-936d-563af52bb0fb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:09.273655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cad2d384-d285-4c35-936d-563af52bb0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:09.371356 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3397/6773] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:09.375870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf26708-6529-4497-9961-cc68090d24cb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:09.395236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf26708-6529-4497-9961-cc68090d24cb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:09.407319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5c97b-1216-4a11-83e3-0d786d49a72f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:09.408296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5c97b-1216-4a11-83e3-0d786d49a72f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:09.408296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5c97b-1216-4a11-83e3-0d786d49a72f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:09.408491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5c97b-1216-4a11-83e3-0d786d49a72f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:09.409172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5c97b-1216-4a11-83e3-0d786d49a72f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:09.411143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5c97b-1216-4a11-83e3-0d786d49a72f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:09.445547 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3398/6774] 10.222.0.16 () {60 vars in 1149 bytes} [Mon Aug 29 15:55:09 2022] POST /identity/v3/domains => generated 277 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:55:09.449551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5c97b-1216-4a11-83e3-0d786d49a72f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:09.453837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2d384-d285-4c35-936d-563af52bb0fb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:09.493547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:09.552924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:09.605475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5c97b-1216-4a11-83e3-0d786d49a72f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:09.612782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb67d00-4728-4fa4-8fed-81dbf02f5e14 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:09.614269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb67d00-4728-4fa4-8fed-81dbf02f5e14 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:09.614737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb67d00-4728-4fa4-8fed-81dbf02f5e14 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:09.615023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb67d00-4728-4fa4-8fed-81dbf02f5e14 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:09.615681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb67d00-4728-4fa4-8fed-81dbf02f5e14 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:09.617763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb67d00-4728-4fa4-8fed-81dbf02f5e14 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:09.711643 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3399/6775] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:09 2022] POST /identity/v3/users => generated 347 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:55:09.715030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcb8ee-5d86-4ccd-b162-ccf885e2c461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:09.716060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb67d00-4728-4fa4-8fed-81dbf02f5e14 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:09.717144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcb8ee-5d86-4ccd-b162-ccf885e2c461 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:09.717584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcb8ee-5d86-4ccd-b162-ccf885e2c461 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:09.717761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcb8ee-5d86-4ccd-b162-ccf885e2c461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:09.738888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb67d00-4728-4fa4-8fed-81dbf02f5e14 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:09.756486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c9f9b-88d7-4088-8780-f6543d9b3b71 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:09.757122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c9f9b-88d7-4088-8780-f6543d9b3b71 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:09.757423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c9f9b-88d7-4088-8780-f6543d9b3b71 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:09.757709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c9f9b-88d7-4088-8780-f6543d9b3b71 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:09.758359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c9f9b-88d7-4088-8780-f6543d9b3b71 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:09.760238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c9f9b-88d7-4088-8780-f6543d9b3b71 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:09.820978 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3400/6776] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:09 2022] POST /identity/v3/users => generated 324 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:55:09.820978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c9f9b-88d7-4088-8780-f6543d9b3b71 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:09.845225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c9f9b-88d7-4088-8780-f6543d9b3b71 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:09.856117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe71fe8-fa78-436c-87c3-490ef6bced74 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:09.857009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe71fe8-fa78-436c-87c3-490ef6bced74 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:09.857360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe71fe8-fa78-436c-87c3-490ef6bced74 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:09.858765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe71fe8-fa78-436c-87c3-490ef6bced74 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/users/c6bab6f1f58c4457af3b74194fda7905` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:09.898190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcb8ee-5d86-4ccd-b162-ccf885e2c461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:09.910179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe71fe8-fa78-436c-87c3-490ef6bced74 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:get_user(user_id=c6bab6f1f58c4457af3b74194fda7905)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:09.912653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe71fe8-fa78-436c-87c3-490ef6bced74 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:09.912934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcb8ee-5d86-4ccd-b162-ccf885e2c461 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:09.922363 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3401/6777] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Aug 29 15:55:09 2022] GET /identity/v3/users/c6bab6f1f58c4457af3b74194fda7905 => generated 347 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:55:09.923493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe71fe8-fa78-436c-87c3-490ef6bced74 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:09.941676 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3377/6778] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:55:09.959277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe71fe8-fa78-436c-87c3-490ef6bced74 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:09.964703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b0b7e-0639-45c6-8b7c-2834ac522a75 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:09.965445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b0b7e-0639-45c6-8b7c-2834ac522a75 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:09.966188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b0b7e-0639-45c6-8b7c-2834ac522a75 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:09.966188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b0b7e-0639-45c6-8b7c-2834ac522a75 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:09.967004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b0b7e-0639-45c6-8b7c-2834ac522a75 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Adding query filter params (domain_id=0a2ff43850d745958f1930d039ffc487) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:09.967376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b0b7e-0639-45c6-8b7c-2834ac522a75 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:09.968586 n-d-854882-3 devstack@keystone.service[89681]: WARNING py.warnings [None req-b74b0b7e-0639-45c6-8b7c-2834ac522a75 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:55:09.968586 n-d-854882-3 devstack@keystone.service[89681]: warnings.warn(msg) Aug 29 15:55:09.968586 n-d-854882-3 devstack@keystone.service[89681]: Aug 29 15:55:09.969992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b0b7e-0639-45c6-8b7c-2834ac522a75 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:09.988341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcb8ee-5d86-4ccd-b162-ccf885e2c461 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:09.993898 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3402/6779] 10.222.0.16 () {58 vars in 1207 bytes} [Mon Aug 29 15:55:09 2022] GET /identity/v3/users?domain_id=0a2ff43850d745958f1930d039ffc487 => generated 484 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:09.999963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcb8ee-5d86-4ccd-b162-ccf885e2c461 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:10.005256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11b556-5513-49c5-ac46-87c21970f051 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:10.006207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b556-5513-49c5-ac46-87c21970f051 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:10.006632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b556-5513-49c5-ac46-87c21970f051 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:10.007011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b556-5513-49c5-ac46-87c21970f051 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:10.007798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11b556-5513-49c5-ac46-87c21970f051 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:10.008891 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-5b11b556-5513-49c5-ac46-87c21970f051 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:55:10.008891 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:55:10.008891 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:55:10.010305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11b556-5513-49c5-ac46-87c21970f051 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:10.067066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b0b7e-0639-45c6-8b7c-2834ac522a75 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:10.069219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b74b0b7e-0639-45c6-8b7c-2834ac522a75 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:10.091554 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3378/6780] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:09 2022] GET /identity/v3/users => generated 8270 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:55:10.096788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11b556-5513-49c5-ac46-87c21970f051 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:10.098114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b0b7e-0639-45c6-8b7c-2834ac522a75 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:10.111456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:10.112198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:10.112484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:10.112759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] PATH_INFO: `/v3/projects/195cb5aa04604258b6d081ab22be2f6a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:10.116053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=195cb5aa04604258b6d081ab22be2f6a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:10.118344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:10.121481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11b556-5513-49c5-ac46-87c21970f051 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:10.138648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471d3bd-ddaa-4440-845e-8a7b93d283c4 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:10.139769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d3bd-ddaa-4440-845e-8a7b93d283c4 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:10.140411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d3bd-ddaa-4440-845e-8a7b93d283c4 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:10.140905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d3bd-ddaa-4440-845e-8a7b93d283c4 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:10.142457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471d3bd-ddaa-4440-845e-8a7b93d283c4 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Adding query filter params (name=tempest-test_user-251351594) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:10.143042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471d3bd-ddaa-4440-845e-8a7b93d283c4 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:10.150285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471d3bd-ddaa-4440-845e-8a7b93d283c4 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:10.217018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195cb5aa04604258b6d081ab22be2f6a', 'request_id': 'req-f7cceac9-bc1a-48ca-a718-6486f358ab6f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.225064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195cb5aa04604258b6d081ab22be2f6a', 'request_id': 'req-f7cceac9-bc1a-48ca-a718-6486f358ab6f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.236928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195cb5aa04604258b6d081ab22be2f6a', 'request_id': 'req-f7cceac9-bc1a-48ca-a718-6486f358ab6f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.243694 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3379/6781] 10.222.0.16 () {58 vars in 1187 bytes} [Mon Aug 29 15:55:10 2022] GET /identity/v3/users?name=tempest-test_user-251351594 => generated 474 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:10.250784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471d3bd-ddaa-4440-845e-8a7b93d283c4 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:10.282845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471d3bd-ddaa-4440-845e-8a7b93d283c4 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:10.287025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] The token cache is being invalidate because project 195cb5aa04604258b6d081ab22be2f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:10.287464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.289888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.293726 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3403/6782] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:10 2022] DELETE /identity/v3/projects/195cb5aa04604258b6d081ab22be2f6a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:10.301106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:10.308347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:10.414064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:10.421793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba698-215c-4085-97d2-c95e00739bd6 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:10.422522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba698-215c-4085-97d2-c95e00739bd6 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:10.422794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba698-215c-4085-97d2-c95e00739bd6 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:10.423127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba698-215c-4085-97d2-c95e00739bd6 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:10.423859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba698-215c-4085-97d2-c95e00739bd6 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:10.424167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba698-215c-4085-97d2-c95e00739bd6 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:10.426107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba698-215c-4085-97d2-c95e00739bd6 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:10.458764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cceac9-bc1a-48ca-a718-6486f358ab6f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:10.465558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:10.468139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:10.468583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:10.469014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] PATH_INFO: `/v3/users/8ab6548051884a2db9beec3daf497768` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:10.471779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab6548051884a2db9beec3daf497768)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:10.474501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:10.484701 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3380/6783] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Aug 29 15:55:10 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:10.485896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba698-215c-4085-97d2-c95e00739bd6 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:10.488955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-11fba698-215c-4085-97d2-c95e00739bd6 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:10.509879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba698-215c-4085-97d2-c95e00739bd6 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:10.525272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:10.528870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:10.529284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:10.529651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/users/845a8fcbaccb45ce9e177c5338b51ace` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:10.570556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab6548051884a2db9beec3daf497768'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.570799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:delete_user(user_id=845a8fcbaccb45ce9e177c5338b51ace)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:10.571231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab6548051884a2db9beec3daf497768'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.573033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:10.617789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab6548051884a2db9beec3daf497768'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.619782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab6548051884a2db9beec3daf497768'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.632746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab6548051884a2db9beec3daf497768'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.666240 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3404/6784] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:10 2022] DELETE /identity/v3/users/8ab6548051884a2db9beec3daf497768 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:10.673798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:10.690962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845a8fcbaccb45ce9e177c5338b51ace'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.691666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845a8fcbaccb45ce9e177c5338b51ace'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.707540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845a8fcbaccb45ce9e177c5338b51ace'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.722363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845a8fcbaccb45ce9e177c5338b51ace'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.739077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845a8fcbaccb45ce9e177c5338b51ace'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:10.751682 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3381/6785] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:10 2022] DELETE /identity/v3/users/845a8fcbaccb45ce9e177c5338b51ace => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:10.754290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:10.758760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:10.918274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:10.919404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2982bdf-3a14-487c-9734-8d6800f082ed admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:10.919996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:11.087490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fdc17-d99a-43a6-b104-d2e07c644f7f tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:11.100760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:11.101607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:11.101993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:11.102395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] PATH_INFO: `/v3/projects/c9b41a7132cd447abd152fb424f481e1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:11.104031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b41a7132cd447abd152fb424f481e1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:11.106829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:11.123153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:11.124605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:11.125168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:11.125745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/users/c6bab6f1f58c4457af3b74194fda7905` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:11.127152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c6bab6f1f58c4457af3b74194fda7905)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:11.129264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:11.140652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:11.231103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bab6f1f58c4457af3b74194fda7905'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.232665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bab6f1f58c4457af3b74194fda7905'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.236115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b41a7132cd447abd152fb424f481e1', 'request_id': 'req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.263303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b41a7132cd447abd152fb424f481e1', 'request_id': 'req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.269305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bab6f1f58c4457af3b74194fda7905'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.271763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bab6f1f58c4457af3b74194fda7905'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.277717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b41a7132cd447abd152fb424f481e1', 'request_id': 'req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.300291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bab6f1f58c4457af3b74194fda7905'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.307650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] The token cache is being invalidate because project c9b41a7132cd447abd152fb424f481e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:11.308571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.309420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.313872 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3382/6786] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:10 2022] DELETE /identity/v3/projects/c9b41a7132cd447abd152fb424f481e1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:11.320027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:11.331297 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3405/6787] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:10 2022] DELETE /identity/v3/users/c6bab6f1f58c4457af3b74194fda7905 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:11.332578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:11.334090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:11.334349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:11.455052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:11.543283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c2732-fdc2-4c72-b55d-a0398fca9c20 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:11.578502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155d07a-478c-40ac-b818-2683bd2615c3 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:11.594792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:11.595821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:11.596111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:11.596392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/domains/0a2ff43850d745958f1930d039ffc487` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:11.597792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0a2ff43850d745958f1930d039ffc487)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:11.603263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:11.654578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0a2ff43850d745958f1930d039ffc487'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.658121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0a2ff43850d745958f1930d039ffc487'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.681664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:11.682225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:11.682503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:11.683314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] PATH_INFO: `/v3/users/454c63036c9d46759dce85fac8e185ca` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:11.684677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] RBAC: Authorizing `identity:delete_user(user_id=454c63036c9d46759dce85fac8e185ca)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:11.687782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:11.707572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0a2ff43850d745958f1930d039ffc487'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.708298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0a2ff43850d745958f1930d039ffc487'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.711870 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3406/6788] 10.222.0.16 () {60 vars in 1249 bytes} [Mon Aug 29 15:55:11 2022] PATCH /identity/v3/domains/0a2ff43850d745958f1930d039ffc487 => generated 278 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:11.712833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:11.714771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:11.785932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454c63036c9d46759dce85fac8e185ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.787732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454c63036c9d46759dce85fac8e185ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.819727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:11.819926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454c63036c9d46759dce85fac8e185ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.835789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454c63036c9d46759dce85fac8e185ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.847856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067df94-c0ae-4632-9a1d-d31971ca9735 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:11.852331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454c63036c9d46759dce85fac8e185ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:11.853876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:11.854771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:11.855814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:11.856189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] PATH_INFO: `/v3/projects/f29da9832eaf411d866b40e000769a7e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:11.857624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29da9832eaf411d866b40e000769a7e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:11.863079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:11.863248 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3383/6789] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:11 2022] DELETE /identity/v3/users/454c63036c9d46759dce85fac8e185ca => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:11.863248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:11.863248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:11.979115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f190140-6c43-498b-83ab-8d7bab23438e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:11.993419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:11.998683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29da9832eaf411d866b40e000769a7e', 'request_id': 'req-66ce4c21-1a2d-472f-8d4c-af80468a5d52'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.016119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29da9832eaf411d866b40e000769a7e', 'request_id': 'req-66ce4c21-1a2d-472f-8d4c-af80468a5d52'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.025578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29da9832eaf411d866b40e000769a7e', 'request_id': 'req-66ce4c21-1a2d-472f-8d4c-af80468a5d52'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.040935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] The token cache is being invalidate because project f29da9832eaf411d866b40e000769a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:12.041372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.042722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-66ce4c21-1a2d-472f-8d4c-af80468a5d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.046958 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3407/6790] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:11 2022] DELETE /identity/v3/projects/f29da9832eaf411d866b40e000769a7e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:12.052386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4c9bd-7b33-4583-9c38-9bc6a43d6029 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:12.052921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4c9bd-7b33-4583-9c38-9bc6a43d6029 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:12.053541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4c9bd-7b33-4583-9c38-9bc6a43d6029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:12.075056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2195842eae3b46c2b162c95387e3a48c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cf63fbbdb964dafa10d72e1369fe4a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:12.076288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:12.076834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:12.077205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] PATH_INFO: `/v3/domains/0a2ff43850d745958f1930d039ffc487` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:12.093064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0a2ff43850d745958f1930d039ffc487)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:12.094279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5df4c9bd-7b33-4583-9c38-9bc6a43d6029 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:12.094979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:12.095891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5df4c9bd-7b33-4583-9c38-9bc6a43d6029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:12.135445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0a2ff43850d745958f1930d039ffc487'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.157478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0a2ff43850d745958f1930d039ffc487'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.239387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2ff43850d745958f1930d039ffc487', 'request_id': 'req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.246498 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3408/6791] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:12.254136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5e16-3699-4a1b-b8b8-78f3db769e43 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:12.254467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5e16-3699-4a1b-b8b8-78f3db769e43 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:12.258140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5e16-3699-4a1b-b8b8-78f3db769e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:12.259399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2ff43850d745958f1930d039ffc487', 'request_id': 'req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.280667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2ff43850d745958f1930d039ffc487', 'request_id': 'req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.287608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8d5a5e16-3699-4a1b-b8b8-78f3db769e43 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:12.289013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8d5a5e16-3699-4a1b-b8b8-78f3db769e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:12.300900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] The token cache is being invalidate because project 0a2ff43850d745958f1930d039ffc487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:12.301486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.302436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.316906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0a2ff43850d745958f1930d039ffc487', 'request_id': 'req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.319051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0a2ff43850d745958f1930d039ffc487', 'request_id': 'req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.320394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0a2ff43850d745958f1930d039ffc487', 'request_id': 'req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.333909 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3384/6792] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Aug 29 15:55:11 2022] DELETE /identity/v3/domains/0a2ff43850d745958f1930d039ffc487 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:12.343152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:12.346684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:12.386997 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3409/6793] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:12.386997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a5e16-3699-4a1b-b8b8-78f3db769e43 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:12.386997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8d5a5e16-3699-4a1b-b8b8-78f3db769e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:12.403861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a5e16-3699-4a1b-b8b8-78f3db769e43 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:12.411845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:12.412568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:12.412946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:12.413169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] PATH_INFO: `/v3/projects/5fe054ee1f3a4d549243bcafc37595ff` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:12.414670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe054ee1f3a4d549243bcafc37595ff)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:12.416954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:12.441940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:12.449330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:12.474406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7572f-3cc1-4f0c-bb6e-7794989d40a2 tempest-UsersV3TestJSON-997186986 tempest-UsersV3TestJSON-997186986-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:12.517662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe054ee1f3a4d549243bcafc37595ff', 'request_id': 'req-8833b37e-e0f0-4dca-80e9-1875c1a99d49'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.539609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe054ee1f3a4d549243bcafc37595ff', 'request_id': 'req-8833b37e-e0f0-4dca-80e9-1875c1a99d49'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.556087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe054ee1f3a4d549243bcafc37595ff', 'request_id': 'req-8833b37e-e0f0-4dca-80e9-1875c1a99d49'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.573440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:12.574623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:12.575046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:12.575540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] PATH_INFO: `/v3/users/1d6aea8c1b124f74a714fe43d8d476bb` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:12.577038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6aea8c1b124f74a714fe43d8d476bb)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:12.580011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:12.587823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] The token cache is being invalidate because project 5fe054ee1f3a4d549243bcafc37595ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:12.588147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.589986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.591645 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3410/6794] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:12 2022] DELETE /identity/v3/projects/5fe054ee1f3a4d549243bcafc37595ff => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:12.592377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:12.599509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:12.632930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833b37e-e0f0-4dca-80e9-1875c1a99d49 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:12.641722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa972cf-cc98-4f1a-9dfb-e2bd12fd28e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:12.643380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa972cf-cc98-4f1a-9dfb-e2bd12fd28e6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:12.643902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa972cf-cc98-4f1a-9dfb-e2bd12fd28e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:12.644456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa972cf-cc98-4f1a-9dfb-e2bd12fd28e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:12.645741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa972cf-cc98-4f1a-9dfb-e2bd12fd28e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:12.646397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa972cf-cc98-4f1a-9dfb-e2bd12fd28e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:12.648178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6aea8c1b124f74a714fe43d8d476bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.648880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6aea8c1b124f74a714fe43d8d476bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.649428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa972cf-cc98-4f1a-9dfb-e2bd12fd28e6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:12.666257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6aea8c1b124f74a714fe43d8d476bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.672585 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3411/6795] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:12.678050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c753b7-993a-4505-978d-d59450435196 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:12.678050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c753b7-993a-4505-978d-d59450435196 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:12.678423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c753b7-993a-4505-978d-d59450435196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:12.682963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6aea8c1b124f74a714fe43d8d476bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.699483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6aea8c1b124f74a714fe43d8d476bb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:12.709914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a9c753b7-993a-4505-978d-d59450435196 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:12.711574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a9c753b7-993a-4505-978d-d59450435196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:12.713749 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3385/6796] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:12 2022] DELETE /identity/v3/users/1d6aea8c1b124f74a714fe43d8d476bb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:12.717138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:12.721284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:12.873622 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3412/6797] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:12.874801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c753b7-993a-4505-978d-d59450435196 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:12.876247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a9c753b7-993a-4505-978d-d59450435196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:12.910192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c753b7-993a-4505-978d-d59450435196 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:12.932935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88672a84-6178-47e9-a7d0-6c0f47e9c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:12.933817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672a84-6178-47e9-a7d0-6c0f47e9c3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:12.934200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672a84-6178-47e9-a7d0-6c0f47e9c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:12.934940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672a84-6178-47e9-a7d0-6c0f47e9c3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:12.935697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88672a84-6178-47e9-a7d0-6c0f47e9c3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:12.938238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88672a84-6178-47e9-a7d0-6c0f47e9c3f1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.004047 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3413/6798] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:12 2022] POST /identity/v3/projects => generated 361 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:13.005559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c779827-927e-4d26-8db7-3216a72134b7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.005920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c779827-927e-4d26-8db7-3216a72134b7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.006382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c779827-927e-4d26-8db7-3216a72134b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.015023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e3ce7-5b6f-4a5c-b3ce-7fa733dcb435 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.040382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0c779827-927e-4d26-8db7-3216a72134b7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:13.041813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0c779827-927e-4d26-8db7-3216a72134b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:13.047408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:13.111656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:13.112362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.112648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.112928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] PATH_INFO: `/v3/users/83bbfa5b89984301a13159a5a0f867bd` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.114602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bbfa5b89984301a13159a5a0f867bd)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:13.118307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.173703 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3414/6799] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:13.175268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68960b8e-6a12-4c2e-aea1-199a41e90229 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.175658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68960b8e-6a12-4c2e-aea1-199a41e90229 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.176048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68960b8e-6a12-4c2e-aea1-199a41e90229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.206042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bbfa5b89984301a13159a5a0f867bd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:13.206841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bbfa5b89984301a13159a5a0f867bd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:13.210496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-68960b8e-6a12-4c2e-aea1-199a41e90229 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:13.212460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-68960b8e-6a12-4c2e-aea1-199a41e90229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:13.229674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bbfa5b89984301a13159a5a0f867bd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:13.234855 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3415/6800] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:13.234855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68960b8e-6a12-4c2e-aea1-199a41e90229 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:13.243527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:13.248423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68960b8e-6a12-4c2e-aea1-199a41e90229 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.250914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bbfa5b89984301a13159a5a0f867bd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:13.261128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bbfa5b89984301a13159a5a0f867bd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:13.267169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971978d-e680-4e35-8f25-cc5b4e773485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:13.269193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971978d-e680-4e35-8f25-cc5b4e773485 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.269615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971978d-e680-4e35-8f25-cc5b4e773485 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.271075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971978d-e680-4e35-8f25-cc5b4e773485 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.275553 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3386/6801] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:12 2022] DELETE /identity/v3/users/83bbfa5b89984301a13159a5a0f867bd => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:13.275553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:13.275792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971978d-e680-4e35-8f25-cc5b4e773485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:13.277578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971978d-e680-4e35-8f25-cc5b4e773485 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.280532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:13.323848 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3416/6802] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:13 2022] POST /identity/v3/users => generated 281 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:13.323848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971978d-e680-4e35-8f25-cc5b4e773485 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:13.331047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0971978d-e680-4e35-8f25-cc5b4e773485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:13.347596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971978d-e680-4e35-8f25-cc5b4e773485 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.396932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96a090-fbc9-46f5-955b-1aec556be303 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.408661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93cd5b-e1f1-4f0d-953f-2e570d59f7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:13.409284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93cd5b-e1f1-4f0d-953f-2e570d59f7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.409587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93cd5b-e1f1-4f0d-953f-2e570d59f7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.409861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93cd5b-e1f1-4f0d-953f-2e570d59f7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.411722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3f93cd5b-e1f1-4f0d-953f-2e570d59f7a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:13.446897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8f7b7-1f5b-41f5-88be-27d04767db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:13.447796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f7b7-1f5b-41f5-88be-27d04767db3f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.448757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f7b7-1f5b-41f5-88be-27d04767db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.449681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f7b7-1f5b-41f5-88be-27d04767db3f admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.451638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8f7b7-1f5b-41f5-88be-27d04767db3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:13.452244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8f7b7-1f5b-41f5-88be-27d04767db3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:13.454975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8f7b7-1f5b-41f5-88be-27d04767db3f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.473881 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3417/6803] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:13.475851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42d284-8c31-4aa5-95e5-cf18a7b13a67 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.476939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42d284-8c31-4aa5-95e5-cf18a7b13a67 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.477469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42d284-8c31-4aa5-95e5-cf18a7b13a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.503583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dd42d284-8c31-4aa5-95e5-cf18a7b13a67 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:13.505149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dd42d284-8c31-4aa5-95e5-cf18a7b13a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:13.520972 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3418/6804] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:13.522647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42d284-8c31-4aa5-95e5-cf18a7b13a67 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:13.524410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dd42d284-8c31-4aa5-95e5-cf18a7b13a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:13.539785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42d284-8c31-4aa5-95e5-cf18a7b13a67 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.547424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db1823-d4d7-4c21-84fd-1260e30795c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:13.548264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db1823-d4d7-4c21-84fd-1260e30795c3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.548699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db1823-d4d7-4c21-84fd-1260e30795c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.549135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db1823-d4d7-4c21-84fd-1260e30795c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.549964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db1823-d4d7-4c21-84fd-1260e30795c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:13.553098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db1823-d4d7-4c21-84fd-1260e30795c3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.557332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:13.570384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93cd5b-e1f1-4f0d-953f-2e570d59f7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:13.571920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93cd5b-e1f1-4f0d-953f-2e570d59f7a3 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.574709 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3419/6805] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:13.577304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db1823-d4d7-4c21-84fd-1260e30795c3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:13.584615 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3387/6806] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:13.585707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93cd5b-e1f1-4f0d-953f-2e570d59f7a3 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:13.597096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93cd5b-e1f1-4f0d-953f-2e570d59f7a3 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.601953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9744-3913-42a6-9f24-8d993aa268a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:13.602859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9744-3913-42a6-9f24-8d993aa268a5 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.603236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9744-3913-42a6-9f24-8d993aa268a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.603776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9744-3913-42a6-9f24-8d993aa268a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.611719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db1823-d4d7-4c21-84fd-1260e30795c3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.615169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f9744-3913-42a6-9f24-8d993aa268a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:13.616382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f9744-3913-42a6-9f24-8d993aa268a5 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.623028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45410-2cb7-4066-8b8f-2b20be490b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:13.624823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45410-2cb7-4066-8b8f-2b20be490b66 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.624823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45410-2cb7-4066-8b8f-2b20be490b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.625032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45410-2cb7-4066-8b8f-2b20be490b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.626212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45410-2cb7-4066-8b8f-2b20be490b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:13.627989 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3388/6807] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:13.629110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9744-3913-42a6-9f24-8d993aa268a5 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:13.629301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45410-2cb7-4066-8b8f-2b20be490b66 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.647148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9744-3913-42a6-9f24-8d993aa268a5 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.653420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a10f73-875b-4dfe-adb2-8794d000e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:13.654402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a10f73-875b-4dfe-adb2-8794d000e698 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.654530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a10f73-875b-4dfe-adb2-8794d000e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.655160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a10f73-875b-4dfe-adb2-8794d000e698 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.655912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a10f73-875b-4dfe-adb2-8794d000e698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:13.658109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a10f73-875b-4dfe-adb2-8794d000e698 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.678990 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3389/6808] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:13.683974 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3420/6809] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:13 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:13.687291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a10f73-875b-4dfe-adb2-8794d000e698 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:13.688770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45410-2cb7-4066-8b8f-2b20be490b66 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:13.706262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a10f73-875b-4dfe-adb2-8794d000e698 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.820022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89340c1a-014e-4fb7-ba1a-aadf083117b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:13.820772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340c1a-014e-4fb7-ba1a-aadf083117b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.820985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340c1a-014e-4fb7-ba1a-aadf083117b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.821262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340c1a-014e-4fb7-ba1a-aadf083117b0 admin admin] PATH_INFO: `/v3/projects/6fcafac84ccf41ee87d592adbb6d71d9/users/030aab7434fa445ab00e2116daf29a83/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.830469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45410-2cb7-4066-8b8f-2b20be490b66 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.837288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537081f-5cad-4594-a149-8b91fe4a74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:13.838351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537081f-5cad-4594-a149-8b91fe4a74ac admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.838646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537081f-5cad-4594-a149-8b91fe4a74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.839387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537081f-5cad-4594-a149-8b91fe4a74ac admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.839572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89340c1a-014e-4fb7-ba1a-aadf083117b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcafac84ccf41ee87d592adbb6d71d9, user_id=030aab7434fa445ab00e2116daf29a83, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:13.840568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537081f-5cad-4594-a149-8b91fe4a74ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:13.842758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537081f-5cad-4594-a149-8b91fe4a74ac admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.843358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89340c1a-014e-4fb7-ba1a-aadf083117b0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:13.874944 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3390/6810] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:13 2022] PUT /identity/v3/projects/6fcafac84ccf41ee87d592adbb6d71d9/users/030aab7434fa445ab00e2116daf29a83/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:13.876789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60808d5f-852a-4e79-b8c6-4c7c8b9eee2e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:13.877096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60808d5f-852a-4e79-b8c6-4c7c8b9eee2e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:13.877578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60808d5f-852a-4e79-b8c6-4c7c8b9eee2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:13.906868 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3421/6811] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:13 2022] POST /identity/v3/users => generated 285 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:13.908269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537081f-5cad-4594-a149-8b91fe4a74ac admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:13.913195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-60808d5f-852a-4e79-b8c6-4c7c8b9eee2e None None] MFA Rules not processed for user `030aab7434fa445ab00e2116daf29a83`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:13.914453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-60808d5f-852a-4e79-b8c6-4c7c8b9eee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:13.919352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537081f-5cad-4594-a149-8b91fe4a74ac admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:13.975286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:14.039695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0309ef5-d804-4e88-b23e-199779d642ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:14.040891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309ef5-d804-4e88-b23e-199779d642ae admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:14.042355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309ef5-d804-4e88-b23e-199779d642ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:14.042711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309ef5-d804-4e88-b23e-199779d642ae admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:14.043441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0309ef5-d804-4e88-b23e-199779d642ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:14.049372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0309ef5-d804-4e88-b23e-199779d642ae admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:14.072556 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3391/6812] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:14.076675 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3422/6813] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:55:14.078067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60808d5f-852a-4e79-b8c6-4c7c8b9eee2e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:14.095051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60808d5f-852a-4e79-b8c6-4c7c8b9eee2e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:14.096173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0309ef5-d804-4e88-b23e-199779d642ae admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:14.099220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c0309ef5-d804-4e88-b23e-199779d642ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:14.100075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499fe75-151e-4acf-9623-c5050d5f3c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:14.100704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499fe75-151e-4acf-9623-c5050d5f3c95 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:14.101071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499fe75-151e-4acf-9623-c5050d5f3c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:14.101349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499fe75-151e-4acf-9623-c5050d5f3c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:14.102209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499fe75-151e-4acf-9623-c5050d5f3c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:14.103802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499fe75-151e-4acf-9623-c5050d5f3c95 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:14.118233 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3392/6814] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:14.120694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499fe75-151e-4acf-9623-c5050d5f3c95 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:14.135927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499fe75-151e-4acf-9623-c5050d5f3c95 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:14.142572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07462330-7334-4110-a857-8d5d34403f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:14.144159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462330-7334-4110-a857-8d5d34403f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:14.144737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462330-7334-4110-a857-8d5d34403f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:14.145306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462330-7334-4110-a857-8d5d34403f48 admin admin] PATH_INFO: `/v3/projects/59fd804f4fe749408e53b18802691a9d/users/42d2badcf1cb405e8294010d33ae6e7e/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:14.167131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07462330-7334-4110-a857-8d5d34403f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59fd804f4fe749408e53b18802691a9d, user_id=42d2badcf1cb405e8294010d33ae6e7e, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:14.170214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07462330-7334-4110-a857-8d5d34403f48 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:14.203823 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3393/6815] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:14 2022] PUT /identity/v3/projects/59fd804f4fe749408e53b18802691a9d/users/42d2badcf1cb405e8294010d33ae6e7e/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:14.204962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5598-3804-48cd-b9be-e07d747c8d68 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:14.205239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5598-3804-48cd-b9be-e07d747c8d68 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:14.205550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5598-3804-48cd-b9be-e07d747c8d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:14.219508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:14.241837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0309ef5-d804-4e88-b23e-199779d642ae admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:14.251584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8d2d5598-3804-48cd-b9be-e07d747c8d68 None None] MFA Rules not processed for user `42d2badcf1cb405e8294010d33ae6e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:14.252902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8d2d5598-3804-48cd-b9be-e07d747c8d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:14.349523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719decc-3ccf-480d-aa07-b77017500469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:14.350580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719decc-3ccf-480d-aa07-b77017500469 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:14.350845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719decc-3ccf-480d-aa07-b77017500469 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:14.351142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719decc-3ccf-480d-aa07-b77017500469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:14.361800 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3394/6816] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:14.361800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d5598-3804-48cd-b9be-e07d747c8d68 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:14.361800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8d2d5598-3804-48cd-b9be-e07d747c8d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:14.437636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719decc-3ccf-480d-aa07-b77017500469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:14.439231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719decc-3ccf-480d-aa07-b77017500469 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:14.446679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d5598-3804-48cd-b9be-e07d747c8d68 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:14.451530 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3423/6817] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:55:14.452057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:14.452549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719decc-3ccf-480d-aa07-b77017500469 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:14.452704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:14.452990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:14.453637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] PATH_INFO: `/v3/projects/de08796ac142447098e5309065882160` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:14.454180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2719decc-3ccf-480d-aa07-b77017500469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:14.454810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=de08796ac142447098e5309065882160)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:14.456733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:14.475590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719decc-3ccf-480d-aa07-b77017500469 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:14.488146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:14.488682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:14.488960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:14.489858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] PATH_INFO: `/v3/projects/a777161269d74a27b658499483fc593d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:14.495462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a777161269d74a27b658499483fc593d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:14.497419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:14.516272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de08796ac142447098e5309065882160', 'request_id': 'req-5f9648ed-fb01-48cd-a783-7ab9c61673ea'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.523475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de08796ac142447098e5309065882160', 'request_id': 'req-5f9648ed-fb01-48cd-a783-7ab9c61673ea'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.543683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de08796ac142447098e5309065882160', 'request_id': 'req-5f9648ed-fb01-48cd-a783-7ab9c61673ea'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.565353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:14.572893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] The token cache is being invalidate because project de08796ac142447098e5309065882160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:14.574281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.575468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.579858 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3395/6818] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:14 2022] DELETE /identity/v3/projects/de08796ac142447098e5309065882160 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:14.579858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:14.581593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:14.590138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a777161269d74a27b658499483fc593d', 'request_id': 'req-7afc9027-f0e1-4e83-8a61-2abefcaa623b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.603231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a777161269d74a27b658499483fc593d', 'request_id': 'req-7afc9027-f0e1-4e83-8a61-2abefcaa623b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.615901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a777161269d74a27b658499483fc593d', 'request_id': 'req-7afc9027-f0e1-4e83-8a61-2abefcaa623b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.631506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:14.634943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] The token cache is being invalidate because project a777161269d74a27b658499483fc593d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:14.635631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.639200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.641241 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3424/6819] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:14 2022] DELETE /identity/v3/projects/a777161269d74a27b658499483fc593d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:14.642880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:14.645162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:14.688726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9648ed-fb01-48cd-a783-7ab9c61673ea admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:14.785748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef973c-66fa-4773-8152-11b1e37f25d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:14.786939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef973c-66fa-4773-8152-11b1e37f25d1 service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:14.787229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef973c-66fa-4773-8152-11b1e37f25d1 service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:14.787666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef973c-66fa-4773-8152-11b1e37f25d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:14.791446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-35ef973c-66fa-4773-8152-11b1e37f25d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:14.796070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc9027-f0e1-4e83-8a61-2abefcaa623b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:14.816961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:14.817992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:14.818390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:14.818867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] PATH_INFO: `/v3/users/2195842eae3b46c2b162c95387e3a48c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:14.822452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2195842eae3b46c2b162c95387e3a48c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:14.836202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:14.925732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef973c-66fa-4773-8152-11b1e37f25d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:14.928905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef973c-66fa-4773-8152-11b1e37f25d1 service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:14.953718 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3396/6820] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:14.954162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2195842eae3b46c2b162c95387e3a48c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.955002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2195842eae3b46c2b162c95387e3a48c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.955235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef973c-66fa-4773-8152-11b1e37f25d1 service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:14.962616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-35ef973c-66fa-4773-8152-11b1e37f25d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:14.972527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2195842eae3b46c2b162c95387e3a48c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.973983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2195842eae3b46c2b162c95387e3a48c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:14.998779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2195842eae3b46c2b162c95387e3a48c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.002622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef973c-66fa-4773-8152-11b1e37f25d1 service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:15.011180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:15.017682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:15.018099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:15.020708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] PATH_INFO: `/v3/users/c251175dddbe452383824587e9c6260b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:15.024055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c251175dddbe452383824587e9c6260b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:15.028373 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3425/6821] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:14 2022] DELETE /identity/v3/users/2195842eae3b46c2b162c95387e3a48c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:15.032999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:15.101274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:15.103709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:15.156848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c251175dddbe452383824587e9c6260b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.158881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c251175dddbe452383824587e9c6260b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.201337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c251175dddbe452383824587e9c6260b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.217116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c251175dddbe452383824587e9c6260b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.225766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c251175dddbe452383824587e9c6260b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.228680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:15.238271 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3397/6822] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:14 2022] DELETE /identity/v3/users/c251175dddbe452383824587e9c6260b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:15.245249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:15.297334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d75c8-ed87-4231-aa1f-0c44bff02185 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:15.378804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeb1d6-6c5e-489a-999a-2b382c3050d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:15.379529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeb1d6-6c5e-489a-999a-2b382c3050d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:15.379811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeb1d6-6c5e-489a-999a-2b382c3050d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:15.380731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeb1d6-6c5e-489a-999a-2b382c3050d7 admin admin] PATH_INFO: `/v3/users/42d2badcf1cb405e8294010d33ae6e7e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:15.381797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edeb1d6-6c5e-489a-999a-2b382c3050d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d2badcf1cb405e8294010d33ae6e7e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:15.384541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edeb1d6-6c5e-489a-999a-2b382c3050d7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:15.455780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8edeb1d6-6c5e-489a-999a-2b382c3050d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d2badcf1cb405e8294010d33ae6e7e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.456745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8edeb1d6-6c5e-489a-999a-2b382c3050d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d2badcf1cb405e8294010d33ae6e7e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.469369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:15.471332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:15.472398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8edeb1d6-6c5e-489a-999a-2b382c3050d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d2badcf1cb405e8294010d33ae6e7e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.473207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8edeb1d6-6c5e-489a-999a-2b382c3050d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d2badcf1cb405e8294010d33ae6e7e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.482065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8edeb1d6-6c5e-489a-999a-2b382c3050d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d2badcf1cb405e8294010d33ae6e7e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.500332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1967502-eda7-4d3a-b8a0-49b6f6c3698b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:15.510857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:15.511840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:15.512439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:15.512907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] PATH_INFO: `/v3/projects/3cf63fbbdb964dafa10d72e1369fe4a4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:15.515009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf63fbbdb964dafa10d72e1369fe4a4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:15.518199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:15.519775 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3426/6823] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:15 2022] DELETE /identity/v3/users/42d2badcf1cb405e8294010d33ae6e7e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:15.521577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fe4ec-8194-403b-9f47-7e7ef63bd085 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:15.522250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fe4ec-8194-403b-9f47-7e7ef63bd085 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:15.522732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fe4ec-8194-403b-9f47-7e7ef63bd085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:15.583588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4e0fe4ec-8194-403b-9f47-7e7ef63bd085 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:15.587240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4e0fe4ec-8194-403b-9f47-7e7ef63bd085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:15.588599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf63fbbdb964dafa10d72e1369fe4a4', 'request_id': 'req-027cde8c-8f72-4c11-8f6b-756a687044ed'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.596490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf63fbbdb964dafa10d72e1369fe4a4', 'request_id': 'req-027cde8c-8f72-4c11-8f6b-756a687044ed'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.606471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf63fbbdb964dafa10d72e1369fe4a4', 'request_id': 'req-027cde8c-8f72-4c11-8f6b-756a687044ed'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.619290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] The token cache is being invalidate because project 3cf63fbbdb964dafa10d72e1369fe4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:15.619596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.620617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-027cde8c-8f72-4c11-8f6b-756a687044ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:15.622598 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3398/6824] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:15 2022] DELETE /identity/v3/projects/3cf63fbbdb964dafa10d72e1369fe4a4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:15.626649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e568860-c5e5-4d1a-81c3-cf217565df7d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:15.627064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e568860-c5e5-4d1a-81c3-cf217565df7d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:15.627494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e568860-c5e5-4d1a-81c3-cf217565df7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:15.663979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3e568860-c5e5-4d1a-81c3-cf217565df7d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:15.665994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3e568860-c5e5-4d1a-81c3-cf217565df7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:15.672826 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3427/6825] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:15.683981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fe4ec-8194-403b-9f47-7e7ef63bd085 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:15.684282 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3399/6826] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:15.685832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4e0fe4ec-8194-403b-9f47-7e7ef63bd085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:15.693754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee644-f7c2-416d-b646-e4a8286531e9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:15.694346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee644-f7c2-416d-b646-e4a8286531e9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:15.694853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee644-f7c2-416d-b646-e4a8286531e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:15.697037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:15.724594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f86ee644-f7c2-416d-b646-e4a8286531e9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:15.725956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f86ee644-f7c2-416d-b646-e4a8286531e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:15.735735 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3400/6827] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:15.742089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ee644-f7c2-416d-b646-e4a8286531e9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:15.757931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ee644-f7c2-416d-b646-e4a8286531e9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:15.770332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bf0d5-5a56-4d5e-8f62-a5efc8e78b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:15.771254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bf0d5-5a56-4d5e-8f62-a5efc8e78b61 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:15.771725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bf0d5-5a56-4d5e-8f62-a5efc8e78b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:15.772315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bf0d5-5a56-4d5e-8f62-a5efc8e78b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:15.773123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bf0d5-5a56-4d5e-8f62-a5efc8e78b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:15.773600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bf0d5-5a56-4d5e-8f62-a5efc8e78b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:15.775634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bf0d5-5a56-4d5e-8f62-a5efc8e78b61 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:15.784720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fe4ec-8194-403b-9f47-7e7ef63bd085 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:15.792955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00f27-971e-4f3c-9703-678a8cf8b54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:15.793919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00f27-971e-4f3c-9703-678a8cf8b54a service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:15.797436 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3401/6828] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:15.797799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00f27-971e-4f3c-9703-678a8cf8b54a service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:15.798345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00f27-971e-4f3c-9703-678a8cf8b54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:15.799374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bf0d5-5a56-4d5e-8f62-a5efc8e78b61 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:15.814407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bf0d5-5a56-4d5e-8f62-a5efc8e78b61 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:15.814548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c00f27-971e-4f3c-9703-678a8cf8b54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:15.820262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574aa3e-07af-4f8b-9958-3b074c5558f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:15.821369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574aa3e-07af-4f8b-9958-3b074c5558f1 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:15.821723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574aa3e-07af-4f8b-9958-3b074c5558f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:15.821958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574aa3e-07af-4f8b-9958-3b074c5558f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:15.822598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574aa3e-07af-4f8b-9958-3b074c5558f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:15.825991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574aa3e-07af-4f8b-9958-3b074c5558f1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:15.831286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c00f27-971e-4f3c-9703-678a8cf8b54a service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:15.855314 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3428/6829] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:55:15.866100 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3402/6830] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:15 2022] POST /identity/v3/projects => generated 395 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:55:15.870265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00f27-971e-4f3c-9703-678a8cf8b54a service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:15.882198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00f27-971e-4f3c-9703-678a8cf8b54a service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:15.964536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97d5d-ae4c-4fc4-a8eb-0dcfb35d1f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:15.965285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97d5d-ae4c-4fc4-a8eb-0dcfb35d1f9e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:15.965683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97d5d-ae4c-4fc4-a8eb-0dcfb35d1f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:15.966149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97d5d-ae4c-4fc4-a8eb-0dcfb35d1f9e admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:15.966818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d97d5d-ae4c-4fc4-a8eb-0dcfb35d1f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:15.968907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d97d5d-ae4c-4fc4-a8eb-0dcfb35d1f9e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:16.001287 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3429/6831] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:15 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:16.009457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574aa3e-07af-4f8b-9958-3b074c5558f1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:16.018652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574aa3e-07af-4f8b-9958-3b074c5558f1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:16.034485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391548d-c6ff-4e2a-9ddf-061b8f11c5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:16.035401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391548d-c6ff-4e2a-9ddf-061b8f11c5ec admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.036869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391548d-c6ff-4e2a-9ddf-061b8f11c5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.037368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391548d-c6ff-4e2a-9ddf-061b8f11c5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.038234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391548d-c6ff-4e2a-9ddf-061b8f11c5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:16.047923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391548d-c6ff-4e2a-9ddf-061b8f11c5ec admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:16.063316 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3403/6832] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:16.067309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97d5d-ae4c-4fc4-a8eb-0dcfb35d1f9e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:16.085547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97d5d-ae4c-4fc4-a8eb-0dcfb35d1f9e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:16.095199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1a394-5bb1-41de-baca-dc6d37c029ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:16.095959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1a394-5bb1-41de-baca-dc6d37c029ae admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.096795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1a394-5bb1-41de-baca-dc6d37c029ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.097083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1a394-5bb1-41de-baca-dc6d37c029ae admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.109939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1a394-5bb1-41de-baca-dc6d37c029ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:16.111650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391548d-c6ff-4e2a-9ddf-061b8f11c5ec admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:16.113381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1a394-5bb1-41de-baca-dc6d37c029ae admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:16.115479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f391548d-c6ff-4e2a-9ddf-061b8f11c5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:16.141204 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3430/6833] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:16.145142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1a394-5bb1-41de-baca-dc6d37c029ae admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:16.158502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391548d-c6ff-4e2a-9ddf-061b8f11c5ec admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:16.169896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:16.170633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.170917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.171370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] PATH_INFO: `/v3/projects/ca11fbf398f64b11b799851df92e2f13` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.174367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca11fbf398f64b11b799851df92e2f13)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:16.176300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:16.185100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1a394-5bb1-41de-baca-dc6d37c029ae admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:16.199487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3167284-1b1f-4a3d-99dc-e2c4d29a58f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:16.200529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3167284-1b1f-4a3d-99dc-e2c4d29a58f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.201008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3167284-1b1f-4a3d-99dc-e2c4d29a58f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.215038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3167284-1b1f-4a3d-99dc-e2c4d29a58f9 admin admin] PATH_INFO: `/v3/projects/134ff9c642a949ec8b0798fb93d62b6c/users/c593697969d04e48a253b2db237299f4/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.267497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3167284-1b1f-4a3d-99dc-e2c4d29a58f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134ff9c642a949ec8b0798fb93d62b6c, user_id=c593697969d04e48a253b2db237299f4, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:16.280407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3167284-1b1f-4a3d-99dc-e2c4d29a58f9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:16.309757 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3431/6834] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:16 2022] PUT /identity/v3/projects/134ff9c642a949ec8b0798fb93d62b6c/users/c593697969d04e48a253b2db237299f4/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:16.318488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5108-dfa3-4ba7-9529-876a53a032ee None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.318849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5108-dfa3-4ba7-9529-876a53a032ee None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.319047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5108-dfa3-4ba7-9529-876a53a032ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.334241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca11fbf398f64b11b799851df92e2f13', 'request_id': 'req-f0234996-db70-4aaf-91a0-30f7188d7028'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:16.343369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca11fbf398f64b11b799851df92e2f13', 'request_id': 'req-f0234996-db70-4aaf-91a0-30f7188d7028'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:16.355814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca11fbf398f64b11b799851df92e2f13', 'request_id': 'req-f0234996-db70-4aaf-91a0-30f7188d7028'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:16.373589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e34f5108-dfa3-4ba7-9529-876a53a032ee None None] MFA Rules not processed for user `c593697969d04e48a253b2db237299f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:16.376984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e34f5108-dfa3-4ba7-9529-876a53a032ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:16.381747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] The token cache is being invalidate because project ca11fbf398f64b11b799851df92e2f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:16.382781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:16.385928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f0234996-db70-4aaf-91a0-30f7188d7028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:16.389223 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3404/6835] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:16 2022] DELETE /identity/v3/projects/ca11fbf398f64b11b799851df92e2f13 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:16.392527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408fa15-fabf-4535-b460-b2f8879fe2c2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.393094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408fa15-fabf-4535-b460-b2f8879fe2c2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.393742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408fa15-fabf-4535-b460-b2f8879fe2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.424310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:16.444105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2408fa15-fabf-4535-b460-b2f8879fe2c2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:16.447753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2408fa15-fabf-4535-b460-b2f8879fe2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:16.486506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:16.511948 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3432/6836] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:16.516254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f5108-dfa3-4ba7-9529-876a53a032ee None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:16.519663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e34f5108-dfa3-4ba7-9529-876a53a032ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:16.581734 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3405/6837] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:16.583883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c330ba-633d-4cd7-83dc-616d4d5e70ef None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.584393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c330ba-633d-4cd7-83dc-616d4d5e70ef None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.584770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c330ba-633d-4cd7-83dc-616d4d5e70ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.642549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-39c330ba-633d-4cd7-83dc-616d4d5e70ef None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:16.644534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-39c330ba-633d-4cd7-83dc-616d4d5e70ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:16.662679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f5108-dfa3-4ba7-9529-876a53a032ee None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:16.662955 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3406/6838] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:16.667531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c330ba-633d-4cd7-83dc-616d4d5e70ef None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:16.672578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e3eca-2686-4edd-85a0-f9912e492b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:16.672938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e3eca-2686-4edd-85a0-f9912e492b35 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.674329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e3eca-2686-4edd-85a0-f9912e492b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.674329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e3eca-2686-4edd-85a0-f9912e492b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.674329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e3eca-2686-4edd-85a0-f9912e492b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:16.676039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e3eca-2686-4edd-85a0-f9912e492b35 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:16.692168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c330ba-633d-4cd7-83dc-616d4d5e70ef None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:16.706110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18efd7-2ce3-4d65-8aa6-f2978cdb857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:16.709059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18efd7-2ce3-4d65-8aa6-f2978cdb857e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.709824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18efd7-2ce3-4d65-8aa6-f2978cdb857e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.710278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18efd7-2ce3-4d65-8aa6-f2978cdb857e admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.712415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18efd7-2ce3-4d65-8aa6-f2978cdb857e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:16.714168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18efd7-2ce3-4d65-8aa6-f2978cdb857e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:16.717805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18efd7-2ce3-4d65-8aa6-f2978cdb857e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:16.731795 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3433/6839] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:16 2022] POST /identity/v3/projects => generated 395 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:16.735934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e3eca-2686-4edd-85a0-f9912e492b35 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:16.759696 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3407/6840] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:55:16.761518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18efd7-2ce3-4d65-8aa6-f2978cdb857e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:16.788200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18efd7-2ce3-4d65-8aa6-f2978cdb857e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:16.902787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e3eca-2686-4edd-85a0-f9912e492b35 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:16.919043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed98a9-ca03-4783-bc8e-6b31c25e4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:16.919678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed98a9-ca03-4783-bc8e-6b31c25e4d03 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.919961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed98a9-ca03-4783-bc8e-6b31c25e4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.920242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed98a9-ca03-4783-bc8e-6b31c25e4d03 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.924146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed98a9-ca03-4783-bc8e-6b31c25e4d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:16.935540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed98a9-ca03-4783-bc8e-6b31c25e4d03 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:16.942529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fdbf5-077e-4c62-ad94-fdd346629810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:16.943315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fdbf5-077e-4c62-ad94-fdd346629810 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:16.943617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fdbf5-077e-4c62-ad94-fdd346629810 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:16.943898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fdbf5-077e-4c62-ad94-fdd346629810 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:16.944546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fdbf5-077e-4c62-ad94-fdd346629810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:16.950227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fdbf5-077e-4c62-ad94-fdd346629810 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:16.997662 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3434/6841] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:16 2022] POST /identity/v3/users => generated 304 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:16.999496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed98a9-ca03-4783-bc8e-6b31c25e4d03 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.002554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-56ed98a9-ca03-4783-bc8e-6b31c25e4d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:17.018071 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3408/6842] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:16 2022] POST /identity/v3/projects => generated 363 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:17.019008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fdbf5-077e-4c62-ad94-fdd346629810 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.035305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed98a9-ca03-4783-bc8e-6b31c25e4d03 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.120654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.122083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.122611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.123182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] PATH_INFO: `/v3/projects/59fd804f4fe749408e53b18802691a9d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.126414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=59fd804f4fe749408e53b18802691a9d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.128871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.144834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:17.161945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fdbf5-077e-4c62-ad94-fdd346629810 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.181771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf22b7-0f5e-46be-89be-2701b9143590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.183414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf22b7-0f5e-46be-89be-2701b9143590 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.183763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf22b7-0f5e-46be-89be-2701b9143590 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.184107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf22b7-0f5e-46be-89be-2701b9143590 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.184851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf22b7-0f5e-46be-89be-2701b9143590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.186772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf22b7-0f5e-46be-89be-2701b9143590 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.207746 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3409/6843] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:17.210934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf22b7-0f5e-46be-89be-2701b9143590 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.220005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59fd804f4fe749408e53b18802691a9d', 'request_id': 'req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:17.225852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf22b7-0f5e-46be-89be-2701b9143590 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.231321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59fd804f4fe749408e53b18802691a9d', 'request_id': 'req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:17.233422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:17.246015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59fd804f4fe749408e53b18802691a9d', 'request_id': 'req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:17.284309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] The token cache is being invalidate because project 59fd804f4fe749408e53b18802691a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:17.284602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:17.285318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:17.289517 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3435/6844] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:16 2022] DELETE /identity/v3/projects/59fd804f4fe749408e53b18802691a9d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:17.289517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.298351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:17.323947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6f495-0da0-41d8-95e0-11bf9736e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.324576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6f495-0da0-41d8-95e0-11bf9736e4cc admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.324859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6f495-0da0-41d8-95e0-11bf9736e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.325135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6f495-0da0-41d8-95e0-11bf9736e4cc admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.325820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6f495-0da0-41d8-95e0-11bf9736e4cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.327997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6f495-0da0-41d8-95e0-11bf9736e4cc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.375302 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3410/6845] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:17 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:17.376973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99e32-c0bf-4635-8aa6-6eb2c16e7922 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.377264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99e32-c0bf-4635-8aa6-6eb2c16e7922 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.377586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99e32-c0bf-4635-8aa6-6eb2c16e7922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.409845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-44a99e32-c0bf-4635-8aa6-6eb2c16e7922 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:17.412429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-44a99e32-c0bf-4635-8aa6-6eb2c16e7922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:17.416674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b8d56-e172-4cc9-b5ea-f4643d1c2fff admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.423199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec12274-fe40-4784-b4f0-956852452da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.424138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12274-fe40-4784-b4f0-956852452da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.424847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12274-fe40-4784-b4f0-956852452da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.425265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12274-fe40-4784-b4f0-956852452da6 admin admin] PATH_INFO: `/v3/projects/844b007673db4e1ba8a2867e541ba51e/users/615c39c504054e9ab2dd2e641403d748/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.430084 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3411/6846] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:17.433299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99e32-c0bf-4635-8aa6-6eb2c16e7922 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.436937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-44a99e32-c0bf-4635-8aa6-6eb2c16e7922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:17.452017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec12274-fe40-4784-b4f0-956852452da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844b007673db4e1ba8a2867e541ba51e, user_id=615c39c504054e9ab2dd2e641403d748, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.454262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99e32-c0bf-4635-8aa6-6eb2c16e7922 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.456017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec12274-fe40-4784-b4f0-956852452da6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.459706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0be89-c50c-4505-bd05-58cc2169fcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.460660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0be89-c50c-4505-bd05-58cc2169fcbb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.460944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0be89-c50c-4505-bd05-58cc2169fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.461228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0be89-c50c-4505-bd05-58cc2169fcbb admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.461948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0be89-c50c-4505-bd05-58cc2169fcbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.463587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0be89-c50c-4505-bd05-58cc2169fcbb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.477580 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3412/6847] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:17.480403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a5c6-13b0-4dfd-8052-999896da8435 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.480834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a5c6-13b0-4dfd-8052-999896da8435 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.481518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a5c6-13b0-4dfd-8052-999896da8435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.482346 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3436/6848] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:17 2022] PUT /identity/v3/projects/844b007673db4e1ba8a2867e541ba51e/users/615c39c504054e9ab2dd2e641403d748/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:17.483906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec12274-fe40-4784-b4f0-956852452da6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.507319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2c04a5c6-13b0-4dfd-8052-999896da8435 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:17.508804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2c04a5c6-13b0-4dfd-8052-999896da8435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:17.619369 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3413/6849] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:17.620749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a5c6-13b0-4dfd-8052-999896da8435 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.635898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a5c6-13b0-4dfd-8052-999896da8435 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.643154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d4bb-3afa-40e8-a747-873293356791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.645845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d4bb-3afa-40e8-a747-873293356791 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.646312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d4bb-3afa-40e8-a747-873293356791 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.646678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d4bb-3afa-40e8-a747-873293356791 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.647512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771d4bb-3afa-40e8-a747-873293356791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.652201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771d4bb-3afa-40e8-a747-873293356791 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.673291 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3414/6850] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:17.674434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d4bb-3afa-40e8-a747-873293356791 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.688948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d4bb-3afa-40e8-a747-873293356791 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.696565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0785de9-4556-464d-a78c-a1bb4b1260cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.697634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0785de9-4556-464d-a78c-a1bb4b1260cf admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.698632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0785de9-4556-464d-a78c-a1bb4b1260cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.699014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0785de9-4556-464d-a78c-a1bb4b1260cf admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.700181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0785de9-4556-464d-a78c-a1bb4b1260cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:17.700580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0785de9-4556-464d-a78c-a1bb4b1260cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.704010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0785de9-4556-464d-a78c-a1bb4b1260cf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.725845 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3415/6851] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:17.726934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0785de9-4556-464d-a78c-a1bb4b1260cf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.748331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0785de9-4556-464d-a78c-a1bb4b1260cf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.755144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78aa01-9132-4316-8368-544f1ed6acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.756250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78aa01-9132-4316-8368-544f1ed6acff admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.756250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78aa01-9132-4316-8368-544f1ed6acff admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.756595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78aa01-9132-4316-8368-544f1ed6acff admin admin] PATH_INFO: `/v3/projects/844b007673db4e1ba8a2867e541ba51e/users/615c39c504054e9ab2dd2e641403d748/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.759883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78aa01-9132-4316-8368-544f1ed6acff admin admin] RBAC: Authorizing `identity:create_grant(project_id=844b007673db4e1ba8a2867e541ba51e, user_id=615c39c504054e9ab2dd2e641403d748, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.763134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78aa01-9132-4316-8368-544f1ed6acff admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.774594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec12274-fe40-4784-b4f0-956852452da6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.795891 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3416/6852] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:17 2022] PUT /identity/v3/projects/844b007673db4e1ba8a2867e541ba51e/users/615c39c504054e9ab2dd2e641403d748/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:17.797343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78aa01-9132-4316-8368-544f1ed6acff admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:17.813969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ca6ab-9d33-4a11-a848-f0b46096be3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.815027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ca6ab-9d33-4a11-a848-f0b46096be3d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.815740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ca6ab-9d33-4a11-a848-f0b46096be3d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.816316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ca6ab-9d33-4a11-a848-f0b46096be3d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.817142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ca6ab-9d33-4a11-a848-f0b46096be3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.824588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ca6ab-9d33-4a11-a848-f0b46096be3d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:17.858729 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3437/6853] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:17.861188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaec85-e0a6-44ce-b5a5-b51c6960acc2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.863760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaec85-e0a6-44ce-b5a5-b51c6960acc2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.864645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaec85-e0a6-44ce-b5a5-b51c6960acc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.917941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-72aaec85-e0a6-44ce-b5a5-b51c6960acc2 None None] MFA Rules not processed for user `615c39c504054e9ab2dd2e641403d748`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:17.919765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-72aaec85-e0a6-44ce-b5a5-b51c6960acc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:17.922609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:17.930913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:17.956265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78aa01-9132-4316-8368-544f1ed6acff admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:17.965630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae4a1c-c316-44df-a596-335c8d5efba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:17.966265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae4a1c-c316-44df-a596-335c8d5efba0 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:17.967240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae4a1c-c316-44df-a596-335c8d5efba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:17.967527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae4a1c-c316-44df-a596-335c8d5efba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:17.968518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae4a1c-c316-44df-a596-335c8d5efba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:17.970843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae4a1c-c316-44df-a596-335c8d5efba0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:18.036162 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3417/6854] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:17 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:18.037646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae4a1c-c316-44df-a596-335c8d5efba0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:18.057495 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3438/6855] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:18.063323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaec85-e0a6-44ce-b5a5-b51c6960acc2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:18.083293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaec85-e0a6-44ce-b5a5-b51c6960acc2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:18.248490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b77e3-ae15-4484-9560-b765483a5637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:18.249168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b77e3-ae15-4484-9560-b765483a5637 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.249541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b77e3-ae15-4484-9560-b765483a5637 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.249834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b77e3-ae15-4484-9560-b765483a5637 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.250484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b77e3-ae15-4484-9560-b765483a5637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:18.252751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b77e3-ae15-4484-9560-b765483a5637 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:18.310043 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3439/6856] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:18 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:18.319455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b77e3-ae15-4484-9560-b765483a5637 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:18.326951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae4a1c-c316-44df-a596-335c8d5efba0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:18.336033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ae1b77e3-ae15-4484-9560-b765483a5637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:18.344036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bfc1-d395-4cc3-9451-67c72d5bfbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:18.344735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bfc1-d395-4cc3-9451-67c72d5bfbc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.345677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bfc1-d395-4cc3-9451-67c72d5bfbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.348050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bfc1-d395-4cc3-9451-67c72d5bfbc3 admin admin] PATH_INFO: `/v3/projects/0e8b377b9ce74ddea72691a59f640ce4/users/79aeb99784444848a52fb9145429da42/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.426747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bfc1-d395-4cc3-9451-67c72d5bfbc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8b377b9ce74ddea72691a59f640ce4, user_id=79aeb99784444848a52fb9145429da42, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:18.429885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bfc1-d395-4cc3-9451-67c72d5bfbc3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:18.470653 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3418/6857] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:18 2022] PUT /identity/v3/projects/0e8b377b9ce74ddea72691a59f640ce4/users/79aeb99784444848a52fb9145429da42/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:18.481962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bfc1-d395-4cc3-9451-67c72d5bfbc3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:18.497057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b77e3-ae15-4484-9560-b765483a5637 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:18.612662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:18.626151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bfc1-d395-4cc3-9451-67c72d5bfbc3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:18.637093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3834e0a-1d29-4101-b423-fa448f93da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:18.638663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3834e0a-1d29-4101-b423-fa448f93da99 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.639100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3834e0a-1d29-4101-b423-fa448f93da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.639657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3834e0a-1d29-4101-b423-fa448f93da99 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.648648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3834e0a-1d29-4101-b423-fa448f93da99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:18.650368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e7309-01db-472e-bc08-e2cae47d4d78 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c593697969d04e48a253b2db237299f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134ff9c642a949ec8b0798fb93d62b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:18.652610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e7309-01db-472e-bc08-e2cae47d4d78 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.653010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e7309-01db-472e-bc08-e2cae47d4d78 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.653720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e7309-01db-472e-bc08-e2cae47d4d78 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.656525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e7309-01db-472e-bc08-e2cae47d4d78 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:18.657754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3834e0a-1d29-4101-b423-fa448f93da99 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-705e7309-01db-472e-bc08-e2cae47d4d78 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Aug 29 15:55:18.670632 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 29 15:55:18.671956 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 29 15:55:18.671956 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 29 15:55:18.671956 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 29 15:55:18.671956 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 29 15:55:18.671956 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:55:18.671956 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 29 15:55:18.671956 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 29 15:55:18.671956 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:18.677952 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3440/6859] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:55:18 2022] POST /identity/v3/projects => generated 136 bytes in 367 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:55:18.678156 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3419/6859] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:18.681350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3834e0a-1d29-4101-b423-fa448f93da99 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:18.681517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538fe93-d82d-4945-9fdc-a23a28522810 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.681786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538fe93-d82d-4945-9fdc-a23a28522810 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.682076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538fe93-d82d-4945-9fdc-a23a28522810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.747765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d538fe93-d82d-4945-9fdc-a23a28522810 None None] MFA Rules not processed for user `79aeb99784444848a52fb9145429da42`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:18.749009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d538fe93-d82d-4945-9fdc-a23a28522810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:18.760197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:18.793012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3834e0a-1d29-4101-b423-fa448f93da99 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:18.808501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad2f0b-17c0-4b57-b3bc-37c86de6cb0c tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '615c39c504054e9ab2dd2e641403d748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '844b007673db4e1ba8a2867e541ba51e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:18.808880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad2f0b-17c0-4b57-b3bc-37c86de6cb0c tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.810612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad2f0b-17c0-4b57-b3bc-37c86de6cb0c tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.811329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad2f0b-17c0-4b57-b3bc-37c86de6cb0c tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.812687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad2f0b-17c0-4b57-b3bc-37c86de6cb0c tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:18.815911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad2f0b-17c0-4b57-b3bc-37c86de6cb0c tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-cdad2f0b-17c0-4b57-b3bc-37c86de6cb0c tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Invalid input for field 'name': '' is too short Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: Failed validating 'minLength' in schema['properties']['name']: Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: On instance['name']: Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: Failed validating 'minLength' in schema['properties']['name']: Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: On instance['name']: Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: '' Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise error Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application On instance['name']: Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application '' Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:55:18.826390 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 15:55:18.828076 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 15:55:18.828997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 15:55:18.828997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 29 15:55:18.828997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:55:18.828997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 29 15:55:18.828997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:55:18.828997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:55:18.828997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application On instance['name']: Aug 29 15:55:18.828997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application '' Aug 29 15:55:18.828997 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:55:18.832169 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3420/6860] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:55:18 2022] POST /identity/v3/projects => generated 283 bytes in 150 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 29 15:55:18.834694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad2f0b-17c0-4b57-b3bc-37c86de6cb0c tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:18.852676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad2f0b-17c0-4b57-b3bc-37c86de6cb0c tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:18.858218 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3441/6861] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:18.858218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538fe93-d82d-4945-9fdc-a23a28522810 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:18.863796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450a376-057b-4b4a-8e93-c94dddb71e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:18.864713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450a376-057b-4b4a-8e93-c94dddb71e9c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.865207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450a376-057b-4b4a-8e93-c94dddb71e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.866368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450a376-057b-4b4a-8e93-c94dddb71e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.867333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450a376-057b-4b4a-8e93-c94dddb71e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:18.869222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450a376-057b-4b4a-8e93-c94dddb71e9c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:18.872101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538fe93-d82d-4945-9fdc-a23a28522810 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:18.880809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781786a-438b-49c6-baaa-a0f3da4fbea0 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '615c39c504054e9ab2dd2e641403d748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '844b007673db4e1ba8a2867e541ba51e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:18.881898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781786a-438b-49c6-baaa-a0f3da4fbea0 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.882188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781786a-438b-49c6-baaa-a0f3da4fbea0 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.882475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781786a-438b-49c6-baaa-a0f3da4fbea0 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.883103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781786a-438b-49c6-baaa-a0f3da4fbea0 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:18.885326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781786a-438b-49c6-baaa-a0f3da4fbea0 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:18.888261 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3421/6862] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:18.888970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450a376-057b-4b4a-8e93-c94dddb71e9c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-1781786a-438b-49c6-baaa-a0f3da4fbea0 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: Failed validating 'maxLength' in schema['properties']['name']: Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: On instance['name']: Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: Failed validating 'maxLength' in schema['properties']['name']: Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: On instance['name']: Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise error Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 29 15:55:18.894144 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application On instance['name']: Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:55:18.895472 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application On instance['name']: Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:18.896592 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3442/6863] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:55:18 2022] POST /identity/v3/projects => generated 412 bytes in 40 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 15:55:18.897534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781786a-438b-49c6-baaa-a0f3da4fbea0 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:18.909984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450a376-057b-4b4a-8e93-c94dddb71e9c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:18.915532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781786a-438b-49c6-baaa-a0f3da4fbea0 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:18.915806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e9837-f727-4112-ad8b-2e567985c104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:18.916502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9837-f727-4112-ad8b-2e567985c104 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.916843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9837-f727-4112-ad8b-2e567985c104 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.917251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9837-f727-4112-ad8b-2e567985c104 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.917980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e9837-f727-4112-ad8b-2e567985c104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:18.920620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e9837-f727-4112-ad8b-2e567985c104 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:18.921985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55429f0-3d99-48e5-9372-4d762bf70e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:18.922723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55429f0-3d99-48e5-9372-4d762bf70e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.923072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55429f0-3d99-48e5-9372-4d762bf70e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.923417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55429f0-3d99-48e5-9372-4d762bf70e15 admin admin] PATH_INFO: `/v3/projects/cb512231bd1b4c2e9ce6a439e4585d9f/users/145d5a34b72a4037aefd1c8aeccc8adf/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:18.943349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55429f0-3d99-48e5-9372-4d762bf70e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb512231bd1b4c2e9ce6a439e4585d9f, user_id=145d5a34b72a4037aefd1c8aeccc8adf, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:18.946341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55429f0-3d99-48e5-9372-4d762bf70e15 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:18.963142 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3443/6864] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:18 2022] PUT /identity/v3/projects/cb512231bd1b4c2e9ce6a439e4585d9f/users/145d5a34b72a4037aefd1c8aeccc8adf/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:18.964687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55429f0-3d99-48e5-9372-4d762bf70e15 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:18.974469 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3422/6865] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:18 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:18.977229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68c0b-acba-4435-b47e-143077b3b720 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:18.978001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68c0b-acba-4435-b47e-143077b3b720 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:18.978276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68c0b-acba-4435-b47e-143077b3b720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.019602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b1f68c0b-acba-4435-b47e-143077b3b720 None None] MFA Rules not processed for user `145d5a34b72a4037aefd1c8aeccc8adf`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:19.021709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b1f68c0b-acba-4435-b47e-143077b3b720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:19.073146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55429f0-3d99-48e5-9372-4d762bf70e15 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.165305 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3423/6866] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:19.166405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f68c0b-acba-4435-b47e-143077b3b720 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.234353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1692d21-a781-47fa-8286-15b0235cc6ee tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '615c39c504054e9ab2dd2e641403d748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '844b007673db4e1ba8a2867e541ba51e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.235376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1692d21-a781-47fa-8286-15b0235cc6ee tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.236425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1692d21-a781-47fa-8286-15b0235cc6ee tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.236979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1692d21-a781-47fa-8286-15b0235cc6ee tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] PATH_INFO: `/v3/projects/c1d4154df3a84883b7a6e9b88f51f294` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.240406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:19.253286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1692d21-a781-47fa-8286-15b0235cc6ee tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c1d4154df3a84883b7a6e9b88f51f294)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.255545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1692d21-a781-47fa-8286-15b0235cc6ee tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.275982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f68c0b-acba-4435-b47e-143077b3b720 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-c1692d21-a781-47fa-8286-15b0235cc6ee tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Could not find project: c1d4154df3a84883b7a6e9b88f51f294.: keystone.exception.ProjectNotFound: Could not find project: c1d4154df3a84883b7a6e9b88f51f294. Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 29 15:55:19.281438 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 29 15:55:19.282598 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:55:19.282598 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:55:19.282598 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 29 15:55:19.282598 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 29 15:55:19.282598 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:55:19.282598 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:55:19.282598 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:55:19.282598 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:55:19.282598 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c1d4154df3a84883b7a6e9b88f51f294. Aug 29 15:55:19.282598 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:19.296241 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3444/6867] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:18 2022] DELETE /identity/v3/projects/c1d4154df3a84883b7a6e9b88f51f294 => generated 113 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:55:19.298378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1692d21-a781-47fa-8286-15b0235cc6ee tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.315566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1692d21-a781-47fa-8286-15b0235cc6ee tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.315750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c95a0-65a3-4068-be05-b5b7ad00a3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.316745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c95a0-65a3-4068-be05-b5b7ad00a3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.317931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c95a0-65a3-4068-be05-b5b7ad00a3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.322735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c95a0-65a3-4068-be05-b5b7ad00a3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.323495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713709-ac04-407e-9e2d-27f49ff54bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.324130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713709-ac04-407e-9e2d-27f49ff54bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.324407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c95a0-65a3-4068-be05-b5b7ad00a3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.324533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713709-ac04-407e-9e2d-27f49ff54bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.324677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713709-ac04-407e-9e2d-27f49ff54bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.325317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5713709-ac04-407e-9e2d-27f49ff54bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.327467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c95a0-65a3-4068-be05-b5b7ad00a3b8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.327599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5713709-ac04-407e-9e2d-27f49ff54bc7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.394185 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3445/6868] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:19 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:19.394406 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3424/6869] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:19 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:19.401025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c95a0-65a3-4068-be05-b5b7ad00a3b8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.403297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713709-ac04-407e-9e2d-27f49ff54bc7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.426825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c95a0-65a3-4068-be05-b5b7ad00a3b8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.551122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:19.585164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713709-ac04-407e-9e2d-27f49ff54bc7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.591726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a28a2-f718-4b14-bc39-e07f521d7809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.592346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af41e8e-0445-4e27-a481-36f4878a7354 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c593697969d04e48a253b2db237299f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134ff9c642a949ec8b0798fb93d62b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.593106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a28a2-f718-4b14-bc39-e07f521d7809 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.593286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af41e8e-0445-4e27-a481-36f4878a7354 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.593716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af41e8e-0445-4e27-a481-36f4878a7354 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.593831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a28a2-f718-4b14-bc39-e07f521d7809 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.594250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a28a2-f718-4b14-bc39-e07f521d7809 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.594590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af41e8e-0445-4e27-a481-36f4878a7354 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.595197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a28a2-f718-4b14-bc39-e07f521d7809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.595518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af41e8e-0445-4e27-a481-36f4878a7354 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] RBAC: Authorizing `identity:list_projects()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.597300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a28a2-f718-4b14-bc39-e07f521d7809 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-6af41e8e-0445-4e27-a481-36f4878a7354 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Aug 29 15:55:19.607186 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._list_projects() Aug 29 15:55:19.608242 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Aug 29 15:55:19.608242 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Aug 29 15:55:19.608242 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 29 15:55:19.608242 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 29 15:55:19.608242 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 29 15:55:19.608242 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 29 15:55:19.608242 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:55:19.608242 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 29 15:55:19.608242 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 29 15:55:19.608242 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:19.621520 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3446/6870] 10.222.0.16 () {58 vars in 1131 bytes} [Mon Aug 29 15:55:19 2022] GET /identity/v3/projects => generated 135 bytes in 220 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:55:19.621520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af41e8e-0445-4e27-a481-36f4878a7354 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.621832 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3425/6871] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:19.621832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a28a2-f718-4b14-bc39-e07f521d7809 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.637313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af41e8e-0445-4e27-a481-36f4878a7354 tempest-ProjectsNegativeStaticTestJSON-709147684 tempest-ProjectsNegativeStaticTestJSON-709147684-project] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.642969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7245b4-1776-4239-bfd7-266e3420fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.643574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7245b4-1776-4239-bfd7-266e3420fa12 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.643855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7245b4-1776-4239-bfd7-266e3420fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.644714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7245b4-1776-4239-bfd7-266e3420fa12 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.645372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7245b4-1776-4239-bfd7-266e3420fa12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.647858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7245b4-1776-4239-bfd7-266e3420fa12 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.690032 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3447/6872] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:19 2022] POST /identity/v3/users => generated 294 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:19.691327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7245b4-1776-4239-bfd7-266e3420fa12 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.703509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7245b4-1776-4239-bfd7-266e3420fa12 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.729163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a5f03-7c86-40f1-9acd-7e1c12f497f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.730402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a5f03-7c86-40f1-9acd-7e1c12f497f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.730968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a28a2-f718-4b14-bc39-e07f521d7809 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.734196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a5f03-7c86-40f1-9acd-7e1c12f497f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.735872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a5f03-7c86-40f1-9acd-7e1c12f497f7 admin admin] PATH_INFO: `/v3/projects/6874652370ba4ed5840e37db96913023/users/22234176fe0d4d88adde9ab8188cd6b8/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.740841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f22f3-d7d0-458c-9370-c5c1a6feff04 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '615c39c504054e9ab2dd2e641403d748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '844b007673db4e1ba8a2867e541ba51e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.741598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f22f3-d7d0-458c-9370-c5c1a6feff04 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.741884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f22f3-d7d0-458c-9370-c5c1a6feff04 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.745102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f22f3-d7d0-458c-9370-c5c1a6feff04 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.746439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f22f3-d7d0-458c-9370-c5c1a6feff04 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.748354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f22f3-d7d0-458c-9370-c5c1a6feff04 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.764751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a5f03-7c86-40f1-9acd-7e1c12f497f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6874652370ba4ed5840e37db96913023, user_id=22234176fe0d4d88adde9ab8188cd6b8, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.769900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a5f03-7c86-40f1-9acd-7e1c12f497f7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:19.794593 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3426/6873] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:19 2022] POST /identity/v3/projects => generated 357 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:19.795741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f22f3-d7d0-458c-9370-c5c1a6feff04 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.824729 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3448/6874] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:19 2022] PUT /identity/v3/projects/6874652370ba4ed5840e37db96913023/users/22234176fe0d4d88adde9ab8188cd6b8/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:19.825344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a5f03-7c86-40f1-9acd-7e1c12f497f7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:19.926637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f22f3-d7d0-458c-9370-c5c1a6feff04 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.956425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a5f03-7c86-40f1-9acd-7e1c12f497f7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:19.966242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f90b0-24dc-4b65-989b-a2f27033e628 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '615c39c504054e9ab2dd2e641403d748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '844b007673db4e1ba8a2867e541ba51e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:19.967402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f90b0-24dc-4b65-989b-a2f27033e628 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:19.968149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f90b0-24dc-4b65-989b-a2f27033e628 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:19.968579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f90b0-24dc-4b65-989b-a2f27033e628 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:19.969827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f90b0-24dc-4b65-989b-a2f27033e628 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:19.972682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f90b0-24dc-4b65-989b-a2f27033e628 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.016404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.sql.core [None req-502f90b0-24dc-4b65-989b-a2f27033e628 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-70070576' for key 'project.ixu_project_name_domain_id'") Aug 29 15:55:20.016404 n-d-854882-3 devstack@keystone.service[89681]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 15:55:20.016404 n-d-854882-3 devstack@keystone.service[89681]: [parameters: {'id': '8cc24c5792844aee8920fa54a6a4628d', 'name': 'tempest-project-dup-70070576', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 15:55:20.016404 n-d-854882-3 devstack@keystone.service[89681]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89681) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 15:55:20.028924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a574d6-d06f-40f0-a598-a4214682ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:20.029752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a574d6-d06f-40f0-a598-a4214682ef92 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.030140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a574d6-d06f-40f0-a598-a4214682ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.030507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a574d6-d06f-40f0-a598-a4214682ef92 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.031252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a574d6-d06f-40f0-a598-a4214682ef92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:20.033123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a574d6-d06f-40f0-a598-a4214682ef92 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-502f90b0-24dc-4b65-989b-a2f27033e628 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-70070576, project id 8cc24c5792844aee8920fa54a6a4628d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-70070576, project id 8cc24c5792844aee8920fa54a6a4628d. Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:55:20.042488 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application result.read() Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-70070576' for key 'project.ixu_project_name_domain_id'") Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 15:55:20.043583 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application yield resource Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise self.value Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 15:55:20.044971 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application session.commit() Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.session.flush() Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application compat.raise_( Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 15:55:20.046080 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 15:55:20.047921 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application conn.query(q) Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application result.read() Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:55:20.049142 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-70070576' for key 'project.ixu_project_name_domain_id'") Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [parameters: {'id': '8cc24c5792844aee8920fa54a6a4628d', 'name': 'tempest-project-dup-70070576', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:20.050416 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-70070576 at domain ID default. Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:55:20.051426 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:55:20.052470 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:55:20.052470 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 15:55:20.052470 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 15:55:20.052470 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:55:20.052470 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:55:20.052470 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 15:55:20.052470 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 15:55:20.052470 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-70070576, project id 8cc24c5792844aee8920fa54a6a4628d. Aug 29 15:55:20.052470 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:55:20.055388 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3449/6875] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:55:19 2022] POST /identity/v3/projects => generated 283 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 15:55:20.056789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f90b0-24dc-4b65-989b-a2f27033e628 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:20.068694 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3427/6876] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:20.070228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a574d6-d06f-40f0-a598-a4214682ef92 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:20.076907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f90b0-24dc-4b65-989b-a2f27033e628 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:20.081765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:20.091531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e26f3a-5fde-4183-968d-b6a92ef60750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:20.092788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26f3a-5fde-4183-968d-b6a92ef60750 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.093503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26f3a-5fde-4183-968d-b6a92ef60750 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.094173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26f3a-5fde-4183-968d-b6a92ef60750 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.095184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e26f3a-5fde-4183-968d-b6a92ef60750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:20.098577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e26f3a-5fde-4183-968d-b6a92ef60750 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.099164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a574d6-d06f-40f0-a598-a4214682ef92 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:20.106581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '615c39c504054e9ab2dd2e641403d748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '844b007673db4e1ba8a2867e541ba51e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:20.107242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.107527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.107810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] PATH_INFO: `/v3/projects/9f9357d34dd54ff090194014346aaef9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.109158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9f9357d34dd54ff090194014346aaef9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:20.111440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.118833 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3450/6877] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:20.120170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e26f3a-5fde-4183-968d-b6a92ef60750 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:20.131978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e26f3a-5fde-4183-968d-b6a92ef60750 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:20.137731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca9b7e-4213-4f4a-9ef4-a3fba9a1adf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:20.138681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca9b7e-4213-4f4a-9ef4-a3fba9a1adf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.139149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca9b7e-4213-4f4a-9ef4-a3fba9a1adf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.139609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca9b7e-4213-4f4a-9ef4-a3fba9a1adf2 admin admin] PATH_INFO: `/v3/projects/236b35f2542c404f88f5888eaf38314d/users/f1fe53baadd84c4c8717ffc81713048e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.187885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:20.191357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9357d34dd54ff090194014346aaef9', 'request_id': 'req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:20.199580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca9b7e-4213-4f4a-9ef4-a3fba9a1adf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236b35f2542c404f88f5888eaf38314d, user_id=f1fe53baadd84c4c8717ffc81713048e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:20.207487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca9b7e-4213-4f4a-9ef4-a3fba9a1adf2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.208759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9357d34dd54ff090194014346aaef9', 'request_id': 'req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:20.218901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9357d34dd54ff090194014346aaef9', 'request_id': 'req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:20.223461 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3451/6878] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:20 2022] PUT /identity/v3/projects/236b35f2542c404f88f5888eaf38314d/users/f1fe53baadd84c4c8717ffc81713048e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:20.224380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca9b7e-4213-4f4a-9ef4-a3fba9a1adf2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:20.249803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] The token cache is being invalidate because project 9f9357d34dd54ff090194014346aaef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:20.250107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:20.251984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:20.258820 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3428/6879] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:20 2022] DELETE /identity/v3/projects/9f9357d34dd54ff090194014346aaef9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:20.258820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:20.258820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:20.367057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca9b7e-4213-4f4a-9ef4-a3fba9a1adf2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:20.384775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3135810-98f8-4ef8-8297-833ff04099be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:20.386530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3135810-98f8-4ef8-8297-833ff04099be admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.386884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3135810-98f8-4ef8-8297-833ff04099be admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.401259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3135810-98f8-4ef8-8297-833ff04099be admin admin] PATH_INFO: `/v3/projects/6874652370ba4ed5840e37db96913023/users/22234176fe0d4d88adde9ab8188cd6b8/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.402339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71435f0-1c3c-4ef8-8237-ad637d63e6a4 tempest-ProjectsNegativeStaticTestJSON-426598563 tempest-ProjectsNegativeStaticTestJSON-426598563-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:20.403396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3135810-98f8-4ef8-8297-833ff04099be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6874652370ba4ed5840e37db96913023, user_id=22234176fe0d4d88adde9ab8188cd6b8, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:20.406222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3135810-98f8-4ef8-8297-833ff04099be admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.414265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf303da-5d11-4a5e-a3cd-901391adcf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:20.415435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf303da-5d11-4a5e-a3cd-901391adcf3f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.416269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf303da-5d11-4a5e-a3cd-901391adcf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.417042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf303da-5d11-4a5e-a3cd-901391adcf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.417988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf303da-5d11-4a5e-a3cd-901391adcf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:20.420117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf303da-5d11-4a5e-a3cd-901391adcf3f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.425825 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3452/6880] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:20 2022] PUT /identity/v3/projects/6874652370ba4ed5840e37db96913023/users/22234176fe0d4d88adde9ab8188cd6b8/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:20.426688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3135810-98f8-4ef8-8297-833ff04099be admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:20.437366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a3135810-98f8-4ef8-8297-833ff04099be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:20.446612 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3429/6881] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:20.448765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25981384-51b7-4f56-9877-ba784271ac9a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.449062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25981384-51b7-4f56-9877-ba784271ac9a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.449379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25981384-51b7-4f56-9877-ba784271ac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.491618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-25981384-51b7-4f56-9877-ba784271ac9a None None] MFA Rules not processed for user `22234176fe0d4d88adde9ab8188cd6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:20.492957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-25981384-51b7-4f56-9877-ba784271ac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:20.582755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3135810-98f8-4ef8-8297-833ff04099be admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:20.588396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287616e-e465-49bb-b421-00883203de2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:20.589041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287616e-e465-49bb-b421-00883203de2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.589321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287616e-e465-49bb-b421-00883203de2c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.589611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287616e-e465-49bb-b421-00883203de2c admin admin] PATH_INFO: `/v3/users/c593697969d04e48a253b2db237299f4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.591420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287616e-e465-49bb-b421-00883203de2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c593697969d04e48a253b2db237299f4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:20.593344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287616e-e465-49bb-b421-00883203de2c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.675932 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3430/6882] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:20.676864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25981384-51b7-4f56-9877-ba784271ac9a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:20.715403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2287616e-e465-49bb-b421-00883203de2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c593697969d04e48a253b2db237299f4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:20.717188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25981384-51b7-4f56-9877-ba784271ac9a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:20.718261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2287616e-e465-49bb-b421-00883203de2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c593697969d04e48a253b2db237299f4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:20.734509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d689e6-01f2-4c4c-bdf3-0d9e3f6b0a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:20.735258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d689e6-01f2-4c4c-bdf3-0d9e3f6b0a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.735534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d689e6-01f2-4c4c-bdf3-0d9e3f6b0a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.735808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d689e6-01f2-4c4c-bdf3-0d9e3f6b0a4f admin admin] PATH_INFO: `/v3/projects/236b35f2542c404f88f5888eaf38314d/users/f1fe53baadd84c4c8717ffc81713048e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.741657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d689e6-01f2-4c4c-bdf3-0d9e3f6b0a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=236b35f2542c404f88f5888eaf38314d, user_id=f1fe53baadd84c4c8717ffc81713048e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:20.744352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d689e6-01f2-4c4c-bdf3-0d9e3f6b0a4f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:20.751579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:20.753510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2287616e-e465-49bb-b421-00883203de2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c593697969d04e48a253b2db237299f4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:20.754828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2287616e-e465-49bb-b421-00883203de2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c593697969d04e48a253b2db237299f4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:20.769496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2287616e-e465-49bb-b421-00883203de2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c593697969d04e48a253b2db237299f4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:20.782076 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3431/6883] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:20 2022] PUT /identity/v3/projects/236b35f2542c404f88f5888eaf38314d/users/f1fe53baadd84c4c8717ffc81713048e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:20.783519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d689e6-01f2-4c4c-bdf3-0d9e3f6b0a4f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:20.792599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-90d689e6-01f2-4c4c-bdf3-0d9e3f6b0a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:20.809522 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3453/6884] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:20 2022] DELETE /identity/v3/users/c593697969d04e48a253b2db237299f4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:20.811328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884337b8-ab14-42ac-8023-34523b05827f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:20.811823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884337b8-ab14-42ac-8023-34523b05827f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:20.812349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884337b8-ab14-42ac-8023-34523b05827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:20.824421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:20.875185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-884337b8-ab14-42ac-8023-34523b05827f None None] MFA Rules not processed for user `f1fe53baadd84c4c8717ffc81713048e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:20.876531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-884337b8-ab14-42ac-8023-34523b05827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:20.996128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d689e6-01f2-4c4c-bdf3-0d9e3f6b0a4f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:21.020651 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3454/6885] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:21.020651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123a422-330c-4c69-b8dc-e238731034e5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:21.020651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123a422-330c-4c69-b8dc-e238731034e5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:21.020651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123a422-330c-4c69-b8dc-e238731034e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:21.063795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4123a422-330c-4c69-b8dc-e238731034e5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:21.065900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4123a422-330c-4c69-b8dc-e238731034e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:21.109475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d2b22-8d63-4eca-9865-1691734ea049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:21.110583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2b22-8d63-4eca-9865-1691734ea049 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:21.111029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2b22-8d63-4eca-9865-1691734ea049 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:21.111860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2b22-8d63-4eca-9865-1691734ea049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:21.114068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e82d2b22-8d63-4eca-9865-1691734ea049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:21.242897 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3455/6886] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:21.242897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123a422-330c-4c69-b8dc-e238731034e5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:21.243979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4123a422-330c-4c69-b8dc-e238731034e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:21.281457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d2b22-8d63-4eca-9865-1691734ea049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:21.296408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d2b22-8d63-4eca-9865-1691734ea049 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:21.339621 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3432/6887] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:21.340630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d2b22-8d63-4eca-9865-1691734ea049 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:21.344366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e82d2b22-8d63-4eca-9865-1691734ea049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:21.380877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123a422-330c-4c69-b8dc-e238731034e5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:21.386536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bcd27-36f4-44ff-88a2-66e11b468460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:21.389107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bcd27-36f4-44ff-88a2-66e11b468460 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:21.389415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bcd27-36f4-44ff-88a2-66e11b468460 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:21.389701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bcd27-36f4-44ff-88a2-66e11b468460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:21.427696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bcd27-36f4-44ff-88a2-66e11b468460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:21.432096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bcd27-36f4-44ff-88a2-66e11b468460 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:21.446035 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3456/6888] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:21.467580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d2b22-8d63-4eca-9865-1691734ea049 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:21.475528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74e1d-be07-4910-b570-b7eceb24b064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:21.477122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74e1d-be07-4910-b570-b7eceb24b064 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:21.477529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74e1d-be07-4910-b570-b7eceb24b064 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:21.477936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74e1d-be07-4910-b570-b7eceb24b064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:21.482171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bcd27-36f4-44ff-88a2-66e11b468460 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:21.486523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:21.493852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf74e1d-be07-4910-b570-b7eceb24b064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:21.495911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf74e1d-be07-4910-b570-b7eceb24b064 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:21.501566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bcd27-36f4-44ff-88a2-66e11b468460 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:21.511448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8472d2-9c13-49fa-b039-6ccd9102e62e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:21.512161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8472d2-9c13-49fa-b039-6ccd9102e62e service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:21.512508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8472d2-9c13-49fa-b039-6ccd9102e62e service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:21.513977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8472d2-9c13-49fa-b039-6ccd9102e62e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:21.516368 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3433/6889] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:21.517914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ac8472d2-9c13-49fa-b039-6ccd9102e62e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:21.577546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:21.629653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8472d2-9c13-49fa-b039-6ccd9102e62e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:21.631348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8472d2-9c13-49fa-b039-6ccd9102e62e service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:21.658911 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3457/6890] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:55:21.900685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74e1d-be07-4910-b570-b7eceb24b064 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:21.903183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ebf74e1d-be07-4910-b570-b7eceb24b064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:21.923152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74e1d-be07-4910-b570-b7eceb24b064 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:21.930465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:21.931258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:21.931682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:21.932057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] PATH_INFO: `/v3/projects/134ff9c642a949ec8b0798fb93d62b6c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:21.934209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=134ff9c642a949ec8b0798fb93d62b6c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:21.936548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:22.017106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134ff9c642a949ec8b0798fb93d62b6c', 'request_id': 'req-60d65897-3061-45ad-9457-a6f7c783e0ef'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:22.024339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134ff9c642a949ec8b0798fb93d62b6c', 'request_id': 'req-60d65897-3061-45ad-9457-a6f7c783e0ef'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:22.032603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134ff9c642a949ec8b0798fb93d62b6c', 'request_id': 'req-60d65897-3061-45ad-9457-a6f7c783e0ef'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:22.048696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] The token cache is being invalidate because project 134ff9c642a949ec8b0798fb93d62b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:22.048696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:22.049342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:22.051369 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3434/6891] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:21 2022] DELETE /identity/v3/projects/134ff9c642a949ec8b0798fb93d62b6c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:22.055077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8472d2-9c13-49fa-b039-6ccd9102e62e service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:22.067881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8472d2-9c13-49fa-b039-6ccd9102e62e service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:22.133879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db9872-4cfc-47af-99db-ee996202b762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:22.134626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db9872-4cfc-47af-99db-ee996202b762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:22.134906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db9872-4cfc-47af-99db-ee996202b762 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:22.135179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db9872-4cfc-47af-99db-ee996202b762 admin admin] PATH_INFO: `/v3/users/615c39c504054e9ab2dd2e641403d748` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:22.136394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db9872-4cfc-47af-99db-ee996202b762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=615c39c504054e9ab2dd2e641403d748)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:22.138439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db9872-4cfc-47af-99db-ee996202b762 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:22.211342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73db9872-4cfc-47af-99db-ee996202b762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '615c39c504054e9ab2dd2e641403d748'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:22.212333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73db9872-4cfc-47af-99db-ee996202b762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '615c39c504054e9ab2dd2e641403d748'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:22.236406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73db9872-4cfc-47af-99db-ee996202b762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '615c39c504054e9ab2dd2e641403d748'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:22.237339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73db9872-4cfc-47af-99db-ee996202b762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '615c39c504054e9ab2dd2e641403d748'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:22.246419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-73db9872-4cfc-47af-99db-ee996202b762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '615c39c504054e9ab2dd2e641403d748'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:22.291140 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3458/6892] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:22 2022] DELETE /identity/v3/users/615c39c504054e9ab2dd2e641403d748 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:23.209332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:23.214954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:23.231988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65897-3061-45ad-9457-a6f7c783e0ef admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:23.354886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:23.355457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:23.355907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:23.356334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] PATH_INFO: `/v3/projects/844b007673db4e1ba8a2867e541ba51e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:23.358152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=844b007673db4e1ba8a2867e541ba51e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:23.360408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:23.424228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844b007673db4e1ba8a2867e541ba51e', 'request_id': 'req-1ed0a7fa-d9e6-455b-8c55-43992f424653'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:23.430355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844b007673db4e1ba8a2867e541ba51e', 'request_id': 'req-1ed0a7fa-d9e6-455b-8c55-43992f424653'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:23.442625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844b007673db4e1ba8a2867e541ba51e', 'request_id': 'req-1ed0a7fa-d9e6-455b-8c55-43992f424653'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:23.459955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] The token cache is being invalidate because project 844b007673db4e1ba8a2867e541ba51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:23.460655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:23.461847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1ed0a7fa-d9e6-455b-8c55-43992f424653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:23.471457 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3435/6893] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:23 2022] DELETE /identity/v3/projects/844b007673db4e1ba8a2867e541ba51e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:23.473137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc1d39-ab33-4915-aaa9-b4bb295d7d2c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:23.474227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc1d39-ab33-4915-aaa9-b4bb295d7d2c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:23.474893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc1d39-ab33-4915-aaa9-b4bb295d7d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:23.523165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3edc1d39-ab33-4915-aaa9-b4bb295d7d2c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:23.527119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3edc1d39-ab33-4915-aaa9-b4bb295d7d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:23.658837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:23.669785 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3459/6894] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:23.679403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4bcc2-ca9e-4323-ba29-6e17c94f322d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:23.679403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4bcc2-ca9e-4323-ba29-6e17c94f322d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:23.679666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4bcc2-ca9e-4323-ba29-6e17c94f322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:23.702253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:23.708826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-65c4bcc2-ca9e-4323-ba29-6e17c94f322d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:23.710901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-65c4bcc2-ca9e-4323-ba29-6e17c94f322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:23.722293 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3436/6895] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:23.726240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc1d39-ab33-4915-aaa9-b4bb295d7d2c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:23.742530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc1d39-ab33-4915-aaa9-b4bb295d7d2c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:23.756989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24820de2-665a-4aed-882b-ad0e458df176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:23.757982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24820de2-665a-4aed-882b-ad0e458df176 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:23.758221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24820de2-665a-4aed-882b-ad0e458df176 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:23.758500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24820de2-665a-4aed-882b-ad0e458df176 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:23.759179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24820de2-665a-4aed-882b-ad0e458df176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:23.759488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24820de2-665a-4aed-882b-ad0e458df176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:23.765519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24820de2-665a-4aed-882b-ad0e458df176 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:23.798494 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3460/6896] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:23.799644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4bcc2-ca9e-4323-ba29-6e17c94f322d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:23.813298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4bcc2-ca9e-4323-ba29-6e17c94f322d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:23.827090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c477825-be59-48da-874c-1ff8aeadbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:23.827731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c477825-be59-48da-874c-1ff8aeadbcfe admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:23.828017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c477825-be59-48da-874c-1ff8aeadbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:23.828442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c477825-be59-48da-874c-1ff8aeadbcfe admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:23.829114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c477825-be59-48da-874c-1ff8aeadbcfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:23.831074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c477825-be59-48da-874c-1ff8aeadbcfe admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:23.894072 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3437/6897] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:23 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:23.895788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24820de2-665a-4aed-882b-ad0e458df176 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:23.911829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24820de2-665a-4aed-882b-ad0e458df176 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:24.045776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607b863-190c-4ea6-9294-0412a6c67dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:24.046572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b863-190c-4ea6-9294-0412a6c67dba admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.047331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b863-190c-4ea6-9294-0412a6c67dba admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.047659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b863-190c-4ea6-9294-0412a6c67dba admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:24.048548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607b863-190c-4ea6-9294-0412a6c67dba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:24.051288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607b863-190c-4ea6-9294-0412a6c67dba admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:24.089876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3461/6898] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:23 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:24.091404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c477825-be59-48da-874c-1ff8aeadbcfe admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:24.111102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c477825-be59-48da-874c-1ff8aeadbcfe admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:24.124246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2aaf8-0294-494d-bafb-6d2099d4f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:24.125151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2aaf8-0294-494d-bafb-6d2099d4f5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.125628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2aaf8-0294-494d-bafb-6d2099d4f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.126056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2aaf8-0294-494d-bafb-6d2099d4f5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:24.127086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2aaf8-0294-494d-bafb-6d2099d4f5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:24.129041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2aaf8-0294-494d-bafb-6d2099d4f5f0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:24.154787 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3438/6899] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:24.155759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607b863-190c-4ea6-9294-0412a6c67dba admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:24.168700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607b863-190c-4ea6-9294-0412a6c67dba admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:24.190781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37f31a-4bbd-4db4-97ef-d8a0e50f1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:24.191422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37f31a-4bbd-4db4-97ef-d8a0e50f1ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.191800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37f31a-4bbd-4db4-97ef-d8a0e50f1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.192105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37f31a-4bbd-4db4-97ef-d8a0e50f1ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:24.193352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37f31a-4bbd-4db4-97ef-d8a0e50f1ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:24.195633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37f31a-4bbd-4db4-97ef-d8a0e50f1ac9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:24.211730 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3462/6900] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:55:24.215661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2aaf8-0294-494d-bafb-6d2099d4f5f0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:24.230830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2aaf8-0294-494d-bafb-6d2099d4f5f0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:24.247854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db8d06-cdeb-4e8f-9e73-4c3078b8d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:24.248541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db8d06-cdeb-4e8f-9e73-4c3078b8d287 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.248823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db8d06-cdeb-4e8f-9e73-4c3078b8d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.249097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db8d06-cdeb-4e8f-9e73-4c3078b8d287 admin admin] PATH_INFO: `/v3/projects/ce73b94849b9401ebbe60f02fe35a583/users/d98b52fa91aa44658c55981f892716e1/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:24.282349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db8d06-cdeb-4e8f-9e73-4c3078b8d287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce73b94849b9401ebbe60f02fe35a583, user_id=d98b52fa91aa44658c55981f892716e1, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:24.285068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db8d06-cdeb-4e8f-9e73-4c3078b8d287 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:24.312907 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3439/6901] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:24 2022] PUT /identity/v3/projects/ce73b94849b9401ebbe60f02fe35a583/users/d98b52fa91aa44658c55981f892716e1/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:24.324242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b850202-e245-4773-a75b-364410893b08 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.324616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b850202-e245-4773-a75b-364410893b08 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.324998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b850202-e245-4773-a75b-364410893b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:24.382795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7b850202-e245-4773-a75b-364410893b08 None None] MFA Rules not processed for user `d98b52fa91aa44658c55981f892716e1`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:24.393117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7b850202-e245-4773-a75b-364410893b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:24.547863 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3463/6902] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:24.549259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db8d06-cdeb-4e8f-9e73-4c3078b8d287 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:24.564124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db8d06-cdeb-4e8f-9e73-4c3078b8d287 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:24.579115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a557ad9-85be-4aa3-8932-c8579efcab45 tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98b52fa91aa44658c55981f892716e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce73b94849b9401ebbe60f02fe35a583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:24.580596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a557ad9-85be-4aa3-8932-c8579efcab45 tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.583058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a557ad9-85be-4aa3-8932-c8579efcab45 tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.586097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a557ad9-85be-4aa3-8932-c8579efcab45 tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] PATH_INFO: `/v3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:24.592755 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3440/6903] 10.222.0.16 () {58 vars in 1104 bytes} [Mon Aug 29 15:55:24 2022] GET /identity/v3 => generated 255 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:55:24.598214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b850202-e245-4773-a75b-364410893b08 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:24.610048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b850202-e245-4773-a75b-364410893b08 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:24.624254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b424bce-f310-4066-8063-3d5a9191239d tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98b52fa91aa44658c55981f892716e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce73b94849b9401ebbe60f02fe35a583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:24.624792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424bce-f310-4066-8063-3d5a9191239d tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.625078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424bce-f310-4066-8063-3d5a9191239d tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.625443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424bce-f310-4066-8063-3d5a9191239d tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] PATH_INFO: `/v3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:24.636311 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3464/6904] 10.222.0.16 () {58 vars in 1104 bytes} [Mon Aug 29 15:55:24 2022] GET /identity/v3 => generated 255 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:24.637756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a557ad9-85be-4aa3-8932-c8579efcab45 tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:24.671213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a557ad9-85be-4aa3-8932-c8579efcab45 tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:24.685964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a40d02-084d-4f27-ab8f-de4da52cefe5 tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98b52fa91aa44658c55981f892716e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce73b94849b9401ebbe60f02fe35a583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:24.688087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40d02-084d-4f27-ab8f-de4da52cefe5 tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.688087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40d02-084d-4f27-ab8f-de4da52cefe5 tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.688087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40d02-084d-4f27-ab8f-de4da52cefe5 tempest-TestApiDiscovery-15228290 tempest-TestApiDiscovery-15228290-project] PATH_INFO: `/v3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:24.692202 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3441/6905] 10.222.0.16 () {58 vars in 1104 bytes} [Mon Aug 29 15:55:24 2022] GET /identity/v3 => generated 255 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:55:24.697705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97e91f-c1d5-48b1-b4ac-e7410bb56022 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.697979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97e91f-c1d5-48b1-b4ac-e7410bb56022 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.699613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97e91f-c1d5-48b1-b4ac-e7410bb56022 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:24.701254 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3465/6906] 10.222.0.16 () {56 vars in 895 bytes} [Mon Aug 29 15:55:24 2022] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:55:24.706818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e47aa9-3cbb-4cd0-aae9-9f67f400b299 None None] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.707218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e47aa9-3cbb-4cd0-aae9-9f67f400b299 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.707591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e47aa9-3cbb-4cd0-aae9-9f67f400b299 None None] PATH_INFO: `/` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:24.710635 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3442/6907] 10.222.0.16 () {56 vars in 895 bytes} [Mon Aug 29 15:55:24 2022] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 15:55:24.713985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97e91f-c1d5-48b1-b4ac-e7410bb56022 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:24.826014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:24.848338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97e91f-c1d5-48b1-b4ac-e7410bb56022 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:24.853256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:24.853927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.854210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.855698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] PATH_INFO: `/v3/users/d98b52fa91aa44658c55981f892716e1` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:24.856152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98b52fa91aa44658c55981f892716e1)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:24.858351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:24.920511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98b52fa91aa44658c55981f892716e1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:24.921270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98b52fa91aa44658c55981f892716e1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:24.937565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98b52fa91aa44658c55981f892716e1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:24.938467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98b52fa91aa44658c55981f892716e1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:24.946662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98b52fa91aa44658c55981f892716e1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:24.966664 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3466/6908] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:24 2022] DELETE /identity/v3/users/d98b52fa91aa44658c55981f892716e1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:24.970802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2cf0b-935f-436d-a17c-46b48de02c59 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:24.971090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2cf0b-935f-436d-a17c-46b48de02c59 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:24.971366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2cf0b-935f-436d-a17c-46b48de02c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:25.037275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-73c2cf0b-935f-436d-a17c-46b48de02c59 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:25.038856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-73c2cf0b-935f-436d-a17c-46b48de02c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:25.129019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:25.130875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:25.224824 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3443/6909] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:25.227085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83f84d-15e4-4d2d-9cfe-a22d36fd6589 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:25.227715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83f84d-15e4-4d2d-9cfe-a22d36fd6589 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:25.228606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83f84d-15e4-4d2d-9cfe-a22d36fd6589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:25.259400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25c05-43a8-406c-b0af-e4ffc5170581 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:25.265033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7c83f84d-15e4-4d2d-9cfe-a22d36fd6589 None None] MFA Rules not processed for user `74602998065943c4a49a96d23ec0ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:25.265286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:25.266395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:25.266825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:25.267247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] PATH_INFO: `/v3/users/145d5a34b72a4037aefd1c8aeccc8adf` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:25.268658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] RBAC: Authorizing `identity:delete_user(user_id=145d5a34b72a4037aefd1c8aeccc8adf)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:25.268968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7c83f84d-15e4-4d2d-9cfe-a22d36fd6589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:25.271934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:25.380973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145d5a34b72a4037aefd1c8aeccc8adf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:25.382602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145d5a34b72a4037aefd1c8aeccc8adf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:25.409844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:25.415230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145d5a34b72a4037aefd1c8aeccc8adf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:25.416385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145d5a34b72a4037aefd1c8aeccc8adf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:25.435802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145d5a34b72a4037aefd1c8aeccc8adf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:25.441811 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3444/6910] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:25.445991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83f84d-15e4-4d2d-9cfe-a22d36fd6589 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:25.453502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7c83f84d-15e4-4d2d-9cfe-a22d36fd6589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:25.456132 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3467/6911] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:25 2022] DELETE /identity/v3/users/145d5a34b72a4037aefd1c8aeccc8adf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:25.456917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:25.458518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:25.489225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83f84d-15e4-4d2d-9cfe-a22d36fd6589 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:25.566236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc09d9a-77a8-42c5-9dd3-c8bb109c826c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:25.570720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07be03-11db-4485-b725-0bfe79879a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:25.572002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07be03-11db-4485-b725-0bfe79879a5e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:25.572291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07be03-11db-4485-b725-0bfe79879a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:25.572565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07be03-11db-4485-b725-0bfe79879a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:25.574997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4f07be03-11db-4485-b725-0bfe79879a5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:25.602944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:25.650444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:25.651950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:25.652591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:25.653005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] PATH_INFO: `/v3/users/79aeb99784444848a52fb9145429da42` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:25.655917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] RBAC: Authorizing `identity:delete_user(user_id=79aeb99784444848a52fb9145429da42)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:25.658493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:25.701593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07be03-11db-4485-b725-0bfe79879a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:25.703686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07be03-11db-4485-b725-0bfe79879a5e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:25.726461 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3468/6912] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:25.731798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325763-15d9-47ca-afa8-362d98e20949 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:25.732098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325763-15d9-47ca-afa8-362d98e20949 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:25.732381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325763-15d9-47ca-afa8-362d98e20949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:25.754136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79aeb99784444848a52fb9145429da42'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:25.756480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79aeb99784444848a52fb9145429da42'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:25.779646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7a325763-15d9-47ca-afa8-362d98e20949 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:25.780874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7a325763-15d9-47ca-afa8-362d98e20949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:25.783864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79aeb99784444848a52fb9145429da42'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:25.795721 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3469/6913] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:25.798611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79aeb99784444848a52fb9145429da42'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:25.811101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79aeb99784444848a52fb9145429da42'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:25.823688 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3445/6914] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:25 2022] DELETE /identity/v3/users/79aeb99784444848a52fb9145429da42 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:25.835926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:25.836143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76967-c615-4dd5-8059-3938a38d3f23 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:25.836255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76967-c615-4dd5-8059-3938a38d3f23 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:25.836514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76967-c615-4dd5-8059-3938a38d3f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:25.837671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:25.874752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7ea76967-c615-4dd5-8059-3938a38d3f23 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:25.876764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7ea76967-c615-4dd5-8059-3938a38d3f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:25.969626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4be76-f84b-46f6-8b21-ad3406e5063b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:25.976372 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3470/6915] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:25.984414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d694bd-b7d9-4403-bbf3-5a1ac1f415fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:25.985143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d694bd-b7d9-4403-bbf3-5a1ac1f415fd service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:25.985537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d694bd-b7d9-4403-bbf3-5a1ac1f415fd service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:25.985884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d694bd-b7d9-4403-bbf3-5a1ac1f415fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:25.988277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-79d694bd-b7d9-4403-bbf3-5a1ac1f415fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:26.000199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76967-c615-4dd5-8059-3938a38d3f23 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:26.008693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d694bd-b7d9-4403-bbf3-5a1ac1f415fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:26.014812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d694bd-b7d9-4403-bbf3-5a1ac1f415fd service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:26.027199 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3446/6916] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:55:26.030685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76967-c615-4dd5-8059-3938a38d3f23 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:26.035849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f7b0-8441-4fc7-a5c0-da03752b58c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:26.036610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f7b0-8441-4fc7-a5c0-da03752b58c4 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:26.036959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f7b0-8441-4fc7-a5c0-da03752b58c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:26.037300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f7b0-8441-4fc7-a5c0-da03752b58c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:26.068375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f7b0-8441-4fc7-a5c0-da03752b58c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:26.069908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f7b0-8441-4fc7-a5c0-da03752b58c4 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:26.086362 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3471/6917] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:55:26.559857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d694bd-b7d9-4403-bbf3-5a1ac1f415fd service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:26.561832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-79d694bd-b7d9-4403-bbf3-5a1ac1f415fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:26.576989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d694bd-b7d9-4403-bbf3-5a1ac1f415fd service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:26.582450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:26.583144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:26.583484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:26.583703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] PATH_INFO: `/v3/projects/ce73b94849b9401ebbe60f02fe35a583` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:26.584864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce73b94849b9401ebbe60f02fe35a583)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:26.587112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:26.647500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:26.650171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce73b94849b9401ebbe60f02fe35a583', 'request_id': 'req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:26.668118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce73b94849b9401ebbe60f02fe35a583', 'request_id': 'req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:26.680488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce73b94849b9401ebbe60f02fe35a583', 'request_id': 'req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:26.695908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] The token cache is being invalidate because project ce73b94849b9401ebbe60f02fe35a583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:26.696312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:26.696961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a552d7ce-41bf-43cc-b8bc-ff1724ab4d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:26.699964 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3447/6918] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:26 2022] DELETE /identity/v3/projects/ce73b94849b9401ebbe60f02fe35a583 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:26.710026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ee64e-3f2a-48c1-9461-df9e13a9b453 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:26.710559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ee64e-3f2a-48c1-9461-df9e13a9b453 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:26.710559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ee64e-3f2a-48c1-9461-df9e13a9b453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:26.733842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-814ee64e-3f2a-48c1-9461-df9e13a9b453 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:26.735167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-814ee64e-3f2a-48c1-9461-df9e13a9b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:26.742247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:26.844010 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3472/6919] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:26.846107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b76a3-96cb-4c0b-b0e2-6248e1477acf None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:26.848203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b76a3-96cb-4c0b-b0e2-6248e1477acf None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:26.849404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b76a3-96cb-4c0b-b0e2-6248e1477acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:26.911051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ee64e-3f2a-48c1-9461-df9e13a9b453 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:26.913210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-814ee64e-3f2a-48c1-9461-df9e13a9b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:26.914142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6d9b76a3-96cb-4c0b-b0e2-6248e1477acf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:26.917939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6d9b76a3-96cb-4c0b-b0e2-6248e1477acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:26.949737 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3448/6920] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:26.955882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b76a3-96cb-4c0b-b0e2-6248e1477acf None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:26.962950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ee64e-3f2a-48c1-9461-df9e13a9b453 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:26.971299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b76a3-96cb-4c0b-b0e2-6248e1477acf None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:26.977585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b12dc-9b4c-430f-afe3-fb8086cebf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:26.977985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b12dc-9b4c-430f-afe3-fb8086cebf7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:26.978261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b12dc-9b4c-430f-afe3-fb8086cebf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:26.979031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b12dc-9b4c-430f-afe3-fb8086cebf7e admin admin] PATH_INFO: `/v3/users/9654324d5cab4ff99b493f30f25d9237` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:26.981039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b12dc-9b4c-430f-afe3-fb8086cebf7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9654324d5cab4ff99b493f30f25d9237)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:26.982397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2136ee-4f13-4d1f-975b-1509699923be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:26.982966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b12dc-9b4c-430f-afe3-fb8086cebf7e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:26.983905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2136ee-4f13-4d1f-975b-1509699923be admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:26.984832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2136ee-4f13-4d1f-975b-1509699923be admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:26.985332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2136ee-4f13-4d1f-975b-1509699923be admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:26.986233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2136ee-4f13-4d1f-975b-1509699923be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:26.987751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2136ee-4f13-4d1f-975b-1509699923be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:26.997710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2136ee-4f13-4d1f-975b-1509699923be admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:27.031715 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3449/6921] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:27.036331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2136ee-4f13-4d1f-975b-1509699923be admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:27.050001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2136ee-4f13-4d1f-975b-1509699923be admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:27.058978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078604b-870e-4ed4-bc72-7d9c6bc2c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:27.059740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078604b-870e-4ed4-bc72-7d9c6bc2c838 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:27.060139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078604b-870e-4ed4-bc72-7d9c6bc2c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:27.060713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078604b-870e-4ed4-bc72-7d9c6bc2c838 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:27.062564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078604b-870e-4ed4-bc72-7d9c6bc2c838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:27.066119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078604b-870e-4ed4-bc72-7d9c6bc2c838 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:27.094278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a00b12dc-9b4c-430f-afe3-fb8086cebf7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9654324d5cab4ff99b493f30f25d9237'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.095167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a00b12dc-9b4c-430f-afe3-fb8086cebf7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9654324d5cab4ff99b493f30f25d9237'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.116130 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3450/6922] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:27 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:27.121214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a00b12dc-9b4c-430f-afe3-fb8086cebf7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9654324d5cab4ff99b493f30f25d9237'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.121511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078604b-870e-4ed4-bc72-7d9c6bc2c838 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:27.122162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a00b12dc-9b4c-430f-afe3-fb8086cebf7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9654324d5cab4ff99b493f30f25d9237'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.124063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b078604b-870e-4ed4-bc72-7d9c6bc2c838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:27.134827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a00b12dc-9b4c-430f-afe3-fb8086cebf7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9654324d5cab4ff99b493f30f25d9237'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.175769 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3473/6923] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:26 2022] DELETE /identity/v3/users/9654324d5cab4ff99b493f30f25d9237 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:27.180494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ea30e-71bc-4f8b-bf12-d2afec33b499 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:27.180900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ea30e-71bc-4f8b-bf12-d2afec33b499 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:27.181275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ea30e-71bc-4f8b-bf12-d2afec33b499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:27.243914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c72ea30e-71bc-4f8b-bf12-d2afec33b499 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:27.247306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c72ea30e-71bc-4f8b-bf12-d2afec33b499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:27.286373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078604b-870e-4ed4-bc72-7d9c6bc2c838 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:27.383935 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3474/6924] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:27.383935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ea30e-71bc-4f8b-bf12-d2afec33b499 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:27.393358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c72ea30e-71bc-4f8b-bf12-d2afec33b499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:27.421167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ea30e-71bc-4f8b-bf12-d2afec33b499 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:27.427988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:27.428644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:27.428928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:27.429223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] PATH_INFO: `/v3/projects/cb512231bd1b4c2e9ce6a439e4585d9f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:27.430480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb512231bd1b4c2e9ce6a439e4585d9f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:27.430778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990175c-61b1-4381-8d0c-876c0a8e2d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:27.431878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990175c-61b1-4381-8d0c-876c0a8e2d9e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:27.432171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990175c-61b1-4381-8d0c-876c0a8e2d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:27.432538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:27.432731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990175c-61b1-4381-8d0c-876c0a8e2d9e admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:27.433962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990175c-61b1-4381-8d0c-876c0a8e2d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:27.436840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990175c-61b1-4381-8d0c-876c0a8e2d9e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:27.466049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:27.496579 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3451/6925] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:27 2022] POST /identity/v3/users => generated 299 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:27.497700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990175c-61b1-4381-8d0c-876c0a8e2d9e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:27.504557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1990175c-61b1-4381-8d0c-876c0a8e2d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:27.518534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb512231bd1b4c2e9ce6a439e4585d9f', 'request_id': 'req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.530650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb512231bd1b4c2e9ce6a439e4585d9f', 'request_id': 'req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.545011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb512231bd1b4c2e9ce6a439e4585d9f', 'request_id': 'req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.560220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] The token cache is being invalidate because project cb512231bd1b4c2e9ce6a439e4585d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:27.560619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.561809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.564784 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3475/6926] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:27 2022] DELETE /identity/v3/projects/cb512231bd1b4c2e9ce6a439e4585d9f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:27.568338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:27.568962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:27.571346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:27.613799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990175c-61b1-4381-8d0c-876c0a8e2d9e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:27.679603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1490c-7018-498b-8437-38e0f3ff0194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:27.680549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1490c-7018-498b-8437-38e0f3ff0194 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:27.680878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1490c-7018-498b-8437-38e0f3ff0194 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:27.681159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1490c-7018-498b-8437-38e0f3ff0194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:27.683129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b1d1490c-7018-498b-8437-38e0f3ff0194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:27.731551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaab72-d9a7-4c1b-b7c5-ce66affa79f6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:27.746142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:27.746806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:27.747803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:27.747803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] PATH_INFO: `/v3/projects/0e8b377b9ce74ddea72691a59f640ce4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:27.754300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8b377b9ce74ddea72691a59f640ce4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:27.758252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:27.788112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1490c-7018-498b-8437-38e0f3ff0194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:27.790901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1490c-7018-498b-8437-38e0f3ff0194 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:27.808057 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3452/6927] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:27.809490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1490c-7018-498b-8437-38e0f3ff0194 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:27.811794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b1d1490c-7018-498b-8437-38e0f3ff0194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:27.835794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1490c-7018-498b-8437-38e0f3ff0194 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:27.856827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8b377b9ce74ddea72691a59f640ce4', 'request_id': 'req-6fb74c44-925f-4349-8d17-bff7ab4f0c19'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.864535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8b377b9ce74ddea72691a59f640ce4', 'request_id': 'req-6fb74c44-925f-4349-8d17-bff7ab4f0c19'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.877099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8b377b9ce74ddea72691a59f640ce4', 'request_id': 'req-6fb74c44-925f-4349-8d17-bff7ab4f0c19'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.892137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] The token cache is being invalidate because project 0e8b377b9ce74ddea72691a59f640ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:27.892456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.893405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:27.895288 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3476/6928] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:27 2022] DELETE /identity/v3/projects/0e8b377b9ce74ddea72691a59f640ce4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:27.896141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:27.898503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:27.920621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e838dc-6db9-4704-b64d-04eac0747556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:27.921634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e838dc-6db9-4704-b64d-04eac0747556 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:27.922403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e838dc-6db9-4704-b64d-04eac0747556 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:27.922868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e838dc-6db9-4704-b64d-04eac0747556 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:27.923724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e838dc-6db9-4704-b64d-04eac0747556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:27.926075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e838dc-6db9-4704-b64d-04eac0747556 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:27.939784 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3453/6929] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:27.940908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e838dc-6db9-4704-b64d-04eac0747556 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:27.943344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-44e838dc-6db9-4704-b64d-04eac0747556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:27.955230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:27.959324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e838dc-6db9-4704-b64d-04eac0747556 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:27.966145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:27.966799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:27.967087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:27.967374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] PATH_INFO: `/v3/users/22234176fe0d4d88adde9ab8188cd6b8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:27.968766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22234176fe0d4d88adde9ab8188cd6b8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:27.970926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:27.987128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb74c44-925f-4349-8d17-bff7ab4f0c19 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:27.995779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:27.996622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:27.996981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:27.997329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] PATH_INFO: `/v3/users/f1fe53baadd84c4c8717ffc81713048e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:27.998924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fe53baadd84c4c8717ffc81713048e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:28.001528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:28.014945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:28.072096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22234176fe0d4d88adde9ab8188cd6b8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.073928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22234176fe0d4d88adde9ab8188cd6b8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.097359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22234176fe0d4d88adde9ab8188cd6b8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.103200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fe53baadd84c4c8717ffc81713048e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.104530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fe53baadd84c4c8717ffc81713048e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.112187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22234176fe0d4d88adde9ab8188cd6b8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.127091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22234176fe0d4d88adde9ab8188cd6b8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.130824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fe53baadd84c4c8717ffc81713048e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.132681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fe53baadd84c4c8717ffc81713048e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.139431 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3454/6930] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:27 2022] DELETE /identity/v3/users/22234176fe0d4d88adde9ab8188cd6b8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:28.142409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:28.146520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:28.160705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fe53baadd84c4c8717ffc81713048e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.187101 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3477/6931] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:27 2022] DELETE /identity/v3/users/f1fe53baadd84c4c8717ffc81713048e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:28.292890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e910df-75cc-4052-92b0-774aab009f56 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:28.448631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4968913-6395-4ebf-bd8f-53600615975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:28.449325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968913-6395-4ebf-bd8f-53600615975c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:28.449650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968913-6395-4ebf-bd8f-53600615975c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:28.449926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968913-6395-4ebf-bd8f-53600615975c admin admin] PATH_INFO: `/v3/projects/1c4da2965a484d95b707987b6e8c7a1e/users/53da0e92d545452e85ce4fdbf8b3df6f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:28.472667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4968913-6395-4ebf-bd8f-53600615975c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4da2965a484d95b707987b6e8c7a1e, user_id=53da0e92d545452e85ce4fdbf8b3df6f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:28.478325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4968913-6395-4ebf-bd8f-53600615975c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:28.508757 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3455/6932] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:28 2022] PUT /identity/v3/projects/1c4da2965a484d95b707987b6e8c7a1e/users/53da0e92d545452e85ce4fdbf8b3df6f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:28.514055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:28.515913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:28.536561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5d31b-6299-47cb-8606-170e6d1dc4b2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:28.620865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4968913-6395-4ebf-bd8f-53600615975c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:28.622806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c4968913-6395-4ebf-bd8f-53600615975c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:28.623894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76f4f3-b4f2-44aa-a3d1-5db4cead264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:28.624709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f4f3-b4f2-44aa-a3d1-5db4cead264c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:28.625101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f4f3-b4f2-44aa-a3d1-5db4cead264c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:28.625886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f4f3-b4f2-44aa-a3d1-5db4cead264c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:28.626876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76f4f3-b4f2-44aa-a3d1-5db4cead264c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:28.638733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76f4f3-b4f2-44aa-a3d1-5db4cead264c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:28.647397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4968913-6395-4ebf-bd8f-53600615975c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:28.667348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:28.668187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:28.668570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:28.668976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] PATH_INFO: `/v3/projects/236b35f2542c404f88f5888eaf38314d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:28.672079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=236b35f2542c404f88f5888eaf38314d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:28.673611 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3478/6933] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:28.674420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76f4f3-b4f2-44aa-a3d1-5db4cead264c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:28.675327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:28.694968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76f4f3-b4f2-44aa-a3d1-5db4cead264c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:28.704411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c233-2c56-414f-9210-537edcf89339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:28.708214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c233-2c56-414f-9210-537edcf89339 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:28.708570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c233-2c56-414f-9210-537edcf89339 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:28.708921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c233-2c56-414f-9210-537edcf89339 admin admin] PATH_INFO: `/v3/projects/1c4da2965a484d95b707987b6e8c7a1e/users/53da0e92d545452e85ce4fdbf8b3df6f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:28.711703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3c233-2c56-414f-9210-537edcf89339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4da2965a484d95b707987b6e8c7a1e, user_id=53da0e92d545452e85ce4fdbf8b3df6f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:28.715275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3c233-2c56-414f-9210-537edcf89339 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:28.756094 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3479/6934] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:28 2022] PUT /identity/v3/projects/1c4da2965a484d95b707987b6e8c7a1e/users/53da0e92d545452e85ce4fdbf8b3df6f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:28.757733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf366e4-c4c7-4c3b-b66c-d4e988741f09 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:28.758025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf366e4-c4c7-4c3b-b66c-d4e988741f09 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:28.758299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf366e4-c4c7-4c3b-b66c-d4e988741f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:28.782670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:28.808233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236b35f2542c404f88f5888eaf38314d', 'request_id': 'req-81afb4c7-5d29-473d-abdd-7279a9d901e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.818254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236b35f2542c404f88f5888eaf38314d', 'request_id': 'req-81afb4c7-5d29-473d-abdd-7279a9d901e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.832959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236b35f2542c404f88f5888eaf38314d', 'request_id': 'req-81afb4c7-5d29-473d-abdd-7279a9d901e7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.846754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] The token cache is being invalidate because project 236b35f2542c404f88f5888eaf38314d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:28.846754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.847504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:28.854625 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3456/6935] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:28 2022] DELETE /identity/v3/projects/236b35f2542c404f88f5888eaf38314d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:28.854625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:28.854625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:28.876516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-baf366e4-c4c7-4c3b-b66c-d4e988741f09 None None] MFA Rules not processed for user `53da0e92d545452e85ce4fdbf8b3df6f`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:28.877852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-baf366e4-c4c7-4c3b-b66c-d4e988741f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:28.952287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:28.988741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afb4c7-5d29-473d-abdd-7279a9d901e7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:29.000953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:29.002018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.002018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.002279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] PATH_INFO: `/v3/projects/e97e0971c0f2471fae86f3b85593b5a4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.004832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97e0971c0f2471fae86f3b85593b5a4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:29.008415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:29.061639 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3480/6936] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:29.063345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b99dde-b7fa-47a4-b994-7763e526d39c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.066943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b99dde-b7fa-47a4-b994-7763e526d39c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.069667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b99dde-b7fa-47a4-b994-7763e526d39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.104422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97e0971c0f2471fae86f3b85593b5a4', 'request_id': 'req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.115644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97e0971c0f2471fae86f3b85593b5a4', 'request_id': 'req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.119580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-19b99dde-b7fa-47a4-b994-7763e526d39c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:29.122128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-19b99dde-b7fa-47a4-b994-7763e526d39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:29.144729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97e0971c0f2471fae86f3b85593b5a4', 'request_id': 'req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.168297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] The token cache is being invalidate because project e97e0971c0f2471fae86f3b85593b5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:29.169565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.172460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.175374 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3457/6937] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:28 2022] DELETE /identity/v3/projects/e97e0971c0f2471fae86f3b85593b5a4 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:29.176552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:29.181058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:29.268056 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3481/6938] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:29.268056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b99dde-b7fa-47a4-b994-7763e526d39c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:29.268056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-19b99dde-b7fa-47a4-b994-7763e526d39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:29.282782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b99dde-b7fa-47a4-b994-7763e526d39c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:29.290384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:29.293165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf070a-e9f3-4b97-84ab-00b488f8705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:29.295068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf070a-e9f3-4b97-84ab-00b488f8705d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.295756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf070a-e9f3-4b97-84ab-00b488f8705d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.296286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf070a-e9f3-4b97-84ab-00b488f8705d admin admin] PATH_INFO: `/v3/users/9bffa09ff5994961abb90f615217bd81` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.298818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf070a-e9f3-4b97-84ab-00b488f8705d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bffa09ff5994961abb90f615217bd81)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:29.302006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf070a-e9f3-4b97-84ab-00b488f8705d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:29.324230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03ed91-0ccf-4f58-9bf5-8a37953b0880 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:29.333099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a717f7d-f52d-441f-8eb4-daafd75d7204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:29.334218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717f7d-f52d-441f-8eb4-daafd75d7204 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.334543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717f7d-f52d-441f-8eb4-daafd75d7204 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.335089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717f7d-f52d-441f-8eb4-daafd75d7204 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.335754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a717f7d-f52d-441f-8eb4-daafd75d7204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:29.338681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a717f7d-f52d-441f-8eb4-daafd75d7204 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:29.391646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ecf070a-e9f3-4b97-84ab-00b488f8705d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bffa09ff5994961abb90f615217bd81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.392373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ecf070a-e9f3-4b97-84ab-00b488f8705d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bffa09ff5994961abb90f615217bd81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.400192 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3458/6939] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:29 2022] POST /identity/v3/projects => generated 387 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:29.403800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a717f7d-f52d-441f-8eb4-daafd75d7204 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:29.408026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9a717f7d-f52d-441f-8eb4-daafd75d7204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:29.409130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ecf070a-e9f3-4b97-84ab-00b488f8705d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bffa09ff5994961abb90f615217bd81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.409913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ecf070a-e9f3-4b97-84ab-00b488f8705d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bffa09ff5994961abb90f615217bd81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.418895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3ecf070a-e9f3-4b97-84ab-00b488f8705d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bffa09ff5994961abb90f615217bd81'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.442487 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3482/6940] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:29 2022] DELETE /identity/v3/users/9bffa09ff5994961abb90f615217bd81 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:29.445579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196a14e-ea21-4b1f-96b6-1a588188a3b9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.445942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196a14e-ea21-4b1f-96b6-1a588188a3b9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.446428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196a14e-ea21-4b1f-96b6-1a588188a3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.474477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5196a14e-ea21-4b1f-96b6-1a588188a3b9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:29.475770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5196a14e-ea21-4b1f-96b6-1a588188a3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:29.525128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:29.581237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a717f7d-f52d-441f-8eb4-daafd75d7204 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:29.588669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:29.592441 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3483/6941] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:29.592552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.592630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196a14e-ea21-4b1f-96b6-1a588188a3b9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:29.592704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.592704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] PATH_INFO: `/v3/projects/6874652370ba4ed5840e37db96913023` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.592857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5196a14e-ea21-4b1f-96b6-1a588188a3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:29.592932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6874652370ba4ed5840e37db96913023)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:29.596270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:29.623005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196a14e-ea21-4b1f-96b6-1a588188a3b9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:29.633407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871699be-bdaa-41a4-87d1-7d34e2f267a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:29.634049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871699be-bdaa-41a4-87d1-7d34e2f267a5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.634638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871699be-bdaa-41a4-87d1-7d34e2f267a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.634638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871699be-bdaa-41a4-87d1-7d34e2f267a5 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.635097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871699be-bdaa-41a4-87d1-7d34e2f267a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:29.640020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871699be-bdaa-41a4-87d1-7d34e2f267a5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:29.691842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6874652370ba4ed5840e37db96913023', 'request_id': 'req-02a1d32d-6383-4fc7-89a6-b0967a430a52'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.695303 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3484/6942] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:29 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:29.696703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871699be-bdaa-41a4-87d1-7d34e2f267a5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:29.715631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6874652370ba4ed5840e37db96913023', 'request_id': 'req-02a1d32d-6383-4fc7-89a6-b0967a430a52'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.719607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871699be-bdaa-41a4-87d1-7d34e2f267a5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:29.738099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6874652370ba4ed5840e37db96913023', 'request_id': 'req-02a1d32d-6383-4fc7-89a6-b0967a430a52'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.773226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] The token cache is being invalidate because project 6874652370ba4ed5840e37db96913023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:29.773728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.776588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:29.788528 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3459/6943] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:29 2022] DELETE /identity/v3/projects/6874652370ba4ed5840e37db96913023 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:29.789607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:29.791849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:29.878027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926cc2d-2edc-41ac-9cc1-ea22cff145ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:29.878799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926cc2d-2edc-41ac-9cc1-ea22cff145ad admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.879086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926cc2d-2edc-41ac-9cc1-ea22cff145ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.879361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926cc2d-2edc-41ac-9cc1-ea22cff145ad admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.880046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926cc2d-2edc-41ac-9cc1-ea22cff145ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:29.880322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926cc2d-2edc-41ac-9cc1-ea22cff145ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:29.884590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926cc2d-2edc-41ac-9cc1-ea22cff145ad admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:29.920387 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3485/6944] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:29.922081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac1c5f-05fe-44ba-84bd-943076260c28 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.922377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac1c5f-05fe-44ba-84bd-943076260c28 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.923170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac1c5f-05fe-44ba-84bd-943076260c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.942611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1d32d-6383-4fc7-89a6-b0967a430a52 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:29.958237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732dde-6025-4250-9c4a-8d0a6f208e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:29.958237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732dde-6025-4250-9c4a-8d0a6f208e36 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:29.958570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732dde-6025-4250-9c4a-8d0a6f208e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:29.960070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732dde-6025-4250-9c4a-8d0a6f208e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:29.961200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da732dde-6025-4250-9c4a-8d0a6f208e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:29.963428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da732dde-6025-4250-9c4a-8d0a6f208e36 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:29.972642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-deac1c5f-05fe-44ba-84bd-943076260c28 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:29.973985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-deac1c5f-05fe-44ba-84bd-943076260c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:29.978646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:29.992568 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3486/6945] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:29.992919 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3460/6946] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:29.996687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732dde-6025-4250-9c4a-8d0a6f208e36 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:29.997330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac1c5f-05fe-44ba-84bd-943076260c28 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.000319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-da732dde-6025-4250-9c4a-8d0a6f208e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.001666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-deac1c5f-05fe-44ba-84bd-943076260c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.025120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac1c5f-05fe-44ba-84bd-943076260c28 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.026732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732dde-6025-4250-9c4a-8d0a6f208e36 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.030497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2304508-cefa-47c1-9a46-0ceee4dccc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.031122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2304508-cefa-47c1-9a46-0ceee4dccc8d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.031497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2304508-cefa-47c1-9a46-0ceee4dccc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.031824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2304508-cefa-47c1-9a46-0ceee4dccc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.032478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2304508-cefa-47c1-9a46-0ceee4dccc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.034522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.034669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2304508-cefa-47c1-9a46-0ceee4dccc8d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.036234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.037063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.037744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] PATH_INFO: `/v3/projects/2a291e838df142a0b36b8db0836a5160` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.039533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a291e838df142a0b36b8db0836a5160)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.042378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.081668 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3487/6947] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:29 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:30.081668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2304508-cefa-47c1-9a46-0ceee4dccc8d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.141819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a291e838df142a0b36b8db0836a5160', 'request_id': 'req-2310b53d-bf46-40d9-9f96-ac87079514cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:30.152431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a291e838df142a0b36b8db0836a5160', 'request_id': 'req-2310b53d-bf46-40d9-9f96-ac87079514cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:30.165381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a291e838df142a0b36b8db0836a5160', 'request_id': 'req-2310b53d-bf46-40d9-9f96-ac87079514cb'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:30.172263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2304508-cefa-47c1-9a46-0ceee4dccc8d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.184557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] The token cache is being invalidate because project 2a291e838df142a0b36b8db0836a5160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:30.185111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:30.186254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2310b53d-bf46-40d9-9f96-ac87079514cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:30.188594 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3461/6948] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:29 2022] DELETE /identity/v3/projects/2a291e838df142a0b36b8db0836a5160 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:30.191391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd743ac-b9c8-40eb-b209-6adb4a86922b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.191868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd743ac-b9c8-40eb-b209-6adb4a86922b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.192364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd743ac-b9c8-40eb-b209-6adb4a86922b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.215770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:30.218438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8dd743ac-b9c8-40eb-b209-6adb4a86922b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:30.220811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8dd743ac-b9c8-40eb-b209-6adb4a86922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.254612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490bb00-8f38-4976-bfb0-a8bb8be406dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.255728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490bb00-8f38-4976-bfb0-a8bb8be406dc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.256021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490bb00-8f38-4976-bfb0-a8bb8be406dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.256484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490bb00-8f38-4976-bfb0-a8bb8be406dc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.257160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490bb00-8f38-4976-bfb0-a8bb8be406dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.259176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490bb00-8f38-4976-bfb0-a8bb8be406dc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.273868 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3488/6949] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:30.273868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490bb00-8f38-4976-bfb0-a8bb8be406dc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.276343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f490bb00-8f38-4976-bfb0-a8bb8be406dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.302960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490bb00-8f38-4976-bfb0-a8bb8be406dc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.310459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7f064-9c59-44ee-adb1-20c861940afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.311459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7f064-9c59-44ee-adb1-20c861940afd admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.311910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7f064-9c59-44ee-adb1-20c861940afd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.312583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7f064-9c59-44ee-adb1-20c861940afd admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.313643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7f064-9c59-44ee-adb1-20c861940afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.314834 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3462/6950] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:30.316368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a49342-11d2-46c2-8f66-b3eefae20529 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.316773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a49342-11d2-46c2-8f66-b3eefae20529 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.317144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a49342-11d2-46c2-8f66-b3eefae20529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.317337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7f064-9c59-44ee-adb1-20c861940afd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.343340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d1a49342-11d2-46c2-8f66-b3eefae20529 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:30.344727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d1a49342-11d2-46c2-8f66-b3eefae20529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.347743 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3489/6951] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:30 2022] POST /identity/v3/users => generated 284 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:30.349927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7f064-9c59-44ee-adb1-20c861940afd admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.352574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-96b7f064-9c59-44ee-adb1-20c861940afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.369592 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3463/6952] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:30.369592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a49342-11d2-46c2-8f66-b3eefae20529 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.369592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d1a49342-11d2-46c2-8f66-b3eefae20529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.383975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7f064-9c59-44ee-adb1-20c861940afd admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.390369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5974f89-20af-43c0-8e27-47dd40c149da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.391417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974f89-20af-43c0-8e27-47dd40c149da admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.391768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974f89-20af-43c0-8e27-47dd40c149da admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.392177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974f89-20af-43c0-8e27-47dd40c149da admin admin] PATH_INFO: `/v3/projects/f97ebe06f2e04d3fae9b6e951ecce6a4/users/246aa6a694004ba68f557a0b41e6ee50/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.415666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5974f89-20af-43c0-8e27-47dd40c149da admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97ebe06f2e04d3fae9b6e951ecce6a4, user_id=246aa6a694004ba68f557a0b41e6ee50, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.420663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5974f89-20af-43c0-8e27-47dd40c149da admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.456363 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3490/6953] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:30 2022] PUT /identity/v3/projects/f97ebe06f2e04d3fae9b6e951ecce6a4/users/246aa6a694004ba68f557a0b41e6ee50/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:30.456363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5974f89-20af-43c0-8e27-47dd40c149da admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.509733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a49342-11d2-46c2-8f66-b3eefae20529 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.521009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:30.532478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5974f89-20af-43c0-8e27-47dd40c149da admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.543995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455621ee-a7fe-441a-ae77-aa16544a7424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.544626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455621ee-a7fe-441a-ae77-aa16544a7424 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.545168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455621ee-a7fe-441a-ae77-aa16544a7424 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.545519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455621ee-a7fe-441a-ae77-aa16544a7424 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.546166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455621ee-a7fe-441a-ae77-aa16544a7424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:30.546597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455621ee-a7fe-441a-ae77-aa16544a7424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.548521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455621ee-a7fe-441a-ae77-aa16544a7424 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.563128 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3491/6954] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:30.567521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455621ee-a7fe-441a-ae77-aa16544a7424 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.578612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455621ee-a7fe-441a-ae77-aa16544a7424 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.584908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f327f7-03cd-4450-b72d-409cb1836d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.584908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f327f7-03cd-4450-b72d-409cb1836d45 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.585188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f327f7-03cd-4450-b72d-409cb1836d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.585539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f327f7-03cd-4450-b72d-409cb1836d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.586400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f327f7-03cd-4450-b72d-409cb1836d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.589230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f327f7-03cd-4450-b72d-409cb1836d45 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.606297 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3492/6955] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:30.608410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf517-e862-4c70-9218-db38aeb558e7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.608803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf517-e862-4c70-9218-db38aeb558e7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.609089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf517-e862-4c70-9218-db38aeb558e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.614240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e23f2a-5a87-43f9-9d64-7ba949478a5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.615332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23f2a-5a87-43f9-9d64-7ba949478a5d service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.616262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23f2a-5a87-43f9-9d64-7ba949478a5d service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.616762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23f2a-5a87-43f9-9d64-7ba949478a5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.620514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-61e23f2a-5a87-43f9-9d64-7ba949478a5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.631962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-abbdf517-e862-4c70-9218-db38aeb558e7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:30.633188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-abbdf517-e862-4c70-9218-db38aeb558e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.646170 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3493/6956] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:30.653252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39feb-33f8-460d-8e14-1298f483ccdd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.653405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39feb-33f8-460d-8e14-1298f483ccdd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.653698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39feb-33f8-460d-8e14-1298f483ccdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.654517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e23f2a-5a87-43f9-9d64-7ba949478a5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.656088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e23f2a-5a87-43f9-9d64-7ba949478a5d service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.676086 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3464/6957] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:30.677733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e23f2a-5a87-43f9-9d64-7ba949478a5d service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.687026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a8e39feb-33f8-460d-8e14-1298f483ccdd None None] MFA Rules not processed for user `246aa6a694004ba68f557a0b41e6ee50`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:30.688267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a8e39feb-33f8-460d-8e14-1298f483ccdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.695283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e23f2a-5a87-43f9-9d64-7ba949478a5d service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.705719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03426ae-6b9f-417d-bcf0-fd5b8b323139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.706475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03426ae-6b9f-417d-bcf0-fd5b8b323139 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.706856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03426ae-6b9f-417d-bcf0-fd5b8b323139 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.707230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03426ae-6b9f-417d-bcf0-fd5b8b323139 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.708034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03426ae-6b9f-417d-bcf0-fd5b8b323139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.712314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03426ae-6b9f-417d-bcf0-fd5b8b323139 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.759457 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3465/6958] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:30 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:30.760178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03426ae-6b9f-417d-bcf0-fd5b8b323139 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.782144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:30.803856 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3494/6959] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:30.804828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e39feb-33f8-460d-8e14-1298f483ccdd None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.821657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e39feb-33f8-460d-8e14-1298f483ccdd None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.850555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03426ae-6b9f-417d-bcf0-fd5b8b323139 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.856266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf536f-19f4-4bfe-ac79-15410f74c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.857083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf536f-19f4-4bfe-ac79-15410f74c429 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.857324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf536f-19f4-4bfe-ac79-15410f74c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.857635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf536f-19f4-4bfe-ac79-15410f74c429 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.858289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf536f-19f4-4bfe-ac79-15410f74c429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.859948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf536f-19f4-4bfe-ac79-15410f74c429 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.874905 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3466/6960] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:30.876339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf536f-19f4-4bfe-ac79-15410f74c429 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.891529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf536f-19f4-4bfe-ac79-15410f74c429 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.903387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7423d-16f3-4eee-ba6f-c345b9cedd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.904142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7423d-16f3-4eee-ba6f-c345b9cedd38 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.905048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7423d-16f3-4eee-ba6f-c345b9cedd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.905452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7423d-16f3-4eee-ba6f-c345b9cedd38 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.906202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7423d-16f3-4eee-ba6f-c345b9cedd38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.908738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7423d-16f3-4eee-ba6f-c345b9cedd38 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.908991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb841551-f079-47ed-87f2-2ea430cd170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.909651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb841551-f079-47ed-87f2-2ea430cd170a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.909937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb841551-f079-47ed-87f2-2ea430cd170a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.910217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb841551-f079-47ed-87f2-2ea430cd170a admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:30.910873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb841551-f079-47ed-87f2-2ea430cd170a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:30.911180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb841551-f079-47ed-87f2-2ea430cd170a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:30.913019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb841551-f079-47ed-87f2-2ea430cd170a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:30.939951 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3495/6961] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:30.941500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb841551-f079-47ed-87f2-2ea430cd170a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.943492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-eb841551-f079-47ed-87f2-2ea430cd170a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:30.958727 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3467/6962] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:30 2022] POST /identity/v3/users => generated 290 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:30.961058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7423d-16f3-4eee-ba6f-c345b9cedd38 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:30.973361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7423d-16f3-4eee-ba6f-c345b9cedd38 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:30.979005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c8b6-b017-4ff7-8302-825ac613b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:30.980282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c8b6-b017-4ff7-8302-825ac613b896 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:30.980282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c8b6-b017-4ff7-8302-825ac613b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:30.980488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c8b6-b017-4ff7-8302-825ac613b896 admin admin] PATH_INFO: `/v3/projects/9c8c5aae333149eba3769864fc726453/users/305d5b19d79f4aaaa535a9e5cda911d3/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.010037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715c8b6-b017-4ff7-8302-825ac613b896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8c5aae333149eba3769864fc726453, user_id=305d5b19d79f4aaaa535a9e5cda911d3, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.013857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715c8b6-b017-4ff7-8302-825ac613b896 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.021804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb841551-f079-47ed-87f2-2ea430cd170a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.027203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856a232-d86b-4451-8df2-3c3f5faa2155 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.028083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a232-d86b-4451-8df2-3c3f5faa2155 service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.028374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a232-d86b-4451-8df2-3c3f5faa2155 service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.028649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a232-d86b-4451-8df2-3c3f5faa2155 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.030634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5856a232-d86b-4451-8df2-3c3f5faa2155 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:31.041459 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3468/6963] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:30 2022] PUT /identity/v3/projects/9c8c5aae333149eba3769864fc726453/users/305d5b19d79f4aaaa535a9e5cda911d3/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:31.041459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c8b6-b017-4ff7-8302-825ac613b896 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.097917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:31.126529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856a232-d86b-4451-8df2-3c3f5faa2155 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.130798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856a232-d86b-4451-8df2-3c3f5faa2155 service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.141738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c8b6-b017-4ff7-8302-825ac613b896 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.146949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0791aad-67fd-43ca-b466-12fd84d4157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.148429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791aad-67fd-43ca-b466-12fd84d4157b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.148716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791aad-67fd-43ca-b466-12fd84d4157b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.148990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791aad-67fd-43ca-b466-12fd84d4157b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.149743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0791aad-67fd-43ca-b466-12fd84d4157b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.152308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0791aad-67fd-43ca-b466-12fd84d4157b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.169583 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3496/6964] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:31.169583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856a232-d86b-4451-8df2-3c3f5faa2155 service glance] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.177927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856a232-d86b-4451-8df2-3c3f5faa2155 service glance] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.187177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b866-e888-43e6-bcbf-e01216e81837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.188907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b866-e888-43e6-bcbf-e01216e81837 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.189419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b866-e888-43e6-bcbf-e01216e81837 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.190035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b866-e888-43e6-bcbf-e01216e81837 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.191828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867b866-e888-43e6-bcbf-e01216e81837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.193859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867b866-e888-43e6-bcbf-e01216e81837 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.204996 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3469/6965] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:31 2022] POST /identity/v3/projects => generated 399 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:31.204996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201dcb-3bef-466b-bfdf-665fa964f0ee None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.204996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201dcb-3bef-466b-bfdf-665fa964f0ee None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.204996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29201dcb-3bef-466b-bfdf-665fa964f0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.222841 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3497/6966] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:31.223874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b866-e888-43e6-bcbf-e01216e81837 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.236106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b866-e888-43e6-bcbf-e01216e81837 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.267275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-29201dcb-3bef-466b-bfdf-665fa964f0ee None None] MFA Rules not processed for user `305d5b19d79f4aaaa535a9e5cda911d3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:31.268665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-29201dcb-3bef-466b-bfdf-665fa964f0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:31.276516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:31.315010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff46b51-df0b-4a0f-a135-a1e9bf74d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.315655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff46b51-df0b-4a0f-a135-a1e9bf74d306 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.315935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff46b51-df0b-4a0f-a135-a1e9bf74d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.316242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff46b51-df0b-4a0f-a135-a1e9bf74d306 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.316949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff46b51-df0b-4a0f-a135-a1e9bf74d306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.318954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff46b51-df0b-4a0f-a135-a1e9bf74d306 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.348244 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3498/6967] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:31 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:31.349108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff46b51-df0b-4a0f-a135-a1e9bf74d306 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.360100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff46b51-df0b-4a0f-a135-a1e9bf74d306 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.365260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d2a76-b47e-4d25-b106-5f4428f40c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.365902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d2a76-b47e-4d25-b106-5f4428f40c07 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.366176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d2a76-b47e-4d25-b106-5f4428f40c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.366645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d2a76-b47e-4d25-b106-5f4428f40c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.367201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d2a76-b47e-4d25-b106-5f4428f40c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.368786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d2a76-b47e-4d25-b106-5f4428f40c07 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.381559 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3499/6968] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:31.382427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d2a76-b47e-4d25-b106-5f4428f40c07 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.387872 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3470/6969] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:31.389860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29201dcb-3bef-466b-bfdf-665fa964f0ee None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.393338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d2a76-b47e-4d25-b106-5f4428f40c07 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.399410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50021d31-f74a-46c6-89c9-38d13336020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.400077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021d31-f74a-46c6-89c9-38d13336020a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.400301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021d31-f74a-46c6-89c9-38d13336020a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.400570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021d31-f74a-46c6-89c9-38d13336020a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.401251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50021d31-f74a-46c6-89c9-38d13336020a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.402890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50021d31-f74a-46c6-89c9-38d13336020a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.408198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29201dcb-3bef-466b-bfdf-665fa964f0ee None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.413673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6030bc-3e33-4060-9e00-1f36fe12a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.414359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6030bc-3e33-4060-9e00-1f36fe12a1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.414640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6030bc-3e33-4060-9e00-1f36fe12a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.414915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6030bc-3e33-4060-9e00-1f36fe12a1eb admin admin] PATH_INFO: `/v3/projects/ade28e98cad9481dbad4484d6da3d5a8/users/a296002e40fa4468a80f27207dbd07e5/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.415126 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3500/6970] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:31.415957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50021d31-f74a-46c6-89c9-38d13336020a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.427056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50021d31-f74a-46c6-89c9-38d13336020a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.434603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e184b6-e681-4cfb-a58c-9a0d676299e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.435341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e184b6-e681-4cfb-a58c-9a0d676299e6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.435685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e184b6-e681-4cfb-a58c-9a0d676299e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.436031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e184b6-e681-4cfb-a58c-9a0d676299e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.436760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e184b6-e681-4cfb-a58c-9a0d676299e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.439198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e184b6-e681-4cfb-a58c-9a0d676299e6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.448220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6030bc-3e33-4060-9e00-1f36fe12a1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade28e98cad9481dbad4484d6da3d5a8, user_id=a296002e40fa4468a80f27207dbd07e5, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.451956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6030bc-3e33-4060-9e00-1f36fe12a1eb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.470208 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3471/6971] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:31 2022] PUT /identity/v3/projects/ade28e98cad9481dbad4484d6da3d5a8/users/a296002e40fa4468a80f27207dbd07e5/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:31.471342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6030bc-3e33-4060-9e00-1f36fe12a1eb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.499107 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3501/6972] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:31 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:31.501415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317b47-420e-4520-9744-0a575da9c9e9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.501780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317b47-420e-4520-9744-0a575da9c9e9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.502148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317b47-420e-4520-9744-0a575da9c9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.543823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1f317b47-420e-4520-9744-0a575da9c9e9 None None] MFA Rules not processed for user `a296002e40fa4468a80f27207dbd07e5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:31.545586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1f317b47-420e-4520-9744-0a575da9c9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:31.608086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6030bc-3e33-4060-9e00-1f36fe12a1eb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.647788 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3502/6973] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:31.647909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:31.647992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f317b47-420e-4520-9744-0a575da9c9e9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.693564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cf9e7-dcab-42cd-9127-2da6fb14aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.694293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cf9e7-dcab-42cd-9127-2da6fb14aa40 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.694718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cf9e7-dcab-42cd-9127-2da6fb14aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.695095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cf9e7-dcab-42cd-9127-2da6fb14aa40 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.695865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cf9e7-dcab-42cd-9127-2da6fb14aa40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.697616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cf9e7-dcab-42cd-9127-2da6fb14aa40 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.710627 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3472/6974] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:31.711616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cf9e7-dcab-42cd-9127-2da6fb14aa40 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.730180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f317b47-420e-4520-9744-0a575da9c9e9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.736223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cebdc8-f947-4168-9a6a-1571ed878e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.736850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cebdc8-f947-4168-9a6a-1571ed878e5a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.737129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cebdc8-f947-4168-9a6a-1571ed878e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.737420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cebdc8-f947-4168-9a6a-1571ed878e5a admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.738286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cebdc8-f947-4168-9a6a-1571ed878e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.740216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cebdc8-f947-4168-9a6a-1571ed878e5a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.741676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cf9e7-dcab-42cd-9127-2da6fb14aa40 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.753355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:31.755711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c57cf-9b10-42d5-af21-12e5c36eaccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.756546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c57cf-9b10-42d5-af21-12e5c36eaccb admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.756966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c57cf-9b10-42d5-af21-12e5c36eaccb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.757302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c57cf-9b10-42d5-af21-12e5c36eaccb admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.758114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c57cf-9b10-42d5-af21-12e5c36eaccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.762164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c57cf-9b10-42d5-af21-12e5c36eaccb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.776988 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3503/6975] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:31 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:31.778101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cebdc8-f947-4168-9a6a-1571ed878e5a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.789777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cebdc8-f947-4168-9a6a-1571ed878e5a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:31.795764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094f052-5a7c-4095-bded-3b3abd28aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:31.796576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094f052-5a7c-4095-bded-3b3abd28aa08 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:31.797130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094f052-5a7c-4095-bded-3b3abd28aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:31.798287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094f052-5a7c-4095-bded-3b3abd28aa08 admin admin] PATH_INFO: `/v3/projects/15a6da1b5a394191af53eb09eb1a934a/users/1421db8ced6042369a1a2904dc0ed7e6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:31.815751 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3473/6976] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:31 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:31.816689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c57cf-9b10-42d5-af21-12e5c36eaccb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.836588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094f052-5a7c-4095-bded-3b3abd28aa08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a6da1b5a394191af53eb09eb1a934a, user_id=1421db8ced6042369a1a2904dc0ed7e6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:31.839820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094f052-5a7c-4095-bded-3b3abd28aa08 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:31.871776 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3504/6977] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:31 2022] PUT /identity/v3/projects/15a6da1b5a394191af53eb09eb1a934a/users/1421db8ced6042369a1a2904dc0ed7e6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:31.872637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094f052-5a7c-4095-bded-3b3abd28aa08 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:31.943566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c57cf-9b10-42d5-af21-12e5c36eaccb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:32.040205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff33e3-44cf-4b56-b1d8-f4d41f59d8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:32.040892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094f052-5a7c-4095-bded-3b3abd28aa08 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:32.041701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff33e3-44cf-4b56-b1d8-f4d41f59d8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.041701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff33e3-44cf-4b56-b1d8-f4d41f59d8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.042994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff33e3-44cf-4b56-b1d8-f4d41f59d8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.043824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff33e3-44cf-4b56-b1d8-f4d41f59d8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:32.045931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff33e3-44cf-4b56-b1d8-f4d41f59d8e9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:32.056632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70b41-c892-4b60-a1da-1aa3969c58d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:32.063342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70b41-c892-4b60-a1da-1aa3969c58d8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.063342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70b41-c892-4b60-a1da-1aa3969c58d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.063342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70b41-c892-4b60-a1da-1aa3969c58d8 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.066512 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3474/6978] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:32.066697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f70b41-c892-4b60-a1da-1aa3969c58d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:32.067904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db3928-e9f5-40ca-a832-ce52f5b490ca None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.068217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db3928-e9f5-40ca-a832-ce52f5b490ca None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.068477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db3928-e9f5-40ca-a832-ce52f5b490ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.069137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f70b41-c892-4b60-a1da-1aa3969c58d8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:32.121506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-29db3928-e9f5-40ca-a832-ce52f5b490ca None None] MFA Rules not processed for user `1421db8ced6042369a1a2904dc0ed7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:32.123025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-29db3928-e9f5-40ca-a832-ce52f5b490ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:32.132655 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3505/6979] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:31 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:32.133798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70b41-c892-4b60-a1da-1aa3969c58d8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:32.154378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70b41-c892-4b60-a1da-1aa3969c58d8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:32.162919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:32.164334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.164701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.165046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] PATH_INFO: `/v3/users/53da0e92d545452e85ce4fdbf8b3df6f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.167451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=53da0e92d545452e85ce4fdbf8b3df6f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:32.170397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:32.188357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:32.284838 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3475/6980] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:32.287679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db3928-e9f5-40ca-a832-ce52f5b490ca None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:32.288494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53da0e92d545452e85ce4fdbf8b3df6f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:32.289605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53da0e92d545452e85ce4fdbf8b3df6f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:32.306974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53da0e92d545452e85ce4fdbf8b3df6f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:32.308592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53da0e92d545452e85ce4fdbf8b3df6f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:32.317946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53da0e92d545452e85ce4fdbf8b3df6f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:32.318930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db3928-e9f5-40ca-a832-ce52f5b490ca None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:32.332152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407bd06-4355-47f2-8d19-664b7d37c2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:32.333423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407bd06-4355-47f2-8d19-664b7d37c2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.334195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407bd06-4355-47f2-8d19-664b7d37c2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.334998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407bd06-4355-47f2-8d19-664b7d37c2f5 admin admin] PATH_INFO: `/v3/projects/8e1ef32bc30c49faa6292d87a363f69f/users/e9dcc4dbfe314decb6906233ac11cea0/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.342819 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3506/6981] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:32 2022] DELETE /identity/v3/users/53da0e92d545452e85ce4fdbf8b3df6f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:32.343944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:32.347330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:32.368157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407bd06-4355-47f2-8d19-664b7d37c2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1ef32bc30c49faa6292d87a363f69f, user_id=e9dcc4dbfe314decb6906233ac11cea0, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:32.372311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407bd06-4355-47f2-8d19-664b7d37c2f5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:32.393505 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3476/6982] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:32 2022] PUT /identity/v3/projects/8e1ef32bc30c49faa6292d87a363f69f/users/e9dcc4dbfe314decb6906233ac11cea0/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:32.397910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407bd06-4355-47f2-8d19-664b7d37c2f5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:32.402517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=7,keystone:SELECT=83,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:32.403007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6407bd06-4355-47f2-8d19-664b7d37c2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:32.480796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72091c-3295-4dc4-a0ad-9213ccc7f22d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:32.569781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e60305-a3f2-4d6a-ad28-0705cedba86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:32.570721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60305-a3f2-4d6a-ad28-0705cedba86f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.571004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60305-a3f2-4d6a-ad28-0705cedba86f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.571269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60305-a3f2-4d6a-ad28-0705cedba86f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.574519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e60305-a3f2-4d6a-ad28-0705cedba86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:32.576227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e60305-a3f2-4d6a-ad28-0705cedba86f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:32.590115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407bd06-4355-47f2-8d19-664b7d37c2f5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:32.590328 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3507/6983] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:32.591519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e173-dad5-4116-b33c-06cce927f036 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.591811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e173-dad5-4116-b33c-06cce927f036 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.592231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e173-dad5-4116-b33c-06cce927f036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.610750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b2842-e198-47f0-a28b-59a7fe698dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:32.611731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b2842-e198-47f0-a28b-59a7fe698dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.612265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b2842-e198-47f0-a28b-59a7fe698dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.613863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b2842-e198-47f0-a28b-59a7fe698dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.614287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b2842-e198-47f0-a28b-59a7fe698dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:32.623836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b2842-e198-47f0-a28b-59a7fe698dc9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:32.635216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-80d4e173-dad5-4116-b33c-06cce927f036 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:32.637074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-80d4e173-dad5-4116-b33c-06cce927f036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:32.647354 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3508/6984] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:32.648819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e173-dad5-4116-b33c-06cce927f036 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:32.650276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-80d4e173-dad5-4116-b33c-06cce927f036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:32.666259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e173-dad5-4116-b33c-06cce927f036 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:32.673324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b0934-86f7-4f1d-9cd1-6f450ae8633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:32.673973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0934-86f7-4f1d-9cd1-6f450ae8633c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.674255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0934-86f7-4f1d-9cd1-6f450ae8633c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.674635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0934-86f7-4f1d-9cd1-6f450ae8633c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.675387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b0934-86f7-4f1d-9cd1-6f450ae8633c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:32.677081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b0934-86f7-4f1d-9cd1-6f450ae8633c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:32.682956 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3477/6985] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:32 2022] POST /identity/v3/projects => generated 401 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:32.684553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b2842-e198-47f0-a28b-59a7fe698dc9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:32.691260 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3509/6986] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:32.697537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b0934-86f7-4f1d-9cd1-6f450ae8633c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:32.701632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-092b0934-86f7-4f1d-9cd1-6f450ae8633c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:32.784463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b0934-86f7-4f1d-9cd1-6f450ae8633c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:32.784729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b2842-e198-47f0-a28b-59a7fe698dc9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:32.790516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b449d-cc94-4ef9-ad5f-2eaf38482083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:32.791428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b449d-cc94-4ef9-ad5f-2eaf38482083 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.791760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b449d-cc94-4ef9-ad5f-2eaf38482083 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.792100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b449d-cc94-4ef9-ad5f-2eaf38482083 admin admin] PATH_INFO: `/v3/projects/d2e2fa527ebc42f0bd39f11722e3af2d/users/1415bfe15df8473b875eb633a3d8850f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.812981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b449d-cc94-4ef9-ad5f-2eaf38482083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e2fa527ebc42f0bd39f11722e3af2d, user_id=1415bfe15df8473b875eb633a3d8850f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:32.817046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b449d-cc94-4ef9-ad5f-2eaf38482083 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:32.838290 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3478/6987] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:32 2022] PUT /identity/v3/projects/d2e2fa527ebc42f0bd39f11722e3af2d/users/1415bfe15df8473b875eb633a3d8850f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:32.839894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b449d-cc94-4ef9-ad5f-2eaf38482083 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:32.856361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408a77b-4adb-442d-a0c2-a33f8c76cca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:32.857142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408a77b-4adb-442d-a0c2-a33f8c76cca7 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.857566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408a77b-4adb-442d-a0c2-a33f8c76cca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.857942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408a77b-4adb-442d-a0c2-a33f8c76cca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.867975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:32.870646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408a77b-4adb-442d-a0c2-a33f8c76cca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:32.873499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408a77b-4adb-442d-a0c2-a33f8c76cca7 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:32.886750 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3510/6988] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:32.887902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408a77b-4adb-442d-a0c2-a33f8c76cca7 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:32.898712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408a77b-4adb-442d-a0c2-a33f8c76cca7 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:32.909335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:32.915010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b449d-cc94-4ef9-ad5f-2eaf38482083 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:32.922448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732291f5-c73b-49fa-8a0c-c13b21d9ab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:32.923126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732291f5-c73b-49fa-8a0c-c13b21d9ab3d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.923414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732291f5-c73b-49fa-8a0c-c13b21d9ab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.923893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732291f5-c73b-49fa-8a0c-c13b21d9ab3d admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.924665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732291f5-c73b-49fa-8a0c-c13b21d9ab3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:32.927440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732291f5-c73b-49fa-8a0c-c13b21d9ab3d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:32.981807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e582d6-f545-48a8-902a-6ab69102e6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:32.982092 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3479/6989] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:32 2022] POST /identity/v3/users => generated 307 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:32.983065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e582d6-f545-48a8-902a-6ab69102e6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:32.984184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e582d6-f545-48a8-902a-6ab69102e6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:32.984382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732291f5-c73b-49fa-8a0c-c13b21d9ab3d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:32.984789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e582d6-f545-48a8-902a-6ab69102e6dc admin admin] PATH_INFO: `/v3/projects/8e1ef32bc30c49faa6292d87a363f69f/users/e9dcc4dbfe314decb6906233ac11cea0/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:32.987568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e582d6-f545-48a8-902a-6ab69102e6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1ef32bc30c49faa6292d87a363f69f, user_id=e9dcc4dbfe314decb6906233ac11cea0, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:32.991188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e582d6-f545-48a8-902a-6ab69102e6dc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:33.013532 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3511/6990] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:32 2022] PUT /identity/v3/projects/8e1ef32bc30c49faa6292d87a363f69f/users/e9dcc4dbfe314decb6906233ac11cea0/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:33.015076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e582d6-f545-48a8-902a-6ab69102e6dc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:33.028667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732291f5-c73b-49fa-8a0c-c13b21d9ab3d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:33.166332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e582d6-f545-48a8-902a-6ab69102e6dc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:33.175031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca1836-a502-4971-8e8f-cd6a82c4ace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:33.175466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca1836-a502-4971-8e8f-cd6a82c4ace4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.175783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca1836-a502-4971-8e8f-cd6a82c4ace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.176519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca1836-a502-4971-8e8f-cd6a82c4ace4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.176904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca1836-a502-4971-8e8f-cd6a82c4ace4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:33.184910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca1836-a502-4971-8e8f-cd6a82c4ace4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:33.186750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bf1c5-1c06-4326-bcf0-148ced5acc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:33.187483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bf1c5-1c06-4326-bcf0-148ced5acc7d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.187690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bf1c5-1c06-4326-bcf0-148ced5acc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.187933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bf1c5-1c06-4326-bcf0-148ced5acc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.188594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bf1c5-1c06-4326-bcf0-148ced5acc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:33.190353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bf1c5-1c06-4326-bcf0-148ced5acc7d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:33.202981 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3512/6991] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:33.204938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f78bd6-7189-4840-a811-aea6d5d40bdd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.205458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f78bd6-7189-4840-a811-aea6d5d40bdd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.205835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f78bd6-7189-4840-a811-aea6d5d40bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.220393 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3480/6992] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:33.221332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bf1c5-1c06-4326-bcf0-148ced5acc7d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:33.244091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-00f78bd6-7189-4840-a811-aea6d5d40bdd None None] MFA Rules not processed for user `e9dcc4dbfe314decb6906233ac11cea0`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:33.246123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-00f78bd6-7189-4840-a811-aea6d5d40bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:33.246807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bf1c5-1c06-4326-bcf0-148ced5acc7d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:33.259583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea96506-df09-4ddd-b97e-5e82a3d8ca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:33.260284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea96506-df09-4ddd-b97e-5e82a3d8ca60 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.260618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea96506-df09-4ddd-b97e-5e82a3d8ca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.260901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea96506-df09-4ddd-b97e-5e82a3d8ca60 admin admin] PATH_INFO: `/v3/projects/3027ca4d647746118828a8bfc235e653/users/e6ea8131b4b44e2f8fd1bbb017ad251c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.287932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea96506-df09-4ddd-b97e-5e82a3d8ca60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3027ca4d647746118828a8bfc235e653, user_id=e6ea8131b4b44e2f8fd1bbb017ad251c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:33.291176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea96506-df09-4ddd-b97e-5e82a3d8ca60 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:33.318007 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3481/6993] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:33 2022] PUT /identity/v3/projects/3027ca4d647746118828a8bfc235e653/users/e6ea8131b4b44e2f8fd1bbb017ad251c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:33.319780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea96506-df09-4ddd-b97e-5e82a3d8ca60 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:33.377886 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3513/6994] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:33.378776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f78bd6-7189-4840-a811-aea6d5d40bdd None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:33.390317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f78bd6-7189-4840-a811-aea6d5d40bdd None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:33.422350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:33.447425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea96506-df09-4ddd-b97e-5e82a3d8ca60 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:33.458774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3ffd6-d3a8-40d9-b714-3b9f070368d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:33.459460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ffd6-d3a8-40d9-b714-3b9f070368d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.459747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ffd6-d3a8-40d9-b714-3b9f070368d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.460029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ffd6-d3a8-40d9-b714-3b9f070368d4 admin admin] PATH_INFO: `/v3/projects/d2e2fa527ebc42f0bd39f11722e3af2d/users/1415bfe15df8473b875eb633a3d8850f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.464399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3ffd6-d3a8-40d9-b714-3b9f070368d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e2fa527ebc42f0bd39f11722e3af2d, user_id=1415bfe15df8473b875eb633a3d8850f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:33.465288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b9836-9147-41e1-8e6b-41d01fe66bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:33.466023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9836-9147-41e1-8e6b-41d01fe66bcf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.466394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9836-9147-41e1-8e6b-41d01fe66bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.466764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9836-9147-41e1-8e6b-41d01fe66bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.467120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3ffd6-d3a8-40d9-b714-3b9f070368d4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:33.467701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b9836-9147-41e1-8e6b-41d01fe66bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:33.471376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b9836-9147-41e1-8e6b-41d01fe66bcf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:33.490667 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3482/6995] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:33 2022] PUT /identity/v3/projects/d2e2fa527ebc42f0bd39f11722e3af2d/users/1415bfe15df8473b875eb633a3d8850f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:33.491711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3ffd6-d3a8-40d9-b714-3b9f070368d4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:33.492795 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3514/6996] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:33.493587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-15a3ffd6-d3a8-40d9-b714-3b9f070368d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:33.493787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b9836-9147-41e1-8e6b-41d01fe66bcf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:33.544517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:33.583361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b9836-9147-41e1-8e6b-41d01fe66bcf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:33.618899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3ffd6-d3a8-40d9-b714-3b9f070368d4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:33.624870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:33.626274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.626981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.627485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] PATH_INFO: `/v3/projects/1c4da2965a484d95b707987b6e8c7a1e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.629165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4da2965a484d95b707987b6e8c7a1e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:33.631464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:33.686780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f45c5-5290-4118-ab47-a10b54d2e71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:33.688380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f45c5-5290-4118-ab47-a10b54d2e71b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.688918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f45c5-5290-4118-ab47-a10b54d2e71b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.690205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f45c5-5290-4118-ab47-a10b54d2e71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.714942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4da2965a484d95b707987b6e8c7a1e', 'request_id': 'req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:33.730415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4da2965a484d95b707987b6e8c7a1e', 'request_id': 'req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:33.760265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4da2965a484d95b707987b6e8c7a1e', 'request_id': 'req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:33.785269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] The token cache is being invalidate because project 1c4da2965a484d95b707987b6e8c7a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:33.785947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:33.788044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8570d92d-0a47-4eb0-ad1a-0c736895b2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:33.790870 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3483/6997] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:33 2022] DELETE /identity/v3/projects/1c4da2965a484d95b707987b6e8c7a1e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:33.792483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd7684-dd74-4fc6-83f4-d5b6482d745a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.792986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd7684-dd74-4fc6-83f4-d5b6482d745a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.793334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd7684-dd74-4fc6-83f4-d5b6482d745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.818276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f45c5-5290-4118-ab47-a10b54d2e71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:33.820652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f45c5-5290-4118-ab47-a10b54d2e71b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:33.836125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f1dd7684-dd74-4fc6-83f4-d5b6482d745a None None] MFA Rules not processed for user `1415bfe15df8473b875eb633a3d8850f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:33.837658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f1dd7684-dd74-4fc6-83f4-d5b6482d745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:33.840936 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3515/6998] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:33.841916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f45c5-5290-4118-ab47-a10b54d2e71b service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:33.853402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f45c5-5290-4118-ab47-a10b54d2e71b service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:33.890948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:33.934956 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3484/6999] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:33.936063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd7684-dd74-4fc6-83f4-d5b6482d745a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:33.938384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013c0d-1b1b-4dfe-ab1b-2f08aff16d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:33.939171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013c0d-1b1b-4dfe-ab1b-2f08aff16d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:33.939451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013c0d-1b1b-4dfe-ab1b-2f08aff16d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:33.939727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013c0d-1b1b-4dfe-ab1b-2f08aff16d69 admin admin] PATH_INFO: `/v3/projects/3027ca4d647746118828a8bfc235e653/users/e6ea8131b4b44e2f8fd1bbb017ad251c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:33.941753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f1dd7684-dd74-4fc6-83f4-d5b6482d745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:33.943727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19013c0d-1b1b-4dfe-ab1b-2f08aff16d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3027ca4d647746118828a8bfc235e653, user_id=e6ea8131b4b44e2f8fd1bbb017ad251c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:33.947751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19013c0d-1b1b-4dfe-ab1b-2f08aff16d69 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:33.976310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd7684-dd74-4fc6-83f4-d5b6482d745a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:33.988978 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3516/7000] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:33 2022] PUT /identity/v3/projects/3027ca4d647746118828a8bfc235e653/users/e6ea8131b4b44e2f8fd1bbb017ad251c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:33.990201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013c0d-1b1b-4dfe-ab1b-2f08aff16d69 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:33.995004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-19013c0d-1b1b-4dfe-ab1b-2f08aff16d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:34.025293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:34.068941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6bb2-2391-462a-8a4a-013e9544e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:34.071353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6bb2-2391-462a-8a4a-013e9544e86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:34.072405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6bb2-2391-462a-8a4a-013e9544e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:34.072700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6bb2-2391-462a-8a4a-013e9544e86b admin admin] PATH_INFO: `/v3/users/246aa6a694004ba68f557a0b41e6ee50` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:34.077767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6bb2-2391-462a-8a4a-013e9544e86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=246aa6a694004ba68f557a0b41e6ee50)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:34.080681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6bb2-2391-462a-8a4a-013e9544e86b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:34.138404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013c0d-1b1b-4dfe-ab1b-2f08aff16d69 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:34.142715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ff59f-a421-4e49-af68-f2875d824753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:34.143779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff59f-a421-4e49-af68-f2875d824753 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:34.144062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff59f-a421-4e49-af68-f2875d824753 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:34.144330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff59f-a421-4e49-af68-f2875d824753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:34.151291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-761ff59f-a421-4e49-af68-f2875d824753 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:34.185802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-820d6bb2-2391-462a-8a4a-013e9544e86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246aa6a694004ba68f557a0b41e6ee50'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:34.187341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-820d6bb2-2391-462a-8a4a-013e9544e86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246aa6a694004ba68f557a0b41e6ee50'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:34.218545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-820d6bb2-2391-462a-8a4a-013e9544e86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246aa6a694004ba68f557a0b41e6ee50'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:34.231754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-820d6bb2-2391-462a-8a4a-013e9544e86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246aa6a694004ba68f557a0b41e6ee50'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:34.243648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-820d6bb2-2391-462a-8a4a-013e9544e86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246aa6a694004ba68f557a0b41e6ee50'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:34.248082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ff59f-a421-4e49-af68-f2875d824753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:34.251414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ff59f-a421-4e49-af68-f2875d824753 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:34.252456 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3485/7001] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:33 2022] DELETE /identity/v3/users/246aa6a694004ba68f557a0b41e6ee50 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:34.268558 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3517/7002] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:34.272948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbb2a5-ebf1-4ed2-99af-88c5207386e6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:34.273140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbb2a5-ebf1-4ed2-99af-88c5207386e6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:34.274894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbb2a5-ebf1-4ed2-99af-88c5207386e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:34.325145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8afbb2a5-ebf1-4ed2-99af-88c5207386e6 None None] MFA Rules not processed for user `e6ea8131b4b44e2f8fd1bbb017ad251c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:34.327005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8afbb2a5-ebf1-4ed2-99af-88c5207386e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:34.494019 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3486/7003] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:34 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:34.507298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ff59f-a421-4e49-af68-f2875d824753 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:34.509462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-761ff59f-a421-4e49-af68-f2875d824753 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:34.540698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ff59f-a421-4e49-af68-f2875d824753 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:34.645112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded70dd-3e60-414c-acc3-a7273a91e3ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:34.646935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded70dd-3e60-414c-acc3-a7273a91e3ea service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:34.650460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded70dd-3e60-414c-acc3-a7273a91e3ea service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:34.654820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded70dd-3e60-414c-acc3-a7273a91e3ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:34.721473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded70dd-3e60-414c-acc3-a7273a91e3ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:34.726934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded70dd-3e60-414c-acc3-a7273a91e3ea service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:34.761823 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3518/7004] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:34 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:34.892393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbb2a5-ebf1-4ed2-99af-88c5207386e6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:34.893864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8afbb2a5-ebf1-4ed2-99af-88c5207386e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:34.918968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbb2a5-ebf1-4ed2-99af-88c5207386e6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:34.929008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58eedda-6d3d-4e69-b96f-89da84e37b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:34.929751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eedda-6d3d-4e69-b96f-89da84e37b7a service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:34.930110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eedda-6d3d-4e69-b96f-89da84e37b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:34.930459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eedda-6d3d-4e69-b96f-89da84e37b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:34.932474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d58eedda-6d3d-4e69-b96f-89da84e37b7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:35.023184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:35.076316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58eedda-6d3d-4e69-b96f-89da84e37b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:35.078005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58eedda-6d3d-4e69-b96f-89da84e37b7a service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:35.090147 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3487/7005] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:35.100262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded70dd-3e60-414c-acc3-a7273a91e3ea service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:35.105040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bded70dd-3e60-414c-acc3-a7273a91e3ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:35.193636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:35.296700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded70dd-3e60-414c-acc3-a7273a91e3ea service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:35.308227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:35.309321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:35.310868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:35.311558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] PATH_INFO: `/v3/projects/f97ebe06f2e04d3fae9b6e951ecce6a4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:35.314913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97ebe06f2e04d3fae9b6e951ecce6a4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:35.319664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:35.453151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97ebe06f2e04d3fae9b6e951ecce6a4', 'request_id': 'req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:35.461942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97ebe06f2e04d3fae9b6e951ecce6a4', 'request_id': 'req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:35.477646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97ebe06f2e04d3fae9b6e951ecce6a4', 'request_id': 'req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:35.506817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] The token cache is being invalidate because project f97ebe06f2e04d3fae9b6e951ecce6a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:35.509532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:35.510178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e62f52a-e519-4a0a-82fe-823e4d5b09c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:35.517608 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3519/7006] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:35 2022] DELETE /identity/v3/projects/f97ebe06f2e04d3fae9b6e951ecce6a4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:35.519483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58239aa2-733d-47b5-ae7e-7c19e19f8d87 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:35.519646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58239aa2-733d-47b5-ae7e-7c19e19f8d87 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:35.519930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58239aa2-733d-47b5-ae7e-7c19e19f8d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:35.556765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-58239aa2-733d-47b5-ae7e-7c19e19f8d87 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:35.558615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-58239aa2-733d-47b5-ae7e-7c19e19f8d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:35.709483 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3488/7007] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:35.718320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f2e03-f96c-4e77-a1da-c8869c3fbf0f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:35.722466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f2e03-f96c-4e77-a1da-c8869c3fbf0f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:35.722921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f2e03-f96c-4e77-a1da-c8869c3fbf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:35.765339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-042f2e03-f96c-4e77-a1da-c8869c3fbf0f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:35.767619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-042f2e03-f96c-4e77-a1da-c8869c3fbf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:35.787829 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3520/7008] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:35.792639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58239aa2-733d-47b5-ae7e-7c19e19f8d87 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:35.811399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58239aa2-733d-47b5-ae7e-7c19e19f8d87 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:35.823612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b84b4-1a26-4f70-b372-0b8e9c0ccd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:35.825537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b84b4-1a26-4f70-b372-0b8e9c0ccd7b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:35.825831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b84b4-1a26-4f70-b372-0b8e9c0ccd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:35.827903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b84b4-1a26-4f70-b372-0b8e9c0ccd7b admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:35.828620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b84b4-1a26-4f70-b372-0b8e9c0ccd7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:35.830883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b84b4-1a26-4f70-b372-0b8e9c0ccd7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:35.835657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b84b4-1a26-4f70-b372-0b8e9c0ccd7b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:35.871935 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3489/7009] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:35.876467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f2e03-f96c-4e77-a1da-c8869c3fbf0f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:35.898774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f2e03-f96c-4e77-a1da-c8869c3fbf0f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:35.914615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d208b-8b82-42fe-8ea2-840fa043e1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:35.915250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d208b-8b82-42fe-8ea2-840fa043e1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:35.915558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d208b-8b82-42fe-8ea2-840fa043e1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:35.915969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d208b-8b82-42fe-8ea2-840fa043e1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:35.916583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d208b-8b82-42fe-8ea2-840fa043e1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:35.922633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d208b-8b82-42fe-8ea2-840fa043e1e3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:36.034110 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3521/7010] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:35 2022] POST /identity/v3/projects => generated 407 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:36.035323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b84b4-1a26-4f70-b372-0b8e9c0ccd7b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:36.052573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b84b4-1a26-4f70-b372-0b8e9c0ccd7b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:36.138880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5557ea-d97e-4643-b17f-291b35223cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:36.139534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5557ea-d97e-4643-b17f-291b35223cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:36.139821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5557ea-d97e-4643-b17f-291b35223cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:36.140102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5557ea-d97e-4643-b17f-291b35223cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:36.140762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5557ea-d97e-4643-b17f-291b35223cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:36.145032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5557ea-d97e-4643-b17f-291b35223cf8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:36.196367 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3490/7011] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:36 2022] POST /identity/v3/users => generated 304 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:36.203349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d208b-8b82-42fe-8ea2-840fa043e1e3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:36.216847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d208b-8b82-42fe-8ea2-840fa043e1e3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:36.229845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4753e75-0cdd-48a1-a402-57518c8fb14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:36.230484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4753e75-0cdd-48a1-a402-57518c8fb14a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:36.230765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4753e75-0cdd-48a1-a402-57518c8fb14a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:36.231045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4753e75-0cdd-48a1-a402-57518c8fb14a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:36.231700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4753e75-0cdd-48a1-a402-57518c8fb14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:36.233325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4753e75-0cdd-48a1-a402-57518c8fb14a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:36.263979 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3522/7012] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:36.268224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5557ea-d97e-4643-b17f-291b35223cf8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:36.289820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5557ea-d97e-4643-b17f-291b35223cf8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:36.299402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdfb12-6d75-463e-bda5-2e759e4e05bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:36.300041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdfb12-6d75-463e-bda5-2e759e4e05bd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:36.300344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdfb12-6d75-463e-bda5-2e759e4e05bd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:36.300609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdfb12-6d75-463e-bda5-2e759e4e05bd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:36.301269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdfb12-6d75-463e-bda5-2e759e4e05bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:36.302919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdfb12-6d75-463e-bda5-2e759e4e05bd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:36.329952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4753e75-0cdd-48a1-a402-57518c8fb14a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:36.330657 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3491/7013] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:36.355860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4753e75-0cdd-48a1-a402-57518c8fb14a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:36.389941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3954ea-b5bd-4c03-a58e-baf3cc22437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:36.390629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3954ea-b5bd-4c03-a58e-baf3cc22437e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:36.390906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3954ea-b5bd-4c03-a58e-baf3cc22437e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:36.391177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3954ea-b5bd-4c03-a58e-baf3cc22437e admin admin] PATH_INFO: `/v3/projects/e65df48ab13e4c73866ffdb1303f729b/users/1128966dc28e476d88bc785632c7ab06/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:36.457515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3954ea-b5bd-4c03-a58e-baf3cc22437e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65df48ab13e4c73866ffdb1303f729b, user_id=1128966dc28e476d88bc785632c7ab06, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:36.464961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3954ea-b5bd-4c03-a58e-baf3cc22437e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:36.514264 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3523/7014] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:36 2022] PUT /identity/v3/projects/e65df48ab13e4c73866ffdb1303f729b/users/1128966dc28e476d88bc785632c7ab06/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:36.524320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463aa64-81e5-49ec-8b08-c504d24afa77 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:36.524624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463aa64-81e5-49ec-8b08-c504d24afa77 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:36.565729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463aa64-81e5-49ec-8b08-c504d24afa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:36.641161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c463aa64-81e5-49ec-8b08-c504d24afa77 None None] MFA Rules not processed for user `1128966dc28e476d88bc785632c7ab06`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:36.648402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c463aa64-81e5-49ec-8b08-c504d24afa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:36.698623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:36.773999 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3492/7015] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:36 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:36.775287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3954ea-b5bd-4c03-a58e-baf3cc22437e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:36.866138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:36.930874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3954ea-b5bd-4c03-a58e-baf3cc22437e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:36.948356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c021d-1925-46cf-9ca0-8fe767f30494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:36.949682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c021d-1925-46cf-9ca0-8fe767f30494 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:36.950237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c021d-1925-46cf-9ca0-8fe767f30494 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:36.950816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c021d-1925-46cf-9ca0-8fe767f30494 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:36.952431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c021d-1925-46cf-9ca0-8fe767f30494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:36.959644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c021d-1925-46cf-9ca0-8fe767f30494 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:37.045011 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3524/7016] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:36 2022] POST /identity/v3/projects => generated 405 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:37.049465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463aa64-81e5-49ec-8b08-c504d24afa77 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:37.067492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463aa64-81e5-49ec-8b08-c504d24afa77 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:37.172813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c021d-1925-46cf-9ca0-8fe767f30494 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:37.175373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-054c021d-1925-46cf-9ca0-8fe767f30494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:37.215071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c3c5-cc45-4a48-aad9-a790e4cf3e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:37.215911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c3c5-cc45-4a48-aad9-a790e4cf3e6d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:37.216390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c3c5-cc45-4a48-aad9-a790e4cf3e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:37.216812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c3c5-cc45-4a48-aad9-a790e4cf3e6d admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:37.217701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695c3c5-cc45-4a48-aad9-a790e4cf3e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:37.225060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695c3c5-cc45-4a48-aad9-a790e4cf3e6d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:37.263144 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3493/7017] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:37 2022] POST /identity/v3/users => generated 309 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:55:37.265864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c3c5-cc45-4a48-aad9-a790e4cf3e6d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:37.289655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c3c5-cc45-4a48-aad9-a790e4cf3e6d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:37.302461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3e393-8198-4549-bc89-ef48999c53a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:37.303720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3e393-8198-4549-bc89-ef48999c53a9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:37.304819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3e393-8198-4549-bc89-ef48999c53a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:37.305160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3e393-8198-4549-bc89-ef48999c53a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:37.306618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3e393-8198-4549-bc89-ef48999c53a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:37.311753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3e393-8198-4549-bc89-ef48999c53a9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:37.328236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c021d-1925-46cf-9ca0-8fe767f30494 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:37.336486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa667f-239a-43a7-9e41-4aab096e721e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:37.337137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa667f-239a-43a7-9e41-4aab096e721e service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:37.337419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa667f-239a-43a7-9e41-4aab096e721e service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:37.337744 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3494/7018] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:37.338051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa667f-239a-43a7-9e41-4aab096e721e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:37.339886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3e393-8198-4549-bc89-ef48999c53a9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:37.343530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-eeaa667f-239a-43a7-9e41-4aab096e721e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:37.359023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3e393-8198-4549-bc89-ef48999c53a9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:37.372981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361e488-3a8a-41ce-8936-3ac0e0fe1a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:37.373715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361e488-3a8a-41ce-8936-3ac0e0fe1a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:37.373992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361e488-3a8a-41ce-8936-3ac0e0fe1a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:37.374263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361e488-3a8a-41ce-8936-3ac0e0fe1a83 admin admin] PATH_INFO: `/v3/projects/5e591244fc1f49b3adc083f02069c11f/users/dfef2b18aa36438da8f25188148e9304/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:37.407734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361e488-3a8a-41ce-8936-3ac0e0fe1a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e591244fc1f49b3adc083f02069c11f, user_id=dfef2b18aa36438da8f25188148e9304, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:37.410661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361e488-3a8a-41ce-8936-3ac0e0fe1a83 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:37.443929 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3495/7019] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:37 2022] PUT /identity/v3/projects/5e591244fc1f49b3adc083f02069c11f/users/dfef2b18aa36438da8f25188148e9304/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:37.448219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361e488-3a8a-41ce-8936-3ac0e0fe1a83 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:37.482403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa667f-239a-43a7-9e41-4aab096e721e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:37.485962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa667f-239a-43a7-9e41-4aab096e721e service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:37.513899 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3525/7020] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:37.602480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361e488-3a8a-41ce-8936-3ac0e0fe1a83 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:37.607755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758fe5d-46bf-4698-8048-9021355c8e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:37.608378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758fe5d-46bf-4698-8048-9021355c8e29 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:37.608657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758fe5d-46bf-4698-8048-9021355c8e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:37.608929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758fe5d-46bf-4698-8048-9021355c8e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:37.610196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758fe5d-46bf-4698-8048-9021355c8e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:37.611809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758fe5d-46bf-4698-8048-9021355c8e29 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:37.640591 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3496/7021] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:37.643249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa667f-239a-43a7-9e41-4aab096e721e service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:37.663750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa667f-239a-43a7-9e41-4aab096e721e service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:37.690124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929e52-d568-41b6-8125-6c7f36ea3a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:37.693758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929e52-d568-41b6-8125-6c7f36ea3a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:37.694173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929e52-d568-41b6-8125-6c7f36ea3a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:37.694874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929e52-d568-41b6-8125-6c7f36ea3a8e admin admin] PATH_INFO: `/v3/projects/5e591244fc1f49b3adc083f02069c11f/users/dfef2b18aa36438da8f25188148e9304/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:37.706705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea929e52-d568-41b6-8125-6c7f36ea3a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e591244fc1f49b3adc083f02069c11f, user_id=dfef2b18aa36438da8f25188148e9304, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:37.709571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea929e52-d568-41b6-8125-6c7f36ea3a8e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:37.736141 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3526/7022] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:37 2022] PUT /identity/v3/projects/5e591244fc1f49b3adc083f02069c11f/users/dfef2b18aa36438da8f25188148e9304/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:37.737981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3ffec-e35e-40b4-9c1b-5487d1b737fb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:37.738512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3ffec-e35e-40b4-9c1b-5487d1b737fb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:37.738954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3ffec-e35e-40b4-9c1b-5487d1b737fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:37.860222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0bd3ffec-e35e-40b4-9c1b-5487d1b737fb None None] MFA Rules not processed for user `dfef2b18aa36438da8f25188148e9304`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:37.862547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0bd3ffec-e35e-40b4-9c1b-5487d1b737fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:37.875136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:38.059250 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3497/7023] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:37 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:38.070712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929e52-d568-41b6-8125-6c7f36ea3a8e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:38.073282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ea929e52-d568-41b6-8125-6c7f36ea3a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:38.153313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929e52-d568-41b6-8125-6c7f36ea3a8e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:38.158763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67843c7b-7ac2-4b31-a844-67112cba2d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:38.160616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67843c7b-7ac2-4b31-a844-67112cba2d1f service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:38.161013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67843c7b-7ac2-4b31-a844-67112cba2d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:38.161361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67843c7b-7ac2-4b31-a844-67112cba2d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:38.191135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:38.237230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67843c7b-7ac2-4b31-a844-67112cba2d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:38.238907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67843c7b-7ac2-4b31-a844-67112cba2d1f service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:38.265915 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3527/7024] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:38 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:55:39.218238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3ffec-e35e-40b4-9c1b-5487d1b737fb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:39.219952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0bd3ffec-e35e-40b4-9c1b-5487d1b737fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:39.445069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3ffec-e35e-40b4-9c1b-5487d1b737fb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:39.457919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fbe92-9e24-4c25-ae10-b3e7ad32b0fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:39.458660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fbe92-9e24-4c25-ae10-b3e7ad32b0fd service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:39.459015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fbe92-9e24-4c25-ae10-b3e7ad32b0fd service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:39.459376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fbe92-9e24-4c25-ae10-b3e7ad32b0fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:39.478767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fbe92-9e24-4c25-ae10-b3e7ad32b0fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:39.484816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fbe92-9e24-4c25-ae10-b3e7ad32b0fd service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:39.509034 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3498/7025] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:39 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:43.734038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67843c7b-7ac2-4b31-a844-67112cba2d1f service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:43.736176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-67843c7b-7ac2-4b31-a844-67112cba2d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:43.843637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fbe92-9e24-4c25-ae10-b3e7ad32b0fd service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:43.847562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bb0fbe92-9e24-4c25-ae10-b3e7ad32b0fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:43.859074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67843c7b-7ac2-4b31-a844-67112cba2d1f service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:43.877656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4e302-4298-4e59-8928-3c14aab1c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:43.880103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4e302-4298-4e59-8928-3c14aab1c6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:43.882251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4e302-4298-4e59-8928-3c14aab1c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:43.882647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4e302-4298-4e59-8928-3c14aab1c6c0 admin admin] PATH_INFO: `/v3/users/1421db8ced6042369a1a2904dc0ed7e6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:43.886434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4e302-4298-4e59-8928-3c14aab1c6c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1421db8ced6042369a1a2904dc0ed7e6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:43.890253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4e302-4298-4e59-8928-3c14aab1c6c0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:44.017005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88d4e302-4298-4e59-8928-3c14aab1c6c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1421db8ced6042369a1a2904dc0ed7e6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:44.018849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88d4e302-4298-4e59-8928-3c14aab1c6c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1421db8ced6042369a1a2904dc0ed7e6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:44.032004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fbe92-9e24-4c25-ae10-b3e7ad32b0fd service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:44.039062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88d4e302-4298-4e59-8928-3c14aab1c6c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1421db8ced6042369a1a2904dc0ed7e6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:44.039922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88d4e302-4298-4e59-8928-3c14aab1c6c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1421db8ced6042369a1a2904dc0ed7e6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:44.045591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76913c74-50fe-416a-bba1-4cf4ea8dfd0d tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcc4dbfe314decb6906233ac11cea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1ef32bc30c49faa6292d87a363f69f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:44.046527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76913c74-50fe-416a-bba1-4cf4ea8dfd0d tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:44.048149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76913c74-50fe-416a-bba1-4cf4ea8dfd0d tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:44.048604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76913c74-50fe-416a-bba1-4cf4ea8dfd0d tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:44.049025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88d4e302-4298-4e59-8928-3c14aab1c6c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1421db8ced6042369a1a2904dc0ed7e6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:44.051801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76913c74-50fe-416a-bba1-4cf4ea8dfd0d tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:44.052541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76913c74-50fe-416a-bba1-4cf4ea8dfd0d tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:44.061845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76913c74-50fe-416a-bba1-4cf4ea8dfd0d tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:44.071214 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3528/7026] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:43 2022] DELETE /identity/v3/users/1421db8ced6042369a1a2904dc0ed7e6 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:44.074104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7608c55-03a6-4e57-88e0-bb0c101f9a6a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:44.074566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7608c55-03a6-4e57-88e0-bb0c101f9a6a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:44.074963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7608c55-03a6-4e57-88e0-bb0c101f9a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:44.086572 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3499/7027] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:44.089641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aad9d-ea71-41d8-82da-e85a285e9d1f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:44.090091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aad9d-ea71-41d8-82da-e85a285e9d1f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:44.090520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aad9d-ea71-41d8-82da-e85a285e9d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:44.103167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c7608c55-03a6-4e57-88e0-bb0c101f9a6a None None] MFA Rules not processed for user `74602998065943c4a49a96d23ec0ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:44.104673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c7608c55-03a6-4e57-88e0-bb0c101f9a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:44.127507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ba6aad9d-ea71-41d8-82da-e85a285e9d1f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:44.129085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ba6aad9d-ea71-41d8-82da-e85a285e9d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:44.161427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:44.172707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:44.225109 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3529/7028] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:44.225109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7608c55-03a6-4e57-88e0-bb0c101f9a6a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:44.250098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c7608c55-03a6-4e57-88e0-bb0c101f9a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:44.273754 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3500/7029] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:44.289731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aad9d-ea71-41d8-82da-e85a285e9d1f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:44.293340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ba6aad9d-ea71-41d8-82da-e85a285e9d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:44.396745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7608c55-03a6-4e57-88e0-bb0c101f9a6a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:44.410498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cc2dc-c69f-477d-863a-f5fbf5d06306 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcc4dbfe314decb6906233ac11cea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1ef32bc30c49faa6292d87a363f69f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:44.412570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc2dc-c69f-477d-863a-f5fbf5d06306 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:44.412570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc2dc-c69f-477d-863a-f5fbf5d06306 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:44.412570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc2dc-c69f-477d-863a-f5fbf5d06306 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:44.412570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cc2dc-c69f-477d-863a-f5fbf5d06306 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:44.414409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cc2dc-c69f-477d-863a-f5fbf5d06306 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:44.417607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aad9d-ea71-41d8-82da-e85a285e9d1f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:44.424323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd01411-a368-4e79-be9d-8fd3772de906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:44.425046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd01411-a368-4e79-be9d-8fd3772de906 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:44.425430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd01411-a368-4e79-be9d-8fd3772de906 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:44.426039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd01411-a368-4e79-be9d-8fd3772de906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:44.446236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd01411-a368-4e79-be9d-8fd3772de906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:44.448448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd01411-a368-4e79-be9d-8fd3772de906 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:44.475931 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3530/7030] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:44 2022] POST /identity/v3/projects => generated 348 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:44.477184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cc2dc-c69f-477d-863a-f5fbf5d06306 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:44.502770 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3501/7031] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:55:44.629625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cc2dc-c69f-477d-863a-f5fbf5d06306 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:44.646270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ab203-020f-473b-9208-145cb0b148c3 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcc4dbfe314decb6906233ac11cea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1ef32bc30c49faa6292d87a363f69f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:44.647062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ab203-020f-473b-9208-145cb0b148c3 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:44.647451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ab203-020f-473b-9208-145cb0b148c3 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:44.647831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ab203-020f-473b-9208-145cb0b148c3 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:44.648741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ab203-020f-473b-9208-145cb0b148c3 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:44.649146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ab203-020f-473b-9208-145cb0b148c3 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:44.650985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ab203-020f-473b-9208-145cb0b148c3 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:44.677880 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3531/7032] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:45.982427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd01411-a368-4e79-be9d-8fd3772de906 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:45.990576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ab203-020f-473b-9208-145cb0b148c3 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:45.992347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-af4ab203-020f-473b-9208-145cb0b148c3 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:46.000788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd01411-a368-4e79-be9d-8fd3772de906 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:46.018695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcc4dbfe314decb6906233ac11cea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1ef32bc30c49faa6292d87a363f69f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:46.019060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:46.019349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:46.019630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] PATH_INFO: `/v3/projects/76228f05dd104aacb7d64325fa97167a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:46.021986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: Authorizing `identity:delete_project(project_id=76228f05dd104aacb7d64325fa97167a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:46.023920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:46.133966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76228f05dd104aacb7d64325fa97167a', 'request_id': 'req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.151623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76228f05dd104aacb7d64325fa97167a', 'request_id': 'req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.178877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76228f05dd104aacb7d64325fa97167a', 'request_id': 'req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.182568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ab203-020f-473b-9208-145cb0b148c3 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:46.209206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:46.212528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] The token cache is being invalidate because project 76228f05dd104aacb7d64325fa97167a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:46.214312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.215849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.219558 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3502/7033] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:45 2022] DELETE /identity/v3/projects/76228f05dd104aacb7d64325fa97167a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:46.237943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:46.240717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:46.341417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:46.342346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:46.342989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:46.343333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] PATH_INFO: `/v3/projects/15a6da1b5a394191af53eb09eb1a934a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:46.344654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a6da1b5a394191af53eb09eb1a934a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:46.347519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:46.361544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:46.394915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2efe4e-8e81-47ea-a326-c91f2a9724e6 tempest-RoutersAdminTest-1313831639 tempest-RoutersAdminTest-1313831639-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:46.403931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb8e01-63e7-4254-bec0-bdd54be03156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:46.409966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8e01-63e7-4254-bec0-bdd54be03156 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:46.410348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8e01-63e7-4254-bec0-bdd54be03156 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:46.411250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8e01-63e7-4254-bec0-bdd54be03156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:46.416264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e0cb8e01-63e7-4254-bec0-bdd54be03156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:46.464188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a6da1b5a394191af53eb09eb1a934a', 'request_id': 'req-da481136-d833-49cc-acf7-36dabc522cc5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.484752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a6da1b5a394191af53eb09eb1a934a', 'request_id': 'req-da481136-d833-49cc-acf7-36dabc522cc5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.503384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a6da1b5a394191af53eb09eb1a934a', 'request_id': 'req-da481136-d833-49cc-acf7-36dabc522cc5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.520498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] The token cache is being invalidate because project 15a6da1b5a394191af53eb09eb1a934a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:46.520799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.523144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.529485 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3532/7034] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:45 2022] DELETE /identity/v3/projects/15a6da1b5a394191af53eb09eb1a934a => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:46.534069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:46.541048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:46.596576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb8e01-63e7-4254-bec0-bdd54be03156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:46.597760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb8e01-63e7-4254-bec0-bdd54be03156 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:46.617436 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3503/7035] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:46.650341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da481136-d833-49cc-acf7-36dabc522cc5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:46.666190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775ea06-40b5-4285-a1fc-6929b3a20010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:46.666190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ea06-40b5-4285-a1fc-6929b3a20010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:46.666190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ea06-40b5-4285-a1fc-6929b3a20010 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:46.666190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ea06-40b5-4285-a1fc-6929b3a20010 admin admin] PATH_INFO: `/v3/users/e6ea8131b4b44e2f8fd1bbb017ad251c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:46.669120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775ea06-40b5-4285-a1fc-6929b3a20010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ea8131b4b44e2f8fd1bbb017ad251c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:46.673397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775ea06-40b5-4285-a1fc-6929b3a20010 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:46.782034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9775ea06-40b5-4285-a1fc-6929b3a20010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ea8131b4b44e2f8fd1bbb017ad251c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.782786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9775ea06-40b5-4285-a1fc-6929b3a20010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ea8131b4b44e2f8fd1bbb017ad251c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.784500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:46.827571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9775ea06-40b5-4285-a1fc-6929b3a20010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ea8131b4b44e2f8fd1bbb017ad251c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.828437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9775ea06-40b5-4285-a1fc-6929b3a20010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ea8131b4b44e2f8fd1bbb017ad251c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.840810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-9775ea06-40b5-4285-a1fc-6929b3a20010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ea8131b4b44e2f8fd1bbb017ad251c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:46.865484 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3533/7036] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:46 2022] DELETE /identity/v3/users/e6ea8131b4b44e2f8fd1bbb017ad251c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:47.883400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb8e01-63e7-4254-bec0-bdd54be03156 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:47.886218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e0cb8e01-63e7-4254-bec0-bdd54be03156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:47.903608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb8e01-63e7-4254-bec0-bdd54be03156 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:47.992601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:47.993061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:47.993451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:47.993708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] PATH_INFO: `/v3/users/a296002e40fa4468a80f27207dbd07e5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:47.995482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a296002e40fa4468a80f27207dbd07e5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:47.997627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:48.107250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a296002e40fa4468a80f27207dbd07e5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:48.109660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a296002e40fa4468a80f27207dbd07e5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:48.131090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a296002e40fa4468a80f27207dbd07e5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:48.142493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a296002e40fa4468a80f27207dbd07e5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:48.154575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a296002e40fa4468a80f27207dbd07e5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:48.164533 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3504/7037] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:47 2022] DELETE /identity/v3/users/a296002e40fa4468a80f27207dbd07e5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:48.170091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8e8b6-e285-47f5-aa3a-ed0ba6b33302 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:48.170595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8e8b6-e285-47f5-aa3a-ed0ba6b33302 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:48.170690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8e8b6-e285-47f5-aa3a-ed0ba6b33302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:48.191951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f9b8e8b6-e285-47f5-aa3a-ed0ba6b33302 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:48.193329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f9b8e8b6-e285-47f5-aa3a-ed0ba6b33302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:48.274580 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3534/7038] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:48.305536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:48.308115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:48.370290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:48.466996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b457c2f-f007-41af-87e6-cf07f7f4e2d3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:48.475073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5336bc0-4620-4b4f-b54c-b32c92e94b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:48.476139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5336bc0-4620-4b4f-b54c-b32c92e94b50 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:48.477372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5336bc0-4620-4b4f-b54c-b32c92e94b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:48.478384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5336bc0-4620-4b4f-b54c-b32c92e94b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:48.490749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8e8b6-e285-47f5-aa3a-ed0ba6b33302 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:48.494189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f9b8e8b6-e285-47f5-aa3a-ed0ba6b33302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:48.500403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5336bc0-4620-4b4f-b54c-b32c92e94b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:48.502410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5336bc0-4620-4b4f-b54c-b32c92e94b50 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:48.519858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8e8b6-e285-47f5-aa3a-ed0ba6b33302 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:48.525170 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3505/7039] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:48.526581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:48.527318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:48.527690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:48.528046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] PATH_INFO: `/v3/projects/3027ca4d647746118828a8bfc235e653` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:48.530909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3027ca4d647746118828a8bfc235e653)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:48.534022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:48.654297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3027ca4d647746118828a8bfc235e653', 'request_id': 'req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:48.668844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3027ca4d647746118828a8bfc235e653', 'request_id': 'req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:48.679689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3027ca4d647746118828a8bfc235e653', 'request_id': 'req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:48.698175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] The token cache is being invalidate because project 3027ca4d647746118828a8bfc235e653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:48.698506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:48.699467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d92f2094-5544-4b9f-b17b-77a0e4e87b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:48.706230 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3535/7040] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:48 2022] DELETE /identity/v3/projects/3027ca4d647746118828a8bfc235e653 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:48.709732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7bca-6b7d-4b88-9d66-f58b4a6f2f60 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:48.710301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7bca-6b7d-4b88-9d66-f58b4a6f2f60 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:48.710795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7bca-6b7d-4b88-9d66-f58b4a6f2f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:48.737613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-42ff7bca-6b7d-4b88-9d66-f58b4a6f2f60 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:48.740164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42ff7bca-6b7d-4b88-9d66-f58b4a6f2f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:48.839356 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3506/7041] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:48.842320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfedeca-9bf9-4d34-9cfb-9a82821b52d1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:48.842851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfedeca-9bf9-4d34-9cfb-9a82821b52d1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:48.843358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfedeca-9bf9-4d34-9cfb-9a82821b52d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:48.872513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3dfedeca-9bf9-4d34-9cfb-9a82821b52d1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:48.874371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3dfedeca-9bf9-4d34-9cfb-9a82821b52d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:48.892143 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3536/7042] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:48.895608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff7bca-6b7d-4b88-9d66-f58b4a6f2f60 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:48.915583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff7bca-6b7d-4b88-9d66-f58b4a6f2f60 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:48.924733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1950a-4351-499e-9f99-8246f7656a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:48.925872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1950a-4351-499e-9f99-8246f7656a61 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:48.926309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1950a-4351-499e-9f99-8246f7656a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:48.926767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1950a-4351-499e-9f99-8246f7656a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:48.927582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1950a-4351-499e-9f99-8246f7656a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:48.928040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1950a-4351-499e-9f99-8246f7656a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:48.930480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1950a-4351-499e-9f99-8246f7656a61 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:48.952626 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3507/7043] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:48.954921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfedeca-9bf9-4d34-9cfb-9a82821b52d1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:48.969351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfedeca-9bf9-4d34-9cfb-9a82821b52d1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:48.977202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02204c9-1a35-426e-b2a9-cac543db5436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:48.978301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02204c9-1a35-426e-b2a9-cac543db5436 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:48.979037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02204c9-1a35-426e-b2a9-cac543db5436 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:48.979639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02204c9-1a35-426e-b2a9-cac543db5436 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:48.980559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02204c9-1a35-426e-b2a9-cac543db5436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:48.982939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02204c9-1a35-426e-b2a9-cac543db5436 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:49.077741 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3537/7044] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:48 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:49.083328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1950a-4351-499e-9f99-8246f7656a61 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:49.095895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1950a-4351-499e-9f99-8246f7656a61 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:49.176474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def8668-8e45-4c86-ad2c-6a9bb990152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:49.176474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8668-8e45-4c86-ad2c-6a9bb990152c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:49.176474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8668-8e45-4c86-ad2c-6a9bb990152c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:49.176843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8668-8e45-4c86-ad2c-6a9bb990152c admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:49.177380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def8668-8e45-4c86-ad2c-6a9bb990152c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:49.179766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def8668-8e45-4c86-ad2c-6a9bb990152c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:49.210643 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3508/7045] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:49 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:49.214772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02204c9-1a35-426e-b2a9-cac543db5436 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:49.228381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02204c9-1a35-426e-b2a9-cac543db5436 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:49.234136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8605dd-f253-4513-a95c-e23a031243c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:49.234714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8605dd-f253-4513-a95c-e23a031243c6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:49.235010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8605dd-f253-4513-a95c-e23a031243c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:49.235660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8605dd-f253-4513-a95c-e23a031243c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:49.236174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8605dd-f253-4513-a95c-e23a031243c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:49.238101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8605dd-f253-4513-a95c-e23a031243c6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:49.251125 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3538/7046] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:55:49.254996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def8668-8e45-4c86-ad2c-6a9bb990152c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:49.271903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def8668-8e45-4c86-ad2c-6a9bb990152c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:49.285616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6d5e-81da-46a8-95de-6d1872ce81a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:49.286287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6d5e-81da-46a8-95de-6d1872ce81a5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:49.286573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6d5e-81da-46a8-95de-6d1872ce81a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:49.286854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6d5e-81da-46a8-95de-6d1872ce81a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:49.287775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6d5e-81da-46a8-95de-6d1872ce81a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:49.291460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6d5e-81da-46a8-95de-6d1872ce81a5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:49.306261 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3509/7047] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:49.310767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8605dd-f253-4513-a95c-e23a031243c6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:49.344779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8605dd-f253-4513-a95c-e23a031243c6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:49.357853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b949b1-d947-4ac9-8f17-70de671ffa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:49.360772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b949b1-d947-4ac9-8f17-70de671ffa32 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:49.363830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b949b1-d947-4ac9-8f17-70de671ffa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:49.364982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b949b1-d947-4ac9-8f17-70de671ffa32 admin admin] PATH_INFO: `/v3/projects/760879e08e76487882b3c951ea527f98/users/707d3ee536524835a6d39951cd8d903b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:49.370646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:49.379397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6d5e-81da-46a8-95de-6d1872ce81a5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:49.381414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b48a6d5e-81da-46a8-95de-6d1872ce81a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:49.407138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6d5e-81da-46a8-95de-6d1872ce81a5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:49.416972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b949b1-d947-4ac9-8f17-70de671ffa32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760879e08e76487882b3c951ea527f98, user_id=707d3ee536524835a6d39951cd8d903b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:49.420060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b949b1-d947-4ac9-8f17-70de671ffa32 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:49.423838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:49.424570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:49.424775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:49.425138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] PATH_INFO: `/v3/projects/ade28e98cad9481dbad4484d6da3d5a8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:49.434766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade28e98cad9481dbad4484d6da3d5a8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:49.437034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:49.458694 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3539/7048] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:49 2022] PUT /identity/v3/projects/760879e08e76487882b3c951ea527f98/users/707d3ee536524835a6d39951cd8d903b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:49.473786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3480d-3c3c-48b4-a67f-a4be8e494ce8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:49.474392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3480d-3c3c-48b4-a67f-a4be8e494ce8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:49.474866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3480d-3c3c-48b4-a67f-a4be8e494ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:49.498844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:49.527178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a1b3480d-3c3c-48b4-a67f-a4be8e494ce8 None None] MFA Rules not processed for user `707d3ee536524835a6d39951cd8d903b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:49.528753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a1b3480d-3c3c-48b4-a67f-a4be8e494ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:49.570609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade28e98cad9481dbad4484d6da3d5a8', 'request_id': 'req-aa48a617-417a-4b41-abad-3ef5ab285797'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:49.583130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade28e98cad9481dbad4484d6da3d5a8', 'request_id': 'req-aa48a617-417a-4b41-abad-3ef5ab285797'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:49.600509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade28e98cad9481dbad4484d6da3d5a8', 'request_id': 'req-aa48a617-417a-4b41-abad-3ef5ab285797'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:49.644262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] The token cache is being invalidate because project ade28e98cad9481dbad4484d6da3d5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:49.644597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:49.646995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:49.651071 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3510/7049] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:49 2022] DELETE /identity/v3/projects/ade28e98cad9481dbad4484d6da3d5a8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:49.655194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:49.660193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:49.667723 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3540/7050] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:49.668764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3480d-3c3c-48b4-a67f-a4be8e494ce8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:49.823016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48a617-417a-4b41-abad-3ef5ab285797 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:49.823798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3480d-3c3c-48b4-a67f-a4be8e494ce8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:49.828702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:49.829361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:49.829674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:49.829955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] PATH_INFO: `/v3/users/1415bfe15df8473b875eb633a3d8850f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:49.831552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1415bfe15df8473b875eb633a3d8850f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:49.831689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70289c-1385-4f23-9f6e-0948994267c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:49.832316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70289c-1385-4f23-9f6e-0948994267c9 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:49.832902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70289c-1385-4f23-9f6e-0948994267c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:49.833183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70289c-1385-4f23-9f6e-0948994267c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:49.833524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:49.833845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70289c-1385-4f23-9f6e-0948994267c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:49.837370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70289c-1385-4f23-9f6e-0948994267c9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:49.895078 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3541/7051] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:49 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:49.903193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70289c-1385-4f23-9f6e-0948994267c9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:49.907393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1a70289c-1385-4f23-9f6e-0948994267c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:49.935076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1415bfe15df8473b875eb633a3d8850f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:49.937789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1415bfe15df8473b875eb633a3d8850f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:49.993266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1415bfe15df8473b875eb633a3d8850f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:50.011987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1415bfe15df8473b875eb633a3d8850f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:50.027932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1415bfe15df8473b875eb633a3d8850f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:50.038521 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3511/7052] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:49 2022] DELETE /identity/v3/users/1415bfe15df8473b875eb633a3d8850f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:50.063116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70289c-1385-4f23-9f6e-0948994267c9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:50.068232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:50.153534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f468f6-1e6a-44e2-9344-70cb06e72dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:50.154348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f468f6-1e6a-44e2-9344-70cb06e72dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:50.154670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f468f6-1e6a-44e2-9344-70cb06e72dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:50.154998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f468f6-1e6a-44e2-9344-70cb06e72dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:50.155900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f468f6-1e6a-44e2-9344-70cb06e72dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:50.157620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f468f6-1e6a-44e2-9344-70cb06e72dc2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:50.189844 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3542/7053] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:49 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:50.191611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:50.193982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:50.216387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606606b1-7c1c-4d15-a7b2-97f5ed4e1a56 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:50.222100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73ffa1-c373-44ab-b0f7-654cd10e5513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:50.222729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73ffa1-c373-44ab-b0f7-654cd10e5513 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:50.223008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73ffa1-c373-44ab-b0f7-654cd10e5513 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:50.223285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73ffa1-c373-44ab-b0f7-654cd10e5513 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:50.224000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73ffa1-c373-44ab-b0f7-654cd10e5513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:50.226258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73ffa1-c373-44ab-b0f7-654cd10e5513 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:50.241936 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3512/7054] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:50.243341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f468f6-1e6a-44e2-9344-70cb06e72dc2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:50.254989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f468f6-1e6a-44e2-9344-70cb06e72dc2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:50.262871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b76ed1-088d-4494-8491-c1c94844a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:50.263684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b76ed1-088d-4494-8491-c1c94844a89e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:50.263986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b76ed1-088d-4494-8491-c1c94844a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:50.264241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b76ed1-088d-4494-8491-c1c94844a89e admin admin] PATH_INFO: `/v3/projects/cc5d9b8b83dd4ba9b094e9ab3d45ebd9/users/36a9f8c83a7e4228b7e794e8181b180e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:50.281087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b76ed1-088d-4494-8491-c1c94844a89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5d9b8b83dd4ba9b094e9ab3d45ebd9, user_id=36a9f8c83a7e4228b7e794e8181b180e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:50.283974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b76ed1-088d-4494-8491-c1c94844a89e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:50.305433 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3543/7055] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:50 2022] PUT /identity/v3/projects/cc5d9b8b83dd4ba9b094e9ab3d45ebd9/users/36a9f8c83a7e4228b7e794e8181b180e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:50.309331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73ffa1-c373-44ab-b0f7-654cd10e5513 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:50.323742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73ffa1-c373-44ab-b0f7-654cd10e5513 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:50.341528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:50.405031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08023d-2613-482d-b026-3d7ac44651ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:50.405618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08023d-2613-482d-b026-3d7ac44651ad admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:50.405899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08023d-2613-482d-b026-3d7ac44651ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:50.406173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08023d-2613-482d-b026-3d7ac44651ad admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:50.406819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08023d-2613-482d-b026-3d7ac44651ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:50.408420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08023d-2613-482d-b026-3d7ac44651ad admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:50.421530 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3513/7056] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:50.426396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b76ed1-088d-4494-8491-c1c94844a89e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:50.447199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b76ed1-088d-4494-8491-c1c94844a89e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:50.453091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f116b2-4fcd-4059-9358-1736721aa0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:50.453971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f116b2-4fcd-4059-9358-1736721aa0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:50.454340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f116b2-4fcd-4059-9358-1736721aa0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:50.454981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f116b2-4fcd-4059-9358-1736721aa0b7 admin admin] PATH_INFO: `/v3/projects/cc5d9b8b83dd4ba9b094e9ab3d45ebd9/users/36a9f8c83a7e4228b7e794e8181b180e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:50.457800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f116b2-4fcd-4059-9358-1736721aa0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5d9b8b83dd4ba9b094e9ab3d45ebd9, user_id=36a9f8c83a7e4228b7e794e8181b180e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:50.461116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f116b2-4fcd-4059-9358-1736721aa0b7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:50.476099 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3544/7057] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:50 2022] PUT /identity/v3/projects/cc5d9b8b83dd4ba9b094e9ab3d45ebd9/users/36a9f8c83a7e4228b7e794e8181b180e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:50.488127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688f3d8-850b-4a5d-8f34-c8e1941119b6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:50.488862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688f3d8-850b-4a5d-8f34-c8e1941119b6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:50.489708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688f3d8-850b-4a5d-8f34-c8e1941119b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:50.527188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8688f3d8-850b-4a5d-8f34-c8e1941119b6 None None] MFA Rules not processed for user `36a9f8c83a7e4228b7e794e8181b180e`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:50.528611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8688f3d8-850b-4a5d-8f34-c8e1941119b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:50.649321 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3514/7058] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:50.662170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f116b2-4fcd-4059-9358-1736721aa0b7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:50.664361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-06f116b2-4fcd-4059-9358-1736721aa0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:50.778318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f116b2-4fcd-4059-9358-1736721aa0b7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:50.782996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba82ebb-2a2f-4228-90ce-04cb5d412fbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:50.783868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba82ebb-2a2f-4228-90ce-04cb5d412fbe service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:50.784443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba82ebb-2a2f-4228-90ce-04cb5d412fbe service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:50.784752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba82ebb-2a2f-4228-90ce-04cb5d412fbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:50.788740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cba82ebb-2a2f-4228-90ce-04cb5d412fbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:50.882622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba82ebb-2a2f-4228-90ce-04cb5d412fbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:50.884803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba82ebb-2a2f-4228-90ce-04cb5d412fbe service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:50.902866 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3545/7059] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:51.003519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688f3d8-850b-4a5d-8f34-c8e1941119b6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:51.004900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8688f3d8-850b-4a5d-8f34-c8e1941119b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:51.152146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688f3d8-850b-4a5d-8f34-c8e1941119b6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:51.160268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:51.161812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:51.162919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:51.163928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] PATH_INFO: `/v3/projects/d2e2fa527ebc42f0bd39f11722e3af2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:51.165907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e2fa527ebc42f0bd39f11722e3af2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:51.168357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:51.249003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:51.280159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e2fa527ebc42f0bd39f11722e3af2d', 'request_id': 'req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:51.303062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e2fa527ebc42f0bd39f11722e3af2d', 'request_id': 'req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:51.318423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e2fa527ebc42f0bd39f11722e3af2d', 'request_id': 'req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:51.341435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] The token cache is being invalidate because project d2e2fa527ebc42f0bd39f11722e3af2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:51.342381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:51.344001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2c2fc37c-f6df-4f4a-9c21-2d61287d9fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:51.349995 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3515/7060] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:51 2022] DELETE /identity/v3/projects/d2e2fa527ebc42f0bd39f11722e3af2d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:51.354831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54d26f-74f9-4d17-ad16-2ec91ca1f143 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:51.355470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54d26f-74f9-4d17-ad16-2ec91ca1f143 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:51.355470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54d26f-74f9-4d17-ad16-2ec91ca1f143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:51.409594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cc54d26f-74f9-4d17-ad16-2ec91ca1f143 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:51.411168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cc54d26f-74f9-4d17-ad16-2ec91ca1f143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:51.428083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:51.570746 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3546/7061] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:51.579708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b071520-ea5e-402e-a9d9-da946d800fe6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:51.580246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b071520-ea5e-402e-a9d9-da946d800fe6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:51.580950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b071520-ea5e-402e-a9d9-da946d800fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:51.650322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2b071520-ea5e-402e-a9d9-da946d800fe6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:51.654079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2b071520-ea5e-402e-a9d9-da946d800fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:51.684295 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3516/7062] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:51.688663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54d26f-74f9-4d17-ad16-2ec91ca1f143 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:51.708260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54d26f-74f9-4d17-ad16-2ec91ca1f143 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:51.722933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06495069-e3f2-4b73-bc7c-46106a936ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:51.723697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06495069-e3f2-4b73-bc7c-46106a936ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:51.724144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06495069-e3f2-4b73-bc7c-46106a936ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:51.724443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06495069-e3f2-4b73-bc7c-46106a936ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:51.725351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06495069-e3f2-4b73-bc7c-46106a936ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:51.725985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06495069-e3f2-4b73-bc7c-46106a936ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:51.742967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06495069-e3f2-4b73-bc7c-46106a936ea1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:51.774528 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3547/7063] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:51.778919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b071520-ea5e-402e-a9d9-da946d800fe6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:51.793071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b071520-ea5e-402e-a9d9-da946d800fe6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:51.804900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071279ae-ddc8-41b6-bf3f-5fb6fc80e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:51.805630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071279ae-ddc8-41b6-bf3f-5fb6fc80e65a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:51.806021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071279ae-ddc8-41b6-bf3f-5fb6fc80e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:51.806417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071279ae-ddc8-41b6-bf3f-5fb6fc80e65a admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:51.807715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071279ae-ddc8-41b6-bf3f-5fb6fc80e65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:51.811481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071279ae-ddc8-41b6-bf3f-5fb6fc80e65a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:51.862538 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3517/7064] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:51 2022] POST /identity/v3/projects => generated 407 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:51.867763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06495069-e3f2-4b73-bc7c-46106a936ea1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:51.895168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06495069-e3f2-4b73-bc7c-46106a936ea1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:52.058308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdea8d-288c-4b5f-920f-cb19c354ef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:52.060983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdea8d-288c-4b5f-920f-cb19c354ef94 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:52.061276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdea8d-288c-4b5f-920f-cb19c354ef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:52.064890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdea8d-288c-4b5f-920f-cb19c354ef94 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:52.065714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdea8d-288c-4b5f-920f-cb19c354ef94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:52.067726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdea8d-288c-4b5f-920f-cb19c354ef94 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:52.109921 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3548/7065] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:51 2022] POST /identity/v3/users => generated 304 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:52.112913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071279ae-ddc8-41b6-bf3f-5fb6fc80e65a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:52.130553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071279ae-ddc8-41b6-bf3f-5fb6fc80e65a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:52.143782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74ffdf-ae2e-4b97-85eb-71b38f56776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:52.144421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74ffdf-ae2e-4b97-85eb-71b38f56776e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:52.146964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74ffdf-ae2e-4b97-85eb-71b38f56776e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:52.147366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74ffdf-ae2e-4b97-85eb-71b38f56776e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:52.149207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74ffdf-ae2e-4b97-85eb-71b38f56776e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:52.155463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74ffdf-ae2e-4b97-85eb-71b38f56776e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:52.184221 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3518/7066] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:52.185495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdea8d-288c-4b5f-920f-cb19c354ef94 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:52.197537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdea8d-288c-4b5f-920f-cb19c354ef94 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:52.210445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00671166-5a11-404e-865a-c23665008c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:52.211524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00671166-5a11-404e-865a-c23665008c16 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:52.212021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00671166-5a11-404e-865a-c23665008c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:52.212400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00671166-5a11-404e-865a-c23665008c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:52.213855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00671166-5a11-404e-865a-c23665008c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:52.216853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00671166-5a11-404e-865a-c23665008c16 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:52.294234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74ffdf-ae2e-4b97-85eb-71b38f56776e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:52.295980 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3549/7067] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:52.322584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74ffdf-ae2e-4b97-85eb-71b38f56776e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:52.355478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f174c0c-2cd9-4863-9afc-8a7cb836fcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:52.358108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174c0c-2cd9-4863-9afc-8a7cb836fcb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:52.358398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174c0c-2cd9-4863-9afc-8a7cb836fcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:52.358681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174c0c-2cd9-4863-9afc-8a7cb836fcb5 admin admin] PATH_INFO: `/v3/projects/d21affdfe1b54a2391441ec22eeafbda/users/4d3c358944514314b0ceeab261073ab6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:52.418483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f174c0c-2cd9-4863-9afc-8a7cb836fcb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21affdfe1b54a2391441ec22eeafbda, user_id=4d3c358944514314b0ceeab261073ab6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:52.421423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f174c0c-2cd9-4863-9afc-8a7cb836fcb5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:52.450958 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3519/7068] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:52 2022] PUT /identity/v3/projects/d21affdfe1b54a2391441ec22eeafbda/users/4d3c358944514314b0ceeab261073ab6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:55:52.462044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd978e-27d2-4f63-9c14-eb0c967210d0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:52.462585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd978e-27d2-4f63-9c14-eb0c967210d0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:52.462585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd978e-27d2-4f63-9c14-eb0c967210d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:52.523257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-85dd978e-27d2-4f63-9c14-eb0c967210d0 None None] MFA Rules not processed for user `4d3c358944514314b0ceeab261073ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:52.524790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-85dd978e-27d2-4f63-9c14-eb0c967210d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:52.724844 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3550/7069] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:52 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:52.731136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f174c0c-2cd9-4863-9afc-8a7cb836fcb5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:52.842626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f174c0c-2cd9-4863-9afc-8a7cb836fcb5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:52.848919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c6943-07ad-4982-a6cf-549fe2b68900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:52.849816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6943-07ad-4982-a6cf-549fe2b68900 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:52.850948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6943-07ad-4982-a6cf-549fe2b68900 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:52.851340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6943-07ad-4982-a6cf-549fe2b68900 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:52.852346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c6943-07ad-4982-a6cf-549fe2b68900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:52.855164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c6943-07ad-4982-a6cf-549fe2b68900 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:52.908961 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3520/7070] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:52 2022] POST /identity/v3/projects => generated 409 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:52.912612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd978e-27d2-4f63-9c14-eb0c967210d0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:52.955619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd978e-27d2-4f63-9c14-eb0c967210d0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:52.969839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:53.055538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bed6f-b68e-4b81-b43f-60bdb0e0f20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:53.056180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bed6f-b68e-4b81-b43f-60bdb0e0f20c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:53.056464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bed6f-b68e-4b81-b43f-60bdb0e0f20c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:53.056739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bed6f-b68e-4b81-b43f-60bdb0e0f20c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:53.058143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bed6f-b68e-4b81-b43f-60bdb0e0f20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:53.062219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bed6f-b68e-4b81-b43f-60bdb0e0f20c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:53.120122 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3551/7071] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:52 2022] POST /identity/v3/users => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:53.121607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c6943-07ad-4982-a6cf-549fe2b68900 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:53.137120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c6943-07ad-4982-a6cf-549fe2b68900 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:53.152539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bfca8-576c-4b81-bab7-08af94807fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:53.152539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bfca8-576c-4b81-bab7-08af94807fdc admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:53.152539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bfca8-576c-4b81-bab7-08af94807fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:53.152978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bfca8-576c-4b81-bab7-08af94807fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:53.154286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bfca8-576c-4b81-bab7-08af94807fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:53.155696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bfca8-576c-4b81-bab7-08af94807fdc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:53.181629 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3521/7072] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:53.182974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bed6f-b68e-4b81-b43f-60bdb0e0f20c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:53.193571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bed6f-b68e-4b81-b43f-60bdb0e0f20c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:53.207250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84e4d9-364a-499c-bdb5-6a1cdcea3f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:53.208407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84e4d9-364a-499c-bdb5-6a1cdcea3f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:53.208691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84e4d9-364a-499c-bdb5-6a1cdcea3f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:53.209202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84e4d9-364a-499c-bdb5-6a1cdcea3f81 admin admin] PATH_INFO: `/v3/projects/432121536e624a7399134b0d201eb7c1/users/7375afd819834435886724c280b30941/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:53.235071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84e4d9-364a-499c-bdb5-6a1cdcea3f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432121536e624a7399134b0d201eb7c1, user_id=7375afd819834435886724c280b30941, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:53.238282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84e4d9-364a-499c-bdb5-6a1cdcea3f81 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:53.266357 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3552/7073] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:53 2022] PUT /identity/v3/projects/432121536e624a7399134b0d201eb7c1/users/7375afd819834435886724c280b30941/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:53.270534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bfca8-576c-4b81-bab7-08af94807fdc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:53.285679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bfca8-576c-4b81-bab7-08af94807fdc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:53.371197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:53.401272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904031c-ef73-4839-8189-1f2ff2b34c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:53.403219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904031c-ef73-4839-8189-1f2ff2b34c51 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:53.403657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904031c-ef73-4839-8189-1f2ff2b34c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:53.404070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904031c-ef73-4839-8189-1f2ff2b34c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:53.405190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904031c-ef73-4839-8189-1f2ff2b34c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:53.407334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904031c-ef73-4839-8189-1f2ff2b34c51 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:53.425006 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3522/7074] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:55:53.426879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84e4d9-364a-499c-bdb5-6a1cdcea3f81 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:53.448194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84e4d9-364a-499c-bdb5-6a1cdcea3f81 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:53.457710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d53e5-93f4-486c-8424-3357f4b4ec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:53.459474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d53e5-93f4-486c-8424-3357f4b4ec90 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:53.459894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d53e5-93f4-486c-8424-3357f4b4ec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:53.461122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d53e5-93f4-486c-8424-3357f4b4ec90 admin admin] PATH_INFO: `/v3/projects/432121536e624a7399134b0d201eb7c1/users/7375afd819834435886724c280b30941/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:53.464644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d53e5-93f4-486c-8424-3357f4b4ec90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432121536e624a7399134b0d201eb7c1, user_id=7375afd819834435886724c280b30941, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:53.470337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d53e5-93f4-486c-8424-3357f4b4ec90 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:53.487471 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3553/7075] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:53 2022] PUT /identity/v3/projects/432121536e624a7399134b0d201eb7c1/users/7375afd819834435886724c280b30941/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:53.508921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d2339-4fe7-4b7b-8c0d-79711117142b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:53.509545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d2339-4fe7-4b7b-8c0d-79711117142b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:53.510574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d2339-4fe7-4b7b-8c0d-79711117142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:53.546511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-218d2339-4fe7-4b7b-8c0d-79711117142b None None] MFA Rules not processed for user `7375afd819834435886724c280b30941`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:53.549347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-218d2339-4fe7-4b7b-8c0d-79711117142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:53.744075 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3523/7076] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:53 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:53.756870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d53e5-93f4-486c-8424-3357f4b4ec90 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:53.758776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-557d53e5-93f4-486c-8424-3357f4b4ec90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:53.868966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d53e5-93f4-486c-8424-3357f4b4ec90 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:53.874473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cba58-f7f1-40b7-bf28-c6ff4562ee24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:53.875371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cba58-f7f1-40b7-bf28-c6ff4562ee24 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:53.876423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cba58-f7f1-40b7-bf28-c6ff4562ee24 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:53.876925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cba58-f7f1-40b7-bf28-c6ff4562ee24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:53.891367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cba58-f7f1-40b7-bf28-c6ff4562ee24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:53.894022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cba58-f7f1-40b7-bf28-c6ff4562ee24 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:53.908077 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3554/7077] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:53 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:54.159310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d2339-4fe7-4b7b-8c0d-79711117142b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:54.172479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d2339-4fe7-4b7b-8c0d-79711117142b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:54.176660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b5f2-4f83-4521-9262-b96234f3d2e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:54.177466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b5f2-4f83-4521-9262-b96234f3d2e3 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:54.177757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b5f2-4f83-4521-9262-b96234f3d2e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:54.178041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b5f2-4f83-4521-9262-b96234f3d2e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:54.280763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9b5f2-4f83-4521-9262-b96234f3d2e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:54.285115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9b5f2-4f83-4521-9262-b96234f3d2e3 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:54.314806 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3524/7078] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:54 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:55.877854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cba58-f7f1-40b7-bf28-c6ff4562ee24 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:55.880661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a04cba58-f7f1-40b7-bf28-c6ff4562ee24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:55.989365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cba58-f7f1-40b7-bf28-c6ff4562ee24 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:55.995591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:55.996395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:55.996687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:55.996966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] PATH_INFO: `/v3/users/1128966dc28e476d88bc785632c7ab06` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:55.998432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1128966dc28e476d88bc785632c7ab06)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:56.000512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:56.010428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:56.070533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1128966dc28e476d88bc785632c7ab06'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:56.071196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1128966dc28e476d88bc785632c7ab06'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:56.083837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1128966dc28e476d88bc785632c7ab06'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:56.084631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1128966dc28e476d88bc785632c7ab06'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:56.092594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1128966dc28e476d88bc785632c7ab06'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:56.108328 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3555/7079] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:55 2022] DELETE /identity/v3/users/1128966dc28e476d88bc785632c7ab06 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:56.112889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775165-572e-4a17-8099-283d0a05a6d2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:56.113418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775165-572e-4a17-8099-283d0a05a6d2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:56.113806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775165-572e-4a17-8099-283d0a05a6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:56.133318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a4775165-572e-4a17-8099-283d0a05a6d2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:56.134501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a4775165-572e-4a17-8099-283d0a05a6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:56.191689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:56.205904 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3525/7080] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:56.227296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:56.228689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:56.296953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ffd91-37dc-488b-92a4-e1fd53b51812 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:56.302912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97fefb-c7a1-4293-a854-c1ddf48a4923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:56.303924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97fefb-c7a1-4293-a854-c1ddf48a4923 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:56.304211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97fefb-c7a1-4293-a854-c1ddf48a4923 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:56.304505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97fefb-c7a1-4293-a854-c1ddf48a4923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:56.315280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97fefb-c7a1-4293-a854-c1ddf48a4923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:56.317240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97fefb-c7a1-4293-a854-c1ddf48a4923 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:56.329121 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3556/7081] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:56.787879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4775165-572e-4a17-8099-283d0a05a6d2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:56.789851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a4775165-572e-4a17-8099-283d0a05a6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:56.808236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4775165-572e-4a17-8099-283d0a05a6d2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:56.814231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:56.815105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:56.815547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:56.815993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] PATH_INFO: `/v3/projects/e65df48ab13e4c73866ffdb1303f729b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:56.817356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65df48ab13e4c73866ffdb1303f729b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:56.819751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:56.923204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65df48ab13e4c73866ffdb1303f729b', 'request_id': 'req-6458c442-0205-4769-a841-d9f89e234bcd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:56.930863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65df48ab13e4c73866ffdb1303f729b', 'request_id': 'req-6458c442-0205-4769-a841-d9f89e234bcd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:56.943984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65df48ab13e4c73866ffdb1303f729b', 'request_id': 'req-6458c442-0205-4769-a841-d9f89e234bcd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:56.973944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] The token cache is being invalidate because project e65df48ab13e4c73866ffdb1303f729b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:56.973944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:56.974472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:56.982528 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3526/7082] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:56 2022] DELETE /identity/v3/projects/e65df48ab13e4c73866ffdb1303f729b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:56.983473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97fefb-c7a1-4293-a854-c1ddf48a4923 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:57.003661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97fefb-c7a1-4293-a854-c1ddf48a4923 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:57.168674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4f1df-fa5f-4471-9549-1855c31170a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:57.169335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4f1df-fa5f-4471-9549-1855c31170a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:57.169652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4f1df-fa5f-4471-9549-1855c31170a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:57.169932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4f1df-fa5f-4471-9549-1855c31170a8 admin admin] PATH_INFO: `/v3/users/dfef2b18aa36438da8f25188148e9304` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:57.178343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4f1df-fa5f-4471-9549-1855c31170a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfef2b18aa36438da8f25188148e9304)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:57.180255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4f1df-fa5f-4471-9549-1855c31170a8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:57.237888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:57.277348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ccf4f1df-fa5f-4471-9549-1855c31170a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfef2b18aa36438da8f25188148e9304'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.278174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ccf4f1df-fa5f-4471-9549-1855c31170a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfef2b18aa36438da8f25188148e9304'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.305922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ccf4f1df-fa5f-4471-9549-1855c31170a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfef2b18aa36438da8f25188148e9304'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.307506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ccf4f1df-fa5f-4471-9549-1855c31170a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfef2b18aa36438da8f25188148e9304'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.326864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ccf4f1df-fa5f-4471-9549-1855c31170a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfef2b18aa36438da8f25188148e9304'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:57.357162 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3557/7083] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:55:56 2022] DELETE /identity/v3/users/dfef2b18aa36438da8f25188148e9304 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:57.917049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:57.919000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:57.949703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458c442-0205-4769-a841-d9f89e234bcd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:58.118180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:58.125887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:58.126311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:58.127243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] PATH_INFO: `/v3/projects/5e591244fc1f49b3adc083f02069c11f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:58.131176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e591244fc1f49b3adc083f02069c11f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:58.139733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:58.264750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e591244fc1f49b3adc083f02069c11f', 'request_id': 'req-a05a1b97-daed-465d-a553-0c2fa96e50e4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:58.286717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e591244fc1f49b3adc083f02069c11f', 'request_id': 'req-a05a1b97-daed-465d-a553-0c2fa96e50e4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:58.304457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e591244fc1f49b3adc083f02069c11f', 'request_id': 'req-a05a1b97-daed-465d-a553-0c2fa96e50e4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:58.335605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] The token cache is being invalidate because project 5e591244fc1f49b3adc083f02069c11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:55:58.337140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:58.337976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a05a1b97-daed-465d-a553-0c2fa96e50e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:55:58.340443 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3527/7084] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:55:57 2022] DELETE /identity/v3/projects/5e591244fc1f49b3adc083f02069c11f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:58.345203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e8df-d025-4710-ac9b-ef12aeee27b9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:58.345723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e8df-d025-4710-ac9b-ef12aeee27b9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:58.345823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e8df-d025-4710-ac9b-ef12aeee27b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:58.370659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-20a7e8df-d025-4710-ac9b-ef12aeee27b9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:58.374392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-20a7e8df-d025-4710-ac9b-ef12aeee27b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:58.478288 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3558/7085] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:58.486861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a698d69-716f-4ab5-a5a9-82afbf34a210 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:58.492214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a698d69-716f-4ab5-a5a9-82afbf34a210 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:58.492214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a698d69-716f-4ab5-a5a9-82afbf34a210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:58.524369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5a698d69-716f-4ab5-a5a9-82afbf34a210 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:58.526707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5a698d69-716f-4ab5-a5a9-82afbf34a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:58.552461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7e8df-d025-4710-ac9b-ef12aeee27b9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:58.562437 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3528/7086] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:55:58.565609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7e8df-d025-4710-ac9b-ef12aeee27b9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:58.574837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851eca0-c08f-490c-8e0c-782d7ef9d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:58.575887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851eca0-c08f-490c-8e0c-782d7ef9d7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:58.576987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851eca0-c08f-490c-8e0c-782d7ef9d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:58.578232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851eca0-c08f-490c-8e0c-782d7ef9d7f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:58.579667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851eca0-c08f-490c-8e0c-782d7ef9d7f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:55:58.580770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851eca0-c08f-490c-8e0c-782d7ef9d7f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:58.583814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851eca0-c08f-490c-8e0c-782d7ef9d7f1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:58.610709 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3559/7087] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:55:58.611653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a698d69-716f-4ab5-a5a9-82afbf34a210 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:58.624022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a698d69-716f-4ab5-a5a9-82afbf34a210 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:58.657827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9e1db-ba77-403c-871f-df8874ba0908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:58.659384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9e1db-ba77-403c-871f-df8874ba0908 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:58.659900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9e1db-ba77-403c-871f-df8874ba0908 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:58.660757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9e1db-ba77-403c-871f-df8874ba0908 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:58.661707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9e1db-ba77-403c-871f-df8874ba0908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:58.667876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9e1db-ba77-403c-871f-df8874ba0908 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:58.683326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:58.745920 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3529/7088] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:58 2022] POST /identity/v3/projects => generated 357 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:55:58.750384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851eca0-c08f-490c-8e0c-782d7ef9d7f1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:58.772162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851eca0-c08f-490c-8e0c-782d7ef9d7f1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:58.972955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b059b-3470-42fb-bdc8-141f734d79e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:58.973621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b059b-3470-42fb-bdc8-141f734d79e0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:58.973909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b059b-3470-42fb-bdc8-141f734d79e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:58.974186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b059b-3470-42fb-bdc8-141f734d79e0 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:58.974835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b059b-3470-42fb-bdc8-141f734d79e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:58.988649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b059b-3470-42fb-bdc8-141f734d79e0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.065343 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3560/7089] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:58 2022] POST /identity/v3/users => generated 279 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:59.066591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9e1db-ba77-403c-871f-df8874ba0908 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.082178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9e1db-ba77-403c-871f-df8874ba0908 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.096866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1287a29-7c01-441a-9da7-928060732973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.097544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1287a29-7c01-441a-9da7-928060732973 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.097837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1287a29-7c01-441a-9da7-928060732973 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.098198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1287a29-7c01-441a-9da7-928060732973 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.098864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1287a29-7c01-441a-9da7-928060732973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:59.110979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1287a29-7c01-441a-9da7-928060732973 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.134505 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3530/7090] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:55:59.139180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b059b-3470-42fb-bdc8-141f734d79e0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.156581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b059b-3470-42fb-bdc8-141f734d79e0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.169610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f952-56c4-4802-861b-773ed927e87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.170239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f952-56c4-4802-861b-773ed927e87d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.170538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f952-56c4-4802-861b-773ed927e87d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.170830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f952-56c4-4802-861b-773ed927e87d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.178826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f952-56c4-4802-861b-773ed927e87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:59.183315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f952-56c4-4802-861b-773ed927e87d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.232778 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3561/7091] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:55:59.234428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1287a29-7c01-441a-9da7-928060732973 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.250367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1287a29-7c01-441a-9da7-928060732973 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.261116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4560bb6-d82a-4ec8-abb1-6ac35c5aa004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.262451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4560bb6-d82a-4ec8-abb1-6ac35c5aa004 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.263088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4560bb6-d82a-4ec8-abb1-6ac35c5aa004 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.263759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4560bb6-d82a-4ec8-abb1-6ac35c5aa004 admin admin] PATH_INFO: `/v3/projects/58d9df9c86cc447895bd29f2adc2ba65/users/155ba188b3b9453299537dd20080a881/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.286574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4560bb6-d82a-4ec8-abb1-6ac35c5aa004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d9df9c86cc447895bd29f2adc2ba65, user_id=155ba188b3b9453299537dd20080a881, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:59.292273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4560bb6-d82a-4ec8-abb1-6ac35c5aa004 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.329460 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3531/7092] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:55:59 2022] PUT /identity/v3/projects/58d9df9c86cc447895bd29f2adc2ba65/users/155ba188b3b9453299537dd20080a881/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:55:59.329640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f952-56c4-4802-861b-773ed927e87d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.333792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7348f952-56c4-4802-861b-773ed927e87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:59.370752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:59.428250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888de25b-ad5e-4c24-b1fe-2cc3e597ed82 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.428640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888de25b-ad5e-4c24-b1fe-2cc3e597ed82 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.429010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888de25b-ad5e-4c24-b1fe-2cc3e597ed82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.467448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-888de25b-ad5e-4c24-b1fe-2cc3e597ed82 None None] MFA Rules not processed for user `155ba188b3b9453299537dd20080a881`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:55:59.469292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-888de25b-ad5e-4c24-b1fe-2cc3e597ed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:59.470031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f952-56c4-4802-861b-773ed927e87d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.612462 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3532/7093] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:55:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:55:59.617849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888de25b-ad5e-4c24-b1fe-2cc3e597ed82 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:55:59.672345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0714d06-4e74-4449-83d7-e44e1de90918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.672986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714d06-4e74-4449-83d7-e44e1de90918 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.673375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714d06-4e74-4449-83d7-e44e1de90918 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.673749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714d06-4e74-4449-83d7-e44e1de90918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.677742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f0714d06-4e74-4449-83d7-e44e1de90918 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:55:59.785482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888de25b-ad5e-4c24-b1fe-2cc3e597ed82 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:55:59.831957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f5cd-d01a-45e5-bbb4-a64542c9933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:55:59.833359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f5cd-d01a-45e5-bbb4-a64542c9933e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:55:59.833925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f5cd-d01a-45e5-bbb4-a64542c9933e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:55:59.834279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f5cd-d01a-45e5-bbb4-a64542c9933e admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:55:59.846094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8f5cd-d01a-45e5-bbb4-a64542c9933e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:55:59.847778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8f5cd-d01a-45e5-bbb4-a64542c9933e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:55:59.966343 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3533/7094] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:55:59 2022] POST /identity/v3/projects => generated 355 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:55:59.969108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f5cd-d01a-45e5-bbb4-a64542c9933e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:00.010782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0714d06-4e74-4449-83d7-e44e1de90918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:00.015006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0714d06-4e74-4449-83d7-e44e1de90918 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:00.032684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:00.052367 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3562/7095] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:55:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:00.151685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f5cd-d01a-45e5-bbb4-a64542c9933e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:00.169151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f0c0d-ce3e-491d-b32d-1f90e4459f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:00.170531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f0c0d-ce3e-491d-b32d-1f90e4459f87 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:00.170531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f0c0d-ce3e-491d-b32d-1f90e4459f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:00.170531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f0c0d-ce3e-491d-b32d-1f90e4459f87 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:00.171447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f0c0d-ce3e-491d-b32d-1f90e4459f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:00.174513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f0c0d-ce3e-491d-b32d-1f90e4459f87 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:00.205337 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3534/7096] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:55:59 2022] POST /identity/v3/users => generated 284 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:00.209802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0714d06-4e74-4449-83d7-e44e1de90918 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:00.238245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0714d06-4e74-4449-83d7-e44e1de90918 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:00.252158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a7755-74c1-4752-8da2-961ece3ee0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:00.254604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a7755-74c1-4752-8da2-961ece3ee0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:00.255055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a7755-74c1-4752-8da2-961ece3ee0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:00.255343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a7755-74c1-4752-8da2-961ece3ee0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:00.257935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a7755-74c1-4752-8da2-961ece3ee0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:00.263106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a7755-74c1-4752-8da2-961ece3ee0f1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:00.294868 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3563/7097] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:00.298810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f0c0d-ce3e-491d-b32d-1f90e4459f87 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:00.315096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f0c0d-ce3e-491d-b32d-1f90e4459f87 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:00.332490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621590a-b56c-439a-a7b8-d84543d437be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:00.335158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621590a-b56c-439a-a7b8-d84543d437be admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:00.335585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621590a-b56c-439a-a7b8-d84543d437be admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:00.336355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621590a-b56c-439a-a7b8-d84543d437be admin admin] PATH_INFO: `/v3/projects/7b69cacb188f45d4b7a08a70b7ccad54/users/ffe8d12b7e4843aaac79bd7fd992a04e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:00.400153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621590a-b56c-439a-a7b8-d84543d437be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b69cacb188f45d4b7a08a70b7ccad54, user_id=ffe8d12b7e4843aaac79bd7fd992a04e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:00.408107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621590a-b56c-439a-a7b8-d84543d437be admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:00.417618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a7755-74c1-4752-8da2-961ece3ee0f1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:00.421066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f17a7755-74c1-4752-8da2-961ece3ee0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:00.436846 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3535/7098] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:00 2022] PUT /identity/v3/projects/7b69cacb188f45d4b7a08a70b7ccad54/users/ffe8d12b7e4843aaac79bd7fd992a04e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:00.437946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621590a-b56c-439a-a7b8-d84543d437be admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:00.583592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a7755-74c1-4752-8da2-961ece3ee0f1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:00.600783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621590a-b56c-439a-a7b8-d84543d437be admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:00.619603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed97d0-d904-40f0-871c-435d8ef05c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:00.619804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed97d0-d904-40f0-871c-435d8ef05c43 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:00.620195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed97d0-d904-40f0-871c-435d8ef05c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:00.620639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed97d0-d904-40f0-871c-435d8ef05c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:00.621350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed97d0-d904-40f0-871c-435d8ef05c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:00.623362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed97d0-d904-40f0-871c-435d8ef05c43 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:00.640550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:00.656712 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3536/7099] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:00.662549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed97d0-d904-40f0-871c-435d8ef05c43 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:00.685127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed97d0-d904-40f0-871c-435d8ef05c43 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:00.704567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e670-89bc-4e43-aa74-80996adb8172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:00.705359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e670-89bc-4e43-aa74-80996adb8172 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:00.705893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e670-89bc-4e43-aa74-80996adb8172 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:00.706292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e670-89bc-4e43-aa74-80996adb8172 admin admin] PATH_INFO: `/v3/projects/7b69cacb188f45d4b7a08a70b7ccad54/users/ffe8d12b7e4843aaac79bd7fd992a04e/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:00.708678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4e670-89bc-4e43-aa74-80996adb8172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b69cacb188f45d4b7a08a70b7ccad54, user_id=ffe8d12b7e4843aaac79bd7fd992a04e, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:00.711553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4e670-89bc-4e43-aa74-80996adb8172 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:00.720485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e30617-796b-4e50-99c4-3e1ec61a0c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:00.721366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e30617-796b-4e50-99c4-3e1ec61a0c67 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:00.722350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e30617-796b-4e50-99c4-3e1ec61a0c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:00.722350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e30617-796b-4e50-99c4-3e1ec61a0c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:00.728101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-23e30617-796b-4e50-99c4-3e1ec61a0c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:00.750013 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3537/7100] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:00 2022] PUT /identity/v3/projects/7b69cacb188f45d4b7a08a70b7ccad54/users/ffe8d12b7e4843aaac79bd7fd992a04e/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:56:00.751990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c241-62bf-4029-8500-a42fe69fa570 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:00.752503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c241-62bf-4029-8500-a42fe69fa570 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:00.753476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c241-62bf-4029-8500-a42fe69fa570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:00.816918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4377c241-62bf-4029-8500-a42fe69fa570 None None] MFA Rules not processed for user `ffe8d12b7e4843aaac79bd7fd992a04e`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:00.822550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4377c241-62bf-4029-8500-a42fe69fa570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:00.983987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e30617-796b-4e50-99c4-3e1ec61a0c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:00.990167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e30617-796b-4e50-99c4-3e1ec61a0c67 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:01.000362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:01.019796 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3564/7101] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:56:01.091017 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3538/7102] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:01.096106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e30617-796b-4e50-99c4-3e1ec61a0c67 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:01.218530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e30617-796b-4e50-99c4-3e1ec61a0c67 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:01.227456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b185f-f4c7-4e00-8f04-6d85741800f5 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe8d12b7e4843aaac79bd7fd992a04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b69cacb188f45d4b7a08a70b7ccad54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:01.228082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b185f-f4c7-4e00-8f04-6d85741800f5 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:01.228369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b185f-f4c7-4e00-8f04-6d85741800f5 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:01.228690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b185f-f4c7-4e00-8f04-6d85741800f5 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:01.229351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b185f-f4c7-4e00-8f04-6d85741800f5 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:01.231009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b185f-f4c7-4e00-8f04-6d85741800f5 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:01.232914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b185f-f4c7-4e00-8f04-6d85741800f5 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:01.267175 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3565/7103] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:56:01.272917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c241-62bf-4029-8500-a42fe69fa570 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:01.293662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c241-62bf-4029-8500-a42fe69fa570 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:01.317275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bba88b-d132-41bd-b45e-7312964023fc tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe8d12b7e4843aaac79bd7fd992a04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b69cacb188f45d4b7a08a70b7ccad54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:01.321891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba88b-d132-41bd-b45e-7312964023fc tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:01.323407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba88b-d132-41bd-b45e-7312964023fc tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:01.323772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba88b-d132-41bd-b45e-7312964023fc tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:01.329361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bba88b-d132-41bd-b45e-7312964023fc tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:01.356349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bba88b-d132-41bd-b45e-7312964023fc tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:01.433515 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3539/7104] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:01 2022] POST /identity/v3/projects => generated 349 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:01.434738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b185f-f4c7-4e00-8f04-6d85741800f5 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:01.448507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b185f-f4c7-4e00-8f04-6d85741800f5 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:01.580393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:01.599460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e35fb-9b70-4038-93ae-3a12440a12b9 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe8d12b7e4843aaac79bd7fd992a04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b69cacb188f45d4b7a08a70b7ccad54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:01.600094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e35fb-9b70-4038-93ae-3a12440a12b9 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:01.600376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e35fb-9b70-4038-93ae-3a12440a12b9 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:01.600650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e35fb-9b70-4038-93ae-3a12440a12b9 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:01.601315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e35fb-9b70-4038-93ae-3a12440a12b9 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:01.601819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e35fb-9b70-4038-93ae-3a12440a12b9 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:01.603460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e35fb-9b70-4038-93ae-3a12440a12b9 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:01.630683 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3566/7105] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:56:01.663900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bba88b-d132-41bd-b45e-7312964023fc tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:01.667920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-92bba88b-d132-41bd-b45e-7312964023fc tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:01.818082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bba88b-d132-41bd-b45e-7312964023fc tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:01.839484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6b430-f183-4c18-a634-d3279fc4bc76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:01.845124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6b430-f183-4c18-a634-d3279fc4bc76 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:01.845555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6b430-f183-4c18-a634-d3279fc4bc76 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:01.845857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6b430-f183-4c18-a634-d3279fc4bc76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:01.861592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6b430-f183-4c18-a634-d3279fc4bc76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:01.863094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6b430-f183-4c18-a634-d3279fc4bc76 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:01.881281 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3540/7106] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:02.280734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e35fb-9b70-4038-93ae-3a12440a12b9 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:02.317279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e35fb-9b70-4038-93ae-3a12440a12b9 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:02.336440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffe8d12b7e4843aaac79bd7fd992a04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b69cacb188f45d4b7a08a70b7ccad54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:02.346137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:02.346507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:02.346792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] PATH_INFO: `/v3/projects/e47be38fad374673b96cea4f05436564` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:02.351842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e47be38fad374673b96cea4f05436564)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:02.354159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:02.459747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47be38fad374673b96cea4f05436564', 'request_id': 'req-29696244-a5fe-4da2-862f-149495b076a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:02.471703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47be38fad374673b96cea4f05436564', 'request_id': 'req-29696244-a5fe-4da2-862f-149495b076a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:02.483213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47be38fad374673b96cea4f05436564', 'request_id': 'req-29696244-a5fe-4da2-862f-149495b076a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:02.508661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] The token cache is being invalidate because project e47be38fad374673b96cea4f05436564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:02.508964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:02.510988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:02.513215 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3567/7107] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:02 2022] DELETE /identity/v3/projects/e47be38fad374673b96cea4f05436564 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:02.764766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6b430-f183-4c18-a634-d3279fc4bc76 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:02.777663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6b430-f183-4c18-a634-d3279fc4bc76 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:02.858552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09c8dd-3832-4fdb-a92b-3b1035828da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:02.859307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c8dd-3832-4fdb-a92b-3b1035828da2 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:02.859672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c8dd-3832-4fdb-a92b-3b1035828da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:02.860174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c8dd-3832-4fdb-a92b-3b1035828da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:02.862153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8a09c8dd-3832-4fdb-a92b-3b1035828da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:02.911902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:02.913341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:03.044493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09c8dd-3832-4fdb-a92b-3b1035828da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:03.050885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09c8dd-3832-4fdb-a92b-3b1035828da2 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:03.056175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29696244-a5fe-4da2-862f-149495b076a1 tempest-QuotasTest-713803644 tempest-QuotasTest-713803644-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:03.070837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:03.085414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:03.085414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:03.085414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] PATH_INFO: `/v3/users/155ba188b3b9453299537dd20080a881` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:03.085414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155ba188b3b9453299537dd20080a881)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:03.085414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:03.094484 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3541/7108] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:03.164343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155ba188b3b9453299537dd20080a881'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:03.165283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155ba188b3b9453299537dd20080a881'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:03.206677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155ba188b3b9453299537dd20080a881'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:03.207754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155ba188b3b9453299537dd20080a881'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:03.218211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155ba188b3b9453299537dd20080a881'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:03.222812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:03.255304 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3568/7109] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:02 2022] DELETE /identity/v3/users/155ba188b3b9453299537dd20080a881 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:56:03.261151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce917a64-5dd1-474a-9bf7-9f17deaee6ea None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:03.262016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce917a64-5dd1-474a-9bf7-9f17deaee6ea None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:03.262471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce917a64-5dd1-474a-9bf7-9f17deaee6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:03.321280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ce917a64-5dd1-474a-9bf7-9f17deaee6ea None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:03.322920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ce917a64-5dd1-474a-9bf7-9f17deaee6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:03.336967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:03.595519 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3542/7110] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:03.605716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:03.607269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:03.777588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe04b3d-ca27-47af-9162-3d89292844b8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:03.786351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbc204-5e72-42c3-90a2-553a8e043655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:03.787242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbc204-5e72-42c3-90a2-553a8e043655 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:03.787685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbc204-5e72-42c3-90a2-553a8e043655 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:03.788119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbc204-5e72-42c3-90a2-553a8e043655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:03.820341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbc204-5e72-42c3-90a2-553a8e043655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:03.822114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbc204-5e72-42c3-90a2-553a8e043655 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:03.854337 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3569/7111] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:05.009164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce917a64-5dd1-474a-9bf7-9f17deaee6ea None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:05.011535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ce917a64-5dd1-474a-9bf7-9f17deaee6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:05.038951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce917a64-5dd1-474a-9bf7-9f17deaee6ea None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:05.071796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:05.072780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:05.073225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:05.073792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] PATH_INFO: `/v3/projects/58d9df9c86cc447895bd29f2adc2ba65` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:05.078300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d9df9c86cc447895bd29f2adc2ba65)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:05.080755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:05.292966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d9df9c86cc447895bd29f2adc2ba65', 'request_id': 'req-3c8c0d52-2bba-4036-b7e3-a4556db77f69'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:05.318337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d9df9c86cc447895bd29f2adc2ba65', 'request_id': 'req-3c8c0d52-2bba-4036-b7e3-a4556db77f69'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:05.349891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d9df9c86cc447895bd29f2adc2ba65', 'request_id': 'req-3c8c0d52-2bba-4036-b7e3-a4556db77f69'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:05.372047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] The token cache is being invalidate because project 58d9df9c86cc447895bd29f2adc2ba65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:05.372482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:05.382140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:05.390454 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3543/7112] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:05 2022] DELETE /identity/v3/projects/58d9df9c86cc447895bd29f2adc2ba65 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:05.391811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbc204-5e72-42c3-90a2-553a8e043655 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:05.412534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbc204-5e72-42c3-90a2-553a8e043655 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:05.602674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbe91b-9bef-47e7-b911-a10bf099b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:05.603448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbe91b-9bef-47e7-b911-a10bf099b5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:05.603756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbe91b-9bef-47e7-b911-a10bf099b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:05.604146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbe91b-9bef-47e7-b911-a10bf099b5fb admin admin] PATH_INFO: `/v3/users/ffe8d12b7e4843aaac79bd7fd992a04e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:05.618536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbe91b-9bef-47e7-b911-a10bf099b5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe8d12b7e4843aaac79bd7fd992a04e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:05.621296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbe91b-9bef-47e7-b911-a10bf099b5fb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:05.814156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b6fbe91b-9bef-47e7-b911-a10bf099b5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe8d12b7e4843aaac79bd7fd992a04e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:05.815041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b6fbe91b-9bef-47e7-b911-a10bf099b5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe8d12b7e4843aaac79bd7fd992a04e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:05.868933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b6fbe91b-9bef-47e7-b911-a10bf099b5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe8d12b7e4843aaac79bd7fd992a04e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:05.870022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b6fbe91b-9bef-47e7-b911-a10bf099b5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe8d12b7e4843aaac79bd7fd992a04e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:05.886060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b6fbe91b-9bef-47e7-b911-a10bf099b5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe8d12b7e4843aaac79bd7fd992a04e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:05.939526 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3570/7113] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:05 2022] DELETE /identity/v3/users/ffe8d12b7e4843aaac79bd7fd992a04e => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:08.011715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:08.013884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:08.068209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c0d52-2bba-4036-b7e3-a4556db77f69 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:08.288395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:08.288883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:08.289172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:08.289475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] PATH_INFO: `/v3/projects/7b69cacb188f45d4b7a08a70b7ccad54` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:08.293292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b69cacb188f45d4b7a08a70b7ccad54)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:08.295099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:08.404718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:08.436912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b69cacb188f45d4b7a08a70b7ccad54', 'request_id': 'req-a8fb0e13-8812-4e9f-a93e-9f75b879a731'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:08.454528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b69cacb188f45d4b7a08a70b7ccad54', 'request_id': 'req-a8fb0e13-8812-4e9f-a93e-9f75b879a731'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:08.464975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b69cacb188f45d4b7a08a70b7ccad54', 'request_id': 'req-a8fb0e13-8812-4e9f-a93e-9f75b879a731'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:08.487740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] The token cache is being invalidate because project 7b69cacb188f45d4b7a08a70b7ccad54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:08.488040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:08.488718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a8fb0e13-8812-4e9f-a93e-9f75b879a731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:08.490311 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3544/7114] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:08 2022] DELETE /identity/v3/projects/7b69cacb188f45d4b7a08a70b7ccad54 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:08.496790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2033852-4199-4b47-ac8c-6dd027e29248 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:08.497812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2033852-4199-4b47-ac8c-6dd027e29248 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:08.498300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2033852-4199-4b47-ac8c-6dd027e29248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:08.537105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c2033852-4199-4b47-ac8c-6dd027e29248 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:08.538593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c2033852-4199-4b47-ac8c-6dd027e29248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:08.558687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:08.669274 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3571/7115] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:08.677662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6c9a-0a94-420b-9f0b-4695083539e3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:08.678268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6c9a-0a94-420b-9f0b-4695083539e3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:08.678770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6c9a-0a94-420b-9f0b-4695083539e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:08.726649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-823a6c9a-0a94-420b-9f0b-4695083539e3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:08.732048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-823a6c9a-0a94-420b-9f0b-4695083539e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:08.755222 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3545/7116] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:08.759198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2033852-4199-4b47-ac8c-6dd027e29248 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:08.780862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2033852-4199-4b47-ac8c-6dd027e29248 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:08.786719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9ffa1-a3d9-442d-aa5b-38db10731149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:08.787636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9ffa1-a3d9-442d-aa5b-38db10731149 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:08.788166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9ffa1-a3d9-442d-aa5b-38db10731149 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:08.788673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9ffa1-a3d9-442d-aa5b-38db10731149 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:08.790257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9ffa1-a3d9-442d-aa5b-38db10731149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:08.793195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9ffa1-a3d9-442d-aa5b-38db10731149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:08.795109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9ffa1-a3d9-442d-aa5b-38db10731149 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:08.824620 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3572/7117] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:56:08.828684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6c9a-0a94-420b-9f0b-4695083539e3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:08.843050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6c9a-0a94-420b-9f0b-4695083539e3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:08.854518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4132246-72a6-4f8e-ad42-8772494223c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:08.855810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4132246-72a6-4f8e-ad42-8772494223c2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:08.857574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4132246-72a6-4f8e-ad42-8772494223c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:08.859436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4132246-72a6-4f8e-ad42-8772494223c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:08.860614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4132246-72a6-4f8e-ad42-8772494223c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:08.864922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4132246-72a6-4f8e-ad42-8772494223c2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:08.935897 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3546/7118] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:08 2022] POST /identity/v3/projects => generated 357 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:08.939699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9ffa1-a3d9-442d-aa5b-38db10731149 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:08.954870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9ffa1-a3d9-442d-aa5b-38db10731149 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:09.037224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c0c89-cc77-4a9e-abc4-9c8a22c0eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:09.038315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c0c89-cc77-4a9e-abc4-9c8a22c0eaee admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:09.038759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c0c89-cc77-4a9e-abc4-9c8a22c0eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:09.039192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c0c89-cc77-4a9e-abc4-9c8a22c0eaee admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:09.040053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c0c89-cc77-4a9e-abc4-9c8a22c0eaee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:09.042937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c0c89-cc77-4a9e-abc4-9c8a22c0eaee admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:09.072034 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3573/7119] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:08 2022] POST /identity/v3/users => generated 279 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:09.076780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4132246-72a6-4f8e-ad42-8772494223c2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:09.095417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4132246-72a6-4f8e-ad42-8772494223c2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:09.107751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19928e-1e7d-44b2-9629-c7a4216b4804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:09.109788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19928e-1e7d-44b2-9629-c7a4216b4804 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:09.112208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19928e-1e7d-44b2-9629-c7a4216b4804 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:09.113929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19928e-1e7d-44b2-9629-c7a4216b4804 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:09.116289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19928e-1e7d-44b2-9629-c7a4216b4804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:09.120748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19928e-1e7d-44b2-9629-c7a4216b4804 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:09.212802 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3547/7120] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:09.214853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c0c89-cc77-4a9e-abc4-9c8a22c0eaee admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:09.232039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c0c89-cc77-4a9e-abc4-9c8a22c0eaee admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:09.256369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b3a2f-de9b-4cdb-a98d-4338d74b9316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:09.257602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b3a2f-de9b-4cdb-a98d-4338d74b9316 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:09.263317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b3a2f-de9b-4cdb-a98d-4338d74b9316 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:09.263778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b3a2f-de9b-4cdb-a98d-4338d74b9316 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:09.264626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b3a2f-de9b-4cdb-a98d-4338d74b9316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:09.274412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b3a2f-de9b-4cdb-a98d-4338d74b9316 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:09.332735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19928e-1e7d-44b2-9629-c7a4216b4804 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:09.343209 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3574/7121] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:09.349146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19928e-1e7d-44b2-9629-c7a4216b4804 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:09.377985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfe586-9c7b-47ff-9f73-39a612f0ffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:09.379161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfe586-9c7b-47ff-9f73-39a612f0ffe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:09.379667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfe586-9c7b-47ff-9f73-39a612f0ffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:09.381370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfe586-9c7b-47ff-9f73-39a612f0ffe2 admin admin] PATH_INFO: `/v3/projects/ade35914dfb445ec92a50a8044559199/users/9974d334ff724d08af31ca4d9b5e875f/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:09.444579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfe586-9c7b-47ff-9f73-39a612f0ffe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade35914dfb445ec92a50a8044559199, user_id=9974d334ff724d08af31ca4d9b5e875f, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:09.457967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfe586-9c7b-47ff-9f73-39a612f0ffe2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:09.513010 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3548/7122] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:09 2022] PUT /identity/v3/projects/ade35914dfb445ec92a50a8044559199/users/9974d334ff724d08af31ca4d9b5e875f/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:09.514146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e7679-0aa6-426b-89ce-5de76148bb57 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:09.514630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e7679-0aa6-426b-89ce-5de76148bb57 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:09.514732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e7679-0aa6-426b-89ce-5de76148bb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:09.634345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a11e7679-0aa6-426b-89ce-5de76148bb57 None None] MFA Rules not processed for user `9974d334ff724d08af31ca4d9b5e875f`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:09.647132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a11e7679-0aa6-426b-89ce-5de76148bb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:09.927955 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3575/7123] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:09.939440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfe586-9c7b-47ff-9f73-39a612f0ffe2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:09.941624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b0dfe586-9c7b-47ff-9f73-39a612f0ffe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:10.070970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfe586-9c7b-47ff-9f73-39a612f0ffe2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:10.084872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06867a97-f472-4c9f-a21a-9163e37c0fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:10.085585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06867a97-f472-4c9f-a21a-9163e37c0fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:10.085848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06867a97-f472-4c9f-a21a-9163e37c0fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:10.086896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06867a97-f472-4c9f-a21a-9163e37c0fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:10.123135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06867a97-f472-4c9f-a21a-9163e37c0fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:10.126684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06867a97-f472-4c9f-a21a-9163e37c0fe1 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:10.166437 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3549/7124] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:56:10.819086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e7679-0aa6-426b-89ce-5de76148bb57 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:10.820824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a11e7679-0aa6-426b-89ce-5de76148bb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:10.850265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:10.984582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e7679-0aa6-426b-89ce-5de76148bb57 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:10.989872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:10.990520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:10.990798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:10.991258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] PATH_INFO: `/v3/users/4d3c358944514314b0ceeab261073ab6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:10.993845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3c358944514314b0ceeab261073ab6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:10.996542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:11.099858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3c358944514314b0ceeab261073ab6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:11.100897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3c358944514314b0ceeab261073ab6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:11.131610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3c358944514314b0ceeab261073ab6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:11.132656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3c358944514314b0ceeab261073ab6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:11.150791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3c358944514314b0ceeab261073ab6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:11.175342 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3576/7125] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:10 2022] DELETE /identity/v3/users/4d3c358944514314b0ceeab261073ab6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:11.179870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fafee-aaf8-4ff9-a24b-a80297ab568d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:11.180396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fafee-aaf8-4ff9-a24b-a80297ab568d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:11.180396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fafee-aaf8-4ff9-a24b-a80297ab568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:11.227753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-079fafee-aaf8-4ff9-a24b-a80297ab568d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:11.229805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-079fafee-aaf8-4ff9-a24b-a80297ab568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:11.362508 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3550/7126] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:11.384780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:11.388325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:11.512859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8790ff-a93e-4b61-aaa4-3b57b6f8c666 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:11.517163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ed579-5038-4dd6-919a-e41919a88386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:11.517881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ed579-5038-4dd6-919a-e41919a88386 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:11.518168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ed579-5038-4dd6-919a-e41919a88386 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:11.518642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ed579-5038-4dd6-919a-e41919a88386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:11.553028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ed579-5038-4dd6-919a-e41919a88386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:11.553028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ed579-5038-4dd6-919a-e41919a88386 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:11.571420 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3577/7127] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:12.650939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fafee-aaf8-4ff9-a24b-a80297ab568d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:12.652446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-079fafee-aaf8-4ff9-a24b-a80297ab568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:12.667086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:12.681071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fafee-aaf8-4ff9-a24b-a80297ab568d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:12.706146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:12.707326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:12.708124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:12.733276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] PATH_INFO: `/v3/projects/d21affdfe1b54a2391441ec22eeafbda` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:12.739464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d21affdfe1b54a2391441ec22eeafbda)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:12.750718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:12.903278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd21affdfe1b54a2391441ec22eeafbda', 'request_id': 'req-b440596e-2644-4584-ba6a-0e4360462e9c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:12.938534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd21affdfe1b54a2391441ec22eeafbda', 'request_id': 'req-b440596e-2644-4584-ba6a-0e4360462e9c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:12.956557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd21affdfe1b54a2391441ec22eeafbda', 'request_id': 'req-b440596e-2644-4584-ba6a-0e4360462e9c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:12.979423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] The token cache is being invalidate because project d21affdfe1b54a2391441ec22eeafbda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:12.979948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:12.980981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:12.982713 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3551/7128] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:12 2022] DELETE /identity/v3/projects/d21affdfe1b54a2391441ec22eeafbda => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:12.986762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ed579-5038-4dd6-919a-e41919a88386 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:13.002830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ed579-5038-4dd6-919a-e41919a88386 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:13.090916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:13.159475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7d79-9c30-4ec8-a8cb-ebb7ec1ac262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:13.160144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7d79-9c30-4ec8-a8cb-ebb7ec1ac262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:13.160432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7d79-9c30-4ec8-a8cb-ebb7ec1ac262 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:13.160721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7d79-9c30-4ec8-a8cb-ebb7ec1ac262 admin admin] PATH_INFO: `/v3/users/7375afd819834435886724c280b30941` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:13.166743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7d79-9c30-4ec8-a8cb-ebb7ec1ac262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7375afd819834435886724c280b30941)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:13.168749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7d79-9c30-4ec8-a8cb-ebb7ec1ac262 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:13.292794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dad7d79-9c30-4ec8-a8cb-ebb7ec1ac262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7375afd819834435886724c280b30941'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:13.295798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dad7d79-9c30-4ec8-a8cb-ebb7ec1ac262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7375afd819834435886724c280b30941'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:13.332549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dad7d79-9c30-4ec8-a8cb-ebb7ec1ac262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7375afd819834435886724c280b30941'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:13.334713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dad7d79-9c30-4ec8-a8cb-ebb7ec1ac262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7375afd819834435886724c280b30941'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:13.358021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dad7d79-9c30-4ec8-a8cb-ebb7ec1ac262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7375afd819834435886724c280b30941'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:13.386650 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3578/7129] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:12 2022] DELETE /identity/v3/users/7375afd819834435886724c280b30941 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:14.954283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:14.958187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:14.968515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793459-bde5-4767-9405-a5879d56ccd6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:14.969008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793459-bde5-4767-9405-a5879d56ccd6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:14.969106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793459-bde5-4767-9405-a5879d56ccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:14.986895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440596e-2644-4584-ba6a-0e4360462e9c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:15.013856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-95793459-bde5-4767-9405-a5879d56ccd6 None None] MFA Rules not processed for user `74602998065943c4a49a96d23ec0ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:15.018802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-95793459-bde5-4767-9405-a5879d56ccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:15.151770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:15.152710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:15.153142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:15.153622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] PATH_INFO: `/v3/projects/432121536e624a7399134b0d201eb7c1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:15.155407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=432121536e624a7399134b0d201eb7c1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:15.161980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:15.200045 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3579/7130] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:56:15.290078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432121536e624a7399134b0d201eb7c1', 'request_id': 'req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:15.308705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432121536e624a7399134b0d201eb7c1', 'request_id': 'req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:15.324181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432121536e624a7399134b0d201eb7c1', 'request_id': 'req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:15.354902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] The token cache is being invalidate because project 432121536e624a7399134b0d201eb7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:15.355486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:15.357610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:15.359371 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3552/7131] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:14 2022] DELETE /identity/v3/projects/432121536e624a7399134b0d201eb7c1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:15.364699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8aebf-4ada-4a18-aa11-20f07849bafa None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:15.365184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8aebf-4ada-4a18-aa11-20f07849bafa None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:15.365726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8aebf-4ada-4a18-aa11-20f07849bafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:15.407079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-eba8aebf-4ada-4a18-aa11-20f07849bafa None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:15.412977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-eba8aebf-4ada-4a18-aa11-20f07849bafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:15.528641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:15.529988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:15.531503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:15.560611 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3580/7132] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:15.567481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8a11e-487c-4424-950f-7fc87ddd63da None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:15.567788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8a11e-487c-4424-950f-7fc87ddd63da None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:15.568044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8a11e-487c-4424-950f-7fc87ddd63da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:15.589476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:15.610225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-36a8a11e-487c-4424-950f-7fc87ddd63da None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:15.615881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-36a8a11e-487c-4424-950f-7fc87ddd63da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:15.657446 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3581/7133] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:15.659997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8a11e-487c-4424-950f-7fc87ddd63da None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:15.679238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8a11e-487c-4424-950f-7fc87ddd63da None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:15.692658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95c12c-a7b0-4a04-9e19-f020f15b0390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:15.693287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95c12c-a7b0-4a04-9e19-f020f15b0390 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:15.694704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95c12c-a7b0-4a04-9e19-f020f15b0390 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:15.694990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95c12c-a7b0-4a04-9e19-f020f15b0390 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:15.697286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95c12c-a7b0-4a04-9e19-f020f15b0390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:15.701990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95c12c-a7b0-4a04-9e19-f020f15b0390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:15.701990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95c12c-a7b0-4a04-9e19-f020f15b0390 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:15.721919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea55c5-a9f1-49c1-958e-fd67125c5b9f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:15.730153 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3582/7134] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:56:15.733829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95c12c-a7b0-4a04-9e19-f020f15b0390 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:15.734419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b1d59-6ad1-4c6f-84dc-2ac7e4e1328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:15.737204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1d59-6ad1-4c6f-84dc-2ac7e4e1328c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:15.737589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1d59-6ad1-4c6f-84dc-2ac7e4e1328c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:15.737932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1d59-6ad1-4c6f-84dc-2ac7e4e1328c admin admin] PATH_INFO: `/v3/users/030aab7434fa445ab00e2116daf29a83` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:15.742902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b1d59-6ad1-4c6f-84dc-2ac7e4e1328c admin admin] RBAC: Authorizing `identity:delete_user(user_id=030aab7434fa445ab00e2116daf29a83)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:15.747659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b1d59-6ad1-4c6f-84dc-2ac7e4e1328c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:15.752916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95c12c-a7b0-4a04-9e19-f020f15b0390 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:15.770669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9b632-27b0-461b-a724-4ac053396adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:15.773072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b632-27b0-461b-a724-4ac053396adf admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:15.773399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b632-27b0-461b-a724-4ac053396adf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:15.773685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b632-27b0-461b-a724-4ac053396adf admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:15.775643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9b632-27b0-461b-a724-4ac053396adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:15.779558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9b632-27b0-461b-a724-4ac053396adf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:15.855069 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3583/7135] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:15 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:15.859110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9b632-27b0-461b-a724-4ac053396adf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:15.865646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dd6b1d59-6ad1-4c6f-84dc-2ac7e4e1328c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030aab7434fa445ab00e2116daf29a83'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:15.866703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dd6b1d59-6ad1-4c6f-84dc-2ac7e4e1328c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030aab7434fa445ab00e2116daf29a83'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:15.895618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dd6b1d59-6ad1-4c6f-84dc-2ac7e4e1328c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030aab7434fa445ab00e2116daf29a83'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:15.913703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dd6b1d59-6ad1-4c6f-84dc-2ac7e4e1328c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030aab7434fa445ab00e2116daf29a83'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:15.927113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-dd6b1d59-6ad1-4c6f-84dc-2ac7e4e1328c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030aab7434fa445ab00e2116daf29a83'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:15.941484 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3553/7136] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:15 2022] DELETE /identity/v3/users/030aab7434fa445ab00e2116daf29a83 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:15.945805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae88369-13c1-463b-92e0-28ccaf536f91 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:15.949004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae88369-13c1-463b-92e0-28ccaf536f91 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:15.949457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae88369-13c1-463b-92e0-28ccaf536f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:15.991242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cae88369-13c1-463b-92e0-28ccaf536f91 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:15.993425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cae88369-13c1-463b-92e0-28ccaf536f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:16.003216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9b632-27b0-461b-a724-4ac053396adf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:16.100994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be77d0-bf7b-4a88-b660-22e46c8edf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:16.101874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be77d0-bf7b-4a88-b660-22e46c8edf3f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:16.102884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be77d0-bf7b-4a88-b660-22e46c8edf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:16.103328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be77d0-bf7b-4a88-b660-22e46c8edf3f admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:16.104199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be77d0-bf7b-4a88-b660-22e46c8edf3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:16.106532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be77d0-bf7b-4a88-b660-22e46c8edf3f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:16.144964 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3584/7137] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:15 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:16.146298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be77d0-bf7b-4a88-b660-22e46c8edf3f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:16.148338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b6be77d0-bf7b-4a88-b660-22e46c8edf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:16.162725 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3554/7138] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:16.166067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be77d0-bf7b-4a88-b660-22e46c8edf3f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:16.172496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f8be0-e775-41c0-bcba-ea371ec074c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:16.173339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f8be0-e775-41c0-bcba-ea371ec074c4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:16.173792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f8be0-e775-41c0-bcba-ea371ec074c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:16.174782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f8be0-e775-41c0-bcba-ea371ec074c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:16.175642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f8be0-e775-41c0-bcba-ea371ec074c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:16.177897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f8be0-e775-41c0-bcba-ea371ec074c4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:16.190070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae88369-13c1-463b-92e0-28ccaf536f91 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:16.191708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cae88369-13c1-463b-92e0-28ccaf536f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:16.198713 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3585/7139] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:16.202076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f8be0-e775-41c0-bcba-ea371ec074c4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:16.218658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f8be0-e775-41c0-bcba-ea371ec074c4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:16.228531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc6999-12a0-4954-a107-a4cbc230f958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:16.229103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc6999-12a0-4954-a107-a4cbc230f958 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:16.229530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc6999-12a0-4954-a107-a4cbc230f958 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:16.229922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc6999-12a0-4954-a107-a4cbc230f958 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:16.230748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc6999-12a0-4954-a107-a4cbc230f958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:16.232571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc6999-12a0-4954-a107-a4cbc230f958 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:16.253456 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3586/7140] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:16.255813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc6999-12a0-4954-a107-a4cbc230f958 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:16.276319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc6999-12a0-4954-a107-a4cbc230f958 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:16.284171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:16.284410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61719d20-a493-4d33-b226-172e43b734b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:16.286368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61719d20-a493-4d33-b226-172e43b734b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:16.286657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61719d20-a493-4d33-b226-172e43b734b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:16.286939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61719d20-a493-4d33-b226-172e43b734b7 admin admin] PATH_INFO: `/v3/projects/864b03f2c28d4f3b89604aeccae89ab8/users/365e90ce6bf64e12a07f47b2b7158322/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:16.334656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae88369-13c1-463b-92e0-28ccaf536f91 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:16.366126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebda7c1-878d-4efe-b597-c46c3476d199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:16.366824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebda7c1-878d-4efe-b597-c46c3476d199 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:16.367810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebda7c1-878d-4efe-b597-c46c3476d199 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:16.367810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebda7c1-878d-4efe-b597-c46c3476d199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:16.370690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61719d20-a493-4d33-b226-172e43b734b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=864b03f2c28d4f3b89604aeccae89ab8, user_id=365e90ce6bf64e12a07f47b2b7158322, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:16.377302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61719d20-a493-4d33-b226-172e43b734b7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:16.396229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebda7c1-878d-4efe-b597-c46c3476d199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:16.397889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebda7c1-878d-4efe-b597-c46c3476d199 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:16.412128 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3587/7141] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:16 2022] PUT /identity/v3/projects/864b03f2c28d4f3b89604aeccae89ab8/users/365e90ce6bf64e12a07f47b2b7158322/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:16.424766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd957b16-502d-4695-8ea3-8a1ded63ea35 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:16.425132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd957b16-502d-4695-8ea3-8a1ded63ea35 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:16.425456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd957b16-502d-4695-8ea3-8a1ded63ea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:16.447787 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3555/7142] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:16.508072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:16.569498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fd957b16-502d-4695-8ea3-8a1ded63ea35 None None] MFA Rules not processed for user `365e90ce6bf64e12a07f47b2b7158322`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:16.569498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fd957b16-502d-4695-8ea3-8a1ded63ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:16.740672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebda7c1-878d-4efe-b597-c46c3476d199 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:16.742074 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3588/7143] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:56:16.764645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebda7c1-878d-4efe-b597-c46c3476d199 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:16.962079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a10385-312d-4251-a1f6-e9237e86330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:16.963646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a10385-312d-4251-a1f6-e9237e86330a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:16.965790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a10385-312d-4251-a1f6-e9237e86330a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:16.966234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a10385-312d-4251-a1f6-e9237e86330a admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:16.972778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a10385-312d-4251-a1f6-e9237e86330a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:16.975142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a10385-312d-4251-a1f6-e9237e86330a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:16.995340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd957b16-502d-4695-8ea3-8a1ded63ea35 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:16.996981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fd957b16-502d-4695-8ea3-8a1ded63ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:17.030989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd957b16-502d-4695-8ea3-8a1ded63ea35 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:17.038561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3556/7144] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:16 2022] POST /identity/v3/projects => generated 383 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:17.042964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a10385-312d-4251-a1f6-e9237e86330a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:17.044458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:17.045741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:17.046229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:17.046685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] PATH_INFO: `/v3/projects/6fcafac84ccf41ee87d592adbb6d71d9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:17.048431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fcafac84ccf41ee87d592adbb6d71d9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:17.051023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:17.167165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a10385-312d-4251-a1f6-e9237e86330a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:17.178954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fcafac84ccf41ee87d592adbb6d71d9', 'request_id': 'req-3fe3aa60-3551-4aff-855a-ef8582f88892'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:17.196516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fcafac84ccf41ee87d592adbb6d71d9', 'request_id': 'req-3fe3aa60-3551-4aff-855a-ef8582f88892'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:17.218271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fcafac84ccf41ee87d592adbb6d71d9', 'request_id': 'req-3fe3aa60-3551-4aff-855a-ef8582f88892'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:17.238050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] The token cache is being invalidate because project 6fcafac84ccf41ee87d592adbb6d71d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:17.238237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:17.239656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3fe3aa60-3551-4aff-855a-ef8582f88892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:17.247495 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3589/7145] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:16 2022] DELETE /identity/v3/projects/6fcafac84ccf41ee87d592adbb6d71d9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:17.249217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8b4c-991c-4a4a-be17-70ba06433303 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:17.249637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8b4c-991c-4a4a-be17-70ba06433303 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:17.249975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8b4c-991c-4a4a-be17-70ba06433303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:17.298637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bd2b8b4c-991c-4a4a-be17-70ba06433303 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:17.299839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bd2b8b4c-991c-4a4a-be17-70ba06433303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:17.303998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591ba53-0047-4315-8c4e-5fcdb3a6ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:17.304669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591ba53-0047-4315-8c4e-5fcdb3a6ae21 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:17.305310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591ba53-0047-4315-8c4e-5fcdb3a6ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:17.305310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591ba53-0047-4315-8c4e-5fcdb3a6ae21 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:17.306249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591ba53-0047-4315-8c4e-5fcdb3a6ae21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:17.309623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591ba53-0047-4315-8c4e-5fcdb3a6ae21 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:17.329931 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3590/7146] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:17.331209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b788e-1363-4660-bae0-f143edfcb9d9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:17.331557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b788e-1363-4660-bae0-f143edfcb9d9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:17.331835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b788e-1363-4660-bae0-f143edfcb9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:17.367662 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3557/7147] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:17 2022] POST /identity/v3/users => generated 298 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:17.369268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591ba53-0047-4315-8c4e-5fcdb3a6ae21 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:17.375888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1591ba53-0047-4315-8c4e-5fcdb3a6ae21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:17.395561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ce0b788e-1363-4660-bae0-f143edfcb9d9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:17.396452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ce0b788e-1363-4660-bae0-f143edfcb9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:17.401734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:17.411423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591ba53-0047-4315-8c4e-5fcdb3a6ae21 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:17.423602 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3591/7148] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:56:17.423602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b788e-1363-4660-bae0-f143edfcb9d9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:17.423602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ce0b788e-1363-4660-bae0-f143edfcb9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:17.425638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded05f8c-8eb9-479f-b5c9-c006afc49d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:17.426268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05f8c-8eb9-479f-b5c9-c006afc49d6f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:17.426543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05f8c-8eb9-479f-b5c9-c006afc49d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:17.426805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05f8c-8eb9-479f-b5c9-c006afc49d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:17.427839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded05f8c-8eb9-479f-b5c9-c006afc49d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:17.429253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded05f8c-8eb9-479f-b5c9-c006afc49d6f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:17.455088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b788e-1363-4660-bae0-f143edfcb9d9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:17.459275 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3558/7149] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:17.459275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded05f8c-8eb9-479f-b5c9-c006afc49d6f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:17.468669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:17.469463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:17.469742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:17.470027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] PATH_INFO: `/v3/users/707d3ee536524835a6d39951cd8d903b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:17.471842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=707d3ee536524835a6d39951cd8d903b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:17.474027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:17.481864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded05f8c-8eb9-479f-b5c9-c006afc49d6f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:17.496555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987de52d-2b3b-4cf5-a329-b3586c845d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:17.497904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987de52d-2b3b-4cf5-a329-b3586c845d53 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:17.497904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987de52d-2b3b-4cf5-a329-b3586c845d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:17.497904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987de52d-2b3b-4cf5-a329-b3586c845d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:17.498505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987de52d-2b3b-4cf5-a329-b3586c845d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:17.498809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987de52d-2b3b-4cf5-a329-b3586c845d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:17.503342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987de52d-2b3b-4cf5-a329-b3586c845d53 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:17.538541 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3559/7150] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:56:17.544382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987de52d-2b3b-4cf5-a329-b3586c845d53 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:17.568721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987de52d-2b3b-4cf5-a329-b3586c845d53 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:17.592223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23c13-037b-44d9-985e-8e8126dcb44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:17.594965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23c13-037b-44d9-985e-8e8126dcb44a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:17.595250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23c13-037b-44d9-985e-8e8126dcb44a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:17.595556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23c13-037b-44d9-985e-8e8126dcb44a admin admin] PATH_INFO: `/v3/projects/d18132f91b614f82809e1d566c19adc1/users/f4044f64397540bb8f8119ac230ba845/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:17.596700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707d3ee536524835a6d39951cd8d903b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:17.597735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707d3ee536524835a6d39951cd8d903b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:17.623887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:17.659876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707d3ee536524835a6d39951cd8d903b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:17.661801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707d3ee536524835a6d39951cd8d903b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:17.676293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d23c13-037b-44d9-985e-8e8126dcb44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18132f91b614f82809e1d566c19adc1, user_id=f4044f64397540bb8f8119ac230ba845, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:17.690455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d23c13-037b-44d9-985e-8e8126dcb44a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:17.695510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707d3ee536524835a6d39951cd8d903b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:17.747739 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3560/7151] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:17 2022] PUT /identity/v3/projects/d18132f91b614f82809e1d566c19adc1/users/f4044f64397540bb8f8119ac230ba845/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:17.749693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23c13-037b-44d9-985e-8e8126dcb44a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:17.754567 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3592/7152] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:17 2022] DELETE /identity/v3/users/707d3ee536524835a6d39951cd8d903b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:17.755618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-60d23c13-037b-44d9-985e-8e8126dcb44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:17.758467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:17.764290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:17.934371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbdd56-f33e-40a8-9ee2-affaf10d0d3f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:17.944636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fc117-9be7-4a5d-ab60-59780c51e8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:17.945575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fc117-9be7-4a5d-ab60-59780c51e8bf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:17.945767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fc117-9be7-4a5d-ab60-59780c51e8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:17.946009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fc117-9be7-4a5d-ab60-59780c51e8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:17.946758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fc117-9be7-4a5d-ab60-59780c51e8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:17.949026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fc117-9be7-4a5d-ab60-59780c51e8bf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:17.970807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23c13-037b-44d9-985e-8e8126dcb44a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:17.975355 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3593/7153] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:17.977728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853216c4-575a-4480-a676-efcb581a8b4f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:17.978013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853216c4-575a-4480-a676-efcb581a8b4f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:17.978813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853216c4-575a-4480-a676-efcb581a8b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:17.982115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db6e75-2471-400d-89bd-fb8984eb64c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:17.983044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db6e75-2471-400d-89bd-fb8984eb64c8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:17.983570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db6e75-2471-400d-89bd-fb8984eb64c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:17.984107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db6e75-2471-400d-89bd-fb8984eb64c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:17.984988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db6e75-2471-400d-89bd-fb8984eb64c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:17.990720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db6e75-2471-400d-89bd-fb8984eb64c8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:18.048576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-853216c4-575a-4480-a676-efcb581a8b4f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:18.050622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-853216c4-575a-4480-a676-efcb581a8b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:18.074954 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3594/7154] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:18.076560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853216c4-575a-4480-a676-efcb581a8b4f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:18.094500 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3561/7155] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:17 2022] POST /identity/v3/projects => generated 363 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:18.098639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db6e75-2471-400d-89bd-fb8984eb64c8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:18.115182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853216c4-575a-4480-a676-efcb581a8b4f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:18.247033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db6e75-2471-400d-89bd-fb8984eb64c8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:18.257479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a217498-d800-4ae7-afbe-edc77a0eb659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:18.259592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a217498-d800-4ae7-afbe-edc77a0eb659 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:18.259880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a217498-d800-4ae7-afbe-edc77a0eb659 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:18.260160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a217498-d800-4ae7-afbe-edc77a0eb659 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:18.263324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a217498-d800-4ae7-afbe-edc77a0eb659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:18.270056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a217498-d800-4ae7-afbe-edc77a0eb659 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:18.339393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfcaa7-6186-4cf3-9394-d763ed0cf034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:18.339577 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3562/7156] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:18 2022] POST /identity/v3/users => generated 282 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:56:18.339667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcaa7-6186-4cf3-9394-d763ed0cf034 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:18.339667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcaa7-6186-4cf3-9394-d763ed0cf034 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:18.340183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a217498-d800-4ae7-afbe-edc77a0eb659 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:18.340398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcaa7-6186-4cf3-9394-d763ed0cf034 admin admin] PATH_INFO: `/v3/projects/d18132f91b614f82809e1d566c19adc1/users/f4044f64397540bb8f8119ac230ba845/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:18.346105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfcaa7-6186-4cf3-9394-d763ed0cf034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18132f91b614f82809e1d566c19adc1, user_id=f4044f64397540bb8f8119ac230ba845, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:18.347668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9a217498-d800-4ae7-afbe-edc77a0eb659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:18.352595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfcaa7-6186-4cf3-9394-d763ed0cf034 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:18.372505 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3595/7157] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:18 2022] PUT /identity/v3/projects/d18132f91b614f82809e1d566c19adc1/users/f4044f64397540bb8f8119ac230ba845/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:18.373412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfcaa7-6186-4cf3-9394-d763ed0cf034 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:18.441564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:18.517253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a217498-d800-4ae7-afbe-edc77a0eb659 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:18.616281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfcaa7-6186-4cf3-9394-d763ed0cf034 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:18.634541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498415-7ef1-4a20-9fb7-90ea71b28de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:18.636028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498415-7ef1-4a20-9fb7-90ea71b28de3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:18.636311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498415-7ef1-4a20-9fb7-90ea71b28de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:18.636588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498415-7ef1-4a20-9fb7-90ea71b28de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:18.638181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d727d9-ee66-4166-a295-8e3725d69ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:18.638595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80498415-7ef1-4a20-9fb7-90ea71b28de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:18.639954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d727d9-ee66-4166-a295-8e3725d69ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:18.640439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d727d9-ee66-4166-a295-8e3725d69ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:18.641216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d727d9-ee66-4166-a295-8e3725d69ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:18.644250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80498415-7ef1-4a20-9fb7-90ea71b28de3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:18.650767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:18.654186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d727d9-ee66-4166-a295-8e3725d69ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:18.655820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d727d9-ee66-4166-a295-8e3725d69ae8 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:18.680897 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3563/7158] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:18.682545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765060b5-d0d8-4f03-ae22-2deec4cdfee1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:18.682937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765060b5-d0d8-4f03-ae22-2deec4cdfee1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:18.683321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765060b5-d0d8-4f03-ae22-2deec4cdfee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:18.690130 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3596/7159] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:18.694203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498415-7ef1-4a20-9fb7-90ea71b28de3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:18.711048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498415-7ef1-4a20-9fb7-90ea71b28de3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:18.718404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70b6a7-af6f-49ac-8167-3da7c386e182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:18.719025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70b6a7-af6f-49ac-8167-3da7c386e182 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:18.719303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70b6a7-af6f-49ac-8167-3da7c386e182 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:18.719574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70b6a7-af6f-49ac-8167-3da7c386e182 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:18.720216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70b6a7-af6f-49ac-8167-3da7c386e182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:18.722337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70b6a7-af6f-49ac-8167-3da7c386e182 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:18.757239 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3597/7160] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:18.758212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-765060b5-d0d8-4f03-ae22-2deec4cdfee1 None None] MFA Rules not processed for user `f4044f64397540bb8f8119ac230ba845`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:18.758343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70b6a7-af6f-49ac-8167-3da7c386e182 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:18.760351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-765060b5-d0d8-4f03-ae22-2deec4cdfee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:18.771955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70b6a7-af6f-49ac-8167-3da7c386e182 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:18.777684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cebaf2-1652-4e58-a1a1-2f07988b2a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:18.778444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cebaf2-1652-4e58-a1a1-2f07988b2a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:18.781197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cebaf2-1652-4e58-a1a1-2f07988b2a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:18.781197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cebaf2-1652-4e58-a1a1-2f07988b2a07 admin admin] PATH_INFO: `/v3/projects/06cbd14177b14bc4af7ddd9dac7a5a59/users/e5bffce3cdf1411695125a30d5795282/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:18.809355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cebaf2-1652-4e58-a1a1-2f07988b2a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06cbd14177b14bc4af7ddd9dac7a5a59, user_id=e5bffce3cdf1411695125a30d5795282, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:18.812187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cebaf2-1652-4e58-a1a1-2f07988b2a07 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:18.840637 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3598/7161] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:18 2022] PUT /identity/v3/projects/06cbd14177b14bc4af7ddd9dac7a5a59/users/e5bffce3cdf1411695125a30d5795282/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:18.934984 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3564/7162] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:18.949202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a6667-83c2-45c1-b5dc-2c74af2be66f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:18.949543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a6667-83c2-45c1-b5dc-2c74af2be66f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:18.949898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a6667-83c2-45c1-b5dc-2c74af2be66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:18.953078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765060b5-d0d8-4f03-ae22-2deec4cdfee1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:18.954807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-765060b5-d0d8-4f03-ae22-2deec4cdfee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:19.005605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-487a6667-83c2-45c1-b5dc-2c74af2be66f None None] MFA Rules not processed for user `e5bffce3cdf1411695125a30d5795282`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:19.006867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-487a6667-83c2-45c1-b5dc-2c74af2be66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:19.105475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765060b5-d0d8-4f03-ae22-2deec4cdfee1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:19.168057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:19.180095 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3599/7163] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:19.194399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a6667-83c2-45c1-b5dc-2c74af2be66f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:19.265510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8f379-4115-4f8b-9a73-9340ec4c0b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:19.265782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f379-4115-4f8b-9a73-9340ec4c0b42 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:19.265990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f379-4115-4f8b-9a73-9340ec4c0b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:19.266310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f379-4115-4f8b-9a73-9340ec4c0b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:19.424975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a6667-83c2-45c1-b5dc-2c74af2be66f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:19.439878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647185-7851-4df9-9977-1351dba1120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:19.443920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647185-7851-4df9-9977-1351dba1120f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:19.444721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647185-7851-4df9-9977-1351dba1120f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:19.447541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647185-7851-4df9-9977-1351dba1120f admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:19.455639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4647185-7851-4df9-9977-1351dba1120f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:19.466054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4647185-7851-4df9-9977-1351dba1120f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:19.509781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8f379-4115-4f8b-9a73-9340ec4c0b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:19.514248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8f379-4115-4f8b-9a73-9340ec4c0b42 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:19.525689 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3600/7164] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:19 2022] POST /identity/v3/projects => generated 365 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:19.528096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647185-7851-4df9-9977-1351dba1120f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:19.539642 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3565/7165] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:56:19.643627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:19.710612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647185-7851-4df9-9977-1351dba1120f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:19.723936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b31f-606a-496e-a25d-efea55b42698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:19.724917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b31f-606a-496e-a25d-efea55b42698 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:19.725351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b31f-606a-496e-a25d-efea55b42698 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:19.727005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b31f-606a-496e-a25d-efea55b42698 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:19.729042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b31f-606a-496e-a25d-efea55b42698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:19.733894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b31f-606a-496e-a25d-efea55b42698 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:19.757835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8f379-4115-4f8b-9a73-9340ec4c0b42 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:19.774477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8f379-4115-4f8b-9a73-9340ec4c0b42 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:19.784470 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3601/7166] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:19 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:19.788744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b31f-606a-496e-a25d-efea55b42698 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:19.815985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b31f-606a-496e-a25d-efea55b42698 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:19.829343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cf645-4c9e-4bc7-8c8d-8434ff534acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:19.831285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf645-4c9e-4bc7-8c8d-8434ff534acb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:19.833111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf645-4c9e-4bc7-8c8d-8434ff534acb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:19.833664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf645-4c9e-4bc7-8c8d-8434ff534acb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:19.834577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cf645-4c9e-4bc7-8c8d-8434ff534acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:19.842214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cf645-4c9e-4bc7-8c8d-8434ff534acb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:19.873666 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3602/7167] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:19.877608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cf645-4c9e-4bc7-8c8d-8434ff534acb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:19.898041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cf645-4c9e-4bc7-8c8d-8434ff534acb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:19.904825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afb713-9995-445d-97c2-c79152aa9516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:19.906140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afb713-9995-445d-97c2-c79152aa9516 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:19.907047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afb713-9995-445d-97c2-c79152aa9516 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:19.907642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afb713-9995-445d-97c2-c79152aa9516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:19.912299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289452e-6649-4b76-850b-a778f60a9d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:19.912656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-23afb713-9995-445d-97c2-c79152aa9516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:19.914674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289452e-6649-4b76-850b-a778f60a9d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:19.915058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289452e-6649-4b76-850b-a778f60a9d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:19.915612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289452e-6649-4b76-850b-a778f60a9d3f admin admin] PATH_INFO: `/v3/projects/eef1850d320d41798943e10551d07fc4/users/71e601b954d94303a9113a30cfbe6818/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:19.943978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289452e-6649-4b76-850b-a778f60a9d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef1850d320d41798943e10551d07fc4, user_id=71e601b954d94303a9113a30cfbe6818, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:19.947091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289452e-6649-4b76-850b-a778f60a9d3f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:19.968249 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3603/7168] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:19 2022] PUT /identity/v3/projects/eef1850d320d41798943e10551d07fc4/users/71e601b954d94303a9113a30cfbe6818/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:56:19.969694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289452e-6649-4b76-850b-a778f60a9d3f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:20.015720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afb713-9995-445d-97c2-c79152aa9516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:20.017773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afb713-9995-445d-97c2-c79152aa9516 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:20.030176 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3566/7169] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:56:20.108235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289452e-6649-4b76-850b-a778f60a9d3f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:20.113922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96873a7b-a235-4660-bfd7-f95a04c77c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:20.114551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873a7b-a235-4660-bfd7-f95a04c77c6a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:20.114880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873a7b-a235-4660-bfd7-f95a04c77c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:20.115160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873a7b-a235-4660-bfd7-f95a04c77c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:20.115974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96873a7b-a235-4660-bfd7-f95a04c77c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:20.117641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96873a7b-a235-4660-bfd7-f95a04c77c6a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:20.143397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afb713-9995-445d-97c2-c79152aa9516 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:20.167665 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3604/7170] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:56:20.175589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afb713-9995-445d-97c2-c79152aa9516 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:20.195055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96174238-b696-4b98-920c-7b38f6bd9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:20.196104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96174238-b696-4b98-920c-7b38f6bd9da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:20.196590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96174238-b696-4b98-920c-7b38f6bd9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:20.198177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96174238-b696-4b98-920c-7b38f6bd9da0 admin admin] PATH_INFO: `/v3/projects/eef1850d320d41798943e10551d07fc4/users/71e601b954d94303a9113a30cfbe6818/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:20.202698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96174238-b696-4b98-920c-7b38f6bd9da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef1850d320d41798943e10551d07fc4, user_id=71e601b954d94303a9113a30cfbe6818, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:20.215154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96174238-b696-4b98-920c-7b38f6bd9da0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:20.241372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cbddd-5a8d-4355-b265-f6f1c9585132 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:20.241838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cbddd-5a8d-4355-b265-f6f1c9585132 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:20.242012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cbddd-5a8d-4355-b265-f6f1c9585132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:20.244932 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3567/7171] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:20 2022] PUT /identity/v3/projects/eef1850d320d41798943e10551d07fc4/users/71e601b954d94303a9113a30cfbe6818/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:20.283466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fa3cbddd-5a8d-4355-b265-f6f1c9585132 None None] MFA Rules not processed for user `71e601b954d94303a9113a30cfbe6818`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:20.285476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fa3cbddd-5a8d-4355-b265-f6f1c9585132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:20.349194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96174238-b696-4b98-920c-7b38f6bd9da0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:20.352007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-96174238-b696-4b98-920c-7b38f6bd9da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:20.483524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:20.525913 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3605/7172] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:20.552693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cbddd-5a8d-4355-b265-f6f1c9585132 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:20.581675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96174238-b696-4b98-920c-7b38f6bd9da0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:20.584045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:20.618939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:20.619740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:20.621469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:20.627297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] PATH_INFO: `/v3/projects/760879e08e76487882b3c951ea527f98` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:20.630759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760879e08e76487882b3c951ea527f98)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:20.638246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:20.740788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cbddd-5a8d-4355-b265-f6f1c9585132 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:20.750208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af47695-8870-4313-af22-794a735edcb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:20.751278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47695-8870-4313-af22-794a735edcb6 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:20.751278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47695-8870-4313-af22-794a735edcb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:20.751478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47695-8870-4313-af22-794a735edcb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:20.774483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af47695-8870-4313-af22-794a735edcb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:20.776656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af47695-8870-4313-af22-794a735edcb6 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:20.778029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760879e08e76487882b3c951ea527f98', 'request_id': 'req-4837144d-c47e-42ae-bd2e-aeff82780724'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:20.787997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760879e08e76487882b3c951ea527f98', 'request_id': 'req-4837144d-c47e-42ae-bd2e-aeff82780724'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:20.802306 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3606/7173] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:56:20.803410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af47695-8870-4313-af22-794a735edcb6 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:20.812336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760879e08e76487882b3c951ea527f98', 'request_id': 'req-4837144d-c47e-42ae-bd2e-aeff82780724'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:20.824740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af47695-8870-4313-af22-794a735edcb6 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:20.843776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] The token cache is being invalidate because project 760879e08e76487882b3c951ea527f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:20.844131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:20.850697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:20.852824 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3568/7174] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:20 2022] DELETE /identity/v3/projects/760879e08e76487882b3c951ea527f98 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:20.857323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:20.866285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:20.980103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a94452-71f6-443b-a3a4-a876931ed115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:20.981811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94452-71f6-443b-a3a4-a876931ed115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:20.982534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94452-71f6-443b-a3a4-a876931ed115 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:20.983048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94452-71f6-443b-a3a4-a876931ed115 admin admin] PATH_INFO: `/v3/users/365e90ce6bf64e12a07f47b2b7158322` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:20.996257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a94452-71f6-443b-a3a4-a876931ed115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=365e90ce6bf64e12a07f47b2b7158322)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:20.998765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a94452-71f6-443b-a3a4-a876931ed115 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:21.099646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43a94452-71f6-443b-a3a4-a876931ed115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365e90ce6bf64e12a07f47b2b7158322'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.100393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43a94452-71f6-443b-a3a4-a876931ed115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365e90ce6bf64e12a07f47b2b7158322'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.132638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43a94452-71f6-443b-a3a4-a876931ed115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365e90ce6bf64e12a07f47b2b7158322'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.133750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43a94452-71f6-443b-a3a4-a876931ed115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365e90ce6bf64e12a07f47b2b7158322'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.145324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-43a94452-71f6-443b-a3a4-a876931ed115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365e90ce6bf64e12a07f47b2b7158322'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.161851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837144d-c47e-42ae-bd2e-aeff82780724 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:21.170712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:21.171833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:21.172531 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3607/7175] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:20 2022] DELETE /identity/v3/users/365e90ce6bf64e12a07f47b2b7158322 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:21.172679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:21.173082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] PATH_INFO: `/v3/users/36a9f8c83a7e4228b7e794e8181b180e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:21.174819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a9f8c83a7e4228b7e794e8181b180e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:21.178998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e62e5-c1f9-4d0c-a2b9-2210b3a324e0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:21.179379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e62e5-c1f9-4d0c-a2b9-2210b3a324e0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:21.181951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e62e5-c1f9-4d0c-a2b9-2210b3a324e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:21.187858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:21.226475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-210e62e5-c1f9-4d0c-a2b9-2210b3a324e0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:21.228054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-210e62e5-c1f9-4d0c-a2b9-2210b3a324e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:21.315325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a9f8c83a7e4228b7e794e8181b180e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.316477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a9f8c83a7e4228b7e794e8181b180e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.326244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:21.354750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a9f8c83a7e4228b7e794e8181b180e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.357039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:21.385596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a9f8c83a7e4228b7e794e8181b180e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.410093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a9f8c83a7e4228b7e794e8181b180e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.424993 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3608/7177] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:21.425090 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3569/7177] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:20 2022] DELETE /identity/v3/users/36a9f8c83a7e4228b7e794e8181b180e => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:21.461554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e62e5-c1f9-4d0c-a2b9-2210b3a324e0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:21.463016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-210e62e5-c1f9-4d0c-a2b9-2210b3a324e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:21.549650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e62e5-c1f9-4d0c-a2b9-2210b3a324e0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:21.571771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:21.574226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:21.668042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0e1b5-ffc0-4f6d-aaad-ef35e00b3d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:21.674951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0e1b5-ffc0-4f6d-aaad-ef35e00b3d47 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:21.675632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0e1b5-ffc0-4f6d-aaad-ef35e00b3d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:21.676739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0e1b5-ffc0-4f6d-aaad-ef35e00b3d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:21.714621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d6207-67b0-43be-8b2f-8de696368361 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:21.727547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:21.728663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:21.728991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:21.729302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] PATH_INFO: `/v3/users/e5bffce3cdf1411695125a30d5795282` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:21.733186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5bffce3cdf1411695125a30d5795282)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:21.735226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:21.814278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0e1b5-ffc0-4f6d-aaad-ef35e00b3d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:21.817213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0e1b5-ffc0-4f6d-aaad-ef35e00b3d47 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:21.836050 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3609/7178] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:21.841304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5bffce3cdf1411695125a30d5795282'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.843156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5bffce3cdf1411695125a30d5795282'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.875973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5bffce3cdf1411695125a30d5795282'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.904700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5bffce3cdf1411695125a30d5795282'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.917958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5bffce3cdf1411695125a30d5795282'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:21.929321 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3570/7179] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:21 2022] DELETE /identity/v3/users/e5bffce3cdf1411695125a30d5795282 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:56:21.935048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f39a-e5c3-4cb3-ba81-02c28927e622 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:21.935457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f39a-e5c3-4cb3-ba81-02c28927e622 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:21.936087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f39a-e5c3-4cb3-ba81-02c28927e622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:21.962550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3918f39a-e5c3-4cb3-ba81-02c28927e622 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:21.965282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3918f39a-e5c3-4cb3-ba81-02c28927e622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:22.081760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:22.144702 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3610/7180] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:22.176564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:22.178939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:22.325448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:22.343237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f4b2e-394c-4875-8731-670a92c07311 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:22.350018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c1f4e-8b37-4b3f-a0d1-a0a2f9b59b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:22.351189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c1f4e-8b37-4b3f-a0d1-a0a2f9b59b76 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:22.351830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c1f4e-8b37-4b3f-a0d1-a0a2f9b59b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:22.352311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c1f4e-8b37-4b3f-a0d1-a0a2f9b59b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:22.364069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c1f4e-8b37-4b3f-a0d1-a0a2f9b59b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:22.367741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c1f4e-8b37-4b3f-a0d1-a0a2f9b59b76 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:22.383905 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3571/7181] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:23.172251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918f39a-e5c3-4cb3-ba81-02c28927e622 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:23.174121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3918f39a-e5c3-4cb3-ba81-02c28927e622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:23.189254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918f39a-e5c3-4cb3-ba81-02c28927e622 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:23.195169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:23.195942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:23.196352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:23.196731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] PATH_INFO: `/v3/projects/06cbd14177b14bc4af7ddd9dac7a5a59` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:23.198628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06cbd14177b14bc4af7ddd9dac7a5a59)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:23.200695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:23.263858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06cbd14177b14bc4af7ddd9dac7a5a59', 'request_id': 'req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.271724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06cbd14177b14bc4af7ddd9dac7a5a59', 'request_id': 'req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.282996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06cbd14177b14bc4af7ddd9dac7a5a59', 'request_id': 'req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.306163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] The token cache is being invalidate because project 06cbd14177b14bc4af7ddd9dac7a5a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:23.306827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.307612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.309611 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3611/7182] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:23 2022] DELETE /identity/v3/projects/06cbd14177b14bc4af7ddd9dac7a5a59 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:23.313305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c1f4e-8b37-4b3f-a0d1-a0a2f9b59b76 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:23.335348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c1f4e-8b37-4b3f-a0d1-a0a2f9b59b76 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:23.411971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:23.414010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:23.442352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba610fb9-1e69-4384-937e-e97d756fa80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:23.443441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba610fb9-1e69-4384-937e-e97d756fa80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:23.444075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba610fb9-1e69-4384-937e-e97d756fa80a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:23.444604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba610fb9-1e69-4384-937e-e97d756fa80a admin admin] PATH_INFO: `/v3/users/71e601b954d94303a9113a30cfbe6818` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:23.446170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba610fb9-1e69-4384-937e-e97d756fa80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e601b954d94303a9113a30cfbe6818)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:23.449114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba610fb9-1e69-4384-937e-e97d756fa80a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:23.497629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3523d32-dfd6-41f3-be9c-cdadd8916ca3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:23.509033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:23.512568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:23.512937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:23.513816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] PATH_INFO: `/v3/projects/cc5d9b8b83dd4ba9b094e9ab3d45ebd9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:23.517776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5d9b8b83dd4ba9b094e9ab3d45ebd9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:23.522306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:23.538538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ba610fb9-1e69-4384-937e-e97d756fa80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e601b954d94303a9113a30cfbe6818'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.539474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ba610fb9-1e69-4384-937e-e97d756fa80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e601b954d94303a9113a30cfbe6818'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.555458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ba610fb9-1e69-4384-937e-e97d756fa80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e601b954d94303a9113a30cfbe6818'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.566824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ba610fb9-1e69-4384-937e-e97d756fa80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e601b954d94303a9113a30cfbe6818'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.579839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ba610fb9-1e69-4384-937e-e97d756fa80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e601b954d94303a9113a30cfbe6818'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.588159 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3572/7183] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:23 2022] DELETE /identity/v3/users/71e601b954d94303a9113a30cfbe6818 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:23.639382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5d9b8b83dd4ba9b094e9ab3d45ebd9', 'request_id': 'req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.647340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5d9b8b83dd4ba9b094e9ab3d45ebd9', 'request_id': 'req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.657522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5d9b8b83dd4ba9b094e9ab3d45ebd9', 'request_id': 'req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.667858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:23.674543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] The token cache is being invalidate because project cc5d9b8b83dd4ba9b094e9ab3d45ebd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:23.674543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.675390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6b3da7d1-15b3-45c5-a771-630bb6e28ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.701256 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3612/7184] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:23 2022] DELETE /identity/v3/projects/cc5d9b8b83dd4ba9b094e9ab3d45ebd9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:23.704131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a08fe-153f-4cff-b606-80cca8435d99 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:23.704678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a08fe-153f-4cff-b606-80cca8435d99 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:23.705183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a08fe-153f-4cff-b606-80cca8435d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:23.730144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-aa1a08fe-153f-4cff-b606-80cca8435d99 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:23.731686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aa1a08fe-153f-4cff-b606-80cca8435d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:23.814726 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3573/7185] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:23.824718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365690a4-b483-4791-b4af-9c78b2531382 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:23.824992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365690a4-b483-4791-b4af-9c78b2531382 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:23.825261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365690a4-b483-4791-b4af-9c78b2531382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:23.833531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a08fe-153f-4cff-b606-80cca8435d99 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:23.836084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aa1a08fe-153f-4cff-b606-80cca8435d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:23.846202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-365690a4-b483-4791-b4af-9c78b2531382 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:23.847721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-365690a4-b483-4791-b4af-9c78b2531382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:23.855557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a08fe-153f-4cff-b606-80cca8435d99 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:23.856830 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3613/7186] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:23.861684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365690a4-b483-4791-b4af-9c78b2531382 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:23.864733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:23.866043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:23.866658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:23.867342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] PATH_INFO: `/v3/projects/864b03f2c28d4f3b89604aeccae89ab8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:23.870170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=864b03f2c28d4f3b89604aeccae89ab8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:23.873603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:23.874854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365690a4-b483-4791-b4af-9c78b2531382 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:23.882911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bfb75-5885-4cea-9404-a39690114579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:23.883666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bfb75-5885-4cea-9404-a39690114579 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:23.884088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bfb75-5885-4cea-9404-a39690114579 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:23.884547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bfb75-5885-4cea-9404-a39690114579 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:23.885890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bfb75-5885-4cea-9404-a39690114579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:23.886200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bfb75-5885-4cea-9404-a39690114579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:23.888933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bfb75-5885-4cea-9404-a39690114579 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:23.890688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:23.910593 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3614/7187] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:56:23.911894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bfb75-5885-4cea-9404-a39690114579 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:23.930631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bfb75-5885-4cea-9404-a39690114579 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:23.940126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa7e8c-0299-40e5-bdf2-3dc1103f8fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:23.940942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa7e8c-0299-40e5-bdf2-3dc1103f8fca admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:23.941224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa7e8c-0299-40e5-bdf2-3dc1103f8fca admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:23.941540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa7e8c-0299-40e5-bdf2-3dc1103f8fca admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:23.942184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa7e8c-0299-40e5-bdf2-3dc1103f8fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:23.946007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa7e8c-0299-40e5-bdf2-3dc1103f8fca admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:23.961616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864b03f2c28d4f3b89604aeccae89ab8', 'request_id': 'req-cd36252f-7b40-4669-a4d9-e695c6900078'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.975389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864b03f2c28d4f3b89604aeccae89ab8', 'request_id': 'req-cd36252f-7b40-4669-a4d9-e695c6900078'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:23.985470 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3615/7188] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:23 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:23.990064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa7e8c-0299-40e5-bdf2-3dc1103f8fca admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:23.991781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864b03f2c28d4f3b89604aeccae89ab8', 'request_id': 'req-cd36252f-7b40-4669-a4d9-e695c6900078'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.006467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] The token cache is being invalidate because project 864b03f2c28d4f3b89604aeccae89ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:24.006961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.007789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.011287 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3574/7189] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:23 2022] DELETE /identity/v3/projects/864b03f2c28d4f3b89604aeccae89ab8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:24.015630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:24.035897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:24.090525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa7e8c-0299-40e5-bdf2-3dc1103f8fca admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:24.106191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025bfd-a393-4e7e-a24c-deab30899db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:24.107894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025bfd-a393-4e7e-a24c-deab30899db3 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.108770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025bfd-a393-4e7e-a24c-deab30899db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.109245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025bfd-a393-4e7e-a24c-deab30899db3 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.110594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66025bfd-a393-4e7e-a24c-deab30899db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:24.114144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66025bfd-a393-4e7e-a24c-deab30899db3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:24.149732 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3616/7190] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:23 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:24.154064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025bfd-a393-4e7e-a24c-deab30899db3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:24.155883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36252f-7b40-4669-a4d9-e695c6900078 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:24.156017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66025bfd-a393-4e7e-a24c-deab30899db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:24.161345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:24.162030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.162308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.163583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] PATH_INFO: `/v3/users/f4044f64397540bb8f8119ac230ba845` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.164906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4044f64397540bb8f8119ac230ba845)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:24.166905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:24.168734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025bfd-a393-4e7e-a24c-deab30899db3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:24.175357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1da77-5ff5-4a4f-8c91-5182f22b3858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:24.176071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1da77-5ff5-4a4f-8c91-5182f22b3858 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.176418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1da77-5ff5-4a4f-8c91-5182f22b3858 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.176759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1da77-5ff5-4a4f-8c91-5182f22b3858 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.177534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1da77-5ff5-4a4f-8c91-5182f22b3858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:24.179206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1da77-5ff5-4a4f-8c91-5182f22b3858 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:24.192203 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3617/7191] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:56:24.196319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1da77-5ff5-4a4f-8c91-5182f22b3858 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:24.209554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1da77-5ff5-4a4f-8c91-5182f22b3858 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:24.215427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fd1f7-d666-4e55-ad9a-8387cedd0e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:24.216276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd1f7-d666-4e55-ad9a-8387cedd0e47 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.216588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd1f7-d666-4e55-ad9a-8387cedd0e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.216819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd1f7-d666-4e55-ad9a-8387cedd0e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.217483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fd1f7-d666-4e55-ad9a-8387cedd0e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:24.219081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fd1f7-d666-4e55-ad9a-8387cedd0e47 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:24.234432 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3618/7192] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:56:24.235351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fd1f7-d666-4e55-ad9a-8387cedd0e47 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:24.246299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fd1f7-d666-4e55-ad9a-8387cedd0e47 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:24.252266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651ef67-7c66-4efc-879d-46221b40efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:24.252982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4044f64397540bb8f8119ac230ba845'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.253235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651ef67-7c66-4efc-879d-46221b40efc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.253656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651ef67-7c66-4efc-879d-46221b40efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.254001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651ef67-7c66-4efc-879d-46221b40efc9 admin admin] PATH_INFO: `/v3/projects/cb3fcfc53fa64cad819199aaae6108b9/users/3233b797e1a64e338203ee6a4636ab49/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.261885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4044f64397540bb8f8119ac230ba845'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.273784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651ef67-7c66-4efc-879d-46221b40efc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3fcfc53fa64cad819199aaae6108b9, user_id=3233b797e1a64e338203ee6a4636ab49, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:24.281120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651ef67-7c66-4efc-879d-46221b40efc9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:24.290408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4044f64397540bb8f8119ac230ba845'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.305746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4044f64397540bb8f8119ac230ba845'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.310003 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3619/7193] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:24 2022] PUT /identity/v3/projects/cb3fcfc53fa64cad819199aaae6108b9/users/3233b797e1a64e338203ee6a4636ab49/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:24.323145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a240-6afc-4453-ad00-6c0ef82b0fd6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.328070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a240-6afc-4453-ad00-6c0ef82b0fd6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.329084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4044f64397540bb8f8119ac230ba845'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.329624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a240-6afc-4453-ad00-6c0ef82b0fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.348175 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3575/7194] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:24 2022] DELETE /identity/v3/users/f4044f64397540bb8f8119ac230ba845 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:24.373277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6580a240-6afc-4453-ad00-6c0ef82b0fd6 None None] MFA Rules not processed for user `3233b797e1a64e338203ee6a4636ab49`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:24.374564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6580a240-6afc-4453-ad00-6c0ef82b0fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:24.457192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:24.469799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:24.472293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:24.503184 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3620/7195] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:56:24.505414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580a240-6afc-4453-ad00-6c0ef82b0fd6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:24.506470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6580a240-6afc-4453-ad00-6c0ef82b0fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:24.557349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:24.617273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa805-08e9-4f1c-a1d3-a3ab8e80f187 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:24.623872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:24.624816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.625299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.626035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] PATH_INFO: `/v3/projects/eef1850d320d41798943e10551d07fc4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.627430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef1850d320d41798943e10551d07fc4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:24.630349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580a240-6afc-4453-ad00-6c0ef82b0fd6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:24.630536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:24.636619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed944ed6-d729-49d8-9bc4-cb4c98abb8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:24.637238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed944ed6-d729-49d8-9bc4-cb4c98abb8db admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.638453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed944ed6-d729-49d8-9bc4-cb4c98abb8db admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.638746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed944ed6-d729-49d8-9bc4-cb4c98abb8db admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.639511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed944ed6-d729-49d8-9bc4-cb4c98abb8db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:24.643433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed944ed6-d729-49d8-9bc4-cb4c98abb8db admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:24.695262 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3621/7196] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:24 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:56:24.702178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed944ed6-d729-49d8-9bc4-cb4c98abb8db admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:24.710879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef1850d320d41798943e10551d07fc4', 'request_id': 'req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.720843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef1850d320d41798943e10551d07fc4', 'request_id': 'req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.736780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef1850d320d41798943e10551d07fc4', 'request_id': 'req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.750592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] The token cache is being invalidate because project eef1850d320d41798943e10551d07fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:24.750952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.751732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-988edb0b-c170-4a3b-b5af-89e3a0b9be1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:24.753496 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3576/7197] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:24 2022] DELETE /identity/v3/projects/eef1850d320d41798943e10551d07fc4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:24.758531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927353f5-32cd-417d-a965-72bf87b5cf36 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.758894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927353f5-32cd-417d-a965-72bf87b5cf36 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.759245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927353f5-32cd-417d-a965-72bf87b5cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.793046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-927353f5-32cd-417d-a965-72bf87b5cf36 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:24.794701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-927353f5-32cd-417d-a965-72bf87b5cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:24.818191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed944ed6-d729-49d8-9bc4-cb4c98abb8db admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:24.824547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17356134-75d1-4939-8a34-b60525a6aee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:24.826249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356134-75d1-4939-8a34-b60525a6aee0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.826886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356134-75d1-4939-8a34-b60525a6aee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.827878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356134-75d1-4939-8a34-b60525a6aee0 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.828783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17356134-75d1-4939-8a34-b60525a6aee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:24.833880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17356134-75d1-4939-8a34-b60525a6aee0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:24.889931 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3622/7198] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:24 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:24.891029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17356134-75d1-4939-8a34-b60525a6aee0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:24.902696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-17356134-75d1-4939-8a34-b60525a6aee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:24.903467 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3577/7199] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:56:24.905189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927353f5-32cd-417d-a965-72bf87b5cf36 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:24.907606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-927353f5-32cd-417d-a965-72bf87b5cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:24.921711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17356134-75d1-4939-8a34-b60525a6aee0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:24.926758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927353f5-32cd-417d-a965-72bf87b5cf36 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:24.927113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:24.927774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.928208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.928495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] PATH_INFO: `/v3/projects/d18132f91b614f82809e1d566c19adc1` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.930834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18132f91b614f82809e1d566c19adc1)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:24.931892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:24.937229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174421f-ca1d-4342-9940-545aac69c7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:24.938177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174421f-ca1d-4342-9940-545aac69c7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.938662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174421f-ca1d-4342-9940-545aac69c7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.939132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174421f-ca1d-4342-9940-545aac69c7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.940028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174421f-ca1d-4342-9940-545aac69c7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:24.942359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174421f-ca1d-4342-9940-545aac69c7c4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:24.958809 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3578/7200] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:24.960203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec76734-25aa-441a-bb91-14bba9d5ac50 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:24.960490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec76734-25aa-441a-bb91-14bba9d5ac50 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:24.960766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec76734-25aa-441a-bb91-14bba9d5ac50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:24.986287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fec76734-25aa-441a-bb91-14bba9d5ac50 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:24.988316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fec76734-25aa-441a-bb91-14bba9d5ac50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:24.997718 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3579/7201] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:24.999336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec76734-25aa-441a-bb91-14bba9d5ac50 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.011355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec76734-25aa-441a-bb91-14bba9d5ac50 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.023668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18132f91b614f82809e1d566c19adc1', 'request_id': 'req-a5461796-c45a-4f12-8b58-75171417652a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:25.037404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18132f91b614f82809e1d566c19adc1', 'request_id': 'req-a5461796-c45a-4f12-8b58-75171417652a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:25.040475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:25.046681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:25.051757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18132f91b614f82809e1d566c19adc1', 'request_id': 'req-a5461796-c45a-4f12-8b58-75171417652a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:25.088831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] The token cache is being invalidate because project d18132f91b614f82809e1d566c19adc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:25.090910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bee578-551a-4b9a-bfd3-b8349f1d2f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.091197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:25.091594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bee578-551a-4b9a-bfd3-b8349f1d2f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.091883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bee578-551a-4b9a-bfd3-b8349f1d2f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.092252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bee578-551a-4b9a-bfd3-b8349f1d2f05 admin admin] PATH_INFO: `/v3/projects/fed77a41a47b4d3680bca4abb306a79c/users/736bb3190e5f415cb182256552f848a6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.092576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:25.096529 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3623/7202] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:24 2022] DELETE /identity/v3/projects/d18132f91b614f82809e1d566c19adc1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:25.097973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.100850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:25.110919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bee578-551a-4b9a-bfd3-b8349f1d2f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed77a41a47b4d3680bca4abb306a79c, user_id=736bb3190e5f415cb182256552f848a6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.114140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bee578-551a-4b9a-bfd3-b8349f1d2f05 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:25.124436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5461796-c45a-4f12-8b58-75171417652a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.130694 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3580/7203] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:24 2022] PUT /identity/v3/projects/fed77a41a47b4d3680bca4abb306a79c/users/736bb3190e5f415cb182256552f848a6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:25.136909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23807c-342d-4bea-839b-2cc430e34ed4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.137216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23807c-342d-4bea-839b-2cc430e34ed4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.137525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23807c-342d-4bea-839b-2cc430e34ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.164661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4e23807c-342d-4bea-839b-2cc430e34ed4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:25.167050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4e23807c-342d-4bea-839b-2cc430e34ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:25.223378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f53e60-203c-4fcd-b09d-5a352fb906f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.224004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f53e60-203c-4fcd-b09d-5a352fb906f3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.224285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f53e60-203c-4fcd-b09d-5a352fb906f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.225039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f53e60-203c-4fcd-b09d-5a352fb906f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.225895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f53e60-203c-4fcd-b09d-5a352fb906f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:25.226339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f53e60-203c-4fcd-b09d-5a352fb906f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.229097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f53e60-203c-4fcd-b09d-5a352fb906f3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:25.254823 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3624/7204] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:56:25.254823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f53e60-203c-4fcd-b09d-5a352fb906f3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.255143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d5f53e60-203c-4fcd-b09d-5a352fb906f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:25.271662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f53e60-203c-4fcd-b09d-5a352fb906f3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.276643 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3581/7205] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:25.277982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23807c-342d-4bea-839b-2cc430e34ed4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.278844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940d648-beb3-46e8-b91d-bbe1212b9133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.283621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940d648-beb3-46e8-b91d-bbe1212b9133 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.284237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940d648-beb3-46e8-b91d-bbe1212b9133 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.285214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940d648-beb3-46e8-b91d-bbe1212b9133 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.285214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940d648-beb3-46e8-b91d-bbe1212b9133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.287641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940d648-beb3-46e8-b91d-bbe1212b9133 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:25.300435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23807c-342d-4bea-839b-2cc430e34ed4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.304695 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3625/7206] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:25.304695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eed2c3-cc1c-408b-9754-2721d7178983 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.304695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eed2c3-cc1c-408b-9754-2721d7178983 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.304695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eed2c3-cc1c-408b-9754-2721d7178983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.311209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456b8a7-ca16-42af-b0b3-d136b9a3b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.311959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456b8a7-ca16-42af-b0b3-d136b9a3b3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.312338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456b8a7-ca16-42af-b0b3-d136b9a3b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.312709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456b8a7-ca16-42af-b0b3-d136b9a3b3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.313660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456b8a7-ca16-42af-b0b3-d136b9a3b3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.316599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456b8a7-ca16-42af-b0b3-d136b9a3b3f0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:25.338580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-75eed2c3-cc1c-408b-9754-2721d7178983 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:25.340105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75eed2c3-cc1c-408b-9754-2721d7178983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:25.357161 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3626/7207] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:25.364164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eed2c3-cc1c-408b-9754-2721d7178983 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.367952 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3582/7208] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:25 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:25.367952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456b8a7-ca16-42af-b0b3-d136b9a3b3f0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.382362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eed2c3-cc1c-408b-9754-2721d7178983 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.470275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12bb8e-0d0e-4ddd-9ad8-d024631e68fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.470953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456b8a7-ca16-42af-b0b3-d136b9a3b3f0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.471563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12bb8e-0d0e-4ddd-9ad8-d024631e68fb admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.471843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12bb8e-0d0e-4ddd-9ad8-d024631e68fb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.472903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12bb8e-0d0e-4ddd-9ad8-d024631e68fb admin admin] PATH_INFO: `/v3/projects/fed77a41a47b4d3680bca4abb306a79c/users/736bb3190e5f415cb182256552f848a6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.475834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12bb8e-0d0e-4ddd-9ad8-d024631e68fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed77a41a47b4d3680bca4abb306a79c, user_id=736bb3190e5f415cb182256552f848a6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.477966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481e66c-b38f-45f1-99b7-853719fd3f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.478862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481e66c-b38f-45f1-99b7-853719fd3f66 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.479263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481e66c-b38f-45f1-99b7-853719fd3f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.479590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12bb8e-0d0e-4ddd-9ad8-d024631e68fb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:25.479713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481e66c-b38f-45f1-99b7-853719fd3f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.480426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481e66c-b38f-45f1-99b7-853719fd3f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:25.480936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481e66c-b38f-45f1-99b7-853719fd3f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.483684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481e66c-b38f-45f1-99b7-853719fd3f66 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:25.506494 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3627/7209] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:25 2022] PUT /identity/v3/projects/fed77a41a47b4d3680bca4abb306a79c/users/736bb3190e5f415cb182256552f848a6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:25.506699 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3583/7210] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:56:25.506810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12bb8e-0d0e-4ddd-9ad8-d024631e68fb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.506910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515afb8f-a9c6-4cb5-89a3-0199669191e6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.506910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515afb8f-a9c6-4cb5-89a3-0199669191e6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.506910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515afb8f-a9c6-4cb5-89a3-0199669191e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.550328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-515afb8f-a9c6-4cb5-89a3-0199669191e6 None None] MFA Rules not processed for user `736bb3190e5f415cb182256552f848a6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:25.551932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-515afb8f-a9c6-4cb5-89a3-0199669191e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:25.564489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:25.628367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:25.638039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12bb8e-0d0e-4ddd-9ad8-d024631e68fb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.649573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a0fbc-52e3-46d6-b319-8d3830f31524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.652440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0fbc-52e3-46d6-b319-8d3830f31524 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.653007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0fbc-52e3-46d6-b319-8d3830f31524 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.665632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0fbc-52e3-46d6-b319-8d3830f31524 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.667052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a0fbc-52e3-46d6-b319-8d3830f31524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.669705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a0fbc-52e3-46d6-b319-8d3830f31524 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:25.711691 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3628/7211] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:25 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:25.713801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a0fbc-52e3-46d6-b319-8d3830f31524 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.721141 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3584/7212] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:25.721141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515afb8f-a9c6-4cb5-89a3-0199669191e6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.731689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515afb8f-a9c6-4cb5-89a3-0199669191e6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.735289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a0fbc-52e3-46d6-b319-8d3830f31524 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.737409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c9a8c-d04b-45cf-86c6-5e8c04ed90c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.738072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c9a8c-d04b-45cf-86c6-5e8c04ed90c2 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.738339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c9a8c-d04b-45cf-86c6-5e8c04ed90c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.738607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c9a8c-d04b-45cf-86c6-5e8c04ed90c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.739497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c9a8c-d04b-45cf-86c6-5e8c04ed90c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.741705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c9a8c-d04b-45cf-86c6-5e8c04ed90c2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:25.745419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c0036-87eb-4af6-a6f1-b0c4279d01bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.746113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c0036-87eb-4af6-a6f1-b0c4279d01bb admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.746398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c0036-87eb-4af6-a6f1-b0c4279d01bb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.746730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c0036-87eb-4af6-a6f1-b0c4279d01bb admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.747378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c0036-87eb-4af6-a6f1-b0c4279d01bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.751518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c0036-87eb-4af6-a6f1-b0c4279d01bb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:25.757464 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3585/7213] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:25.757464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c9a8c-d04b-45cf-86c6-5e8c04ed90c2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.758269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-739c9a8c-d04b-45cf-86c6-5e8c04ed90c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:25.793777 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3629/7214] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:25 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:25.795008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c0036-87eb-4af6-a6f1-b0c4279d01bb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.874328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c0036-87eb-4af6-a6f1-b0c4279d01bb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.878459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c9a8c-d04b-45cf-86c6-5e8c04ed90c2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.880215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca0be-ac39-4c0b-aa66-9d3a72f434e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.881019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca0be-ac39-4c0b-aa66-9d3a72f434e9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.881307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca0be-ac39-4c0b-aa66-9d3a72f434e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.881640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca0be-ac39-4c0b-aa66-9d3a72f434e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.882306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bca0be-ac39-4c0b-aa66-9d3a72f434e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.883974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bca0be-ac39-4c0b-aa66-9d3a72f434e9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:25.898728 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3630/7215] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:25.898728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca0be-ac39-4c0b-aa66-9d3a72f434e9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.909859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca0be-ac39-4c0b-aa66-9d3a72f434e9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.917412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713eb8-59af-465c-857d-9f6920f1f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.918966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713eb8-59af-465c-857d-9f6920f1f94d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.918966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713eb8-59af-465c-857d-9f6920f1f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.918966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713eb8-59af-465c-857d-9f6920f1f94d admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.919259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2713eb8-59af-465c-857d-9f6920f1f94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.921174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2713eb8-59af-465c-857d-9f6920f1f94d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:25.947444 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3631/7216] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:25 2022] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:25.948306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713eb8-59af-465c-857d-9f6920f1f94d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:25.951130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d6d37-a1f7-4071-bfcd-897781ca8767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.952507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d6d37-a1f7-4071-bfcd-897781ca8767 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.952981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d6d37-a1f7-4071-bfcd-897781ca8767 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.953467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d6d37-a1f7-4071-bfcd-897781ca8767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.955691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4a5d6d37-a1f7-4071-bfcd-897781ca8767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:25.958742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713eb8-59af-465c-857d-9f6920f1f94d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:25.965406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acdbd3-215d-4885-b2f6-4ed62e984383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:25.966374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acdbd3-215d-4885-b2f6-4ed62e984383 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:25.966374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acdbd3-215d-4885-b2f6-4ed62e984383 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:25.966597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acdbd3-215d-4885-b2f6-4ed62e984383 admin admin] PATH_INFO: `/v3/projects/6539a92d711e432fa2d19a62ccf414dc/users/1c601c71eb10496b8bd808b998d104dc/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:25.984137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acdbd3-215d-4885-b2f6-4ed62e984383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6539a92d711e432fa2d19a62ccf414dc, user_id=1c601c71eb10496b8bd808b998d104dc, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:25.987477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acdbd3-215d-4885-b2f6-4ed62e984383 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.007013 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3632/7217] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:25 2022] PUT /identity/v3/projects/6539a92d711e432fa2d19a62ccf414dc/users/1c601c71eb10496b8bd808b998d104dc/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:26.008043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acdbd3-215d-4885-b2f6-4ed62e984383 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:26.029037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d6d37-a1f7-4071-bfcd-897781ca8767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:26.030633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d6d37-a1f7-4071-bfcd-897781ca8767 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.049596 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3586/7218] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:26.051686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5afc5-fef7-4401-bbb5-3c339d449853 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.052151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5afc5-fef7-4401-bbb5-3c339d449853 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.052349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5afc5-fef7-4401-bbb5-3c339d449853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.070801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:26.085296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acdbd3-215d-4885-b2f6-4ed62e984383 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:26.090765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5690a71-3f71-4c17-a55e-208dae19f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:26.091476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5690a71-3f71-4c17-a55e-208dae19f527 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.091727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5690a71-3f71-4c17-a55e-208dae19f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.091997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-67d5afc5-fef7-4401-bbb5-3c339d449853 None None] MFA Rules not processed for user `1c601c71eb10496b8bd808b998d104dc`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:26.092115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5690a71-3f71-4c17-a55e-208dae19f527 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.092646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5690a71-3f71-4c17-a55e-208dae19f527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:26.093227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-67d5afc5-fef7-4401-bbb5-3c339d449853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:26.094428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5690a71-3f71-4c17-a55e-208dae19f527 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.110613 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3633/7219] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:26.115840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5690a71-3f71-4c17-a55e-208dae19f527 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:26.131614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5690a71-3f71-4c17-a55e-208dae19f527 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:26.140689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab4c04-f8ef-446d-8c88-58487da0eb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:26.141367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab4c04-f8ef-446d-8c88-58487da0eb1d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.141681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab4c04-f8ef-446d-8c88-58487da0eb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.141961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab4c04-f8ef-446d-8c88-58487da0eb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.143377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab4c04-f8ef-446d-8c88-58487da0eb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:26.145029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab4c04-f8ef-446d-8c88-58487da0eb1d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.161618 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3634/7220] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:56:26.166009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab4c04-f8ef-446d-8c88-58487da0eb1d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:26.172875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:26.179171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab4c04-f8ef-446d-8c88-58487da0eb1d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:26.183916 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3587/7221] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:26.189019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5afc5-fef7-4401-bbb5-3c339d449853 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:26.189681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5e740-7a37-43ef-842a-a94ef21945ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:26.190886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5e740-7a37-43ef-842a-a94ef21945ce admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.191017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5e740-7a37-43ef-842a-a94ef21945ce admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.191277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5e740-7a37-43ef-842a-a94ef21945ce admin admin] PATH_INFO: `/v3/projects/96a3bf50605d40a6bf93593e2931c8d6/users/bff55cf3683a4ff4a30a622b9defa841/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.203616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5afc5-fef7-4401-bbb5-3c339d449853 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:26.213691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c04d38-9a6a-418d-99cb-6044c4d3b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:26.214208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c04d38-9a6a-418d-99cb-6044c4d3b62d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.214538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c04d38-9a6a-418d-99cb-6044c4d3b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.215168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c04d38-9a6a-418d-99cb-6044c4d3b62d admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.215513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c04d38-9a6a-418d-99cb-6044c4d3b62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:26.216270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5e740-7a37-43ef-842a-a94ef21945ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a3bf50605d40a6bf93593e2931c8d6, user_id=bff55cf3683a4ff4a30a622b9defa841, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:26.217580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c04d38-9a6a-418d-99cb-6044c4d3b62d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.221956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5e740-7a37-43ef-842a-a94ef21945ce admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.249230 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3635/7222] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:26 2022] PUT /identity/v3/projects/96a3bf50605d40a6bf93593e2931c8d6/users/bff55cf3683a4ff4a30a622b9defa841/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:26.251132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c0658-5061-4fa8-a513-66c4aa6b7d78 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.251424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c0658-5061-4fa8-a513-66c4aa6b7d78 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.251745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c0658-5061-4fa8-a513-66c4aa6b7d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.274634 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3588/7223] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:26 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:56:26.278807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c04d38-9a6a-418d-99cb-6044c4d3b62d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:26.300560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-096c0658-5061-4fa8-a513-66c4aa6b7d78 None None] MFA Rules not processed for user `bff55cf3683a4ff4a30a622b9defa841`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:26.302469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-096c0658-5061-4fa8-a513-66c4aa6b7d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:26.392636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c04d38-9a6a-418d-99cb-6044c4d3b62d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:26.408367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8710616-da63-4d42-8f92-bcb70f44f01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:26.410819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8710616-da63-4d42-8f92-bcb70f44f01a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.412152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8710616-da63-4d42-8f92-bcb70f44f01a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.413573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8710616-da63-4d42-8f92-bcb70f44f01a admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.414515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8710616-da63-4d42-8f92-bcb70f44f01a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:26.419127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8710616-da63-4d42-8f92-bcb70f44f01a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.450185 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3636/7224] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:56:26.466077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c0658-5061-4fa8-a513-66c4aa6b7d78 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:26.469883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-096c0658-5061-4fa8-a513-66c4aa6b7d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:26.491565 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3589/7225] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:26 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:26.492551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8710616-da63-4d42-8f92-bcb70f44f01a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:26.522518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8710616-da63-4d42-8f92-bcb70f44f01a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:26.549008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e0891-886a-4bc8-b3d8-095e5bb0461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:26.549693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e0891-886a-4bc8-b3d8-095e5bb0461a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.549978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e0891-886a-4bc8-b3d8-095e5bb0461a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.550693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e0891-886a-4bc8-b3d8-095e5bb0461a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.551357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e0891-886a-4bc8-b3d8-095e5bb0461a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:26.557642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e0891-886a-4bc8-b3d8-095e5bb0461a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.584060 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3590/7226] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:26.584994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e0891-886a-4bc8-b3d8-095e5bb0461a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:26.598554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c0658-5061-4fa8-a513-66c4aa6b7d78 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:26.605619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed4773-31fc-4989-807b-17b190eacc3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:26.606744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed4773-31fc-4989-807b-17b190eacc3e service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.607303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed4773-31fc-4989-807b-17b190eacc3e service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.608164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed4773-31fc-4989-807b-17b190eacc3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.610970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e0891-886a-4bc8-b3d8-095e5bb0461a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:26.619382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7411b-e3ce-4423-9da7-be070296c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:26.620062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7411b-e3ce-4423-9da7-be070296c916 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.620350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7411b-e3ce-4423-9da7-be070296c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.620632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7411b-e3ce-4423-9da7-be070296c916 admin admin] PATH_INFO: `/v3/projects/feb3db7d2f624032b552eeaf911646b8/users/37fa12cbe9dd44299d94ef418add40c6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.626290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed4773-31fc-4989-807b-17b190eacc3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:26.628820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed4773-31fc-4989-807b-17b190eacc3e service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.662341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7411b-e3ce-4423-9da7-be070296c916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb3db7d2f624032b552eeaf911646b8, user_id=37fa12cbe9dd44299d94ef418add40c6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:26.665055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7411b-e3ce-4423-9da7-be070296c916 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.666937 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3637/7227] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:26.705749 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3591/7228] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:26 2022] PUT /identity/v3/projects/feb3db7d2f624032b552eeaf911646b8/users/37fa12cbe9dd44299d94ef418add40c6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:26.709584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed4773-31fc-4989-807b-17b190eacc3e service glance] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:26.725475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed4773-31fc-4989-807b-17b190eacc3e service glance] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:26.847655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd444c9-e675-4148-9646-051da6a2d67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:26.848279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd444c9-e675-4148-9646-051da6a2d67a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.848561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd444c9-e675-4148-9646-051da6a2d67a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.849089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd444c9-e675-4148-9646-051da6a2d67a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.849790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd444c9-e675-4148-9646-051da6a2d67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:26.851404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd444c9-e675-4148-9646-051da6a2d67a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.863905 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3638/7229] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:26.868124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7411b-e3ce-4423-9da7-be070296c916 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:26.886284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7411b-e3ce-4423-9da7-be070296c916 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:26.910754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e243c-47fd-4070-a986-6201c83ea89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:26.911854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e243c-47fd-4070-a986-6201c83ea89b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.912367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e243c-47fd-4070-a986-6201c83ea89b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.912849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e243c-47fd-4070-a986-6201c83ea89b admin admin] PATH_INFO: `/v3/projects/feb3db7d2f624032b552eeaf911646b8/users/37fa12cbe9dd44299d94ef418add40c6/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:26.916179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e243c-47fd-4070-a986-6201c83ea89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb3db7d2f624032b552eeaf911646b8, user_id=37fa12cbe9dd44299d94ef418add40c6, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:26.918982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e243c-47fd-4070-a986-6201c83ea89b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:26.944272 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3592/7230] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:26 2022] PUT /identity/v3/projects/feb3db7d2f624032b552eeaf911646b8/users/37fa12cbe9dd44299d94ef418add40c6/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:26.957401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bec70-48d6-4e9e-8883-5bea59e9bcaa None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:26.957700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bec70-48d6-4e9e-8883-5bea59e9bcaa None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:26.958034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bec70-48d6-4e9e-8883-5bea59e9bcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:27.005843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:27.046294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1d9bec70-48d6-4e9e-8883-5bea59e9bcaa None None] MFA Rules not processed for user `37fa12cbe9dd44299d94ef418add40c6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:27.048017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1d9bec70-48d6-4e9e-8883-5bea59e9bcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:27.206773 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3639/7231] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:27.219600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e243c-47fd-4070-a986-6201c83ea89b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:27.222144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ff3e243c-47fd-4070-a986-6201c83ea89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:27.261173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:27.401220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e243c-47fd-4070-a986-6201c83ea89b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:27.411449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b427b8c-3a3e-4d9a-934f-4ee6d2767125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:27.411838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b427b8c-3a3e-4d9a-934f-4ee6d2767125 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:27.412124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b427b8c-3a3e-4d9a-934f-4ee6d2767125 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:27.412402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b427b8c-3a3e-4d9a-934f-4ee6d2767125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:27.428023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b427b8c-3a3e-4d9a-934f-4ee6d2767125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:27.429903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b427b8c-3a3e-4d9a-934f-4ee6d2767125 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:27.469056 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3593/7232] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:27.641521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bec70-48d6-4e9e-8883-5bea59e9bcaa None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:27.665298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bec70-48d6-4e9e-8883-5bea59e9bcaa None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:27.678983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f057e-e94f-412a-a97f-dbf6de5c1486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:27.679750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f057e-e94f-412a-a97f-dbf6de5c1486 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:27.680184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f057e-e94f-412a-a97f-dbf6de5c1486 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:27.680591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f057e-e94f-412a-a97f-dbf6de5c1486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:27.777083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f057e-e94f-412a-a97f-dbf6de5c1486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:27.778965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f057e-e94f-412a-a97f-dbf6de5c1486 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:27.804064 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3640/7233] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:29.752058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b427b8c-3a3e-4d9a-934f-4ee6d2767125 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:29.756851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5b427b8c-3a3e-4d9a-934f-4ee6d2767125 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:30.001996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b427b8c-3a3e-4d9a-934f-4ee6d2767125 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:30.018411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000b7fe-efae-4c3e-b023-b76bc5564996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:30.019053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000b7fe-efae-4c3e-b023-b76bc5564996 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:30.019331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000b7fe-efae-4c3e-b023-b76bc5564996 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:30.019604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000b7fe-efae-4c3e-b023-b76bc5564996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:30.022162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7000b7fe-efae-4c3e-b023-b76bc5564996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:30.057823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000b7fe-efae-4c3e-b023-b76bc5564996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:30.059837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000b7fe-efae-4c3e-b023-b76bc5564996 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:30.073070 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3594/7234] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:32.184328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f057e-e94f-412a-a97f-dbf6de5c1486 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:32.351251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f057e-e94f-412a-a97f-dbf6de5c1486 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:32.372750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:32.375999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:32.381333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:32.384303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] PATH_INFO: `/v3/users/3233b797e1a64e338203ee6a4636ab49` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:32.386460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3233b797e1a64e338203ee6a4636ab49)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:32.389011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:32.478768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:32.514769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3233b797e1a64e338203ee6a4636ab49'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:32.515812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3233b797e1a64e338203ee6a4636ab49'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:32.541566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3233b797e1a64e338203ee6a4636ab49'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:32.543933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3233b797e1a64e338203ee6a4636ab49'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:32.563077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3233b797e1a64e338203ee6a4636ab49'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:32.594010 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3641/7235] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:32 2022] DELETE /identity/v3/users/3233b797e1a64e338203ee6a4636ab49 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:32.595753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c0e43-443a-4a02-9554-5a41a48ed246 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:32.596217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c0e43-443a-4a02-9554-5a41a48ed246 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:32.596339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c0e43-443a-4a02-9554-5a41a48ed246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:32.621528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fb4c0e43-443a-4a02-9554-5a41a48ed246 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:32.622822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fb4c0e43-443a-4a02-9554-5a41a48ed246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:32.702696 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3595/7236] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:32.718639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:32.720093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:32.844261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f129a-9f28-4ed8-8892-bdcac39a21c4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:32.849852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8e144-1b38-4cbd-8db0-fc489613977a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:32.850440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8e144-1b38-4cbd-8db0-fc489613977a service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:32.850803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8e144-1b38-4cbd-8db0-fc489613977a service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:32.852023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8e144-1b38-4cbd-8db0-fc489613977a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:32.876453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8e144-1b38-4cbd-8db0-fc489613977a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:32.877565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8e144-1b38-4cbd-8db0-fc489613977a service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:32.907910 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3642/7237] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:56:35.126556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c0e43-443a-4a02-9554-5a41a48ed246 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:35.129229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fb4c0e43-443a-4a02-9554-5a41a48ed246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:35.177404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c0e43-443a-4a02-9554-5a41a48ed246 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:35.185897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:35.186804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:35.188028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:35.188718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] PATH_INFO: `/v3/projects/cb3fcfc53fa64cad819199aaae6108b9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:35.191177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb3fcfc53fa64cad819199aaae6108b9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:35.194003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:35.303507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3fcfc53fa64cad819199aaae6108b9', 'request_id': 'req-8d0182dc-c705-419a-bccb-ebb5fe8b750f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:35.313725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:35.314841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3fcfc53fa64cad819199aaae6108b9', 'request_id': 'req-8d0182dc-c705-419a-bccb-ebb5fe8b750f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:35.331620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3fcfc53fa64cad819199aaae6108b9', 'request_id': 'req-8d0182dc-c705-419a-bccb-ebb5fe8b750f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:35.365235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] The token cache is being invalidate because project cb3fcfc53fa64cad819199aaae6108b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:35.366252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:35.367126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:35.372177 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3596/7238] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:35 2022] DELETE /identity/v3/projects/cb3fcfc53fa64cad819199aaae6108b9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:35.373236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8e144-1b38-4cbd-8db0-fc489613977a service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:35.390651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8e144-1b38-4cbd-8db0-fc489613977a service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:35.532176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89bbb0-c737-4c34-899a-5cfc985931e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:35.532868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bbb0-c737-4c34-899a-5cfc985931e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:35.533277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bbb0-c737-4c34-899a-5cfc985931e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:35.533581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bbb0-c737-4c34-899a-5cfc985931e0 admin admin] PATH_INFO: `/v3/users/736bb3190e5f415cb182256552f848a6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:35.534813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89bbb0-c737-4c34-899a-5cfc985931e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=736bb3190e5f415cb182256552f848a6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:35.536933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89bbb0-c737-4c34-899a-5cfc985931e0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:35.636879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0f89bbb0-c737-4c34-899a-5cfc985931e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736bb3190e5f415cb182256552f848a6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:35.637998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0f89bbb0-c737-4c34-899a-5cfc985931e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736bb3190e5f415cb182256552f848a6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:35.647568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:35.672158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0f89bbb0-c737-4c34-899a-5cfc985931e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736bb3190e5f415cb182256552f848a6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:35.675268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0f89bbb0-c737-4c34-899a-5cfc985931e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736bb3190e5f415cb182256552f848a6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:35.701185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0f89bbb0-c737-4c34-899a-5cfc985931e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736bb3190e5f415cb182256552f848a6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:35.734653 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3643/7239] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:35 2022] DELETE /identity/v3/users/736bb3190e5f415cb182256552f848a6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:56:37.072962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:37.074692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:37.108040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0182dc-c705-419a-bccb-ebb5fe8b750f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:37.208443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:37.209775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:37.210056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:37.210332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] PATH_INFO: `/v3/projects/fed77a41a47b4d3680bca4abb306a79c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:37.215861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed77a41a47b4d3680bca4abb306a79c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:37.219152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:37.373453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed77a41a47b4d3680bca4abb306a79c', 'request_id': 'req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:37.403479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed77a41a47b4d3680bca4abb306a79c', 'request_id': 'req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:37.420159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed77a41a47b4d3680bca4abb306a79c', 'request_id': 'req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:37.475065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] The token cache is being invalidate because project fed77a41a47b4d3680bca4abb306a79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:37.475685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:37.476650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-93b7a8a3-f9dc-4e51-bfcc-8e36b427ecc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:37.486059 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3597/7240] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:37 2022] DELETE /identity/v3/projects/fed77a41a47b4d3680bca4abb306a79c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:37.486616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee2934-a861-455f-9937-fdd22db64d73 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:37.487104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee2934-a861-455f-9937-fdd22db64d73 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:37.487205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee2934-a861-455f-9937-fdd22db64d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:37.526909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d4ee2934-a861-455f-9937-fdd22db64d73 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:37.528442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d4ee2934-a861-455f-9937-fdd22db64d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:37.639820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc05c87-e93e-413f-9f7c-2afebc0ca587 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:37.640147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc05c87-e93e-413f-9f7c-2afebc0ca587 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:37.640482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc05c87-e93e-413f-9f7c-2afebc0ca587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:37.666727 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3644/7241] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:37.718496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5bc05c87-e93e-413f-9f7c-2afebc0ca587 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:37.719752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5bc05c87-e93e-413f-9f7c-2afebc0ca587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:37.747847 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3598/7242] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:37.750589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee2934-a861-455f-9937-fdd22db64d73 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:37.765747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee2934-a861-455f-9937-fdd22db64d73 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:37.793717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf859e2-59ce-4966-8d9f-ce1f6a8df3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:37.794366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf859e2-59ce-4966-8d9f-ce1f6a8df3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:37.794657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf859e2-59ce-4966-8d9f-ce1f6a8df3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:37.794930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf859e2-59ce-4966-8d9f-ce1f6a8df3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:37.795595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf859e2-59ce-4966-8d9f-ce1f6a8df3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:37.795904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf859e2-59ce-4966-8d9f-ce1f6a8df3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:37.797859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf859e2-59ce-4966-8d9f-ce1f6a8df3d1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:37.852719 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3645/7243] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:56:37.854752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc05c87-e93e-413f-9f7c-2afebc0ca587 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:37.871840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc05c87-e93e-413f-9f7c-2afebc0ca587 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:37.881469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca48b3a-a789-4b48-8630-37e3bf7a272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:37.882360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca48b3a-a789-4b48-8630-37e3bf7a272a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:37.882791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca48b3a-a789-4b48-8630-37e3bf7a272a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:37.883248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca48b3a-a789-4b48-8630-37e3bf7a272a admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:37.885221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca48b3a-a789-4b48-8630-37e3bf7a272a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:37.888431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca48b3a-a789-4b48-8630-37e3bf7a272a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:38.043124 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3599/7244] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:37 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:38.047226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf859e2-59ce-4966-8d9f-ce1f6a8df3d1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:38.070492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf859e2-59ce-4966-8d9f-ce1f6a8df3d1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:38.280864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e7345-71fb-434d-8580-95bf0aa0e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:38.282556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e7345-71fb-434d-8580-95bf0aa0e430 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:38.283267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e7345-71fb-434d-8580-95bf0aa0e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:38.284977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e7345-71fb-434d-8580-95bf0aa0e430 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:38.286017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e7345-71fb-434d-8580-95bf0aa0e430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:38.289098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e7345-71fb-434d-8580-95bf0aa0e430 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:38.336415 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3646/7245] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:38 2022] POST /identity/v3/users => generated 292 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:38.342025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca48b3a-a789-4b48-8630-37e3bf7a272a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:38.379272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca48b3a-a789-4b48-8630-37e3bf7a272a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:38.391138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbd8b7-35c9-49f0-bda9-ebcf6a1c8f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:38.392185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd8b7-35c9-49f0-bda9-ebcf6a1c8f61 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:38.395566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd8b7-35c9-49f0-bda9-ebcf6a1c8f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:38.395860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd8b7-35c9-49f0-bda9-ebcf6a1c8f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:38.396575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbd8b7-35c9-49f0-bda9-ebcf6a1c8f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:38.402832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbd8b7-35c9-49f0-bda9-ebcf6a1c8f61 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:38.436179 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3600/7246] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:38.440944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e7345-71fb-434d-8580-95bf0aa0e430 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:38.454824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e7345-71fb-434d-8580-95bf0aa0e430 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:38.471814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50623bb6-a9f4-4769-8c54-f92df4fa4eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:38.471814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50623bb6-a9f4-4769-8c54-f92df4fa4eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:38.471814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50623bb6-a9f4-4769-8c54-f92df4fa4eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:38.473256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50623bb6-a9f4-4769-8c54-f92df4fa4eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:38.474508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50623bb6-a9f4-4769-8c54-f92df4fa4eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:38.477247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50623bb6-a9f4-4769-8c54-f92df4fa4eb4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:38.513440 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3647/7247] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:56:38.518397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbd8b7-35c9-49f0-bda9-ebcf6a1c8f61 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:38.535281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbd8b7-35c9-49f0-bda9-ebcf6a1c8f61 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:38.553507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ba2c1-4469-4681-a6a5-bc7580ed78e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:38.559400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ba2c1-4469-4681-a6a5-bc7580ed78e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:38.561417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ba2c1-4469-4681-a6a5-bc7580ed78e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:38.563694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ba2c1-4469-4681-a6a5-bc7580ed78e1 admin admin] PATH_INFO: `/v3/projects/2f85e7f4ced54460b4e1f446ae9df34f/users/9c0d727094934d989698d26208a0926e/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:38.619610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ba2c1-4469-4681-a6a5-bc7580ed78e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f85e7f4ced54460b4e1f446ae9df34f, user_id=9c0d727094934d989698d26208a0926e, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:38.626657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ba2c1-4469-4681-a6a5-bc7580ed78e1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:38.664394 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3601/7248] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:38 2022] PUT /identity/v3/projects/2f85e7f4ced54460b4e1f446ae9df34f/users/9c0d727094934d989698d26208a0926e/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:38.681571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15edae-5ae4-4847-a495-b0d6d772f818 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:38.681905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15edae-5ae4-4847-a495-b0d6d772f818 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:38.682190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15edae-5ae4-4847-a495-b0d6d772f818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:38.761341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ef15edae-5ae4-4847-a495-b0d6d772f818 None None] MFA Rules not processed for user `9c0d727094934d989698d26208a0926e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:38.765096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ef15edae-5ae4-4847-a495-b0d6d772f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:38.832467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:38.894638 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3648/7249] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:38.906659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ba2c1-4469-4681-a6a5-bc7580ed78e1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:38.908789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bd2ba2c1-4469-4681-a6a5-bc7580ed78e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:38.929318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:39.066176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ba2c1-4469-4681-a6a5-bc7580ed78e1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:39.076870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb58fc4-69f0-419d-ae0f-7e19fa8e3306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:39.077956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58fc4-69f0-419d-ae0f-7e19fa8e3306 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:39.079671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58fc4-69f0-419d-ae0f-7e19fa8e3306 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:39.082839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58fc4-69f0-419d-ae0f-7e19fa8e3306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:39.115601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb58fc4-69f0-419d-ae0f-7e19fa8e3306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:39.118029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb58fc4-69f0-419d-ae0f-7e19fa8e3306 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:39.158777 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3602/7250] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:39.416341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7c95f-b706-46c6-82b5-ec1863eb4a42 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:39.416648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7c95f-b706-46c6-82b5-ec1863eb4a42 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:39.416955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7c95f-b706-46c6-82b5-ec1863eb4a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:39.463543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-81d7c95f-b706-46c6-82b5-ec1863eb4a42 None None] MFA Rules not processed for user `74602998065943c4a49a96d23ec0ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:39.469061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-81d7c95f-b706-46c6-82b5-ec1863eb4a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:39.625876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3649/7251] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:47.005760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb58fc4-69f0-419d-ae0f-7e19fa8e3306 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:47.105717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb58fc4-69f0-419d-ae0f-7e19fa8e3306 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:47.111627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:47.112386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:47.113053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:47.113443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] PATH_INFO: `/v3/users/9c0d727094934d989698d26208a0926e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:47.115180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0d727094934d989698d26208a0926e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:47.118145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:47.283892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0d727094934d989698d26208a0926e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:47.283892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0d727094934d989698d26208a0926e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:47.336110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0d727094934d989698d26208a0926e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:47.351174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0d727094934d989698d26208a0926e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:47.374483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0d727094934d989698d26208a0926e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:47.388403 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3603/7252] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:47 2022] DELETE /identity/v3/users/9c0d727094934d989698d26208a0926e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:47.398407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602e27-fe02-4ac2-afe3-b9d3efbffce2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:47.399008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602e27-fe02-4ac2-afe3-b9d3efbffce2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:47.399008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602e27-fe02-4ac2-afe3-b9d3efbffce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:47.449341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b4602e27-fe02-4ac2-afe3-b9d3efbffce2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:47.452169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b4602e27-fe02-4ac2-afe3-b9d3efbffce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:47.686785 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3650/7253] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:56:47.770094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:47.771580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:47.876076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:47.917031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15848ba4-e586-4010-bfda-098c6473576b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:47.930323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde1508-785d-459d-9113-a43102f42c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:47.931513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde1508-785d-459d-9113-a43102f42c13 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:47.931799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde1508-785d-459d-9113-a43102f42c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:47.932078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde1508-785d-459d-9113-a43102f42c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:47.976776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde1508-785d-459d-9113-a43102f42c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:47.978846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde1508-785d-459d-9113-a43102f42c13 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:48.005944 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3604/7254] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:49.658279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4602e27-fe02-4ac2-afe3-b9d3efbffce2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:49.661682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b4602e27-fe02-4ac2-afe3-b9d3efbffce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:49.687374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4602e27-fe02-4ac2-afe3-b9d3efbffce2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:49.702594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:49.705212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:49.706173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:49.706542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] PATH_INFO: `/v3/projects/2f85e7f4ced54460b4e1f446ae9df34f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:49.708572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f85e7f4ced54460b4e1f446ae9df34f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:49.710961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:49.850217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f85e7f4ced54460b4e1f446ae9df34f', 'request_id': 'req-4cae7759-1d6c-473c-979b-9e68cf8c986f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:49.904461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f85e7f4ced54460b4e1f446ae9df34f', 'request_id': 'req-4cae7759-1d6c-473c-979b-9e68cf8c986f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:49.916457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f85e7f4ced54460b4e1f446ae9df34f', 'request_id': 'req-4cae7759-1d6c-473c-979b-9e68cf8c986f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:49.929045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:49.944972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] The token cache is being invalidate because project 2f85e7f4ced54460b4e1f446ae9df34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:49.945346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:49.948867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4cae7759-1d6c-473c-979b-9e68cf8c986f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:49.963961 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3651/7255] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:49 2022] DELETE /identity/v3/projects/2f85e7f4ced54460b4e1f446ae9df34f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:49.964190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5da31-df59-4c4e-b4a5-13680a46c778 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:49.964190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5da31-df59-4c4e-b4a5-13680a46c778 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:49.964190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5da31-df59-4c4e-b4a5-13680a46c778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:49.988068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b2e5da31-df59-4c4e-b4a5-13680a46c778 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:49.989796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b2e5da31-df59-4c4e-b4a5-13680a46c778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:50.077575 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3605/7256] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:50.083780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaabbc-76e2-42ca-9fb8-86043d4a2baf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:50.084156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaabbc-76e2-42ca-9fb8-86043d4a2baf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:50.084457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaabbc-76e2-42ca-9fb8-86043d4a2baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:50.119061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-06eaabbc-76e2-42ca-9fb8-86043d4a2baf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:50.120505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-06eaabbc-76e2-42ca-9fb8-86043d4a2baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:50.131094 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3652/7257] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:50.135671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5da31-df59-4c4e-b4a5-13680a46c778 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:50.147630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5da31-df59-4c4e-b4a5-13680a46c778 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:50.153023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b49415-654b-4fa7-894d-8d4cf21569de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:50.153850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b49415-654b-4fa7-894d-8d4cf21569de admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:50.154238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b49415-654b-4fa7-894d-8d4cf21569de admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:50.154614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b49415-654b-4fa7-894d-8d4cf21569de admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:50.155566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b49415-654b-4fa7-894d-8d4cf21569de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:50.155978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b49415-654b-4fa7-894d-8d4cf21569de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:50.158463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b49415-654b-4fa7-894d-8d4cf21569de admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:50.178857 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3606/7258] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:56:50.180669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaabbc-76e2-42ca-9fb8-86043d4a2baf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:50.193295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaabbc-76e2-42ca-9fb8-86043d4a2baf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:50.205606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b709-f7dc-4b04-a596-5996ae2db634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:50.206961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b709-f7dc-4b04-a596-5996ae2db634 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:50.207348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b709-f7dc-4b04-a596-5996ae2db634 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:50.207990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b709-f7dc-4b04-a596-5996ae2db634 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:50.208801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1b709-f7dc-4b04-a596-5996ae2db634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:50.211364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1b709-f7dc-4b04-a596-5996ae2db634 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:50.265473 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3653/7259] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:50 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:50.269002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b49415-654b-4fa7-894d-8d4cf21569de admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:50.285676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b49415-654b-4fa7-894d-8d4cf21569de admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:50.372661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9d596-aa93-45a2-94e6-25c9ab1e95f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:50.374576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9d596-aa93-45a2-94e6-25c9ab1e95f2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:50.375132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9d596-aa93-45a2-94e6-25c9ab1e95f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:50.375634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9d596-aa93-45a2-94e6-25c9ab1e95f2 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:50.376502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9d596-aa93-45a2-94e6-25c9ab1e95f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:50.379243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9d596-aa93-45a2-94e6-25c9ab1e95f2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:50.417670 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3607/7260] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:50 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:50.421956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b709-f7dc-4b04-a596-5996ae2db634 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:50.438085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b709-f7dc-4b04-a596-5996ae2db634 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:50.443396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd14f72-e5fa-4137-b186-6e16a6783643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:50.444014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14f72-e5fa-4137-b186-6e16a6783643 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:50.444288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14f72-e5fa-4137-b186-6e16a6783643 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:50.444558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14f72-e5fa-4137-b186-6e16a6783643 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:50.445372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd14f72-e5fa-4137-b186-6e16a6783643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:50.447442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd14f72-e5fa-4137-b186-6e16a6783643 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:50.460119 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3654/7261] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:50.464545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9d596-aa93-45a2-94e6-25c9ab1e95f2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:50.475594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9d596-aa93-45a2-94e6-25c9ab1e95f2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:50.482383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27b11f-c30b-4fea-bab8-28f6f2f447b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:50.483172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b11f-c30b-4fea-bab8-28f6f2f447b5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:50.483682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b11f-c30b-4fea-bab8-28f6f2f447b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:50.484096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b11f-c30b-4fea-bab8-28f6f2f447b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:50.484837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27b11f-c30b-4fea-bab8-28f6f2f447b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:50.487076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27b11f-c30b-4fea-bab8-28f6f2f447b5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:50.511460 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3608/7262] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:50.513003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd14f72-e5fa-4137-b186-6e16a6783643 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:50.525034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd14f72-e5fa-4137-b186-6e16a6783643 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:50.531120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d648-1664-49cc-9ff2-d5b877706536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:50.531854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d648-1664-49cc-9ff2-d5b877706536 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:50.532303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d648-1664-49cc-9ff2-d5b877706536 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:50.543071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d648-1664-49cc-9ff2-d5b877706536 admin admin] PATH_INFO: `/v3/projects/7686f5f846414b3b9706ae0a9f89ba6f/users/9b95cef51ea04d9b886a7c29791ec255/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:50.562168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851d648-1664-49cc-9ff2-d5b877706536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7686f5f846414b3b9706ae0a9f89ba6f, user_id=9b95cef51ea04d9b886a7c29791ec255, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:50.564780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851d648-1664-49cc-9ff2-d5b877706536 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:50.590791 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3655/7263] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:50 2022] PUT /identity/v3/projects/7686f5f846414b3b9706ae0a9f89ba6f/users/9b95cef51ea04d9b886a7c29791ec255/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:50.593145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023345-5533-40ab-8d9a-f91a998b64a6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:50.593567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023345-5533-40ab-8d9a-f91a998b64a6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:50.594015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023345-5533-40ab-8d9a-f91a998b64a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:50.643379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-44023345-5533-40ab-8d9a-f91a998b64a6 None None] MFA Rules not processed for user `9b95cef51ea04d9b886a7c29791ec255`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:50.644821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-44023345-5533-40ab-8d9a-f91a998b64a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:50.687120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:50.742694 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3609/7264] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:50.748415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d648-1664-49cc-9ff2-d5b877706536 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:50.855772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d648-1664-49cc-9ff2-d5b877706536 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:50.860895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998921-0211-4f3f-b8b2-3d68a0c7dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:50.861527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998921-0211-4f3f-b8b2-3d68a0c7dd68 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:50.861871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998921-0211-4f3f-b8b2-3d68a0c7dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:50.862172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998921-0211-4f3f-b8b2-3d68a0c7dd68 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:50.862817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de998921-0211-4f3f-b8b2-3d68a0c7dd68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:50.864737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de998921-0211-4f3f-b8b2-3d68a0c7dd68 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:50.902726 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3656/7265] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:50 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:50.903934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44023345-5533-40ab-8d9a-f91a998b64a6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:50.915965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44023345-5533-40ab-8d9a-f91a998b64a6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:51.058218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ba273-3ab2-4df8-84bc-0141060ab130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:51.060182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ba273-3ab2-4df8-84bc-0141060ab130 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:51.061120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ba273-3ab2-4df8-84bc-0141060ab130 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:51.062385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ba273-3ab2-4df8-84bc-0141060ab130 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:51.063107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ba273-3ab2-4df8-84bc-0141060ab130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:51.065021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ba273-3ab2-4df8-84bc-0141060ab130 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:51.139007 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3610/7266] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:50 2022] POST /identity/v3/users => generated 295 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:51.139788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998921-0211-4f3f-b8b2-3d68a0c7dd68 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:51.156454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998921-0211-4f3f-b8b2-3d68a0c7dd68 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:51.172281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485215-449f-4761-8de7-1d48ce7aab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:51.173170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485215-449f-4761-8de7-1d48ce7aab29 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:51.173517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485215-449f-4761-8de7-1d48ce7aab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:51.173806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485215-449f-4761-8de7-1d48ce7aab29 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:51.174468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68485215-449f-4761-8de7-1d48ce7aab29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:51.176112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68485215-449f-4761-8de7-1d48ce7aab29 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:51.197637 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3657/7267] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:56:51.203601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ba273-3ab2-4df8-84bc-0141060ab130 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:51.230876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ba273-3ab2-4df8-84bc-0141060ab130 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:51.244621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ccd6c-4f0c-409e-922d-d1dd5728d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:51.245620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ccd6c-4f0c-409e-922d-d1dd5728d9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:51.246164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ccd6c-4f0c-409e-922d-d1dd5728d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:51.246653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ccd6c-4f0c-409e-922d-d1dd5728d9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:51.247714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ccd6c-4f0c-409e-922d-d1dd5728d9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:51.250134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ccd6c-4f0c-409e-922d-d1dd5728d9a0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:51.266646 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3611/7268] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:51.271529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485215-449f-4761-8de7-1d48ce7aab29 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:51.284140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485215-449f-4761-8de7-1d48ce7aab29 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:51.291904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cb66a-fa50-4ce8-934d-dbb1a0f8f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:51.294612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cb66a-fa50-4ce8-934d-dbb1a0f8f1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:51.294996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cb66a-fa50-4ce8-934d-dbb1a0f8f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:51.295357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cb66a-fa50-4ce8-934d-dbb1a0f8f1dc admin admin] PATH_INFO: `/v3/projects/99d44e2dca024327add35f5171b219a3/users/515436464dff424bb2ccabbd36990d8b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:51.318546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cb66a-fa50-4ce8-934d-dbb1a0f8f1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d44e2dca024327add35f5171b219a3, user_id=515436464dff424bb2ccabbd36990d8b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:51.322956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cb66a-fa50-4ce8-934d-dbb1a0f8f1dc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:51.341151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ccd6c-4f0c-409e-922d-d1dd5728d9a0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:51.343527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-981ccd6c-4f0c-409e-922d-d1dd5728d9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:51.353092 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3658/7269] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:51 2022] PUT /identity/v3/projects/99d44e2dca024327add35f5171b219a3/users/515436464dff424bb2ccabbd36990d8b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:51.367353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ccd6c-4f0c-409e-922d-d1dd5728d9a0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:51.367749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d25c7-2bad-4bf6-8f21-fa25dca05a98 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:51.368048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d25c7-2bad-4bf6-8f21-fa25dca05a98 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:51.368877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d25c7-2bad-4bf6-8f21-fa25dca05a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:51.412567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dd7d25c7-2bad-4bf6-8f21-fa25dca05a98 None None] MFA Rules not processed for user `515436464dff424bb2ccabbd36990d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:51.413813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dd7d25c7-2bad-4bf6-8f21-fa25dca05a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:51.450190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:51.518743 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3659/7270] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:51.522878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d25c7-2bad-4bf6-8f21-fa25dca05a98 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:51.532496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f304db-d173-4d87-a4e6-df4382b08fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:51.535776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f304db-d173-4d87-a4e6-df4382b08fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:51.538328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f304db-d173-4d87-a4e6-df4382b08fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:51.538823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f304db-d173-4d87-a4e6-df4382b08fc3 admin admin] PATH_INFO: `/v3/users/305d5b19d79f4aaaa535a9e5cda911d3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:51.541552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f304db-d173-4d87-a4e6-df4382b08fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=305d5b19d79f4aaaa535a9e5cda911d3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:51.549462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f304db-d173-4d87-a4e6-df4382b08fc3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:51.637308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d25c7-2bad-4bf6-8f21-fa25dca05a98 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:51.643603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f46ee-bf6e-4de9-a50c-17e430a02562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:51.644406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f46ee-bf6e-4de9-a50c-17e430a02562 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:51.644692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f46ee-bf6e-4de9-a50c-17e430a02562 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:51.645047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f46ee-bf6e-4de9-a50c-17e430a02562 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:51.646168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f46ee-bf6e-4de9-a50c-17e430a02562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:51.648833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f46ee-bf6e-4de9-a50c-17e430a02562 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:51.668139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d8f304db-d173-4d87-a4e6-df4382b08fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '305d5b19d79f4aaaa535a9e5cda911d3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:51.668902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d8f304db-d173-4d87-a4e6-df4382b08fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '305d5b19d79f4aaaa535a9e5cda911d3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:51.674695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:51.691369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d8f304db-d173-4d87-a4e6-df4382b08fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '305d5b19d79f4aaaa535a9e5cda911d3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:51.694220 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3660/7271] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:51 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:56:51.698102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f46ee-bf6e-4de9-a50c-17e430a02562 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:51.714847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d8f304db-d173-4d87-a4e6-df4382b08fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '305d5b19d79f4aaaa535a9e5cda911d3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:51.736296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d8f304db-d173-4d87-a4e6-df4382b08fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '305d5b19d79f4aaaa535a9e5cda911d3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:51.750636 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3612/7272] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:51 2022] DELETE /identity/v3/users/305d5b19d79f4aaaa535a9e5cda911d3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:51.755717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6aba3-7801-4a4a-82bd-0a4549f84b4c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:51.756248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6aba3-7801-4a4a-82bd-0a4549f84b4c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:51.756688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6aba3-7801-4a4a-82bd-0a4549f84b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:51.803652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f8e6aba3-7801-4a4a-82bd-0a4549f84b4c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:51.805140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f8e6aba3-7801-4a4a-82bd-0a4549f84b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:51.903467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f46ee-bf6e-4de9-a50c-17e430a02562 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:51.951929 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3613/7273] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:51.972933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6aba3-7801-4a4a-82bd-0a4549f84b4c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:51.974319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f8e6aba3-7801-4a4a-82bd-0a4549f84b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:52.025700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0ba1-83ba-4893-8048-3aca1065402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:52.026510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0ba1-83ba-4893-8048-3aca1065402a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:52.026980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0ba1-83ba-4893-8048-3aca1065402a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:52.027349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0ba1-83ba-4893-8048-3aca1065402a admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:52.028085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f0ba1-83ba-4893-8048-3aca1065402a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:52.030177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f0ba1-83ba-4893-8048-3aca1065402a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:52.078023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:52.081765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6aba3-7801-4a4a-82bd-0a4549f84b4c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:52.085890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68682500-14f6-4647-9ce5-a625f366ece3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:52.086513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68682500-14f6-4647-9ce5-a625f366ece3 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:52.087032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68682500-14f6-4647-9ce5-a625f366ece3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:52.087751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68682500-14f6-4647-9ce5-a625f366ece3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:52.096144 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3661/7274] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:51 2022] POST /identity/v3/users => generated 300 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:52.099257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0ba1-83ba-4893-8048-3aca1065402a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:52.100870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68682500-14f6-4647-9ce5-a625f366ece3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:52.101189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9b8f0ba1-83ba-4893-8048-3aca1065402a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:52.102312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68682500-14f6-4647-9ce5-a625f366ece3 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:52.115102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0ba1-83ba-4893-8048-3aca1065402a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:52.120693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eb3e7-edca-49d2-88d6-a3471dd13e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:52.121448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb3e7-edca-49d2-88d6-a3471dd13e15 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:52.121827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb3e7-edca-49d2-88d6-a3471dd13e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:52.122190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb3e7-edca-49d2-88d6-a3471dd13e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:52.122968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643eb3e7-edca-49d2-88d6-a3471dd13e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:52.124962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643eb3e7-edca-49d2-88d6-a3471dd13e15 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:52.129002 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3614/7275] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:52.141698 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3662/7276] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:56:52.142895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68682500-14f6-4647-9ce5-a625f366ece3 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:52.154520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68682500-14f6-4647-9ce5-a625f366ece3 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:52.159813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1655a1-5c4a-41f5-aeaa-3573aac2a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:52.161179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1655a1-5c4a-41f5-aeaa-3573aac2a0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:52.161512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1655a1-5c4a-41f5-aeaa-3573aac2a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:52.161932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1655a1-5c4a-41f5-aeaa-3573aac2a0c3 admin admin] PATH_INFO: `/v3/projects/d0ec230ad50c46288f9069fbaaec87ad/users/034d90e5a7824151b8bf36f4fdfcad8c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:52.192349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1655a1-5c4a-41f5-aeaa-3573aac2a0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ec230ad50c46288f9069fbaaec87ad, user_id=034d90e5a7824151b8bf36f4fdfcad8c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:52.195076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1655a1-5c4a-41f5-aeaa-3573aac2a0c3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:52.213334 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3615/7277] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:52 2022] PUT /identity/v3/projects/d0ec230ad50c46288f9069fbaaec87ad/users/034d90e5a7824151b8bf36f4fdfcad8c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:52.217058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eb3e7-edca-49d2-88d6-a3471dd13e15 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:52.228439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eb3e7-edca-49d2-88d6-a3471dd13e15 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:52.303427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e43d8-5635-4bcd-94e4-1de974d945a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:52.304035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e43d8-5635-4bcd-94e4-1de974d945a0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:52.304409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e43d8-5635-4bcd-94e4-1de974d945a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:52.304694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e43d8-5635-4bcd-94e4-1de974d945a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:52.305484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e43d8-5635-4bcd-94e4-1de974d945a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:52.308115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e43d8-5635-4bcd-94e4-1de974d945a0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:52.325641 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3663/7278] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:56:52.326785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1655a1-5c4a-41f5-aeaa-3573aac2a0c3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:52.357044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1655a1-5c4a-41f5-aeaa-3573aac2a0c3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:52.375555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33efc2-40a9-4379-a37d-33e09195be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:52.376256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33efc2-40a9-4379-a37d-33e09195be41 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:52.376571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33efc2-40a9-4379-a37d-33e09195be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:52.376989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33efc2-40a9-4379-a37d-33e09195be41 admin admin] PATH_INFO: `/v3/projects/d0ec230ad50c46288f9069fbaaec87ad/users/034d90e5a7824151b8bf36f4fdfcad8c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:52.379300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33efc2-40a9-4379-a37d-33e09195be41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ec230ad50c46288f9069fbaaec87ad, user_id=034d90e5a7824151b8bf36f4fdfcad8c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:52.382009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33efc2-40a9-4379-a37d-33e09195be41 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:52.415766 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3616/7279] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:52 2022] PUT /identity/v3/projects/d0ec230ad50c46288f9069fbaaec87ad/users/034d90e5a7824151b8bf36f4fdfcad8c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:52.419032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357c61f-6e71-4d6b-ab65-d71d42d9785d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:52.419610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357c61f-6e71-4d6b-ab65-d71d42d9785d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:52.420147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357c61f-6e71-4d6b-ab65-d71d42d9785d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:52.482305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2357c61f-6e71-4d6b-ab65-d71d42d9785d None None] MFA Rules not processed for user `034d90e5a7824151b8bf36f4fdfcad8c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:52.484237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2357c61f-6e71-4d6b-ab65-d71d42d9785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:52.574044 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3664/7280] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:52.593265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33efc2-40a9-4379-a37d-33e09195be41 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:52.595186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0d33efc2-40a9-4379-a37d-33e09195be41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:52.682951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:52.755000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33efc2-40a9-4379-a37d-33e09195be41 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:52.767540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9b9b2-67b3-4605-b793-7c9e3c9e11b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:52.768532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9b9b2-67b3-4605-b793-7c9e3c9e11b3 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:52.769499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9b9b2-67b3-4605-b793-7c9e3c9e11b3 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:52.769499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9b9b2-67b3-4605-b793-7c9e3c9e11b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:52.771731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-18d9b9b2-67b3-4605-b793-7c9e3c9e11b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:52.857421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9b9b2-67b3-4605-b793-7c9e3c9e11b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:52.858988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9b9b2-67b3-4605-b793-7c9e3c9e11b3 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:52.876317 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3617/7281] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:53.361495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357c61f-6e71-4d6b-ab65-d71d42d9785d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:53.365577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2357c61f-6e71-4d6b-ab65-d71d42d9785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:53.535299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357c61f-6e71-4d6b-ab65-d71d42d9785d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:53.543841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:53.544614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:53.544993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:53.545359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] PATH_INFO: `/v3/projects/9c8c5aae333149eba3769864fc726453` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:53.547296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8c5aae333149eba3769864fc726453)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:53.549696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:53.559443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:53.676318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8c5aae333149eba3769864fc726453', 'request_id': 'req-6a14fedd-20d4-494b-b758-44b786723487'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:53.691830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8c5aae333149eba3769864fc726453', 'request_id': 'req-6a14fedd-20d4-494b-b758-44b786723487'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:53.720732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8c5aae333149eba3769864fc726453', 'request_id': 'req-6a14fedd-20d4-494b-b758-44b786723487'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:53.749689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] The token cache is being invalidate because project 9c8c5aae333149eba3769864fc726453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:53.750722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:53.751766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:53.757051 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3665/7282] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:53 2022] DELETE /identity/v3/projects/9c8c5aae333149eba3769864fc726453 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:53.762736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9b9b2-67b3-4605-b793-7c9e3c9e11b3 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:53.788043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9b9b2-67b3-4605-b793-7c9e3c9e11b3 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:53.919805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077df2a9-c280-48f1-8afa-b70ef8489881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:53.920491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077df2a9-c280-48f1-8afa-b70ef8489881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:53.921240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077df2a9-c280-48f1-8afa-b70ef8489881 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:53.921240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077df2a9-c280-48f1-8afa-b70ef8489881 admin admin] PATH_INFO: `/v3/users/e9dcc4dbfe314decb6906233ac11cea0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:53.922268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077df2a9-c280-48f1-8afa-b70ef8489881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9dcc4dbfe314decb6906233ac11cea0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:53.924627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077df2a9-c280-48f1-8afa-b70ef8489881 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:54.034033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-077df2a9-c280-48f1-8afa-b70ef8489881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9dcc4dbfe314decb6906233ac11cea0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:54.038913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-077df2a9-c280-48f1-8afa-b70ef8489881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9dcc4dbfe314decb6906233ac11cea0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:54.065688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-077df2a9-c280-48f1-8afa-b70ef8489881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9dcc4dbfe314decb6906233ac11cea0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:54.089372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-077df2a9-c280-48f1-8afa-b70ef8489881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9dcc4dbfe314decb6906233ac11cea0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:54.091972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:54.105890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-077df2a9-c280-48f1-8afa-b70ef8489881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9dcc4dbfe314decb6906233ac11cea0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:54.121208 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3618/7283] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:56:53 2022] DELETE /identity/v3/users/e9dcc4dbfe314decb6906233ac11cea0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:55.207386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:55.210521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:55.255099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14fedd-20d4-494b-b758-44b786723487 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:55.424053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:55.425089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:55.425540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:55.425830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] PATH_INFO: `/v3/projects/8e1ef32bc30c49faa6292d87a363f69f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:55.428103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1ef32bc30c49faa6292d87a363f69f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:55.430118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:55.539210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1ef32bc30c49faa6292d87a363f69f', 'request_id': 'req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:55.547156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1ef32bc30c49faa6292d87a363f69f', 'request_id': 'req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:55.558027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1ef32bc30c49faa6292d87a363f69f', 'request_id': 'req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:55.586051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] The token cache is being invalidate because project 8e1ef32bc30c49faa6292d87a363f69f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:56:55.586356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:55.588074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fe7135ef-7462-44d3-8792-6c5a7a5de3d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:56:55.592497 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3666/7284] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:56:55 2022] DELETE /identity/v3/projects/8e1ef32bc30c49faa6292d87a363f69f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:55.597813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8e3ac-27b1-40f8-9e8d-64c6722de241 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:55.598302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8e3ac-27b1-40f8-9e8d-64c6722de241 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:55.599360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8e3ac-27b1-40f8-9e8d-64c6722de241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:55.648518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-80a8e3ac-27b1-40f8-9e8d-64c6722de241 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:55.652470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-80a8e3ac-27b1-40f8-9e8d-64c6722de241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:55.806453 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3619/7285] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:56:55.815441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea50ba-10a4-46ca-8c9b-5bc5ce773a2f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:55.815731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea50ba-10a4-46ca-8c9b-5bc5ce773a2f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:55.816203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea50ba-10a4-46ca-8c9b-5bc5ce773a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:55.875952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1aea50ba-10a4-46ca-8c9b-5bc5ce773a2f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:55.879047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1aea50ba-10a4-46ca-8c9b-5bc5ce773a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:55.896857 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3667/7286] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:55.897898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8e3ac-27b1-40f8-9e8d-64c6722de241 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:55.915506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8e3ac-27b1-40f8-9e8d-64c6722de241 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:55.939168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fd311-afff-4945-bdb9-a54d6054993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:55.940841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fd311-afff-4945-bdb9-a54d6054993d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:55.941370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fd311-afff-4945-bdb9-a54d6054993d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:55.942036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fd311-afff-4945-bdb9-a54d6054993d admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:55.943441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fd311-afff-4945-bdb9-a54d6054993d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:56:55.943583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fd311-afff-4945-bdb9-a54d6054993d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:55.948308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fd311-afff-4945-bdb9-a54d6054993d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:55.967980 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3620/7287] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:56:55.971839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea50ba-10a4-46ca-8c9b-5bc5ce773a2f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:55.985455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea50ba-10a4-46ca-8c9b-5bc5ce773a2f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:55.998519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae521be-16d1-43fe-a970-c96ec4f4f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:55.999683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae521be-16d1-43fe-a970-c96ec4f4f290 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:56.000392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae521be-16d1-43fe-a970-c96ec4f4f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:56.000921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae521be-16d1-43fe-a970-c96ec4f4f290 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:56.001911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae521be-16d1-43fe-a970-c96ec4f4f290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:56.007289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae521be-16d1-43fe-a970-c96ec4f4f290 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:56.049438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:56.088538 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3668/7288] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:56:55 2022] POST /identity/v3/projects => generated 395 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:56.093564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fd311-afff-4945-bdb9-a54d6054993d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:56.113906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fd311-afff-4945-bdb9-a54d6054993d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:56.262137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d1450-26a8-4943-8105-631dfb302a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:56.262767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1450-26a8-4943-8105-631dfb302a57 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:56.263047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1450-26a8-4943-8105-631dfb302a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:56.263486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1450-26a8-4943-8105-631dfb302a57 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:56.264124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d1450-26a8-4943-8105-631dfb302a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:56.270153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d1450-26a8-4943-8105-631dfb302a57 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:56.315848 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3621/7289] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:56:56 2022] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:56:56.319886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae521be-16d1-43fe-a970-c96ec4f4f290 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:56.339964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae521be-16d1-43fe-a970-c96ec4f4f290 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:56.353783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f893650-0083-447f-8c47-8dd8890c2abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:56.354411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f893650-0083-447f-8c47-8dd8890c2abf admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:56.354693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f893650-0083-447f-8c47-8dd8890c2abf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:56.354962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f893650-0083-447f-8c47-8dd8890c2abf admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:56.355615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f893650-0083-447f-8c47-8dd8890c2abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:56.357211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f893650-0083-447f-8c47-8dd8890c2abf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:56.379704 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3669/7290] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:56:56.380541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d1450-26a8-4943-8105-631dfb302a57 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:56.400898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d1450-26a8-4943-8105-631dfb302a57 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:56.411414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbba6c7-544b-433e-9f1f-e8c917f309d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:56.412050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba6c7-544b-433e-9f1f-e8c917f309d5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:56.412337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba6c7-544b-433e-9f1f-e8c917f309d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:56.412613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba6c7-544b-433e-9f1f-e8c917f309d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:56.413267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbba6c7-544b-433e-9f1f-e8c917f309d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:56.415569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbba6c7-544b-433e-9f1f-e8c917f309d5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:56.443605 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3622/7291] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:56:56.445311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f893650-0083-447f-8c47-8dd8890c2abf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:56.463804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f893650-0083-447f-8c47-8dd8890c2abf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:56.487625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bfc46-e7d5-4bfb-97c1-138c5544c588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:56.488612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bfc46-e7d5-4bfb-97c1-138c5544c588 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:56.489085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bfc46-e7d5-4bfb-97c1-138c5544c588 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:56.489593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bfc46-e7d5-4bfb-97c1-138c5544c588 admin admin] PATH_INFO: `/v3/projects/fe4f71db8ab04238a4abbf8c33167d6e/users/63fd3dfce40b4b47b8b3f78608a8d0c7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:56.548674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bfc46-e7d5-4bfb-97c1-138c5544c588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4f71db8ab04238a4abbf8c33167d6e, user_id=63fd3dfce40b4b47b8b3f78608a8d0c7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:56.551378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bfc46-e7d5-4bfb-97c1-138c5544c588 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:56.598988 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3670/7292] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:56:56 2022] PUT /identity/v3/projects/fe4f71db8ab04238a4abbf8c33167d6e/users/63fd3dfce40b4b47b8b3f78608a8d0c7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:56:56.610163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce0ffa-0c10-4ca2-b83a-a8106def1c62 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:56.610690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce0ffa-0c10-4ca2-b83a-a8106def1c62 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:56.610924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce0ffa-0c10-4ca2-b83a-a8106def1c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:56.671799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f6ce0ffa-0c10-4ca2-b83a-a8106def1c62 None None] MFA Rules not processed for user `63fd3dfce40b4b47b8b3f78608a8d0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:56:56.675132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f6ce0ffa-0c10-4ca2-b83a-a8106def1c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:56.778110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:56.824715 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3623/7293] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:56:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:56:56.847344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bfc46-e7d5-4bfb-97c1-138c5544c588 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:56.849158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d84bfc46-e7d5-4bfb-97c1-138c5544c588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:56.972912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bfc46-e7d5-4bfb-97c1-138c5544c588 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:56.980523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0de724-2b23-47df-a007-ae10c5732d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:56.981152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0de724-2b23-47df-a007-ae10c5732d31 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:56.981453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0de724-2b23-47df-a007-ae10c5732d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:56.981788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0de724-2b23-47df-a007-ae10c5732d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:57.006638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0de724-2b23-47df-a007-ae10c5732d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:57.008095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0de724-2b23-47df-a007-ae10c5732d31 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:57.029175 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3671/7294] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:56 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:56:57.316497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce0ffa-0c10-4ca2-b83a-a8106def1c62 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:56:57.318576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f6ce0ffa-0c10-4ca2-b83a-a8106def1c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:57.351359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce0ffa-0c10-4ca2-b83a-a8106def1c62 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:56:57.379982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca02438-0525-4baf-a82b-7bb8a2f9556d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:56:57.383369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca02438-0525-4baf-a82b-7bb8a2f9556d service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:56:57.384370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca02438-0525-4baf-a82b-7bb8a2f9556d service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:56:57.384715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca02438-0525-4baf-a82b-7bb8a2f9556d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:56:57.401304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fca02438-0525-4baf-a82b-7bb8a2f9556d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:56:57.646273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca02438-0525-4baf-a82b-7bb8a2f9556d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:56:57.648277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca02438-0525-4baf-a82b-7bb8a2f9556d service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:56:57.675495 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3624/7295] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:56:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:57:00.762691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0de724-2b23-47df-a007-ae10c5732d31 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:00.766737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5e0de724-2b23-47df-a007-ae10c5732d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:00.895558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0de724-2b23-47df-a007-ae10c5732d31 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:00.910976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:00.911668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:00.912104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:00.912389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] PATH_INFO: `/v3/users/1c601c71eb10496b8bd808b998d104dc` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:00.917081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c601c71eb10496b8bd808b998d104dc)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:00.919720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:01.088547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c601c71eb10496b8bd808b998d104dc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:01.090502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c601c71eb10496b8bd808b998d104dc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:01.154182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c601c71eb10496b8bd808b998d104dc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:01.158535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c601c71eb10496b8bd808b998d104dc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:01.160271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:01.187114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c601c71eb10496b8bd808b998d104dc'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:01.222732 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3672/7296] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:00 2022] DELETE /identity/v3/users/1c601c71eb10496b8bd808b998d104dc => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:01.227084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd52a-99fc-4d1f-95cc-d4f766a2cbe4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:01.228010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd52a-99fc-4d1f-95cc-d4f766a2cbe4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:01.228466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd52a-99fc-4d1f-95cc-d4f766a2cbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:01.283336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7bedd52a-99fc-4d1f-95cc-d4f766a2cbe4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:01.286587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7bedd52a-99fc-4d1f-95cc-d4f766a2cbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:01.440041 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3625/7297] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:01.451427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:01.452900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:01.573381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8434e0a-39c5-47fd-a3fc-fb5b8af00fb1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:01.579640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72307bd-7fa8-48a6-9a1c-138566df95eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:01.580552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72307bd-7fa8-48a6-9a1c-138566df95eb service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:01.580995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72307bd-7fa8-48a6-9a1c-138566df95eb service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:01.581486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72307bd-7fa8-48a6-9a1c-138566df95eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:01.601671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72307bd-7fa8-48a6-9a1c-138566df95eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:01.603449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72307bd-7fa8-48a6-9a1c-138566df95eb service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:01.615948 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3673/7298] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:03.067805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedd52a-99fc-4d1f-95cc-d4f766a2cbe4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:03.070004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7bedd52a-99fc-4d1f-95cc-d4f766a2cbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:03.124254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedd52a-99fc-4d1f-95cc-d4f766a2cbe4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:03.163512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:03.165793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:03.166258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:03.166633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] PATH_INFO: `/v3/projects/6539a92d711e432fa2d19a62ccf414dc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:03.170500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6539a92d711e432fa2d19a62ccf414dc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:03.181955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:03.348102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6539a92d711e432fa2d19a62ccf414dc', 'request_id': 'req-e1e51e5a-cb69-4453-b42b-fc6c62037218'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:03.360485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6539a92d711e432fa2d19a62ccf414dc', 'request_id': 'req-e1e51e5a-cb69-4453-b42b-fc6c62037218'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:03.434908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6539a92d711e432fa2d19a62ccf414dc', 'request_id': 'req-e1e51e5a-cb69-4453-b42b-fc6c62037218'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:03.472636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] The token cache is being invalidate because project 6539a92d711e432fa2d19a62ccf414dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:03.473166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:03.474759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:03.479431 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3626/7299] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:03 2022] DELETE /identity/v3/projects/6539a92d711e432fa2d19a62ccf414dc => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:03.483723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72307bd-7fa8-48a6-9a1c-138566df95eb service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:03.512022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72307bd-7fa8-48a6-9a1c-138566df95eb service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:03.609644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72804dd6-395d-4d06-87b4-21c3da6b03a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:03.610447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72804dd6-395d-4d06-87b4-21c3da6b03a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:03.610978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72804dd6-395d-4d06-87b4-21c3da6b03a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:03.611466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72804dd6-395d-4d06-87b4-21c3da6b03a3 admin admin] PATH_INFO: `/v3/users/37fa12cbe9dd44299d94ef418add40c6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:03.612592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72804dd6-395d-4d06-87b4-21c3da6b03a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fa12cbe9dd44299d94ef418add40c6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:03.614605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72804dd6-395d-4d06-87b4-21c3da6b03a3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:03.687409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72804dd6-395d-4d06-87b4-21c3da6b03a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fa12cbe9dd44299d94ef418add40c6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:03.688612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72804dd6-395d-4d06-87b4-21c3da6b03a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fa12cbe9dd44299d94ef418add40c6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:03.709627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72804dd6-395d-4d06-87b4-21c3da6b03a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fa12cbe9dd44299d94ef418add40c6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:03.710549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72804dd6-395d-4d06-87b4-21c3da6b03a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fa12cbe9dd44299d94ef418add40c6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:03.741764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-72804dd6-395d-4d06-87b4-21c3da6b03a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fa12cbe9dd44299d94ef418add40c6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:03.769373 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3674/7300] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:03 2022] DELETE /identity/v3/users/37fa12cbe9dd44299d94ef418add40c6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:05.143937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:05.147891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:05.181768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:05.207834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51e5a-cb69-4453-b42b-fc6c62037218 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:05.506568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:05.507482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:05.507921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:05.509116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] PATH_INFO: `/v3/projects/feb3db7d2f624032b552eeaf911646b8` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:05.511068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb3db7d2f624032b552eeaf911646b8)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:05.513674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:05.645528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb3db7d2f624032b552eeaf911646b8', 'request_id': 'req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:05.670169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb3db7d2f624032b552eeaf911646b8', 'request_id': 'req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:05.683494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb3db7d2f624032b552eeaf911646b8', 'request_id': 'req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:05.718403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] The token cache is being invalidate because project feb3db7d2f624032b552eeaf911646b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:05.719102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:05.719998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-30cb25d1-617e-4ecd-b26f-f9c504fe42f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:05.721957 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3627/7301] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:05 2022] DELETE /identity/v3/projects/feb3db7d2f624032b552eeaf911646b8 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:57:05.727037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27893d-b1d6-43db-8606-130a82db8f88 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:05.727916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27893d-b1d6-43db-8606-130a82db8f88 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:05.728350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27893d-b1d6-43db-8606-130a82db8f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:05.744740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:05.790464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ae27893d-b1d6-43db-8606-130a82db8f88 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:05.791711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ae27893d-b1d6-43db-8606-130a82db8f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:05.939292 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3675/7302] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:05.940173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ee755-e358-4af1-8d51-9adf52a299b7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:05.940467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ee755-e358-4af1-8d51-9adf52a299b7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:05.940751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ee755-e358-4af1-8d51-9adf52a299b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:05.982671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b46ee755-e358-4af1-8d51-9adf52a299b7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:05.986016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b46ee755-e358-4af1-8d51-9adf52a299b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:06.006891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27893d-b1d6-43db-8606-130a82db8f88 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:06.017045 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3628/7303] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:57:06.026404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27893d-b1d6-43db-8606-130a82db8f88 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:06.058347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9a572-8fd4-4ca6-a1f9-8a2ee42a9143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:06.058997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9a572-8fd4-4ca6-a1f9-8a2ee42a9143 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:06.059718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9a572-8fd4-4ca6-a1f9-8a2ee42a9143 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:06.059718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9a572-8fd4-4ca6-a1f9-8a2ee42a9143 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:06.060211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9a572-8fd4-4ca6-a1f9-8a2ee42a9143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:57:06.060526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9a572-8fd4-4ca6-a1f9-8a2ee42a9143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:06.074287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9a572-8fd4-4ca6-a1f9-8a2ee42a9143 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:06.124813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ee755-e358-4af1-8d51-9adf52a299b7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:06.135145 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3676/7304] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:57:06.137899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ee755-e358-4af1-8d51-9adf52a299b7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:06.152835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175673c-4b87-4e52-a896-9133e12d49ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:06.156462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175673c-4b87-4e52-a896-9133e12d49ee admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:06.157167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175673c-4b87-4e52-a896-9133e12d49ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:06.158099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175673c-4b87-4e52-a896-9133e12d49ee admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:06.160892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175673c-4b87-4e52-a896-9133e12d49ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:06.170694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175673c-4b87-4e52-a896-9133e12d49ee admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:06.258393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9a572-8fd4-4ca6-a1f9-8a2ee42a9143 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:06.275259 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3629/7305] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:06 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:06.279021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9a572-8fd4-4ca6-a1f9-8a2ee42a9143 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:06.393187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195344f9-e55c-4787-9caa-f082676205e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:06.394207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195344f9-e55c-4787-9caa-f082676205e9 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:06.394709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195344f9-e55c-4787-9caa-f082676205e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:06.395200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195344f9-e55c-4787-9caa-f082676205e9 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:06.396081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195344f9-e55c-4787-9caa-f082676205e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:06.398337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195344f9-e55c-4787-9caa-f082676205e9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:06.448663 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3677/7306] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:06 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:06.455742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175673c-4b87-4e52-a896-9133e12d49ee admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:06.471701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175673c-4b87-4e52-a896-9133e12d49ee admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:06.477943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdf94a-e0fb-45ea-b412-f50942e28335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:06.478838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf94a-e0fb-45ea-b412-f50942e28335 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:06.479226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf94a-e0fb-45ea-b412-f50942e28335 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:06.479830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf94a-e0fb-45ea-b412-f50942e28335 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:06.480875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdf94a-e0fb-45ea-b412-f50942e28335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:06.485672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdf94a-e0fb-45ea-b412-f50942e28335 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:06.554515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195344f9-e55c-4787-9caa-f082676205e9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:06.569007 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3630/7307] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:06.573920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195344f9-e55c-4787-9caa-f082676205e9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:06.582730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413d033-857e-434d-a1ca-71c2a248e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:06.584749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413d033-857e-434d-a1ca-71c2a248e130 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:06.585138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413d033-857e-434d-a1ca-71c2a248e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:06.585666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413d033-857e-434d-a1ca-71c2a248e130 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:06.586440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413d033-857e-434d-a1ca-71c2a248e130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:06.589213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413d033-857e-434d-a1ca-71c2a248e130 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:06.607791 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3678/7308] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:06.612798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdf94a-e0fb-45ea-b412-f50942e28335 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:06.630274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdf94a-e0fb-45ea-b412-f50942e28335 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:06.644080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be85987-1736-4eac-a8de-74f8c731c0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:06.647004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be85987-1736-4eac-a8de-74f8c731c0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:06.647551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be85987-1736-4eac-a8de-74f8c731c0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:06.648096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be85987-1736-4eac-a8de-74f8c731c0c6 admin admin] PATH_INFO: `/v3/projects/7b07c7222d074ec4a9f1cdd58b094869/users/a470dc3db60346a38928108c325abecb/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:06.686871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be85987-1736-4eac-a8de-74f8c731c0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b07c7222d074ec4a9f1cdd58b094869, user_id=a470dc3db60346a38928108c325abecb, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:06.694265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be85987-1736-4eac-a8de-74f8c731c0c6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:06.726212 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3631/7309] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:06 2022] PUT /identity/v3/projects/7b07c7222d074ec4a9f1cdd58b094869/users/a470dc3db60346a38928108c325abecb/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:06.739344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105feccb-3a20-43dd-874c-6fec908f8fd5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:06.739876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105feccb-3a20-43dd-874c-6fec908f8fd5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:06.740149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105feccb-3a20-43dd-874c-6fec908f8fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:06.839821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-105feccb-3a20-43dd-874c-6fec908f8fd5 None None] MFA Rules not processed for user `a470dc3db60346a38928108c325abecb`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:06.849848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-105feccb-3a20-43dd-874c-6fec908f8fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:07.189918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:07.210366 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3679/7310] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:07.210596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be85987-1736-4eac-a8de-74f8c731c0c6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:07.338692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:07.440691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be85987-1736-4eac-a8de-74f8c731c0c6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:07.460593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5b51d-5d75-4e2e-949b-8b35bd955ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:07.461237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5b51d-5d75-4e2e-949b-8b35bd955ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:07.462114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5b51d-5d75-4e2e-949b-8b35bd955ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:07.462398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5b51d-5d75-4e2e-949b-8b35bd955ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:07.463058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5b51d-5d75-4e2e-949b-8b35bd955ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:07.466938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5b51d-5d75-4e2e-949b-8b35bd955ec0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:07.559512 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3632/7311] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:07 2022] POST /identity/v3/projects => generated 387 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:57:07.564261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105feccb-3a20-43dd-874c-6fec908f8fd5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:07.588400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105feccb-3a20-43dd-874c-6fec908f8fd5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:07.762210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f98c9-e641-4429-8da0-17849feabfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:07.762876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f98c9-e641-4429-8da0-17849feabfbd admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:07.763131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f98c9-e641-4429-8da0-17849feabfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:07.763384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f98c9-e641-4429-8da0-17849feabfbd admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:07.764177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f98c9-e641-4429-8da0-17849feabfbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:07.766255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f98c9-e641-4429-8da0-17849feabfbd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:07.835808 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3680/7312] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:07 2022] POST /identity/v3/users => generated 300 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:07.836049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5b51d-5d75-4e2e-949b-8b35bd955ec0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:07.854102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5b51d-5d75-4e2e-949b-8b35bd955ec0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:07.872259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348ef32-60b6-4c25-862c-63715cd33fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:07.873891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348ef32-60b6-4c25-862c-63715cd33fee admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:07.874213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348ef32-60b6-4c25-862c-63715cd33fee admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:07.874551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348ef32-60b6-4c25-862c-63715cd33fee admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:07.875240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348ef32-60b6-4c25-862c-63715cd33fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:07.884919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348ef32-60b6-4c25-862c-63715cd33fee admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:07.918746 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3633/7313] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:07.924286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f98c9-e641-4429-8da0-17849feabfbd admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:07.944999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f98c9-e641-4429-8da0-17849feabfbd admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:07.957915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8c790-adb4-40f2-951b-7fd497bed681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:07.959341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8c790-adb4-40f2-951b-7fd497bed681 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:07.960131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8c790-adb4-40f2-951b-7fd497bed681 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:07.960420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8c790-adb4-40f2-951b-7fd497bed681 admin admin] PATH_INFO: `/v3/projects/ebd06edc59f446ba9ea15e46695f6331/users/15b83c0b2afc4e569a2110869ef9c2fa/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:08.003079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8c790-adb4-40f2-951b-7fd497bed681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd06edc59f446ba9ea15e46695f6331, user_id=15b83c0b2afc4e569a2110869ef9c2fa, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:08.007878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8c790-adb4-40f2-951b-7fd497bed681 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:08.054880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348ef32-60b6-4c25-862c-63715cd33fee admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:08.065087 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3681/7314] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:07 2022] PUT /identity/v3/projects/ebd06edc59f446ba9ea15e46695f6331/users/15b83c0b2afc4e569a2110869ef9c2fa/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:57:08.075161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348ef32-60b6-4c25-862c-63715cd33fee admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:08.229795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dab60-2640-4205-abc9-2fd53c4ba735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:08.231879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dab60-2640-4205-abc9-2fd53c4ba735 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:08.233834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dab60-2640-4205-abc9-2fd53c4ba735 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:08.234616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dab60-2640-4205-abc9-2fd53c4ba735 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:08.237171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dab60-2640-4205-abc9-2fd53c4ba735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:08.239190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dab60-2640-4205-abc9-2fd53c4ba735 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:08.259439 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3634/7315] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:08.262732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8c790-adb4-40f2-951b-7fd497bed681 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:08.277830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8c790-adb4-40f2-951b-7fd497bed681 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:08.284686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c13c5-6826-4c61-967d-4e527cea8714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:08.285766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c13c5-6826-4c61-967d-4e527cea8714 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:08.286270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c13c5-6826-4c61-967d-4e527cea8714 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:08.286779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c13c5-6826-4c61-967d-4e527cea8714 admin admin] PATH_INFO: `/v3/projects/ebd06edc59f446ba9ea15e46695f6331/users/15b83c0b2afc4e569a2110869ef9c2fa/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:08.289185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c13c5-6826-4c61-967d-4e527cea8714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd06edc59f446ba9ea15e46695f6331, user_id=15b83c0b2afc4e569a2110869ef9c2fa, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:08.295519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c13c5-6826-4c61-967d-4e527cea8714 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:08.325915 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3682/7316] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:08 2022] PUT /identity/v3/projects/ebd06edc59f446ba9ea15e46695f6331/users/15b83c0b2afc4e569a2110869ef9c2fa/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:08.326798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23c2e1-32bf-42bf-b20c-f118f536dc19 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:08.327089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23c2e1-32bf-42bf-b20c-f118f536dc19 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:08.327519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23c2e1-32bf-42bf-b20c-f118f536dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:08.384771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4f23c2e1-32bf-42bf-b20c-f118f536dc19 None None] MFA Rules not processed for user `15b83c0b2afc4e569a2110869ef9c2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:08.386102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4f23c2e1-32bf-42bf-b20c-f118f536dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:08.598965 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3635/7317] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:08.607566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c13c5-6826-4c61-967d-4e527cea8714 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:08.610952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-221c13c5-6826-4c61-967d-4e527cea8714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:08.700282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c13c5-6826-4c61-967d-4e527cea8714 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:08.711324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1affa-ee47-47c1-baf3-2b9c7f5483fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:08.713979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1affa-ee47-47c1-baf3-2b9c7f5483fd service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:08.714335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1affa-ee47-47c1-baf3-2b9c7f5483fd service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:08.714787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1affa-ee47-47c1-baf3-2b9c7f5483fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:08.740642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1affa-ee47-47c1-baf3-2b9c7f5483fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:08.746825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1affa-ee47-47c1-baf3-2b9c7f5483fd service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:08.767324 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3683/7318] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:08.939434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aba44-642f-4f70-be05-846468fd2cb5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:08.939434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aba44-642f-4f70-be05-846468fd2cb5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:08.939829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aba44-642f-4f70-be05-846468fd2cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:08.967710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-aa2aba44-642f-4f70-be05-846468fd2cb5 None None] MFA Rules not processed for user `9b95cef51ea04d9b886a7c29791ec255`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:08.971226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aa2aba44-642f-4f70-be05-846468fd2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:09.000401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:09.032098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1affa-ee47-47c1-baf3-2b9c7f5483fd service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:09.071453 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3636/7319] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:09.178002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:09.195134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1affa-ee47-47c1-baf3-2b9c7f5483fd service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:09.207786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:09.208450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:09.208801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:09.209226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] PATH_INFO: `/v3/users/a470dc3db60346a38928108c325abecb` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:09.210428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a470dc3db60346a38928108c325abecb)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:09.213071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:09.346724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a470dc3db60346a38928108c325abecb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:09.347437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a470dc3db60346a38928108c325abecb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:09.374775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a470dc3db60346a38928108c325abecb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:09.375516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a470dc3db60346a38928108c325abecb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:09.394275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a470dc3db60346a38928108c325abecb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:09.437235 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3684/7320] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:09 2022] DELETE /identity/v3/users/a470dc3db60346a38928108c325abecb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:09.439378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6c156-2ae9-42a8-aae2-b2931ec6ed5e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:09.439827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6c156-2ae9-42a8-aae2-b2931ec6ed5e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:09.440063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6c156-2ae9-42a8-aae2-b2931ec6ed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:09.480982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-17a6c156-2ae9-42a8-aae2-b2931ec6ed5e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:09.482281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-17a6c156-2ae9-42a8-aae2-b2931ec6ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:09.656025 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3637/7321] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:09.668443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:09.670283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:09.810193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2f4fe-5bea-4191-803b-7f7a29382ddf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:09.818007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624559-6159-4155-a9a6-d09de39bdb16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:09.819099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624559-6159-4155-a9a6-d09de39bdb16 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:09.819543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624559-6159-4155-a9a6-d09de39bdb16 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:09.819971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624559-6159-4155-a9a6-d09de39bdb16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:09.833974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb624559-6159-4155-a9a6-d09de39bdb16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:09.835776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb624559-6159-4155-a9a6-d09de39bdb16 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:09.853067 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3685/7322] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:10.321759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6c156-2ae9-42a8-aae2-b2931ec6ed5e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:10.323374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-17a6c156-2ae9-42a8-aae2-b2931ec6ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:10.347836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6c156-2ae9-42a8-aae2-b2931ec6ed5e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:10.364494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:10.365644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:10.366188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:10.366688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] PATH_INFO: `/v3/projects/7b07c7222d074ec4a9f1cdd58b094869` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:10.368332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b07c7222d074ec4a9f1cdd58b094869)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:10.370956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:10.462448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b07c7222d074ec4a9f1cdd58b094869', 'request_id': 'req-f279f62d-18ee-4fee-bc18-799fc623441d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:10.470437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b07c7222d074ec4a9f1cdd58b094869', 'request_id': 'req-f279f62d-18ee-4fee-bc18-799fc623441d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:10.480188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b07c7222d074ec4a9f1cdd58b094869', 'request_id': 'req-f279f62d-18ee-4fee-bc18-799fc623441d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:10.498354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] The token cache is being invalidate because project 7b07c7222d074ec4a9f1cdd58b094869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:10.498897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:10.499853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:10.502895 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3638/7323] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:10 2022] DELETE /identity/v3/projects/7b07c7222d074ec4a9f1cdd58b094869 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:10.507265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624559-6159-4155-a9a6-d09de39bdb16 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:10.519647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624559-6159-4155-a9a6-d09de39bdb16 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:10.616371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdd37b-efb1-4c59-bd07-3b635e63d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:10.617347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdd37b-efb1-4c59-bd07-3b635e63d745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:10.618445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdd37b-efb1-4c59-bd07-3b635e63d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:10.619132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdd37b-efb1-4c59-bd07-3b635e63d745 admin admin] PATH_INFO: `/v3/users/15b83c0b2afc4e569a2110869ef9c2fa` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:10.621182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdd37b-efb1-4c59-bd07-3b635e63d745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b83c0b2afc4e569a2110869ef9c2fa)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:10.623499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdd37b-efb1-4c59-bd07-3b635e63d745 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:10.752057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:10.801911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6cdd37b-efb1-4c59-bd07-3b635e63d745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b83c0b2afc4e569a2110869ef9c2fa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:10.803982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6cdd37b-efb1-4c59-bd07-3b635e63d745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b83c0b2afc4e569a2110869ef9c2fa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:10.831579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6cdd37b-efb1-4c59-bd07-3b635e63d745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b83c0b2afc4e569a2110869ef9c2fa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:10.832996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6cdd37b-efb1-4c59-bd07-3b635e63d745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b83c0b2afc4e569a2110869ef9c2fa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:10.856663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6cdd37b-efb1-4c59-bd07-3b635e63d745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b83c0b2afc4e569a2110869ef9c2fa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:10.875989 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3686/7324] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:10 2022] DELETE /identity/v3/users/15b83c0b2afc4e569a2110869ef9c2fa => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:11.441370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:11.443389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:11.466995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279f62d-18ee-4fee-bc18-799fc623441d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:11.668276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:11.677160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:11.678553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:11.679351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:11.679779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] PATH_INFO: `/v3/projects/ebd06edc59f446ba9ea15e46695f6331` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:11.682873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd06edc59f446ba9ea15e46695f6331)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:11.684841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:11.839104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd06edc59f446ba9ea15e46695f6331', 'request_id': 'req-29c5000b-9007-4005-b4b4-315516f0f70b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:11.855439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd06edc59f446ba9ea15e46695f6331', 'request_id': 'req-29c5000b-9007-4005-b4b4-315516f0f70b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:11.871678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd06edc59f446ba9ea15e46695f6331', 'request_id': 'req-29c5000b-9007-4005-b4b4-315516f0f70b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:11.898491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] The token cache is being invalidate because project ebd06edc59f446ba9ea15e46695f6331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:11.898790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:11.905832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-29c5000b-9007-4005-b4b4-315516f0f70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:11.907802 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3639/7325] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:11 2022] DELETE /identity/v3/projects/ebd06edc59f446ba9ea15e46695f6331 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:11.912522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659815-757a-47e6-86a6-0950a18e77b4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:11.913319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659815-757a-47e6-86a6-0950a18e77b4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:11.913793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659815-757a-47e6-86a6-0950a18e77b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:11.963089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-99659815-757a-47e6-86a6-0950a18e77b4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:11.964825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-99659815-757a-47e6-86a6-0950a18e77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:12.105903 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3687/7326] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:12.107429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03e95a-45b3-487b-a337-d25577081f9d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:12.107788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03e95a-45b3-487b-a337-d25577081f9d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:12.108135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03e95a-45b3-487b-a337-d25577081f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:12.159559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3b03e95a-45b3-487b-a337-d25577081f9d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:12.167495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3b03e95a-45b3-487b-a337-d25577081f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:12.214548 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3640/7327] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:57:12.216085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99659815-757a-47e6-86a6-0950a18e77b4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:12.229444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99659815-757a-47e6-86a6-0950a18e77b4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:12.264085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947b3ed-1ca8-469a-96e9-8f40b693507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:12.264970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947b3ed-1ca8-469a-96e9-8f40b693507d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:12.265418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947b3ed-1ca8-469a-96e9-8f40b693507d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:12.265916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947b3ed-1ca8-469a-96e9-8f40b693507d admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:12.266725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947b3ed-1ca8-469a-96e9-8f40b693507d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:57:12.267176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947b3ed-1ca8-469a-96e9-8f40b693507d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:12.280540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947b3ed-1ca8-469a-96e9-8f40b693507d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:12.317704 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3688/7328] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:57:12.323427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03e95a-45b3-487b-a337-d25577081f9d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:12.336479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03e95a-45b3-487b-a337-d25577081f9d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:12.342908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2cc24-48a9-4d2d-b5d9-48429904405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:12.343752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2cc24-48a9-4d2d-b5d9-48429904405e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:12.344226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2cc24-48a9-4d2d-b5d9-48429904405e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:12.344684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2cc24-48a9-4d2d-b5d9-48429904405e admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:12.345880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2cc24-48a9-4d2d-b5d9-48429904405e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:12.348109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2cc24-48a9-4d2d-b5d9-48429904405e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:12.408111 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3641/7329] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:12 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:12.409077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947b3ed-1ca8-469a-96e9-8f40b693507d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:12.424448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947b3ed-1ca8-469a-96e9-8f40b693507d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:12.557295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8343a-367f-4970-9b48-1205c5099301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:12.558151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8343a-367f-4970-9b48-1205c5099301 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:12.558474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8343a-367f-4970-9b48-1205c5099301 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:12.558851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8343a-367f-4970-9b48-1205c5099301 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:12.559988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8343a-367f-4970-9b48-1205c5099301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:12.562609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8343a-367f-4970-9b48-1205c5099301 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:12.612290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2cc24-48a9-4d2d-b5d9-48429904405e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:12.613058 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3689/7330] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:12 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:12.627009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2cc24-48a9-4d2d-b5d9-48429904405e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:12.651733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1248eb9-228c-4717-8f41-8ebf319f9997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:12.652399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1248eb9-228c-4717-8f41-8ebf319f9997 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:12.652966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1248eb9-228c-4717-8f41-8ebf319f9997 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:12.653496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1248eb9-228c-4717-8f41-8ebf319f9997 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:12.654426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1248eb9-228c-4717-8f41-8ebf319f9997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:12.657321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1248eb9-228c-4717-8f41-8ebf319f9997 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:12.690056 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3642/7331] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:57:12.691439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8343a-367f-4970-9b48-1205c5099301 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:12.712738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8343a-367f-4970-9b48-1205c5099301 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:12.727303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c5b8a-02b0-4ce1-9af1-6bf0f6f07cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:12.728894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5b8a-02b0-4ce1-9af1-6bf0f6f07cfd admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:12.729746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5b8a-02b0-4ce1-9af1-6bf0f6f07cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:12.730334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5b8a-02b0-4ce1-9af1-6bf0f6f07cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:12.731324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c5b8a-02b0-4ce1-9af1-6bf0f6f07cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:12.733538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c5b8a-02b0-4ce1-9af1-6bf0f6f07cfd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:12.776735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1248eb9-228c-4717-8f41-8ebf319f9997 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:12.785636 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3690/7332] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:12.802316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1248eb9-228c-4717-8f41-8ebf319f9997 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:12.809148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b90522-4bac-4ac6-9a56-e91c26e9d5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:12.812429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b90522-4bac-4ac6-9a56-e91c26e9d5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:12.812834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b90522-4bac-4ac6-9a56-e91c26e9d5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:12.813734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b90522-4bac-4ac6-9a56-e91c26e9d5cd admin admin] PATH_INFO: `/v3/projects/645e30c2d8ee47dd8172068547d80e30/users/bd07dde5e54c41a5bb60c76b594e13a6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:12.846929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b90522-4bac-4ac6-9a56-e91c26e9d5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=645e30c2d8ee47dd8172068547d80e30, user_id=bd07dde5e54c41a5bb60c76b594e13a6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:12.851695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b90522-4bac-4ac6-9a56-e91c26e9d5cd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:12.879577 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3643/7333] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:12 2022] PUT /identity/v3/projects/645e30c2d8ee47dd8172068547d80e30/users/bd07dde5e54c41a5bb60c76b594e13a6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:57:12.891433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7208b3-7930-4623-8f7e-5c06dc9afc6f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:12.892113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7208b3-7930-4623-8f7e-5c06dc9afc6f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:12.892615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7208b3-7930-4623-8f7e-5c06dc9afc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:12.902559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:12.963535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4a7208b3-7930-4623-8f7e-5c06dc9afc6f None None] MFA Rules not processed for user `bd07dde5e54c41a5bb60c76b594e13a6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:12.967779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a7208b3-7930-4623-8f7e-5c06dc9afc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:13.231928 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3691/7334] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:57:13.237510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b90522-4bac-4ac6-9a56-e91c26e9d5cd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:13.392074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b90522-4bac-4ac6-9a56-e91c26e9d5cd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:13.410615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98356b15-bb66-4531-b08b-6cd5a373b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:13.412176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98356b15-bb66-4531-b08b-6cd5a373b539 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:13.413707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98356b15-bb66-4531-b08b-6cd5a373b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:13.414510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98356b15-bb66-4531-b08b-6cd5a373b539 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:13.420540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98356b15-bb66-4531-b08b-6cd5a373b539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:13.423801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98356b15-bb66-4531-b08b-6cd5a373b539 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:13.497170 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3644/7335] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:13 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:13.504131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7208b3-7930-4623-8f7e-5c06dc9afc6f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:13.520037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7208b3-7930-4623-8f7e-5c06dc9afc6f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:13.671448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4543228-5d4f-46b8-8e97-d667cc45cc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:13.675090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4543228-5d4f-46b8-8e97-d667cc45cc25 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:13.675745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4543228-5d4f-46b8-8e97-d667cc45cc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:13.676094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4543228-5d4f-46b8-8e97-d667cc45cc25 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:13.677190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4543228-5d4f-46b8-8e97-d667cc45cc25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:13.691689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4543228-5d4f-46b8-8e97-d667cc45cc25 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:13.773560 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3692/7336] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:13 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:57:13.777232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98356b15-bb66-4531-b08b-6cd5a373b539 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:13.792869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98356b15-bb66-4531-b08b-6cd5a373b539 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:13.799482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5e204-a480-41b3-b339-7aca539aeb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:13.800741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5e204-a480-41b3-b339-7aca539aeb32 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:13.801645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5e204-a480-41b3-b339-7aca539aeb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:13.802292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5e204-a480-41b3-b339-7aca539aeb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:13.803057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5e204-a480-41b3-b339-7aca539aeb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:13.804775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5e204-a480-41b3-b339-7aca539aeb32 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:13.807987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:13.835720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4543228-5d4f-46b8-8e97-d667cc45cc25 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:13.839558 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3645/7337] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:13.849811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4543228-5d4f-46b8-8e97-d667cc45cc25 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:13.855913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b696cc-8a47-4a6f-ac30-69a612e3a494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:13.856869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b696cc-8a47-4a6f-ac30-69a612e3a494 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:13.857364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b696cc-8a47-4a6f-ac30-69a612e3a494 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:13.857924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b696cc-8a47-4a6f-ac30-69a612e3a494 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:13.858812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b696cc-8a47-4a6f-ac30-69a612e3a494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:13.860865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b696cc-8a47-4a6f-ac30-69a612e3a494 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:13.887964 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3693/7338] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:13.888973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5e204-a480-41b3-b339-7aca539aeb32 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:13.901621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5e204-a480-41b3-b339-7aca539aeb32 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:13.907308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c5bcf-088b-4c4c-9565-6938a48eeb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:13.908200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5bcf-088b-4c4c-9565-6938a48eeb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:13.908501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5bcf-088b-4c4c-9565-6938a48eeb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:13.908787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5bcf-088b-4c4c-9565-6938a48eeb04 admin admin] PATH_INFO: `/v3/projects/dcaf5db5661341a2bb611d013a75944b/users/50633784dcbd4179b1e598c264eb5eb7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:13.930991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c5bcf-088b-4c4c-9565-6938a48eeb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcaf5db5661341a2bb611d013a75944b, user_id=50633784dcbd4179b1e598c264eb5eb7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:13.933910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c5bcf-088b-4c4c-9565-6938a48eeb04 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:13.952905 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3646/7339] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:13 2022] PUT /identity/v3/projects/dcaf5db5661341a2bb611d013a75944b/users/50633784dcbd4179b1e598c264eb5eb7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:57:13.965173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fa6f6-5b17-472a-a825-bf5308fdfbe2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:13.965786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fa6f6-5b17-472a-a825-bf5308fdfbe2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:13.966113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fa6f6-5b17-472a-a825-bf5308fdfbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:14.033647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ee9fa6f6-5b17-472a-a825-bf5308fdfbe2 None None] MFA Rules not processed for user `50633784dcbd4179b1e598c264eb5eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:14.034920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ee9fa6f6-5b17-472a-a825-bf5308fdfbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:14.200391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:14.207702 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3694/7340] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:14.213622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c5bcf-088b-4c4c-9565-6938a48eeb04 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:14.425053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c5bcf-088b-4c4c-9565-6938a48eeb04 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:14.434108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e57794-3f2c-445d-83b4-92e9b02c9d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:14.434795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57794-3f2c-445d-83b4-92e9b02c9d97 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:14.435136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57794-3f2c-445d-83b4-92e9b02c9d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:14.435411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57794-3f2c-445d-83b4-92e9b02c9d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:14.436116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e57794-3f2c-445d-83b4-92e9b02c9d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:14.439309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e57794-3f2c-445d-83b4-92e9b02c9d97 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:14.501206 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3647/7341] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:14 2022] POST /identity/v3/projects => generated 385 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:14.506088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fa6f6-5b17-472a-a825-bf5308fdfbe2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:14.522074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fa6f6-5b17-472a-a825-bf5308fdfbe2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:14.638591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a57e4-cc60-44de-830e-bb88bc8ccb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:14.639459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a57e4-cc60-44de-830e-bb88bc8ccb4b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:14.639973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a57e4-cc60-44de-830e-bb88bc8ccb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:14.640405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a57e4-cc60-44de-830e-bb88bc8ccb4b admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:14.641857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a57e4-cc60-44de-830e-bb88bc8ccb4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:14.644078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a57e4-cc60-44de-830e-bb88bc8ccb4b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:14.678115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e57794-3f2c-445d-83b4-92e9b02c9d97 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:14.679192 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3695/7342] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:14 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:14.696353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e57794-3f2c-445d-83b4-92e9b02c9d97 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:14.704739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ad3d8-456d-45b5-8af9-0ed25a0a57cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:14.706061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ad3d8-456d-45b5-8af9-0ed25a0a57cd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:14.706542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ad3d8-456d-45b5-8af9-0ed25a0a57cd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:14.706978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ad3d8-456d-45b5-8af9-0ed25a0a57cd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:14.708125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ad3d8-456d-45b5-8af9-0ed25a0a57cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:14.710190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ad3d8-456d-45b5-8af9-0ed25a0a57cd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:14.730498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a57e4-cc60-44de-830e-bb88bc8ccb4b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:14.742092 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3648/7343] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:14.744934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a57e4-cc60-44de-830e-bb88bc8ccb4b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:14.751476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50986755-69f8-4f23-9b7b-e74f4c1ac155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:14.752547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50986755-69f8-4f23-9b7b-e74f4c1ac155 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:14.752988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50986755-69f8-4f23-9b7b-e74f4c1ac155 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:14.753630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50986755-69f8-4f23-9b7b-e74f4c1ac155 admin admin] PATH_INFO: `/v3/projects/43a6bfef75294ce19fd08e24e37f2d23/users/ac16f29ec2784ca6a0018a18035e5723/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:14.779469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50986755-69f8-4f23-9b7b-e74f4c1ac155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a6bfef75294ce19fd08e24e37f2d23, user_id=ac16f29ec2784ca6a0018a18035e5723, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:14.783710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50986755-69f8-4f23-9b7b-e74f4c1ac155 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:14.830714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ad3d8-456d-45b5-8af9-0ed25a0a57cd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:14.841958 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3696/7344] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:14 2022] PUT /identity/v3/projects/43a6bfef75294ce19fd08e24e37f2d23/users/ac16f29ec2784ca6a0018a18035e5723/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:14.845502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ad3d8-456d-45b5-8af9-0ed25a0a57cd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:14.932124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8c690-1f1a-48a9-bd18-5555d99a7183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:14.933097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c690-1f1a-48a9-bd18-5555d99a7183 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:14.934660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c690-1f1a-48a9-bd18-5555d99a7183 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:14.935498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c690-1f1a-48a9-bd18-5555d99a7183 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:14.936837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8c690-1f1a-48a9-bd18-5555d99a7183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:14.940089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8c690-1f1a-48a9-bd18-5555d99a7183 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:14.962385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50986755-69f8-4f23-9b7b-e74f4c1ac155 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:14.964013 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3649/7345] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:14.986332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50986755-69f8-4f23-9b7b-e74f4c1ac155 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:15.011300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c2db4-c03e-4567-b546-2614a3ef32b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:15.020121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c2db4-c03e-4567-b546-2614a3ef32b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:15.021491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c2db4-c03e-4567-b546-2614a3ef32b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:15.021995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c2db4-c03e-4567-b546-2614a3ef32b6 admin admin] PATH_INFO: `/v3/projects/43a6bfef75294ce19fd08e24e37f2d23/users/ac16f29ec2784ca6a0018a18035e5723/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:15.026488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c2db4-c03e-4567-b546-2614a3ef32b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a6bfef75294ce19fd08e24e37f2d23, user_id=ac16f29ec2784ca6a0018a18035e5723, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:15.029717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c2db4-c03e-4567-b546-2614a3ef32b6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:15.046234 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3697/7346] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:14 2022] PUT /identity/v3/projects/43a6bfef75294ce19fd08e24e37f2d23/users/ac16f29ec2784ca6a0018a18035e5723/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:15.060429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e1efe-cb28-4e87-a3c9-3dc5340aa9be None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:15.060429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e1efe-cb28-4e87-a3c9-3dc5340aa9be None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:15.060676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e1efe-cb28-4e87-a3c9-3dc5340aa9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:15.109229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-252e1efe-cb28-4e87-a3c9-3dc5340aa9be None None] MFA Rules not processed for user `ac16f29ec2784ca6a0018a18035e5723`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:15.111757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-252e1efe-cb28-4e87-a3c9-3dc5340aa9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:15.174157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:15.273890 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3650/7347] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:57:15.287864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c2db4-c03e-4567-b546-2614a3ef32b6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:15.290929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d41c2db4-c03e-4567-b546-2614a3ef32b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:15.379502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c2db4-c03e-4567-b546-2614a3ef32b6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:15.385845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3e862-7dad-449b-bca0-024a14abaf5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:15.386899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3e862-7dad-449b-bca0-024a14abaf5c service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:15.387545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3e862-7dad-449b-bca0-024a14abaf5c service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:15.388049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3e862-7dad-449b-bca0-024a14abaf5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:15.402519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3e862-7dad-449b-bca0-024a14abaf5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:15.404110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3e862-7dad-449b-bca0-024a14abaf5c service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:15.426925 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3698/7348] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:16.263781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e1efe-cb28-4e87-a3c9-3dc5340aa9be None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:16.280807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e1efe-cb28-4e87-a3c9-3dc5340aa9be None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:16.293140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2548f1a-c9ef-42cf-afc4-95abc75ccfad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:16.294335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2548f1a-c9ef-42cf-afc4-95abc75ccfad service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:16.294624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2548f1a-c9ef-42cf-afc4-95abc75ccfad service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:16.295013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2548f1a-c9ef-42cf-afc4-95abc75ccfad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:16.390324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2548f1a-c9ef-42cf-afc4-95abc75ccfad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:16.391981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2548f1a-c9ef-42cf-afc4-95abc75ccfad service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:16.403342 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3651/7349] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:24.055714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3e862-7dad-449b-bca0-024a14abaf5c service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:24.057355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-53e3e862-7dad-449b-bca0-024a14abaf5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:24.255276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:24.299886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3e862-7dad-449b-bca0-024a14abaf5c service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:24.315890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0d644-31cb-49e4-b128-6137c1931954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:24.316936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0d644-31cb-49e4-b128-6137c1931954 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:24.317342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0d644-31cb-49e4-b128-6137c1931954 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:24.317713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0d644-31cb-49e4-b128-6137c1931954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:24.322273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cad0d644-31cb-49e4-b128-6137c1931954 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:24.355772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0d644-31cb-49e4-b128-6137c1931954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:24.364785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0d644-31cb-49e4-b128-6137c1931954 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:24.396059 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3699/7350] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:25.590284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2548f1a-c9ef-42cf-afc4-95abc75ccfad service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:25.591755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f2548f1a-c9ef-42cf-afc4-95abc75ccfad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:25.611741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0d644-31cb-49e4-b128-6137c1931954 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:25.628340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0d644-31cb-49e4-b128-6137c1931954 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:25.636817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cea7dc-26ed-42e4-bb1c-9d54609c0637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:25.637888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cea7dc-26ed-42e4-bb1c-9d54609c0637 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:25.643360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cea7dc-26ed-42e4-bb1c-9d54609c0637 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:25.643707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cea7dc-26ed-42e4-bb1c-9d54609c0637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:25.740239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2548f1a-c9ef-42cf-afc4-95abc75ccfad service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:25.747897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:25.748659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:25.749037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:25.749428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] PATH_INFO: `/v3/users/63fd3dfce40b4b47b8b3f78608a8d0c7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:25.751113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cea7dc-26ed-42e4-bb1c-9d54609c0637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:25.751747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63fd3dfce40b4b47b8b3f78608a8d0c7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:25.752911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cea7dc-26ed-42e4-bb1c-9d54609c0637 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:25.754441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:25.767801 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3700/7351] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:25.854176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fd3dfce40b4b47b8b3f78608a8d0c7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:25.854946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fd3dfce40b4b47b8b3f78608a8d0c7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:25.882581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fd3dfce40b4b47b8b3f78608a8d0c7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:25.888329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:25.901043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fd3dfce40b4b47b8b3f78608a8d0c7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:25.917803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fd3dfce40b4b47b8b3f78608a8d0c7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:25.934720 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3652/7352] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:25 2022] DELETE /identity/v3/users/63fd3dfce40b4b47b8b3f78608a8d0c7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:25.940454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e25cd-2fdb-4bfe-a1bc-f0ed9d8cacd2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:25.940738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e25cd-2fdb-4bfe-a1bc-f0ed9d8cacd2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:25.941020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e25cd-2fdb-4bfe-a1bc-f0ed9d8cacd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:25.985631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a54e25cd-2fdb-4bfe-a1bc-f0ed9d8cacd2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:25.987182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a54e25cd-2fdb-4bfe-a1bc-f0ed9d8cacd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:26.134932 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3701/7353] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:26.142511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:26.146526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:26.282369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcb9b1-2e00-4767-a7b2-163e2f12f7e4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:26.287665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb1fea-4d10-4475-a4b7-c1bafce00c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:26.288864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb1fea-4d10-4475-a4b7-c1bafce00c12 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:26.289143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb1fea-4d10-4475-a4b7-c1bafce00c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:26.307988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb1fea-4d10-4475-a4b7-c1bafce00c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:26.327042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb1fea-4d10-4475-a4b7-c1bafce00c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:26.329111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb1fea-4d10-4475-a4b7-c1bafce00c12 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:26.349536 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3653/7354] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:57:26.788480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e25cd-2fdb-4bfe-a1bc-f0ed9d8cacd2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:26.791038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a54e25cd-2fdb-4bfe-a1bc-f0ed9d8cacd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:26.820549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e25cd-2fdb-4bfe-a1bc-f0ed9d8cacd2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:26.839898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:26.841571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:26.842573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:26.843946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] PATH_INFO: `/v3/projects/fe4f71db8ab04238a4abbf8c33167d6e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:26.846204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4f71db8ab04238a4abbf8c33167d6e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:26.855704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:27.000946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4f71db8ab04238a4abbf8c33167d6e', 'request_id': 'req-b4613143-8717-41ee-b9ee-ac61e17a8b10'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:27.013199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4f71db8ab04238a4abbf8c33167d6e', 'request_id': 'req-b4613143-8717-41ee-b9ee-ac61e17a8b10'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:27.025829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4f71db8ab04238a4abbf8c33167d6e', 'request_id': 'req-b4613143-8717-41ee-b9ee-ac61e17a8b10'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:27.051935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] The token cache is being invalidate because project fe4f71db8ab04238a4abbf8c33167d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:27.052242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:27.052994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4613143-8717-41ee-b9ee-ac61e17a8b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:27.058460 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3702/7355] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:26 2022] DELETE /identity/v3/projects/fe4f71db8ab04238a4abbf8c33167d6e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:27.061023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3f0ab-6d0d-445b-8d91-c431813982ea None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:27.063276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3f0ab-6d0d-445b-8d91-c431813982ea None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:27.063944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3f0ab-6d0d-445b-8d91-c431813982ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:27.130656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-29d3f0ab-6d0d-445b-8d91-c431813982ea None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:27.135045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-29d3f0ab-6d0d-445b-8d91-c431813982ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:27.287374 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3654/7356] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:27.296710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b688d-350a-4a6c-87ba-5ba46a86f533 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:27.297069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b688d-350a-4a6c-87ba-5ba46a86f533 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:27.297587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b688d-350a-4a6c-87ba-5ba46a86f533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:27.305868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:27.325236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f59b688d-350a-4a6c-87ba-5ba46a86f533 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:27.326718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f59b688d-350a-4a6c-87ba-5ba46a86f533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:27.341581 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3703/7357] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:27.342235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3f0ab-6d0d-445b-8d91-c431813982ea None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:27.357235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3f0ab-6d0d-445b-8d91-c431813982ea None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:27.366433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76028271-ca1c-47e3-bbba-d24e8a3f9b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:27.367071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028271-ca1c-47e3-bbba-d24e8a3f9b26 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:27.367363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028271-ca1c-47e3-bbba-d24e8a3f9b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:27.368083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028271-ca1c-47e3-bbba-d24e8a3f9b26 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:27.368789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76028271-ca1c-47e3-bbba-d24e8a3f9b26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:57:27.369100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76028271-ca1c-47e3-bbba-d24e8a3f9b26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:27.371681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76028271-ca1c-47e3-bbba-d24e8a3f9b26 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:27.406348 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3655/7358] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:57:27.409728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b688d-350a-4a6c-87ba-5ba46a86f533 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:27.421085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b688d-350a-4a6c-87ba-5ba46a86f533 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:27.437870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6c132-0ed4-4f4e-b811-ccd8edd50600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:27.438507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6c132-0ed4-4f4e-b811-ccd8edd50600 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:27.438804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6c132-0ed4-4f4e-b811-ccd8edd50600 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:27.439099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6c132-0ed4-4f4e-b811-ccd8edd50600 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:27.439708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6c132-0ed4-4f4e-b811-ccd8edd50600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:27.441677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6c132-0ed4-4f4e-b811-ccd8edd50600 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:27.507038 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3704/7359] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:27 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:27.511805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76028271-ca1c-47e3-bbba-d24e8a3f9b26 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:27.531865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76028271-ca1c-47e3-bbba-d24e8a3f9b26 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:27.654174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f353840-17a7-4b24-8393-af049fb9bd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:27.654807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353840-17a7-4b24-8393-af049fb9bd0f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:27.655094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353840-17a7-4b24-8393-af049fb9bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:27.655379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353840-17a7-4b24-8393-af049fb9bd0f admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:27.656035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f353840-17a7-4b24-8393-af049fb9bd0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:27.670903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f353840-17a7-4b24-8393-af049fb9bd0f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:27.704925 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3656/7360] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:27 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:27.709546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6c132-0ed4-4f4e-b811-ccd8edd50600 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:27.723392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6c132-0ed4-4f4e-b811-ccd8edd50600 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:27.733689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0b5ab-a77e-47db-a767-6af1c4b6c962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:27.734963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b5ab-a77e-47db-a767-6af1c4b6c962 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:27.735145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f353840-17a7-4b24-8393-af049fb9bd0f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:27.735876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b5ab-a77e-47db-a767-6af1c4b6c962 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:27.735876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b5ab-a77e-47db-a767-6af1c4b6c962 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:27.736428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0b5ab-a77e-47db-a767-6af1c4b6c962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:27.737199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2f353840-17a7-4b24-8393-af049fb9bd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:27.738118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0b5ab-a77e-47db-a767-6af1c4b6c962 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:27.746800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:27.752493 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3705/7361] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:27.760833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0b5ab-a77e-47db-a767-6af1c4b6c962 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:27.762280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f353840-17a7-4b24-8393-af049fb9bd0f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:27.776544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd026d-7b57-42f3-b9dc-7c94c3813d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:27.776915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd026d-7b57-42f3-b9dc-7c94c3813d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:27.776915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd026d-7b57-42f3-b9dc-7c94c3813d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:27.777169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd026d-7b57-42f3-b9dc-7c94c3813d81 admin admin] PATH_INFO: `/v3/users/bff55cf3683a4ff4a30a622b9defa841` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:27.778372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd026d-7b57-42f3-b9dc-7c94c3813d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff55cf3683a4ff4a30a622b9defa841)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:27.780415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd026d-7b57-42f3-b9dc-7c94c3813d81 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:27.785064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0b5ab-a77e-47db-a767-6af1c4b6c962 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:27.797162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b055fb-2664-4b03-820a-fdfd34ab77a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:27.798342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b055fb-2664-4b03-820a-fdfd34ab77a4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:27.799308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b055fb-2664-4b03-820a-fdfd34ab77a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:27.799523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b055fb-2664-4b03-820a-fdfd34ab77a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:27.801060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b055fb-2664-4b03-820a-fdfd34ab77a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:27.802853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b055fb-2664-4b03-820a-fdfd34ab77a4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:27.834831 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3706/7362] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:27.836547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b055fb-2664-4b03-820a-fdfd34ab77a4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:27.853679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b055fb-2664-4b03-820a-fdfd34ab77a4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:27.867054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f1c70-f478-4c99-9b4d-9037cf05ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:27.868689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f1c70-f478-4c99-9b4d-9037cf05ed9a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:27.870994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f1c70-f478-4c99-9b4d-9037cf05ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:27.871492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f1c70-f478-4c99-9b4d-9037cf05ed9a admin admin] PATH_INFO: `/v3/projects/93b2505f889c442c844ced600721ae06/users/f580223b9a6e4d0c8a725f924cb9be79/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:27.880241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-30fd026d-7b57-42f3-b9dc-7c94c3813d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff55cf3683a4ff4a30a622b9defa841'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:27.881044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-30fd026d-7b57-42f3-b9dc-7c94c3813d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff55cf3683a4ff4a30a622b9defa841'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:27.906031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-30fd026d-7b57-42f3-b9dc-7c94c3813d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff55cf3683a4ff4a30a622b9defa841'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:27.910581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f1c70-f478-4c99-9b4d-9037cf05ed9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b2505f889c442c844ced600721ae06, user_id=f580223b9a6e4d0c8a725f924cb9be79, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:27.915573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f1c70-f478-4c99-9b4d-9037cf05ed9a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:27.917641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-30fd026d-7b57-42f3-b9dc-7c94c3813d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff55cf3683a4ff4a30a622b9defa841'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:27.939762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-30fd026d-7b57-42f3-b9dc-7c94c3813d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff55cf3683a4ff4a30a622b9defa841'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:27.944668 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3707/7363] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:27 2022] PUT /identity/v3/projects/93b2505f889c442c844ced600721ae06/users/f580223b9a6e4d0c8a725f924cb9be79/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:27.955964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67515202-0ba0-4a8e-a6b1-9b785964c00d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:27.956570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67515202-0ba0-4a8e-a6b1-9b785964c00d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:27.957096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67515202-0ba0-4a8e-a6b1-9b785964c00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:27.965964 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3657/7364] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:27 2022] DELETE /identity/v3/users/bff55cf3683a4ff4a30a622b9defa841 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:57:27.967439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab7b69-48ff-45c3-a6ab-df5cb17339cc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:27.967730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab7b69-48ff-45c3-a6ab-df5cb17339cc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:27.968031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab7b69-48ff-45c3-a6ab-df5cb17339cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:27.995416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-67515202-0ba0-4a8e-a6b1-9b785964c00d None None] MFA Rules not processed for user `f580223b9a6e4d0c8a725f924cb9be79`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:27.996904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-67515202-0ba0-4a8e-a6b1-9b785964c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:28.021463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b6ab7b69-48ff-45c3-a6ab-df5cb17339cc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:28.025649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b6ab7b69-48ff-45c3-a6ab-df5cb17339cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:28.192519 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3708/7365] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:57:28.208898 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3658/7366] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:28.220105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67515202-0ba0-4a8e-a6b1-9b785964c00d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:28.221834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-67515202-0ba0-4a8e-a6b1-9b785964c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:28.230263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab7b69-48ff-45c3-a6ab-df5cb17339cc None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:28.232873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b6ab7b69-48ff-45c3-a6ab-df5cb17339cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:28.362301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67515202-0ba0-4a8e-a6b1-9b785964c00d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:28.370775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99269df-9dc7-4c37-b1a8-4183e1dac104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:28.372766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99269df-9dc7-4c37-b1a8-4183e1dac104 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:28.374721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99269df-9dc7-4c37-b1a8-4183e1dac104 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:28.375113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99269df-9dc7-4c37-b1a8-4183e1dac104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:28.393114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab7b69-48ff-45c3-a6ab-df5cb17339cc None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:28.399137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99269df-9dc7-4c37-b1a8-4183e1dac104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:28.401196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99269df-9dc7-4c37-b1a8-4183e1dac104 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:28.404737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328134-d7b2-4477-b65b-6dcac95fd49b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:28.405509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328134-d7b2-4477-b65b-6dcac95fd49b service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:28.406846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328134-d7b2-4477-b65b-6dcac95fd49b service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:28.407331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328134-d7b2-4477-b65b-6dcac95fd49b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:28.439061 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3709/7367] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:28.443682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e328134-d7b2-4477-b65b-6dcac95fd49b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:28.447007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e328134-d7b2-4477-b65b-6dcac95fd49b service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:28.471515 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3659/7368] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:57:29.567420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99269df-9dc7-4c37-b1a8-4183e1dac104 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:29.569057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d99269df-9dc7-4c37-b1a8-4183e1dac104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:29.614185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99269df-9dc7-4c37-b1a8-4183e1dac104 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:29.628048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:29.629045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:29.629575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:29.630232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] PATH_INFO: `/v3/projects/96a3bf50605d40a6bf93593e2931c8d6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:29.635677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a3bf50605d40a6bf93593e2931c8d6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:29.638715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:29.703103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:29.796469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a3bf50605d40a6bf93593e2931c8d6', 'request_id': 'req-fff6dd1a-a69c-43af-a49e-7483b55cc905'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:29.817707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a3bf50605d40a6bf93593e2931c8d6', 'request_id': 'req-fff6dd1a-a69c-43af-a49e-7483b55cc905'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:29.827942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a3bf50605d40a6bf93593e2931c8d6', 'request_id': 'req-fff6dd1a-a69c-43af-a49e-7483b55cc905'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:29.847087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] The token cache is being invalidate because project 96a3bf50605d40a6bf93593e2931c8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:29.847378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:29.848395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fff6dd1a-a69c-43af-a49e-7483b55cc905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:29.873763 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3710/7369] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:29 2022] DELETE /identity/v3/projects/96a3bf50605d40a6bf93593e2931c8d6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:32.108758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328134-d7b2-4477-b65b-6dcac95fd49b service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:32.110529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5e328134-d7b2-4477-b65b-6dcac95fd49b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:32.133974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328134-d7b2-4477-b65b-6dcac95fd49b service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:32.197762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:32.281377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:32.282596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:32.283209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:32.283796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] PATH_INFO: `/v3/users/bd07dde5e54c41a5bb60c76b594e13a6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:32.285915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd07dde5e54c41a5bb60c76b594e13a6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:32.288086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:32.369777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd07dde5e54c41a5bb60c76b594e13a6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:32.370511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd07dde5e54c41a5bb60c76b594e13a6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:32.393910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd07dde5e54c41a5bb60c76b594e13a6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:32.403804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd07dde5e54c41a5bb60c76b594e13a6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:32.413346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd07dde5e54c41a5bb60c76b594e13a6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:32.431369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77f7de-20e1-404e-896c-ac5fb02e8fa5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:32.431369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77f7de-20e1-404e-896c-ac5fb02e8fa5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:32.431369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77f7de-20e1-404e-896c-ac5fb02e8fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:32.436588 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3660/7370] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:32 2022] DELETE /identity/v3/users/bd07dde5e54c41a5bb60c76b594e13a6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:32.457171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2d77f7de-20e1-404e-896c-ac5fb02e8fa5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:32.458437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2d77f7de-20e1-404e-896c-ac5fb02e8fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:32.563126 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3711/7371] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:32.613886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:32.616163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:32.752026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849fea0-5c48-4627-8418-40d4fbfab6ff admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:32.766440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699071d1-7b23-458b-a2e3-9847a11aa276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:32.768592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699071d1-7b23-458b-a2e3-9847a11aa276 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:32.768956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699071d1-7b23-458b-a2e3-9847a11aa276 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:32.769364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699071d1-7b23-458b-a2e3-9847a11aa276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:32.782406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699071d1-7b23-458b-a2e3-9847a11aa276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:32.784361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699071d1-7b23-458b-a2e3-9847a11aa276 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:32.804968 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3661/7372] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:33.771856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77f7de-20e1-404e-896c-ac5fb02e8fa5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:33.774093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2d77f7de-20e1-404e-896c-ac5fb02e8fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:33.796988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77f7de-20e1-404e-896c-ac5fb02e8fa5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:33.813132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:33.814225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:33.815252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:33.818101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] PATH_INFO: `/v3/projects/645e30c2d8ee47dd8172068547d80e30` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:33.820107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=645e30c2d8ee47dd8172068547d80e30)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:33.826609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:33.963078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645e30c2d8ee47dd8172068547d80e30', 'request_id': 'req-8e2bfd0a-4add-47d0-b258-68b709f56cc2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:33.979420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645e30c2d8ee47dd8172068547d80e30', 'request_id': 'req-8e2bfd0a-4add-47d0-b258-68b709f56cc2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:33.988697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645e30c2d8ee47dd8172068547d80e30', 'request_id': 'req-8e2bfd0a-4add-47d0-b258-68b709f56cc2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:34.013190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] The token cache is being invalidate because project 645e30c2d8ee47dd8172068547d80e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:34.013511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:34.014660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:34.018064 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3712/7373] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:33 2022] DELETE /identity/v3/projects/645e30c2d8ee47dd8172068547d80e30 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:34.024391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699071d1-7b23-458b-a2e3-9847a11aa276 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:34.060790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699071d1-7b23-458b-a2e3-9847a11aa276 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:34.122604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:34.159538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:34.160350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:34.160549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:34.161130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] PATH_INFO: `/v3/users/50633784dcbd4179b1e598c264eb5eb7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:34.163174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50633784dcbd4179b1e598c264eb5eb7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:34.166774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:34.254824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50633784dcbd4179b1e598c264eb5eb7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:34.255559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50633784dcbd4179b1e598c264eb5eb7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:34.275538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50633784dcbd4179b1e598c264eb5eb7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:34.288062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50633784dcbd4179b1e598c264eb5eb7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:34.298758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50633784dcbd4179b1e598c264eb5eb7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:34.312048 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3662/7374] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:34 2022] DELETE /identity/v3/users/50633784dcbd4179b1e598c264eb5eb7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:34.931894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:34.933223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:34.985145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:35.045976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bfd0a-4add-47d0-b258-68b709f56cc2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:35.241207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:35.244601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:35.279484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006a3b5-ca54-44f3-b90b-1b68e988e7e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:35.280448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a3b5-ca54-44f3-b90b-1b68e988e7e6 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:35.280938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a3b5-ca54-44f3-b90b-1b68e988e7e6 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:35.281459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a3b5-ca54-44f3-b90b-1b68e988e7e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:35.289756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f006a3b5-ca54-44f3-b90b-1b68e988e7e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:35.315629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006a3b5-ca54-44f3-b90b-1b68e988e7e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:35.318116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006a3b5-ca54-44f3-b90b-1b68e988e7e6 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:35.365800 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3713/7375] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:35.421221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9de5e-5d91-4785-998a-a3035636d233 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:35.428008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:35.428812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:35.429191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:35.429695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] PATH_INFO: `/v3/projects/dcaf5db5661341a2bb611d013a75944b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:35.432219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcaf5db5661341a2bb611d013a75944b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:35.435049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:35.542432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcaf5db5661341a2bb611d013a75944b', 'request_id': 'req-41d8165d-6f69-4988-9b48-e8254d80413a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:35.561899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcaf5db5661341a2bb611d013a75944b', 'request_id': 'req-41d8165d-6f69-4988-9b48-e8254d80413a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:35.566167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:35.574102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcaf5db5661341a2bb611d013a75944b', 'request_id': 'req-41d8165d-6f69-4988-9b48-e8254d80413a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:35.603837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] The token cache is being invalidate because project dcaf5db5661341a2bb611d013a75944b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:35.604049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:35.604751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:35.624202 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3663/7376] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:35 2022] DELETE /identity/v3/projects/dcaf5db5661341a2bb611d013a75944b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:35.627393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006a3b5-ca54-44f3-b90b-1b68e988e7e6 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:35.645688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006a3b5-ca54-44f3-b90b-1b68e988e7e6 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:35.796552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307ea55-3d3f-43da-bacd-fe5ffc7c44a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:35.797203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307ea55-3d3f-43da-bacd-fe5ffc7c44a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:35.797715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307ea55-3d3f-43da-bacd-fe5ffc7c44a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:35.797997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307ea55-3d3f-43da-bacd-fe5ffc7c44a8 admin admin] PATH_INFO: `/v3/users/ac16f29ec2784ca6a0018a18035e5723` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:35.799702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307ea55-3d3f-43da-bacd-fe5ffc7c44a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac16f29ec2784ca6a0018a18035e5723)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:35.803075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307ea55-3d3f-43da-bacd-fe5ffc7c44a8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:35.938247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e307ea55-3d3f-43da-bacd-fe5ffc7c44a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac16f29ec2784ca6a0018a18035e5723'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:35.941481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e307ea55-3d3f-43da-bacd-fe5ffc7c44a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac16f29ec2784ca6a0018a18035e5723'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:35.964880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:35.983512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e307ea55-3d3f-43da-bacd-fe5ffc7c44a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac16f29ec2784ca6a0018a18035e5723'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:35.985407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e307ea55-3d3f-43da-bacd-fe5ffc7c44a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac16f29ec2784ca6a0018a18035e5723'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:35.998371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e307ea55-3d3f-43da-bacd-fe5ffc7c44a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac16f29ec2784ca6a0018a18035e5723'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:36.024586 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3714/7377] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:35 2022] DELETE /identity/v3/users/ac16f29ec2784ca6a0018a18035e5723 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:37.375009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:37.378929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:37.400781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8165d-6f69-4988-9b48-e8254d80413a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:37.599834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:37.600445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:37.600729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:37.601014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] PATH_INFO: `/v3/projects/43a6bfef75294ce19fd08e24e37f2d23` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:37.602465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a6bfef75294ce19fd08e24e37f2d23)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:37.606699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:37.710506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a6bfef75294ce19fd08e24e37f2d23', 'request_id': 'req-4491faf6-772b-4db1-b4a3-080aefe94f6f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:37.750375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a6bfef75294ce19fd08e24e37f2d23', 'request_id': 'req-4491faf6-772b-4db1-b4a3-080aefe94f6f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:37.764000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a6bfef75294ce19fd08e24e37f2d23', 'request_id': 'req-4491faf6-772b-4db1-b4a3-080aefe94f6f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:37.792602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] The token cache is being invalidate because project 43a6bfef75294ce19fd08e24e37f2d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:37.792903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:37.793617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4491faf6-772b-4db1-b4a3-080aefe94f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:37.800351 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3664/7378] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:37 2022] DELETE /identity/v3/projects/43a6bfef75294ce19fd08e24e37f2d23 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:37.802312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2a54-e920-4cca-9a90-051697aef92c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:37.803106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2a54-e920-4cca-9a90-051697aef92c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:37.803545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2a54-e920-4cca-9a90-051697aef92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:37.833967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-73ee2a54-e920-4cca-9a90-051697aef92c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:37.835684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-73ee2a54-e920-4cca-9a90-051697aef92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:37.946574 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3715/7379] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:37.947731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baafd3b-1bc9-4980-aed5-028198fb9f05 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:37.948015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baafd3b-1bc9-4980-aed5-028198fb9f05 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:37.948296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baafd3b-1bc9-4980-aed5-028198fb9f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:37.983111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9baafd3b-1bc9-4980-aed5-028198fb9f05 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:37.986233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9baafd3b-1bc9-4980-aed5-028198fb9f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:38.006787 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3665/7380] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:57:38.008812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2a54-e920-4cca-9a90-051697aef92c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:38.023035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2a54-e920-4cca-9a90-051697aef92c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:38.055198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad853da-289b-43df-a19b-62273a4bb5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:38.056266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad853da-289b-43df-a19b-62273a4bb5dd admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:38.057180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad853da-289b-43df-a19b-62273a4bb5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:38.057180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad853da-289b-43df-a19b-62273a4bb5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:38.060453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad853da-289b-43df-a19b-62273a4bb5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:57:38.060779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad853da-289b-43df-a19b-62273a4bb5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:38.063090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad853da-289b-43df-a19b-62273a4bb5dd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:38.082395 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3716/7381] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:57:38.083357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baafd3b-1bc9-4980-aed5-028198fb9f05 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:38.095266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baafd3b-1bc9-4980-aed5-028198fb9f05 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:38.100814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e98229-7e29-480d-b724-394ed4c804be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:38.101743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e98229-7e29-480d-b724-394ed4c804be admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:38.102116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e98229-7e29-480d-b724-394ed4c804be admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:38.102703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e98229-7e29-480d-b724-394ed4c804be admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:38.103430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e98229-7e29-480d-b724-394ed4c804be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:38.105511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e98229-7e29-480d-b724-394ed4c804be admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:38.140626 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3666/7382] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:38 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:38.144244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad853da-289b-43df-a19b-62273a4bb5dd admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:38.156041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad853da-289b-43df-a19b-62273a4bb5dd admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:38.220770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed2d74-6674-4457-84f6-d32cb0cee6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:38.221405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2d74-6674-4457-84f6-d32cb0cee6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:38.221704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2d74-6674-4457-84f6-d32cb0cee6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:38.221980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2d74-6674-4457-84f6-d32cb0cee6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:38.222615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed2d74-6674-4457-84f6-d32cb0cee6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:38.224651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed2d74-6674-4457-84f6-d32cb0cee6d1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:38.248261 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3717/7383] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:38 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:38.252838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e98229-7e29-480d-b724-394ed4c804be admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:38.264651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e98229-7e29-480d-b724-394ed4c804be admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:38.270213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d477d6-0f9b-4414-a128-597338995610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:38.270943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d477d6-0f9b-4414-a128-597338995610 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:38.271300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d477d6-0f9b-4414-a128-597338995610 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:38.271648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d477d6-0f9b-4414-a128-597338995610 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:38.272437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d477d6-0f9b-4414-a128-597338995610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:38.274800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d477d6-0f9b-4414-a128-597338995610 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:38.288401 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3667/7384] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:38.292856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed2d74-6674-4457-84f6-d32cb0cee6d1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:38.304138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed2d74-6674-4457-84f6-d32cb0cee6d1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:38.310289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cd802-70e9-4014-bea2-e2135a1beea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:38.310924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cd802-70e9-4014-bea2-e2135a1beea3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:38.311209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cd802-70e9-4014-bea2-e2135a1beea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:38.311556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cd802-70e9-4014-bea2-e2135a1beea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:38.312211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cd802-70e9-4014-bea2-e2135a1beea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:38.313864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cd802-70e9-4014-bea2-e2135a1beea3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:38.328266 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3718/7385] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:57:38.332600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d477d6-0f9b-4414-a128-597338995610 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:38.346753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d477d6-0f9b-4414-a128-597338995610 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:38.352254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c11b8-4dc1-49a8-b322-3daf86348356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:38.353037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c11b8-4dc1-49a8-b322-3daf86348356 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:38.353475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c11b8-4dc1-49a8-b322-3daf86348356 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:38.353844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c11b8-4dc1-49a8-b322-3daf86348356 admin admin] PATH_INFO: `/v3/projects/f3b374406a1e4d2b9b01ec510d3e0c9a/users/0226018002784d4880406db76638e495/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:38.373435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c11b8-4dc1-49a8-b322-3daf86348356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b374406a1e4d2b9b01ec510d3e0c9a, user_id=0226018002784d4880406db76638e495, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:38.376506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c11b8-4dc1-49a8-b322-3daf86348356 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:38.397569 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3668/7386] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:38 2022] PUT /identity/v3/projects/f3b374406a1e4d2b9b01ec510d3e0c9a/users/0226018002784d4880406db76638e495/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:38.405836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b5d9-2202-4ca9-8713-e1403876f9e0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:38.406444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b5d9-2202-4ca9-8713-e1403876f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:38.406842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b5d9-2202-4ca9-8713-e1403876f9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:38.444458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b802b5d9-2202-4ca9-8713-e1403876f9e0 None None] MFA Rules not processed for user `0226018002784d4880406db76638e495`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:38.446444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b802b5d9-2202-4ca9-8713-e1403876f9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:38.490940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:38.543799 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3719/7387] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:38.544723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c11b8-4dc1-49a8-b322-3daf86348356 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:38.566964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:38.626210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c11b8-4dc1-49a8-b322-3daf86348356 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:38.631431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d058ff-7433-4b20-91d2-8c7d7fe570a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:38.632272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d058ff-7433-4b20-91d2-8c7d7fe570a9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:38.632557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d058ff-7433-4b20-91d2-8c7d7fe570a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:38.632869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d058ff-7433-4b20-91d2-8c7d7fe570a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:38.633575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d058ff-7433-4b20-91d2-8c7d7fe570a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:38.635541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d058ff-7433-4b20-91d2-8c7d7fe570a9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:38.673561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3669/7388] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:38 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:38.677757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b5d9-2202-4ca9-8713-e1403876f9e0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:38.692449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b5d9-2202-4ca9-8713-e1403876f9e0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:38.774215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e50a4-6fe3-41f5-94dc-9844f02eccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:38.775257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e50a4-6fe3-41f5-94dc-9844f02eccd0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:38.775639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e50a4-6fe3-41f5-94dc-9844f02eccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:38.776082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e50a4-6fe3-41f5-94dc-9844f02eccd0 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:38.776821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e50a4-6fe3-41f5-94dc-9844f02eccd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:38.779399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e50a4-6fe3-41f5-94dc-9844f02eccd0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:38.814677 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3720/7389] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:38 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:38.815943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d058ff-7433-4b20-91d2-8c7d7fe570a9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:38.827621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d058ff-7433-4b20-91d2-8c7d7fe570a9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:38.832709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38514bb8-bc3b-4195-9227-e9613c162d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:38.833334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514bb8-bc3b-4195-9227-e9613c162d46 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:38.833659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514bb8-bc3b-4195-9227-e9613c162d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:38.834081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514bb8-bc3b-4195-9227-e9613c162d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:38.834730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38514bb8-bc3b-4195-9227-e9613c162d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:38.836393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38514bb8-bc3b-4195-9227-e9613c162d46 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:38.852272 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3670/7390] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:38.854204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e50a4-6fe3-41f5-94dc-9844f02eccd0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:38.865963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e50a4-6fe3-41f5-94dc-9844f02eccd0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:38.872491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da0d91-0b84-47ac-8d52-4109ed1dd1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:38.873429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da0d91-0b84-47ac-8d52-4109ed1dd1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:38.874186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da0d91-0b84-47ac-8d52-4109ed1dd1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:38.874465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da0d91-0b84-47ac-8d52-4109ed1dd1a0 admin admin] PATH_INFO: `/v3/projects/3bda7d87b1534399901d8cf88a87c998/users/78352599528948b6b846f1fe3144ff12/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:38.897579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da0d91-0b84-47ac-8d52-4109ed1dd1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bda7d87b1534399901d8cf88a87c998, user_id=78352599528948b6b846f1fe3144ff12, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:38.901944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da0d91-0b84-47ac-8d52-4109ed1dd1a0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:38.929681 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3721/7391] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:38 2022] PUT /identity/v3/projects/3bda7d87b1534399901d8cf88a87c998/users/78352599528948b6b846f1fe3144ff12/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:38.931482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38514bb8-bc3b-4195-9227-e9613c162d46 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:38.946517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38514bb8-bc3b-4195-9227-e9613c162d46 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:39.025295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aded74-a603-4d10-8d67-1e9ce14816fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:39.025973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aded74-a603-4d10-8d67-1e9ce14816fc admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:39.026262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aded74-a603-4d10-8d67-1e9ce14816fc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:39.026933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aded74-a603-4d10-8d67-1e9ce14816fc admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:39.027658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aded74-a603-4d10-8d67-1e9ce14816fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:39.029524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aded74-a603-4d10-8d67-1e9ce14816fc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:39.045398 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3671/7392] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:39.046374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da0d91-0b84-47ac-8d52-4109ed1dd1a0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:39.060597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da0d91-0b84-47ac-8d52-4109ed1dd1a0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:39.069708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38596bb2-3a70-4d94-81b7-d58d64b00de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:39.070589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38596bb2-3a70-4d94-81b7-d58d64b00de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:39.070934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38596bb2-3a70-4d94-81b7-d58d64b00de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:39.071398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38596bb2-3a70-4d94-81b7-d58d64b00de3 admin admin] PATH_INFO: `/v3/projects/3bda7d87b1534399901d8cf88a87c998/users/78352599528948b6b846f1fe3144ff12/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:39.073615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38596bb2-3a70-4d94-81b7-d58d64b00de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bda7d87b1534399901d8cf88a87c998, user_id=78352599528948b6b846f1fe3144ff12, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:39.082876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38596bb2-3a70-4d94-81b7-d58d64b00de3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:39.119156 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3722/7393] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:39 2022] PUT /identity/v3/projects/3bda7d87b1534399901d8cf88a87c998/users/78352599528948b6b846f1fe3144ff12/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:39.125535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec7814-3f48-46d1-be14-27f55e8c3399 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:39.126109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec7814-3f48-46d1-be14-27f55e8c3399 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:39.126552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec7814-3f48-46d1-be14-27f55e8c3399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:39.194279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-38ec7814-3f48-46d1-be14-27f55e8c3399 None None] MFA Rules not processed for user `78352599528948b6b846f1fe3144ff12`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:39.195555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-38ec7814-3f48-46d1-be14-27f55e8c3399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:39.315109 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3672/7394] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:39.332571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38596bb2-3a70-4d94-81b7-d58d64b00de3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:39.334717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-38596bb2-3a70-4d94-81b7-d58d64b00de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:39.419818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38596bb2-3a70-4d94-81b7-d58d64b00de3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:39.448084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecccd1-090e-402a-a358-146b8466add5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:39.449113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecccd1-090e-402a-a358-146b8466add5 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:39.450310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecccd1-090e-402a-a358-146b8466add5 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:39.450833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecccd1-090e-402a-a358-146b8466add5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:39.470830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecccd1-090e-402a-a358-146b8466add5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:39.475521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecccd1-090e-402a-a358-146b8466add5 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:39.491105 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3723/7395] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:39.687916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec7814-3f48-46d1-be14-27f55e8c3399 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:39.704319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec7814-3f48-46d1-be14-27f55e8c3399 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:39.713069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66efdb-c4d7-4c2b-aebf-4afa70467f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:39.714643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66efdb-c4d7-4c2b-aebf-4afa70467f4b service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:39.715123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66efdb-c4d7-4c2b-aebf-4afa70467f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:39.715617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66efdb-c4d7-4c2b-aebf-4afa70467f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:39.744604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:39.822495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66efdb-c4d7-4c2b-aebf-4afa70467f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:39.823882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66efdb-c4d7-4c2b-aebf-4afa70467f4b service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:39.834447 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3673/7396] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:48.473735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecccd1-090e-402a-a358-146b8466add5 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:48.475566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-45ecccd1-090e-402a-a358-146b8466add5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:48.532792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:48.609050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecccd1-090e-402a-a358-146b8466add5 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:48.624959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:48.626843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:48.627629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:48.628727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] PATH_INFO: `/v3/users/74602998065943c4a49a96d23ec0ce43` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:48.630320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74602998065943c4a49a96d23ec0ce43)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:48.635389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:48.712720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74602998065943c4a49a96d23ec0ce43'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:48.713755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74602998065943c4a49a96d23ec0ce43'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:48.739429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74602998065943c4a49a96d23ec0ce43'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:48.740436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74602998065943c4a49a96d23ec0ce43'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:48.772796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74602998065943c4a49a96d23ec0ce43'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:48.793087 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3724/7397] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:48 2022] DELETE /identity/v3/users/74602998065943c4a49a96d23ec0ce43 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:49.450431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66efdb-c4d7-4c2b-aebf-4afa70467f4b service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:49.474225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66efdb-c4d7-4c2b-aebf-4afa70467f4b service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:49.645081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:49.649984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:49.666865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:49.667536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.667823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.668103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] PATH_INFO: `/v3/projects/da746b18bda24573a98f42a731b9fd27` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.670817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da746b18bda24573a98f42a731b9fd27)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:49.675386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:49.685646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18ee40-c48d-4e58-a92f-de4477a84a34 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:49.719355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b632ba-9e4c-4135-ac02-3a3e6af30a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:49.722387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b632ba-9e4c-4135-ac02-3a3e6af30a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.729126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b632ba-9e4c-4135-ac02-3a3e6af30a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.729126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b632ba-9e4c-4135-ac02-3a3e6af30a24 admin admin] PATH_INFO: `/v3/users/0226018002784d4880406db76638e495` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.730113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b632ba-9e4c-4135-ac02-3a3e6af30a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0226018002784d4880406db76638e495)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:49.733890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b632ba-9e4c-4135-ac02-3a3e6af30a24 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:49.783696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da746b18bda24573a98f42a731b9fd27', 'request_id': 'req-0afba990-9a38-4243-8a1e-8a1eec56e880'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:49.826814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da746b18bda24573a98f42a731b9fd27', 'request_id': 'req-0afba990-9a38-4243-8a1e-8a1eec56e880'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:49.843775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da746b18bda24573a98f42a731b9fd27', 'request_id': 'req-0afba990-9a38-4243-8a1e-8a1eec56e880'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:49.844609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7b632ba-9e4c-4135-ac02-3a3e6af30a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0226018002784d4880406db76638e495'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:49.845317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7b632ba-9e4c-4135-ac02-3a3e6af30a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0226018002784d4880406db76638e495'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:49.862957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7b632ba-9e4c-4135-ac02-3a3e6af30a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0226018002784d4880406db76638e495'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:49.863726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7b632ba-9e4c-4135-ac02-3a3e6af30a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0226018002784d4880406db76638e495'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:49.865177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] The token cache is being invalidate because project da746b18bda24573a98f42a731b9fd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:49.865722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:49.869178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-0afba990-9a38-4243-8a1e-8a1eec56e880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:49.872877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7b632ba-9e4c-4135-ac02-3a3e6af30a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0226018002784d4880406db76638e495'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:49.887179 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3674/7398] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:49 2022] DELETE /identity/v3/projects/da746b18bda24573a98f42a731b9fd27 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:49.894103 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3725/7399] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:49 2022] DELETE /identity/v3/users/0226018002784d4880406db76638e495 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:57:49.896725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6457-6ce5-4b4f-9b00-7ac0fc86dc68 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.897160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6457-6ce5-4b4f-9b00-7ac0fc86dc68 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.897631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6457-6ce5-4b4f-9b00-7ac0fc86dc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.926726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa872d0-5afb-455d-b642-d8888ae9b871 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:49.927019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa872d0-5afb-455d-b642-d8888ae9b871 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:49.927311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa872d0-5afb-455d-b642-d8888ae9b871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:49.943465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-168e6457-6ce5-4b4f-9b00-7ac0fc86dc68 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:49.944828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-168e6457-6ce5-4b4f-9b00-7ac0fc86dc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:49.963591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7fa872d0-5afb-455d-b642-d8888ae9b871 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:49.965233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7fa872d0-5afb-455d-b642-d8888ae9b871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:49.987587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:50.037691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:50.090785 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3675/7400] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:50.101680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7333e-6dad-458b-8b4e-9ac680ff345c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.102144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7333e-6dad-458b-8b4e-9ac680ff345c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.102525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7333e-6dad-458b-8b4e-9ac680ff345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.116001 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3726/7401] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:50.126798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa872d0-5afb-455d-b642-d8888ae9b871 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.128301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7fa872d0-5afb-455d-b642-d8888ae9b871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:50.165201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-84e7333e-6dad-458b-8b4e-9ac680ff345c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:50.169255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-84e7333e-6dad-458b-8b4e-9ac680ff345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:50.193357 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3676/7402] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:50.200288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7333e-6dad-458b-8b4e-9ac680ff345c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.225775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7333e-6dad-458b-8b4e-9ac680ff345c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.241736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f1a0a-dfef-4d11-897c-6b617c281197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.243084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1a0a-dfef-4d11-897c-6b617c281197 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.243816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1a0a-dfef-4d11-897c-6b617c281197 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.244245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1a0a-dfef-4d11-897c-6b617c281197 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.245597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f1a0a-dfef-4d11-897c-6b617c281197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:57:50.246054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f1a0a-dfef-4d11-897c-6b617c281197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:50.248621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f1a0a-dfef-4d11-897c-6b617c281197 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:50.253286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa872d0-5afb-455d-b642-d8888ae9b871 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.259698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe9b1c-76ba-4aad-90b0-786838720cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.260480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9b1c-76ba-4aad-90b0-786838720cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.261210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9b1c-76ba-4aad-90b0-786838720cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.261210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9b1c-76ba-4aad-90b0-786838720cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.272572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe9b1c-76ba-4aad-90b0-786838720cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:50.274763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe9b1c-76ba-4aad-90b0-786838720cc9 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:50.283700 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3677/7403] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:57:50.285003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f1a0a-dfef-4d11-897c-6b617c281197 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.287155 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3727/7404] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:57:50.302976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f1a0a-dfef-4d11-897c-6b617c281197 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.308789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11672c10-e7d6-4618-803c-e73277e8f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.309376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672c10-e7d6-4618-803c-e73277e8f9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.309753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672c10-e7d6-4618-803c-e73277e8f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.310104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672c10-e7d6-4618-803c-e73277e8f9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.311001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11672c10-e7d6-4618-803c-e73277e8f9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:50.313026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11672c10-e7d6-4618-803c-e73277e8f9e8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:50.368334 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3678/7405] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:50 2022] POST /identity/v3/projects => generated 403 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:50.372499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe9b1c-76ba-4aad-90b0-786838720cc9 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.397256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe9b1c-76ba-4aad-90b0-786838720cc9 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.542802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccec688-faae-4029-a8e5-314704559079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.543680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccec688-faae-4029-a8e5-314704559079 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.543964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccec688-faae-4029-a8e5-314704559079 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.544242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccec688-faae-4029-a8e5-314704559079 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.544891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccec688-faae-4029-a8e5-314704559079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:50.548110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccec688-faae-4029-a8e5-314704559079 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:50.615019 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3728/7406] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:50 2022] POST /identity/v3/users => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:50.618385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11672c10-e7d6-4618-803c-e73277e8f9e8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.634166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11672c10-e7d6-4618-803c-e73277e8f9e8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.646916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e25c6-eeae-4d18-94a7-5d677a933b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.646916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e25c6-eeae-4d18-94a7-5d677a933b34 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.647280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e25c6-eeae-4d18-94a7-5d677a933b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.647660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e25c6-eeae-4d18-94a7-5d677a933b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.649036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e25c6-eeae-4d18-94a7-5d677a933b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:50.652271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e25c6-eeae-4d18-94a7-5d677a933b34 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:50.669712 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3679/7407] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:50.673771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccec688-faae-4029-a8e5-314704559079 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.685230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccec688-faae-4029-a8e5-314704559079 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.691717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e0c13-7a2a-4597-b35b-34a643f1e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.692413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e0c13-7a2a-4597-b35b-34a643f1e307 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.692798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e0c13-7a2a-4597-b35b-34a643f1e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.693176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e0c13-7a2a-4597-b35b-34a643f1e307 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.694360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e0c13-7a2a-4597-b35b-34a643f1e307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:50.696406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e0c13-7a2a-4597-b35b-34a643f1e307 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:50.708807 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3729/7408] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:57:50.713206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e25c6-eeae-4d18-94a7-5d677a933b34 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.724550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e25c6-eeae-4d18-94a7-5d677a933b34 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:50.730859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb0b6-68ba-44b3-8049-301c1ef6cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:50.731712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb0b6-68ba-44b3-8049-301c1ef6cbc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.732113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb0b6-68ba-44b3-8049-301c1ef6cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.732484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb0b6-68ba-44b3-8049-301c1ef6cbc8 admin admin] PATH_INFO: `/v3/projects/7fae5ca512c248a7923f618d7809910d/users/84c0b2f7cc2a4fc59f1235450797425a/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.757320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfb0b6-68ba-44b3-8049-301c1ef6cbc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fae5ca512c248a7923f618d7809910d, user_id=84c0b2f7cc2a4fc59f1235450797425a, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:50.760982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfb0b6-68ba-44b3-8049-301c1ef6cbc8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:50.795859 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3680/7409] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:50 2022] PUT /identity/v3/projects/7fae5ca512c248a7923f618d7809910d/users/84c0b2f7cc2a4fc59f1235450797425a/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:57:50.798233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c0c4-06e2-4f1d-9fab-4a3e73213086 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:50.798991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c0c4-06e2-4f1d-9fab-4a3e73213086 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:50.799250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c0c4-06e2-4f1d-9fab-4a3e73213086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:50.844816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c627c0c4-06e2-4f1d-9fab-4a3e73213086 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:50.848235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c627c0c4-06e2-4f1d-9fab-4a3e73213086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:50.924265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb0b6-68ba-44b3-8049-301c1ef6cbc8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:50.926186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-49dfb0b6-68ba-44b3-8049-301c1ef6cbc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:50.946364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:51.001037 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3730/7410] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:51.031115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627c0c4-06e2-4f1d-9fab-4a3e73213086 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:51.078057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb0b6-68ba-44b3-8049-301c1ef6cbc8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:51.104829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:51.107217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:51.108557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:51.109868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] PATH_INFO: `/v3/projects/f3b374406a1e4d2b9b01ec510d3e0c9a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:51.114928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b374406a1e4d2b9b01ec510d3e0c9a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:51.124737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:51.160135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627c0c4-06e2-4f1d-9fab-4a3e73213086 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:51.168640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d158d5-4553-45fb-9ae3-45df75086a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:51.169568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d158d5-4553-45fb-9ae3-45df75086a37 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:51.169847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d158d5-4553-45fb-9ae3-45df75086a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:51.170117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d158d5-4553-45fb-9ae3-45df75086a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:51.195853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d158d5-4553-45fb-9ae3-45df75086a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:51.197310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d158d5-4553-45fb-9ae3-45df75086a37 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:51.227337 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3731/7411] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:51.259109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b374406a1e4d2b9b01ec510d3e0c9a', 'request_id': 'req-539bcd6e-5720-41db-a913-a4d1edcbc908'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:51.284406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b374406a1e4d2b9b01ec510d3e0c9a', 'request_id': 'req-539bcd6e-5720-41db-a913-a4d1edcbc908'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:51.296730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b374406a1e4d2b9b01ec510d3e0c9a', 'request_id': 'req-539bcd6e-5720-41db-a913-a4d1edcbc908'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:51.307064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:51.341225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] The token cache is being invalidate because project f3b374406a1e4d2b9b01ec510d3e0c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:51.341743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:51.343291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:51.357742 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3681/7412] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:50 2022] DELETE /identity/v3/projects/f3b374406a1e4d2b9b01ec510d3e0c9a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:51.362202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d158d5-4553-45fb-9ae3-45df75086a37 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:51.383383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d158d5-4553-45fb-9ae3-45df75086a37 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:51.503940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118989a-fbbd-4772-b8f4-c2900b06e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:51.505027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118989a-fbbd-4772-b8f4-c2900b06e699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:51.505610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118989a-fbbd-4772-b8f4-c2900b06e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:51.506117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118989a-fbbd-4772-b8f4-c2900b06e699 admin admin] PATH_INFO: `/v3/users/78352599528948b6b846f1fe3144ff12` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:51.508045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118989a-fbbd-4772-b8f4-c2900b06e699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78352599528948b6b846f1fe3144ff12)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:51.510496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118989a-fbbd-4772-b8f4-c2900b06e699 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:51.578134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b118989a-fbbd-4772-b8f4-c2900b06e699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78352599528948b6b846f1fe3144ff12'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:51.581048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b118989a-fbbd-4772-b8f4-c2900b06e699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78352599528948b6b846f1fe3144ff12'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:51.600021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b118989a-fbbd-4772-b8f4-c2900b06e699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78352599528948b6b846f1fe3144ff12'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:51.602802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b118989a-fbbd-4772-b8f4-c2900b06e699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78352599528948b6b846f1fe3144ff12'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:51.615162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b118989a-fbbd-4772-b8f4-c2900b06e699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78352599528948b6b846f1fe3144ff12'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:51.636104 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3732/7413] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:51 2022] DELETE /identity/v3/users/78352599528948b6b846f1fe3144ff12 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:52.804651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:52.807076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:52.836844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bcd6e-5720-41db-a913-a4d1edcbc908 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:53.003653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:53.004631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:53.005016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:53.005477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] PATH_INFO: `/v3/projects/3bda7d87b1534399901d8cf88a87c998` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:53.006812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bda7d87b1534399901d8cf88a87c998)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:53.009575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:53.118571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bda7d87b1534399901d8cf88a87c998', 'request_id': 'req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:53.132183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bda7d87b1534399901d8cf88a87c998', 'request_id': 'req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:53.151647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bda7d87b1534399901d8cf88a87c998', 'request_id': 'req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:53.175444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] The token cache is being invalidate because project 3bda7d87b1534399901d8cf88a87c998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:53.176009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:53.177681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bee1d9b7-a1d1-4e21-bd93-ed0cab1833ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:53.180380 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3682/7414] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:52 2022] DELETE /identity/v3/projects/3bda7d87b1534399901d8cf88a87c998 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:53.185377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7382-7214-4199-84fe-6c3ff792b4ba None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:53.186226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7382-7214-4199-84fe-6c3ff792b4ba None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:53.186613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7382-7214-4199-84fe-6c3ff792b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:53.207282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:53.235616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-02fb7382-7214-4199-84fe-6c3ff792b4ba None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:53.238994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-02fb7382-7214-4199-84fe-6c3ff792b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:53.346248 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3733/7415] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:53.354481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1eb0f-7a1a-4587-8a38-352311193f12 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:53.355178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1eb0f-7a1a-4587-8a38-352311193f12 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:53.355734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1eb0f-7a1a-4587-8a38-352311193f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:53.391209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c0d1eb0f-7a1a-4587-8a38-352311193f12 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:53.393787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c0d1eb0f-7a1a-4587-8a38-352311193f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:53.404889 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3683/7416] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:53.408982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb7382-7214-4199-84fe-6c3ff792b4ba None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:53.427382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb7382-7214-4199-84fe-6c3ff792b4ba None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:53.441175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427581f-23d8-4781-8709-b1b53447d9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:53.442009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427581f-23d8-4781-8709-b1b53447d9cc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:53.442401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427581f-23d8-4781-8709-b1b53447d9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:53.443116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427581f-23d8-4781-8709-b1b53447d9cc admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:53.444013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427581f-23d8-4781-8709-b1b53447d9cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:57:53.444440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427581f-23d8-4781-8709-b1b53447d9cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:53.447891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427581f-23d8-4781-8709-b1b53447d9cc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:53.483203 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3734/7417] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:57:53.484958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1eb0f-7a1a-4587-8a38-352311193f12 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:53.504747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1eb0f-7a1a-4587-8a38-352311193f12 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:53.514873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4ba-d935-4f58-916a-e24d471298c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:53.516418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4ba-d935-4f58-916a-e24d471298c2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:53.516998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4ba-d935-4f58-916a-e24d471298c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:53.517406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4ba-d935-4f58-916a-e24d471298c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:53.518497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613d4ba-d935-4f58-916a-e24d471298c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:53.525176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613d4ba-d935-4f58-916a-e24d471298c2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:53.602349 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3684/7418] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:53 2022] POST /identity/v3/projects => generated 361 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:53.604531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427581f-23d8-4781-8709-b1b53447d9cc admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:53.625447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427581f-23d8-4781-8709-b1b53447d9cc admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:53.796068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228bbcf-5a11-4beb-8a5d-c8ad03e8cda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:53.797159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228bbcf-5a11-4beb-8a5d-c8ad03e8cda5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:53.799185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228bbcf-5a11-4beb-8a5d-c8ad03e8cda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:53.800502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228bbcf-5a11-4beb-8a5d-c8ad03e8cda5 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:53.803731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228bbcf-5a11-4beb-8a5d-c8ad03e8cda5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:53.810008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228bbcf-5a11-4beb-8a5d-c8ad03e8cda5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:53.870420 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3735/7419] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:53 2022] POST /identity/v3/users => generated 281 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:53.872217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4ba-d935-4f58-916a-e24d471298c2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:53.893508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4ba-d935-4f58-916a-e24d471298c2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:53.905783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d7444-3674-4654-99ed-3c69b8f971cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:53.906675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d7444-3674-4654-99ed-3c69b8f971cc admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:53.907094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d7444-3674-4654-99ed-3c69b8f971cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:53.907482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d7444-3674-4654-99ed-3c69b8f971cc admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:53.908251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d7444-3674-4654-99ed-3c69b8f971cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:53.910823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d7444-3674-4654-99ed-3c69b8f971cc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:53.940665 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3685/7420] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:53.942124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228bbcf-5a11-4beb-8a5d-c8ad03e8cda5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:53.958207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228bbcf-5a11-4beb-8a5d-c8ad03e8cda5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:53.984214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187e2b1-aae4-4254-a35e-9a2cf462fb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:53.984887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187e2b1-aae4-4254-a35e-9a2cf462fb39 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:53.985218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187e2b1-aae4-4254-a35e-9a2cf462fb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:53.985777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187e2b1-aae4-4254-a35e-9a2cf462fb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:53.986718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187e2b1-aae4-4254-a35e-9a2cf462fb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:53.988830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187e2b1-aae4-4254-a35e-9a2cf462fb39 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:54.009440 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3736/7421] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:57:54.012249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d7444-3674-4654-99ed-3c69b8f971cc admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:54.031727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d7444-3674-4654-99ed-3c69b8f971cc admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:54.046072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c6a4c-6926-4025-8a05-ae1bb231d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:54.046768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c6a4c-6926-4025-8a05-ae1bb231d26c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:54.047052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c6a4c-6926-4025-8a05-ae1bb231d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:54.047331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c6a4c-6926-4025-8a05-ae1bb231d26c admin admin] PATH_INFO: `/v3/projects/5669c308e4474e6893e2698047606982/users/d2be5c9b24b747b29532b3c9f19d9480/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:54.083321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c6a4c-6926-4025-8a05-ae1bb231d26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5669c308e4474e6893e2698047606982, user_id=d2be5c9b24b747b29532b3c9f19d9480, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:54.088732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c6a4c-6926-4025-8a05-ae1bb231d26c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:54.116979 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3686/7422] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:54 2022] PUT /identity/v3/projects/5669c308e4474e6893e2698047606982/users/d2be5c9b24b747b29532b3c9f19d9480/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:57:54.120579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3eb9-390a-4480-801d-9d7fd29da953 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:54.121109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3eb9-390a-4480-801d-9d7fd29da953 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:54.121647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3eb9-390a-4480-801d-9d7fd29da953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:54.170009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ea5a3eb9-390a-4480-801d-9d7fd29da953 None None] MFA Rules not processed for user `d2be5c9b24b747b29532b3c9f19d9480`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:54.171652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ea5a3eb9-390a-4480-801d-9d7fd29da953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:54.298093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:54.325551 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3737/7423] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:54.355183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c6a4c-6926-4025-8a05-ae1bb231d26c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:54.361030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-797c6a4c-6926-4025-8a05-ae1bb231d26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:54.427295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:54.478391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c6a4c-6926-4025-8a05-ae1bb231d26c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:54.482836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009c85e-4b01-4475-a904-ef48dfdfc4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:54.483888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c85e-4b01-4475-a904-ef48dfdfc4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:54.484318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c85e-4b01-4475-a904-ef48dfdfc4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:54.484804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c85e-4b01-4475-a904-ef48dfdfc4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:54.508781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009c85e-4b01-4475-a904-ef48dfdfc4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:54.510566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009c85e-4b01-4475-a904-ef48dfdfc4d2 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:54.525594 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3687/7424] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:57:54.552732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3eb9-390a-4480-801d-9d7fd29da953 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:54.670934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3eb9-390a-4480-801d-9d7fd29da953 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:54.680207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:54.681008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:54.681820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:54.682114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] PATH_INFO: `/v3/users/d2be5c9b24b747b29532b3c9f19d9480` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:54.683407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2be5c9b24b747b29532b3c9f19d9480)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:54.685502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:54.768040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2be5c9b24b747b29532b3c9f19d9480'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:54.768937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2be5c9b24b747b29532b3c9f19d9480'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:54.796635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2be5c9b24b747b29532b3c9f19d9480'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:54.797405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2be5c9b24b747b29532b3c9f19d9480'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:54.806861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2be5c9b24b747b29532b3c9f19d9480'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:54.833753 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3738/7425] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:57:54 2022] DELETE /identity/v3/users/d2be5c9b24b747b29532b3c9f19d9480 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:54.841917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2d27-d30a-4c1e-bd53-728b227bc306 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:54.842279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2d27-d30a-4c1e-bd53-728b227bc306 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:54.842999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2d27-d30a-4c1e-bd53-728b227bc306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:54.886432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-52fe2d27-d30a-4c1e-bd53-728b227bc306 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:54.887830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-52fe2d27-d30a-4c1e-bd53-728b227bc306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:55.037999 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3688/7426] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:55.089338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:55.091587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:55.259228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303f656-facb-4c88-af18-ce69daf1018a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:55.270210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c8684-9b51-4fb1-bdcf-fba24006c078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:55.270877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c8684-9b51-4fb1-bdcf-fba24006c078 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:55.271203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c8684-9b51-4fb1-bdcf-fba24006c078 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:55.271481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c8684-9b51-4fb1-bdcf-fba24006c078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:55.302971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c8684-9b51-4fb1-bdcf-fba24006c078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:55.305026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c8684-9b51-4fb1-bdcf-fba24006c078 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:55.342465 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3739/7427] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:57:56.267719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe2d27-d30a-4c1e-bd53-728b227bc306 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:56.270155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-52fe2d27-d30a-4c1e-bd53-728b227bc306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:56.315822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe2d27-d30a-4c1e-bd53-728b227bc306 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:56.334608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:56.336889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:56.337641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:56.339747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] PATH_INFO: `/v3/projects/5669c308e4474e6893e2698047606982` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:56.342550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5669c308e4474e6893e2698047606982)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:56.346692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:56.477627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5669c308e4474e6893e2698047606982', 'request_id': 'req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:56.491717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5669c308e4474e6893e2698047606982', 'request_id': 'req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:56.510484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5669c308e4474e6893e2698047606982', 'request_id': 'req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:56.524146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] The token cache is being invalidate because project 5669c308e4474e6893e2698047606982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:57:56.524436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:56.525123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4ac492fd-5a43-49ce-880a-0ffd8edd8b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:57:56.529672 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3689/7428] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:57:56 2022] DELETE /identity/v3/projects/5669c308e4474e6893e2698047606982 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:56.534940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17941064-bfec-46ec-8344-0f5dc6fae85e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:56.535406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17941064-bfec-46ec-8344-0f5dc6fae85e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:56.535526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17941064-bfec-46ec-8344-0f5dc6fae85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:56.570650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-17941064-bfec-46ec-8344-0f5dc6fae85e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:56.572995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-17941064-bfec-46ec-8344-0f5dc6fae85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:56.606637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:56.750637 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3740/7429] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:56.759361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d050c-0f79-4920-a2cc-99760cc5e511 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:56.759361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d050c-0f79-4920-a2cc-99760cc5e511 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:56.759361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d050c-0f79-4920-a2cc-99760cc5e511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:56.806362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-654d050c-0f79-4920-a2cc-99760cc5e511 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:56.808224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-654d050c-0f79-4920-a2cc-99760cc5e511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:56.820958 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3690/7430] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:56.825452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17941064-bfec-46ec-8344-0f5dc6fae85e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:56.844707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17941064-bfec-46ec-8344-0f5dc6fae85e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:56.887436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04409e79-01f9-4ee3-8f12-d0a61b9426a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:56.889491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409e79-01f9-4ee3-8f12-d0a61b9426a8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:56.890059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409e79-01f9-4ee3-8f12-d0a61b9426a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:56.890547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409e79-01f9-4ee3-8f12-d0a61b9426a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:56.891478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04409e79-01f9-4ee3-8f12-d0a61b9426a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:57:56.892031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04409e79-01f9-4ee3-8f12-d0a61b9426a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:56.895640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04409e79-01f9-4ee3-8f12-d0a61b9426a8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:56.935233 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3741/7431] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:57:56.939927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d050c-0f79-4920-a2cc-99760cc5e511 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:56.960231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d050c-0f79-4920-a2cc-99760cc5e511 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:56.968236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4232-5fb0-4c31-a63f-52fe06940e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:56.968891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4232-5fb0-4c31-a63f-52fe06940e47 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:56.969258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4232-5fb0-4c31-a63f-52fe06940e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:56.969578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4232-5fb0-4c31-a63f-52fe06940e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:56.970335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c4232-5fb0-4c31-a63f-52fe06940e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:56.972438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c4232-5fb0-4c31-a63f-52fe06940e47 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:57.081869 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3691/7432] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:56 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:57.086688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04409e79-01f9-4ee3-8f12-d0a61b9426a8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:57.100185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04409e79-01f9-4ee3-8f12-d0a61b9426a8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:57.268449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c8f6-3d68-4cd3-9ea3-dbf31a306309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:57.269433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c8f6-3d68-4cd3-9ea3-dbf31a306309 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:57.269910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c8f6-3d68-4cd3-9ea3-dbf31a306309 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:57.270415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c8f6-3d68-4cd3-9ea3-dbf31a306309 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:57.271397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8c8f6-3d68-4cd3-9ea3-dbf31a306309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:57.274044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8c8f6-3d68-4cd3-9ea3-dbf31a306309 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:57.327961 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3742/7433] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:57 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:57.329694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4232-5fb0-4c31-a63f-52fe06940e47 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:57.343917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4232-5fb0-4c31-a63f-52fe06940e47 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:57.368559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b62594-118f-42d7-beed-49305500a938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:57.369192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62594-118f-42d7-beed-49305500a938 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:57.369502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62594-118f-42d7-beed-49305500a938 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:57.369784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62594-118f-42d7-beed-49305500a938 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:57.370442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b62594-118f-42d7-beed-49305500a938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:57.372073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b62594-118f-42d7-beed-49305500a938 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:57.398017 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3692/7434] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:57.399844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c8f6-3d68-4cd3-9ea3-dbf31a306309 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:57.413607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c8f6-3d68-4cd3-9ea3-dbf31a306309 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:57.427411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c627009-03b5-4ab9-8ff1-9b98eedab187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:57.428109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c627009-03b5-4ab9-8ff1-9b98eedab187 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:57.428463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c627009-03b5-4ab9-8ff1-9b98eedab187 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:57.428816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c627009-03b5-4ab9-8ff1-9b98eedab187 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:57.430137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c627009-03b5-4ab9-8ff1-9b98eedab187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:57.431919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c627009-03b5-4ab9-8ff1-9b98eedab187 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:57.448110 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3743/7435] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:57.452327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b62594-118f-42d7-beed-49305500a938 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:57.470044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b62594-118f-42d7-beed-49305500a938 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:57.477668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddbd25-7df7-4499-9dad-1a36daa24795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:57.478526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddbd25-7df7-4499-9dad-1a36daa24795 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:57.479005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddbd25-7df7-4499-9dad-1a36daa24795 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:57.479307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddbd25-7df7-4499-9dad-1a36daa24795 admin admin] PATH_INFO: `/v3/projects/a25fd35c61e041998da08b5ea285a92d/users/c0d6cbf921164bf8874c40ac45f73019/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:57.485900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:57.510857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddbd25-7df7-4499-9dad-1a36daa24795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25fd35c61e041998da08b5ea285a92d, user_id=c0d6cbf921164bf8874c40ac45f73019, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:57.514040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddbd25-7df7-4499-9dad-1a36daa24795 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:57.552076 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3693/7436] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:57 2022] PUT /identity/v3/projects/a25fd35c61e041998da08b5ea285a92d/users/c0d6cbf921164bf8874c40ac45f73019/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:57.552687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fbbe4-6b74-4732-a284-ec9f8eb95f56 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:57.553121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fbbe4-6b74-4732-a284-ec9f8eb95f56 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:57.553420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fbbe4-6b74-4732-a284-ec9f8eb95f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:57.592751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-518fbbe4-6b74-4732-a284-ec9f8eb95f56 None None] MFA Rules not processed for user `c0d6cbf921164bf8874c40ac45f73019`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:57.594477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-518fbbe4-6b74-4732-a284-ec9f8eb95f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:57.707374 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3744/7437] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:57.713577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddbd25-7df7-4499-9dad-1a36daa24795 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:57.800485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddbd25-7df7-4499-9dad-1a36daa24795 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:57.809117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b35e6-5f5d-4734-a3de-f5cc893802e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:57.811133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b35e6-5f5d-4734-a3de-f5cc893802e6 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:57.811775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b35e6-5f5d-4734-a3de-f5cc893802e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:57.812436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b35e6-5f5d-4734-a3de-f5cc893802e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:57.814221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b35e6-5f5d-4734-a3de-f5cc893802e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:57.816528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b35e6-5f5d-4734-a3de-f5cc893802e6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:57.856212 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3694/7438] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:57 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:57.857573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fbbe4-6b74-4732-a284-ec9f8eb95f56 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:57.877364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fbbe4-6b74-4732-a284-ec9f8eb95f56 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:57.897843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:57.975210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff1c17-ea96-43f4-be10-0e8209c6a040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:57.975840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1c17-ea96-43f4-be10-0e8209c6a040 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:57.976124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1c17-ea96-43f4-be10-0e8209c6a040 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:57.977984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff1c17-ea96-43f4-be10-0e8209c6a040 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:57.978761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff1c17-ea96-43f4-be10-0e8209c6a040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:57.981141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff1c17-ea96-43f4-be10-0e8209c6a040 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:58.012618 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3745/7439] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:57 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:58.018375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b35e6-5f5d-4734-a3de-f5cc893802e6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:58.031498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b35e6-5f5d-4734-a3de-f5cc893802e6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:58.038468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb86da-cd3b-41b8-b8a1-82c2fd3f2d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:58.039211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb86da-cd3b-41b8-b8a1-82c2fd3f2d10 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:58.039742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb86da-cd3b-41b8-b8a1-82c2fd3f2d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:58.040030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb86da-cd3b-41b8-b8a1-82c2fd3f2d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:58.041808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb86da-cd3b-41b8-b8a1-82c2fd3f2d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:58.044775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb86da-cd3b-41b8-b8a1-82c2fd3f2d10 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:58.063615 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3695/7440] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:58.067762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff1c17-ea96-43f4-be10-0e8209c6a040 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:58.080563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff1c17-ea96-43f4-be10-0e8209c6a040 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:58.088618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192f36e-9940-43eb-99a6-5cb06fffbf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:58.089644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f36e-9940-43eb-99a6-5cb06fffbf87 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:58.090151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f36e-9940-43eb-99a6-5cb06fffbf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:58.090686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f36e-9940-43eb-99a6-5cb06fffbf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:58.091586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192f36e-9940-43eb-99a6-5cb06fffbf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:58.093838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192f36e-9940-43eb-99a6-5cb06fffbf87 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:58.106144 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3746/7441] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:58.110675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb86da-cd3b-41b8-b8a1-82c2fd3f2d10 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:58.128891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb86da-cd3b-41b8-b8a1-82c2fd3f2d10 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:58.151403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bf4f4-2233-42d1-9c25-4bd5c9a0dafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:58.153339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bf4f4-2233-42d1-9c25-4bd5c9a0dafe admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:58.155427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bf4f4-2233-42d1-9c25-4bd5c9a0dafe admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:58.156066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bf4f4-2233-42d1-9c25-4bd5c9a0dafe admin admin] PATH_INFO: `/v3/projects/4c9c178f61f546fc95fa7e23ebdc8e0b/users/a62ede18068b4baeacacc5d3c20f02ba/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:58.204669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bf4f4-2233-42d1-9c25-4bd5c9a0dafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9c178f61f546fc95fa7e23ebdc8e0b, user_id=a62ede18068b4baeacacc5d3c20f02ba, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:58.208864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bf4f4-2233-42d1-9c25-4bd5c9a0dafe admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:58.226560 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3696/7442] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:58 2022] PUT /identity/v3/projects/4c9c178f61f546fc95fa7e23ebdc8e0b/users/a62ede18068b4baeacacc5d3c20f02ba/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:58.240851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b3d3-8751-4616-8073-872aa60ab518 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:58.240851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b3d3-8751-4616-8073-872aa60ab518 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:58.240851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b3d3-8751-4616-8073-872aa60ab518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:58.304470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fef5b3d3-8751-4616-8073-872aa60ab518 None None] MFA Rules not processed for user `a62ede18068b4baeacacc5d3c20f02ba`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:58.306436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fef5b3d3-8751-4616-8073-872aa60ab518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:58.459658 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3747/7443] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:57:58.462035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bf4f4-2233-42d1-9c25-4bd5c9a0dafe admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:58.640402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bf4f4-2233-42d1-9c25-4bd5c9a0dafe admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:58.653894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd4f7-8b25-4c93-9f56-165a89a38709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:58.654694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd4f7-8b25-4c93-9f56-165a89a38709 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:58.654985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd4f7-8b25-4c93-9f56-165a89a38709 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:58.655263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd4f7-8b25-4c93-9f56-165a89a38709 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:58.656249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd4f7-8b25-4c93-9f56-165a89a38709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:58.658388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd4f7-8b25-4c93-9f56-165a89a38709 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:58.750388 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3697/7444] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:57:58 2022] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:57:58.755224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5b3d3-8751-4616-8073-872aa60ab518 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:58.796674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5b3d3-8751-4616-8073-872aa60ab518 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:58.913205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5b365-2aad-44d8-bf58-7dcc9caf917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:58.914193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5b365-2aad-44d8-bf58-7dcc9caf917f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:58.914540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5b365-2aad-44d8-bf58-7dcc9caf917f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:58.914991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5b365-2aad-44d8-bf58-7dcc9caf917f admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:58.915709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5b365-2aad-44d8-bf58-7dcc9caf917f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:58.918504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5b365-2aad-44d8-bf58-7dcc9caf917f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:58.992882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd4f7-8b25-4c93-9f56-165a89a38709 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:59.005571 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3748/7445] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:57:58 2022] POST /identity/v3/users => generated 299 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:57:59.012355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd4f7-8b25-4c93-9f56-165a89a38709 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:59.023836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593f670-471d-4c2e-b21f-113e35bbe976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:59.024473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593f670-471d-4c2e-b21f-113e35bbe976 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:59.024763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593f670-471d-4c2e-b21f-113e35bbe976 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:59.025032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593f670-471d-4c2e-b21f-113e35bbe976 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:59.025715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593f670-471d-4c2e-b21f-113e35bbe976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:59.030759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593f670-471d-4c2e-b21f-113e35bbe976 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:59.057226 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3698/7446] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:59.062224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5b365-2aad-44d8-bf58-7dcc9caf917f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:59.079813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5b365-2aad-44d8-bf58-7dcc9caf917f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:59.092989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012236b2-e953-4053-a46a-f5947c9b953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:59.104759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012236b2-e953-4053-a46a-f5947c9b953a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:59.105142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012236b2-e953-4053-a46a-f5947c9b953a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:59.105845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012236b2-e953-4053-a46a-f5947c9b953a admin admin] PATH_INFO: `/v3/projects/74456b406ee944c19aefa4e076e4d5e5/users/c7ded1bf4aeb468593d98dacaa85d545/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:59.129767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:59.139707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012236b2-e953-4053-a46a-f5947c9b953a admin admin] RBAC: Authorizing `identity:create_grant(project_id=74456b406ee944c19aefa4e076e4d5e5, user_id=c7ded1bf4aeb468593d98dacaa85d545, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:59.143586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012236b2-e953-4053-a46a-f5947c9b953a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:59.178588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593f670-471d-4c2e-b21f-113e35bbe976 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:59.179043 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3749/7447] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:59 2022] PUT /identity/v3/projects/74456b406ee944c19aefa4e076e4d5e5/users/c7ded1bf4aeb468593d98dacaa85d545/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:59.190472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593f670-471d-4c2e-b21f-113e35bbe976 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:59.206245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:59.352953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868966c-8e3d-4b35-8619-f466e865993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:59.353828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868966c-8e3d-4b35-8619-f466e865993a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:59.354113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868966c-8e3d-4b35-8619-f466e865993a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:59.354386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868966c-8e3d-4b35-8619-f466e865993a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:59.355170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868966c-8e3d-4b35-8619-f466e865993a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:59.356952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868966c-8e3d-4b35-8619-f466e865993a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:59.388772 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3699/7448] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:57:59.394348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012236b2-e953-4053-a46a-f5947c9b953a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:59.410898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012236b2-e953-4053-a46a-f5947c9b953a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:59.419560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42b77b-74a3-42b8-971d-df017e3fec91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:59.420244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42b77b-74a3-42b8-971d-df017e3fec91 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:59.420525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42b77b-74a3-42b8-971d-df017e3fec91 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:59.420802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42b77b-74a3-42b8-971d-df017e3fec91 admin admin] PATH_INFO: `/v3/projects/74456b406ee944c19aefa4e076e4d5e5/users/c7ded1bf4aeb468593d98dacaa85d545/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:59.427183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42b77b-74a3-42b8-971d-df017e3fec91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74456b406ee944c19aefa4e076e4d5e5, user_id=c7ded1bf4aeb468593d98dacaa85d545, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:59.436719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42b77b-74a3-42b8-971d-df017e3fec91 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:59.467327 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3750/7449] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:57:59 2022] PUT /identity/v3/projects/74456b406ee944c19aefa4e076e4d5e5/users/c7ded1bf4aeb468593d98dacaa85d545/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:57:59.468637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc598c6-d884-4ef6-813f-9e0228270184 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:59.469143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc598c6-d884-4ef6-813f-9e0228270184 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:59.469267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc598c6-d884-4ef6-813f-9e0228270184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:59.528751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0cc598c6-d884-4ef6-813f-9e0228270184 None None] MFA Rules not processed for user `c7ded1bf4aeb468593d98dacaa85d545`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:57:59.530001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0cc598c6-d884-4ef6-813f-9e0228270184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:59.645436 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3700/7450] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:57:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:57:59.656704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42b77b-74a3-42b8-971d-df017e3fec91 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:57:59.658796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7c42b77b-74a3-42b8-971d-df017e3fec91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:57:59.762472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42b77b-74a3-42b8-971d-df017e3fec91 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:57:59.774440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976b3e1-0bc0-4676-9f3d-b2485be1f08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:57:59.776056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976b3e1-0bc0-4676-9f3d-b2485be1f08e service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:57:59.776620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976b3e1-0bc0-4676-9f3d-b2485be1f08e service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:57:59.778252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976b3e1-0bc0-4676-9f3d-b2485be1f08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:57:59.885499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976b3e1-0bc0-4676-9f3d-b2485be1f08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:57:59.888064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976b3e1-0bc0-4676-9f3d-b2485be1f08e service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:57:59.916066 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3751/7451] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:57:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:00.701918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1438d-46f5-4c74-9473-02dde7bb4513 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:00.703896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1438d-46f5-4c74-9473-02dde7bb4513 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:00.707921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1438d-46f5-4c74-9473-02dde7bb4513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:00.789131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8af1438d-46f5-4c74-9473-02dde7bb4513 None None] MFA Rules not processed for user `84c0b2f7cc2a4fc59f1235450797425a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:00.790645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8af1438d-46f5-4c74-9473-02dde7bb4513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:00.930611 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3701/7452] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:00 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:00.935135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976b3e1-0bc0-4676-9f3d-b2485be1f08e service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:00.938171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9976b3e1-0bc0-4676-9f3d-b2485be1f08e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:01.097943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976b3e1-0bc0-4676-9f3d-b2485be1f08e service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:01.106306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f72f4-36dd-4e2f-b88d-6edb2d4d3215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:01.106946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f72f4-36dd-4e2f-b88d-6edb2d4d3215 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:01.107224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f72f4-36dd-4e2f-b88d-6edb2d4d3215 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:01.107546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f72f4-36dd-4e2f-b88d-6edb2d4d3215 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:01.108199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f72f4-36dd-4e2f-b88d-6edb2d4d3215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:01.114571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f72f4-36dd-4e2f-b88d-6edb2d4d3215 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:01.173199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1438d-46f5-4c74-9473-02dde7bb4513 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:01.180677 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3752/7453] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:00 2022] POST /identity/v3/projects => generated 405 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:01.191233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1438d-46f5-4c74-9473-02dde7bb4513 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:01.223209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:01.286831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569e2b2-ac50-421d-ac40-408aa0beba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:01.287507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569e2b2-ac50-421d-ac40-408aa0beba22 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:01.287875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569e2b2-ac50-421d-ac40-408aa0beba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:01.288329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569e2b2-ac50-421d-ac40-408aa0beba22 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:01.289745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569e2b2-ac50-421d-ac40-408aa0beba22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:01.292193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569e2b2-ac50-421d-ac40-408aa0beba22 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:01.305828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f72f4-36dd-4e2f-b88d-6edb2d4d3215 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:01.307598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a99f72f4-36dd-4e2f-b88d-6edb2d4d3215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:01.331093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f72f4-36dd-4e2f-b88d-6edb2d4d3215 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:01.356938 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3702/7454] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:01 2022] POST /identity/v3/users => generated 303 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:01.366084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569e2b2-ac50-421d-ac40-408aa0beba22 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:01.368823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:01.369799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:01.371591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:01.372862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] PATH_INFO: `/v3/users/f580223b9a6e4d0c8a725f924cb9be79` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:01.376468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f580223b9a6e4d0c8a725f924cb9be79)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:01.384632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:01.395928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569e2b2-ac50-421d-ac40-408aa0beba22 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:01.408807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4698b2-896b-46d9-9a9f-5a0c269fa6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:01.418139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4698b2-896b-46d9-9a9f-5a0c269fa6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:01.418357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4698b2-896b-46d9-9a9f-5a0c269fa6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:01.418638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4698b2-896b-46d9-9a9f-5a0c269fa6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:01.419333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4698b2-896b-46d9-9a9f-5a0c269fa6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:01.420971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4698b2-896b-46d9-9a9f-5a0c269fa6d3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:01.422032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:01.439234 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3703/7455] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:01.443809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4698b2-896b-46d9-9a9f-5a0c269fa6d3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:01.464631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4698b2-896b-46d9-9a9f-5a0c269fa6d3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:01.469675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c98ede-cbd9-4b0d-bf01-9e8549abba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:01.475248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c98ede-cbd9-4b0d-bf01-9e8549abba47 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:01.475658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c98ede-cbd9-4b0d-bf01-9e8549abba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:01.475939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c98ede-cbd9-4b0d-bf01-9e8549abba47 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:01.482050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c98ede-cbd9-4b0d-bf01-9e8549abba47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:01.483758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c98ede-cbd9-4b0d-bf01-9e8549abba47 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:01.507652 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3704/7456] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:01.510901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f580223b9a6e4d0c8a725f924cb9be79'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:01.512542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c98ede-cbd9-4b0d-bf01-9e8549abba47 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:01.522363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f580223b9a6e4d0c8a725f924cb9be79'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:01.522883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c98ede-cbd9-4b0d-bf01-9e8549abba47 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:01.543019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad42b35-69af-4050-8c18-7e2c8ddf4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:01.543723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42b35-69af-4050-8c18-7e2c8ddf4c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:01.544000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42b35-69af-4050-8c18-7e2c8ddf4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:01.544279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42b35-69af-4050-8c18-7e2c8ddf4c0d admin admin] PATH_INFO: `/v3/projects/7a2e9a8f2891451c9199528a3aae2594/users/c66a6fe93b604459ad298f7dd211e467/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:01.568783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad42b35-69af-4050-8c18-7e2c8ddf4c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2e9a8f2891451c9199528a3aae2594, user_id=c66a6fe93b604459ad298f7dd211e467, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:01.573335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad42b35-69af-4050-8c18-7e2c8ddf4c0d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:01.580934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f580223b9a6e4d0c8a725f924cb9be79'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:01.583304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f580223b9a6e4d0c8a725f924cb9be79'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:01.595770 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3705/7457] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:01 2022] PUT /identity/v3/projects/7a2e9a8f2891451c9199528a3aae2594/users/c66a6fe93b604459ad298f7dd211e467/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:01.613321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f580223b9a6e4d0c8a725f924cb9be79'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:01.670521 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3753/7458] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:01 2022] DELETE /identity/v3/users/f580223b9a6e4d0c8a725f924cb9be79 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:01.675412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c963e3-b02c-4fd8-9c04-1c62397ffecb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:01.675707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c963e3-b02c-4fd8-9c04-1c62397ffecb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:01.675976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c963e3-b02c-4fd8-9c04-1c62397ffecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:01.735862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a3c963e3-b02c-4fd8-9c04-1c62397ffecb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:01.745797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a3c963e3-b02c-4fd8-9c04-1c62397ffecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:01.946928 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3706/7459] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:01.973713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:01.975488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:02.067165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e1822-9b15-4b08-82a2-d091f96e6afe admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:02.076407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa10f1-d600-4020-8544-a3636238060f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:02.077163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa10f1-d600-4020-8544-a3636238060f service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:02.077484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa10f1-d600-4020-8544-a3636238060f service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:02.077765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa10f1-d600-4020-8544-a3636238060f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:02.096485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa10f1-d600-4020-8544-a3636238060f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:02.098354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa10f1-d600-4020-8544-a3636238060f service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:02.117539 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3754/7460] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:02.996577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c963e3-b02c-4fd8-9c04-1c62397ffecb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:03.000063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a3c963e3-b02c-4fd8-9c04-1c62397ffecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:03.061807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c963e3-b02c-4fd8-9c04-1c62397ffecb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:03.070405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:03.071366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.072078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.072971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] PATH_INFO: `/v3/projects/93b2505f889c442c844ced600721ae06` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.075977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b2505f889c442c844ced600721ae06)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:03.078696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:03.159012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa10f1-d600-4020-8544-a3636238060f service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:03.160834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2ffa10f1-d600-4020-8544-a3636238060f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:03.244509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b2505f889c442c844ced600721ae06', 'request_id': 'req-c6741f9a-c56c-4111-9d59-a51faf52e6d9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:03.257676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b2505f889c442c844ced600721ae06', 'request_id': 'req-c6741f9a-c56c-4111-9d59-a51faf52e6d9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:03.260489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:03.271927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b2505f889c442c844ced600721ae06', 'request_id': 'req-c6741f9a-c56c-4111-9d59-a51faf52e6d9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:03.287425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] The token cache is being invalidate because project 93b2505f889c442c844ced600721ae06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:03.288018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:03.290042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c6741f9a-c56c-4111-9d59-a51faf52e6d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:03.296332 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3707/7461] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:02 2022] DELETE /identity/v3/projects/93b2505f889c442c844ced600721ae06 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:03.299498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0d120-9965-4987-b61d-f7c3f94ad71f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.299847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0d120-9965-4987-b61d-f7c3f94ad71f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.300407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0d120-9965-4987-b61d-f7c3f94ad71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.330640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa10f1-d600-4020-8544-a3636238060f service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:03.333799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-06a0d120-9965-4987-b61d-f7c3f94ad71f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:03.335888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-06a0d120-9965-4987-b61d-f7c3f94ad71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:03.448554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:03.466547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f77c77-1232-4384-b157-f191b252b6bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:03.468318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f77c77-1232-4384-b157-f191b252b6bc service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.468874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f77c77-1232-4384-b157-f191b252b6bc service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.470998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f77c77-1232-4384-b157-f191b252b6bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.476761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-79f77c77-1232-4384-b157-f191b252b6bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:03.510117 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3708/7462] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:03.518765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a88d0-c09e-414d-b3f1-dac024fa0f48 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.519481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a88d0-c09e-414d-b3f1-dac024fa0f48 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.519918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a88d0-c09e-414d-b3f1-dac024fa0f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.565888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-903a88d0-c09e-414d-b3f1-dac024fa0f48 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:03.567153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-903a88d0-c09e-414d-b3f1-dac024fa0f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:03.588614 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3709/7463] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:03.591899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a88d0-c09e-414d-b3f1-dac024fa0f48 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:03.612430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a88d0-c09e-414d-b3f1-dac024fa0f48 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:03.616734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f77c77-1232-4384-b157-f191b252b6bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:03.620066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f77c77-1232-4384-b157-f191b252b6bc service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:03.626563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61677c-a877-40c8-ac7f-dd6e8cc78eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:03.627426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61677c-a877-40c8-ac7f-dd6e8cc78eea admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.627865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61677c-a877-40c8-ac7f-dd6e8cc78eea admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.628332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61677c-a877-40c8-ac7f-dd6e8cc78eea admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.629145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61677c-a877-40c8-ac7f-dd6e8cc78eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:03.629634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61677c-a877-40c8-ac7f-dd6e8cc78eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:03.631432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61677c-a877-40c8-ac7f-dd6e8cc78eea admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:03.643394 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3755/7464] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:03.654050 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3710/7465] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:03.658238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f77c77-1232-4384-b157-f191b252b6bc service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:03.670211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f77c77-1232-4384-b157-f191b252b6bc service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:03.675968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad347b3-31b5-4c84-b0df-9bd3d8999ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:03.677200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad347b3-31b5-4c84-b0df-9bd3d8999ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.677698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad347b3-31b5-4c84-b0df-9bd3d8999ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.679998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad347b3-31b5-4c84-b0df-9bd3d8999ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.683333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad347b3-31b5-4c84-b0df-9bd3d8999ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:03.687171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad347b3-31b5-4c84-b0df-9bd3d8999ca0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:03.730212 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3756/7466] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:03 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:03.731985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61677c-a877-40c8-ac7f-dd6e8cc78eea admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:03.744986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61677c-a877-40c8-ac7f-dd6e8cc78eea admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:03.937066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94acee-57fb-499e-be1c-db22ddb77bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:03.938098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94acee-57fb-499e-be1c-db22ddb77bad admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:03.941103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94acee-57fb-499e-be1c-db22ddb77bad admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:03.941727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94acee-57fb-499e-be1c-db22ddb77bad admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:03.942644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94acee-57fb-499e-be1c-db22ddb77bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:03.948593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94acee-57fb-499e-be1c-db22ddb77bad admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:04.012136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad347b3-31b5-4c84-b0df-9bd3d8999ca0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:04.021210 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3711/7467] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:03 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:58:04.032757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad347b3-31b5-4c84-b0df-9bd3d8999ca0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:04.052275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773faeef-b6fb-4287-b330-ea629bf6a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:04.053878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773faeef-b6fb-4287-b330-ea629bf6a317 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:04.053878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773faeef-b6fb-4287-b330-ea629bf6a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:04.053878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773faeef-b6fb-4287-b330-ea629bf6a317 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:04.056974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773faeef-b6fb-4287-b330-ea629bf6a317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:04.058761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773faeef-b6fb-4287-b330-ea629bf6a317 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:04.087323 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3757/7468] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:04.092058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94acee-57fb-499e-be1c-db22ddb77bad admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:04.106387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94acee-57fb-499e-be1c-db22ddb77bad admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:04.147577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496dc8d-3c10-4b4d-80c8-85ec45752d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:04.152660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496dc8d-3c10-4b4d-80c8-85ec45752d18 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:04.154490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496dc8d-3c10-4b4d-80c8-85ec45752d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:04.159322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496dc8d-3c10-4b4d-80c8-85ec45752d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:04.160272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496dc8d-3c10-4b4d-80c8-85ec45752d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:04.182560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496dc8d-3c10-4b4d-80c8-85ec45752d18 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:04.267210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773faeef-b6fb-4287-b330-ea629bf6a317 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:04.267803 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3712/7469] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:04.290530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773faeef-b6fb-4287-b330-ea629bf6a317 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:04.301830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ca5c8-fc2c-4bce-bcb0-c049cd9bd56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:04.303298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ca5c8-fc2c-4bce-bcb0-c049cd9bd56a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:04.303741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ca5c8-fc2c-4bce-bcb0-c049cd9bd56a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:04.304683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ca5c8-fc2c-4bce-bcb0-c049cd9bd56a admin admin] PATH_INFO: `/v3/projects/e7c408b7ddf04e199819ce01b246f298/users/2c60878ceaa6433fade1606b198060c5/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:04.343727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ca5c8-fc2c-4bce-bcb0-c049cd9bd56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c408b7ddf04e199819ce01b246f298, user_id=2c60878ceaa6433fade1606b198060c5, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:04.346716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ca5c8-fc2c-4bce-bcb0-c049cd9bd56a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:04.371320 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3758/7470] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:04 2022] PUT /identity/v3/projects/e7c408b7ddf04e199819ce01b246f298/users/2c60878ceaa6433fade1606b198060c5/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:58:04.384866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620db20f-2540-43f6-8241-7e7fc0815ef8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:04.385202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620db20f-2540-43f6-8241-7e7fc0815ef8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:04.385503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620db20f-2540-43f6-8241-7e7fc0815ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:04.488919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-620db20f-2540-43f6-8241-7e7fc0815ef8 None None] MFA Rules not processed for user `2c60878ceaa6433fade1606b198060c5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:04.498089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-620db20f-2540-43f6-8241-7e7fc0815ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:04.598487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:04.700638 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3713/7471] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:04.794285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ca5c8-fc2c-4bce-bcb0-c049cd9bd56a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:04.799606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-682ca5c8-fc2c-4bce-bcb0-c049cd9bd56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:04.956112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620db20f-2540-43f6-8241-7e7fc0815ef8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:04.957845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-620db20f-2540-43f6-8241-7e7fc0815ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:05.051542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ca5c8-fc2c-4bce-bcb0-c049cd9bd56a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:05.064380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec0c2d-d0a4-4fab-b776-6b1b6d055fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:05.065479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec0c2d-d0a4-4fab-b776-6b1b6d055fae service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:05.065876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec0c2d-d0a4-4fab-b776-6b1b6d055fae service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:05.066377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec0c2d-d0a4-4fab-b776-6b1b6d055fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:05.092251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec0c2d-d0a4-4fab-b776-6b1b6d055fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:05.094057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec0c2d-d0a4-4fab-b776-6b1b6d055fae service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:05.117842 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3759/7472] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:05.155852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620db20f-2540-43f6-8241-7e7fc0815ef8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:05.163148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d48d25-3d03-42e8-897b-268e6e4bab88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:05.164389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d48d25-3d03-42e8-897b-268e6e4bab88 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:05.164672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d48d25-3d03-42e8-897b-268e6e4bab88 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:05.164950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d48d25-3d03-42e8-897b-268e6e4bab88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:05.167490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-90d48d25-3d03-42e8-897b-268e6e4bab88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:05.363532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d48d25-3d03-42e8-897b-268e6e4bab88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:05.370147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d48d25-3d03-42e8-897b-268e6e4bab88 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:05.408208 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3714/7473] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:58:12.645547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f6c68-ef24-4447-8871-80713ac47010 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:12.646632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f6c68-ef24-4447-8871-80713ac47010 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:12.647505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f6c68-ef24-4447-8871-80713ac47010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:12.713703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1f1f6c68-ef24-4447-8871-80713ac47010 None None] MFA Rules not processed for user `c66a6fe93b604459ad298f7dd211e467`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:12.715216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1f1f6c68-ef24-4447-8871-80713ac47010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:12.792531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:12.869429 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3760/7474] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:12.880936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc10bb-f280-40c8-8aa2-2d7df3f40737 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:12.881809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc10bb-f280-40c8-8aa2-2d7df3f40737 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:12.882319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc10bb-f280-40c8-8aa2-2d7df3f40737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:12.922504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c6cc10bb-f280-40c8-8aa2-2d7df3f40737 None None] MFA Rules not processed for user `84c0b2f7cc2a4fc59f1235450797425a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:12.927343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c6cc10bb-f280-40c8-8aa2-2d7df3f40737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:13.083616 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3715/7475] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:12 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:13.105204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f6c68-ef24-4447-8871-80713ac47010 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:13.107054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1f1f6c68-ef24-4447-8871-80713ac47010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:13.239001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f6c68-ef24-4447-8871-80713ac47010 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:13.248230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec838277-5e24-4bfb-9b90-832cfed11db5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:13.248883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838277-5e24-4bfb-9b90-832cfed11db5 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:13.249168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838277-5e24-4bfb-9b90-832cfed11db5 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:13.250153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838277-5e24-4bfb-9b90-832cfed11db5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:13.252983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ec838277-5e24-4bfb-9b90-832cfed11db5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:13.267087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec838277-5e24-4bfb-9b90-832cfed11db5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:13.274227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec838277-5e24-4bfb-9b90-832cfed11db5 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:13.296622 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3761/7476] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:13 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:15.840344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc10bb-f280-40c8-8aa2-2d7df3f40737 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:15.842606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c6cc10bb-f280-40c8-8aa2-2d7df3f40737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:15.925465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:16.014802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc10bb-f280-40c8-8aa2-2d7df3f40737 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:16.027656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087ec0e-2659-42df-b4cb-cba89daa423f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:16.028311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087ec0e-2659-42df-b4cb-cba89daa423f service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:16.028601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087ec0e-2659-42df-b4cb-cba89daa423f service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:16.028872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087ec0e-2659-42df-b4cb-cba89daa423f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:16.031447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3087ec0e-2659-42df-b4cb-cba89daa423f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:16.061094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087ec0e-2659-42df-b4cb-cba89daa423f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:16.063277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087ec0e-2659-42df-b4cb-cba89daa423f service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:16.094317 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3716/7477] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:18.099603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec838277-5e24-4bfb-9b90-832cfed11db5 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:18.102889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ec838277-5e24-4bfb-9b90-832cfed11db5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:18.275654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec838277-5e24-4bfb-9b90-832cfed11db5 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:18.286553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:18.287714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:18.289643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:18.291160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] PATH_INFO: `/v3/users/c0d6cbf921164bf8874c40ac45f73019` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:18.292945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d6cbf921164bf8874c40ac45f73019)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:18.295624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:18.414423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d6cbf921164bf8874c40ac45f73019'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:18.415962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d6cbf921164bf8874c40ac45f73019'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:18.456757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d6cbf921164bf8874c40ac45f73019'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:18.460058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d6cbf921164bf8874c40ac45f73019'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:18.463976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:18.492112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d6cbf921164bf8874c40ac45f73019'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:18.521714 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3762/7478] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:18 2022] DELETE /identity/v3/users/c0d6cbf921164bf8874c40ac45f73019 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:18.528070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423ba2-ba5e-4aa3-803f-9266a9acae77 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:18.528861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423ba2-ba5e-4aa3-803f-9266a9acae77 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:18.529300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423ba2-ba5e-4aa3-803f-9266a9acae77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:18.613293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-72423ba2-ba5e-4aa3-803f-9266a9acae77 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:18.615395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72423ba2-ba5e-4aa3-803f-9266a9acae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:18.846021 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3717/7479] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:18.898702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:18.900353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:19.082273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a93b9-4a30-4136-b5a5-0b498bb52e8f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:19.113929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e36d8-70a7-4dac-9cac-481add4c74a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:19.114677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e36d8-70a7-4dac-9cac-481add4c74a8 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:19.115029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e36d8-70a7-4dac-9cac-481add4c74a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:19.118018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e36d8-70a7-4dac-9cac-481add4c74a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:19.141851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e36d8-70a7-4dac-9cac-481add4c74a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:19.143401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e36d8-70a7-4dac-9cac-481add4c74a8 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:19.171190 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3763/7480] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:20.066100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72423ba2-ba5e-4aa3-803f-9266a9acae77 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:20.068548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72423ba2-ba5e-4aa3-803f-9266a9acae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:20.089644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72423ba2-ba5e-4aa3-803f-9266a9acae77 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:20.094626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1c7ba-adce-42f9-b479-e730cf31a548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:20.095370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c7ba-adce-42f9-b479-e730cf31a548 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:20.095656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c7ba-adce-42f9-b479-e730cf31a548 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:20.095932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c7ba-adce-42f9-b479-e730cf31a548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:20.098008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-97c1c7ba-adce-42f9-b479-e730cf31a548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:20.113045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1c7ba-adce-42f9-b479-e730cf31a548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:20.114865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1c7ba-adce-42f9-b479-e730cf31a548 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:20.131459 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3718/7481] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:21.440962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e36d8-70a7-4dac-9cac-481add4c74a8 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:21.442656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9f0e36d8-70a7-4dac-9cac-481add4c74a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:21.479048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e36d8-70a7-4dac-9cac-481add4c74a8 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:21.490955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:21.492197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:21.492499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:21.492795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] PATH_INFO: `/v3/projects/a25fd35c61e041998da08b5ea285a92d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:21.494240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25fd35c61e041998da08b5ea285a92d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:21.496523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:21.590936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25fd35c61e041998da08b5ea285a92d', 'request_id': 'req-a54629ab-6a9d-4cb1-9174-d96303bacd9b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.600087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25fd35c61e041998da08b5ea285a92d', 'request_id': 'req-a54629ab-6a9d-4cb1-9174-d96303bacd9b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.615687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25fd35c61e041998da08b5ea285a92d', 'request_id': 'req-a54629ab-6a9d-4cb1-9174-d96303bacd9b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.633313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] The token cache is being invalidate because project a25fd35c61e041998da08b5ea285a92d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:21.633661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.634335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.635930 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3764/7482] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:21 2022] DELETE /identity/v3/projects/a25fd35c61e041998da08b5ea285a92d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:58:21.640757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1c7ba-adce-42f9-b479-e730cf31a548 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:21.665167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:21.672820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:21.706146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1c7ba-adce-42f9-b479-e730cf31a548 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:21.817583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54629ab-6a9d-4cb1-9174-d96303bacd9b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:21.834910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01082a04-b6ca-4d9d-a16f-99d9fcb541e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:21.836320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:21.837268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:21.837832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:21.839003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] PATH_INFO: `/v3/users/a62ede18068b4baeacacc5d3c20f02ba` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:21.841153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62ede18068b4baeacacc5d3c20f02ba)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:21.843226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082a04-b6ca-4d9d-a16f-99d9fcb541e5 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:21.843226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082a04-b6ca-4d9d-a16f-99d9fcb541e5 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:21.843226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082a04-b6ca-4d9d-a16f-99d9fcb541e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:21.845006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:21.846749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-01082a04-b6ca-4d9d-a16f-99d9fcb541e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:21.859289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:21.879404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01082a04-b6ca-4d9d-a16f-99d9fcb541e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:21.882540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01082a04-b6ca-4d9d-a16f-99d9fcb541e5 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:21.904717 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3765/7483] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:21.939845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62ede18068b4baeacacc5d3c20f02ba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.940964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62ede18068b4baeacacc5d3c20f02ba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.945870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:21.976499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62ede18068b4baeacacc5d3c20f02ba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:21.986222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62ede18068b4baeacacc5d3c20f02ba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:22.002072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62ede18068b4baeacacc5d3c20f02ba'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:22.011569 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3719/7484] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:21 2022] DELETE /identity/v3/users/a62ede18068b4baeacacc5d3c20f02ba => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:58:23.148923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01082a04-b6ca-4d9d-a16f-99d9fcb541e5 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:23.150437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-01082a04-b6ca-4d9d-a16f-99d9fcb541e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:23.164352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01082a04-b6ca-4d9d-a16f-99d9fcb541e5 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:23.234312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:23.234992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:23.235275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:23.235548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] PATH_INFO: `/v3/projects/4c9c178f61f546fc95fa7e23ebdc8e0b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:23.236680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c9c178f61f546fc95fa7e23ebdc8e0b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:23.238619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:23.293116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c9c178f61f546fc95fa7e23ebdc8e0b', 'request_id': 'req-f0256bae-86b7-43e0-98e3-325f64fb335a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.305948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c9c178f61f546fc95fa7e23ebdc8e0b', 'request_id': 'req-f0256bae-86b7-43e0-98e3-325f64fb335a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.314741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c9c178f61f546fc95fa7e23ebdc8e0b', 'request_id': 'req-f0256bae-86b7-43e0-98e3-325f64fb335a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.327724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] The token cache is being invalidate because project 4c9c178f61f546fc95fa7e23ebdc8e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:23.328098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.330369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.336080 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3766/7485] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:23 2022] DELETE /identity/v3/projects/4c9c178f61f546fc95fa7e23ebdc8e0b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:23.337645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:23.339360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:23.356847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71957-62c8-4516-ad62-09002f5bef15 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:23.443141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35c0d3-6409-4647-81d3-9942a318d383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:23.443794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c0d3-6409-4647-81d3-9942a318d383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:23.444073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c0d3-6409-4647-81d3-9942a318d383 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:23.445621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c0d3-6409-4647-81d3-9942a318d383 admin admin] PATH_INFO: `/v3/users/c7ded1bf4aeb468593d98dacaa85d545` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:23.446225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35c0d3-6409-4647-81d3-9942a318d383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ded1bf4aeb468593d98dacaa85d545)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:23.448147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35c0d3-6409-4647-81d3-9942a318d383 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:23.534755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ef35c0d3-6409-4647-81d3-9942a318d383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ded1bf4aeb468593d98dacaa85d545'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.538226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ef35c0d3-6409-4647-81d3-9942a318d383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ded1bf4aeb468593d98dacaa85d545'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.560290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ef35c0d3-6409-4647-81d3-9942a318d383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ded1bf4aeb468593d98dacaa85d545'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.571058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ef35c0d3-6409-4647-81d3-9942a318d383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ded1bf4aeb468593d98dacaa85d545'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.580853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ef35c0d3-6409-4647-81d3-9942a318d383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ded1bf4aeb468593d98dacaa85d545'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:23.598190 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3720/7486] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:23 2022] DELETE /identity/v3/users/c7ded1bf4aeb468593d98dacaa85d545 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:24.187573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:24.189242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:24.216714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0256bae-86b7-43e0-98e3-325f64fb335a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:24.304975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:24.305700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:24.305985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:24.306261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] PATH_INFO: `/v3/projects/74456b406ee944c19aefa4e076e4d5e5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:24.308217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74456b406ee944c19aefa4e076e4d5e5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:24.310627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:24.358319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:24.393134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74456b406ee944c19aefa4e076e4d5e5', 'request_id': 'req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.402010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74456b406ee944c19aefa4e076e4d5e5', 'request_id': 'req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.413524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74456b406ee944c19aefa4e076e4d5e5', 'request_id': 'req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.433942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] The token cache is being invalidate because project 74456b406ee944c19aefa4e076e4d5e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:24.434521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.435511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-75a30728-1b1f-4ed4-8944-f5d83a8ca83b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:24.437496 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3767/7487] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:24 2022] DELETE /identity/v3/projects/74456b406ee944c19aefa4e076e4d5e5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:24.443470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ea515-b1da-486c-9084-0146e2f8df03 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:24.444308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ea515-b1da-486c-9084-0146e2f8df03 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:24.444308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ea515-b1da-486c-9084-0146e2f8df03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:24.480352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0b4ea515-b1da-486c-9084-0146e2f8df03 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:24.481944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0b4ea515-b1da-486c-9084-0146e2f8df03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:24.551922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:24.585593 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3721/7488] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:24.592290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcdbe5-7e11-4ef5-9c2d-1fb102caa7af None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:24.592811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcdbe5-7e11-4ef5-9c2d-1fb102caa7af None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:24.593291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcdbe5-7e11-4ef5-9c2d-1fb102caa7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:24.617618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fcfcdbe5-7e11-4ef5-9c2d-1fb102caa7af None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:24.619349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fcfcdbe5-7e11-4ef5-9c2d-1fb102caa7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:24.633521 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3768/7489] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:24.635222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ea515-b1da-486c-9084-0146e2f8df03 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:24.646216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ea515-b1da-486c-9084-0146e2f8df03 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:24.655975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025338d-d6b7-483d-8473-3cf6f35f605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:24.657044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025338d-d6b7-483d-8473-3cf6f35f605b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:24.657616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025338d-d6b7-483d-8473-3cf6f35f605b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:24.657972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025338d-d6b7-483d-8473-3cf6f35f605b admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:24.658701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025338d-d6b7-483d-8473-3cf6f35f605b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:24.659097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025338d-d6b7-483d-8473-3cf6f35f605b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:24.661336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025338d-d6b7-483d-8473-3cf6f35f605b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:24.680233 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3722/7490] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:24.681664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcdbe5-7e11-4ef5-9c2d-1fb102caa7af None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:24.691375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcdbe5-7e11-4ef5-9c2d-1fb102caa7af None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:24.713329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfa72d-fe38-4574-89f5-491d01255217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:24.714022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfa72d-fe38-4574-89f5-491d01255217 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:24.714300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfa72d-fe38-4574-89f5-491d01255217 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:24.714577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfa72d-fe38-4574-89f5-491d01255217 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:24.715227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfa72d-fe38-4574-89f5-491d01255217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:24.717161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfa72d-fe38-4574-89f5-491d01255217 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:24.791682 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3769/7491] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:24 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:58:24.793588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025338d-d6b7-483d-8473-3cf6f35f605b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:24.807286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025338d-d6b7-483d-8473-3cf6f35f605b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:24.818724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c7478-60f6-4d38-865f-eb9f7ddcd93b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:24.819041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c7478-60f6-4d38-865f-eb9f7ddcd93b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:24.819310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c7478-60f6-4d38-865f-eb9f7ddcd93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:24.851462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e47c7478-60f6-4d38-865f-eb9f7ddcd93b None None] MFA Rules not processed for user `9b95cef51ea04d9b886a7c29791ec255`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:24.853809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e47c7478-60f6-4d38-865f-eb9f7ddcd93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:24.912170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247503fe-0ac0-4700-b93d-399c824bac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:24.913269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247503fe-0ac0-4700-b93d-399c824bac82 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:24.914147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247503fe-0ac0-4700-b93d-399c824bac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:24.914497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247503fe-0ac0-4700-b93d-399c824bac82 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:24.915283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247503fe-0ac0-4700-b93d-399c824bac82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:24.917448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247503fe-0ac0-4700-b93d-399c824bac82 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:24.948183 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3723/7492] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:24 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:24.951628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247503fe-0ac0-4700-b93d-399c824bac82 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:24.967013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247503fe-0ac0-4700-b93d-399c824bac82 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:24.967956 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3770/7493] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:24.976458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed3d37-3e1d-4093-8931-4d22f0ad1372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:24.977100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3d37-3e1d-4093-8931-4d22f0ad1372 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:24.978142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3d37-3e1d-4093-8931-4d22f0ad1372 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:24.978142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed3d37-3e1d-4093-8931-4d22f0ad1372 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:24.978800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed3d37-3e1d-4093-8931-4d22f0ad1372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:24.980874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed3d37-3e1d-4093-8931-4d22f0ad1372 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:24.998801 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3724/7494] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:25.003784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c7478-60f6-4d38-865f-eb9f7ddcd93b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.025909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c7478-60f6-4d38-865f-eb9f7ddcd93b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.031676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396679f-de96-45f6-9e3a-a69a979c54a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.032409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396679f-de96-45f6-9e3a-a69a979c54a4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.032764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396679f-de96-45f6-9e3a-a69a979c54a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.033117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396679f-de96-45f6-9e3a-a69a979c54a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.034228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396679f-de96-45f6-9e3a-a69a979c54a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.036051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396679f-de96-45f6-9e3a-a69a979c54a4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.054376 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3771/7495] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:25.055530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed3d37-3e1d-4093-8931-4d22f0ad1372 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.071126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed3d37-3e1d-4093-8931-4d22f0ad1372 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.083531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b4202-a235-46e1-a289-12d15c32e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.084254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4202-a235-46e1-a289-12d15c32e45a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.084532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4202-a235-46e1-a289-12d15c32e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.084810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4202-a235-46e1-a289-12d15c32e45a admin admin] PATH_INFO: `/v3/projects/60a19cab0721487b9dada0e3ad35381e/users/9a121acf89554c7a9650c6461082fbc6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.105822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b4202-a235-46e1-a289-12d15c32e45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a19cab0721487b9dada0e3ad35381e, user_id=9a121acf89554c7a9650c6461082fbc6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.108838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b4202-a235-46e1-a289-12d15c32e45a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.138125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511fdae-b901-4f41-94e2-80e8710eb3b9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.138455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511fdae-b901-4f41-94e2-80e8710eb3b9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.138667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511fdae-b901-4f41-94e2-80e8710eb3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.146157 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3725/7496] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:25 2022] PUT /identity/v3/projects/60a19cab0721487b9dada0e3ad35381e/users/9a121acf89554c7a9650c6461082fbc6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:25.171439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c511fdae-b901-4f41-94e2-80e8710eb3b9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:25.174476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c511fdae-b901-4f41-94e2-80e8710eb3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:25.299523 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3772/7497] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:25.315994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b4202-a235-46e1-a289-12d15c32e45a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.318141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5a0b4202-a235-46e1-a289-12d15c32e45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:25.385028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511fdae-b901-4f41-94e2-80e8710eb3b9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:25.388137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c511fdae-b901-4f41-94e2-80e8710eb3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:25.442043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b4202-a235-46e1-a289-12d15c32e45a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.447603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:25.450246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c2318-4373-49ce-928b-adb9f10f29fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.451896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2318-4373-49ce-928b-adb9f10f29fc service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.452420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2318-4373-49ce-928b-adb9f10f29fc service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.452945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2318-4373-49ce-928b-adb9f10f29fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.471127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c2318-4373-49ce-928b-adb9f10f29fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.473018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c2318-4373-49ce-928b-adb9f10f29fc service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.487558 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3726/7498] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:25.525940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511fdae-b901-4f41-94e2-80e8710eb3b9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:25.530235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cfa4b-75eb-4f58-8025-469916275348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:25.531056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cfa4b-75eb-4f58-8025-469916275348 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:25.531339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cfa4b-75eb-4f58-8025-469916275348 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:25.531613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cfa4b-75eb-4f58-8025-469916275348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:25.534393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fa7cfa4b-75eb-4f58-8025-469916275348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:25.551308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cfa4b-75eb-4f58-8025-469916275348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:25.553086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cfa4b-75eb-4f58-8025-469916275348 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:25.573905 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3773/7499] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:58:29.065778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390923d-d6fc-4d43-896d-70dc5bc0762b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:29.067316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390923d-d6fc-4d43-896d-70dc5bc0762b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:29.068046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390923d-d6fc-4d43-896d-70dc5bc0762b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:29.177119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3390923d-d6fc-4d43-896d-70dc5bc0762b None None] MFA Rules not processed for user `9a121acf89554c7a9650c6461082fbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:29.178644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3390923d-d6fc-4d43-896d-70dc5bc0762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:29.232347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:29.356296 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3727/7500] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:29.370737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cfa4b-75eb-4f58-8025-469916275348 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:29.372255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fa7cfa4b-75eb-4f58-8025-469916275348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:29.470203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cfa4b-75eb-4f58-8025-469916275348 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:29.475251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04fda6-6679-43ec-8274-1ac8c5e8b9b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:29.476468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04fda6-6679-43ec-8274-1ac8c5e8b9b4 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:29.477017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04fda6-6679-43ec-8274-1ac8c5e8b9b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:29.477694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04fda6-6679-43ec-8274-1ac8c5e8b9b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:29.490566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04fda6-6679-43ec-8274-1ac8c5e8b9b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:29.492378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04fda6-6679-43ec-8274-1ac8c5e8b9b4 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:29.510178 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3774/7501] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:32.157114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f88a6-198e-485a-9f02-b999216566b3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:32.157998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f88a6-198e-485a-9f02-b999216566b3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:32.158452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f88a6-198e-485a-9f02-b999216566b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:32.179752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0b7f88a6-198e-485a-9f02-b999216566b3 None None] MFA Rules not processed for user `9a121acf89554c7a9650c6461082fbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:32.181633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0b7f88a6-198e-485a-9f02-b999216566b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:32.194436 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3728/7502] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:32.635024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04fda6-6679-43ec-8274-1ac8c5e8b9b4 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:32.637426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5e04fda6-6679-43ec-8274-1ac8c5e8b9b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:32.673160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04fda6-6679-43ec-8274-1ac8c5e8b9b4 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:32.689190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:32.690704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:32.691179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:32.691751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] PATH_INFO: `/v3/users/2c60878ceaa6433fade1606b198060c5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:32.693835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c60878ceaa6433fade1606b198060c5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:32.705877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:32.832204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c60878ceaa6433fade1606b198060c5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:32.833137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c60878ceaa6433fade1606b198060c5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:32.850181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c60878ceaa6433fade1606b198060c5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:32.850996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c60878ceaa6433fade1606b198060c5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:32.860442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c60878ceaa6433fade1606b198060c5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:32.878964 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3775/7503] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:32 2022] DELETE /identity/v3/users/2c60878ceaa6433fade1606b198060c5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:32.884515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fe61d-9ef4-4468-81de-a90f7136f81e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:32.885467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fe61d-9ef4-4468-81de-a90f7136f81e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:32.885884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fe61d-9ef4-4468-81de-a90f7136f81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:32.914723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-220fe61d-9ef4-4468-81de-a90f7136f81e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:32.917681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-220fe61d-9ef4-4468-81de-a90f7136f81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:33.002757 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3729/7504] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:33.010340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:33.011894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:33.081452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:33.111465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e3be7-996a-424e-ad09-e33bd4e4b972 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:33.115716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282b7f-5c5c-41f7-9dd5-75d2b60bbd64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:33.116212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282b7f-5c5c-41f7-9dd5-75d2b60bbd64 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:33.116728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282b7f-5c5c-41f7-9dd5-75d2b60bbd64 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:33.117441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282b7f-5c5c-41f7-9dd5-75d2b60bbd64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:33.129152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a282b7f-5c5c-41f7-9dd5-75d2b60bbd64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:33.131186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a282b7f-5c5c-41f7-9dd5-75d2b60bbd64 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:33.150828 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3776/7505] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:33.960943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fe61d-9ef4-4468-81de-a90f7136f81e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:33.962889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-220fe61d-9ef4-4468-81de-a90f7136f81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:34.112571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fe61d-9ef4-4468-81de-a90f7136f81e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:34.127893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d077c4-158e-4b05-9dd9-4a47b2529abb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:34.128990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d077c4-158e-4b05-9dd9-4a47b2529abb service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:34.129278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d077c4-158e-4b05-9dd9-4a47b2529abb service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:34.129653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d077c4-158e-4b05-9dd9-4a47b2529abb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:34.133411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f5d077c4-158e-4b05-9dd9-4a47b2529abb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:34.216091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:34.229513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d077c4-158e-4b05-9dd9-4a47b2529abb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:34.231357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d077c4-158e-4b05-9dd9-4a47b2529abb service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:34.246114 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3730/7506] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:33 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:34.300108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282b7f-5c5c-41f7-9dd5-75d2b60bbd64 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:34.300108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3a282b7f-5c5c-41f7-9dd5-75d2b60bbd64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:34.334605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282b7f-5c5c-41f7-9dd5-75d2b60bbd64 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:34.349381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:34.354162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:34.354641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:34.355038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] PATH_INFO: `/v3/projects/e7c408b7ddf04e199819ce01b246f298` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:34.357773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c408b7ddf04e199819ce01b246f298)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:34.364578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:34.486756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c408b7ddf04e199819ce01b246f298', 'request_id': 'req-22e21705-52a8-4c0c-8af9-d44d452da2b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:34.496764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c408b7ddf04e199819ce01b246f298', 'request_id': 'req-22e21705-52a8-4c0c-8af9-d44d452da2b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:34.533211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c408b7ddf04e199819ce01b246f298', 'request_id': 'req-22e21705-52a8-4c0c-8af9-d44d452da2b2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:34.571911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] The token cache is being invalidate because project e7c408b7ddf04e199819ce01b246f298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:34.572446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:34.573553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-22e21705-52a8-4c0c-8af9-d44d452da2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:34.575589 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3777/7507] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:34 2022] DELETE /identity/v3/projects/e7c408b7ddf04e199819ce01b246f298 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:34.581283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91105b02-a294-4859-8c32-75c556cdd0ad None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:34.581567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91105b02-a294-4859-8c32-75c556cdd0ad None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:34.581850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91105b02-a294-4859-8c32-75c556cdd0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:34.613203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-91105b02-a294-4859-8c32-75c556cdd0ad None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:34.615425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-91105b02-a294-4859-8c32-75c556cdd0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:34.768707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea49d3-1d7b-4edd-b861-54b355884b23 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:34.775048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea49d3-1d7b-4edd-b861-54b355884b23 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:34.775490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea49d3-1d7b-4edd-b861-54b355884b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:34.782682 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3731/7508] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:34.852612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-78ea49d3-1d7b-4edd-b861-54b355884b23 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:34.855006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-78ea49d3-1d7b-4edd-b861-54b355884b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:34.880821 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3778/7509] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:34.886083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91105b02-a294-4859-8c32-75c556cdd0ad None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:34.897484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91105b02-a294-4859-8c32-75c556cdd0ad None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:34.904265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32e211-260e-4c01-9008-9b00d925bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:34.905120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32e211-260e-4c01-9008-9b00d925bd16 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:34.905782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32e211-260e-4c01-9008-9b00d925bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:34.906255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32e211-260e-4c01-9008-9b00d925bd16 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:34.907166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32e211-260e-4c01-9008-9b00d925bd16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:34.907627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32e211-260e-4c01-9008-9b00d925bd16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:34.910184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32e211-260e-4c01-9008-9b00d925bd16 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:34.931506 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3732/7510] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:34.932713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea49d3-1d7b-4edd-b861-54b355884b23 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:34.947360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea49d3-1d7b-4edd-b861-54b355884b23 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:34.952319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2ee63-6c24-4076-baa6-34d66a3bf5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:34.953689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2ee63-6c24-4076-baa6-34d66a3bf5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:34.954142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2ee63-6c24-4076-baa6-34d66a3bf5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:34.954654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2ee63-6c24-4076-baa6-34d66a3bf5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:34.955710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2ee63-6c24-4076-baa6-34d66a3bf5c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:34.957965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2ee63-6c24-4076-baa6-34d66a3bf5c6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:35.001913 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3779/7511] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:34 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:58:35.006305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32e211-260e-4c01-9008-9b00d925bd16 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:35.025149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32e211-260e-4c01-9008-9b00d925bd16 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:35.161535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674230d3-0d61-4264-a5f7-8abc79b74d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:35.162910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674230d3-0d61-4264-a5f7-8abc79b74d99 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:35.164965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674230d3-0d61-4264-a5f7-8abc79b74d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:35.175045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674230d3-0d61-4264-a5f7-8abc79b74d99 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:35.178728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674230d3-0d61-4264-a5f7-8abc79b74d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:35.183334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674230d3-0d61-4264-a5f7-8abc79b74d99 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:35.230709 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3733/7512] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:35 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:35.234808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2ee63-6c24-4076-baa6-34d66a3bf5c6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:35.247885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2ee63-6c24-4076-baa6-34d66a3bf5c6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:35.254479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53bc2e-5728-492e-99e9-4c8556d52942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:35.254479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53bc2e-5728-492e-99e9-4c8556d52942 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:35.254785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53bc2e-5728-492e-99e9-4c8556d52942 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:35.255071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53bc2e-5728-492e-99e9-4c8556d52942 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:35.255619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53bc2e-5728-492e-99e9-4c8556d52942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:35.257954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53bc2e-5728-492e-99e9-4c8556d52942 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:35.273162 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3780/7513] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:35.274683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674230d3-0d61-4264-a5f7-8abc79b74d99 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:35.286036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674230d3-0d61-4264-a5f7-8abc79b74d99 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:35.290902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66514a-0e68-4787-bcc9-047aa1f1d219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:35.291526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66514a-0e68-4787-bcc9-047aa1f1d219 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:35.291812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66514a-0e68-4787-bcc9-047aa1f1d219 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:35.292091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66514a-0e68-4787-bcc9-047aa1f1d219 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:35.292747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66514a-0e68-4787-bcc9-047aa1f1d219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:35.294399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66514a-0e68-4787-bcc9-047aa1f1d219 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:35.308443 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3734/7514] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:35.312406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53bc2e-5728-492e-99e9-4c8556d52942 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:35.324252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53bc2e-5728-492e-99e9-4c8556d52942 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:35.329017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b70c6-1d0e-4340-8855-6f794f7b1a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:35.329760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b70c6-1d0e-4340-8855-6f794f7b1a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:35.330045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b70c6-1d0e-4340-8855-6f794f7b1a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:35.330322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b70c6-1d0e-4340-8855-6f794f7b1a2e admin admin] PATH_INFO: `/v3/projects/a2dbd91a0b1d455ab8ec55eeeb3d0520/users/633e6c0f844c4deaa26d32dabf1b02c3/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:35.349283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b70c6-1d0e-4340-8855-6f794f7b1a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2dbd91a0b1d455ab8ec55eeeb3d0520, user_id=633e6c0f844c4deaa26d32dabf1b02c3, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:35.353323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b70c6-1d0e-4340-8855-6f794f7b1a2e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:35.380063 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3781/7515] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:35 2022] PUT /identity/v3/projects/a2dbd91a0b1d455ab8ec55eeeb3d0520/users/633e6c0f844c4deaa26d32dabf1b02c3/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:35.383633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c043d-93d8-42ba-b5e2-0e1d3c79a1ae None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:35.384574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c043d-93d8-42ba-b5e2-0e1d3c79a1ae None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:35.385023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c043d-93d8-42ba-b5e2-0e1d3c79a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:35.420302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-701c043d-93d8-42ba-b5e2-0e1d3c79a1ae None None] MFA Rules not processed for user `633e6c0f844c4deaa26d32dabf1b02c3`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:35.421864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-701c043d-93d8-42ba-b5e2-0e1d3c79a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:35.475388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:35.507825 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3735/7516] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:35.521886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b70c6-1d0e-4340-8855-6f794f7b1a2e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:35.524151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a6b70c6-1d0e-4340-8855-6f794f7b1a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:35.618017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b70c6-1d0e-4340-8855-6f794f7b1a2e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:35.621895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31010097-ac28-4d86-9fae-83d11a00ea77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:35.622842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31010097-ac28-4d86-9fae-83d11a00ea77 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:35.623125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31010097-ac28-4d86-9fae-83d11a00ea77 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:35.623399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31010097-ac28-4d86-9fae-83d11a00ea77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:35.633628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31010097-ac28-4d86-9fae-83d11a00ea77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:35.635063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31010097-ac28-4d86-9fae-83d11a00ea77 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:35.646348 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3782/7517] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:37.160219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c043d-93d8-42ba-b5e2-0e1d3c79a1ae None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:37.163282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-701c043d-93d8-42ba-b5e2-0e1d3c79a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:37.352082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c043d-93d8-42ba-b5e2-0e1d3c79a1ae None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:37.363771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408cbc1-e91b-4e97-9026-a04d99c46034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:37.365917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408cbc1-e91b-4e97-9026-a04d99c46034 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:37.377057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408cbc1-e91b-4e97-9026-a04d99c46034 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:37.377611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408cbc1-e91b-4e97-9026-a04d99c46034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:37.382759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2408cbc1-e91b-4e97-9026-a04d99c46034 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:37.415814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408cbc1-e91b-4e97-9026-a04d99c46034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:37.418445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408cbc1-e91b-4e97-9026-a04d99c46034 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:37.438391 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3736/7518] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:39.826956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31010097-ac28-4d86-9fae-83d11a00ea77 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:39.828419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-31010097-ac28-4d86-9fae-83d11a00ea77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:39.836093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:39.949806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31010097-ac28-4d86-9fae-83d11a00ea77 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:39.955389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:39.956056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:39.956345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:39.956636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] PATH_INFO: `/v3/users/9974d334ff724d08af31ca4d9b5e875f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:39.957967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9974d334ff724d08af31ca4d9b5e875f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:39.960299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.015135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9974d334ff724d08af31ca4d9b5e875f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.015830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9974d334ff724d08af31ca4d9b5e875f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.029843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9974d334ff724d08af31ca4d9b5e875f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.030883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9974d334ff724d08af31ca4d9b5e875f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.038542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9974d334ff724d08af31ca4d9b5e875f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.051831 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3783/7519] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:39 2022] DELETE /identity/v3/users/9974d334ff724d08af31ca4d9b5e875f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:40.057166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdf24-7488-4c1d-915d-0f0198fe0213 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.057708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdf24-7488-4c1d-915d-0f0198fe0213 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.057798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdf24-7488-4c1d-915d-0f0198fe0213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.076828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-de6bdf24-7488-4c1d-915d-0f0198fe0213 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:40.078117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de6bdf24-7488-4c1d-915d-0f0198fe0213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.145259 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3737/7520] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:40.155776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.157298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.229269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88ee14-ffe1-489f-8444-2fc53e4305d6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.235421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce99856-7c37-4eb7-9d5d-d6148f3917fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.236034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99856-7c37-4eb7-9d5d-d6148f3917fa service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.236317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99856-7c37-4eb7-9d5d-d6148f3917fa service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.236651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99856-7c37-4eb7-9d5d-d6148f3917fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.247855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce99856-7c37-4eb7-9d5d-d6148f3917fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.249309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce99856-7c37-4eb7-9d5d-d6148f3917fa service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.283830 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3784/7521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:40.643960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bdf24-7488-4c1d-915d-0f0198fe0213 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:40.648729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de6bdf24-7488-4c1d-915d-0f0198fe0213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.679804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bdf24-7488-4c1d-915d-0f0198fe0213 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:40.685596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:40.686377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.686666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.686947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] PATH_INFO: `/v3/projects/ade35914dfb445ec92a50a8044559199` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.688138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade35914dfb445ec92a50a8044559199)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:40.690414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:40.787254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade35914dfb445ec92a50a8044559199', 'request_id': 'req-ad12d72e-1f1b-4001-bf68-6dde995f5e11'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.797672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade35914dfb445ec92a50a8044559199', 'request_id': 'req-ad12d72e-1f1b-4001-bf68-6dde995f5e11'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.812241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade35914dfb445ec92a50a8044559199', 'request_id': 'req-ad12d72e-1f1b-4001-bf68-6dde995f5e11'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.818108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:40.841804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] The token cache is being invalidate because project ade35914dfb445ec92a50a8044559199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:40.842168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.844441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad12d72e-1f1b-4001-bf68-6dde995f5e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:40.853128 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3738/7522] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:40 2022] DELETE /identity/v3/projects/ade35914dfb445ec92a50a8044559199 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:40.855624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8291d1f-7647-4ce8-b156-b77793191753 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:40.856089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8291d1f-7647-4ce8-b156-b77793191753 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:40.856276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8291d1f-7647-4ce8-b156-b77793191753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:40.895901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e8291d1f-7647-4ce8-b156-b77793191753 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:40.899663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e8291d1f-7647-4ce8-b156-b77793191753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:40.931228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:40.997580 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3785/7523] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:41.007912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1cc6-ab27-4b77-bb91-6c01aba28192 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.008535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1cc6-ab27-4b77-bb91-6c01aba28192 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.009023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1cc6-ab27-4b77-bb91-6c01aba28192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.043657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4e7b1cc6-ab27-4b77-bb91-6c01aba28192 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:41.046171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4e7b1cc6-ab27-4b77-bb91-6c01aba28192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:41.062945 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3739/7524] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:58:41.071697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8291d1f-7647-4ce8-b156-b77793191753 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.088730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8291d1f-7647-4ce8-b156-b77793191753 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.095263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f348f8b-53d6-49b6-b5c0-15d5ee33e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.096093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f348f8b-53d6-49b6-b5c0-15d5ee33e17e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.096702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f348f8b-53d6-49b6-b5c0-15d5ee33e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.097189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f348f8b-53d6-49b6-b5c0-15d5ee33e17e admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.098249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f348f8b-53d6-49b6-b5c0-15d5ee33e17e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:58:41.098742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f348f8b-53d6-49b6-b5c0-15d5ee33e17e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.101767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f348f8b-53d6-49b6-b5c0-15d5ee33e17e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.120272 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3786/7525] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:58:41.121617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b1cc6-ab27-4b77-bb91-6c01aba28192 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.136612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b1cc6-ab27-4b77-bb91-6c01aba28192 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.141448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16be348-431b-4e47-8c79-a6d041e3a595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.142304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16be348-431b-4e47-8c79-a6d041e3a595 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.142583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16be348-431b-4e47-8c79-a6d041e3a595 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.142859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16be348-431b-4e47-8c79-a6d041e3a595 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.143492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16be348-431b-4e47-8c79-a6d041e3a595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.145842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16be348-431b-4e47-8c79-a6d041e3a595 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.181555 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3740/7526] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:58:41 2022] POST /identity/v3/projects => generated 361 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:41.185490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f348f8b-53d6-49b6-b5c0-15d5ee33e17e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.197488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f348f8b-53d6-49b6-b5c0-15d5ee33e17e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.274902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db401c32-fc44-46b1-b96a-ce1d60e27ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.275517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db401c32-fc44-46b1-b96a-ce1d60e27ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.275795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db401c32-fc44-46b1-b96a-ce1d60e27ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.276065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db401c32-fc44-46b1-b96a-ce1d60e27ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.276707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db401c32-fc44-46b1-b96a-ce1d60e27ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.278685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db401c32-fc44-46b1-b96a-ce1d60e27ab7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.309108 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3787/7527] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:58:41 2022] POST /identity/v3/users => generated 281 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:58:41.313183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16be348-431b-4e47-8c79-a6d041e3a595 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.324515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16be348-431b-4e47-8c79-a6d041e3a595 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.329413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fc184-41aa-4b04-8895-da35bc15317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.330713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc184-41aa-4b04-8895-da35bc15317e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.330990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc184-41aa-4b04-8895-da35bc15317e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.331261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc184-41aa-4b04-8895-da35bc15317e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.331915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fc184-41aa-4b04-8895-da35bc15317e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.333546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fc184-41aa-4b04-8895-da35bc15317e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.345577 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3741/7528] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:58:41.351276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db401c32-fc44-46b1-b96a-ce1d60e27ab7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.365831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db401c32-fc44-46b1-b96a-ce1d60e27ab7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.373337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d1b4-c0e6-4c03-90a7-35c4c01dfdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.373337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d1b4-c0e6-4c03-90a7-35c4c01dfdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.374632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d1b4-c0e6-4c03-90a7-35c4c01dfdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.375410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d1b4-c0e6-4c03-90a7-35c4c01dfdf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.376077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146d1b4-c0e6-4c03-90a7-35c4c01dfdf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.377985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146d1b4-c0e6-4c03-90a7-35c4c01dfdf5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.401068 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3788/7529] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:58:41.405119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fc184-41aa-4b04-8895-da35bc15317e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.422431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fc184-41aa-4b04-8895-da35bc15317e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.430231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6100-56d2-4159-bdf9-15153940692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.430920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6100-56d2-4159-bdf9-15153940692a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.431206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6100-56d2-4159-bdf9-15153940692a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.431485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6100-56d2-4159-bdf9-15153940692a admin admin] PATH_INFO: `/v3/projects/1b470fbd7a1c4115b8fc5149fa7a4cc5/users/1f7baf6c46624e8d91029ff799e76ce3/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.449198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b6100-56d2-4159-bdf9-15153940692a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b470fbd7a1c4115b8fc5149fa7a4cc5, user_id=1f7baf6c46624e8d91029ff799e76ce3, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.452890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b6100-56d2-4159-bdf9-15153940692a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.473290 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3742/7530] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:58:41 2022] PUT /identity/v3/projects/1b470fbd7a1c4115b8fc5149fa7a4cc5/users/1f7baf6c46624e8d91029ff799e76ce3/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:58:41.485111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2a48-3d4c-4989-a039-f7f48d0b40bf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.485538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2a48-3d4c-4989-a039-f7f48d0b40bf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.485909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2a48-3d4c-4989-a039-f7f48d0b40bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.574296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ddab2a48-3d4c-4989-a039-f7f48d0b40bf None None] MFA Rules not processed for user `1f7baf6c46624e8d91029ff799e76ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:41.577735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ddab2a48-3d4c-4989-a039-f7f48d0b40bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:41.688248 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3789/7531] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:41.706573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6100-56d2-4159-bdf9-15153940692a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:41.708450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-560b6100-56d2-4159-bdf9-15153940692a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:41.844081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6100-56d2-4159-bdf9-15153940692a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:41.855870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab726a-6c08-49ca-a3c3-d60ab7887586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:41.856814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab726a-6c08-49ca-a3c3-d60ab7887586 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:41.858308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab726a-6c08-49ca-a3c3-d60ab7887586 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:41.858818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab726a-6c08-49ca-a3c3-d60ab7887586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:41.870449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab726a-6c08-49ca-a3c3-d60ab7887586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:41.872225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab726a-6c08-49ca-a3c3-d60ab7887586 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:41.884609 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3743/7532] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:58:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:58:48.598048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27344ef8-13d2-49aa-8b74-b42392ebd85a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:48.598537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27344ef8-13d2-49aa-8b74-b42392ebd85a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:48.598858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27344ef8-13d2-49aa-8b74-b42392ebd85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:48.642056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-27344ef8-13d2-49aa-8b74-b42392ebd85a None None] MFA Rules not processed for user `9a121acf89554c7a9650c6461082fbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:58:48.643562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-27344ef8-13d2-49aa-8b74-b42392ebd85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:48.672023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:48.772926 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3790/7533] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:58:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:58:51.877785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:58.360883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab726a-6c08-49ca-a3c3-d60ab7887586 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:58.364311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3eab726a-6c08-49ca-a3c3-d60ab7887586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:58.533740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab726a-6c08-49ca-a3c3-d60ab7887586 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:58.542773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:58.543624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:58.544051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:58.544489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] PATH_INFO: `/v3/users/84c0b2f7cc2a4fc59f1235450797425a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:58.546010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c0b2f7cc2a4fc59f1235450797425a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:58.548837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:58.635509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c0b2f7cc2a4fc59f1235450797425a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.637724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c0b2f7cc2a4fc59f1235450797425a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.661532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c0b2f7cc2a4fc59f1235450797425a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.674978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c0b2f7cc2a4fc59f1235450797425a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.685493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c0b2f7cc2a4fc59f1235450797425a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:58.700895 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3744/7534] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:58 2022] DELETE /identity/v3/users/84c0b2f7cc2a4fc59f1235450797425a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:58.761572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=16 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:59.285716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27344ef8-13d2-49aa-8b74-b42392ebd85a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:59.301192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27344ef8-13d2-49aa-8b74-b42392ebd85a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:59.448097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:59.449089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:59.449776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:59.450432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] PATH_INFO: `/v3/projects/7fae5ca512c248a7923f618d7809910d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:59.451910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fae5ca512c248a7923f618d7809910d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:59.454122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:59.564145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fae5ca512c248a7923f618d7809910d', 'request_id': 'req-e065c0c0-3769-4a3f-9353-506911ca6b79'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:59.579038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fae5ca512c248a7923f618d7809910d', 'request_id': 'req-e065c0c0-3769-4a3f-9353-506911ca6b79'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:59.592031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fae5ca512c248a7923f618d7809910d', 'request_id': 'req-e065c0c0-3769-4a3f-9353-506911ca6b79'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:59.616511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] The token cache is being invalidate because project 7fae5ca512c248a7923f618d7809910d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:58:59.616808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:59.617790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:59.622893 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3791/7535] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:58:59 2022] DELETE /identity/v3/projects/7fae5ca512c248a7923f618d7809910d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:58:59.624073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:58:59.625727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:58:59.644918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3e9c-b2ff-4a87-b466-952d73ca918d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:58:59.712088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743a288-21bb-4b9f-a156-e35ee144d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:58:59.712905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743a288-21bb-4b9f-a156-e35ee144d7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:58:59.713289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743a288-21bb-4b9f-a156-e35ee144d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:58:59.714277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743a288-21bb-4b9f-a156-e35ee144d7b9 admin admin] PATH_INFO: `/v3/users/c66a6fe93b604459ad298f7dd211e467` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:58:59.715035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743a288-21bb-4b9f-a156-e35ee144d7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66a6fe93b604459ad298f7dd211e467)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:58:59.717587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743a288-21bb-4b9f-a156-e35ee144d7b9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:58:59.748984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:59.790378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b743a288-21bb-4b9f-a156-e35ee144d7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66a6fe93b604459ad298f7dd211e467'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:59.791758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b743a288-21bb-4b9f-a156-e35ee144d7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66a6fe93b604459ad298f7dd211e467'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:59.812923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b743a288-21bb-4b9f-a156-e35ee144d7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66a6fe93b604459ad298f7dd211e467'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:59.837732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b743a288-21bb-4b9f-a156-e35ee144d7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66a6fe93b604459ad298f7dd211e467'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:59.847244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b743a288-21bb-4b9f-a156-e35ee144d7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66a6fe93b604459ad298f7dd211e467'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:58:59.859561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3745/7536] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:58:59 2022] DELETE /identity/v3/users/c66a6fe93b604459ad298f7dd211e467 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:00.119941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:00.121700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:00.143036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065c0c0-3769-4a3f-9353-506911ca6b79 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:00.222596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:00.223452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:00.223870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:00.224157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] PATH_INFO: `/v3/projects/7a2e9a8f2891451c9199528a3aae2594` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:00.225546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2e9a8f2891451c9199528a3aae2594)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:00.228051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:00.293857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:00.314381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2e9a8f2891451c9199528a3aae2594', 'request_id': 'req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.322336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2e9a8f2891451c9199528a3aae2594', 'request_id': 'req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.332602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2e9a8f2891451c9199528a3aae2594', 'request_id': 'req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.348178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] The token cache is being invalidate because project 7a2e9a8f2891451c9199528a3aae2594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:00.348464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.349179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4b082f97-b5c2-4fcd-ad63-b98d9b6cb4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:00.356648 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3792/7537] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:00 2022] DELETE /identity/v3/projects/7a2e9a8f2891451c9199528a3aae2594 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:00.359048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0970f-7a19-4a3d-b182-e2ff0df18a4d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:00.359340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0970f-7a19-4a3d-b182-e2ff0df18a4d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:00.359625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0970f-7a19-4a3d-b182-e2ff0df18a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:00.395757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-10f0970f-7a19-4a3d-b182-e2ff0df18a4d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:00.399021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-10f0970f-7a19-4a3d-b182-e2ff0df18a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:00.561874 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3746/7538] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:00.570334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3824-dad5-40e8-afcc-eb3497caaf53 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:00.570846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3824-dad5-40e8-afcc-eb3497caaf53 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:00.571171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3824-dad5-40e8-afcc-eb3497caaf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:00.606295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ca8b3824-dad5-40e8-afcc-eb3497caaf53 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:00.608502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ca8b3824-dad5-40e8-afcc-eb3497caaf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:00.622254 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3793/7539] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:00.623175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0970f-7a19-4a3d-b182-e2ff0df18a4d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:00.639027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0970f-7a19-4a3d-b182-e2ff0df18a4d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:00.654555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdf64d-535b-4895-bc0a-93f654be9301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:00.655012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdf64d-535b-4895-bc0a-93f654be9301 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:00.655390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdf64d-535b-4895-bc0a-93f654be9301 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:00.655670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdf64d-535b-4895-bc0a-93f654be9301 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:00.656341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdf64d-535b-4895-bc0a-93f654be9301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:00.656648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdf64d-535b-4895-bc0a-93f654be9301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:00.658376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdf64d-535b-4895-bc0a-93f654be9301 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:00.684967 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3747/7540] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:59:00.689403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b3824-dad5-40e8-afcc-eb3497caaf53 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:00.705167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b3824-dad5-40e8-afcc-eb3497caaf53 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:00.713086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8fbe8-90a1-4be6-8709-4e57f0d49f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:00.713815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8fbe8-90a1-4be6-8709-4e57f0d49f6f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:00.714146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8fbe8-90a1-4be6-8709-4e57f0d49f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:00.714428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8fbe8-90a1-4be6-8709-4e57f0d49f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:00.715532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8fbe8-90a1-4be6-8709-4e57f0d49f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:00.718228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8fbe8-90a1-4be6-8709-4e57f0d49f6f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:00.778767 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3794/7541] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:00 2022] POST /identity/v3/projects => generated 369 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:00.782690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdf64d-535b-4895-bc0a-93f654be9301 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:00.798208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdf64d-535b-4895-bc0a-93f654be9301 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:00.888559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2db3b-dbd2-4d8f-ab79-81bc5f7aef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:00.889555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2db3b-dbd2-4d8f-ab79-81bc5f7aef88 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:00.890048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2db3b-dbd2-4d8f-ab79-81bc5f7aef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:00.890502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2db3b-dbd2-4d8f-ab79-81bc5f7aef88 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:00.891315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2db3b-dbd2-4d8f-ab79-81bc5f7aef88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:00.894436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2db3b-dbd2-4d8f-ab79-81bc5f7aef88 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:00.922429 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3748/7542] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:00 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:00.926608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8fbe8-90a1-4be6-8709-4e57f0d49f6f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:00.940259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8fbe8-90a1-4be6-8709-4e57f0d49f6f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:00.952310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa6a9a-1658-4952-bf90-4ed84928665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:00.953941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa6a9a-1658-4952-bf90-4ed84928665c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:00.954487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa6a9a-1658-4952-bf90-4ed84928665c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:00.954927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa6a9a-1658-4952-bf90-4ed84928665c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:00.955796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa6a9a-1658-4952-bf90-4ed84928665c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:00.958677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa6a9a-1658-4952-bf90-4ed84928665c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:00.974114 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3795/7543] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:00.978611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2db3b-dbd2-4d8f-ab79-81bc5f7aef88 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:00.998493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2db3b-dbd2-4d8f-ab79-81bc5f7aef88 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.009866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63653b2d-b05f-4abd-ab1a-923dba9735a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.010677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653b2d-b05f-4abd-ab1a-923dba9735a1 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.011030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653b2d-b05f-4abd-ab1a-923dba9735a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.011415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653b2d-b05f-4abd-ab1a-923dba9735a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.012146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63653b2d-b05f-4abd-ab1a-923dba9735a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.014222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63653b2d-b05f-4abd-ab1a-923dba9735a1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:01.030615 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3749/7544] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:01.032172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa6a9a-1658-4952-bf90-4ed84928665c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.046489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa6a9a-1658-4952-bf90-4ed84928665c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.052312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0e345-61e6-4c26-9225-328597bb0a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.053881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0e345-61e6-4c26-9225-328597bb0a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.054321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0e345-61e6-4c26-9225-328597bb0a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.054769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0e345-61e6-4c26-9225-328597bb0a03 admin admin] PATH_INFO: `/v3/projects/a8b119bc39354987a34ebeaff5f2d9c7/users/218a89d223e146ae95b37b1987da0335/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.077637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0e345-61e6-4c26-9225-328597bb0a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b119bc39354987a34ebeaff5f2d9c7, user_id=218a89d223e146ae95b37b1987da0335, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.081893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0e345-61e6-4c26-9225-328597bb0a03 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:01.113429 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3796/7545] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:01 2022] PUT /identity/v3/projects/a8b119bc39354987a34ebeaff5f2d9c7/users/218a89d223e146ae95b37b1987da0335/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:01.117953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f7937-c1e0-472f-94ec-96c2950562b3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.118369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f7937-c1e0-472f-94ec-96c2950562b3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.118726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f7937-c1e0-472f-94ec-96c2950562b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.128992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:01.153651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-537f7937-c1e0-472f-94ec-96c2950562b3 None None] MFA Rules not processed for user `218a89d223e146ae95b37b1987da0335`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:01.155108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-537f7937-c1e0-472f-94ec-96c2950562b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:01.180728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0e345-61e6-4c26-9225-328597bb0a03 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.182649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-92b0e345-61e6-4c26-9225-328597bb0a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:01.251751 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3750/7546] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:01.254646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f7937-c1e0-472f-94ec-96c2950562b3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.316843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0e345-61e6-4c26-9225-328597bb0a03 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.323038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee11e7-a59c-42ce-8cf6-e7a88c18cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.324060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee11e7-a59c-42ce-8cf6-e7a88c18cea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.324630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee11e7-a59c-42ce-8cf6-e7a88c18cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.325077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee11e7-a59c-42ce-8cf6-e7a88c18cea9 admin admin] PATH_INFO: `/v3/users/1f7baf6c46624e8d91029ff799e76ce3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.326456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee11e7-a59c-42ce-8cf6-e7a88c18cea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7baf6c46624e8d91029ff799e76ce3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.328790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee11e7-a59c-42ce-8cf6-e7a88c18cea9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:01.360773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f7937-c1e0-472f-94ec-96c2950562b3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.369321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fa779-0f1c-4743-b5af-38e50fed34b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.370176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fa779-0f1c-4743-b5af-38e50fed34b4 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.370490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fa779-0f1c-4743-b5af-38e50fed34b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.371269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fa779-0f1c-4743-b5af-38e50fed34b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.371892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fa779-0f1c-4743-b5af-38e50fed34b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.376239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fa779-0f1c-4743-b5af-38e50fed34b4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:01.398722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f2ee11e7-a59c-42ce-8cf6-e7a88c18cea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7baf6c46624e8d91029ff799e76ce3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.400195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f2ee11e7-a59c-42ce-8cf6-e7a88c18cea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7baf6c46624e8d91029ff799e76ce3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.412244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:01.423061 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3751/7547] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:01 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:01.424501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f2ee11e7-a59c-42ce-8cf6-e7a88c18cea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7baf6c46624e8d91029ff799e76ce3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.425252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f2ee11e7-a59c-42ce-8cf6-e7a88c18cea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7baf6c46624e8d91029ff799e76ce3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.427128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fa779-0f1c-4743-b5af-38e50fed34b4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.432752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b77fa779-0f1c-4743-b5af-38e50fed34b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:01.449665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f2ee11e7-a59c-42ce-8cf6-e7a88c18cea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7baf6c46624e8d91029ff799e76ce3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:01.467357 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3797/7548] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:01 2022] DELETE /identity/v3/users/1f7baf6c46624e8d91029ff799e76ce3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:01.471941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf580ca-fe1c-436b-b987-a71961482fef None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.472234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf580ca-fe1c-436b-b987-a71961482fef None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.472511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf580ca-fe1c-436b-b987-a71961482fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.502413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3cf580ca-fe1c-436b-b987-a71961482fef None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:01.503641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3cf580ca-fe1c-436b-b987-a71961482fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:01.575898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fa779-0f1c-4743-b5af-38e50fed34b4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.629897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:01.636915 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3798/7549] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:01.644049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf580ca-fe1c-436b-b987-a71961482fef None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.646062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3cf580ca-fe1c-436b-b987-a71961482fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:01.701592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83676040-ff5d-4acd-939b-dce0b7794136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.703093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83676040-ff5d-4acd-939b-dce0b7794136 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.703631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83676040-ff5d-4acd-939b-dce0b7794136 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.704061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83676040-ff5d-4acd-939b-dce0b7794136 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.704723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83676040-ff5d-4acd-939b-dce0b7794136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.706817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83676040-ff5d-4acd-939b-dce0b7794136 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:01.761134 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3752/7550] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:01 2022] POST /identity/v3/users => generated 291 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:01.762413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83676040-ff5d-4acd-939b-dce0b7794136 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.764270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-83676040-ff5d-4acd-939b-dce0b7794136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:01.769187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf580ca-fe1c-436b-b987-a71961482fef None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.783857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b1dbd-7724-4d3c-bba3-39095795eab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.784841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b1dbd-7724-4d3c-bba3-39095795eab0 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.785092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b1dbd-7724-4d3c-bba3-39095795eab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.785370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b1dbd-7724-4d3c-bba3-39095795eab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.813365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b1dbd-7724-4d3c-bba3-39095795eab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.816500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b1dbd-7724-4d3c-bba3-39095795eab0 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:01.840190 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3799/7551] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:59:01.841016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b1dbd-7724-4d3c-bba3-39095795eab0 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.861111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b1dbd-7724-4d3c-bba3-39095795eab0 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.863750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83676040-ff5d-4acd-939b-dce0b7794136 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.874829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be477fa-452c-4641-a74c-07078efc3423 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.876222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be477fa-452c-4641-a74c-07078efc3423 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.876955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be477fa-452c-4641-a74c-07078efc3423 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.877232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb4310-73d1-4768-9182-5200d6769be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.877757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be477fa-452c-4641-a74c-07078efc3423 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.877893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4310-73d1-4768-9182-5200d6769be9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.878472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4310-73d1-4768-9182-5200d6769be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.878472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4310-73d1-4768-9182-5200d6769be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.879109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb4310-73d1-4768-9182-5200d6769be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.880790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb4310-73d1-4768-9182-5200d6769be9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:01.883869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4be477fa-452c-4641-a74c-07078efc3423 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:01.906506 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3800/7552] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:01.906742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb4310-73d1-4768-9182-5200d6769be9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:01.910168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be477fa-452c-4641-a74c-07078efc3423 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.913298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be477fa-452c-4641-a74c-07078efc3423 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:01.934167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb4310-73d1-4768-9182-5200d6769be9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:01.938603 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3753/7553] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:01.943089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e5fdd-8eab-49b0-b3dd-f38b43c0b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:01.943493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e5fdd-8eab-49b0-b3dd-f38b43c0b920 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:01.943859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e5fdd-8eab-49b0-b3dd-f38b43c0b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:01.944342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e5fdd-8eab-49b0-b3dd-f38b43c0b920 admin admin] PATH_INFO: `/v3/projects/36e3a45cb5c04e3591275e18b7942f66/users/3fcf5a56e06e457398bbe7f09d0acc30/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:01.989771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e5fdd-8eab-49b0-b3dd-f38b43c0b920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e3a45cb5c04e3591275e18b7942f66, user_id=3fcf5a56e06e457398bbe7f09d0acc30, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:01.994603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e5fdd-8eab-49b0-b3dd-f38b43c0b920 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.041338 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3801/7554] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:01 2022] PUT /identity/v3/projects/36e3a45cb5c04e3591275e18b7942f66/users/3fcf5a56e06e457398bbe7f09d0acc30/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:02.045179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be477fa-452c-4641-a74c-07078efc3423 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.071247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be477fa-452c-4641-a74c-07078efc3423 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.190488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f7ff4-eeaa-43e4-9844-5ae63d8c92d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.191463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f7ff4-eeaa-43e4-9844-5ae63d8c92d7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.192964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f7ff4-eeaa-43e4-9844-5ae63d8c92d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.193316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f7ff4-eeaa-43e4-9844-5ae63d8c92d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.197220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f7ff4-eeaa-43e4-9844-5ae63d8c92d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.203125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f7ff4-eeaa-43e4-9844-5ae63d8c92d7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.208416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e5fdd-8eab-49b0-b3dd-f38b43c0b920 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.211149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b98e5fdd-8eab-49b0-b3dd-f38b43c0b920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:02.229604 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3754/7555] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:59:02.230946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f7ff4-eeaa-43e4-9844-5ae63d8c92d7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.232531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e5fdd-8eab-49b0-b3dd-f38b43c0b920 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.239803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.241463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.242078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.242551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] PATH_INFO: `/v3/projects/1b470fbd7a1c4115b8fc5149fa7a4cc5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.243387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f7ff4-eeaa-43e4-9844-5ae63d8c92d7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.244175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b470fbd7a1c4115b8fc5149fa7a4cc5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.246405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.249364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05973217-2cb6-4151-9672-6d3e0af3c6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.251374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05973217-2cb6-4151-9672-6d3e0af3c6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.251666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05973217-2cb6-4151-9672-6d3e0af3c6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.251949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05973217-2cb6-4151-9672-6d3e0af3c6d0 admin admin] PATH_INFO: `/v3/projects/36e3a45cb5c04e3591275e18b7942f66/users/3fcf5a56e06e457398bbe7f09d0acc30/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.255427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05973217-2cb6-4151-9672-6d3e0af3c6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e3a45cb5c04e3591275e18b7942f66, user_id=3fcf5a56e06e457398bbe7f09d0acc30, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.259000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05973217-2cb6-4151-9672-6d3e0af3c6d0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.275810 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3755/7556] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:02 2022] PUT /identity/v3/projects/36e3a45cb5c04e3591275e18b7942f66/users/3fcf5a56e06e457398bbe7f09d0acc30/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:02.360018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:02.387754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b470fbd7a1c4115b8fc5149fa7a4cc5', 'request_id': 'req-5768e901-43ca-45ee-8c2f-a20444414769'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:02.392654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5dfd-bfb0-4117-b493-c1d31975c7e0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.392962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5dfd-bfb0-4117-b493-c1d31975c7e0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.399261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5dfd-bfb0-4117-b493-c1d31975c7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.399695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b470fbd7a1c4115b8fc5149fa7a4cc5', 'request_id': 'req-5768e901-43ca-45ee-8c2f-a20444414769'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:02.414629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b470fbd7a1c4115b8fc5149fa7a4cc5', 'request_id': 'req-5768e901-43ca-45ee-8c2f-a20444414769'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:02.439731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] The token cache is being invalidate because project 1b470fbd7a1c4115b8fc5149fa7a4cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:02.440160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:02.440954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5768e901-43ca-45ee-8c2f-a20444414769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:02.442922 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3802/7557] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:02 2022] DELETE /identity/v3/projects/1b470fbd7a1c4115b8fc5149fa7a4cc5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:02.448445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7844c-e8da-415b-9a23-6daf68959f83 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.448868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7844c-e8da-415b-9a23-6daf68959f83 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.449363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7844c-e8da-415b-9a23-6daf68959f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.470115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-666b5dfd-bfb0-4117-b493-c1d31975c7e0 None None] MFA Rules not processed for user `3fcf5a56e06e457398bbe7f09d0acc30`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:02.471651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-666b5dfd-bfb0-4117-b493-c1d31975c7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:02.473537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f2d7844c-e8da-415b-9a23-6daf68959f83 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:02.476144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f2d7844c-e8da-415b-9a23-6daf68959f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:02.542562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:02.653098 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3756/7558] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:02.659621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5dfd-bfb0-4117-b493-c1d31975c7e0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.665874 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3803/7559] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:02.673365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851df35-c123-4910-8666-f7c6fb3a3df9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.674012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851df35-c123-4910-8666-f7c6fb3a3df9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.674827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851df35-c123-4910-8666-f7c6fb3a3df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.684270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5dfd-bfb0-4117-b493-c1d31975c7e0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.692096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb54a4-332c-4bcb-8a31-051c74b323ae tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.693746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb54a4-332c-4bcb-8a31-051c74b323ae tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.695266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb54a4-332c-4bcb-8a31-051c74b323ae tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.696048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb54a4-332c-4bcb-8a31-051c74b323ae tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.696987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb54a4-332c-4bcb-8a31-051c74b323ae tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.699200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb54a4-332c-4bcb-8a31-051c74b323ae tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.705825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c851df35-c123-4910-8666-f7c6fb3a3df9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:02.707996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c851df35-c123-4910-8666-f7c6fb3a3df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:02.721421 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3804/7560] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:02.727140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851df35-c123-4910-8666-f7c6fb3a3df9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.739219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851df35-c123-4910-8666-f7c6fb3a3df9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.741137 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3757/7561] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/projects => generated 328 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:02.751042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb54a4-332c-4bcb-8a31-051c74b323ae tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.841978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d049a33-1524-447f-98c7-41d254142407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.842635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d049a33-1524-447f-98c7-41d254142407 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.842919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d049a33-1524-447f-98c7-41d254142407 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.843215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d049a33-1524-447f-98c7-41d254142407 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.843858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d049a33-1524-447f-98c7-41d254142407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:02.844170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d049a33-1524-447f-98c7-41d254142407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.845943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d049a33-1524-447f-98c7-41d254142407 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.858549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb54a4-332c-4bcb-8a31-051c74b323ae tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.864779 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3805/7562] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:02.866758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d049a33-1524-447f-98c7-41d254142407 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.870943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe952b-4ab9-4c0a-9d63-bfe779f2fe2c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.871920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe952b-4ab9-4c0a-9d63-bfe779f2fe2c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.872448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe952b-4ab9-4c0a-9d63-bfe779f2fe2c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.872988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe952b-4ab9-4c0a-9d63-bfe779f2fe2c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.874056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe952b-4ab9-4c0a-9d63-bfe779f2fe2c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.877667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe952b-4ab9-4c0a-9d63-bfe779f2fe2c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.880146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d049a33-1524-447f-98c7-41d254142407 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.885899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c58db-d8dd-4fca-90b3-df994ca75bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:02.886756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c58db-d8dd-4fca-90b3-df994ca75bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:02.887049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c58db-d8dd-4fca-90b3-df994ca75bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:02.887713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c58db-d8dd-4fca-90b3-df994ca75bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:02.889000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c58db-d8dd-4fca-90b3-df994ca75bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:02.893127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c58db-d8dd-4fca-90b3-df994ca75bc7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:02.907739 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3758/7563] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/users => generated 413 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:02.912169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe952b-4ab9-4c0a-9d63-bfe779f2fe2c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.933658 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3806/7564] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:02.937478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c58db-d8dd-4fca-90b3-df994ca75bc7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:02.958884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe952b-4ab9-4c0a-9d63-bfe779f2fe2c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:02.986568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:03.077691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c58db-d8dd-4fca-90b3-df994ca75bc7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.085271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0908e4c-c1d9-4dfd-9e40-8bd6922e4566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.092491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0908e4c-c1d9-4dfd-9e40-8bd6922e4566 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.092924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0908e4c-c1d9-4dfd-9e40-8bd6922e4566 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.093332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0908e4c-c1d9-4dfd-9e40-8bd6922e4566 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.094126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0908e4c-c1d9-4dfd-9e40-8bd6922e4566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.097026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0908e4c-c1d9-4dfd-9e40-8bd6922e4566 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.132602 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3807/7565] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:03.136485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0908e4c-c1d9-4dfd-9e40-8bd6922e4566 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.150159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0908e4c-c1d9-4dfd-9e40-8bd6922e4566 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.150540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438e897-9269-4323-bbd3-89f47783fbd7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.151460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438e897-9269-4323-bbd3-89f47783fbd7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.152022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438e897-9269-4323-bbd3-89f47783fbd7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.152556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438e897-9269-4323-bbd3-89f47783fbd7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.153875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438e897-9269-4323-bbd3-89f47783fbd7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.156348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438e897-9269-4323-bbd3-89f47783fbd7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.160932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a77fa-96e9-4d94-a74e-23e92239ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.161729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a77fa-96e9-4d94-a74e-23e92239ca12 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.162355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a77fa-96e9-4d94-a74e-23e92239ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.163488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a77fa-96e9-4d94-a74e-23e92239ca12 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.164392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a77fa-96e9-4d94-a74e-23e92239ca12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.166438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a77fa-96e9-4d94-a74e-23e92239ca12 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.178761 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3759/7566] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:02 2022] POST /identity/v3/roles => generated 243 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:03.182461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438e897-9269-4323-bbd3-89f47783fbd7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.190608 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3808/7567] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:03 2022] GET /identity/v3/roles => generated 1654 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:03.191707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a77fa-96e9-4d94-a74e-23e92239ca12 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.195628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438e897-9269-4323-bbd3-89f47783fbd7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.209792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7af98a-3e01-4aed-a2b4-3bebc3d26c79 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.210911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7af98a-3e01-4aed-a2b4-3bebc3d26c79 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.211439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7af98a-3e01-4aed-a2b4-3bebc3d26c79 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.211964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7af98a-3e01-4aed-a2b4-3bebc3d26c79 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.212975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7af98a-3e01-4aed-a2b4-3bebc3d26c79 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.214373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a77fa-96e9-4d94-a74e-23e92239ca12 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.216143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7af98a-3e01-4aed-a2b4-3bebc3d26c79 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.221313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db072190-afe4-4cb0-b2c2-eabfdb33924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.222745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db072190-afe4-4cb0-b2c2-eabfdb33924c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.223003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db072190-afe4-4cb0-b2c2-eabfdb33924c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.223554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db072190-afe4-4cb0-b2c2-eabfdb33924c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.224861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db072190-afe4-4cb0-b2c2-eabfdb33924c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.228977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db072190-afe4-4cb0-b2c2-eabfdb33924c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.243727 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3760/7568] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:03 2022] POST /identity/v3/roles => generated 247 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:03.248217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7af98a-3e01-4aed-a2b4-3bebc3d26c79 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.256167 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3809/7569] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:03 2022] GET /identity/v3/roles => generated 1892 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:03.257459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db072190-afe4-4cb0-b2c2-eabfdb33924c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.259517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:03.268873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7af98a-3e01-4aed-a2b4-3bebc3d26c79 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.276017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c23f9-8227-44b0-9d3c-33c061bc4222 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.276718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c23f9-8227-44b0-9d3c-33c061bc4222 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.277154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c23f9-8227-44b0-9d3c-33c061bc4222 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.277261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db072190-afe4-4cb0-b2c2-eabfdb33924c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.277468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c23f9-8227-44b0-9d3c-33c061bc4222 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/547b61c84e2447cba19f551ce00f22a9/users/e1d4542c46a24166a67390ac0e021e1b/roles/6ca35f4f6c194dad87659406664ec3e1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.282783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e62212-cf88-454a-a136-c002288f66cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.285888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62212-cf88-454a-a136-c002288f66cf admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.287189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62212-cf88-454a-a136-c002288f66cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.288390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62212-cf88-454a-a136-c002288f66cf admin admin] PATH_INFO: `/v3/projects/a497030d122a4283a642466364aaecfa/users/2108aac7615e4832bc4351fc989d2233/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.307471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c23f9-8227-44b0-9d3c-33c061bc4222 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=547b61c84e2447cba19f551ce00f22a9, user_id=e1d4542c46a24166a67390ac0e021e1b, role_id=6ca35f4f6c194dad87659406664ec3e1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.310364 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c23f9-8227-44b0-9d3c-33c061bc4222 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.316005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e62212-cf88-454a-a136-c002288f66cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a497030d122a4283a642466364aaecfa, user_id=2108aac7615e4832bc4351fc989d2233, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.319945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e62212-cf88-454a-a136-c002288f66cf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.325728 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3761/7570] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:03 2022] PUT /identity/v3/projects/547b61c84e2447cba19f551ce00f22a9/users/e1d4542c46a24166a67390ac0e021e1b/roles/6ca35f4f6c194dad87659406664ec3e1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:03.329974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c23f9-8227-44b0-9d3c-33c061bc4222 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.338183 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3810/7571] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:03 2022] PUT /identity/v3/projects/a497030d122a4283a642466364aaecfa/users/2108aac7615e4832bc4351fc989d2233/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:03.351190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4db9e-eefe-4361-834f-b7e7c38977d9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.351595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4db9e-eefe-4361-834f-b7e7c38977d9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.351871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4db9e-eefe-4361-834f-b7e7c38977d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.382321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-32a4db9e-eefe-4361-834f-b7e7c38977d9 None None] MFA Rules not processed for user `2108aac7615e4832bc4351fc989d2233`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:03.383610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-32a4db9e-eefe-4361-834f-b7e7c38977d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:03.407806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c23f9-8227-44b0-9d3c-33c061bc4222 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.518709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df9648-5c7b-4c27-a936-33a9b2809344 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.519770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df9648-5c7b-4c27-a936-33a9b2809344 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.520128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df9648-5c7b-4c27-a936-33a9b2809344 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.520478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df9648-5c7b-4c27-a936-33a9b2809344 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/547b61c84e2447cba19f551ce00f22a9/users/e1d4542c46a24166a67390ac0e021e1b/roles/72203d971b74467cbfc9a0217871faa6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.523947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df9648-5c7b-4c27-a936-33a9b2809344 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=547b61c84e2447cba19f551ce00f22a9, user_id=e1d4542c46a24166a67390ac0e021e1b, role_id=72203d971b74467cbfc9a0217871faa6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.525299 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3811/7572] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:03.529669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4db9e-eefe-4361-834f-b7e7c38977d9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.530612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df9648-5c7b-4c27-a936-33a9b2809344 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.566922 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3762/7573] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:03 2022] PUT /identity/v3/projects/547b61c84e2447cba19f551ce00f22a9/users/e1d4542c46a24166a67390ac0e021e1b/roles/72203d971b74467cbfc9a0217871faa6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:03.568180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df9648-5c7b-4c27-a936-33a9b2809344 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.665887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df9648-5c7b-4c27-a936-33a9b2809344 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.671948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d6a2-4fa9-4391-afb4-34275ee54dc0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.672878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d6a2-4fa9-4391-afb4-34275ee54dc0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.673531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d6a2-4fa9-4391-afb4-34275ee54dc0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.674105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d6a2-4fa9-4391-afb4-34275ee54dc0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.675882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4d6a2-4fa9-4391-afb4-34275ee54dc0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.677975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4d6a2-4fa9-4391-afb4-34275ee54dc0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.688790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4db9e-eefe-4361-834f-b7e7c38977d9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:03.719520 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3763/7574] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:03 2022] GET /identity/v3/users => generated 7781 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:03.724443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:03.727028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feb5b7-4998-4eca-9406-4f10222c9cd8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.727977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feb5b7-4998-4eca-9406-4f10222c9cd8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.728450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feb5b7-4998-4eca-9406-4f10222c9cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.798017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:03.816762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-87feb5b7-4998-4eca-9406-4f10222c9cd8 None None] MFA Rules not processed for user `e1d4542c46a24166a67390ac0e021e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:03.817714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-87feb5b7-4998-4eca-9406-4f10222c9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:03.843574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d006b2a-6bf7-45e9-af37-fdc955ddc6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:03.844283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d006b2a-6bf7-45e9-af37-fdc955ddc6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:03.844574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d006b2a-6bf7-45e9-af37-fdc955ddc6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:03.844855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d006b2a-6bf7-45e9-af37-fdc955ddc6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:03.845623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d006b2a-6bf7-45e9-af37-fdc955ddc6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:03.848101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d006b2a-6bf7-45e9-af37-fdc955ddc6d1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:03.914012 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3812/7575] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:03 2022] POST /identity/v3/projects => generated 385 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:03.914800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d006b2a-6bf7-45e9-af37-fdc955ddc6d1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:03.989519 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3764/7576] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:04.008003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ff93b-dd96-4146-af50-3d34d66784c8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.008264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ff93b-dd96-4146-af50-3d34d66784c8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.008520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ff93b-dd96-4146-af50-3d34d66784c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.045154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4c1ff93b-dd96-4146-af50-3d34d66784c8 None None] MFA Rules not processed for user `e1d4542c46a24166a67390ac0e021e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:04.046410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4c1ff93b-dd96-4146-af50-3d34d66784c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:04.076517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d006b2a-6bf7-45e9-af37-fdc955ddc6d1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.097733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63727db-75a8-4350-8ccf-138781e01326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.098620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63727db-75a8-4350-8ccf-138781e01326 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.099021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63727db-75a8-4350-8ccf-138781e01326 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.099404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63727db-75a8-4350-8ccf-138781e01326 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.100524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63727db-75a8-4350-8ccf-138781e01326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.115084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63727db-75a8-4350-8ccf-138781e01326 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.149572 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3765/7577] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:04.152819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ff93b-dd96-4146-af50-3d34d66784c8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.161912 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3813/7578] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:03 2022] POST /identity/v3/users => generated 299 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:04.165752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63727db-75a8-4350-8ccf-138781e01326 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.175270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ff93b-dd96-4146-af50-3d34d66784c8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.229874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63727db-75a8-4350-8ccf-138781e01326 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.231116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a562e17-07c4-48f9-a1ec-2002ae82c638 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d4542c46a24166a67390ac0e021e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '547b61c84e2447cba19f551ce00f22a9', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-884640523', 'tempest-NotDelegatedRole-1832678263'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.232886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562e17-07c4-48f9-a1ec-2002ae82c638 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.234572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562e17-07c4-48f9-a1ec-2002ae82c638 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.236424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562e17-07c4-48f9-a1ec-2002ae82c638 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.239417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a562e17-07c4-48f9-a1ec-2002ae82c638 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] RBAC: Authorizing `identity:create_trust()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.241966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a562e17-07c4-48f9-a1ec-2002ae82c638 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.242265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4db9f-7834-4026-afba-84f2df485f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.242904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4db9f-7834-4026-afba-84f2df485f0d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.243435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4db9f-7834-4026-afba-84f2df485f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.243720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4db9f-7834-4026-afba-84f2df485f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.245196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4db9f-7834-4026-afba-84f2df485f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.247972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4db9f-7834-4026-afba-84f2df485f0d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.269296 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3814/7579] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:04 2022] GET /identity/v3/roles => generated 1892 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:04.270536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4db9f-7834-4026-afba-84f2df485f0d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.307480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4db9f-7834-4026-afba-84f2df485f0d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.315907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e83ec-e828-4bae-abd4-c10450008138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.317540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e83ec-e828-4bae-abd4-c10450008138 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.317829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e83ec-e828-4bae-abd4-c10450008138 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.318106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e83ec-e828-4bae-abd4-c10450008138 admin admin] PATH_INFO: `/v3/projects/5bdf2108b6f042e3856a27d63a9a38e7/users/2cb5c52002894f34a96c8b25409fb978/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.342338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e83ec-e828-4bae-abd4-c10450008138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdf2108b6f042e3856a27d63a9a38e7, user_id=2cb5c52002894f34a96c8b25409fb978, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.345890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e83ec-e828-4bae-abd4-c10450008138 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.378044 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3815/7580] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:04 2022] PUT /identity/v3/projects/5bdf2108b6f042e3856a27d63a9a38e7/users/2cb5c52002894f34a96c8b25409fb978/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:04.391967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e83ec-e828-4bae-abd4-c10450008138 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.512725 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3766/7581] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Aug 29 15:59:04 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:04.518425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a562e17-07c4-48f9-a1ec-2002ae82c638 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.559374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:04.582375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e83ec-e828-4bae-abd4-c10450008138 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.595763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24272d76-464c-42c0-81ea-247cc17f954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.596395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24272d76-464c-42c0-81ea-247cc17f954a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.596676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24272d76-464c-42c0-81ea-247cc17f954a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.596953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24272d76-464c-42c0-81ea-247cc17f954a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.598550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24272d76-464c-42c0-81ea-247cc17f954a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.600808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24272d76-464c-42c0-81ea-247cc17f954a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.606084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:04.644079 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3816/7582] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:04 2022] GET /identity/v3/roles => generated 1892 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:04.649308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24272d76-464c-42c0-81ea-247cc17f954a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.674837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24272d76-464c-42c0-81ea-247cc17f954a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.686555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae5227-941b-4b74-8d3c-73d4d9b5289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.687300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5227-941b-4b74-8d3c-73d4d9b5289c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.687590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5227-941b-4b74-8d3c-73d4d9b5289c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.687869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5227-941b-4b74-8d3c-73d4d9b5289c admin admin] PATH_INFO: `/v3/projects/5bdf2108b6f042e3856a27d63a9a38e7/users/2cb5c52002894f34a96c8b25409fb978/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.692752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae5227-941b-4b74-8d3c-73d4d9b5289c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdf2108b6f042e3856a27d63a9a38e7, user_id=2cb5c52002894f34a96c8b25409fb978, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.698213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae5227-941b-4b74-8d3c-73d4d9b5289c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.707174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a562e17-07c4-48f9-a1ec-2002ae82c638 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:04.727131 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3817/7583] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:04 2022] PUT /identity/v3/projects/5bdf2108b6f042e3856a27d63a9a38e7/users/2cb5c52002894f34a96c8b25409fb978/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:04.737370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1c77-8990-47a1-98f7-81f733f714c1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.737843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1c77-8990-47a1-98f7-81f733f714c1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.738294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1c77-8990-47a1-98f7-81f733f714c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.789294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3b0c1c77-8990-47a1-98f7-81f733f714c1 None None] MFA Rules not processed for user `2cb5c52002894f34a96c8b25409fb978`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:04.790738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3b0c1c77-8990-47a1-98f7-81f733f714c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:04.864325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4bd34-ba64-4d2c-82fa-8d67f34a15fb tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:04.864325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4bd34-ba64-4d2c-82fa-8d67f34a15fb tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:04.864946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4bd34-ba64-4d2c-82fa-8d67f34a15fb tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:04.864946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4bd34-ba64-4d2c-82fa-8d67f34a15fb tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:04.866438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4bd34-ba64-4d2c-82fa-8d67f34a15fb tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:04.867594 n-d-854882-3 devstack@keystone.service[89680]: WARNING py.warnings [None req-b3e4bd34-ba64-4d2c-82fa-8d67f34a15fb tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 15:59:04.867594 n-d-854882-3 devstack@keystone.service[89680]: warnings.warn(msg) Aug 29 15:59:04.867594 n-d-854882-3 devstack@keystone.service[89680]: Aug 29 15:59:04.868533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4bd34-ba64-4d2c-82fa-8d67f34a15fb tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:04.890427 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3767/7584] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Aug 29 15:59:04 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:59:04.891898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4bd34-ba64-4d2c-82fa-8d67f34a15fb tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.932717 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3818/7585] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:04.946817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c1c77-8990-47a1-98f7-81f733f714c1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:04.948752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3b0c1c77-8990-47a1-98f7-81f733f714c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:05.009310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4bd34-ba64-4d2c-82fa-8d67f34a15fb tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.124331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d4542c46a24166a67390ac0e021e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '547b61c84e2447cba19f551ce00f22a9', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-884640523', 'tempest-NotDelegatedRole-1832678263'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.128063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c1c77-8990-47a1-98f7-81f733f714c1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.128387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.129326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.129723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] PATH_INFO: `/v3/OS-TRUST/trusts/6df44e2dff724a31866e9bbc32ed3d02` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.151164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15a2ec-1c45-4f16-9dfd-bd309e084d88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.151820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15a2ec-1c45-4f16-9dfd-bd309e084d88 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.152486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15a2ec-1c45-4f16-9dfd-bd309e084d88 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.152759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15a2ec-1c45-4f16-9dfd-bd309e084d88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.167477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] RBAC: Authorizing `identity:delete_trust(trust_id=6df44e2dff724a31866e9bbc32ed3d02)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.171085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.182006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15a2ec-1c45-4f16-9dfd-bd309e084d88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.186448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15a2ec-1c45-4f16-9dfd-bd309e084d88 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.217789 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3819/7586] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:05.226247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6df44e2dff724a31866e9bbc32ed3d02', 'request_id': 'req-c66a04ae-34f0-4be7-80bb-1e75e9695e30'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:05.226922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6df44e2dff724a31866e9bbc32ed3d02', 'request_id': 'req-c66a04ae-34f0-4be7-80bb-1e75e9695e30'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:05.228230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6df44e2dff724a31866e9bbc32ed3d02', 'request_id': 'req-c66a04ae-34f0-4be7-80bb-1e75e9695e30'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:05.257820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15a2ec-1c45-4f16-9dfd-bd309e084d88 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.284734 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3768/7587] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 15:59:04 2022] DELETE /identity/v3/OS-TRUST/trusts/6df44e2dff724a31866e9bbc32ed3d02 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:05.291153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15a2ec-1c45-4f16-9dfd-bd309e084d88 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.296053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebedc2-c05a-488c-9cb8-ea83e8a048bf tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d4542c46a24166a67390ac0e021e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '547b61c84e2447cba19f551ce00f22a9', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-884640523', 'tempest-NotDelegatedRole-1832678263'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.296807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebedc2-c05a-488c-9cb8-ea83e8a048bf tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.297325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebedc2-c05a-488c-9cb8-ea83e8a048bf tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.297738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebedc2-c05a-488c-9cb8-ea83e8a048bf tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] PATH_INFO: `/v3/OS-TRUST/trusts/6df44e2dff724a31866e9bbc32ed3d02` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-29ebedc2-c05a-488c-9cb8-ea83e8a048bf tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Could not find trust: 6df44e2dff724a31866e9bbc32ed3d02.: keystone.exception.TrustNotFound: Could not find trust: 6df44e2dff724a31866e9bbc32ed3d02. Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 29 15:59:05.338933 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6df44e2dff724a31866e9bbc32ed3d02. Aug 29 15:59:05.340235 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:59:05.343870 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3820/7588] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:05 2022] GET /identity/v3/OS-TRUST/trusts/6df44e2dff724a31866e9bbc32ed3d02 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:59:05.344978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.346597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:05.354854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:05.601092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebedc2-c05a-488c-9cb8-ea83e8a048bf tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.605287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-29ebedc2-c05a-488c-9cb8-ea83e8a048bf tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:05.613247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a04ae-34f0-4be7-80bb-1e75e9695e30 tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.628710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:05.637300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:05.639624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:05.639998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/72203d971b74467cbfc9a0217871faa6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:05.644671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=72203d971b74467cbfc9a0217871faa6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:05.648209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:05.734425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role 72203d971b74467cbfc9a0217871faa6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:05.734425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:05.734425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:05.741807 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3769/7589] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:05 2022] DELETE /identity/v3/roles/72203d971b74467cbfc9a0217871faa6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:05.745224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:05.759480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:05.783915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:05.837246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebedc2-c05a-488c-9cb8-ea83e8a048bf tempest-TrustsV3TestJSON-302150950 tempest-user-263199593] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:05.994020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03aa1-20a1-464e-b495-892ed4d0c3f7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:06.006417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.007394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.008840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.009875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/6ca35f4f6c194dad87659406664ec3e1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.012984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6ca35f4f6c194dad87659406664ec3e1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.017049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:06.023077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642de848-005a-481c-98a9-07841a94a7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.024061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de848-005a-481c-98a9-07841a94a7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.024555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de848-005a-481c-98a9-07841a94a7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.025001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de848-005a-481c-98a9-07841a94a7e6 admin admin] PATH_INFO: `/v3/users/2108aac7615e4832bc4351fc989d2233` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.030347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642de848-005a-481c-98a9-07841a94a7e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2108aac7615e4832bc4351fc989d2233)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.034771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642de848-005a-481c-98a9-07841a94a7e6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:06.110192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role 6ca35f4f6c194dad87659406664ec3e1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:06.115201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.117762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.128723 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3770/7590] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:05 2022] DELETE /identity/v3/roles/6ca35f4f6c194dad87659406664ec3e1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:06.134281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:06.141273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:06.202204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-642de848-005a-481c-98a9-07841a94a7e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2108aac7615e4832bc4351fc989d2233'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.203746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-642de848-005a-481c-98a9-07841a94a7e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2108aac7615e4832bc4351fc989d2233'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.227148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-642de848-005a-481c-98a9-07841a94a7e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2108aac7615e4832bc4351fc989d2233'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.227850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-642de848-005a-481c-98a9-07841a94a7e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2108aac7615e4832bc4351fc989d2233'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.243960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-642de848-005a-481c-98a9-07841a94a7e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2108aac7615e4832bc4351fc989d2233'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.281082 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3821/7591] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:05 2022] DELETE /identity/v3/users/2108aac7615e4832bc4351fc989d2233 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:06.283609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9da107-17bc-43cc-96b3-8034c77ce859 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.283609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9da107-17bc-43cc-96b3-8034c77ce859 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.283919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9da107-17bc-43cc-96b3-8034c77ce859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.297349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:06.340412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3b9da107-17bc-43cc-96b3-8034c77ce859 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:06.343152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3b9da107-17bc-43cc-96b3-8034c77ce859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:06.398202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9886af5-3db3-4fbf-8414-46c3d23ae3ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:06.489565 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3822/7592] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:06.500971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9da107-17bc-43cc-96b3-8034c77ce859 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:06.506859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3b9da107-17bc-43cc-96b3-8034c77ce859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:06.547965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:06.562175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.562975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.563262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.563563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users/e1d4542c46a24166a67390ac0e021e1b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.564932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e1d4542c46a24166a67390ac0e021e1b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.567026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:06.623480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9da107-17bc-43cc-96b3-8034c77ce859 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:06.632334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8b070-0c8b-43bf-aa54-e8c1021d38df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.635090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8b070-0c8b-43bf-aa54-e8c1021d38df service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.635405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8b070-0c8b-43bf-aa54-e8c1021d38df service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.637000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8b070-0c8b-43bf-aa54-e8c1021d38df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.662179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8b070-0c8b-43bf-aa54-e8c1021d38df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.666351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8b070-0c8b-43bf-aa54-e8c1021d38df service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:06.701500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d4542c46a24166a67390ac0e021e1b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.704783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d4542c46a24166a67390ac0e021e1b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.721119 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3823/7593] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:06.737994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d4542c46a24166a67390ac0e021e1b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.748031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d4542c46a24166a67390ac0e021e1b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.785777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d4542c46a24166a67390ac0e021e1b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:06.800471 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3771/7594] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:06 2022] DELETE /identity/v3/users/e1d4542c46a24166a67390ac0e021e1b => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:06.801726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8b070-0c8b-43bf-aa54-e8c1021d38df service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:06.803530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-22d8b070-0c8b-43bf-aa54-e8c1021d38df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:06.824913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8b070-0c8b-43bf-aa54-e8c1021d38df service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:06.921548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:06.923204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:06.923604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:06.924931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/547b61c84e2447cba19f551ce00f22a9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:06.927645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_project(project_id=547b61c84e2447cba19f551ce00f22a9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:06.945674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:07.050864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547b61c84e2447cba19f551ce00f22a9', 'request_id': 'req-7d8c23a0-3c54-4912-a8de-60dca2db500a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.073250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547b61c84e2447cba19f551ce00f22a9', 'request_id': 'req-7d8c23a0-3c54-4912-a8de-60dca2db500a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.087512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547b61c84e2447cba19f551ce00f22a9', 'request_id': 'req-7d8c23a0-3c54-4912-a8de-60dca2db500a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.106357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] The token cache is being invalidate because project 547b61c84e2447cba19f551ce00f22a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:07.106659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.107869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:07.109972 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3824/7595] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:06 2022] DELETE /identity/v3/projects/547b61c84e2447cba19f551ce00f22a9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:07.115379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:07.117366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:07.145620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7998b-dd61-4e50-ba38-f8f9cb04ad7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:07.238794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbd212-b0a3-4118-bedd-a947b2bee081 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:07.239676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbd212-b0a3-4118-bedd-a947b2bee081 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.240079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbd212-b0a3-4118-bedd-a947b2bee081 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.240938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbd212-b0a3-4118-bedd-a947b2bee081 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.241711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbd212-b0a3-4118-bedd-a947b2bee081 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:07.245820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbd212-b0a3-4118-bedd-a947b2bee081 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:07.251033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:07.297220 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3772/7596] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:59:07 2022] POST /identity/v3/projects => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:07.299752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:07.301402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:07.326869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c23a0-3c54-4912-a8de-60dca2db500a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:07.387984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:07.414536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c84a7-d2b2-45c9-8e42-fa789bb43c85 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:07.415358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c84a7-d2b2-45c9-8e42-fa789bb43c85 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.415738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c84a7-d2b2-45c9-8e42-fa789bb43c85 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.416115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c84a7-d2b2-45c9-8e42-fa789bb43c85 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.416883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c84a7-d2b2-45c9-8e42-fa789bb43c85 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:07.419086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c84a7-d2b2-45c9-8e42-fa789bb43c85 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:07.450733 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3825/7597] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:07 2022] POST /identity/v3/users => generated 413 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:07.453123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbd212-b0a3-4118-bedd-a947b2bee081 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:07.464875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbd212-b0a3-4118-bedd-a947b2bee081 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:07.470350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1540dff-3b3a-4d9d-b460-d2f8ce80866c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:07.471264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1540dff-3b3a-4d9d-b460-d2f8ce80866c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.471816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1540dff-3b3a-4d9d-b460-d2f8ce80866c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.472203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1540dff-3b3a-4d9d-b460-d2f8ce80866c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.472999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1540dff-3b3a-4d9d-b460-d2f8ce80866c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:07.475496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1540dff-3b3a-4d9d-b460-d2f8ce80866c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:07.496387 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3773/7598] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:07 2022] POST /identity/v3/roles => generated 243 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:07.505319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c84a7-d2b2-45c9-8e42-fa789bb43c85 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:07.521129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c84a7-d2b2-45c9-8e42-fa789bb43c85 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:07.527656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc58a3-3777-4e9f-a6fa-e9183f4322ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:07.528475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc58a3-3777-4e9f-a6fa-e9183f4322ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.528891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc58a3-3777-4e9f-a6fa-e9183f4322ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.529970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc58a3-3777-4e9f-a6fa-e9183f4322ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.531161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc58a3-3777-4e9f-a6fa-e9183f4322ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:07.533203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc58a3-3777-4e9f-a6fa-e9183f4322ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:07.558536 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3826/7599] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:07 2022] POST /identity/v3/roles => generated 247 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:07.562832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1540dff-3b3a-4d9d-b460-d2f8ce80866c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:07.584718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1540dff-3b3a-4d9d-b460-d2f8ce80866c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:07.597425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87c13d-0dcb-4d36-843c-ffd255613eaf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:07.598663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87c13d-0dcb-4d36-843c-ffd255613eaf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.599078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87c13d-0dcb-4d36-843c-ffd255613eaf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.599458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87c13d-0dcb-4d36-843c-ffd255613eaf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/fe9c1c6775394f048dc2f0cf245b5ee4/users/12ef9d729c7343c4b6a45da71bc97656/roles/84bf264c5dab4ca89cbf2acae95170fa` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.634432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87c13d-0dcb-4d36-843c-ffd255613eaf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c1c6775394f048dc2f0cf245b5ee4, user_id=12ef9d729c7343c4b6a45da71bc97656, role_id=84bf264c5dab4ca89cbf2acae95170fa)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:07.637628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87c13d-0dcb-4d36-843c-ffd255613eaf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:07.661600 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3774/7600] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:07 2022] PUT /identity/v3/projects/fe9c1c6775394f048dc2f0cf245b5ee4/users/12ef9d729c7343c4b6a45da71bc97656/roles/84bf264c5dab4ca89cbf2acae95170fa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:07.667101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc58a3-3777-4e9f-a6fa-e9183f4322ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:07.683239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc58a3-3777-4e9f-a6fa-e9183f4322ff tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:07.762618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8802c-17b3-4c52-9a79-6deaa57d0d0c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:07.763760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8802c-17b3-4c52-9a79-6deaa57d0d0c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.764621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8802c-17b3-4c52-9a79-6deaa57d0d0c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.765147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8802c-17b3-4c52-9a79-6deaa57d0d0c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/fe9c1c6775394f048dc2f0cf245b5ee4/users/12ef9d729c7343c4b6a45da71bc97656/roles/51f73eca037141d4b7a0802940ee8c7c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.768199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8802c-17b3-4c52-9a79-6deaa57d0d0c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c1c6775394f048dc2f0cf245b5ee4, user_id=12ef9d729c7343c4b6a45da71bc97656, role_id=51f73eca037141d4b7a0802940ee8c7c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:07.777668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8802c-17b3-4c52-9a79-6deaa57d0d0c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:07.800547 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3827/7601] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:07 2022] PUT /identity/v3/projects/fe9c1c6775394f048dc2f0cf245b5ee4/users/12ef9d729c7343c4b6a45da71bc97656/roles/51f73eca037141d4b7a0802940ee8c7c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:07.801930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87c13d-0dcb-4d36-843c-ffd255613eaf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:07.817686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87c13d-0dcb-4d36-843c-ffd255613eaf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:07.968316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e408b-58f3-4ff7-8b3d-db7f4d4cfcd8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:07.969147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e408b-58f3-4ff7-8b3d-db7f4d4cfcd8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:07.969461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e408b-58f3-4ff7-8b3d-db7f4d4cfcd8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:07.970552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e408b-58f3-4ff7-8b3d-db7f4d4cfcd8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:07.970552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e408b-58f3-4ff7-8b3d-db7f4d4cfcd8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:07.972303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e408b-58f3-4ff7-8b3d-db7f4d4cfcd8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:08.037334 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3775/7602] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:07 2022] GET /identity/v3/users => generated 7786 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:08.042196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941500-3d31-49bc-ba7f-34639e6ffdd1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:08.042855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941500-3d31-49bc-ba7f-34639e6ffdd1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:08.043296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941500-3d31-49bc-ba7f-34639e6ffdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:08.117570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-4d941500-3d31-49bc-ba7f-34639e6ffdd1 None None] MFA Rules not processed for user `12ef9d729c7343c4b6a45da71bc97656`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:08.118827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4d941500-3d31-49bc-ba7f-34639e6ffdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:08.293716 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3828/7603] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:08.296994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b1848-31f6-492e-9ac1-df9d4c22caa6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:08.297655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b1848-31f6-492e-9ac1-df9d4c22caa6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:08.298229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b1848-31f6-492e-9ac1-df9d4c22caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:08.316298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941500-3d31-49bc-ba7f-34639e6ffdd1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:08.317756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4d941500-3d31-49bc-ba7f-34639e6ffdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:08.344952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b31b1848-31f6-492e-9ac1-df9d4c22caa6 None None] MFA Rules not processed for user `12ef9d729c7343c4b6a45da71bc97656`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:08.347123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b31b1848-31f6-492e-9ac1-df9d4c22caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:08.376124 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3776/7604] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:08.380155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b1848-31f6-492e-9ac1-df9d4c22caa6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:08.395676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b1848-31f6-492e-9ac1-df9d4c22caa6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:08.401156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:08.405533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38b3fc-ebcb-4691-8e9d-c0a15146d23a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ef9d729c7343c4b6a45da71bc97656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe9c1c6775394f048dc2f0cf245b5ee4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-794773989', 'tempest-NotDelegatedRole-1558204720'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:08.406899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b3fc-ebcb-4691-8e9d-c0a15146d23a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:08.407410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b3fc-ebcb-4691-8e9d-c0a15146d23a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:08.408119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b3fc-ebcb-4691-8e9d-c0a15146d23a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:08.410195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38b3fc-ebcb-4691-8e9d-c0a15146d23a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] RBAC: Authorizing `identity:create_trust()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:08.414140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38b3fc-ebcb-4691-8e9d-c0a15146d23a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:08.452943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941500-3d31-49bc-ba7f-34639e6ffdd1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:08.458421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:08.459061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:08.459377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:08.459651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] PATH_INFO: `/v3/projects/a497030d122a4283a642466364aaecfa` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:08.460943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a497030d122a4283a642466364aaecfa)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:08.463841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:08.562736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a497030d122a4283a642466364aaecfa', 'request_id': 'req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.578450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a497030d122a4283a642466364aaecfa', 'request_id': 'req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.590288 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3777/7605] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Aug 29 15:59:08 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:08.594132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38b3fc-ebcb-4691-8e9d-c0a15146d23a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:08.605760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a497030d122a4283a642466364aaecfa', 'request_id': 'req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.618023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38b3fc-ebcb-4691-8e9d-c0a15146d23a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:08.631847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] The token cache is being invalidate because project a497030d122a4283a642466364aaecfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:08.632480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.634208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.638165 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3829/7606] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:08 2022] DELETE /identity/v3/projects/a497030d122a4283a642466364aaecfa => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:08.642426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:08.648807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:08.669504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:08.722991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c7557-5043-4d7b-a09e-ea726a6bf346 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ef9d729c7343c4b6a45da71bc97656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe9c1c6775394f048dc2f0cf245b5ee4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-794773989', 'tempest-NotDelegatedRole-1558204720'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:08.723638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c7557-5043-4d7b-a09e-ea726a6bf346 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:08.724014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c7557-5043-4d7b-a09e-ea726a6bf346 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:08.724296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c7557-5043-4d7b-a09e-ea726a6bf346 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:08.725727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c7557-5043-4d7b-a09e-ea726a6bf346 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:08.727234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c7557-5043-4d7b-a09e-ea726a6bf346 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:08.737437 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3778/7607] 10.222.0.16 () {58 vars in 1252 bytes} [Mon Aug 29 15:59:08 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=12ef9d729c7343c4b6a45da71bc97656 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:08.740461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c7557-5043-4d7b-a09e-ea726a6bf346 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:08.744318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0c8c7557-5043-4d7b-a09e-ea726a6bf346 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:08.776595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f6ce1-a3c1-4a1d-8cbb-1dca6f3e766e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:08.783795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:08.784522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:08.784810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:08.785213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] PATH_INFO: `/v3/users/2cb5c52002894f34a96c8b25409fb978` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:08.786349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c7557-5043-4d7b-a09e-ea726a6bf346 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:08.786546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb5c52002894f34a96c8b25409fb978)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:08.790905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:08.795412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ef9d729c7343c4b6a45da71bc97656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe9c1c6775394f048dc2f0cf245b5ee4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-794773989', 'tempest-NotDelegatedRole-1558204720'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:08.796545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:08.796993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:08.797488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] PATH_INFO: `/v3/OS-TRUST/trusts/8f0de6392a9340c5802bd67d50206bfa` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:08.805312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] RBAC: Authorizing `identity:delete_trust(trust_id=8f0de6392a9340c5802bd67d50206bfa)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:08.807559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:08.830028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8f0de6392a9340c5802bd67d50206bfa', 'request_id': 'req-420f2de2-b522-488f-b9a1-e991468a486a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.831855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8f0de6392a9340c5802bd67d50206bfa', 'request_id': 'req-420f2de2-b522-488f-b9a1-e991468a486a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.832984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8f0de6392a9340c5802bd67d50206bfa', 'request_id': 'req-420f2de2-b522-488f-b9a1-e991468a486a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.853104 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3779/7608] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 15:59:08 2022] DELETE /identity/v3/OS-TRUST/trusts/8f0de6392a9340c5802bd67d50206bfa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:08.857635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:08.859388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:08.867521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb5c52002894f34a96c8b25409fb978'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.868193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb5c52002894f34a96c8b25409fb978'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.874107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f2de2-b522-488f-b9a1-e991468a486a tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:08.880005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a4e88-c356-495d-b0e7-a314a876e534 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ef9d729c7343c4b6a45da71bc97656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe9c1c6775394f048dc2f0cf245b5ee4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-794773989', 'tempest-NotDelegatedRole-1558204720'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:08.881225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a4e88-c356-495d-b0e7-a314a876e534 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:08.882139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a4e88-c356-495d-b0e7-a314a876e534 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:08.883031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a4e88-c356-495d-b0e7-a314a876e534 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] PATH_INFO: `/v3/OS-TRUST/trusts/8f0de6392a9340c5802bd67d50206bfa` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-e47a4e88-c356-495d-b0e7-a314a876e534 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Could not find trust: 8f0de6392a9340c5802bd67d50206bfa.: keystone.exception.TrustNotFound: Could not find trust: 8f0de6392a9340c5802bd67d50206bfa. Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 29 15:59:08.898683 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8f0de6392a9340c5802bd67d50206bfa. Aug 29 15:59:08.899781 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:08.906145 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3780/7609] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:08 2022] GET /identity/v3/OS-TRUST/trusts/8f0de6392a9340c5802bd67d50206bfa => generated 111 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 15:59:08.907423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a4e88-c356-495d-b0e7-a314a876e534 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:08.910899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e47a4e88-c356-495d-b0e7-a314a876e534 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:08.915284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb5c52002894f34a96c8b25409fb978'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.916000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb5c52002894f34a96c8b25409fb978'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.919915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:08.938319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb5c52002894f34a96c8b25409fb978'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:08.967164 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3830/7610] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:08 2022] DELETE /identity/v3/users/2cb5c52002894f34a96c8b25409fb978 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:09.108589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a4e88-c356-495d-b0e7-a314a876e534 tempest-TrustsV3TestJSON-68564731 tempest-user-431712863] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:09.263804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:09.266754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:09.267455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:09.267751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/51f73eca037141d4b7a0802940ee8c7c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:09.272723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=51f73eca037141d4b7a0802940ee8c7c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:09.275472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:09.312671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:09.317755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:09.339923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:09.369349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role 51f73eca037141d4b7a0802940ee8c7c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:09.369789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.371256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.383551 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3781/7611] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:08 2022] DELETE /identity/v3/roles/51f73eca037141d4b7a0802940ee8c7c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:09.384816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:09.388174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:09.500443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a80b75-f8a0-4ee0-989d-cd99ae43c325 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:09.506159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:09.507749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:09.508100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:09.508446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/84bf264c5dab4ca89cbf2acae95170fa` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:09.510142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=84bf264c5dab4ca89cbf2acae95170fa)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:09.512162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:09.532881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7f299-74c5-42e5-bbf8-b58213c95993 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:09.583909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role 84bf264c5dab4ca89cbf2acae95170fa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:09.584604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.586023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.592848 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3782/7612] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:09 2022] DELETE /identity/v3/roles/84bf264c5dab4ca89cbf2acae95170fa => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:09.596663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:09.601009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:09.653802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c13376-6958-460c-a2ee-619b592669c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:09.654409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c13376-6958-460c-a2ee-619b592669c1 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:09.654741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c13376-6958-460c-a2ee-619b592669c1 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:09.655023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c13376-6958-460c-a2ee-619b592669c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:09.657327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-16c13376-6958-460c-a2ee-619b592669c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:09.676454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c13376-6958-460c-a2ee-619b592669c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:09.683912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c13376-6958-460c-a2ee-619b592669c1 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:09.706353 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3831/7613] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:09.750262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a89df-8a60-4247-aefd-846be9f2cd78 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:09.758619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:09.760127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:09.760575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:09.761044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users/12ef9d729c7343c4b6a45da71bc97656` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:09.762453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_user(user_id=12ef9d729c7343c4b6a45da71bc97656)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:09.765619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:09.865098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ef9d729c7343c4b6a45da71bc97656'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.868489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ef9d729c7343c4b6a45da71bc97656'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.890097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=12,keystone:SELECT=88 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:09.892914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ef9d729c7343c4b6a45da71bc97656'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.905166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ef9d729c7343c4b6a45da71bc97656'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.918016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ef9d729c7343c4b6a45da71bc97656'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:09.932630 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3783/7614] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:09 2022] DELETE /identity/v3/users/12ef9d729c7343c4b6a45da71bc97656 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:09.936941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c13376-6958-460c-a2ee-619b592669c1 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:09.951409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c13376-6958-460c-a2ee-619b592669c1 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.094916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.096132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.096619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.097136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/fe9c1c6775394f048dc2f0cf245b5ee4` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.098537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fe9c1c6775394f048dc2f0cf245b5ee4)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.101860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.125980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.128342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.141966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:10.224300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9c1c6775394f048dc2f0cf245b5ee4', 'request_id': 'req-62529a9b-9378-4c99-a593-e03b0a6bc000'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.237552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9c1c6775394f048dc2f0cf245b5ee4', 'request_id': 'req-62529a9b-9378-4c99-a593-e03b0a6bc000'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.256634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9c1c6775394f048dc2f0cf245b5ee4', 'request_id': 'req-62529a9b-9378-4c99-a593-e03b0a6bc000'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.279317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d18a4e-4b48-4776-b21a-332e8b282120 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.286993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] The token cache is being invalidate because project fe9c1c6775394f048dc2f0cf245b5ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:10.288175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.289407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.294287 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3832/7615] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:09 2022] DELETE /identity/v3/projects/fe9c1c6775394f048dc2f0cf245b5ee4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:10.299772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.301897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.376857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.377557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.377826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.378061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62529a9b-9378-4c99-a593-e03b0a6bc000 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.378505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] PATH_INFO: `/v3/projects/5bdf2108b6f042e3856a27d63a9a38e7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.379273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bdf2108b6f042e3856a27d63a9a38e7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.382171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.384526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d3860-d9ac-4ef2-b57a-b597e00a3166 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.385145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d3860-d9ac-4ef2-b57a-b597e00a3166 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.393552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d3860-d9ac-4ef2-b57a-b597e00a3166 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.393979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d3860-d9ac-4ef2-b57a-b597e00a3166 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.394675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d3860-d9ac-4ef2-b57a-b597e00a3166 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.397535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d3860-d9ac-4ef2-b57a-b597e00a3166 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.457996 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3833/7616] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/projects => generated 328 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:10.461845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d3860-d9ac-4ef2-b57a-b597e00a3166 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.483249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bdf2108b6f042e3856a27d63a9a38e7', 'request_id': 'req-03b11374-f5e6-49f0-8290-1b21c88bb566'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.499641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bdf2108b6f042e3856a27d63a9a38e7', 'request_id': 'req-03b11374-f5e6-49f0-8290-1b21c88bb566'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.517240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bdf2108b6f042e3856a27d63a9a38e7', 'request_id': 'req-03b11374-f5e6-49f0-8290-1b21c88bb566'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.541093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] The token cache is being invalidate because project 5bdf2108b6f042e3856a27d63a9a38e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:10.541650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.543584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-03b11374-f5e6-49f0-8290-1b21c88bb566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:10.547287 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3784/7617] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:10 2022] DELETE /identity/v3/projects/5bdf2108b6f042e3856a27d63a9a38e7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:10.551970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a3cc2-bdb5-41e1-88ab-3a13894911e3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.552357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a3cc2-bdb5-41e1-88ab-3a13894911e3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.552732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a3cc2-bdb5-41e1-88ab-3a13894911e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.574856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-204a3cc2-bdb5-41e1-88ab-3a13894911e3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:10.576308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-204a3cc2-bdb5-41e1-88ab-3a13894911e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.589906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:10.625364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d3860-d9ac-4ef2-b57a-b597e00a3166 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.633840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1c368-7de3-454a-8980-97f90b346539 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.634615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1c368-7de3-454a-8980-97f90b346539 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.635051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1c368-7de3-454a-8980-97f90b346539 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.635449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1c368-7de3-454a-8980-97f90b346539 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.636236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1c368-7de3-454a-8980-97f90b346539 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.639606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1c368-7de3-454a-8980-97f90b346539 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.669436 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3834/7618] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/users => generated 413 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:10.673234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1c368-7de3-454a-8980-97f90b346539 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.675452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-42a1c368-7de3-454a-8980-97f90b346539 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.677536 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3785/7619] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:10.687261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84424-25ae-48a9-b359-b99e570f3f38 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.688003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84424-25ae-48a9-b359-b99e570f3f38 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.688443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84424-25ae-48a9-b359-b99e570f3f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.701882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1c368-7de3-454a-8980-97f90b346539 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.708562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9ea5-b8f8-461f-9845-182a0627a32e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.709406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9ea5-b8f8-461f-9845-182a0627a32e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.709823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9ea5-b8f8-461f-9845-182a0627a32e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.710502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9ea5-b8f8-461f-9845-182a0627a32e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.711283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac9ea5-b8f8-461f-9845-182a0627a32e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.716243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-48e84424-25ae-48a9-b359-b99e570f3f38 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:10.716792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac9ea5-b8f8-461f-9845-182a0627a32e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.717987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-48e84424-25ae-48a9-b359-b99e570f3f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.728570 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3786/7620] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:10.732910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84424-25ae-48a9-b359-b99e570f3f38 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.743482 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3835/7621] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/roles => generated 244 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:10.743681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84424-25ae-48a9-b359-b99e570f3f38 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.747220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9ea5-b8f8-461f-9845-182a0627a32e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.749019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b4b64-54f7-4666-ae40-b88f4de648f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.749759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b4b64-54f7-4666-ae40-b88f4de648f8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.750113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b4b64-54f7-4666-ae40-b88f4de648f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.750471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b4b64-54f7-4666-ae40-b88f4de648f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.751213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b4b64-54f7-4666-ae40-b88f4de648f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:10.751590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b4b64-54f7-4666-ae40-b88f4de648f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.753469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b4b64-54f7-4666-ae40-b88f4de648f8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.759674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9ea5-b8f8-461f-9845-182a0627a32e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.764861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172df15-9609-41b2-99bc-a4c8192ca38c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.765748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172df15-9609-41b2-99bc-a4c8192ca38c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.766091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172df15-9609-41b2-99bc-a4c8192ca38c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.766287 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3787/7622] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:59:10.766437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172df15-9609-41b2-99bc-a4c8192ca38c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.767261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172df15-9609-41b2-99bc-a4c8192ca38c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.769050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172df15-9609-41b2-99bc-a4c8192ca38c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.770822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b4b64-54f7-4666-ae40-b88f4de648f8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.773536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:10.783117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b4b64-54f7-4666-ae40-b88f4de648f8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.790769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359790e-1321-46cc-9c46-cd36750b8e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.792294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359790e-1321-46cc-9c46-cd36750b8e5f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.792770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359790e-1321-46cc-9c46-cd36750b8e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.793296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359790e-1321-46cc-9c46-cd36750b8e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.794047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359790e-1321-46cc-9c46-cd36750b8e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.798823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359790e-1321-46cc-9c46-cd36750b8e5f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.805483 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3836/7623] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/roles => generated 247 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:10.814334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172df15-9609-41b2-99bc-a4c8192ca38c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.840488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172df15-9609-41b2-99bc-a4c8192ca38c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:10.848554 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3788/7624] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:10.863340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359790e-1321-46cc-9c46-cd36750b8e5f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.864057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5dd86-1038-4dd8-817d-c16bb0dc354a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:10.864759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5dd86-1038-4dd8-817d-c16bb0dc354a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:10.865061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5dd86-1038-4dd8-817d-c16bb0dc354a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:10.865334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5dd86-1038-4dd8-817d-c16bb0dc354a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/57ceb6ef72d44a6f939736d54261c4f3/users/cec778544e154af895ba33acde39a114/roles/07a0d187063e40bcb64de5418e539a90` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:10.866312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c359790e-1321-46cc-9c46-cd36750b8e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:10.886927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5dd86-1038-4dd8-817d-c16bb0dc354a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=57ceb6ef72d44a6f939736d54261c4f3, user_id=cec778544e154af895ba33acde39a114, role_id=07a0d187063e40bcb64de5418e539a90)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:10.896193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5dd86-1038-4dd8-817d-c16bb0dc354a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:10.934096 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3837/7625] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:10 2022] PUT /identity/v3/projects/57ceb6ef72d44a6f939736d54261c4f3/users/cec778544e154af895ba33acde39a114/roles/07a0d187063e40bcb64de5418e539a90 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:10.934096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5dd86-1038-4dd8-817d-c16bb0dc354a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:10.979912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359790e-1321-46cc-9c46-cd36750b8e5f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.046194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5dd86-1038-4dd8-817d-c16bb0dc354a tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.052936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56994d-34e4-4943-9746-4f9aa7e9ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.053681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56994d-34e4-4943-9746-4f9aa7e9ea5c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.054033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56994d-34e4-4943-9746-4f9aa7e9ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.054378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56994d-34e4-4943-9746-4f9aa7e9ea5c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.055084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56994d-34e4-4943-9746-4f9aa7e9ea5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.057615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56994d-34e4-4943-9746-4f9aa7e9ea5c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.094098 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3838/7626] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:10 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:11.097827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56994d-34e4-4943-9746-4f9aa7e9ea5c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:11.098178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.099273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.099762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.100720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] PATH_INFO: `/v3/users/9b95cef51ea04d9b886a7c29791ec255` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.101983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b95cef51ea04d9b886a7c29791ec255)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.104725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.135187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:11.168774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b95cef51ea04d9b886a7c29791ec255'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:11.169589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b95cef51ea04d9b886a7c29791ec255'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:11.182875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b95cef51ea04d9b886a7c29791ec255'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:11.187702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56994d-34e4-4943-9746-4f9aa7e9ea5c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.191643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b95cef51ea04d9b886a7c29791ec255'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:11.196365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d28c47-737d-4536-95ec-88f7a2fef683 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.197297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d28c47-737d-4536-95ec-88f7a2fef683 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.197624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d28c47-737d-4536-95ec-88f7a2fef683 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.197908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d28c47-737d-4536-95ec-88f7a2fef683 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/57ceb6ef72d44a6f939736d54261c4f3/users/cec778544e154af895ba33acde39a114/roles/3c06472e09c140d49ebc8ee3fd0bbeb0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.200769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d28c47-737d-4536-95ec-88f7a2fef683 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=57ceb6ef72d44a6f939736d54261c4f3, user_id=cec778544e154af895ba33acde39a114, role_id=3c06472e09c140d49ebc8ee3fd0bbeb0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.202531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b95cef51ea04d9b886a7c29791ec255'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:11.203632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d28c47-737d-4536-95ec-88f7a2fef683 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.210880 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3789/7627] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:10 2022] DELETE /identity/v3/users/9b95cef51ea04d9b886a7c29791ec255 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:11.211893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:11.213378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:11.221281 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3839/7628] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:11 2022] PUT /identity/v3/projects/57ceb6ef72d44a6f939736d54261c4f3/users/cec778544e154af895ba33acde39a114/roles/3c06472e09c140d49ebc8ee3fd0bbeb0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:11.225502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e150-ba3a-46e1-97ab-c9903301e4a0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.225502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e150-ba3a-46e1-97ab-c9903301e4a0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.225502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e150-ba3a-46e1-97ab-c9903301e4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.243552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a867e150-ba3a-46e1-97ab-c9903301e4a0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:11.244600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a867e150-ba3a-46e1-97ab-c9903301e4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:11.289049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7aa07-5866-413d-9265-affa32005c2e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.306652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:11.321644 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3840/7629] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:11.322851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867e150-ba3a-46e1-97ab-c9903301e4a0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:11.324226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a867e150-ba3a-46e1-97ab-c9903301e4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:11.370258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db9328-c496-4b7c-91a7-8e2a8b8074a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.370987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db9328-c496-4b7c-91a7-8e2a8b8074a5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.371911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db9328-c496-4b7c-91a7-8e2a8b8074a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.372108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db9328-c496-4b7c-91a7-8e2a8b8074a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.374975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db9328-c496-4b7c-91a7-8e2a8b8074a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.377341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db9328-c496-4b7c-91a7-8e2a8b8074a5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.391798 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3790/7630] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:11 2022] GET /identity/v3/roles => generated 1893 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:11.392757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db9328-c496-4b7c-91a7-8e2a8b8074a5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:11.395666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d1db9328-c496-4b7c-91a7-8e2a8b8074a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:11.405272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867e150-ba3a-46e1-97ab-c9903301e4a0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.416082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece84580-634e-49a6-9bed-b92b39cae981 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.416716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece84580-634e-49a6-9bed-b92b39cae981 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.417011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece84580-634e-49a6-9bed-b92b39cae981 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.417298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece84580-634e-49a6-9bed-b92b39cae981 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.418569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece84580-634e-49a6-9bed-b92b39cae981 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.426778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece84580-634e-49a6-9bed-b92b39cae981 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.486762 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3841/7631] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:11 2022] GET /identity/v3/users => generated 7492 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:11.487918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:11.489116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece84580-634e-49a6-9bed-b92b39cae981 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:11.515645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece84580-634e-49a6-9bed-b92b39cae981 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.521675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47256860-59b4-4acb-9c67-43c61b6074f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.522428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256860-59b4-4acb-9c67-43c61b6074f8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.522672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256860-59b4-4acb-9c67-43c61b6074f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.523044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256860-59b4-4acb-9c67-43c61b6074f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.524049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db9328-c496-4b7c-91a7-8e2a8b8074a5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.524148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47256860-59b4-4acb-9c67-43c61b6074f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.525698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47256860-59b4-4acb-9c67-43c61b6074f8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.545564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78142a7b-fda6-4f4b-9e0c-e3f7039c6d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.546176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142a7b-fda6-4f4b-9e0c-e3f7039c6d94 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.547092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142a7b-fda6-4f4b-9e0c-e3f7039c6d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.547927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142a7b-fda6-4f4b-9e0c-e3f7039c6d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.562317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78142a7b-fda6-4f4b-9e0c-e3f7039c6d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.563889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78142a7b-fda6-4f4b-9e0c-e3f7039c6d94 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.567233 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3842/7632] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:11 2022] GET /identity/v3/roles => generated 1893 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:11.567233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8402b-5abc-4726-8b35-3bc9ad58a354 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.567233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8402b-5abc-4726-8b35-3bc9ad58a354 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.567233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8402b-5abc-4726-8b35-3bc9ad58a354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.575835 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3791/7633] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:11.576659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78142a7b-fda6-4f4b-9e0c-e3f7039c6d94 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:11.586973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78142a7b-fda6-4f4b-9e0c-e3f7039c6d94 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.602376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f861d9-8c8c-4e0e-97c7-6ae25758001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.603216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f861d9-8c8c-4e0e-97c7-6ae25758001b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.603568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f861d9-8c8c-4e0e-97c7-6ae25758001b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.603854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f861d9-8c8c-4e0e-97c7-6ae25758001b admin admin] PATH_INFO: `/v3/projects/aa8ed8ec0e0c41548fc7a49065cf591d/users/aa6c328bf2be49c78faddf5c02d3d908/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.639988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f861d9-8c8c-4e0e-97c7-6ae25758001b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8ed8ec0e0c41548fc7a49065cf591d, user_id=aa6c328bf2be49c78faddf5c02d3d908, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.650651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f861d9-8c8c-4e0e-97c7-6ae25758001b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.673653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-88b8402b-5abc-4726-8b35-3bc9ad58a354 None None] MFA Rules not processed for user `cec778544e154af895ba33acde39a114`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:11.676854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-88b8402b-5abc-4726-8b35-3bc9ad58a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:11.679623 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3792/7634] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:11 2022] PUT /identity/v3/projects/aa8ed8ec0e0c41548fc7a49065cf591d/users/aa6c328bf2be49c78faddf5c02d3d908/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:11.690979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc0b2-0639-46b0-af21-f7431d9bc5bf None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.691302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc0b2-0639-46b0-af21-f7431d9bc5bf None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.691528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc0b2-0639-46b0-af21-f7431d9bc5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.814372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a7afc0b2-0639-46b0-af21-f7431d9bc5bf None None] MFA Rules not processed for user `aa6c328bf2be49c78faddf5c02d3d908`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:11.821091 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3843/7635] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:11.824626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a7afc0b2-0639-46b0-af21-f7431d9bc5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:11.832253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e6e42-c59a-41ff-8820-1f6f5be1720a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.833246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e6e42-c59a-41ff-8820-1f6f5be1720a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.835074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e6e42-c59a-41ff-8820-1f6f5be1720a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.869141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0a3e6e42-c59a-41ff-8820-1f6f5be1720a None None] MFA Rules not processed for user `cec778544e154af895ba33acde39a114`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:11.870988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0a3e6e42-c59a-41ff-8820-1f6f5be1720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:11.896400 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3844/7636] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:11.899295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e6e42-c59a-41ff-8820-1f6f5be1720a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:11.915112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e6e42-c59a-41ff-8820-1f6f5be1720a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:11.924245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440c485-da6d-4abd-a1db-4b1b3e57a8ad tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec778544e154af895ba33acde39a114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ceb6ef72d44a6f939736d54261c4f3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1214040125', 'tempest-DelegatedRole-1740969636'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:11.925195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440c485-da6d-4abd-a1db-4b1b3e57a8ad tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:11.925994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440c485-da6d-4abd-a1db-4b1b3e57a8ad tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:11.925994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440c485-da6d-4abd-a1db-4b1b3e57a8ad tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:11.926666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440c485-da6d-4abd-a1db-4b1b3e57a8ad tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorizing `identity:create_trust()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:11.928181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440c485-da6d-4abd-a1db-4b1b3e57a8ad tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:11.971743 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3793/7637] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:11.976203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afc0b2-0639-46b0-af21-f7431d9bc5bf None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.033721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:12.078027 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3845/7638] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Aug 29 15:59:11 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:12.078027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440c485-da6d-4abd-a1db-4b1b3e57a8ad tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.081379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f440c485-da6d-4abd-a1db-4b1b3e57a8ad tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:12.133770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afc0b2-0639-46b0-af21-f7431d9bc5bf None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.141094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc9f1f-5333-4ace-81b5-b79bba49a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.142358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc9f1f-5333-4ace-81b5-b79bba49a0ab admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.142762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc9f1f-5333-4ace-81b5-b79bba49a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.143046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc9f1f-5333-4ace-81b5-b79bba49a0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.144578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc9f1f-5333-4ace-81b5-b79bba49a0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:12.147738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc9f1f-5333-4ace-81b5-b79bba49a0ab admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:12.212950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440c485-da6d-4abd-a1db-4b1b3e57a8ad tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.222072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.222828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.223180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.223533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] PATH_INFO: `/v3/projects/7686f5f846414b3b9706ae0a9f89ba6f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.226014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7686f5f846414b3b9706ae0a9f89ba6f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:12.229762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:12.234015 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3794/7639] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:11 2022] POST /identity/v3/projects => generated 381 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:12.234433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc9f1f-5333-4ace-81b5-b79bba49a0ab admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.332646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:12.338513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7686f5f846414b3b9706ae0a9f89ba6f', 'request_id': 'req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:12.349884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7686f5f846414b3b9706ae0a9f89ba6f', 'request_id': 'req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:12.367405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7686f5f846414b3b9706ae0a9f89ba6f', 'request_id': 'req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:12.382488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc9f1f-5333-4ace-81b5-b79bba49a0ab admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.393375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] The token cache is being invalidate because project 7686f5f846414b3b9706ae0a9f89ba6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:12.393659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:12.395823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:12.401521 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3846/7640] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:12 2022] DELETE /identity/v3/projects/7686f5f846414b3b9706ae0a9f89ba6f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:12.404737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.406448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:12.504630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1baa8-00e6-4e10-83df-e5041f1151a6 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec778544e154af895ba33acde39a114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ceb6ef72d44a6f939736d54261c4f3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1214040125', 'tempest-DelegatedRole-1740969636'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.505292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1baa8-00e6-4e10-83df-e5041f1151a6 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.505611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1baa8-00e6-4e10-83df-e5041f1151a6 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.505893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1baa8-00e6-4e10-83df-e5041f1151a6 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] PATH_INFO: `/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.517269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1baa8-00e6-4e10-83df-e5041f1151a6 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorizing `identity:get_trust(trust_id=5f2d29bcd12e4813a48fbde8f8bcbb6d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:12.518701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1baa8-00e6-4e10-83df-e5041f1151a6 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:12.530058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb2e1e-3627-40ee-b9f4-77ace04b0e71 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.530394 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3795/7641] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:12 2022] GET /identity/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d => generated 859 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:12.531332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1baa8-00e6-4e10-83df-e5041f1151a6 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.539957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9bb1baa8-00e6-4e10-83df-e5041f1151a6 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:12.540195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756a984-2fc0-4017-a130-3030d920e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.540195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756a984-2fc0-4017-a130-3030d920e3ca admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.540195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756a984-2fc0-4017-a130-3030d920e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.540195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756a984-2fc0-4017-a130-3030d920e3ca admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.540613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756a984-2fc0-4017-a130-3030d920e3ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:12.544656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756a984-2fc0-4017-a130-3030d920e3ca admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:12.576516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1baa8-00e6-4e10-83df-e5041f1151a6 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.577309 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3847/7642] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:12 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:12.578417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756a984-2fc0-4017-a130-3030d920e3ca admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.581373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6756a984-2fc0-4017-a130-3030d920e3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:12.587477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.588139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.588423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.588702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] PATH_INFO: `/v3/users/515436464dff424bb2ccabbd36990d8b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.590006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] RBAC: Authorizing `identity:delete_user(user_id=515436464dff424bb2ccabbd36990d8b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:12.592088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:12.594428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:12.599501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756a984-2fc0-4017-a130-3030d920e3ca admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.608108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83215d6-38c2-4f19-8748-aa3044e8d849 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec778544e154af895ba33acde39a114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ceb6ef72d44a6f939736d54261c4f3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1214040125', 'tempest-DelegatedRole-1740969636'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.609300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83215d6-38c2-4f19-8748-aa3044e8d849 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.609859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83215d6-38c2-4f19-8748-aa3044e8d849 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.610447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83215d6-38c2-4f19-8748-aa3044e8d849 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] PATH_INFO: `/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.622915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83215d6-38c2-4f19-8748-aa3044e8d849 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=5f2d29bcd12e4813a48fbde8f8bcbb6d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:12.624795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83215d6-38c2-4f19-8748-aa3044e8d849 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:12.636383 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3848/7643] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:59:12 2022] GET /identity/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d/roles => generated 371 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:12.637799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83215d6-38c2-4f19-8748-aa3044e8d849 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.653259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83215d6-38c2-4f19-8748-aa3044e8d849 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.661729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec54e82-a87f-4efe-a009-4e9618d9dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.663170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec54e82-a87f-4efe-a009-4e9618d9dede admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.663170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec54e82-a87f-4efe-a009-4e9618d9dede admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.663415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec54e82-a87f-4efe-a009-4e9618d9dede admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.664221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec54e82-a87f-4efe-a009-4e9618d9dede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:12.666753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec54e82-a87f-4efe-a009-4e9618d9dede admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:12.681420 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3849/7644] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:12 2022] GET /identity/v3/roles => generated 1893 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:12.682403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec54e82-a87f-4efe-a009-4e9618d9dede admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.699382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515436464dff424bb2ccabbd36990d8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:12.702144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515436464dff424bb2ccabbd36990d8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:12.702337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec54e82-a87f-4efe-a009-4e9618d9dede admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.709842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1b93c-d407-4f76-bacb-1b0b0ba68cd9 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec778544e154af895ba33acde39a114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ceb6ef72d44a6f939736d54261c4f3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1214040125', 'tempest-DelegatedRole-1740969636'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.710707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1b93c-d407-4f76-bacb-1b0b0ba68cd9 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.710919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1b93c-d407-4f76-bacb-1b0b0ba68cd9 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.711182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1b93c-d407-4f76-bacb-1b0b0ba68cd9 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] PATH_INFO: `/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d/roles/07a0d187063e40bcb64de5418e539a90` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.727109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1b93c-d407-4f76-bacb-1b0b0ba68cd9 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5f2d29bcd12e4813a48fbde8f8bcbb6d, role_id=07a0d187063e40bcb64de5418e539a90)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:12.733868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1b93c-d407-4f76-bacb-1b0b0ba68cd9 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:12.734276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515436464dff424bb2ccabbd36990d8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:12.746016 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3850/7645] 10.222.0.16 () {58 vars in 1368 bytes} [Mon Aug 29 15:59:12 2022] GET /identity/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d/roles/07a0d187063e40bcb64de5418e539a90 => generated 244 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:12.746982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1b93c-d407-4f76-bacb-1b0b0ba68cd9 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.750634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515436464dff424bb2ccabbd36990d8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:12.760557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1b93c-d407-4f76-bacb-1b0b0ba68cd9 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.766469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ecee-1048-4d19-b52a-1c72ebc4c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:12.766958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ecee-1048-4d19-b52a-1c72ebc4c91f admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:12.767253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ecee-1048-4d19-b52a-1c72ebc4c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:12.767527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ecee-1048-4d19-b52a-1c72ebc4c91f admin admin] PATH_INFO: `/v3/projects/03292a79cf16493b91feaa739fbea495/users/e0b08c98e16a4589a6b4a8819b2c93c9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:12.769930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515436464dff424bb2ccabbd36990d8b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:12.786377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95ecee-1048-4d19-b52a-1c72ebc4c91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03292a79cf16493b91feaa739fbea495, user_id=e0b08c98e16a4589a6b4a8819b2c93c9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:12.787739 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3796/7646] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:12 2022] DELETE /identity/v3/users/515436464dff424bb2ccabbd36990d8b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:12.788939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.791221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95ecee-1048-4d19-b52a-1c72ebc4c91f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:12.798257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:12.814265 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3851/7647] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:12 2022] PUT /identity/v3/projects/03292a79cf16493b91feaa739fbea495/users/e0b08c98e16a4589a6b4a8819b2c93c9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:12.818343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ecee-1048-4d19-b52a-1c72ebc4c91f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:12.823456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8d95ecee-1048-4d19-b52a-1c72ebc4c91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:12.972154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf12d1c-c2c7-4af0-b64d-9be29feea1df admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:12.991934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:13.009930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ecee-1048-4d19-b52a-1c72ebc4c91f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.038774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edb084-b653-4756-baa0-dcf3e769b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.042355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edb084-b653-4756-baa0-dcf3e769b5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.044434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edb084-b653-4756-baa0-dcf3e769b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.044942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edb084-b653-4756-baa0-dcf3e769b5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.045920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edb084-b653-4756-baa0-dcf3e769b5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.048307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edb084-b653-4756-baa0-dcf3e769b5b6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.079553 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3852/7648] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:12 2022] GET /identity/v3/roles => generated 1893 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:13.083517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edb084-b653-4756-baa0-dcf3e769b5b6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.097345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd96b31-1a48-4510-ba01-b9f5c0f4b06b tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec778544e154af895ba33acde39a114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ceb6ef72d44a6f939736d54261c4f3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1214040125', 'tempest-DelegatedRole-1740969636'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.098654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd96b31-1a48-4510-ba01-b9f5c0f4b06b tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.098954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd96b31-1a48-4510-ba01-b9f5c0f4b06b tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.099233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd96b31-1a48-4510-ba01-b9f5c0f4b06b tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] PATH_INFO: `/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d/roles/07a0d187063e40bcb64de5418e539a90` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.105975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edb084-b653-4756-baa0-dcf3e769b5b6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.107449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd96b31-1a48-4510-ba01-b9f5c0f4b06b tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5f2d29bcd12e4813a48fbde8f8bcbb6d, role_id=07a0d187063e40bcb64de5418e539a90)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.108944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd96b31-1a48-4510-ba01-b9f5c0f4b06b tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.112865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a30c66-ad2d-4d60-baa2-2442e59d9b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.114270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30c66-ad2d-4d60-baa2-2442e59d9b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.114900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30c66-ad2d-4d60-baa2-2442e59d9b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.115423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30c66-ad2d-4d60-baa2-2442e59d9b2b admin admin] PATH_INFO: `/v3/projects/03292a79cf16493b91feaa739fbea495/users/e0b08c98e16a4589a6b4a8819b2c93c9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.117865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a30c66-ad2d-4d60-baa2-2442e59d9b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03292a79cf16493b91feaa739fbea495, user_id=e0b08c98e16a4589a6b4a8819b2c93c9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.121107 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3797/7649] 10.222.0.16 () {58 vars in 1369 bytes} [Mon Aug 29 15:59:12 2022] HEAD /identity/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d/roles/07a0d187063e40bcb64de5418e539a90 => generated 0 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 29 15:59:13.121686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a30c66-ad2d-4d60-baa2-2442e59d9b2b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.122506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd96b31-1a48-4510-ba01-b9f5c0f4b06b tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.140010 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3853/7650] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:13 2022] PUT /identity/v3/projects/03292a79cf16493b91feaa739fbea495/users/e0b08c98e16a4589a6b4a8819b2c93c9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:13.143101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd96b31-1a48-4510-ba01-b9f5c0f4b06b tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.151291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a40891-df39-4b81-92e9-defee350a82d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.151740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a40891-df39-4b81-92e9-defee350a82d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.152028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a40891-df39-4b81-92e9-defee350a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.231384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-49a40891-df39-4b81-92e9-defee350a82d None None] MFA Rules not processed for user `e0b08c98e16a4589a6b4a8819b2c93c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:13.232695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-49a40891-df39-4b81-92e9-defee350a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:13.291449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18175595-5574-4a0d-bb38-7dcfc0d68b98 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec778544e154af895ba33acde39a114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ceb6ef72d44a6f939736d54261c4f3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1214040125', 'tempest-DelegatedRole-1740969636'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.292764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18175595-5574-4a0d-bb38-7dcfc0d68b98 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.293148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18175595-5574-4a0d-bb38-7dcfc0d68b98 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.293570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18175595-5574-4a0d-bb38-7dcfc0d68b98 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] PATH_INFO: `/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d/roles/3c06472e09c140d49ebc8ee3fd0bbeb0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.302238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18175595-5574-4a0d-bb38-7dcfc0d68b98 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5f2d29bcd12e4813a48fbde8f8bcbb6d, role_id=3c06472e09c140d49ebc8ee3fd0bbeb0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.303899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18175595-5574-4a0d-bb38-7dcfc0d68b98 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-18175595-5574-4a0d-bb38-7dcfc0d68b98 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Could not find role: 3c06472e09c140d49ebc8ee3fd0bbeb0.: keystone.exception.RoleNotFound: Could not find role: 3c06472e09c140d49ebc8ee3fd0bbeb0. Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:59:13.316448 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 3c06472e09c140d49ebc8ee3fd0bbeb0. Aug 29 15:59:13.317825 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:13.322850 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3798/7651] 10.222.0.16 () {58 vars in 1368 bytes} [Mon Aug 29 15:59:13 2022] GET /identity/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d/roles/3c06472e09c140d49ebc8ee3fd0bbeb0 => generated 110 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:59:13.323880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18175595-5574-4a0d-bb38-7dcfc0d68b98 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.338432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18175595-5574-4a0d-bb38-7dcfc0d68b98 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.343727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c44cd4-1799-4132-8874-61cb70f24267 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec778544e154af895ba33acde39a114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ceb6ef72d44a6f939736d54261c4f3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1214040125', 'tempest-DelegatedRole-1740969636'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.344472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44cd4-1799-4132-8874-61cb70f24267 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.344929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44cd4-1799-4132-8874-61cb70f24267 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.345273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44cd4-1799-4132-8874-61cb70f24267 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] PATH_INFO: `/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d/roles/3c06472e09c140d49ebc8ee3fd0bbeb0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.365801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c44cd4-1799-4132-8874-61cb70f24267 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5f2d29bcd12e4813a48fbde8f8bcbb6d, role_id=3c06472e09c140d49ebc8ee3fd0bbeb0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.369073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c44cd4-1799-4132-8874-61cb70f24267 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.389078 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3854/7652] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-21c44cd4-1799-4132-8874-61cb70f24267 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Could not find role: 3c06472e09c140d49ebc8ee3fd0bbeb0.: keystone.exception.RoleNotFound: Could not find role: 3c06472e09c140d49ebc8ee3fd0bbeb0. Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:59:13.389900 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 3c06472e09c140d49ebc8ee3fd0bbeb0. Aug 29 15:59:13.391288 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:13.391580 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3799/7653] 10.222.0.16 () {58 vars in 1369 bytes} [Mon Aug 29 15:59:13 2022] HEAD /identity/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d/roles/3c06472e09c140d49ebc8ee3fd0bbeb0 => generated 0 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 29 15:59:13.395413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a40891-df39-4b81-92e9-defee350a82d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.402767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:13.410555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c44cd4-1799-4132-8874-61cb70f24267 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.413959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a40891-df39-4b81-92e9-defee350a82d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.416178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-21c44cd4-1799-4132-8874-61cb70f24267 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:13.419800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec778544e154af895ba33acde39a114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ceb6ef72d44a6f939736d54261c4f3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1214040125', 'tempest-DelegatedRole-1740969636'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.420878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.421369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.421934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] PATH_INFO: `/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.429091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorizing `identity:delete_trust(trust_id=5f2d29bcd12e4813a48fbde8f8bcbb6d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.431276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.469707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5f2d29bcd12e4813a48fbde8f8bcbb6d', 'request_id': 'req-f8d9f19b-0981-4452-ac39-a24b753bb874'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:13.470721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '5f2d29bcd12e4813a48fbde8f8bcbb6d', 'request_id': 'req-f8d9f19b-0981-4452-ac39-a24b753bb874'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:13.482441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5f2d29bcd12e4813a48fbde8f8bcbb6d', 'request_id': 'req-f8d9f19b-0981-4452-ac39-a24b753bb874'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:13.493363 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3855/7654] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 15:59:13 2022] DELETE /identity/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:13.494766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.497910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:13.511382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c44cd4-1799-4132-8874-61cb70f24267 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.515822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096c331-7e41-4d8c-b8c1-9af5b7c66fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.516506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c331-7e41-4d8c-b8c1-9af5b7c66fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.516857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c331-7e41-4d8c-b8c1-9af5b7c66fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.517251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c331-7e41-4d8c-b8c1-9af5b7c66fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.519278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9096c331-7e41-4d8c-b8c1-9af5b7c66fe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:13.534312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096c331-7e41-4d8c-b8c1-9af5b7c66fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.536510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096c331-7e41-4d8c-b8c1-9af5b7c66fe9 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.567217 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3800/7655] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:13.581486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096c331-7e41-4d8c-b8c1-9af5b7c66fe9 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.586561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9096c331-7e41-4d8c-b8c1-9af5b7c66fe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:13.614275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9f19b-0981-4452-ac39-a24b753bb874 tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.618883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096c331-7e41-4d8c-b8c1-9af5b7c66fe9 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.621832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.623253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.623787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.624413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] PATH_INFO: `/v3/projects/99d44e2dca024327add35f5171b219a3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.625912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d44e2dca024327add35f5171b219a3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.626170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3a436-8c76-4249-a078-b34d899f8e3f tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec778544e154af895ba33acde39a114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ceb6ef72d44a6f939736d54261c4f3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1214040125', 'tempest-DelegatedRole-1740969636'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.626834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3a436-8c76-4249-a078-b34d899f8e3f tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.627728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3a436-8c76-4249-a078-b34d899f8e3f tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.630603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:13.638799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3a436-8c76-4249-a078-b34d899f8e3f tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] PATH_INFO: `/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-1ae3a436-8c76-4249-a078-b34d899f8e3f tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Could not find trust: 5f2d29bcd12e4813a48fbde8f8bcbb6d.: keystone.exception.TrustNotFound: Could not find trust: 5f2d29bcd12e4813a48fbde8f8bcbb6d. Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 29 15:59:13.659257 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 5f2d29bcd12e4813a48fbde8f8bcbb6d. Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:13.660460 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3801/7656] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:13 2022] GET /identity/v3/OS-TRUST/trusts/5f2d29bcd12e4813a48fbde8f8bcbb6d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:59:13.666543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3a436-8c76-4249-a078-b34d899f8e3f tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.669641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1ae3a436-8c76-4249-a078-b34d899f8e3f tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:13.687142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:13.754467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d44e2dca024327add35f5171b219a3', 'request_id': 'req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:13.764214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d44e2dca024327add35f5171b219a3', 'request_id': 'req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:13.786075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3a436-8c76-4249-a078-b34d899f8e3f tempest-TrustsV3TestJSON-981228135 tempest-user-987794972] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:13.789121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d44e2dca024327add35f5171b219a3', 'request_id': 'req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:13.824699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] The token cache is being invalidate because project 99d44e2dca024327add35f5171b219a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:13.825021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:13.827287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:13.833024 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3856/7657] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:13 2022] DELETE /identity/v3/projects/99d44e2dca024327add35f5171b219a3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:13.836736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:13.840710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:13.973848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5566b8-be01-409d-8059-4a0306c2c8a5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:13.975568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5566b8-be01-409d-8059-4a0306c2c8a5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:13.975935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5566b8-be01-409d-8059-4a0306c2c8a5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:13.976205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5566b8-be01-409d-8059-4a0306c2c8a5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/3c06472e09c140d49ebc8ee3fd0bbeb0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:13.978467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5566b8-be01-409d-8059-4a0306c2c8a5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c06472e09c140d49ebc8ee3fd0bbeb0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:13.983114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5566b8-be01-409d-8059-4a0306c2c8a5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:14.007305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:14.026055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6a6c0-7f23-4105-8db0-d198d6ae4ca4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:14.037010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:14.038777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:14.039705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:14.040999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] PATH_INFO: `/v3/users/034d90e5a7824151b8bf36f4fdfcad8c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:14.044813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=034d90e5a7824151b8bf36f4fdfcad8c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:14.050768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:14.078523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cc5566b8-be01-409d-8059-4a0306c2c8a5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role 3c06472e09c140d49ebc8ee3fd0bbeb0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:14.078820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cc5566b8-be01-409d-8059-4a0306c2c8a5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.080496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-cc5566b8-be01-409d-8059-4a0306c2c8a5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.086350 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3802/7658] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:13 2022] DELETE /identity/v3/roles/3c06472e09c140d49ebc8ee3fd0bbeb0 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:14.088956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2e447-ddf0-4edc-bc73-18887c952ca8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:14.090498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2e447-ddf0-4edc-bc73-18887c952ca8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:14.093571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2e447-ddf0-4edc-bc73-18887c952ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:14.127560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '034d90e5a7824151b8bf36f4fdfcad8c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.128389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '034d90e5a7824151b8bf36f4fdfcad8c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.181434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '034d90e5a7824151b8bf36f4fdfcad8c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.182866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '034d90e5a7824151b8bf36f4fdfcad8c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.184199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7ed2e447-ddf0-4edc-bc73-18887c952ca8 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:14.185504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7ed2e447-ddf0-4edc-bc73-18887c952ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:14.199829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '034d90e5a7824151b8bf36f4fdfcad8c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.231946 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3857/7659] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:13 2022] DELETE /identity/v3/users/034d90e5a7824151b8bf36f4fdfcad8c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:14.232817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:14.236148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:14.278394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:14.332672 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3803/7660] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:14.348579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14795cd-f66f-4ba8-99f5-9f3a5477c000 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:14.354107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:14.354886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:14.355216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:14.355499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/07a0d187063e40bcb64de5418e539a90` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:14.357940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=07a0d187063e40bcb64de5418e539a90)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:14.359839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:14.367123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2e447-ddf0-4edc-bc73-18887c952ca8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:14.369865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7ed2e447-ddf0-4edc-bc73-18887c952ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:14.427145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role 07a0d187063e40bcb64de5418e539a90 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:14.427636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.431860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.438158 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3858/7661] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:14 2022] DELETE /identity/v3/roles/07a0d187063e40bcb64de5418e539a90 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:14.439008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:14.441774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:14.525276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2e447-ddf0-4edc-bc73-18887c952ca8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:14.547998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:14.626814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:14.627470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:14.627802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:14.628077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] PATH_INFO: `/v3/users/aa6c328bf2be49c78faddf5c02d3d908` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:14.629287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6c328bf2be49c78faddf5c02d3d908)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:14.632623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:14.633485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501515e-ad97-4b0f-be65-1caa29d5be01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:14.641845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c4239-adf5-43d2-ac0e-d1499d3e13f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:14.642458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4239-adf5-43d2-ac0e-d1499d3e13f6 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:14.642740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4239-adf5-43d2-ac0e-d1499d3e13f6 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:14.643016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4239-adf5-43d2-ac0e-d1499d3e13f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:14.644914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0c3c4239-adf5-43d2-ac0e-d1499d3e13f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:14.710759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6c328bf2be49c78faddf5c02d3d908'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.711519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6c328bf2be49c78faddf5c02d3d908'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.739111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6c328bf2be49c78faddf5c02d3d908'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.742458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c4239-adf5-43d2-ac0e-d1499d3e13f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:14.744484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c4239-adf5-43d2-ac0e-d1499d3e13f6 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:14.749895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6c328bf2be49c78faddf5c02d3d908'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.753922 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3859/7662] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:14.754688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c4239-adf5-43d2-ac0e-d1499d3e13f6 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:14.756763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0c3c4239-adf5-43d2-ac0e-d1499d3e13f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:14.760682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6c328bf2be49c78faddf5c02d3d908'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:14.774219 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3804/7663] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:14 2022] DELETE /identity/v3/users/aa6c328bf2be49c78faddf5c02d3d908 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:14.774219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:14.776033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:14.794982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:14.906307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c4239-adf5-43d2-ac0e-d1499d3e13f6 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:14.913092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d18ec-b9b2-4b85-9519-a2dfa92c05eb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:14.925627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:14.926509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:14.928870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:14.929163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] PATH_INFO: `/v3/projects/d0ec230ad50c46288f9069fbaaec87ad` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:14.934639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ec230ad50c46288f9069fbaaec87ad)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:14.938288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:15.055748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83769905-7000-4826-9c33-7cd031d3da01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:15.057093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83769905-7000-4826-9c33-7cd031d3da01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.058029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83769905-7000-4826-9c33-7cd031d3da01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.058906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83769905-7000-4826-9c33-7cd031d3da01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users/cec778544e154af895ba33acde39a114` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.062557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83769905-7000-4826-9c33-7cd031d3da01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cec778544e154af895ba33acde39a114)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:15.065852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83769905-7000-4826-9c33-7cd031d3da01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:15.068530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ec230ad50c46288f9069fbaaec87ad', 'request_id': 'req-65cdaaa2-e100-481f-9758-59f636ad0564'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.077906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:15.084896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ec230ad50c46288f9069fbaaec87ad', 'request_id': 'req-65cdaaa2-e100-481f-9758-59f636ad0564'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.124534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ec230ad50c46288f9069fbaaec87ad', 'request_id': 'req-65cdaaa2-e100-481f-9758-59f636ad0564'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.149546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] The token cache is being invalidate because project d0ec230ad50c46288f9069fbaaec87ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:15.150325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.152619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-83769905-7000-4826-9c33-7cd031d3da01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec778544e154af895ba33acde39a114'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.153484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-65cdaaa2-e100-481f-9758-59f636ad0564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.154130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-83769905-7000-4826-9c33-7cd031d3da01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec778544e154af895ba33acde39a114'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.158203 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3805/7664] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:14 2022] DELETE /identity/v3/projects/d0ec230ad50c46288f9069fbaaec87ad => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:15.159965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840aad-600a-4b11-adc1-462cec5ee18e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.160250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840aad-600a-4b11-adc1-462cec5ee18e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.160527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840aad-600a-4b11-adc1-462cec5ee18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.185984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-83769905-7000-4826-9c33-7cd031d3da01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec778544e154af895ba33acde39a114'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.187234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-83769905-7000-4826-9c33-7cd031d3da01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec778544e154af895ba33acde39a114'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.201037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-83769905-7000-4826-9c33-7cd031d3da01 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec778544e154af895ba33acde39a114'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.207839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f3840aad-600a-4b11-adc1-462cec5ee18e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:15.209148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f3840aad-600a-4b11-adc1-462cec5ee18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:15.227280 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3860/7665] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:14 2022] DELETE /identity/v3/users/cec778544e154af895ba33acde39a114 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:15.227280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee724f3-17a0-406b-bd52-1d4d26afb447 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.227280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee724f3-17a0-406b-bd52-1d4d26afb447 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.227280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee724f3-17a0-406b-bd52-1d4d26afb447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.267501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8ee724f3-17a0-406b-bd52-1d4d26afb447 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:15.269055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8ee724f3-17a0-406b-bd52-1d4d26afb447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:15.353446 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3806/7666] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:15.354361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3840aad-600a-4b11-adc1-462cec5ee18e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:15.359473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f3840aad-600a-4b11-adc1-462cec5ee18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:15.375996 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3861/7667] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:15.376811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee724f3-17a0-406b-bd52-1d4d26afb447 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:15.378423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8ee724f3-17a0-406b-bd52-1d4d26afb447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:15.422555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:15.451083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3840aad-600a-4b11-adc1-462cec5ee18e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:15.474695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee724f3-17a0-406b-bd52-1d4d26afb447 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:15.487914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16499d-3ec3-4d61-9621-d961ce3e41d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:15.489049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16499d-3ec3-4d61-9621-d961ce3e41d2 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.489327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16499d-3ec3-4d61-9621-d961ce3e41d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.489919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16499d-3ec3-4d61-9621-d961ce3e41d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.509826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16499d-3ec3-4d61-9621-d961ce3e41d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:15.511268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16499d-3ec3-4d61-9621-d961ce3e41d2 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:15.522928 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3862/7668] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:15.524396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c85de6-2b67-4f2c-b8c7-cc169e8bbbcd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.524682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c85de6-2b67-4f2c-b8c7-cc169e8bbbcd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.524969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c85de6-2b67-4f2c-b8c7-cc169e8bbbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.557771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:15.558541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.559350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.559644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/57ceb6ef72d44a6f939736d54261c4f3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.563989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_project(project_id=57ceb6ef72d44a6f939736d54261c4f3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:15.565954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:15.567617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-19c85de6-2b67-4f2c-b8c7-cc169e8bbbcd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:15.571064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-19c85de6-2b67-4f2c-b8c7-cc169e8bbbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:15.604430 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3863/7669] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:15.611312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c85de6-2b67-4f2c-b8c7-cc169e8bbbcd None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:15.635907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c85de6-2b67-4f2c-b8c7-cc169e8bbbcd None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:15.653266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a63d3a-a3d5-4c04-9ef6-6cb670b7b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:15.655857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a63d3a-a3d5-4c04-9ef6-6cb670b7b9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.656174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a63d3a-a3d5-4c04-9ef6-6cb670b7b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.656474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a63d3a-a3d5-4c04-9ef6-6cb670b7b9f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.657192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a63d3a-a3d5-4c04-9ef6-6cb670b7b9f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:15.657530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a63d3a-a3d5-4c04-9ef6-6cb670b7b9f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:15.663328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a63d3a-a3d5-4c04-9ef6-6cb670b7b9f2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:15.704721 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3864/7670] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:15.706437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a63d3a-a3d5-4c04-9ef6-6cb670b7b9f2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:15.738815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ceb6ef72d44a6f939736d54261c4f3', 'request_id': 'req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.739083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a63d3a-a3d5-4c04-9ef6-6cb670b7b9f2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:15.752947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ceb6ef72d44a6f939736d54261c4f3', 'request_id': 'req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.756837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:15.765447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ceb6ef72d44a6f939736d54261c4f3', 'request_id': 'req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.791921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] The token cache is being invalidate because project 57ceb6ef72d44a6f939736d54261c4f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:15.792327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.793809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:15.798466 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3807/7671] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:15 2022] DELETE /identity/v3/projects/57ceb6ef72d44a6f939736d54261c4f3 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:15.806104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:15.810119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:15.938166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb90b-f691-49c9-a273-bbcaf38ad6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:15.939956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb90b-f691-49c9-a273-bbcaf38ad6ba admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:15.944326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb90b-f691-49c9-a273-bbcaf38ad6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:15.944654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb90b-f691-49c9-a273-bbcaf38ad6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:15.945370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb90b-f691-49c9-a273-bbcaf38ad6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:15.956178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb90b-f691-49c9-a273-bbcaf38ad6ba admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:16.032025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c0df6-d2b7-4202-a6d9-fe91df8e1cf1 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:16.044799 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3865/7672] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:15 2022] POST /identity/v3/projects => generated 379 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:16.051960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb90b-f691-49c9-a273-bbcaf38ad6ba admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:16.059606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-40ceb90b-f691-49c9-a273-bbcaf38ad6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:16.125686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:16.211424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963e6ef-44cb-407b-8097-9578765cb9b3 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:16.212230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963e6ef-44cb-407b-8097-9578765cb9b3 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:16.212623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963e6ef-44cb-407b-8097-9578765cb9b3 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:16.213007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963e6ef-44cb-407b-8097-9578765cb9b3 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:16.213819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963e6ef-44cb-407b-8097-9578765cb9b3 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:16.215873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963e6ef-44cb-407b-8097-9578765cb9b3 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:16.256980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb90b-f691-49c9-a273-bbcaf38ad6ba admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:16.262635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77bdd8-db33-44f0-8e91-30d1545db93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:16.263286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77bdd8-db33-44f0-8e91-30d1545db93c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:16.263573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77bdd8-db33-44f0-8e91-30d1545db93c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:16.263834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77bdd8-db33-44f0-8e91-30d1545db93c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:16.264709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77bdd8-db33-44f0-8e91-30d1545db93c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:16.284620 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3808/7673] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:59:15 2022] POST /identity/v3/projects => generated 329 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:16.284966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77bdd8-db33-44f0-8e91-30d1545db93c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:16.286700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963e6ef-44cb-407b-8097-9578765cb9b3 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:16.305553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a963e6ef-44cb-407b-8097-9578765cb9b3 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:16.331951 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3866/7674] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:16 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:16.333703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77bdd8-db33-44f0-8e91-30d1545db93c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:16.382422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77bdd8-db33-44f0-8e91-30d1545db93c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:16.511205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963e6ef-44cb-407b-8097-9578765cb9b3 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:16.523220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:16.525553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:16.525855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:16.526146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] PATH_INFO: `/v3/projects/aa8ed8ec0e0c41548fc7a49065cf591d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:16.530642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8ed8ec0e0c41548fc7a49065cf591d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:16.533815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:16.583145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4a4bf-c896-490a-b715-91387c92feb5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:16.583782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a4bf-c896-490a-b715-91387c92feb5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:16.584236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a4bf-c896-490a-b715-91387c92feb5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:16.584633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a4bf-c896-490a-b715-91387c92feb5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:16.585422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4a4bf-c896-490a-b715-91387c92feb5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:16.587470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4a4bf-c896-490a-b715-91387c92feb5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:16.633753 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3867/7675] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:16 2022] POST /identity/v3/users => generated 404 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:16.637777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4a4bf-c896-490a-b715-91387c92feb5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:16.649892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8ed8ec0e0c41548fc7a49065cf591d', 'request_id': 'req-04c7806e-283b-4b4c-8ce4-61939016df46'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:16.664537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8ed8ec0e0c41548fc7a49065cf591d', 'request_id': 'req-04c7806e-283b-4b4c-8ce4-61939016df46'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:16.669494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4a4bf-c896-490a-b715-91387c92feb5 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:16.676349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8ed8ec0e0c41548fc7a49065cf591d', 'request_id': 'req-04c7806e-283b-4b4c-8ce4-61939016df46'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:16.696945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:16.707556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] The token cache is being invalidate because project aa8ed8ec0e0c41548fc7a49065cf591d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:16.707867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:16.710854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:16.713114 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3809/7676] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:16 2022] DELETE /identity/v3/projects/aa8ed8ec0e0c41548fc7a49065cf591d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:16.717952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:16.719563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:16.789568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:16.821213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39364755-cba6-456b-b7f9-fdd6e2331bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:16.823218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39364755-cba6-456b-b7f9-fdd6e2331bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:16.823573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39364755-cba6-456b-b7f9-fdd6e2331bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:16.823851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39364755-cba6-456b-b7f9-fdd6e2331bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:16.825904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39364755-cba6-456b-b7f9-fdd6e2331bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:16.827532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39364755-cba6-456b-b7f9-fdd6e2331bf1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:16.845502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7806e-283b-4b4c-8ce4-61939016df46 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:16.855444 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3868/7677] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:16.855444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39364755-cba6-456b-b7f9-fdd6e2331bf1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:16.860947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84dbd4-ab74-44f5-b8e1-6f774b7c35b6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:16.861618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84dbd4-ab74-44f5-b8e1-6f774b7c35b6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:16.862078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84dbd4-ab74-44f5-b8e1-6f774b7c35b6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:16.862200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84dbd4-ab74-44f5-b8e1-6f774b7c35b6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:16.862850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84dbd4-ab74-44f5-b8e1-6f774b7c35b6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:16.864416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-39364755-cba6-456b-b7f9-fdd6e2331bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:16.867436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84dbd4-ab74-44f5-b8e1-6f774b7c35b6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:16.888348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39364755-cba6-456b-b7f9-fdd6e2331bf1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:16.901620 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3810/7678] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:16 2022] POST /identity/v3/roles => generated 244 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:16.902500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84dbd4-ab74-44f5-b8e1-6f774b7c35b6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:16.905336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ba84dbd4-ab74-44f5-b8e1-6f774b7c35b6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:16.909050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:16.909273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:16.909590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:16.909871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] PATH_INFO: `/v3/users/e0b08c98e16a4589a6b4a8819b2c93c9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:16.914492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b08c98e16a4589a6b4a8819b2c93c9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:16.916463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:16.953133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84dbd4-ab74-44f5-b8e1-6f774b7c35b6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:16.964640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30d922-6106-4b7b-b12a-e4489b0579d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:16.964912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30d922-6106-4b7b-b12a-e4489b0579d9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:16.965195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30d922-6106-4b7b-b12a-e4489b0579d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:16.965506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30d922-6106-4b7b-b12a-e4489b0579d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:16.966771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30d922-6106-4b7b-b12a-e4489b0579d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:16.968394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30d922-6106-4b7b-b12a-e4489b0579d9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:16.991381 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3811/7679] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:16 2022] GET /identity/v3/roles => generated 1655 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:16.992276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30d922-6106-4b7b-b12a-e4489b0579d9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:17.019594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30d922-6106-4b7b-b12a-e4489b0579d9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:17.032985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6058ca-9cb9-4087-8698-26964c6d01c7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:17.033798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6058ca-9cb9-4087-8698-26964c6d01c7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:17.034682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6058ca-9cb9-4087-8698-26964c6d01c7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:17.034971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6058ca-9cb9-4087-8698-26964c6d01c7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:17.035779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6058ca-9cb9-4087-8698-26964c6d01c7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:17.036296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b08c98e16a4589a6b4a8819b2c93c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:17.037786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b08c98e16a4589a6b4a8819b2c93c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:17.038566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6058ca-9cb9-4087-8698-26964c6d01c7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:17.061967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b08c98e16a4589a6b4a8819b2c93c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:17.063479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b08c98e16a4589a6b4a8819b2c93c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:17.065479 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3812/7680] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:16 2022] POST /identity/v3/roles => generated 246 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:17.066301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6058ca-9cb9-4087-8698-26964c6d01c7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:17.074736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ab6058ca-9cb9-4087-8698-26964c6d01c7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:17.076075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b08c98e16a4589a6b4a8819b2c93c9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:17.099529 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3869/7681] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:16 2022] DELETE /identity/v3/users/e0b08c98e16a4589a6b4a8819b2c93c9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:17.101059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:17.102562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:17.110486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6058ca-9cb9-4087-8698-26964c6d01c7 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:17.181304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30be5-dbd9-4723-b996-2b53ffc9e281 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:17.186277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a53f-ec15-40dc-b336-d5cadf033468 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:17.187050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a53f-ec15-40dc-b336-d5cadf033468 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:17.187431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a53f-ec15-40dc-b336-d5cadf033468 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:17.187877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a53f-ec15-40dc-b336-d5cadf033468 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/9dede7d486e84fe7981dee4be439c2b2/users/4e445742bc604a74888deca431f485c6/roles/11198c226912447f9c83b595225b83a2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:17.205179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895a53f-ec15-40dc-b336-d5cadf033468 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9dede7d486e84fe7981dee4be439c2b2, user_id=4e445742bc604a74888deca431f485c6, role_id=11198c226912447f9c83b595225b83a2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:17.208370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895a53f-ec15-40dc-b336-d5cadf033468 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:17.242792 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3870/7682] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:17 2022] PUT /identity/v3/projects/9dede7d486e84fe7981dee4be439c2b2/users/4e445742bc604a74888deca431f485c6/roles/11198c226912447f9c83b595225b83a2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:17.246250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a53f-ec15-40dc-b336-d5cadf033468 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:17.257874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:17.289485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dbe12-1840-4fa8-96dc-ba74a0f96ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:17.290687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dbe12-1840-4fa8-96dc-ba74a0f96ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:17.290994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dbe12-1840-4fa8-96dc-ba74a0f96ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:17.291655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dbe12-1840-4fa8-96dc-ba74a0f96ea7 admin admin] PATH_INFO: `/v3/projects/6fa1c2b97c8748ba831eb63c98d978c2/users/e276b9fae4594c17a1883dd4e48184c2/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:17.323372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dbe12-1840-4fa8-96dc-ba74a0f96ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa1c2b97c8748ba831eb63c98d978c2, user_id=e276b9fae4594c17a1883dd4e48184c2, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:17.329876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dbe12-1840-4fa8-96dc-ba74a0f96ea7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:17.376329 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3813/7683] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:17 2022] PUT /identity/v3/projects/6fa1c2b97c8748ba831eb63c98d978c2/users/e276b9fae4594c17a1883dd4e48184c2/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:17.384413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adff50-5d2a-4f8b-b7f4-12b278d9c2b7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:17.384727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adff50-5d2a-4f8b-b7f4-12b278d9c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:17.385119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adff50-5d2a-4f8b-b7f4-12b278d9c2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:17.428573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a53f-ec15-40dc-b336-d5cadf033468 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:17.440827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d1adff50-5d2a-4f8b-b7f4-12b278d9c2b7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:17.444535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d1adff50-5d2a-4f8b-b7f4-12b278d9c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:17.560513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2a690-ba4a-4183-a4e5-0509d3052068 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:17.561867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2a690-ba4a-4183-a4e5-0509d3052068 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:17.562206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2a690-ba4a-4183-a4e5-0509d3052068 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:17.562681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2a690-ba4a-4183-a4e5-0509d3052068 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/9dede7d486e84fe7981dee4be439c2b2/users/4e445742bc604a74888deca431f485c6/roles/b544df2684614e58a863fab6df7f076e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:17.566091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2a690-ba4a-4183-a4e5-0509d3052068 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9dede7d486e84fe7981dee4be439c2b2, user_id=4e445742bc604a74888deca431f485c6, role_id=b544df2684614e58a863fab6df7f076e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:17.571994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2a690-ba4a-4183-a4e5-0509d3052068 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:17.599751 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3871/7684] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:17 2022] PUT /identity/v3/projects/9dede7d486e84fe7981dee4be439c2b2/users/4e445742bc604a74888deca431f485c6/roles/b544df2684614e58a863fab6df7f076e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:17.603312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2a690-ba4a-4183-a4e5-0509d3052068 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:17.615167 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3814/7685] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:17.629550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adff50-5d2a-4f8b-b7f4-12b278d9c2b7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:17.634418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d1adff50-5d2a-4f8b-b7f4-12b278d9c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:17.706271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:17.743158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adff50-5d2a-4f8b-b7f4-12b278d9c2b7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:17.747396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2a690-ba4a-4183-a4e5-0509d3052068 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:17.755967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed56c20-b373-48fe-8d6c-4dddc94edec8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:17.756911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed56c20-b373-48fe-8d6c-4dddc94edec8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:17.757421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed56c20-b373-48fe-8d6c-4dddc94edec8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:17.757917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed56c20-b373-48fe-8d6c-4dddc94edec8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:17.758789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed56c20-b373-48fe-8d6c-4dddc94edec8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:17.760848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed56c20-b373-48fe-8d6c-4dddc94edec8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:17.795686 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3872/7686] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:17 2022] GET /identity/v3/users => generated 6905 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:17.796613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed56c20-b373-48fe-8d6c-4dddc94edec8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:17.798605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-aed56c20-b373-48fe-8d6c-4dddc94edec8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:17.863216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fab64c-4ed8-47eb-8c7f-2a913c689030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:17.864495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fab64c-4ed8-47eb-8c7f-2a913c689030 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:17.864880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fab64c-4ed8-47eb-8c7f-2a913c689030 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:17.865189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fab64c-4ed8-47eb-8c7f-2a913c689030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:17.885917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:17.911656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed56c20-b373-48fe-8d6c-4dddc94edec8 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:17.919201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:17.920443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:17.921027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:17.921367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] PATH_INFO: `/v3/projects/03292a79cf16493b91feaa739fbea495` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:17.922758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=03292a79cf16493b91feaa739fbea495)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:17.925908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:18.003967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fab64c-4ed8-47eb-8c7f-2a913c689030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:18.005580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03292a79cf16493b91feaa739fbea495', 'request_id': 'req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:18.006581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fab64c-4ed8-47eb-8c7f-2a913c689030 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:18.014130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03292a79cf16493b91feaa739fbea495', 'request_id': 'req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:18.024447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03292a79cf16493b91feaa739fbea495', 'request_id': 'req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:18.031264 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3815/7687] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:18.032855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910ddd-4926-486f-bae2-0a79c0623bda None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:18.034533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910ddd-4926-486f-bae2-0a79c0623bda None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:18.035129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910ddd-4926-486f-bae2-0a79c0623bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:18.039038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] The token cache is being invalidate because project 03292a79cf16493b91feaa739fbea495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:18.039815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:18.040703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a6c2a79d-4a5e-4fd7-8f18-7f3a7f05d1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:18.043085 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3873/7688] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:17 2022] DELETE /identity/v3/projects/03292a79cf16493b91feaa739fbea495 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:18.048631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49906133-1ede-488c-854a-2893b90b6d85 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:18.049178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49906133-1ede-488c-854a-2893b90b6d85 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:18.051367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49906133-1ede-488c-854a-2893b90b6d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:18.099101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-49906133-1ede-488c-854a-2893b90b6d85 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:18.100423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-49906133-1ede-488c-854a-2893b90b6d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:18.104281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3e910ddd-4926-486f-bae2-0a79c0623bda None None] MFA Rules not processed for user `4e445742bc604a74888deca431f485c6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:18.107153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3e910ddd-4926-486f-bae2-0a79c0623bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:18.252889 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3874/7689] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:18.255206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a231-c413-41b2-9b40-0e9ce7c7bcde None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:18.255499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a231-c413-41b2-9b40-0e9ce7c7bcde None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:18.255778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a231-c413-41b2-9b40-0e9ce7c7bcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:18.285441 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3816/7690] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:18.302873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf3d4-3d8f-4457-8ca7-7bded27dad0f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:18.304205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf3d4-3d8f-4457-8ca7-7bded27dad0f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:18.306093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf3d4-3d8f-4457-8ca7-7bded27dad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:18.340011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-de87a231-c413-41b2-9b40-0e9ce7c7bcde None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:18.342691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-de87a231-c413-41b2-9b40-0e9ce7c7bcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:18.362733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b33bf3d4-3d8f-4457-8ca7-7bded27dad0f None None] MFA Rules not processed for user `4e445742bc604a74888deca431f485c6`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:18.366795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b33bf3d4-3d8f-4457-8ca7-7bded27dad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:18.372709 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3875/7691] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:18.373729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87a231-c413-41b2-9b40-0e9ce7c7bcde None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:18.388060 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3817/7692] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:18.392203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bf3d4-3d8f-4457-8ca7-7bded27dad0f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:18.403127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bf3d4-3d8f-4457-8ca7-7bded27dad0f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:18.409727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87a231-c413-41b2-9b40-0e9ce7c7bcde None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:18.415461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c62c9-c54f-4964-b7f3-e9a66e8ba10f tempest-TrustsV3TestJSON-1232183192 tempest-user-121127] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e445742bc604a74888deca431f485c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dede7d486e84fe7981dee4be439c2b2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1758725402', 'tempest-NotDelegatedRole-689582562'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:18.416158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c62c9-c54f-4964-b7f3-e9a66e8ba10f tempest-TrustsV3TestJSON-1232183192 tempest-user-121127] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:18.416501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c62c9-c54f-4964-b7f3-e9a66e8ba10f tempest-TrustsV3TestJSON-1232183192 tempest-user-121127] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:18.416789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c62c9-c54f-4964-b7f3-e9a66e8ba10f tempest-TrustsV3TestJSON-1232183192 tempest-user-121127] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:18.418962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c62c9-c54f-4964-b7f3-e9a66e8ba10f tempest-TrustsV3TestJSON-1232183192 tempest-user-121127] RBAC: Authorizing `identity:create_trust()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:18.421693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c62c9-c54f-4964-b7f3-e9a66e8ba10f tempest-TrustsV3TestJSON-1232183192 tempest-user-121127] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:18.426752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee4073-c19f-4b3b-86e3-11a69aa70ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:18.430139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee4073-c19f-4b3b-86e3-11a69aa70ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:18.430425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee4073-c19f-4b3b-86e3-11a69aa70ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:18.430701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee4073-c19f-4b3b-86e3-11a69aa70ff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:18.434817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee4073-c19f-4b3b-86e3-11a69aa70ff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:18.436625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee4073-c19f-4b3b-86e3-11a69aa70ff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:18.442626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee4073-c19f-4b3b-86e3-11a69aa70ff4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:18.457101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:18.497521 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3876/7693] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:18.501982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee4073-c19f-4b3b-86e3-11a69aa70ff4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:18.535831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee4073-c19f-4b3b-86e3-11a69aa70ff4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:18.549610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faad6a-905a-40b2-8cfc-e8dfbad6c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:18.550319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faad6a-905a-40b2-8cfc-e8dfbad6c784 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:18.550601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faad6a-905a-40b2-8cfc-e8dfbad6c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:18.551531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faad6a-905a-40b2-8cfc-e8dfbad6c784 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:18.555515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85faad6a-905a-40b2-8cfc-e8dfbad6c784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:18.560061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85faad6a-905a-40b2-8cfc-e8dfbad6c784 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-5f6c62c9-c54f-4964-b7f3-e9a66e8ba10f tempest-TrustsV3TestJSON-1232183192 tempest-user-121127] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Aug 29 15:59:18.603908 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise ValueError(str(e)) Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Aug 29 15:59:18.605091 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Aug 29 15:59:18.606758 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Aug 29 15:59:18.606758 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Aug 29 15:59:18.606758 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Aug 29 15:59:18.606758 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Aug 29 15:59:18.606758 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 15:59:18.606758 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:18.607436 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3818/7694] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Aug 29 15:59:18 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 215 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 15:59:18.609451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c62c9-c54f-4964-b7f3-e9a66e8ba10f tempest-TrustsV3TestJSON-1232183192 tempest-user-121127] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:18.611580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5f6c62c9-c54f-4964-b7f3-e9a66e8ba10f tempest-TrustsV3TestJSON-1232183192 tempest-user-121127] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:18.633613 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3877/7695] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:18 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:18.639784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faad6a-905a-40b2-8cfc-e8dfbad6c784 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:18.741360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:18.781034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c62c9-c54f-4964-b7f3-e9a66e8ba10f tempest-TrustsV3TestJSON-1232183192 tempest-user-121127] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:18.821481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faad6a-905a-40b2-8cfc-e8dfbad6c784 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:18.834769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe994d12-09e1-4769-90c5-6bb8a9482f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:18.835392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994d12-09e1-4769-90c5-6bb8a9482f75 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:18.835670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994d12-09e1-4769-90c5-6bb8a9482f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:18.835947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe994d12-09e1-4769-90c5-6bb8a9482f75 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:18.836576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe994d12-09e1-4769-90c5-6bb8a9482f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:18.838555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe994d12-09e1-4769-90c5-6bb8a9482f75 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:18.855100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:18.856936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:18.857458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:18.857747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/b544df2684614e58a863fab6df7f076e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:18.860000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b544df2684614e58a863fab6df7f076e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:18.862277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:18.891735 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3878/7696] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:18 2022] POST /identity/v3/users => generated 287 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:18.892988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe994d12-09e1-4769-90c5-6bb8a9482f75 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:18.918964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe994d12-09e1-4769-90c5-6bb8a9482f75 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:18.931302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387c22-18dd-4745-819f-8ed1bb1ec05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:18.931924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387c22-18dd-4745-819f-8ed1bb1ec05b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:18.932474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387c22-18dd-4745-819f-8ed1bb1ec05b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:18.932766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387c22-18dd-4745-819f-8ed1bb1ec05b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:18.933438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30387c22-18dd-4745-819f-8ed1bb1ec05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:18.935053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30387c22-18dd-4745-819f-8ed1bb1ec05b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:18.976896 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3879/7697] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:18 2022] GET /identity/v3/roles => generated 1655 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:18.981214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387c22-18dd-4745-819f-8ed1bb1ec05b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:18.993072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role b544df2684614e58a863fab6df7f076e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:18.994360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:18.999912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:19.008348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387c22-18dd-4745-819f-8ed1bb1ec05b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:19.009905 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3819/7698] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:18 2022] DELETE /identity/v3/roles/b544df2684614e58a863fab6df7f076e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:19.014476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:19.017346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:19.173036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759856f-2611-4cfb-a629-d83fab2ff739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:19.173036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759856f-2611-4cfb-a629-d83fab2ff739 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:19.173036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759856f-2611-4cfb-a629-d83fab2ff739 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:19.173472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759856f-2611-4cfb-a629-d83fab2ff739 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:19.174127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759856f-2611-4cfb-a629-d83fab2ff739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:19.179124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759856f-2611-4cfb-a629-d83fab2ff739 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:19.188189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:19.233221 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3880/7699] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:18 2022] GET /identity/v3/roles => generated 1655 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:19.234435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759856f-2611-4cfb-a629-d83fab2ff739 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:19.241257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2759856f-2611-4cfb-a629-d83fab2ff739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:19.267958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759856f-2611-4cfb-a629-d83fab2ff739 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:19.280437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfb18f-3a71-4b8c-986e-f8db5fbabb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:19.281859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfb18f-3a71-4b8c-986e-f8db5fbabb42 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:19.282370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfb18f-3a71-4b8c-986e-f8db5fbabb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:19.282883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfb18f-3a71-4b8c-986e-f8db5fbabb42 admin admin] PATH_INFO: `/v3/projects/100ca676a92148a78c3de75e9a3bfa55/users/4ba6354796c546649f20d0dbe3cb3706/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:19.329180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfb18f-3a71-4b8c-986e-f8db5fbabb42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100ca676a92148a78c3de75e9a3bfa55, user_id=4ba6354796c546649f20d0dbe3cb3706, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:19.332839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfb18f-3a71-4b8c-986e-f8db5fbabb42 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:19.344867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e219c-02fd-4b25-a262-406ea77e7dc6 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:19.359780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:19.360191 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3881/7700] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:19 2022] PUT /identity/v3/projects/100ca676a92148a78c3de75e9a3bfa55/users/4ba6354796c546649f20d0dbe3cb3706/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:19.360640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:19.360940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:19.361316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/11198c226912447f9c83b595225b83a2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:19.364432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=11198c226912447f9c83b595225b83a2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:19.365028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4a28b-a7bb-4387-98cf-f20ead18f966 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:19.365619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4a28b-a7bb-4387-98cf-f20ead18f966 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:19.366124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4a28b-a7bb-4387-98cf-f20ead18f966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:19.366918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:19.413868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e4c4a28b-a7bb-4387-98cf-f20ead18f966 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:19.415968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e4c4a28b-a7bb-4387-98cf-f20ead18f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:19.464174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role 11198c226912447f9c83b595225b83a2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:19.465620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:19.467020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:19.475878 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3820/7701] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:19 2022] DELETE /identity/v3/roles/11198c226912447f9c83b595225b83a2 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:19.479537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:19.484841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:19.602242 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3882/7702] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:19.614615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4a28b-a7bb-4387-98cf-f20ead18f966 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:19.616585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e4c4a28b-a7bb-4387-98cf-f20ead18f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:19.676502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:19.768109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f375c74-94d3-4582-bb53-eb4a735bd7b0 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:19.778954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4a28b-a7bb-4387-98cf-f20ead18f966 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:19.784227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:19.785782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:19.786293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:19.786965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users/4e445742bc604a74888deca431f485c6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:19.794941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4e445742bc604a74888deca431f485c6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:19.797676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:19.908144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb557f2-d03b-4829-a70e-9d34a7878311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:19.908779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb557f2-d03b-4829-a70e-9d34a7878311 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:19.909063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb557f2-d03b-4829-a70e-9d34a7878311 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:19.910048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb557f2-d03b-4829-a70e-9d34a7878311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:19.942437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e445742bc604a74888deca431f485c6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:19.945429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e445742bc604a74888deca431f485c6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:19.978926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e445742bc604a74888deca431f485c6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:19.995319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e445742bc604a74888deca431f485c6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:20.015482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e445742bc604a74888deca431f485c6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:20.032585 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3821/7703] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:19 2022] DELETE /identity/v3/users/4e445742bc604a74888deca431f485c6 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:20.037436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:20.043375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:20.098964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:20.141889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb557f2-d03b-4829-a70e-9d34a7878311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:20.145745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb557f2-d03b-4829-a70e-9d34a7878311 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:20.180166 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3883/7704] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:20.194142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250d5f0-fd98-4814-a94c-491668788b56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:20.201123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:20.203582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:20.204192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:20.204814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/9dede7d486e84fe7981dee4be439c2b2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:20.207940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9dede7d486e84fe7981dee4be439c2b2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:20.211113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:20.327839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dede7d486e84fe7981dee4be439c2b2', 'request_id': 'req-1c313769-f0ba-433b-87ed-ddb832fda737'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:20.334844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dede7d486e84fe7981dee4be439c2b2', 'request_id': 'req-1c313769-f0ba-433b-87ed-ddb832fda737'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:20.343387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dede7d486e84fe7981dee4be439c2b2', 'request_id': 'req-1c313769-f0ba-433b-87ed-ddb832fda737'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:20.360035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] The token cache is being invalidate because project 9dede7d486e84fe7981dee4be439c2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:20.360430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:20.361081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:20.375953 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3822/7705] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:20 2022] DELETE /identity/v3/projects/9dede7d486e84fe7981dee4be439c2b2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:20.376748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb557f2-d03b-4829-a70e-9d34a7878311 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:20.393996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb557f2-d03b-4829-a70e-9d34a7878311 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:20.486908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d6ad5-5749-4a16-9ecc-e6454d926724 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:20.487533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d6ad5-5749-4a16-9ecc-e6454d926724 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:20.487817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d6ad5-5749-4a16-9ecc-e6454d926724 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:20.488096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d6ad5-5749-4a16-9ecc-e6454d926724 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:20.488726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d6ad5-5749-4a16-9ecc-e6454d926724 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:20.490875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d6ad5-5749-4a16-9ecc-e6454d926724 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:20.532627 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3884/7706] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:59:20 2022] POST /identity/v3/projects => generated 329 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:20.533781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:20.540556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:20.577859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c313769-f0ba-433b-87ed-ddb832fda737 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:20.706540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf17fb-c761-4e50-819b-3d3d45bb3917 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:20.708824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf17fb-c761-4e50-819b-3d3d45bb3917 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:20.710576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf17fb-c761-4e50-819b-3d3d45bb3917 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:20.712250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf17fb-c761-4e50-819b-3d3d45bb3917 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:20.713818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf17fb-c761-4e50-819b-3d3d45bb3917 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:20.718533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf17fb-c761-4e50-819b-3d3d45bb3917 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:20.807688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d6ad5-5749-4a16-9ecc-e6454d926724 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:20.809667 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3823/7707] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:20 2022] POST /identity/v3/users => generated 416 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:20.825328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d6ad5-5749-4a16-9ecc-e6454d926724 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:20.841150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2811da-c66d-4c7f-a12a-50b313717c90 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:20.841828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2811da-c66d-4c7f-a12a-50b313717c90 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:20.842117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2811da-c66d-4c7f-a12a-50b313717c90 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:20.842421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2811da-c66d-4c7f-a12a-50b313717c90 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:20.843154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2811da-c66d-4c7f-a12a-50b313717c90 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:20.844843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2811da-c66d-4c7f-a12a-50b313717c90 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:20.873776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:20.893346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf17fb-c761-4e50-819b-3d3d45bb3917 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:20.898994 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3885/7708] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:20 2022] POST /identity/v3/roles => generated 243 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:20.945231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf17fb-c761-4e50-819b-3d3d45bb3917 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:21.003256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dc173-33ba-46e0-b148-af399c37ffdf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:21.007092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc173-33ba-46e0-b148-af399c37ffdf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:21.009048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc173-33ba-46e0-b148-af399c37ffdf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:21.010649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc173-33ba-46e0-b148-af399c37ffdf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:21.015191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dc173-33ba-46e0-b148-af399c37ffdf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:21.019756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dc173-33ba-46e0-b148-af399c37ffdf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:21.087243 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3824/7709] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:20 2022] POST /identity/v3/roles => generated 247 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:21.091124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2811da-c66d-4c7f-a12a-50b313717c90 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:21.110529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2811da-c66d-4c7f-a12a-50b313717c90 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:21.116619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9034f53-65ca-4060-bc80-edf883423e9e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:21.117501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9034f53-65ca-4060-bc80-edf883423e9e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:21.118129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9034f53-65ca-4060-bc80-edf883423e9e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:21.118685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9034f53-65ca-4060-bc80-edf883423e9e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/ab470695b5af461d9ff128cf2460f8c3/users/b1c257dcdbbc4cb594902ec57b0096cd/roles/a4e50b0799a84afab9813d5a8700634f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:21.148726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9034f53-65ca-4060-bc80-edf883423e9e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ab470695b5af461d9ff128cf2460f8c3, user_id=b1c257dcdbbc4cb594902ec57b0096cd, role_id=a4e50b0799a84afab9813d5a8700634f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:21.153079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9034f53-65ca-4060-bc80-edf883423e9e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:21.186279 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3886/7710] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:21 2022] PUT /identity/v3/projects/ab470695b5af461d9ff128cf2460f8c3/users/b1c257dcdbbc4cb594902ec57b0096cd/roles/a4e50b0799a84afab9813d5a8700634f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:21.189996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dc173-33ba-46e0-b148-af399c37ffdf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:21.205290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dc173-33ba-46e0-b148-af399c37ffdf tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:21.232396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:21.367365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307b227-df41-45de-a0a0-dfc6415b8889 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:21.369804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b227-df41-45de-a0a0-dfc6415b8889 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:21.370095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b227-df41-45de-a0a0-dfc6415b8889 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:21.378164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307b227-df41-45de-a0a0-dfc6415b8889 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/ab470695b5af461d9ff128cf2460f8c3/users/b1c257dcdbbc4cb594902ec57b0096cd/roles/c92624385dff4732a7b07e9f09637642` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:21.385375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307b227-df41-45de-a0a0-dfc6415b8889 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ab470695b5af461d9ff128cf2460f8c3, user_id=b1c257dcdbbc4cb594902ec57b0096cd, role_id=c92624385dff4732a7b07e9f09637642)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:21.388705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307b227-df41-45de-a0a0-dfc6415b8889 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:21.409022 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3825/7711] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:21 2022] PUT /identity/v3/projects/ab470695b5af461d9ff128cf2460f8c3/users/b1c257dcdbbc4cb594902ec57b0096cd/roles/c92624385dff4732a7b07e9f09637642 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:21.413814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9034f53-65ca-4060-bc80-edf883423e9e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:21.428220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9034f53-65ca-4060-bc80-edf883423e9e tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:21.548925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1104e-4a20-45b5-bd87-da7ffdadbf7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:21.550058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1104e-4a20-45b5-bd87-da7ffdadbf7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:21.550353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1104e-4a20-45b5-bd87-da7ffdadbf7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:21.550633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1104e-4a20-45b5-bd87-da7ffdadbf7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:21.551507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1104e-4a20-45b5-bd87-da7ffdadbf7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:21.553607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1104e-4a20-45b5-bd87-da7ffdadbf7b tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:21.612769 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3887/7712] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:21 2022] GET /identity/v3/users => generated 7195 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:21.618295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524cd59-e744-473b-8902-aa496e173c81 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:21.618583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524cd59-e744-473b-8902-aa496e173c81 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:21.618874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524cd59-e744-473b-8902-aa496e173c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:21.775818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8524cd59-e744-473b-8902-aa496e173c81 None None] MFA Rules not processed for user `b1c257dcdbbc4cb594902ec57b0096cd`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:21.777070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8524cd59-e744-473b-8902-aa496e173c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:22.030580 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3826/7713] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:21 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:22.031768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d19ed-b4b8-43f6-8062-846cb6a23832 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:22.032161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d19ed-b4b8-43f6-8062-846cb6a23832 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:22.032529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d19ed-b4b8-43f6-8062-846cb6a23832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:22.078116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a52d19ed-b4b8-43f6-8062-846cb6a23832 None None] MFA Rules not processed for user `b1c257dcdbbc4cb594902ec57b0096cd`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:22.079493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a52d19ed-b4b8-43f6-8062-846cb6a23832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:22.091692 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3888/7714] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:22.092991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524cd59-e744-473b-8902-aa496e173c81 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:22.104448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524cd59-e744-473b-8902-aa496e173c81 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:22.112123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd5b35-cd21-413f-a359-b78b7c07cf5b tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c257dcdbbc4cb594902ec57b0096cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab470695b5af461d9ff128cf2460f8c3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1608159537', 'tempest-DelegatedRole-360586464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:22.112908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd5b35-cd21-413f-a359-b78b7c07cf5b tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:22.113444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd5b35-cd21-413f-a359-b78b7c07cf5b tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:22.113839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd5b35-cd21-413f-a359-b78b7c07cf5b tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:22.114621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd5b35-cd21-413f-a359-b78b7c07cf5b tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorizing `identity:create_trust()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:22.115937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd5b35-cd21-413f-a359-b78b7c07cf5b tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:22.284171 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3827/7715] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Aug 29 15:59:22 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:22.285020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d19ed-b4b8-43f6-8062-846cb6a23832 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:22.296308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d19ed-b4b8-43f6-8062-846cb6a23832 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:22.308750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649548d5-cd29-4d78-8672-9005db05eea5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c257dcdbbc4cb594902ec57b0096cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab470695b5af461d9ff128cf2460f8c3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1608159537', 'tempest-DelegatedRole-360586464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:22.309676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649548d5-cd29-4d78-8672-9005db05eea5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:22.310427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649548d5-cd29-4d78-8672-9005db05eea5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:22.310892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649548d5-cd29-4d78-8672-9005db05eea5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] PATH_INFO: `/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:22.346095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649548d5-cd29-4d78-8672-9005db05eea5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorizing `identity:get_trust(trust_id=07be26f3ab1d4f1bbe5670f5159ba3fe)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:22.347577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649548d5-cd29-4d78-8672-9005db05eea5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:22.368521 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3889/7716] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:22 2022] GET /identity/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe => generated 833 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:59:22.373117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd5b35-cd21-413f-a359-b78b7c07cf5b tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:22.392022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd5b35-cd21-413f-a359-b78b7c07cf5b tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:22.399512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae7b9-fdab-451f-8de6-0de42b2becf0 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c257dcdbbc4cb594902ec57b0096cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab470695b5af461d9ff128cf2460f8c3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1608159537', 'tempest-DelegatedRole-360586464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:22.400173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae7b9-fdab-451f-8de6-0de42b2becf0 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:22.400459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae7b9-fdab-451f-8de6-0de42b2becf0 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:22.400750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae7b9-fdab-451f-8de6-0de42b2becf0 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] PATH_INFO: `/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:22.414988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfae7b9-fdab-451f-8de6-0de42b2becf0 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=07be26f3ab1d4f1bbe5670f5159ba3fe)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:22.418349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfae7b9-fdab-451f-8de6-0de42b2becf0 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:22.466487 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3828/7717] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:59:22 2022] GET /identity/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe/roles => generated 370 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:22.470472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649548d5-cd29-4d78-8672-9005db05eea5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:22.485340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649548d5-cd29-4d78-8672-9005db05eea5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:22.491237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bb9ea-0ebd-440d-81a7-20b8c1557483 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c257dcdbbc4cb594902ec57b0096cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab470695b5af461d9ff128cf2460f8c3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1608159537', 'tempest-DelegatedRole-360586464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:22.492057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bb9ea-0ebd-440d-81a7-20b8c1557483 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:22.493047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bb9ea-0ebd-440d-81a7-20b8c1557483 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:22.493419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bb9ea-0ebd-440d-81a7-20b8c1557483 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] PATH_INFO: `/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe/roles/a4e50b0799a84afab9813d5a8700634f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:22.512455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bb9ea-0ebd-440d-81a7-20b8c1557483 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorizing `identity:get_role_for_trust(trust_id=07be26f3ab1d4f1bbe5670f5159ba3fe, role_id=a4e50b0799a84afab9813d5a8700634f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:22.514611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bb9ea-0ebd-440d-81a7-20b8c1557483 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:22.525629 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3890/7718] 10.222.0.16 () {58 vars in 1368 bytes} [Mon Aug 29 15:59:22 2022] GET /identity/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe/roles/a4e50b0799a84afab9813d5a8700634f => generated 243 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:22.529660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae7b9-fdab-451f-8de6-0de42b2becf0 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:22.545151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae7b9-fdab-451f-8de6-0de42b2becf0 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:22.556473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c128bf-170c-43d9-971b-cb533201cee9 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c257dcdbbc4cb594902ec57b0096cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab470695b5af461d9ff128cf2460f8c3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1608159537', 'tempest-DelegatedRole-360586464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:22.557879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c128bf-170c-43d9-971b-cb533201cee9 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:22.558360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c128bf-170c-43d9-971b-cb533201cee9 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:22.559131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c128bf-170c-43d9-971b-cb533201cee9 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] PATH_INFO: `/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe/roles/a4e50b0799a84afab9813d5a8700634f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:22.567343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:22.582873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c128bf-170c-43d9-971b-cb533201cee9 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorizing `identity:get_role_for_trust(trust_id=07be26f3ab1d4f1bbe5670f5159ba3fe, role_id=a4e50b0799a84afab9813d5a8700634f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:22.585561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c128bf-170c-43d9-971b-cb533201cee9 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:22.599348 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3829/7719] 10.222.0.16 () {58 vars in 1369 bytes} [Mon Aug 29 15:59:22 2022] HEAD /identity/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe/roles/a4e50b0799a84afab9813d5a8700634f => generated 0 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 29 15:59:22.604140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bb9ea-0ebd-440d-81a7-20b8c1557483 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:22.633228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bb9ea-0ebd-440d-81a7-20b8c1557483 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:22.639745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914f40-fb48-41fd-9131-4c06397aa434 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c257dcdbbc4cb594902ec57b0096cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab470695b5af461d9ff128cf2460f8c3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1608159537', 'tempest-DelegatedRole-360586464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:22.640420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914f40-fb48-41fd-9131-4c06397aa434 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:22.640705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914f40-fb48-41fd-9131-4c06397aa434 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:22.641183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914f40-fb48-41fd-9131-4c06397aa434 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] PATH_INFO: `/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe/roles/c92624385dff4732a7b07e9f09637642` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:22.650847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23914f40-fb48-41fd-9131-4c06397aa434 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorizing `identity:get_role_for_trust(trust_id=07be26f3ab1d4f1bbe5670f5159ba3fe, role_id=c92624385dff4732a7b07e9f09637642)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:22.655134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23914f40-fb48-41fd-9131-4c06397aa434 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-23914f40-fb48-41fd-9131-4c06397aa434 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Could not find role: c92624385dff4732a7b07e9f09637642.: keystone.exception.RoleNotFound: Could not find role: c92624385dff4732a7b07e9f09637642. Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:59:22.673363 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c92624385dff4732a7b07e9f09637642. Aug 29 15:59:22.674833 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:59:22.679785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c128bf-170c-43d9-971b-cb533201cee9 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:22.686540 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3891/7720] 10.222.0.16 () {58 vars in 1368 bytes} [Mon Aug 29 15:59:22 2022] GET /identity/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe/roles/c92624385dff4732a7b07e9f09637642 => generated 110 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:59:22.690535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c128bf-170c-43d9-971b-cb533201cee9 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:22.695410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc7d69-47e8-49f5-a909-7f48ee715597 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c257dcdbbc4cb594902ec57b0096cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab470695b5af461d9ff128cf2460f8c3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1608159537', 'tempest-DelegatedRole-360586464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:22.695965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7d69-47e8-49f5-a909-7f48ee715597 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:22.696256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7d69-47e8-49f5-a909-7f48ee715597 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:22.696539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7d69-47e8-49f5-a909-7f48ee715597 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] PATH_INFO: `/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe/roles/c92624385dff4732a7b07e9f09637642` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:22.719423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc7d69-47e8-49f5-a909-7f48ee715597 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorizing `identity:get_role_for_trust(trust_id=07be26f3ab1d4f1bbe5670f5159ba3fe, role_id=c92624385dff4732a7b07e9f09637642)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:22.723052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc7d69-47e8-49f5-a909-7f48ee715597 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-64cc7d69-47e8-49f5-a909-7f48ee715597 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Could not find role: c92624385dff4732a7b07e9f09637642.: keystone.exception.RoleNotFound: Could not find role: c92624385dff4732a7b07e9f09637642. Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:59:22.758543 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c92624385dff4732a7b07e9f09637642. Aug 29 15:59:22.759928 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:22.759928 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3830/7721] 10.222.0.16 () {58 vars in 1369 bytes} [Mon Aug 29 15:59:22 2022] HEAD /identity/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe/roles/c92624385dff4732a7b07e9f09637642 => generated 0 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 29 15:59:22.761256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914f40-fb48-41fd-9131-4c06397aa434 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:22.780181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914f40-fb48-41fd-9131-4c06397aa434 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:22.793474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c257dcdbbc4cb594902ec57b0096cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab470695b5af461d9ff128cf2460f8c3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1608159537', 'tempest-DelegatedRole-360586464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:22.794140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:22.794422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:22.794694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] PATH_INFO: `/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:22.802515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorizing `identity:delete_trust(trust_id=07be26f3ab1d4f1bbe5670f5159ba3fe)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:22.805156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:22.833609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '07be26f3ab1d4f1bbe5670f5159ba3fe', 'request_id': 'req-47553559-100a-43e1-b2b4-8c82294c9621'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:22.835506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '07be26f3ab1d4f1bbe5670f5159ba3fe', 'request_id': 'req-47553559-100a-43e1-b2b4-8c82294c9621'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:22.847187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '07be26f3ab1d4f1bbe5670f5159ba3fe', 'request_id': 'req-47553559-100a-43e1-b2b4-8c82294c9621'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:22.867123 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3892/7722] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 15:59:22 2022] DELETE /identity/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:22.868459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc7d69-47e8-49f5-a909-7f48ee715597 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:22.870413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-64cc7d69-47e8-49f5-a909-7f48ee715597 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:22.890195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc7d69-47e8-49f5-a909-7f48ee715597 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:22.896084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74fe9f-a678-4349-9c97-11d84599bdb5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c257dcdbbc4cb594902ec57b0096cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab470695b5af461d9ff128cf2460f8c3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1608159537', 'tempest-DelegatedRole-360586464'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:22.897371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74fe9f-a678-4349-9c97-11d84599bdb5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:22.897877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74fe9f-a678-4349-9c97-11d84599bdb5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:22.898168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74fe9f-a678-4349-9c97-11d84599bdb5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] PATH_INFO: `/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-7b74fe9f-a678-4349-9c97-11d84599bdb5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Could not find trust: 07be26f3ab1d4f1bbe5670f5159ba3fe.: keystone.exception.TrustNotFound: Could not find trust: 07be26f3ab1d4f1bbe5670f5159ba3fe. Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 29 15:59:22.910105 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 07be26f3ab1d4f1bbe5670f5159ba3fe. Aug 29 15:59:22.911190 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:22.912189 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3831/7723] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:22 2022] GET /identity/v3/OS-TRUST/trusts/07be26f3ab1d4f1bbe5670f5159ba3fe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:59:22.916405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:22.918308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:22.954730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47553559-100a-43e1-b2b4-8c82294c9621 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:22.970005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251022f2-091f-469e-b3f8-7ab357ccd587 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:22.970664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251022f2-091f-469e-b3f8-7ab357ccd587 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:22.970953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251022f2-091f-469e-b3f8-7ab357ccd587 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:22.971234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251022f2-091f-469e-b3f8-7ab357ccd587 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/c92624385dff4732a7b07e9f09637642` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:22.972996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251022f2-091f-469e-b3f8-7ab357ccd587 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c92624385dff4732a7b07e9f09637642)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:22.978558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251022f2-091f-469e-b3f8-7ab357ccd587 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:23.028497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:23.063502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-251022f2-091f-469e-b3f8-7ab357ccd587 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role c92624385dff4732a7b07e9f09637642 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:23.064398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-251022f2-091f-469e-b3f8-7ab357ccd587 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:23.064876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-251022f2-091f-469e-b3f8-7ab357ccd587 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:23.068582 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3893/7724] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:22 2022] DELETE /identity/v3/roles/c92624385dff4732a7b07e9f09637642 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:23.072303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74fe9f-a678-4349-9c97-11d84599bdb5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:23.074202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7b74fe9f-a678-4349-9c97-11d84599bdb5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:23.094800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74fe9f-a678-4349-9c97-11d84599bdb5 tempest-TrustsV3TestJSON-2009761950 tempest-user-1737901928] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:23.237642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ba5e4-f3fb-4212-8f08-546f49badd1c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:23.238305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ba5e4-f3fb-4212-8f08-546f49badd1c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:23.238594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ba5e4-f3fb-4212-8f08-546f49badd1c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:23.238874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ba5e4-f3fb-4212-8f08-546f49badd1c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/a4e50b0799a84afab9813d5a8700634f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:23.246646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ba5e4-f3fb-4212-8f08-546f49badd1c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a4e50b0799a84afab9813d5a8700634f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:23.249025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ba5e4-f3fb-4212-8f08-546f49badd1c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:23.370719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7d6ba5e4-f3fb-4212-8f08-546f49badd1c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role a4e50b0799a84afab9813d5a8700634f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:23.372178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7d6ba5e4-f3fb-4212-8f08-546f49badd1c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:23.379130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7d6ba5e4-f3fb-4212-8f08-546f49badd1c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:23.388392 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3832/7725] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:23 2022] DELETE /identity/v3/roles/a4e50b0799a84afab9813d5a8700634f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:23.389142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251022f2-091f-469e-b3f8-7ab357ccd587 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:23.407710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251022f2-091f-469e-b3f8-7ab357ccd587 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:23.543681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:23.544679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:23.546680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:23.549914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users/b1c257dcdbbc4cb594902ec57b0096cd` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:23.551938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b1c257dcdbbc4cb594902ec57b0096cd)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:23.554688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:23.597585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487818-c88f-482a-81b0-c2805bac48d2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:23.598034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487818-c88f-482a-81b0-c2805bac48d2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:23.600363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487818-c88f-482a-81b0-c2805bac48d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:23.624779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c257dcdbbc4cb594902ec57b0096cd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:23.626215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c257dcdbbc4cb594902ec57b0096cd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:23.651987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c257dcdbbc4cb594902ec57b0096cd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:23.655363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c257dcdbbc4cb594902ec57b0096cd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:23.683010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c257dcdbbc4cb594902ec57b0096cd'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:23.686600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ac487818-c88f-482a-81b0-c2805bac48d2 None None] MFA Rules not processed for user `4ba6354796c546649f20d0dbe3cb3706`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:23.687976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ac487818-c88f-482a-81b0-c2805bac48d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:23.737482 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3894/7726] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:23 2022] DELETE /identity/v3/users/b1c257dcdbbc4cb594902ec57b0096cd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:23.738543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:23.740034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:23.919382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daf69e-4632-43cc-af7d-125232bb18d4 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:23.926909 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3833/7727] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:23.936151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac487818-c88f-482a-81b0-c2805bac48d2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:23.941777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ac487818-c88f-482a-81b0-c2805bac48d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:23.942105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:23.944326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:23.944615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:23.944891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] PATH_INFO: `/v3/users/633e6c0f844c4deaa26d32dabf1b02c3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:23.947106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=633e6c0f844c4deaa26d32dabf1b02c3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:23.949071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:23.984663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:23.986506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac487818-c88f-482a-81b0-c2805bac48d2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:24.035783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:24.133683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633e6c0f844c4deaa26d32dabf1b02c3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:24.135057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633e6c0f844c4deaa26d32dabf1b02c3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:24.139951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:24.140746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:24.141879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:24.142415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/ab470695b5af461d9ff128cf2460f8c3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:24.146298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ab470695b5af461d9ff128cf2460f8c3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:24.151082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:24.168033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633e6c0f844c4deaa26d32dabf1b02c3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:24.169172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633e6c0f844c4deaa26d32dabf1b02c3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:24.186504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633e6c0f844c4deaa26d32dabf1b02c3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:24.233040 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3895/7728] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:23 2022] DELETE /identity/v3/users/633e6c0f844c4deaa26d32dabf1b02c3 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:24.235449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:24.245933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:24.286769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab470695b5af461d9ff128cf2460f8c3', 'request_id': 'req-e8241102-5f06-4a94-aaf0-6980fb399c68'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:24.301604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab470695b5af461d9ff128cf2460f8c3', 'request_id': 'req-e8241102-5f06-4a94-aaf0-6980fb399c68'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:24.314707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab470695b5af461d9ff128cf2460f8c3', 'request_id': 'req-e8241102-5f06-4a94-aaf0-6980fb399c68'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:24.343510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] The token cache is being invalidate because project ab470695b5af461d9ff128cf2460f8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:24.344361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:24.346216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e8241102-5f06-4a94-aaf0-6980fb399c68 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:24.357041 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3834/7729] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:23 2022] DELETE /identity/v3/projects/ab470695b5af461d9ff128cf2460f8c3 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:24.363038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a56ce0-a790-4a69-abb9-1e433dd84765 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:24.364440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a56ce0-a790-4a69-abb9-1e433dd84765 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:24.364928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a56ce0-a790-4a69-abb9-1e433dd84765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:24.421953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f5a56ce0-a790-4a69-abb9-1e433dd84765 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:24.423326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f5a56ce0-a790-4a69-abb9-1e433dd84765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:24.437983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6b38f-c6ea-4f3b-859d-4b0035a33af2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:24.610899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917e2b7-5c0b-4719-969e-e0eee5617576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:24.613444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917e2b7-5c0b-4719-969e-e0eee5617576 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:24.615041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917e2b7-5c0b-4719-969e-e0eee5617576 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:24.617675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917e2b7-5c0b-4719-969e-e0eee5617576 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:24.619933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917e2b7-5c0b-4719-969e-e0eee5617576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:24.626299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917e2b7-5c0b-4719-969e-e0eee5617576 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:24.649978 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3835/7730] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:24.651845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a56ce0-a790-4a69-abb9-1e433dd84765 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:24.665887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f5a56ce0-a790-4a69-abb9-1e433dd84765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:24.743668 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3896/7731] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:24 2022] POST /identity/v3/projects => generated 373 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:24.747238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917e2b7-5c0b-4719-969e-e0eee5617576 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:24.758631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6917e2b7-5c0b-4719-969e-e0eee5617576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:24.872970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:24.875540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:24.972534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a56ce0-a790-4a69-abb9-1e433dd84765 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:25.027774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917e2b7-5c0b-4719-969e-e0eee5617576 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:25.044110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7b449-7639-4fb4-a705-b7d19e7f9a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:25.045503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b449-7639-4fb4-a705-b7d19e7f9a9e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:25.046122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b449-7639-4fb4-a705-b7d19e7f9a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:25.046826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b449-7639-4fb4-a705-b7d19e7f9a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:25.211027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc580299-ed34-40b0-b5fc-e16f8588192d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:25.213032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc580299-ed34-40b0-b5fc-e16f8588192d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:25.213336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc580299-ed34-40b0-b5fc-e16f8588192d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:25.213653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc580299-ed34-40b0-b5fc-e16f8588192d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:25.221732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc580299-ed34-40b0-b5fc-e16f8588192d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:25.226993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc580299-ed34-40b0-b5fc-e16f8588192d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:25.309019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7b449-7639-4fb4-a705-b7d19e7f9a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:25.316819 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3836/7732] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Aug 29 15:59:24 2022] POST /identity/v3/projects => generated 327 bytes in 667 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:25.318725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc580299-ed34-40b0-b5fc-e16f8588192d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:25.322355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dc580299-ed34-40b0-b5fc-e16f8588192d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:25.326451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7b449-7639-4fb4-a705-b7d19e7f9a9e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:25.391329 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3897/7733] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:25.395005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7b449-7639-4fb4-a705-b7d19e7f9a9e service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:25.432297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7b449-7639-4fb4-a705-b7d19e7f9a9e service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:25.499300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc580299-ed34-40b0-b5fc-e16f8588192d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:25.507504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42b40c-4760-4dd6-8b42-1fbaa12254af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:25.508273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b40c-4760-4dd6-8b42-1fbaa12254af admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:25.508696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b40c-4760-4dd6-8b42-1fbaa12254af admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:25.508992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b40c-4760-4dd6-8b42-1fbaa12254af admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:25.517668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42b40c-4760-4dd6-8b42-1fbaa12254af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:25.520700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42b40c-4760-4dd6-8b42-1fbaa12254af admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:25.565574 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3837/7734] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:25 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:25.574250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42b40c-4760-4dd6-8b42-1fbaa12254af admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:25.592791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42b40c-4760-4dd6-8b42-1fbaa12254af admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:25.602170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47044e-5daa-49b8-bc2f-44c24cf05b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:25.602798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47044e-5daa-49b8-bc2f-44c24cf05b8b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:25.603082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47044e-5daa-49b8-bc2f-44c24cf05b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:25.603361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47044e-5daa-49b8-bc2f-44c24cf05b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:25.610849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47044e-5daa-49b8-bc2f-44c24cf05b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:25.619934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47044e-5daa-49b8-bc2f-44c24cf05b8b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:25.645995 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3838/7735] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:25.651600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47044e-5daa-49b8-bc2f-44c24cf05b8b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:25.664509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47044e-5daa-49b8-bc2f-44c24cf05b8b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:25.665624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af506ac-1ea3-47df-995d-4a7b6da23e67 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:25.666428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af506ac-1ea3-47df-995d-4a7b6da23e67 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:25.666851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af506ac-1ea3-47df-995d-4a7b6da23e67 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:25.667241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af506ac-1ea3-47df-995d-4a7b6da23e67 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:25.668046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af506ac-1ea3-47df-995d-4a7b6da23e67 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:25.679042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8348b-42a2-4ccb-ae0c-0e5377f0f400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:25.679042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8348b-42a2-4ccb-ae0c-0e5377f0f400 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:25.679385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af506ac-1ea3-47df-995d-4a7b6da23e67 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:25.679514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8348b-42a2-4ccb-ae0c-0e5377f0f400 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:25.679514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8348b-42a2-4ccb-ae0c-0e5377f0f400 admin admin] PATH_INFO: `/v3/projects/7f91eea2e8d442b9bdd675c975233f0f/users/490767a5516a43a1817cc53e8bf311a1/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:25.719403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8348b-42a2-4ccb-ae0c-0e5377f0f400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f91eea2e8d442b9bdd675c975233f0f, user_id=490767a5516a43a1817cc53e8bf311a1, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:25.727531 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3898/7736] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:25 2022] POST /identity/v3/users => generated 416 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:25.728131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8348b-42a2-4ccb-ae0c-0e5377f0f400 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:25.729178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af506ac-1ea3-47df-995d-4a7b6da23e67 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:25.751336 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3839/7737] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:25 2022] PUT /identity/v3/projects/7f91eea2e8d442b9bdd675c975233f0f/users/490767a5516a43a1817cc53e8bf311a1/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:25.756661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8348b-42a2-4ccb-ae0c-0e5377f0f400 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:25.758036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af506ac-1ea3-47df-995d-4a7b6da23e67 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:25.866572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:25.914312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01623901-86d7-450e-ba47-9ca9d2d40739 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:25.914957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623901-86d7-450e-ba47-9ca9d2d40739 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:25.915376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623901-86d7-450e-ba47-9ca9d2d40739 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:25.915507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623901-86d7-450e-ba47-9ca9d2d40739 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:25.916191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01623901-86d7-450e-ba47-9ca9d2d40739 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:25.917869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01623901-86d7-450e-ba47-9ca9d2d40739 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:25.919041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8348b-42a2-4ccb-ae0c-0e5377f0f400 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:25.924380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:25.933644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f58b82-44b2-42b6-b8f2-68f7975f69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:25.934494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f58b82-44b2-42b6-b8f2-68f7975f69d4 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:25.935383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f58b82-44b2-42b6-b8f2-68f7975f69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:25.936260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f58b82-44b2-42b6-b8f2-68f7975f69d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:25.938761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f58b82-44b2-42b6-b8f2-68f7975f69d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:25.943128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f58b82-44b2-42b6-b8f2-68f7975f69d4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:25.951677 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3899/7738] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:25 2022] POST /identity/v3/roles => generated 244 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:25.956447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01623901-86d7-450e-ba47-9ca9d2d40739 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:25.982460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01623901-86d7-450e-ba47-9ca9d2d40739 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:25.989274 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3840/7739] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:25 2022] GET /identity/v3/roles => generated 1655 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:25.992255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f58b82-44b2-42b6-b8f2-68f7975f69d4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:26.002804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed855f52-ef6a-463b-b6e2-42c86ca49806 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:26.003348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed855f52-ef6a-463b-b6e2-42c86ca49806 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:26.003634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed855f52-ef6a-463b-b6e2-42c86ca49806 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:26.003928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed855f52-ef6a-463b-b6e2-42c86ca49806 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:26.004579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed855f52-ef6a-463b-b6e2-42c86ca49806 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:26.009233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed855f52-ef6a-463b-b6e2-42c86ca49806 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:26.018129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f58b82-44b2-42b6-b8f2-68f7975f69d4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:26.034300 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3900/7740] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Aug 29 15:59:25 2022] POST /identity/v3/roles => generated 247 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:26.035238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed855f52-ef6a-463b-b6e2-42c86ca49806 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:26.037627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ed855f52-ef6a-463b-b6e2-42c86ca49806 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:26.045039 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196c1d-fd6f-49ba-a8c5-10785881d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:26.047085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196c1d-fd6f-49ba-a8c5-10785881d6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:26.048244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196c1d-fd6f-49ba-a8c5-10785881d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:26.048659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196c1d-fd6f-49ba-a8c5-10785881d6b3 admin admin] PATH_INFO: `/v3/projects/7f91eea2e8d442b9bdd675c975233f0f/users/490767a5516a43a1817cc53e8bf311a1/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:26.053316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1196c1d-fd6f-49ba-a8c5-10785881d6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f91eea2e8d442b9bdd675c975233f0f, user_id=490767a5516a43a1817cc53e8bf311a1, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:26.056377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1196c1d-fd6f-49ba-a8c5-10785881d6b3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:26.058152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed855f52-ef6a-463b-b6e2-42c86ca49806 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:26.069765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:26.070642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:26.070924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:26.071199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] PATH_INFO: `/v3/projects/a2dbd91a0b1d455ab8ec55eeeb3d0520` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:26.079110 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3841/7741] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:25 2022] PUT /identity/v3/projects/7f91eea2e8d442b9bdd675c975233f0f/users/490767a5516a43a1817cc53e8bf311a1/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:26.079110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196c1d-fd6f-49ba-a8c5-10785881d6b3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:26.079416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2dbd91a0b1d455ab8ec55eeeb3d0520)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:26.079760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:26.197524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2dbd91a0b1d455ab8ec55eeeb3d0520', 'request_id': 'req-832d2f16-8e17-426f-91e0-e9656e72991c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:26.204933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2dbd91a0b1d455ab8ec55eeeb3d0520', 'request_id': 'req-832d2f16-8e17-426f-91e0-e9656e72991c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:26.214677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2dbd91a0b1d455ab8ec55eeeb3d0520', 'request_id': 'req-832d2f16-8e17-426f-91e0-e9656e72991c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:26.227610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] The token cache is being invalidate because project a2dbd91a0b1d455ab8ec55eeeb3d0520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:26.227906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:26.231275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-832d2f16-8e17-426f-91e0-e9656e72991c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:26.233262 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3901/7742] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:26 2022] DELETE /identity/v3/projects/a2dbd91a0b1d455ab8ec55eeeb3d0520 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:26.240350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ce4da-04cf-4a1c-9c21-8c942441486f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:26.240911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ce4da-04cf-4a1c-9c21-8c942441486f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:26.241173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ce4da-04cf-4a1c-9c21-8c942441486f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:26.282458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196c1d-fd6f-49ba-a8c5-10785881d6b3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:26.286643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-880ce4da-04cf-4a1c-9c21-8c942441486f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:26.288655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-880ce4da-04cf-4a1c-9c21-8c942441486f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:26.437362 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3902/7743] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:26.445506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbfa4b-e75e-4ed6-8c8e-48402100ba59 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:26.446124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbfa4b-e75e-4ed6-8c8e-48402100ba59 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:26.446596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbfa4b-e75e-4ed6-8c8e-48402100ba59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:26.486505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703a029-2d17-4d23-ac22-fdcaab708979 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:26.487390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a029-2d17-4d23-ac22-fdcaab708979 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:26.489055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a029-2d17-4d23-ac22-fdcaab708979 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:26.489055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a029-2d17-4d23-ac22-fdcaab708979 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/779e852bbdfc4ee3bbca65fcbdec6a7b/users/5dd286e2afc44a5994a89326abb8d89a/roles/12398de1fc464feea45a327bc5274d8a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:26.541056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d6bbfa4b-e75e-4ed6-8c8e-48402100ba59 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:26.544924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d6bbfa4b-e75e-4ed6-8c8e-48402100ba59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:26.550192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703a029-2d17-4d23-ac22-fdcaab708979 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=779e852bbdfc4ee3bbca65fcbdec6a7b, user_id=5dd286e2afc44a5994a89326abb8d89a, role_id=12398de1fc464feea45a327bc5274d8a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:26.553901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703a029-2d17-4d23-ac22-fdcaab708979 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:26.575525 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3903/7744] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:26.580225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbfa4b-e75e-4ed6-8c8e-48402100ba59 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:26.596613 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3842/7745] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:26 2022] PUT /identity/v3/projects/779e852bbdfc4ee3bbca65fcbdec6a7b/users/5dd286e2afc44a5994a89326abb8d89a/roles/12398de1fc464feea45a327bc5274d8a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:26.607032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703a029-2d17-4d23-ac22-fdcaab708979 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:26.609732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbfa4b-e75e-4ed6-8c8e-48402100ba59 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:26.611510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c703a029-2d17-4d23-ac22-fdcaab708979 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:26.791124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:26.821423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfbca5-9689-45e3-81a1-b8a0280f14f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:26.823274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfbca5-9689-45e3-81a1-b8a0280f14f9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:26.823566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfbca5-9689-45e3-81a1-b8a0280f14f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:26.824039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfbca5-9689-45e3-81a1-b8a0280f14f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:26.824724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfbca5-9689-45e3-81a1-b8a0280f14f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:26.825085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfbca5-9689-45e3-81a1-b8a0280f14f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:26.827505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703a029-2d17-4d23-ac22-fdcaab708979 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:26.831110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfbca5-9689-45e3-81a1-b8a0280f14f9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:26.833354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:26.834973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33c43e-87c1-40ed-9a28-ffcc387c3f8c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:26.836406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33c43e-87c1-40ed-9a28-ffcc387c3f8c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:26.836807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33c43e-87c1-40ed-9a28-ffcc387c3f8c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:26.837198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33c43e-87c1-40ed-9a28-ffcc387c3f8c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/779e852bbdfc4ee3bbca65fcbdec6a7b/users/5dd286e2afc44a5994a89326abb8d89a/roles/f12c153be5574506855bf74e05464d87` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:26.840935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33c43e-87c1-40ed-9a28-ffcc387c3f8c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:create_grant(project_id=779e852bbdfc4ee3bbca65fcbdec6a7b, user_id=5dd286e2afc44a5994a89326abb8d89a, role_id=f12c153be5574506855bf74e05464d87)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:26.844852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33c43e-87c1-40ed-9a28-ffcc387c3f8c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:26.875507 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3904/7746] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:59:26.877023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfbca5-9689-45e3-81a1-b8a0280f14f9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:26.879701 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3843/7747] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:26 2022] PUT /identity/v3/projects/779e852bbdfc4ee3bbca65fcbdec6a7b/users/5dd286e2afc44a5994a89326abb8d89a/roles/f12c153be5574506855bf74e05464d87 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:26.881050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33c43e-87c1-40ed-9a28-ffcc387c3f8c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:26.893637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfbca5-9689-45e3-81a1-b8a0280f14f9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:26.976867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33c43e-87c1-40ed-9a28-ffcc387c3f8c tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:26.982972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038b51e-97f5-4fb7-8fa6-b68042680d56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:26.985343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b51e-97f5-4fb7-8fa6-b68042680d56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:26.985802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b51e-97f5-4fb7-8fa6-b68042680d56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:26.986250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b51e-97f5-4fb7-8fa6-b68042680d56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:26.987043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038b51e-97f5-4fb7-8fa6-b68042680d56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:26.989713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038b51e-97f5-4fb7-8fa6-b68042680d56 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:27.029442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9eec18-4d90-4507-b3d7-915d6b8b0b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:27.030075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eec18-4d90-4507-b3d7-915d6b8b0b04 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:27.030411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eec18-4d90-4507-b3d7-915d6b8b0b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:27.030762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eec18-4d90-4507-b3d7-915d6b8b0b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:27.031457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9eec18-4d90-4507-b3d7-915d6b8b0b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:27.033411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9eec18-4d90-4507-b3d7-915d6b8b0b04 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:27.059786 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3844/7748] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:26 2022] GET /identity/v3/users => generated 7203 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:27.085027 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3905/7749] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:26 2022] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:27.085849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccece3-99e0-4c87-81b5-a842e4355a59 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:27.088726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9eec18-4d90-4507-b3d7-915d6b8b0b04 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:27.089969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccece3-99e0-4c87-81b5-a842e4355a59 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:27.091089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccece3-99e0-4c87-81b5-a842e4355a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:27.280374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f6ccece3-99e0-4c87-81b5-a842e4355a59 None None] MFA Rules not processed for user `5dd286e2afc44a5994a89326abb8d89a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:27.283643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f6ccece3-99e0-4c87-81b5-a842e4355a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:27.291266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9eec18-4d90-4507-b3d7-915d6b8b0b04 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:27.301755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7054f6-afb3-475c-b89e-43ac7682e022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:27.302460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7054f6-afb3-475c-b89e-43ac7682e022 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:27.302753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7054f6-afb3-475c-b89e-43ac7682e022 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:27.303033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7054f6-afb3-475c-b89e-43ac7682e022 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:27.303850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7054f6-afb3-475c-b89e-43ac7682e022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:27.307177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7054f6-afb3-475c-b89e-43ac7682e022 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:27.339017 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3906/7750] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:27 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:27.344774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7054f6-afb3-475c-b89e-43ac7682e022 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:27.369025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7054f6-afb3-475c-b89e-43ac7682e022 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:27.378897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755da2a0-fa4a-4abe-b2fa-7e903925ea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:27.379527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da2a0-fa4a-4abe-b2fa-7e903925ea1e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:27.379806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da2a0-fa4a-4abe-b2fa-7e903925ea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:27.380077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da2a0-fa4a-4abe-b2fa-7e903925ea1e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:27.384890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755da2a0-fa4a-4abe-b2fa-7e903925ea1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:27.386645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755da2a0-fa4a-4abe-b2fa-7e903925ea1e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:27.413572 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3907/7751] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:27 2022] GET /identity/v3/roles => generated 1893 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:27.415492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755da2a0-fa4a-4abe-b2fa-7e903925ea1e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:27.438097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755da2a0-fa4a-4abe-b2fa-7e903925ea1e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:27.448103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87c220-7b6a-41b7-9d9c-0e116944143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:27.449379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87c220-7b6a-41b7-9d9c-0e116944143b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:27.449688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87c220-7b6a-41b7-9d9c-0e116944143b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:27.450357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87c220-7b6a-41b7-9d9c-0e116944143b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:27.450716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87c220-7b6a-41b7-9d9c-0e116944143b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:27.456950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87c220-7b6a-41b7-9d9c-0e116944143b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:27.488618 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3908/7752] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:27 2022] GET /identity/v3/roles => generated 1893 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:27.493422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87c220-7b6a-41b7-9d9c-0e116944143b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:27.516005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87c220-7b6a-41b7-9d9c-0e116944143b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:27.529203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c940154-3347-4782-8212-c878f1789d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:27.531684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c940154-3347-4782-8212-c878f1789d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:27.533190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c940154-3347-4782-8212-c878f1789d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:27.533729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c940154-3347-4782-8212-c878f1789d6d admin admin] PATH_INFO: `/v3/projects/d0920eb168834c78b41f1fab7b138225/users/ceeb4f9e8ddc4d85a85f22f38d60cabb/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:27.534621 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3845/7753] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:27.552011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b4f36-e2e1-4460-9387-51b281cda120 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:27.553732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b4f36-e2e1-4460-9387-51b281cda120 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:27.554474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b4f36-e2e1-4460-9387-51b281cda120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:27.581994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c940154-3347-4782-8212-c878f1789d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0920eb168834c78b41f1fab7b138225, user_id=ceeb4f9e8ddc4d85a85f22f38d60cabb, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:27.585202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c940154-3347-4782-8212-c878f1789d6d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:27.599547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-018b4f36-e2e1-4460-9387-51b281cda120 None None] MFA Rules not processed for user `5dd286e2afc44a5994a89326abb8d89a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:27.609434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-018b4f36-e2e1-4460-9387-51b281cda120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:27.614447 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3909/7754] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:27 2022] PUT /identity/v3/projects/d0920eb168834c78b41f1fab7b138225/users/ceeb4f9e8ddc4d85a85f22f38d60cabb/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:27.625749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f2eab-cdb8-4558-8e22-976fe19db443 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:27.626300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f2eab-cdb8-4558-8e22-976fe19db443 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:27.626903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f2eab-cdb8-4558-8e22-976fe19db443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:27.714378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3c7f2eab-cdb8-4558-8e22-976fe19db443 None None] MFA Rules not processed for user `ceeb4f9e8ddc4d85a85f22f38d60cabb`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:27.716045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3c7f2eab-cdb8-4558-8e22-976fe19db443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:27.729679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:27.823743 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3846/7755] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:27.824828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b4f36-e2e1-4460-9387-51b281cda120 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:27.841967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b4f36-e2e1-4460-9387-51b281cda120 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:27.851081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcca67-5fb8-445e-877b-4891dc074ba0 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd286e2afc44a5994a89326abb8d89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1746232109', 'tempest-DelegatedRole-1588638309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:27.851777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcca67-5fb8-445e-877b-4891dc074ba0 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:27.852070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcca67-5fb8-445e-877b-4891dc074ba0 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:27.852439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcca67-5fb8-445e-877b-4891dc074ba0 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:27.863992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcca67-5fb8-445e-877b-4891dc074ba0 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorizing `identity:create_trust()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:27.863992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcca67-5fb8-445e-877b-4891dc074ba0 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:27.869684 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3910/7756] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:27.871313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c102d3-9ab8-4209-8b59-31c20b0e9a21 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:27.871766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c102d3-9ab8-4209-8b59-31c20b0e9a21 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:27.872202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c102d3-9ab8-4209-8b59-31c20b0e9a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:27.926864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:27.952413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-15c102d3-9ab8-4209-8b59-31c20b0e9a21 None None] MFA Rules not processed for user `490767a5516a43a1817cc53e8bf311a1`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:27.953933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-15c102d3-9ab8-4209-8b59-31c20b0e9a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:28.076612 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3847/7757] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Aug 29 15:59:27 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:28.077507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcca67-5fb8-445e-877b-4891dc074ba0 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:28.080271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8dbcca67-5fb8-445e-877b-4891dc074ba0 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:28.115925 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3911/7758] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:28.116942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c102d3-9ab8-4209-8b59-31c20b0e9a21 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:28.143261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c102d3-9ab8-4209-8b59-31c20b0e9a21 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:28.157904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68447429-82dc-47b6-b65d-5c1b0d00c20c tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd286e2afc44a5994a89326abb8d89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1746232109', 'tempest-DelegatedRole-1588638309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:28.158791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68447429-82dc-47b6-b65d-5c1b0d00c20c tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:28.159208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68447429-82dc-47b6-b65d-5c1b0d00c20c tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:28.159493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68447429-82dc-47b6-b65d-5c1b0d00c20c tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] PATH_INFO: `/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:28.173860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68447429-82dc-47b6-b65d-5c1b0d00c20c tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorizing `identity:get_trust(trust_id=87caf4631d34409b83cc8c2686490cc3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:28.178685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68447429-82dc-47b6-b65d-5c1b0d00c20c tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:28.217276 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3912/7759] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:28 2022] GET /identity/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3 => generated 835 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:28.219138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e9334-f5f1-4e6b-8636-52d0d49bd115 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:28.219438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e9334-f5f1-4e6b-8636-52d0d49bd115 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:28.219660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e9334-f5f1-4e6b-8636-52d0d49bd115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:28.261673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ba1e9334-f5f1-4e6b-8636-52d0d49bd115 None None] MFA Rules not processed for user `4ba6354796c546649f20d0dbe3cb3706`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:28.262914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ba1e9334-f5f1-4e6b-8636-52d0d49bd115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:28.288833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcca67-5fb8-445e-877b-4891dc074ba0 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:28.299311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df6fa2-8d7f-4c74-8678-37e6f56b9430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:28.301010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6fa2-8d7f-4c74-8678-37e6f56b9430 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:28.303300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6fa2-8d7f-4c74-8678-37e6f56b9430 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:28.303892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6fa2-8d7f-4c74-8678-37e6f56b9430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:28.338800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df6fa2-8d7f-4c74-8678-37e6f56b9430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:28.340587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df6fa2-8d7f-4c74-8678-37e6f56b9430 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:28.381222 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3848/7760] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:28.383600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df6fa2-8d7f-4c74-8678-37e6f56b9430 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:28.416772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df6fa2-8d7f-4c74-8678-37e6f56b9430 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:28.421907 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3913/7761] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:28.423054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e9334-f5f1-4e6b-8636-52d0d49bd115 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:28.428287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195ef47-fef7-400a-bf99-136a0b51e2f2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd286e2afc44a5994a89326abb8d89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1746232109', 'tempest-DelegatedRole-1588638309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:28.429255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195ef47-fef7-400a-bf99-136a0b51e2f2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:28.429938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195ef47-fef7-400a-bf99-136a0b51e2f2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:28.432599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195ef47-fef7-400a-bf99-136a0b51e2f2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] PATH_INFO: `/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:28.446215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195ef47-fef7-400a-bf99-136a0b51e2f2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=87caf4631d34409b83cc8c2686490cc3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:28.447707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195ef47-fef7-400a-bf99-136a0b51e2f2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:28.477628 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3849/7762] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Aug 29 15:59:28 2022] GET /identity/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3/roles => generated 371 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:28.478316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195ef47-fef7-400a-bf99-136a0b51e2f2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:28.487983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9195ef47-fef7-400a-bf99-136a0b51e2f2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:28.505089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:28.612438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e9334-f5f1-4e6b-8636-52d0d49bd115 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:28.625782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399e2af-e413-43be-a771-2ccc2ad855fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:28.629880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399e2af-e413-43be-a771-2ccc2ad855fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:28.630225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399e2af-e413-43be-a771-2ccc2ad855fe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:28.630499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399e2af-e413-43be-a771-2ccc2ad855fe admin admin] PATH_INFO: `/v3/users/ceeb4f9e8ddc4d85a85f22f38d60cabb` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:28.635266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399e2af-e413-43be-a771-2ccc2ad855fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceeb4f9e8ddc4d85a85f22f38d60cabb)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:28.637265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399e2af-e413-43be-a771-2ccc2ad855fe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:28.677002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195ef47-fef7-400a-bf99-136a0b51e2f2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:28.703201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f452fdc-21d9-482b-aa94-e6cc3546a1f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:28.703844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452fdc-21d9-482b-aa94-e6cc3546a1f0 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:28.708678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452fdc-21d9-482b-aa94-e6cc3546a1f0 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:28.708678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f452fdc-21d9-482b-aa94-e6cc3546a1f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:28.712055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7f452fdc-21d9-482b-aa94-e6cc3546a1f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:28.731421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f452fdc-21d9-482b-aa94-e6cc3546a1f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:28.741212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f452fdc-21d9-482b-aa94-e6cc3546a1f0 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:28.757306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5399e2af-e413-43be-a771-2ccc2ad855fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceeb4f9e8ddc4d85a85f22f38d60cabb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:28.758054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5399e2af-e413-43be-a771-2ccc2ad855fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceeb4f9e8ddc4d85a85f22f38d60cabb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:28.768747 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3850/7763] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:28.769509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f452fdc-21d9-482b-aa94-e6cc3546a1f0 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:28.807722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5399e2af-e413-43be-a771-2ccc2ad855fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceeb4f9e8ddc4d85a85f22f38d60cabb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:28.808217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5399e2af-e413-43be-a771-2ccc2ad855fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceeb4f9e8ddc4d85a85f22f38d60cabb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:28.812601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f452fdc-21d9-482b-aa94-e6cc3546a1f0 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:28.833380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5399e2af-e413-43be-a771-2ccc2ad855fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceeb4f9e8ddc4d85a85f22f38d60cabb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:28.835649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1d69-6a27-4f38-b41e-a2c1a91c8b42 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd286e2afc44a5994a89326abb8d89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1746232109', 'tempest-DelegatedRole-1588638309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:28.836739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1d69-6a27-4f38-b41e-a2c1a91c8b42 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:28.837132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1d69-6a27-4f38-b41e-a2c1a91c8b42 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:28.837550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1d69-6a27-4f38-b41e-a2c1a91c8b42 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] PATH_INFO: `/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3/roles/12398de1fc464feea45a327bc5274d8a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:28.842701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:28.854506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a1d69-6a27-4f38-b41e-a2c1a91c8b42 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorizing `identity:get_role_for_trust(trust_id=87caf4631d34409b83cc8c2686490cc3, role_id=12398de1fc464feea45a327bc5274d8a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:28.858195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a1d69-6a27-4f38-b41e-a2c1a91c8b42 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:28.859025 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3914/7764] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:28 2022] DELETE /identity/v3/users/ceeb4f9e8ddc4d85a85f22f38d60cabb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:28.863131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23cfb6-bb60-43c2-bc99-6b32cb5c7240 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:28.863422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23cfb6-bb60-43c2-bc99-6b32cb5c7240 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:28.863722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23cfb6-bb60-43c2-bc99-6b32cb5c7240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:28.892428 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3851/7765] 10.222.0.16 () {58 vars in 1368 bytes} [Mon Aug 29 15:59:28 2022] GET /identity/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3/roles/12398de1fc464feea45a327bc5274d8a => generated 244 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:28.893767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1d69-6a27-4f38-b41e-a2c1a91c8b42 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:28.897498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b64a1d69-6a27-4f38-b41e-a2c1a91c8b42 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:28.909242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6e23cfb6-bb60-43c2-bc99-6b32cb5c7240 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:28.910934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6e23cfb6-bb60-43c2-bc99-6b32cb5c7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:28.942971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1d69-6a27-4f38-b41e-a2c1a91c8b42 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:29.047673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db009f-7188-4547-aab0-dbba8d400c6a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd286e2afc44a5994a89326abb8d89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1746232109', 'tempest-DelegatedRole-1588638309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:29.048347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db009f-7188-4547-aab0-dbba8d400c6a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:29.048631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db009f-7188-4547-aab0-dbba8d400c6a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:29.050183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db009f-7188-4547-aab0-dbba8d400c6a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] PATH_INFO: `/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3/roles/12398de1fc464feea45a327bc5274d8a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:29.062486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db009f-7188-4547-aab0-dbba8d400c6a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorizing `identity:get_role_for_trust(trust_id=87caf4631d34409b83cc8c2686490cc3, role_id=12398de1fc464feea45a327bc5274d8a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:29.064203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db009f-7188-4547-aab0-dbba8d400c6a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:29.075294 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3915/7766] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:29.090361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23cfb6-bb60-43c2-bc99-6b32cb5c7240 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:29.090754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6e23cfb6-bb60-43c2-bc99-6b32cb5c7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:29.133081 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3852/7767] 10.222.0.16 () {58 vars in 1369 bytes} [Mon Aug 29 15:59:28 2022] HEAD /identity/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3/roles/12398de1fc464feea45a327bc5274d8a => generated 0 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 29 15:59:29.134104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db009f-7188-4547-aab0-dbba8d400c6a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:29.156754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db009f-7188-4547-aab0-dbba8d400c6a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:29.163984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96fe51-7d19-4990-a792-3d21ae807e70 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd286e2afc44a5994a89326abb8d89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1746232109', 'tempest-DelegatedRole-1588638309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:29.164751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96fe51-7d19-4990-a792-3d21ae807e70 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:29.165042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96fe51-7d19-4990-a792-3d21ae807e70 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:29.165339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96fe51-7d19-4990-a792-3d21ae807e70 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] PATH_INFO: `/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3/roles/f12c153be5574506855bf74e05464d87` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:29.175931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96fe51-7d19-4990-a792-3d21ae807e70 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorizing `identity:get_role_for_trust(trust_id=87caf4631d34409b83cc8c2686490cc3, role_id=f12c153be5574506855bf74e05464d87)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:29.177433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96fe51-7d19-4990-a792-3d21ae807e70 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:29.202531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-3c96fe51-7d19-4990-a792-3d21ae807e70 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Could not find role: f12c153be5574506855bf74e05464d87.: keystone.exception.RoleNotFound: Could not find role: f12c153be5574506855bf74e05464d87. Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:59:29.206698 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: f12c153be5574506855bf74e05464d87. Aug 29 15:59:29.213422 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:29.213422 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3853/7768] 10.222.0.16 () {58 vars in 1368 bytes} [Mon Aug 29 15:59:29 2022] GET /identity/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3/roles/f12c153be5574506855bf74e05464d87 => generated 110 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:59:29.222117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96fe51-7d19-4990-a792-3d21ae807e70 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:29.236638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23cfb6-bb60-43c2-bc99-6b32cb5c7240 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:29.249221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79fe65-2a14-4918-99b9-573ec8c9f54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:29.250156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79fe65-2a14-4918-99b9-573ec8c9f54d service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:29.251577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79fe65-2a14-4918-99b9-573ec8c9f54d service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:29.252124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79fe65-2a14-4918-99b9-573ec8c9f54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:29.254501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96fe51-7d19-4990-a792-3d21ae807e70 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:29.270013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bff31-0b6f-4730-b766-b9485297cea2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd286e2afc44a5994a89326abb8d89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1746232109', 'tempest-DelegatedRole-1588638309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:29.271018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bff31-0b6f-4730-b766-b9485297cea2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] REQUEST_METHOD: `HEAD` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:29.272513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bff31-0b6f-4730-b766-b9485297cea2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:29.273124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bff31-0b6f-4730-b766-b9485297cea2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] PATH_INFO: `/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3/roles/f12c153be5574506855bf74e05464d87` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:29.277162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79fe65-2a14-4918-99b9-573ec8c9f54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:29.278877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79fe65-2a14-4918-99b9-573ec8c9f54d service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:29.298557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95bff31-0b6f-4730-b766-b9485297cea2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorizing `identity:get_role_for_trust(trust_id=87caf4631d34409b83cc8c2686490cc3, role_id=f12c153be5574506855bf74e05464d87)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:29.300510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95bff31-0b6f-4730-b766-b9485297cea2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:29.309849 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3916/7769] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:59:29.313171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4677c-1e56-487d-a490-75d4010229df None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:29.313828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4677c-1e56-487d-a490-75d4010229df None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:29.314762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4677c-1e56-487d-a490-75d4010229df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-b95bff31-0b6f-4730-b766-b9485297cea2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Could not find role: f12c153be5574506855bf74e05464d87.: keystone.exception.RoleNotFound: Could not find role: f12c153be5574506855bf74e05464d87. Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 15:59:29.323658 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: f12c153be5574506855bf74e05464d87. Aug 29 15:59:29.324901 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:29.330836 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3854/7770] 10.222.0.16 () {58 vars in 1369 bytes} [Mon Aug 29 15:59:29 2022] HEAD /identity/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3/roles/f12c153be5574506855bf74e05464d87 => generated 0 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 29 15:59:29.340763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bff31-0b6f-4730-b766-b9485297cea2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:29.372324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bff31-0b6f-4730-b766-b9485297cea2 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:29.386397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd286e2afc44a5994a89326abb8d89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1746232109', 'tempest-DelegatedRole-1588638309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:29.386397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:29.388741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:29.389128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] PATH_INFO: `/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:29.410188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6ee4677c-1e56-487d-a490-75d4010229df None None] MFA Rules not processed for user `e276b9fae4594c17a1883dd4e48184c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:29.411189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorizing `identity:delete_trust(trust_id=87caf4631d34409b83cc8c2686490cc3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:29.413968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6ee4677c-1e56-487d-a490-75d4010229df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:29.419262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:29.479174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '87caf4631d34409b83cc8c2686490cc3', 'request_id': 'req-f51cd153-7266-4ee3-a250-6a9b4807bc11'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:29.481414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '87caf4631d34409b83cc8c2686490cc3', 'request_id': 'req-f51cd153-7266-4ee3-a250-6a9b4807bc11'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:29.482692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '87caf4631d34409b83cc8c2686490cc3', 'request_id': 'req-f51cd153-7266-4ee3-a250-6a9b4807bc11'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:29.518197 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3855/7771] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Aug 29 15:59:29 2022] DELETE /identity/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:29.519525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:29.525239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:29.556846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cd153-7266-4ee3-a250-6a9b4807bc11 tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:29.565657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf1bf3-5f40-457a-bc51-a02ba22eee9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:29.566298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf1bf3-5f40-457a-bc51-a02ba22eee9a service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:29.566700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf1bf3-5f40-457a-bc51-a02ba22eee9a service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:29.566865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf1bf3-5f40-457a-bc51-a02ba22eee9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:29.570232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2aaf1bf3-5f40-457a-bc51-a02ba22eee9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:29.597645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf1bf3-5f40-457a-bc51-a02ba22eee9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:29.599118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf1bf3-5f40-457a-bc51-a02ba22eee9a service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:29.611914 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3917/7772] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:29.613590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4677c-1e56-487d-a490-75d4010229df None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:29.618478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6ee4677c-1e56-487d-a490-75d4010229df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:29.631589 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3856/7773] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:29.633082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf1bf3-5f40-457a-bc51-a02ba22eee9a service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:29.635496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2aaf1bf3-5f40-457a-bc51-a02ba22eee9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:29.644733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4677c-1e56-487d-a490-75d4010229df None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:29.660741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2d864-aeae-4aa9-b1eb-91f06d174f0a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd286e2afc44a5994a89326abb8d89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1746232109', 'tempest-DelegatedRole-1588638309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:29.661420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d864-aeae-4aa9-b1eb-91f06d174f0a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:29.661718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d864-aeae-4aa9-b1eb-91f06d174f0a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:29.662573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d864-aeae-4aa9-b1eb-91f06d174f0a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] PATH_INFO: `/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:29.667417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf1bf3-5f40-457a-bc51-a02ba22eee9a service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:29.676128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35045937-e669-4125-be9e-33f6dd2a4934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:29.676761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35045937-e669-4125-be9e-33f6dd2a4934 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:29.677047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35045937-e669-4125-be9e-33f6dd2a4934 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:29.677326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35045937-e669-4125-be9e-33f6dd2a4934 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:29.678046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35045937-e669-4125-be9e-33f6dd2a4934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:29.680401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35045937-e669-4125-be9e-33f6dd2a4934 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-45d2d864-aeae-4aa9-b1eb-91f06d174f0a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Could not find trust: 87caf4631d34409b83cc8c2686490cc3.: keystone.exception.TrustNotFound: Could not find trust: 87caf4631d34409b83cc8c2686490cc3. Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 29 15:59:29.683399 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 87caf4631d34409b83cc8c2686490cc3. Aug 29 15:59:29.684754 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:59:29.687716 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3918/7774] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:29 2022] GET /identity/v3/OS-TRUST/trusts/87caf4631d34409b83cc8c2686490cc3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 29 15:59:29.691902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2d864-aeae-4aa9-b1eb-91f06d174f0a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:29.694007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-45d2d864-aeae-4aa9-b1eb-91f06d174f0a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:29.728625 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3857/7775] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:29 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:29.732415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35045937-e669-4125-be9e-33f6dd2a4934 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:29.795618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:29.873621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2d864-aeae-4aa9-b1eb-91f06d174f0a tempest-TrustsV3TestJSON-80161398 tempest-user-1687820664] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:29.883067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35045937-e669-4125-be9e-33f6dd2a4934 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:29.900956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13171d5-0571-430a-b7f0-056a81207075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:29.901837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13171d5-0571-430a-b7f0-056a81207075 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:29.902152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13171d5-0571-430a-b7f0-056a81207075 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:29.902719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13171d5-0571-430a-b7f0-056a81207075 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:29.903397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13171d5-0571-430a-b7f0-056a81207075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:29.909003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13171d5-0571-430a-b7f0-056a81207075 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:29.964830 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3858/7776] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:29 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:29.970895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13171d5-0571-430a-b7f0-056a81207075 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:30.002778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13171d5-0571-430a-b7f0-056a81207075 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:30.007491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:30.008469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:30.009076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:30.010064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/f12c153be5574506855bf74e05464d87` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:30.012058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f12c153be5574506855bf74e05464d87)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:30.014086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266431-a73f-4dfa-8911-ebd37150c570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:30.014825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266431-a73f-4dfa-8911-ebd37150c570 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:30.015020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:30.015352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266431-a73f-4dfa-8911-ebd37150c570 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:30.015730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266431-a73f-4dfa-8911-ebd37150c570 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:30.016482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b266431-a73f-4dfa-8911-ebd37150c570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:30.018270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b266431-a73f-4dfa-8911-ebd37150c570 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:30.036601 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3859/7777] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:29 2022] GET /identity/v3/roles => generated 1893 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:30.037588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266431-a73f-4dfa-8911-ebd37150c570 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:30.048192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:30.060512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266431-a73f-4dfa-8911-ebd37150c570 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:30.069406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f399f62-1bd4-49ea-b5d3-3396cc885149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:30.070754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399f62-1bd4-49ea-b5d3-3396cc885149 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:30.071456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399f62-1bd4-49ea-b5d3-3396cc885149 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:30.071775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399f62-1bd4-49ea-b5d3-3396cc885149 admin admin] PATH_INFO: `/v3/projects/30dbcce93a1c4f938180a9d652859531/users/21a3b05def674718ba8ef668abf7ea46/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:30.088781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role f12c153be5574506855bf74e05464d87 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:30.089993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.090898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.094703 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3919/7778] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:29 2022] DELETE /identity/v3/roles/f12c153be5574506855bf74e05464d87 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:30.101120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:30.103769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:30.120118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f399f62-1bd4-49ea-b5d3-3396cc885149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30dbcce93a1c4f938180a9d652859531, user_id=21a3b05def674718ba8ef668abf7ea46, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:30.144304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f399f62-1bd4-49ea-b5d3-3396cc885149 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:30.206777 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3860/7779] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:30 2022] PUT /identity/v3/projects/30dbcce93a1c4f938180a9d652859531/users/21a3b05def674718ba8ef668abf7ea46/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:30.208506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f399f62-1bd4-49ea-b5d3-3396cc885149 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:30.208632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c91fa-8520-421d-a435-c85e414e9bee tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:30.215505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8f399f62-1bd4-49ea-b5d3-3396cc885149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:30.315318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:30.318197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:30.318491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:30.318787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/roles/12398de1fc464feea45a327bc5274d8a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:30.323942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_role(role_id=12398de1fc464feea45a327bc5274d8a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:30.325617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:30.371966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f399f62-1bd4-49ea-b5d3-3396cc885149 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:30.384993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682f4a-d94b-4a1e-a114-018fb61425b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:30.391359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682f4a-d94b-4a1e-a114-018fb61425b8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:30.391359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682f4a-d94b-4a1e-a114-018fb61425b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:30.391359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682f4a-d94b-4a1e-a114-018fb61425b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:30.391359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66682f4a-d94b-4a1e-a114-018fb61425b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:30.391359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66682f4a-d94b-4a1e-a114-018fb61425b8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:30.420381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invalidating the token cache because role 12398de1fc464feea45a327bc5274d8a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:30.420766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.421803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.427533 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3920/7780] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:30 2022] DELETE /identity/v3/roles/12398de1fc464feea45a327bc5274d8a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:30.427533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:30.429152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:30.461614 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3861/7781] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:30.464384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682f4a-d94b-4a1e-a114-018fb61425b8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:30.472780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-66682f4a-d94b-4a1e-a114-018fb61425b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:30.517330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682f4a-d94b-4a1e-a114-018fb61425b8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:30.553126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:30.578726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe536043-54e0-4f00-ba14-58f37ab4d232 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:30.585720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:30.586233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:30.586573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:30.586913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] PATH_INFO: `/v3/projects/d0920eb168834c78b41f1fab7b138225` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:30.588187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0920eb168834c78b41f1fab7b138225)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:30.590535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:30.690576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa4126-42a8-42ca-a93e-2b31305ada65 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:30.691239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa4126-42a8-42ca-a93e-2b31305ada65 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:30.691584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa4126-42a8-42ca-a93e-2b31305ada65 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:30.691794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa4126-42a8-42ca-a93e-2b31305ada65 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/users/5dd286e2afc44a5994a89326abb8d89a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:30.694083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa4126-42a8-42ca-a93e-2b31305ada65 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5dd286e2afc44a5994a89326abb8d89a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:30.697946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa4126-42a8-42ca-a93e-2b31305ada65 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:30.707367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0920eb168834c78b41f1fab7b138225', 'request_id': 'req-abddcd61-d549-43ea-8624-b66b7d176a24'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.715125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0920eb168834c78b41f1fab7b138225', 'request_id': 'req-abddcd61-d549-43ea-8624-b66b7d176a24'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.728342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0920eb168834c78b41f1fab7b138225', 'request_id': 'req-abddcd61-d549-43ea-8624-b66b7d176a24'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.750970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] The token cache is being invalidate because project d0920eb168834c78b41f1fab7b138225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:30.751480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.752536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.755199 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3921/7782] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:30 2022] DELETE /identity/v3/projects/d0920eb168834c78b41f1fab7b138225 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:30.756953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:30.759286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:30.759755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:30.791124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eaaa4126-42a8-42ca-a93e-2b31305ada65 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd286e2afc44a5994a89326abb8d89a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.792833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eaaa4126-42a8-42ca-a93e-2b31305ada65 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd286e2afc44a5994a89326abb8d89a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.831001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eaaa4126-42a8-42ca-a93e-2b31305ada65 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd286e2afc44a5994a89326abb8d89a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.847512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eaaa4126-42a8-42ca-a93e-2b31305ada65 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd286e2afc44a5994a89326abb8d89a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.863237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eaaa4126-42a8-42ca-a93e-2b31305ada65 tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd286e2afc44a5994a89326abb8d89a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:30.874312 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3862/7783] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:30 2022] DELETE /identity/v3/users/5dd286e2afc44a5994a89326abb8d89a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:30.876109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5001fb6-0802-44ff-ad97-882578db8442 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:30.876492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5001fb6-0802-44ff-ad97-882578db8442 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:30.877087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5001fb6-0802-44ff-ad97-882578db8442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:30.909677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b5001fb6-0802-44ff-ad97-882578db8442 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:30.911247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b5001fb6-0802-44ff-ad97-882578db8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:30.955239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddcd61-d549-43ea-8624-b66b7d176a24 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:31.068972 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3863/7784] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:31.071034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5001fb6-0802-44ff-ad97-882578db8442 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:31.072993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b5001fb6-0802-44ff-ad97-882578db8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:31.090267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6145f3-6fa5-4aa0-9e0f-defe6df4f4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:31.091073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6145f3-6fa5-4aa0-9e0f-defe6df4f4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:31.091418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6145f3-6fa5-4aa0-9e0f-defe6df4f4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:31.091858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6145f3-6fa5-4aa0-9e0f-defe6df4f4b6 admin admin] PATH_INFO: `/v3/projects/30dbcce93a1c4f938180a9d652859531/users/21a3b05def674718ba8ef668abf7ea46/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:31.095041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6145f3-6fa5-4aa0-9e0f-defe6df4f4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30dbcce93a1c4f938180a9d652859531, user_id=21a3b05def674718ba8ef668abf7ea46, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:31.100387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6145f3-6fa5-4aa0-9e0f-defe6df4f4b6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:31.122785 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3922/7785] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:30 2022] PUT /identity/v3/projects/30dbcce93a1c4f938180a9d652859531/users/21a3b05def674718ba8ef668abf7ea46/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:31.122785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6b1ca-3749-4cf2-bb5c-c42b458f62b9 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:31.122785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6b1ca-3749-4cf2-bb5c-c42b458f62b9 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:31.122785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6b1ca-3749-4cf2-bb5c-c42b458f62b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:31.200097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f7d6b1ca-3749-4cf2-bb5c-c42b458f62b9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:31.202008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f7d6b1ca-3749-4cf2-bb5c-c42b458f62b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:31.233133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:31.278090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5001fb6-0802-44ff-ad97-882578db8442 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:31.342311 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3923/7786] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:31.347068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6b1ca-3749-4cf2-bb5c-c42b458f62b9 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:31.371726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6b1ca-3749-4cf2-bb5c-c42b458f62b9 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:31.385250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96f15-aef9-4485-84de-20faa077f291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:31.386223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96f15-aef9-4485-84de-20faa077f291 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:31.386602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96f15-aef9-4485-84de-20faa077f291 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:31.388021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96f15-aef9-4485-84de-20faa077f291 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:31.388821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f96f15-aef9-4485-84de-20faa077f291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:31.389376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f96f15-aef9-4485-84de-20faa077f291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:31.392641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f96f15-aef9-4485-84de-20faa077f291 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:31.411941 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3924/7787] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:31.433437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96f15-aef9-4485-84de-20faa077f291 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:31.440274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:31.478442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96f15-aef9-4485-84de-20faa077f291 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:31.484906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fcf5a56e06e457398bbe7f09d0acc30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e3a45cb5c04e3591275e18b7942f66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:31.485720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:31.486079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:31.487044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] PATH_INFO: `/v3/projects/779e852bbdfc4ee3bbca65fcbdec6a7b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:31.487931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorizing `identity:delete_project(project_id=779e852bbdfc4ee3bbca65fcbdec6a7b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:31.493475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:31.502466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a380f-8c81-41c2-a3c5-02140f016e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:31.503394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a380f-8c81-41c2-a3c5-02140f016e08 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:31.503825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a380f-8c81-41c2-a3c5-02140f016e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:31.504284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a380f-8c81-41c2-a3c5-02140f016e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:31.505224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a380f-8c81-41c2-a3c5-02140f016e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:31.511900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a380f-8c81-41c2-a3c5-02140f016e08 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:31.581162 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3925/7788] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:31 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:31.586053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a380f-8c81-41c2-a3c5-02140f016e08 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:31.651069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'request_id': 'req-7e611f72-5757-4f74-a614-5b0edfbefb6d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:31.677060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'request_id': 'req-7e611f72-5757-4f74-a614-5b0edfbefb6d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:31.708251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779e852bbdfc4ee3bbca65fcbdec6a7b', 'request_id': 'req-7e611f72-5757-4f74-a614-5b0edfbefb6d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:31.741266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] The token cache is being invalidate because project 779e852bbdfc4ee3bbca65fcbdec6a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:31.741736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:31.745585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:31.752610 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3864/7789] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:31 2022] DELETE /identity/v3/projects/779e852bbdfc4ee3bbca65fcbdec6a7b => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:31.759144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:31.761835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a380f-8c81-41c2-a3c5-02140f016e08 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:31.764967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:31.778475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecd18c-9ac8-447b-9f96-d120f72e1456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:31.781329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd18c-9ac8-447b-9f96-d120f72e1456 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:31.781651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd18c-9ac8-447b-9f96-d120f72e1456 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:31.781931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd18c-9ac8-447b-9f96-d120f72e1456 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:31.782586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecd18c-9ac8-447b-9f96-d120f72e1456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:31.791520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecd18c-9ac8-447b-9f96-d120f72e1456 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:31.841460 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3926/7790] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:31 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:31.844126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecd18c-9ac8-447b-9f96-d120f72e1456 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:31.853515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e5ecd18c-9ac8-447b-9f96-d120f72e1456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:31.884702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecd18c-9ac8-447b-9f96-d120f72e1456 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:31.891291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852f29a-fd23-4f73-b6d4-2a5fb7644c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:31.891969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852f29a-fd23-4f73-b6d4-2a5fb7644c8a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:31.892375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852f29a-fd23-4f73-b6d4-2a5fb7644c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:31.892784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852f29a-fd23-4f73-b6d4-2a5fb7644c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:31.893498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852f29a-fd23-4f73-b6d4-2a5fb7644c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:31.896779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852f29a-fd23-4f73-b6d4-2a5fb7644c8a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:31.926188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e611f72-5757-4f74-a614-5b0edfbefb6d tempest-TrustsV3TestJSON-1101323179 tempest-TrustsV3TestJSON-1101323179-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:31.929363 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3927/7791] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:31.933903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852f29a-fd23-4f73-b6d4-2a5fb7644c8a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:31.946466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42ce0d-510f-4db8-94b5-abd202e9fb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:31.947136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42ce0d-510f-4db8-94b5-abd202e9fb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:31.947484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42ce0d-510f-4db8-94b5-abd202e9fb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:31.947911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42ce0d-510f-4db8-94b5-abd202e9fb10 admin admin] PATH_INFO: `/v3/users/218a89d223e146ae95b37b1987da0335` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:31.949620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42ce0d-510f-4db8-94b5-abd202e9fb10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218a89d223e146ae95b37b1987da0335)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:31.952301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42ce0d-510f-4db8-94b5-abd202e9fb10 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:31.954798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852f29a-fd23-4f73-b6d4-2a5fb7644c8a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:31.962316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff68c8-b629-48ca-8518-e40d9138d176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:31.963184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff68c8-b629-48ca-8518-e40d9138d176 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:31.963534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff68c8-b629-48ca-8518-e40d9138d176 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:31.964112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff68c8-b629-48ca-8518-e40d9138d176 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:31.964581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff68c8-b629-48ca-8518-e40d9138d176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:31.966358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff68c8-b629-48ca-8518-e40d9138d176 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:32.007548 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3928/7792] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:32.012521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff68c8-b629-48ca-8518-e40d9138d176 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:32.034768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff68c8-b629-48ca-8518-e40d9138d176 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:32.046136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af452e-ea0c-4360-9d76-54963f964a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:32.046973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af452e-ea0c-4360-9d76-54963f964a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:32.047852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af452e-ea0c-4360-9d76-54963f964a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:32.048392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af452e-ea0c-4360-9d76-54963f964a8c admin admin] PATH_INFO: `/v3/projects/df55f7e5f9b14e7fa72c3faf04a55486/users/6a62cc1984cc4586a21751f94054f215/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:32.082201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af452e-ea0c-4360-9d76-54963f964a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df55f7e5f9b14e7fa72c3faf04a55486, user_id=6a62cc1984cc4586a21751f94054f215, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:32.084895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e42ce0d-510f-4db8-94b5-abd202e9fb10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218a89d223e146ae95b37b1987da0335'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:32.088645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af452e-ea0c-4360-9d76-54963f964a8c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:32.092484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e42ce0d-510f-4db8-94b5-abd202e9fb10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218a89d223e146ae95b37b1987da0335'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:32.115917 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3929/7793] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:32 2022] PUT /identity/v3/projects/df55f7e5f9b14e7fa72c3faf04a55486/users/6a62cc1984cc4586a21751f94054f215/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:32.125908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80c1d5-1d3e-4cfa-961c-bbf118922e1b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:32.126186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80c1d5-1d3e-4cfa-961c-bbf118922e1b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:32.126611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80c1d5-1d3e-4cfa-961c-bbf118922e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:32.140416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e42ce0d-510f-4db8-94b5-abd202e9fb10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218a89d223e146ae95b37b1987da0335'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:32.160739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e42ce0d-510f-4db8-94b5-abd202e9fb10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218a89d223e146ae95b37b1987da0335'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:32.176724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9e42ce0d-510f-4db8-94b5-abd202e9fb10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218a89d223e146ae95b37b1987da0335'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:32.181837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:32.182478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5b80c1d5-1d3e-4cfa-961c-bbf118922e1b None None] MFA Rules not processed for user `6a62cc1984cc4586a21751f94054f215`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:32.183826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5b80c1d5-1d3e-4cfa-961c-bbf118922e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:32.193314 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3865/7794] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:31 2022] DELETE /identity/v3/users/218a89d223e146ae95b37b1987da0335 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:32.202720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4e38-f93d-4138-a4ae-260f927d6068 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:32.203094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4e38-f93d-4138-a4ae-260f927d6068 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:32.203446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4e38-f93d-4138-a4ae-260f927d6068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:32.235360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:32.279003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fc1e4e38-f93d-4138-a4ae-260f927d6068 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:32.283974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fc1e4e38-f93d-4138-a4ae-260f927d6068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:32.347364 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3930/7795] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:32.359915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80c1d5-1d3e-4cfa-961c-bbf118922e1b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:32.361783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5b80c1d5-1d3e-4cfa-961c-bbf118922e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:32.410522 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3866/7796] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:32.426457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e4e38-f93d-4138-a4ae-260f927d6068 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:32.430505 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fc1e4e38-f93d-4138-a4ae-260f927d6068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:32.486977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80c1d5-1d3e-4cfa-961c-bbf118922e1b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:32.678137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07833524-915b-41b8-897d-98ff004f80a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:32.678964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07833524-915b-41b8-897d-98ff004f80a3 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:32.679083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07833524-915b-41b8-897d-98ff004f80a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:32.679361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07833524-915b-41b8-897d-98ff004f80a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:32.687120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e4e38-f93d-4138-a4ae-260f927d6068 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:32.699438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9067644-3e92-4aaa-a988-acc672d8a757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:32.700645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9067644-3e92-4aaa-a988-acc672d8a757 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:32.704402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9067644-3e92-4aaa-a988-acc672d8a757 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:32.705832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9067644-3e92-4aaa-a988-acc672d8a757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:32.732403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9067644-3e92-4aaa-a988-acc672d8a757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:32.736912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9067644-3e92-4aaa-a988-acc672d8a757 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:32.766614 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3867/7797] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:32.772175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07833524-915b-41b8-897d-98ff004f80a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:32.776859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07833524-915b-41b8-897d-98ff004f80a3 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:32.795459 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3931/7798] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:59:33.677009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9067644-3e92-4aaa-a988-acc672d8a757 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:33.678629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f9067644-3e92-4aaa-a988-acc672d8a757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:33.703919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9067644-3e92-4aaa-a988-acc672d8a757 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:33.717564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:33.718373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:33.718752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:33.719814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] PATH_INFO: `/v3/projects/a8b119bc39354987a34ebeaff5f2d9c7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:33.720428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b119bc39354987a34ebeaff5f2d9c7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:33.722501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:33.879277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b119bc39354987a34ebeaff5f2d9c7', 'request_id': 'req-da3a54ae-d460-4c3c-8ada-421e52d35c8e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:33.893155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b119bc39354987a34ebeaff5f2d9c7', 'request_id': 'req-da3a54ae-d460-4c3c-8ada-421e52d35c8e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:33.909998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b119bc39354987a34ebeaff5f2d9c7', 'request_id': 'req-da3a54ae-d460-4c3c-8ada-421e52d35c8e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:33.931447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] The token cache is being invalidate because project a8b119bc39354987a34ebeaff5f2d9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:33.931851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:33.932772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:33.938089 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3868/7799] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:33 2022] DELETE /identity/v3/projects/a8b119bc39354987a34ebeaff5f2d9c7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:33.939315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07833524-915b-41b8-897d-98ff004f80a3 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:33.940867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-07833524-915b-41b8-897d-98ff004f80a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:33.942191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:33.944458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:33.974023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07833524-915b-41b8-897d-98ff004f80a3 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:34.050096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:34.060195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:34.130397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b6b51-e38b-46e9-8c78-18b0a1535f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:34.132734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6b51-e38b-46e9-8c78-18b0a1535f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:34.133023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6b51-e38b-46e9-8c78-18b0a1535f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:34.133302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6b51-e38b-46e9-8c78-18b0a1535f1b admin admin] PATH_INFO: `/v3/users/6a62cc1984cc4586a21751f94054f215` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:34.136396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b6b51-e38b-46e9-8c78-18b0a1535f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a62cc1984cc4586a21751f94054f215)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:34.137245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a54ae-d460-4c3c-8ada-421e52d35c8e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:34.141326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b6b51-e38b-46e9-8c78-18b0a1535f1b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:34.152684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:34.154725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:34.156172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:34.156994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] PATH_INFO: `/v3/users/3fcf5a56e06e457398bbe7f09d0acc30` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:34.159060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fcf5a56e06e457398bbe7f09d0acc30)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:34.162766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:34.264377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a78b6b51-e38b-46e9-8c78-18b0a1535f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a62cc1984cc4586a21751f94054f215'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.266224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a78b6b51-e38b-46e9-8c78-18b0a1535f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a62cc1984cc4586a21751f94054f215'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.293598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a78b6b51-e38b-46e9-8c78-18b0a1535f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a62cc1984cc4586a21751f94054f215'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.294846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a78b6b51-e38b-46e9-8c78-18b0a1535f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a62cc1984cc4586a21751f94054f215'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.306494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a78b6b51-e38b-46e9-8c78-18b0a1535f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a62cc1984cc4586a21751f94054f215'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.311061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fcf5a56e06e457398bbe7f09d0acc30'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.321939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fcf5a56e06e457398bbe7f09d0acc30'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.330619 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3932/7800] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:33 2022] DELETE /identity/v3/users/6a62cc1984cc4586a21751f94054f215 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:34.332296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc7af-3ead-417f-9406-bb46ffd4ffbf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:34.332590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc7af-3ead-417f-9406-bb46ffd4ffbf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:34.333169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc7af-3ead-417f-9406-bb46ffd4ffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:34.359585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-444dc7af-3ead-417f-9406-bb46ffd4ffbf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:34.361118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fcf5a56e06e457398bbe7f09d0acc30'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.361340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-444dc7af-3ead-417f-9406-bb46ffd4ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:34.400624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fcf5a56e06e457398bbe7f09d0acc30'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.427120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fcf5a56e06e457398bbe7f09d0acc30'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:34.445873 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3869/7801] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:33 2022] DELETE /identity/v3/users/3fcf5a56e06e457398bbe7f09d0acc30 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:34.504286 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3933/7802] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:34.544049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:34.545632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:34.732800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb6d5-bae9-47f2-a3a6-dac88dec534b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:34.746353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e4df-11e3-4ae2-8e2c-1631fa8dbf67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:34.746993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e4df-11e3-4ae2-8e2c-1631fa8dbf67 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:34.747280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e4df-11e3-4ae2-8e2c-1631fa8dbf67 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:34.747559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e4df-11e3-4ae2-8e2c-1631fa8dbf67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:34.918078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:34.921360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e4df-11e3-4ae2-8e2c-1631fa8dbf67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:34.923449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e4df-11e3-4ae2-8e2c-1631fa8dbf67 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:34.938175 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3870/7803] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:35.300157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dc7af-3ead-417f-9406-bb46ffd4ffbf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:35.301646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-444dc7af-3ead-417f-9406-bb46ffd4ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:35.325223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dc7af-3ead-417f-9406-bb46ffd4ffbf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:35.337532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:35.338301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:35.345036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:35.345285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] PATH_INFO: `/v3/projects/36e3a45cb5c04e3591275e18b7942f66` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:35.346861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e3a45cb5c04e3591275e18b7942f66)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:35.350410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:35.483253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:35.484740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e3a45cb5c04e3591275e18b7942f66', 'request_id': 'req-7b9ab561-5ae8-448b-999c-d8b11ac47680'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:35.499553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e3a45cb5c04e3591275e18b7942f66', 'request_id': 'req-7b9ab561-5ae8-448b-999c-d8b11ac47680'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:35.514318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e3a45cb5c04e3591275e18b7942f66', 'request_id': 'req-7b9ab561-5ae8-448b-999c-d8b11ac47680'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:35.537913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] The token cache is being invalidate because project 36e3a45cb5c04e3591275e18b7942f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:35.538271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:35.539295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7b9ab561-5ae8-448b-999c-d8b11ac47680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:35.541638 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3934/7804] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:35 2022] DELETE /identity/v3/projects/36e3a45cb5c04e3591275e18b7942f66 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:35.547107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b0f42-c6c4-460d-a1bd-a41bde1e1095 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:35.547379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b0f42-c6c4-460d-a1bd-a41bde1e1095 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:35.548332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b0f42-c6c4-460d-a1bd-a41bde1e1095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:35.663045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2f9b0f42-c6c4-460d-a1bd-a41bde1e1095 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:35.663045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2f9b0f42-c6c4-460d-a1bd-a41bde1e1095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:35.963804 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3871/7805] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:35.971369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce6e85-7861-4c12-ac25-62e267f37da3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:35.971655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce6e85-7861-4c12-ac25-62e267f37da3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:35.971939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce6e85-7861-4c12-ac25-62e267f37da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.030568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ddce6e85-7861-4c12-ac25-62e267f37da3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:36.042700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ddce6e85-7861-4c12-ac25-62e267f37da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:36.057849 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3935/7806] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:36.062151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b0f42-c6c4-460d-a1bd-a41bde1e1095 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.082942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b0f42-c6c4-460d-a1bd-a41bde1e1095 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.097568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66784e39-61dd-4dbd-8bf3-d6e6ae00bc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.098221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66784e39-61dd-4dbd-8bf3-d6e6ae00bc8e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.098504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66784e39-61dd-4dbd-8bf3-d6e6ae00bc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.098777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66784e39-61dd-4dbd-8bf3-d6e6ae00bc8e admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.099807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66784e39-61dd-4dbd-8bf3-d6e6ae00bc8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:36.100125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66784e39-61dd-4dbd-8bf3-d6e6ae00bc8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.101791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66784e39-61dd-4dbd-8bf3-d6e6ae00bc8e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.135948 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3872/7807] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:36.139953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce6e85-7861-4c12-ac25-62e267f37da3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.152622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce6e85-7861-4c12-ac25-62e267f37da3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.174002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69ec7b-b0d3-4ee8-9207-556f48bc9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.174896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ec7b-b0d3-4ee8-9207-556f48bc9556 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.175179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ec7b-b0d3-4ee8-9207-556f48bc9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.177740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ec7b-b0d3-4ee8-9207-556f48bc9556 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.178413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69ec7b-b0d3-4ee8-9207-556f48bc9556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.204386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69ec7b-b0d3-4ee8-9207-556f48bc9556 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.294651 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3936/7808] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:36 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:36.295725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66784e39-61dd-4dbd-8bf3-d6e6ae00bc8e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.316357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66784e39-61dd-4dbd-8bf3-d6e6ae00bc8e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.495231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740dbc6-9813-4ad6-ae19-dee98fb6d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.496041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740dbc6-9813-4ad6-ae19-dee98fb6d6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.496436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740dbc6-9813-4ad6-ae19-dee98fb6d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.496822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740dbc6-9813-4ad6-ae19-dee98fb6d6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.497792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740dbc6-9813-4ad6-ae19-dee98fb6d6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.500023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740dbc6-9813-4ad6-ae19-dee98fb6d6b4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.576639 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3873/7809] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:36 2022] POST /identity/v3/users => generated 286 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:36.580525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69ec7b-b0d3-4ee8-9207-556f48bc9556 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.617361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69ec7b-b0d3-4ee8-9207-556f48bc9556 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.643057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd05043-67e9-4f29-8ef3-8976b5374dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.643855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05043-67e9-4f29-8ef3-8976b5374dbe admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.644591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05043-67e9-4f29-8ef3-8976b5374dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.644910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05043-67e9-4f29-8ef3-8976b5374dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.647705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd05043-67e9-4f29-8ef3-8976b5374dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.652473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd05043-67e9-4f29-8ef3-8976b5374dbe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.679526 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3937/7810] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:36.683572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740dbc6-9813-4ad6-ae19-dee98fb6d6b4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.750802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740dbc6-9813-4ad6-ae19-dee98fb6d6b4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.803449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb21e79-3784-4d20-b046-616b4fce232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.804315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21e79-3784-4d20-b046-616b4fce232b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.804682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21e79-3784-4d20-b046-616b4fce232b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.808494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21e79-3784-4d20-b046-616b4fce232b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.811257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb21e79-3784-4d20-b046-616b4fce232b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.820012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb21e79-3784-4d20-b046-616b4fce232b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.837786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd05043-67e9-4f29-8ef3-8976b5374dbe admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.839939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6bd05043-67e9-4f29-8ef3-8976b5374dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:36.882014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd05043-67e9-4f29-8ef3-8976b5374dbe admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.891891 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3874/7811] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:36.896450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb21e79-3784-4d20-b046-616b4fce232b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:36.924824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.934017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.934308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.934592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] PATH_INFO: `/v3/projects/df55f7e5f9b14e7fa72c3faf04a55486` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:36.939581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=df55f7e5f9b14e7fa72c3faf04a55486)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:36.947728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:36.966603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb21e79-3784-4d20-b046-616b4fce232b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:36.996351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c5267-3f7e-4a5d-b086-baf2cf600bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:36.996351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c5267-3f7e-4a5d-b086-baf2cf600bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:36.996351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c5267-3f7e-4a5d-b086-baf2cf600bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:36.996351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c5267-3f7e-4a5d-b086-baf2cf600bc5 admin admin] PATH_INFO: `/v3/projects/a4fd6689f90a4b24ba477cc6e72fdfea/users/3524fba0b3cc4d989ac03d69e3557cfa/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:37.043260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c5267-3f7e-4a5d-b086-baf2cf600bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fd6689f90a4b24ba477cc6e72fdfea, user_id=3524fba0b3cc4d989ac03d69e3557cfa, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:37.048805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c5267-3f7e-4a5d-b086-baf2cf600bc5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:37.078836 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3875/7812] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:36 2022] PUT /identity/v3/projects/a4fd6689f90a4b24ba477cc6e72fdfea/users/3524fba0b3cc4d989ac03d69e3557cfa/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:37.090355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53ddef-9f92-4bb9-a600-468eda4b9244 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:37.090797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53ddef-9f92-4bb9-a600-468eda4b9244 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:37.091132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53ddef-9f92-4bb9-a600-468eda4b9244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:37.180020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df55f7e5f9b14e7fa72c3faf04a55486', 'request_id': 'req-1e215756-c115-46bb-b000-477c40bf4c6e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:37.185087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cb53ddef-9f92-4bb9-a600-468eda4b9244 None None] MFA Rules not processed for user `3524fba0b3cc4d989ac03d69e3557cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:37.189867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cb53ddef-9f92-4bb9-a600-468eda4b9244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:37.218999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df55f7e5f9b14e7fa72c3faf04a55486', 'request_id': 'req-1e215756-c115-46bb-b000-477c40bf4c6e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:37.261672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:37.261957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df55f7e5f9b14e7fa72c3faf04a55486', 'request_id': 'req-1e215756-c115-46bb-b000-477c40bf4c6e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:37.322942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] The token cache is being invalidate because project df55f7e5f9b14e7fa72c3faf04a55486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:37.323504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:37.324367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e215756-c115-46bb-b000-477c40bf4c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:37.328482 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3938/7813] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:36 2022] DELETE /identity/v3/projects/df55f7e5f9b14e7fa72c3faf04a55486 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:37.334421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37efbd-3eb5-407f-a012-7d464001157f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:37.334943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37efbd-3eb5-407f-a012-7d464001157f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:37.335385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37efbd-3eb5-407f-a012-7d464001157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:37.375460 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3876/7814] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:37.376948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53ddef-9f92-4bb9-a600-468eda4b9244 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:37.378562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cb53ddef-9f92-4bb9-a600-468eda4b9244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:37.387854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ea37efbd-3eb5-407f-a012-7d464001157f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:37.389106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ea37efbd-3eb5-407f-a012-7d464001157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:37.555890 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3939/7815] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:37.564207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53ddef-9f92-4bb9-a600-468eda4b9244 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:37.569150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f99299-a25e-4fac-971d-202976c585ea None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:37.569540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f99299-a25e-4fac-971d-202976c585ea None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:37.569738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f99299-a25e-4fac-971d-202976c585ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:37.599923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8fc9e-f7e6-47dc-be54-5c7f5daa59f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:37.601107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8fc9e-f7e6-47dc-be54-5c7f5daa59f5 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:37.605114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8fc9e-f7e6-47dc-be54-5c7f5daa59f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:37.608207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8fc9e-f7e6-47dc-be54-5c7f5daa59f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:37.612186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8fc9e-f7e6-47dc-be54-5c7f5daa59f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:37.619652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8fc9e-f7e6-47dc-be54-5c7f5daa59f5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:37.654561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-33f99299-a25e-4fac-971d-202976c585ea None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:37.655817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-33f99299-a25e-4fac-971d-202976c585ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:37.698083 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3940/7816] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:37.704012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f99299-a25e-4fac-971d-202976c585ea None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:37.705799 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3877/7817] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:37 2022] POST /identity/v3/projects => generated 371 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:37.710014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8fc9e-f7e6-47dc-be54-5c7f5daa59f5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:37.726574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f99299-a25e-4fac-971d-202976c585ea None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:37.774189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:37.911561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8fc9e-f7e6-47dc-be54-5c7f5daa59f5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:37.946091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b3ca7-7ec4-4e48-88e0-d4168abeb6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:37.946783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3ca7-7ec4-4e48-88e0-d4168abeb6ba admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:37.947072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3ca7-7ec4-4e48-88e0-d4168abeb6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:37.947352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3ca7-7ec4-4e48-88e0-d4168abeb6ba admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:37.948004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b3ca7-7ec4-4e48-88e0-d4168abeb6ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:37.959809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b3ca7-7ec4-4e48-88e0-d4168abeb6ba admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:38.009546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33065f65-fdbe-4583-b6ab-9d34e212b38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:38.010231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065f65-fdbe-4583-b6ab-9d34e212b38f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:38.010478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065f65-fdbe-4583-b6ab-9d34e212b38f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:38.010760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065f65-fdbe-4583-b6ab-9d34e212b38f admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:38.011525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33065f65-fdbe-4583-b6ab-9d34e212b38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:38.011837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33065f65-fdbe-4583-b6ab-9d34e212b38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:38.013502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33065f65-fdbe-4583-b6ab-9d34e212b38f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:38.057859 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3878/7818] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:37 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:38.059449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b3ca7-7ec4-4e48-88e0-d4168abeb6ba admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:38.089016 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3941/7819] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:38.092536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b3ca7-7ec4-4e48-88e0-d4168abeb6ba admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:38.099127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33065f65-fdbe-4583-b6ab-9d34e212b38f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:38.110020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607d442-f9f6-4384-a085-f815702ecb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:38.112310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d442-f9f6-4384-a085-f815702ecb77 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:38.112616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d442-f9f6-4384-a085-f815702ecb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:38.112955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d442-f9f6-4384-a085-f815702ecb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:38.113679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607d442-f9f6-4384-a085-f815702ecb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:38.119995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607d442-f9f6-4384-a085-f815702ecb77 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:38.122310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33065f65-fdbe-4583-b6ab-9d34e212b38f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:38.134843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c1adb-1857-4c20-a87b-5684172ce5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:38.135764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c1adb-1857-4c20-a87b-5684172ce5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:38.136255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c1adb-1857-4c20-a87b-5684172ce5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:38.136691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c1adb-1857-4c20-a87b-5684172ce5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:38.137839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c1adb-1857-4c20-a87b-5684172ce5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:38.163077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c1adb-1857-4c20-a87b-5684172ce5f0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:38.167267 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3879/7820] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:38.172033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607d442-f9f6-4384-a085-f815702ecb77 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:38.188898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607d442-f9f6-4384-a085-f815702ecb77 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:38.195284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9fc72-f829-41cb-b1b7-e46a32286805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:38.196384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9fc72-f829-41cb-b1b7-e46a32286805 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:38.197203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9fc72-f829-41cb-b1b7-e46a32286805 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:38.197927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9fc72-f829-41cb-b1b7-e46a32286805 admin admin] PATH_INFO: `/v3/projects/a14f2a7b46904e4da48fc94a535b4048/users/0273c8fbe00b4649890f9bc0a03cb414/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:38.226860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9fc72-f829-41cb-b1b7-e46a32286805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14f2a7b46904e4da48fc94a535b4048, user_id=0273c8fbe00b4649890f9bc0a03cb414, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:38.235276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9fc72-f829-41cb-b1b7-e46a32286805 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:38.248525 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3942/7821] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:38 2022] POST /identity/v3/projects => generated 351 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:38.252631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c1adb-1857-4c20-a87b-5684172ce5f0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:38.263052 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3880/7822] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:38 2022] PUT /identity/v3/projects/a14f2a7b46904e4da48fc94a535b4048/users/0273c8fbe00b4649890f9bc0a03cb414/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:38.266960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9fc72-f829-41cb-b1b7-e46a32286805 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:38.315965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:38.475192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c1adb-1857-4c20-a87b-5684172ce5f0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:38.566154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9fc72-f829-41cb-b1b7-e46a32286805 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:38.593274 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301d525-a53c-45f7-93f8-f46c98d72884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:38.593882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301d525-a53c-45f7-93f8-f46c98d72884 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:38.594171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301d525-a53c-45f7-93f8-f46c98d72884 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:38.594451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301d525-a53c-45f7-93f8-f46c98d72884 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:38.595117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301d525-a53c-45f7-93f8-f46c98d72884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:38.596754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301d525-a53c-45f7-93f8-f46c98d72884 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:38.598398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a8ca6-7a36-4c94-9bc5-910b1d58cc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:38.599089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8ca6-7a36-4c94-9bc5-910b1d58cc76 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:38.599413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8ca6-7a36-4c94-9bc5-910b1d58cc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:38.599690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8ca6-7a36-4c94-9bc5-910b1d58cc76 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:38.600329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a8ca6-7a36-4c94-9bc5-910b1d58cc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:38.602590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a8ca6-7a36-4c94-9bc5-910b1d58cc76 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:38.653019 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3943/7823] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:38 2022] POST /identity/v3/users => generated 276 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:38.654188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a8ca6-7a36-4c94-9bc5-910b1d58cc76 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:38.667128 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3881/7824] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:38.668195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301d525-a53c-45f7-93f8-f46c98d72884 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:38.677641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a8ca6-7a36-4c94-9bc5-910b1d58cc76 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:38.695374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10207fb-5026-4083-a10e-f1ecfa480388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:38.696517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10207fb-5026-4083-a10e-f1ecfa480388 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:38.696963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10207fb-5026-4083-a10e-f1ecfa480388 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:38.697486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10207fb-5026-4083-a10e-f1ecfa480388 admin admin] PATH_INFO: `/v3/projects/a14f2a7b46904e4da48fc94a535b4048/users/0273c8fbe00b4649890f9bc0a03cb414/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:38.703828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10207fb-5026-4083-a10e-f1ecfa480388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14f2a7b46904e4da48fc94a535b4048, user_id=0273c8fbe00b4649890f9bc0a03cb414, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:38.711030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10207fb-5026-4083-a10e-f1ecfa480388 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:38.716386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301d525-a53c-45f7-93f8-f46c98d72884 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:38.729211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccbc84-eb0d-49be-a8d5-5a6f6fd43087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:38.729872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccbc84-eb0d-49be-a8d5-5a6f6fd43087 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:38.731198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccbc84-eb0d-49be-a8d5-5a6f6fd43087 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:38.731377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccbc84-eb0d-49be-a8d5-5a6f6fd43087 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:38.733435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccbc84-eb0d-49be-a8d5-5a6f6fd43087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:38.735172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccbc84-eb0d-49be-a8d5-5a6f6fd43087 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:38.744095 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3944/7825] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:38 2022] PUT /identity/v3/projects/a14f2a7b46904e4da48fc94a535b4048/users/0273c8fbe00b4649890f9bc0a03cb414/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:38.752658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fbdfb-266c-4b89-8c9d-03ebe612ee9b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:38.753275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fbdfb-266c-4b89-8c9d-03ebe612ee9b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:38.753741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fbdfb-266c-4b89-8c9d-03ebe612ee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:38.763123 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3882/7826] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:38.767103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccbc84-eb0d-49be-a8d5-5a6f6fd43087 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:38.804757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccbc84-eb0d-49be-a8d5-5a6f6fd43087 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:38.805314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:38.832487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-344fbdfb-266c-4b89-8c9d-03ebe612ee9b None None] MFA Rules not processed for user `0273c8fbe00b4649890f9bc0a03cb414`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:38.837829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-344fbdfb-266c-4b89-8c9d-03ebe612ee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:38.956020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97f963-bd60-4913-b829-0b8287692207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:38.957085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97f963-bd60-4913-b829-0b8287692207 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:38.957493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97f963-bd60-4913-b829-0b8287692207 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:38.958760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97f963-bd60-4913-b829-0b8287692207 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:38.959504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97f963-bd60-4913-b829-0b8287692207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:38.963346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97f963-bd60-4913-b829-0b8287692207 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:38.993167 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3883/7827] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:39.003137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97f963-bd60-4913-b829-0b8287692207 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:39.039416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97f963-bd60-4913-b829-0b8287692207 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:39.061275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f65cd-1149-4ec0-8ef5-b2225186f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:39.066452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f65cd-1149-4ec0-8ef5-b2225186f76f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:39.067194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f65cd-1149-4ec0-8ef5-b2225186f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:39.067606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f65cd-1149-4ec0-8ef5-b2225186f76f admin admin] PATH_INFO: `/v3/projects/a0b88c82dca7484787f6d069171f4919/users/f73d404f88cd4f8f9b4882fd9f6abb20/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:39.097505 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3945/7828] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:39.102446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fbdfb-266c-4b89-8c9d-03ebe612ee9b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:39.119386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f65cd-1149-4ec0-8ef5-b2225186f76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b88c82dca7484787f6d069171f4919, user_id=f73d404f88cd4f8f9b4882fd9f6abb20, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:39.121146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fbdfb-266c-4b89-8c9d-03ebe612ee9b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:39.122597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f65cd-1149-4ec0-8ef5-b2225186f76f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:39.136848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a047b-09f8-4aff-bc61-6efafff0dc36 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0273c8fbe00b4649890f9bc0a03cb414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a14f2a7b46904e4da48fc94a535b4048', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:39.137619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a047b-09f8-4aff-bc61-6efafff0dc36 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:39.137972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a047b-09f8-4aff-bc61-6efafff0dc36 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:39.138322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a047b-09f8-4aff-bc61-6efafff0dc36 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:39.139034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a047b-09f8-4aff-bc61-6efafff0dc36 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:39.141004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a047b-09f8-4aff-bc61-6efafff0dc36 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:39.142085 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3884/7829] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:39 2022] PUT /identity/v3/projects/a0b88c82dca7484787f6d069171f4919/users/f73d404f88cd4f8f9b4882fd9f6abb20/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:39.152583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb7d7c-a8f3-4524-ae4c-b675eea8f69d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:39.153112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb7d7c-a8f3-4524-ae4c-b675eea8f69d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:39.153684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb7d7c-a8f3-4524-ae4c-b675eea8f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:39.217552 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3946/7830] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:39 2022] POST /identity/v3/projects => generated 359 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:39.221113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a047b-09f8-4aff-bc61-6efafff0dc36 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:39.222793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-dfbb7d7c-a8f3-4524-ae4c-b675eea8f69d None None] MFA Rules not processed for user `f73d404f88cd4f8f9b4882fd9f6abb20`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:39.224952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dfbb7d7c-a8f3-4524-ae4c-b675eea8f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:39.512509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:39.525300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a047b-09f8-4aff-bc61-6efafff0dc36 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:39.535962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23678b-9c4d-4ac1-ad8c-d66d28b98da2 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0273c8fbe00b4649890f9bc0a03cb414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a14f2a7b46904e4da48fc94a535b4048', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:39.537334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23678b-9c4d-4ac1-ad8c-d66d28b98da2 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:39.537742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23678b-9c4d-4ac1-ad8c-d66d28b98da2 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:39.538141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23678b-9c4d-4ac1-ad8c-d66d28b98da2 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:39.539135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23678b-9c4d-4ac1-ad8c-d66d28b98da2 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:39.541727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23678b-9c4d-4ac1-ad8c-d66d28b98da2 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:39.565691 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3885/7831] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:39.577194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb7d7c-a8f3-4524-ae4c-b675eea8f69d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:39.588184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dfbb7d7c-a8f3-4524-ae4c-b675eea8f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:39.623350 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3947/7832] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:39 2022] POST /identity/v3/users => generated 371 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:39.627468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23678b-9c4d-4ac1-ad8c-d66d28b98da2 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:39.649614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23678b-9c4d-4ac1-ad8c-d66d28b98da2 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:39.663185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1340358-c7d9-4deb-968d-0a9f3ec6c6cb tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0273c8fbe00b4649890f9bc0a03cb414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a14f2a7b46904e4da48fc94a535b4048', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:39.664276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1340358-c7d9-4deb-968d-0a9f3ec6c6cb tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:39.664768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1340358-c7d9-4deb-968d-0a9f3ec6c6cb tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:39.665250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1340358-c7d9-4deb-968d-0a9f3ec6c6cb tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:39.666245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1340358-c7d9-4deb-968d-0a9f3ec6c6cb tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:39.667042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1340358-c7d9-4deb-968d-0a9f3ec6c6cb tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:39.670150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1340358-c7d9-4deb-968d-0a9f3ec6c6cb tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:39.721177 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3948/7833] 10.222.0.16 () {58 vars in 1157 bytes} [Mon Aug 29 15:59:39 2022] GET /identity/v3/users?domain_id=default => generated 7430 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:39.725722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1340358-c7d9-4deb-968d-0a9f3ec6c6cb tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:39.744921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1340358-c7d9-4deb-968d-0a9f3ec6c6cb tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:39.756222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0273c8fbe00b4649890f9bc0a03cb414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a14f2a7b46904e4da48fc94a535b4048', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:39.757242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] REQUEST_METHOD: `PATCH` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:39.757886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:39.758361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] PATH_INFO: `/v3/users/068343ce857d47b4896669fb9812db62` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:39.792369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorizing `identity:update_user(user_id=068343ce857d47b4896669fb9812db62)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:39.794764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:39.803261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb7d7c-a8f3-4524-ae4c-b675eea8f69d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:39.813785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c52ed-2c75-4189-8afa-fcdb66332704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:39.814418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c52ed-2c75-4189-8afa-fcdb66332704 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:39.815319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c52ed-2c75-4189-8afa-fcdb66332704 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:39.815608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c52ed-2c75-4189-8afa-fcdb66332704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:39.833419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c52ed-2c75-4189-8afa-fcdb66332704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:39.835905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c52ed-2c75-4189-8afa-fcdb66332704 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:39.871789 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3886/7834] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:39.904437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '068343ce857d47b4896669fb9812db62'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:39.929715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invalidating the token cache because user 068343ce857d47b4896669fb9812db62 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:39.929715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:39.930470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:39.933273 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3949/7835] 10.222.0.16 () {60 vars in 1244 bytes} [Mon Aug 29 15:59:39 2022] PATCH /identity/v3/users/068343ce857d47b4896669fb9812db62 => generated 485 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:59:39.937567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742478b9-bad7-4d83-b51c-6207da273263 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:39.937857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742478b9-bad7-4d83-b51c-6207da273263 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:39.938208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742478b9-bad7-4d83-b51c-6207da273263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:39.973104 n-d-854882-3 devstack@keystone.service[89680]: WARNING keystone.auth.plugins.core [None req-742478b9-bad7-4d83-b51c-6207da273263 None None] User is disabled: 068343ce857d47b4896669fb9812db62: AssertionError: User is disabled: 068343ce857d47b4896669fb9812db62 Aug 29 15:59:39.998014 n-d-854882-3 devstack@keystone.service[89680]: WARNING keystone.server.flask.application [None req-742478b9-bad7-4d83-b51c-6207da273263 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 29 15:59:39.999824 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3887/7836] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:39 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 63 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 29 15:59:40.003930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:40.006179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:40.034225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515fff-c350-460c-a19d-0e30b2964d9f tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:40.064827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0273c8fbe00b4649890f9bc0a03cb414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a14f2a7b46904e4da48fc94a535b4048', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:40.065087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:40.065568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:40.065776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] PATH_INFO: `/v3/users/068343ce857d47b4896669fb9812db62` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:40.093097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:40.101668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorizing `identity:delete_user(user_id=068343ce857d47b4896669fb9812db62)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:40.104351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:40.245597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068343ce857d47b4896669fb9812db62'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:40.248451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068343ce857d47b4896669fb9812db62'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:40.303346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068343ce857d47b4896669fb9812db62'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:40.305280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068343ce857d47b4896669fb9812db62'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:40.325332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068343ce857d47b4896669fb9812db62'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:40.350496 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3950/7837] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:40 2022] DELETE /identity/v3/users/068343ce857d47b4896669fb9812db62 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:40.353284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742478b9-bad7-4d83-b51c-6207da273263 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:40.356979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-742478b9-bad7-4d83-b51c-6207da273263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:40.528477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742478b9-bad7-4d83-b51c-6207da273263 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:40.535324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0273c8fbe00b4649890f9bc0a03cb414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a14f2a7b46904e4da48fc94a535b4048', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:40.536441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:40.537525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:40.538068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] PATH_INFO: `/v3/projects/a00d454b9617496faafa6e27a2ef9998` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:40.539790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a00d454b9617496faafa6e27a2ef9998)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:40.542338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:40.653976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00d454b9617496faafa6e27a2ef9998', 'request_id': 'req-d141c19b-86f1-4ea3-a177-6dadbabbed3a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:40.660402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00d454b9617496faafa6e27a2ef9998', 'request_id': 'req-d141c19b-86f1-4ea3-a177-6dadbabbed3a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:40.672545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00d454b9617496faafa6e27a2ef9998', 'request_id': 'req-d141c19b-86f1-4ea3-a177-6dadbabbed3a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:40.696072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] The token cache is being invalidate because project a00d454b9617496faafa6e27a2ef9998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:40.696072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:40.697955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:40.701014 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3888/7838] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:40 2022] DELETE /identity/v3/projects/a00d454b9617496faafa6e27a2ef9998 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:40.705938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:40.716958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37e2f8-0af2-4e54-ad3a-789790dfb339 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:40.980106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6d3de-e176-47b5-aeed-38ab69ff3520 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0273c8fbe00b4649890f9bc0a03cb414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a14f2a7b46904e4da48fc94a535b4048', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:40.980856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6d3de-e176-47b5-aeed-38ab69ff3520 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:40.981155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6d3de-e176-47b5-aeed-38ab69ff3520 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:40.981584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6d3de-e176-47b5-aeed-38ab69ff3520 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:40.982515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6d3de-e176-47b5-aeed-38ab69ff3520 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:40.984983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6d3de-e176-47b5-aeed-38ab69ff3520 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-5bb6d3de-e176-47b5-aeed-38ab69ff3520 tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Could not find domain: 0d034812628442a5b5fc24095f7013d4.: keystone.exception.DomainNotFound: Could not find domain: 0d034812628442a5b5fc24095f7013d4. Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0d034812628442a5b5fc24095f7013d4. Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:41.003079 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 15:59:41.004324 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application with Lock( Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._enter() Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.creator() Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 15:59:41.005616 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application created_value = creator( Aug 29 15:59:41.006747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 15:59:41.006747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 15:59:41.006747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0d034812628442a5b5fc24095f7013d4. Aug 29 15:59:41.006747 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 15:59:41.009413 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3951/7839] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:40 2022] POST /identity/v3/users => generated 112 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 29 15:59:41.010628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:41.012298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:41.073201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:41.220066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141c19b-86f1-4ea3-a177-6dadbabbed3a tempest-UsersNegativeTest-1004754288 tempest-UsersNegativeTest-1004754288-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:41.231692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:41.233067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:41.233633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:41.234293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] PATH_INFO: `/v3/users/3524fba0b3cc4d989ac03d69e3557cfa` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:41.235760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3524fba0b3cc4d989ac03d69e3557cfa)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:41.242821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:41.382945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3524fba0b3cc4d989ac03d69e3557cfa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:41.383817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3524fba0b3cc4d989ac03d69e3557cfa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:41.430445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3524fba0b3cc4d989ac03d69e3557cfa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:41.451901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3524fba0b3cc4d989ac03d69e3557cfa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:41.479757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3524fba0b3cc4d989ac03d69e3557cfa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:41.511807 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3889/7840] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:41 2022] DELETE /identity/v3/users/3524fba0b3cc4d989ac03d69e3557cfa => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:41.513867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381e004-aa40-4e90-8cb0-76315deb0e2a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:41.514160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381e004-aa40-4e90-8cb0-76315deb0e2a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:41.514548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381e004-aa40-4e90-8cb0-76315deb0e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:41.573591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2381e004-aa40-4e90-8cb0-76315deb0e2a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:41.574835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2381e004-aa40-4e90-8cb0-76315deb0e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:41.742189 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3952/7841] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:41.765449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:41.767145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:41.805355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891e52-ee90-4cac-8ef4-653653dbc3fc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:41.805866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891e52-ee90-4cac-8ef4-653653dbc3fc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:41.806304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891e52-ee90-4cac-8ef4-653653dbc3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:41.874414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:41.891281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e8891e52-ee90-4cac-8ef4-653653dbc3fc None None] MFA Rules not processed for user `21a3b05def674718ba8ef668abf7ea46`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:41.894072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e8891e52-ee90-4cac-8ef4-653653dbc3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:41.940522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb3d23-9a72-44c5-a110-654de360f49b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:41.950270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff968f7-f203-4fa8-a003-2ac5785c482b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:41.950795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff968f7-f203-4fa8-a003-2ac5785c482b service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:41.951076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff968f7-f203-4fa8-a003-2ac5785c482b service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:41.951354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff968f7-f203-4fa8-a003-2ac5785c482b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:41.981106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff968f7-f203-4fa8-a003-2ac5785c482b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:41.982616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff968f7-f203-4fa8-a003-2ac5785c482b service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:42.010233 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3890/7842] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:42.044065 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3953/7843] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:42.057732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff968f7-f203-4fa8-a003-2ac5785c482b service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:42.059534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dff968f7-f203-4fa8-a003-2ac5785c482b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:42.129362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:42.144022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff968f7-f203-4fa8-a003-2ac5785c482b service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:42.172492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e113f8-202b-4d9e-bc4a-7771b4423aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:42.175144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e113f8-202b-4d9e-bc4a-7771b4423aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:42.175448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e113f8-202b-4d9e-bc4a-7771b4423aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:42.175732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e113f8-202b-4d9e-bc4a-7771b4423aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:42.212581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e113f8-202b-4d9e-bc4a-7771b4423aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:42.217242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e113f8-202b-4d9e-bc4a-7771b4423aa2 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:42.260615 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3891/7844] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:42.469374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8891e52-ee90-4cac-8ef4-653653dbc3fc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:42.492282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8891e52-ee90-4cac-8ef4-653653dbc3fc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:42.504112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70c20-1086-443a-bac1-082a591dbad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:42.505209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70c20-1086-443a-bac1-082a591dbad7 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:42.505209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70c20-1086-443a-bac1-082a591dbad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:42.505528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70c20-1086-443a-bac1-082a591dbad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:42.516151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-38e70c20-1086-443a-bac1-082a591dbad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:42.655971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e70c20-1086-443a-bac1-082a591dbad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:42.657485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e70c20-1086-443a-bac1-082a591dbad7 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:42.672879 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3954/7845] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:42.814540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e113f8-202b-4d9e-bc4a-7771b4423aa2 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:42.817099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-90e113f8-202b-4d9e-bc4a-7771b4423aa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:42.870596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e113f8-202b-4d9e-bc4a-7771b4423aa2 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:42.899178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:42.902199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:42.903065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:42.906287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] PATH_INFO: `/v3/projects/a4fd6689f90a4b24ba477cc6e72fdfea` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:42.910141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4fd6689f90a4b24ba477cc6e72fdfea)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:42.923242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:43.068649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4fd6689f90a4b24ba477cc6e72fdfea', 'request_id': 'req-929fd468-8547-478d-84e9-4939c6cced78'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:43.081066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4fd6689f90a4b24ba477cc6e72fdfea', 'request_id': 'req-929fd468-8547-478d-84e9-4939c6cced78'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:43.096117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4fd6689f90a4b24ba477cc6e72fdfea', 'request_id': 'req-929fd468-8547-478d-84e9-4939c6cced78'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:43.113353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] The token cache is being invalidate because project a4fd6689f90a4b24ba477cc6e72fdfea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:43.113679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:43.114536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:43.116649 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3892/7846] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:42 2022] DELETE /identity/v3/projects/a4fd6689f90a4b24ba477cc6e72fdfea => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:43.120746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70c20-1086-443a-bac1-082a591dbad7 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:43.149617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70c20-1086-443a-bac1-082a591dbad7 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:43.270544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3255b-0207-4063-9f36-48c2e8244cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:43.271287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3255b-0207-4063-9f36-48c2e8244cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:43.271576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3255b-0207-4063-9f36-48c2e8244cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:43.271854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3255b-0207-4063-9f36-48c2e8244cd3 admin admin] PATH_INFO: `/v3/users/0273c8fbe00b4649890f9bc0a03cb414` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:43.276429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3255b-0207-4063-9f36-48c2e8244cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0273c8fbe00b4649890f9bc0a03cb414)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:43.276429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3255b-0207-4063-9f36-48c2e8244cd3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:43.357452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:43.369933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3fa3255b-0207-4063-9f36-48c2e8244cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0273c8fbe00b4649890f9bc0a03cb414'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:43.370950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3fa3255b-0207-4063-9f36-48c2e8244cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0273c8fbe00b4649890f9bc0a03cb414'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:43.388585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3fa3255b-0207-4063-9f36-48c2e8244cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0273c8fbe00b4649890f9bc0a03cb414'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:43.389467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3fa3255b-0207-4063-9f36-48c2e8244cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0273c8fbe00b4649890f9bc0a03cb414'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:43.400116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3fa3255b-0207-4063-9f36-48c2e8244cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0273c8fbe00b4649890f9bc0a03cb414'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:43.434872 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3955/7847] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:43 2022] DELETE /identity/v3/users/0273c8fbe00b4649890f9bc0a03cb414 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:44.355161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:44.356658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:44.397103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fd468-8547-478d-84e9-4939c6cced78 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:44.527879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:44.528535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:44.529164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:44.530420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] PATH_INFO: `/v3/projects/a14f2a7b46904e4da48fc94a535b4048` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:44.531819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14f2a7b46904e4da48fc94a535b4048)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:44.534397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:44.659918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14f2a7b46904e4da48fc94a535b4048', 'request_id': 'req-e2c1e230-3d06-4aa1-a3b6-186199aabda5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:44.670278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14f2a7b46904e4da48fc94a535b4048', 'request_id': 'req-e2c1e230-3d06-4aa1-a3b6-186199aabda5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:44.684861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14f2a7b46904e4da48fc94a535b4048', 'request_id': 'req-e2c1e230-3d06-4aa1-a3b6-186199aabda5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:44.742337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:44.756664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] The token cache is being invalidate because project a14f2a7b46904e4da48fc94a535b4048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:44.757125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:44.759216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:44.783249 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3893/7848] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:44 2022] DELETE /identity/v3/projects/a14f2a7b46904e4da48fc94a535b4048 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:44.790233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88371b-5cb9-4e34-9c88-23b439e48440 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:44.791741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88371b-5cb9-4e34-9c88-23b439e48440 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:44.791741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88371b-5cb9-4e34-9c88-23b439e48440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:44.829976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6b88371b-5cb9-4e34-9c88-23b439e48440 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:44.831703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6b88371b-5cb9-4e34-9c88-23b439e48440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:44.905374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:44.908045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:44.928679 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3956/7849] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:44.936253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb459d-959a-48b9-9f04-3037f4c802e8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:44.937678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb459d-959a-48b9-9f04-3037f4c802e8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:44.939879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb459d-959a-48b9-9f04-3037f4c802e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:44.982196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e4cb459d-959a-48b9-9f04-3037f4c802e8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:44.985554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e4cb459d-959a-48b9-9f04-3037f4c802e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:45.013995 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3957/7850] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:45.018168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb459d-959a-48b9-9f04-3037f4c802e8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:45.053842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb459d-959a-48b9-9f04-3037f4c802e8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:45.072352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99d320-7b47-42c2-bda0-afbd5437d74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:45.075131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99d320-7b47-42c2-bda0-afbd5437d74c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.075640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99d320-7b47-42c2-bda0-afbd5437d74c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.076702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99d320-7b47-42c2-bda0-afbd5437d74c admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.078386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99d320-7b47-42c2-bda0-afbd5437d74c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:45.080722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99d320-7b47-42c2-bda0-afbd5437d74c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:45.085897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99d320-7b47-42c2-bda0-afbd5437d74c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:45.103887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1e230-3d06-4aa1-a3b6-186199aabda5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:45.112712 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3958/7851] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:45.114129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad46dd-2f8d-4265-a8aa-81c6f8b3575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:45.116051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99d320-7b47-42c2-bda0-afbd5437d74c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:45.116574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad46dd-2f8d-4265-a8aa-81c6f8b3575b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.116923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad46dd-2f8d-4265-a8aa-81c6f8b3575b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.117268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad46dd-2f8d-4265-a8aa-81c6f8b3575b admin admin] PATH_INFO: `/v3/users/f73d404f88cd4f8f9b4882fd9f6abb20` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.120059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad46dd-2f8d-4265-a8aa-81c6f8b3575b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73d404f88cd4f8f9b4882fd9f6abb20)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:45.126727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad46dd-2f8d-4265-a8aa-81c6f8b3575b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:45.138798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99d320-7b47-42c2-bda0-afbd5437d74c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:45.158561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a386a3-dd38-4a70-b7a8-b7940d0f1f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:45.159271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a386a3-dd38-4a70-b7a8-b7940d0f1f58 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.159615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a386a3-dd38-4a70-b7a8-b7940d0f1f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.159888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a386a3-dd38-4a70-b7a8-b7940d0f1f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.160520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a386a3-dd38-4a70-b7a8-b7940d0f1f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:45.163220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a386a3-dd38-4a70-b7a8-b7940d0f1f58 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:45.218069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a6ad46dd-2f8d-4265-a8aa-81c6f8b3575b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73d404f88cd4f8f9b4882fd9f6abb20'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.220104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a6ad46dd-2f8d-4265-a8aa-81c6f8b3575b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73d404f88cd4f8f9b4882fd9f6abb20'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.231370 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3959/7852] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:45 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:45.233012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a386a3-dd38-4a70-b7a8-b7940d0f1f58 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:45.252875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a6ad46dd-2f8d-4265-a8aa-81c6f8b3575b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73d404f88cd4f8f9b4882fd9f6abb20'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.266994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a6ad46dd-2f8d-4265-a8aa-81c6f8b3575b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73d404f88cd4f8f9b4882fd9f6abb20'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.283571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a6ad46dd-2f8d-4265-a8aa-81c6f8b3575b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73d404f88cd4f8f9b4882fd9f6abb20'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:45.300528 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3894/7853] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:44 2022] DELETE /identity/v3/users/f73d404f88cd4f8f9b4882fd9f6abb20 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:45.302110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750d87-994c-495c-b7da-ae5272e2c387 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.302499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750d87-994c-495c-b7da-ae5272e2c387 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.302858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750d87-994c-495c-b7da-ae5272e2c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.344554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-46750d87-994c-495c-b7da-ae5272e2c387 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:45.346918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-46750d87-994c-495c-b7da-ae5272e2c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:45.389768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a386a3-dd38-4a70-b7a8-b7940d0f1f58 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:45.442431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:45.490834 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3895/7854] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:45.500764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46750d87-994c-495c-b7da-ae5272e2c387 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:45.502595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-46750d87-994c-495c-b7da-ae5272e2c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:45.554788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:45.560548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e7377-102b-4240-8e8c-e8db6049be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:45.561696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e7377-102b-4240-8e8c-e8db6049be23 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.562877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e7377-102b-4240-8e8c-e8db6049be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.565814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e7377-102b-4240-8e8c-e8db6049be23 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.570374 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e7377-102b-4240-8e8c-e8db6049be23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:45.574334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e7377-102b-4240-8e8c-e8db6049be23 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:45.644605 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3960/7855] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:45 2022] POST /identity/v3/users => generated 285 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:45.648804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e7377-102b-4240-8e8c-e8db6049be23 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:45.658419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-332e7377-102b-4240-8e8c-e8db6049be23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:45.687539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e7377-102b-4240-8e8c-e8db6049be23 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:45.713825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12352f64-ee1d-44d1-980a-59927830d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:45.717892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12352f64-ee1d-44d1-980a-59927830d439 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.718281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12352f64-ee1d-44d1-980a-59927830d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.718628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12352f64-ee1d-44d1-980a-59927830d439 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.719386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12352f64-ee1d-44d1-980a-59927830d439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:45.726690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46750d87-994c-495c-b7da-ae5272e2c387 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:45.731573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d2826-4396-4c5f-932e-d60977d07154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:45.732601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d2826-4396-4c5f-932e-d60977d07154 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.733080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d2826-4396-4c5f-932e-d60977d07154 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.733645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d2826-4396-4c5f-932e-d60977d07154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.748524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12352f64-ee1d-44d1-980a-59927830d439 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:45.765498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d2826-4396-4c5f-932e-d60977d07154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:45.769135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d2826-4396-4c5f-932e-d60977d07154 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:45.795016 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3961/7856] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:45.801920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12352f64-ee1d-44d1-980a-59927830d439 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:45.814187 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3896/7857] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:59:45.838585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12352f64-ee1d-44d1-980a-59927830d439 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:45.857822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb83c0-8672-445e-8c0b-69bb45bb2316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:45.858795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb83c0-8672-445e-8c0b-69bb45bb2316 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.859254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb83c0-8672-445e-8c0b-69bb45bb2316 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.859702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb83c0-8672-445e-8c0b-69bb45bb2316 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.860588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb83c0-8672-445e-8c0b-69bb45bb2316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:45.863316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb83c0-8672-445e-8c0b-69bb45bb2316 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:45.864893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76735988-69d5-47e1-b6b7-0148f2da712b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.865186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76735988-69d5-47e1-b6b7-0148f2da712b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.865511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76735988-69d5-47e1-b6b7-0148f2da712b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.879584 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3962/7858] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:45.884485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb83c0-8672-445e-8c0b-69bb45bb2316 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:45.899718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb83c0-8672-445e-8c0b-69bb45bb2316 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:45.906033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-76735988-69d5-47e1-b6b7-0148f2da712b None None] MFA Rules not processed for user `e276b9fae4594c17a1883dd4e48184c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:45.916417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76735988-69d5-47e1-b6b7-0148f2da712b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:45.924496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a10c95-645d-48c5-8b5a-3bec39491e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:45.925587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a10c95-645d-48c5-8b5a-3bec39491e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.925990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a10c95-645d-48c5-8b5a-3bec39491e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.926471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a10c95-645d-48c5-8b5a-3bec39491e4e admin admin] PATH_INFO: `/v3/projects/9e9901bb84a2486bbb9773e5968eeadb/users/09dee66466af4b69a28e0d576a215b31/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:45.945911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a10c95-645d-48c5-8b5a-3bec39491e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9901bb84a2486bbb9773e5968eeadb, user_id=09dee66466af4b69a28e0d576a215b31, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:45.949238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a10c95-645d-48c5-8b5a-3bec39491e4e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:45.974851 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3963/7859] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:45 2022] PUT /identity/v3/projects/9e9901bb84a2486bbb9773e5968eeadb/users/09dee66466af4b69a28e0d576a215b31/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:45.986314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326448-ba85-4d4e-8eaa-d56b7309b689 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:45.986828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326448-ba85-4d4e-8eaa-d56b7309b689 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:45.987504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326448-ba85-4d4e-8eaa-d56b7309b689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:46.029044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-68326448-ba85-4d4e-8eaa-d56b7309b689 None None] MFA Rules not processed for user `09dee66466af4b69a28e0d576a215b31`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:46.031512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-68326448-ba85-4d4e-8eaa-d56b7309b689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:46.141096 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3897/7860] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:46.144562 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3964/7861] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:46.152512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76735988-69d5-47e1-b6b7-0148f2da712b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:46.277645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326448-ba85-4d4e-8eaa-d56b7309b689 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:46.280387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-68326448-ba85-4d4e-8eaa-d56b7309b689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:46.424224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76735988-69d5-47e1-b6b7-0148f2da712b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:46.433929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3bdce-7dee-4f2e-8721-cb44c6caabd2 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09dee66466af4b69a28e0d576a215b31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9901bb84a2486bbb9773e5968eeadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:46.435566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3bdce-7dee-4f2e-8721-cb44c6caabd2 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:46.435843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3bdce-7dee-4f2e-8721-cb44c6caabd2 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:46.436120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3bdce-7dee-4f2e-8721-cb44c6caabd2 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] PATH_INFO: `/v3/users/09dee66466af4b69a28e0d576a215b31/application_credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:46.436816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3bdce-7dee-4f2e-8721-cb44c6caabd2 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorizing `identity:create_application_credential(user_id=09dee66466af4b69a28e0d576a215b31)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:46.438024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3bdce-7dee-4f2e-8721-cb44c6caabd2 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:46.456754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:46.481807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326448-ba85-4d4e-8eaa-d56b7309b689 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:46.487984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:46.489029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:46.490413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:46.490931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] PATH_INFO: `/v3/projects/a0b88c82dca7484787f6d069171f4919` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:46.492645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b88c82dca7484787f6d069171f4919)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:46.495761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:46.612822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b88c82dca7484787f6d069171f4919', 'request_id': 'req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:46.625177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b88c82dca7484787f6d069171f4919', 'request_id': 'req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:46.644992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b88c82dca7484787f6d069171f4919', 'request_id': 'req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:46.647299 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3898/7862] 10.222.0.16 () {60 vars in 1315 bytes} [Mon Aug 29 15:59:46 2022] POST /identity/v3/users/09dee66466af4b69a28e0d576a215b31/application_credentials => generated 920 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:46.651153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3bdce-7dee-4f2e-8721-cb44c6caabd2 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:46.658383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:46.663531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] The token cache is being invalidate because project a0b88c82dca7484787f6d069171f4919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:46.664350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:46.665520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3916e9ff-3d69-49c8-b35d-0a76a2e4f59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:46.670877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3bdce-7dee-4f2e-8721-cb44c6caabd2 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:46.672874 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3965/7863] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:46 2022] DELETE /identity/v3/projects/a0b88c82dca7484787f6d069171f4919 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:46.674489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeabcd-5a95-453d-850f-b4e9dd39f1f4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:46.675543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeabcd-5a95-453d-850f-b4e9dd39f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:46.675543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeabcd-5a95-453d-850f-b4e9dd39f1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:46.708803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5abeabcd-5a95-453d-850f-b4e9dd39f1f4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:46.710739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5abeabcd-5a95-453d-850f-b4e9dd39f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:46.814348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286e119-0de1-4f3f-bf3d-b5f290ab7318 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09dee66466af4b69a28e0d576a215b31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9901bb84a2486bbb9773e5968eeadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:46.816246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e119-0de1-4f3f-bf3d-b5f290ab7318 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:46.817024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e119-0de1-4f3f-bf3d-b5f290ab7318 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:46.818306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e119-0de1-4f3f-bf3d-b5f290ab7318 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] PATH_INFO: `/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules/c9dc0338accf42bfb64369d2ca21cba1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:46.821506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286e119-0de1-4f3f-bf3d-b5f290ab7318 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorizing `identity:delete_access_rule(user_id=09dee66466af4b69a28e0d576a215b31, access_rule_id=c9dc0338accf42bfb64369d2ca21cba1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:46.823084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286e119-0de1-4f3f-bf3d-b5f290ab7318 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:46.853809 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3966/7864] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:46.862556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b639d4-91ad-46b5-a1ec-9dc4f6b71a90 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:46.864035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b639d4-91ad-46b5-a1ec-9dc4f6b71a90 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:46.864489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b639d4-91ad-46b5-a1ec-9dc4f6b71a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application [None req-0286e119-0de1-4f3f-bf3d-b5f290ab7318 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application session.delete(ref) Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application yield resource Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application next(self.gen) Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:59:46.882556 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise self.value Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application session.commit() Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.session.flush() Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:59:46.883909 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application compat.raise_( Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self._synchronize( Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise AssertionError( Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Aug 29 15:59:46.885163 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 15:59:46.886546 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 15:59:46.888228 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Aug 29 15:59:46.888228 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Aug 29 15:59:46.888228 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Aug 29 15:59:46.888228 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 29 15:59:46.888228 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 29 15:59:46.888228 n-d-854882-3 devstack@keystone.service[89680]: ERROR keystone.server.flask.application Aug 29 15:59:46.891089 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3899/7865] 10.222.0.16 () {58 vars in 1362 bytes} [Mon Aug 29 15:59:46 2022] DELETE /identity/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules/c9dc0338accf42bfb64369d2ca21cba1 => generated 89 bytes in 240 msecs (HTTP/1.1 403) 5 headers in 183 bytes (2 switches on core 0) Aug 29 15:59:46.895777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286e119-0de1-4f3f-bf3d-b5f290ab7318 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:46.899796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0286e119-0de1-4f3f-bf3d-b5f290ab7318 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:46.937517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c3b639d4-91ad-46b5-a1ec-9dc4f6b71a90 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:46.939732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286e119-0de1-4f3f-bf3d-b5f290ab7318 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:46.943982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c3b639d4-91ad-46b5-a1ec-9dc4f6b71a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:46.951614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c231c-ed11-4af1-8bff-c5b02b023c62 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09dee66466af4b69a28e0d576a215b31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9901bb84a2486bbb9773e5968eeadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:46.952498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c231c-ed11-4af1-8bff-c5b02b023c62 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:46.953766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c231c-ed11-4af1-8bff-c5b02b023c62 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:46.954647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c231c-ed11-4af1-8bff-c5b02b023c62 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] PATH_INFO: `/v3/users/09dee66466af4b69a28e0d576a215b31/application_credentials/1f15fe89a63a44fdb16f48687937357c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:46.965961 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3967/7866] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:46.970624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b639d4-91ad-46b5-a1ec-9dc4f6b71a90 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:46.986677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b639d4-91ad-46b5-a1ec-9dc4f6b71a90 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:46.988019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c231c-ed11-4af1-8bff-c5b02b023c62 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorizing `identity:delete_application_credential(user_id=09dee66466af4b69a28e0d576a215b31, application_credential_id=1f15fe89a63a44fdb16f48687937357c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:46.996783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c231c-ed11-4af1-8bff-c5b02b023c62 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.012968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea83d0-6afa-4043-8eae-aad110e659af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.014024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea83d0-6afa-4043-8eae-aad110e659af admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.014541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea83d0-6afa-4043-8eae-aad110e659af admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.015267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea83d0-6afa-4043-8eae-aad110e659af admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.016169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea83d0-6afa-4043-8eae-aad110e659af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:47.016710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea83d0-6afa-4043-8eae-aad110e659af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.018843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea83d0-6afa-4043-8eae-aad110e659af admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.064941 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3900/7867] 10.222.0.16 () {58 vars in 1395 bytes} [Mon Aug 29 15:59:46 2022] DELETE /identity/v3/users/09dee66466af4b69a28e0d576a215b31/application_credentials/1f15fe89a63a44fdb16f48687937357c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:47.074186 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3968/7868] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:47.080306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c231c-ed11-4af1-8bff-c5b02b023c62 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.080510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea83d0-6afa-4043-8eae-aad110e659af admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.107900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c231c-ed11-4af1-8bff-c5b02b023c62 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.113938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb5cf8-bc0a-4ba2-97c8-09ab826bfe60 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09dee66466af4b69a28e0d576a215b31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9901bb84a2486bbb9773e5968eeadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.115185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb5cf8-bc0a-4ba2-97c8-09ab826bfe60 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.115430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb5cf8-bc0a-4ba2-97c8-09ab826bfe60 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.115772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb5cf8-bc0a-4ba2-97c8-09ab826bfe60 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] PATH_INFO: `/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.117483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb5cf8-bc0a-4ba2-97c8-09ab826bfe60 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorizing `identity:list_access_rules(user_id=09dee66466af4b69a28e0d576a215b31)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.119591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb5cf8-bc0a-4ba2-97c8-09ab826bfe60 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.124617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea83d0-6afa-4043-8eae-aad110e659af admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.132609 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3901/7869] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:59:47 2022] GET /identity/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules => generated 369 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:47.136211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb5cf8-bc0a-4ba2-97c8-09ab826bfe60 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.137292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc38c3-e49d-4c50-9ca8-322378ed2067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.138060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc38c3-e49d-4c50-9ca8-322378ed2067 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.138234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc38c3-e49d-4c50-9ca8-322378ed2067 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.138508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc38c3-e49d-4c50-9ca8-322378ed2067 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.139148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc38c3-e49d-4c50-9ca8-322378ed2067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.142237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc38c3-e49d-4c50-9ca8-322378ed2067 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.152777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb5cf8-bc0a-4ba2-97c8-09ab826bfe60 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.158822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c05e77-9f58-451e-a607-5eb1e11f92b0 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09dee66466af4b69a28e0d576a215b31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9901bb84a2486bbb9773e5968eeadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.160213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c05e77-9f58-451e-a607-5eb1e11f92b0 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.160667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c05e77-9f58-451e-a607-5eb1e11f92b0 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.161187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c05e77-9f58-451e-a607-5eb1e11f92b0 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] PATH_INFO: `/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules/c9dc0338accf42bfb64369d2ca21cba1` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.163188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c05e77-9f58-451e-a607-5eb1e11f92b0 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorizing `identity:delete_access_rule(user_id=09dee66466af4b69a28e0d576a215b31, access_rule_id=c9dc0338accf42bfb64369d2ca21cba1)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.164731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c05e77-9f58-451e-a607-5eb1e11f92b0 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.201025 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3902/7870] 10.222.0.16 () {58 vars in 1362 bytes} [Mon Aug 29 15:59:47 2022] DELETE /identity/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules/c9dc0338accf42bfb64369d2ca21cba1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:47.207563 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3969/7871] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:47 2022] POST /identity/v3/projects => generated 403 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:47.212399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c05e77-9f58-451e-a607-5eb1e11f92b0 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.219318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc38c3-e49d-4c50-9ca8-322378ed2067 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.230649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c05e77-9f58-451e-a607-5eb1e11f92b0 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.411068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697abb4-d7f8-4161-a65d-b4086f04db2d tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09dee66466af4b69a28e0d576a215b31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9901bb84a2486bbb9773e5968eeadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.412751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697abb4-d7f8-4161-a65d-b4086f04db2d tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.413215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697abb4-d7f8-4161-a65d-b4086f04db2d tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.414015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697abb4-d7f8-4161-a65d-b4086f04db2d tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] PATH_INFO: `/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.415510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697abb4-d7f8-4161-a65d-b4086f04db2d tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorizing `identity:list_access_rules(user_id=09dee66466af4b69a28e0d576a215b31)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.419396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697abb4-d7f8-4161-a65d-b4086f04db2d tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.434521 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3903/7872] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:59:47 2022] GET /identity/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules => generated 158 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:47.439582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697abb4-d7f8-4161-a65d-b4086f04db2d tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.462702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697abb4-d7f8-4161-a65d-b4086f04db2d tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.469250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591662cb-081a-41d9-81ae-e92850ea4e89 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09dee66466af4b69a28e0d576a215b31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9901bb84a2486bbb9773e5968eeadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.470125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591662cb-081a-41d9-81ae-e92850ea4e89 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.470534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591662cb-081a-41d9-81ae-e92850ea4e89 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.471313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591662cb-081a-41d9-81ae-e92850ea4e89 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] PATH_INFO: `/v3/users/09dee66466af4b69a28e0d576a215b31/application_credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.472097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591662cb-081a-41d9-81ae-e92850ea4e89 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorizing `identity:create_application_credential(user_id=09dee66466af4b69a28e0d576a215b31)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.473366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591662cb-081a-41d9-81ae-e92850ea4e89 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.476993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:47.532262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:47.543138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc38c3-e49d-4c50-9ca8-322378ed2067 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.553955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e81ae-183a-42a0-b0a5-edbd8c30a550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.554628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e81ae-183a-42a0-b0a5-edbd8c30a550 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.554912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e81ae-183a-42a0-b0a5-edbd8c30a550 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.555185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e81ae-183a-42a0-b0a5-edbd8c30a550 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.556053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e81ae-183a-42a0-b0a5-edbd8c30a550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.558382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e81ae-183a-42a0-b0a5-edbd8c30a550 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.590485 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3970/7873] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:47 2022] POST /identity/v3/users => generated 302 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:47.594713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e81ae-183a-42a0-b0a5-edbd8c30a550 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.606946 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3904/7874] 10.222.0.16 () {60 vars in 1315 bytes} [Mon Aug 29 15:59:47 2022] POST /identity/v3/users/09dee66466af4b69a28e0d576a215b31/application_credentials => generated 920 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:47.611596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591662cb-081a-41d9-81ae-e92850ea4e89 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.623506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e81ae-183a-42a0-b0a5-edbd8c30a550 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.642257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591662cb-081a-41d9-81ae-e92850ea4e89 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.645741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b8a05-b198-4482-a4e3-3a438cf2cb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.650121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b8a05-b198-4482-a4e3-3a438cf2cb4b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.650408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b8a05-b198-4482-a4e3-3a438cf2cb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.650689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b8a05-b198-4482-a4e3-3a438cf2cb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.652047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b8a05-b198-4482-a4e3-3a438cf2cb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.653347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba6ee6-daca-4d2d-80a6-19776ea76283 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09dee66466af4b69a28e0d576a215b31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9901bb84a2486bbb9773e5968eeadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.654045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6ee6-daca-4d2d-80a6-19776ea76283 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.654284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b8a05-b198-4482-a4e3-3a438cf2cb4b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.654453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6ee6-daca-4d2d-80a6-19776ea76283 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.654690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6ee6-daca-4d2d-80a6-19776ea76283 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] PATH_INFO: `/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.655934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba6ee6-daca-4d2d-80a6-19776ea76283 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorizing `identity:list_access_rules(user_id=09dee66466af4b69a28e0d576a215b31)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.658889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba6ee6-daca-4d2d-80a6-19776ea76283 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.669085 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3971/7875] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:47.673190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b8a05-b198-4482-a4e3-3a438cf2cb4b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.673989 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3905/7876] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Aug 29 15:59:47 2022] GET /identity/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules => generated 369 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 15:59:47.679484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba6ee6-daca-4d2d-80a6-19776ea76283 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.695830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b8a05-b198-4482-a4e3-3a438cf2cb4b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.705037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0f396-e472-4ea3-835c-8f756576a37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.706328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0f396-e472-4ea3-835c-8f756576a37c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.706594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba6ee6-daca-4d2d-80a6-19776ea76283 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.708211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0f396-e472-4ea3-835c-8f756576a37c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.710627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0f396-e472-4ea3-835c-8f756576a37c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.712579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0f396-e472-4ea3-835c-8f756576a37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.714731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0f396-e472-4ea3-835c-8f756576a37c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.731504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70158a0-840f-49f2-ba8e-2a09b1ee4191 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09dee66466af4b69a28e0d576a215b31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9901bb84a2486bbb9773e5968eeadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.732516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70158a0-840f-49f2-ba8e-2a09b1ee4191 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.732981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70158a0-840f-49f2-ba8e-2a09b1ee4191 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.733441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70158a0-840f-49f2-ba8e-2a09b1ee4191 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] PATH_INFO: `/v3/users/09dee66466af4b69a28e0d576a215b31/application_credentials` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.734308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70158a0-840f-49f2-ba8e-2a09b1ee4191 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorizing `identity:create_application_credential(user_id=09dee66466af4b69a28e0d576a215b31)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.735986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70158a0-840f-49f2-ba8e-2a09b1ee4191 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.773885 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3972/7877] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:47.778469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0f396-e472-4ea3-835c-8f756576a37c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.815467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0f396-e472-4ea3-835c-8f756576a37c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:47.826498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d2314-de32-45a4-9fff-4e0f31a31298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:47.827339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2314-de32-45a4-9fff-4e0f31a31298 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.827727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2314-de32-45a4-9fff-4e0f31a31298 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.836111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2314-de32-45a4-9fff-4e0f31a31298 admin admin] PATH_INFO: `/v3/projects/d448764c9f714bf5baede9e93e8e86a9/users/90c1966698a3409f842f1ddd54189aa2/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.897944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d2314-de32-45a4-9fff-4e0f31a31298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d448764c9f714bf5baede9e93e8e86a9, user_id=90c1966698a3409f842f1ddd54189aa2, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:47.909267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d2314-de32-45a4-9fff-4e0f31a31298 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:47.933607 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3973/7878] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:47 2022] PUT /identity/v3/projects/d448764c9f714bf5baede9e93e8e86a9/users/90c1966698a3409f842f1ddd54189aa2/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:47.935534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb29f3-db2f-44d8-9f3b-ae038519d51c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:47.936041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb29f3-db2f-44d8-9f3b-ae038519d51c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:47.936646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb29f3-db2f-44d8-9f3b-ae038519d51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:47.950911 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3906/7879] 10.222.0.16 () {60 vars in 1315 bytes} [Mon Aug 29 15:59:47 2022] POST /identity/v3/users/09dee66466af4b69a28e0d576a215b31/application_credentials => generated 920 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:47.961088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70158a0-840f-49f2-ba8e-2a09b1ee4191 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:47.973077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8ddb29f3-db2f-44d8-9f3b-ae038519d51c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:47.975091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8ddb29f3-db2f-44d8-9f3b-ae038519d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:47.998064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70158a0-840f-49f2-ba8e-2a09b1ee4191 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:48.091384 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3974/7880] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:48.120774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb29f3-db2f-44d8-9f3b-ae038519d51c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:48.126553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8ddb29f3-db2f-44d8-9f3b-ae038519d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:48.194150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60d4d1-8612-41ef-b3f8-1ec651329c63 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09dee66466af4b69a28e0d576a215b31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9901bb84a2486bbb9773e5968eeadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:48.194829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d4d1-8612-41ef-b3f8-1ec651329c63 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:48.195120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d4d1-8612-41ef-b3f8-1ec651329c63 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:48.195407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60d4d1-8612-41ef-b3f8-1ec651329c63 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] PATH_INFO: `/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules/192e97785ca84ed08ad819754a1f9abe` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:48.198636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60d4d1-8612-41ef-b3f8-1ec651329c63 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorizing `identity:get_access_rule(user_id=09dee66466af4b69a28e0d576a215b31, access_rule_id=192e97785ca84ed08ad819754a1f9abe)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:48.209937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60d4d1-8612-41ef-b3f8-1ec651329c63 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:48.249594 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3907/7881] 10.222.0.16 () {58 vars in 1359 bytes} [Mon Aug 29 15:59:47 2022] GET /identity/v3/users/09dee66466af4b69a28e0d576a215b31/access_rules/192e97785ca84ed08ad819754a1f9abe => generated 229 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:48.252018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60d4d1-8612-41ef-b3f8-1ec651329c63 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:48.263688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6f60d4d1-8612-41ef-b3f8-1ec651329c63 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:48.302701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb29f3-db2f-44d8-9f3b-ae038519d51c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:48.310256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60d4d1-8612-41ef-b3f8-1ec651329c63 tempest-AccessRulesV3Test-539664467 tempest-AccessRulesV3Test-539664467-project] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:48.315699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada80dd2-6338-4c97-ae80-121cccc71f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:48.316332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80dd2-6338-4c97-ae80-121cccc71f54 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:48.316647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80dd2-6338-4c97-ae80-121cccc71f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:48.317143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80dd2-6338-4c97-ae80-121cccc71f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:48.326422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:48.327092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:48.327375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:48.327659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] PATH_INFO: `/v3/users/09dee66466af4b69a28e0d576a215b31` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:48.333016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada80dd2-6338-4c97-ae80-121cccc71f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:48.336246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada80dd2-6338-4c97-ae80-121cccc71f54 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:48.338248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09dee66466af4b69a28e0d576a215b31)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:48.340432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:48.378390 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3975/7882] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:59:48.533419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:48.571525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09dee66466af4b69a28e0d576a215b31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:48.574062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09dee66466af4b69a28e0d576a215b31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:48.727200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09dee66466af4b69a28e0d576a215b31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:48.771688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09dee66466af4b69a28e0d576a215b31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:48.837858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09dee66466af4b69a28e0d576a215b31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:48.872626 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3908/7883] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:48 2022] DELETE /identity/v3/users/09dee66466af4b69a28e0d576a215b31 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:48.878185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459dc5f-7d54-4b9c-9ab1-d6ce441c689c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:48.878710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459dc5f-7d54-4b9c-9ab1-d6ce441c689c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:48.879181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459dc5f-7d54-4b9c-9ab1-d6ce441c689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:48.934523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e459dc5f-7d54-4b9c-9ab1-d6ce441c689c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:48.937213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e459dc5f-7d54-4b9c-9ab1-d6ce441c689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:49.015881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:49.093473 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3976/7884] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:49.109136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:49.112861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:49.340839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee20416-e806-4587-bd88-bbc91e2154c9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:49.346798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b4255-0ed7-43fd-8cf9-32207d6f57bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:49.347994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b4255-0ed7-43fd-8cf9-32207d6f57bd service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:49.348493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b4255-0ed7-43fd-8cf9-32207d6f57bd service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:49.349069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b4255-0ed7-43fd-8cf9-32207d6f57bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:49.363023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b4255-0ed7-43fd-8cf9-32207d6f57bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:49.371532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b4255-0ed7-43fd-8cf9-32207d6f57bd service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:49.419057 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3909/7885] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:50.016698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459dc5f-7d54-4b9c-9ab1-d6ce441c689c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:50.019185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e459dc5f-7d54-4b9c-9ab1-d6ce441c689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:50.037700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459dc5f-7d54-4b9c-9ab1-d6ce441c689c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:50.056282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:50.057307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:50.057871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:50.058398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] PATH_INFO: `/v3/projects/9e9901bb84a2486bbb9773e5968eeadb` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:50.061182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9901bb84a2486bbb9773e5968eeadb)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:50.064148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:50.166845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9901bb84a2486bbb9773e5968eeadb', 'request_id': 'req-ac1531f8-4543-46ba-958c-9dfbaa331194'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.181305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9901bb84a2486bbb9773e5968eeadb', 'request_id': 'req-ac1531f8-4543-46ba-958c-9dfbaa331194'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.195057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9901bb84a2486bbb9773e5968eeadb', 'request_id': 'req-ac1531f8-4543-46ba-958c-9dfbaa331194'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.227332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] The token cache is being invalidate because project 9e9901bb84a2486bbb9773e5968eeadb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:50.228547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.238178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ac1531f8-4543-46ba-958c-9dfbaa331194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:50.248368 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3977/7886] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:50 2022] DELETE /identity/v3/projects/9e9901bb84a2486bbb9773e5968eeadb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:50.268529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78174-212d-4349-8864-1492a4b979ed None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:50.268529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78174-212d-4349-8864-1492a4b979ed None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:50.268529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78174-212d-4349-8864-1492a4b979ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:50.340348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b9e78174-212d-4349-8864-1492a4b979ed None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:50.351608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b9e78174-212d-4349-8864-1492a4b979ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:50.501626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb539-fe1b-4173-9811-a23ac78a3943 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:50.503094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb539-fe1b-4173-9811-a23ac78a3943 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:50.503636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb539-fe1b-4173-9811-a23ac78a3943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:50.629330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1ceeb539-fe1b-4173-9811-a23ac78a3943 None None] MFA Rules not processed for user `90c1966698a3409f842f1ddd54189aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:50.633824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1ceeb539-fe1b-4173-9811-a23ac78a3943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:50.684873 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3910/7887] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:50.697351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303063c-eb83-44ad-92bc-6d5db83e2e2c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:50.697580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303063c-eb83-44ad-92bc-6d5db83e2e2c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:50.697877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303063c-eb83-44ad-92bc-6d5db83e2e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:50.773795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e303063c-eb83-44ad-92bc-6d5db83e2e2c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:50.775043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e303063c-eb83-44ad-92bc-6d5db83e2e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:50.824617 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3911/7888] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:50.828024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303063c-eb83-44ad-92bc-6d5db83e2e2c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:50.857954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303063c-eb83-44ad-92bc-6d5db83e2e2c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:50.881857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0513aa-bec1-4663-b888-ff1ec5d578b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:50.882820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0513aa-bec1-4663-b888-ff1ec5d578b0 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:50.884184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0513aa-bec1-4663-b888-ff1ec5d578b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:50.884634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0513aa-bec1-4663-b888-ff1ec5d578b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:50.885518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0513aa-bec1-4663-b888-ff1ec5d578b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:50.885971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0513aa-bec1-4663-b888-ff1ec5d578b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:50.887858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0513aa-bec1-4663-b888-ff1ec5d578b0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:50.896192 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3978/7889] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:50.956782 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3912/7890] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:50.960960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeb539-fe1b-4173-9811-a23ac78a3943 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:50.986881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeb539-fe1b-4173-9811-a23ac78a3943 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:50.998469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b35a00-669b-4028-a9e0-406bac0ca573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:51.001133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35a00-669b-4028-a9e0-406bac0ca573 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.001464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35a00-669b-4028-a9e0-406bac0ca573 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.001752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35a00-669b-4028-a9e0-406bac0ca573 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.003779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b35a00-669b-4028-a9e0-406bac0ca573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:51.017007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b35a00-669b-4028-a9e0-406bac0ca573 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:51.032881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0513aa-bec1-4663-b888-ff1ec5d578b0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.036068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0b0513aa-bec1-4663-b888-ff1ec5d578b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:51.087729 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3979/7891] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:50 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:51.088800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0513aa-bec1-4663-b888-ff1ec5d578b0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:51.091843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b35a00-669b-4028-a9e0-406bac0ca573 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.155531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:51.161086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:51.251999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0fb6f-6679-40d2-accd-27b5e4b36568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:51.253024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0fb6f-6679-40d2-accd-27b5e4b36568 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.253733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0fb6f-6679-40d2-accd-27b5e4b36568 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.254246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0fb6f-6679-40d2-accd-27b5e4b36568 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.255139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0fb6f-6679-40d2-accd-27b5e4b36568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:51.257451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0fb6f-6679-40d2-accd-27b5e4b36568 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:51.259059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b35a00-669b-4028-a9e0-406bac0ca573 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:51.270120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c723c-1064-4695-b53b-753e7afd2a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:51.270761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c723c-1064-4695-b53b-753e7afd2a60 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.271082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c723c-1064-4695-b53b-753e7afd2a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.271365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c723c-1064-4695-b53b-753e7afd2a60 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.272015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c723c-1064-4695-b53b-753e7afd2a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:51.274029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c723c-1064-4695-b53b-753e7afd2a60 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:51.319978 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3980/7892] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:51 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:51.323794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c723c-1064-4695-b53b-753e7afd2a60 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.330984 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3913/7893] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:51 2022] POST /identity/v3/projects => generated 403 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:51.335238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0fb6f-6679-40d2-accd-27b5e4b36568 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.341831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c723c-1064-4695-b53b-753e7afd2a60 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:51.472511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe054ec-0268-49ed-a23b-b96ae6c06502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:51.473460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe054ec-0268-49ed-a23b-b96ae6c06502 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.473926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe054ec-0268-49ed-a23b-b96ae6c06502 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.474926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe054ec-0268-49ed-a23b-b96ae6c06502 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.475111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0fb6f-6679-40d2-accd-27b5e4b36568 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:51.476032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe054ec-0268-49ed-a23b-b96ae6c06502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:51.478729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe054ec-0268-49ed-a23b-b96ae6c06502 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:51.486089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbea7cb-77d6-450b-ad4f-ab24bc1739a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:51.486880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbea7cb-77d6-450b-ad4f-ab24bc1739a0 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.487177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbea7cb-77d6-450b-ad4f-ab24bc1739a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.487456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbea7cb-77d6-450b-ad4f-ab24bc1739a0 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.488105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbea7cb-77d6-450b-ad4f-ab24bc1739a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:51.490707 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbea7cb-77d6-450b-ad4f-ab24bc1739a0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:51.536357 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3914/7894] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:51 2022] POST /identity/v3/users => generated 308 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 15:59:51.564050 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3981/7895] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:59:51.564300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbea7cb-77d6-450b-ad4f-ab24bc1739a0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.566740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe054ec-0268-49ed-a23b-b96ae6c06502 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.592385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe054ec-0268-49ed-a23b-b96ae6c06502 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:51.607656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df76b0-b990-4a39-b307-b9d36b5c1f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:51.608680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df76b0-b990-4a39-b307-b9d36b5c1f17 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.609146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df76b0-b990-4a39-b307-b9d36b5c1f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.610925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df76b0-b990-4a39-b307-b9d36b5c1f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.612279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df76b0-b990-4a39-b307-b9d36b5c1f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:51.613838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbea7cb-77d6-450b-ad4f-ab24bc1739a0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:51.616579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df76b0-b990-4a39-b307-b9d36b5c1f17 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:51.627632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aa653-9292-4253-be37-0e93ce73906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:51.628446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aa653-9292-4253-be37-0e93ce73906f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.628446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aa653-9292-4253-be37-0e93ce73906f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.629868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aa653-9292-4253-be37-0e93ce73906f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.629868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54aa653-9292-4253-be37-0e93ce73906f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:51.631368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54aa653-9292-4253-be37-0e93ce73906f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:51.660347 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3982/7896] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:51.665031 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3915/7897] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:59:51.665775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df76b0-b990-4a39-b307-b9d36b5c1f17 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.674713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aa653-9292-4253-be37-0e93ce73906f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.693826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aa653-9292-4253-be37-0e93ce73906f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:51.696020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df76b0-b990-4a39-b307-b9d36b5c1f17 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:51.711478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963505be-b386-450e-bf1b-f6a0e83866a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:51.712251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963505be-b386-450e-bf1b-f6a0e83866a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.712531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963505be-b386-450e-bf1b-f6a0e83866a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.712808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963505be-b386-450e-bf1b-f6a0e83866a7 admin admin] PATH_INFO: `/v3/projects/3e32da93d4c442988be1f7dc0d36e7cf/users/1b08431e1126431d9c2e65f3a96e2c9f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.715675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ee445-a78e-4b27-bfa4-755615459ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:51.716683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee445-a78e-4b27-bfa4-755615459ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.718106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee445-a78e-4b27-bfa4-755615459ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.718616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee445-a78e-4b27-bfa4-755615459ad7 admin admin] PATH_INFO: `/v3/projects/e80fe0ac0c654c388dab540f6a7db31f/users/d97acce6fac14d0ea1efe15d3c321698/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.762158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ee445-a78e-4b27-bfa4-755615459ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80fe0ac0c654c388dab540f6a7db31f, user_id=d97acce6fac14d0ea1efe15d3c321698, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:51.765478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ee445-a78e-4b27-bfa4-755615459ad7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:51.770128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963505be-b386-450e-bf1b-f6a0e83866a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e32da93d4c442988be1f7dc0d36e7cf, user_id=1b08431e1126431d9c2e65f3a96e2c9f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:51.773374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963505be-b386-450e-bf1b-f6a0e83866a7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:51.796636 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3983/7898] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:51 2022] PUT /identity/v3/projects/e80fe0ac0c654c388dab540f6a7db31f/users/d97acce6fac14d0ea1efe15d3c321698/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:51.810266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f5153-70af-44ef-8621-7e736b4d17d0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.811006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f5153-70af-44ef-8621-7e736b4d17d0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.811433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f5153-70af-44ef-8621-7e736b4d17d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.813451 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3916/7899] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:51 2022] PUT /identity/v3/projects/3e32da93d4c442988be1f7dc0d36e7cf/users/1b08431e1126431d9c2e65f3a96e2c9f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 15:59:51.817371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963505be-b386-450e-bf1b-f6a0e83866a7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.913968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963505be-b386-450e-bf1b-f6a0e83866a7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:51.915089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a23f5153-70af-44ef-8621-7e736b4d17d0 None None] MFA Rules not processed for user `d97acce6fac14d0ea1efe15d3c321698`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:51.916417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a23f5153-70af-44ef-8621-7e736b4d17d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:51.934741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d21ef8-900e-40bb-8685-9bc5e0a8c4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:51.935383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21ef8-900e-40bb-8685-9bc5e0a8c4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:51.935664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21ef8-900e-40bb-8685-9bc5e0a8c4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:51.935940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21ef8-900e-40bb-8685-9bc5e0a8c4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:51.936601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d21ef8-900e-40bb-8685-9bc5e0a8c4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:51.938250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d21ef8-900e-40bb-8685-9bc5e0a8c4c8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:51.940759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:51.960681 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3917/7900] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:51.961412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d21ef8-900e-40bb-8685-9bc5e0a8c4c8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:51.998304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d21ef8-900e-40bb-8685-9bc5e0a8c4c8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:52.013023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69236d-1a88-4938-bf9a-c621cbac5cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:52.013744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69236d-1a88-4938-bf9a-c621cbac5cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.014356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69236d-1a88-4938-bf9a-c621cbac5cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.014659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69236d-1a88-4938-bf9a-c621cbac5cd4 admin admin] PATH_INFO: `/v3/projects/3e32da93d4c442988be1f7dc0d36e7cf/users/1b08431e1126431d9c2e65f3a96e2c9f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.023988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69236d-1a88-4938-bf9a-c621cbac5cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e32da93d4c442988be1f7dc0d36e7cf, user_id=1b08431e1126431d9c2e65f3a96e2c9f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:52.026771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69236d-1a88-4938-bf9a-c621cbac5cd4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:52.038263 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3918/7901] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:51 2022] PUT /identity/v3/projects/3e32da93d4c442988be1f7dc0d36e7cf/users/1b08431e1126431d9c2e65f3a96e2c9f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:52.102176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:52.110475 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3984/7902] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:52.134174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69236d-1a88-4938-bf9a-c621cbac5cd4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:52.135943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2c69236d-1a88-4938-bf9a-c621cbac5cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:52.251933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69236d-1a88-4938-bf9a-c621cbac5cd4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:52.262906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa07f9a-92d7-463f-8c5c-f2df454f095c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:52.265144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa07f9a-92d7-463f-8c5c-f2df454f095c service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.265536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa07f9a-92d7-463f-8c5c-f2df454f095c service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.265840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa07f9a-92d7-463f-8c5c-f2df454f095c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.393884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa07f9a-92d7-463f-8c5c-f2df454f095c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:52.397082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa07f9a-92d7-463f-8c5c-f2df454f095c service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:52.418743 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3919/7903] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 15:59:52.692495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8754a-5662-43d1-a445-b0812caf044a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:52.692916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8754a-5662-43d1-a445-b0812caf044a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:52.693293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8754a-5662-43d1-a445-b0812caf044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:52.742688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b7a8754a-5662-43d1-a445-b0812caf044a None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:52.744110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b7a8754a-5662-43d1-a445-b0812caf044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:52.864400 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3985/7904] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:52.885287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa07f9a-92d7-463f-8c5c-f2df454f095c service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:52.889963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4fa07f9a-92d7-463f-8c5c-f2df454f095c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:53.073636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa07f9a-92d7-463f-8c5c-f2df454f095c service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:53.084563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7c535-9c7a-46cb-9786-86996c199e1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:53.085483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c535-9c7a-46cb-9786-86996c199e1b service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.087387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c535-9c7a-46cb-9786-86996c199e1b service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.087819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c535-9c7a-46cb-9786-86996c199e1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.121863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7c535-9c7a-46cb-9786-86996c199e1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:53.123497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7c535-9c7a-46cb-9786-86996c199e1b service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:53.153004 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3920/7905] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:53.637286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8754a-5662-43d1-a445-b0812caf044a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:53.639034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b7a8754a-5662-43d1-a445-b0812caf044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:53.746958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce63cb6-544b-4726-aab7-da2101b9fc24 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.747943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce63cb6-544b-4726-aab7-da2101b9fc24 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.748577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce63cb6-544b-4726-aab7-da2101b9fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.772367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fce63cb6-544b-4726-aab7-da2101b9fc24 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:53.774024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fce63cb6-544b-4726-aab7-da2101b9fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:53.788486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8754a-5662-43d1-a445-b0812caf044a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:53.795951 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3921/7906] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:53.806822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce63cb6-544b-4726-aab7-da2101b9fc24 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:53.815261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618d541-6276-4b2e-bd97-fb0844e6324e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:53.816108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618d541-6276-4b2e-bd97-fb0844e6324e service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.816550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618d541-6276-4b2e-bd97-fb0844e6324e service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.816982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618d541-6276-4b2e-bd97-fb0844e6324e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.828276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5618d541-6276-4b2e-bd97-fb0844e6324e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:53.834519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce63cb6-544b-4726-aab7-da2101b9fc24 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:53.842553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfc570-91e2-45f4-9b45-8a1a23c0f6fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:53.843702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfc570-91e2-45f4-9b45-8a1a23c0f6fa service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.844566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfc570-91e2-45f4-9b45-8a1a23c0f6fa service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.845685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfc570-91e2-45f4-9b45-8a1a23c0f6fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.867093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfc570-91e2-45f4-9b45-8a1a23c0f6fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:53.872297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfc570-91e2-45f4-9b45-8a1a23c0f6fa service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:53.888453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:53.905465 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3922/7907] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:53.944352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bf5c-0454-4f47-a10b-1fcc6da9b7a9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:53.945082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bf5c-0454-4f47-a10b-1fcc6da9b7a9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:53.945651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bf5c-0454-4f47-a10b-1fcc6da9b7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:53.956842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618d541-6276-4b2e-bd97-fb0844e6324e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:53.958457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618d541-6276-4b2e-bd97-fb0844e6324e service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:54.000235 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3986/7908] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 15:59:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 15:59:54.010095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4af7bf5c-0454-4f47-a10b-1fcc6da9b7a9 None None] MFA Rules not processed for user `1b08431e1126431d9c2e65f3a96e2c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:54.011746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4af7bf5c-0454-4f47-a10b-1fcc6da9b7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:54.214245 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3923/7909] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:54.470929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ea970-f08e-4d60-880c-531b1e98c38a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:54.471655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ea970-f08e-4d60-880c-531b1e98c38a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:54.472195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ea970-f08e-4d60-880c-531b1e98c38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:54.515808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-390ea970-f08e-4d60-880c-531b1e98c38a None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:54.517141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-390ea970-f08e-4d60-880c-531b1e98c38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:54.541426 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3987/7910] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:54.561114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7bf5c-0454-4f47-a10b-1fcc6da9b7a9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:54.585699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7bf5c-0454-4f47-a10b-1fcc6da9b7a9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:54.605771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dac39-2c6d-4712-9de2-70efec7f1a62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:54.606692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dac39-2c6d-4712-9de2-70efec7f1a62 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:54.606692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dac39-2c6d-4712-9de2-70efec7f1a62 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:54.606952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dac39-2c6d-4712-9de2-70efec7f1a62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:54.624729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5dac39-2c6d-4712-9de2-70efec7f1a62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:54.626328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5dac39-2c6d-4712-9de2-70efec7f1a62 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:54.648762 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3924/7911] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:55.173775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884bf11-4eea-42f9-a1a1-b6781a421c4a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.174354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884bf11-4eea-42f9-a1a1-b6781a421c4a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.175344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884bf11-4eea-42f9-a1a1-b6781a421c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.221830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b884bf11-4eea-42f9-a1a1-b6781a421c4a None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:55.223773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b884bf11-4eea-42f9-a1a1-b6781a421c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:55.233725 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3988/7912] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:55.252351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dac39-2c6d-4712-9de2-70efec7f1a62 service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:55.268238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dac39-2c6d-4712-9de2-70efec7f1a62 service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:55.283425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b4161-249e-4712-9bbf-a772088d25ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:55.284066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b4161-249e-4712-9bbf-a772088d25ef service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.284350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b4161-249e-4712-9bbf-a772088d25ef service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.284629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b4161-249e-4712-9bbf-a772088d25ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.297350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b4161-249e-4712-9bbf-a772088d25ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:55.300375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b4161-249e-4712-9bbf-a772088d25ef service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:55.326402 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3925/7913] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:55.793967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da31855-e1be-4145-9971-ebdfed59ec7b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.794380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da31855-e1be-4145-9971-ebdfed59ec7b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.794950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0008f-6634-4517-a61a-a85eabbafd63 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.795063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da31855-e1be-4145-9971-ebdfed59ec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.795245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0008f-6634-4517-a61a-a85eabbafd63 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.795530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0008f-6634-4517-a61a-a85eabbafd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.821161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-54a0008f-6634-4517-a61a-a85eabbafd63 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:55.822620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-54a0008f-6634-4517-a61a-a85eabbafd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:55.830328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0da31855-e1be-4145-9971-ebdfed59ec7b None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:55.831786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0da31855-e1be-4145-9971-ebdfed59ec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:55.832491 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3926/7914] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:55.847433 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3989/7915] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:55.848723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0008f-6634-4517-a61a-a85eabbafd63 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:55.857417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da31855-e1be-4145-9971-ebdfed59ec7b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:55.869073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0008f-6634-4517-a61a-a85eabbafd63 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:55.877780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da31855-e1be-4145-9971-ebdfed59ec7b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:55.877981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e2ce8-1a5e-4402-a333-cb2bec54060c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:55.878432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e2ce8-1a5e-4402-a333-cb2bec54060c service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.878702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e2ce8-1a5e-4402-a333-cb2bec54060c service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.878975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e2ce8-1a5e-4402-a333-cb2bec54060c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.885122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749c7a8-96da-4777-a38b-2bf5df6fafd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:55.886158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749c7a8-96da-4777-a38b-2bf5df6fafd8 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:55.886626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749c7a8-96da-4777-a38b-2bf5df6fafd8 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:55.887178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749c7a8-96da-4777-a38b-2bf5df6fafd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:55.890554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e2ce8-1a5e-4402-a333-cb2bec54060c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:55.892937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e2ce8-1a5e-4402-a333-cb2bec54060c service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:55.899133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749c7a8-96da-4777-a38b-2bf5df6fafd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:55.901491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749c7a8-96da-4777-a38b-2bf5df6fafd8 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:55.916155 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3990/7916] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 15:59:55.917601 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3927/7917] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:56.410288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949625cd-7037-4a2c-9163-ab08bf148048 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:56.410750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949625cd-7037-4a2c-9163-ab08bf148048 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:56.410854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949625cd-7037-4a2c-9163-ab08bf148048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:56.449251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-949625cd-7037-4a2c-9163-ab08bf148048 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:56.450635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-949625cd-7037-4a2c-9163-ab08bf148048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:56.481818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e2ce8-1a5e-4402-a333-cb2bec54060c service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:56.497122 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3991/7918] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 15:59:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:56.522408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e2ce8-1a5e-4402-a333-cb2bec54060c service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:56.546933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d29075-4c7a-4511-a707-d87815a9913b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:56.547770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d29075-4c7a-4511-a707-d87815a9913b service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:56.548203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d29075-4c7a-4511-a707-d87815a9913b service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:56.548645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d29075-4c7a-4511-a707-d87815a9913b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:56.572117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d29075-4c7a-4511-a707-d87815a9913b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:56.574509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d29075-4c7a-4511-a707-d87815a9913b service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:56.594432 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3928/7919] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:57.462009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949625cd-7037-4a2c-9163-ab08bf148048 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:57.501426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:57.611877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949625cd-7037-4a2c-9163-ab08bf148048 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:57.624446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e3f0c-836d-4371-b684-a1ffad676aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:57.625103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3f0c-836d-4371-b684-a1ffad676aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:57.625424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3f0c-836d-4371-b684-a1ffad676aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:57.625699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3f0c-836d-4371-b684-a1ffad676aa6 admin admin] PATH_INFO: `/v3/users/90c1966698a3409f842f1ddd54189aa2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:57.626865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e3f0c-836d-4371-b684-a1ffad676aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c1966698a3409f842f1ddd54189aa2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:57.628996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e3f0c-836d-4371-b684-a1ffad676aa6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:57.703012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed2e3f0c-836d-4371-b684-a1ffad676aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c1966698a3409f842f1ddd54189aa2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:57.703838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed2e3f0c-836d-4371-b684-a1ffad676aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c1966698a3409f842f1ddd54189aa2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:57.719363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed2e3f0c-836d-4371-b684-a1ffad676aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c1966698a3409f842f1ddd54189aa2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:57.720536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed2e3f0c-836d-4371-b684-a1ffad676aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c1966698a3409f842f1ddd54189aa2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:57.731377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ed2e3f0c-836d-4371-b684-a1ffad676aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c1966698a3409f842f1ddd54189aa2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:57.753172 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3992/7920] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:57 2022] DELETE /identity/v3/users/90c1966698a3409f842f1ddd54189aa2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:58.030664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d29075-4c7a-4511-a707-d87815a9913b service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:58.064498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d29075-4c7a-4511-a707-d87815a9913b service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:58.254763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23ca91-65d2-4950-a614-7561c2d491ad None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.255272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23ca91-65d2-4950-a614-7561c2d491ad None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.255921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23ca91-65d2-4950-a614-7561c2d491ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:58.266958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:58.272940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.276381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.276797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] PATH_INFO: `/v3/projects/d448764c9f714bf5baede9e93e8e86a9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:58.283009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d448764c9f714bf5baede9e93e8e86a9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:58.285170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:58.311333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2a23ca91-65d2-4950-a614-7561c2d491ad None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:58.313051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2a23ca91-65d2-4950-a614-7561c2d491ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:58.360995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:58.389543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd448764c9f714bf5baede9e93e8e86a9', 'request_id': 'req-ccab55ac-12a7-481d-b445-717345e6babe'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:58.398236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd448764c9f714bf5baede9e93e8e86a9', 'request_id': 'req-ccab55ac-12a7-481d-b445-717345e6babe'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:58.409006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd448764c9f714bf5baede9e93e8e86a9', 'request_id': 'req-ccab55ac-12a7-481d-b445-717345e6babe'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:58.414005 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3993/7921] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:58.423646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] The token cache is being invalidate because project d448764c9f714bf5baede9e93e8e86a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:58.424527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:58.425368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:58.427287 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3929/7922] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:58 2022] DELETE /identity/v3/projects/d448764c9f714bf5baede9e93e8e86a9 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:58.431507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23ca91-65d2-4950-a614-7561c2d491ad None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:58.431661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:58.432931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:58.433204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2a23ca91-65d2-4950-a614-7561c2d491ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:58.514176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:58.531284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab55ac-12a7-481d-b445-717345e6babe admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:58.540194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:58.540858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.541141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.541448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] PATH_INFO: `/v3/users/1b08431e1126431d9c2e65f3a96e2c9f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:58.542638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b08431e1126431d9c2e65f3a96e2c9f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:58.544723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:58.559447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23ca91-65d2-4950-a614-7561c2d491ad None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:58.612420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b08431e1126431d9c2e65f3a96e2c9f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:58.613349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b08431e1126431d9c2e65f3a96e2c9f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:58.629336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b08431e1126431d9c2e65f3a96e2c9f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:58.631119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fadceb-5481-4407-a66e-3f1685cdedd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:58.631942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fadceb-5481-4407-a66e-3f1685cdedd3 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.632211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fadceb-5481-4407-a66e-3f1685cdedd3 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.632483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fadceb-5481-4407-a66e-3f1685cdedd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:58.638406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-93fadceb-5481-4407-a66e-3f1685cdedd3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:58.640302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b08431e1126431d9c2e65f3a96e2c9f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:58.654626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b08431e1126431d9c2e65f3a96e2c9f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:58.663261 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3930/7923] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 15:59:58 2022] DELETE /identity/v3/users/1b08431e1126431d9c2e65f3a96e2c9f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:58.730039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fadceb-5481-4407-a66e-3f1685cdedd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:58.732225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fadceb-5481-4407-a66e-3f1685cdedd3 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:58.743831 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3994/7924] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:58.962983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:58.964774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:58.972965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba7c93-cc71-4b94-bfb0-8c97b6bafb73 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:58.973684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba7c93-cc71-4b94-bfb0-8c97b6bafb73 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:58.974284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba7c93-cc71-4b94-bfb0-8c97b6bafb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.009289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-38ba7c93-cc71-4b94-bfb0-8c97b6bafb73 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:59.010444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:59.011276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-38ba7c93-cc71-4b94-bfb0-8c97b6bafb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:59.060563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758887-c731-4823-a199-b99bf143fb0c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.069996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.071143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.071430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.071712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] PATH_INFO: `/v3/projects/3e32da93d4c442988be1f7dc0d36e7cf` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.073796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e32da93d4c442988be1f7dc0d36e7cf)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.079528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.088586 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3995/7925] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 15:59:59.105480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba7c93-cc71-4b94-bfb0-8c97b6bafb73 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.107014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-38ba7c93-cc71-4b94-bfb0-8c97b6bafb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:59.141499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e32da93d4c442988be1f7dc0d36e7cf', 'request_id': 'req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:59.149155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:59.165252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e32da93d4c442988be1f7dc0d36e7cf', 'request_id': 'req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:59.181251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e32da93d4c442988be1f7dc0d36e7cf', 'request_id': 'req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:59.199498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] The token cache is being invalidate because project 3e32da93d4c442988be1f7dc0d36e7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 15:59:59.201075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:59.201997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b4237b-fc94-4f19-8d2f-20dc7dc5c930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 15:59:59.204317 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3931/7926] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 15:59:58 2022] DELETE /identity/v3/projects/3e32da93d4c442988be1f7dc0d36e7cf => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:59.207160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba7c93-cc71-4b94-bfb0-8c97b6bafb73 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.210814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d90ea-7706-4bc5-b941-7d05da2c13e9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.211148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d90ea-7706-4bc5-b941-7d05da2c13e9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.211480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d90ea-7706-4bc5-b941-7d05da2c13e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.240950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3b9d90ea-7706-4bc5-b941-7d05da2c13e9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:59.243552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3b9d90ea-7706-4bc5-b941-7d05da2c13e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:59.310378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3626077-e878-44e6-a55e-2a1a6ee585fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.311170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3626077-e878-44e6-a55e-2a1a6ee585fa service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.311421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3626077-e878-44e6-a55e-2a1a6ee585fa service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.311819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3626077-e878-44e6-a55e-2a1a6ee585fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.314049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e3626077-e878-44e6-a55e-2a1a6ee585fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:59.358098 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3932/7927] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:59.362268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f90091-e9b4-40ff-9686-a155e9973a6e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.362623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f90091-e9b4-40ff-9686-a155e9973a6e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.362856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f90091-e9b4-40ff-9686-a155e9973a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.400376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f3f90091-e9b4-40ff-9686-a155e9973a6e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:59.401704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f3f90091-e9b4-40ff-9686-a155e9973a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:59.415824 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3933/7928] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:59.416907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f90091-e9b4-40ff-9686-a155e9973a6e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.428006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f90091-e9b4-40ff-9686-a155e9973a6e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.438531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd10a3d-5b27-4098-9093-d39200e6aa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.439559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd10a3d-5b27-4098-9093-d39200e6aa7a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.440038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd10a3d-5b27-4098-9093-d39200e6aa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.440614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd10a3d-5b27-4098-9093-d39200e6aa7a admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.441865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd10a3d-5b27-4098-9093-d39200e6aa7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 15:59:59.459087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd10a3d-5b27-4098-9093-d39200e6aa7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.462594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd10a3d-5b27-4098-9093-d39200e6aa7a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.470517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3626077-e878-44e6-a55e-2a1a6ee585fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.472241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3626077-e878-44e6-a55e-2a1a6ee585fa service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.486332 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3934/7929] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 15:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 15:59:59.492380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd10a3d-5b27-4098-9093-d39200e6aa7a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.511095 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3996/7930] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:59.520054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd10a3d-5b27-4098-9093-d39200e6aa7a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.553700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299fbdd-3b3a-47b6-bdfa-9c54719e88e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.554269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fbdd-3b3a-47b6-bdfa-9c54719e88e0 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.554560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fbdd-3b3a-47b6-bdfa-9c54719e88e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.554839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fbdd-3b3a-47b6-bdfa-9c54719e88e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.555482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299fbdd-3b3a-47b6-bdfa-9c54719e88e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.557630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299fbdd-3b3a-47b6-bdfa-9c54719e88e0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.597708 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3935/7931] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 15:59:59 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:59.604102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3626077-e878-44e6-a55e-2a1a6ee585fa service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.617045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3626077-e878-44e6-a55e-2a1a6ee585fa service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.714153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f3ee3-ac41-47df-a7ea-6e013fb8ce2f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.714520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f3ee3-ac41-47df-a7ea-6e013fb8ce2f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.714869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f3ee3-ac41-47df-a7ea-6e013fb8ce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.720228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d64585-9559-48d4-b633-a8c9750b375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.720847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d64585-9559-48d4-b633-a8c9750b375b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.721131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d64585-9559-48d4-b633-a8c9750b375b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.721433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d64585-9559-48d4-b633-a8c9750b375b admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.722059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d64585-9559-48d4-b633-a8c9750b375b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.724172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d64585-9559-48d4-b633-a8c9750b375b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.736956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1d5f3ee3-ac41-47df-a7ea-6e013fb8ce2f None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:59.738386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1d5f3ee3-ac41-47df-a7ea-6e013fb8ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:59.751139 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3997/7932] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 15:59:59 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 15:59:59.756065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d64585-9559-48d4-b633-a8c9750b375b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.763741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:59.766934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:59.772879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d64585-9559-48d4-b633-a8c9750b375b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.779353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d5ceb-0052-41d3-90eb-09e95b5d3a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.780053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d5ceb-0052-41d3-90eb-09e95b5d3a98 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.780927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d5ceb-0052-41d3-90eb-09e95b5d3a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.781263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d5ceb-0052-41d3-90eb-09e95b5d3a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.782018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d5ceb-0052-41d3-90eb-09e95b5d3a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.783624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d5ceb-0052-41d3-90eb-09e95b5d3a98 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.795322 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3998/7933] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 15:59:59.799412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d5ceb-0052-41d3-90eb-09e95b5d3a98 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.810656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d5ceb-0052-41d3-90eb-09e95b5d3a98 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.815561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b32981-d8f7-44d4-8d67-187163019759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.816168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32981-d8f7-44d4-8d67-187163019759 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.816458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32981-d8f7-44d4-8d67-187163019759 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.816756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32981-d8f7-44d4-8d67-187163019759 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.817405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b32981-d8f7-44d4-8d67-187163019759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.826346 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3936/7934] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 15:59:59.826553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b32981-d8f7-44d4-8d67-187163019759 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.842878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f3ee3-ac41-47df-a7ea-6e013fb8ce2f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.844306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1d5f3ee3-ac41-47df-a7ea-6e013fb8ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 15:59:59.846716 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 3999/7935] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 15:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 15:59:59.847594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b32981-d8f7-44d4-8d67-187163019759 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 15:59:59.859578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b32981-d8f7-44d4-8d67-187163019759 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.867490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e83ee2-ee50-4d5b-a826-54ea024cae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 15:59:59.877807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e83ee2-ee50-4d5b-a826-54ea024cae6e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.881317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e83ee2-ee50-4d5b-a826-54ea024cae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.881701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e83ee2-ee50-4d5b-a826-54ea024cae6e admin admin] PATH_INFO: `/v3/projects/c4fb584a03fa4dc2bd773656055ef3a3/users/0100fe6fc53b4d7ba5b2746bb4130a5b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.910256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e83ee2-ee50-4d5b-a826-54ea024cae6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fb584a03fa4dc2bd773656055ef3a3, user_id=0100fe6fc53b4d7ba5b2746bb4130a5b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 15:59:59.913282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e83ee2-ee50-4d5b-a826-54ea024cae6e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 15:59:59.941506 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4000/7936] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 15:59:59 2022] PUT /identity/v3/projects/c4fb584a03fa4dc2bd773656055ef3a3/users/0100fe6fc53b4d7ba5b2746bb4130a5b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 15:59:59.944088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462485b-2852-4379-a5e2-ef28a19f796c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 15:59:59.944649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462485b-2852-4379-a5e2-ef28a19f796c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 15:59:59.945085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462485b-2852-4379-a5e2-ef28a19f796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 15:59:59.951772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f3ee3-ac41-47df-a7ea-6e013fb8ce2f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 15:59:59.979504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e462485b-2852-4379-a5e2-ef28a19f796c None None] MFA Rules not processed for user `0100fe6fc53b4d7ba5b2746bb4130a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 15:59:59.981139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e462485b-2852-4379-a5e2-ef28a19f796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:00.029838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c1d27-8161-4c4c-b62e-4954c3f10a71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.030455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1d27-8161-4c4c-b62e-4954c3f10a71 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.030738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1d27-8161-4c4c-b62e-4954c3f10a71 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.031018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1d27-8161-4c4c-b62e-4954c3f10a71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.066502 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4001/7937] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:00.071791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462485b-2852-4379-a5e2-ef28a19f796c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.153500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462485b-2852-4379-a5e2-ef28a19f796c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.159623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947924f-7cb2-46c2-8f75-1eba7096664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.160740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947924f-7cb2-46c2-8f75-1eba7096664e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.161026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947924f-7cb2-46c2-8f75-1eba7096664e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.162043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947924f-7cb2-46c2-8f75-1eba7096664e admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.162735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947924f-7cb2-46c2-8f75-1eba7096664e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.165316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947924f-7cb2-46c2-8f75-1eba7096664e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.178525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c1d27-8161-4c4c-b62e-4954c3f10a71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.180456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c1d27-8161-4c4c-b62e-4954c3f10a71 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.203920 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3937/7938] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 15:59:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:00:00.205604 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4002/7939] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:00 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:00.206901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c1d27-8161-4c4c-b62e-4954c3f10a71 service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.218942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c1d27-8161-4c4c-b62e-4954c3f10a71 service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.229106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:00.312260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbb204-9cee-43bc-ae63-3cfd4640b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.313034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb204-9cee-43bc-ae63-3cfd4640b6ad admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.313593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb204-9cee-43bc-ae63-3cfd4640b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.313935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb204-9cee-43bc-ae63-3cfd4640b6ad admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.314794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbb204-9cee-43bc-ae63-3cfd4640b6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.318687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbb204-9cee-43bc-ae63-3cfd4640b6ad admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.357145 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3938/7940] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:00 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:00.358642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947924f-7cb2-46c2-8f75-1eba7096664e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.379599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947924f-7cb2-46c2-8f75-1eba7096664e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.390328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060b00d-80f4-4980-8738-f4d1d2f51cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.391525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060b00d-80f4-4980-8738-f4d1d2f51cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.391889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060b00d-80f4-4980-8738-f4d1d2f51cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.392230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060b00d-80f4-4980-8738-f4d1d2f51cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.393122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060b00d-80f4-4980-8738-f4d1d2f51cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.398276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060b00d-80f4-4980-8738-f4d1d2f51cd5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.412431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6587b-2d33-4dd5-96e5-fa940671929a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.412719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6587b-2d33-4dd5-96e5-fa940671929a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.412998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6587b-2d33-4dd5-96e5-fa940671929a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.424367 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4003/7941] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:00.425897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060b00d-80f4-4980-8738-f4d1d2f51cd5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.437365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-76a6587b-2d33-4dd5-96e5-fa940671929a None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:00.438697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76a6587b-2d33-4dd5-96e5-fa940671929a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:00.447742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060b00d-80f4-4980-8738-f4d1d2f51cd5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.468007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550c004-69c0-4ffc-9945-66ebd3efbce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.468607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c004-69c0-4ffc-9945-66ebd3efbce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.468885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c004-69c0-4ffc-9945-66ebd3efbce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.469157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c004-69c0-4ffc-9945-66ebd3efbce8 admin admin] PATH_INFO: `/v3/projects/d7ac674e435647b5ab3fea718786cef0/users/df957a27e33947d898a8f65ac5a4d528/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.503550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550c004-69c0-4ffc-9945-66ebd3efbce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ac674e435647b5ab3fea718786cef0, user_id=df957a27e33947d898a8f65ac5a4d528, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.507010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550c004-69c0-4ffc-9945-66ebd3efbce8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.514781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:00.538600 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3939/7942] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 16:00:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:00.541070 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4004/7943] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:00 2022] PUT /identity/v3/projects/d7ac674e435647b5ab3fea718786cef0/users/df957a27e33947d898a8f65ac5a4d528/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:00.545766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6587b-2d33-4dd5-96e5-fa940671929a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.570769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550c004-69c0-4ffc-9945-66ebd3efbce8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.575036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6587b-2d33-4dd5-96e5-fa940671929a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.694041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550c004-69c0-4ffc-9945-66ebd3efbce8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.706863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1483-a2ae-4458-a643-e99c9996bba9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.707646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1483-a2ae-4458-a643-e99c9996bba9 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.708082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1483-a2ae-4458-a643-e99c9996bba9 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.708976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1483-a2ae-4458-a643-e99c9996bba9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.763770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6a010-a658-46b9-8bf5-ac76275911a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.764302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6a010-a658-46b9-8bf5-ac76275911a5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.764582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6a010-a658-46b9-8bf5-ac76275911a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.764856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6a010-a658-46b9-8bf5-ac76275911a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.765537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6a010-a658-46b9-8bf5-ac76275911a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.767147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6a010-a658-46b9-8bf5-ac76275911a5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.792492 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3940/7944] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:00.795581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6a010-a658-46b9-8bf5-ac76275911a5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.814721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6a010-a658-46b9-8bf5-ac76275911a5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.822091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b2583-ac82-42b3-b2d4-08e08c8c19e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:00.823129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2583-ac82-42b3-b2d4-08e08c8c19e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.823821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2583-ac82-42b3-b2d4-08e08c8c19e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.824314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2583-ac82-42b3-b2d4-08e08c8c19e5 admin admin] PATH_INFO: `/v3/projects/d7ac674e435647b5ab3fea718786cef0/users/df957a27e33947d898a8f65ac5a4d528/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.826993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b2583-ac82-42b3-b2d4-08e08c8c19e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ac674e435647b5ab3fea718786cef0, user_id=df957a27e33947d898a8f65ac5a4d528, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.830861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b2583-ac82-42b3-b2d4-08e08c8c19e5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.853550 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3941/7945] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:00 2022] PUT /identity/v3/projects/d7ac674e435647b5ab3fea718786cef0/users/df957a27e33947d898a8f65ac5a4d528/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:00.854313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a1483-a2ae-4458-a643-e99c9996bba9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:00.856557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55bba5-1147-4e2b-8c96-e77134c2b23b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:00.856892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55bba5-1147-4e2b-8c96-e77134c2b23b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:00.857173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55bba5-1147-4e2b-8c96-e77134c2b23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:00.860797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a1483-a2ae-4458-a643-e99c9996bba9 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:00.882679 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4005/7946] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:00:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 16:00:00.883547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1483-a2ae-4458-a643-e99c9996bba9 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:00.886519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-940a1483-a2ae-4458-a643-e99c9996bba9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:00.908555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5c55bba5-1147-4e2b-8c96-e77134c2b23b None None] MFA Rules not processed for user `df957a27e33947d898a8f65ac5a4d528`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:00.909862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5c55bba5-1147-4e2b-8c96-e77134c2b23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:00.914421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1483-a2ae-4458-a643-e99c9996bba9 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:00.936881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:01.019835 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3942/7947] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:01.032053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d51621-2fd1-4cd2-bbf8-2ee43cd320dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.033191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d51621-2fd1-4cd2-bbf8-2ee43cd320dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.033570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d51621-2fd1-4cd2-bbf8-2ee43cd320dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.034079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d51621-2fd1-4cd2-bbf8-2ee43cd320dd admin admin] PATH_INFO: `/v3/users/9a121acf89554c7a9650c6461082fbc6` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.035126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d51621-2fd1-4cd2-bbf8-2ee43cd320dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a121acf89554c7a9650c6461082fbc6)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.035253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55bba5-1147-4e2b-8c96-e77134c2b23b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.037440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d51621-2fd1-4cd2-bbf8-2ee43cd320dd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.037617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5c55bba5-1147-4e2b-8c96-e77134c2b23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.102971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:01.119616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-49d51621-2fd1-4cd2-bbf8-2ee43cd320dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a121acf89554c7a9650c6461082fbc6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:01.120316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-49d51621-2fd1-4cd2-bbf8-2ee43cd320dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a121acf89554c7a9650c6461082fbc6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:01.120714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55bba5-1147-4e2b-8c96-e77134c2b23b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.126278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6235ffd-a734-4dad-8af9-86af9fba45f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.127259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235ffd-a734-4dad-8af9-86af9fba45f6 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.127541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235ffd-a734-4dad-8af9-86af9fba45f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.127816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235ffd-a734-4dad-8af9-86af9fba45f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.129670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d6235ffd-a734-4dad-8af9-86af9fba45f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.138191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-49d51621-2fd1-4cd2-bbf8-2ee43cd320dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a121acf89554c7a9650c6461082fbc6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:01.138950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-49d51621-2fd1-4cd2-bbf8-2ee43cd320dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a121acf89554c7a9650c6461082fbc6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:01.146322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-49d51621-2fd1-4cd2-bbf8-2ee43cd320dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a121acf89554c7a9650c6461082fbc6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:01.150919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6235ffd-a734-4dad-8af9-86af9fba45f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.153420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6235ffd-a734-4dad-8af9-86af9fba45f6 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.165564 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4006/7948] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:00 2022] DELETE /identity/v3/users/9a121acf89554c7a9650c6461082fbc6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:01.165717 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3943/7949] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:00:01.167012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677971ef-d7b8-4ca1-a0da-ba16054144b7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.167320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677971ef-d7b8-4ca1-a0da-ba16054144b7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.167574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677971ef-d7b8-4ca1-a0da-ba16054144b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.192489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-677971ef-d7b8-4ca1-a0da-ba16054144b7 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:01.194534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-677971ef-d7b8-4ca1-a0da-ba16054144b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.249144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6235ffd-a734-4dad-8af9-86af9fba45f6 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.250604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d6235ffd-a734-4dad-8af9-86af9fba45f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.260357 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4007/7950] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:01.264988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6235ffd-a734-4dad-8af9-86af9fba45f6 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.275797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677971ef-d7b8-4ca1-a0da-ba16054144b7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.277409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-677971ef-d7b8-4ca1-a0da-ba16054144b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.322208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea45480-b42a-44aa-9cdd-bc4625f892d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.322959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea45480-b42a-44aa-9cdd-bc4625f892d8 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.323247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea45480-b42a-44aa-9cdd-bc4625f892d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.323523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea45480-b42a-44aa-9cdd-bc4625f892d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.325371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cea45480-b42a-44aa-9cdd-bc4625f892d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.371192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677971ef-d7b8-4ca1-a0da-ba16054144b7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.377110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647bf1b-c01b-4d86-a341-8ca1b91557ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.377849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647bf1b-c01b-4d86-a341-8ca1b91557ba service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.378199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647bf1b-c01b-4d86-a341-8ca1b91557ba service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.378541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647bf1b-c01b-4d86-a341-8ca1b91557ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.389008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647bf1b-c01b-4d86-a341-8ca1b91557ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.391912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647bf1b-c01b-4d86-a341-8ca1b91557ba service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.399807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea45480-b42a-44aa-9cdd-bc4625f892d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.401261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea45480-b42a-44aa-9cdd-bc4625f892d8 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.401921 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4008/7951] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:00:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:00:01.403016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647bf1b-c01b-4d86-a341-8ca1b91557ba service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.404677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5647bf1b-c01b-4d86-a341-8ca1b91557ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.412593 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3944/7952] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:00:01.467769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:01.486956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647bf1b-c01b-4d86-a341-8ca1b91557ba service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.493029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.493781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.494219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.494523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] PATH_INFO: `/v3/projects/60a19cab0721487b9dada0e3ad35381e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.495884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a19cab0721487b9dada0e3ad35381e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.502103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.568768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a19cab0721487b9dada0e3ad35381e', 'request_id': 'req-a3d83675-69d1-45cd-bf16-cf2845192b09'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:01.579798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a19cab0721487b9dada0e3ad35381e', 'request_id': 'req-a3d83675-69d1-45cd-bf16-cf2845192b09'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:01.593716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a19cab0721487b9dada0e3ad35381e', 'request_id': 'req-a3d83675-69d1-45cd-bf16-cf2845192b09'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:01.614180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbd16b-a57d-44da-8a00-f8a8e5c1cf18 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.614538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbd16b-a57d-44da-8a00-f8a8e5c1cf18 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.614824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbd16b-a57d-44da-8a00-f8a8e5c1cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.615040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] The token cache is being invalidate because project 60a19cab0721487b9dada0e3ad35381e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:01.615331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:01.616019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3d83675-69d1-45cd-bf16-cf2845192b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:01.620971 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4009/7953] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:01 2022] DELETE /identity/v3/projects/60a19cab0721487b9dada0e3ad35381e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:01.622346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e3df7-39bf-4b97-90ff-1a06799f43cc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.622570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e3df7-39bf-4b97-90ff-1a06799f43cc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.622845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e3df7-39bf-4b97-90ff-1a06799f43cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.636014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-72cbd16b-a57d-44da-8a00-f8a8e5c1cf18 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:01.637313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72cbd16b-a57d-44da-8a00-f8a8e5c1cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.644400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:01.648918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2b4e3df7-39bf-4b97-90ff-1a06799f43cc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:01.650459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2b4e3df7-39bf-4b97-90ff-1a06799f43cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.715600 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3945/7954] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:01.722773 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4010/7955] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:01.731075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00f5d2-95be-4dcb-81a8-b8e1adf850ef None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.731583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00f5d2-95be-4dcb-81a8-b8e1adf850ef None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.732095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00f5d2-95be-4dcb-81a8-b8e1adf850ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.734330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e3df7-39bf-4b97-90ff-1a06799f43cc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.736708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2b4e3df7-39bf-4b97-90ff-1a06799f43cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.763112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6b00f5d2-95be-4dcb-81a8-b8e1adf850ef None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:01.764348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6b00f5d2-95be-4dcb-81a8-b8e1adf850ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:01.776454 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3946/7956] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:01.781538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00f5d2-95be-4dcb-81a8-b8e1adf850ef None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.793174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00f5d2-95be-4dcb-81a8-b8e1adf850ef None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.798456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61793306-cbb3-487e-b07f-875a4d345bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.799339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61793306-cbb3-487e-b07f-875a4d345bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.799662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61793306-cbb3-487e-b07f-875a4d345bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.800428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61793306-cbb3-487e-b07f-875a4d345bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.801099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61793306-cbb3-487e-b07f-875a4d345bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:01.801573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61793306-cbb3-487e-b07f-875a4d345bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.803479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61793306-cbb3-487e-b07f-875a4d345bc3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.820162 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3947/7957] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:00:01.821131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61793306-cbb3-487e-b07f-875a4d345bc3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.827972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e3df7-39bf-4b97-90ff-1a06799f43cc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.834161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6064471-10db-435f-bd19-5c6141d9372d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.834820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6064471-10db-435f-bd19-5c6141d9372d service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.835283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6064471-10db-435f-bd19-5c6141d9372d service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.835446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6064471-10db-435f-bd19-5c6141d9372d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.837923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61793306-cbb3-487e-b07f-875a4d345bc3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.844283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc12c65-35a0-45eb-b0b7-c22f18472162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.844900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc12c65-35a0-45eb-b0b7-c22f18472162 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.845012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6064471-10db-435f-bd19-5c6141d9372d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.845176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc12c65-35a0-45eb-b0b7-c22f18472162 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.845646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc12c65-35a0-45eb-b0b7-c22f18472162 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.846272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc12c65-35a0-45eb-b0b7-c22f18472162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.846831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6064471-10db-435f-bd19-5c6141d9372d service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.848158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc12c65-35a0-45eb-b0b7-c22f18472162 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:01.856318 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4011/7958] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:00:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 16:00:01.886462 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3948/7959] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:01 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:01.887623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6064471-10db-435f-bd19-5c6141d9372d service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:01.898850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6064471-10db-435f-bd19-5c6141d9372d service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:01.909183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:01.985523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a6915-e5aa-436d-b263-8bd07c1c0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:01.986660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a6915-e5aa-436d-b263-8bd07c1c0b6a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:01.987013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a6915-e5aa-436d-b263-8bd07c1c0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:01.988130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a6915-e5aa-436d-b263-8bd07c1c0b6a admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:01.989252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a6915-e5aa-436d-b263-8bd07c1c0b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:01.996461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a6915-e5aa-436d-b263-8bd07c1c0b6a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.025840 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4012/7960] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:01 2022] POST /identity/v3/users => generated 282 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:02.029644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc12c65-35a0-45eb-b0b7-c22f18472162 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.036317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a6915-e5aa-436d-b263-8bd07c1c0b6a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.039830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-222a6915-e5aa-436d-b263-8bd07c1c0b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:02.046323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc12c65-35a0-45eb-b0b7-c22f18472162 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:02.053929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7646251-84fc-4377-b881-71dcdb1cd507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:02.054102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a6915-e5aa-436d-b263-8bd07c1c0b6a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:02.054548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7646251-84fc-4377-b881-71dcdb1cd507 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.054831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7646251-84fc-4377-b881-71dcdb1cd507 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.055106 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7646251-84fc-4377-b881-71dcdb1cd507 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.055781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7646251-84fc-4377-b881-71dcdb1cd507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.058489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7646251-84fc-4377-b881-71dcdb1cd507 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.059480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b47487-cb6b-453f-b87f-b9959ec44595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:02.063842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b47487-cb6b-453f-b87f-b9959ec44595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.063842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b47487-cb6b-453f-b87f-b9959ec44595 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.063842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b47487-cb6b-453f-b87f-b9959ec44595 admin admin] PATH_INFO: `/v3/users/d97acce6fac14d0ea1efe15d3c321698` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.063842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b47487-cb6b-453f-b87f-b9959ec44595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97acce6fac14d0ea1efe15d3c321698)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.064225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b47487-cb6b-453f-b87f-b9959ec44595 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.071485 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3949/7961] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:02.074671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7646251-84fc-4377-b881-71dcdb1cd507 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.090784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7646251-84fc-4377-b881-71dcdb1cd507 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:02.106057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f17c17-06e7-46f7-bd8a-b63859d1076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:02.106613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17c17-06e7-46f7-bd8a-b63859d1076f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.106912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17c17-06e7-46f7-bd8a-b63859d1076f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.107229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17c17-06e7-46f7-bd8a-b63859d1076f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.112553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f17c17-06e7-46f7-bd8a-b63859d1076f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.114284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f17c17-06e7-46f7-bd8a-b63859d1076f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.130921 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3950/7962] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:02.132151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f17c17-06e7-46f7-bd8a-b63859d1076f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.139255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16b47487-cb6b-453f-b87f-b9959ec44595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97acce6fac14d0ea1efe15d3c321698'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.140049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16b47487-cb6b-453f-b87f-b9959ec44595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97acce6fac14d0ea1efe15d3c321698'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.143929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f17c17-06e7-46f7-bd8a-b63859d1076f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:02.149159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cc59d-559a-48f2-ba0a-3cef5d0236f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:02.150104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cc59d-559a-48f2-ba0a-3cef5d0236f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.150607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cc59d-559a-48f2-ba0a-3cef5d0236f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.151113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cc59d-559a-48f2-ba0a-3cef5d0236f8 admin admin] PATH_INFO: `/v3/projects/1bbbe73321744650a59bd53052001d54/users/91a5d0ec125549d2a92d7e6ba0bf8d00/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.156514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16b47487-cb6b-453f-b87f-b9959ec44595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97acce6fac14d0ea1efe15d3c321698'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.157640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16b47487-cb6b-453f-b87f-b9959ec44595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97acce6fac14d0ea1efe15d3c321698'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.166864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-16b47487-cb6b-453f-b87f-b9959ec44595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97acce6fac14d0ea1efe15d3c321698'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.168464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cc59d-559a-48f2-ba0a-3cef5d0236f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbbe73321744650a59bd53052001d54, user_id=91a5d0ec125549d2a92d7e6ba0bf8d00, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.171589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cc59d-559a-48f2-ba0a-3cef5d0236f8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.189494 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4013/7963] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:02 2022] DELETE /identity/v3/users/d97acce6fac14d0ea1efe15d3c321698 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:02.191609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92161c24-e903-475c-a1ef-134ca2c74dc1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.192017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92161c24-e903-475c-a1ef-134ca2c74dc1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.192380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92161c24-e903-475c-a1ef-134ca2c74dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.199889 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3951/7964] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:02 2022] PUT /identity/v3/projects/1bbbe73321744650a59bd53052001d54/users/91a5d0ec125549d2a92d7e6ba0bf8d00/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:02.213892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-92161c24-e903-475c-a1ef-134ca2c74dc1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:02.215257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-92161c24-e903-475c-a1ef-134ca2c74dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:02.292577 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4014/7965] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:02.303605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cc59d-559a-48f2-ba0a-3cef5d0236f8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.306059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8f4cc59d-559a-48f2-ba0a-3cef5d0236f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:02.308459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670932f-7a93-45ab-83f6-c78a9b7627b6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.308850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670932f-7a93-45ab-83f6-c78a9b7627b6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.309138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670932f-7a93-45ab-83f6-c78a9b7627b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.336592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:02.339575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b670932f-7a93-45ab-83f6-c78a9b7627b6 None None] MFA Rules not processed for user `91a5d0ec125549d2a92d7e6ba0bf8d00`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:02.340797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b670932f-7a93-45ab-83f6-c78a9b7627b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:02.388430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cc59d-559a-48f2-ba0a-3cef5d0236f8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:02.392923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5afa-b7c1-411b-bc44-72d1aaed2415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:02.393767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5afa-b7c1-411b-bc44-72d1aaed2415 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.394218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5afa-b7c1-411b-bc44-72d1aaed2415 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.394678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5afa-b7c1-411b-bc44-72d1aaed2415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.407517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a5afa-b7c1-411b-bc44-72d1aaed2415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.409201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a5afa-b7c1-411b-bc44-72d1aaed2415 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.416125 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4015/7966] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:02.422363 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3952/7967] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:02.428445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670932f-7a93-45ab-83f6-c78a9b7627b6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.429829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b670932f-7a93-45ab-83f6-c78a9b7627b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:02.499947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670932f-7a93-45ab-83f6-c78a9b7627b6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:02.504127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e04b43-4b68-4f26-8b58-0829c16aa247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:02.504881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e04b43-4b68-4f26-8b58-0829c16aa247 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.505792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e04b43-4b68-4f26-8b58-0829c16aa247 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.506163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e04b43-4b68-4f26-8b58-0829c16aa247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.515669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e04b43-4b68-4f26-8b58-0829c16aa247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.517904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e04b43-4b68-4f26-8b58-0829c16aa247 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.526983 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4016/7968] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:02.751510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5afa-b7c1-411b-bc44-72d1aaed2415 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:02.756063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3f8a5afa-b7c1-411b-bc44-72d1aaed2415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:02.775805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5afa-b7c1-411b-bc44-72d1aaed2415 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:02.782941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:02.783962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.784366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.784752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] PATH_INFO: `/v3/projects/e80fe0ac0c654c388dab540f6a7db31f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.787634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80fe0ac0c654c388dab540f6a7db31f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:02.790189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:02.848595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:02.894465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80fe0ac0c654c388dab540f6a7db31f', 'request_id': 'req-2f52b223-bd74-453e-8b31-aa28d9dd8167'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.913983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80fe0ac0c654c388dab540f6a7db31f', 'request_id': 'req-2f52b223-bd74-453e-8b31-aa28d9dd8167'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.947212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80fe0ac0c654c388dab540f6a7db31f', 'request_id': 'req-2f52b223-bd74-453e-8b31-aa28d9dd8167'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.969083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] The token cache is being invalidate because project e80fe0ac0c654c388dab540f6a7db31f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:02.969771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.970756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2f52b223-bd74-453e-8b31-aa28d9dd8167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:02.977882 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3953/7969] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:02 2022] DELETE /identity/v3/projects/e80fe0ac0c654c388dab540f6a7db31f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:02.978557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe70b6-9f58-42bb-94ff-bab7f57b9649 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:02.979049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe70b6-9f58-42bb-94ff-bab7f57b9649 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:02.979198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe70b6-9f58-42bb-94ff-bab7f57b9649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:02.999583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-88fe70b6-9f58-42bb-94ff-bab7f57b9649 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:03.002344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-88fe70b6-9f58-42bb-94ff-bab7f57b9649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:03.072002 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4017/7970] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:03.081005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35043a7c-b196-4735-893d-3e3f863ef366 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.081332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35043a7c-b196-4735-893d-3e3f863ef366 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.081596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35043a7c-b196-4735-893d-3e3f863ef366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.124592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-35043a7c-b196-4735-893d-3e3f863ef366 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:03.127237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-35043a7c-b196-4735-893d-3e3f863ef366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:03.153840 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3954/7971] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:03.155074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe70b6-9f58-42bb-94ff-bab7f57b9649 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.168252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe70b6-9f58-42bb-94ff-bab7f57b9649 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.179466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27d556-982a-4f08-be03-77d70f74b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.180106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d556-982a-4f08-be03-77d70f74b079 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.180390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d556-982a-4f08-be03-77d70f74b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.180667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d556-982a-4f08-be03-77d70f74b079 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.181344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27d556-982a-4f08-be03-77d70f74b079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:03.181677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27d556-982a-4f08-be03-77d70f74b079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:03.183571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27d556-982a-4f08-be03-77d70f74b079 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:03.212824 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4018/7972] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:03.217239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35043a7c-b196-4735-893d-3e3f863ef366 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.231143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35043a7c-b196-4735-893d-3e3f863ef366 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.246651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb68020-9bca-4631-9050-b679f2023f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.247559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb68020-9bca-4631-9050-b679f2023f72 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.247942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb68020-9bca-4631-9050-b679f2023f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.248315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb68020-9bca-4631-9050-b679f2023f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.249104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb68020-9bca-4631-9050-b679f2023f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:03.251298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb68020-9bca-4631-9050-b679f2023f72 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:03.285652 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3955/7973] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:03 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:00:03.290226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27d556-982a-4f08-be03-77d70f74b079 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.301337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27d556-982a-4f08-be03-77d70f74b079 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.346848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:03.407553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76961d0-fcb2-4066-a1c5-eca09f2a072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.408353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76961d0-fcb2-4066-a1c5-eca09f2a072d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.408733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76961d0-fcb2-4066-a1c5-eca09f2a072d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.409142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76961d0-fcb2-4066-a1c5-eca09f2a072d admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.409967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76961d0-fcb2-4066-a1c5-eca09f2a072d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:03.412865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76961d0-fcb2-4066-a1c5-eca09f2a072d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:03.469798 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4019/7974] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:03 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:03.474948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb68020-9bca-4631-9050-b679f2023f72 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.494161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb68020-9bca-4631-9050-b679f2023f72 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.507314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122123c-930b-42c5-9cfc-83472b9f00dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.508206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122123c-930b-42c5-9cfc-83472b9f00dd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.508583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122123c-930b-42c5-9cfc-83472b9f00dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.508959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122123c-930b-42c5-9cfc-83472b9f00dd admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.509783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122123c-930b-42c5-9cfc-83472b9f00dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:03.511558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122123c-930b-42c5-9cfc-83472b9f00dd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:03.526986 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3956/7975] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:03.530980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76961d0-fcb2-4066-a1c5-eca09f2a072d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.547522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76961d0-fcb2-4066-a1c5-eca09f2a072d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.553958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98818ddc-28cf-4fea-b992-c45193c5db2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.554858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818ddc-28cf-4fea-b992-c45193c5db2e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.555306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818ddc-28cf-4fea-b992-c45193c5db2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.555742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818ddc-28cf-4fea-b992-c45193c5db2e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.557814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98818ddc-28cf-4fea-b992-c45193c5db2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:03.559493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98818ddc-28cf-4fea-b992-c45193c5db2e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:03.585101 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4020/7976] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:03.589323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122123c-930b-42c5-9cfc-83472b9f00dd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.602551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122123c-930b-42c5-9cfc-83472b9f00dd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.608536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c633b84-3bb1-487b-ba19-449d751f9932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.609373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633b84-3bb1-487b-ba19-449d751f9932 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.609985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633b84-3bb1-487b-ba19-449d751f9932 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.610368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633b84-3bb1-487b-ba19-449d751f9932 admin admin] PATH_INFO: `/v3/projects/08205d452dfb4feba6d4bcf4303e00a3/users/6e4ba587b23b42b988077c6be5e0a391/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.629081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c633b84-3bb1-487b-ba19-449d751f9932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08205d452dfb4feba6d4bcf4303e00a3, user_id=6e4ba587b23b42b988077c6be5e0a391, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:03.632758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c633b84-3bb1-487b-ba19-449d751f9932 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:03.649913 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3957/7977] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:03 2022] PUT /identity/v3/projects/08205d452dfb4feba6d4bcf4303e00a3/users/6e4ba587b23b42b988077c6be5e0a391/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:03.660328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3514c-0bd5-40d4-bbaa-e7ec0c2c237a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.660614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3514c-0bd5-40d4-bbaa-e7ec0c2c237a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.660892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3514c-0bd5-40d4-bbaa-e7ec0c2c237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.692022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a2f3514c-0bd5-40d4-bbaa-e7ec0c2c237a None None] MFA Rules not processed for user `6e4ba587b23b42b988077c6be5e0a391`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:03.693841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a2f3514c-0bd5-40d4-bbaa-e7ec0c2c237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:03.775365 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4021/7978] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:03.788717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c633b84-3bb1-487b-ba19-449d751f9932 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:03.790796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8c633b84-3bb1-487b-ba19-449d751f9932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:03.871179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c633b84-3bb1-487b-ba19-449d751f9932 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:03.882701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b338f-f8fd-4b0e-8e06-c08b580f04dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:03.883560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b338f-f8fd-4b0e-8e06-c08b580f04dc service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:03.884018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b338f-f8fd-4b0e-8e06-c08b580f04dc service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:03.884465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b338f-f8fd-4b0e-8e06-c08b580f04dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:03.895469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b338f-f8fd-4b0e-8e06-c08b580f04dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:03.897534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b338f-f8fd-4b0e-8e06-c08b580f04dc service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:03.923224 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3958/7979] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:04.541928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3514c-0bd5-40d4-bbaa-e7ec0c2c237a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:04.667605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3514c-0bd5-40d4-bbaa-e7ec0c2c237a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:04.679514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:04.680163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:04.680441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:04.680714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] PATH_INFO: `/v3/users/6e4ba587b23b42b988077c6be5e0a391` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:04.681900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4ba587b23b42b988077c6be5e0a391)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:04.683827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:04.753909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:04.757440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4ba587b23b42b988077c6be5e0a391'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:04.758200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4ba587b23b42b988077c6be5e0a391'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:04.774013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4ba587b23b42b988077c6be5e0a391'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:04.774790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4ba587b23b42b988077c6be5e0a391'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:04.782071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4ba587b23b42b988077c6be5e0a391'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:04.798932 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4022/7980] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:04 2022] DELETE /identity/v3/users/6e4ba587b23b42b988077c6be5e0a391 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:04.800960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2b63-f123-40e2-b7ab-952c0628936e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:04.801461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2b63-f123-40e2-b7ab-952c0628936e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:04.801655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2b63-f123-40e2-b7ab-952c0628936e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:04.823017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cefd2b63-f123-40e2-b7ab-952c0628936e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:04.824310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cefd2b63-f123-40e2-b7ab-952c0628936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:04.874128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:04.890420 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3959/7981] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:04.900137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:04.901791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:04.972281 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d0f31-e023-4d41-8c92-6e5011e8d176 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:04.976177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c862ce-bbb6-41cd-bf97-4d31f6ecdb3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:04.976805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c862ce-bbb6-41cd-bf97-4d31f6ecdb3c service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:04.977076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c862ce-bbb6-41cd-bf97-4d31f6ecdb3c service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:04.977357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c862ce-bbb6-41cd-bf97-4d31f6ecdb3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:04.988746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c862ce-bbb6-41cd-bf97-4d31f6ecdb3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:04.990846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c862ce-bbb6-41cd-bf97-4d31f6ecdb3c service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:05.002562 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4023/7982] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:05.417002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2b63-f123-40e2-b7ab-952c0628936e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:05.418739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cefd2b63-f123-40e2-b7ab-952c0628936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:05.443197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2b63-f123-40e2-b7ab-952c0628936e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:05.468370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:05.469237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.469419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.469677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] PATH_INFO: `/v3/projects/08205d452dfb4feba6d4bcf4303e00a3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.473013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08205d452dfb4feba6d4bcf4303e00a3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:05.480712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:05.586159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08205d452dfb4feba6d4bcf4303e00a3', 'request_id': 'req-56b5a6fb-bc15-4ba2-912b-dc9765334550'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.599331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08205d452dfb4feba6d4bcf4303e00a3', 'request_id': 'req-56b5a6fb-bc15-4ba2-912b-dc9765334550'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.614202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08205d452dfb4feba6d4bcf4303e00a3', 'request_id': 'req-56b5a6fb-bc15-4ba2-912b-dc9765334550'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.638951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] The token cache is being invalidate because project 08205d452dfb4feba6d4bcf4303e00a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:05.639316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.643942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-56b5a6fb-bc15-4ba2-912b-dc9765334550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:05.646141 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3960/7983] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:05 2022] DELETE /identity/v3/projects/08205d452dfb4feba6d4bcf4303e00a3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:05.653143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74dda-354a-4846-b940-4e894027201b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.654013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74dda-354a-4846-b940-4e894027201b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.654293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74dda-354a-4846-b940-4e894027201b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.691732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cfc74dda-354a-4846-b940-4e894027201b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:05.693472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cfc74dda-354a-4846-b940-4e894027201b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:05.769162 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4024/7984] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:05.778182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7438-1811-4682-9c74-6f43c242cdd6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.778629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7438-1811-4682-9c74-6f43c242cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.779011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7438-1811-4682-9c74-6f43c242cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.821560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-352e7438-1811-4682-9c74-6f43c242cdd6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:05.823536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-352e7438-1811-4682-9c74-6f43c242cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:05.862994 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3961/7985] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:05.867293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc74dda-354a-4846-b940-4e894027201b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:05.883916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc74dda-354a-4846-b940-4e894027201b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:05.898477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed296c-aa42-4f97-86e6-783989a8c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:05.899409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed296c-aa42-4f97-86e6-783989a8c4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:05.899911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed296c-aa42-4f97-86e6-783989a8c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:05.900457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed296c-aa42-4f97-86e6-783989a8c4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:05.901620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed296c-aa42-4f97-86e6-783989a8c4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:05.902138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed296c-aa42-4f97-86e6-783989a8c4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:05.904044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed296c-aa42-4f97-86e6-783989a8c4c9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:05.952563 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4025/7986] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:05.955213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e7438-1811-4682-9c74-6f43c242cdd6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:05.985512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e7438-1811-4682-9c74-6f43c242cdd6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.003454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c884cc-aea3-4320-ac6b-0cd6d9d0ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.005751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c884cc-aea3-4320-ac6b-0cd6d9d0ea3e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.009207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c884cc-aea3-4320-ac6b-0cd6d9d0ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.013691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c884cc-aea3-4320-ac6b-0cd6d9d0ea3e admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.014534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c884cc-aea3-4320-ac6b-0cd6d9d0ea3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.017272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c884cc-aea3-4320-ac6b-0cd6d9d0ea3e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.120428 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3962/7987] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:05 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:06.122294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed296c-aa42-4f97-86e6-783989a8c4c9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.137996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed296c-aa42-4f97-86e6-783989a8c4c9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.283542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:06.296168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e0ae5-9167-4307-a75a-e1986c460417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.296829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e0ae5-9167-4307-a75a-e1986c460417 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.297526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e0ae5-9167-4307-a75a-e1986c460417 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.298048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e0ae5-9167-4307-a75a-e1986c460417 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.315441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e0ae5-9167-4307-a75a-e1986c460417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.322851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e0ae5-9167-4307-a75a-e1986c460417 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.368743 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4026/7988] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:06 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:06.373540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c884cc-aea3-4320-ac6b-0cd6d9d0ea3e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.387023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c884cc-aea3-4320-ac6b-0cd6d9d0ea3e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.403843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bf13f-0606-4b72-88fd-9b601708a026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.404842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf13f-0606-4b72-88fd-9b601708a026 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.405281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf13f-0606-4b72-88fd-9b601708a026 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.405661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf13f-0606-4b72-88fd-9b601708a026 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.406728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bf13f-0606-4b72-88fd-9b601708a026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.410437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bf13f-0606-4b72-88fd-9b601708a026 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.445641 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3963/7989] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:06.447244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e0ae5-9167-4307-a75a-e1986c460417 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.463449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e0ae5-9167-4307-a75a-e1986c460417 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.476356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b303079-1744-474a-8069-c3d1d85e3b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.477090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303079-1744-474a-8069-c3d1d85e3b5a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.477520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303079-1744-474a-8069-c3d1d85e3b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.477899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303079-1744-474a-8069-c3d1d85e3b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.478645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b303079-1744-474a-8069-c3d1d85e3b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.480423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b303079-1744-474a-8069-c3d1d85e3b5a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.512895 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4027/7990] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:06.517030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bf13f-0606-4b72-88fd-9b601708a026 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.527395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bf13f-0606-4b72-88fd-9b601708a026 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.532460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71981d-c9a6-4dc0-a365-fcca9e6361fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.533144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71981d-c9a6-4dc0-a365-fcca9e6361fd admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.543020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71981d-c9a6-4dc0-a365-fcca9e6361fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.543278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71981d-c9a6-4dc0-a365-fcca9e6361fd admin admin] PATH_INFO: `/v3/projects/f9c02ec91efa480fb29045cb0fbbabb2/users/c74183a342244acab2975d100bd08152/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.562346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71981d-c9a6-4dc0-a365-fcca9e6361fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c02ec91efa480fb29045cb0fbbabb2, user_id=c74183a342244acab2975d100bd08152, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.565350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71981d-c9a6-4dc0-a365-fcca9e6361fd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.582609 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3964/7991] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:06 2022] PUT /identity/v3/projects/f9c02ec91efa480fb29045cb0fbbabb2/users/c74183a342244acab2975d100bd08152/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:06.593688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4a7e2-c03a-4205-8498-d70a248450e1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.593983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4a7e2-c03a-4205-8498-d70a248450e1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.594260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4a7e2-c03a-4205-8498-d70a248450e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.650270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ebb4a7e2-c03a-4205-8498-d70a248450e1 None None] MFA Rules not processed for user `c74183a342244acab2975d100bd08152`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:06.651510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ebb4a7e2-c03a-4205-8498-d70a248450e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:06.761101 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4028/7992] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:06.765268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71981d-c9a6-4dc0-a365-fcca9e6361fd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.834824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71981d-c9a6-4dc0-a365-fcca9e6361fd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.840689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef63837-fc33-4be3-95f0-142f48bed4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.841831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef63837-fc33-4be3-95f0-142f48bed4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.842307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef63837-fc33-4be3-95f0-142f48bed4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.842756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef63837-fc33-4be3-95f0-142f48bed4f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.843571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef63837-fc33-4be3-95f0-142f48bed4f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.845879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef63837-fc33-4be3-95f0-142f48bed4f5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:06.870718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:06.885819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4a7e2-c03a-4205-8498-d70a248450e1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:06.896642 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3965/7993] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:06 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:06.900807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4a7e2-c03a-4205-8498-d70a248450e1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:06.973460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942c3a2-a7fd-4ae1-9f4c-d258192ed898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:06.974643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942c3a2-a7fd-4ae1-9f4c-d258192ed898 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:06.975067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942c3a2-a7fd-4ae1-9f4c-d258192ed898 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:06.975353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942c3a2-a7fd-4ae1-9f4c-d258192ed898 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:06.975994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942c3a2-a7fd-4ae1-9f4c-d258192ed898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:06.978115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942c3a2-a7fd-4ae1-9f4c-d258192ed898 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.005931 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4029/7994] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:06 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:07.007278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef63837-fc33-4be3-95f0-142f48bed4f5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.025564 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef63837-fc33-4be3-95f0-142f48bed4f5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.031513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90bbc4-b666-466c-9fbc-089dbbcb76ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.032492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90bbc4-b666-466c-9fbc-089dbbcb76ec admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.032879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90bbc4-b666-466c-9fbc-089dbbcb76ec admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.033317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90bbc4-b666-466c-9fbc-089dbbcb76ec admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.034104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90bbc4-b666-466c-9fbc-089dbbcb76ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.035981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90bbc4-b666-466c-9fbc-089dbbcb76ec admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.053453 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3966/7995] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:07.057700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942c3a2-a7fd-4ae1-9f4c-d258192ed898 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.091108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942c3a2-a7fd-4ae1-9f4c-d258192ed898 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.104941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14bac9-43fb-483f-a455-4a2ee770d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.105844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14bac9-43fb-483f-a455-4a2ee770d30d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.117874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14bac9-43fb-483f-a455-4a2ee770d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.119775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14bac9-43fb-483f-a455-4a2ee770d30d admin admin] PATH_INFO: `/v3/projects/3509b2d49700472ab5adc16ff49e206e/users/bc2c46c1d8bf46cd9b51c51f5f9482cf/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.174934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14bac9-43fb-483f-a455-4a2ee770d30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3509b2d49700472ab5adc16ff49e206e, user_id=bc2c46c1d8bf46cd9b51c51f5f9482cf, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.178275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14bac9-43fb-483f-a455-4a2ee770d30d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.200764 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4030/7996] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:07 2022] PUT /identity/v3/projects/3509b2d49700472ab5adc16ff49e206e/users/bc2c46c1d8bf46cd9b51c51f5f9482cf/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:07.200997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90bbc4-b666-466c-9fbc-089dbbcb76ec admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.212394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90bbc4-b666-466c-9fbc-089dbbcb76ec admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.349405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ad74a-2da1-4abb-b81e-e57edfa91602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.350116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ad74a-2da1-4abb-b81e-e57edfa91602 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.350411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ad74a-2da1-4abb-b81e-e57edfa91602 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.350753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ad74a-2da1-4abb-b81e-e57edfa91602 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.351411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ad74a-2da1-4abb-b81e-e57edfa91602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.353049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ad74a-2da1-4abb-b81e-e57edfa91602 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.388579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14bac9-43fb-483f-a455-4a2ee770d30d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.390717 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3967/7997] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:07.406288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14bac9-43fb-483f-a455-4a2ee770d30d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.435417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7675c92-210d-4888-bb00-a9dbc69f6578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.436118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675c92-210d-4888-bb00-a9dbc69f6578 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.436408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675c92-210d-4888-bb00-a9dbc69f6578 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.436689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675c92-210d-4888-bb00-a9dbc69f6578 admin admin] PATH_INFO: `/v3/projects/3509b2d49700472ab5adc16ff49e206e/users/bc2c46c1d8bf46cd9b51c51f5f9482cf/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.441010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7675c92-210d-4888-bb00-a9dbc69f6578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3509b2d49700472ab5adc16ff49e206e, user_id=bc2c46c1d8bf46cd9b51c51f5f9482cf, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.443889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7675c92-210d-4888-bb00-a9dbc69f6578 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.477216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72635d7-9d85-4dfc-8b73-65608de05656 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.478050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72635d7-9d85-4dfc-8b73-65608de05656 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.478316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72635d7-9d85-4dfc-8b73-65608de05656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.481315 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4031/7998] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:07 2022] PUT /identity/v3/projects/3509b2d49700472ab5adc16ff49e206e/users/bc2c46c1d8bf46cd9b51c51f5f9482cf/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:07.519032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d72635d7-9d85-4dfc-8b73-65608de05656 None None] MFA Rules not processed for user `bc2c46c1d8bf46cd9b51c51f5f9482cf`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:07.520374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d72635d7-9d85-4dfc-8b73-65608de05656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:07.602049 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3968/7999] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:07.612822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7675c92-210d-4888-bb00-a9dbc69f6578 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:07.614583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d7675c92-210d-4888-bb00-a9dbc69f6578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:07.628825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:07.677640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7675c92-210d-4888-bb00-a9dbc69f6578 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:07.681190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe1a86-6d84-4c65-ab3d-5a8e9903a9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:07.681941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe1a86-6d84-4c65-ab3d-5a8e9903a9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:07.682228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe1a86-6d84-4c65-ab3d-5a8e9903a9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:07.682506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe1a86-6d84-4c65-ab3d-5a8e9903a9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:07.691785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe1a86-6d84-4c65-ab3d-5a8e9903a9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:07.693829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe1a86-6d84-4c65-ab3d-5a8e9903a9f6 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:07.703569 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4032/8000] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:16.206716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72635d7-9d85-4dfc-8b73-65608de05656 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:16.220809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72635d7-9d85-4dfc-8b73-65608de05656 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:16.239520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029ea61-b707-4398-8715-ede40783a9f3 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2c46c1d8bf46cd9b51c51f5f9482cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3509b2d49700472ab5adc16ff49e206e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:16.240177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ea61-b707-4398-8715-ede40783a9f3 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:16.240531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ea61-b707-4398-8715-ede40783a9f3 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:16.242077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ea61-b707-4398-8715-ede40783a9f3 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:16.242077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029ea61-b707-4398-8715-ede40783a9f3 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:16.242077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029ea61-b707-4398-8715-ede40783a9f3 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:16.244112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029ea61-b707-4398-8715-ede40783a9f3 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:16.268662 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3969/8001] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:16.269772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe1a86-6d84-4c65-ab3d-5a8e9903a9f6 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:16.294260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe1a86-6d84-4c65-ab3d-5a8e9903a9f6 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:16.327498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95575b73-4944-461c-b7ab-eef9068a218e tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2c46c1d8bf46cd9b51c51f5f9482cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3509b2d49700472ab5adc16ff49e206e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:16.328776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95575b73-4944-461c-b7ab-eef9068a218e tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:16.330044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95575b73-4944-461c-b7ab-eef9068a218e tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:16.334213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95575b73-4944-461c-b7ab-eef9068a218e tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:16.335085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95575b73-4944-461c-b7ab-eef9068a218e tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:16.341868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95575b73-4944-461c-b7ab-eef9068a218e tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:16.433971 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4033/8002] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:16 2022] POST /identity/v3/projects => generated 348 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:16.434434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029ea61-b707-4398-8715-ede40783a9f3 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:16.467314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029ea61-b707-4398-8715-ede40783a9f3 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:16.595054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:16.605595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0fbfd-0a03-4cf1-af95-a8bc98bb434d tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2c46c1d8bf46cd9b51c51f5f9482cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3509b2d49700472ab5adc16ff49e206e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:16.606508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0fbfd-0a03-4cf1-af95-a8bc98bb434d tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:16.606996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0fbfd-0a03-4cf1-af95-a8bc98bb434d tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:16.607471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0fbfd-0a03-4cf1-af95-a8bc98bb434d tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:16.608346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0fbfd-0a03-4cf1-af95-a8bc98bb434d tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:16.608661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0fbfd-0a03-4cf1-af95-a8bc98bb434d tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:16.610301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0fbfd-0a03-4cf1-af95-a8bc98bb434d tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:16.638156 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3970/8003] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:18.084628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95575b73-4944-461c-b7ab-eef9068a218e tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:18.098935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95575b73-4944-461c-b7ab-eef9068a218e tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:18.119020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2c46c1d8bf46cd9b51c51f5f9482cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3509b2d49700472ab5adc16ff49e206e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:18.120460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:18.120802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:18.121005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] PATH_INFO: `/v3/projects/b484de2634b8402eaefa979abcffc483` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:18.131245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b484de2634b8402eaefa979abcffc483)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:18.139661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:18.269595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b484de2634b8402eaefa979abcffc483', 'request_id': 'req-3c98d534-cc45-4c24-90f6-a9f715fde5a0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:18.289776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b484de2634b8402eaefa979abcffc483', 'request_id': 'req-3c98d534-cc45-4c24-90f6-a9f715fde5a0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:18.305551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b484de2634b8402eaefa979abcffc483', 'request_id': 'req-3c98d534-cc45-4c24-90f6-a9f715fde5a0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:18.343678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] The token cache is being invalidate because project b484de2634b8402eaefa979abcffc483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:18.344056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:18.344695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3c98d534-cc45-4c24-90f6-a9f715fde5a0 tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:18.350885 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4034/8004] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:18 2022] DELETE /identity/v3/projects/b484de2634b8402eaefa979abcffc483 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:18.358664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0fbfd-0a03-4cf1-af95-a8bc98bb434d tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:18.360750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5bb0fbfd-0a03-4cf1-af95-a8bc98bb434d tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:18.503231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0fbfd-0a03-4cf1-af95-a8bc98bb434d tempest-RoutersIpV6AdminTest-227733049 tempest-RoutersIpV6AdminTest-227733049-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:18.688363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b468-ba09-4bdf-b460-f470589cd18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:18.691305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b468-ba09-4bdf-b460-f470589cd18c service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:18.695418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b468-ba09-4bdf-b460-f470589cd18c service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:18.695585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b468-ba09-4bdf-b460-f470589cd18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:18.709428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8457b468-ba09-4bdf-b460-f470589cd18c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:18.974413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457b468-ba09-4bdf-b460-f470589cd18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:18.978002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457b468-ba09-4bdf-b460-f470589cd18c service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:18.999633 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3971/8005] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:28.335085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=57,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:28.985418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=73 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:38.727777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e593a-a9b2-4647-9869-7d16ca8579d7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:38.728855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e593a-a9b2-4647-9869-7d16ca8579d7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:38.729302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e593a-a9b2-4647-9869-7d16ca8579d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:38.760329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ec0e593a-a9b2-4647-9869-7d16ca8579d7 None None] MFA Rules not processed for user `e276b9fae4594c17a1883dd4e48184c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:38.762303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ec0e593a-a9b2-4647-9869-7d16ca8579d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:38.854855 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4035/8006] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:40.830798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b468-ba09-4bdf-b460-f470589cd18c service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:40.832512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8457b468-ba09-4bdf-b460-f470589cd18c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:40.967567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b468-ba09-4bdf-b460-f470589cd18c service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:40.979552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017b74c-c814-46b7-bcf5-b4766e5a48a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:40.981509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017b74c-c814-46b7-bcf5-b4766e5a48a8 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:40.986882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017b74c-c814-46b7-bcf5-b4766e5a48a8 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:40.987483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017b74c-c814-46b7-bcf5-b4766e5a48a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:40.991031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a017b74c-c814-46b7-bcf5-b4766e5a48a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:41.015134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017b74c-c814-46b7-bcf5-b4766e5a48a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:41.017612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017b74c-c814-46b7-bcf5-b4766e5a48a8 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:41.034987 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3972/8007] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:42.258757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e593a-a9b2-4647-9869-7d16ca8579d7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:42.260769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ec0e593a-a9b2-4647-9869-7d16ca8579d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:42.442190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e593a-a9b2-4647-9869-7d16ca8579d7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:42.451575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:42.452916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:42.453204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:42.453922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] PATH_INFO: `/v3/users/4ba6354796c546649f20d0dbe3cb3706` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:42.454981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba6354796c546649f20d0dbe3cb3706)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:42.458224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:42.513656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba6354796c546649f20d0dbe3cb3706'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.514411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba6354796c546649f20d0dbe3cb3706'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.529674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba6354796c546649f20d0dbe3cb3706'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.530791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba6354796c546649f20d0dbe3cb3706'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.540724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba6354796c546649f20d0dbe3cb3706'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:42.559042 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4036/8008] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:42 2022] DELETE /identity/v3/users/4ba6354796c546649f20d0dbe3cb3706 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:42.810203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017b74c-c814-46b7-bcf5-b4766e5a48a8 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:42.827251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017b74c-c814-46b7-bcf5-b4766e5a48a8 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:42.936253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:42.937013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:42.938010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:42.938398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] PATH_INFO: `/v3/projects/100ca676a92148a78c3de75e9a3bfa55` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:42.939677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=100ca676a92148a78c3de75e9a3bfa55)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:42.942578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:43.009122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100ca676a92148a78c3de75e9a3bfa55', 'request_id': 'req-9bc95917-9bff-4d29-8b04-38cdf95d00ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.016404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100ca676a92148a78c3de75e9a3bfa55', 'request_id': 'req-9bc95917-9bff-4d29-8b04-38cdf95d00ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.025979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100ca676a92148a78c3de75e9a3bfa55', 'request_id': 'req-9bc95917-9bff-4d29-8b04-38cdf95d00ca'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.039633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] The token cache is being invalidate because project 100ca676a92148a78c3de75e9a3bfa55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:43.040286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.041202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.043530 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3973/8009] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:42 2022] DELETE /identity/v3/projects/100ca676a92148a78c3de75e9a3bfa55 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:43.047280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:43.048978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:43.084320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2598bf-9bb4-4947-b765-044546e8cec9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:43.148740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:43.282918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a75921-037d-49b5-8acc-1cc82fcc2cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:43.283814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75921-037d-49b5-8acc-1cc82fcc2cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:43.284195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75921-037d-49b5-8acc-1cc82fcc2cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:43.284574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75921-037d-49b5-8acc-1cc82fcc2cc5 admin admin] PATH_INFO: `/v3/users/490767a5516a43a1817cc53e8bf311a1` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:43.289578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a75921-037d-49b5-8acc-1cc82fcc2cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490767a5516a43a1817cc53e8bf311a1)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:43.291885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a75921-037d-49b5-8acc-1cc82fcc2cc5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:43.385776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-32a75921-037d-49b5-8acc-1cc82fcc2cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490767a5516a43a1817cc53e8bf311a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.386696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-32a75921-037d-49b5-8acc-1cc82fcc2cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490767a5516a43a1817cc53e8bf311a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.421955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-32a75921-037d-49b5-8acc-1cc82fcc2cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490767a5516a43a1817cc53e8bf311a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.423328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-32a75921-037d-49b5-8acc-1cc82fcc2cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490767a5516a43a1817cc53e8bf311a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.458877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-32a75921-037d-49b5-8acc-1cc82fcc2cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490767a5516a43a1817cc53e8bf311a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.509152 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4037/8010] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:00:43 2022] DELETE /identity/v3/users/490767a5516a43a1817cc53e8bf311a1 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:43.789326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:43.791151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:43.811164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95917-9bff-4d29-8b04-38cdf95d00ca admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:43.834501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:43.898065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:43.899309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:43.900713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:43.901251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] PATH_INFO: `/v3/projects/7f91eea2e8d442b9bdd675c975233f0f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:43.903341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f91eea2e8d442b9bdd675c975233f0f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:43.907048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:43.980897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f91eea2e8d442b9bdd675c975233f0f', 'request_id': 'req-e7053ad8-fa63-493b-8393-ef36e9b640f2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.988350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f91eea2e8d442b9bdd675c975233f0f', 'request_id': 'req-e7053ad8-fa63-493b-8393-ef36e9b640f2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:43.998668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f91eea2e8d442b9bdd675c975233f0f', 'request_id': 'req-e7053ad8-fa63-493b-8393-ef36e9b640f2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.015883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] The token cache is being invalidate because project 7f91eea2e8d442b9bdd675c975233f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:00:44.016514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.017591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e7053ad8-fa63-493b-8393-ef36e9b640f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:00:44.020183 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3974/8011] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:00:43 2022] DELETE /identity/v3/projects/7f91eea2e8d442b9bdd675c975233f0f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:44.024861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4229c-f612-4681-90b2-482c8c87dccf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.025376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4229c-f612-4681-90b2-482c8c87dccf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.026223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4229c-f612-4681-90b2-482c8c87dccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.054265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f2e4229c-f612-4681-90b2-482c8c87dccf None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:44.057141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f2e4229c-f612-4681-90b2-482c8c87dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:44.141899 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4038/8012] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:44.151544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f5c83-8a2b-4adb-b39f-66c794b06199 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.151841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f5c83-8a2b-4adb-b39f-66c794b06199 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.152120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f5c83-8a2b-4adb-b39f-66c794b06199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.195556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-418f5c83-8a2b-4adb-b39f-66c794b06199 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:44.201308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-418f5c83-8a2b-4adb-b39f-66c794b06199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:44.212587 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3975/8013] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:00:44.216620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4229c-f612-4681-90b2-482c8c87dccf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:44.234514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4229c-f612-4681-90b2-482c8c87dccf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:44.242056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd39c8-4ba5-4841-98df-e888a81f2e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:44.243313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd39c8-4ba5-4841-98df-e888a81f2e23 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.243626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd39c8-4ba5-4841-98df-e888a81f2e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.244130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd39c8-4ba5-4841-98df-e888a81f2e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.244806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd39c8-4ba5-4841-98df-e888a81f2e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:00:44.245114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd39c8-4ba5-4841-98df-e888a81f2e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:44.261271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd39c8-4ba5-4841-98df-e888a81f2e23 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:44.281439 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4039/8014] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:00:44.285086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f5c83-8a2b-4adb-b39f-66c794b06199 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:44.299517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f5c83-8a2b-4adb-b39f-66c794b06199 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:44.314184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb1acc-8357-4c45-939c-9f69f18f1112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:44.316519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1acc-8357-4c45-939c-9f69f18f1112 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.316918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1acc-8357-4c45-939c-9f69f18f1112 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.317282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1acc-8357-4c45-939c-9f69f18f1112 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.318530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb1acc-8357-4c45-939c-9f69f18f1112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:44.322738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb1acc-8357-4c45-939c-9f69f18f1112 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:44.388075 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3976/8015] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:44 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:44.392030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd39c8-4ba5-4841-98df-e888a81f2e23 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:44.403776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd39c8-4ba5-4841-98df-e888a81f2e23 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:44.445282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:44.487631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f83a55-5d57-4043-843a-4efd1197ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:44.488104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f83a55-5d57-4043-843a-4efd1197ba12 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.488391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f83a55-5d57-4043-843a-4efd1197ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.489303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f83a55-5d57-4043-843a-4efd1197ba12 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.490069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f83a55-5d57-4043-843a-4efd1197ba12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:44.501423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f83a55-5d57-4043-843a-4efd1197ba12 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:44.526655 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4040/8016] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:44 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:44.530503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb1acc-8357-4c45-939c-9f69f18f1112 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:44.543374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb1acc-8357-4c45-939c-9f69f18f1112 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:44.549034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b8e0-0db8-4d5f-abf4-d14bd2cec6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:44.549839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b8e0-0db8-4d5f-abf4-d14bd2cec6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.550127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b8e0-0db8-4d5f-abf4-d14bd2cec6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.550671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b8e0-0db8-4d5f-abf4-d14bd2cec6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.551935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2b8e0-0db8-4d5f-abf4-d14bd2cec6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:44.553857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2b8e0-0db8-4d5f-abf4-d14bd2cec6a6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:44.565959 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3977/8017] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:44.570071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f83a55-5d57-4043-843a-4efd1197ba12 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:44.581884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f83a55-5d57-4043-843a-4efd1197ba12 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:44.587914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a64c7-756b-487f-97a8-74bb485befd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:44.588839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a64c7-756b-487f-97a8-74bb485befd9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.589322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a64c7-756b-487f-97a8-74bb485befd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.589698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a64c7-756b-487f-97a8-74bb485befd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.590626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a64c7-756b-487f-97a8-74bb485befd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:44.593838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a64c7-756b-487f-97a8-74bb485befd9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:44.606134 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4041/8018] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:44.610460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b8e0-0db8-4d5f-abf4-d14bd2cec6a6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:44.624933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b8e0-0db8-4d5f-abf4-d14bd2cec6a6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:44.630603 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45917374-d2e1-416c-b4cc-15028517875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:44.631304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45917374-d2e1-416c-b4cc-15028517875e admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.631592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45917374-d2e1-416c-b4cc-15028517875e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.631868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45917374-d2e1-416c-b4cc-15028517875e admin admin] PATH_INFO: `/v3/projects/539657c1d89d4b6fb7c523410811bd13/users/16e4479f0b9446c9ba971e85ea9daa4e/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.656456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45917374-d2e1-416c-b4cc-15028517875e admin admin] RBAC: Authorizing `identity:create_grant(project_id=539657c1d89d4b6fb7c523410811bd13, user_id=16e4479f0b9446c9ba971e85ea9daa4e, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:44.659527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45917374-d2e1-416c-b4cc-15028517875e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:44.686524 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3978/8019] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:44 2022] PUT /identity/v3/projects/539657c1d89d4b6fb7c523410811bd13/users/16e4479f0b9446c9ba971e85ea9daa4e/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:00:44.698107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00ac4b-cd63-4006-a55f-6bfae961e81a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.698397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00ac4b-cd63-4006-a55f-6bfae961e81a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.698678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00ac4b-cd63-4006-a55f-6bfae961e81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.761884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-db00ac4b-cd63-4006-a55f-6bfae961e81a None None] MFA Rules not processed for user `16e4479f0b9446c9ba971e85ea9daa4e`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:44.763758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-db00ac4b-cd63-4006-a55f-6bfae961e81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:44.888125 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4042/8020] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:44.892743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45917374-d2e1-416c-b4cc-15028517875e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:44.951682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:44.969041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45917374-d2e1-416c-b4cc-15028517875e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:44.974614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a625-54d7-4988-a185-4414ed204943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:44.975248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a625-54d7-4988-a185-4414ed204943 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:44.975528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a625-54d7-4988-a185-4414ed204943 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:44.975947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a625-54d7-4988-a185-4414ed204943 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:44.976491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7a625-54d7-4988-a185-4414ed204943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:44.978666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7a625-54d7-4988-a185-4414ed204943 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:45.022609 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3979/8021] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:00:44 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:45.026643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00ac4b-cd63-4006-a55f-6bfae961e81a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:45.042948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00ac4b-cd63-4006-a55f-6bfae961e81a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:45.163053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f26e87-dc1a-4fb3-af2d-c0e36d6e2207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:45.163609 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26e87-dc1a-4fb3-af2d-c0e36d6e2207 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:45.163891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26e87-dc1a-4fb3-af2d-c0e36d6e2207 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:45.164160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26e87-dc1a-4fb3-af2d-c0e36d6e2207 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:45.169061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f26e87-dc1a-4fb3-af2d-c0e36d6e2207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:45.171582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f26e87-dc1a-4fb3-af2d-c0e36d6e2207 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:45.216514 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4043/8022] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:00:45 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:00:45.220509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a625-54d7-4988-a185-4414ed204943 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:45.235984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a625-54d7-4988-a185-4414ed204943 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:45.248301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29075cc-c1d7-4655-aacb-b4cab3759630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:45.248870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29075cc-c1d7-4655-aacb-b4cab3759630 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:45.249151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29075cc-c1d7-4655-aacb-b4cab3759630 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:45.249816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29075cc-c1d7-4655-aacb-b4cab3759630 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:45.250502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29075cc-c1d7-4655-aacb-b4cab3759630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:45.252122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29075cc-c1d7-4655-aacb-b4cab3759630 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:45.293880 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3980/8023] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:45.294974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f26e87-dc1a-4fb3-af2d-c0e36d6e2207 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:45.311285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f26e87-dc1a-4fb3-af2d-c0e36d6e2207 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:45.322022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b730c3-84c4-4974-9962-6a7283b8fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:45.322884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b730c3-84c4-4974-9962-6a7283b8fd97 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:45.323782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b730c3-84c4-4974-9962-6a7283b8fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:45.325888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b730c3-84c4-4974-9962-6a7283b8fd97 admin admin] PATH_INFO: `/v3/projects/33ad4dc3c33b4a649a3f4b06dcb7a5f5/users/ae6ec5d3808d4cb4913eb2f624c34a8c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:45.359283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b730c3-84c4-4974-9962-6a7283b8fd97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ad4dc3c33b4a649a3f4b06dcb7a5f5, user_id=ae6ec5d3808d4cb4913eb2f624c34a8c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:45.368081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b730c3-84c4-4974-9962-6a7283b8fd97 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:45.412852 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4044/8024] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:45 2022] PUT /identity/v3/projects/33ad4dc3c33b4a649a3f4b06dcb7a5f5/users/ae6ec5d3808d4cb4913eb2f624c34a8c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:45.416485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29075cc-c1d7-4655-aacb-b4cab3759630 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:45.427306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29075cc-c1d7-4655-aacb-b4cab3759630 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:45.613822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f21994-13f8-4af9-90b9-c49c1131e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:45.614462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f21994-13f8-4af9-90b9-c49c1131e9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:45.614744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f21994-13f8-4af9-90b9-c49c1131e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:45.615023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f21994-13f8-4af9-90b9-c49c1131e9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:45.615674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f21994-13f8-4af9-90b9-c49c1131e9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:45.617287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f21994-13f8-4af9-90b9-c49c1131e9a8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:45.642645 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3981/8025] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:00:45.649559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b730c3-84c4-4974-9962-6a7283b8fd97 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:45.658933 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:45.668391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b730c3-84c4-4974-9962-6a7283b8fd97 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:45.682175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa363922-b6a6-41b4-8e64-8255df65d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:45.683011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa363922-b6a6-41b4-8e64-8255df65d15e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:45.683393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa363922-b6a6-41b4-8e64-8255df65d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:45.683771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa363922-b6a6-41b4-8e64-8255df65d15e admin admin] PATH_INFO: `/v3/projects/33ad4dc3c33b4a649a3f4b06dcb7a5f5/users/ae6ec5d3808d4cb4913eb2f624c34a8c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:45.688179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa363922-b6a6-41b4-8e64-8255df65d15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ad4dc3c33b4a649a3f4b06dcb7a5f5, user_id=ae6ec5d3808d4cb4913eb2f624c34a8c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:45.693934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa363922-b6a6-41b4-8e64-8255df65d15e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:45.738901 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4045/8026] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:00:45 2022] PUT /identity/v3/projects/33ad4dc3c33b4a649a3f4b06dcb7a5f5/users/ae6ec5d3808d4cb4913eb2f624c34a8c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:00:45.741685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0fe6-794b-4c6a-8e00-4aee79bd83fa None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:45.741848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0fe6-794b-4c6a-8e00-4aee79bd83fa None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:45.742090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0fe6-794b-4c6a-8e00-4aee79bd83fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:45.803229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6bde0fe6-794b-4c6a-8e00-4aee79bd83fa None None] MFA Rules not processed for user `ae6ec5d3808d4cb4913eb2f624c34a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:00:45.804441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6bde0fe6-794b-4c6a-8e00-4aee79bd83fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:45.909807 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3982/8027] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:00:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:00:45.922197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa363922-b6a6-41b4-8e64-8255df65d15e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:45.923942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fa363922-b6a6-41b4-8e64-8255df65d15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:45.999256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa363922-b6a6-41b4-8e64-8255df65d15e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:46.003457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07751f26-be2a-418c-951c-959818cdf9c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:46.005031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07751f26-be2a-418c-951c-959818cdf9c0 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:46.005544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07751f26-be2a-418c-951c-959818cdf9c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:46.005819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07751f26-be2a-418c-951c-959818cdf9c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:46.073698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07751f26-be2a-418c-951c-959818cdf9c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:46.075168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07751f26-be2a-418c-951c-959818cdf9c0 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:46.098454 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4046/8028] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:00:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:00:55.905032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:56.081580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=51,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:59.794581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde0fe6-794b-4c6a-8e00-4aee79bd83fa None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:00:59.796588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6bde0fe6-794b-4c6a-8e00-4aee79bd83fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:00:59.911849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde0fe6-794b-4c6a-8e00-4aee79bd83fa None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:00:59.918660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30fe3c-27ad-4ec7-aa58-b06738476499 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:00:59.919738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fe3c-27ad-4ec7-aa58-b06738476499 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:00:59.920020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fe3c-27ad-4ec7-aa58-b06738476499 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:00:59.920300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fe3c-27ad-4ec7-aa58-b06738476499 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:00:59.934438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30fe3c-27ad-4ec7-aa58-b06738476499 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:00:59.936512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30fe3c-27ad-4ec7-aa58-b06738476499 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:00:59.955900 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3983/8029] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:00:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:00.650574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07751f26-be2a-418c-951c-959818cdf9c0 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:00.652712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-07751f26-be2a-418c-951c-959818cdf9c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:00.822903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07751f26-be2a-418c-951c-959818cdf9c0 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:00.831153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565be45-4aaa-4ead-bfc1-c7c95bc6dab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:00.831786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565be45-4aaa-4ead-bfc1-c7c95bc6dab9 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:00.838708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565be45-4aaa-4ead-bfc1-c7c95bc6dab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:00.839260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565be45-4aaa-4ead-bfc1-c7c95bc6dab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:00.842723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e565be45-4aaa-4ead-bfc1-c7c95bc6dab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:01.004962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565be45-4aaa-4ead-bfc1-c7c95bc6dab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:01.006746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565be45-4aaa-4ead-bfc1-c7c95bc6dab9 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:01.046596 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4047/8030] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:03.562538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30fe3c-27ad-4ec7-aa58-b06738476499 service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:03.565691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1e30fe3c-27ad-4ec7-aa58-b06738476499 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:03.589735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30fe3c-27ad-4ec7-aa58-b06738476499 service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:03.595904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ea668-437c-4c7c-b05a-2ff36cb54e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:03.597253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea668-437c-4c7c-b05a-2ff36cb54e19 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:03.598407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea668-437c-4c7c-b05a-2ff36cb54e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:03.598929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ea668-437c-4c7c-b05a-2ff36cb54e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:03.601335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-921ea668-437c-4c7c-b05a-2ff36cb54e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:03.623178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ea668-437c-4c7c-b05a-2ff36cb54e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:03.627043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ea668-437c-4c7c-b05a-2ff36cb54e19 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:03.661190 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3984/8031] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:04.750420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565be45-4aaa-4ead-bfc1-c7c95bc6dab9 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:04.751944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e565be45-4aaa-4ead-bfc1-c7c95bc6dab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:04.878823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565be45-4aaa-4ead-bfc1-c7c95bc6dab9 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:04.884208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:04.884900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:04.885186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:04.885489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] PATH_INFO: `/v3/users/c74183a342244acab2975d100bd08152` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:04.886693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74183a342244acab2975d100bd08152)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:04.888629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:04.967172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:04.972006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74183a342244acab2975d100bd08152'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:04.974208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74183a342244acab2975d100bd08152'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:05.007118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74183a342244acab2975d100bd08152'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:05.010813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74183a342244acab2975d100bd08152'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:05.026304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74183a342244acab2975d100bd08152'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:05.053911 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4048/8032] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:04 2022] DELETE /identity/v3/users/c74183a342244acab2975d100bd08152 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:05.058570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0842c-c17b-49cd-973d-0bb0105bd050 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:05.059235 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0842c-c17b-49cd-973d-0bb0105bd050 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:05.059630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0842c-c17b-49cd-973d-0bb0105bd050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:05.110930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-41c0842c-c17b-49cd-973d-0bb0105bd050 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:05.112601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-41c0842c-c17b-49cd-973d-0bb0105bd050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:05.249370 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3985/8033] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:05.259083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:05.260558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:05.398263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6bc62-e7ce-4e6b-80a4-74c379e52d6b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:05.402525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae1a4c-88c9-49a2-a267-78b3bc87eba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:05.403760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae1a4c-88c9-49a2-a267-78b3bc87eba6 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:05.404053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae1a4c-88c9-49a2-a267-78b3bc87eba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:05.404330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae1a4c-88c9-49a2-a267-78b3bc87eba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:05.428265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae1a4c-88c9-49a2-a267-78b3bc87eba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:05.429804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae1a4c-88c9-49a2-a267-78b3bc87eba6 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:05.454636 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4049/8034] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:06.077320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0842c-c17b-49cd-973d-0bb0105bd050 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:06.079113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-41c0842c-c17b-49cd-973d-0bb0105bd050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:06.108599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0842c-c17b-49cd-973d-0bb0105bd050 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:06.139209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:06.140999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:06.141381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:06.143600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] PATH_INFO: `/v3/projects/f9c02ec91efa480fb29045cb0fbbabb2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:06.146178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c02ec91efa480fb29045cb0fbbabb2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:06.152370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:06.315605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c02ec91efa480fb29045cb0fbbabb2', 'request_id': 'req-2ad63a76-fb8d-4fcd-8824-1de499f73030'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.333042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c02ec91efa480fb29045cb0fbbabb2', 'request_id': 'req-2ad63a76-fb8d-4fcd-8824-1de499f73030'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.354338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c02ec91efa480fb29045cb0fbbabb2', 'request_id': 'req-2ad63a76-fb8d-4fcd-8824-1de499f73030'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.366228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:06.372920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] The token cache is being invalidate because project f9c02ec91efa480fb29045cb0fbbabb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:06.373760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.374704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.376781 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3986/8035] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:06 2022] DELETE /identity/v3/projects/f9c02ec91efa480fb29045cb0fbbabb2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:06.382202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae1a4c-88c9-49a2-a267-78b3bc87eba6 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:06.396057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae1a4c-88c9-49a2-a267-78b3bc87eba6 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:06.479502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadae57-da92-4c4f-9bae-d819cd6a770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:06.480148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadae57-da92-4c4f-9bae-d819cd6a770d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:06.480433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadae57-da92-4c4f-9bae-d819cd6a770d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:06.480712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadae57-da92-4c4f-9bae-d819cd6a770d admin admin] PATH_INFO: `/v3/users/bc2c46c1d8bf46cd9b51c51f5f9482cf` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:06.482331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadae57-da92-4c4f-9bae-d819cd6a770d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2c46c1d8bf46cd9b51c51f5f9482cf)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:06.484369 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadae57-da92-4c4f-9bae-d819cd6a770d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:06.570507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dfadae57-da92-4c4f-9bae-d819cd6a770d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2c46c1d8bf46cd9b51c51f5f9482cf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.571312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dfadae57-da92-4c4f-9bae-d819cd6a770d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2c46c1d8bf46cd9b51c51f5f9482cf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.586035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dfadae57-da92-4c4f-9bae-d819cd6a770d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2c46c1d8bf46cd9b51c51f5f9482cf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.586794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dfadae57-da92-4c4f-9bae-d819cd6a770d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2c46c1d8bf46cd9b51c51f5f9482cf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.588122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:06.598633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-dfadae57-da92-4c4f-9bae-d819cd6a770d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2c46c1d8bf46cd9b51c51f5f9482cf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:06.615781 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4050/8036] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:06 2022] DELETE /identity/v3/users/bc2c46c1d8bf46cd9b51c51f5f9482cf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:06.973236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:06.975112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:07.002863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad63a76-fb8d-4fcd-8824-1de499f73030 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:07.162167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:07.163528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:07.163975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:07.164408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] PATH_INFO: `/v3/projects/3509b2d49700472ab5adc16ff49e206e` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:07.166370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3509b2d49700472ab5adc16ff49e206e)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:07.168547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:07.227619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3509b2d49700472ab5adc16ff49e206e', 'request_id': 'req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:07.235080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3509b2d49700472ab5adc16ff49e206e', 'request_id': 'req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:07.246350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3509b2d49700472ab5adc16ff49e206e', 'request_id': 'req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:07.272378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] The token cache is being invalidate because project 3509b2d49700472ab5adc16ff49e206e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:07.272678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:07.275949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a2fae1a2-1a66-41a1-975a-fff9bacfe87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:07.279737 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3987/8037] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:06 2022] DELETE /identity/v3/projects/3509b2d49700472ab5adc16ff49e206e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:07.285892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f8d4-8f6f-4f82-acb4-15a3cb68c319 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:07.286803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f8d4-8f6f-4f82-acb4-15a3cb68c319 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:07.287321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f8d4-8f6f-4f82-acb4-15a3cb68c319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:07.332981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0f30f8d4-8f6f-4f82-acb4-15a3cb68c319 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:07.338759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0f30f8d4-8f6f-4f82-acb4-15a3cb68c319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:07.495003 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4051/8038] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:07.504867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d5fa2-26d5-4369-bf18-2731e31509b6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:07.505162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d5fa2-26d5-4369-bf18-2731e31509b6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:07.505468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d5fa2-26d5-4369-bf18-2731e31509b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:07.542946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6e2d5fa2-26d5-4369-bf18-2731e31509b6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:07.545043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6e2d5fa2-26d5-4369-bf18-2731e31509b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:07.553972 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3988/8039] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:07.560265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30f8d4-8f6f-4f82-acb4-15a3cb68c319 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:07.608619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30f8d4-8f6f-4f82-acb4-15a3cb68c319 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:07.614136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03bbad-bd76-4dbf-a9dd-eb5a409d21a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:07.614633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03bbad-bd76-4dbf-a9dd-eb5a409d21a1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:07.615019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03bbad-bd76-4dbf-a9dd-eb5a409d21a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:07.615395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03bbad-bd76-4dbf-a9dd-eb5a409d21a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:07.616169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03bbad-bd76-4dbf-a9dd-eb5a409d21a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:07.616578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03bbad-bd76-4dbf-a9dd-eb5a409d21a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:07.622109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03bbad-bd76-4dbf-a9dd-eb5a409d21a1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:07.638093 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4052/8040] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:01:07.642417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d5fa2-26d5-4369-bf18-2731e31509b6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:07.654031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d5fa2-26d5-4369-bf18-2731e31509b6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:07.660621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d922b0-a01f-4cd0-8e5d-ab579619b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:07.661545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d922b0-a01f-4cd0-8e5d-ab579619b348 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:07.661998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d922b0-a01f-4cd0-8e5d-ab579619b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:07.662446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d922b0-a01f-4cd0-8e5d-ab579619b348 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:07.663843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d922b0-a01f-4cd0-8e5d-ab579619b348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:07.666211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d922b0-a01f-4cd0-8e5d-ab579619b348 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:07.704012 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3989/8041] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:07 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:07.708402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03bbad-bd76-4dbf-a9dd-eb5a409d21a1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:07.719894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03bbad-bd76-4dbf-a9dd-eb5a409d21a1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:07.785892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7bc4a-cf6e-442c-8f38-15cc8a48c392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:07.786665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7bc4a-cf6e-442c-8f38-15cc8a48c392 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:07.787195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7bc4a-cf6e-442c-8f38-15cc8a48c392 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:07.787575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7bc4a-cf6e-442c-8f38-15cc8a48c392 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:07.788355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7bc4a-cf6e-442c-8f38-15cc8a48c392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:07.790769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7bc4a-cf6e-442c-8f38-15cc8a48c392 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:07.822151 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4053/8042] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:07 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:07.823133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d922b0-a01f-4cd0-8e5d-ab579619b348 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:07.838064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d922b0-a01f-4cd0-8e5d-ab579619b348 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:07.845086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a7ef-10e7-4def-b49d-cc48fac0dda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:07.846195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a7ef-10e7-4def-b49d-cc48fac0dda4 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:07.846577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a7ef-10e7-4def-b49d-cc48fac0dda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:07.847036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a7ef-10e7-4def-b49d-cc48fac0dda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:07.847987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a7ef-10e7-4def-b49d-cc48fac0dda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:07.849913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a7ef-10e7-4def-b49d-cc48fac0dda4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:07.868090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7bc4a-cf6e-442c-8f38-15cc8a48c392 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:07.881014 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3990/8043] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:01:07.881889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7bc4a-cf6e-442c-8f38-15cc8a48c392 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:07.887996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b7757-53bd-48c7-b1a6-d774034eec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:07.888896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b7757-53bd-48c7-b1a6-d774034eec3a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:07.889329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b7757-53bd-48c7-b1a6-d774034eec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:07.889736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b7757-53bd-48c7-b1a6-d774034eec3a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:07.890619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b7757-53bd-48c7-b1a6-d774034eec3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:07.892336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b7757-53bd-48c7-b1a6-d774034eec3a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:07.910533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a7ef-10e7-4def-b49d-cc48fac0dda4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:07.918439 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4054/8044] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:07.923369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a7ef-10e7-4def-b49d-cc48fac0dda4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:07.930029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f9770-3ac3-4b26-993c-172a21fe508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:07.930910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f9770-3ac3-4b26-993c-172a21fe508f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:07.931298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f9770-3ac3-4b26-993c-172a21fe508f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:07.931679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f9770-3ac3-4b26-993c-172a21fe508f admin admin] PATH_INFO: `/v3/projects/54d2cb907fd2493ca6fd96b5c56a4bd3/users/e66728dc6900440299b46df152737a7d/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:07.950026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f9770-3ac3-4b26-993c-172a21fe508f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d2cb907fd2493ca6fd96b5c56a4bd3, user_id=e66728dc6900440299b46df152737a7d, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:07.953197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f9770-3ac3-4b26-993c-172a21fe508f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:07.981043 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3991/8045] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:07 2022] PUT /identity/v3/projects/54d2cb907fd2493ca6fd96b5c56a4bd3/users/e66728dc6900440299b46df152737a7d/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:07.982714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a390d-9579-4fe0-bc7f-c3cfb2aec18f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:07.983390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a390d-9579-4fe0-bc7f-c3cfb2aec18f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:07.983829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a390d-9579-4fe0-bc7f-c3cfb2aec18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:08.017150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c26a390d-9579-4fe0-bc7f-c3cfb2aec18f None None] MFA Rules not processed for user `e66728dc6900440299b46df152737a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:08.018820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c26a390d-9579-4fe0-bc7f-c3cfb2aec18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:08.067646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:08.105735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f9770-3ac3-4b26-993c-172a21fe508f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:08.106407 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4055/8046] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:08.158032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:08.210011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f9770-3ac3-4b26-993c-172a21fe508f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:08.216714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fce206-ca66-4246-82af-49723b447041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:08.218057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fce206-ca66-4246-82af-49723b447041 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:08.218558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fce206-ca66-4246-82af-49723b447041 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:08.219056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fce206-ca66-4246-82af-49723b447041 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:08.219891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fce206-ca66-4246-82af-49723b447041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:08.222132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fce206-ca66-4246-82af-49723b447041 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:08.264281 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3992/8047] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:08 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:08.268748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a390d-9579-4fe0-bc7f-c3cfb2aec18f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:08.285435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a390d-9579-4fe0-bc7f-c3cfb2aec18f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:08.360041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fd442-dcb2-4490-be6c-7959e983a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:08.361065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fd442-dcb2-4490-be6c-7959e983a881 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:08.361566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fd442-dcb2-4490-be6c-7959e983a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:08.362159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fd442-dcb2-4490-be6c-7959e983a881 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:08.362956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fd442-dcb2-4490-be6c-7959e983a881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:08.365496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fd442-dcb2-4490-be6c-7959e983a881 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:08.400169 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4056/8048] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:08 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:08.404054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fce206-ca66-4246-82af-49723b447041 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:08.417650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fce206-ca66-4246-82af-49723b447041 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:08.423842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9f849-3b69-4439-97bf-e9f771cabf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:08.424556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9f849-3b69-4439-97bf-e9f771cabf6e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:08.424846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9f849-3b69-4439-97bf-e9f771cabf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:08.425123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9f849-3b69-4439-97bf-e9f771cabf6e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:08.426123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9f849-3b69-4439-97bf-e9f771cabf6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:08.427750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9f849-3b69-4439-97bf-e9f771cabf6e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:08.461884 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3993/8049] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:08.465686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fd442-dcb2-4490-be6c-7959e983a881 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:08.480476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fd442-dcb2-4490-be6c-7959e983a881 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:08.495297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81783dd6-04ce-451e-bbee-3e45d4732f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:08.501610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783dd6-04ce-451e-bbee-3e45d4732f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:08.501610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783dd6-04ce-451e-bbee-3e45d4732f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:08.501610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783dd6-04ce-451e-bbee-3e45d4732f2d admin admin] PATH_INFO: `/v3/projects/18cd5bc6fb5b406d940367b1d6fd0304/users/9dce541da3964fc89101849dff885988/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:08.547843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81783dd6-04ce-451e-bbee-3e45d4732f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cd5bc6fb5b406d940367b1d6fd0304, user_id=9dce541da3964fc89101849dff885988, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:08.550541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81783dd6-04ce-451e-bbee-3e45d4732f2d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:08.582897 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4057/8050] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:08 2022] PUT /identity/v3/projects/18cd5bc6fb5b406d940367b1d6fd0304/users/9dce541da3964fc89101849dff885988/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:01:08.586769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9f849-3b69-4439-97bf-e9f771cabf6e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:08.605585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9f849-3b69-4439-97bf-e9f771cabf6e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:08.740141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c324738-4462-4fe6-9ef2-08313b8d212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:08.740930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324738-4462-4fe6-9ef2-08313b8d212f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:08.741219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324738-4462-4fe6-9ef2-08313b8d212f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:08.741533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324738-4462-4fe6-9ef2-08313b8d212f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:08.742251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c324738-4462-4fe6-9ef2-08313b8d212f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:08.743969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c324738-4462-4fe6-9ef2-08313b8d212f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:08.767175 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3994/8051] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:08.771735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81783dd6-04ce-451e-bbee-3e45d4732f2d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:08.786270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81783dd6-04ce-451e-bbee-3e45d4732f2d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:08.796570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeb218-d343-4cf0-9cb8-58fe9877eb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:08.797339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeb218-d343-4cf0-9cb8-58fe9877eb81 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:08.797747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeb218-d343-4cf0-9cb8-58fe9877eb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:08.798092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeb218-d343-4cf0-9cb8-58fe9877eb81 admin admin] PATH_INFO: `/v3/projects/18cd5bc6fb5b406d940367b1d6fd0304/users/9dce541da3964fc89101849dff885988/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:08.800232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faeb218-d343-4cf0-9cb8-58fe9877eb81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cd5bc6fb5b406d940367b1d6fd0304, user_id=9dce541da3964fc89101849dff885988, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:08.803514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faeb218-d343-4cf0-9cb8-58fe9877eb81 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:08.818447 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4058/8052] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:08 2022] PUT /identity/v3/projects/18cd5bc6fb5b406d940367b1d6fd0304/users/9dce541da3964fc89101849dff885988/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:08.828480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafb51b-30cf-4a17-8136-37c9e3d0ee2d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:08.829000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafb51b-30cf-4a17-8136-37c9e3d0ee2d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:08.829416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafb51b-30cf-4a17-8136-37c9e3d0ee2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:08.889824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3cafb51b-30cf-4a17-8136-37c9e3d0ee2d None None] MFA Rules not processed for user `9dce541da3964fc89101849dff885988`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:08.891333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3cafb51b-30cf-4a17-8136-37c9e3d0ee2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:08.998546 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3995/8053] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:09.014863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeb218-d343-4cf0-9cb8-58fe9877eb81 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:09.023131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9faeb218-d343-4cf0-9cb8-58fe9877eb81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:09.154983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeb218-d343-4cf0-9cb8-58fe9877eb81 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:09.159936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c71a7e-fecf-45bf-a046-97605d93dd2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:09.160596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71a7e-fecf-45bf-a046-97605d93dd2e service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:09.160881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71a7e-fecf-45bf-a046-97605d93dd2e service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:09.161182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71a7e-fecf-45bf-a046-97605d93dd2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:09.195043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c71a7e-fecf-45bf-a046-97605d93dd2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:09.202392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c71a7e-fecf-45bf-a046-97605d93dd2e service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:09.231246 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4059/8054] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:12.179815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafb51b-30cf-4a17-8136-37c9e3d0ee2d None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:12.219782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:12.285551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafb51b-30cf-4a17-8136-37c9e3d0ee2d None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:12.293148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:12.294181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:12.294650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:12.295243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] PATH_INFO: `/v3/users/e66728dc6900440299b46df152737a7d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:12.296596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66728dc6900440299b46df152737a7d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:12.299964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:12.385159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66728dc6900440299b46df152737a7d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:12.385952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66728dc6900440299b46df152737a7d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:12.417572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66728dc6900440299b46df152737a7d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:12.440257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66728dc6900440299b46df152737a7d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:12.458390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66728dc6900440299b46df152737a7d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:12.465489 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3996/8055] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:12 2022] DELETE /identity/v3/users/e66728dc6900440299b46df152737a7d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:12.470900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945d22d-5efb-42dd-89f9-a633383242a7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:12.471493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945d22d-5efb-42dd-89f9-a633383242a7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:12.471493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945d22d-5efb-42dd-89f9-a633383242a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:12.524493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e945d22d-5efb-42dd-89f9-a633383242a7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:12.526333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e945d22d-5efb-42dd-89f9-a633383242a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:12.591726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:12.638681 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4060/8056] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:12.645134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:12.647285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:12.750642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c0b1e-ddd5-4938-8ad0-f0dd5a275e2f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:12.756125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ec5a3-e058-4e14-b114-38185ad2db36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:12.757155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ec5a3-e058-4e14-b114-38185ad2db36 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:12.757481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ec5a3-e058-4e14-b114-38185ad2db36 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:12.757765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ec5a3-e058-4e14-b114-38185ad2db36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:12.799384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ec5a3-e058-4e14-b114-38185ad2db36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:12.801973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ec5a3-e058-4e14-b114-38185ad2db36 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:12.815641 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3997/8057] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:13.476788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945d22d-5efb-42dd-89f9-a633383242a7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:13.478947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e945d22d-5efb-42dd-89f9-a633383242a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:13.509930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945d22d-5efb-42dd-89f9-a633383242a7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:13.517503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:13.518726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:13.520271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:13.521191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] PATH_INFO: `/v3/projects/54d2cb907fd2493ca6fd96b5c56a4bd3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:13.523139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d2cb907fd2493ca6fd96b5c56a4bd3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:13.526274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:13.693250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d2cb907fd2493ca6fd96b5c56a4bd3', 'request_id': 'req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:13.727938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d2cb907fd2493ca6fd96b5c56a4bd3', 'request_id': 'req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:13.765187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d2cb907fd2493ca6fd96b5c56a4bd3', 'request_id': 'req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:13.793326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] The token cache is being invalidate because project 54d2cb907fd2493ca6fd96b5c56a4bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:13.793904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:13.796098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:13.801770 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4061/8058] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:13 2022] DELETE /identity/v3/projects/54d2cb907fd2493ca6fd96b5c56a4bd3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:13.803585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ec5a3-e058-4e14-b114-38185ad2db36 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:13.828879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ec5a3-e058-4e14-b114-38185ad2db36 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:13.905511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:13.956557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad15d6-c5e4-4e7f-98f2-0e3801fa3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:13.957789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad15d6-c5e4-4e7f-98f2-0e3801fa3551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:13.958080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad15d6-c5e4-4e7f-98f2-0e3801fa3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:13.967881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad15d6-c5e4-4e7f-98f2-0e3801fa3551 admin admin] PATH_INFO: `/v3/users/9dce541da3964fc89101849dff885988` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:13.969711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad15d6-c5e4-4e7f-98f2-0e3801fa3551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dce541da3964fc89101849dff885988)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:13.978315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad15d6-c5e4-4e7f-98f2-0e3801fa3551 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:14.049621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4bad15d6-c5e4-4e7f-98f2-0e3801fa3551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dce541da3964fc89101849dff885988'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.051386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4bad15d6-c5e4-4e7f-98f2-0e3801fa3551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dce541da3964fc89101849dff885988'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.067159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4bad15d6-c5e4-4e7f-98f2-0e3801fa3551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dce541da3964fc89101849dff885988'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.077890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4bad15d6-c5e4-4e7f-98f2-0e3801fa3551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dce541da3964fc89101849dff885988'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.087491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4bad15d6-c5e4-4e7f-98f2-0e3801fa3551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dce541da3964fc89101849dff885988'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.099123 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3998/8059] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:13 2022] DELETE /identity/v3/users/9dce541da3964fc89101849dff885988 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:14.380785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:14.382379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:14.402902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf3bbd-4eb7-4dee-8585-bdf42418e3ac admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:14.558888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:14.559645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:14.559993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:14.560331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] PATH_INFO: `/v3/projects/18cd5bc6fb5b406d940367b1d6fd0304` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:14.561581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18cd5bc6fb5b406d940367b1d6fd0304)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:14.563582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:14.652839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18cd5bc6fb5b406d940367b1d6fd0304', 'request_id': 'req-45e36322-cecb-436d-ab03-18db41207803'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.660077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18cd5bc6fb5b406d940367b1d6fd0304', 'request_id': 'req-45e36322-cecb-436d-ab03-18db41207803'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.664897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:14.673925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18cd5bc6fb5b406d940367b1d6fd0304', 'request_id': 'req-45e36322-cecb-436d-ab03-18db41207803'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.707398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] The token cache is being invalidate because project 18cd5bc6fb5b406d940367b1d6fd0304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:14.707969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.708655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-45e36322-cecb-436d-ab03-18db41207803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:14.710782 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4062/8060] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:14 2022] DELETE /identity/v3/projects/18cd5bc6fb5b406d940367b1d6fd0304 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:14.724718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc75bdc-372e-4b9d-9943-c0a33e907c34 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:14.725233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc75bdc-372e-4b9d-9943-c0a33e907c34 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:14.730089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc75bdc-372e-4b9d-9943-c0a33e907c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:14.787769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2bc75bdc-372e-4b9d-9943-c0a33e907c34 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:14.792202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2bc75bdc-372e-4b9d-9943-c0a33e907c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:14.929488 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 3999/8061] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:14.936746 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a72f-1c3a-4a5c-94db-13466cb5e233 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:14.937036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a72f-1c3a-4a5c-94db-13466cb5e233 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:14.937315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a72f-1c3a-4a5c-94db-13466cb5e233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:14.981517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-89b4a72f-1c3a-4a5c-94db-13466cb5e233 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:14.997750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-89b4a72f-1c3a-4a5c-94db-13466cb5e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:15.016367 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4063/8062] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:15.022910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc75bdc-372e-4b9d-9943-c0a33e907c34 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.039019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc75bdc-372e-4b9d-9943-c0a33e907c34 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.045142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db68d6-921b-426e-bb0a-06a7ab86a70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.046040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db68d6-921b-426e-bb0a-06a7ab86a70d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.046324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db68d6-921b-426e-bb0a-06a7ab86a70d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.046599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db68d6-921b-426e-bb0a-06a7ab86a70d admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.047254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db68d6-921b-426e-bb0a-06a7ab86a70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:15.047557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db68d6-921b-426e-bb0a-06a7ab86a70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.049181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db68d6-921b-426e-bb0a-06a7ab86a70d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.065668 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4000/8063] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:01:15.070777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4a72f-1c3a-4a5c-94db-13466cb5e233 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.087088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4a72f-1c3a-4a5c-94db-13466cb5e233 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.094542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2a942-2a6f-4cbb-9317-907202cd8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.095893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a942-2a6f-4cbb-9317-907202cd8c40 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.096404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a942-2a6f-4cbb-9317-907202cd8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.098134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a942-2a6f-4cbb-9317-907202cd8c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.099128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2a942-2a6f-4cbb-9317-907202cd8c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.101344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2a942-2a6f-4cbb-9317-907202cd8c40 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.140337 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4064/8064] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:15 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:01:15.141925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db68d6-921b-426e-bb0a-06a7ab86a70d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.153626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db68d6-921b-426e-bb0a-06a7ab86a70d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.218443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:15.254715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f57db-d24b-47bc-90f4-4a2bacd24f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.255361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f57db-d24b-47bc-90f4-4a2bacd24f92 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.255741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f57db-d24b-47bc-90f4-4a2bacd24f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.256021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f57db-d24b-47bc-90f4-4a2bacd24f92 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.256776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f57db-d24b-47bc-90f4-4a2bacd24f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.259243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f57db-d24b-47bc-90f4-4a2bacd24f92 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.295415 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4001/8065] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:15 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:01:15.301868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2a942-2a6f-4cbb-9317-907202cd8c40 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.321981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2a942-2a6f-4cbb-9317-907202cd8c40 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.328573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61216a72-804d-4d71-b28c-128a05045969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.329452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216a72-804d-4d71-b28c-128a05045969 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.330079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216a72-804d-4d71-b28c-128a05045969 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.330234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216a72-804d-4d71-b28c-128a05045969 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.331015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61216a72-804d-4d71-b28c-128a05045969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.334471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61216a72-804d-4d71-b28c-128a05045969 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.350810 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4065/8066] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:15.354693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f57db-d24b-47bc-90f4-4a2bacd24f92 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.369437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f57db-d24b-47bc-90f4-4a2bacd24f92 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.377700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3833d53-2cd2-473a-bf7e-919a36787356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.379176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833d53-2cd2-473a-bf7e-919a36787356 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.379712 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833d53-2cd2-473a-bf7e-919a36787356 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.380194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833d53-2cd2-473a-bf7e-919a36787356 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.381421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3833d53-2cd2-473a-bf7e-919a36787356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.384260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3833d53-2cd2-473a-bf7e-919a36787356 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.399723 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4002/8067] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:15.404039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61216a72-804d-4d71-b28c-128a05045969 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.420773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61216a72-804d-4d71-b28c-128a05045969 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.428866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730ddba-df9e-4c75-a219-e7c0889f17c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.429591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730ddba-df9e-4c75-a219-e7c0889f17c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.429897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730ddba-df9e-4c75-a219-e7c0889f17c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.430181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730ddba-df9e-4c75-a219-e7c0889f17c9 admin admin] PATH_INFO: `/v3/projects/b2009dd3abc44fe28538427fa2868753/users/3e1f58ab8da541bd975e4d5c60430e23/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.448292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730ddba-df9e-4c75-a219-e7c0889f17c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2009dd3abc44fe28538427fa2868753, user_id=3e1f58ab8da541bd975e4d5c60430e23, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.452479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730ddba-df9e-4c75-a219-e7c0889f17c9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.478482 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4066/8068] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:15 2022] PUT /identity/v3/projects/b2009dd3abc44fe28538427fa2868753/users/3e1f58ab8da541bd975e4d5c60430e23/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:15.488739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237a3a4-45dd-4435-ba55-6b53d1f3ca5a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.489118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237a3a4-45dd-4435-ba55-6b53d1f3ca5a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.489335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237a3a4-45dd-4435-ba55-6b53d1f3ca5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.525070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6237a3a4-45dd-4435-ba55-6b53d1f3ca5a None None] MFA Rules not processed for user `3e1f58ab8da541bd975e4d5c60430e23`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:15.526323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6237a3a4-45dd-4435-ba55-6b53d1f3ca5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:15.605381 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4003/8069] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:15.617205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730ddba-df9e-4c75-a219-e7c0889f17c9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:15.619139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c730ddba-df9e-4c75-a219-e7c0889f17c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:15.694455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730ddba-df9e-4c75-a219-e7c0889f17c9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:15.699449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fbd6f-4f3a-4a84-9b15-34c7404f2b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:15.700267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fbd6f-4f3a-4a84-9b15-34c7404f2b1b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:15.700552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fbd6f-4f3a-4a84-9b15-34c7404f2b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:15.700829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fbd6f-4f3a-4a84-9b15-34c7404f2b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:15.715808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fbd6f-4f3a-4a84-9b15-34c7404f2b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:15.717322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fbd6f-4f3a-4a84-9b15-34c7404f2b1b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:15.729237 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4067/8070] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:21.695762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237a3a4-45dd-4435-ba55-6b53d1f3ca5a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:21.697772 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6237a3a4-45dd-4435-ba55-6b53d1f3ca5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:21.874314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237a3a4-45dd-4435-ba55-6b53d1f3ca5a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:21.880548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:21.881547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:21.882035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:21.882514 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] PATH_INFO: `/v3/users/0100fe6fc53b4d7ba5b2746bb4130a5b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:21.884536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0100fe6fc53b4d7ba5b2746bb4130a5b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:21.887728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:21.985034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0100fe6fc53b4d7ba5b2746bb4130a5b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:21.986187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0100fe6fc53b4d7ba5b2746bb4130a5b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:22.046117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:22.052013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0100fe6fc53b4d7ba5b2746bb4130a5b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:22.070026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0100fe6fc53b4d7ba5b2746bb4130a5b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:22.079576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0100fe6fc53b4d7ba5b2746bb4130a5b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:22.089646 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4004/8071] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:21 2022] DELETE /identity/v3/users/0100fe6fc53b4d7ba5b2746bb4130a5b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:22.094079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b681-eba1-4663-8bab-9d75d59cfd0c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:22.095043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b681-eba1-4663-8bab-9d75d59cfd0c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:22.095820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78b681-eba1-4663-8bab-9d75d59cfd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:22.121989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9d78b681-eba1-4663-8bab-9d75d59cfd0c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:22.123611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9d78b681-eba1-4663-8bab-9d75d59cfd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:22.250650 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4068/8072] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:22.264152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:22.266575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:22.398944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e50a4-0d99-4276-a570-81563aebb15d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:22.416291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227dbdb-9575-48ac-9691-10d1a486985a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:22.416968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227dbdb-9575-48ac-9691-10d1a486985a service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:22.417256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227dbdb-9575-48ac-9691-10d1a486985a service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:22.417585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227dbdb-9575-48ac-9691-10d1a486985a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:22.452518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227dbdb-9575-48ac-9691-10d1a486985a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:22.454111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227dbdb-9575-48ac-9691-10d1a486985a service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:22.466686 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4005/8073] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:23.007666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78b681-eba1-4663-8bab-9d75d59cfd0c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:23.010814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9d78b681-eba1-4663-8bab-9d75d59cfd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:23.040849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78b681-eba1-4663-8bab-9d75d59cfd0c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:23.058218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:23.063958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:23.064393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:23.064903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] PATH_INFO: `/v3/projects/c4fb584a03fa4dc2bd773656055ef3a3` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:23.067578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fb584a03fa4dc2bd773656055ef3a3)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:23.076203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:23.145342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:23.202775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fb584a03fa4dc2bd773656055ef3a3', 'request_id': 'req-68c9da05-e5c7-4d90-92ac-cd47747d72a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:23.211641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fb584a03fa4dc2bd773656055ef3a3', 'request_id': 'req-68c9da05-e5c7-4d90-92ac-cd47747d72a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:23.223605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fb584a03fa4dc2bd773656055ef3a3', 'request_id': 'req-68c9da05-e5c7-4d90-92ac-cd47747d72a4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:23.242638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] The token cache is being invalidate because project c4fb584a03fa4dc2bd773656055ef3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:23.242973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:23.244040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:23.248749 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4069/8074] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:23 2022] DELETE /identity/v3/projects/c4fb584a03fa4dc2bd773656055ef3a3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:23.250637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227dbdb-9575-48ac-9691-10d1a486985a service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:23.266642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227dbdb-9575-48ac-9691-10d1a486985a service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:23.369022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c386c36-08c4-4da2-8e5f-55947348b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:23.369956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c386c36-08c4-4da2-8e5f-55947348b7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:23.370301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c386c36-08c4-4da2-8e5f-55947348b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:23.370672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c386c36-08c4-4da2-8e5f-55947348b7c9 admin admin] PATH_INFO: `/v3/users/df957a27e33947d898a8f65ac5a4d528` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:23.372302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c386c36-08c4-4da2-8e5f-55947348b7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df957a27e33947d898a8f65ac5a4d528)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:23.375080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c386c36-08c4-4da2-8e5f-55947348b7c9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:23.473079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c386c36-08c4-4da2-8e5f-55947348b7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df957a27e33947d898a8f65ac5a4d528'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:23.473893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c386c36-08c4-4da2-8e5f-55947348b7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df957a27e33947d898a8f65ac5a4d528'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:23.507537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c386c36-08c4-4da2-8e5f-55947348b7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df957a27e33947d898a8f65ac5a4d528'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:23.524778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c386c36-08c4-4da2-8e5f-55947348b7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df957a27e33947d898a8f65ac5a4d528'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:23.561895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3c386c36-08c4-4da2-8e5f-55947348b7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df957a27e33947d898a8f65ac5a4d528'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:23.567745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:23.578314 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4006/8075] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:23 2022] DELETE /identity/v3/users/df957a27e33947d898a8f65ac5a4d528 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:24.362101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:24.364355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:24.390261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9da05-e5c7-4d90-92ac-cd47747d72a4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:24.577076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:24.577762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:24.578045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:24.578320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] PATH_INFO: `/v3/projects/d7ac674e435647b5ab3fea718786cef0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:24.579695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ac674e435647b5ab3fea718786cef0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:24.582165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:24.682593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ac674e435647b5ab3fea718786cef0', 'request_id': 'req-d387564b-e246-43b9-ad42-e82e34ced2b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:24.695385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ac674e435647b5ab3fea718786cef0', 'request_id': 'req-d387564b-e246-43b9-ad42-e82e34ced2b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:24.721962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ac674e435647b5ab3fea718786cef0', 'request_id': 'req-d387564b-e246-43b9-ad42-e82e34ced2b5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:24.748793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] The token cache is being invalidate because project d7ac674e435647b5ab3fea718786cef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:24.749180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:24.751320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d387564b-e246-43b9-ad42-e82e34ced2b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:24.755140 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4070/8076] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:24 2022] DELETE /identity/v3/projects/d7ac674e435647b5ab3fea718786cef0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:24.760268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563cea-72ef-499b-b60d-2dd4a3f764ab None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:24.760754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563cea-72ef-499b-b60d-2dd4a3f764ab None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:24.761007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563cea-72ef-499b-b60d-2dd4a3f764ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:24.793757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b2563cea-72ef-499b-b60d-2dd4a3f764ab None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:24.795259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b2563cea-72ef-499b-b60d-2dd4a3f764ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:24.907871 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4007/8077] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:24.914990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ca0fd-bb6d-4d27-8101-a62fe2c154ab None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:24.915413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ca0fd-bb6d-4d27-8101-a62fe2c154ab None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:24.915812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ca0fd-bb6d-4d27-8101-a62fe2c154ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:24.947955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-912ca0fd-bb6d-4d27-8101-a62fe2c154ab None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:24.949331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-912ca0fd-bb6d-4d27-8101-a62fe2c154ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:24.968745 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4071/8078] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:24.973379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2563cea-72ef-499b-b60d-2dd4a3f764ab None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:24.986754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2563cea-72ef-499b-b60d-2dd4a3f764ab None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:25.002824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36d31c-09ea-4457-8fd5-473dfc351751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:25.003758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d31c-09ea-4457-8fd5-473dfc351751 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:25.005240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d31c-09ea-4457-8fd5-473dfc351751 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:25.005713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d31c-09ea-4457-8fd5-473dfc351751 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:25.022217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36d31c-09ea-4457-8fd5-473dfc351751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:25.023186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36d31c-09ea-4457-8fd5-473dfc351751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:25.027808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36d31c-09ea-4457-8fd5-473dfc351751 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:25.084569 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4008/8079] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:01:25.088937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ca0fd-bb6d-4d27-8101-a62fe2c154ab None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:25.110064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ca0fd-bb6d-4d27-8101-a62fe2c154ab None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:25.121877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb164d3-b91a-4b17-a99d-1b902fe44db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:25.122503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb164d3-b91a-4b17-a99d-1b902fe44db7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:25.122785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb164d3-b91a-4b17-a99d-1b902fe44db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:25.123064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb164d3-b91a-4b17-a99d-1b902fe44db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:25.123708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb164d3-b91a-4b17-a99d-1b902fe44db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:25.125727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb164d3-b91a-4b17-a99d-1b902fe44db7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:25.197015 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4072/8080] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:25 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:25.201075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36d31c-09ea-4457-8fd5-473dfc351751 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:25.223421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36d31c-09ea-4457-8fd5-473dfc351751 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:25.371214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a8c67-4df8-4936-adfd-859405c4c6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:25.372257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a8c67-4df8-4936-adfd-859405c4c6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:25.372850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a8c67-4df8-4936-adfd-859405c4c6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:25.373456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a8c67-4df8-4936-adfd-859405c4c6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:25.379552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a8c67-4df8-4936-adfd-859405c4c6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:25.381771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a8c67-4df8-4936-adfd-859405c4c6c3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:25.432468 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4009/8081] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:25 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:25.436010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb164d3-b91a-4b17-a99d-1b902fe44db7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:25.462762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb164d3-b91a-4b17-a99d-1b902fe44db7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:25.476517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda3cd8-5b18-404e-8e30-662701cb0b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:25.478881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3cd8-5b18-404e-8e30-662701cb0b23 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:25.480105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3cd8-5b18-404e-8e30-662701cb0b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:25.480477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3cd8-5b18-404e-8e30-662701cb0b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:25.482690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda3cd8-5b18-404e-8e30-662701cb0b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:25.486610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda3cd8-5b18-404e-8e30-662701cb0b23 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:25.493852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:25.506004 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4073/8082] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:25.506695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a8c67-4df8-4936-adfd-859405c4c6c3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:25.522585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a8c67-4df8-4936-adfd-859405c4c6c3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:25.528540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87265060-72b6-4002-844c-d3c5e37a33d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:25.529259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265060-72b6-4002-844c-d3c5e37a33d4 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:25.529962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265060-72b6-4002-844c-d3c5e37a33d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:25.530377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265060-72b6-4002-844c-d3c5e37a33d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:25.531120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87265060-72b6-4002-844c-d3c5e37a33d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:25.532874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87265060-72b6-4002-844c-d3c5e37a33d4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:25.554786 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4010/8083] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:25.556108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda3cd8-5b18-404e-8e30-662701cb0b23 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:25.570656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda3cd8-5b18-404e-8e30-662701cb0b23 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:25.576234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b6d9e-ea81-4b00-bbd2-2ad38fd9aede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:25.577545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b6d9e-ea81-4b00-bbd2-2ad38fd9aede admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:25.578316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b6d9e-ea81-4b00-bbd2-2ad38fd9aede admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:25.578922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b6d9e-ea81-4b00-bbd2-2ad38fd9aede admin admin] PATH_INFO: `/v3/projects/ac249d1789a44313b5a5036e450c9d28/users/62aba6589e72490d870b62c294c18441/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:25.623835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b6d9e-ea81-4b00-bbd2-2ad38fd9aede admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac249d1789a44313b5a5036e450c9d28, user_id=62aba6589e72490d870b62c294c18441, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:25.632420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b6d9e-ea81-4b00-bbd2-2ad38fd9aede admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:25.660914 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4074/8084] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:25 2022] PUT /identity/v3/projects/ac249d1789a44313b5a5036e450c9d28/users/62aba6589e72490d870b62c294c18441/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:25.676183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db353-32d0-481f-89ec-3c6e9218138f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:25.676403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db353-32d0-481f-89ec-3c6e9218138f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:25.676833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db353-32d0-481f-89ec-3c6e9218138f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:25.749431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-359db353-32d0-481f-89ec-3c6e9218138f None None] MFA Rules not processed for user `62aba6589e72490d870b62c294c18441`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:25.749431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-359db353-32d0-481f-89ec-3c6e9218138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:25.899882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:25.917266 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4011/8085] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:25.918965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b6d9e-ea81-4b00-bbd2-2ad38fd9aede admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:26.088088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b6d9e-ea81-4b00-bbd2-2ad38fd9aede admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:26.102825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2dd95-8731-42a4-8c4b-1713b7c98aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:26.103758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2dd95-8731-42a4-8c4b-1713b7c98aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:26.104267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2dd95-8731-42a4-8c4b-1713b7c98aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:26.104795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2dd95-8731-42a4-8c4b-1713b7c98aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:26.105683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2dd95-8731-42a4-8c4b-1713b7c98aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:26.108112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2dd95-8731-42a4-8c4b-1713b7c98aa5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:26.165138 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4075/8086] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:25 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:26.165820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359db353-32d0-481f-89ec-3c6e9218138f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:26.187840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359db353-32d0-481f-89ec-3c6e9218138f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:26.361938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecde92-b50d-4ff2-8fda-9dd74fbc8123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:26.363795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecde92-b50d-4ff2-8fda-9dd74fbc8123 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:26.365339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecde92-b50d-4ff2-8fda-9dd74fbc8123 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:26.365776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecde92-b50d-4ff2-8fda-9dd74fbc8123 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:26.368074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecde92-b50d-4ff2-8fda-9dd74fbc8123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:26.370379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecde92-b50d-4ff2-8fda-9dd74fbc8123 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:26.405887 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4012/8087] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:26 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:01:26.410154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2dd95-8731-42a4-8c4b-1713b7c98aa5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:26.421647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2dd95-8731-42a4-8c4b-1713b7c98aa5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:26.429248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4023f-6db0-41e1-bbe9-0be8dea1b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:26.430077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4023f-6db0-41e1-bbe9-0be8dea1b60e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:26.430384 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4023f-6db0-41e1-bbe9-0be8dea1b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:26.430772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4023f-6db0-41e1-bbe9-0be8dea1b60e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:26.431454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4023f-6db0-41e1-bbe9-0be8dea1b60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:26.433087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4023f-6db0-41e1-bbe9-0be8dea1b60e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:26.445612 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4076/8088] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:01:26.449945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecde92-b50d-4ff2-8fda-9dd74fbc8123 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:26.463525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecde92-b50d-4ff2-8fda-9dd74fbc8123 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:26.470414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caadd9-bdf6-4b15-ad80-2cea2a58885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:26.471522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caadd9-bdf6-4b15-ad80-2cea2a58885d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:26.472995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caadd9-bdf6-4b15-ad80-2cea2a58885d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:26.473528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caadd9-bdf6-4b15-ad80-2cea2a58885d admin admin] PATH_INFO: `/v3/projects/7e8f560b3d0b4842a5d65ae190b33db5/users/d2cd9a08ced64f38ac84138a1da6592c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:26.498172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8caadd9-bdf6-4b15-ad80-2cea2a58885d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8f560b3d0b4842a5d65ae190b33db5, user_id=d2cd9a08ced64f38ac84138a1da6592c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:26.501559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8caadd9-bdf6-4b15-ad80-2cea2a58885d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:26.526949 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4013/8089] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:26 2022] PUT /identity/v3/projects/7e8f560b3d0b4842a5d65ae190b33db5/users/d2cd9a08ced64f38ac84138a1da6592c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:26.528278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4023f-6db0-41e1-bbe9-0be8dea1b60e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:26.543840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4023f-6db0-41e1-bbe9-0be8dea1b60e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:26.652575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb83cd5-bb14-4c23-b032-e9f1249839eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:26.653161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83cd5-bb14-4c23-b032-e9f1249839eb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:26.653561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83cd5-bb14-4c23-b032-e9f1249839eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:26.653946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb83cd5-bb14-4c23-b032-e9f1249839eb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:26.654670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb83cd5-bb14-4c23-b032-e9f1249839eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:26.657715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb83cd5-bb14-4c23-b032-e9f1249839eb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:26.676596 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4077/8090] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:26.678133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caadd9-bdf6-4b15-ad80-2cea2a58885d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:26.694696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caadd9-bdf6-4b15-ad80-2cea2a58885d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:26.700424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6f3bb-155f-4e11-bfd6-11f0a9445b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:26.701120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6f3bb-155f-4e11-bfd6-11f0a9445b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:26.701416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6f3bb-155f-4e11-bfd6-11f0a9445b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:26.701906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6f3bb-155f-4e11-bfd6-11f0a9445b45 admin admin] PATH_INFO: `/v3/projects/7e8f560b3d0b4842a5d65ae190b33db5/users/d2cd9a08ced64f38ac84138a1da6592c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:26.704330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6f3bb-155f-4e11-bfd6-11f0a9445b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8f560b3d0b4842a5d65ae190b33db5, user_id=d2cd9a08ced64f38ac84138a1da6592c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:26.710134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6f3bb-155f-4e11-bfd6-11f0a9445b45 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:26.733235 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4014/8091] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:26 2022] PUT /identity/v3/projects/7e8f560b3d0b4842a5d65ae190b33db5/users/d2cd9a08ced64f38ac84138a1da6592c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:26.736218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbca8b-a431-4450-9371-de62e69a0c1d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:26.736502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbca8b-a431-4450-9371-de62e69a0c1d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:26.736782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbca8b-a431-4450-9371-de62e69a0c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:26.809997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6ecbca8b-a431-4450-9371-de62e69a0c1d None None] MFA Rules not processed for user `d2cd9a08ced64f38ac84138a1da6592c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:26.811222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6ecbca8b-a431-4450-9371-de62e69a0c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:26.897638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:26.980613 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4078/8092] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:26.994058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6f3bb-155f-4e11-bfd6-11f0a9445b45 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:26.996610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f2a6f3bb-155f-4e11-bfd6-11f0a9445b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:27.122649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6f3bb-155f-4e11-bfd6-11f0a9445b45 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:27.136879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc536ae4-c65e-43d3-8e19-d681ecf0b4d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:27.137561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536ae4-c65e-43d3-8e19-d681ecf0b4d7 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:27.137847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536ae4-c65e-43d3-8e19-d681ecf0b4d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:27.138125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536ae4-c65e-43d3-8e19-d681ecf0b4d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:27.156343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc536ae4-c65e-43d3-8e19-d681ecf0b4d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:27.158078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc536ae4-c65e-43d3-8e19-d681ecf0b4d7 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:27.180999 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4015/8093] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:27.329079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbca8b-a431-4450-9371-de62e69a0c1d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:27.351403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbca8b-a431-4450-9371-de62e69a0c1d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:27.360525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87e9c0-7455-4045-a0cc-50b6c1e14954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:27.361590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87e9c0-7455-4045-a0cc-50b6c1e14954 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:27.363761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87e9c0-7455-4045-a0cc-50b6c1e14954 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:27.364316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87e9c0-7455-4045-a0cc-50b6c1e14954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:27.454402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87e9c0-7455-4045-a0cc-50b6c1e14954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:27.458226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87e9c0-7455-4045-a0cc-50b6c1e14954 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:27.484729 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4079/8094] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:31.198854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc536ae4-c65e-43d3-8e19-d681ecf0b4d7 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:31.200351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dc536ae4-c65e-43d3-8e19-d681ecf0b4d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:31.375349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:31.401672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc536ae4-c65e-43d3-8e19-d681ecf0b4d7 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:31.408105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:31.409381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:31.409999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:31.411450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] PATH_INFO: `/v3/users/91a5d0ec125549d2a92d7e6ba0bf8d00` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:31.413120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a5d0ec125549d2a92d7e6ba0bf8d00)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:31.415687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:31.529324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a5d0ec125549d2a92d7e6ba0bf8d00'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:31.530281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a5d0ec125549d2a92d7e6ba0bf8d00'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:31.562900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a5d0ec125549d2a92d7e6ba0bf8d00'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:31.573120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a5d0ec125549d2a92d7e6ba0bf8d00'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:31.612535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a5d0ec125549d2a92d7e6ba0bf8d00'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:31.637263 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4016/8095] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:31 2022] DELETE /identity/v3/users/91a5d0ec125549d2a92d7e6ba0bf8d00 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:31.642010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4442db-05cf-4c1c-bd92-5cf7cb282bdb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:31.642653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4442db-05cf-4c1c-bd92-5cf7cb282bdb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:31.642653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4442db-05cf-4c1c-bd92-5cf7cb282bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:31.692036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8f4442db-05cf-4c1c-bd92-5cf7cb282bdb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:31.693763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8f4442db-05cf-4c1c-bd92-5cf7cb282bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:31.771986 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4080/8096] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:31.782160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:31.784296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:31.911023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350a35b-bd73-4d1a-82d2-edf06991100e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:31.920026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979a382-8ca1-4418-b9f3-d6f1dba3c852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:31.920790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979a382-8ca1-4418-b9f3-d6f1dba3c852 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:31.921848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979a382-8ca1-4418-b9f3-d6f1dba3c852 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:31.922248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979a382-8ca1-4418-b9f3-d6f1dba3c852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:31.944674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979a382-8ca1-4418-b9f3-d6f1dba3c852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:31.948369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979a382-8ca1-4418-b9f3-d6f1dba3c852 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:31.970303 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4017/8097] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:33.286094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4442db-05cf-4c1c-bd92-5cf7cb282bdb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:33.288776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8f4442db-05cf-4c1c-bd92-5cf7cb282bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:33.318083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4442db-05cf-4c1c-bd92-5cf7cb282bdb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:33.334154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:33.334880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:33.335952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:33.336662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] PATH_INFO: `/v3/projects/1bbbe73321744650a59bd53052001d54` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:33.339204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bbbe73321744650a59bd53052001d54)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:33.341375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:33.441482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bbbe73321744650a59bd53052001d54', 'request_id': 'req-0ec9b6e7-25b6-4125-b152-4651c2988f3a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.461340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bbbe73321744650a59bd53052001d54', 'request_id': 'req-0ec9b6e7-25b6-4125-b152-4651c2988f3a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.472921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bbbe73321744650a59bd53052001d54', 'request_id': 'req-0ec9b6e7-25b6-4125-b152-4651c2988f3a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.480976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:33.490360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979a382-8ca1-4418-b9f3-d6f1dba3c852 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:33.498083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d979a382-8ca1-4418-b9f3-d6f1dba3c852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:33.524848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] The token cache is being invalidate because project 1bbbe73321744650a59bd53052001d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:33.525627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.527024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0ec9b6e7-25b6-4125-b152-4651c2988f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.532192 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4081/8098] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:33 2022] DELETE /identity/v3/projects/1bbbe73321744650a59bd53052001d54 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:33.542081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053624-ba6f-4930-bc4f-0621cdaf601a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:33.542081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053624-ba6f-4930-bc4f-0621cdaf601a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:33.542081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053624-ba6f-4930-bc4f-0621cdaf601a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:33.561257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979a382-8ca1-4418-b9f3-d6f1dba3c852 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:33.573893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b6053624-ba6f-4930-bc4f-0621cdaf601a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:33.576102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b6053624-ba6f-4930-bc4f-0621cdaf601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:33.670993 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4082/8099] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:33.676418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b235221-1f92-4012-a6a7-1ea61097e9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:33.677252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235221-1f92-4012-a6a7-1ea61097e9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:33.677917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235221-1f92-4012-a6a7-1ea61097e9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:33.678304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235221-1f92-4012-a6a7-1ea61097e9e4 admin admin] PATH_INFO: `/v3/users/3e1f58ab8da541bd975e4d5c60430e23` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:33.679606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b235221-1f92-4012-a6a7-1ea61097e9e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1f58ab8da541bd975e4d5c60430e23)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:33.680524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760c7ee-d54e-4e2e-9ecb-52625ce6400a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:33.680832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760c7ee-d54e-4e2e-9ecb-52625ce6400a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:33.681111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760c7ee-d54e-4e2e-9ecb-52625ce6400a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:33.682790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b235221-1f92-4012-a6a7-1ea61097e9e4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:33.699883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:33.704049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e760c7ee-d54e-4e2e-9ecb-52625ce6400a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:33.705380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e760c7ee-d54e-4e2e-9ecb-52625ce6400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:33.719321 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4083/8100] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:33.725013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760c7ee-d54e-4e2e-9ecb-52625ce6400a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:33.739588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760c7ee-d54e-4e2e-9ecb-52625ce6400a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:33.746984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d265013-41af-446b-aaf8-efeee5587b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:33.747758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265013-41af-446b-aaf8-efeee5587b55 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:33.748106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265013-41af-446b-aaf8-efeee5587b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:33.748442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265013-41af-446b-aaf8-efeee5587b55 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:33.749749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d265013-41af-446b-aaf8-efeee5587b55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:33.750122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d265013-41af-446b-aaf8-efeee5587b55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:33.752095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d265013-41af-446b-aaf8-efeee5587b55 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:33.778771 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4084/8101] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:01:33.785259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7b235221-1f92-4012-a6a7-1ea61097e9e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1f58ab8da541bd975e4d5c60430e23'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.785936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d265013-41af-446b-aaf8-efeee5587b55 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:33.786836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7b235221-1f92-4012-a6a7-1ea61097e9e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1f58ab8da541bd975e4d5c60430e23'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.807227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d265013-41af-446b-aaf8-efeee5587b55 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:33.812959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50084a99-6d52-488e-ac6c-235218c2aca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:33.813604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50084a99-6d52-488e-ac6c-235218c2aca5 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:33.813882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50084a99-6d52-488e-ac6c-235218c2aca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:33.814153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50084a99-6d52-488e-ac6c-235218c2aca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:33.814797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50084a99-6d52-488e-ac6c-235218c2aca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:33.816911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50084a99-6d52-488e-ac6c-235218c2aca5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:33.819859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7b235221-1f92-4012-a6a7-1ea61097e9e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1f58ab8da541bd975e4d5c60430e23'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.832941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7b235221-1f92-4012-a6a7-1ea61097e9e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1f58ab8da541bd975e4d5c60430e23'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.844646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7b235221-1f92-4012-a6a7-1ea61097e9e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1f58ab8da541bd975e4d5c60430e23'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:33.851797 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4085/8102] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:33 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:33.858191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50084a99-6d52-488e-ac6c-235218c2aca5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:33.861947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-50084a99-6d52-488e-ac6c-235218c2aca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:33.865490 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4018/8103] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:33 2022] DELETE /identity/v3/users/3e1f58ab8da541bd975e4d5c60430e23 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:33.870340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ce510-1df0-4ff4-b78c-65459ea7a8d9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:33.870757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ce510-1df0-4ff4-b78c-65459ea7a8d9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:33.871125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ce510-1df0-4ff4-b78c-65459ea7a8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:33.920644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-681ce510-1df0-4ff4-b78c-65459ea7a8d9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:33.924488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-681ce510-1df0-4ff4-b78c-65459ea7a8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:33.970690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50084a99-6d52-488e-ac6c-235218c2aca5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:34.056806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5790d-0dff-4b33-b1e5-413e9d2b77f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:34.057758 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4019/8104] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:34.058682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5790d-0dff-4b33-b1e5-413e9d2b77f2 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:34.060013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5790d-0dff-4b33-b1e5-413e9d2b77f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:34.060821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5790d-0dff-4b33-b1e5-413e9d2b77f2 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:34.062091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5790d-0dff-4b33-b1e5-413e9d2b77f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:34.066887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5790d-0dff-4b33-b1e5-413e9d2b77f2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:34.068122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ce510-1df0-4ff4-b78c-65459ea7a8d9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:34.071024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-681ce510-1df0-4ff4-b78c-65459ea7a8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:34.077575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:34.108915 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4086/8105] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:33 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:34.113832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5790d-0dff-4b33-b1e5-413e9d2b77f2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:34.139372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5790d-0dff-4b33-b1e5-413e9d2b77f2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:34.145823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e40055-3b3f-49b5-b83a-fe10000a55ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:34.146655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e40055-3b3f-49b5-b83a-fe10000a55ae admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:34.147005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e40055-3b3f-49b5-b83a-fe10000a55ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:34.147342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e40055-3b3f-49b5-b83a-fe10000a55ae admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:34.148198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e40055-3b3f-49b5-b83a-fe10000a55ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:34.149805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e40055-3b3f-49b5-b83a-fe10000a55ae admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:34.180684 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4087/8106] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:01:34.181550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e40055-3b3f-49b5-b83a-fe10000a55ae admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:34.194544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e40055-3b3f-49b5-b83a-fe10000a55ae admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:34.202615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ce510-1df0-4ff4-b78c-65459ea7a8d9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:34.203682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69ee47-3931-4c00-bcc3-413224de4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:34.204404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69ee47-3931-4c00-bcc3-413224de4eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:34.204873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69ee47-3931-4c00-bcc3-413224de4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:34.205231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69ee47-3931-4c00-bcc3-413224de4eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:34.206217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69ee47-3931-4c00-bcc3-413224de4eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:34.208117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69ee47-3931-4c00-bcc3-413224de4eb1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:34.208286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01372c1e-44cc-47e9-a289-d5970fc38bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:34.209157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01372c1e-44cc-47e9-a289-d5970fc38bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:34.209558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01372c1e-44cc-47e9-a289-d5970fc38bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:34.210042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01372c1e-44cc-47e9-a289-d5970fc38bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:34.225491 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4088/8107] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:34.229471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69ee47-3931-4c00-bcc3-413224de4eb1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:34.233684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01372c1e-44cc-47e9-a289-d5970fc38bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:34.235732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01372c1e-44cc-47e9-a289-d5970fc38bb7 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:34.257069 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4020/8108] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:34.258880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69ee47-3931-4c00-bcc3-413224de4eb1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:34.276761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a438b6a-b7bb-4cfb-8575-7e224ffb42ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:34.278691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a438b6a-b7bb-4cfb-8575-7e224ffb42ed admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:34.279050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a438b6a-b7bb-4cfb-8575-7e224ffb42ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:34.279913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a438b6a-b7bb-4cfb-8575-7e224ffb42ed admin admin] PATH_INFO: `/v3/projects/3aa392f4c8b448018e5183c22d620b11/users/84c5079395c946f0ad9bdadfad78421f/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:34.310135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a438b6a-b7bb-4cfb-8575-7e224ffb42ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa392f4c8b448018e5183c22d620b11, user_id=84c5079395c946f0ad9bdadfad78421f, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:34.314436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a438b6a-b7bb-4cfb-8575-7e224ffb42ed admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:34.339343 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4089/8109] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:34 2022] PUT /identity/v3/projects/3aa392f4c8b448018e5183c22d620b11/users/84c5079395c946f0ad9bdadfad78421f/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:34.350139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd599f-3591-4374-bf9f-5a206ece21b1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:34.352202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd599f-3591-4374-bf9f-5a206ece21b1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:34.352506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd599f-3591-4374-bf9f-5a206ece21b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:34.495346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6fbd599f-3591-4374-bf9f-5a206ece21b1 None None] MFA Rules not processed for user `84c5079395c946f0ad9bdadfad78421f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:34.496953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6fbd599f-3591-4374-bf9f-5a206ece21b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:34.581986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:34.662025 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4021/8110] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:34.665039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a438b6a-b7bb-4cfb-8575-7e224ffb42ed admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:34.667433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7a438b6a-b7bb-4cfb-8575-7e224ffb42ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:34.718254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd599f-3591-4374-bf9f-5a206ece21b1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:34.732583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6fbd599f-3591-4374-bf9f-5a206ece21b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:34.783728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a438b6a-b7bb-4cfb-8575-7e224ffb42ed admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:34.788968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:34.789630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:34.790038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:34.790315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] PATH_INFO: `/v3/projects/b2009dd3abc44fe28538427fa2868753` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:34.791558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2009dd3abc44fe28538427fa2868753)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:34.794326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:34.841769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd599f-3591-4374-bf9f-5a206ece21b1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:34.861782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2009dd3abc44fe28538427fa2868753', 'request_id': 'req-62534271-5c9c-44b2-add5-3d8a9f101f2e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:34.871716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2009dd3abc44fe28538427fa2868753', 'request_id': 'req-62534271-5c9c-44b2-add5-3d8a9f101f2e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:34.880641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2009dd3abc44fe28538427fa2868753', 'request_id': 'req-62534271-5c9c-44b2-add5-3d8a9f101f2e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:34.894734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] The token cache is being invalidate because project b2009dd3abc44fe28538427fa2868753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:34.894734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:34.895584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-62534271-5c9c-44b2-add5-3d8a9f101f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:34.897221 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4090/8111] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:34 2022] DELETE /identity/v3/projects/b2009dd3abc44fe28538427fa2868753 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:34.902709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ccf08-fd31-4f16-aaf9-3920b817d41d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:34.903460 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ccf08-fd31-4f16-aaf9-3920b817d41d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:34.904456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ccf08-fd31-4f16-aaf9-3920b817d41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:34.918641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02190f44-c354-4cf5-931f-4edae5904a70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:34.919254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02190f44-c354-4cf5-931f-4edae5904a70 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:34.920643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02190f44-c354-4cf5-931f-4edae5904a70 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:34.920643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02190f44-c354-4cf5-931f-4edae5904a70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:34.923462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-02190f44-c354-4cf5-931f-4edae5904a70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:34.936598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e63ccf08-fd31-4f16-aaf9-3920b817d41d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:34.942604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e63ccf08-fd31-4f16-aaf9-3920b817d41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:34.985690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:35.006008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02190f44-c354-4cf5-931f-4edae5904a70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:35.008766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02190f44-c354-4cf5-931f-4edae5904a70 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:35.037980 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4091/8112] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:35.044360 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4022/8113] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:01:35.052228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cb4bc-519e-418d-9cd3-941b1b9090d8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:35.062803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cb4bc-519e-418d-9cd3-941b1b9090d8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:35.063994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cb4bc-519e-418d-9cd3-941b1b9090d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:35.096559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2d2cb4bc-519e-418d-9cd3-941b1b9090d8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:35.098372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2d2cb4bc-519e-418d-9cd3-941b1b9090d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:35.117071 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4092/8114] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:35.121996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02190f44-c354-4cf5-931f-4edae5904a70 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:35.135996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02190f44-c354-4cf5-931f-4edae5904a70 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:35.142272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663f9c8-94e0-4c87-b066-c4cd12aaaa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:35.142946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663f9c8-94e0-4c87-b066-c4cd12aaaa4e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:35.143349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663f9c8-94e0-4c87-b066-c4cd12aaaa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:35.144132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663f9c8-94e0-4c87-b066-c4cd12aaaa4e admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:35.144795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663f9c8-94e0-4c87-b066-c4cd12aaaa4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:35.145101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663f9c8-94e0-4c87-b066-c4cd12aaaa4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:35.146947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663f9c8-94e0-4c87-b066-c4cd12aaaa4e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:35.164592 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4023/8115] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:01:35.165765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cb4bc-519e-418d-9cd3-941b1b9090d8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:35.178545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cb4bc-519e-418d-9cd3-941b1b9090d8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:35.192144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc312ab-c48a-459a-898c-2e6335e52c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:35.192925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc312ab-c48a-459a-898c-2e6335e52c15 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:35.193344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc312ab-c48a-459a-898c-2e6335e52c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:35.194464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc312ab-c48a-459a-898c-2e6335e52c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:35.194464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc312ab-c48a-459a-898c-2e6335e52c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:35.196612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc312ab-c48a-459a-898c-2e6335e52c15 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:35.241438 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4093/8116] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:35 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:01:35.244657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663f9c8-94e0-4c87-b066-c4cd12aaaa4e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:35.260647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663f9c8-94e0-4c87-b066-c4cd12aaaa4e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:35.294972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:35.382124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cbeb6-1912-4ded-abed-b313eff895c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:35.383317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cbeb6-1912-4ded-abed-b313eff895c7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:35.383870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cbeb6-1912-4ded-abed-b313eff895c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:35.384311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cbeb6-1912-4ded-abed-b313eff895c7 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:35.385252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cbeb6-1912-4ded-abed-b313eff895c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:35.388190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cbeb6-1912-4ded-abed-b313eff895c7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:35.425855 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4024/8117] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:35 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:35.430448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc312ab-c48a-459a-898c-2e6335e52c15 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:35.447019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc312ab-c48a-459a-898c-2e6335e52c15 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:35.470287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1e4cc-39e8-46d3-b9ff-77f6145e00a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:35.470287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e4cc-39e8-46d3-b9ff-77f6145e00a2 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:35.470287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e4cc-39e8-46d3-b9ff-77f6145e00a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:35.470287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e4cc-39e8-46d3-b9ff-77f6145e00a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:35.470849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1e4cc-39e8-46d3-b9ff-77f6145e00a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:35.476906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1e4cc-39e8-46d3-b9ff-77f6145e00a2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:35.492430 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4094/8118] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:35.493650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cbeb6-1912-4ded-abed-b313eff895c7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:35.515594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cbeb6-1912-4ded-abed-b313eff895c7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:35.524098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edf0fa-310f-4a54-b77c-fe9f48ac04fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:35.524098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf0fa-310f-4a54-b77c-fe9f48ac04fe admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:35.524098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf0fa-310f-4a54-b77c-fe9f48ac04fe admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:35.524098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf0fa-310f-4a54-b77c-fe9f48ac04fe admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:35.524881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edf0fa-310f-4a54-b77c-fe9f48ac04fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:35.526540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edf0fa-310f-4a54-b77c-fe9f48ac04fe admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:35.541487 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4025/8119] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:01:35.545574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1e4cc-39e8-46d3-b9ff-77f6145e00a2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:35.557708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1e4cc-39e8-46d3-b9ff-77f6145e00a2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:35.563137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83835b-adc0-4ba9-a224-6a72495e4da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:35.563806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83835b-adc0-4ba9-a224-6a72495e4da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:35.564200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83835b-adc0-4ba9-a224-6a72495e4da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:35.564470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83835b-adc0-4ba9-a224-6a72495e4da9 admin admin] PATH_INFO: `/v3/projects/e48b07db55094e27929b97225dfffa36/users/ca2de1b05cb84d8daf8488bf21895e08/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:35.585199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83835b-adc0-4ba9-a224-6a72495e4da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48b07db55094e27929b97225dfffa36, user_id=ca2de1b05cb84d8daf8488bf21895e08, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:35.588059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83835b-adc0-4ba9-a224-6a72495e4da9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:35.603492 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4095/8120] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:35 2022] PUT /identity/v3/projects/e48b07db55094e27929b97225dfffa36/users/ca2de1b05cb84d8daf8488bf21895e08/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:35.616860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74063e-2f22-4ade-9173-619369255e1c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:35.617154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74063e-2f22-4ade-9173-619369255e1c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:35.617456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74063e-2f22-4ade-9173-619369255e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:35.684158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0d74063e-2f22-4ade-9173-619369255e1c None None] MFA Rules not processed for user `ca2de1b05cb84d8daf8488bf21895e08`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:35.685894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0d74063e-2f22-4ade-9173-619369255e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:35.821577 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4026/8121] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:35.833073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83835b-adc0-4ba9-a224-6a72495e4da9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:35.837319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-df83835b-adc0-4ba9-a224-6a72495e4da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:35.971917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83835b-adc0-4ba9-a224-6a72495e4da9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:35.977087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379e772-dd1e-4ab6-a235-d78a03dda0cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:35.978421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379e772-dd1e-4ab6-a235-d78a03dda0cb service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:35.978801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379e772-dd1e-4ab6-a235-d78a03dda0cb service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:35.979180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379e772-dd1e-4ab6-a235-d78a03dda0cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:35.990116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379e772-dd1e-4ab6-a235-d78a03dda0cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:35.993924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379e772-dd1e-4ab6-a235-d78a03dda0cb service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:36.021788 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4096/8122] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:37.739386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333500e6-5bdd-42d5-894e-3e7a39550968 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:37.739912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333500e6-5bdd-42d5-894e-3e7a39550968 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:37.740049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333500e6-5bdd-42d5-894e-3e7a39550968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:37.770191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-333500e6-5bdd-42d5-894e-3e7a39550968 None None] MFA Rules not processed for user `84c5079395c946f0ad9bdadfad78421f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:37.771687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-333500e6-5bdd-42d5-894e-3e7a39550968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:37.843964 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4027/8123] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:42.271643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379e772-dd1e-4ab6-a235-d78a03dda0cb service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:42.273238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f379e772-dd1e-4ab6-a235-d78a03dda0cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:42.306368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379e772-dd1e-4ab6-a235-d78a03dda0cb service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:42.326336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faba3da-135d-446e-ab4d-7028422fbb0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:42.326969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faba3da-135d-446e-ab4d-7028422fbb0a service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:42.327230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faba3da-135d-446e-ab4d-7028422fbb0a service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:42.327601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faba3da-135d-446e-ab4d-7028422fbb0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:42.334920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3faba3da-135d-446e-ab4d-7028422fbb0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:42.384683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faba3da-135d-446e-ab4d-7028422fbb0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:42.386173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faba3da-135d-446e-ab4d-7028422fbb0a service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:42.410367 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4097/8124] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:42.899959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333500e6-5bdd-42d5-894e-3e7a39550968 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:42.902334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-333500e6-5bdd-42d5-894e-3e7a39550968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:42.982037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:43.039199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333500e6-5bdd-42d5-894e-3e7a39550968 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:43.045109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:43.046107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:43.046621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:43.047125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] PATH_INFO: `/v3/users/62aba6589e72490d870b62c294c18441` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:43.048696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62aba6589e72490d870b62c294c18441)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:43.052387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:43.132100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62aba6589e72490d870b62c294c18441'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:43.134962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62aba6589e72490d870b62c294c18441'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:43.166519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62aba6589e72490d870b62c294c18441'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:43.183267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62aba6589e72490d870b62c294c18441'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:43.200010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62aba6589e72490d870b62c294c18441'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:43.218863 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4028/8125] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:42 2022] DELETE /identity/v3/users/62aba6589e72490d870b62c294c18441 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:43.224056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753acb-f290-44ac-b444-24feb18a35d1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:43.224667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753acb-f290-44ac-b444-24feb18a35d1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:43.224977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753acb-f290-44ac-b444-24feb18a35d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:43.263866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-26753acb-f290-44ac-b444-24feb18a35d1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:43.267406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-26753acb-f290-44ac-b444-24feb18a35d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:43.406484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:43.421762 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4098/8126] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:43.435899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:43.437932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:43.641771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbcef9-3bae-4205-a7f0-53f33913d844 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:43.648310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f705f-931b-4f60-bf3e-d9cbb031f1ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:43.651066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f705f-931b-4f60-bf3e-d9cbb031f1ea service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:43.651757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f705f-931b-4f60-bf3e-d9cbb031f1ea service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:43.653143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f705f-931b-4f60-bf3e-d9cbb031f1ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:43.692777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f705f-931b-4f60-bf3e-d9cbb031f1ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:43.707314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f705f-931b-4f60-bf3e-d9cbb031f1ea service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:43.739598 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4029/8127] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:44.287658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26753acb-f290-44ac-b444-24feb18a35d1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:44.289520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-26753acb-f290-44ac-b444-24feb18a35d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:44.312210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26753acb-f290-44ac-b444-24feb18a35d1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:44.321194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:44.333671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:44.334184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:44.334938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] PATH_INFO: `/v3/projects/ac249d1789a44313b5a5036e450c9d28` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:44.339297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac249d1789a44313b5a5036e450c9d28)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:44.358517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:44.469428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac249d1789a44313b5a5036e450c9d28', 'request_id': 'req-40da6c3f-c022-4488-afd1-95b10f1ca9f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:44.480434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac249d1789a44313b5a5036e450c9d28', 'request_id': 'req-40da6c3f-c022-4488-afd1-95b10f1ca9f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:44.495577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac249d1789a44313b5a5036e450c9d28', 'request_id': 'req-40da6c3f-c022-4488-afd1-95b10f1ca9f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:44.527907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] The token cache is being invalidate because project ac249d1789a44313b5a5036e450c9d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:44.528203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:44.529974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:44.532288 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4099/8128] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:44 2022] DELETE /identity/v3/projects/ac249d1789a44313b5a5036e450c9d28 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:44.537262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f705f-931b-4f60-bf3e-d9cbb031f1ea service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:44.577862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f705f-931b-4f60-bf3e-d9cbb031f1ea service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:44.805765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:44.838314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db15f2-290e-4f09-a0ce-8db90e833d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:44.838993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db15f2-290e-4f09-a0ce-8db90e833d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:44.839278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db15f2-290e-4f09-a0ce-8db90e833d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:44.839556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db15f2-290e-4f09-a0ce-8db90e833d62 admin admin] PATH_INFO: `/v3/users/d2cd9a08ced64f38ac84138a1da6592c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:44.840904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db15f2-290e-4f09-a0ce-8db90e833d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2cd9a08ced64f38ac84138a1da6592c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:44.849760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db15f2-290e-4f09-a0ce-8db90e833d62 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:44.992869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74db15f2-290e-4f09-a0ce-8db90e833d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2cd9a08ced64f38ac84138a1da6592c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:44.994249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74db15f2-290e-4f09-a0ce-8db90e833d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2cd9a08ced64f38ac84138a1da6592c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:45.032655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74db15f2-290e-4f09-a0ce-8db90e833d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2cd9a08ced64f38ac84138a1da6592c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:45.047922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74db15f2-290e-4f09-a0ce-8db90e833d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2cd9a08ced64f38ac84138a1da6592c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:45.070251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-74db15f2-290e-4f09-a0ce-8db90e833d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2cd9a08ced64f38ac84138a1da6592c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:45.082623 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4030/8129] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:44 2022] DELETE /identity/v3/users/d2cd9a08ced64f38ac84138a1da6592c => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:45.986683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:45.988838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:46.031305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da6c3f-c022-4488-afd1-95b10f1ca9f9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:46.161851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:46.162745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:46.163213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:46.163664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] PATH_INFO: `/v3/projects/7e8f560b3d0b4842a5d65ae190b33db5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:46.165032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8f560b3d0b4842a5d65ae190b33db5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:46.167378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:46.254975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8f560b3d0b4842a5d65ae190b33db5', 'request_id': 'req-905900c0-9d23-49b7-a4a4-f5af2e28e396'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:46.265868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8f560b3d0b4842a5d65ae190b33db5', 'request_id': 'req-905900c0-9d23-49b7-a4a4-f5af2e28e396'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:46.277093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8f560b3d0b4842a5d65ae190b33db5', 'request_id': 'req-905900c0-9d23-49b7-a4a4-f5af2e28e396'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:46.309844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] The token cache is being invalidate because project 7e8f560b3d0b4842a5d65ae190b33db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:46.310276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:46.311021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-905900c0-9d23-49b7-a4a4-f5af2e28e396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:46.316517 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4100/8130] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:45 2022] DELETE /identity/v3/projects/7e8f560b3d0b4842a5d65ae190b33db5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:46.318460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec177c6e-fd57-4bf3-a9c6-5c4f2589b026 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:46.318942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec177c6e-fd57-4bf3-a9c6-5c4f2589b026 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:46.319055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec177c6e-fd57-4bf3-a9c6-5c4f2589b026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:46.342013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ec177c6e-fd57-4bf3-a9c6-5c4f2589b026 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:46.343336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ec177c6e-fd57-4bf3-a9c6-5c4f2589b026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:46.437857 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4031/8131] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:46.445836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1a55c-0b59-4c6f-9e03-16a4862fa698 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:46.446150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1a55c-0b59-4c6f-9e03-16a4862fa698 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:46.446401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1a55c-0b59-4c6f-9e03-16a4862fa698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:46.478040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-94d1a55c-0b59-4c6f-9e03-16a4862fa698 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:46.482288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-94d1a55c-0b59-4c6f-9e03-16a4862fa698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:46.504024 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4101/8132] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:46.508222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec177c6e-fd57-4bf3-a9c6-5c4f2589b026 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:46.533821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec177c6e-fd57-4bf3-a9c6-5c4f2589b026 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:46.544194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f01325-4c73-4fb8-bdec-6b4e36f8dac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:46.546157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f01325-4c73-4fb8-bdec-6b4e36f8dac5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:46.546896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f01325-4c73-4fb8-bdec-6b4e36f8dac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:46.547468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f01325-4c73-4fb8-bdec-6b4e36f8dac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:46.549085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f01325-4c73-4fb8-bdec-6b4e36f8dac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:46.549821 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f01325-4c73-4fb8-bdec-6b4e36f8dac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:46.553872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f01325-4c73-4fb8-bdec-6b4e36f8dac5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:46.595441 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4032/8133] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:01:46.600309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1a55c-0b59-4c6f-9e03-16a4862fa698 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:46.613453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1a55c-0b59-4c6f-9e03-16a4862fa698 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:46.625437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4eda5-de39-4202-a37d-d7d5f4113f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:46.626191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4eda5-de39-4202-a37d-d7d5f4113f70 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:46.626406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4eda5-de39-4202-a37d-d7d5f4113f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:46.626671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4eda5-de39-4202-a37d-d7d5f4113f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:46.627330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4eda5-de39-4202-a37d-d7d5f4113f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:46.630364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4eda5-de39-4202-a37d-d7d5f4113f70 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:46.635747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:46.672257 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4102/8134] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:46 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:01:46.676983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f01325-4c73-4fb8-bdec-6b4e36f8dac5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:46.689511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f01325-4c73-4fb8-bdec-6b4e36f8dac5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:46.785313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59fcba-3f06-446e-95be-dd7ea0923f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:46.786183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59fcba-3f06-446e-95be-dd7ea0923f07 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:46.786629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59fcba-3f06-446e-95be-dd7ea0923f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:46.788058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59fcba-3f06-446e-95be-dd7ea0923f07 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:46.788843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59fcba-3f06-446e-95be-dd7ea0923f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:46.795679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59fcba-3f06-446e-95be-dd7ea0923f07 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:46.820089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:46.853338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4eda5-de39-4202-a37d-d7d5f4113f70 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:46.861844 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4033/8135] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:46 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:46.873557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4eda5-de39-4202-a37d-d7d5f4113f70 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:46.888578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03cd43-5997-4302-b38e-5a88cbcc932a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:46.888578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03cd43-5997-4302-b38e-5a88cbcc932a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:46.888578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03cd43-5997-4302-b38e-5a88cbcc932a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:46.888578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03cd43-5997-4302-b38e-5a88cbcc932a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:46.889060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03cd43-5997-4302-b38e-5a88cbcc932a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:46.889060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03cd43-5997-4302-b38e-5a88cbcc932a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:46.900595 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4103/8136] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:46.904817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59fcba-3f06-446e-95be-dd7ea0923f07 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:46.924661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59fcba-3f06-446e-95be-dd7ea0923f07 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:46.938278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d4164-0aeb-48b5-86a9-1218875a2473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:46.938926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4164-0aeb-48b5-86a9-1218875a2473 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:46.939213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4164-0aeb-48b5-86a9-1218875a2473 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:46.939493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4164-0aeb-48b5-86a9-1218875a2473 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:46.940153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d4164-0aeb-48b5-86a9-1218875a2473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:46.942633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d4164-0aeb-48b5-86a9-1218875a2473 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:46.965539 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4034/8137] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:01:46.970660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03cd43-5997-4302-b38e-5a88cbcc932a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:46.993070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03cd43-5997-4302-b38e-5a88cbcc932a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:47.009551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113967c-e113-456a-8249-684236fb6aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:47.011100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113967c-e113-456a-8249-684236fb6aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:47.012550 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113967c-e113-456a-8249-684236fb6aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:47.013060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113967c-e113-456a-8249-684236fb6aa2 admin admin] PATH_INFO: `/v3/projects/0dd1fbaa3f664a6fa0e0c7cf2be95b19/users/e948fc8b105a46648d10114e7f669a66/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:47.080508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113967c-e113-456a-8249-684236fb6aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd1fbaa3f664a6fa0e0c7cf2be95b19, user_id=e948fc8b105a46648d10114e7f669a66, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:47.084347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113967c-e113-456a-8249-684236fb6aa2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:47.122714 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4104/8138] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:46 2022] PUT /identity/v3/projects/0dd1fbaa3f664a6fa0e0c7cf2be95b19/users/e948fc8b105a46648d10114e7f669a66/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:47.138726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa9b44-1f92-493f-85c1-2dfdfe3ee7f9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:47.139484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa9b44-1f92-493f-85c1-2dfdfe3ee7f9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:47.139849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa9b44-1f92-493f-85c1-2dfdfe3ee7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:47.202713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f2aa9b44-1f92-493f-85c1-2dfdfe3ee7f9 None None] MFA Rules not processed for user `e948fc8b105a46648d10114e7f669a66`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:47.203973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f2aa9b44-1f92-493f-85c1-2dfdfe3ee7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:47.314484 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4035/8139] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:47.315661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113967c-e113-456a-8249-684236fb6aa2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:47.393781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113967c-e113-456a-8249-684236fb6aa2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:47.402325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1e3a6-3902-4672-802c-51b5c4207468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:47.403426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1e3a6-3902-4672-802c-51b5c4207468 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:47.403929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1e3a6-3902-4672-802c-51b5c4207468 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:47.404436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1e3a6-3902-4672-802c-51b5c4207468 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:47.405322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1e3a6-3902-4672-802c-51b5c4207468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:47.407690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1e3a6-3902-4672-802c-51b5c4207468 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:47.455974 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4105/8140] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:47 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:47.460222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa9b44-1f92-493f-85c1-2dfdfe3ee7f9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:47.477643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa9b44-1f92-493f-85c1-2dfdfe3ee7f9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:47.552672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a43f7-0c6f-45d4-a062-41f28f27fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:47.553515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a43f7-0c6f-45d4-a062-41f28f27fae6 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:47.553897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a43f7-0c6f-45d4-a062-41f28f27fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:47.554175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a43f7-0c6f-45d4-a062-41f28f27fae6 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:47.555172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a43f7-0c6f-45d4-a062-41f28f27fae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:47.557104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a43f7-0c6f-45d4-a062-41f28f27fae6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:47.586072 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4036/8141] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:47 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:47.587232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1e3a6-3902-4672-802c-51b5c4207468 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:47.602288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1e3a6-3902-4672-802c-51b5c4207468 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:47.607777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9839e-c11f-4a10-8178-8dfce99f2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:47.608641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9839e-c11f-4a10-8178-8dfce99f2f6b admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:47.609147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9839e-c11f-4a10-8178-8dfce99f2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:47.609677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9839e-c11f-4a10-8178-8dfce99f2f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:47.610553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9839e-c11f-4a10-8178-8dfce99f2f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:47.612740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9839e-c11f-4a10-8178-8dfce99f2f6b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:47.632925 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4106/8142] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:47.637748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a43f7-0c6f-45d4-a062-41f28f27fae6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:47.650400 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a43f7-0c6f-45d4-a062-41f28f27fae6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:47.656012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e035f5-9182-4858-9473-757a6faaba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:47.657184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e035f5-9182-4858-9473-757a6faaba58 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:47.657702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e035f5-9182-4858-9473-757a6faaba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:47.658183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e035f5-9182-4858-9473-757a6faaba58 admin admin] PATH_INFO: `/v3/projects/de24d77479ed48adbfba793d2a68e777/users/3bcd7ee83c4f41a08a78199ca3e2ad56/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:47.677132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e035f5-9182-4858-9473-757a6faaba58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de24d77479ed48adbfba793d2a68e777, user_id=3bcd7ee83c4f41a08a78199ca3e2ad56, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:47.679993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e035f5-9182-4858-9473-757a6faaba58 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:47.701599 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4037/8143] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:47 2022] PUT /identity/v3/projects/de24d77479ed48adbfba793d2a68e777/users/3bcd7ee83c4f41a08a78199ca3e2ad56/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:47.703160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9839e-c11f-4a10-8178-8dfce99f2f6b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:47.716546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9839e-c11f-4a10-8178-8dfce99f2f6b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:47.807715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116dcb3-5a92-499b-8395-7d788568ad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:47.808671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116dcb3-5a92-499b-8395-7d788568ad24 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:47.809142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116dcb3-5a92-499b-8395-7d788568ad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:47.809758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116dcb3-5a92-499b-8395-7d788568ad24 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:47.811922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116dcb3-5a92-499b-8395-7d788568ad24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:47.814340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116dcb3-5a92-499b-8395-7d788568ad24 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:47.831018 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4107/8144] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:47.835834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e035f5-9182-4858-9473-757a6faaba58 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:47.847510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e035f5-9182-4858-9473-757a6faaba58 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:47.852982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21f577-0694-45d8-b7b9-03e8e6255a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:47.853732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21f577-0694-45d8-b7b9-03e8e6255a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:47.854163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21f577-0694-45d8-b7b9-03e8e6255a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:47.854450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21f577-0694-45d8-b7b9-03e8e6255a69 admin admin] PATH_INFO: `/v3/projects/de24d77479ed48adbfba793d2a68e777/users/3bcd7ee83c4f41a08a78199ca3e2ad56/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:47.856547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21f577-0694-45d8-b7b9-03e8e6255a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de24d77479ed48adbfba793d2a68e777, user_id=3bcd7ee83c4f41a08a78199ca3e2ad56, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:47.860263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21f577-0694-45d8-b7b9-03e8e6255a69 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:47.894132 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4038/8145] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:47 2022] PUT /identity/v3/projects/de24d77479ed48adbfba793d2a68e777/users/3bcd7ee83c4f41a08a78199ca3e2ad56/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:01:47.894701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38552e-89fd-4d56-9659-844eb70d8ad0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:47.895245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38552e-89fd-4d56-9659-844eb70d8ad0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:47.896926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38552e-89fd-4d56-9659-844eb70d8ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:47.969780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6f38552e-89fd-4d56-9659-844eb70d8ad0 None None] MFA Rules not processed for user `3bcd7ee83c4f41a08a78199ca3e2ad56`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:47.971655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6f38552e-89fd-4d56-9659-844eb70d8ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:47.984517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:48.090729 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4108/8146] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:48.108706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21f577-0694-45d8-b7b9-03e8e6255a69 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:48.111336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5f21f577-0694-45d8-b7b9-03e8e6255a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:48.231483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:48.308815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21f577-0694-45d8-b7b9-03e8e6255a69 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:48.319566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905749b-9119-4426-886c-09f46da55781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:48.320424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905749b-9119-4426-886c-09f46da55781 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:48.320805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905749b-9119-4426-886c-09f46da55781 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:48.321203 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905749b-9119-4426-886c-09f46da55781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:48.343324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905749b-9119-4426-886c-09f46da55781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:48.344955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905749b-9119-4426-886c-09f46da55781 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:48.388514 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4039/8147] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:48.452078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38552e-89fd-4d56-9659-844eb70d8ad0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:48.454097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6f38552e-89fd-4d56-9659-844eb70d8ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:48.477928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38552e-89fd-4d56-9659-844eb70d8ad0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:48.485684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc2470-7dd4-45b2-aeee-ac5ef62863c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:48.487119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc2470-7dd4-45b2-aeee-ac5ef62863c0 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:48.487623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc2470-7dd4-45b2-aeee-ac5ef62863c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:48.488082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc2470-7dd4-45b2-aeee-ac5ef62863c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:48.560293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc2470-7dd4-45b2-aeee-ac5ef62863c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:48.562980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc2470-7dd4-45b2-aeee-ac5ef62863c0 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:48.573658 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4109/8148] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:52.482779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905749b-9119-4426-886c-09f46da55781 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:52.497793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905749b-9119-4426-886c-09f46da55781 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:52.516192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cda13-3a5b-44f9-89bc-866fc8f598cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:52.518026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cda13-3a5b-44f9-89bc-866fc8f598cb service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:52.518026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cda13-3a5b-44f9-89bc-866fc8f598cb service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:52.518336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cda13-3a5b-44f9-89bc-866fc8f598cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:52.521580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f83cda13-3a5b-44f9-89bc-866fc8f598cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:52.646947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cda13-3a5b-44f9-89bc-866fc8f598cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:52.648495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cda13-3a5b-44f9-89bc-866fc8f598cb service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:52.662142 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4040/8149] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:52.887605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc2470-7dd4-45b2-aeee-ac5ef62863c0 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:52.970530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc2470-7dd4-45b2-aeee-ac5ef62863c0 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:53.007232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:53.007885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:53.008231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:53.008416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] PATH_INFO: `/v3/users/e948fc8b105a46648d10114e7f669a66` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:53.012191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e948fc8b105a46648d10114e7f669a66)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:53.015061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:53.081925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:53.086014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e948fc8b105a46648d10114e7f669a66'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:53.087011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e948fc8b105a46648d10114e7f669a66'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:53.104036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e948fc8b105a46648d10114e7f669a66'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:53.105321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e948fc8b105a46648d10114e7f669a66'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:53.114810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e948fc8b105a46648d10114e7f669a66'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:53.134874 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4110/8150] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:52 2022] DELETE /identity/v3/users/e948fc8b105a46648d10114e7f669a66 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:53.136703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c533-6b91-4a02-8b6b-41394807efad None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:53.136995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c533-6b91-4a02-8b6b-41394807efad None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:53.137275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c533-6b91-4a02-8b6b-41394807efad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:53.160889 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-32f9c533-6b91-4a02-8b6b-41394807efad None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:53.162187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-32f9c533-6b91-4a02-8b6b-41394807efad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:53.250072 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4041/8151] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:53.266804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:53.269224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:53.389274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eca5e-94cb-4845-bac0-70f97d02a07f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:53.393361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3d0c9-ed6a-46c7-b995-882b6ceea79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:53.394083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d0c9-ed6a-46c7-b995-882b6ceea79d service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:53.394371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d0c9-ed6a-46c7-b995-882b6ceea79d service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:53.394689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d0c9-ed6a-46c7-b995-882b6ceea79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:53.408001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3d0c9-ed6a-46c7-b995-882b6ceea79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:53.408656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3d0c9-ed6a-46c7-b995-882b6ceea79d service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:53.424148 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4111/8152] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:53.773733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9c533-6b91-4a02-8b6b-41394807efad None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:53.775501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-32f9c533-6b91-4a02-8b6b-41394807efad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:53.792658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9c533-6b91-4a02-8b6b-41394807efad None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:53.802611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:53.803551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:53.804870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:53.805213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] PATH_INFO: `/v3/projects/0dd1fbaa3f664a6fa0e0c7cf2be95b19` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:53.806801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd1fbaa3f664a6fa0e0c7cf2be95b19)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:53.809956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:53.884722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd1fbaa3f664a6fa0e0c7cf2be95b19', 'request_id': 'req-7c084218-90c5-49ea-8032-ef91e204b9a1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:53.886667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb55b7b-14d0-46f8-a72a-37a839473593 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:53.888001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb55b7b-14d0-46f8-a72a-37a839473593 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:53.888620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb55b7b-14d0-46f8-a72a-37a839473593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:53.891394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:53.892932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd1fbaa3f664a6fa0e0c7cf2be95b19', 'request_id': 'req-7c084218-90c5-49ea-8032-ef91e204b9a1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:53.905185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd1fbaa3f664a6fa0e0c7cf2be95b19', 'request_id': 'req-7c084218-90c5-49ea-8032-ef91e204b9a1'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:53.910242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9bb55b7b-14d0-46f8-a72a-37a839473593 None None] MFA Rules not processed for user `e276b9fae4594c17a1883dd4e48184c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:53.911672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9bb55b7b-14d0-46f8-a72a-37a839473593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:53.923171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] The token cache is being invalidate because project 0dd1fbaa3f664a6fa0e0c7cf2be95b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:53.923525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:53.924829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:53.927558 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4042/8153] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:53 2022] DELETE /identity/v3/projects/0dd1fbaa3f664a6fa0e0c7cf2be95b19 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:01:53.933088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:53.934593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:53.993045 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4112/8154] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:54.015631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c084218-90c5-49ea-8032-ef91e204b9a1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:54.023139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a843b-622e-4a37-9238-ed7263f2a3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:54.023857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a843b-622e-4a37-9238-ed7263f2a3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:54.024202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a843b-622e-4a37-9238-ed7263f2a3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:54.024572 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a843b-622e-4a37-9238-ed7263f2a3b8 admin admin] PATH_INFO: `/v3/users/3bcd7ee83c4f41a08a78199ca3e2ad56` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:54.025851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a843b-622e-4a37-9238-ed7263f2a3b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bcd7ee83c4f41a08a78199ca3e2ad56)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:54.027978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a843b-622e-4a37-9238-ed7263f2a3b8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:54.122390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e66a843b-622e-4a37-9238-ed7263f2a3b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bcd7ee83c4f41a08a78199ca3e2ad56'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:54.123095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e66a843b-622e-4a37-9238-ed7263f2a3b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bcd7ee83c4f41a08a78199ca3e2ad56'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:54.142034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e66a843b-622e-4a37-9238-ed7263f2a3b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bcd7ee83c4f41a08a78199ca3e2ad56'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:54.154026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e66a843b-622e-4a37-9238-ed7263f2a3b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bcd7ee83c4f41a08a78199ca3e2ad56'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:54.164924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e66a843b-622e-4a37-9238-ed7263f2a3b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bcd7ee83c4f41a08a78199ca3e2ad56'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:54.173097 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4043/8155] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:53 2022] DELETE /identity/v3/users/3bcd7ee83c4f41a08a78199ca3e2ad56 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:54.788282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb55b7b-14d0-46f8-a72a-37a839473593 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:54.822218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb55b7b-14d0-46f8-a72a-37a839473593 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:54.918952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:54.932722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:54.934045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:54.936469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] PATH_INFO: `/v3/projects/de24d77479ed48adbfba793d2a68e777` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:54.939748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de24d77479ed48adbfba793d2a68e777)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:54.945486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:54.972441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:55.023739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de24d77479ed48adbfba793d2a68e777', 'request_id': 'req-e43461a5-3ce3-4955-9821-cf951285b262'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:55.037329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de24d77479ed48adbfba793d2a68e777', 'request_id': 'req-e43461a5-3ce3-4955-9821-cf951285b262'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:55.049204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de24d77479ed48adbfba793d2a68e777', 'request_id': 'req-e43461a5-3ce3-4955-9821-cf951285b262'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:55.076149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] The token cache is being invalidate because project de24d77479ed48adbfba793d2a68e777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:55.076931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:55.077701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e43461a5-3ce3-4955-9821-cf951285b262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:55.082377 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4113/8156] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:54 2022] DELETE /identity/v3/projects/de24d77479ed48adbfba793d2a68e777 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:55.087050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db997d3-6827-45a2-a888-a83da1dd2f82 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:55.087919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db997d3-6827-45a2-a888-a83da1dd2f82 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:55.088197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db997d3-6827-45a2-a888-a83da1dd2f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:55.109434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4db997d3-6827-45a2-a888-a83da1dd2f82 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:55.115944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4db997d3-6827-45a2-a888-a83da1dd2f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:55.199529 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4044/8157] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:55.208252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213d5a9-a5e1-4fc6-95ac-5857ef990119 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:55.208757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213d5a9-a5e1-4fc6-95ac-5857ef990119 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:55.209077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213d5a9-a5e1-4fc6-95ac-5857ef990119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:55.249798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9213d5a9-a5e1-4fc6-95ac-5857ef990119 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:55.251063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9213d5a9-a5e1-4fc6-95ac-5857ef990119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:55.265797 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4114/8158] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:55.275200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db997d3-6827-45a2-a888-a83da1dd2f82 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:55.285606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:55.302579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db997d3-6827-45a2-a888-a83da1dd2f82 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:55.310594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e70cb-1d00-49e8-ad79-468ede97d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:55.312381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e70cb-1d00-49e8-ad79-468ede97d3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:55.313004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e70cb-1d00-49e8-ad79-468ede97d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:55.313924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e70cb-1d00-49e8-ad79-468ede97d3c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:55.315056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e70cb-1d00-49e8-ad79-468ede97d3c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:01:55.316261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e70cb-1d00-49e8-ad79-468ede97d3c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:55.319113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e70cb-1d00-49e8-ad79-468ede97d3c9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:55.338380 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4045/8159] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:01:55.349883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213d5a9-a5e1-4fc6-95ac-5857ef990119 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:55.368765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213d5a9-a5e1-4fc6-95ac-5857ef990119 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:55.375532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08991cdd-138a-45e6-958a-001f76d38af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:55.376151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991cdd-138a-45e6-958a-001f76d38af9 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:55.377007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991cdd-138a-45e6-958a-001f76d38af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:55.382103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991cdd-138a-45e6-958a-001f76d38af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:55.382997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08991cdd-138a-45e6-958a-001f76d38af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:55.386820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08991cdd-138a-45e6-958a-001f76d38af9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:55.430328 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4115/8160] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:55 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:55.434307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e70cb-1d00-49e8-ad79-468ede97d3c9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:55.450555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e70cb-1d00-49e8-ad79-468ede97d3c9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:55.555865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87ead6-1d71-4e01-820d-4830b50d7ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:55.556485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87ead6-1d71-4e01-820d-4830b50d7ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:55.558250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87ead6-1d71-4e01-820d-4830b50d7ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:55.558401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87ead6-1d71-4e01-820d-4830b50d7ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:55.559152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87ead6-1d71-4e01-820d-4830b50d7ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:55.561103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87ead6-1d71-4e01-820d-4830b50d7ea0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:55.604946 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4046/8161] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:55 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:55.605823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08991cdd-138a-45e6-958a-001f76d38af9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:55.624310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08991cdd-138a-45e6-958a-001f76d38af9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:55.640664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563f505-4e90-41ae-93ed-06b54bcc6e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:55.641502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f505-4e90-41ae-93ed-06b54bcc6e04 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:55.641784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f505-4e90-41ae-93ed-06b54bcc6e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:55.646545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f505-4e90-41ae-93ed-06b54bcc6e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:55.647571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563f505-4e90-41ae-93ed-06b54bcc6e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:55.651244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563f505-4e90-41ae-93ed-06b54bcc6e04 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:55.668203 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4116/8162] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:01:55.670423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87ead6-1d71-4e01-820d-4830b50d7ea0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:55.683577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87ead6-1d71-4e01-820d-4830b50d7ea0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:55.688962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bbe33-5cd2-490c-a321-51fe85a5b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:55.690230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bbe33-5cd2-490c-a321-51fe85a5b16b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:55.690230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bbe33-5cd2-490c-a321-51fe85a5b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:55.690749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bbe33-5cd2-490c-a321-51fe85a5b16b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:55.691506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bbe33-5cd2-490c-a321-51fe85a5b16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:55.693280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bbe33-5cd2-490c-a321-51fe85a5b16b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:55.725361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563f505-4e90-41ae-93ed-06b54bcc6e04 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:55.731965 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4047/8163] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:55.735779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563f505-4e90-41ae-93ed-06b54bcc6e04 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:55.742431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4895dd6-999d-43f5-940a-57f28139d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:55.743227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4895dd6-999d-43f5-940a-57f28139d429 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:55.743582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4895dd6-999d-43f5-940a-57f28139d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:55.744145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4895dd6-999d-43f5-940a-57f28139d429 admin admin] PATH_INFO: `/v3/projects/bee3dd2e51d9499580fb822615fd1edb/users/7b952d48145c441ca88d6a5ab6335b84/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:55.762101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4895dd6-999d-43f5-940a-57f28139d429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee3dd2e51d9499580fb822615fd1edb, user_id=7b952d48145c441ca88d6a5ab6335b84, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:55.766433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4895dd6-999d-43f5-940a-57f28139d429 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:55.788251 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4117/8164] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:55 2022] PUT /identity/v3/projects/bee3dd2e51d9499580fb822615fd1edb/users/7b952d48145c441ca88d6a5ab6335b84/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:55.800646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972b76-c268-4adc-aa4d-5f479d6ffc46 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:55.800895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972b76-c268-4adc-aa4d-5f479d6ffc46 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:55.801279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972b76-c268-4adc-aa4d-5f479d6ffc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:55.835618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9d972b76-c268-4adc-aa4d-5f479d6ffc46 None None] MFA Rules not processed for user `7b952d48145c441ca88d6a5ab6335b84`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:55.836958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9d972b76-c268-4adc-aa4d-5f479d6ffc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:55.947761 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4048/8165] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:55.951796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4895dd6-999d-43f5-940a-57f28139d429 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:56.084047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4895dd6-999d-43f5-940a-57f28139d429 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:56.092411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d317e0a-b97b-4879-87b9-f6a1fad72e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:56.093074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d317e0a-b97b-4879-87b9-f6a1fad72e1b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:56.093587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d317e0a-b97b-4879-87b9-f6a1fad72e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:56.094639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d317e0a-b97b-4879-87b9-f6a1fad72e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:56.095673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d317e0a-b97b-4879-87b9-f6a1fad72e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:56.098441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d317e0a-b97b-4879-87b9-f6a1fad72e1b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:56.139426 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4118/8166] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:01:55 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:56.144809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d972b76-c268-4adc-aa4d-5f479d6ffc46 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:56.169675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d972b76-c268-4adc-aa4d-5f479d6ffc46 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:56.296139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cc8b7-0675-4a76-9035-6b05d0cad710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:56.296858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cc8b7-0675-4a76-9035-6b05d0cad710 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:56.297265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cc8b7-0675-4a76-9035-6b05d0cad710 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:56.297659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cc8b7-0675-4a76-9035-6b05d0cad710 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:56.298393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cc8b7-0675-4a76-9035-6b05d0cad710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:56.300494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cc8b7-0675-4a76-9035-6b05d0cad710 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:56.309916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:56.333077 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4049/8167] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:01:56 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:01:56.336165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d317e0a-b97b-4879-87b9-f6a1fad72e1b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:56.351421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d317e0a-b97b-4879-87b9-f6a1fad72e1b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:56.360283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01256e72-5587-40bb-8266-4dee385928af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:56.361252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01256e72-5587-40bb-8266-4dee385928af admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:56.361708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01256e72-5587-40bb-8266-4dee385928af admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:56.361971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01256e72-5587-40bb-8266-4dee385928af admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:56.362885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01256e72-5587-40bb-8266-4dee385928af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:56.364674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01256e72-5587-40bb-8266-4dee385928af admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:56.379821 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4119/8168] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:56.384198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cc8b7-0675-4a76-9035-6b05d0cad710 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:56.398035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cc8b7-0675-4a76-9035-6b05d0cad710 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:56.403669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eed300-dba9-4217-998f-5389a389eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:56.404436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eed300-dba9-4217-998f-5389a389eb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:56.404789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eed300-dba9-4217-998f-5389a389eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:56.405179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eed300-dba9-4217-998f-5389a389eb00 admin admin] PATH_INFO: `/v3/projects/eb4a5b3125b046f7b1dc8935463813c9/users/c515af2c77174af0a8528210e88f2280/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:56.426214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eed300-dba9-4217-998f-5389a389eb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4a5b3125b046f7b1dc8935463813c9, user_id=c515af2c77174af0a8528210e88f2280, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:56.429601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eed300-dba9-4217-998f-5389a389eb00 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:56.455238 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4050/8169] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:56 2022] PUT /identity/v3/projects/eb4a5b3125b046f7b1dc8935463813c9/users/c515af2c77174af0a8528210e88f2280/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:56.459876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01256e72-5587-40bb-8266-4dee385928af admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:56.493644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01256e72-5587-40bb-8266-4dee385928af admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:56.525087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:56.654144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef040687-b4dc-4070-83ce-1d7ff236850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:56.654773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef040687-b4dc-4070-83ce-1d7ff236850c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:56.655059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef040687-b4dc-4070-83ce-1d7ff236850c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:56.655333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef040687-b4dc-4070-83ce-1d7ff236850c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:56.655988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef040687-b4dc-4070-83ce-1d7ff236850c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:56.657635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef040687-b4dc-4070-83ce-1d7ff236850c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:56.684643 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4120/8170] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:01:56.687109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eed300-dba9-4217-998f-5389a389eb00 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:56.709237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eed300-dba9-4217-998f-5389a389eb00 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:56.718757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af43cdb-a090-4632-99fb-6c3af2f26d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:56.719957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43cdb-a090-4632-99fb-6c3af2f26d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:56.720554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43cdb-a090-4632-99fb-6c3af2f26d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:56.721065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43cdb-a090-4632-99fb-6c3af2f26d28 admin admin] PATH_INFO: `/v3/projects/eb4a5b3125b046f7b1dc8935463813c9/users/c515af2c77174af0a8528210e88f2280/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:56.725215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af43cdb-a090-4632-99fb-6c3af2f26d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4a5b3125b046f7b1dc8935463813c9, user_id=c515af2c77174af0a8528210e88f2280, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:56.729020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af43cdb-a090-4632-99fb-6c3af2f26d28 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:56.747622 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4051/8171] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:01:56 2022] PUT /identity/v3/projects/eb4a5b3125b046f7b1dc8935463813c9/users/c515af2c77174af0a8528210e88f2280/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:56.760503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7090075-75f8-4655-8b94-a38f090d2156 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:56.761156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7090075-75f8-4655-8b94-a38f090d2156 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:56.761731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7090075-75f8-4655-8b94-a38f090d2156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:56.830215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e7090075-75f8-4655-8b94-a38f090d2156 None None] MFA Rules not processed for user `c515af2c77174af0a8528210e88f2280`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:56.831505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e7090075-75f8-4655-8b94-a38f090d2156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:56.975934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de352764-30d7-42c0-a76d-396009f9e993 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:56.977029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de352764-30d7-42c0-a76d-396009f9e993 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:56.977608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de352764-30d7-42c0-a76d-396009f9e993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:57.035735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-de352764-30d7-42c0-a76d-396009f9e993 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:57.038952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de352764-30d7-42c0-a76d-396009f9e993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:57.068721 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4121/8172] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:57.084805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7090075-75f8-4655-8b94-a38f090d2156 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:57.086250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e7090075-75f8-4655-8b94-a38f090d2156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:57.240027 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4052/8173] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:01:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:57.267051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7090075-75f8-4655-8b94-a38f090d2156 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:57.288810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d992441-a877-4307-b06f-863bcef6c688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:57.292158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992441-a877-4307-b06f-863bcef6c688 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:57.292454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992441-a877-4307-b06f-863bcef6c688 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:57.292732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992441-a877-4307-b06f-863bcef6c688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:57.315166 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de352764-30d7-42c0-a76d-396009f9e993 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:57.317738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de352764-30d7-42c0-a76d-396009f9e993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:57.333670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d992441-a877-4307-b06f-863bcef6c688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:57.342417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d992441-a877-4307-b06f-863bcef6c688 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:57.379388 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4122/8174] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:01:57.570621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de352764-30d7-42c0-a76d-396009f9e993 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:57.576402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb4e5a-2566-4457-9d2a-7c614f03a2e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:57.577124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4e5a-2566-4457-9d2a-7c614f03a2e4 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:57.578077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4e5a-2566-4457-9d2a-7c614f03a2e4 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:57.578077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4e5a-2566-4457-9d2a-7c614f03a2e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:57.588628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb4e5a-2566-4457-9d2a-7c614f03a2e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:57.590996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb4e5a-2566-4457-9d2a-7c614f03a2e4 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:57.607812 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4053/8175] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:01:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 16:01:58.483498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d992441-a877-4307-b06f-863bcef6c688 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:58.570110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d68a8-4d3d-40f1-94d8-81cc211de9a0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:58.570950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d68a8-4d3d-40f1-94d8-81cc211de9a0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:58.571399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d68a8-4d3d-40f1-94d8-81cc211de9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:58.604915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-601d68a8-4d3d-40f1-94d8-81cc211de9a0 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:58.607822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:58.608516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-601d68a8-4d3d-40f1-94d8-81cc211de9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:58.618239 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4054/8176] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 16:01:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:01:58.643696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d68a8-4d3d-40f1-94d8-81cc211de9a0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:58.644379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d992441-a877-4307-b06f-863bcef6c688 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:58.649495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:58.650564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:58.651099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:58.651605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] PATH_INFO: `/v3/users/7b952d48145c441ca88d6a5ab6335b84` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:58.654000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b952d48145c441ca88d6a5ab6335b84)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:58.655996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:58.682910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d68a8-4d3d-40f1-94d8-81cc211de9a0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:58.689798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e35a1-d088-4a90-8734-b9f688da7b0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:58.691053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e35a1-d088-4a90-8734-b9f688da7b0f service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:58.691594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e35a1-d088-4a90-8734-b9f688da7b0f service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:58.692222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e35a1-d088-4a90-8734-b9f688da7b0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:58.711743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e35a1-d088-4a90-8734-b9f688da7b0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:58.713659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e35a1-d088-4a90-8734-b9f688da7b0f service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:58.727439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b952d48145c441ca88d6a5ab6335b84'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:58.728390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b952d48145c441ca88d6a5ab6335b84'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:58.742213 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4055/8177] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:01:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 16:01:58.757035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b952d48145c441ca88d6a5ab6335b84'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:58.761316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b952d48145c441ca88d6a5ab6335b84'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:58.782875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b952d48145c441ca88d6a5ab6335b84'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:58.806854 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4123/8178] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:58 2022] DELETE /identity/v3/users/7b952d48145c441ca88d6a5ab6335b84 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:58.811729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d22e06-d7db-4bb0-9a51-b98be96c7282 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:58.812027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d22e06-d7db-4bb0-9a51-b98be96c7282 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:58.812344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d22e06-d7db-4bb0-9a51-b98be96c7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:58.841279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-42d22e06-d7db-4bb0-9a51-b98be96c7282 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:58.843272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42d22e06-d7db-4bb0-9a51-b98be96c7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:58.898774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:58.951782 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4056/8179] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:58.962045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:58.963782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:59.115543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7868bb6-1856-4a39-bb41-ec135d70bbef admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:59.124200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb83a72-5530-4165-97b7-d39f1aeacc70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:59.125264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb83a72-5530-4165-97b7-d39f1aeacc70 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:59.125758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb83a72-5530-4165-97b7-d39f1aeacc70 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:59.129199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751617-eae4-418b-9752-ad87b5dfb5cd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:59.129373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb83a72-5530-4165-97b7-d39f1aeacc70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:59.129927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751617-eae4-418b-9752-ad87b5dfb5cd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:59.130462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751617-eae4-418b-9752-ad87b5dfb5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:59.151159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb83a72-5530-4165-97b7-d39f1aeacc70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:59.154212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb83a72-5530-4165-97b7-d39f1aeacc70 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:59.161472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-78751617-eae4-418b-9752-ad87b5dfb5cd None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:59.162670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-78751617-eae4-418b-9752-ad87b5dfb5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:59.166680 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4124/8180] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:01:59.226714 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4057/8181] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:01:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:01:59.241666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb83a72-5530-4165-97b7-d39f1aeacc70 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:59.243528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3cb83a72-5530-4165-97b7-d39f1aeacc70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:59.314878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:59.343359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb83a72-5530-4165-97b7-d39f1aeacc70 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:59.350678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d23617-98f7-4a11-91f8-e4d402eddf9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:59.352259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23617-98f7-4a11-91f8-e4d402eddf9a service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:59.352656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23617-98f7-4a11-91f8-e4d402eddf9a service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:59.353037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23617-98f7-4a11-91f8-e4d402eddf9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:59.364503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d23617-98f7-4a11-91f8-e4d402eddf9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:59.366498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d23617-98f7-4a11-91f8-e4d402eddf9a service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:59.378814 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4125/8182] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:01:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:59.642193 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78751617-eae4-418b-9752-ad87b5dfb5cd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:59.644500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-78751617-eae4-418b-9752-ad87b5dfb5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:59.672241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78751617-eae4-418b-9752-ad87b5dfb5cd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:59.685688 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:01:59.686608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:59.687145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:59.687523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] PATH_INFO: `/v3/projects/bee3dd2e51d9499580fb822615fd1edb` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:59.689598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee3dd2e51d9499580fb822615fd1edb)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:01:59.694859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:01:59.786275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee3dd2e51d9499580fb822615fd1edb', 'request_id': 'req-c9cb2224-691f-4383-94d6-eee987d441dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:59.797804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee3dd2e51d9499580fb822615fd1edb', 'request_id': 'req-c9cb2224-691f-4383-94d6-eee987d441dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:59.814894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee3dd2e51d9499580fb822615fd1edb', 'request_id': 'req-c9cb2224-691f-4383-94d6-eee987d441dc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:59.839276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] The token cache is being invalidate because project bee3dd2e51d9499580fb822615fd1edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:01:59.839794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:59.840747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c9cb2224-691f-4383-94d6-eee987d441dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:01:59.843795 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4058/8183] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:01:59 2022] DELETE /identity/v3/projects/bee3dd2e51d9499580fb822615fd1edb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:01:59.848107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d23617-98f7-4a11-91f8-e4d402eddf9a service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:01:59.861626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d23617-98f7-4a11-91f8-e4d402eddf9a service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:01:59.917217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262ab8-725a-4ce0-973e-afef96d20971 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:01:59.918463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262ab8-725a-4ce0-973e-afef96d20971 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:01:59.918987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262ab8-725a-4ce0-973e-afef96d20971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:01:59.943732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0c262ab8-725a-4ce0-973e-afef96d20971 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:01:59.945323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0c262ab8-725a-4ce0-973e-afef96d20971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:01:59.998398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:00.000514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:00.001238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:00.001758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] PATH_INFO: `/v3/users/c515af2c77174af0a8528210e88f2280` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:00.007152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c515af2c77174af0a8528210e88f2280)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:00.009514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:00.048599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:00.089020 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4059/8184] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 16:01:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:00.091510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c262ab8-725a-4ce0-973e-afef96d20971 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:00.096292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0c262ab8-725a-4ce0-973e-afef96d20971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:00.123174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c515af2c77174af0a8528210e88f2280'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:00.124238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c515af2c77174af0a8528210e88f2280'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:00.153511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c515af2c77174af0a8528210e88f2280'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:00.154618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c515af2c77174af0a8528210e88f2280'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:00.168231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c515af2c77174af0a8528210e88f2280'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:00.194763 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4126/8185] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:01:59 2022] DELETE /identity/v3/users/c515af2c77174af0a8528210e88f2280 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:00.269331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c262ab8-725a-4ce0-973e-afef96d20971 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:00.379849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842a356-e33e-41fc-962a-216b9f0ccaa0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:00.381566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842a356-e33e-41fc-962a-216b9f0ccaa0 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:00.382083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842a356-e33e-41fc-962a-216b9f0ccaa0 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:00.382834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842a356-e33e-41fc-962a-216b9f0ccaa0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:00.386321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0842a356-e33e-41fc-962a-216b9f0ccaa0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:00.555911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842a356-e33e-41fc-962a-216b9f0ccaa0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:00.557604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842a356-e33e-41fc-962a-216b9f0ccaa0 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:00.578961 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4060/8186] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:02:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:02:01.046033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:01.047690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:01.148205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ffbc0-77b8-4fa4-a8e7-b3a6f33d460e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:01.154107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:01.159655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:01.160260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:01.161090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] PATH_INFO: `/v3/projects/eb4a5b3125b046f7b1dc8935463813c9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:01.162645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4a5b3125b046f7b1dc8935463813c9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:01.164898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:01.183121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:01.275768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4a5b3125b046f7b1dc8935463813c9', 'request_id': 'req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:01.283392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4a5b3125b046f7b1dc8935463813c9', 'request_id': 'req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:01.294235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4a5b3125b046f7b1dc8935463813c9', 'request_id': 'req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:01.314444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] The token cache is being invalidate because project eb4a5b3125b046f7b1dc8935463813c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:02:01.315032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:01.316756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ab5e4b68-ea0f-450d-a61b-c9d6baf4786f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:01.319013 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4127/8187] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:02:01 2022] DELETE /identity/v3/projects/eb4a5b3125b046f7b1dc8935463813c9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:01.324104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f43282-03c2-4542-a189-1cafcad7a86e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:01.324600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f43282-03c2-4542-a189-1cafcad7a86e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:01.324708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f43282-03c2-4542-a189-1cafcad7a86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:01.372414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b0f43282-03c2-4542-a189-1cafcad7a86e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:01.377250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b0f43282-03c2-4542-a189-1cafcad7a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:01.488354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:01.548387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a0c4-6a90-43f6-8300-5942d7a2d894 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:01.548678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a0c4-6a90-43f6-8300-5942d7a2d894 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:01.548955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a0c4-6a90-43f6-8300-5942d7a2d894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:01.564232 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4061/8188] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:02:01.590894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-aba3a0c4-6a90-43f6-8300-5942d7a2d894 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:01.592105 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-aba3a0c4-6a90-43f6-8300-5942d7a2d894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:01.621139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f43282-03c2-4542-a189-1cafcad7a86e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:01.627718 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4128/8189] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:01.633258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f43282-03c2-4542-a189-1cafcad7a86e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:01.646517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9192083-ce7a-4e4a-b918-f6330f62e0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:01.647262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9192083-ce7a-4e4a-b918-f6330f62e0bd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:01.647548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9192083-ce7a-4e4a-b918-f6330f62e0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:01.647819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9192083-ce7a-4e4a-b918-f6330f62e0bd admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:01.648577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9192083-ce7a-4e4a-b918-f6330f62e0bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:02:01.648886 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9192083-ce7a-4e4a-b918-f6330f62e0bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:01.652036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9192083-ce7a-4e4a-b918-f6330f62e0bd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:01.686993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3a0c4-6a90-43f6-8300-5942d7a2d894 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:01.698625 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4062/8190] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:02:01.699096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3a0c4-6a90-43f6-8300-5942d7a2d894 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:01.705683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985891f-fde7-45a9-95bd-65d3c2d167de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:01.709147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985891f-fde7-45a9-95bd-65d3c2d167de admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:01.709499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985891f-fde7-45a9-95bd-65d3c2d167de admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:01.709787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985891f-fde7-45a9-95bd-65d3c2d167de admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:01.710515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985891f-fde7-45a9-95bd-65d3c2d167de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:01.728335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985891f-fde7-45a9-95bd-65d3c2d167de admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:01.804345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9192083-ce7a-4e4a-b918-f6330f62e0bd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:01.812350 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4129/8191] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:02:01 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:01.819779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9192083-ce7a-4e4a-b918-f6330f62e0bd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:01.966714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbfa50-7c11-470e-a8cb-d86dae1ef047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:01.967930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfa50-7c11-470e-a8cb-d86dae1ef047 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:01.968597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfa50-7c11-470e-a8cb-d86dae1ef047 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:01.969050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfa50-7c11-470e-a8cb-d86dae1ef047 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:01.970406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbfa50-7c11-470e-a8cb-d86dae1ef047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:01.972966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbfa50-7c11-470e-a8cb-d86dae1ef047 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:02.021114 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4063/8192] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:02:01 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:02.023382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985891f-fde7-45a9-95bd-65d3c2d167de admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:02.038628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985891f-fde7-45a9-95bd-65d3c2d167de admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:02.054857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f5039-f742-49c5-9354-2d73266dc782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:02.055786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f5039-f742-49c5-9354-2d73266dc782 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:02.056085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f5039-f742-49c5-9354-2d73266dc782 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:02.057523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f5039-f742-49c5-9354-2d73266dc782 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:02.069328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f5039-f742-49c5-9354-2d73266dc782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:02.072714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f5039-f742-49c5-9354-2d73266dc782 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:02.123087 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4130/8193] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:02.126616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbfa50-7c11-470e-a8cb-d86dae1ef047 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:02.144781 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbfa50-7c11-470e-a8cb-d86dae1ef047 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:02.158946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec73fc-2e90-4e48-bef8-a70db4960b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:02.159683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec73fc-2e90-4e48-bef8-a70db4960b60 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:02.160063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec73fc-2e90-4e48-bef8-a70db4960b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:02.160438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec73fc-2e90-4e48-bef8-a70db4960b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:02.161189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec73fc-2e90-4e48-bef8-a70db4960b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:02.163000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec73fc-2e90-4e48-bef8-a70db4960b60 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:02.208916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f5039-f742-49c5-9354-2d73266dc782 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:02.211056 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4064/8194] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:02.229301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f5039-f742-49c5-9354-2d73266dc782 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:02.267258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c7a5a-1dc7-43f8-8e46-36b7f745446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:02.270017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c7a5a-1dc7-43f8-8e46-36b7f745446a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:02.272216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c7a5a-1dc7-43f8-8e46-36b7f745446a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:02.275224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c7a5a-1dc7-43f8-8e46-36b7f745446a admin admin] PATH_INFO: `/v3/projects/0d5fe04378c8466784f80ea16d5fab4d/users/08bde0ed99a7484aac626eefc7a3d9a8/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:02.333554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c7a5a-1dc7-43f8-8e46-36b7f745446a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5fe04378c8466784f80ea16d5fab4d, user_id=08bde0ed99a7484aac626eefc7a3d9a8, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:02.336533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c7a5a-1dc7-43f8-8e46-36b7f745446a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:02.407454 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4131/8195] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:02:02 2022] PUT /identity/v3/projects/0d5fe04378c8466784f80ea16d5fab4d/users/08bde0ed99a7484aac626eefc7a3d9a8/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:02.410078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3cfc7-8ea6-4226-8906-cec5f9981d9f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:02.410877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3cfc7-8ea6-4226-8906-cec5f9981d9f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:02.411162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3cfc7-8ea6-4226-8906-cec5f9981d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:02.471161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1fb3cfc7-8ea6-4226-8906-cec5f9981d9f None None] MFA Rules not processed for user `08bde0ed99a7484aac626eefc7a3d9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:02.475114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1fb3cfc7-8ea6-4226-8906-cec5f9981d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:02.694792 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4065/8196] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:02:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:02.707255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c7a5a-1dc7-43f8-8e46-36b7f745446a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:02.709527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-111c7a5a-1dc7-43f8-8e46-36b7f745446a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:02.807086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c7a5a-1dc7-43f8-8e46-36b7f745446a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:02.815935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580aa96e-856a-4a77-965a-08bfa401915b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:02.817522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aa96e-856a-4a77-965a-08bfa401915b service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:02.818040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aa96e-856a-4a77-965a-08bfa401915b service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:02.818538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aa96e-856a-4a77-965a-08bfa401915b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:02.831712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580aa96e-856a-4a77-965a-08bfa401915b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:02.833456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580aa96e-856a-4a77-965a-08bfa401915b service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:02.846317 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4132/8197] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:08.574540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3cfc7-8ea6-4226-8906-cec5f9981d9f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:08.576337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1fb3cfc7-8ea6-4226-8906-cec5f9981d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:08.739863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:08.836158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3cfc7-8ea6-4226-8906-cec5f9981d9f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:08.846909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:08.847555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:08.847851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:08.848114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] PATH_INFO: `/v3/users/84c5079395c946f0ad9bdadfad78421f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:08.851695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c5079395c946f0ad9bdadfad78421f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:08.853678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:08.990185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c5079395c946f0ad9bdadfad78421f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:08.991052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c5079395c946f0ad9bdadfad78421f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:09.030897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c5079395c946f0ad9bdadfad78421f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:09.052241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c5079395c946f0ad9bdadfad78421f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:09.070473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c5079395c946f0ad9bdadfad78421f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:09.081869 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4066/8198] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:02:08 2022] DELETE /identity/v3/users/84c5079395c946f0ad9bdadfad78421f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:09.088163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e2de-c279-41cd-a7e3-deec0aa4d67a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:09.089048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e2de-c279-41cd-a7e3-deec0aa4d67a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:09.089328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e2de-c279-41cd-a7e3-deec0aa4d67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:09.149504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-66c2e2de-c279-41cd-a7e3-deec0aa4d67a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:09.151164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66c2e2de-c279-41cd-a7e3-deec0aa4d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:09.242629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:09.351060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:09.352713 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4133/8199] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:09.353412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:09.604167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffb758-4c95-48a6-8e70-baba0938e2cd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:09.632884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c776647-c7e7-44d5-ab64-0277123e91d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:09.635654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776647-c7e7-44d5-ab64-0277123e91d7 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:09.640445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776647-c7e7-44d5-ab64-0277123e91d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:09.640445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776647-c7e7-44d5-ab64-0277123e91d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:09.664007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c776647-c7e7-44d5-ab64-0277123e91d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:09.669363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c776647-c7e7-44d5-ab64-0277123e91d7 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:09.696702 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4067/8200] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:10.254210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2e2de-c279-41cd-a7e3-deec0aa4d67a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:10.258478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66c2e2de-c279-41cd-a7e3-deec0aa4d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:10.293873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2e2de-c279-41cd-a7e3-deec0aa4d67a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:10.308197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:10.309356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:10.310779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:10.311499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] PATH_INFO: `/v3/projects/3aa392f4c8b448018e5183c22d620b11` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:10.320756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa392f4c8b448018e5183c22d620b11)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:10.452878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:10.576200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa392f4c8b448018e5183c22d620b11', 'request_id': 'req-8078a31f-e596-4059-a4ec-76af17740d28'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:10.587778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa392f4c8b448018e5183c22d620b11', 'request_id': 'req-8078a31f-e596-4059-a4ec-76af17740d28'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:10.596850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa392f4c8b448018e5183c22d620b11', 'request_id': 'req-8078a31f-e596-4059-a4ec-76af17740d28'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:10.632726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] The token cache is being invalidate because project 3aa392f4c8b448018e5183c22d620b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:02:10.633070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:10.637787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8078a31f-e596-4059-a4ec-76af17740d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:02:10.639830 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4134/8201] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:02:10 2022] DELETE /identity/v3/projects/3aa392f4c8b448018e5183c22d620b11 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:02:10.650852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71782647-b05d-4a74-ba04-03faf44714d7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:10.652169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71782647-b05d-4a74-ba04-03faf44714d7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:10.652877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71782647-b05d-4a74-ba04-03faf44714d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:10.698394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-71782647-b05d-4a74-ba04-03faf44714d7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:10.699816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-71782647-b05d-4a74-ba04-03faf44714d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:10.934149 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4068/8202] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:10.958493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55ace-94ab-4f31-814c-52662665691b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:10.958493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55ace-94ab-4f31-814c-52662665691b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:10.958493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55ace-94ab-4f31-814c-52662665691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:11.010394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-00c55ace-94ab-4f31-814c-52662665691b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:11.012038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-00c55ace-94ab-4f31-814c-52662665691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:11.028392 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4135/8203] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:11.029981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71782647-b05d-4a74-ba04-03faf44714d7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:11.035943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:11.047768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71782647-b05d-4a74-ba04-03faf44714d7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:11.057943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7583a0b-1321-465b-ac48-1ab274678770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:11.063157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7583a0b-1321-465b-ac48-1ab274678770 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:11.067754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7583a0b-1321-465b-ac48-1ab274678770 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:11.077049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7583a0b-1321-465b-ac48-1ab274678770 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:11.086535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7583a0b-1321-465b-ac48-1ab274678770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:02:11.086658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7583a0b-1321-465b-ac48-1ab274678770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:11.093925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7583a0b-1321-465b-ac48-1ab274678770 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:11.128289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c55ace-94ab-4f31-814c-52662665691b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:11.139403 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4069/8204] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:02:11.142052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c55ace-94ab-4f31-814c-52662665691b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:11.170371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb01c73-9edf-4b67-8fd7-3a2f69fa2dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:11.174931 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb01c73-9edf-4b67-8fd7-3a2f69fa2dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:11.175473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb01c73-9edf-4b67-8fd7-3a2f69fa2dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:11.175997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb01c73-9edf-4b67-8fd7-3a2f69fa2dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:11.177128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb01c73-9edf-4b67-8fd7-3a2f69fa2dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:11.180965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb01c73-9edf-4b67-8fd7-3a2f69fa2dc2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:11.301753 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4136/8205] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:02:11 2022] POST /identity/v3/projects => generated 391 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:11.303122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7583a0b-1321-465b-ac48-1ab274678770 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:11.314764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7583a0b-1321-465b-ac48-1ab274678770 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:11.548823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ab4c8-327f-4355-a415-fe90f5fbd059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:11.550327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ab4c8-327f-4355-a415-fe90f5fbd059 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:11.550649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ab4c8-327f-4355-a415-fe90f5fbd059 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:11.550895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ab4c8-327f-4355-a415-fe90f5fbd059 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:11.552787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ab4c8-327f-4355-a415-fe90f5fbd059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:11.558169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ab4c8-327f-4355-a415-fe90f5fbd059 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:11.604564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb01c73-9edf-4b67-8fd7-3a2f69fa2dc2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:11.618583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb01c73-9edf-4b67-8fd7-3a2f69fa2dc2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:11.619328 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4070/8206] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:02:11 2022] POST /identity/v3/users => generated 296 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:11.636869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05da97c-24fa-4bb8-8770-4e6cbe1e9d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:11.637701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05da97c-24fa-4bb8-8770-4e6cbe1e9d81 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:11.637701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05da97c-24fa-4bb8-8770-4e6cbe1e9d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:11.637701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05da97c-24fa-4bb8-8770-4e6cbe1e9d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:11.641270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05da97c-24fa-4bb8-8770-4e6cbe1e9d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:11.645851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05da97c-24fa-4bb8-8770-4e6cbe1e9d81 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:11.676925 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4137/8207] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:11.684959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ab4c8-327f-4355-a415-fe90f5fbd059 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:11.705243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ab4c8-327f-4355-a415-fe90f5fbd059 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:11.743628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedb988-a32d-4350-a6d0-96be320e39d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:11.748246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb988-a32d-4350-a6d0-96be320e39d6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:11.749033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb988-a32d-4350-a6d0-96be320e39d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:11.751840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb988-a32d-4350-a6d0-96be320e39d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:11.754542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedb988-a32d-4350-a6d0-96be320e39d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:11.757576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedb988-a32d-4350-a6d0-96be320e39d6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:11.788722 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4071/8208] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:11.792771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05da97c-24fa-4bb8-8770-4e6cbe1e9d81 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:11.807071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05da97c-24fa-4bb8-8770-4e6cbe1e9d81 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:11.825368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4da0b-2972-4ad1-b827-c1ba023c51e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:11.829929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4da0b-2972-4ad1-b827-c1ba023c51e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:11.830513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4da0b-2972-4ad1-b827-c1ba023c51e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:11.831120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4da0b-2972-4ad1-b827-c1ba023c51e5 admin admin] PATH_INFO: `/v3/projects/fa29b3844343454c8ade410470e7d897/users/64dd24ea45ac485d8d411837d7078301/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:11.900602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4da0b-2972-4ad1-b827-c1ba023c51e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa29b3844343454c8ade410470e7d897, user_id=64dd24ea45ac485d8d411837d7078301, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:11.905777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4da0b-2972-4ad1-b827-c1ba023c51e5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:11.929934 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4138/8209] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:02:11 2022] PUT /identity/v3/projects/fa29b3844343454c8ade410470e7d897/users/64dd24ea45ac485d8d411837d7078301/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:02:11.940817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956298-1594-4066-89f2-cfd295fc5442 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:11.941422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956298-1594-4066-89f2-cfd295fc5442 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:11.941954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956298-1594-4066-89f2-cfd295fc5442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:11.981002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3b956298-1594-4066-89f2-cfd295fc5442 None None] MFA Rules not processed for user `64dd24ea45ac485d8d411837d7078301`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:11.983481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3b956298-1594-4066-89f2-cfd295fc5442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:12.109474 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4072/8210] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:02:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:12.114605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4da0b-2972-4ad1-b827-c1ba023c51e5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:12.246590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:12.262742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4da0b-2972-4ad1-b827-c1ba023c51e5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:12.285637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e156b4-f497-4369-8006-230cdcf74fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:12.286272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e156b4-f497-4369-8006-230cdcf74fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:12.286555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e156b4-f497-4369-8006-230cdcf74fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:12.286981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e156b4-f497-4369-8006-230cdcf74fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:12.287510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e156b4-f497-4369-8006-230cdcf74fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:12.289453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e156b4-f497-4369-8006-230cdcf74fa1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:12.343667 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4139/8211] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:02:12 2022] POST /identity/v3/projects => generated 391 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:12.347515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956298-1594-4066-89f2-cfd295fc5442 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:12.365732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956298-1594-4066-89f2-cfd295fc5442 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:12.498279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:12.512656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f5bf7-1550-4cb9-874a-87f6ace01e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:12.513419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f5bf7-1550-4cb9-874a-87f6ace01e89 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:12.513763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f5bf7-1550-4cb9-874a-87f6ace01e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:12.514109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f5bf7-1550-4cb9-874a-87f6ace01e89 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:12.514970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f5bf7-1550-4cb9-874a-87f6ace01e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:12.516972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f5bf7-1550-4cb9-874a-87f6ace01e89 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:12.548347 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4073/8212] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:02:12 2022] POST /identity/v3/users => generated 302 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:02:12.555256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e156b4-f497-4369-8006-230cdcf74fa1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:12.572573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e156b4-f497-4369-8006-230cdcf74fa1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:12.583987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdec6d-268c-4a78-a6ff-e5e037801b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:12.584618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdec6d-268c-4a78-a6ff-e5e037801b27 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:12.584899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdec6d-268c-4a78-a6ff-e5e037801b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:12.585170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdec6d-268c-4a78-a6ff-e5e037801b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:12.585849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdec6d-268c-4a78-a6ff-e5e037801b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:12.590373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdec6d-268c-4a78-a6ff-e5e037801b27 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:12.624852 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4140/8213] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:12.629284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f5bf7-1550-4cb9-874a-87f6ace01e89 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:12.645249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f5bf7-1550-4cb9-874a-87f6ace01e89 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:12.651581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364cd84-0105-4d19-a0fc-bb608ddec9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:12.652303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364cd84-0105-4d19-a0fc-bb608ddec9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:12.652589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364cd84-0105-4d19-a0fc-bb608ddec9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:12.652871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364cd84-0105-4d19-a0fc-bb608ddec9b6 admin admin] PATH_INFO: `/v3/projects/72278a148b104eb88fee0e2384fc83b4/users/a2100452cd4444db9467899791cd745c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:12.673352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364cd84-0105-4d19-a0fc-bb608ddec9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72278a148b104eb88fee0e2384fc83b4, user_id=a2100452cd4444db9467899791cd745c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:12.676959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364cd84-0105-4d19-a0fc-bb608ddec9b6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:12.704595 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4074/8214] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:02:12 2022] PUT /identity/v3/projects/72278a148b104eb88fee0e2384fc83b4/users/a2100452cd4444db9467899791cd745c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:02:12.708665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdec6d-268c-4a78-a6ff-e5e037801b27 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:12.726059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdec6d-268c-4a78-a6ff-e5e037801b27 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:12.816739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffec50-feca-46b4-869c-4c5237afe8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:12.817654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffec50-feca-46b4-869c-4c5237afe8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:12.818045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffec50-feca-46b4-869c-4c5237afe8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:12.818458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffec50-feca-46b4-869c-4c5237afe8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:12.821901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffec50-feca-46b4-869c-4c5237afe8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:12.824515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffec50-feca-46b4-869c-4c5237afe8b8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:12.859578 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4141/8215] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:02:12.862939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364cd84-0105-4d19-a0fc-bb608ddec9b6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:12.904606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364cd84-0105-4d19-a0fc-bb608ddec9b6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:12.927188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9bb2b-55c8-46ad-8d94-a2b724da10a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:12.928134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9bb2b-55c8-46ad-8d94-a2b724da10a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:12.928817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9bb2b-55c8-46ad-8d94-a2b724da10a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:12.929254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9bb2b-55c8-46ad-8d94-a2b724da10a3 admin admin] PATH_INFO: `/v3/projects/72278a148b104eb88fee0e2384fc83b4/users/a2100452cd4444db9467899791cd745c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:12.931649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9bb2b-55c8-46ad-8d94-a2b724da10a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72278a148b104eb88fee0e2384fc83b4, user_id=a2100452cd4444db9467899791cd745c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:12.935040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9bb2b-55c8-46ad-8d94-a2b724da10a3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:12.949550 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4075/8216] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:02:12 2022] PUT /identity/v3/projects/72278a148b104eb88fee0e2384fc83b4/users/a2100452cd4444db9467899791cd745c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:02:12.963934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f45a-0463-4ee1-a9a6-639bf7321afd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:12.964913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f45a-0463-4ee1-a9a6-639bf7321afd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:12.965440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f45a-0463-4ee1-a9a6-639bf7321afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:13.048644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6471f45a-0463-4ee1-a9a6-639bf7321afd None None] MFA Rules not processed for user `a2100452cd4444db9467899791cd745c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:13.050446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6471f45a-0463-4ee1-a9a6-639bf7321afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:13.234159 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4142/8217] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:02:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:13.241793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9bb2b-55c8-46ad-8d94-a2b724da10a3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:13.243901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b2e9bb2b-55c8-46ad-8d94-a2b724da10a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:13.371045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9bb2b-55c8-46ad-8d94-a2b724da10a3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:13.378268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517bee4-92d8-4042-8f26-2ed12104705c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:13.378948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517bee4-92d8-4042-8f26-2ed12104705c service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:13.379237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517bee4-92d8-4042-8f26-2ed12104705c service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:13.379518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517bee4-92d8-4042-8f26-2ed12104705c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:13.510789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517bee4-92d8-4042-8f26-2ed12104705c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:13.516051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517bee4-92d8-4042-8f26-2ed12104705c service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:13.535866 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4076/8218] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:20.951629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471f45a-0463-4ee1-a9a6-639bf7321afd None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:20.953747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6471f45a-0463-4ee1-a9a6-639bf7321afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:21.111289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471f45a-0463-4ee1-a9a6-639bf7321afd None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:21.111289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17802456-64ac-4909-ab02-ccfd2e70e03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:21.111289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802456-64ac-4909-ab02-ccfd2e70e03c service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:21.111289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802456-64ac-4909-ab02-ccfd2e70e03c service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:21.111846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802456-64ac-4909-ab02-ccfd2e70e03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:21.112367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:21.124227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17802456-64ac-4909-ab02-ccfd2e70e03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:21.127036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17802456-64ac-4909-ab02-ccfd2e70e03c service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:21.214943 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4143/8219] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:20 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:23.527685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:27.898361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fec94-094f-403e-b420-82729bdb7717 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:27.899604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fec94-094f-403e-b420-82729bdb7717 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:27.899604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fec94-094f-403e-b420-82729bdb7717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:27.929275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-579fec94-094f-403e-b420-82729bdb7717 None None] MFA Rules not processed for user `64dd24ea45ac485d8d411837d7078301`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:02:27.930541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-579fec94-094f-403e-b420-82729bdb7717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:27.946192 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4077/8220] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:02:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:02:31.147680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:33.921376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17802456-64ac-4909-ab02-ccfd2e70e03c service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:33.947276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17802456-64ac-4909-ab02-ccfd2e70e03c service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:33.963345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28c1ff-52b5-44c5-be1b-1a2b0cbd3123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:33.964662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28c1ff-52b5-44c5-be1b-1a2b0cbd3123 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:33.965170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28c1ff-52b5-44c5-be1b-1a2b0cbd3123 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:33.965980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28c1ff-52b5-44c5-be1b-1a2b0cbd3123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:33.977824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1a28c1ff-52b5-44c5-be1b-1a2b0cbd3123 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:34.009695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28c1ff-52b5-44c5-be1b-1a2b0cbd3123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:34.012407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28c1ff-52b5-44c5-be1b-1a2b0cbd3123 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:34.044110 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4144/8221] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:02:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:02:37.918334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:38.768487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fec94-094f-403e-b420-82729bdb7717 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:02:38.770211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-579fec94-094f-403e-b420-82729bdb7717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:38.961433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fec94-094f-403e-b420-82729bdb7717 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:02:38.984625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbd7cd-992e-4eda-8b74-fd9592a1fc73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:02:38.985283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd7cd-992e-4eda-8b74-fd9592a1fc73 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:02:38.985591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd7cd-992e-4eda-8b74-fd9592a1fc73 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:02:38.985871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd7cd-992e-4eda-8b74-fd9592a1fc73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:02:38.991253 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6dcbd7cd-992e-4eda-8b74-fd9592a1fc73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:02:39.157732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbd7cd-992e-4eda-8b74-fd9592a1fc73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:02:39.159922 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbd7cd-992e-4eda-8b74-fd9592a1fc73 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:02:39.190206 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4078/8222] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:02:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:02:44.030002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:49.178155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=56 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:04.837029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28c1ff-52b5-44c5-be1b-1a2b0cbd3123 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:04.839203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1a28c1ff-52b5-44c5-be1b-1a2b0cbd3123 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:04.948083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28c1ff-52b5-44c5-be1b-1a2b0cbd3123 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:04.957473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:04.958377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:04.958793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:04.959203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] PATH_INFO: `/v3/users/ca2de1b05cb84d8daf8488bf21895e08` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:04.961729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2de1b05cb84d8daf8488bf21895e08)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:04.964247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:05.055169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2de1b05cb84d8daf8488bf21895e08'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:05.055600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2de1b05cb84d8daf8488bf21895e08'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:05.079457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2de1b05cb84d8daf8488bf21895e08'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:05.080723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2de1b05cb84d8daf8488bf21895e08'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:05.092502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2de1b05cb84d8daf8488bf21895e08'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:05.109519 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4145/8223] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:03:04 2022] DELETE /identity/v3/users/ca2de1b05cb84d8daf8488bf21895e08 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:05.114645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70161cb-6217-445d-a3c4-aa7c39249f7c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:05.115098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70161cb-6217-445d-a3c4-aa7c39249f7c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:05.115187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70161cb-6217-445d-a3c4-aa7c39249f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:05.154977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b70161cb-6217-445d-a3c4-aa7c39249f7c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:05.159391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b70161cb-6217-445d-a3c4-aa7c39249f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:05.268085 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4079/8224] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:05.281505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:05.283780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:05.369613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c6bc9-8d4c-4492-af83-99109ddc96b7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:05.373720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff45be-fa8f-4eb1-a6e2-7fd4d6126e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:05.374561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff45be-fa8f-4eb1-a6e2-7fd4d6126e30 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:05.374900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff45be-fa8f-4eb1-a6e2-7fd4d6126e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:05.375441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff45be-fa8f-4eb1-a6e2-7fd4d6126e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:05.391178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff45be-fa8f-4eb1-a6e2-7fd4d6126e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:05.392710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff45be-fa8f-4eb1-a6e2-7fd4d6126e30 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:05.405236 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4146/8225] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:05.834793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70161cb-6217-445d-a3c4-aa7c39249f7c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:05.836701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b70161cb-6217-445d-a3c4-aa7c39249f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:05.855001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70161cb-6217-445d-a3c4-aa7c39249f7c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:05.865176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:05.866755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:05.867168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:05.867708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] PATH_INFO: `/v3/projects/e48b07db55094e27929b97225dfffa36` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:05.869299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48b07db55094e27929b97225dfffa36)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:05.871840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:05.961240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48b07db55094e27929b97225dfffa36', 'request_id': 'req-5ea78194-1e21-46f3-9d08-1c5c3473a973'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:05.981599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48b07db55094e27929b97225dfffa36', 'request_id': 'req-5ea78194-1e21-46f3-9d08-1c5c3473a973'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:05.996020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48b07db55094e27929b97225dfffa36', 'request_id': 'req-5ea78194-1e21-46f3-9d08-1c5c3473a973'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:06.031335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] The token cache is being invalidate because project e48b07db55094e27929b97225dfffa36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:03:06.031663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:06.032349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ea78194-1e21-46f3-9d08-1c5c3473a973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:06.034768 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4080/8226] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:03:05 2022] DELETE /identity/v3/projects/e48b07db55094e27929b97225dfffa36 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:06.039443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee186c-b8c1-460e-af4e-1a127f6fc10f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.039909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee186c-b8c1-460e-af4e-1a127f6fc10f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.040020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee186c-b8c1-460e-af4e-1a127f6fc10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.063779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7aee186c-b8c1-460e-af4e-1a127f6fc10f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:06.065974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7aee186c-b8c1-460e-af4e-1a127f6fc10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:06.090709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:06.174670 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4147/8227] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:06.183117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59655-ecde-4fc6-accf-4ebefcfcf5e8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.183668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59655-ecde-4fc6-accf-4ebefcfcf5e8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.183668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59655-ecde-4fc6-accf-4ebefcfcf5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.211539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ede59655-ecde-4fc6-accf-4ebefcfcf5e8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:06.213264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ede59655-ecde-4fc6-accf-4ebefcfcf5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:06.227879 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4081/8228] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:06.228943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee186c-b8c1-460e-af4e-1a127f6fc10f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:06.245557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee186c-b8c1-460e-af4e-1a127f6fc10f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:06.279377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5301e-57ac-4a7a-899b-a854053c0999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:06.280066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5301e-57ac-4a7a-899b-a854053c0999 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.280349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5301e-57ac-4a7a-899b-a854053c0999 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.280648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5301e-57ac-4a7a-899b-a854053c0999 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.282137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5301e-57ac-4a7a-899b-a854053c0999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:03:06.282571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5301e-57ac-4a7a-899b-a854053c0999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:06.292755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5301e-57ac-4a7a-899b-a854053c0999 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:06.358085 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4148/8229] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:03:06.359643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede59655-ecde-4fc6-accf-4ebefcfcf5e8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:06.375104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede59655-ecde-4fc6-accf-4ebefcfcf5e8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:06.385281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92874211-5a45-40ad-9942-56c2bec9ca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:06.386435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874211-5a45-40ad-9942-56c2bec9ca31 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.387354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874211-5a45-40ad-9942-56c2bec9ca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.387785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874211-5a45-40ad-9942-56c2bec9ca31 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.388574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92874211-5a45-40ad-9942-56c2bec9ca31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:06.398025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92874211-5a45-40ad-9942-56c2bec9ca31 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:06.453468 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4082/8230] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:03:06 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:06.457747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5301e-57ac-4a7a-899b-a854053c0999 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:06.468549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5301e-57ac-4a7a-899b-a854053c0999 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:06.553918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068c427-04f8-4398-98fc-c103236bba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:06.554521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068c427-04f8-4398-98fc-c103236bba4f admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.554799 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068c427-04f8-4398-98fc-c103236bba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.555070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068c427-04f8-4398-98fc-c103236bba4f admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.555694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068c427-04f8-4398-98fc-c103236bba4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:06.557783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068c427-04f8-4398-98fc-c103236bba4f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:06.588138 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4149/8231] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:03:06 2022] POST /identity/v3/users => generated 282 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:03:06.589611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92874211-5a45-40ad-9942-56c2bec9ca31 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:06.603495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92874211-5a45-40ad-9942-56c2bec9ca31 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:06.609189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356e9d-b3a4-40c7-8908-3aa5149521a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:06.610075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356e9d-b3a4-40c7-8908-3aa5149521a3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.610470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356e9d-b3a4-40c7-8908-3aa5149521a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.610867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356e9d-b3a4-40c7-8908-3aa5149521a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.612195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356e9d-b3a4-40c7-8908-3aa5149521a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:06.614609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356e9d-b3a4-40c7-8908-3aa5149521a3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:06.634975 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4083/8232] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:03:06.635158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068c427-04f8-4398-98fc-c103236bba4f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:06.657541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068c427-04f8-4398-98fc-c103236bba4f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:06.702364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685cad3-a9d8-4a70-8a23-dabcd593ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:06.714888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685cad3-a9d8-4a70-8a23-dabcd593ce57 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.714888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685cad3-a9d8-4a70-8a23-dabcd593ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.714888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685cad3-a9d8-4a70-8a23-dabcd593ce57 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.721867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685cad3-a9d8-4a70-8a23-dabcd593ce57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:06.723787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685cad3-a9d8-4a70-8a23-dabcd593ce57 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:06.764254 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4150/8233] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:06.768888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356e9d-b3a4-40c7-8908-3aa5149521a3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:06.800828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356e9d-b3a4-40c7-8908-3aa5149521a3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:06.834299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968ede4-467d-41c1-851c-080884c826b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:06.835054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968ede4-467d-41c1-851c-080884c826b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.835332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968ede4-467d-41c1-851c-080884c826b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.835607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968ede4-467d-41c1-851c-080884c826b2 admin admin] PATH_INFO: `/v3/projects/12bf00bf3d4243f4be9d0475cf8be3f0/users/a07c7f7f5025466781f741a07e207a94/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.870512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968ede4-467d-41c1-851c-080884c826b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12bf00bf3d4243f4be9d0475cf8be3f0, user_id=a07c7f7f5025466781f741a07e207a94, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:06.873351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968ede4-467d-41c1-851c-080884c826b2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:06.900961 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4084/8234] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:06 2022] PUT /identity/v3/projects/12bf00bf3d4243f4be9d0475cf8be3f0/users/a07c7f7f5025466781f741a07e207a94/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:06.912189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab198c0-f557-4d94-aead-3c8c203f3e65 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:06.913036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab198c0-f557-4d94-aead-3c8c203f3e65 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:06.913538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab198c0-f557-4d94-aead-3c8c203f3e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:06.961683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1ab198c0-f557-4d94-aead-3c8c203f3e65 None None] MFA Rules not processed for user `a07c7f7f5025466781f741a07e207a94`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:06.963439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1ab198c0-f557-4d94-aead-3c8c203f3e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:07.068364 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4151/8235] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:03:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:07.075527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968ede4-467d-41c1-851c-080884c826b2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:07.077612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3968ede4-467d-41c1-851c-080884c826b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:07.112936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:07.211597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968ede4-467d-41c1-851c-080884c826b2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:07.216325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0fd8e-f78d-455f-bf68-167efedc759a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:07.217004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0fd8e-f78d-455f-bf68-167efedc759a service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:07.217548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0fd8e-f78d-455f-bf68-167efedc759a service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:07.217928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0fd8e-f78d-455f-bf68-167efedc759a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:07.232084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0fd8e-f78d-455f-bf68-167efedc759a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:07.233905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0fd8e-f78d-455f-bf68-167efedc759a service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:07.245665 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4085/8236] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:12.610106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab198c0-f557-4d94-aead-3c8c203f3e65 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:12.611877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1ab198c0-f557-4d94-aead-3c8c203f3e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:12.642636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:12.856973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab198c0-f557-4d94-aead-3c8c203f3e65 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:12.868667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fd820-8d6e-4c23-9e95-eeb36fcd5b8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:12.869955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fd820-8d6e-4c23-9e95-eeb36fcd5b8b service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:12.870390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fd820-8d6e-4c23-9e95-eeb36fcd5b8b service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:12.870794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fd820-8d6e-4c23-9e95-eeb36fcd5b8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:12.872875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c60fd820-8d6e-4c23-9e95-eeb36fcd5b8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:12.894820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fd820-8d6e-4c23-9e95-eeb36fcd5b8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:12.898870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fd820-8d6e-4c23-9e95-eeb36fcd5b8b service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:12.928478 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4152/8237] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:17.240676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=17 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:20.822612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0fd8e-f78d-455f-bf68-167efedc759a service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:20.844668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0fd8e-f78d-455f-bf68-167efedc759a service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:20.867937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98650-ec75-4057-ab17-3048fb633c63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:20.872769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98650-ec75-4057-ab17-3048fb633c63 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:20.873462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98650-ec75-4057-ab17-3048fb633c63 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:20.873882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98650-ec75-4057-ab17-3048fb633c63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:20.876112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-56b98650-ec75-4057-ab17-3048fb633c63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:20.944143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98650-ec75-4057-ab17-3048fb633c63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:20.948140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98650-ec75-4057-ab17-3048fb633c63 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:20.974379 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4086/8238] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:21.345712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fd820-8d6e-4c23-9e95-eeb36fcd5b8b service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:21.354117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c60fd820-8d6e-4c23-9e95-eeb36fcd5b8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:21.375531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fd820-8d6e-4c23-9e95-eeb36fcd5b8b service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:21.397163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2109861-db21-4dd9-906f-ad37bf548504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:21.397764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2109861-db21-4dd9-906f-ad37bf548504 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:21.398149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2109861-db21-4dd9-906f-ad37bf548504 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:21.405013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2109861-db21-4dd9-906f-ad37bf548504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:21.407854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a2109861-db21-4dd9-906f-ad37bf548504 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:21.433408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2109861-db21-4dd9-906f-ad37bf548504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:21.435069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2109861-db21-4dd9-906f-ad37bf548504 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:21.454535 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4153/8239] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:21.644916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98650-ec75-4057-ab17-3048fb633c63 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:21.646592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-56b98650-ec75-4057-ab17-3048fb633c63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:21.696559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98650-ec75-4057-ab17-3048fb633c63 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:21.704813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aa9eb-4c9b-4201-91ca-2adf7b299cdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:21.705528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aa9eb-4c9b-4201-91ca-2adf7b299cdb service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:21.705883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aa9eb-4c9b-4201-91ca-2adf7b299cdb service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:21.706257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aa9eb-4c9b-4201-91ca-2adf7b299cdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:21.708219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5f1aa9eb-4c9b-4201-91ca-2adf7b299cdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:21.730006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aa9eb-4c9b-4201-91ca-2adf7b299cdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:21.733319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aa9eb-4c9b-4201-91ca-2adf7b299cdb service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:21.780643 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4087/8240] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:22.315967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2109861-db21-4dd9-906f-ad37bf548504 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:22.329233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2109861-db21-4dd9-906f-ad37bf548504 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:22.334951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd1b4-7405-46f5-943b-c3600840a606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:22.335922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd1b4-7405-46f5-943b-c3600840a606 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:22.339476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd1b4-7405-46f5-943b-c3600840a606 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:22.339845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd1b4-7405-46f5-943b-c3600840a606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:22.344274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7ddfd1b4-7405-46f5-943b-c3600840a606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:22.528450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd1b4-7405-46f5-943b-c3600840a606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:22.543614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd1b4-7405-46f5-943b-c3600840a606 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:22.576820 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4154/8241] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:22.811600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aa9eb-4c9b-4201-91ca-2adf7b299cdb service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:22.832587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aa9eb-4c9b-4201-91ca-2adf7b299cdb service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:22.848696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402dbb6-1e2c-49b7-9552-92823e2fb2b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:22.851361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402dbb6-1e2c-49b7-9552-92823e2fb2b1 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:22.851859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402dbb6-1e2c-49b7-9552-92823e2fb2b1 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:22.856014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402dbb6-1e2c-49b7-9552-92823e2fb2b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:22.862014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3402dbb6-1e2c-49b7-9552-92823e2fb2b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:22.886304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402dbb6-1e2c-49b7-9552-92823e2fb2b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:22.888584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402dbb6-1e2c-49b7-9552-92823e2fb2b1 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:22.933451 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4088/8242] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:32.556960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=64 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:32.898219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=18 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:35.493831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd1b4-7405-46f5-943b-c3600840a606 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:35.495624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7ddfd1b4-7405-46f5-943b-c3600840a606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:35.664994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd1b4-7405-46f5-943b-c3600840a606 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:35.673465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:35.674331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:35.674628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:35.674907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] PATH_INFO: `/v3/users/08bde0ed99a7484aac626eefc7a3d9a8` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:35.678004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=08bde0ed99a7484aac626eefc7a3d9a8)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:35.681713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:35.768773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08bde0ed99a7484aac626eefc7a3d9a8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:35.769116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08bde0ed99a7484aac626eefc7a3d9a8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:35.784406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08bde0ed99a7484aac626eefc7a3d9a8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:35.785219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08bde0ed99a7484aac626eefc7a3d9a8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:35.800243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08bde0ed99a7484aac626eefc7a3d9a8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:35.817823 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4155/8243] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:03:35 2022] DELETE /identity/v3/users/08bde0ed99a7484aac626eefc7a3d9a8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:35.822650 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4e29c-99a7-4288-a8ad-f6a07b977d5c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:35.823227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4e29c-99a7-4288-a8ad-f6a07b977d5c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:35.823227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4e29c-99a7-4288-a8ad-f6a07b977d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:35.849367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e2f4e29c-99a7-4288-a8ad-f6a07b977d5c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:35.850558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e2f4e29c-99a7-4288-a8ad-f6a07b977d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:35.964733 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4089/8244] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:35.974514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:35.976575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:36.119805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b110b-64da-45b5-ab61-53bb55ec0a3f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:36.124766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d06c7c-cf22-4a7a-bb5f-2ce88074b698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:36.125559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d06c7c-cf22-4a7a-bb5f-2ce88074b698 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:36.126065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d06c7c-cf22-4a7a-bb5f-2ce88074b698 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:36.126445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d06c7c-cf22-4a7a-bb5f-2ce88074b698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:36.141859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d06c7c-cf22-4a7a-bb5f-2ce88074b698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:36.143671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d06c7c-cf22-4a7a-bb5f-2ce88074b698 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:36.164586 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4156/8245] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:37.019830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4e29c-99a7-4288-a8ad-f6a07b977d5c None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:37.021351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e2f4e29c-99a7-4288-a8ad-f6a07b977d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:37.053315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4e29c-99a7-4288-a8ad-f6a07b977d5c None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:37.074082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:37.074747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:37.075025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:37.075304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] PATH_INFO: `/v3/projects/0d5fe04378c8466784f80ea16d5fab4d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:37.086345 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5fe04378c8466784f80ea16d5fab4d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:37.088308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:37.205976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5fe04378c8466784f80ea16d5fab4d', 'request_id': 'req-5ef7d986-0413-4b81-81c8-716707bad7cd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:37.220072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5fe04378c8466784f80ea16d5fab4d', 'request_id': 'req-5ef7d986-0413-4b81-81c8-716707bad7cd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:37.246411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5fe04378c8466784f80ea16d5fab4d', 'request_id': 'req-5ef7d986-0413-4b81-81c8-716707bad7cd'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:37.271284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] The token cache is being invalidate because project 0d5fe04378c8466784f80ea16d5fab4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:03:37.271619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:37.273711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-5ef7d986-0413-4b81-81c8-716707bad7cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:03:37.277757 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4090/8246] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:03:37 2022] DELETE /identity/v3/projects/0d5fe04378c8466784f80ea16d5fab4d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:37.282949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989628-a2e7-4a73-8388-a6f87d8b8679 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:37.283455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989628-a2e7-4a73-8388-a6f87d8b8679 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:37.283530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989628-a2e7-4a73-8388-a6f87d8b8679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:37.339469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ae989628-a2e7-4a73-8388-a6f87d8b8679 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:37.341314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ae989628-a2e7-4a73-8388-a6f87d8b8679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:37.397952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:37.533910 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4157/8247] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:37.536016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddb667-86d4-4858-92e6-dc739642bf65 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:37.536585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddb667-86d4-4858-92e6-dc739642bf65 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:37.537067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddb667-86d4-4858-92e6-dc739642bf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:37.582763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-afddb667-86d4-4858-92e6-dc739642bf65 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:37.584025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-afddb667-86d4-4858-92e6-dc739642bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:37.630809 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4091/8248] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:37.636667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae989628-a2e7-4a73-8388-a6f87d8b8679 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:37.647125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae989628-a2e7-4a73-8388-a6f87d8b8679 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:37.672782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd77bd-820a-45e7-bbf9-dd3497a5dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:37.674067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd77bd-820a-45e7-bbf9-dd3497a5dffe admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:37.674403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd77bd-820a-45e7-bbf9-dd3497a5dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:37.674687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd77bd-820a-45e7-bbf9-dd3497a5dffe admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:37.675358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd77bd-820a-45e7-bbf9-dd3497a5dffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:03:37.675668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd77bd-820a-45e7-bbf9-dd3497a5dffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:37.678053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd77bd-820a-45e7-bbf9-dd3497a5dffe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:37.698373 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4158/8249] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:03:37.700180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddb667-86d4-4858-92e6-dc739642bf65 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:37.713468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddb667-86d4-4858-92e6-dc739642bf65 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:37.743012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477cdf4-aae9-4b7b-8468-96ddc7d96d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:37.743658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477cdf4-aae9-4b7b-8468-96ddc7d96d20 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:37.743944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477cdf4-aae9-4b7b-8468-96ddc7d96d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:37.744222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477cdf4-aae9-4b7b-8468-96ddc7d96d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:37.744894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477cdf4-aae9-4b7b-8468-96ddc7d96d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:37.746902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477cdf4-aae9-4b7b-8468-96ddc7d96d20 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:37.840071 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4092/8250] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:03:37 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:03:37.846199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd77bd-820a-45e7-bbf9-dd3497a5dffe admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:37.871743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd77bd-820a-45e7-bbf9-dd3497a5dffe admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:38.072969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2105b33-aeb4-4cc0-9f2e-b5e2e160ef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:38.076084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2105b33-aeb4-4cc0-9f2e-b5e2e160ef97 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:38.076402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2105b33-aeb4-4cc0-9f2e-b5e2e160ef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:38.076677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2105b33-aeb4-4cc0-9f2e-b5e2e160ef97 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:38.077376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2105b33-aeb4-4cc0-9f2e-b5e2e160ef97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:38.086184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2105b33-aeb4-4cc0-9f2e-b5e2e160ef97 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:38.141315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477cdf4-aae9-4b7b-8468-96ddc7d96d20 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:38.144436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6477cdf4-aae9-4b7b-8468-96ddc7d96d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:38.152490 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4159/8251] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:03:37 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:03:38.158622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2105b33-aeb4-4cc0-9f2e-b5e2e160ef97 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:38.184865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2105b33-aeb4-4cc0-9f2e-b5e2e160ef97 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:38.197753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7072-f1d5-45a5-8eab-cd48cecbc7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:38.198510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7072-f1d5-45a5-8eab-cd48cecbc7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:38.198846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7072-f1d5-45a5-8eab-cd48cecbc7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:38.202128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7072-f1d5-45a5-8eab-cd48cecbc7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:38.202128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e7072-f1d5-45a5-8eab-cd48cecbc7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:38.208563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e7072-f1d5-45a5-8eab-cd48cecbc7f4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:38.258934 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4160/8252] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:03:38.263453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7072-f1d5-45a5-8eab-cd48cecbc7f4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:38.292982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477cdf4-aae9-4b7b-8468-96ddc7d96d20 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:38.300507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7072-f1d5-45a5-8eab-cd48cecbc7f4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:38.308699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cc816-7abd-48fd-8f4a-7ee31c57a0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:38.309237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc816-7abd-48fd-8f4a-7ee31c57a0ea service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:38.309656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc816-7abd-48fd-8f4a-7ee31c57a0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:38.309847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc816-7abd-48fd-8f4a-7ee31c57a0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:38.313807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-223cc816-7abd-48fd-8f4a-7ee31c57a0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:38.319084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785cb44-841d-4b92-84d6-9b2669081ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:38.319084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785cb44-841d-4b92-84d6-9b2669081ffe admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:38.319084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785cb44-841d-4b92-84d6-9b2669081ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:38.319084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785cb44-841d-4b92-84d6-9b2669081ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:38.320557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785cb44-841d-4b92-84d6-9b2669081ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:38.322159 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785cb44-841d-4b92-84d6-9b2669081ffe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:38.336573 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4161/8253] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:03:38.340822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cc816-7abd-48fd-8f4a-7ee31c57a0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:38.340943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785cb44-841d-4b92-84d6-9b2669081ffe admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:38.342247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cc816-7abd-48fd-8f4a-7ee31c57a0ea service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:38.349850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:38.356408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785cb44-841d-4b92-84d6-9b2669081ffe admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:38.366776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334d419-a28b-42c4-8e29-3562df912e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:38.367549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334d419-a28b-42c4-8e29-3562df912e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:38.368068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334d419-a28b-42c4-8e29-3562df912e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:38.368365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334d419-a28b-42c4-8e29-3562df912e47 admin admin] PATH_INFO: `/v3/projects/8df11b687fb547f1b9fbfa1850faae8d/users/f3e97edd3e10433ca84d2a6206c1c521/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:38.386643 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4093/8254] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:38.468495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334d419-a28b-42c4-8e29-3562df912e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df11b687fb547f1b9fbfa1850faae8d, user_id=f3e97edd3e10433ca84d2a6206c1c521, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:38.474107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334d419-a28b-42c4-8e29-3562df912e47 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:38.605488 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4162/8255] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:03:38 2022] PUT /identity/v3/projects/8df11b687fb547f1b9fbfa1850faae8d/users/f3e97edd3e10433ca84d2a6206c1c521/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:03:38.609412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3223bc-2bb1-42dc-a534-e311a95b0987 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:38.610026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3223bc-2bb1-42dc-a534-e311a95b0987 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:38.610548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3223bc-2bb1-42dc-a534-e311a95b0987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:38.658930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9c3223bc-2bb1-42dc-a534-e311a95b0987 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:38.660489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9c3223bc-2bb1-42dc-a534-e311a95b0987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:38.850006 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4094/8256] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:38.939514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334d419-a28b-42c4-8e29-3562df912e47 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:38.942377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6334d419-a28b-42c4-8e29-3562df912e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:39.094581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334d419-a28b-42c4-8e29-3562df912e47 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:39.098409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85f86b-9f9d-463d-b9ee-77c3fa627d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:39.099187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85f86b-9f9d-463d-b9ee-77c3fa627d06 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:39.099478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85f86b-9f9d-463d-b9ee-77c3fa627d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:39.099924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85f86b-9f9d-463d-b9ee-77c3fa627d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:39.113091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:39.115832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85f86b-9f9d-463d-b9ee-77c3fa627d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:39.118423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85f86b-9f9d-463d-b9ee-77c3fa627d06 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:39.149464 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4163/8257] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:03:39.599140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3223bc-2bb1-42dc-a534-e311a95b0987 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:39.601209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9c3223bc-2bb1-42dc-a534-e311a95b0987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:39.846381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3223bc-2bb1-42dc-a534-e311a95b0987 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:39.861206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c774c3-d715-4ae0-bc8a-183cafa310a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:39.861971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c774c3-d715-4ae0-bc8a-183cafa310a8 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:39.862257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c774c3-d715-4ae0-bc8a-183cafa310a8 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:39.862541 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c774c3-d715-4ae0-bc8a-183cafa310a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:39.866208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c8c774c3-d715-4ae0-bc8a-183cafa310a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:39.896578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c774c3-d715-4ae0-bc8a-183cafa310a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:39.901604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c774c3-d715-4ae0-bc8a-183cafa310a8 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:39.944963 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4095/8258] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:41.113162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7982-58e5-4ee4-90ce-e5f69079d16f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:41.113717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7982-58e5-4ee4-90ce-e5f69079d16f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:41.114083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7982-58e5-4ee4-90ce-e5f69079d16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:41.139513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-598f7982-58e5-4ee4-90ce-e5f69079d16f None None] MFA Rules not processed for user `e276b9fae4594c17a1883dd4e48184c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:41.140977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-598f7982-58e5-4ee4-90ce-e5f69079d16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:41.242969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233fd0-545b-4210-b7dd-a3716522d045 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:41.244354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233fd0-545b-4210-b7dd-a3716522d045 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:41.244791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233fd0-545b-4210-b7dd-a3716522d045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:41.330620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8e233fd0-545b-4210-b7dd-a3716522d045 None None] MFA Rules not processed for user `f3e97edd3e10433ca84d2a6206c1c521`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:03:41.335633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8e233fd0-545b-4210-b7dd-a3716522d045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:41.421741 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4164/8259] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:03:41.492809 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4096/8260] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:03:41.515402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7982-58e5-4ee4-90ce-e5f69079d16f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:41.517860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-598f7982-58e5-4ee4-90ce-e5f69079d16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:41.706819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7982-58e5-4ee4-90ce-e5f69079d16f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:41.711386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e64e6f-a96f-4171-a3de-63a399ecf474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:41.712618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64e6f-a96f-4171-a3de-63a399ecf474 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:41.712618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64e6f-a96f-4171-a3de-63a399ecf474 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:41.712618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64e6f-a96f-4171-a3de-63a399ecf474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:41.726741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e64e6f-a96f-4171-a3de-63a399ecf474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:41.729113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e64e6f-a96f-4171-a3de-63a399ecf474 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:41.764006 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4165/8261] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:42.041890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e233fd0-545b-4210-b7dd-a3716522d045 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:03:42.055474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:42.075692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e233fd0-545b-4210-b7dd-a3716522d045 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:03:42.093129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14801be7-cc4b-4d6a-9dc5-1767d8a9163e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:03:42.094116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14801be7-cc4b-4d6a-9dc5-1767d8a9163e service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:03:42.094570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14801be7-cc4b-4d6a-9dc5-1767d8a9163e service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:03:42.095022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14801be7-cc4b-4d6a-9dc5-1767d8a9163e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:03:42.106515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-14801be7-cc4b-4d6a-9dc5-1767d8a9163e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:03:42.133024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14801be7-cc4b-4d6a-9dc5-1767d8a9163e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:03:42.134794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14801be7-cc4b-4d6a-9dc5-1767d8a9163e service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:03:42.154425 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4097/8262] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:03:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:03:51.735547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=68 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:52.149164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:08.296808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e64e6f-a96f-4171-a3de-63a399ecf474 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:08.298569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f9e64e6f-a96f-4171-a3de-63a399ecf474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:08.562122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e64e6f-a96f-4171-a3de-63a399ecf474 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:08.576546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74a3ca-bfdb-4ad3-97ce-5527ab7dbd3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:08.577450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74a3ca-bfdb-4ad3-97ce-5527ab7dbd3e service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:08.577879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74a3ca-bfdb-4ad3-97ce-5527ab7dbd3e service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:08.578334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74a3ca-bfdb-4ad3-97ce-5527ab7dbd3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:08.582183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0f74a3ca-bfdb-4ad3-97ce-5527ab7dbd3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:08.634428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74a3ca-bfdb-4ad3-97ce-5527ab7dbd3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:08.636939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74a3ca-bfdb-4ad3-97ce-5527ab7dbd3e service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:08.665230 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4166/8263] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:08.991954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14801be7-cc4b-4d6a-9dc5-1767d8a9163e service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:08.994282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-14801be7-cc4b-4d6a-9dc5-1767d8a9163e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:09.133794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14801be7-cc4b-4d6a-9dc5-1767d8a9163e service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:09.143845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89d438-7eb8-45b1-bbb5-e9026cc13dd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:09.144824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89d438-7eb8-45b1-bbb5-e9026cc13dd1 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:09.145322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89d438-7eb8-45b1-bbb5-e9026cc13dd1 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:09.145917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89d438-7eb8-45b1-bbb5-e9026cc13dd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:09.158033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89d438-7eb8-45b1-bbb5-e9026cc13dd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:09.160175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89d438-7eb8-45b1-bbb5-e9026cc13dd1 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:09.173708 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4098/8264] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:04:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:04:12.014198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74a3ca-bfdb-4ad3-97ce-5527ab7dbd3e service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:12.016682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0f74a3ca-bfdb-4ad3-97ce-5527ab7dbd3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:12.042566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74a3ca-bfdb-4ad3-97ce-5527ab7dbd3e service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:12.064421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:12.065095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.065379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.065685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] PATH_INFO: `/v3/users/16e4479f0b9446c9ba971e85ea9daa4e` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.070879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e4479f0b9446c9ba971e85ea9daa4e)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:12.072951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:12.212452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e4479f0b9446c9ba971e85ea9daa4e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.213158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e4479f0b9446c9ba971e85ea9daa4e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.232053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e4479f0b9446c9ba971e85ea9daa4e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.232903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e4479f0b9446c9ba971e85ea9daa4e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.246494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e4479f0b9446c9ba971e85ea9daa4e'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:12.280437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15877012-07d1-46e9-b6e3-7cea7e2b565f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.280952 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15877012-07d1-46e9-b6e3-7cea7e2b565f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.281061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15877012-07d1-46e9-b6e3-7cea7e2b565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.283142 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4167/8265] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:12 2022] DELETE /identity/v3/users/16e4479f0b9446c9ba971e85ea9daa4e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:12.333209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-15877012-07d1-46e9-b6e3-7cea7e2b565f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:12.342545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-15877012-07d1-46e9-b6e3-7cea7e2b565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:12.503398 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4099/8266] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:04:12.509235 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:12.510802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:12.577557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be991fa-ae68-47fd-9c63-4a913a9d46e7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.577848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be991fa-ae68-47fd-9c63-4a913a9d46e7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.578310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be991fa-ae68-47fd-9c63-4a913a9d46e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.618451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3be991fa-ae68-47fd-9c63-4a913a9d46e7 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:12.619696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3be991fa-ae68-47fd-9c63-4a913a9d46e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:12.636367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:12.667182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4c2fb-1fe9-4004-b3c1-a83244087742 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:12.704687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef0858-cca4-4352-b475-3ed8fdca8516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:12.709699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef0858-cca4-4352-b475-3ed8fdca8516 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:12.712037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef0858-cca4-4352-b475-3ed8fdca8516 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:12.712408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef0858-cca4-4352-b475-3ed8fdca8516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:12.743956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef0858-cca4-4352-b475-3ed8fdca8516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:12.746153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef0858-cca4-4352-b475-3ed8fdca8516 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:12.785510 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4168/8267] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:12.830957 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4100/8268] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:04:12.921591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef0858-cca4-4352-b475-3ed8fdca8516 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:12.924221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b6ef0858-cca4-4352-b475-3ed8fdca8516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:13.106180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef0858-cca4-4352-b475-3ed8fdca8516 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:13.124131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d78e64-03c6-428f-97f9-62673a623675 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:13.125084 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d78e64-03c6-428f-97f9-62673a623675 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:13.125752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d78e64-03c6-428f-97f9-62673a623675 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:13.126216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d78e64-03c6-428f-97f9-62673a623675 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:13.145273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d78e64-03c6-428f-97f9-62673a623675 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:13.147377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d78e64-03c6-428f-97f9-62673a623675 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:13.176761 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4169/8269] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:04:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:04:13.735988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be991fa-ae68-47fd-9c63-4a913a9d46e7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:13.738190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3be991fa-ae68-47fd-9c63-4a913a9d46e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:13.762365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be991fa-ae68-47fd-9c63-4a913a9d46e7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:13.776023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:13.779838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:13.780328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:13.780822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] PATH_INFO: `/v3/projects/539657c1d89d4b6fb7c523410811bd13` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:13.785100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=539657c1d89d4b6fb7c523410811bd13)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:13.792415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:13.911722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:13.992472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539657c1d89d4b6fb7c523410811bd13', 'request_id': 'req-ba2df1a0-9f80-4082-97e1-434979b70645'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:14.006780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539657c1d89d4b6fb7c523410811bd13', 'request_id': 'req-ba2df1a0-9f80-4082-97e1-434979b70645'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:14.025295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539657c1d89d4b6fb7c523410811bd13', 'request_id': 'req-ba2df1a0-9f80-4082-97e1-434979b70645'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:14.047721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] The token cache is being invalidate because project 539657c1d89d4b6fb7c523410811bd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:14.048255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:14.049479 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:14.053539 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4101/8270] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:13 2022] DELETE /identity/v3/projects/539657c1d89d4b6fb7c523410811bd13 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:04:14.058768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d78e64-03c6-428f-97f9-62673a623675 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:14.088532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d78e64-03c6-428f-97f9-62673a623675 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:14.236442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d843f-1c83-4d54-aa70-3f8aa2fa6ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:14.237101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d843f-1c83-4d54-aa70-3f8aa2fa6ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:14.237379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d843f-1c83-4d54-aa70-3f8aa2fa6ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:14.237686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d843f-1c83-4d54-aa70-3f8aa2fa6ba7 admin admin] PATH_INFO: `/v3/users/ae6ec5d3808d4cb4913eb2f624c34a8c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:14.238906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d843f-1c83-4d54-aa70-3f8aa2fa6ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6ec5d3808d4cb4913eb2f624c34a8c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:14.240861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d843f-1c83-4d54-aa70-3f8aa2fa6ba7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:14.381522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5c3d843f-1c83-4d54-aa70-3f8aa2fa6ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6ec5d3808d4cb4913eb2f624c34a8c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:14.384807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5c3d843f-1c83-4d54-aa70-3f8aa2fa6ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6ec5d3808d4cb4913eb2f624c34a8c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:14.419412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5c3d843f-1c83-4d54-aa70-3f8aa2fa6ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6ec5d3808d4cb4913eb2f624c34a8c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:14.420897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5c3d843f-1c83-4d54-aa70-3f8aa2fa6ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6ec5d3808d4cb4913eb2f624c34a8c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:14.433851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5c3d843f-1c83-4d54-aa70-3f8aa2fa6ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6ec5d3808d4cb4913eb2f624c34a8c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:14.438768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:14.458568 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4170/8271] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:14 2022] DELETE /identity/v3/users/ae6ec5d3808d4cb4913eb2f624c34a8c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:15.087828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:15.091474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:15.178720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2df1a0-9f80-4082-97e1-434979b70645 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:15.356411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:15.357896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:15.358398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:15.358885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] PATH_INFO: `/v3/projects/33ad4dc3c33b4a649a3f4b06dcb7a5f5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:15.360412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ad4dc3c33b4a649a3f4b06dcb7a5f5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:15.362938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:15.429775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ad4dc3c33b4a649a3f4b06dcb7a5f5', 'request_id': 'req-6943674d-c073-4098-bd95-ae3424993977'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:15.436249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ad4dc3c33b4a649a3f4b06dcb7a5f5', 'request_id': 'req-6943674d-c073-4098-bd95-ae3424993977'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:15.445658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ad4dc3c33b4a649a3f4b06dcb7a5f5', 'request_id': 'req-6943674d-c073-4098-bd95-ae3424993977'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:15.459188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] The token cache is being invalidate because project 33ad4dc3c33b4a649a3f4b06dcb7a5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:15.459716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:15.460491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:15.463530 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4102/8272] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:15 2022] DELETE /identity/v3/projects/33ad4dc3c33b4a649a3f4b06dcb7a5f5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:15.468874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581ee80-a9d1-4699-a5e0-76eb0a778444 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:15.470756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581ee80-a9d1-4699-a5e0-76eb0a778444 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:15.471241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581ee80-a9d1-4699-a5e0-76eb0a778444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:15.502824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9581ee80-a9d1-4699-a5e0-76eb0a778444 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:15.504806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9581ee80-a9d1-4699-a5e0-76eb0a778444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:15.551959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:15.554348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:15.640030 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4171/8273] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:15.650264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0f46c-c971-47dc-9c5e-cd56ca936fa0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:15.651581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0f46c-c971-47dc-9c5e-cd56ca936fa0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:15.653075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0f46c-c971-47dc-9c5e-cd56ca936fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:15.714924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-63a0f46c-c971-47dc-9c5e-cd56ca936fa0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:15.716463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-63a0f46c-c971-47dc-9c5e-cd56ca936fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:15.720447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:15.756581 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4172/8274] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:15.760745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0f46c-c971-47dc-9c5e-cd56ca936fa0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:15.774974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0f46c-c971-47dc-9c5e-cd56ca936fa0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:15.780304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faac5d7-ad97-41c2-9e70-fb753300857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:15.780842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac5d7-ad97-41c2-9e70-fb753300857e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:15.781126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac5d7-ad97-41c2-9e70-fb753300857e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:15.781422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac5d7-ad97-41c2-9e70-fb753300857e admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:15.782663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac5d7-ad97-41c2-9e70-fb753300857e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:04:15.782966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac5d7-ad97-41c2-9e70-fb753300857e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:15.784177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943674d-c073-4098-bd95-ae3424993977 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:15.784872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac5d7-ad97-41c2-9e70-fb753300857e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:15.804149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304d758-a4ff-4393-810b-4a2a17624e33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:15.804791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d758-a4ff-4393-810b-4a2a17624e33 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:15.805175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d758-a4ff-4393-810b-4a2a17624e33 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:15.805480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d758-a4ff-4393-810b-4a2a17624e33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:15.809623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2304d758-a4ff-4393-810b-4a2a17624e33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:15.828476 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4173/8275] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:04:15.830202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156356-a8ca-4d62-8c32-4421fee6bcb8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:15.830675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156356-a8ca-4d62-8c32-4421fee6bcb8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:15.831108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156356-a8ca-4d62-8c32-4421fee6bcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:15.855177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304d758-a4ff-4393-810b-4a2a17624e33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:15.857108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304d758-a4ff-4393-810b-4a2a17624e33 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:15.868297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-87156356-a8ca-4d62-8c32-4421fee6bcb8 None None] MFA Rules not processed for user `e276b9fae4594c17a1883dd4e48184c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:15.870150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-87156356-a8ca-4d62-8c32-4421fee6bcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:15.894996 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4103/8276] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:04:15.895900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304d758-a4ff-4393-810b-4a2a17624e33 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:15.952034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304d758-a4ff-4393-810b-4a2a17624e33 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:15.960015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faca605-464f-4a87-a82e-9c5f9d9837a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:15.960685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca605-464f-4a87-a82e-9c5f9d9837a7 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:15.960964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca605-464f-4a87-a82e-9c5f9d9837a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:15.961242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca605-464f-4a87-a82e-9c5f9d9837a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:15.961976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faca605-464f-4a87-a82e-9c5f9d9837a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:15.963965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faca605-464f-4a87-a82e-9c5f9d9837a7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:15.974716 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4174/8277] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:16.268154 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4104/8278] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:15 2022] POST /identity/v3/projects => generated 377 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:16.272755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87156356-a8ca-4d62-8c32-4421fee6bcb8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:16.300361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87156356-a8ca-4d62-8c32-4421fee6bcb8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:16.434824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c738be-1d61-4cb0-b9da-9937c1e63fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:16.435629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c738be-1d61-4cb0-b9da-9937c1e63fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:16.435926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c738be-1d61-4cb0-b9da-9937c1e63fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:16.436206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c738be-1d61-4cb0-b9da-9937c1e63fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:16.437033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c738be-1d61-4cb0-b9da-9937c1e63fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:16.439975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c738be-1d61-4cb0-b9da-9937c1e63fd4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:16.469712 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4175/8279] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:16 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:16.471443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faca605-464f-4a87-a82e-9c5f9d9837a7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:16.485872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faca605-464f-4a87-a82e-9c5f9d9837a7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:16.492401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6785828-6dda-42fa-88a8-ef84c015a676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:16.493185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6785828-6dda-42fa-88a8-ef84c015a676 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:16.493604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6785828-6dda-42fa-88a8-ef84c015a676 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:16.493993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6785828-6dda-42fa-88a8-ef84c015a676 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:16.494766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6785828-6dda-42fa-88a8-ef84c015a676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:16.496714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6785828-6dda-42fa-88a8-ef84c015a676 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:16.522386 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4105/8280] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:16.524485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c738be-1d61-4cb0-b9da-9937c1e63fd4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:16.539651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c738be-1d61-4cb0-b9da-9937c1e63fd4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:16.545882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9c283-6baa-463f-8edb-f90995ce40fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:16.546608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c283-6baa-463f-8edb-f90995ce40fa admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:16.546982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c283-6baa-463f-8edb-f90995ce40fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:16.548134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c283-6baa-463f-8edb-f90995ce40fa admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:16.549062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9c283-6baa-463f-8edb-f90995ce40fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:16.552352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9c283-6baa-463f-8edb-f90995ce40fa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:16.599299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:16.604911 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4176/8281] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:16.609303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6785828-6dda-42fa-88a8-ef84c015a676 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:16.621574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6785828-6dda-42fa-88a8-ef84c015a676 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:16.626917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33feb6-7cdb-4b58-a27d-04c474f35940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:16.627526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33feb6-7cdb-4b58-a27d-04c474f35940 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:16.627805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33feb6-7cdb-4b58-a27d-04c474f35940 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:16.628075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33feb6-7cdb-4b58-a27d-04c474f35940 admin admin] PATH_INFO: `/v3/projects/231685f25a3d432d8c3e17f8b8a15ec6/users/363f93103d2c4885af3b4b96404a5c00/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:16.651604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33feb6-7cdb-4b58-a27d-04c474f35940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231685f25a3d432d8c3e17f8b8a15ec6, user_id=363f93103d2c4885af3b4b96404a5c00, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:16.654330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33feb6-7cdb-4b58-a27d-04c474f35940 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:16.681492 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4106/8282] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:16 2022] PUT /identity/v3/projects/231685f25a3d432d8c3e17f8b8a15ec6/users/363f93103d2c4885af3b4b96404a5c00/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:16.692597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fb048-e26f-4a71-96f9-bb5d0af1e2e0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:16.693048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fb048-e26f-4a71-96f9-bb5d0af1e2e0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:16.693487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fb048-e26f-4a71-96f9-bb5d0af1e2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:16.742868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-df3fb048-e26f-4a71-96f9-bb5d0af1e2e0 None None] MFA Rules not processed for user `363f93103d2c4885af3b4b96404a5c00`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:16.744243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-df3fb048-e26f-4a71-96f9-bb5d0af1e2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:16.830885 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4177/8283] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:16.836183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33feb6-7cdb-4b58-a27d-04c474f35940 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:16.969914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33feb6-7cdb-4b58-a27d-04c474f35940 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:16.985968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d2c6c-e3c5-427e-be57-6ff539f0adf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:16.986597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d2c6c-e3c5-427e-be57-6ff539f0adf8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:16.986873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d2c6c-e3c5-427e-be57-6ff539f0adf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:16.987144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d2c6c-e3c5-427e-be57-6ff539f0adf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:16.987778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d2c6c-e3c5-427e-be57-6ff539f0adf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:16.989743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d2c6c-e3c5-427e-be57-6ff539f0adf8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:17.086971 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4107/8284] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:16 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:17.088227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fb048-e26f-4a71-96f9-bb5d0af1e2e0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:17.105249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fb048-e26f-4a71-96f9-bb5d0af1e2e0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:17.218657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966f9ec-a7be-4c27-b0e8-8a9f320d6f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:17.221572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966f9ec-a7be-4c27-b0e8-8a9f320d6f73 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:17.223695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966f9ec-a7be-4c27-b0e8-8a9f320d6f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:17.224359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966f9ec-a7be-4c27-b0e8-8a9f320d6f73 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:17.228541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966f9ec-a7be-4c27-b0e8-8a9f320d6f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:17.234689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966f9ec-a7be-4c27-b0e8-8a9f320d6f73 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:17.295655 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4178/8285] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:17 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:17.296104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d2c6c-e3c5-427e-be57-6ff539f0adf8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:17.316304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d2c6c-e3c5-427e-be57-6ff539f0adf8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:17.321950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293045d-d68e-470d-99ac-ed5b7b51f714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:17.322556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293045d-d68e-470d-99ac-ed5b7b51f714 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:17.322829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293045d-d68e-470d-99ac-ed5b7b51f714 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:17.323104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293045d-d68e-470d-99ac-ed5b7b51f714 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:17.323748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293045d-d68e-470d-99ac-ed5b7b51f714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:17.325332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293045d-d68e-470d-99ac-ed5b7b51f714 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:17.344761 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4108/8286] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:17.346123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966f9ec-a7be-4c27-b0e8-8a9f320d6f73 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:17.360515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966f9ec-a7be-4c27-b0e8-8a9f320d6f73 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:17.365883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad2d42-9ce5-4222-91c3-477ce028aa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:17.366498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad2d42-9ce5-4222-91c3-477ce028aa6d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:17.366774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad2d42-9ce5-4222-91c3-477ce028aa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:17.367071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad2d42-9ce5-4222-91c3-477ce028aa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:17.368205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad2d42-9ce5-4222-91c3-477ce028aa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:17.370070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad2d42-9ce5-4222-91c3-477ce028aa6d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:17.414336 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4179/8287] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:17.415460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293045d-d68e-470d-99ac-ed5b7b51f714 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:17.436339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293045d-d68e-470d-99ac-ed5b7b51f714 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:17.456858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538757fa-aa2b-400c-b6f5-6b63093821a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:17.457761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538757fa-aa2b-400c-b6f5-6b63093821a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:17.458137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538757fa-aa2b-400c-b6f5-6b63093821a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:17.458416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538757fa-aa2b-400c-b6f5-6b63093821a8 admin admin] PATH_INFO: `/v3/projects/7a805cf589394f809464d53ebac4f437/users/280fe1c4ccc34cf2938ca4af4f648912/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:17.561280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538757fa-aa2b-400c-b6f5-6b63093821a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a805cf589394f809464d53ebac4f437, user_id=280fe1c4ccc34cf2938ca4af4f648912, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:17.568283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538757fa-aa2b-400c-b6f5-6b63093821a8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:17.603988 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4109/8288] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:17 2022] PUT /identity/v3/projects/7a805cf589394f809464d53ebac4f437/users/280fe1c4ccc34cf2938ca4af4f648912/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:04:17.614997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd2ae-ad58-4870-af75-a4f548134f3a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:17.616234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd2ae-ad58-4870-af75-a4f548134f3a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:17.616786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd2ae-ad58-4870-af75-a4f548134f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:17.653430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538757fa-aa2b-400c-b6f5-6b63093821a8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:17.660754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-538757fa-aa2b-400c-b6f5-6b63093821a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:17.719192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-376bd2ae-ad58-4870-af75-a4f548134f3a None None] MFA Rules not processed for user `280fe1c4ccc34cf2938ca4af4f648912`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:17.720480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-376bd2ae-ad58-4870-af75-a4f548134f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:17.747585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:17.852650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:17.869324 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4180/8289] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:04:17.872229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538757fa-aa2b-400c-b6f5-6b63093821a8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:17.874229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bd2ae-ad58-4870-af75-a4f548134f3a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:17.895946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb7eb-56c5-452b-9be1-df21b0b2978b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:17.897284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb7eb-56c5-452b-9be1-df21b0b2978b service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:17.897788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb7eb-56c5-452b-9be1-df21b0b2978b service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:17.898434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb7eb-56c5-452b-9be1-df21b0b2978b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:17.920958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-956fb7eb-56c5-452b-9be1-df21b0b2978b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:17.944481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fb7eb-56c5-452b-9be1-df21b0b2978b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:17.946653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fb7eb-56c5-452b-9be1-df21b0b2978b service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:17.978333 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4110/8290] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:18.401007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bd2ae-ad58-4870-af75-a4f548134f3a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:18.408176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efabea1-018b-4300-9951-dabb62d1a679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:18.409029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efabea1-018b-4300-9951-dabb62d1a679 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:18.409484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efabea1-018b-4300-9951-dabb62d1a679 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:18.409896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efabea1-018b-4300-9951-dabb62d1a679 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:18.410979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efabea1-018b-4300-9951-dabb62d1a679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:18.413316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efabea1-018b-4300-9951-dabb62d1a679 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:18.455126 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4181/8291] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:17 2022] POST /identity/v3/projects => generated 377 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:18.462544 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb7eb-56c5-452b-9be1-df21b0b2978b service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:18.485923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb7eb-56c5-452b-9be1-df21b0b2978b service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:18.661114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e30fbb-2e0f-401a-ac26-ce67dcec89b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:18.662099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e30fbb-2e0f-401a-ac26-ce67dcec89b6 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:18.662543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e30fbb-2e0f-401a-ac26-ce67dcec89b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:18.662957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e30fbb-2e0f-401a-ac26-ce67dcec89b6 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:18.663739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e30fbb-2e0f-401a-ac26-ce67dcec89b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:18.669071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e30fbb-2e0f-401a-ac26-ce67dcec89b6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:18.718258 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4111/8292] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:18 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:18.719730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efabea1-018b-4300-9951-dabb62d1a679 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:18.740257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efabea1-018b-4300-9951-dabb62d1a679 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:18.752558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb051c5-28f9-42b4-9993-2031d61006f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:18.753988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb051c5-28f9-42b4-9993-2031d61006f5 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:18.754634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb051c5-28f9-42b4-9993-2031d61006f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:18.754634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb051c5-28f9-42b4-9993-2031d61006f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:18.755192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb051c5-28f9-42b4-9993-2031d61006f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:18.757519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb051c5-28f9-42b4-9993-2031d61006f5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:18.776366 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4182/8293] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:04:18.778427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e30fbb-2e0f-401a-ac26-ce67dcec89b6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:18.795830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e30fbb-2e0f-401a-ac26-ce67dcec89b6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:18.804401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589199f-ae56-4861-a61b-baf0de0c1b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:18.804715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589199f-ae56-4861-a61b-baf0de0c1b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:18.805004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589199f-ae56-4861-a61b-baf0de0c1b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:18.805280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589199f-ae56-4861-a61b-baf0de0c1b33 admin admin] PATH_INFO: `/v3/projects/762bcd476bd34f50997d6c602e801d53/users/c408aefc12684c72911823c044366f14/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:18.839125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589199f-ae56-4861-a61b-baf0de0c1b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762bcd476bd34f50997d6c602e801d53, user_id=c408aefc12684c72911823c044366f14, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:18.843881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589199f-ae56-4861-a61b-baf0de0c1b33 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:18.870162 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4112/8294] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:18 2022] PUT /identity/v3/projects/762bcd476bd34f50997d6c602e801d53/users/c408aefc12684c72911823c044366f14/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:18.871570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb051c5-28f9-42b4-9993-2031d61006f5 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:18.888628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb051c5-28f9-42b4-9993-2031d61006f5 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:19.061425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220c00d-ee76-4e3c-807b-011daffed86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:19.061690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220c00d-ee76-4e3c-807b-011daffed86f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:19.061958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220c00d-ee76-4e3c-807b-011daffed86f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:19.063649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220c00d-ee76-4e3c-807b-011daffed86f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:19.063649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220c00d-ee76-4e3c-807b-011daffed86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:19.071338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220c00d-ee76-4e3c-807b-011daffed86f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:19.106398 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4183/8295] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:04:19.111487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589199f-ae56-4861-a61b-baf0de0c1b33 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:19.141090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589199f-ae56-4861-a61b-baf0de0c1b33 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:19.147516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004e9b4-b26a-4fd2-bc2d-7bd0bf1192ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:19.148535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004e9b4-b26a-4fd2-bc2d-7bd0bf1192ca admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:19.148914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004e9b4-b26a-4fd2-bc2d-7bd0bf1192ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:19.149294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004e9b4-b26a-4fd2-bc2d-7bd0bf1192ca admin admin] PATH_INFO: `/v3/projects/762bcd476bd34f50997d6c602e801d53/users/c408aefc12684c72911823c044366f14/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:19.151819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004e9b4-b26a-4fd2-bc2d-7bd0bf1192ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=762bcd476bd34f50997d6c602e801d53, user_id=c408aefc12684c72911823c044366f14, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:19.154676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004e9b4-b26a-4fd2-bc2d-7bd0bf1192ca admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:19.187331 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4113/8296] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:19 2022] PUT /identity/v3/projects/762bcd476bd34f50997d6c602e801d53/users/c408aefc12684c72911823c044366f14/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:19.200702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d32e-95bc-494f-a6e1-578f1376202d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:19.201273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d32e-95bc-494f-a6e1-578f1376202d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:19.201669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d32e-95bc-494f-a6e1-578f1376202d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:19.310924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1ac9d32e-95bc-494f-a6e1-578f1376202d None None] MFA Rules not processed for user `c408aefc12684c72911823c044366f14`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:19.315710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1ac9d32e-95bc-494f-a6e1-578f1376202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:19.476160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:19.493227 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4184/8297] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:19.507014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004e9b4-b26a-4fd2-bc2d-7bd0bf1192ca admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:19.510929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b004e9b4-b26a-4fd2-bc2d-7bd0bf1192ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:19.751362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:19.782877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004e9b4-b26a-4fd2-bc2d-7bd0bf1192ca admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:19.799607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3b91a-5cef-415e-8b25-e016f3277d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:19.800329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b91a-5cef-415e-8b25-e016f3277d5a service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:19.801853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b91a-5cef-415e-8b25-e016f3277d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:19.802645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3b91a-5cef-415e-8b25-e016f3277d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:20.040995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3b91a-5cef-415e-8b25-e016f3277d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:20.055369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3b91a-5cef-415e-8b25-e016f3277d5a service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:20.106471 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4114/8298] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:23.411045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9d32e-95bc-494f-a6e1-578f1376202d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:23.412669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1ac9d32e-95bc-494f-a6e1-578f1376202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:23.439270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9d32e-95bc-494f-a6e1-578f1376202d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:23.451980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed0085-9df2-4e18-859f-a6bb435c60b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:23.455629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0085-9df2-4e18-859f-a6bb435c60b1 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:23.457307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0085-9df2-4e18-859f-a6bb435c60b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:23.465889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0085-9df2-4e18-859f-a6bb435c60b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:23.706110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed0085-9df2-4e18-859f-a6bb435c60b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:23.708594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed0085-9df2-4e18-859f-a6bb435c60b1 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:23.725590 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4185/8299] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:25.126865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3b91a-5cef-415e-8b25-e016f3277d5a service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:25.151268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3b91a-5cef-415e-8b25-e016f3277d5a service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:25.166188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80338d8e-c7bd-43f1-bc04-8c4980e414da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:25.167277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80338d8e-c7bd-43f1-bc04-8c4980e414da service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:25.167920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80338d8e-c7bd-43f1-bc04-8c4980e414da service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:25.168491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80338d8e-c7bd-43f1-bc04-8c4980e414da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:25.232843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80338d8e-c7bd-43f1-bc04-8c4980e414da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:25.235005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80338d8e-c7bd-43f1-bc04-8c4980e414da service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:25.255375 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4115/8300] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:33.719833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=31 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:34.626750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed0085-9df2-4e18-859f-a6bb435c60b1 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:34.629193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0aed0085-9df2-4e18-859f-a6bb435c60b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:34.758119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed0085-9df2-4e18-859f-a6bb435c60b1 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:34.786904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:34.788380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:34.788380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:34.788380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] PATH_INFO: `/v3/users/a07c7f7f5025466781f741a07e207a94` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:34.817180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07c7f7f5025466781f741a07e207a94)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:34.819408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:34.947534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07c7f7f5025466781f741a07e207a94'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:34.948332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07c7f7f5025466781f741a07e207a94'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:34.988562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07c7f7f5025466781f741a07e207a94'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:34.989545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07c7f7f5025466781f741a07e207a94'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:35.011912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07c7f7f5025466781f741a07e207a94'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:35.055634 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4186/8301] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:34 2022] DELETE /identity/v3/users/a07c7f7f5025466781f741a07e207a94 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:35.060606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25b813-413b-4ebf-a867-6e029ff2afb5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:35.061157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25b813-413b-4ebf-a867-6e029ff2afb5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:35.066733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25b813-413b-4ebf-a867-6e029ff2afb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:35.188740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2c25b813-413b-4ebf-a867-6e029ff2afb5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:35.206521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2c25b813-413b-4ebf-a867-6e029ff2afb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:35.424970 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4116/8302] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:35.437210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:35.440043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:35.577662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c45f1d-00fe-4a44-ac6a-0431d36d3df7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:35.586086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d3caf-ac12-4aff-b8c0-c54505705c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:35.586772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d3caf-ac12-4aff-b8c0-c54505705c40 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:35.587545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d3caf-ac12-4aff-b8c0-c54505705c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:35.587545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d3caf-ac12-4aff-b8c0-c54505705c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:35.608065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d3caf-ac12-4aff-b8c0-c54505705c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:35.610468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d3caf-ac12-4aff-b8c0-c54505705c40 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:35.631295 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4187/8303] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:04:35.967935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25b813-413b-4ebf-a867-6e029ff2afb5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:35.972202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2c25b813-413b-4ebf-a867-6e029ff2afb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:36.013834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25b813-413b-4ebf-a867-6e029ff2afb5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:36.034942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:36.035401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:36.036667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:36.037276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] PATH_INFO: `/v3/projects/12bf00bf3d4243f4be9d0475cf8be3f0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:36.039449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12bf00bf3d4243f4be9d0475cf8be3f0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:36.043492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:36.329430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12bf00bf3d4243f4be9d0475cf8be3f0', 'request_id': 'req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:36.348329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12bf00bf3d4243f4be9d0475cf8be3f0', 'request_id': 'req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:36.364409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12bf00bf3d4243f4be9d0475cf8be3f0', 'request_id': 'req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:36.405027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] The token cache is being invalidate because project 12bf00bf3d4243f4be9d0475cf8be3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:36.406052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:36.407668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-eb30b1a5-cb9a-4495-ad2b-57914e46b8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:36.423087 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4117/8304] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:35 2022] DELETE /identity/v3/projects/12bf00bf3d4243f4be9d0475cf8be3f0 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:36.430152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3daac6-ac6d-4429-8a0f-a36cac5fdf3d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:36.431077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3daac6-ac6d-4429-8a0f-a36cac5fdf3d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:36.431571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3daac6-ac6d-4429-8a0f-a36cac5fdf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:36.491252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:36.618187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3f3daac6-ac6d-4429-8a0f-a36cac5fdf3d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:36.619914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3f3daac6-ac6d-4429-8a0f-a36cac5fdf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:36.806587 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4188/8305] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:36.820125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f760-62fe-4ea5-8747-0f46b02eae59 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:36.820740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f760-62fe-4ea5-8747-0f46b02eae59 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:36.821248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f760-62fe-4ea5-8747-0f46b02eae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:36.849341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:36.872082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7bb8f760-62fe-4ea5-8747-0f46b02eae59 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:36.875439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7bb8f760-62fe-4ea5-8747-0f46b02eae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:36.899778 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4118/8306] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:36.904830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3daac6-ac6d-4429-8a0f-a36cac5fdf3d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:36.920494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3daac6-ac6d-4429-8a0f-a36cac5fdf3d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:36.932708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f3bb7-4065-433d-b2b4-848cb675759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:36.937923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f3bb7-4065-433d-b2b4-848cb675759a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:36.938428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f3bb7-4065-433d-b2b4-848cb675759a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:36.938737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f3bb7-4065-433d-b2b4-848cb675759a admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:36.939478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f3bb7-4065-433d-b2b4-848cb675759a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:04:36.939780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f3bb7-4065-433d-b2b4-848cb675759a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:36.941501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f3bb7-4065-433d-b2b4-848cb675759a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:36.977090 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4189/8307] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:36.981379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8f760-62fe-4ea5-8747-0f46b02eae59 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:36.997128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8f760-62fe-4ea5-8747-0f46b02eae59 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:37.007990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4b09b-6b8e-4000-89bd-e17e2625f86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:37.008777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4b09b-6b8e-4000-89bd-e17e2625f86d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:37.009040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4b09b-6b8e-4000-89bd-e17e2625f86d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:37.009500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4b09b-6b8e-4000-89bd-e17e2625f86d admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:37.010333 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4b09b-6b8e-4000-89bd-e17e2625f86d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:37.012325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4b09b-6b8e-4000-89bd-e17e2625f86d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:37.092076 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4119/8308] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:36 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:37.096141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f3bb7-4065-433d-b2b4-848cb675759a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:37.110848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f3bb7-4065-433d-b2b4-848cb675759a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:37.248677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dbb25-e199-40c7-afab-dec2f32ecda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:37.249579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbb25-e199-40c7-afab-dec2f32ecda8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:37.250516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbb25-e199-40c7-afab-dec2f32ecda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:37.250943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbb25-e199-40c7-afab-dec2f32ecda8 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:37.252263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dbb25-e199-40c7-afab-dec2f32ecda8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:37.254791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dbb25-e199-40c7-afab-dec2f32ecda8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:37.292560 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4190/8309] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:37 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:37.306692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4b09b-6b8e-4000-89bd-e17e2625f86d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:37.335486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4b09b-6b8e-4000-89bd-e17e2625f86d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:37.350314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9235931-2d46-4096-b0f0-e47589c25d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:37.352653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9235931-2d46-4096-b0f0-e47589c25d4e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:37.354091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9235931-2d46-4096-b0f0-e47589c25d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:37.355774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9235931-2d46-4096-b0f0-e47589c25d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:37.358161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9235931-2d46-4096-b0f0-e47589c25d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:37.362738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9235931-2d46-4096-b0f0-e47589c25d4e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:37.398369 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4120/8310] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:37.402476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dbb25-e199-40c7-afab-dec2f32ecda8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:37.419006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dbb25-e199-40c7-afab-dec2f32ecda8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:37.425797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d137d8-f722-40ea-9b5b-2045359032c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:37.427120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d137d8-f722-40ea-9b5b-2045359032c7 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:37.427529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d137d8-f722-40ea-9b5b-2045359032c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:37.428119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d137d8-f722-40ea-9b5b-2045359032c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:37.429167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d137d8-f722-40ea-9b5b-2045359032c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:37.432404 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d137d8-f722-40ea-9b5b-2045359032c7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:37.452799 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4191/8311] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:37.458160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9235931-2d46-4096-b0f0-e47589c25d4e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:37.475546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9235931-2d46-4096-b0f0-e47589c25d4e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:37.486645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18b2fd-ec11-45e6-9fcb-4608b21e2f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:37.487684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b2fd-ec11-45e6-9fcb-4608b21e2f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:37.488212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b2fd-ec11-45e6-9fcb-4608b21e2f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:37.488728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b2fd-ec11-45e6-9fcb-4608b21e2f6f admin admin] PATH_INFO: `/v3/projects/0ee5983d46a5439e8884cb455bd2cec2/users/c77dd731bcbd4fb58230613009356ecf/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:37.515789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18b2fd-ec11-45e6-9fcb-4608b21e2f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee5983d46a5439e8884cb455bd2cec2, user_id=c77dd731bcbd4fb58230613009356ecf, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:37.523545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18b2fd-ec11-45e6-9fcb-4608b21e2f6f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:37.562938 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4121/8312] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:37 2022] PUT /identity/v3/projects/0ee5983d46a5439e8884cb455bd2cec2/users/c77dd731bcbd4fb58230613009356ecf/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:37.573204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97feb39-ca7a-4a5b-b033-2926b2de64c1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:37.573621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97feb39-ca7a-4a5b-b033-2926b2de64c1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:37.573977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97feb39-ca7a-4a5b-b033-2926b2de64c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:37.642673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e97feb39-ca7a-4a5b-b033-2926b2de64c1 None None] MFA Rules not processed for user `c77dd731bcbd4fb58230613009356ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:37.644078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e97feb39-ca7a-4a5b-b033-2926b2de64c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:37.728391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:37.766223 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4192/8313] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:37.782545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18b2fd-ec11-45e6-9fcb-4608b21e2f6f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:37.786343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bb18b2fd-ec11-45e6-9fcb-4608b21e2f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:37.914011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18b2fd-ec11-45e6-9fcb-4608b21e2f6f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:37.920226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f96169-7b61-43e0-91c1-8e7650ff6324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:37.920226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f96169-7b61-43e0-91c1-8e7650ff6324 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:37.920665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f96169-7b61-43e0-91c1-8e7650ff6324 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:37.920665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f96169-7b61-43e0-91c1-8e7650ff6324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:37.935818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f96169-7b61-43e0-91c1-8e7650ff6324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:37.937376 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f96169-7b61-43e0-91c1-8e7650ff6324 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:37.949875 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4122/8314] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:38.513097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97feb39-ca7a-4a5b-b033-2926b2de64c1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:38.516632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e97feb39-ca7a-4a5b-b033-2926b2de64c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:38.655671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97feb39-ca7a-4a5b-b033-2926b2de64c1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:38.661857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:38.662509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:38.662793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:38.663070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] PATH_INFO: `/v3/users/363f93103d2c4885af3b4b96404a5c00` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:38.664620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=363f93103d2c4885af3b4b96404a5c00)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:38.666728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:38.735182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363f93103d2c4885af3b4b96404a5c00'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:38.736137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363f93103d2c4885af3b4b96404a5c00'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:38.751260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363f93103d2c4885af3b4b96404a5c00'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:38.752357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363f93103d2c4885af3b4b96404a5c00'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:38.762431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363f93103d2c4885af3b4b96404a5c00'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:38.794608 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4193/8315] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:38 2022] DELETE /identity/v3/users/363f93103d2c4885af3b4b96404a5c00 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:38.799366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131881-75d9-4417-bcd2-369692663ab1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:38.799954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131881-75d9-4417-bcd2-369692663ab1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:38.799954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131881-75d9-4417-bcd2-369692663ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:38.850894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-76131881-75d9-4417-bcd2-369692663ab1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:38.854913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76131881-75d9-4417-bcd2-369692663ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:39.026548 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4123/8316] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:39.035615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:39.037798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:39.141884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc7182-81e7-45b9-bc1f-a19fefac73cf admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:39.146665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336023c-d32c-4604-abae-81c1a97ee35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:39.147307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336023c-d32c-4604-abae-81c1a97ee35b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:39.147593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336023c-d32c-4604-abae-81c1a97ee35b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:39.147872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336023c-d32c-4604-abae-81c1a97ee35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:39.186651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336023c-d32c-4604-abae-81c1a97ee35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:39.188803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336023c-d32c-4604-abae-81c1a97ee35b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:39.214130 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4194/8317] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:39.798939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76131881-75d9-4417-bcd2-369692663ab1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:39.801042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-76131881-75d9-4417-bcd2-369692663ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:39.817811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76131881-75d9-4417-bcd2-369692663ab1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:39.834048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:39.834587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:39.834840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:39.835154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] PATH_INFO: `/v3/projects/231685f25a3d432d8c3e17f8b8a15ec6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:39.839281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=231685f25a3d432d8c3e17f8b8a15ec6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:39.842287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:39.939930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:39.947763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231685f25a3d432d8c3e17f8b8a15ec6', 'request_id': 'req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:39.955581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231685f25a3d432d8c3e17f8b8a15ec6', 'request_id': 'req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:39.979874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231685f25a3d432d8c3e17f8b8a15ec6', 'request_id': 'req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:40.000073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] The token cache is being invalidate because project 231685f25a3d432d8c3e17f8b8a15ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:40.000478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:40.001145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:40.003169 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4124/8318] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:39 2022] DELETE /identity/v3/projects/231685f25a3d432d8c3e17f8b8a15ec6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:40.007728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336023c-d32c-4604-abae-81c1a97ee35b service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:40.016391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:40.038494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336023c-d32c-4604-abae-81c1a97ee35b service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:40.279652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:40.280252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:40.280529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:40.280858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] PATH_INFO: `/v3/users/280fe1c4ccc34cf2938ca4af4f648912` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:40.282871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=280fe1c4ccc34cf2938ca4af4f648912)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:40.288621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:40.424624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280fe1c4ccc34cf2938ca4af4f648912'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:40.425721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280fe1c4ccc34cf2938ca4af4f648912'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:40.452252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280fe1c4ccc34cf2938ca4af4f648912'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:40.453200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280fe1c4ccc34cf2938ca4af4f648912'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:40.465588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280fe1c4ccc34cf2938ca4af4f648912'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:40.495272 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4195/8319] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:40 2022] DELETE /identity/v3/users/280fe1c4ccc34cf2938ca4af4f648912 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:41.128908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:41.131208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:41.162427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb1c16-a87d-4e6d-abe6-8fa3801a1e8e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:41.369805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:41.373005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:41.374999 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:41.375406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] PATH_INFO: `/v3/projects/7a805cf589394f809464d53ebac4f437` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:41.377979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a805cf589394f809464d53ebac4f437)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:41.384370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:41.547531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a805cf589394f809464d53ebac4f437', 'request_id': 'req-8b7f39ba-f710-40f7-a320-0c47f42b7bed'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:41.568161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a805cf589394f809464d53ebac4f437', 'request_id': 'req-8b7f39ba-f710-40f7-a320-0c47f42b7bed'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:41.587034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a805cf589394f809464d53ebac4f437', 'request_id': 'req-8b7f39ba-f710-40f7-a320-0c47f42b7bed'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:41.622064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] The token cache is being invalidate because project 7a805cf589394f809464d53ebac4f437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:41.622064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:41.626440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:41.635580 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4125/8320] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:41 2022] DELETE /identity/v3/projects/7a805cf589394f809464d53ebac4f437 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:41.637371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:41.639513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:41.666102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd6745-184a-4094-bf66-acdc558b5c7f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:41.840350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:41.841012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:41.841756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:41.842047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] PATH_INFO: `/v3/users/c408aefc12684c72911823c044366f14` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:41.845098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c408aefc12684c72911823c044366f14)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:41.847678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:41.941986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:41.997103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c408aefc12684c72911823c044366f14'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:42.000677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c408aefc12684c72911823c044366f14'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:42.046928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c408aefc12684c72911823c044366f14'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:42.054258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c408aefc12684c72911823c044366f14'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:42.086633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c408aefc12684c72911823c044366f14'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:42.116078 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4196/8321] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:41 2022] DELETE /identity/v3/users/c408aefc12684c72911823c044366f14 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:42.674950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:42.676962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:42.687517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:42.690004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:42.825331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:42.846164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ee6e3-939a-45d9-a083-e8edbb2d5548 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:42.857822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:42.858764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:42.859216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:42.859587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] PATH_INFO: `/v3/projects/762bcd476bd34f50997d6c602e801d53` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:42.862723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=762bcd476bd34f50997d6c602e801d53)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:42.866149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:42.908360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f39ba-f710-40f7-a320-0c47f42b7bed admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:42.983289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762bcd476bd34f50997d6c602e801d53', 'request_id': 'req-4eba4163-9d11-4b1f-8782-7518ebbb88e3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:42.992299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762bcd476bd34f50997d6c602e801d53', 'request_id': 'req-4eba4163-9d11-4b1f-8782-7518ebbb88e3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:43.005969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762bcd476bd34f50997d6c602e801d53', 'request_id': 'req-4eba4163-9d11-4b1f-8782-7518ebbb88e3'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:43.047228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] The token cache is being invalidate because project 762bcd476bd34f50997d6c602e801d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:43.047228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:43.049830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-4eba4163-9d11-4b1f-8782-7518ebbb88e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:43.052827 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4197/8322] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:42 2022] DELETE /identity/v3/projects/762bcd476bd34f50997d6c602e801d53 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:04:43.070680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3d81-2aa5-43af-a1dd-22bfadc585aa None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:43.071314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3d81-2aa5-43af-a1dd-22bfadc585aa None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:43.073025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3d81-2aa5-43af-a1dd-22bfadc585aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:43.110869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a805b2-f951-4118-9a6c-6935f910f828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:43.112609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a805b2-f951-4118-9a6c-6935f910f828 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:43.117612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a805b2-f951-4118-9a6c-6935f910f828 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:43.118004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a805b2-f951-4118-9a6c-6935f910f828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:43.121791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-11a805b2-f951-4118-9a6c-6935f910f828 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:43.131382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-604f3d81-2aa5-43af-a1dd-22bfadc585aa None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:43.133158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-604f3d81-2aa5-43af-a1dd-22bfadc585aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:43.220818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:43.313091 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4198/8323] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:04:43.330547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a805b2-f951-4118-9a6c-6935f910f828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:43.334442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a805b2-f951-4118-9a6c-6935f910f828 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:43.337627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2266e-85e4-434e-8206-84afe6432bd7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:43.338122 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2266e-85e4-434e-8206-84afe6432bd7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:43.338539 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2266e-85e4-434e-8206-84afe6432bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:43.363648 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4126/8324] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:43.405149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fcb2266e-85e4-434e-8206-84afe6432bd7 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:43.410561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fcb2266e-85e4-434e-8206-84afe6432bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:43.463806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a805b2-f951-4118-9a6c-6935f910f828 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:43.471811 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4199/8325] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:43.485331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a805b2-f951-4118-9a6c-6935f910f828 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:43.498945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d34ef1-52d6-4441-97fc-15bb7e57e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:43.503803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d34ef1-52d6-4441-97fc-15bb7e57e8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:43.505187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d34ef1-52d6-4441-97fc-15bb7e57e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:43.506381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d34ef1-52d6-4441-97fc-15bb7e57e8a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:43.507112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d34ef1-52d6-4441-97fc-15bb7e57e8a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:04:43.510620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d34ef1-52d6-4441-97fc-15bb7e57e8a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:43.522589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d34ef1-52d6-4441-97fc-15bb7e57e8a6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:43.561524 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4127/8326] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:43.566578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2266e-85e4-434e-8206-84afe6432bd7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:43.586525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2266e-85e4-434e-8206-84afe6432bd7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:43.601817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52556ba-a1e7-4ce7-89c3-dbfd49e6d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:43.603607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52556ba-a1e7-4ce7-89c3-dbfd49e6d835 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:43.604371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52556ba-a1e7-4ce7-89c3-dbfd49e6d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:43.605597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52556ba-a1e7-4ce7-89c3-dbfd49e6d835 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:43.606278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52556ba-a1e7-4ce7-89c3-dbfd49e6d835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:43.608227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52556ba-a1e7-4ce7-89c3-dbfd49e6d835 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:43.701618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d34ef1-52d6-4441-97fc-15bb7e57e8a6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:43.710376 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4200/8327] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:43 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:04:43.722208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d34ef1-52d6-4441-97fc-15bb7e57e8a6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:43.914395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569e2b9-b655-45d2-b9f3-5bcebdc153f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:43.915251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569e2b9-b655-45d2-b9f3-5bcebdc153f5 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:43.918543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569e2b9-b655-45d2-b9f3-5bcebdc153f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:43.919111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569e2b9-b655-45d2-b9f3-5bcebdc153f5 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:43.919822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569e2b9-b655-45d2-b9f3-5bcebdc153f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:43.925324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569e2b9-b655-45d2-b9f3-5bcebdc153f5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:43.967549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:44.014221 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4128/8328] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:43 2022] POST /identity/v3/users => generated 292 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:44.019293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52556ba-a1e7-4ce7-89c3-dbfd49e6d835 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:44.038500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52556ba-a1e7-4ce7-89c3-dbfd49e6d835 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:44.052469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73955ae6-8e57-4df2-ace1-f448b4701baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:44.055039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73955ae6-8e57-4df2-ace1-f448b4701baa admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:44.055345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73955ae6-8e57-4df2-ace1-f448b4701baa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:44.057225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73955ae6-8e57-4df2-ace1-f448b4701baa admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:44.058241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73955ae6-8e57-4df2-ace1-f448b4701baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:44.066191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73955ae6-8e57-4df2-ace1-f448b4701baa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:44.105029 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4201/8329] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:44.112066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569e2b9-b655-45d2-b9f3-5bcebdc153f5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:44.132503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569e2b9-b655-45d2-b9f3-5bcebdc153f5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:44.149048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e15967-5c0d-4b2b-b834-a00d04ec3dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:44.150502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e15967-5c0d-4b2b-b834-a00d04ec3dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:44.151004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e15967-5c0d-4b2b-b834-a00d04ec3dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:44.151450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e15967-5c0d-4b2b-b834-a00d04ec3dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:44.152270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e15967-5c0d-4b2b-b834-a00d04ec3dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:44.155062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e15967-5c0d-4b2b-b834-a00d04ec3dc5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:44.187017 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4129/8330] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:44.193704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73955ae6-8e57-4df2-ace1-f448b4701baa admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:44.206190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73955ae6-8e57-4df2-ace1-f448b4701baa admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:44.222770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f0427-4ed6-4bc8-93b5-4853297791bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:44.224120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f0427-4ed6-4bc8-93b5-4853297791bb admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:44.224757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f0427-4ed6-4bc8-93b5-4853297791bb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:44.225426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f0427-4ed6-4bc8-93b5-4853297791bb admin admin] PATH_INFO: `/v3/projects/c84a80351a9c478e9fc935d89a8f2bec/users/a07aa6e9f7e64d4d953ecb3413aab8ec/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:44.255036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f0427-4ed6-4bc8-93b5-4853297791bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84a80351a9c478e9fc935d89a8f2bec, user_id=a07aa6e9f7e64d4d953ecb3413aab8ec, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:44.260400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f0427-4ed6-4bc8-93b5-4853297791bb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:44.300959 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4202/8331] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:44 2022] PUT /identity/v3/projects/c84a80351a9c478e9fc935d89a8f2bec/users/a07aa6e9f7e64d4d953ecb3413aab8ec/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:44.470867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dfea7-fbac-40d4-a425-2635233f2e71 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:44.471252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dfea7-fbac-40d4-a425-2635233f2e71 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:44.471628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dfea7-fbac-40d4-a425-2635233f2e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:44.573225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b72dfea7-fbac-40d4-a425-2635233f2e71 None None] MFA Rules not processed for user `a07aa6e9f7e64d4d953ecb3413aab8ec`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:44.574642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b72dfea7-fbac-40d4-a425-2635233f2e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:44.726118 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4130/8332] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:44.730912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f0427-4ed6-4bc8-93b5-4853297791bb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:44.931303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f0427-4ed6-4bc8-93b5-4853297791bb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:44.951627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb22d48-47f4-4f93-8c9a-85bef11232e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:44.953493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb22d48-47f4-4f93-8c9a-85bef11232e3 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:44.953864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb22d48-47f4-4f93-8c9a-85bef11232e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:44.954098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb22d48-47f4-4f93-8c9a-85bef11232e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:44.954773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb22d48-47f4-4f93-8c9a-85bef11232e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:44.957756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb22d48-47f4-4f93-8c9a-85bef11232e3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:44.998257 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4203/8333] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:44 2022] POST /identity/v3/projects => generated 383 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:45.008829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72dfea7-fbac-40d4-a425-2635233f2e71 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:45.037171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72dfea7-fbac-40d4-a425-2635233f2e71 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:45.276968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c89ac2-fe83-426a-a566-11af71963223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:45.277740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c89ac2-fe83-426a-a566-11af71963223 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:45.278027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c89ac2-fe83-426a-a566-11af71963223 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:45.278308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c89ac2-fe83-426a-a566-11af71963223 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:45.284327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c89ac2-fe83-426a-a566-11af71963223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:45.286446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c89ac2-fe83-426a-a566-11af71963223 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:45.360790 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4131/8334] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:45 2022] POST /identity/v3/users => generated 292 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:45.362215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb22d48-47f4-4f93-8c9a-85bef11232e3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:45.406498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb22d48-47f4-4f93-8c9a-85bef11232e3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:45.415842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961e2e3-9428-4cb6-ac4d-f013768b5182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:45.416476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e2e3-9428-4cb6-ac4d-f013768b5182 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:45.416757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e2e3-9428-4cb6-ac4d-f013768b5182 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:45.417029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e2e3-9428-4cb6-ac4d-f013768b5182 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:45.420925 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961e2e3-9428-4cb6-ac4d-f013768b5182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:45.423807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961e2e3-9428-4cb6-ac4d-f013768b5182 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:45.446290 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4204/8335] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:45.450036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c89ac2-fe83-426a-a566-11af71963223 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:45.480238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c89ac2-fe83-426a-a566-11af71963223 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:45.495459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8678f60-d727-4e69-839e-6636e841237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:45.496154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8678f60-d727-4e69-839e-6636e841237f admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:45.496443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8678f60-d727-4e69-839e-6636e841237f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:45.496728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8678f60-d727-4e69-839e-6636e841237f admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:45.497506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8678f60-d727-4e69-839e-6636e841237f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:45.525812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8678f60-d727-4e69-839e-6636e841237f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:45.570098 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4132/8336] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:45.577030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961e2e3-9428-4cb6-ac4d-f013768b5182 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:45.597962 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961e2e3-9428-4cb6-ac4d-f013768b5182 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:45.669568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1651ee-c222-4eb4-abdc-3b96083b26e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:45.670414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1651ee-c222-4eb4-abdc-3b96083b26e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:45.672921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1651ee-c222-4eb4-abdc-3b96083b26e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:45.672921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1651ee-c222-4eb4-abdc-3b96083b26e6 admin admin] PATH_INFO: `/v3/projects/b720c7383da44a92afe7f3335fd0e76c/users/a71c414d78024e1dacf5c921b7acb338/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:45.763086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1651ee-c222-4eb4-abdc-3b96083b26e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b720c7383da44a92afe7f3335fd0e76c, user_id=a71c414d78024e1dacf5c921b7acb338, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:45.774246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1651ee-c222-4eb4-abdc-3b96083b26e6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:45.827767 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4205/8337] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:45 2022] PUT /identity/v3/projects/b720c7383da44a92afe7f3335fd0e76c/users/a71c414d78024e1dacf5c921b7acb338/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:45.830470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28968b-8ecc-49ae-a324-f6e6cb1d96b0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:45.830964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28968b-8ecc-49ae-a324-f6e6cb1d96b0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:45.831338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28968b-8ecc-49ae-a324-f6e6cb1d96b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:45.928817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4b28968b-8ecc-49ae-a324-f6e6cb1d96b0 None None] MFA Rules not processed for user `a71c414d78024e1dacf5c921b7acb338`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:45.930050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4b28968b-8ecc-49ae-a324-f6e6cb1d96b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:45.997283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:46.064955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1651ee-c222-4eb4-abdc-3b96083b26e6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:46.065457 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4133/8338] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:46.120867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:46.235026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1651ee-c222-4eb4-abdc-3b96083b26e6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:46.246818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee108716-3fe5-4374-896d-02c505f97d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:46.247689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee108716-3fe5-4374-896d-02c505f97d7e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:46.248389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee108716-3fe5-4374-896d-02c505f97d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:46.253300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee108716-3fe5-4374-896d-02c505f97d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:46.255286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee108716-3fe5-4374-896d-02c505f97d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:46.261035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee108716-3fe5-4374-896d-02c505f97d7e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:46.321718 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4206/8339] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:46 2022] POST /identity/v3/projects => generated 383 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:46.325633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28968b-8ecc-49ae-a324-f6e6cb1d96b0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:46.339366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28968b-8ecc-49ae-a324-f6e6cb1d96b0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:46.433008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c0a4-0b79-4901-ab29-571b68391d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:46.433800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c0a4-0b79-4901-ab29-571b68391d2a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:46.434242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c0a4-0b79-4901-ab29-571b68391d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:46.434549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c0a4-0b79-4901-ab29-571b68391d2a admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:46.435381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03c0a4-0b79-4901-ab29-571b68391d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:46.437855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03c0a4-0b79-4901-ab29-571b68391d2a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:46.472473 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4134/8340] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:46 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:04:46.476784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee108716-3fe5-4374-896d-02c505f97d7e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:46.491809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee108716-3fe5-4374-896d-02c505f97d7e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:46.510307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0321ae9-2c12-4ed0-8be1-d6e50fcfb659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:46.511182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321ae9-2c12-4ed0-8be1-d6e50fcfb659 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:46.511560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321ae9-2c12-4ed0-8be1-d6e50fcfb659 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:46.512085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321ae9-2c12-4ed0-8be1-d6e50fcfb659 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:46.513638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0321ae9-2c12-4ed0-8be1-d6e50fcfb659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:46.518607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0321ae9-2c12-4ed0-8be1-d6e50fcfb659 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:46.549415 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4207/8341] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:46.555440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c0a4-0b79-4901-ab29-571b68391d2a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:46.590641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c0a4-0b79-4901-ab29-571b68391d2a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:46.602256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121eb96-0774-4b35-b7ec-7101ac917d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:46.604325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121eb96-0774-4b35-b7ec-7101ac917d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:46.604973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121eb96-0774-4b35-b7ec-7101ac917d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:46.605704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121eb96-0774-4b35-b7ec-7101ac917d4c admin admin] PATH_INFO: `/v3/projects/ba6b27d9b1bd4479bfc2122dea4cc749/users/e10a2d1f13ce417db5926ea1c59cdeb5/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:46.636907 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121eb96-0774-4b35-b7ec-7101ac917d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6b27d9b1bd4479bfc2122dea4cc749, user_id=e10a2d1f13ce417db5926ea1c59cdeb5, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:46.639983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121eb96-0774-4b35-b7ec-7101ac917d4c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:46.666943 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4135/8342] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:46 2022] PUT /identity/v3/projects/ba6b27d9b1bd4479bfc2122dea4cc749/users/e10a2d1f13ce417db5926ea1c59cdeb5/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:46.671317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0321ae9-2c12-4ed0-8be1-d6e50fcfb659 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:46.688057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0321ae9-2c12-4ed0-8be1-d6e50fcfb659 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:46.862444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3db2b1-c442-464b-ba6e-7281053f9fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:46.865773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db2b1-c442-464b-ba6e-7281053f9fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:46.866574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db2b1-c442-464b-ba6e-7281053f9fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:46.867239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db2b1-c442-464b-ba6e-7281053f9fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:46.868831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3db2b1-c442-464b-ba6e-7281053f9fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:46.871081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3db2b1-c442-464b-ba6e-7281053f9fa1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:46.896390 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4208/8343] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:46.900625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121eb96-0774-4b35-b7ec-7101ac917d4c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:46.929863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121eb96-0774-4b35-b7ec-7101ac917d4c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:46.959404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3bb73-4013-4b80-915b-fed92a081438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:46.961717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3bb73-4013-4b80-915b-fed92a081438 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:46.963026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3bb73-4013-4b80-915b-fed92a081438 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:46.963476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3bb73-4013-4b80-915b-fed92a081438 admin admin] PATH_INFO: `/v3/projects/ba6b27d9b1bd4479bfc2122dea4cc749/users/e10a2d1f13ce417db5926ea1c59cdeb5/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:46.970526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3bb73-4013-4b80-915b-fed92a081438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6b27d9b1bd4479bfc2122dea4cc749, user_id=e10a2d1f13ce417db5926ea1c59cdeb5, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:46.981438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3bb73-4013-4b80-915b-fed92a081438 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:47.010078 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4136/8344] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:46 2022] PUT /identity/v3/projects/ba6b27d9b1bd4479bfc2122dea4cc749/users/e10a2d1f13ce417db5926ea1c59cdeb5/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:47.021133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bc9bc-d5c4-489a-9436-b9b9cb4882fe None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:47.021452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bc9bc-d5c4-489a-9436-b9b9cb4882fe None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:47.021732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bc9bc-d5c4-489a-9436-b9b9cb4882fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:47.082841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-872bc9bc-d5c4-489a-9436-b9b9cb4882fe None None] MFA Rules not processed for user `e10a2d1f13ce417db5926ea1c59cdeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:47.084094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-872bc9bc-d5c4-489a-9436-b9b9cb4882fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:47.300500 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4209/8345] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:47.313283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3bb73-4013-4b80-915b-fed92a081438 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:47.315560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d0a3bb73-4013-4b80-915b-fed92a081438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:47.472704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3bb73-4013-4b80-915b-fed92a081438 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:47.477349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba9d5-ba3e-4975-b33a-c62f4470654a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:47.478474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba9d5-ba3e-4975-b33a-c62f4470654a service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:47.478943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba9d5-ba3e-4975-b33a-c62f4470654a service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:47.479374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba9d5-ba3e-4975-b33a-c62f4470654a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:47.571750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:47.601708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ba9d5-ba3e-4975-b33a-c62f4470654a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:47.604679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ba9d5-ba3e-4975-b33a-c62f4470654a service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:47.644777 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4137/8346] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:49.216928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7b481-6f27-472d-897c-c9cbd7f0592c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:49.217380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7b481-6f27-472d-897c-c9cbd7f0592c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:49.217519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7b481-6f27-472d-897c-c9cbd7f0592c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:49.264610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8de7b481-6f27-472d-897c-c9cbd7f0592c None None] MFA Rules not processed for user `64dd24ea45ac485d8d411837d7078301`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:49.266414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8de7b481-6f27-472d-897c-c9cbd7f0592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:49.314103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:49.421307 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4210/8347] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:50.036045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba9d5-ba3e-4975-b33a-c62f4470654a service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:50.039649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ec7ba9d5-ba3e-4975-b33a-c62f4470654a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:50.214696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba9d5-ba3e-4975-b33a-c62f4470654a service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:50.225231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39ac97-82aa-4042-baa6-acedcaf0f46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:50.226038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39ac97-82aa-4042-baa6-acedcaf0f46d service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:50.227473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39ac97-82aa-4042-baa6-acedcaf0f46d service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:50.227872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39ac97-82aa-4042-baa6-acedcaf0f46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:50.233482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de39ac97-82aa-4042-baa6-acedcaf0f46d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:50.260851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39ac97-82aa-4042-baa6-acedcaf0f46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:50.266692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39ac97-82aa-4042-baa6-acedcaf0f46d service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:50.298626 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4138/8348] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:50.811000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7b481-6f27-472d-897c-c9cbd7f0592c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:50.834829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7b481-6f27-472d-897c-c9cbd7f0592c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:50.840672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df3cb5-4cf4-4c86-9dc0-afe204dd89de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:50.841757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3cb5-4cf4-4c86-9dc0-afe204dd89de service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:50.842186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3cb5-4cf4-4c86-9dc0-afe204dd89de service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:50.842607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3cb5-4cf4-4c86-9dc0-afe204dd89de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:50.972780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df3cb5-4cf4-4c86-9dc0-afe204dd89de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:50.974593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df3cb5-4cf4-4c86-9dc0-afe204dd89de service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:51.002061 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4211/8349] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:51.995639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39ac97-82aa-4042-baa6-acedcaf0f46d service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:52.016970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39ac97-82aa-4042-baa6-acedcaf0f46d service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:52.027799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b214ef4-9d92-4c0f-9081-92a53528ad09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:52.028849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214ef4-9d92-4c0f-9081-92a53528ad09 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:52.030226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214ef4-9d92-4c0f-9081-92a53528ad09 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:52.030722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214ef4-9d92-4c0f-9081-92a53528ad09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:52.062317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214ef4-9d92-4c0f-9081-92a53528ad09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:52.064109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214ef4-9d92-4c0f-9081-92a53528ad09 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:52.075544 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4139/8350] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:57.518443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df3cb5-4cf4-4c86-9dc0-afe204dd89de service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:57.520648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-28df3cb5-4cf4-4c86-9dc0-afe204dd89de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:57.649508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df3cb5-4cf4-4c86-9dc0-afe204dd89de service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:57.655135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:57.655883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:57.656237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:57.656435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] PATH_INFO: `/v3/users/c77dd731bcbd4fb58230613009356ecf` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:57.658388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c77dd731bcbd4fb58230613009356ecf)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:57.660327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:57.738922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c77dd731bcbd4fb58230613009356ecf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:57.740037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c77dd731bcbd4fb58230613009356ecf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:57.758237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c77dd731bcbd4fb58230613009356ecf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:57.759301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:57.761620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c77dd731bcbd4fb58230613009356ecf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:57.774219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c77dd731bcbd4fb58230613009356ecf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:57.793685 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4212/8351] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:04:57 2022] DELETE /identity/v3/users/c77dd731bcbd4fb58230613009356ecf => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:57.797627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff733f-80c7-4e76-94d9-a23096990e37 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:57.798522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff733f-80c7-4e76-94d9-a23096990e37 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:57.799110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff733f-80c7-4e76-94d9-a23096990e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:57.856667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d0ff733f-80c7-4e76-94d9-a23096990e37 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:57.858335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d0ff733f-80c7-4e76-94d9-a23096990e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:57.960266 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4140/8352] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:57.961438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:57.963510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:58.067096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd9524-6b88-48b3-851c-9af980f451c8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:58.071389 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7aa53-8bf1-4478-b174-095c43db269c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:58.072192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7aa53-8bf1-4478-b174-095c43db269c service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:58.072489 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7aa53-8bf1-4478-b174-095c43db269c service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:58.072760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7aa53-8bf1-4478-b174-095c43db269c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:58.086160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7aa53-8bf1-4478-b174-095c43db269c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:58.087810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7aa53-8bf1-4478-b174-095c43db269c service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:58.101523 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4213/8353] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:04:58.404115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff733f-80c7-4e76-94d9-a23096990e37 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:58.407001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d0ff733f-80c7-4e76-94d9-a23096990e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:58.441757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff733f-80c7-4e76-94d9-a23096990e37 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:58.452327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:58.453789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:58.454380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:58.454895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] PATH_INFO: `/v3/projects/0ee5983d46a5439e8884cb455bd2cec2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:58.456734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee5983d46a5439e8884cb455bd2cec2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:58.459145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:58.543973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee5983d46a5439e8884cb455bd2cec2', 'request_id': 'req-46e62794-86e8-4595-b285-010d4f5bbdb3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.555951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee5983d46a5439e8884cb455bd2cec2', 'request_id': 'req-46e62794-86e8-4595-b285-010d4f5bbdb3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.575537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee5983d46a5439e8884cb455bd2cec2', 'request_id': 'req-46e62794-86e8-4595-b285-010d4f5bbdb3'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.588973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:58.595099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] The token cache is being invalidate because project 0ee5983d46a5439e8884cb455bd2cec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:04:58.596353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.598367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46e62794-86e8-4595-b285-010d4f5bbdb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:04:58.601040 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4141/8354] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:04:58 2022] DELETE /identity/v3/projects/0ee5983d46a5439e8884cb455bd2cec2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:58.606734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941bce-0c40-418f-ace6-200d9436b775 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:58.607382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941bce-0c40-418f-ace6-200d9436b775 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:58.607787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941bce-0c40-418f-ace6-200d9436b775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:58.647507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b3941bce-0c40-418f-ace6-200d9436b775 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:58.648969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b3941bce-0c40-418f-ace6-200d9436b775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:58.817938 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4214/8355] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:04:58.819099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed172e-a3df-43a6-8d1e-dea5431d37fd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:58.820072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed172e-a3df-43a6-8d1e-dea5431d37fd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:58.820377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed172e-a3df-43a6-8d1e-dea5431d37fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:58.863044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-35ed172e-a3df-43a6-8d1e-dea5431d37fd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:58.867395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-35ed172e-a3df-43a6-8d1e-dea5431d37fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:58.881139 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4142/8356] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:04:58.885454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3941bce-0c40-418f-ace6-200d9436b775 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:58.900658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3941bce-0c40-418f-ace6-200d9436b775 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:58.916403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83925dde-4a85-46d7-aed9-f359add652e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:58.917174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83925dde-4a85-46d7-aed9-f359add652e8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:58.917553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83925dde-4a85-46d7-aed9-f359add652e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:58.917920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83925dde-4a85-46d7-aed9-f359add652e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:58.918662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83925dde-4a85-46d7-aed9-f359add652e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:04:58.919085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83925dde-4a85-46d7-aed9-f359add652e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:58.921133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83925dde-4a85-46d7-aed9-f359add652e8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:58.951668 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4215/8357] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:04:58.956727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed172e-a3df-43a6-8d1e-dea5431d37fd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:58.970618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed172e-a3df-43a6-8d1e-dea5431d37fd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:58.993835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd91e07-d4ca-4c10-8f84-0d09cf0a004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:58.994485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91e07-d4ca-4c10-8f84-0d09cf0a004f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:58.994827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91e07-d4ca-4c10-8f84-0d09cf0a004f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:58.995136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91e07-d4ca-4c10-8f84-0d09cf0a004f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:58.995895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd91e07-d4ca-4c10-8f84-0d09cf0a004f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:58.998584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd91e07-d4ca-4c10-8f84-0d09cf0a004f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.034189 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4143/8358] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:04:58 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:59.038900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83925dde-4a85-46d7-aed9-f359add652e8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.050634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83925dde-4a85-46d7-aed9-f359add652e8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.119889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2557e4-b818-4889-8479-ac1dff00acc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.120502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2557e4-b818-4889-8479-ac1dff00acc6 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.120788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2557e4-b818-4889-8479-ac1dff00acc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.121066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2557e4-b818-4889-8479-ac1dff00acc6 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.121786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2557e4-b818-4889-8479-ac1dff00acc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.123696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2557e4-b818-4889-8479-ac1dff00acc6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.144653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:59.153426 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4216/8359] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:04:59 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:04:59.158436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd91e07-d4ca-4c10-8f84-0d09cf0a004f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.170331 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd91e07-d4ca-4c10-8f84-0d09cf0a004f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.175500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f8167-f0f6-437f-a240-ddf1c4d0e7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.177496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8167-f0f6-437f-a240-ddf1c4d0e7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.178173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8167-f0f6-437f-a240-ddf1c4d0e7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.179303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8167-f0f6-437f-a240-ddf1c4d0e7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.180149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f8167-f0f6-437f-a240-ddf1c4d0e7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.182551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f8167-f0f6-437f-a240-ddf1c4d0e7e1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.203098 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4144/8360] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:59.207574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2557e4-b818-4889-8479-ac1dff00acc6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.221611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2557e4-b818-4889-8479-ac1dff00acc6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.227306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fa568-f92b-4da1-9b62-a40fbd989090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.227919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fa568-f92b-4da1-9b62-a40fbd989090 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.228201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fa568-f92b-4da1-9b62-a40fbd989090 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.228479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fa568-f92b-4da1-9b62-a40fbd989090 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.229118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fa568-f92b-4da1-9b62-a40fbd989090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.230754 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fa568-f92b-4da1-9b62-a40fbd989090 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.247400 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4217/8361] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:04:59.249101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f8167-f0f6-437f-a240-ddf1c4d0e7e1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.264214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f8167-f0f6-437f-a240-ddf1c4d0e7e1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.275314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96c987-6bd1-4811-97ac-d7b313febfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.276461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96c987-6bd1-4811-97ac-d7b313febfdb admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.276773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96c987-6bd1-4811-97ac-d7b313febfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.277126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96c987-6bd1-4811-97ac-d7b313febfdb admin admin] PATH_INFO: `/v3/projects/bb0c995cafe845cf8fff7f11c37a5e35/users/9f59a21679fd4bbdb3fe005685e9d128/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.297486 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96c987-6bd1-4811-97ac-d7b313febfdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0c995cafe845cf8fff7f11c37a5e35, user_id=9f59a21679fd4bbdb3fe005685e9d128, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.300368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96c987-6bd1-4811-97ac-d7b313febfdb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.333595 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4145/8362] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:04:59 2022] PUT /identity/v3/projects/bb0c995cafe845cf8fff7f11c37a5e35/users/9f59a21679fd4bbdb3fe005685e9d128/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:04:59.334798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfde0b-e5c0-4d5e-a75a-d49898cddece None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.335207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfde0b-e5c0-4d5e-a75a-d49898cddece None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.335505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfde0b-e5c0-4d5e-a75a-d49898cddece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.368426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e3bfde0b-e5c0-4d5e-a75a-d49898cddece None None] MFA Rules not processed for user `9f59a21679fd4bbdb3fe005685e9d128`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:04:59.369663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e3bfde0b-e5c0-4d5e-a75a-d49898cddece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:59.455488 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4218/8363] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:04:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:04:59.466036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96c987-6bd1-4811-97ac-d7b313febfdb admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:04:59.467820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ed96c987-6bd1-4811-97ac-d7b313febfdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:04:59.548058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96c987-6bd1-4811-97ac-d7b313febfdb admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:04:59.552022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e2594-d740-4c9d-94a3-33f5611327dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:04:59.552857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e2594-d740-4c9d-94a3-33f5611327dd service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:04:59.553197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e2594-d740-4c9d-94a3-33f5611327dd service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:04:59.553519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e2594-d740-4c9d-94a3-33f5611327dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:04:59.566691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e2594-d740-4c9d-94a3-33f5611327dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:04:59.568152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e2594-d740-4c9d-94a3-33f5611327dd service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:04:59.579388 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4146/8364] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:04:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:02.112705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfde0b-e5c0-4d5e-a75a-d49898cddece None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:02.118234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e3bfde0b-e5c0-4d5e-a75a-d49898cddece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:02.212959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfde0b-e5c0-4d5e-a75a-d49898cddece None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:02.226760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:02.227662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:02.228108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:02.228669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] PATH_INFO: `/v3/users/a07aa6e9f7e64d4d953ecb3413aab8ec` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:02.230491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07aa6e9f7e64d4d953ecb3413aab8ec)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:02.236577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:02.327748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07aa6e9f7e64d4d953ecb3413aab8ec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.328715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07aa6e9f7e64d4d953ecb3413aab8ec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.351634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07aa6e9f7e64d4d953ecb3413aab8ec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.353532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07aa6e9f7e64d4d953ecb3413aab8ec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.371862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07aa6e9f7e64d4d953ecb3413aab8ec'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:02.377469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:02.396906 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4219/8365] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:02 2022] DELETE /identity/v3/users/a07aa6e9f7e64d4d953ecb3413aab8ec => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:02.402234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdab1c-f043-4290-88f6-4965eb1915c4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:02.403194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdab1c-f043-4290-88f6-4965eb1915c4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:02.403632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdab1c-f043-4290-88f6-4965eb1915c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:02.452016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-bdcdab1c-f043-4290-88f6-4965eb1915c4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:02.455358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bdcdab1c-f043-4290-88f6-4965eb1915c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:02.612748 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4147/8366] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:02.632830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:02.634563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:02.759650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be074-a9a5-42dd-836f-39f7a2ca7712 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:02.767323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcc8b5-b056-4114-94b7-f465966d6d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:02.767947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcc8b5-b056-4114-94b7-f465966d6d49 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:02.768223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcc8b5-b056-4114-94b7-f465966d6d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:02.768495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcc8b5-b056-4114-94b7-f465966d6d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:02.791901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcc8b5-b056-4114-94b7-f465966d6d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:02.793538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcc8b5-b056-4114-94b7-f465966d6d49 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:02.808255 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4220/8367] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:03.493709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdab1c-f043-4290-88f6-4965eb1915c4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:03.495231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bdcdab1c-f043-4290-88f6-4965eb1915c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:03.516472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdab1c-f043-4290-88f6-4965eb1915c4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:03.524593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:03.526152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:03.526437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:03.526715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] PATH_INFO: `/v3/projects/c84a80351a9c478e9fc935d89a8f2bec` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:03.528069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c84a80351a9c478e9fc935d89a8f2bec)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:03.531489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:03.603442 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:03.627159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84a80351a9c478e9fc935d89a8f2bec', 'request_id': 'req-a251d609-fc94-4685-b7d9-54a6acc6ebce'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.638776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84a80351a9c478e9fc935d89a8f2bec', 'request_id': 'req-a251d609-fc94-4685-b7d9-54a6acc6ebce'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.650758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84a80351a9c478e9fc935d89a8f2bec', 'request_id': 'req-a251d609-fc94-4685-b7d9-54a6acc6ebce'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.670115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] The token cache is being invalidate because project c84a80351a9c478e9fc935d89a8f2bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:03.670642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.671537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.673981 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4148/8368] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:03 2022] DELETE /identity/v3/projects/c84a80351a9c478e9fc935d89a8f2bec => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:03.677973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcc8b5-b056-4114-94b7-f465966d6d49 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:03.688882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcc8b5-b056-4114-94b7-f465966d6d49 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:03.843755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:03.844752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:03.846349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:03.847188 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] PATH_INFO: `/v3/users/a71c414d78024e1dacf5c921b7acb338` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:03.850948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71c414d78024e1dacf5c921b7acb338)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:03.854492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:03.940143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71c414d78024e1dacf5c921b7acb338'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.940792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71c414d78024e1dacf5c921b7acb338'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.959128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71c414d78024e1dacf5c921b7acb338'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.959904 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71c414d78024e1dacf5c921b7acb338'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.967982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71c414d78024e1dacf5c921b7acb338'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:03.989822 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4221/8369] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:03 2022] DELETE /identity/v3/users/a71c414d78024e1dacf5c921b7acb338 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:04.598435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:04.599896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:04.624064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251d609-fc94-4685-b7d9-54a6acc6ebce admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:04.817244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:04.818005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:04.818328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:04.818615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] PATH_INFO: `/v3/projects/b720c7383da44a92afe7f3335fd0e76c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:04.820073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b720c7383da44a92afe7f3335fd0e76c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:04.823012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:04.930597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b720c7383da44a92afe7f3335fd0e76c', 'request_id': 'req-255376ae-9ba9-4884-98a6-2b1bfd2a4839'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:04.947393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b720c7383da44a92afe7f3335fd0e76c', 'request_id': 'req-255376ae-9ba9-4884-98a6-2b1bfd2a4839'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:04.966573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b720c7383da44a92afe7f3335fd0e76c', 'request_id': 'req-255376ae-9ba9-4884-98a6-2b1bfd2a4839'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:04.976588 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] The token cache is being invalidate because project b720c7383da44a92afe7f3335fd0e76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:04.976894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:04.977787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:04.987014 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4149/8370] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:04 2022] DELETE /identity/v3/projects/b720c7383da44a92afe7f3335fd0e76c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:04.992606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:04.994337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:05.016392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13553421-92b9-44a1-b2fd-3cfa0dd4ff01 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:05.046802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:05.152481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f51f70-5eb4-4ba0-b1a8-e7f7472d7b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:05.156917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51f70-5eb4-4ba0-b1a8-e7f7472d7b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:05.157517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51f70-5eb4-4ba0-b1a8-e7f7472d7b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:05.158142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51f70-5eb4-4ba0-b1a8-e7f7472d7b7f admin admin] PATH_INFO: `/v3/users/e10a2d1f13ce417db5926ea1c59cdeb5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:05.159699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f51f70-5eb4-4ba0-b1a8-e7f7472d7b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10a2d1f13ce417db5926ea1c59cdeb5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:05.161971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f51f70-5eb4-4ba0-b1a8-e7f7472d7b7f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:05.327201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4f51f70-5eb4-4ba0-b1a8-e7f7472d7b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10a2d1f13ce417db5926ea1c59cdeb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.328889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4f51f70-5eb4-4ba0-b1a8-e7f7472d7b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10a2d1f13ce417db5926ea1c59cdeb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.359678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4f51f70-5eb4-4ba0-b1a8-e7f7472d7b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10a2d1f13ce417db5926ea1c59cdeb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.360456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4f51f70-5eb4-4ba0-b1a8-e7f7472d7b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10a2d1f13ce417db5926ea1c59cdeb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.368071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b4f51f70-5eb4-4ba0-b1a8-e7f7472d7b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10a2d1f13ce417db5926ea1c59cdeb5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:05.404049 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4222/8371] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:04 2022] DELETE /identity/v3/users/e10a2d1f13ce417db5926ea1c59cdeb5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:06.435397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:06.437693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:06.465501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255376ae-9ba9-4884-98a6-2b1bfd2a4839 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:06.608429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:06.623606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:06.624692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:06.626067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:06.626721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] PATH_INFO: `/v3/projects/ba6b27d9b1bd4479bfc2122dea4cc749` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:06.630383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6b27d9b1bd4479bfc2122dea4cc749)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:06.633440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:06.727791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6b27d9b1bd4479bfc2122dea4cc749', 'request_id': 'req-04a08d1f-6b75-4ef3-858b-78c42276b405'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:06.739379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6b27d9b1bd4479bfc2122dea4cc749', 'request_id': 'req-04a08d1f-6b75-4ef3-858b-78c42276b405'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:06.754976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6b27d9b1bd4479bfc2122dea4cc749', 'request_id': 'req-04a08d1f-6b75-4ef3-858b-78c42276b405'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:06.790433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] The token cache is being invalidate because project ba6b27d9b1bd4479bfc2122dea4cc749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:06.791642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:06.792702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-04a08d1f-6b75-4ef3-858b-78c42276b405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:06.802679 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4150/8372] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:06 2022] DELETE /identity/v3/projects/ba6b27d9b1bd4479bfc2122dea4cc749 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:06.804182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198e3e8-3d31-4573-be7a-4d6144480cd8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:06.804617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198e3e8-3d31-4573-be7a-4d6144480cd8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:06.804729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198e3e8-3d31-4573-be7a-4d6144480cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:06.839587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6198e3e8-3d31-4573-be7a-4d6144480cd8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:06.841212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6198e3e8-3d31-4573-be7a-4d6144480cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:06.985576 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4223/8373] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:06.989765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b877a-fd3d-4291-8f45-f9d2a5b5739b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:06.990141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b877a-fd3d-4291-8f45-f9d2a5b5739b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:06.990506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b877a-fd3d-4291-8f45-f9d2a5b5739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.030475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ec7b877a-fd3d-4291-8f45-f9d2a5b5739b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:07.053484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ec7b877a-fd3d-4291-8f45-f9d2a5b5739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:07.072213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198e3e8-3d31-4573-be7a-4d6144480cd8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:07.081816 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4151/8374] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:07.086711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198e3e8-3d31-4573-be7a-4d6144480cd8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:07.095849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f33ec8-91c1-4b59-8808-d1b8e957dbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:07.096373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f33ec8-91c1-4b59-8808-d1b8e957dbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.096660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f33ec8-91c1-4b59-8808-d1b8e957dbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.097031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f33ec8-91c1-4b59-8808-d1b8e957dbc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.097900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f33ec8-91c1-4b59-8808-d1b8e957dbc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:07.098217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f33ec8-91c1-4b59-8808-d1b8e957dbc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:07.099845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f33ec8-91c1-4b59-8808-d1b8e957dbc9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:07.134690 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4224/8375] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:05:07.135862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b877a-fd3d-4291-8f45-f9d2a5b5739b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:07.152363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b877a-fd3d-4291-8f45-f9d2a5b5739b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:07.167940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc44e36-e86a-4dd3-9333-aabf77cf7884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:07.168567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44e36-e86a-4dd3-9333-aabf77cf7884 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.168862 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44e36-e86a-4dd3-9333-aabf77cf7884 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.169117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44e36-e86a-4dd3-9333-aabf77cf7884 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.169791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc44e36-e86a-4dd3-9333-aabf77cf7884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:07.172291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc44e36-e86a-4dd3-9333-aabf77cf7884 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:07.239988 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4152/8376] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:07 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:07.244114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f33ec8-91c1-4b59-8808-d1b8e957dbc9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:07.257276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f33ec8-91c1-4b59-8808-d1b8e957dbc9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:07.324899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:07.422674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be94863-eb9e-4da0-8457-6137d4f0e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:07.423618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be94863-eb9e-4da0-8457-6137d4f0e76e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.423779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be94863-eb9e-4da0-8457-6137d4f0e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.424362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be94863-eb9e-4da0-8457-6137d4f0e76e admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.425166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be94863-eb9e-4da0-8457-6137d4f0e76e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:07.427744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be94863-eb9e-4da0-8457-6137d4f0e76e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:07.459326 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4225/8377] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:07 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:07.463420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc44e36-e86a-4dd3-9333-aabf77cf7884 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:07.477067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc44e36-e86a-4dd3-9333-aabf77cf7884 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:07.484818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72b4dd-85fd-427e-827c-e3599e7425c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:07.485647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72b4dd-85fd-427e-827c-e3599e7425c5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.486281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72b4dd-85fd-427e-827c-e3599e7425c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.486755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72b4dd-85fd-427e-827c-e3599e7425c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.488070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72b4dd-85fd-427e-827c-e3599e7425c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:07.490226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72b4dd-85fd-427e-827c-e3599e7425c5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:07.505635 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4153/8378] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:07.509492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be94863-eb9e-4da0-8457-6137d4f0e76e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:07.524741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be94863-eb9e-4da0-8457-6137d4f0e76e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:07.534110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46b224-f1fd-47bb-a726-d0f308dc5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:07.535024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46b224-f1fd-47bb-a726-d0f308dc5267 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.535664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46b224-f1fd-47bb-a726-d0f308dc5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.536163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46b224-f1fd-47bb-a726-d0f308dc5267 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.537184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46b224-f1fd-47bb-a726-d0f308dc5267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:07.539651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46b224-f1fd-47bb-a726-d0f308dc5267 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:07.564889 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4226/8379] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:07.573437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72b4dd-85fd-427e-827c-e3599e7425c5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:07.590757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72b4dd-85fd-427e-827c-e3599e7425c5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:07.604954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e667-ab52-487e-b652-6c22390959d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:07.607296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e667-ab52-487e-b652-6c22390959d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.607683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e667-ab52-487e-b652-6c22390959d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.608273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e667-ab52-487e-b652-6c22390959d1 admin admin] PATH_INFO: `/v3/projects/508cc41c39d14d62be8a88eb11bfc4ca/users/0928e447a8cc4b9f8f8fcdbbf195fcbb/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.665539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278e667-ab52-487e-b652-6c22390959d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508cc41c39d14d62be8a88eb11bfc4ca, user_id=0928e447a8cc4b9f8f8fcdbbf195fcbb, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:07.672992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278e667-ab52-487e-b652-6c22390959d1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:07.714751 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4154/8380] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:07 2022] PUT /identity/v3/projects/508cc41c39d14d62be8a88eb11bfc4ca/users/0928e447a8cc4b9f8f8fcdbbf195fcbb/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:07.725774 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32b2f0-965c-4876-ab89-515d2260179c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.726332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32b2f0-965c-4876-ab89-515d2260179c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.726856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32b2f0-965c-4876-ab89-515d2260179c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.766239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e667-ab52-487e-b652-6c22390959d1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:07.768392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d278e667-ab52-487e-b652-6c22390959d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:07.797149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dc32b2f0-965c-4876-ab89-515d2260179c None None] MFA Rules not processed for user `0928e447a8cc4b9f8f8fcdbbf195fcbb`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:07.801940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc32b2f0-965c-4876-ab89-515d2260179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:07.917098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e667-ab52-487e-b652-6c22390959d1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:07.931048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b357abe-fbfe-426c-a2f3-8aad3a20267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:07.931718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b357abe-fbfe-426c-a2f3-8aad3a20267b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:07.933914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b357abe-fbfe-426c-a2f3-8aad3a20267b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:07.934888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b357abe-fbfe-426c-a2f3-8aad3a20267b admin admin] PATH_INFO: `/v3/users/9f59a21679fd4bbdb3fe005685e9d128` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:07.937656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b357abe-fbfe-426c-a2f3-8aad3a20267b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f59a21679fd4bbdb3fe005685e9d128)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:07.939680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b357abe-fbfe-426c-a2f3-8aad3a20267b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:07.961886 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4227/8381] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:07.977441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32b2f0-965c-4876-ab89-515d2260179c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:07.979627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc32b2f0-965c-4876-ab89-515d2260179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:08.010176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:08.066375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3b357abe-fbfe-426c-a2f3-8aad3a20267b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f59a21679fd4bbdb3fe005685e9d128'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:08.070714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3b357abe-fbfe-426c-a2f3-8aad3a20267b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f59a21679fd4bbdb3fe005685e9d128'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:08.101699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3b357abe-fbfe-426c-a2f3-8aad3a20267b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f59a21679fd4bbdb3fe005685e9d128'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:08.119809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3b357abe-fbfe-426c-a2f3-8aad3a20267b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f59a21679fd4bbdb3fe005685e9d128'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:08.133963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3b357abe-fbfe-426c-a2f3-8aad3a20267b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f59a21679fd4bbdb3fe005685e9d128'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:08.154176 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4155/8382] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:07 2022] DELETE /identity/v3/users/9f59a21679fd4bbdb3fe005685e9d128 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:08.156232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeddf9-bcf1-42fc-a13c-90630918d290 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.156602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeddf9-bcf1-42fc-a13c-90630918d290 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.156785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeddf9-bcf1-42fc-a13c-90630918d290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.191388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32b2f0-965c-4876-ab89-515d2260179c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:08.195160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c1aeddf9-bcf1-42fc-a13c-90630918d290 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:08.196395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c1aeddf9-bcf1-42fc-a13c-90630918d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:08.316837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:08.326948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab3ff-2f3c-4db4-a86c-2320d555263c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:08.328148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab3ff-2f3c-4db4-a86c-2320d555263c service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.328443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab3ff-2f3c-4db4-a86c-2320d555263c service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.330453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab3ff-2f3c-4db4-a86c-2320d555263c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.335395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4f2ab3ff-2f3c-4db4-a86c-2320d555263c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:08.392971 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4156/8383] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:08.397180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeddf9-bcf1-42fc-a13c-90630918d290 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:08.401159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c1aeddf9-bcf1-42fc-a13c-90630918d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:08.530080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab3ff-2f3c-4db4-a86c-2320d555263c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:08.531588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab3ff-2f3c-4db4-a86c-2320d555263c service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:08.563492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeddf9-bcf1-42fc-a13c-90630918d290 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:08.565540 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4228/8384] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:08.571170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea7b5-50e9-4c06-8d5c-ce1397366e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:08.571804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea7b5-50e9-4c06-8d5c-ce1397366e55 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:08.572092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea7b5-50e9-4c06-8d5c-ce1397366e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:08.572369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea7b5-50e9-4c06-8d5c-ce1397366e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:08.591293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ea7b5-50e9-4c06-8d5c-ce1397366e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:08.595026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ea7b5-50e9-4c06-8d5c-ce1397366e55 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:08.653932 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4157/8385] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:05:09.416708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab3ff-2f3c-4db4-a86c-2320d555263c service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:09.418506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4f2ab3ff-2f3c-4db4-a86c-2320d555263c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:09.458474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab3ff-2f3c-4db4-a86c-2320d555263c service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:09.518303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:09.520980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.521171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.521483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] PATH_INFO: `/v3/projects/bb0c995cafe845cf8fff7f11c37a5e35` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.527703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0c995cafe845cf8fff7f11c37a5e35)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:09.529673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:09.679413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0c995cafe845cf8fff7f11c37a5e35', 'request_id': 'req-315a6150-99e4-483b-a28e-4c3f182e1b6d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:09.687529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0c995cafe845cf8fff7f11c37a5e35', 'request_id': 'req-315a6150-99e4-483b-a28e-4c3f182e1b6d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:09.719362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0c995cafe845cf8fff7f11c37a5e35', 'request_id': 'req-315a6150-99e4-483b-a28e-4c3f182e1b6d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:09.761025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] The token cache is being invalidate because project bb0c995cafe845cf8fff7f11c37a5e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:09.761323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:09.775297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-315a6150-99e4-483b-a28e-4c3f182e1b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:09.789771 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4229/8386] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:09 2022] DELETE /identity/v3/projects/bb0c995cafe845cf8fff7f11c37a5e35 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:09.796280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416033c-4ecf-4778-b5a2-af6b789c9db0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:09.796802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416033c-4ecf-4778-b5a2-af6b789c9db0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:09.796885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416033c-4ecf-4778-b5a2-af6b789c9db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:09.847973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b416033c-4ecf-4778-b5a2-af6b789c9db0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:09.849229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b416033c-4ecf-4778-b5a2-af6b789c9db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:09.926255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:10.013873 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4158/8387] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:10.021258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff26e3-dea4-4fcb-b301-c269d1a9485e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.021740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff26e3-dea4-4fcb-b301-c269d1a9485e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.022169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff26e3-dea4-4fcb-b301-c269d1a9485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.050882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f6ff26e3-dea4-4fcb-b301-c269d1a9485e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:10.052432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f6ff26e3-dea4-4fcb-b301-c269d1a9485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:10.077326 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4230/8388] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:10.078863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416033c-4ecf-4778-b5a2-af6b789c9db0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.098573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416033c-4ecf-4778-b5a2-af6b789c9db0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:10.103784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb6519-d952-4a01-b3a0-92a164b994c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:10.104600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6519-d952-4a01-b3a0-92a164b994c8 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.105318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6519-d952-4a01-b3a0-92a164b994c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.105786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6519-d952-4a01-b3a0-92a164b994c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.106590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6519-d952-4a01-b3a0-92a164b994c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:10.110524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6519-d952-4a01-b3a0-92a164b994c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:10.112597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6519-d952-4a01-b3a0-92a164b994c8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:10.132825 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4159/8389] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:05:10.137448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff26e3-dea4-4fcb-b301-c269d1a9485e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.160545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff26e3-dea4-4fcb-b301-c269d1a9485e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:10.179212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd4511-7f3c-4f08-aa7c-ad37fc678f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:10.180091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd4511-7f3c-4f08-aa7c-ad37fc678f24 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.180596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd4511-7f3c-4f08-aa7c-ad37fc678f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.181136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd4511-7f3c-4f08-aa7c-ad37fc678f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.182176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd4511-7f3c-4f08-aa7c-ad37fc678f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:10.184481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd4511-7f3c-4f08-aa7c-ad37fc678f24 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:10.318015 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4231/8390] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:10 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:10.320199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb6519-d952-4a01-b3a0-92a164b994c8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.344269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb6519-d952-4a01-b3a0-92a164b994c8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:10.539151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a983bcb-d7e0-4f3b-9c41-dbe905867295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:10.540133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a983bcb-d7e0-4f3b-9c41-dbe905867295 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.544128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a983bcb-d7e0-4f3b-9c41-dbe905867295 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.544664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a983bcb-d7e0-4f3b-9c41-dbe905867295 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.546240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a983bcb-d7e0-4f3b-9c41-dbe905867295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:10.550739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a983bcb-d7e0-4f3b-9c41-dbe905867295 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:10.585968 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4160/8391] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:10 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:10.590241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd4511-7f3c-4f08-aa7c-ad37fc678f24 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.608358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd4511-7f3c-4f08-aa7c-ad37fc678f24 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:10.614301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868e00c-216c-4d9a-a207-cfe52239936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:10.615346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868e00c-216c-4d9a-a207-cfe52239936f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.615844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868e00c-216c-4d9a-a207-cfe52239936f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.616392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868e00c-216c-4d9a-a207-cfe52239936f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.617226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868e00c-216c-4d9a-a207-cfe52239936f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:10.619565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868e00c-216c-4d9a-a207-cfe52239936f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:10.633253 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4232/8392] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:10.636994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a983bcb-d7e0-4f3b-9c41-dbe905867295 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.650117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a983bcb-d7e0-4f3b-9c41-dbe905867295 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:10.656159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775afa30-236e-48de-baa9-ee4855d41698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:10.657273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775afa30-236e-48de-baa9-ee4855d41698 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.657753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775afa30-236e-48de-baa9-ee4855d41698 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.658035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775afa30-236e-48de-baa9-ee4855d41698 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.658713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775afa30-236e-48de-baa9-ee4855d41698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:10.660370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775afa30-236e-48de-baa9-ee4855d41698 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:10.673738 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4161/8393] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:10.677913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868e00c-216c-4d9a-a207-cfe52239936f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:10.689283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868e00c-216c-4d9a-a207-cfe52239936f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:10.694325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34562ea4-0f79-4301-a5e6-da33473e3b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:10.695698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34562ea4-0f79-4301-a5e6-da33473e3b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.696015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34562ea4-0f79-4301-a5e6-da33473e3b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.696394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34562ea4-0f79-4301-a5e6-da33473e3b4b admin admin] PATH_INFO: `/v3/projects/970a9eaf4bb4462da8489418614fec7f/users/d7f32294c7634f09834a4905b58da348/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.750227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34562ea4-0f79-4301-a5e6-da33473e3b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=970a9eaf4bb4462da8489418614fec7f, user_id=d7f32294c7634f09834a4905b58da348, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:10.755393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34562ea4-0f79-4301-a5e6-da33473e3b4b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:10.774587 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4233/8394] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:10 2022] PUT /identity/v3/projects/970a9eaf4bb4462da8489418614fec7f/users/d7f32294c7634f09834a4905b58da348/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:10.785538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde174b-215c-404b-8173-66766580faa2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:10.786436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde174b-215c-404b-8173-66766580faa2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:10.786923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde174b-215c-404b-8173-66766580faa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:10.833168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-abde174b-215c-404b-8173-66766580faa2 None None] MFA Rules not processed for user `d7f32294c7634f09834a4905b58da348`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:10.835260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-abde174b-215c-404b-8173-66766580faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:10.954183 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4162/8395] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:10.958601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34562ea4-0f79-4301-a5e6-da33473e3b4b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.011902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:11.076736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34562ea4-0f79-4301-a5e6-da33473e3b4b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.083053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e9c26-49b1-4024-803c-73a91d48a85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.083898 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9c26-49b1-4024-803c-73a91d48a85e admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.084386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9c26-49b1-4024-803c-73a91d48a85e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.084801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9c26-49b1-4024-803c-73a91d48a85e admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.085543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e9c26-49b1-4024-803c-73a91d48a85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.087629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e9c26-49b1-4024-803c-73a91d48a85e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.119958 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4234/8396] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:10 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:11.123867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde174b-215c-404b-8173-66766580faa2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.138086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde174b-215c-404b-8173-66766580faa2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.176358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:11.220175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2190915-05ab-455b-99b2-76376d2a4adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.221191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2190915-05ab-455b-99b2-76376d2a4adf admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.221621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2190915-05ab-455b-99b2-76376d2a4adf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.222088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2190915-05ab-455b-99b2-76376d2a4adf admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.222909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2190915-05ab-455b-99b2-76376d2a4adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.225533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2190915-05ab-455b-99b2-76376d2a4adf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.254556 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4163/8397] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:11 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:11.258147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e9c26-49b1-4024-803c-73a91d48a85e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.271326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e9c26-49b1-4024-803c-73a91d48a85e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.276978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56065ff7-16af-4742-9949-bfb8f3415a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.277810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56065ff7-16af-4742-9949-bfb8f3415a30 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.278170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56065ff7-16af-4742-9949-bfb8f3415a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.278551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56065ff7-16af-4742-9949-bfb8f3415a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.279093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56065ff7-16af-4742-9949-bfb8f3415a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.281104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56065ff7-16af-4742-9949-bfb8f3415a30 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.296551 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4235/8398] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:11.298119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2190915-05ab-455b-99b2-76376d2a4adf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.309451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2190915-05ab-455b-99b2-76376d2a4adf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.320837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc8ffa-5f8e-4a8d-9e29-bc2aa044e6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.321725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc8ffa-5f8e-4a8d-9e29-bc2aa044e6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.322086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc8ffa-5f8e-4a8d-9e29-bc2aa044e6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.322403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc8ffa-5f8e-4a8d-9e29-bc2aa044e6b8 admin admin] PATH_INFO: `/v3/projects/19d61bb609b245a8865d424b6d01c49a/users/e27424c20ded46eba0b68b01889d86a7/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.341645 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc8ffa-5f8e-4a8d-9e29-bc2aa044e6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d61bb609b245a8865d424b6d01c49a, user_id=e27424c20ded46eba0b68b01889d86a7, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.345506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc8ffa-5f8e-4a8d-9e29-bc2aa044e6b8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.360794 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4164/8399] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:11 2022] PUT /identity/v3/projects/19d61bb609b245a8865d424b6d01c49a/users/e27424c20ded46eba0b68b01889d86a7/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:11.364561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56065ff7-16af-4742-9949-bfb8f3415a30 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.375233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56065ff7-16af-4742-9949-bfb8f3415a30 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.441026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af383aa4-19c3-4f3a-bfd6-8fc0e19c2cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.441583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af383aa4-19c3-4f3a-bfd6-8fc0e19c2cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.441980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af383aa4-19c3-4f3a-bfd6-8fc0e19c2cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.442337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af383aa4-19c3-4f3a-bfd6-8fc0e19c2cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.443008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af383aa4-19c3-4f3a-bfd6-8fc0e19c2cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.444647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af383aa4-19c3-4f3a-bfd6-8fc0e19c2cc8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.459983 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4236/8400] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:11.461548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc8ffa-5f8e-4a8d-9e29-bc2aa044e6b8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.472715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc8ffa-5f8e-4a8d-9e29-bc2aa044e6b8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.479598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316a511-98c4-47aa-949d-14a0dcc91f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.480339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316a511-98c4-47aa-949d-14a0dcc91f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.481069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316a511-98c4-47aa-949d-14a0dcc91f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.481439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316a511-98c4-47aa-949d-14a0dcc91f06 admin admin] PATH_INFO: `/v3/projects/19d61bb609b245a8865d424b6d01c49a/users/e27424c20ded46eba0b68b01889d86a7/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.483740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316a511-98c4-47aa-949d-14a0dcc91f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d61bb609b245a8865d424b6d01c49a, user_id=e27424c20ded46eba0b68b01889d86a7, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.486490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316a511-98c4-47aa-949d-14a0dcc91f06 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.513181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c809d-b91d-48ec-8890-4928f4d80ad8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.513717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c809d-b91d-48ec-8890-4928f4d80ad8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.514197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c809d-b91d-48ec-8890-4928f4d80ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.515974 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4165/8401] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:11 2022] PUT /identity/v3/projects/19d61bb609b245a8865d424b6d01c49a/users/e27424c20ded46eba0b68b01889d86a7/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:11.546399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-218c809d-b91d-48ec-8890-4928f4d80ad8 None None] MFA Rules not processed for user `e27424c20ded46eba0b68b01889d86a7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:11.548415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-218c809d-b91d-48ec-8890-4928f4d80ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:11.634503 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4237/8402] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:11.664109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316a511-98c4-47aa-949d-14a0dcc91f06 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:11.666115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9316a511-98c4-47aa-949d-14a0dcc91f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:11.743050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316a511-98c4-47aa-949d-14a0dcc91f06 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:11.747656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd739-4337-44fd-98e9-d5b284b85221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:11.748273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd739-4337-44fd-98e9-d5b284b85221 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.750215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd739-4337-44fd-98e9-d5b284b85221 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.750490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd739-4337-44fd-98e9-d5b284b85221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.761833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cd739-4337-44fd-98e9-d5b284b85221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:11.763388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cd739-4337-44fd-98e9-d5b284b85221 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:11.774534 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4166/8403] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:11.875053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd36220-9859-4eae-a8f6-2346c01aa99c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:11.875336 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd36220-9859-4eae-a8f6-2346c01aa99c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:11.875855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd36220-9859-4eae-a8f6-2346c01aa99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:11.903543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-edd36220-9859-4eae-a8f6-2346c01aa99c None None] MFA Rules not processed for user `f3e97edd3e10433ca84d2a6206c1c521`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:11.905117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-edd36220-9859-4eae-a8f6-2346c01aa99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:11.933713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:11.999218 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4238/8404] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:12.385583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd739-4337-44fd-98e9-d5b284b85221 service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:12.478289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd739-4337-44fd-98e9-d5b284b85221 service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:12.484017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:12.485218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:12.485534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:12.485814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] PATH_INFO: `/v3/users/d7f32294c7634f09834a4905b58da348` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:12.487290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f32294c7634f09834a4905b58da348)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:12.489348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:12.539028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:12.567316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f32294c7634f09834a4905b58da348'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.568328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f32294c7634f09834a4905b58da348'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.586691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f32294c7634f09834a4905b58da348'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.603813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f32294c7634f09834a4905b58da348'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.616380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f32294c7634f09834a4905b58da348'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:12.635146 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4167/8405] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:12 2022] DELETE /identity/v3/users/d7f32294c7634f09834a4905b58da348 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:12.638219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3722-93eb-402f-9452-5feec07d6a31 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:12.638750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3722-93eb-402f-9452-5feec07d6a31 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:12.638861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b3722-93eb-402f-9452-5feec07d6a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:12.673590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-622b3722-93eb-402f-9452-5feec07d6a31 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:12.675381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-622b3722-93eb-402f-9452-5feec07d6a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:12.765632 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4239/8406] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:12.781072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:12.782863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:12.924146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf598f-5b04-4e99-a605-da09999acd71 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:12.927916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74604a74-e5cd-401d-987e-231d24538e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:12.928538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604a74-e5cd-401d-987e-231d24538e18 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:12.928814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604a74-e5cd-401d-987e-231d24538e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:12.929342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604a74-e5cd-401d-987e-231d24538e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:12.941455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74604a74-e5cd-401d-987e-231d24538e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:12.943215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74604a74-e5cd-401d-987e-231d24538e18 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:12.955533 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4168/8407] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:13.305075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b3722-93eb-402f-9452-5feec07d6a31 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:13.306792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-622b3722-93eb-402f-9452-5feec07d6a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:13.327066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b3722-93eb-402f-9452-5feec07d6a31 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:13.339641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:13.340300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:13.340583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:13.340844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] PATH_INFO: `/v3/projects/970a9eaf4bb4462da8489418614fec7f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:13.343583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] RBAC: Authorizing `identity:delete_project(project_id=970a9eaf4bb4462da8489418614fec7f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:13.346629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:13.410577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970a9eaf4bb4462da8489418614fec7f', 'request_id': 'req-f888e009-5205-4565-a04b-474a3521436a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.419098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970a9eaf4bb4462da8489418614fec7f', 'request_id': 'req-f888e009-5205-4565-a04b-474a3521436a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.443094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970a9eaf4bb4462da8489418614fec7f', 'request_id': 'req-f888e009-5205-4565-a04b-474a3521436a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.446666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] The token cache is being invalidate because project 970a9eaf4bb4462da8489418614fec7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:13.446961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.448006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.449581 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4240/8408] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:13 2022] DELETE /identity/v3/projects/970a9eaf4bb4462da8489418614fec7f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:13.453777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74604a74-e5cd-401d-987e-231d24538e18 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:13.466281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74604a74-e5cd-401d-987e-231d24538e18 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:13.545025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98f4e6-b39a-4037-8214-7aca22554b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:13.545938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f4e6-b39a-4037-8214-7aca22554b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:13.547017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f4e6-b39a-4037-8214-7aca22554b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:13.547471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f4e6-b39a-4037-8214-7aca22554b5a admin admin] PATH_INFO: `/v3/users/e27424c20ded46eba0b68b01889d86a7` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:13.549213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98f4e6-b39a-4037-8214-7aca22554b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27424c20ded46eba0b68b01889d86a7)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:13.551943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98f4e6-b39a-4037-8214-7aca22554b5a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:13.612927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:13.621084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bb98f4e6-b39a-4037-8214-7aca22554b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27424c20ded46eba0b68b01889d86a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.622033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bb98f4e6-b39a-4037-8214-7aca22554b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27424c20ded46eba0b68b01889d86a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.641925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bb98f4e6-b39a-4037-8214-7aca22554b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27424c20ded46eba0b68b01889d86a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.651900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bb98f4e6-b39a-4037-8214-7aca22554b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27424c20ded46eba0b68b01889d86a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.661021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-bb98f4e6-b39a-4037-8214-7aca22554b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27424c20ded46eba0b68b01889d86a7'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:13.670039 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4169/8409] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:13 2022] DELETE /identity/v3/users/e27424c20ded46eba0b68b01889d86a7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:14.034517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:14.042102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:14.071468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e009-5205-4565-a04b-474a3521436a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:14.138502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:14.156599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:14.157831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.158298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.158724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] PATH_INFO: `/v3/projects/19d61bb609b245a8865d424b6d01c49a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.160200 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d61bb609b245a8865d424b6d01c49a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:14.163155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:14.222960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d61bb609b245a8865d424b6d01c49a', 'request_id': 'req-6c33984f-7e3e-4553-9cc5-467fa417ac7a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.230193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d61bb609b245a8865d424b6d01c49a', 'request_id': 'req-6c33984f-7e3e-4553-9cc5-467fa417ac7a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.239808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d61bb609b245a8865d424b6d01c49a', 'request_id': 'req-6c33984f-7e3e-4553-9cc5-467fa417ac7a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.255397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] The token cache is being invalidate because project 19d61bb609b245a8865d424b6d01c49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:14.255936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.256722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6c33984f-7e3e-4553-9cc5-467fa417ac7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:14.258877 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4241/8410] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:14 2022] DELETE /identity/v3/projects/19d61bb609b245a8865d424b6d01c49a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:14.263844 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbee05-2374-4b87-b466-4657c80d0981 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.264406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbee05-2374-4b87-b466-4657c80d0981 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.264954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbee05-2374-4b87-b466-4657c80d0981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.288842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-34dbee05-2374-4b87-b466-4657c80d0981 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:14.290427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-34dbee05-2374-4b87-b466-4657c80d0981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:14.370266 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4170/8411] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:14.378537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f849f-72a9-41a1-9bee-da22917be2f3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.378821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f849f-72a9-41a1-9bee-da22917be2f3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.379099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f849f-72a9-41a1-9bee-da22917be2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.402585 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ec7f849f-72a9-41a1-9bee-da22917be2f3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:14.403788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ec7f849f-72a9-41a1-9bee-da22917be2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:14.417956 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4242/8412] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:14.419283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbee05-2374-4b87-b466-4657c80d0981 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:14.429910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbee05-2374-4b87-b466-4657c80d0981 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:14.435841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746236d-ce5e-4cc8-818d-35a51bcf32be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:14.436521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746236d-ce5e-4cc8-818d-35a51bcf32be admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.437330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746236d-ce5e-4cc8-818d-35a51bcf32be admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.437649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746236d-ce5e-4cc8-818d-35a51bcf32be admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.438305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746236d-ce5e-4cc8-818d-35a51bcf32be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:14.439420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746236d-ce5e-4cc8-818d-35a51bcf32be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:14.440413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746236d-ce5e-4cc8-818d-35a51bcf32be admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:14.461918 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4171/8413] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:14.462895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f849f-72a9-41a1-9bee-da22917be2f3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:14.480040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f849f-72a9-41a1-9bee-da22917be2f3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:14.486600 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eb4c2-dcc6-43cd-8dab-481728e7a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:14.487224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb4c2-dcc6-43cd-8dab-481728e7a852 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.487503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb4c2-dcc6-43cd-8dab-481728e7a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.487775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb4c2-dcc6-43cd-8dab-481728e7a852 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.488424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eb4c2-dcc6-43cd-8dab-481728e7a852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:14.493045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eb4c2-dcc6-43cd-8dab-481728e7a852 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:14.556928 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4243/8414] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:14 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:14.561314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746236d-ce5e-4cc8-818d-35a51bcf32be admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:14.575113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746236d-ce5e-4cc8-818d-35a51bcf32be admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:14.649782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468675cf-ae5b-479e-8fe8-844265ee86d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:14.650328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468675cf-ae5b-479e-8fe8-844265ee86d3 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.650613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468675cf-ae5b-479e-8fe8-844265ee86d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.650890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468675cf-ae5b-479e-8fe8-844265ee86d3 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.651531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468675cf-ae5b-479e-8fe8-844265ee86d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:14.653491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468675cf-ae5b-479e-8fe8-844265ee86d3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:14.677256 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4172/8415] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:14 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:14.682053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eb4c2-dcc6-43cd-8dab-481728e7a852 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:14.695787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eb4c2-dcc6-43cd-8dab-481728e7a852 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:14.703269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3645c2-629b-4771-92dc-4836d3618df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:14.703948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3645c2-629b-4771-92dc-4836d3618df1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.704254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3645c2-629b-4771-92dc-4836d3618df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.704531 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3645c2-629b-4771-92dc-4836d3618df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.705868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3645c2-629b-4771-92dc-4836d3618df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:14.707486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3645c2-629b-4771-92dc-4836d3618df1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:14.727071 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4244/8416] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:14.730649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468675cf-ae5b-479e-8fe8-844265ee86d3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:14.741944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468675cf-ae5b-479e-8fe8-844265ee86d3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:14.747898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827178f-ea31-4efd-af17-b9a74bfd4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:14.748656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827178f-ea31-4efd-af17-b9a74bfd4770 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.748945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827178f-ea31-4efd-af17-b9a74bfd4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.749887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827178f-ea31-4efd-af17-b9a74bfd4770 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.750547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827178f-ea31-4efd-af17-b9a74bfd4770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:14.752151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827178f-ea31-4efd-af17-b9a74bfd4770 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:14.765096 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4173/8417] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:14.769114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3645c2-629b-4771-92dc-4836d3618df1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:14.780243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3645c2-629b-4771-92dc-4836d3618df1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:14.786497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ecef3-29a2-40d2-963f-eb7f843a4a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:14.787164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ecef3-29a2-40d2-963f-eb7f843a4a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.787602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ecef3-29a2-40d2-963f-eb7f843a4a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.787882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ecef3-29a2-40d2-963f-eb7f843a4a2d admin admin] PATH_INFO: `/v3/projects/312dc1e4b0a949e3847b272fa145e384/users/bd8c78c64d5d4d0fabdae5e78cbf46f9/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.811503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ecef3-29a2-40d2-963f-eb7f843a4a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=312dc1e4b0a949e3847b272fa145e384, user_id=bd8c78c64d5d4d0fabdae5e78cbf46f9, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:14.815101 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ecef3-29a2-40d2-963f-eb7f843a4a2d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:14.838162 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4245/8418] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:14 2022] PUT /identity/v3/projects/312dc1e4b0a949e3847b272fa145e384/users/bd8c78c64d5d4d0fabdae5e78cbf46f9/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:14.841960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c3d4b-931b-48a5-9bd8-5fca92501728 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:14.842251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c3d4b-931b-48a5-9bd8-5fca92501728 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:14.842742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c3d4b-931b-48a5-9bd8-5fca92501728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:14.873708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3b7c3d4b-931b-48a5-9bd8-5fca92501728 None None] MFA Rules not processed for user `bd8c78c64d5d4d0fabdae5e78cbf46f9`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:14.875709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3b7c3d4b-931b-48a5-9bd8-5fca92501728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:14.887284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:14.974394 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4174/8419] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:14.979190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ecef3-29a2-40d2-963f-eb7f843a4a2d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:15.061823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ecef3-29a2-40d2-963f-eb7f843a4a2d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:15.068036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c5e8a-bc46-4702-abf7-7273aab7d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:15.074653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c5e8a-bc46-4702-abf7-7273aab7d598 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:15.075514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c5e8a-bc46-4702-abf7-7273aab7d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:15.075806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c5e8a-bc46-4702-abf7-7273aab7d598 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:15.076499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c5e8a-bc46-4702-abf7-7273aab7d598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:15.079582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c5e8a-bc46-4702-abf7-7273aab7d598 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:15.103157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:15.117536 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4246/8420] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:14 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:05:15.121626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c3d4b-931b-48a5-9bd8-5fca92501728 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:15.133329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c3d4b-931b-48a5-9bd8-5fca92501728 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:15.215763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e089d-df6e-4312-b29e-84988a83bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:15.216529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e089d-df6e-4312-b29e-84988a83bbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:15.216885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e089d-df6e-4312-b29e-84988a83bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:15.217288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e089d-df6e-4312-b29e-84988a83bbe2 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:15.218762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e089d-df6e-4312-b29e-84988a83bbe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:15.224079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e089d-df6e-4312-b29e-84988a83bbe2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:15.274543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c5e8a-bc46-4702-abf7-7273aab7d598 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:15.275201 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4175/8421] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:15 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:15.285960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c5e8a-bc46-4702-abf7-7273aab7d598 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:15.290865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4059d-3b5d-477f-bd4b-18ba7aab2eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:15.291626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4059d-3b5d-477f-bd4b-18ba7aab2eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:15.291918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4059d-3b5d-477f-bd4b-18ba7aab2eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:15.292187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4059d-3b5d-477f-bd4b-18ba7aab2eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:15.293260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4059d-3b5d-477f-bd4b-18ba7aab2eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:15.294538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4059d-3b5d-477f-bd4b-18ba7aab2eb3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:15.309962 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4247/8422] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:15.311715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e089d-df6e-4312-b29e-84988a83bbe2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:15.328882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e089d-df6e-4312-b29e-84988a83bbe2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:15.335009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd10da-e300-4693-8f1f-6e458cd792c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:15.336618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd10da-e300-4693-8f1f-6e458cd792c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:15.337312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd10da-e300-4693-8f1f-6e458cd792c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:15.337891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd10da-e300-4693-8f1f-6e458cd792c4 admin admin] PATH_INFO: `/v3/projects/057c7ded3a694a2a97f3641c5249226f/users/0dc8b0ec74ae45d08a800e07cb548da9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:15.359992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd10da-e300-4693-8f1f-6e458cd792c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=057c7ded3a694a2a97f3641c5249226f, user_id=0dc8b0ec74ae45d08a800e07cb548da9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:15.363511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd10da-e300-4693-8f1f-6e458cd792c4 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:15.385961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4059d-3b5d-477f-bd4b-18ba7aab2eb3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:15.387132 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4176/8423] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:15 2022] PUT /identity/v3/projects/057c7ded3a694a2a97f3641c5249226f/users/0dc8b0ec74ae45d08a800e07cb548da9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:15.407375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4059d-3b5d-477f-bd4b-18ba7aab2eb3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:15.520381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f576ae0-a33b-47b6-9649-6810f47cf56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:15.521987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f576ae0-a33b-47b6-9649-6810f47cf56c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:15.522954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f576ae0-a33b-47b6-9649-6810f47cf56c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:15.523269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f576ae0-a33b-47b6-9649-6810f47cf56c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:15.524568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f576ae0-a33b-47b6-9649-6810f47cf56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:15.527278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f576ae0-a33b-47b6-9649-6810f47cf56c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:15.543731 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4248/8424] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:15.546197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd10da-e300-4693-8f1f-6e458cd792c4 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:15.564386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd10da-e300-4693-8f1f-6e458cd792c4 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:15.570012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d795-2dc0-4b4e-a853-2c7448a6d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:15.570689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d795-2dc0-4b4e-a853-2c7448a6d70b admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:15.571099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d795-2dc0-4b4e-a853-2c7448a6d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:15.571386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d795-2dc0-4b4e-a853-2c7448a6d70b admin admin] PATH_INFO: `/v3/projects/057c7ded3a694a2a97f3641c5249226f/users/0dc8b0ec74ae45d08a800e07cb548da9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:15.573534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423d795-2dc0-4b4e-a853-2c7448a6d70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=057c7ded3a694a2a97f3641c5249226f, user_id=0dc8b0ec74ae45d08a800e07cb548da9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:15.576372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423d795-2dc0-4b4e-a853-2c7448a6d70b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:15.595868 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4177/8425] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:15 2022] PUT /identity/v3/projects/057c7ded3a694a2a97f3641c5249226f/users/0dc8b0ec74ae45d08a800e07cb548da9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:15.607928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d39d8f-2eef-482e-8e8f-c2c2731dfcff None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:15.609672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d39d8f-2eef-482e-8e8f-c2c2731dfcff None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:15.610075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d39d8f-2eef-482e-8e8f-c2c2731dfcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:15.647065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-32d39d8f-2eef-482e-8e8f-c2c2731dfcff None None] MFA Rules not processed for user `0dc8b0ec74ae45d08a800e07cb548da9`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:15.648339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-32d39d8f-2eef-482e-8e8f-c2c2731dfcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:15.753795 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4249/8426] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:15.767722 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d795-2dc0-4b4e-a853-2c7448a6d70b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:15.770163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e423d795-2dc0-4b4e-a853-2c7448a6d70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:15.940378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d795-2dc0-4b4e-a853-2c7448a6d70b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:15.946347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c13062-8369-43b1-a0ba-544257444db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:15.947382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13062-8369-43b1-a0ba-544257444db0 service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:15.947909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13062-8369-43b1-a0ba-544257444db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:15.949231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c13062-8369-43b1-a0ba-544257444db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:15.963880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c13062-8369-43b1-a0ba-544257444db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:15.965977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c13062-8369-43b1-a0ba-544257444db0 service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:15.980393 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4178/8427] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:17.522278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d39d8f-2eef-482e-8e8f-c2c2731dfcff None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:17.608425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d39d8f-2eef-482e-8e8f-c2c2731dfcff None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:17.614003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:17.614657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:17.614947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:17.615214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] PATH_INFO: `/v3/users/bd8c78c64d5d4d0fabdae5e78cbf46f9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:17.616391 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8c78c64d5d4d0fabdae5e78cbf46f9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:17.626662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:17.639467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:17.683403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8c78c64d5d4d0fabdae5e78cbf46f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.684766 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8c78c64d5d4d0fabdae5e78cbf46f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.700968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8c78c64d5d4d0fabdae5e78cbf46f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.701757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8c78c64d5d4d0fabdae5e78cbf46f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.714684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8c78c64d5d4d0fabdae5e78cbf46f9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:17.736966 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4250/8428] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:17 2022] DELETE /identity/v3/users/bd8c78c64d5d4d0fabdae5e78cbf46f9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:17.741806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6525-9b4a-4cbf-8360-ef21d37158b2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:17.742663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6525-9b4a-4cbf-8360-ef21d37158b2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:17.742946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6525-9b4a-4cbf-8360-ef21d37158b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:17.759753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:17.767255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2cec6525-9b4a-4cbf-8360-ef21d37158b2 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:17.769094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2cec6525-9b4a-4cbf-8360-ef21d37158b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:17.844544 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4179/8429] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:17.855291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:17.857024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:17.964417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a15d-3c96-486a-81d2-7eb9f2fc1a34 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:17.968854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628cb31-d010-42f4-83f6-5c4d7b3a68ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:17.969446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628cb31-d010-42f4-83f6-5c4d7b3a68ae service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:17.969710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628cb31-d010-42f4-83f6-5c4d7b3a68ae service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:17.969989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628cb31-d010-42f4-83f6-5c4d7b3a68ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:17.979891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628cb31-d010-42f4-83f6-5c4d7b3a68ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:17.981328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628cb31-d010-42f4-83f6-5c4d7b3a68ae service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:17.991294 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4251/8430] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:18.302787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec6525-9b4a-4cbf-8360-ef21d37158b2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:18.305966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2cec6525-9b4a-4cbf-8360-ef21d37158b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:18.328417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec6525-9b4a-4cbf-8360-ef21d37158b2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:18.338979 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:18.339635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:18.339914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:18.340186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] PATH_INFO: `/v3/projects/312dc1e4b0a949e3847b272fa145e384` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:18.341854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=312dc1e4b0a949e3847b272fa145e384)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:18.343995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:18.401953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312dc1e4b0a949e3847b272fa145e384', 'request_id': 'req-8f84d4b8-de84-4d33-8eab-a8439240b1bf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.409074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312dc1e4b0a949e3847b272fa145e384', 'request_id': 'req-8f84d4b8-de84-4d33-8eab-a8439240b1bf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.420848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312dc1e4b0a949e3847b272fa145e384', 'request_id': 'req-8f84d4b8-de84-4d33-8eab-a8439240b1bf'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.435628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] The token cache is being invalidate because project 312dc1e4b0a949e3847b272fa145e384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:18.435936 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.436691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.441635 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4180/8431] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:18 2022] DELETE /identity/v3/projects/312dc1e4b0a949e3847b272fa145e384 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:18.443056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628cb31-d010-42f4-83f6-5c4d7b3a68ae service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:18.453769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628cb31-d010-42f4-83f6-5c4d7b3a68ae service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:18.522671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175da9da-dd9a-4de5-a3cd-b4ce03c02484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:18.523332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175da9da-dd9a-4de5-a3cd-b4ce03c02484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:18.523578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175da9da-dd9a-4de5-a3cd-b4ce03c02484 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:18.523849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175da9da-dd9a-4de5-a3cd-b4ce03c02484 admin admin] PATH_INFO: `/v3/users/0dc8b0ec74ae45d08a800e07cb548da9` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:18.525012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175da9da-dd9a-4de5-a3cd-b4ce03c02484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc8b0ec74ae45d08a800e07cb548da9)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:18.527052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175da9da-dd9a-4de5-a3cd-b4ce03c02484 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:18.571498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:18.587853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-175da9da-dd9a-4de5-a3cd-b4ce03c02484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc8b0ec74ae45d08a800e07cb548da9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.588671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-175da9da-dd9a-4de5-a3cd-b4ce03c02484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc8b0ec74ae45d08a800e07cb548da9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.601983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-175da9da-dd9a-4de5-a3cd-b4ce03c02484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc8b0ec74ae45d08a800e07cb548da9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.602781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-175da9da-dd9a-4de5-a3cd-b4ce03c02484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc8b0ec74ae45d08a800e07cb548da9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.611182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-175da9da-dd9a-4de5-a3cd-b4ce03c02484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc8b0ec74ae45d08a800e07cb548da9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:18.632365 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4252/8432] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:18 2022] DELETE /identity/v3/users/0dc8b0ec74ae45d08a800e07cb548da9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:18.928635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:18.930394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:18.960036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84d4b8-de84-4d33-8eab-a8439240b1bf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.066453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.067610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.067905 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.068189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] PATH_INFO: `/v3/projects/057c7ded3a694a2a97f3641c5249226f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.069463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=057c7ded3a694a2a97f3641c5249226f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.071429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.116912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:19.135069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057c7ded3a694a2a97f3641c5249226f', 'request_id': 'req-69e6167b-9bad-494c-a245-7e5990d53a5e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:19.145422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057c7ded3a694a2a97f3641c5249226f', 'request_id': 'req-69e6167b-9bad-494c-a245-7e5990d53a5e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:19.156619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057c7ded3a694a2a97f3641c5249226f', 'request_id': 'req-69e6167b-9bad-494c-a245-7e5990d53a5e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:19.173360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] The token cache is being invalidate because project 057c7ded3a694a2a97f3641c5249226f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:19.173711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:19.174397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-69e6167b-9bad-494c-a245-7e5990d53a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:19.176458 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4181/8433] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:18 2022] DELETE /identity/v3/projects/057c7ded3a694a2a97f3641c5249226f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:19.181470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c139d00-bc24-437a-a9a6-21b6c36a4b85 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.181756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c139d00-bc24-437a-a9a6-21b6c36a4b85 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.182030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c139d00-bc24-437a-a9a6-21b6c36a4b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.206831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1c139d00-bc24-437a-a9a6-21b6c36a4b85 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:19.208199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1c139d00-bc24-437a-a9a6-21b6c36a4b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:19.273249 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4253/8434] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:19.281511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4406e-32d4-4d95-a0a3-17452ca4cc22 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.281804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4406e-32d4-4d95-a0a3-17452ca4cc22 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.282304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4406e-32d4-4d95-a0a3-17452ca4cc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.303224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f1f4406e-32d4-4d95-a0a3-17452ca4cc22 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:19.304582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f1f4406e-32d4-4d95-a0a3-17452ca4cc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:19.312845 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4182/8435] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:19.317153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c139d00-bc24-437a-a9a6-21b6c36a4b85 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.327136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c139d00-bc24-437a-a9a6-21b6c36a4b85 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.332285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a5e2-64af-446b-820a-a6881dd2b039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.332884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a5e2-64af-446b-820a-a6881dd2b039 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.333164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a5e2-64af-446b-820a-a6881dd2b039 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.333477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a5e2-64af-446b-820a-a6881dd2b039 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.334112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a5e2-64af-446b-820a-a6881dd2b039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:19.334413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a5e2-64af-446b-820a-a6881dd2b039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.336012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a5e2-64af-446b-820a-a6881dd2b039 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.350123 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4254/8436] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:19.354415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4406e-32d4-4d95-a0a3-17452ca4cc22 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.377299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4406e-32d4-4d95-a0a3-17452ca4cc22 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.382872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b97243-74a9-47ed-b1fa-180cb557b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.383504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b97243-74a9-47ed-b1fa-180cb557b1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.383782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b97243-74a9-47ed-b1fa-180cb557b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.384058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b97243-74a9-47ed-b1fa-180cb557b1c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.384902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b97243-74a9-47ed-b1fa-180cb557b1c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.386957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b97243-74a9-47ed-b1fa-180cb557b1c9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.420820 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4183/8437] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:19.425481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a5e2-64af-446b-820a-a6881dd2b039 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.437548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a5e2-64af-446b-820a-a6881dd2b039 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.503643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd590d-b6c0-4194-9d27-2522b2b2b300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.504289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd590d-b6c0-4194-9d27-2522b2b2b300 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.504572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd590d-b6c0-4194-9d27-2522b2b2b300 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.504846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd590d-b6c0-4194-9d27-2522b2b2b300 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.505576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd590d-b6c0-4194-9d27-2522b2b2b300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.507985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd590d-b6c0-4194-9d27-2522b2b2b300 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.533348 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4255/8438] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:19.537498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b97243-74a9-47ed-b1fa-180cb557b1c9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.549287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b97243-74a9-47ed-b1fa-180cb557b1c9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.554815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdaa7d-c3ae-43aa-b996-a59b9f919552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.555443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdaa7d-c3ae-43aa-b996-a59b9f919552 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.555913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdaa7d-c3ae-43aa-b996-a59b9f919552 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.556260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdaa7d-c3ae-43aa-b996-a59b9f919552 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.556968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdaa7d-c3ae-43aa-b996-a59b9f919552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.558811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdaa7d-c3ae-43aa-b996-a59b9f919552 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.570704 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4184/8439] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:19.574695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd590d-b6c0-4194-9d27-2522b2b2b300 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.586181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd590d-b6c0-4194-9d27-2522b2b2b300 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.591204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51673228-ace8-48f1-8df8-9de03efbbfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.591880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51673228-ace8-48f1-8df8-9de03efbbfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.592245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51673228-ace8-48f1-8df8-9de03efbbfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.592576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51673228-ace8-48f1-8df8-9de03efbbfd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.593479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51673228-ace8-48f1-8df8-9de03efbbfd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.595151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51673228-ace8-48f1-8df8-9de03efbbfd1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.609561 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4256/8440] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:19.611018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdaa7d-c3ae-43aa-b996-a59b9f919552 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.622044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdaa7d-c3ae-43aa-b996-a59b9f919552 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.628204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00df62-4cb4-4d83-89d6-4c78b98f6d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.629374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00df62-4cb4-4d83-89d6-4c78b98f6d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.629812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00df62-4cb4-4d83-89d6-4c78b98f6d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.630219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00df62-4cb4-4d83-89d6-4c78b98f6d9a admin admin] PATH_INFO: `/v3/projects/924003e868ba48b9bbf2b27ad52670b3/users/283eb8eeb188410ab3a3b8727c7b56d6/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.651449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00df62-4cb4-4d83-89d6-4c78b98f6d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=924003e868ba48b9bbf2b27ad52670b3, user_id=283eb8eeb188410ab3a3b8727c7b56d6, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.654310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00df62-4cb4-4d83-89d6-4c78b98f6d9a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.670618 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4185/8441] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:19 2022] PUT /identity/v3/projects/924003e868ba48b9bbf2b27ad52670b3/users/283eb8eeb188410ab3a3b8727c7b56d6/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:19.680490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a141c4f-5f17-4d18-9a32-52d59dbecf11 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.680767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a141c4f-5f17-4d18-9a32-52d59dbecf11 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.681088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a141c4f-5f17-4d18-9a32-52d59dbecf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.710971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6a141c4f-5f17-4d18-9a32-52d59dbecf11 None None] MFA Rules not processed for user `283eb8eeb188410ab3a3b8727c7b56d6`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:19.712267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6a141c4f-5f17-4d18-9a32-52d59dbecf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:19.724090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:19.795144 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4257/8442] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:19.800626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00df62-4cb4-4d83-89d6-4c78b98f6d9a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.879429 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00df62-4cb4-4d83-89d6-4c78b98f6d9a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:19.886529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bad2e-9fd6-44d7-b8b4-ce9fb882692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:19.887385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bad2e-9fd6-44d7-b8b4-ce9fb882692d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:19.887961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bad2e-9fd6-44d7-b8b4-ce9fb882692d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:19.888605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bad2e-9fd6-44d7-b8b4-ce9fb882692d admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:19.889767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bad2e-9fd6-44d7-b8b4-ce9fb882692d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:19.892294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bad2e-9fd6-44d7-b8b4-ce9fb882692d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:19.928913 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4186/8443] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:19.930382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a141c4f-5f17-4d18-9a32-52d59dbecf11 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:19.943697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a141c4f-5f17-4d18-9a32-52d59dbecf11 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.027464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5e226-cf57-4cc1-b604-f4e81cae73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.028132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5e226-cf57-4cc1-b604-f4e81cae73e7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.028421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5e226-cf57-4cc1-b604-f4e81cae73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.028699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5e226-cf57-4cc1-b604-f4e81cae73e7 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.029555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5e226-cf57-4cc1-b604-f4e81cae73e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.031762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5e226-cf57-4cc1-b604-f4e81cae73e7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.065126 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4258/8444] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:19 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:05:20.068173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bad2e-9fd6-44d7-b8b4-ce9fb882692d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.083920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bad2e-9fd6-44d7-b8b4-ce9fb882692d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.090384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a6329-919d-46ac-9d1d-38b74c78a11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.093728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a6329-919d-46ac-9d1d-38b74c78a11b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.094027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a6329-919d-46ac-9d1d-38b74c78a11b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.095727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a6329-919d-46ac-9d1d-38b74c78a11b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.096412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a6329-919d-46ac-9d1d-38b74c78a11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.102375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a6329-919d-46ac-9d1d-38b74c78a11b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.155089 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4187/8445] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:20.161496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5e226-cf57-4cc1-b604-f4e81cae73e7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.177748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5e226-cf57-4cc1-b604-f4e81cae73e7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.185114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58124b-b5db-4599-8c5f-7c371f3eb3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.186052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58124b-b5db-4599-8c5f-7c371f3eb3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.187779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58124b-b5db-4599-8c5f-7c371f3eb3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.189093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58124b-b5db-4599-8c5f-7c371f3eb3a3 admin admin] PATH_INFO: `/v3/projects/142e8fb7d4164df4bdef60877973eb45/users/deeb865c41144d3f804ac5f8cbf567c7/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.237543 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58124b-b5db-4599-8c5f-7c371f3eb3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142e8fb7d4164df4bdef60877973eb45, user_id=deeb865c41144d3f804ac5f8cbf567c7, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.242421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58124b-b5db-4599-8c5f-7c371f3eb3a3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.267135 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4259/8446] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:20 2022] PUT /identity/v3/projects/142e8fb7d4164df4bdef60877973eb45/users/deeb865c41144d3f804ac5f8cbf567c7/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:20.271192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a6329-919d-46ac-9d1d-38b74c78a11b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.284273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a6329-919d-46ac-9d1d-38b74c78a11b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.324369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:20.371634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62843307-7f50-474b-9544-dfa6b544fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.371634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62843307-7f50-474b-9544-dfa6b544fbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.371634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62843307-7f50-474b-9544-dfa6b544fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.371634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62843307-7f50-474b-9544-dfa6b544fbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.372111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62843307-7f50-474b-9544-dfa6b544fbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.374627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62843307-7f50-474b-9544-dfa6b544fbc7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.393954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58124b-b5db-4599-8c5f-7c371f3eb3a3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.406289 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4188/8447] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:20.411921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58124b-b5db-4599-8c5f-7c371f3eb3a3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.418823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560b441-68be-4835-abc5-69f20636bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.419512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b441-68be-4835-abc5-69f20636bb17 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.419795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b441-68be-4835-abc5-69f20636bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.420069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b441-68be-4835-abc5-69f20636bb17 admin admin] PATH_INFO: `/v3/projects/142e8fb7d4164df4bdef60877973eb45/users/deeb865c41144d3f804ac5f8cbf567c7/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.422957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560b441-68be-4835-abc5-69f20636bb17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142e8fb7d4164df4bdef60877973eb45, user_id=deeb865c41144d3f804ac5f8cbf567c7, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.426060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560b441-68be-4835-abc5-69f20636bb17 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.455584 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4260/8448] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:20 2022] PUT /identity/v3/projects/142e8fb7d4164df4bdef60877973eb45/users/deeb865c41144d3f804ac5f8cbf567c7/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:20.467191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3f685-dbcb-4147-ba50-dd27eea55d38 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.467483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3f685-dbcb-4147-ba50-dd27eea55d38 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.467766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3f685-dbcb-4147-ba50-dd27eea55d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.507704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-53b3f685-dbcb-4147-ba50-dd27eea55d38 None None] MFA Rules not processed for user `deeb865c41144d3f804ac5f8cbf567c7`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:20.509000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-53b3f685-dbcb-4147-ba50-dd27eea55d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:20.616239 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4189/8449] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:20.629490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560b441-68be-4835-abc5-69f20636bb17 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:20.631868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d560b441-68be-4835-abc5-69f20636bb17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:20.718444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560b441-68be-4835-abc5-69f20636bb17 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:20.722501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309dd58-9914-4fc7-979c-dec7d63140e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:20.723273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309dd58-9914-4fc7-979c-dec7d63140e9 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:20.723603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309dd58-9914-4fc7-979c-dec7d63140e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:20.723929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309dd58-9914-4fc7-979c-dec7d63140e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:20.737436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309dd58-9914-4fc7-979c-dec7d63140e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:20.739238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309dd58-9914-4fc7-979c-dec7d63140e9 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:20.744992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:20.765713 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4261/8450] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:21.101444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3f685-dbcb-4147-ba50-dd27eea55d38 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.111346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3f685-dbcb-4147-ba50-dd27eea55d38 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.116026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e26fe4-bf68-4247-b8ee-7b4fb8f726e0 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deeb865c41144d3f804ac5f8cbf567c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '142e8fb7d4164df4bdef60877973eb45', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.116621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e26fe4-bf68-4247-b8ee-7b4fb8f726e0 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.117016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e26fe4-bf68-4247-b8ee-7b4fb8f726e0 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.117291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e26fe4-bf68-4247-b8ee-7b4fb8f726e0 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.117994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e26fe4-bf68-4247-b8ee-7b4fb8f726e0 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:21.118301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e26fe4-bf68-4247-b8ee-7b4fb8f726e0 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.119956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e26fe4-bf68-4247-b8ee-7b4fb8f726e0 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.132525 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4190/8451] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:21.136702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309dd58-9914-4fc7-979c-dec7d63140e9 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.146364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309dd58-9914-4fc7-979c-dec7d63140e9 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.151395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1280-437c-4435-97ad-34a1abf6e709 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deeb865c41144d3f804ac5f8cbf567c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '142e8fb7d4164df4bdef60877973eb45', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.151999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1280-437c-4435-97ad-34a1abf6e709 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.152286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1280-437c-4435-97ad-34a1abf6e709 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.152595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1280-437c-4435-97ad-34a1abf6e709 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.153225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e1280-437c-4435-97ad-34a1abf6e709 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.155154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e1280-437c-4435-97ad-34a1abf6e709 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.193563 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4262/8452] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:21 2022] POST /identity/v3/projects => generated 354 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:21.197519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e26fe4-bf68-4247-b8ee-7b4fb8f726e0 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.210906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e26fe4-bf68-4247-b8ee-7b4fb8f726e0 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.280966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a36eb6-8f1d-498b-8141-feb1c45d8742 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deeb865c41144d3f804ac5f8cbf567c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '142e8fb7d4164df4bdef60877973eb45', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.281714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a36eb6-8f1d-498b-8141-feb1c45d8742 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.283112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a36eb6-8f1d-498b-8141-feb1c45d8742 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.283483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a36eb6-8f1d-498b-8141-feb1c45d8742 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.284227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a36eb6-8f1d-498b-8141-feb1c45d8742 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:21.284624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a36eb6-8f1d-498b-8141-feb1c45d8742 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.286402 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a36eb6-8f1d-498b-8141-feb1c45d8742 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.301800 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4191/8453] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:21.352546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1280-437c-4435-97ad-34a1abf6e709 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.363973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1280-437c-4435-97ad-34a1abf6e709 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.369216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deeb865c41144d3f804ac5f8cbf567c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '142e8fb7d4164df4bdef60877973eb45', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.369960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.370368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.370649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] PATH_INFO: `/v3/projects/7ea0a5271eb54043a03cf6d22603682b` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.371994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ea0a5271eb54043a03cf6d22603682b)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.373998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:21.435047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea0a5271eb54043a03cf6d22603682b', 'request_id': 'req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:21.443789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea0a5271eb54043a03cf6d22603682b', 'request_id': 'req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:21.451965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea0a5271eb54043a03cf6d22603682b', 'request_id': 'req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:21.465415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] The token cache is being invalidate because project 7ea0a5271eb54043a03cf6d22603682b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:21.465842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:21.466697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6d4bf8a1-05ba-4ae7-ab97-91f85debd5e4 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:21.472706 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4263/8454] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:21 2022] DELETE /identity/v3/projects/7ea0a5271eb54043a03cf6d22603682b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:21.807462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a36eb6-8f1d-498b-8141-feb1c45d8742 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:21.809729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72a36eb6-8f1d-498b-8141-feb1c45d8742 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:21.851855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:21.892394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a36eb6-8f1d-498b-8141-feb1c45d8742 tempest-VolumeQuotaClassesTest-309476135 tempest-VolumeQuotaClassesTest-309476135-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:21.961101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:21.961777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:21.962065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:21.962348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] PATH_INFO: `/v3/users/283eb8eeb188410ab3a3b8727c7b56d6` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:21.963492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=283eb8eeb188410ab3a3b8727c7b56d6)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:21.965481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.018765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283eb8eeb188410ab3a3b8727c7b56d6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:22.019903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283eb8eeb188410ab3a3b8727c7b56d6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:22.038188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283eb8eeb188410ab3a3b8727c7b56d6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:22.049994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283eb8eeb188410ab3a3b8727c7b56d6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:22.061342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283eb8eeb188410ab3a3b8727c7b56d6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:22.073889 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4192/8455] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:21 2022] DELETE /identity/v3/users/283eb8eeb188410ab3a3b8727c7b56d6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:22.075498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebadcf-270d-4d0f-b90b-a14b11ae248c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.075946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebadcf-270d-4d0f-b90b-a14b11ae248c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.076360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebadcf-270d-4d0f-b90b-a14b11ae248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.101628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-acebadcf-270d-4d0f-b90b-a14b11ae248c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:22.102862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-acebadcf-270d-4d0f-b90b-a14b11ae248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:22.177196 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4264/8456] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:22.188286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.190003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:22.259766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309489-4713-437b-a951-5d9557b421bd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.263697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b3f58-5f41-48c5-8663-e16223691601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.264318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3f58-5f41-48c5-8663-e16223691601 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.264598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3f58-5f41-48c5-8663-e16223691601 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.264940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3f58-5f41-48c5-8663-e16223691601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.274995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b3f58-5f41-48c5-8663-e16223691601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.276495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b3f58-5f41-48c5-8663-e16223691601 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.287365 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4193/8457] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:22.335133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebadcf-270d-4d0f-b90b-a14b11ae248c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.336545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-acebadcf-270d-4d0f-b90b-a14b11ae248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:22.426323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:22.439589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebadcf-270d-4d0f-b90b-a14b11ae248c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.449116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f6d93-a12c-46f5-b55b-a1d5ad161d4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.450527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f6d93-a12c-46f5-b55b-a1d5ad161d4f service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.451357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f6d93-a12c-46f5-b55b-a1d5ad161d4f service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.451844 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f6d93-a12c-46f5-b55b-a1d5ad161d4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.455007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-103f6d93-a12c-46f5-b55b-a1d5ad161d4f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:22.553975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f6d93-a12c-46f5-b55b-a1d5ad161d4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.556094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f6d93-a12c-46f5-b55b-a1d5ad161d4f service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.565370 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4265/8458] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:05:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:22.641811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b3f58-5f41-48c5-8663-e16223691601 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.643555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-417b3f58-5f41-48c5-8663-e16223691601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:22.653183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:22.719431 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b3f58-5f41-48c5-8663-e16223691601 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.736372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.739249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.739602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.739954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] PATH_INFO: `/v3/projects/924003e868ba48b9bbf2b27ad52670b3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.741536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=924003e868ba48b9bbf2b27ad52670b3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.744079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:22.817860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924003e868ba48b9bbf2b27ad52670b3', 'request_id': 'req-f180a382-1999-4607-b613-ad4099ae97d6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:22.823646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924003e868ba48b9bbf2b27ad52670b3', 'request_id': 'req-f180a382-1999-4607-b613-ad4099ae97d6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:22.844134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924003e868ba48b9bbf2b27ad52670b3', 'request_id': 'req-f180a382-1999-4607-b613-ad4099ae97d6'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:22.859655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] The token cache is being invalidate because project 924003e868ba48b9bbf2b27ad52670b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:22.860024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:22.860625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:22.865475 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4194/8459] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:22 2022] DELETE /identity/v3/projects/924003e868ba48b9bbf2b27ad52670b3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:22.866640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f6d93-a12c-46f5-b55b-a1d5ad161d4f service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:22.879986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f6d93-a12c-46f5-b55b-a1d5ad161d4f service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:22.964778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aed75b-d01a-4a90-bfd4-233df613a2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:22.965611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aed75b-d01a-4a90-bfd4-233df613a2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:22.965899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aed75b-d01a-4a90-bfd4-233df613a2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:22.966172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aed75b-d01a-4a90-bfd4-233df613a2d8 admin admin] PATH_INFO: `/v3/users/deeb865c41144d3f804ac5f8cbf567c7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:22.967317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aed75b-d01a-4a90-bfd4-233df613a2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deeb865c41144d3f804ac5f8cbf567c7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:22.970002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aed75b-d01a-4a90-bfd4-233df613a2d8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.055891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1aed75b-d01a-4a90-bfd4-233df613a2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deeb865c41144d3f804ac5f8cbf567c7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:23.056726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1aed75b-d01a-4a90-bfd4-233df613a2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deeb865c41144d3f804ac5f8cbf567c7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:23.074479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1aed75b-d01a-4a90-bfd4-233df613a2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deeb865c41144d3f804ac5f8cbf567c7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:23.075308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1aed75b-d01a-4a90-bfd4-233df613a2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deeb865c41144d3f804ac5f8cbf567c7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:23.087648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e1aed75b-d01a-4a90-bfd4-233df613a2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deeb865c41144d3f804ac5f8cbf567c7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:23.105769 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4266/8460] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:22 2022] DELETE /identity/v3/users/deeb865c41144d3f804ac5f8cbf567c7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:23.557916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:23.560324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:23.589240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180a382-1999-4607-b613-ad4099ae97d6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:23.680725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:23.681689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.682128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.682560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] PATH_INFO: `/v3/projects/142e8fb7d4164df4bdef60877973eb45` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.684098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] RBAC: Authorizing `identity:delete_project(project_id=142e8fb7d4164df4bdef60877973eb45)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:23.687919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:23.775385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142e8fb7d4164df4bdef60877973eb45', 'request_id': 'req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:23.796680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142e8fb7d4164df4bdef60877973eb45', 'request_id': 'req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:23.804628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142e8fb7d4164df4bdef60877973eb45', 'request_id': 'req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:23.820835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] The token cache is being invalidate because project 142e8fb7d4164df4bdef60877973eb45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:23.821249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:23.821802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-46df0e25-a403-45b2-9a4c-2a5f98d1d97c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:23.823289 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4195/8461] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:23 2022] DELETE /identity/v3/projects/142e8fb7d4164df4bdef60877973eb45 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:23.829578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d3af-7124-47af-8e2d-3fd3c49fb44f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.829869 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d3af-7124-47af-8e2d-3fd3c49fb44f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.830203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d3af-7124-47af-8e2d-3fd3c49fb44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.866207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8de2d3af-7124-47af-8e2d-3fd3c49fb44f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:23.867443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8de2d3af-7124-47af-8e2d-3fd3c49fb44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:23.887041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:23.940371 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4267/8462] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:23.950237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ba44-539f-458c-bfb1-de0994202df9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:23.950524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ba44-539f-458c-bfb1-de0994202df9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:23.950803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ba44-539f-458c-bfb1-de0994202df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:23.975643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0969ba44-539f-458c-bfb1-de0994202df9 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:23.976813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0969ba44-539f-458c-bfb1-de0994202df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:23.989721 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4196/8463] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:23.994610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2d3af-7124-47af-8e2d-3fd3c49fb44f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.005077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2d3af-7124-47af-8e2d-3fd3c49fb44f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.012327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b069-2a46-4f99-a17a-883f5b96ced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.012953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b069-2a46-4f99-a17a-883f5b96ced2 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.013239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b069-2a46-4f99-a17a-883f5b96ced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.013556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b069-2a46-4f99-a17a-883f5b96ced2 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.014212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5b069-2a46-4f99-a17a-883f5b96ced2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:24.014523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5b069-2a46-4f99-a17a-883f5b96ced2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.016315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5b069-2a46-4f99-a17a-883f5b96ced2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.031405 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4268/8464] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:24.036715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969ba44-539f-458c-bfb1-de0994202df9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.051100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969ba44-539f-458c-bfb1-de0994202df9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.056806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce032fe-4d0b-4514-a706-c617a4441791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.057856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce032fe-4d0b-4514-a706-c617a4441791 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.058143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce032fe-4d0b-4514-a706-c617a4441791 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.058426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce032fe-4d0b-4514-a706-c617a4441791 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.059071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce032fe-4d0b-4514-a706-c617a4441791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.062057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce032fe-4d0b-4514-a706-c617a4441791 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.067393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:24.096276 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4197/8465] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:24 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:24.100551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b069-2a46-4f99-a17a-883f5b96ced2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.112674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b069-2a46-4f99-a17a-883f5b96ced2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.178081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75cab9-f45b-4c18-9995-93f95efc2476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.178699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75cab9-f45b-4c18-9995-93f95efc2476 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.178981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75cab9-f45b-4c18-9995-93f95efc2476 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.179545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75cab9-f45b-4c18-9995-93f95efc2476 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.180179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75cab9-f45b-4c18-9995-93f95efc2476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.183829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75cab9-f45b-4c18-9995-93f95efc2476 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.208965 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4269/8466] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:24 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:05:24.213011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce032fe-4d0b-4514-a706-c617a4441791 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.225216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce032fe-4d0b-4514-a706-c617a4441791 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.230379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eac23d-9553-4f97-9a9c-5da925ba8521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.230927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eac23d-9553-4f97-9a9c-5da925ba8521 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.231204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eac23d-9553-4f97-9a9c-5da925ba8521 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.231478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eac23d-9553-4f97-9a9c-5da925ba8521 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.232145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eac23d-9553-4f97-9a9c-5da925ba8521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.234355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eac23d-9553-4f97-9a9c-5da925ba8521 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.248890 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4198/8467] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:24.250428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75cab9-f45b-4c18-9995-93f95efc2476 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.266078 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75cab9-f45b-4c18-9995-93f95efc2476 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.274350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb4d70-a03e-4be5-9fab-b9b9007a0d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.274993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4d70-a03e-4be5-9fab-b9b9007a0d9f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.275278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4d70-a03e-4be5-9fab-b9b9007a0d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.275554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4d70-a03e-4be5-9fab-b9b9007a0d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.276412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb4d70-a03e-4be5-9fab-b9b9007a0d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.278233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb4d70-a03e-4be5-9fab-b9b9007a0d9f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.299664 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4270/8468] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:24.302643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eac23d-9553-4f97-9a9c-5da925ba8521 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.313324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eac23d-9553-4f97-9a9c-5da925ba8521 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.318085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d468f5-2874-4d34-9659-b85fa8fa3b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.318753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d468f5-2874-4d34-9659-b85fa8fa3b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.320218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d468f5-2874-4d34-9659-b85fa8fa3b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.320504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d468f5-2874-4d34-9659-b85fa8fa3b29 admin admin] PATH_INFO: `/v3/projects/a5f2446c3c7c42a1b97b03c36b5d5206/users/c246cb108d9d4512b94bf7386e2b20cf/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.344118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d468f5-2874-4d34-9659-b85fa8fa3b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f2446c3c7c42a1b97b03c36b5d5206, user_id=c246cb108d9d4512b94bf7386e2b20cf, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.350218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d468f5-2874-4d34-9659-b85fa8fa3b29 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.366684 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4199/8469] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:24 2022] PUT /identity/v3/projects/a5f2446c3c7c42a1b97b03c36b5d5206/users/c246cb108d9d4512b94bf7386e2b20cf/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:24.377086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eda77-fc44-458b-ad91-af6bc77df4a8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.377473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eda77-fc44-458b-ad91-af6bc77df4a8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.377819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eda77-fc44-458b-ad91-af6bc77df4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.415206 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-585eda77-fc44-458b-ad91-af6bc77df4a8 None None] MFA Rules not processed for user `c246cb108d9d4512b94bf7386e2b20cf`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:24.416631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-585eda77-fc44-458b-ad91-af6bc77df4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:24.500500 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4271/8470] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:24.501704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d468f5-2874-4d34-9659-b85fa8fa3b29 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.587706 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d468f5-2874-4d34-9659-b85fa8fa3b29 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.593647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ef291-1190-4ba1-95b7-11ba6b492d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.594271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ef291-1190-4ba1-95b7-11ba6b492d0f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.594599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ef291-1190-4ba1-95b7-11ba6b492d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.594885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ef291-1190-4ba1-95b7-11ba6b492d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.595516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ef291-1190-4ba1-95b7-11ba6b492d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.597461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ef291-1190-4ba1-95b7-11ba6b492d0f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.634854 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4200/8471] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:24 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:24.639017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585eda77-fc44-458b-ad91-af6bc77df4a8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.666593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585eda77-fc44-458b-ad91-af6bc77df4a8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.689853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:24.749561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad54f-0564-4a60-b497-2c997112af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.750254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad54f-0564-4a60-b497-2c997112af32 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.750538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad54f-0564-4a60-b497-2c997112af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.751099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad54f-0564-4a60-b497-2c997112af32 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.751742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ad54f-0564-4a60-b497-2c997112af32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.755408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ad54f-0564-4a60-b497-2c997112af32 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.788315 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4272/8472] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:24 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:24.792245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ef291-1190-4ba1-95b7-11ba6b492d0f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.805249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ef291-1190-4ba1-95b7-11ba6b492d0f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.811208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dba830-ab14-459a-bc19-a78b22825db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.812370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba830-ab14-459a-bc19-a78b22825db6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.812652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba830-ab14-459a-bc19-a78b22825db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.813052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba830-ab14-459a-bc19-a78b22825db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.813759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dba830-ab14-459a-bc19-a78b22825db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.815338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dba830-ab14-459a-bc19-a78b22825db6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.833824 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4201/8473] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:24.834708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad54f-0564-4a60-b497-2c997112af32 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.849831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad54f-0564-4a60-b497-2c997112af32 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.855787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e10ee-967e-4125-899b-cadbfa4345fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.856906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e10ee-967e-4125-899b-cadbfa4345fc admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.857537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e10ee-967e-4125-899b-cadbfa4345fc admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.857537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e10ee-967e-4125-899b-cadbfa4345fc admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.860917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e10ee-967e-4125-899b-cadbfa4345fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.866524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e10ee-967e-4125-899b-cadbfa4345fc admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.889459 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4273/8474] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:24.891308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dba830-ab14-459a-bc19-a78b22825db6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:24.907700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dba830-ab14-459a-bc19-a78b22825db6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:24.912894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40970a8a-7a56-4c4e-9ca9-430584aace4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:24.913625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40970a8a-7a56-4c4e-9ca9-430584aace4e admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.913918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40970a8a-7a56-4c4e-9ca9-430584aace4e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.914180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40970a8a-7a56-4c4e-9ca9-430584aace4e admin admin] PATH_INFO: `/v3/projects/2df65e884d2245f9a32b004e79ef04ac/users/717042dc9c6149f98e012f510fd8aaba/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:24.931090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40970a8a-7a56-4c4e-9ca9-430584aace4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df65e884d2245f9a32b004e79ef04ac, user_id=717042dc9c6149f98e012f510fd8aaba, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:24.933756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40970a8a-7a56-4c4e-9ca9-430584aace4e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:24.951700 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4202/8475] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:24 2022] PUT /identity/v3/projects/2df65e884d2245f9a32b004e79ef04ac/users/717042dc9c6149f98e012f510fd8aaba/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:24.963423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ee79d-f987-4e4f-8242-9aec1d953e07 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:24.963712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ee79d-f987-4e4f-8242-9aec1d953e07 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:24.964014 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ee79d-f987-4e4f-8242-9aec1d953e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.010683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-789ee79d-f987-4e4f-8242-9aec1d953e07 None None] MFA Rules not processed for user `717042dc9c6149f98e012f510fd8aaba`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:25.011651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-789ee79d-f987-4e4f-8242-9aec1d953e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:25.094583 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4274/8476] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:25.098653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40970a8a-7a56-4c4e-9ca9-430584aace4e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.180646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40970a8a-7a56-4c4e-9ca9-430584aace4e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.186526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf045c0-1c31-451b-880c-b67b2546b797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.187792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf045c0-1c31-451b-880c-b67b2546b797 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.188068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf045c0-1c31-451b-880c-b67b2546b797 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.188342 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf045c0-1c31-451b-880c-b67b2546b797 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.188987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf045c0-1c31-451b-880c-b67b2546b797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.191020 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf045c0-1c31-451b-880c-b67b2546b797 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.198254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:25.230100 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4203/8477] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:25 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:05:25.239249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ee79d-f987-4e4f-8242-9aec1d953e07 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.259993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ee79d-f987-4e4f-8242-9aec1d953e07 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.351638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18417e0b-c390-4497-8f23-0097b7199196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.352377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18417e0b-c390-4497-8f23-0097b7199196 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.352778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18417e0b-c390-4497-8f23-0097b7199196 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.353138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18417e0b-c390-4497-8f23-0097b7199196 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.353885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18417e0b-c390-4497-8f23-0097b7199196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.355940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18417e0b-c390-4497-8f23-0097b7199196 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.386072 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4275/8478] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:25 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:25.390165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf045c0-1c31-451b-880c-b67b2546b797 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.408178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf045c0-1c31-451b-880c-b67b2546b797 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.414895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f1736-e590-4795-b240-793eea653a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.416410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f1736-e590-4795-b240-793eea653a3a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.417091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f1736-e590-4795-b240-793eea653a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.417738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f1736-e590-4795-b240-793eea653a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.418703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f1736-e590-4795-b240-793eea653a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.420704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f1736-e590-4795-b240-793eea653a3a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.451613 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4204/8479] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:25.455321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18417e0b-c390-4497-8f23-0097b7199196 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.470505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18417e0b-c390-4497-8f23-0097b7199196 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.482690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e262a-fa59-4d95-aabd-835ccb65f22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.484333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e262a-fa59-4d95-aabd-835ccb65f22d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.484617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e262a-fa59-4d95-aabd-835ccb65f22d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.484896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e262a-fa59-4d95-aabd-835ccb65f22d admin admin] PATH_INFO: `/v3/projects/7a349282d052454188ea132271c07056/users/a90042bf36e34aafabe13a30d5ae0a65/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.502297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:25.506508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e262a-fa59-4d95-aabd-835ccb65f22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a349282d052454188ea132271c07056, user_id=a90042bf36e34aafabe13a30d5ae0a65, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.509698 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e262a-fa59-4d95-aabd-835ccb65f22d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.534017 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4276/8480] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:25 2022] PUT /identity/v3/projects/7a349282d052454188ea132271c07056/users/a90042bf36e34aafabe13a30d5ae0a65/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:25.537695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f1736-e590-4795-b240-793eea653a3a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.551528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f1736-e590-4795-b240-793eea653a3a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.633220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685d024-499f-42ae-9cbe-4106edd0cb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.633882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685d024-499f-42ae-9cbe-4106edd0cb22 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.634168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685d024-499f-42ae-9cbe-4106edd0cb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.634444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685d024-499f-42ae-9cbe-4106edd0cb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.635088 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685d024-499f-42ae-9cbe-4106edd0cb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.637596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685d024-499f-42ae-9cbe-4106edd0cb22 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.653048 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4205/8481] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:25.657413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e262a-fa59-4d95-aabd-835ccb65f22d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.674308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e262a-fa59-4d95-aabd-835ccb65f22d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:25.679675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd46b5-2fbe-4d96-99fa-9460944b7d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:25.680366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd46b5-2fbe-4d96-99fa-9460944b7d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.680669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd46b5-2fbe-4d96-99fa-9460944b7d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.680946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd46b5-2fbe-4d96-99fa-9460944b7d6c admin admin] PATH_INFO: `/v3/projects/7a349282d052454188ea132271c07056/users/a90042bf36e34aafabe13a30d5ae0a65/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.683254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd46b5-2fbe-4d96-99fa-9460944b7d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a349282d052454188ea132271c07056, user_id=a90042bf36e34aafabe13a30d5ae0a65, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:25.686343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd46b5-2fbe-4d96-99fa-9460944b7d6c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:25.704696 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4277/8482] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:25 2022] PUT /identity/v3/projects/7a349282d052454188ea132271c07056/users/a90042bf36e34aafabe13a30d5ae0a65/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:25.715009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abeb07-41d8-4173-9742-ccfe765994a7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:25.715228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abeb07-41d8-4173-9742-ccfe765994a7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:25.715519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abeb07-41d8-4173-9742-ccfe765994a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:25.758571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a1abeb07-41d8-4173-9742-ccfe765994a7 None None] MFA Rules not processed for user `a90042bf36e34aafabe13a30d5ae0a65`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:25.760840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a1abeb07-41d8-4173-9742-ccfe765994a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:25.896930 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4206/8483] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:25.904638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd46b5-2fbe-4d96-99fa-9460944b7d6c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:25.911168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e3fd46b5-2fbe-4d96-99fa-9460944b7d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:26.006257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd46b5-2fbe-4d96-99fa-9460944b7d6c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:26.010364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c8d71-df20-4d26-a785-f8f28830f497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:26.011044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c8d71-df20-4d26-a785-f8f28830f497 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:26.011329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c8d71-df20-4d26-a785-f8f28830f497 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:26.011611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c8d71-df20-4d26-a785-f8f28830f497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:26.025529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c8d71-df20-4d26-a785-f8f28830f497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:26.027283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c8d71-df20-4d26-a785-f8f28830f497 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:26.046860 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4278/8484] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:26.115335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abeb07-41d8-4173-9742-ccfe765994a7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:26.134942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abeb07-41d8-4173-9742-ccfe765994a7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:26.139280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46777f03-b341-48ef-b90d-8f3ae33ba7ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:26.140658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46777f03-b341-48ef-b90d-8f3ae33ba7ef service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:26.142756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46777f03-b341-48ef-b90d-8f3ae33ba7ef service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:26.142756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46777f03-b341-48ef-b90d-8f3ae33ba7ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:26.231771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46777f03-b341-48ef-b90d-8f3ae33ba7ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:26.246121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:26.248329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46777f03-b341-48ef-b90d-8f3ae33ba7ef service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:26.286908 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4207/8485] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:31.725533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c8d71-df20-4d26-a785-f8f28830f497 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:31.894324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c8d71-df20-4d26-a785-f8f28830f497 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:31.904166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:31.904847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:31.905220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:31.908589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] PATH_INFO: `/v3/users/c246cb108d9d4512b94bf7386e2b20cf` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:31.911017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c246cb108d9d4512b94bf7386e2b20cf)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:31.924497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:32.030748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c246cb108d9d4512b94bf7386e2b20cf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:32.031584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c246cb108d9d4512b94bf7386e2b20cf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:32.046738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c246cb108d9d4512b94bf7386e2b20cf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:32.047601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c246cb108d9d4512b94bf7386e2b20cf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:32.057325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c246cb108d9d4512b94bf7386e2b20cf'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:32.063570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:32.108102 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4279/8486] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:31 2022] DELETE /identity/v3/users/c246cb108d9d4512b94bf7386e2b20cf => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:32.111095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21797d-3a2d-4cf7-9eff-ef48f30a853b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:32.111955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21797d-3a2d-4cf7-9eff-ef48f30a853b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:32.112240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21797d-3a2d-4cf7-9eff-ef48f30a853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:32.158131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9e21797d-3a2d-4cf7-9eff-ef48f30a853b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:32.159762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9e21797d-3a2d-4cf7-9eff-ef48f30a853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:32.257639 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4208/8487] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:32.268327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:32.270059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:32.365924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2915bbb-31b6-4e09-8860-7896f5716e59 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:32.370402 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59282c-6e9c-44a7-a5e5-042b21b83c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:32.371224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59282c-6e9c-44a7-a5e5-042b21b83c5d service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:32.371614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59282c-6e9c-44a7-a5e5-042b21b83c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:32.372082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59282c-6e9c-44a7-a5e5-042b21b83c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:32.383909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59282c-6e9c-44a7-a5e5-042b21b83c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:32.385646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59282c-6e9c-44a7-a5e5-042b21b83c5d service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:32.411441 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4280/8488] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:32.805955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21797d-3a2d-4cf7-9eff-ef48f30a853b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:32.807435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9e21797d-3a2d-4cf7-9eff-ef48f30a853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:32.832615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21797d-3a2d-4cf7-9eff-ef48f30a853b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:32.854080 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:32.854747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:32.855030 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:32.855312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] PATH_INFO: `/v3/projects/a5f2446c3c7c42a1b97b03c36b5d5206` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:32.857605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f2446c3c7c42a1b97b03c36b5d5206)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:32.862976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:32.953453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f2446c3c7c42a1b97b03c36b5d5206', 'request_id': 'req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:32.962420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f2446c3c7c42a1b97b03c36b5d5206', 'request_id': 'req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:32.980653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f2446c3c7c42a1b97b03c36b5d5206', 'request_id': 'req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.012025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] The token cache is being invalidate because project a5f2446c3c7c42a1b97b03c36b5d5206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:33.012890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.016215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.019847 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4209/8489] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:32 2022] DELETE /identity/v3/projects/a5f2446c3c7c42a1b97b03c36b5d5206 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:33.024027 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59282c-6e9c-44a7-a5e5-042b21b83c5d service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:33.039129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59282c-6e9c-44a7-a5e5-042b21b83c5d service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:33.173993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:33.174906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:33.175191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:33.175468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] PATH_INFO: `/v3/users/717042dc9c6149f98e012f510fd8aaba` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:33.185469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=717042dc9c6149f98e012f510fd8aaba)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:33.191970 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:33.310146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717042dc9c6149f98e012f510fd8aaba'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.311062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717042dc9c6149f98e012f510fd8aaba'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.330964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717042dc9c6149f98e012f510fd8aaba'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.332035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717042dc9c6149f98e012f510fd8aaba'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.346680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717042dc9c6149f98e012f510fd8aaba'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.374103 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4281/8490] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:33 2022] DELETE /identity/v3/users/717042dc9c6149f98e012f510fd8aaba => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:33.765811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:33.767312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:33.785268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8892a-2c95-4d3c-88a3-373c0ae95a9e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:33.862605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:33.863377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:33.863739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:33.864087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] PATH_INFO: `/v3/projects/2df65e884d2245f9a32b004e79ef04ac` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:33.867543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df65e884d2245f9a32b004e79ef04ac)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:33.870061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:33.903555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:33.939011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df65e884d2245f9a32b004e79ef04ac', 'request_id': 'req-e220ccf3-49c3-4b7e-8261-e4facdd6074a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.954086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df65e884d2245f9a32b004e79ef04ac', 'request_id': 'req-e220ccf3-49c3-4b7e-8261-e4facdd6074a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.968062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df65e884d2245f9a32b004e79ef04ac', 'request_id': 'req-e220ccf3-49c3-4b7e-8261-e4facdd6074a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.988965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] The token cache is being invalidate because project 2df65e884d2245f9a32b004e79ef04ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:33.992016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.993002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:33.996685 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4210/8491] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:33 2022] DELETE /identity/v3/projects/2df65e884d2245f9a32b004e79ef04ac => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:34.000674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:34.002551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:34.021902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83569-70aa-46d1-b3ab-48f509c37f98 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:34.032327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:34.097248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec83f88-dd47-4e17-95f8-e79169f3075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:34.097941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec83f88-dd47-4e17-95f8-e79169f3075d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:34.098223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec83f88-dd47-4e17-95f8-e79169f3075d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:34.098499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec83f88-dd47-4e17-95f8-e79169f3075d admin admin] PATH_INFO: `/v3/users/a90042bf36e34aafabe13a30d5ae0a65` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:34.101651 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec83f88-dd47-4e17-95f8-e79169f3075d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90042bf36e34aafabe13a30d5ae0a65)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:34.103741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec83f88-dd47-4e17-95f8-e79169f3075d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:34.166885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cec83f88-dd47-4e17-95f8-e79169f3075d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90042bf36e34aafabe13a30d5ae0a65'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:34.167616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cec83f88-dd47-4e17-95f8-e79169f3075d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90042bf36e34aafabe13a30d5ae0a65'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:34.189276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cec83f88-dd47-4e17-95f8-e79169f3075d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90042bf36e34aafabe13a30d5ae0a65'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:34.190323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cec83f88-dd47-4e17-95f8-e79169f3075d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90042bf36e34aafabe13a30d5ae0a65'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:34.204142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cec83f88-dd47-4e17-95f8-e79169f3075d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90042bf36e34aafabe13a30d5ae0a65'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:34.230490 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4282/8492] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:33 2022] DELETE /identity/v3/users/a90042bf36e34aafabe13a30d5ae0a65 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:34.636443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:34.638451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:34.660656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220ccf3-49c3-4b7e-8261-e4facdd6074a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:34.798775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:34.799790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:34.800142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:34.800497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] PATH_INFO: `/v3/projects/7a349282d052454188ea132271c07056` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:34.801838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a349282d052454188ea132271c07056)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:34.805239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:34.874660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a349282d052454188ea132271c07056', 'request_id': 'req-54680a59-4895-41af-9f45-10fca22011db'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:34.883408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a349282d052454188ea132271c07056', 'request_id': 'req-54680a59-4895-41af-9f45-10fca22011db'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:34.892094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a349282d052454188ea132271c07056', 'request_id': 'req-54680a59-4895-41af-9f45-10fca22011db'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:34.907458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] The token cache is being invalidate because project 7a349282d052454188ea132271c07056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:34.907681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:34.908554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-54680a59-4895-41af-9f45-10fca22011db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:34.910578 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4211/8493] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:34 2022] DELETE /identity/v3/projects/7a349282d052454188ea132271c07056 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:34.916109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695477-2cd0-4a06-a8c9-a48b10d1cde1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:34.916433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695477-2cd0-4a06-a8c9-a48b10d1cde1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:34.916673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695477-2cd0-4a06-a8c9-a48b10d1cde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:34.937568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5b695477-2cd0-4a06-a8c9-a48b10d1cde1 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:34.939013 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5b695477-2cd0-4a06-a8c9-a48b10d1cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:35.009993 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4283/8494] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:35.020027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74e747-7b4e-4cea-9a4c-f903f07d305e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.020422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74e747-7b4e-4cea-9a4c-f903f07d305e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.021064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74e747-7b4e-4cea-9a4c-f903f07d305e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.045704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8b74e747-7b4e-4cea-9a4c-f903f07d305e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:35.048610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8b74e747-7b4e-4cea-9a4c-f903f07d305e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:35.063687 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4212/8495] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:35.065092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b695477-2cd0-4a06-a8c9-a48b10d1cde1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.079501 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b695477-2cd0-4a06-a8c9-a48b10d1cde1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.095700 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3625090-bb7a-4e69-a533-ecb7a1473a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.096839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625090-bb7a-4e69-a533-ecb7a1473a63 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.097473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625090-bb7a-4e69-a533-ecb7a1473a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.097954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625090-bb7a-4e69-a533-ecb7a1473a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.098819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3625090-bb7a-4e69-a533-ecb7a1473a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:35.099321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3625090-bb7a-4e69-a533-ecb7a1473a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.101733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3625090-bb7a-4e69-a533-ecb7a1473a63 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.116141 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4284/8496] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:35.120961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74e747-7b4e-4cea-9a4c-f903f07d305e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.132263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74e747-7b4e-4cea-9a4c-f903f07d305e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.141771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b321d-32e6-451c-bab2-efa69a3fb302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.142780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b321d-32e6-451c-bab2-efa69a3fb302 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.143264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b321d-32e6-451c-bab2-efa69a3fb302 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.143771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b321d-32e6-451c-bab2-efa69a3fb302 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.145188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b321d-32e6-451c-bab2-efa69a3fb302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.147758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b321d-32e6-451c-bab2-efa69a3fb302 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.188719 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4213/8497] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:35 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:05:35.193339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3625090-bb7a-4e69-a533-ecb7a1473a63 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.211445 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3625090-bb7a-4e69-a533-ecb7a1473a63 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.242703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:35.306765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794545d-916b-4cb7-a6a4-1d2a60ae99e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.307578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794545d-916b-4cb7-a6a4-1d2a60ae99e2 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.307914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794545d-916b-4cb7-a6a4-1d2a60ae99e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.308430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794545d-916b-4cb7-a6a4-1d2a60ae99e2 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.309175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794545d-916b-4cb7-a6a4-1d2a60ae99e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.312071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794545d-916b-4cb7-a6a4-1d2a60ae99e2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.345052 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4285/8498] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:35 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:35.346359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b321d-32e6-451c-bab2-efa69a3fb302 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.360684 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b321d-32e6-451c-bab2-efa69a3fb302 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.367062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f221dd-20bb-4fca-815f-7481bbcab25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.368223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f221dd-20bb-4fca-815f-7481bbcab25b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.369197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f221dd-20bb-4fca-815f-7481bbcab25b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.369627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f221dd-20bb-4fca-815f-7481bbcab25b admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.370807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f221dd-20bb-4fca-815f-7481bbcab25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.372726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f221dd-20bb-4fca-815f-7481bbcab25b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.380543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:35.393268 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4214/8499] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:35.396798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794545d-916b-4cb7-a6a4-1d2a60ae99e2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.411761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794545d-916b-4cb7-a6a4-1d2a60ae99e2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.418400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298ca6d-7fb6-419b-bb43-7e06bff3d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.419240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298ca6d-7fb6-419b-bb43-7e06bff3d903 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.419822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298ca6d-7fb6-419b-bb43-7e06bff3d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.420296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298ca6d-7fb6-419b-bb43-7e06bff3d903 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.421857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298ca6d-7fb6-419b-bb43-7e06bff3d903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.423617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298ca6d-7fb6-419b-bb43-7e06bff3d903 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.439944 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4286/8500] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:35.441745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f221dd-20bb-4fca-815f-7481bbcab25b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.456047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f221dd-20bb-4fca-815f-7481bbcab25b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.465550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005d419-d7a1-488a-9cdd-2e3925411f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.466977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d419-d7a1-488a-9cdd-2e3925411f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.467259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d419-d7a1-488a-9cdd-2e3925411f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.467565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d419-d7a1-488a-9cdd-2e3925411f2d admin admin] PATH_INFO: `/v3/projects/78aec32b9b81450aaaa4a411a617110f/users/b04faa9feb2240639c816ee2fe4a161d/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.513819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005d419-d7a1-488a-9cdd-2e3925411f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=78aec32b9b81450aaaa4a411a617110f, user_id=b04faa9feb2240639c816ee2fe4a161d, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.517369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005d419-d7a1-488a-9cdd-2e3925411f2d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.546332 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4215/8501] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:35 2022] PUT /identity/v3/projects/78aec32b9b81450aaaa4a411a617110f/users/b04faa9feb2240639c816ee2fe4a161d/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:35.573413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda42d1e-07b9-41b5-b613-d3b5429a50e4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.574216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda42d1e-07b9-41b5-b613-d3b5429a50e4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.574878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda42d1e-07b9-41b5-b613-d3b5429a50e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.658229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-cda42d1e-07b9-41b5-b613-d3b5429a50e4 None None] MFA Rules not processed for user `b04faa9feb2240639c816ee2fe4a161d`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:35.659744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cda42d1e-07b9-41b5-b613-d3b5429a50e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:35.705435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628c37-eef1-4d02-a0a4-0aada7af8655 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.705732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628c37-eef1-4d02-a0a4-0aada7af8655 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.706019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628c37-eef1-4d02-a0a4-0aada7af8655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.731872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-32628c37-eef1-4d02-a0a4-0aada7af8655 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:35.733797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-32628c37-eef1-4d02-a0a4-0aada7af8655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:35.756027 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4287/8502] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:35.767985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda42d1e-07b9-41b5-b613-d3b5429a50e4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.770354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cda42d1e-07b9-41b5-b613-d3b5429a50e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:35.865258 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4216/8503] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 16:05:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:35.872246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda42d1e-07b9-41b5-b613-d3b5429a50e4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:35.877231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83a4f6-ed1a-4f02-a8ad-bc831e17d336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:35.878475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83a4f6-ed1a-4f02-a8ad-bc831e17d336 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:35.878972 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83a4f6-ed1a-4f02-a8ad-bc831e17d336 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:35.879899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83a4f6-ed1a-4f02-a8ad-bc831e17d336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:35.890975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83a4f6-ed1a-4f02-a8ad-bc831e17d336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:35.893007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83a4f6-ed1a-4f02-a8ad-bc831e17d336 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:35.905116 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4288/8504] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:35.928597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32628c37-eef1-4d02-a0a4-0aada7af8655 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.940604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83a4f6-ed1a-4f02-a8ad-bc831e17d336 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:35.942419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8d83a4f6-ed1a-4f02-a8ad-bc831e17d336 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:36.018797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32628c37-eef1-4d02-a0a4-0aada7af8655 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.025279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.026234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.026686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.027133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] PATH_INFO: `/v3/users/b04faa9feb2240639c816ee2fe4a161d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.028971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04faa9feb2240639c816ee2fe4a161d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.031708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.042604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:36.115989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83a4f6-ed1a-4f02-a8ad-bc831e17d336 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.119852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04faa9feb2240639c816ee2fe4a161d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:36.122713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04faa9feb2240639c816ee2fe4a161d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:36.123456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412e9eb-0ed6-480f-ab07-f1474abe03c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.124351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412e9eb-0ed6-480f-ab07-f1474abe03c8 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.125006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412e9eb-0ed6-480f-ab07-f1474abe03c8 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.125415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412e9eb-0ed6-480f-ab07-f1474abe03c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.140993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412e9eb-0ed6-480f-ab07-f1474abe03c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.143185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412e9eb-0ed6-480f-ab07-f1474abe03c8 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.151325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04faa9feb2240639c816ee2fe4a161d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:36.163240 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4289/8505] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:05:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 16:05:36.171770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04faa9feb2240639c816ee2fe4a161d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:36.184753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04faa9feb2240639c816ee2fe4a161d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:36.189525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:36.202303 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4217/8506] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:05:35 2022] DELETE /identity/v3/users/b04faa9feb2240639c816ee2fe4a161d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:05:36.204371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ae7d3-7b32-4c99-8f04-996d61772121 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.204655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ae7d3-7b32-4c99-8f04-996d61772121 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.204949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ae7d3-7b32-4c99-8f04-996d61772121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.239511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a93ae7d3-7b32-4c99-8f04-996d61772121 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:36.240986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a93ae7d3-7b32-4c99-8f04-996d61772121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:36.332467 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4290/8507] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:36.343190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:36.345665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:36.444144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de938513-b283-42af-834c-75126fad7c0b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.450369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5896da-48a9-485f-b2f8-d6682b37707b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.454452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5896da-48a9-485f-b2f8-d6682b37707b service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.455032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5896da-48a9-485f-b2f8-d6682b37707b service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.456089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5896da-48a9-485f-b2f8-d6682b37707b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:36.473417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5896da-48a9-485f-b2f8-d6682b37707b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:36.476386 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5896da-48a9-485f-b2f8-d6682b37707b service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:36.495176 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4218/8508] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:36.929126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ae7d3-7b32-4c99-8f04-996d61772121 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:36.931148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a93ae7d3-7b32-4c99-8f04-996d61772121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:36.987895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ae7d3-7b32-4c99-8f04-996d61772121 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:36.995253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:36.996496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:36.996793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:36.997187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] PATH_INFO: `/v3/projects/78aec32b9b81450aaaa4a411a617110f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.002360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78aec32b9b81450aaaa4a411a617110f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.004354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.109242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78aec32b9b81450aaaa4a411a617110f', 'request_id': 'req-3deb64fa-b07f-4487-abd6-18b2b702e444'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.118006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78aec32b9b81450aaaa4a411a617110f', 'request_id': 'req-3deb64fa-b07f-4487-abd6-18b2b702e444'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.131712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78aec32b9b81450aaaa4a411a617110f', 'request_id': 'req-3deb64fa-b07f-4487-abd6-18b2b702e444'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.150482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] The token cache is being invalidate because project 78aec32b9b81450aaaa4a411a617110f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:05:37.151341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.152240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-3deb64fa-b07f-4487-abd6-18b2b702e444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:05:37.154731 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4291/8509] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:05:36 2022] DELETE /identity/v3/projects/78aec32b9b81450aaaa4a411a617110f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:37.161550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430b22-a250-4a80-ba9b-6c283dec1a94 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.162680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430b22-a250-4a80-ba9b-6c283dec1a94 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.163511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430b22-a250-4a80-ba9b-6c283dec1a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.194552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-0a430b22-a250-4a80-ba9b-6c283dec1a94 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:37.195768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0a430b22-a250-4a80-ba9b-6c283dec1a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:37.287841 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4219/8510] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:37.297189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb50e4-505d-479a-acd3-5c90365febc4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.297556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb50e4-505d-479a-acd3-5c90365febc4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.297837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb50e4-505d-479a-acd3-5c90365febc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.326184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5efb50e4-505d-479a-acd3-5c90365febc4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:37.328530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5efb50e4-505d-479a-acd3-5c90365febc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:37.343649 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4292/8511] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:37.347795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a430b22-a250-4a80-ba9b-6c283dec1a94 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.360638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a430b22-a250-4a80-ba9b-6c283dec1a94 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.368488 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0147c-a865-4c64-9ee0-8b22109e77d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.369538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0147c-a865-4c64-9ee0-8b22109e77d3 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.370162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0147c-a865-4c64-9ee0-8b22109e77d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.370517 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0147c-a865-4c64-9ee0-8b22109e77d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.371509 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0147c-a865-4c64-9ee0-8b22109e77d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:05:37.373424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0147c-a865-4c64-9ee0-8b22109e77d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.373649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0147c-a865-4c64-9ee0-8b22109e77d3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.390956 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4220/8512] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:05:37.394767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb50e4-505d-479a-acd3-5c90365febc4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.417093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb50e4-505d-479a-acd3-5c90365febc4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.429804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a5b04-da34-46db-b02b-7a66307ecd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.431994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a5b04-da34-46db-b02b-7a66307ecd18 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.432279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a5b04-da34-46db-b02b-7a66307ecd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.432579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a5b04-da34-46db-b02b-7a66307ecd18 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.433488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a5b04-da34-46db-b02b-7a66307ecd18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.435461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a5b04-da34-46db-b02b-7a66307ecd18 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.587599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0147c-a865-4c64-9ee0-8b22109e77d3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.587746 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4293/8513] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:05:37 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:05:37.611024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0147c-a865-4c64-9ee0-8b22109e77d3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.719299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc008e-39e0-475c-bc75-8508faaf0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.720079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc008e-39e0-475c-bc75-8508faaf0bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.720370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc008e-39e0-475c-bc75-8508faaf0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.720855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc008e-39e0-475c-bc75-8508faaf0bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.721580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc008e-39e0-475c-bc75-8508faaf0bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.723694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc008e-39e0-475c-bc75-8508faaf0bc8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.765436 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4221/8514] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:05:37 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:05:37.767790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a5b04-da34-46db-b02b-7a66307ecd18 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.779380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a5b04-da34-46db-b02b-7a66307ecd18 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.786124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a1c5d-9f00-45ef-a1e7-bceada1dcc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.786818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a1c5d-9f00-45ef-a1e7-bceada1dcc94 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.787134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a1c5d-9f00-45ef-a1e7-bceada1dcc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.787406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a1c5d-9f00-45ef-a1e7-bceada1dcc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.788043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a1c5d-9f00-45ef-a1e7-bceada1dcc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.789978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a1c5d-9f00-45ef-a1e7-bceada1dcc94 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.805788 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4294/8515] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:05:37.807704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc008e-39e0-475c-bc75-8508faaf0bc8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.822845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc008e-39e0-475c-bc75-8508faaf0bc8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.828877 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912e950-4f39-4a19-b481-facbc2a1adf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.829721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912e950-4f39-4a19-b481-facbc2a1adf1 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.831829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912e950-4f39-4a19-b481-facbc2a1adf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.831829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912e950-4f39-4a19-b481-facbc2a1adf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.831829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912e950-4f39-4a19-b481-facbc2a1adf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.834577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912e950-4f39-4a19-b481-facbc2a1adf1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.864946 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4222/8516] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:05:37.869301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a1c5d-9f00-45ef-a1e7-bceada1dcc94 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:37.878181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:37.888224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a1c5d-9f00-45ef-a1e7-bceada1dcc94 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:37.901692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9abd9-78e5-488e-93e4-e2a6b560e04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:37.902456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9abd9-78e5-488e-93e4-e2a6b560e04b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.902693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9abd9-78e5-488e-93e4-e2a6b560e04b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.903006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9abd9-78e5-488e-93e4-e2a6b560e04b admin admin] PATH_INFO: `/v3/projects/1e7d5ef767224e8fb02c48708db23238/users/f75ae7a10ac14e0fb2b79127f39db44f/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.926182 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9abd9-78e5-488e-93e4-e2a6b560e04b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7d5ef767224e8fb02c48708db23238, user_id=f75ae7a10ac14e0fb2b79127f39db44f, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:37.932194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9abd9-78e5-488e-93e4-e2a6b560e04b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:37.972499 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4295/8517] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:05:37 2022] PUT /identity/v3/projects/1e7d5ef767224e8fb02c48708db23238/users/f75ae7a10ac14e0fb2b79127f39db44f/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:05:37.973791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e42ea-601a-4022-a518-7cda4c98b3d6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:37.973791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e42ea-601a-4022-a518-7cda4c98b3d6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:37.973791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e42ea-601a-4022-a518-7cda4c98b3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:37.995393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:38.008750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c75e42ea-601a-4022-a518-7cda4c98b3d6 None None] MFA Rules not processed for user `f75ae7a10ac14e0fb2b79127f39db44f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:38.010369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c75e42ea-601a-4022-a518-7cda4c98b3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:38.182660 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4223/8518] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:05:38.198541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9abd9-78e5-488e-93e4-e2a6b560e04b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:38.201354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a8c9abd9-78e5-488e-93e4-e2a6b560e04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:38.295329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9abd9-78e5-488e-93e4-e2a6b560e04b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:38.302836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1c051-5662-4078-8c1a-31c175f0b622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:38.303462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1c051-5662-4078-8c1a-31c175f0b622 service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:38.305358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1c051-5662-4078-8c1a-31c175f0b622 service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:38.305673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1c051-5662-4078-8c1a-31c175f0b622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:38.315459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1c051-5662-4078-8c1a-31c175f0b622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:38.316849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1c051-5662-4078-8c1a-31c175f0b622 service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:38.328300 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4296/8519] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:05:38.653810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e42ea-601a-4022-a518-7cda4c98b3d6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:38.655480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c75e42ea-601a-4022-a518-7cda4c98b3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:38.788378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e42ea-601a-4022-a518-7cda4c98b3d6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:38.801943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d22f8b-0c0a-4afd-ad51-52cd8b8e86d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:38.802840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d22f8b-0c0a-4afd-ad51-52cd8b8e86d1 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:38.803184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d22f8b-0c0a-4afd-ad51-52cd8b8e86d1 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:38.803534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d22f8b-0c0a-4afd-ad51-52cd8b8e86d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:38.805911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-91d22f8b-0c0a-4afd-ad51-52cd8b8e86d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:38.824259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d22f8b-0c0a-4afd-ad51-52cd8b8e86d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:38.826249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d22f8b-0c0a-4afd-ad51-52cd8b8e86d1 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:38.844888 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4224/8520] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:39.168503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1c051-5662-4078-8c1a-31c175f0b622 service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.170738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9df1c051-5662-4078-8c1a-31c175f0b622 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:39.324395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1c051-5662-4078-8c1a-31c175f0b622 service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:39.346878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b844e74-b002-4a90-a312-abc3f88edf9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.348721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844e74-b002-4a90-a312-abc3f88edf9a service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.349234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844e74-b002-4a90-a312-abc3f88edf9a service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.349764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844e74-b002-4a90-a312-abc3f88edf9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.353684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7b844e74-b002-4a90-a312-abc3f88edf9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:39.383065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b844e74-b002-4a90-a312-abc3f88edf9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:39.398106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b844e74-b002-4a90-a312-abc3f88edf9a service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:39.427831 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4297/8521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:39.825657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d22f8b-0c0a-4afd-ad51-52cd8b8e86d1 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:05:39.828526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-91d22f8b-0c0a-4afd-ad51-52cd8b8e86d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:39.855991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d22f8b-0c0a-4afd-ad51-52cd8b8e86d1 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:05:39.861178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6380a-073e-46e0-a6d6-344034660b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:05:39.862140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6380a-073e-46e0-a6d6-344034660b74 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:39.865315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6380a-073e-46e0-a6d6-344034660b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:39.865315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6380a-073e-46e0-a6d6-344034660b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:39.866858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5ab6380a-073e-46e0-a6d6-344034660b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:40.025149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6380a-073e-46e0-a6d6-344034660b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:05:40.026741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6380a-073e-46e0-a6d6-344034660b74 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:05:40.043820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:40.048945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea469a-d19d-43d6-9c7a-e7e5f17f46e1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:05:40.049424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea469a-d19d-43d6-9c7a-e7e5f17f46e1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:05:40.049874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea469a-d19d-43d6-9c7a-e7e5f17f46e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:05:40.056781 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4225/8522] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:05:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:05:40.085429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dfea469a-d19d-43d6-9c7a-e7e5f17f46e1 None None] MFA Rules not processed for user `f75ae7a10ac14e0fb2b79127f39db44f`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:05:40.088034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dfea469a-d19d-43d6-9c7a-e7e5f17f46e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:05:40.104496 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4298/8523] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:05:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:05:50.054238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:50.074220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=63,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:00.868567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6380a-073e-46e0-a6d6-344034660b74 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:00.891395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6380a-073e-46e0-a6d6-344034660b74 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:00.901448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedf213-d842-4ac1-b3c5-32babfeea907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:00.902461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedf213-d842-4ac1-b3c5-32babfeea907 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:00.902869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedf213-d842-4ac1-b3c5-32babfeea907 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:00.903232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedf213-d842-4ac1-b3c5-32babfeea907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:00.905866 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ccedf213-d842-4ac1-b3c5-32babfeea907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:00.927371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedf213-d842-4ac1-b3c5-32babfeea907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:00.930115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedf213-d842-4ac1-b3c5-32babfeea907 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:00.951166 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4226/8524] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:01.927604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f82f28-e678-46e0-b329-0c2c4d5c7c47 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:01.928053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f82f28-e678-46e0-b329-0c2c4d5c7c47 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:01.928144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f82f28-e678-46e0-b329-0c2c4d5c7c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:01.949619 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c7f82f28-e678-46e0-b329-0c2c4d5c7c47 None None] MFA Rules not processed for user `e276b9fae4594c17a1883dd4e48184c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:01.950819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c7f82f28-e678-46e0-b329-0c2c4d5c7c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:02.023751 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4299/8525] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:04.380049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedf213-d842-4ac1-b3c5-32babfeea907 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:04.392779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedf213-d842-4ac1-b3c5-32babfeea907 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:04.404392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b8c51-19a7-4f07-ba76-6684f107a181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:04.405182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8c51-19a7-4f07-ba76-6684f107a181 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:04.406103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8c51-19a7-4f07-ba76-6684f107a181 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:04.406103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8c51-19a7-4f07-ba76-6684f107a181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:04.408085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e71b8c51-19a7-4f07-ba76-6684f107a181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:04.515623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b8c51-19a7-4f07-ba76-6684f107a181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:04.517566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b8c51-19a7-4f07-ba76-6684f107a181 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:04.572478 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4227/8526] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:12.015827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=25 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:14.550943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=12 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:17.911293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f82f28-e678-46e0-b329-0c2c4d5c7c47 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:17.917196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c7f82f28-e678-46e0-b329-0c2c4d5c7c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:18.050047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f82f28-e678-46e0-b329-0c2c4d5c7c47 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:18.065755 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:18.066688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:18.067030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:18.067390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] PATH_INFO: `/v3/users/0928e447a8cc4b9f8f8fcdbbf195fcbb` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:18.068646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0928e447a8cc4b9f8f8fcdbbf195fcbb)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:18.070835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:18.158568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0928e447a8cc4b9f8f8fcdbbf195fcbb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:18.159251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0928e447a8cc4b9f8f8fcdbbf195fcbb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:18.224106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0928e447a8cc4b9f8f8fcdbbf195fcbb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:18.226300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0928e447a8cc4b9f8f8fcdbbf195fcbb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:18.257741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0928e447a8cc4b9f8f8fcdbbf195fcbb'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:18.291079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe2365-1e23-4b69-8750-ece9c83c4e9a None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:18.291527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe2365-1e23-4b69-8750-ece9c83c4e9a None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:18.291641 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe2365-1e23-4b69-8750-ece9c83c4e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:18.294332 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4300/8527] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:17 2022] DELETE /identity/v3/users/0928e447a8cc4b9f8f8fcdbbf195fcbb => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:18.327027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c7fe2365-1e23-4b69-8750-ece9c83c4e9a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:18.328281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c7fe2365-1e23-4b69-8750-ece9c83c4e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:18.461693 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4228/8528] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:18.483535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:18.486657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:18.601737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa7cec-192d-4de2-b296-662da575f17f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:18.605466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce59ea-a155-4d83-a7b5-77204876392c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:18.606169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce59ea-a155-4d83-a7b5-77204876392c service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:18.606454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce59ea-a155-4d83-a7b5-77204876392c service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:18.606741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce59ea-a155-4d83-a7b5-77204876392c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:18.617759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce59ea-a155-4d83-a7b5-77204876392c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:18.619231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce59ea-a155-4d83-a7b5-77204876392c service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:18.635168 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4301/8529] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:19.095796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe2365-1e23-4b69-8750-ece9c83c4e9a None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.109895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c7fe2365-1e23-4b69-8750-ece9c83c4e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:19.129236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe2365-1e23-4b69-8750-ece9c83c4e9a None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.135269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.135909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.136189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.136560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] PATH_INFO: `/v3/projects/508cc41c39d14d62be8a88eb11bfc4ca` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.139434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=508cc41c39d14d62be8a88eb11bfc4ca)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.140454 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.214729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508cc41c39d14d62be8a88eb11bfc4ca', 'request_id': 'req-d79fa547-3747-485d-b318-680a9d19a5f9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.241040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508cc41c39d14d62be8a88eb11bfc4ca', 'request_id': 'req-d79fa547-3747-485d-b318-680a9d19a5f9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.254584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508cc41c39d14d62be8a88eb11bfc4ca', 'request_id': 'req-d79fa547-3747-485d-b318-680a9d19a5f9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.281950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] The token cache is being invalidate because project 508cc41c39d14d62be8a88eb11bfc4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:19.283346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.283346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d79fa547-3747-485d-b318-680a9d19a5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:19.287944 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4229/8530] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:19 2022] DELETE /identity/v3/projects/508cc41c39d14d62be8a88eb11bfc4ca => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:19.289897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cf874-aaa1-4f4e-b4aa-5c273c36c981 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.290346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cf874-aaa1-4f4e-b4aa-5c273c36c981 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.290446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cf874-aaa1-4f4e-b4aa-5c273c36c981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.332006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-711cf874-aaa1-4f4e-b4aa-5c273c36c981 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:19.337130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-711cf874-aaa1-4f4e-b4aa-5c273c36c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:19.364323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:19.445977 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4302/8531] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:19.454206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5381-d124-4142-a9c4-deefb95754eb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.454206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5381-d124-4142-a9c4-deefb95754eb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.454206 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5381-d124-4142-a9c4-deefb95754eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.488401 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-49bd5381-d124-4142-a9c4-deefb95754eb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:19.489779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-49bd5381-d124-4142-a9c4-deefb95754eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:19.513837 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4230/8532] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:19.518059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cf874-aaa1-4f4e-b4aa-5c273c36c981 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.534435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cf874-aaa1-4f4e-b4aa-5c273c36c981 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.545277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d099d-4f9a-4d37-9702-a217a0d9d532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.546767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d099d-4f9a-4d37-9702-a217a0d9d532 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.546767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d099d-4f9a-4d37-9702-a217a0d9d532 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.547039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d099d-4f9a-4d37-9702-a217a0d9d532 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.547886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d099d-4f9a-4d37-9702-a217a0d9d532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:19.550527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d099d-4f9a-4d37-9702-a217a0d9d532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.555701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d099d-4f9a-4d37-9702-a217a0d9d532 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.595933 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4303/8533] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:19.597974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd5381-d124-4142-a9c4-deefb95754eb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.618903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd5381-d124-4142-a9c4-deefb95754eb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.637997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31e3c4-c61e-417d-87fe-fa9752abfea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.638694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e3c4-c61e-417d-87fe-fa9752abfea2 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.638976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e3c4-c61e-417d-87fe-fa9752abfea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.639252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31e3c4-c61e-417d-87fe-fa9752abfea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.639911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31e3c4-c61e-417d-87fe-fa9752abfea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.649665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31e3c4-c61e-417d-87fe-fa9752abfea2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.737940 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4231/8534] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:19 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:19.739497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d099d-4f9a-4d37-9702-a217a0d9d532 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.766801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d099d-4f9a-4d37-9702-a217a0d9d532 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.874850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056c3f8-5797-4f5f-81b4-4838e758f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.875590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056c3f8-5797-4f5f-81b4-4838e758f2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.875965 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056c3f8-5797-4f5f-81b4-4838e758f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.876335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056c3f8-5797-4f5f-81b4-4838e758f2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.877097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056c3f8-5797-4f5f-81b4-4838e758f2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.880136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056c3f8-5797-4f5f-81b4-4838e758f2f2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.916536 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4304/8535] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:19 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:06:19.919711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31e3c4-c61e-417d-87fe-fa9752abfea2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.938111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31e3c4-c61e-417d-87fe-fa9752abfea2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:19.948685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2509ba5-9b8a-407a-b589-4fdb01420a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:19.949325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2509ba5-9b8a-407a-b589-4fdb01420a7e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:19.949651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2509ba5-9b8a-407a-b589-4fdb01420a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:19.950061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2509ba5-9b8a-407a-b589-4fdb01420a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:19.950700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2509ba5-9b8a-407a-b589-4fdb01420a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:19.953164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2509ba5-9b8a-407a-b589-4fdb01420a7e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:19.973435 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4232/8536] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:19.976388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056c3f8-5797-4f5f-81b4-4838e758f2f2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:19.993812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056c3f8-5797-4f5f-81b4-4838e758f2f2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:20.011744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b1537-c1f3-4218-be0b-2b2c5ba4d7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:20.012549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b1537-c1f3-4218-be0b-2b2c5ba4d7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.012905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b1537-c1f3-4218-be0b-2b2c5ba4d7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.013304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b1537-c1f3-4218-be0b-2b2c5ba4d7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.014831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b1537-c1f3-4218-be0b-2b2c5ba4d7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:20.021121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b1537-c1f3-4218-be0b-2b2c5ba4d7a7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:20.040747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2509ba5-9b8a-407a-b589-4fdb01420a7e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:20.047047 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4305/8537] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:20.053657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2509ba5-9b8a-407a-b589-4fdb01420a7e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:20.059156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ef2b2-c8e4-4ada-a61d-a297f96db3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:20.060162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef2b2-c8e4-4ada-a61d-a297f96db3db admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.060660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef2b2-c8e4-4ada-a61d-a297f96db3db admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.061055 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef2b2-c8e4-4ada-a61d-a297f96db3db admin admin] PATH_INFO: `/v3/projects/3d70f908fc5a4a698296539d26f6f1da/users/5fbc589384e44be4b48d831b6db99eb2/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.085620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ef2b2-c8e4-4ada-a61d-a297f96db3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d70f908fc5a4a698296539d26f6f1da, user_id=5fbc589384e44be4b48d831b6db99eb2, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:20.093602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ef2b2-c8e4-4ada-a61d-a297f96db3db admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:20.117477 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4233/8538] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:20 2022] PUT /identity/v3/projects/3d70f908fc5a4a698296539d26f6f1da/users/5fbc589384e44be4b48d831b6db99eb2/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:20.128308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede94e18-d407-48d4-92a7-a9d5e01cf837 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.128598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede94e18-d407-48d4-92a7-a9d5e01cf837 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.128927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede94e18-d407-48d4-92a7-a9d5e01cf837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.167896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ede94e18-d407-48d4-92a7-a9d5e01cf837 None None] MFA Rules not processed for user `5fbc589384e44be4b48d831b6db99eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:20.169269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ede94e18-d407-48d4-92a7-a9d5e01cf837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:20.308162 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4306/8539] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:20.314013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ef2b2-c8e4-4ada-a61d-a297f96db3db admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:20.328328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:20.395249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ef2b2-c8e4-4ada-a61d-a297f96db3db admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:20.401339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7c7e9-a57b-48a4-b8bd-5d81cc7d12a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:20.402435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c7e9-a57b-48a4-b8bd-5d81cc7d12a0 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.402435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c7e9-a57b-48a4-b8bd-5d81cc7d12a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.403560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c7e9-a57b-48a4-b8bd-5d81cc7d12a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.403560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7c7e9-a57b-48a4-b8bd-5d81cc7d12a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:20.406183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7c7e9-a57b-48a4-b8bd-5d81cc7d12a0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:20.445434 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4234/8540] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:20 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:20.450701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede94e18-d407-48d4-92a7-a9d5e01cf837 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:20.462988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede94e18-d407-48d4-92a7-a9d5e01cf837 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:20.480209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:20.562801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc024b8-7a15-418d-871c-fb344f441007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:20.563467 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc024b8-7a15-418d-871c-fb344f441007 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.563911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc024b8-7a15-418d-871c-fb344f441007 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.564252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc024b8-7a15-418d-871c-fb344f441007 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.565054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc024b8-7a15-418d-871c-fb344f441007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:20.567375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc024b8-7a15-418d-871c-fb344f441007 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:20.591816 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4307/8541] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:20 2022] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:20.595807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7c7e9-a57b-48a4-b8bd-5d81cc7d12a0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:20.606595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7c7e9-a57b-48a4-b8bd-5d81cc7d12a0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:20.617740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc51ff7-a2d6-4558-a39e-1766f60b6726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:20.618487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc51ff7-a2d6-4558-a39e-1766f60b6726 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.618762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc51ff7-a2d6-4558-a39e-1766f60b6726 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.619076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc51ff7-a2d6-4558-a39e-1766f60b6726 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.619677 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc51ff7-a2d6-4558-a39e-1766f60b6726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:20.621272 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc51ff7-a2d6-4558-a39e-1766f60b6726 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:20.633413 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4235/8542] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:06:20.637837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc024b8-7a15-418d-871c-fb344f441007 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:20.648045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc024b8-7a15-418d-871c-fb344f441007 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:20.653176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c166d64-5973-4975-b186-1cd2fbceb0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:20.653860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c166d64-5973-4975-b186-1cd2fbceb0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.654141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c166d64-5973-4975-b186-1cd2fbceb0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.654630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c166d64-5973-4975-b186-1cd2fbceb0e3 admin admin] PATH_INFO: `/v3/projects/5ded60b7a04b42b1a450f14c707e9d59/users/c348c54d4a254ea98269c3f30d81142d/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.672393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c166d64-5973-4975-b186-1cd2fbceb0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ded60b7a04b42b1a450f14c707e9d59, user_id=c348c54d4a254ea98269c3f30d81142d, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:20.675381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c166d64-5973-4975-b186-1cd2fbceb0e3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:20.690593 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4308/8543] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:20 2022] PUT /identity/v3/projects/5ded60b7a04b42b1a450f14c707e9d59/users/c348c54d4a254ea98269c3f30d81142d/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:20.703349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546b934-5d48-41bd-bbf4-aeb323525a60 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:20.703802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546b934-5d48-41bd-bbf4-aeb323525a60 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:20.704196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546b934-5d48-41bd-bbf4-aeb323525a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:20.735267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-2546b934-5d48-41bd-bbf4-aeb323525a60 None None] MFA Rules not processed for user `c348c54d4a254ea98269c3f30d81142d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:20.736773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2546b934-5d48-41bd-bbf4-aeb323525a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:20.837755 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4236/8544] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:20 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:20.869503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c166d64-5973-4975-b186-1cd2fbceb0e3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:20.871478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4c166d64-5973-4975-b186-1cd2fbceb0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:21.014377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c166d64-5973-4975-b186-1cd2fbceb0e3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:21.020211 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75219574-c589-443b-8229-4bea44b88dab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:21.020815 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75219574-c589-443b-8229-4bea44b88dab service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.021254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75219574-c589-443b-8229-4bea44b88dab service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.021570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75219574-c589-443b-8229-4bea44b88dab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.030805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75219574-c589-443b-8229-4bea44b88dab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:21.032622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75219574-c589-443b-8229-4bea44b88dab service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:21.051814 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4309/8545] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:06:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:06:21.713065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546b934-5d48-41bd-bbf4-aeb323525a60 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:21.781702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546b934-5d48-41bd-bbf4-aeb323525a60 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:21.786726 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:21.787651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.788038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.788407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] PATH_INFO: `/v3/users/5fbc589384e44be4b48d831b6db99eb2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.789681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbc589384e44be4b48d831b6db99eb2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:21.791933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:21.811194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:21.844968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbc589384e44be4b48d831b6db99eb2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:21.845715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbc589384e44be4b48d831b6db99eb2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:21.859840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbc589384e44be4b48d831b6db99eb2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:21.868578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbc589384e44be4b48d831b6db99eb2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:21.878420 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbc589384e44be4b48d831b6db99eb2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:21.884965 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4237/8546] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:21 2022] DELETE /identity/v3/users/5fbc589384e44be4b48d831b6db99eb2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:21.889645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ec2c-1ffc-4b36-b8df-98caa82f7f2d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:21.890135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ec2c-1ffc-4b36-b8df-98caa82f7f2d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:21.890276 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ec2c-1ffc-4b36-b8df-98caa82f7f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:21.911500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-19d4ec2c-1ffc-4b36-b8df-98caa82f7f2d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:21.913032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-19d4ec2c-1ffc-4b36-b8df-98caa82f7f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.010329 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4310/8547] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:22.020610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:22.022152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.090630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa5def-f9ae-49f9-abd5-c1716140752e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:22.094984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa59366-fba6-468f-be4a-3583f77ea9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.095601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa59366-fba6-468f-be4a-3583f77ea9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.095887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa59366-fba6-468f-be4a-3583f77ea9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.096164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa59366-fba6-468f-be4a-3583f77ea9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.105906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa59366-fba6-468f-be4a-3583f77ea9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:22.107378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa59366-fba6-468f-be4a-3583f77ea9b7 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:22.122015 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4238/8548] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:22.588645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ec2c-1ffc-4b36-b8df-98caa82f7f2d None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:22.590113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-19d4ec2c-1ffc-4b36-b8df-98caa82f7f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:22.621075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ec2c-1ffc-4b36-b8df-98caa82f7f2d None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:22.645890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.646557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.646840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.647118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] PATH_INFO: `/v3/projects/3d70f908fc5a4a698296539d26f6f1da` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.649024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d70f908fc5a4a698296539d26f6f1da)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:22.663093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:22.686512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:22.782083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d70f908fc5a4a698296539d26f6f1da', 'request_id': 'req-519de5ee-76f4-4a97-88de-d39ee1ca0f02'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.795715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d70f908fc5a4a698296539d26f6f1da', 'request_id': 'req-519de5ee-76f4-4a97-88de-d39ee1ca0f02'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.815894 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d70f908fc5a4a698296539d26f6f1da', 'request_id': 'req-519de5ee-76f4-4a97-88de-d39ee1ca0f02'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.835225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] The token cache is being invalidate because project 3d70f908fc5a4a698296539d26f6f1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:22.836691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.837864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:22.841209 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4311/8549] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:22 2022] DELETE /identity/v3/projects/3d70f908fc5a4a698296539d26f6f1da => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:22.845358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa59366-fba6-468f-be4a-3583f77ea9b7 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:22.859939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa59366-fba6-468f-be4a-3583f77ea9b7 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:22.950838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d13b53-2a30-46aa-9248-3708b7c681b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:22.951557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13b53-2a30-46aa-9248-3708b7c681b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:22.951831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13b53-2a30-46aa-9248-3708b7c681b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:22.952108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13b53-2a30-46aa-9248-3708b7c681b5 admin admin] PATH_INFO: `/v3/users/c348c54d4a254ea98269c3f30d81142d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:22.954714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d13b53-2a30-46aa-9248-3708b7c681b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c348c54d4a254ea98269c3f30d81142d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:22.957956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d13b53-2a30-46aa-9248-3708b7c681b5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:23.017516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:23.029041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-40d13b53-2a30-46aa-9248-3708b7c681b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c348c54d4a254ea98269c3f30d81142d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.030147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-40d13b53-2a30-46aa-9248-3708b7c681b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c348c54d4a254ea98269c3f30d81142d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.051566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-40d13b53-2a30-46aa-9248-3708b7c681b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c348c54d4a254ea98269c3f30d81142d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.063360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-40d13b53-2a30-46aa-9248-3708b7c681b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c348c54d4a254ea98269c3f30d81142d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.072996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-40d13b53-2a30-46aa-9248-3708b7c681b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c348c54d4a254ea98269c3f30d81142d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.083711 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4239/8550] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:06:22 2022] DELETE /identity/v3/users/c348c54d4a254ea98269c3f30d81142d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:23.477648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.479673 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:23.518381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de5ee-76f4-4a97-88de-d39ee1ca0f02 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:23.603857 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:23.604620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.605006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.605572 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] PATH_INFO: `/v3/projects/5ded60b7a04b42b1a450f14c707e9d59` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.610576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ded60b7a04b42b1a450f14c707e9d59)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:23.612687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:23.678183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ded60b7a04b42b1a450f14c707e9d59', 'request_id': 'req-815481c4-eb5c-4028-9a4d-8938ec190468'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.685507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ded60b7a04b42b1a450f14c707e9d59', 'request_id': 'req-815481c4-eb5c-4028-9a4d-8938ec190468'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.695706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ded60b7a04b42b1a450f14c707e9d59', 'request_id': 'req-815481c4-eb5c-4028-9a4d-8938ec190468'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.708783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] The token cache is being invalidate because project 5ded60b7a04b42b1a450f14c707e9d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:06:23.709279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.710066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-815481c4-eb5c-4028-9a4d-8938ec190468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:06:23.711809 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4312/8551] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:06:23 2022] DELETE /identity/v3/projects/5ded60b7a04b42b1a450f14c707e9d59 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:23.716539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4de6c-f19f-4f8c-a1d3-61531a2787b0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.717531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4de6c-f19f-4f8c-a1d3-61531a2787b0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.717753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4de6c-f19f-4f8c-a1d3-61531a2787b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.740048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-49c4de6c-f19f-4f8c-a1d3-61531a2787b0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:23.741463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-49c4de6c-f19f-4f8c-a1d3-61531a2787b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:23.807616 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4240/8552] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:23.815448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87737d-b3fa-40c5-9c75-82f29936ffcc None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.815726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87737d-b3fa-40c5-9c75-82f29936ffcc None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.816006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87737d-b3fa-40c5-9c75-82f29936ffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.836578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0e87737d-b3fa-40c5-9c75-82f29936ffcc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:23.837817 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0e87737d-b3fa-40c5-9c75-82f29936ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:23.846429 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4313/8553] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:23.850850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4de6c-f19f-4f8c-a1d3-61531a2787b0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.861687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4de6c-f19f-4f8c-a1d3-61531a2787b0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:23.866735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15963c-12d4-4f9b-9f69-e2fb3d8d9f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:23.867361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15963c-12d4-4f9b-9f69-e2fb3d8d9f85 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.867646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15963c-12d4-4f9b-9f69-e2fb3d8d9f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.867914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15963c-12d4-4f9b-9f69-e2fb3d8d9f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.868573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15963c-12d4-4f9b-9f69-e2fb3d8d9f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:06:23.868875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15963c-12d4-4f9b-9f69-e2fb3d8d9f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:23.870612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15963c-12d4-4f9b-9f69-e2fb3d8d9f85 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:23.887570 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4241/8554] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:06:23.889295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87737d-b3fa-40c5-9c75-82f29936ffcc None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.899936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87737d-b3fa-40c5-9c75-82f29936ffcc None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:23.905862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a3a23-bf50-4f75-9145-95cb8ebdfc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:23.906567 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a3a23-bf50-4f75-9145-95cb8ebdfc0b admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:23.906914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a3a23-bf50-4f75-9145-95cb8ebdfc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:23.907253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a3a23-bf50-4f75-9145-95cb8ebdfc0b admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:23.907960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a3a23-bf50-4f75-9145-95cb8ebdfc0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:23.910062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a3a23-bf50-4f75-9145-95cb8ebdfc0b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:23.938118 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:23.946392 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4314/8555] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:23 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:23.950745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15963c-12d4-4f9b-9f69-e2fb3d8d9f85 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:23.961750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15963c-12d4-4f9b-9f69-e2fb3d8d9f85 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.024913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ee75c-1b2c-4f77-b70e-e361a23286fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.025661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee75c-1b2c-4f77-b70e-e361a23286fa admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.025945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee75c-1b2c-4f77-b70e-e361a23286fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.026218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee75c-1b2c-4f77-b70e-e361a23286fa admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.026915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ee75c-1b2c-4f77-b70e-e361a23286fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.028869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ee75c-1b2c-4f77-b70e-e361a23286fa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.056685 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4242/8556] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:23 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:24.057574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a3a23-bf50-4f75-9145-95cb8ebdfc0b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:24.075454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a3a23-bf50-4f75-9145-95cb8ebdfc0b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.080999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca67a37-e631-4ecc-b320-1df065cbde0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.081701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca67a37-e631-4ecc-b320-1df065cbde0e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.081986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca67a37-e631-4ecc-b320-1df065cbde0e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.082270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca67a37-e631-4ecc-b320-1df065cbde0e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.082918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca67a37-e631-4ecc-b320-1df065cbde0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.084690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca67a37-e631-4ecc-b320-1df065cbde0e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.095286 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4315/8557] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:06:24.099307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ee75c-1b2c-4f77-b70e-e361a23286fa admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:24.110233 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ee75c-1b2c-4f77-b70e-e361a23286fa admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.114830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab9f6e-70eb-41af-92ba-93f1ccb79d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.115425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9f6e-70eb-41af-92ba-93f1ccb79d92 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.115703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9f6e-70eb-41af-92ba-93f1ccb79d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.115975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9f6e-70eb-41af-92ba-93f1ccb79d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.116618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab9f6e-70eb-41af-92ba-93f1ccb79d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.118591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab9f6e-70eb-41af-92ba-93f1ccb79d92 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.133430 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4243/8558] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:24.134606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca67a37-e631-4ecc-b320-1df065cbde0e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:24.145718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca67a37-e631-4ecc-b320-1df065cbde0e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.150725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ff7a8-c26d-436b-aba4-6e76eed51cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.151515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ff7a8-c26d-436b-aba4-6e76eed51cda admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.151885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ff7a8-c26d-436b-aba4-6e76eed51cda admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.152225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ff7a8-c26d-436b-aba4-6e76eed51cda admin admin] PATH_INFO: `/v3/projects/c88deb8d5f864d368528400104c35e1a/users/627ff3308c2c43f28573edf551f779aa/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.167414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ff7a8-c26d-436b-aba4-6e76eed51cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88deb8d5f864d368528400104c35e1a, user_id=627ff3308c2c43f28573edf551f779aa, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.170124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ff7a8-c26d-436b-aba4-6e76eed51cda admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.183454 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4316/8559] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:24 2022] PUT /identity/v3/projects/c88deb8d5f864d368528400104c35e1a/users/627ff3308c2c43f28573edf551f779aa/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:06:24.189482 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfaac2-3672-4272-97bb-f3313b79eb38 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.189792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfaac2-3672-4272-97bb-f3313b79eb38 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.190065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfaac2-3672-4272-97bb-f3313b79eb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.211187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-73cfaac2-3672-4272-97bb-f3313b79eb38 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:24.212392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-73cfaac2-3672-4272-97bb-f3313b79eb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:24.230104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:24.276475 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4244/8560] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:24.286927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ff7a8-c26d-436b-aba4-6e76eed51cda admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:24.288717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-376ff7a8-c26d-436b-aba4-6e76eed51cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:24.350920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ff7a8-c26d-436b-aba4-6e76eed51cda admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:24.354537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847447a-6fb4-44cb-b9f7-3cc380a1a4bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:24.355145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847447a-6fb4-44cb-b9f7-3cc380a1a4bb service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:24.355424 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847447a-6fb4-44cb-b9f7-3cc380a1a4bb service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:24.355697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847447a-6fb4-44cb-b9f7-3cc380a1a4bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:24.364939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847447a-6fb4-44cb-b9f7-3cc380a1a4bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:24.366471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847447a-6fb4-44cb-b9f7-3cc380a1a4bb service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:24.376667 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4317/8561] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:27.873758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfaac2-3672-4272-97bb-f3313b79eb38 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:27.875211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-73cfaac2-3672-4272-97bb-f3313b79eb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:27.896521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfaac2-3672-4272-97bb-f3313b79eb38 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:27.901143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d7715-b37b-4695-ac6b-3fc3f289e1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:27.901994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d7715-b37b-4695-ac6b-3fc3f289e1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:27.902380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d7715-b37b-4695-ac6b-3fc3f289e1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:27.902759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d7715-b37b-4695-ac6b-3fc3f289e1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:27.905598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-582d7715-b37b-4695-ac6b-3fc3f289e1c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:27.987860 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d7715-b37b-4695-ac6b-3fc3f289e1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:27.989685 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d7715-b37b-4695-ac6b-3fc3f289e1c2 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:28.002716 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4245/8562] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:32.304123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea965e4d-21f7-4bad-8de1-895abcf2d081 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:32.304675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea965e4d-21f7-4bad-8de1-895abcf2d081 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:32.304675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea965e4d-21f7-4bad-8de1-895abcf2d081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:32.354886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ea965e4d-21f7-4bad-8de1-895abcf2d081 None None] MFA Rules not processed for user `627ff3308c2c43f28573edf551f779aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:32.357016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ea965e4d-21f7-4bad-8de1-895abcf2d081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:32.496760 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4318/8563] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:32.501363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d7715-b37b-4695-ac6b-3fc3f289e1c2 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:32.517037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d7715-b37b-4695-ac6b-3fc3f289e1c2 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:32.528621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a13c5-d095-4093-98f5-d9b4b1d48934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:32.531597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a13c5-d095-4093-98f5-d9b4b1d48934 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:32.531918 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a13c5-d095-4093-98f5-d9b4b1d48934 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:32.532204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a13c5-d095-4093-98f5-d9b4b1d48934 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:32.533259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a13c5-d095-4093-98f5-d9b4b1d48934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:32.539715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a13c5-d095-4093-98f5-d9b4b1d48934 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:32.589822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea965e4d-21f7-4bad-8de1-895abcf2d081 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:32.590190 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4246/8564] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:06:32 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:32.605436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea965e4d-21f7-4bad-8de1-895abcf2d081 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:32.675859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:32.686750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ada127-afbb-4ed2-b913-0dfd33d6a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:32.687808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ada127-afbb-4ed2-b913-0dfd33d6a923 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:32.688155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ada127-afbb-4ed2-b913-0dfd33d6a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:32.688711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ada127-afbb-4ed2-b913-0dfd33d6a923 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:32.689688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ada127-afbb-4ed2-b913-0dfd33d6a923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:32.691635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ada127-afbb-4ed2-b913-0dfd33d6a923 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:32.720810 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4319/8565] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:06:32 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:06:32.725558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a13c5-d095-4093-98f5-d9b4b1d48934 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:32.740179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a13c5-d095-4093-98f5-d9b4b1d48934 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:32.757791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141f135-3df1-4429-a5cb-3683f716ccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:32.758434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141f135-3df1-4429-a5cb-3683f716ccc6 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:32.758869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141f135-3df1-4429-a5cb-3683f716ccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:32.759349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141f135-3df1-4429-a5cb-3683f716ccc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:32.760181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141f135-3df1-4429-a5cb-3683f716ccc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:32.762007 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141f135-3df1-4429-a5cb-3683f716ccc6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:32.803322 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4247/8566] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:32.810055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ada127-afbb-4ed2-b913-0dfd33d6a923 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:32.830583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ada127-afbb-4ed2-b913-0dfd33d6a923 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:32.852953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5d5b0-3b31-40d1-8045-774e8e7ade86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:32.853664 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5d5b0-3b31-40d1-8045-774e8e7ade86 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:32.853944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5d5b0-3b31-40d1-8045-774e8e7ade86 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:32.854221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5d5b0-3b31-40d1-8045-774e8e7ade86 admin admin] PATH_INFO: `/v3/projects/af438921227c4a3bacadd3b785531ad0/users/8975805f925f4c7dae6deb4fbce87e2f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:32.887138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5d5b0-3b31-40d1-8045-774e8e7ade86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af438921227c4a3bacadd3b785531ad0, user_id=8975805f925f4c7dae6deb4fbce87e2f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:32.889026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5d5b0-3b31-40d1-8045-774e8e7ade86 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:32.914898 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4320/8567] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:32 2022] PUT /identity/v3/projects/af438921227c4a3bacadd3b785531ad0/users/8975805f925f4c7dae6deb4fbce87e2f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:32.919155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141f135-3df1-4429-a5cb-3683f716ccc6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:32.934508 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141f135-3df1-4429-a5cb-3683f716ccc6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:33.066876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0bbe8-1b41-4d64-a480-2514fb742cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:33.070339 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bbe8-1b41-4d64-a480-2514fb742cfe admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:33.071989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bbe8-1b41-4d64-a480-2514fb742cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:33.072369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bbe8-1b41-4d64-a480-2514fb742cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:33.073137 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0bbe8-1b41-4d64-a480-2514fb742cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:33.076925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0bbe8-1b41-4d64-a480-2514fb742cfe admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:33.113827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5d5b0-3b31-40d1-8045-774e8e7ade86 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:33.114178 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4248/8568] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:06:33.139968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5d5b0-3b31-40d1-8045-774e8e7ade86 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:33.156431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6f774-d80a-42ac-afcb-ae61a3d69d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:33.157308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6f774-d80a-42ac-afcb-ae61a3d69d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:33.157620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6f774-d80a-42ac-afcb-ae61a3d69d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:33.157907 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6f774-d80a-42ac-afcb-ae61a3d69d6c admin admin] PATH_INFO: `/v3/projects/af438921227c4a3bacadd3b785531ad0/users/8975805f925f4c7dae6deb4fbce87e2f/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:33.166959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6f774-d80a-42ac-afcb-ae61a3d69d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af438921227c4a3bacadd3b785531ad0, user_id=8975805f925f4c7dae6deb4fbce87e2f, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:33.169841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6f774-d80a-42ac-afcb-ae61a3d69d6c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:33.196168 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4321/8569] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:06:33 2022] PUT /identity/v3/projects/af438921227c4a3bacadd3b785531ad0/users/8975805f925f4c7dae6deb4fbce87e2f/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:06:34.050744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0bbe8-1b41-4d64-a480-2514fb742cfe admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:34.053559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-05e0bbe8-1b41-4d64-a480-2514fb742cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:34.091868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:34.167729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0bbe8-1b41-4d64-a480-2514fb742cfe admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:34.272178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1813b3-7b47-4688-b1c8-9cf04d218897 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:34.273175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1813b3-7b47-4688-b1c8-9cf04d218897 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:34.273746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1813b3-7b47-4688-b1c8-9cf04d218897 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:34.274024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1813b3-7b47-4688-b1c8-9cf04d218897 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:34.277183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8b1813b3-7b47-4688-b1c8-9cf04d218897 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:34.407209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1813b3-7b47-4688-b1c8-9cf04d218897 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:34.408909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1813b3-7b47-4688-b1c8-9cf04d218897 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:34.422808 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4249/8570] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:06:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:06:39.297571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb66e4-cb7e-484d-b7b9-55d11eca51c1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:39.298030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb66e4-cb7e-484d-b7b9-55d11eca51c1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:39.298147 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb66e4-cb7e-484d-b7b9-55d11eca51c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:39.336158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-02cb66e4-cb7e-484d-b7b9-55d11eca51c1 None None] MFA Rules not processed for user `f3e97edd3e10433ca84d2a6206c1c521`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:39.337573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-02cb66e4-cb7e-484d-b7b9-55d11eca51c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:39.473084 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4322/8571] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:40.113614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a747c0-6598-4d51-91c8-2675b6a0bd2f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.114165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a747c0-6598-4d51-91c8-2675b6a0bd2f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.114363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a747c0-6598-4d51-91c8-2675b6a0bd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.159864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-26a747c0-6598-4d51-91c8-2675b6a0bd2f None None] MFA Rules not processed for user `8975805f925f4c7dae6deb4fbce87e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:40.161971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-26a747c0-6598-4d51-91c8-2675b6a0bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:40.220770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:40.244086 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4250/8572] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:40.258635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb66e4-cb7e-484d-b7b9-55d11eca51c1 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:40.259873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-02cb66e4-cb7e-484d-b7b9-55d11eca51c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:40.350713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb66e4-cb7e-484d-b7b9-55d11eca51c1 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:40.363672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50c319-43d3-45be-b9a3-3d6be940d6d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:40.365109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50c319-43d3-45be-b9a3-3d6be940d6d1 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:40.365483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50c319-43d3-45be-b9a3-3d6be940d6d1 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:40.365777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50c319-43d3-45be-b9a3-3d6be940d6d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:40.445541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:40.461512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50c319-43d3-45be-b9a3-3d6be940d6d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:40.464001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50c319-43d3-45be-b9a3-3d6be940d6d1 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:40.477481 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4323/8573] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:41.816674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f110ebc-82f6-4fdd-907f-01e54924a7d7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:41.817596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f110ebc-82f6-4fdd-907f-01e54924a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:41.818032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f110ebc-82f6-4fdd-907f-01e54924a7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:41.867005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9f110ebc-82f6-4fdd-907f-01e54924a7d7 None None] MFA Rules not processed for user `627ff3308c2c43f28573edf551f779aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:06:41.868338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9f110ebc-82f6-4fdd-907f-01e54924a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:41.882177 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4251/8574] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:06:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:06:42.925002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50c319-43d3-45be-b9a3-3d6be940d6d1 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:43.035395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50c319-43d3-45be-b9a3-3d6be940d6d1 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:43.041665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e390e-010e-45ec-a9c0-2bb1232f2391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:43.042438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e390e-010e-45ec-a9c0-2bb1232f2391 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:43.042790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e390e-010e-45ec-a9c0-2bb1232f2391 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:43.043221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e390e-010e-45ec-a9c0-2bb1232f2391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:43.045953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8c5e390e-010e-45ec-a9c0-2bb1232f2391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:06:43.062419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e390e-010e-45ec-a9c0-2bb1232f2391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:43.064224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e390e-010e-45ec-a9c0-2bb1232f2391 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:43.078883 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4324/8575] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:06:51.848179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=8 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:53.069685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=31 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:55.364371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f110ebc-82f6-4fdd-907f-01e54924a7d7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:06:55.379557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f110ebc-82f6-4fdd-907f-01e54924a7d7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:06:55.384315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a429e7-a74e-4017-a4d3-d52900760ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:06:55.385188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a429e7-a74e-4017-a4d3-d52900760ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:06:55.385728 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a429e7-a74e-4017-a4d3-d52900760ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:06:55.386180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a429e7-a74e-4017-a4d3-d52900760ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:06:55.402555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a429e7-a74e-4017-a4d3-d52900760ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:06:55.405072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a429e7-a74e-4017-a4d3-d52900760ab6 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:06:55.431040 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4252/8576] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:06:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:04.530406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d81044-d0da-4c47-914d-b388a0930217 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:04.531555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d81044-d0da-4c47-914d-b388a0930217 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:04.532043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d81044-d0da-4c47-914d-b388a0930217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:04.566763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-75d81044-d0da-4c47-914d-b388a0930217 None None] MFA Rules not processed for user `64dd24ea45ac485d8d411837d7078301`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:07:04.568893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75d81044-d0da-4c47-914d-b388a0930217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:04.659308 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4325/8577] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:07:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:07:05.412777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:13.303583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a429e7-a74e-4017-a4d3-d52900760ab6 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:13.305300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-19a429e7-a74e-4017-a4d3-d52900760ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:13.328131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a429e7-a74e-4017-a4d3-d52900760ab6 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:13.333846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de64530-e7bc-48cc-a59e-cb82c2c26dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:13.334473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64530-e7bc-48cc-a59e-cb82c2c26dec service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:13.334762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64530-e7bc-48cc-a59e-cb82c2c26dec service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:13.335034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64530-e7bc-48cc-a59e-cb82c2c26dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:13.336857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9de64530-e7bc-48cc-a59e-cb82c2c26dec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:13.348238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de64530-e7bc-48cc-a59e-cb82c2c26dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:13.349872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de64530-e7bc-48cc-a59e-cb82c2c26dec service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:13.362049 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4253/8578] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:14.648069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=25 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:23.355744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:33.354726 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d81044-d0da-4c47-914d-b388a0930217 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:33.367807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d81044-d0da-4c47-914d-b388a0930217 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:33.371599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb911ebf-ff8d-4ed4-8b76-9740bc4a10fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:33.372551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911ebf-ff8d-4ed4-8b76-9740bc4a10fd service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:33.372990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911ebf-ff8d-4ed4-8b76-9740bc4a10fd service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:33.373488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911ebf-ff8d-4ed4-8b76-9740bc4a10fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:33.375338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fb911ebf-ff8d-4ed4-8b76-9740bc4a10fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:33.388670 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb911ebf-ff8d-4ed4-8b76-9740bc4a10fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:33.390502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb911ebf-ff8d-4ed4-8b76-9740bc4a10fd service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:33.402092 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4326/8579] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:07:43.397353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:56.021727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de64530-e7bc-48cc-a59e-cb82c2c26dec service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:07:56.041906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de64530-e7bc-48cc-a59e-cb82c2c26dec service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:07:56.049894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c1033-32a8-4319-be5f-7575d11ecbe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:07:56.050744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c1033-32a8-4319-be5f-7575d11ecbe7 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:07:56.051209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c1033-32a8-4319-be5f-7575d11ecbe7 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:07:56.051648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c1033-32a8-4319-be5f-7575d11ecbe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:07:56.053715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9f9c1033-32a8-4319-be5f-7575d11ecbe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:07:56.128005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c1033-32a8-4319-be5f-7575d11ecbe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:07:56.129951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c1033-32a8-4319-be5f-7575d11ecbe7 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:07:56.154172 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4254/8580] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:07:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:06.136229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=30 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:15.650265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb911ebf-ff8d-4ed4-8b76-9740bc4a10fd service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:15.656352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fb911ebf-ff8d-4ed4-8b76-9740bc4a10fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:15.789329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb911ebf-ff8d-4ed4-8b76-9740bc4a10fd service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:15.803966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69ef1-3c08-471f-a69f-a100305676fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:15.804653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69ef1-3c08-471f-a69f-a100305676fd service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:15.804981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69ef1-3c08-471f-a69f-a100305676fd service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:15.805267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69ef1-3c08-471f-a69f-a100305676fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:15.807639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-89c69ef1-3c08-471f-a69f-a100305676fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:15.827003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69ef1-3c08-471f-a69f-a100305676fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:15.828691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69ef1-3c08-471f-a69f-a100305676fd service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:15.853857 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4327/8581] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:17.571059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c1033-32a8-4319-be5f-7575d11ecbe7 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:17.574410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9f9c1033-32a8-4319-be5f-7575d11ecbe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:17.649893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c1033-32a8-4319-be5f-7575d11ecbe7 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:17.667846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca49f9-2ec9-4d70-8265-3b718935689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:17.670867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca49f9-2ec9-4d70-8265-3b718935689c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:17.670867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca49f9-2ec9-4d70-8265-3b718935689c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:17.670867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca49f9-2ec9-4d70-8265-3b718935689c admin admin] PATH_INFO: `/v3/users/f3e97edd3e10433ca84d2a6206c1c521` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:17.672009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca49f9-2ec9-4d70-8265-3b718935689c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e97edd3e10433ca84d2a6206c1c521)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:17.675131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca49f9-2ec9-4d70-8265-3b718935689c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:17.751048 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-33ca49f9-2ec9-4d70-8265-3b718935689c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e97edd3e10433ca84d2a6206c1c521'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:17.751729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-33ca49f9-2ec9-4d70-8265-3b718935689c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e97edd3e10433ca84d2a6206c1c521'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:17.768607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-33ca49f9-2ec9-4d70-8265-3b718935689c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e97edd3e10433ca84d2a6206c1c521'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:17.780451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-33ca49f9-2ec9-4d70-8265-3b718935689c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e97edd3e10433ca84d2a6206c1c521'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:17.791478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-33ca49f9-2ec9-4d70-8265-3b718935689c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e97edd3e10433ca84d2a6206c1c521'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:17.803420 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4255/8582] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:17 2022] DELETE /identity/v3/users/f3e97edd3e10433ca84d2a6206c1c521 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:18.150029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69ef1-3c08-471f-a69f-a100305676fd service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:18.194636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69ef1-3c08-471f-a69f-a100305676fd service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:18.312693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:18.313502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.313893 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.314304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] PATH_INFO: `/v3/projects/8df11b687fb547f1b9fbfa1850faae8d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.315634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df11b687fb547f1b9fbfa1850faae8d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:18.317911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:18.378762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df11b687fb547f1b9fbfa1850faae8d', 'request_id': 'req-0aa55f5d-086f-4df1-b928-5dc984e8e086'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:18.386533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df11b687fb547f1b9fbfa1850faae8d', 'request_id': 'req-0aa55f5d-086f-4df1-b928-5dc984e8e086'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:18.396945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df11b687fb547f1b9fbfa1850faae8d', 'request_id': 'req-0aa55f5d-086f-4df1-b928-5dc984e8e086'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:18.417635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] The token cache is being invalidate because project 8df11b687fb547f1b9fbfa1850faae8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:18.418454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:18.420770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0aa55f5d-086f-4df1-b928-5dc984e8e086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:18.428749 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4328/8583] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:18 2022] DELETE /identity/v3/projects/8df11b687fb547f1b9fbfa1850faae8d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:18.430009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d46ae-3b99-472f-ad10-80c9a4450351 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.430492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d46ae-3b99-472f-ad10-80c9a4450351 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.430944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d46ae-3b99-472f-ad10-80c9a4450351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.466855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-3d3d46ae-3b99-472f-ad10-80c9a4450351 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:18.468403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3d3d46ae-3b99-472f-ad10-80c9a4450351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:18.560989 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4256/8584] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:18.568694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1ded-c627-4cf8-96ee-1d12ce9d8f4e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.568986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1ded-c627-4cf8-96ee-1d12ce9d8f4e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.569270 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1ded-c627-4cf8-96ee-1d12ce9d8f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.590173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8f5c1ded-c627-4cf8-96ee-1d12ce9d8f4e None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:18.591744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8f5c1ded-c627-4cf8-96ee-1d12ce9d8f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:18.603720 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4329/8585] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:18.604912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d46ae-3b99-472f-ad10-80c9a4450351 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:18.615830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d46ae-3b99-472f-ad10-80c9a4450351 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:18.620749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bc074-b014-417f-be69-91494b95e10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:18.622111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bc074-b014-417f-be69-91494b95e10b admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.622455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bc074-b014-417f-be69-91494b95e10b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.622815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bc074-b014-417f-be69-91494b95e10b admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.623675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bc074-b014-417f-be69-91494b95e10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:08:18.624040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bc074-b014-417f-be69-91494b95e10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:18.625786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bc074-b014-417f-be69-91494b95e10b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:18.640415 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4257/8586] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:08:18.645016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c1ded-c627-4cf8-96ee-1d12ce9d8f4e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:18.655074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c1ded-c627-4cf8-96ee-1d12ce9d8f4e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:18.660059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c98ba9-c20b-4a52-bb40-351456476d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:18.660760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98ba9-c20b-4a52-bb40-351456476d48 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.661138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98ba9-c20b-4a52-bb40-351456476d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.661510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98ba9-c20b-4a52-bb40-351456476d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.662275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c98ba9-c20b-4a52-bb40-351456476d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:18.664328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c98ba9-c20b-4a52-bb40-351456476d48 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:18.677581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:18.701332 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4330/8587] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:18 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:08:18.705664 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bc074-b014-417f-be69-91494b95e10b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:18.717521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bc074-b014-417f-be69-91494b95e10b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:18.722704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:18.784774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26bcf5-7f7c-4a8e-b931-852f596e325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:18.785597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26bcf5-7f7c-4a8e-b931-852f596e325f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.785917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26bcf5-7f7c-4a8e-b931-852f596e325f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.786254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26bcf5-7f7c-4a8e-b931-852f596e325f admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.786992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26bcf5-7f7c-4a8e-b931-852f596e325f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:18.788993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26bcf5-7f7c-4a8e-b931-852f596e325f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:18.820223 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4258/8588] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:18 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:18.821544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c98ba9-c20b-4a52-bb40-351456476d48 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:18.832737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c98ba9-c20b-4a52-bb40-351456476d48 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:18.837570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa13e67-b49f-44a5-8d4f-2623c430f0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:18.838282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13e67-b49f-44a5-8d4f-2623c430f0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.838627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13e67-b49f-44a5-8d4f-2623c430f0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.838959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13e67-b49f-44a5-8d4f-2623c430f0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.839672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa13e67-b49f-44a5-8d4f-2623c430f0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:18.841375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa13e67-b49f-44a5-8d4f-2623c430f0b7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:18.852447 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4331/8589] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:18.857418 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26bcf5-7f7c-4a8e-b931-852f596e325f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:18.869504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26bcf5-7f7c-4a8e-b931-852f596e325f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:18.875551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec310f-7193-4f0f-ad72-6c9d986a2f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:18.876297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec310f-7193-4f0f-ad72-6c9d986a2f7d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.876582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec310f-7193-4f0f-ad72-6c9d986a2f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.876861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec310f-7193-4f0f-ad72-6c9d986a2f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.877538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec310f-7193-4f0f-ad72-6c9d986a2f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:18.879160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec310f-7193-4f0f-ad72-6c9d986a2f7d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:18.895149 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4259/8590] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:18.896730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa13e67-b49f-44a5-8d4f-2623c430f0b7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:18.908366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa13e67-b49f-44a5-8d4f-2623c430f0b7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:18.914113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b9369-01c7-4ee1-9819-49dce82d4ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:18.914909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9369-01c7-4ee1-9819-49dce82d4ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.915260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9369-01c7-4ee1-9819-49dce82d4ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.915643 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9369-01c7-4ee1-9819-49dce82d4ff3 admin admin] PATH_INFO: `/v3/projects/a8df5e725d7b4f1a810b38b4d39771fc/users/523785aec7914f848ceca7d9a6387946/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.936367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b9369-01c7-4ee1-9819-49dce82d4ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8df5e725d7b4f1a810b38b4d39771fc, user_id=523785aec7914f848ceca7d9a6387946, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:18.939558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b9369-01c7-4ee1-9819-49dce82d4ff3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:18.954047 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4332/8591] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:18 2022] PUT /identity/v3/projects/a8df5e725d7b4f1a810b38b4d39771fc/users/523785aec7914f848ceca7d9a6387946/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:08:18.959129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72770eb8-c96e-4bef-898b-a8b1e42a5dd5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:18.959705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72770eb8-c96e-4bef-898b-a8b1e42a5dd5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:18.960283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72770eb8-c96e-4bef-898b-a8b1e42a5dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:18.982398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-72770eb8-c96e-4bef-898b-a8b1e42a5dd5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:18.984197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72770eb8-c96e-4bef-898b-a8b1e42a5dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:19.057562 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4260/8592] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:19.068515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b9369-01c7-4ee1-9819-49dce82d4ff3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:19.070452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d71b9369-01c7-4ee1-9819-49dce82d4ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:19.140630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b9369-01c7-4ee1-9819-49dce82d4ff3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:19.144586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed727486-5916-41e0-9856-b59aaa7a9372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:19.145296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727486-5916-41e0-9856-b59aaa7a9372 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:19.145604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727486-5916-41e0-9856-b59aaa7a9372 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:19.145878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727486-5916-41e0-9856-b59aaa7a9372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:19.163051 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed727486-5916-41e0-9856-b59aaa7a9372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:19.164043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed727486-5916-41e0-9856-b59aaa7a9372 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:19.176113 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4333/8593] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:25.685560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205e63-9fcd-4ccd-8273-2c64b0e901f4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:25.686995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205e63-9fcd-4ccd-8273-2c64b0e901f4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:25.687711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205e63-9fcd-4ccd-8273-2c64b0e901f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:25.725958 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-17205e63-9fcd-4ccd-8273-2c64b0e901f4 None None] MFA Rules not processed for user `64dd24ea45ac485d8d411837d7078301`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:25.727624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-17205e63-9fcd-4ccd-8273-2c64b0e901f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:25.804898 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4261/8594] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:08:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:27.060172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed727486-5916-41e0-9856-b59aaa7a9372 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:27.061705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ed727486-5916-41e0-9856-b59aaa7a9372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:27.230564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed727486-5916-41e0-9856-b59aaa7a9372 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:27.249233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da610b3-c70f-475d-bd32-e683b7e50272 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:27.249791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da610b3-c70f-475d-bd32-e683b7e50272 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:27.250075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da610b3-c70f-475d-bd32-e683b7e50272 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:27.250351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da610b3-c70f-475d-bd32-e683b7e50272 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:27.254488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8da610b3-c70f-475d-bd32-e683b7e50272 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:27.288666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da610b3-c70f-475d-bd32-e683b7e50272 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:27.288666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da610b3-c70f-475d-bd32-e683b7e50272 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:27.292013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eac68-bd9d-4580-85a2-f22470706a63 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:27.292776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eac68-bd9d-4580-85a2-f22470706a63 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:27.293062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eac68-bd9d-4580-85a2-f22470706a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:27.301014 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4334/8595] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:27.364745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-835eac68-bd9d-4580-85a2-f22470706a63 None None] MFA Rules not processed for user `523785aec7914f848ceca7d9a6387946`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:27.366271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-835eac68-bd9d-4580-85a2-f22470706a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:27.410754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:27.533136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da610b3-c70f-475d-bd32-e683b7e50272 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:27.534249 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4262/8596] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:08:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:08:27.555578 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da610b3-c70f-475d-bd32-e683b7e50272 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:27.571850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bda69-68d5-4cf1-8de9-aa6213239106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:27.572999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bda69-68d5-4cf1-8de9-aa6213239106 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:27.572999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bda69-68d5-4cf1-8de9-aa6213239106 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:27.572999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bda69-68d5-4cf1-8de9-aa6213239106 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:27.573564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bda69-68d5-4cf1-8de9-aa6213239106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:27.577426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bda69-68d5-4cf1-8de9-aa6213239106 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:27.636731 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4335/8597] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:27 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:08:27.641010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eac68-bd9d-4580-85a2-f22470706a63 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:27.656665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eac68-bd9d-4580-85a2-f22470706a63 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:27.782993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a727511-72f2-49f6-ac48-0baaa97a1908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:27.782993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a727511-72f2-49f6-ac48-0baaa97a1908 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:27.782993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a727511-72f2-49f6-ac48-0baaa97a1908 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:27.782993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a727511-72f2-49f6-ac48-0baaa97a1908 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:27.783406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a727511-72f2-49f6-ac48-0baaa97a1908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:27.785217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a727511-72f2-49f6-ac48-0baaa97a1908 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:27.812573 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4263/8598] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:27 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:27.816633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bda69-68d5-4cf1-8de9-aa6213239106 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:27.856052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bda69-68d5-4cf1-8de9-aa6213239106 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:27.870074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a665e5-54a0-4536-bf21-648e39b7fbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:27.872613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a665e5-54a0-4536-bf21-648e39b7fbbe admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:27.873090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a665e5-54a0-4536-bf21-648e39b7fbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:27.873828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a665e5-54a0-4536-bf21-648e39b7fbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:27.874902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a665e5-54a0-4536-bf21-648e39b7fbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:27.876761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a665e5-54a0-4536-bf21-648e39b7fbbe admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:27.947049 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4336/8599] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:27.951303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a727511-72f2-49f6-ac48-0baaa97a1908 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:27.967321 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a727511-72f2-49f6-ac48-0baaa97a1908 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:27.983756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721955d-625a-4050-b578-962dcef31200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:27.985487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721955d-625a-4050-b578-962dcef31200 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:27.985487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721955d-625a-4050-b578-962dcef31200 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:27.985487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721955d-625a-4050-b578-962dcef31200 admin admin] PATH_INFO: `/v3/projects/641131fda7e5498090910c607138c3a3/users/5e9c554aa23d42b89dd2a25d2b705c0c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:28.027243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721955d-625a-4050-b578-962dcef31200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641131fda7e5498090910c607138c3a3, user_id=5e9c554aa23d42b89dd2a25d2b705c0c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:28.031298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721955d-625a-4050-b578-962dcef31200 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:28.051763 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4264/8600] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:27 2022] PUT /identity/v3/projects/641131fda7e5498090910c607138c3a3/users/5e9c554aa23d42b89dd2a25d2b705c0c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:28.055498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a665e5-54a0-4536-bf21-648e39b7fbbe admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:28.067607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a665e5-54a0-4536-bf21-648e39b7fbbe admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:28.114216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:28.208956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ca341-498a-4a6a-b7f6-23a770e6b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:28.210349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ca341-498a-4a6a-b7f6-23a770e6b67f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:28.211218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ca341-498a-4a6a-b7f6-23a770e6b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:28.211623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ca341-498a-4a6a-b7f6-23a770e6b67f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:28.212568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ca341-498a-4a6a-b7f6-23a770e6b67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:28.214570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ca341-498a-4a6a-b7f6-23a770e6b67f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:28.258195 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4337/8601] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:28.261720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721955d-625a-4050-b578-962dcef31200 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:28.278678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721955d-625a-4050-b578-962dcef31200 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:28.293449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d778d-540a-4cc9-a64a-bed6acbf5af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:28.294148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d778d-540a-4cc9-a64a-bed6acbf5af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:28.294439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d778d-540a-4cc9-a64a-bed6acbf5af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:28.294874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d778d-540a-4cc9-a64a-bed6acbf5af1 admin admin] PATH_INFO: `/v3/projects/641131fda7e5498090910c607138c3a3/users/5e9c554aa23d42b89dd2a25d2b705c0c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:28.299817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d778d-540a-4cc9-a64a-bed6acbf5af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641131fda7e5498090910c607138c3a3, user_id=5e9c554aa23d42b89dd2a25d2b705c0c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:28.302553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d778d-540a-4cc9-a64a-bed6acbf5af1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:28.329011 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4265/8602] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:28 2022] PUT /identity/v3/projects/641131fda7e5498090910c607138c3a3/users/5e9c554aa23d42b89dd2a25d2b705c0c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:38.243088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=22 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:38.319993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:38.910120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb39c-8126-4351-9bc6-b6201c74337e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:38.910868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb39c-8126-4351-9bc6-b6201c74337e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:38.910868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb39c-8126-4351-9bc6-b6201c74337e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:38.952559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-db7fb39c-8126-4351-9bc6-b6201c74337e None None] MFA Rules not processed for user `5e9c554aa23d42b89dd2a25d2b705c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:38.954107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-db7fb39c-8126-4351-9bc6-b6201c74337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:39.114026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d778d-540a-4cc9-a64a-bed6acbf5af1 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:39.116215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ab4d778d-540a-4cc9-a64a-bed6acbf5af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:39.118517 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4338/8603] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:08:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:39.250107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb39c-8126-4351-9bc6-b6201c74337e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:39.251574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-db7fb39c-8126-4351-9bc6-b6201c74337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:39.251917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d778d-540a-4cc9-a64a-bed6acbf5af1 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:39.263111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b94f6f-9440-4d76-85da-0ba59d5aa6fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:39.263815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94f6f-9440-4d76-85da-0ba59d5aa6fe service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:39.264303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94f6f-9440-4d76-85da-0ba59d5aa6fe service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:39.264583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94f6f-9440-4d76-85da-0ba59d5aa6fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:39.283906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb39c-8126-4351-9bc6-b6201c74337e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:39.286317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b94f6f-9440-4d76-85da-0ba59d5aa6fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:39.289637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b94f6f-9440-4d76-85da-0ba59d5aa6fe service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:39.299186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534b67b-0fc1-45b8-8a24-b20519cd64d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:39.299923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b67b-0fc1-45b8-8a24-b20519cd64d2 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:39.300269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b67b-0fc1-45b8-8a24-b20519cd64d2 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:39.300454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b67b-0fc1-45b8-8a24-b20519cd64d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:39.302568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f534b67b-0fc1-45b8-8a24-b20519cd64d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:39.308109 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4266/8604] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:08:39.323814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534b67b-0fc1-45b8-8a24-b20519cd64d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:39.325814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534b67b-0fc1-45b8-8a24-b20519cd64d2 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:39.359608 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4339/8605] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:40.149278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b94f6f-9440-4d76-85da-0ba59d5aa6fe service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:40.238258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b94f6f-9440-4d76-85da-0ba59d5aa6fe service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:40.243592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e0e25-b701-49de-9952-78dea9ff1df1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:40.244441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e0e25-b701-49de-9952-78dea9ff1df1 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:40.244724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e0e25-b701-49de-9952-78dea9ff1df1 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:40.244997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e0e25-b701-49de-9952-78dea9ff1df1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:40.247248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db2e0e25-b701-49de-9952-78dea9ff1df1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:40.265294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e0e25-b701-49de-9952-78dea9ff1df1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:40.266955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e0e25-b701-49de-9952-78dea9ff1df1 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:40.289593 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4267/8606] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:40.616137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442aab-c273-43e4-964c-7d142456bd2a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:40.616649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442aab-c273-43e4-964c-7d142456bd2a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:40.616649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442aab-c273-43e4-964c-7d142456bd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:40.645379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-71442aab-c273-43e4-964c-7d142456bd2a None None] MFA Rules not processed for user `e276b9fae4594c17a1883dd4e48184c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:40.646967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-71442aab-c273-43e4-964c-7d142456bd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:40.721055 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4340/8607] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:08:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:46.591938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e0e25-b701-49de-9952-78dea9ff1df1 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:46.593806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db2e0e25-b701-49de-9952-78dea9ff1df1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:46.726916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e0e25-b701-49de-9952-78dea9ff1df1 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:46.754745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321b96d-e798-4ab6-9c26-c6a2d2212141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:46.756074 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321b96d-e798-4ab6-9c26-c6a2d2212141 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:46.756359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321b96d-e798-4ab6-9c26-c6a2d2212141 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:46.757205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321b96d-e798-4ab6-9c26-c6a2d2212141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:46.759154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e321b96d-e798-4ab6-9c26-c6a2d2212141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:46.773160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321b96d-e798-4ab6-9c26-c6a2d2212141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:46.774662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321b96d-e798-4ab6-9c26-c6a2d2212141 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:46.787908 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4268/8608] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:08:48.636874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71442aab-c273-43e4-964c-7d142456bd2a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:48.662193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71442aab-c273-43e4-964c-7d142456bd2a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:48.672403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983257f-f2a1-42b6-aed9-1130c6fdb813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:48.673069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983257f-f2a1-42b6-aed9-1130c6fdb813 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:48.673559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983257f-f2a1-42b6-aed9-1130c6fdb813 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:48.674252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983257f-f2a1-42b6-aed9-1130c6fdb813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:48.679251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0983257f-f2a1-42b6-aed9-1130c6fdb813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:48.707541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983257f-f2a1-42b6-aed9-1130c6fdb813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:48.709789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983257f-f2a1-42b6-aed9-1130c6fdb813 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:48.727721 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4341/8609] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:52.515833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321b96d-e798-4ab6-9c26-c6a2d2212141 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:52.552751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321b96d-e798-4ab6-9c26-c6a2d2212141 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:52.559609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0c86a-506a-45be-a09b-d3eef138be47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:52.560559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0c86a-506a-45be-a09b-d3eef138be47 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:52.561069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0c86a-506a-45be-a09b-d3eef138be47 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:52.561632 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0c86a-506a-45be-a09b-d3eef138be47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:52.564069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-04f0c86a-506a-45be-a09b-d3eef138be47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:52.579996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0c86a-506a-45be-a09b-d3eef138be47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:52.582021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0c86a-506a-45be-a09b-d3eef138be47 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:52.598868 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4269/8610] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:52.614357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983257f-f2a1-42b6-aed9-1130c6fdb813 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:52.698273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983257f-f2a1-42b6-aed9-1130c6fdb813 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:52.703086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:52.703843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:52.704194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:52.704541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] PATH_INFO: `/v3/users/523785aec7914f848ceca7d9a6387946` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:52.705778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] RBAC: Authorizing `identity:delete_user(user_id=523785aec7914f848ceca7d9a6387946)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:52.707942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:52.713432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:52.767889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523785aec7914f848ceca7d9a6387946'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:52.768583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523785aec7914f848ceca7d9a6387946'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:52.781228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523785aec7914f848ceca7d9a6387946'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:52.782015 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523785aec7914f848ceca7d9a6387946'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:52.789408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523785aec7914f848ceca7d9a6387946'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:52.804348 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4342/8611] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:52 2022] DELETE /identity/v3/users/523785aec7914f848ceca7d9a6387946 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:52.998477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0c86a-506a-45be-a09b-d3eef138be47 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.006894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:53.014487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0c86a-506a-45be-a09b-d3eef138be47 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:53.081355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:53.082031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.082315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.082682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] PATH_INFO: `/v3/projects/a8df5e725d7b4f1a810b38b4d39771fc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.083815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8df5e725d7b4f1a810b38b4d39771fc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:53.086114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:53.140574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8df5e725d7b4f1a810b38b4d39771fc', 'request_id': 'req-784b5da1-1153-4f84-9fd4-76eb3153e905'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.146646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8df5e725d7b4f1a810b38b4d39771fc', 'request_id': 'req-784b5da1-1153-4f84-9fd4-76eb3153e905'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.154923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8df5e725d7b4f1a810b38b4d39771fc', 'request_id': 'req-784b5da1-1153-4f84-9fd4-76eb3153e905'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.167984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] The token cache is being invalidate because project a8df5e725d7b4f1a810b38b4d39771fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:53.168389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.169131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.170820 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4270/8612] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:52 2022] DELETE /identity/v3/projects/a8df5e725d7b4f1a810b38b4d39771fc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:53.174858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.176269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:53.190095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d690db-eca9-48a6-8f71-0871787d667b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:53.249484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d7b56-7423-434c-92e4-f2be5f1e063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:53.250109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d7b56-7423-434c-92e4-f2be5f1e063b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.250390 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d7b56-7423-434c-92e4-f2be5f1e063b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.250668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d7b56-7423-434c-92e4-f2be5f1e063b admin admin] PATH_INFO: `/v3/users/5e9c554aa23d42b89dd2a25d2b705c0c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.251926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d7b56-7423-434c-92e4-f2be5f1e063b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9c554aa23d42b89dd2a25d2b705c0c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:53.253882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d7b56-7423-434c-92e4-f2be5f1e063b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:53.316146 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a3d7b56-7423-434c-92e4-f2be5f1e063b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9c554aa23d42b89dd2a25d2b705c0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.317231 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a3d7b56-7423-434c-92e4-f2be5f1e063b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9c554aa23d42b89dd2a25d2b705c0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.334889 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a3d7b56-7423-434c-92e4-f2be5f1e063b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9c554aa23d42b89dd2a25d2b705c0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.335717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a3d7b56-7423-434c-92e4-f2be5f1e063b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9c554aa23d42b89dd2a25d2b705c0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.344916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8a3d7b56-7423-434c-92e4-f2be5f1e063b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9c554aa23d42b89dd2a25d2b705c0c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.361444 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4343/8613] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:08:53 2022] DELETE /identity/v3/users/5e9c554aa23d42b89dd2a25d2b705c0c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:53.565986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.568035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:53.583335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b5da1-1153-4f84-9fd4-76eb3153e905 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:53.643097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:53.643765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.644033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.644317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] PATH_INFO: `/v3/projects/641131fda7e5498090910c607138c3a3` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.645462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641131fda7e5498090910c607138c3a3)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:53.647360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:53.689357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:53.700891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641131fda7e5498090910c607138c3a3', 'request_id': 'req-e1b30923-c2f4-42fe-8735-e1e1d902bb80'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.707846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641131fda7e5498090910c607138c3a3', 'request_id': 'req-e1b30923-c2f4-42fe-8735-e1e1d902bb80'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.716589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641131fda7e5498090910c607138c3a3', 'request_id': 'req-e1b30923-c2f4-42fe-8735-e1e1d902bb80'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.728923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] The token cache is being invalidate because project 641131fda7e5498090910c607138c3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:08:53.729219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.729928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e1b30923-c2f4-42fe-8735-e1e1d902bb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:08:53.732223 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4271/8614] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:08:53 2022] DELETE /identity/v3/projects/641131fda7e5498090910c607138c3a3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:53.737439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32120-bf7d-4155-a3d4-6605501b92ae None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.737922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32120-bf7d-4155-a3d4-6605501b92ae None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.738010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32120-bf7d-4155-a3d4-6605501b92ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.745560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:53.764085 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-30d32120-bf7d-4155-a3d4-6605501b92ae None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:53.765308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-30d32120-bf7d-4155-a3d4-6605501b92ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:53.829853 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4344/8615] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:53.837826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a30939-598e-4e2e-98d2-207bceaf4aea None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.838142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a30939-598e-4e2e-98d2-207bceaf4aea None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.838430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a30939-598e-4e2e-98d2-207bceaf4aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.859708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-11a30939-598e-4e2e-98d2-207bceaf4aea None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:53.860926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-11a30939-598e-4e2e-98d2-207bceaf4aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:53.872129 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4272/8616] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:53.873752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32120-bf7d-4155-a3d4-6605501b92ae None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.884382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32120-bf7d-4155-a3d4-6605501b92ae None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:53.889127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f29ff-ba3b-4725-8d94-b9c0bfd717c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:53.889788 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f29ff-ba3b-4725-8d94-b9c0bfd717c8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.890071 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f29ff-ba3b-4725-8d94-b9c0bfd717c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.890348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f29ff-ba3b-4725-8d94-b9c0bfd717c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.890991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f29ff-ba3b-4725-8d94-b9c0bfd717c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:08:53.891297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f29ff-ba3b-4725-8d94-b9c0bfd717c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:53.892888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f29ff-ba3b-4725-8d94-b9c0bfd717c8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:53.905834 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4345/8617] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:08:53.910232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a30939-598e-4e2e-98d2-207bceaf4aea None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.920256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a30939-598e-4e2e-98d2-207bceaf4aea None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:53.925315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25828c3-86d7-4b45-8414-6e83e3c901f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:53.925954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25828c3-86d7-4b45-8414-6e83e3c901f6 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:53.926239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25828c3-86d7-4b45-8414-6e83e3c901f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:53.926512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25828c3-86d7-4b45-8414-6e83e3c901f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:53.927154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25828c3-86d7-4b45-8414-6e83e3c901f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:53.929054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25828c3-86d7-4b45-8414-6e83e3c901f6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:53.960357 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4273/8618] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:53 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:53.961584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f29ff-ba3b-4725-8d94-b9c0bfd717c8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:53.972184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f29ff-ba3b-4725-8d94-b9c0bfd717c8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.030317 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f223c8f-8014-4495-bb7c-57e171303b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.030848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f223c8f-8014-4495-bb7c-57e171303b28 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.031127 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f223c8f-8014-4495-bb7c-57e171303b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.031393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f223c8f-8014-4495-bb7c-57e171303b28 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.032000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f223c8f-8014-4495-bb7c-57e171303b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:54.034024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f223c8f-8014-4495-bb7c-57e171303b28 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:54.064580 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4346/8619] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:53 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:08:54.069131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25828c3-86d7-4b45-8414-6e83e3c901f6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:54.080627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25828c3-86d7-4b45-8414-6e83e3c901f6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.085406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3145-af13-41f2-9d1a-a6f09459b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.086021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3145-af13-41f2-9d1a-a6f09459b233 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.086300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3145-af13-41f2-9d1a-a6f09459b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.086573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3145-af13-41f2-9d1a-a6f09459b233 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.087216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3145-af13-41f2-9d1a-a6f09459b233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:54.088813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3145-af13-41f2-9d1a-a6f09459b233 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:54.099436 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4274/8620] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:54.103681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f223c8f-8014-4495-bb7c-57e171303b28 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:54.115341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f223c8f-8014-4495-bb7c-57e171303b28 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.122613 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb35d8a-84b7-480d-a8be-8bee92e9dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.123221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb35d8a-84b7-480d-a8be-8bee92e9dfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.123502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb35d8a-84b7-480d-a8be-8bee92e9dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.123780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb35d8a-84b7-480d-a8be-8bee92e9dfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.124423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb35d8a-84b7-480d-a8be-8bee92e9dfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:54.126832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb35d8a-84b7-480d-a8be-8bee92e9dfe7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:54.143575 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4347/8621] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:54.144545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3145-af13-41f2-9d1a-a6f09459b233 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:54.157361 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3145-af13-41f2-9d1a-a6f09459b233 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.163408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7653a7-4971-4559-8cc0-7fd93139f81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.164338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7653a7-4971-4559-8cc0-7fd93139f81f admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.164777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7653a7-4971-4559-8cc0-7fd93139f81f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.165270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7653a7-4971-4559-8cc0-7fd93139f81f admin admin] PATH_INFO: `/v3/projects/4bca2cda19a74c118c8564c694149b95/users/82d1a354ca7f421f803b50f2ff4a48c2/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.184880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7653a7-4971-4559-8cc0-7fd93139f81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bca2cda19a74c118c8564c694149b95, user_id=82d1a354ca7f421f803b50f2ff4a48c2, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:54.187573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7653a7-4971-4559-8cc0-7fd93139f81f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:54.201697 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4275/8622] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:54 2022] PUT /identity/v3/projects/4bca2cda19a74c118c8564c694149b95/users/82d1a354ca7f421f803b50f2ff4a48c2/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:54.213082 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20f243-13f7-4074-9b3b-fff09bc58c6c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.213403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20f243-13f7-4074-9b3b-fff09bc58c6c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.213678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20f243-13f7-4074-9b3b-fff09bc58c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.245642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3d20f243-13f7-4074-9b3b-fff09bc58c6c None None] MFA Rules not processed for user `82d1a354ca7f421f803b50f2ff4a48c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:54.247469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3d20f243-13f7-4074-9b3b-fff09bc58c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:54.307344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:54.317554 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4348/8623] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:08:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:54.318710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7653a7-4971-4559-8cc0-7fd93139f81f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:54.382542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7653a7-4971-4559-8cc0-7fd93139f81f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.387299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edacde-1cd0-4b69-88db-95f4d4c2b107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.387902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edacde-1cd0-4b69-88db-95f4d4c2b107 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.388183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edacde-1cd0-4b69-88db-95f4d4c2b107 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.388459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edacde-1cd0-4b69-88db-95f4d4c2b107 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.389111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edacde-1cd0-4b69-88db-95f4d4c2b107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:54.391079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edacde-1cd0-4b69-88db-95f4d4c2b107 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:54.418474 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4276/8624] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:08:54 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:54.423669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20f243-13f7-4074-9b3b-fff09bc58c6c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:54.435260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20f243-13f7-4074-9b3b-fff09bc58c6c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.496856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1851aa-d5f3-4727-a73f-8c1763dcfb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.497763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1851aa-d5f3-4727-a73f-8c1763dcfb4d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.498323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1851aa-d5f3-4727-a73f-8c1763dcfb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.498742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1851aa-d5f3-4727-a73f-8c1763dcfb4d admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.499545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1851aa-d5f3-4727-a73f-8c1763dcfb4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:54.501656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1851aa-d5f3-4727-a73f-8c1763dcfb4d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:54.526323 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4349/8625] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:08:54 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:08:54.536149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edacde-1cd0-4b69-88db-95f4d4c2b107 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:54.551806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edacde-1cd0-4b69-88db-95f4d4c2b107 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.557298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294506c-b9ea-456e-869d-26aa0f35c3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.558118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294506c-b9ea-456e-869d-26aa0f35c3bf admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.558953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294506c-b9ea-456e-869d-26aa0f35c3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.559326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294506c-b9ea-456e-869d-26aa0f35c3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.560157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294506c-b9ea-456e-869d-26aa0f35c3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:54.562670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294506c-b9ea-456e-869d-26aa0f35c3bf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:54.573916 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4277/8626] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:54.578727 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1851aa-d5f3-4727-a73f-8c1763dcfb4d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:54.589286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1851aa-d5f3-4727-a73f-8c1763dcfb4d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.594458 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9dbf2-29a9-4d3e-beda-7911cf81e8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.595119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9dbf2-29a9-4d3e-beda-7911cf81e8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.595405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9dbf2-29a9-4d3e-beda-7911cf81e8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.595683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9dbf2-29a9-4d3e-beda-7911cf81e8f9 admin admin] PATH_INFO: `/v3/projects/cb073b691ba945f0954eaee508ad0f99/users/661515b1ced1404db0d025d44bbefad0/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.612426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9dbf2-29a9-4d3e-beda-7911cf81e8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb073b691ba945f0954eaee508ad0f99, user_id=661515b1ced1404db0d025d44bbefad0, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:54.615892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9dbf2-29a9-4d3e-beda-7911cf81e8f9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:54.630818 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4350/8627] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:54 2022] PUT /identity/v3/projects/cb073b691ba945f0954eaee508ad0f99/users/661515b1ced1404db0d025d44bbefad0/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:54.634585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294506c-b9ea-456e-869d-26aa0f35c3bf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:54.646090 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294506c-b9ea-456e-869d-26aa0f35c3bf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.684776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:54.713017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45adce-819d-45fc-b3c8-0df4c115e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.713753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45adce-819d-45fc-b3c8-0df4c115e98e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.714035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45adce-819d-45fc-b3c8-0df4c115e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.714313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45adce-819d-45fc-b3c8-0df4c115e98e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.715495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45adce-819d-45fc-b3c8-0df4c115e98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:54.717092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45adce-819d-45fc-b3c8-0df4c115e98e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:54.727460 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4278/8628] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:08:54.731875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9dbf2-29a9-4d3e-beda-7911cf81e8f9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:54.742510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9dbf2-29a9-4d3e-beda-7911cf81e8f9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.750137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c4a99-7086-4d13-8288-924456d51947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.750884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c4a99-7086-4d13-8288-924456d51947 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.751170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c4a99-7086-4d13-8288-924456d51947 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.751723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c4a99-7086-4d13-8288-924456d51947 admin admin] PATH_INFO: `/v3/projects/cb073b691ba945f0954eaee508ad0f99/users/661515b1ced1404db0d025d44bbefad0/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.753760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c4a99-7086-4d13-8288-924456d51947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb073b691ba945f0954eaee508ad0f99, user_id=661515b1ced1404db0d025d44bbefad0, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:54.756678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c4a99-7086-4d13-8288-924456d51947 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:54.770443 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4351/8629] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:08:54 2022] PUT /identity/v3/projects/cb073b691ba945f0954eaee508ad0f99/users/661515b1ced1404db0d025d44bbefad0/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:08:54.782493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a07d95-9d0f-4c40-9f6c-8eb138f6e3f7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.782779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a07d95-9d0f-4c40-9f6c-8eb138f6e3f7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.783056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a07d95-9d0f-4c40-9f6c-8eb138f6e3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:54.811794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e8a07d95-9d0f-4c40-9f6c-8eb138f6e3f7 None None] MFA Rules not processed for user `661515b1ced1404db0d025d44bbefad0`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:08:54.813126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e8a07d95-9d0f-4c40-9f6c-8eb138f6e3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:54.881131 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4279/8630] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:08:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:08:54.894088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c4a99-7086-4d13-8288-924456d51947 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:54.895883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-579c4a99-7086-4d13-8288-924456d51947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:08:54.958273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c4a99-7086-4d13-8288-924456d51947 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:54.961932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef5b51-6d4d-473c-b492-33a7420ba919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:54.962523 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef5b51-6d4d-473c-b492-33a7420ba919 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:54.962801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef5b51-6d4d-473c-b492-33a7420ba919 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:54.963070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef5b51-6d4d-473c-b492-33a7420ba919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:55.030346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef5b51-6d4d-473c-b492-33a7420ba919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:55.031998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef5b51-6d4d-473c-b492-33a7420ba919 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:55.041415 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4352/8631] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:08:57.298553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a07d95-9d0f-4c40-9f6c-8eb138f6e3f7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:08:57.312575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a07d95-9d0f-4c40-9f6c-8eb138f6e3f7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:08:57.316653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18f61c-51a7-4583-8c56-253d0896e838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:08:57.317287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f61c-51a7-4583-8c56-253d0896e838 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:08:57.317607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f61c-51a7-4583-8c56-253d0896e838 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:08:57.317888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f61c-51a7-4583-8c56-253d0896e838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:08:57.329621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18f61c-51a7-4583-8c56-253d0896e838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:08:57.331101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18f61c-51a7-4583-8c56-253d0896e838 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:08:57.358601 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4280/8632] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:08:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:02.881212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b3e48-1d33-4c45-9933-91cbbab6cd23 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:02.881849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b3e48-1d33-4c45-9933-91cbbab6cd23 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:02.881849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b3e48-1d33-4c45-9933-91cbbab6cd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:02.892649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:02.906121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9b0b3e48-1d33-4c45-9933-91cbbab6cd23 None None] MFA Rules not processed for user `82d1a354ca7f421f803b50f2ff4a48c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:02.909224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9b0b3e48-1d33-4c45-9933-91cbbab6cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:02.916982 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4353/8633] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:09:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:07.354917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=53 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:10.263309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18f61c-51a7-4583-8c56-253d0896e838 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:10.265261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-db18f61c-51a7-4583-8c56-253d0896e838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:10.337615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18f61c-51a7-4583-8c56-253d0896e838 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:10.342628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032e3e3-5724-4875-9775-6c53afa8f4f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:10.343239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e3e3-5724-4875-9775-6c53afa8f4f7 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:10.343513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e3e3-5724-4875-9775-6c53afa8f4f7 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:10.343840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e3e3-5724-4875-9775-6c53afa8f4f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:10.345716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8032e3e3-5724-4875-9775-6c53afa8f4f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:10.362308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032e3e3-5724-4875-9775-6c53afa8f4f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:10.364356 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032e3e3-5724-4875-9775-6c53afa8f4f7 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:10.378493 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4281/8634] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:12.909059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:17.889344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b3e48-1d33-4c45-9933-91cbbab6cd23 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:17.891045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9b0b3e48-1d33-4c45-9933-91cbbab6cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:18.005932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b3e48-1d33-4c45-9933-91cbbab6cd23 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:18.012924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6eec3-cc41-490c-a5aa-c7abaf5a80eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:18.013769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6eec3-cc41-490c-a5aa-c7abaf5a80eb service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:18.014272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6eec3-cc41-490c-a5aa-c7abaf5a80eb service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:18.014614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6eec3-cc41-490c-a5aa-c7abaf5a80eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:18.016493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-95b6eec3-cc41-490c-a5aa-c7abaf5a80eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:18.033371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6eec3-cc41-490c-a5aa-c7abaf5a80eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:18.035245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6eec3-cc41-490c-a5aa-c7abaf5a80eb service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:18.061853 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4354/8635] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:20.371158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=32 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:23.476634 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032e3e3-5724-4875-9775-6c53afa8f4f7 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:23.478554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8032e3e3-5724-4875-9775-6c53afa8f4f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:23.511139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032e3e3-5724-4875-9775-6c53afa8f4f7 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:23.517790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40789-a005-45fc-b989-0922aff7c859 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:23.518782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40789-a005-45fc-b989-0922aff7c859 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:23.519155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40789-a005-45fc-b989-0922aff7c859 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:23.519430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40789-a005-45fc-b989-0922aff7c859 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:23.521319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-68c40789-a005-45fc-b989-0922aff7c859 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:23.542178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c40789-a005-45fc-b989-0922aff7c859 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:23.544623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c40789-a005-45fc-b989-0922aff7c859 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:23.559438 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4282/8636] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:09:28.044287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=34 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:33.553251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:57.494345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148498af-79a2-4199-82ef-9f90bee9a254 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:57.494958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148498af-79a2-4199-82ef-9f90bee9a254 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:57.494958 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148498af-79a2-4199-82ef-9f90bee9a254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:57.514214 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-148498af-79a2-4199-82ef-9f90bee9a254 None None] MFA Rules not processed for user `82d1a354ca7f421f803b50f2ff4a48c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:09:57.515408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-148498af-79a2-4199-82ef-9f90bee9a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:57.522403 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4355/8637] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:09:57.850989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40789-a005-45fc-b989-0922aff7c859 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:09:57.852494 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-68c40789-a005-45fc-b989-0922aff7c859 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:57.867547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40789-a005-45fc-b989-0922aff7c859 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:09:57.871328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de81a93-d8f6-489f-b151-820aa1da2886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:09:57.871973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de81a93-d8f6-489f-b151-820aa1da2886 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:09:57.872337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de81a93-d8f6-489f-b151-820aa1da2886 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:09:57.872716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de81a93-d8f6-489f-b151-820aa1da2886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:09:57.874920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3de81a93-d8f6-489f-b151-820aa1da2886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:09:57.887875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de81a93-d8f6-489f-b151-820aa1da2886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:09:57.889310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de81a93-d8f6-489f-b151-820aa1da2886 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:09:57.901847 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4283/8638] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:09:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:07.508548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:07.897271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:20.154707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148498af-79a2-4199-82ef-9f90bee9a254 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:20.154707 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-148498af-79a2-4199-82ef-9f90bee9a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:20.225649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148498af-79a2-4199-82ef-9f90bee9a254 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:20.230671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:20.231306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:20.231590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:20.231870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] PATH_INFO: `/v3/users/64dd24ea45ac485d8d411837d7078301` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:20.233091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64dd24ea45ac485d8d411837d7078301)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:20.235151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:20.285493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64dd24ea45ac485d8d411837d7078301'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.286304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64dd24ea45ac485d8d411837d7078301'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.301019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64dd24ea45ac485d8d411837d7078301'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.301773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64dd24ea45ac485d8d411837d7078301'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.309124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64dd24ea45ac485d8d411837d7078301'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.322710 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4356/8639] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:10:20 2022] DELETE /identity/v3/users/64dd24ea45ac485d8d411837d7078301 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:20.327490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e8c49-ba9a-4a1e-827e-fa8903a5768b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:20.328548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e8c49-ba9a-4a1e-827e-fa8903a5768b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:20.328548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e8c49-ba9a-4a1e-827e-fa8903a5768b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:20.349735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-423e8c49-ba9a-4a1e-827e-fa8903a5768b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:20.351082 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-423e8c49-ba9a-4a1e-827e-fa8903a5768b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:20.415696 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4284/8640] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:20.425681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:20.427203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:20.490258 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aefea-cb8a-4887-a78e-e391514b38a7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:20.494190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b77269-1cb8-483d-8385-424549ac38f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:20.494797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b77269-1cb8-483d-8385-424549ac38f2 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:20.495080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b77269-1cb8-483d-8385-424549ac38f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:20.495356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b77269-1cb8-483d-8385-424549ac38f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:20.508266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b77269-1cb8-483d-8385-424549ac38f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:20.509810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b77269-1cb8-483d-8385-424549ac38f2 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:20.520218 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4357/8641] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:10:20.715056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e8c49-ba9a-4a1e-827e-fa8903a5768b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:20.716624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-423e8c49-ba9a-4a1e-827e-fa8903a5768b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:20.734296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e8c49-ba9a-4a1e-827e-fa8903a5768b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:20.739200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:20.739930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:20.740372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:20.740714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] PATH_INFO: `/v3/projects/fa29b3844343454c8ade410470e7d897` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:20.742011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa29b3844343454c8ade410470e7d897)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:20.744179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:20.798089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa29b3844343454c8ade410470e7d897', 'request_id': 'req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.805014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa29b3844343454c8ade410470e7d897', 'request_id': 'req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.814059 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa29b3844343454c8ade410470e7d897', 'request_id': 'req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.826635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] The token cache is being invalidate because project fa29b3844343454c8ade410470e7d897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:10:20.827046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.827864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.829988 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4285/8642] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:10:20 2022] DELETE /identity/v3/projects/fa29b3844343454c8ade410470e7d897 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:20.834327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b77269-1cb8-483d-8385-424549ac38f2 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:20.844949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b77269-1cb8-483d-8385-424549ac38f2 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:20.869571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:20.917573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abadd8d-bd7b-4316-b1da-c96f1e4507d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:20.918218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abadd8d-bd7b-4316-b1da-c96f1e4507d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:20.918520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abadd8d-bd7b-4316-b1da-c96f1e4507d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:20.918800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abadd8d-bd7b-4316-b1da-c96f1e4507d4 admin admin] PATH_INFO: `/v3/users/a2100452cd4444db9467899791cd745c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:20.919951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abadd8d-bd7b-4316-b1da-c96f1e4507d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2100452cd4444db9467899791cd745c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:20.922510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abadd8d-bd7b-4316-b1da-c96f1e4507d4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:20.971669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1abadd8d-bd7b-4316-b1da-c96f1e4507d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2100452cd4444db9467899791cd745c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.972325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1abadd8d-bd7b-4316-b1da-c96f1e4507d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2100452cd4444db9467899791cd745c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.984561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1abadd8d-bd7b-4316-b1da-c96f1e4507d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2100452cd4444db9467899791cd745c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.985198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1abadd8d-bd7b-4316-b1da-c96f1e4507d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2100452cd4444db9467899791cd745c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:20.992470 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1abadd8d-bd7b-4316-b1da-c96f1e4507d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2100452cd4444db9467899791cd745c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:21.006792 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4358/8643] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:10:20 2022] DELETE /identity/v3/users/a2100452cd4444db9467899791cd745c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:21.199818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:21.201604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:21.230370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fd3f3-9c78-4c31-ae5a-e9ae055f207a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:21.290037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:21.290682 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:21.290964 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:21.291240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] PATH_INFO: `/v3/projects/72278a148b104eb88fee0e2384fc83b4` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:21.292389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72278a148b104eb88fee0e2384fc83b4)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:21.294389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:21.326487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:21.345635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72278a148b104eb88fee0e2384fc83b4', 'request_id': 'req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:21.352135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72278a148b104eb88fee0e2384fc83b4', 'request_id': 'req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:21.363348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72278a148b104eb88fee0e2384fc83b4', 'request_id': 'req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:21.375457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] The token cache is being invalidate because project 72278a148b104eb88fee0e2384fc83b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:10:21.375796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:21.376449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ce5f7f8d-e697-4f6a-9fec-f252d62d512e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:21.378014 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4286/8644] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:10:21 2022] DELETE /identity/v3/projects/72278a148b104eb88fee0e2384fc83b4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:21.384731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bc506-64ab-4eed-aa99-3fe4f4860330 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:21.385197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bc506-64ab-4eed-aa99-3fe4f4860330 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:21.385407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bc506-64ab-4eed-aa99-3fe4f4860330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:21.406932 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-096bc506-64ab-4eed-aa99-3fe4f4860330 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:21.413064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-096bc506-64ab-4eed-aa99-3fe4f4860330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:21.476145 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4359/8645] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:21.484792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd19d6-eb5d-4851-b853-65ddf3e20577 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:21.485175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd19d6-eb5d-4851-b853-65ddf3e20577 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:21.485594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd19d6-eb5d-4851-b853-65ddf3e20577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:21.509830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-52cd19d6-eb5d-4851-b853-65ddf3e20577 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:21.511094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-52cd19d6-eb5d-4851-b853-65ddf3e20577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:21.519430 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4287/8646] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:21.524083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bc506-64ab-4eed-aa99-3fe4f4860330 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:21.545299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bc506-64ab-4eed-aa99-3fe4f4860330 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:21.550706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a1e33-1c78-49a2-bd92-e2b41779bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:21.551309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a1e33-1c78-49a2-bd92-e2b41779bb61 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:21.551589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a1e33-1c78-49a2-bd92-e2b41779bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:21.551861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a1e33-1c78-49a2-bd92-e2b41779bb61 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:21.552500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a1e33-1c78-49a2-bd92-e2b41779bb61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:10:21.552798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a1e33-1c78-49a2-bd92-e2b41779bb61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:21.554492 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a1e33-1c78-49a2-bd92-e2b41779bb61 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:21.566483 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4360/8647] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:10:21.571234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd19d6-eb5d-4851-b853-65ddf3e20577 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:21.581381 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd19d6-eb5d-4851-b853-65ddf3e20577 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:21.586347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de8605-a5b0-444c-a4ac-da66e8031161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:21.586983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de8605-a5b0-444c-a4ac-da66e8031161 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:21.587259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de8605-a5b0-444c-a4ac-da66e8031161 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:21.587531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de8605-a5b0-444c-a4ac-da66e8031161 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:21.588196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de8605-a5b0-444c-a4ac-da66e8031161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:21.590177 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de8605-a5b0-444c-a4ac-da66e8031161 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:21.618924 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4288/8648] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:10:21 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:10:21.623455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a1e33-1c78-49a2-bd92-e2b41779bb61 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:21.634187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a1e33-1c78-49a2-bd92-e2b41779bb61 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:21.661895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:21.700272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccba056-c70a-409d-835c-88e43adbb0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:21.700879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba056-c70a-409d-835c-88e43adbb0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:21.701164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba056-c70a-409d-835c-88e43adbb0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:21.701473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba056-c70a-409d-835c-88e43adbb0d4 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:21.702112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccba056-c70a-409d-835c-88e43adbb0d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:21.704909 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccba056-c70a-409d-835c-88e43adbb0d4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:21.728370 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4361/8649] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:21 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:21.732649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de8605-a5b0-444c-a4ac-da66e8031161 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:21.743536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de8605-a5b0-444c-a4ac-da66e8031161 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:21.748249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b77e-0a03-4d9c-9fc2-a227ee3b07ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:21.748859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b77e-0a03-4d9c-9fc2-a227ee3b07ea admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:21.749140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b77e-0a03-4d9c-9fc2-a227ee3b07ea admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:21.749447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b77e-0a03-4d9c-9fc2-a227ee3b07ea admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:21.750118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44b77e-0a03-4d9c-9fc2-a227ee3b07ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:21.751716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44b77e-0a03-4d9c-9fc2-a227ee3b07ea admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:21.762169 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4289/8650] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:21.766775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccba056-c70a-409d-835c-88e43adbb0d4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:21.776994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccba056-c70a-409d-835c-88e43adbb0d4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:21.782636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21222dcb-8920-420c-8dcb-692a8c315626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:21.783284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21222dcb-8920-420c-8dcb-692a8c315626 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:21.783568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21222dcb-8920-420c-8dcb-692a8c315626 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:21.783897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21222dcb-8920-420c-8dcb-692a8c315626 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:21.784574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21222dcb-8920-420c-8dcb-692a8c315626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:21.786273 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21222dcb-8920-420c-8dcb-692a8c315626 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:21.800878 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4362/8651] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:21.802149 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b77e-0a03-4d9c-9fc2-a227ee3b07ea admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:21.812991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b77e-0a03-4d9c-9fc2-a227ee3b07ea admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:21.817865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea34cfd-b16e-48fd-9159-a9c3af7be737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:21.818522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea34cfd-b16e-48fd-9159-a9c3af7be737 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:21.818801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea34cfd-b16e-48fd-9159-a9c3af7be737 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:21.819077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea34cfd-b16e-48fd-9159-a9c3af7be737 admin admin] PATH_INFO: `/v3/projects/6af797302dad40d49bf84771a8ce30d5/users/eee3c3d7945d4430ba2b7d78c7ab935b/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:21.834547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea34cfd-b16e-48fd-9159-a9c3af7be737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af797302dad40d49bf84771a8ce30d5, user_id=eee3c3d7945d4430ba2b7d78c7ab935b, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:21.837133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea34cfd-b16e-48fd-9159-a9c3af7be737 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:21.851524 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4290/8652] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:21 2022] PUT /identity/v3/projects/6af797302dad40d49bf84771a8ce30d5/users/eee3c3d7945d4430ba2b7d78c7ab935b/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:21.856838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4873e-1904-4427-92c2-0ee2b0bd79e8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:21.857224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4873e-1904-4427-92c2-0ee2b0bd79e8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:21.857569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4873e-1904-4427-92c2-0ee2b0bd79e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:21.877614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8ee4873e-1904-4427-92c2-0ee2b0bd79e8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:21.878821 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8ee4873e-1904-4427-92c2-0ee2b0bd79e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:21.943569 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4363/8653] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:10:21.953916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea34cfd-b16e-48fd-9159-a9c3af7be737 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:21.955620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bea34cfd-b16e-48fd-9159-a9c3af7be737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:22.025550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea34cfd-b16e-48fd-9159-a9c3af7be737 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:22.029504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6665a-45a8-4499-879b-e35be57137dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:22.030218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6665a-45a8-4499-879b-e35be57137dc service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:22.030504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6665a-45a8-4499-879b-e35be57137dc service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:22.030810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6665a-45a8-4499-879b-e35be57137dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:22.040271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6665a-45a8-4499-879b-e35be57137dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:22.041791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6665a-45a8-4499-879b-e35be57137dc service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:22.051438 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4291/8654] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:26.946582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f532d-897e-4627-8e33-205d1bdbc261 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:26.947081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f532d-897e-4627-8e33-205d1bdbc261 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:26.947241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f532d-897e-4627-8e33-205d1bdbc261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:26.984502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-334f532d-897e-4627-8e33-205d1bdbc261 None None] MFA Rules not processed for user `eee3c3d7945d4430ba2b7d78c7ab935b`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:26.985775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-334f532d-897e-4627-8e33-205d1bdbc261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:27.079705 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4364/8655] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:27.084594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6665a-45a8-4499-879b-e35be57137dc service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:27.094859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6665a-45a8-4499-879b-e35be57137dc service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:27.100244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afeff7a-ccff-4ba3-b5d2-f0182ba18b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:27.100871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afeff7a-ccff-4ba3-b5d2-f0182ba18b88 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:27.101150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afeff7a-ccff-4ba3-b5d2-f0182ba18b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:27.101597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afeff7a-ccff-4ba3-b5d2-f0182ba18b88 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:27.102258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afeff7a-ccff-4ba3-b5d2-f0182ba18b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:27.104202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afeff7a-ccff-4ba3-b5d2-f0182ba18b88 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:27.132986 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4292/8656] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:27 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:27.137711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f532d-897e-4627-8e33-205d1bdbc261 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:27.149765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f532d-897e-4627-8e33-205d1bdbc261 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:27.154848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56187b47-01cc-4a48-a36a-648874176f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:27.155575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56187b47-01cc-4a48-a36a-648874176f28 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:27.155988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56187b47-01cc-4a48-a36a-648874176f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:27.156382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56187b47-01cc-4a48-a36a-648874176f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:27.157151 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56187b47-01cc-4a48-a36a-648874176f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:27.158892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56187b47-01cc-4a48-a36a-648874176f28 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:27.170147 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4365/8657] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:27.174916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afeff7a-ccff-4ba3-b5d2-f0182ba18b88 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:27.185224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afeff7a-ccff-4ba3-b5d2-f0182ba18b88 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:27.190561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1c6c6-1d5e-463f-a0e2-f6b78253a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:27.191209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1c6c6-1d5e-463f-a0e2-f6b78253a121 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:27.191498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1c6c6-1d5e-463f-a0e2-f6b78253a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:27.191777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1c6c6-1d5e-463f-a0e2-f6b78253a121 admin admin] PATH_INFO: `/v3/system/users/92fa43429ee041c6a1ca6547b4af1746/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:27.206628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1c6c6-1d5e-463f-a0e2-f6b78253a121 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=92fa43429ee041c6a1ca6547b4af1746, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:27.208248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1c6c6-1d5e-463f-a0e2-f6b78253a121 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:27.215707 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4293/8658] 10.222.0.16 () {60 vars in 1378 bytes} [Mon Aug 29 16:10:27 2022] PUT /identity/v3/system/users/92fa43429ee041c6a1ca6547b4af1746/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:27.226409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046fd6c-2485-4987-b02e-2588456f23c7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:27.226695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046fd6c-2485-4987-b02e-2588456f23c7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:27.226967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046fd6c-2485-4987-b02e-2588456f23c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:27.254282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1046fd6c-2485-4987-b02e-2588456f23c7 None None] MFA Rules not processed for user `92fa43429ee041c6a1ca6547b4af1746`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:27.255648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1046fd6c-2485-4987-b02e-2588456f23c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:27.272429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:27.358547 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4366/8659] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:27 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 16:10:27.363848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1c6c6-1d5e-463f-a0e2-f6b78253a121 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:27.391011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=6,keystone:SELECT=87,keystone:INSERT=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:27.493051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1c6c6-1d5e-463f-a0e2-f6b78253a121 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:27.531910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c7a4-f0f5-4761-a217-5865a71ac84a None tempest-ImageQuotaTest-699305081-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fa43429ee041c6a1ca6547b4af1746', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:27.532708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c7a4-f0f5-4761-a217-5865a71ac84a None tempest-ImageQuotaTest-699305081-system-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:27.533108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c7a4-f0f5-4761-a217-5865a71ac84a None tempest-ImageQuotaTest-699305081-system-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:27.533457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c7a4-f0f5-4761-a217-5865a71ac84a None tempest-ImageQuotaTest-699305081-system-admin] PATH_INFO: `/v3/services` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:27.534167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83c7a4-f0f5-4761-a217-5865a71ac84a None tempest-ImageQuotaTest-699305081-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:27.535539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83c7a4-f0f5-4761-a217-5865a71ac84a None tempest-ImageQuotaTest-699305081-system-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:27.542872 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4294/8660] 10.222.0.16 () {58 vars in 1110 bytes} [Mon Aug 29 16:10:27 2022] GET /identity/v3/services => generated 2191 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:27.548081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046fd6c-2485-4987-b02e-2588456f23c7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:27.690004 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046fd6c-2485-4987-b02e-2588456f23c7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:27.731296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf8238-eb60-41cb-88ce-3dbd2045cab6 None tempest-ImageQuotaTest-699305081-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fa43429ee041c6a1ca6547b4af1746', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:27.732045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf8238-eb60-41cb-88ce-3dbd2045cab6 None tempest-ImageQuotaTest-699305081-system-admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:27.732409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf8238-eb60-41cb-88ce-3dbd2045cab6 None tempest-ImageQuotaTest-699305081-system-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:27.732752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf8238-eb60-41cb-88ce-3dbd2045cab6 None tempest-ImageQuotaTest-699305081-system-admin] PATH_INFO: `/v3/limits` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:27.733534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf8238-eb60-41cb-88ce-3dbd2045cab6 None tempest-ImageQuotaTest-699305081-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:27.734881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf8238-eb60-41cb-88ce-3dbd2045cab6 None tempest-ImageQuotaTest-699305081-system-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:27.753327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-39bf8238-eb60-41cb-88ce-3dbd2045cab6 None tempest-ImageQuotaTest-699305081-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Aug 29 16:10:27.785098 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.NoLimitReference Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 29 16:10:27.786150 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 16:10:27.787687 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4367/8661] 10.222.0.16 () {60 vars in 1126 bytes} [Mon Aug 29 16:10:27 2022] POST /identity/v3/limits => generated 124 bytes in 239 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 29 16:10:27.791654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c7a4-f0f5-4761-a217-5865a71ac84a None tempest-ImageQuotaTest-699305081-system-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:27.909423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:27.938156 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c7a4-f0f5-4761-a217-5865a71ac84a None tempest-ImageQuotaTest-699305081-system-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:27.985835 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69800642-f0ce-46f9-9d6c-2ab4ce176506 None tempest-ImageQuotaTest-699305081-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fa43429ee041c6a1ca6547b4af1746', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:27.986468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69800642-f0ce-46f9-9d6c-2ab4ce176506 None tempest-ImageQuotaTest-699305081-system-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:27.986753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69800642-f0ce-46f9-9d6c-2ab4ce176506 None tempest-ImageQuotaTest-699305081-system-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:27.987032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69800642-f0ce-46f9-9d6c-2ab4ce176506 None tempest-ImageQuotaTest-699305081-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:27.987655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69800642-f0ce-46f9-9d6c-2ab4ce176506 None tempest-ImageQuotaTest-699305081-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:27.988733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69800642-f0ce-46f9-9d6c-2ab4ce176506 None tempest-ImageQuotaTest-699305081-system-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:28.000421 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4295/8662] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 16:10:27 2022] GET /identity/v3/registered_limits => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:10:28.006466 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf8238-eb60-41cb-88ce-3dbd2045cab6 None tempest-ImageQuotaTest-699305081-system-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:28.149559 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf8238-eb60-41cb-88ce-3dbd2045cab6 None tempest-ImageQuotaTest-699305081-system-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:28.197346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfa8fe-0b09-43c1-8f6a-372052cc6ab3 None tempest-ImageQuotaTest-699305081-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92fa43429ee041c6a1ca6547b4af1746', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:28.198003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfa8fe-0b09-43c1-8f6a-372052cc6ab3 None tempest-ImageQuotaTest-699305081-system-admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:28.198348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfa8fe-0b09-43c1-8f6a-372052cc6ab3 None tempest-ImageQuotaTest-699305081-system-admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:28.198633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfa8fe-0b09-43c1-8f6a-372052cc6ab3 None tempest-ImageQuotaTest-699305081-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:28.199255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfa8fe-0b09-43c1-8f6a-372052cc6ab3 None tempest-ImageQuotaTest-699305081-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:28.200506 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfa8fe-0b09-43c1-8f6a-372052cc6ab3 None tempest-ImageQuotaTest-699305081-system-admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:28.208159 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4368/8663] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Aug 29 16:10:28 2022] GET /identity/v3/registered_limits => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:10:31.694463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69800642-f0ce-46f9-9d6c-2ab4ce176506 None tempest-ImageQuotaTest-699305081-system-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:31.706880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69800642-f0ce-46f9-9d6c-2ab4ce176506 None tempest-ImageQuotaTest-699305081-system-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:31.711882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:31.712529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:31.712809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:31.713089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] PATH_INFO: `/v3/users/eee3c3d7945d4430ba2b7d78c7ab935b` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:31.714337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee3c3d7945d4430ba2b7d78c7ab935b)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:31.717025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:31.769064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee3c3d7945d4430ba2b7d78c7ab935b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:31.769747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee3c3d7945d4430ba2b7d78c7ab935b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:31.782736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee3c3d7945d4430ba2b7d78c7ab935b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:31.790569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee3c3d7945d4430ba2b7d78c7ab935b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:31.798169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee3c3d7945d4430ba2b7d78c7ab935b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:31.804578 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4296/8664] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:10:31 2022] DELETE /identity/v3/users/eee3c3d7945d4430ba2b7d78c7ab935b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:31.992256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfa8fe-0b09-43c1-8f6a-372052cc6ab3 None tempest-ImageQuotaTest-699305081-system-admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:31.994180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-99cfa8fe-0b09-43c1-8f6a-372052cc6ab3 None tempest-ImageQuotaTest-699305081-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:32.078510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfa8fe-0b09-43c1-8f6a-372052cc6ab3 None tempest-ImageQuotaTest-699305081-system-admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:32.083265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:32.083880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:32.084162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:32.084439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] PATH_INFO: `/v3/projects/6af797302dad40d49bf84771a8ce30d5` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:32.085597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af797302dad40d49bf84771a8ce30d5)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:32.087508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:32.099331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:32.135378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af797302dad40d49bf84771a8ce30d5', 'request_id': 'req-e245d89d-264d-481b-b66e-2392855d05d6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:32.141509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af797302dad40d49bf84771a8ce30d5', 'request_id': 'req-e245d89d-264d-481b-b66e-2392855d05d6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:32.148881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af797302dad40d49bf84771a8ce30d5', 'request_id': 'req-e245d89d-264d-481b-b66e-2392855d05d6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:32.160331 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] The token cache is being invalidate because project 6af797302dad40d49bf84771a8ce30d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:10:32.160638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:32.161305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:32.162893 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4369/8665] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:10:31 2022] DELETE /identity/v3/projects/6af797302dad40d49bf84771a8ce30d5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:32.166872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:32.177993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0ef56-d3d5-463f-ae47-443c68b976b7 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:32.246391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4c282-4f27-4be2-8d64-a889e7b6869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:32.247159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4c282-4f27-4be2-8d64-a889e7b6869a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:32.247770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4c282-4f27-4be2-8d64-a889e7b6869a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:32.248145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4c282-4f27-4be2-8d64-a889e7b6869a admin admin] PATH_INFO: `/v3/users/92fa43429ee041c6a1ca6547b4af1746` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:32.250199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4c282-4f27-4be2-8d64-a889e7b6869a admin admin] RBAC: Authorizing `identity:delete_user(user_id=92fa43429ee041c6a1ca6547b4af1746)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:32.252756 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4c282-4f27-4be2-8d64-a889e7b6869a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:32.266950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:32.334160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d2d4c282-4f27-4be2-8d64-a889e7b6869a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92fa43429ee041c6a1ca6547b4af1746'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:32.334908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d2d4c282-4f27-4be2-8d64-a889e7b6869a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92fa43429ee041c6a1ca6547b4af1746'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:32.347450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d2d4c282-4f27-4be2-8d64-a889e7b6869a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92fa43429ee041c6a1ca6547b4af1746'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:32.356646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d2d4c282-4f27-4be2-8d64-a889e7b6869a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92fa43429ee041c6a1ca6547b4af1746'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:32.366485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d2d4c282-4f27-4be2-8d64-a889e7b6869a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92fa43429ee041c6a1ca6547b4af1746'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:10:32.374318 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4297/8666] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:10:32 2022] DELETE /identity/v3/users/92fa43429ee041c6a1ca6547b4af1746 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:32.708693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:32.711678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:32.728947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245d89d-264d-481b-b66e-2392855d05d6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:32.798130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7085d5-3fa1-4cc3-a15b-0dd992c34de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:32.798778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7085d5-3fa1-4cc3-a15b-0dd992c34de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:32.799132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7085d5-3fa1-4cc3-a15b-0dd992c34de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:32.799476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7085d5-3fa1-4cc3-a15b-0dd992c34de5 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:32.809752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7085d5-3fa1-4cc3-a15b-0dd992c34de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:32.812354 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7085d5-3fa1-4cc3-a15b-0dd992c34de5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application [None req-6d7085d5-3fa1-4cc3-a15b-0dd992c34de5 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 16:10:32.826778 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 16:10:32.828500 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 29 16:10:32.828500 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 29 16:10:32.828500 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 16:10:32.828500 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 16:10:32.828500 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 16:10:32.828500 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 16:10:32.828500 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Aug 29 16:10:32.828500 n-d-854882-3 devstack@keystone.service[89681]: ERROR keystone.server.flask.application Aug 29 16:10:32.829577 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4370/8667] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Aug 29 16:10:32 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 16:10:32.836128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134b79-f976-40fb-8642-c9772343efcc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:32.836668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134b79-f976-40fb-8642-c9772343efcc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:32.836668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134b79-f976-40fb-8642-c9772343efcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:32.864510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cf134b79-f976-40fb-8642-c9772343efcc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:32.865957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cf134b79-f976-40fb-8642-c9772343efcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:32.881579 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4298/8668] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:32.883837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803694b3-d519-465a-b1be-5bab43ac1c8b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:32.884189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803694b3-d519-465a-b1be-5bab43ac1c8b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:32.884459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803694b3-d519-465a-b1be-5bab43ac1c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:32.907645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-803694b3-d519-465a-b1be-5bab43ac1c8b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:32.908984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-803694b3-d519-465a-b1be-5bab43ac1c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:32.920584 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4371/8669] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:32.922201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134b79-f976-40fb-8642-c9772343efcc None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:32.933812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134b79-f976-40fb-8642-c9772343efcc None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:32.939083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195df2a-964a-4ccb-ab59-71902f1d6c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:32.939798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195df2a-964a-4ccb-ab59-71902f1d6c75 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:32.940145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195df2a-964a-4ccb-ab59-71902f1d6c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:32.940423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195df2a-964a-4ccb-ab59-71902f1d6c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:32.941073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195df2a-964a-4ccb-ab59-71902f1d6c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:10:32.941542 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195df2a-964a-4ccb-ab59-71902f1d6c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:32.943325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195df2a-964a-4ccb-ab59-71902f1d6c75 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:32.960619 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4299/8670] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:10:32.962208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803694b3-d519-465a-b1be-5bab43ac1c8b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:32.974409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803694b3-d519-465a-b1be-5bab43ac1c8b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:32.979526 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f26ef6-b7b7-4dfc-af37-f08e053a82b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:32.980133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f26ef6-b7b7-4dfc-af37-f08e053a82b8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:32.980415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f26ef6-b7b7-4dfc-af37-f08e053a82b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:32.980688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f26ef6-b7b7-4dfc-af37-f08e053a82b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:32.981322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f26ef6-b7b7-4dfc-af37-f08e053a82b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:32.983254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f26ef6-b7b7-4dfc-af37-f08e053a82b8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:33.014550 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4372/8671] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:10:32 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:33.018971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195df2a-964a-4ccb-ab59-71902f1d6c75 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:33.031742 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195df2a-964a-4ccb-ab59-71902f1d6c75 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:33.105870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e72312-e2ed-46ae-bc83-34c2306da15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:33.106592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e72312-e2ed-46ae-bc83-34c2306da15b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:33.106950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e72312-e2ed-46ae-bc83-34c2306da15b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:33.107295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e72312-e2ed-46ae-bc83-34c2306da15b admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:33.108190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e72312-e2ed-46ae-bc83-34c2306da15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:33.110836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e72312-e2ed-46ae-bc83-34c2306da15b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:33.140984 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4300/8672] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:33 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:10:33.143345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f26ef6-b7b7-4dfc-af37-f08e053a82b8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:33.163372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f26ef6-b7b7-4dfc-af37-f08e053a82b8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:33.168676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772229e4-b851-4131-9370-39296ff20ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:33.169512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772229e4-b851-4131-9370-39296ff20ebb admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:33.169892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772229e4-b851-4131-9370-39296ff20ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:33.170199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772229e4-b851-4131-9370-39296ff20ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:33.170911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772229e4-b851-4131-9370-39296ff20ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:33.173158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772229e4-b851-4131-9370-39296ff20ebb admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:33.186970 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4373/8673] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:33.191002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e72312-e2ed-46ae-bc83-34c2306da15b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:33.202243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e72312-e2ed-46ae-bc83-34c2306da15b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:33.208425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42993b-f87c-4d92-8ccd-66c6c6c34f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:33.209034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42993b-f87c-4d92-8ccd-66c6c6c34f36 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:33.209316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42993b-f87c-4d92-8ccd-66c6c6c34f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:33.209630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42993b-f87c-4d92-8ccd-66c6c6c34f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:33.210405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42993b-f87c-4d92-8ccd-66c6c6c34f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:33.212130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42993b-f87c-4d92-8ccd-66c6c6c34f36 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:33.229332 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4301/8674] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:33.233641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772229e4-b851-4131-9370-39296ff20ebb admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:33.245070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772229e4-b851-4131-9370-39296ff20ebb admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:33.249859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55901a0f-a017-4acd-9d7c-0fd7a94c580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:33.250534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55901a0f-a017-4acd-9d7c-0fd7a94c580a admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:33.250816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55901a0f-a017-4acd-9d7c-0fd7a94c580a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:33.251100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55901a0f-a017-4acd-9d7c-0fd7a94c580a admin admin] PATH_INFO: `/v3/projects/b055f0d12a17435cb8f8491123b4c8e8/users/549d35b431a947eda45ea502b0dc753f/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:33.266019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55901a0f-a017-4acd-9d7c-0fd7a94c580a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b055f0d12a17435cb8f8491123b4c8e8, user_id=549d35b431a947eda45ea502b0dc753f, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:33.268671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55901a0f-a017-4acd-9d7c-0fd7a94c580a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:33.286254 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4374/8675] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:33 2022] PUT /identity/v3/projects/b055f0d12a17435cb8f8491123b4c8e8/users/549d35b431a947eda45ea502b0dc753f/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:10:33.291447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6bc5c-f046-4885-b0f1-af9990ce818f None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:33.291739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6bc5c-f046-4885-b0f1-af9990ce818f None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:33.292014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6bc5c-f046-4885-b0f1-af9990ce818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:33.316102 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9ee6bc5c-f046-4885-b0f1-af9990ce818f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:33.316708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9ee6bc5c-f046-4885-b0f1-af9990ce818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:33.348623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:33.383350 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4302/8676] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:33.393093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55901a0f-a017-4acd-9d7c-0fd7a94c580a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:33.394773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-55901a0f-a017-4acd-9d7c-0fd7a94c580a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:33.430335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:33.461133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55901a0f-a017-4acd-9d7c-0fd7a94c580a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:33.464836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55936e5-65ee-4b06-b9b8-43194a6f61fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:33.465508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55936e5-65ee-4b06-b9b8-43194a6f61fe service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:33.465791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55936e5-65ee-4b06-b9b8-43194a6f61fe service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:33.466063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55936e5-65ee-4b06-b9b8-43194a6f61fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:33.475942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55936e5-65ee-4b06-b9b8-43194a6f61fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:33.477406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55936e5-65ee-4b06-b9b8-43194a6f61fe service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:33.488290 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4375/8677] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:34.649842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6bc5c-f046-4885-b0f1-af9990ce818f None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:34.651380 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9ee6bc5c-f046-4885-b0f1-af9990ce818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:34.866375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6bc5c-f046-4885-b0f1-af9990ce818f None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:34.873052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358605b1-af0e-47e1-8f9d-371b4f7eb26f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:34.873916 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358605b1-af0e-47e1-8f9d-371b4f7eb26f service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:34.874833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358605b1-af0e-47e1-8f9d-371b4f7eb26f service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:34.875215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358605b1-af0e-47e1-8f9d-371b4f7eb26f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:34.877502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-358605b1-af0e-47e1-8f9d-371b4f7eb26f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:35.021971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358605b1-af0e-47e1-8f9d-371b4f7eb26f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:35.026410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358605b1-af0e-47e1-8f9d-371b4f7eb26f service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:35.082069 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4303/8678] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:38.230926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55936e5-65ee-4b06-b9b8-43194a6f61fe service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:38.248560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55936e5-65ee-4b06-b9b8-43194a6f61fe service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:38.261173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120442b-e96d-437e-b264-c376803a66dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:38.261827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120442b-e96d-437e-b264-c376803a66dc service cinder] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:38.262107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120442b-e96d-437e-b264-c376803a66dc service cinder] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:38.262380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120442b-e96d-437e-b264-c376803a66dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:38.265626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8120442b-e96d-437e-b264-c376803a66dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:38.420918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120442b-e96d-437e-b264-c376803a66dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:38.430720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120442b-e96d-437e-b264-c376803a66dc service cinder] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:38.446834 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4376/8679] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:40.547150 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae389bd6-2b0c-4bd0-afe5-fa34bb45e761 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:40.547741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae389bd6-2b0c-4bd0-afe5-fa34bb45e761 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:40.547741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae389bd6-2b0c-4bd0-afe5-fa34bb45e761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:40.624112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ae389bd6-2b0c-4bd0-afe5-fa34bb45e761 None None] MFA Rules not processed for user `549d35b431a947eda45ea502b0dc753f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:40.626995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ae389bd6-2b0c-4bd0-afe5-fa34bb45e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:40.720653 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:40.786065 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4304/8680] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:40.787305 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120442b-e96d-437e-b264-c376803a66dc service cinder] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:40.807362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120442b-e96d-437e-b264-c376803a66dc service cinder] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:40.821908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23ea2c-a8bd-49ba-98dc-60e73ec4ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:40.822978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ea2c-a8bd-49ba-98dc-60e73ec4ab8c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:40.823517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ea2c-a8bd-49ba-98dc-60e73ec4ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:40.824044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ea2c-a8bd-49ba-98dc-60e73ec4ab8c admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:40.831203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23ea2c-a8bd-49ba-98dc-60e73ec4ab8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:40.834135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23ea2c-a8bd-49ba-98dc-60e73ec4ab8c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:40.929032 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4377/8681] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:10:40 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:40.930104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae389bd6-2b0c-4bd0-afe5-fa34bb45e761 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:40.956192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae389bd6-2b0c-4bd0-afe5-fa34bb45e761 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:41.111224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254f6b5-1704-4112-9b42-01e0357eff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:41.112535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254f6b5-1704-4112-9b42-01e0357eff1b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:41.112897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254f6b5-1704-4112-9b42-01e0357eff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:41.114920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254f6b5-1704-4112-9b42-01e0357eff1b admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:41.116498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254f6b5-1704-4112-9b42-01e0357eff1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:41.120565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254f6b5-1704-4112-9b42-01e0357eff1b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:41.181007 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4305/8682] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:10:40 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:10:41.182730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23ea2c-a8bd-49ba-98dc-60e73ec4ab8c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:41.214476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23ea2c-a8bd-49ba-98dc-60e73ec4ab8c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:41.229598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18921f29-ac82-4d2b-b709-11b528ceb4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:41.230634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18921f29-ac82-4d2b-b709-11b528ceb4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:41.231158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18921f29-ac82-4d2b-b709-11b528ceb4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:41.231702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18921f29-ac82-4d2b-b709-11b528ceb4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:41.232913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18921f29-ac82-4d2b-b709-11b528ceb4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:41.235124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18921f29-ac82-4d2b-b709-11b528ceb4e6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:41.257266 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4378/8683] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:41.261107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254f6b5-1704-4112-9b42-01e0357eff1b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:41.276920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254f6b5-1704-4112-9b42-01e0357eff1b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:41.289136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a7c10-ac57-49cf-80f9-3b94345f9921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:41.290146 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7c10-ac57-49cf-80f9-3b94345f9921 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:41.290435 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7c10-ac57-49cf-80f9-3b94345f9921 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:41.290713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7c10-ac57-49cf-80f9-3b94345f9921 admin admin] PATH_INFO: `/v3/projects/b9b332a8c4484a149d9c56ac66547b4c/users/fed17418ec8741cd828de2ab3ce1c232/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:41.321009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a7c10-ac57-49cf-80f9-3b94345f9921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b332a8c4484a149d9c56ac66547b4c, user_id=fed17418ec8741cd828de2ab3ce1c232, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:41.323778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a7c10-ac57-49cf-80f9-3b94345f9921 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:41.345730 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4306/8684] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:41 2022] PUT /identity/v3/projects/b9b332a8c4484a149d9c56ac66547b4c/users/fed17418ec8741cd828de2ab3ce1c232/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:41.349910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18921f29-ac82-4d2b-b709-11b528ceb4e6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:41.362088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18921f29-ac82-4d2b-b709-11b528ceb4e6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:41.451627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e985383-e0a8-4972-8170-39dbe432e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:41.452995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e985383-e0a8-4972-8170-39dbe432e4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:41.453282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e985383-e0a8-4972-8170-39dbe432e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:41.453630 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e985383-e0a8-4972-8170-39dbe432e4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:41.454289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e985383-e0a8-4972-8170-39dbe432e4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:41.458891 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e985383-e0a8-4972-8170-39dbe432e4a1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:41.496094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a7c10-ac57-49cf-80f9-3b94345f9921 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:41.501774 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4379/8685] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:10:41.516128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a7c10-ac57-49cf-80f9-3b94345f9921 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:41.524853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca86c37-6542-4b9c-8948-074dca25679d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:41.525569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86c37-6542-4b9c-8948-074dca25679d admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:41.528913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86c37-6542-4b9c-8948-074dca25679d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:41.529216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86c37-6542-4b9c-8948-074dca25679d admin admin] PATH_INFO: `/v3/projects/b9b332a8c4484a149d9c56ac66547b4c/users/fed17418ec8741cd828de2ab3ce1c232/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:41.540578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca86c37-6542-4b9c-8948-074dca25679d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b332a8c4484a149d9c56ac66547b4c, user_id=fed17418ec8741cd828de2ab3ce1c232, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:41.540578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca86c37-6542-4b9c-8948-074dca25679d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:41.571336 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4307/8686] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:10:41 2022] PUT /identity/v3/projects/b9b332a8c4484a149d9c56ac66547b4c/users/fed17418ec8741cd828de2ab3ce1c232/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:10:51.479311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=83,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:51.564075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=53,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:51.671126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b9019-f674-4e49-b555-a7994484ebda None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:51.671412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b9019-f674-4e49-b555-a7994484ebda None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:51.671694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b9019-f674-4e49-b555-a7994484ebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:51.779899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c82b9019-f674-4e49-b555-a7994484ebda None None] MFA Rules not processed for user `fed17418ec8741cd828de2ab3ce1c232`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:51.798798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c82b9019-f674-4e49-b555-a7994484ebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:52.054183 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4380/8687] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:52.066810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca86c37-6542-4b9c-8948-074dca25679d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:52.068582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1ca86c37-6542-4b9c-8948-074dca25679d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:52.323186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca86c37-6542-4b9c-8948-074dca25679d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:52.331940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fda1c0-dae2-4617-aea1-9c385c4aff93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:52.332108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fda1c0-dae2-4617-aea1-9c385c4aff93 service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:52.332396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fda1c0-dae2-4617-aea1-9c385c4aff93 service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:52.332676 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fda1c0-dae2-4617-aea1-9c385c4aff93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:52.451904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fda1c0-dae2-4617-aea1-9c385c4aff93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:52.453944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fda1c0-dae2-4617-aea1-9c385c4aff93 service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:52.496196 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4308/8688] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:10:55.524867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7666-820c-42d6-88e2-4dd0bf6c3840 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:55.525505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7666-820c-42d6-88e2-4dd0bf6c3840 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:55.526080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc7666-820c-42d6-88e2-4dd0bf6c3840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:55.590566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8cbc7666-820c-42d6-88e2-4dd0bf6c3840 None None] MFA Rules not processed for user `e276b9fae4594c17a1883dd4e48184c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:10:55.592714 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8cbc7666-820c-42d6-88e2-4dd0bf6c3840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:55.720641 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4381/8689] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:10:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:10:56.591618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fda1c0-dae2-4617-aea1-9c385c4aff93 service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:10:56.593867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-89fda1c0-dae2-4617-aea1-9c385c4aff93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:56.729813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fda1c0-dae2-4617-aea1-9c385c4aff93 service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:10:56.735378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7639-dc1c-44db-9ab9-195d2f2bb7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:10:56.735973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7639-dc1c-44db-9ab9-195d2f2bb7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:10:56.736250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7639-dc1c-44db-9ab9-195d2f2bb7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:10:56.736873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7639-dc1c-44db-9ab9-195d2f2bb7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:10:56.739720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-28cb7639-dc1c-44db-9ab9-195d2f2bb7b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:10:56.763941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7639-dc1c-44db-9ab9-195d2f2bb7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:10:56.766759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7639-dc1c-44db-9ab9-195d2f2bb7b2 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:10:56.793001 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4309/8690] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:10:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:01.962174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc7666-820c-42d6-88e2-4dd0bf6c3840 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:01.979691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc7666-820c-42d6-88e2-4dd0bf6c3840 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:01.987537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e44f8-080e-498a-9510-09650e7b40ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:01.989163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e44f8-080e-498a-9510-09650e7b40ae service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:01.989658 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e44f8-080e-498a-9510-09650e7b40ae service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:02.023762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e44f8-080e-498a-9510-09650e7b40ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:02.042522 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7b4e44f8-080e-498a-9510-09650e7b40ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:02.252312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e44f8-080e-498a-9510-09650e7b40ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:02.254043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e44f8-080e-498a-9510-09650e7b40ae service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:02.284057 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4382/8691] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:05.512775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7639-dc1c-44db-9ab9-195d2f2bb7b2 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:05.550369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7639-dc1c-44db-9ab9-195d2f2bb7b2 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:05.555782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013381e-8bd4-4b3e-89c7-5231ec8e4cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:05.557006 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013381e-8bd4-4b3e-89c7-5231ec8e4cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:05.558928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013381e-8bd4-4b3e-89c7-5231ec8e4cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:05.559539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013381e-8bd4-4b3e-89c7-5231ec8e4cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:05.562349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0013381e-8bd4-4b3e-89c7-5231ec8e4cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:05.622661 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013381e-8bd4-4b3e-89c7-5231ec8e4cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:05.626953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013381e-8bd4-4b3e-89c7-5231ec8e4cd7 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:05.662881 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4310/8692] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:09.305942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d0c2-27c9-4014-8a03-a5949d27e660 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:09.306514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d0c2-27c9-4014-8a03-a5949d27e660 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:09.306514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d0c2-27c9-4014-8a03-a5949d27e660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:09.333132 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bce3d0c2-27c9-4014-8a03-a5949d27e660 None None] MFA Rules not processed for user `82d1a354ca7f421f803b50f2ff4a48c2`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:09.334807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bce3d0c2-27c9-4014-8a03-a5949d27e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:09.340359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:09.418245 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4383/8693] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:11:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:15.649804 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:19.408333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=21 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:28.897304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013381e-8bd4-4b3e-89c7-5231ec8e4cd7 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:28.898931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0013381e-8bd4-4b3e-89c7-5231ec8e4cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:29.019881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013381e-8bd4-4b3e-89c7-5231ec8e4cd7 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:29.025116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551c9a7-8d8a-4e21-861e-d39bd443baec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:29.025805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551c9a7-8d8a-4e21-861e-d39bd443baec service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:29.026083 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551c9a7-8d8a-4e21-861e-d39bd443baec service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:29.026567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551c9a7-8d8a-4e21-861e-d39bd443baec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:29.035271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551c9a7-8d8a-4e21-861e-d39bd443baec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:29.037078 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551c9a7-8d8a-4e21-861e-d39bd443baec service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:29.046092 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4311/8694] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:11:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:11:31.120341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3d0c2-27c9-4014-8a03-a5949d27e660 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:31.121948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bce3d0c2-27c9-4014-8a03-a5949d27e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:31.189360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3d0c2-27c9-4014-8a03-a5949d27e660 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:31.194116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:31.194749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:31.195036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:31.195315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] PATH_INFO: `/v3/users/f75ae7a10ac14e0fb2b79127f39db44f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:31.197414 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75ae7a10ac14e0fb2b79127f39db44f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:31.199883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:31.248177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75ae7a10ac14e0fb2b79127f39db44f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.249529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75ae7a10ac14e0fb2b79127f39db44f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.263083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75ae7a10ac14e0fb2b79127f39db44f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.263760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75ae7a10ac14e0fb2b79127f39db44f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.273836 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75ae7a10ac14e0fb2b79127f39db44f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.290863 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4384/8695] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:31 2022] DELETE /identity/v3/users/f75ae7a10ac14e0fb2b79127f39db44f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:31.293594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02f291-f109-4f15-8743-8f9b538ba5e4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:31.294502 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02f291-f109-4f15-8743-8f9b538ba5e4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:31.294789 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02f291-f109-4f15-8743-8f9b538ba5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:31.318985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ac02f291-f109-4f15-8743-8f9b538ba5e4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:31.320608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ac02f291-f109-4f15-8743-8f9b538ba5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:31.393434 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4312/8696] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:31.401538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:31.403776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:31.479133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f095a40-89a9-4376-9537-a7166cb80720 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:31.483736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f419a0b-4bcd-4039-84b4-c056243c7189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:31.484397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f419a0b-4bcd-4039-84b4-c056243c7189 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:31.484718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f419a0b-4bcd-4039-84b4-c056243c7189 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:31.485043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f419a0b-4bcd-4039-84b4-c056243c7189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:31.495584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f419a0b-4bcd-4039-84b4-c056243c7189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:31.497234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f419a0b-4bcd-4039-84b4-c056243c7189 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:31.510359 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4385/8697] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:31.703196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02f291-f109-4f15-8743-8f9b538ba5e4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:31.704628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ac02f291-f109-4f15-8743-8f9b538ba5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:31.721585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02f291-f109-4f15-8743-8f9b538ba5e4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:31.727417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:31.728354 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:31.728813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:31.729261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] PATH_INFO: `/v3/projects/1e7d5ef767224e8fb02c48708db23238` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:31.731453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7d5ef767224e8fb02c48708db23238)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:31.733617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:31.790822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7d5ef767224e8fb02c48708db23238', 'request_id': 'req-c3505915-ed76-4274-ad02-2aedf58658d5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.796977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7d5ef767224e8fb02c48708db23238', 'request_id': 'req-c3505915-ed76-4274-ad02-2aedf58658d5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.816165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7d5ef767224e8fb02c48708db23238', 'request_id': 'req-c3505915-ed76-4274-ad02-2aedf58658d5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.817775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:31.840061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] The token cache is being invalidate because project 1e7d5ef767224e8fb02c48708db23238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:31.840304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.840965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:31.849476 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4313/8698] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:31 2022] DELETE /identity/v3/projects/1e7d5ef767224e8fb02c48708db23238 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:40.871367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f419a0b-4bcd-4039-84b4-c056243c7189 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:40.873001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0f419a0b-4bcd-4039-84b4-c056243c7189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:40.907406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:41.028956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f419a0b-4bcd-4039-84b4-c056243c7189 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:41.153671 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1ff7-f923-4e33-b11b-c52b48fd4339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:41.154783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1ff7-f923-4e33-b11b-c52b48fd4339 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:41.155266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1ff7-f923-4e33-b11b-c52b48fd4339 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:41.155835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1ff7-f923-4e33-b11b-c52b48fd4339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:41.165582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-124b1ff7-f923-4e33-b11b-c52b48fd4339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:41.299356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b1ff7-f923-4e33-b11b-c52b48fd4339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:41.300995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b1ff7-f923-4e33-b11b-c52b48fd4339 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:41.317267 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4386/8699] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:41.839294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:43.245185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:43.246792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:43.312047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3505915-ed76-4274-ad02-2aedf58658d5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:43.316365 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f76e12-d1a1-46e3-b508-ad3e09a5d29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:43.316997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f76e12-d1a1-46e3-b508-ad3e09a5d29c service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:43.317277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f76e12-d1a1-46e3-b508-ad3e09a5d29c service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:43.317585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f76e12-d1a1-46e3-b508-ad3e09a5d29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:43.319758 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-29f76e12-d1a1-46e3-b508-ad3e09a5d29c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:43.385507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f76e12-d1a1-46e3-b508-ad3e09a5d29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:43.386932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f76e12-d1a1-46e3-b508-ad3e09a5d29c service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:43.397523 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4314/8700] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:50.298729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1ff7-f923-4e33-b11b-c52b48fd4339 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:50.303605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-124b1ff7-f923-4e33-b11b-c52b48fd4339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:50.320885 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1ff7-f923-4e33-b11b-c52b48fd4339 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:50.326570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:50.327477 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:50.327914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:50.328285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] PATH_INFO: `/v3/users/627ff3308c2c43f28573edf551f779aa` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:50.329610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=627ff3308c2c43f28573edf551f779aa)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:50.331699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:50.380834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627ff3308c2c43f28573edf551f779aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.381620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627ff3308c2c43f28573edf551f779aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.386945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:50.398830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627ff3308c2c43f28573edf551f779aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.399879 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627ff3308c2c43f28573edf551f779aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.408627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627ff3308c2c43f28573edf551f779aa'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.423346 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4387/8701] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:50 2022] DELETE /identity/v3/users/627ff3308c2c43f28573edf551f779aa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:50.601887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f76e12-d1a1-46e3-b508-ad3e09a5d29c service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:50.622037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f76e12-d1a1-46e3-b508-ad3e09a5d29c service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:50.686061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:50.687087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:50.687504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:50.687774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] PATH_INFO: `/v3/projects/c88deb8d5f864d368528400104c35e1a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:50.689109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88deb8d5f864d368528400104c35e1a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:50.691155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:50.747234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88deb8d5f864d368528400104c35e1a', 'request_id': 'req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.750098 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:50.755134 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88deb8d5f864d368528400104c35e1a', 'request_id': 'req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.764527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88deb8d5f864d368528400104c35e1a', 'request_id': 'req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.777103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] The token cache is being invalidate because project c88deb8d5f864d368528400104c35e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:50.777449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.778116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.779666 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4315/8702] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:50 2022] DELETE /identity/v3/projects/c88deb8d5f864d368528400104c35e1a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:50.783930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:50.785413 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:50.798586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57874e6c-55d9-4b3c-8a9c-9dc1faeef328 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:50.855115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946b225-8dce-4930-809e-e1cf3caf16a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:50.855747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946b225-8dce-4930-809e-e1cf3caf16a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:50.856030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946b225-8dce-4930-809e-e1cf3caf16a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:50.856306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946b225-8dce-4930-809e-e1cf3caf16a5 admin admin] PATH_INFO: `/v3/users/8975805f925f4c7dae6deb4fbce87e2f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:50.857993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946b225-8dce-4930-809e-e1cf3caf16a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8975805f925f4c7dae6deb4fbce87e2f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:50.859918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946b225-8dce-4930-809e-e1cf3caf16a5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:50.907618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5946b225-8dce-4930-809e-e1cf3caf16a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8975805f925f4c7dae6deb4fbce87e2f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.908218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5946b225-8dce-4930-809e-e1cf3caf16a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8975805f925f4c7dae6deb4fbce87e2f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.920709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5946b225-8dce-4930-809e-e1cf3caf16a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8975805f925f4c7dae6deb4fbce87e2f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.921634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5946b225-8dce-4930-809e-e1cf3caf16a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8975805f925f4c7dae6deb4fbce87e2f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.928478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-5946b225-8dce-4930-809e-e1cf3caf16a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8975805f925f4c7dae6deb4fbce87e2f'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:50.944243 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4388/8703] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:11:50 2022] DELETE /identity/v3/users/8975805f925f4c7dae6deb4fbce87e2f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:51.118574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:51.120131 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:51.146122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18c1fa-933e-46b6-b7f0-e6c09fb9f3ab admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:51.206831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:51.207384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:51.207666 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:51.207939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] PATH_INFO: `/v3/projects/af438921227c4a3bacadd3b785531ad0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:51.209049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=af438921227c4a3bacadd3b785531ad0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:51.210974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:51.259258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af438921227c4a3bacadd3b785531ad0', 'request_id': 'req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:51.265117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af438921227c4a3bacadd3b785531ad0', 'request_id': 'req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:51.272824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af438921227c4a3bacadd3b785531ad0', 'request_id': 'req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:51.284894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] The token cache is being invalidate because project af438921227c4a3bacadd3b785531ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:11:51.285192 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:51.285861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-13ad6f0e-117a-4dba-b4da-6b421bd9d51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:11:51.287370 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4316/8704] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:11:51 2022] DELETE /identity/v3/projects/af438921227c4a3bacadd3b785531ad0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:51.292482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6946fa-3b78-4a54-9a62-ffdaf0fc7ddb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:51.292823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6946fa-3b78-4a54-9a62-ffdaf0fc7ddb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:51.293103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6946fa-3b78-4a54-9a62-ffdaf0fc7ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:51.313554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ce6946fa-3b78-4a54-9a62-ffdaf0fc7ddb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:51.314742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ce6946fa-3b78-4a54-9a62-ffdaf0fc7ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:51.358750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:51.376146 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4389/8705] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:51.383784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af69e-845b-4d84-8b44-51a4d8ac93f4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:51.384072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af69e-845b-4d84-8b44-51a4d8ac93f4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:51.384351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af69e-845b-4d84-8b44-51a4d8ac93f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:51.404900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a87af69e-845b-4d84-8b44-51a4d8ac93f4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:51.406141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a87af69e-845b-4d84-8b44-51a4d8ac93f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:51.414327 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4317/8706] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:11:51.418826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6946fa-3b78-4a54-9a62-ffdaf0fc7ddb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:51.429830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6946fa-3b78-4a54-9a62-ffdaf0fc7ddb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:51.435634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dec7f-fefd-404f-af2d-61e5443b08d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:51.436323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dec7f-fefd-404f-af2d-61e5443b08d0 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:51.436496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dec7f-fefd-404f-af2d-61e5443b08d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:51.436772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dec7f-fefd-404f-af2d-61e5443b08d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:51.437433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dec7f-fefd-404f-af2d-61e5443b08d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:11:51.437737 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dec7f-fefd-404f-af2d-61e5443b08d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:51.439444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dec7f-fefd-404f-af2d-61e5443b08d0 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:51.451977 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4390/8707] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:11:51.456373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87af69e-845b-4d84-8b44-51a4d8ac93f4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:51.468737 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87af69e-845b-4d84-8b44-51a4d8ac93f4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:51.473749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb4f33-d966-41fa-b3a3-a5b0c89142c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:51.474417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb4f33-d966-41fa-b3a3-a5b0c89142c9 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:51.474719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb4f33-d966-41fa-b3a3-a5b0c89142c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:51.475027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb4f33-d966-41fa-b3a3-a5b0c89142c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:51.475723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb4f33-d966-41fa-b3a3-a5b0c89142c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:51.477912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb4f33-d966-41fa-b3a3-a5b0c89142c9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:51.509163 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4318/8708] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:51 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:51.513504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dec7f-fefd-404f-af2d-61e5443b08d0 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:51.523668 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dec7f-fefd-404f-af2d-61e5443b08d0 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:51.583742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b932164-c5a0-44de-b87c-94a0bfa10865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:51.584340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b932164-c5a0-44de-b87c-94a0bfa10865 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:51.584620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b932164-c5a0-44de-b87c-94a0bfa10865 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:51.585432 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b932164-c5a0-44de-b87c-94a0bfa10865 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:51.585607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b932164-c5a0-44de-b87c-94a0bfa10865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:51.587443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b932164-c5a0-44de-b87c-94a0bfa10865 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:51.609085 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4391/8709] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:51 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:51.613245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb4f33-d966-41fa-b3a3-a5b0c89142c9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:51.624004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb4f33-d966-41fa-b3a3-a5b0c89142c9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:51.628874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec6975-8fae-4634-b7b4-ed8293103d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:51.629554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec6975-8fae-4634-b7b4-ed8293103d16 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:51.629833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec6975-8fae-4634-b7b4-ed8293103d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:51.630104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec6975-8fae-4634-b7b4-ed8293103d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:51.630767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec6975-8fae-4634-b7b4-ed8293103d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:51.632346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec6975-8fae-4634-b7b4-ed8293103d16 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:51.642696 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4319/8710] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:51.646708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b932164-c5a0-44de-b87c-94a0bfa10865 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:51.657807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b932164-c5a0-44de-b87c-94a0bfa10865 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:51.662383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc1284-d4c5-4945-900d-6b872d8a1e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:51.662973 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1284-d4c5-4945-900d-6b872d8a1e49 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:51.663252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1284-d4c5-4945-900d-6b872d8a1e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:51.663524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1284-d4c5-4945-900d-6b872d8a1e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:51.664193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc1284-d4c5-4945-900d-6b872d8a1e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:51.665797 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc1284-d4c5-4945-900d-6b872d8a1e49 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:51.676271 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4392/8711] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:11:51.680409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec6975-8fae-4634-b7b4-ed8293103d16 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:51.690864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec6975-8fae-4634-b7b4-ed8293103d16 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:51.695575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758df67a-5948-4b76-aaf8-0d41a36b117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:51.696221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758df67a-5948-4b76-aaf8-0d41a36b117a admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:51.696504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758df67a-5948-4b76-aaf8-0d41a36b117a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:51.696798 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758df67a-5948-4b76-aaf8-0d41a36b117a admin admin] PATH_INFO: `/v3/projects/4b810c0ee0404ded9135166c917a8732/users/4835a0c3f96a40e7aaa85b2208b722f0/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:51.712373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758df67a-5948-4b76-aaf8-0d41a36b117a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b810c0ee0404ded9135166c917a8732, user_id=4835a0c3f96a40e7aaa85b2208b722f0, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:51.715071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758df67a-5948-4b76-aaf8-0d41a36b117a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:51.728019 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4320/8712] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:51 2022] PUT /identity/v3/projects/4b810c0ee0404ded9135166c917a8732/users/4835a0c3f96a40e7aaa85b2208b722f0/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:11:51.732944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21b1e-4b2f-4e41-8bd4-8565321bb65f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:51.733307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21b1e-4b2f-4e41-8bd4-8565321bb65f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:51.733614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21b1e-4b2f-4e41-8bd4-8565321bb65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:51.752996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7df21b1e-4b2f-4e41-8bd4-8565321bb65f None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:51.754230 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7df21b1e-4b2f-4e41-8bd4-8565321bb65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:51.817199 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4393/8713] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:51.827413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758df67a-5948-4b76-aaf8-0d41a36b117a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:51.829186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-758df67a-5948-4b76-aaf8-0d41a36b117a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:51.840095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:51.894713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758df67a-5948-4b76-aaf8-0d41a36b117a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:51.898568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258ad0-a6e2-4687-95b0-7f194b812720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:51.899185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258ad0-a6e2-4687-95b0-7f194b812720 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:51.899470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258ad0-a6e2-4687-95b0-7f194b812720 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:51.899746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258ad0-a6e2-4687-95b0-7f194b812720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:51.910848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49258ad0-a6e2-4687-95b0-7f194b812720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:51.912305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49258ad0-a6e2-4687-95b0-7f194b812720 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:51.923013 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4321/8714] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:11:56.328299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4bda-8b83-47c7-b9ff-120addb40770 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:56.329245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4bda-8b83-47c7-b9ff-120addb40770 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:56.329828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4bda-8b83-47c7-b9ff-120addb40770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:56.366652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-53df4bda-8b83-47c7-b9ff-120addb40770 None None] MFA Rules not processed for user `4835a0c3f96a40e7aaa85b2208b722f0`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:11:56.367939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-53df4bda-8b83-47c7-b9ff-120addb40770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:11:56.455016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:56.495620 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4394/8715] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:11:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:11:56.500285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258ad0-a6e2-4687-95b0-7f194b812720 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:56.517352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258ad0-a6e2-4687-95b0-7f194b812720 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:56.522119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e606c7-7c44-40e5-8d55-7c7b940b113b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:56.522735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e606c7-7c44-40e5-8d55-7c7b940b113b admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:56.523014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e606c7-7c44-40e5-8d55-7c7b940b113b admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:56.523285 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e606c7-7c44-40e5-8d55-7c7b940b113b admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:56.523917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e606c7-7c44-40e5-8d55-7c7b940b113b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:56.526043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e606c7-7c44-40e5-8d55-7c7b940b113b admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:56.560013 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4322/8716] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:11:56 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:11:56.565247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4bda-8b83-47c7-b9ff-120addb40770 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:56.577603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4bda-8b83-47c7-b9ff-120addb40770 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:56.649057 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ed7af-cec1-47ab-9ce1-e7860bfe15b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:56.649702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ed7af-cec1-47ab-9ce1-e7860bfe15b1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:56.649987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ed7af-cec1-47ab-9ce1-e7860bfe15b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:56.650266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ed7af-cec1-47ab-9ce1-e7860bfe15b1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:56.650903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ed7af-cec1-47ab-9ce1-e7860bfe15b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:56.652822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ed7af-cec1-47ab-9ce1-e7860bfe15b1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:56.675913 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4395/8717] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:11:56 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:11:56.679915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e606c7-7c44-40e5-8d55-7c7b940b113b admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:56.691534 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e606c7-7c44-40e5-8d55-7c7b940b113b admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:56.696695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1bc8-0064-4b4c-bf55-4610e528030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:56.697403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1bc8-0064-4b4c-bf55-4610e528030a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:56.697701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1bc8-0064-4b4c-bf55-4610e528030a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:56.697982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1bc8-0064-4b4c-bf55-4610e528030a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:56.698637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df1bc8-0064-4b4c-bf55-4610e528030a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:56.700259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df1bc8-0064-4b4c-bf55-4610e528030a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:56.712834 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4323/8718] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:56.717219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ed7af-cec1-47ab-9ce1-e7860bfe15b1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:56.728441 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ed7af-cec1-47ab-9ce1-e7860bfe15b1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:56.733418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be989d-b288-4af9-a07c-230a19af083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:56.734156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be989d-b288-4af9-a07c-230a19af083f admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:56.734504 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be989d-b288-4af9-a07c-230a19af083f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:56.734841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be989d-b288-4af9-a07c-230a19af083f admin admin] PATH_INFO: `/v3/projects/b5be276dead34d0198b8996a7a9b1201/users/fb06ceeca6664223b156d1bc7b1c32a1/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:56.752975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be989d-b288-4af9-a07c-230a19af083f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5be276dead34d0198b8996a7a9b1201, user_id=fb06ceeca6664223b156d1bc7b1c32a1, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:56.758333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be989d-b288-4af9-a07c-230a19af083f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:56.775532 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4396/8719] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:56 2022] PUT /identity/v3/projects/b5be276dead34d0198b8996a7a9b1201/users/fb06ceeca6664223b156d1bc7b1c32a1/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:11:56.779813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1bc8-0064-4b4c-bf55-4610e528030a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:56.791169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1bc8-0064-4b4c-bf55-4610e528030a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:56.854480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501e033-c75c-47f4-ac35-982150e5e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:56.855100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501e033-c75c-47f4-ac35-982150e5e86d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:56.855411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501e033-c75c-47f4-ac35-982150e5e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:56.855663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501e033-c75c-47f4-ac35-982150e5e86d admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:56.856309 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501e033-c75c-47f4-ac35-982150e5e86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:56.858499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501e033-c75c-47f4-ac35-982150e5e86d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:56.869780 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4324/8720] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:11:56.874227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be989d-b288-4af9-a07c-230a19af083f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:11:56.888288 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be989d-b288-4af9-a07c-230a19af083f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:11:56.893665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1b48a-8843-4d38-b792-b0356262075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:11:56.894435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1b48a-8843-4d38-b792-b0356262075d admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:11:56.894838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1b48a-8843-4d38-b792-b0356262075d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:11:56.895212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1b48a-8843-4d38-b792-b0356262075d admin admin] PATH_INFO: `/v3/projects/b5be276dead34d0198b8996a7a9b1201/users/fb06ceeca6664223b156d1bc7b1c32a1/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:11:56.897564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1b48a-8843-4d38-b792-b0356262075d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5be276dead34d0198b8996a7a9b1201, user_id=fb06ceeca6664223b156d1bc7b1c32a1, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:11:56.901265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1b48a-8843-4d38-b792-b0356262075d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:11:56.914661 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4397/8721] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:11:56 2022] PUT /identity/v3/projects/b5be276dead34d0198b8996a7a9b1201/users/fb06ceeca6664223b156d1bc7b1c32a1/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:12:04.071569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be0821-0f9a-4bcd-9ef5-95497f4f0989 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:04.072167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be0821-0f9a-4bcd-9ef5-95497f4f0989 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:04.072167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be0821-0f9a-4bcd-9ef5-95497f4f0989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:04.145638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e0be0821-0f9a-4bcd-9ef5-95497f4f0989 None None] MFA Rules not processed for user `fb06ceeca6664223b156d1bc7b1c32a1`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:04.147415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e0be0821-0f9a-4bcd-9ef5-95497f4f0989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:04.282639 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:04.288222 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4325/8722] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:12:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:04.301455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1b48a-8843-4d38-b792-b0356262075d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:04.303760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9fd1b48a-8843-4d38-b792-b0356262075d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:04.419528 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1b48a-8843-4d38-b792-b0356262075d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:04.425729 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd748c-aa21-4f5b-bbda-27771c526d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:04.426285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd748c-aa21-4f5b-bbda-27771c526d7d service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:04.426566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd748c-aa21-4f5b-bbda-27771c526d7d service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:04.426839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd748c-aa21-4f5b-bbda-27771c526d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:04.436517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd748c-aa21-4f5b-bbda-27771c526d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:04.440942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd748c-aa21-4f5b-bbda-27771c526d7d service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:04.465926 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4398/8723] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:04.524097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30877de-fe58-4867-bdd6-2b600aa78dd3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:04.525188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30877de-fe58-4867-bdd6-2b600aa78dd3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:04.525714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30877de-fe58-4867-bdd6-2b600aa78dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:04.555740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f30877de-fe58-4867-bdd6-2b600aa78dd3 None None] MFA Rules not processed for user `4835a0c3f96a40e7aaa85b2208b722f0`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:04.557532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f30877de-fe58-4867-bdd6-2b600aa78dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:04.653152 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4326/8724] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:12:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:09.171896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd748c-aa21-4f5b-bbda-27771c526d7d service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:09.238311 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:09.330471 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd748c-aa21-4f5b-bbda-27771c526d7d service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:09.336061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd79879-7a85-4d5a-bc3b-cb0d5c327a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:09.338119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79879-7a85-4d5a-bc3b-cb0d5c327a07 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:09.344834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79879-7a85-4d5a-bc3b-cb0d5c327a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:09.345112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79879-7a85-4d5a-bc3b-cb0d5c327a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:09.354927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-efd79879-7a85-4d5a-bc3b-cb0d5c327a07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:09.372883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd79879-7a85-4d5a-bc3b-cb0d5c327a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:09.374448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd79879-7a85-4d5a-bc3b-cb0d5c327a07 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:09.421649 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4399/8725] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:09.873612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30877de-fe58-4867-bdd6-2b600aa78dd3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:09.875698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f30877de-fe58-4867-bdd6-2b600aa78dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:09.950784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30877de-fe58-4867-bdd6-2b600aa78dd3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:09.956803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:09.957237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:09.957550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:09.957828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] PATH_INFO: `/v3/users/82d1a354ca7f421f803b50f2ff4a48c2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:09.959244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d1a354ca7f421f803b50f2ff4a48c2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:09.961175 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:10.051938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d1a354ca7f421f803b50f2ff4a48c2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:10.054199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d1a354ca7f421f803b50f2ff4a48c2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:10.069897 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d1a354ca7f421f803b50f2ff4a48c2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:10.085341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d1a354ca7f421f803b50f2ff4a48c2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:10.096305 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d1a354ca7f421f803b50f2ff4a48c2'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:10.107856 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4327/8726] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:09 2022] DELETE /identity/v3/users/82d1a354ca7f421f803b50f2ff4a48c2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:10.111069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71dd4b-c950-4c72-9b24-504e854878b8 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:10.119303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71dd4b-c950-4c72-9b24-504e854878b8 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:10.120946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71dd4b-c950-4c72-9b24-504e854878b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:10.148064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-6a71dd4b-c950-4c72-9b24-504e854878b8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:10.149938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6a71dd4b-c950-4c72-9b24-504e854878b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:10.246158 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4400/8727] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:12:10.262504 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:10.264323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:10.321205 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:10.422711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303bf8-32dc-43bc-a65a-24364b176a94 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:10.429702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde411c-38de-4d88-b87c-93cf59f26436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:10.433139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde411c-38de-4d88-b87c-93cf59f26436 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:10.433606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde411c-38de-4d88-b87c-93cf59f26436 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:10.434014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde411c-38de-4d88-b87c-93cf59f26436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:10.445911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde411c-38de-4d88-b87c-93cf59f26436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:10.447535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde411c-38de-4d88-b87c-93cf59f26436 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:10.463112 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4328/8728] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:12:10.741119 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71dd4b-c950-4c72-9b24-504e854878b8 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:10.742661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6a71dd4b-c950-4c72-9b24-504e854878b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:10.787142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71dd4b-c950-4c72-9b24-504e854878b8 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:10.804685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:10.805483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:10.805944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:10.806314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] PATH_INFO: `/v3/projects/4bca2cda19a74c118c8564c694149b95` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:10.808442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bca2cda19a74c118c8564c694149b95)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:10.816787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:10.919327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bca2cda19a74c118c8564c694149b95', 'request_id': 'req-d25e4b35-eb2e-45a5-b9da-58031aafa973'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:10.947124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bca2cda19a74c118c8564c694149b95', 'request_id': 'req-d25e4b35-eb2e-45a5-b9da-58031aafa973'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:10.963016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bca2cda19a74c118c8564c694149b95', 'request_id': 'req-d25e4b35-eb2e-45a5-b9da-58031aafa973'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:10.976850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] The token cache is being invalidate because project 4bca2cda19a74c118c8564c694149b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:10.976850 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:10.977620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:10.983621 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4401/8729] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:10 2022] DELETE /identity/v3/projects/4bca2cda19a74c118c8564c694149b95 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:10.984234 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde411c-38de-4d88-b87c-93cf59f26436 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:10.998171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde411c-38de-4d88-b87c-93cf59f26436 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:11.071538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379a169-e12a-4bca-b7bb-0f391e87c0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:11.072351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379a169-e12a-4bca-b7bb-0f391e87c0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:11.072720 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379a169-e12a-4bca-b7bb-0f391e87c0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:11.073092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379a169-e12a-4bca-b7bb-0f391e87c0f7 admin admin] PATH_INFO: `/v3/users/661515b1ced1404db0d025d44bbefad0` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:11.074524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379a169-e12a-4bca-b7bb-0f391e87c0f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661515b1ced1404db0d025d44bbefad0)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:11.077252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379a169-e12a-4bca-b7bb-0f391e87c0f7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:11.133281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d379a169-e12a-4bca-b7bb-0f391e87c0f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661515b1ced1404db0d025d44bbefad0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:11.134104 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d379a169-e12a-4bca-b7bb-0f391e87c0f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661515b1ced1404db0d025d44bbefad0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:11.153000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d379a169-e12a-4bca-b7bb-0f391e87c0f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661515b1ced1404db0d025d44bbefad0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:11.161665 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d379a169-e12a-4bca-b7bb-0f391e87c0f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661515b1ced1404db0d025d44bbefad0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:11.168967 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-d379a169-e12a-4bca-b7bb-0f391e87c0f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661515b1ced1404db0d025d44bbefad0'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:11.176016 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4329/8730] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:10 2022] DELETE /identity/v3/users/661515b1ced1404db0d025d44bbefad0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:11.489874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:11.491558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:11.511433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4b35-eb2e-45a5-b9da-58031aafa973 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:11.567874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:11.581219 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:11.581911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:11.582196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:11.582472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] PATH_INFO: `/v3/projects/cb073b691ba945f0954eaee508ad0f99` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:11.583601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb073b691ba945f0954eaee508ad0f99)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:11.585544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:11.632845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb073b691ba945f0954eaee508ad0f99', 'request_id': 'req-28af179b-62d9-453a-808b-4072396ab66a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:11.639837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb073b691ba945f0954eaee508ad0f99', 'request_id': 'req-28af179b-62d9-453a-808b-4072396ab66a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:11.647036 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb073b691ba945f0954eaee508ad0f99', 'request_id': 'req-28af179b-62d9-453a-808b-4072396ab66a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:11.658420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] The token cache is being invalidate because project cb073b691ba945f0954eaee508ad0f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:11.658706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:11.659345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:11.660846 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4402/8731] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:11 2022] DELETE /identity/v3/projects/cb073b691ba945f0954eaee508ad0f99 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:18.373152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159a2b-cfc5-4f41-bee2-ad358b8b85e6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:18.374269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159a2b-cfc5-4f41-bee2-ad358b8b85e6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:18.374269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159a2b-cfc5-4f41-bee2-ad358b8b85e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:18.404249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-47159a2b-cfc5-4f41-bee2-ad358b8b85e6 None None] MFA Rules not processed for user `4835a0c3f96a40e7aaa85b2208b722f0`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:12:18.405693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-47159a2b-cfc5-4f41-bee2-ad358b8b85e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:18.449058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:18.467339 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4330/8732] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:12:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:12:21.655706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:28.459932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:42.000094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:42.001582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:42.089487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af179b-62d9-453a-808b-4072396ab66a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:42.094401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:42.095205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:42.095422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:42.095694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] PATH_INFO: `/v3/users/4835a0c3f96a40e7aaa85b2208b722f0` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:42.096832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4835a0c3f96a40e7aaa85b2208b722f0)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:42.098795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:42.151068 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4835a0c3f96a40e7aaa85b2208b722f0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.151778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4835a0c3f96a40e7aaa85b2208b722f0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.166804 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4835a0c3f96a40e7aaa85b2208b722f0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.167246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4835a0c3f96a40e7aaa85b2208b722f0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.174999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4835a0c3f96a40e7aaa85b2208b722f0'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.190139 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4403/8733] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:41 2022] DELETE /identity/v3/users/4835a0c3f96a40e7aaa85b2208b722f0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:42.392586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47159a2b-cfc5-4f41-bee2-ad358b8b85e6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:42.414268 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47159a2b-cfc5-4f41-bee2-ad358b8b85e6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:42.492324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:42.492976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:42.493260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:42.493602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] PATH_INFO: `/v3/projects/4b810c0ee0404ded9135166c917a8732` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:42.494757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b810c0ee0404ded9135166c917a8732)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:42.496694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:42.564005 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b810c0ee0404ded9135166c917a8732', 'request_id': 'req-ad398194-9dbd-4339-b3f6-7514bee47c12'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.576162 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b810c0ee0404ded9135166c917a8732', 'request_id': 'req-ad398194-9dbd-4339-b3f6-7514bee47c12'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.584584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b810c0ee0404ded9135166c917a8732', 'request_id': 'req-ad398194-9dbd-4339-b3f6-7514bee47c12'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.600511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] The token cache is being invalidate because project 4b810c0ee0404ded9135166c917a8732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:42.600803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.601507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.603075 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4331/8734] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:42 2022] DELETE /identity/v3/projects/4b810c0ee0404ded9135166c917a8732 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:42.607224 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:42.608943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:42.629917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b901c-a888-43f4-9e93-a4fbd0d4c956 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:42.696935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cbc11-45b0-4fe5-9e15-a1739928f75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:42.697629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cbc11-45b0-4fe5-9e15-a1739928f75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:42.697936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cbc11-45b0-4fe5-9e15-a1739928f75d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:42.698507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cbc11-45b0-4fe5-9e15-a1739928f75d admin admin] PATH_INFO: `/v3/users/fb06ceeca6664223b156d1bc7b1c32a1` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:42.699353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cbc11-45b0-4fe5-9e15-a1739928f75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb06ceeca6664223b156d1bc7b1c32a1)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:42.701805 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cbc11-45b0-4fe5-9e15-a1739928f75d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:42.724721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:42.751547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ae8cbc11-45b0-4fe5-9e15-a1739928f75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb06ceeca6664223b156d1bc7b1c32a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.752205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ae8cbc11-45b0-4fe5-9e15-a1739928f75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb06ceeca6664223b156d1bc7b1c32a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.764564 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ae8cbc11-45b0-4fe5-9e15-a1739928f75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb06ceeca6664223b156d1bc7b1c32a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.765275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ae8cbc11-45b0-4fe5-9e15-a1739928f75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb06ceeca6664223b156d1bc7b1c32a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.772066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-ae8cbc11-45b0-4fe5-9e15-a1739928f75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb06ceeca6664223b156d1bc7b1c32a1'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:42.784252 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4404/8735] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:12:42 2022] DELETE /identity/v3/users/fb06ceeca6664223b156d1bc7b1c32a1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:42.966227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:12:42.968287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:12:42.982445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad398194-9dbd-4339-b3f6-7514bee47c12 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:12:43.040626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:12:43.041259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:12:43.041593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:12:43.041892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] PATH_INFO: `/v3/projects/b5be276dead34d0198b8996a7a9b1201` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:12:43.042994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5be276dead34d0198b8996a7a9b1201)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:12:43.044923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:12:43.080211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:43.094589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5be276dead34d0198b8996a7a9b1201', 'request_id': 'req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.100185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5be276dead34d0198b8996a7a9b1201', 'request_id': 'req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.107879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5be276dead34d0198b8996a7a9b1201', 'request_id': 'req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.119094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] The token cache is being invalidate because project b5be276dead34d0198b8996a7a9b1201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:12:43.119385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.120028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:12:43.121556 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4332/8736] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:12:42 2022] DELETE /identity/v3/projects/b5be276dead34d0198b8996a7a9b1201 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:12:52.780961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:53.116079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:03.433582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbd4c-2017-419e-8bb7-acca2b2115da None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:03.434117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbd4c-2017-419e-8bb7-acca2b2115da None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:03.434334 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbd4c-2017-419e-8bb7-acca2b2115da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:03.454353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bd0fbd4c-2017-419e-8bb7-acca2b2115da None None] MFA Rules not processed for user `549d35b431a947eda45ea502b0dc753f`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:13:03.455547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bd0fbd4c-2017-419e-8bb7-acca2b2115da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:03.529655 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4405/8737] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:13:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:13:13.522340 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=25 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:24.952132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:24.953638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:25.014778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b678ae-a00a-4d2b-82a3-c457a8c6dba9 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:25.018539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238f02f-337a-42df-90bb-400667b9f8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:25.019231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238f02f-337a-42df-90bb-400667b9f8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:25.019601 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238f02f-337a-42df-90bb-400667b9f8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:25.019955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238f02f-337a-42df-90bb-400667b9f8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:25.021761 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a238f02f-337a-42df-90bb-400667b9f8e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:25.100032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238f02f-337a-42df-90bb-400667b9f8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:25.101585 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238f02f-337a-42df-90bb-400667b9f8e4 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:25.113872 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4333/8738] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:26.640951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbd4c-2017-419e-8bb7-acca2b2115da None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:26.642626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bd0fbd4c-2017-419e-8bb7-acca2b2115da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:26.658654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbd4c-2017-419e-8bb7-acca2b2115da None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:26.662730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658f17-e49c-493f-b5d3-f9365ab5dda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:26.663348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658f17-e49c-493f-b5d3-f9365ab5dda0 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:26.663627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658f17-e49c-493f-b5d3-f9365ab5dda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:26.663897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658f17-e49c-493f-b5d3-f9365ab5dda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:26.665719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cd658f17-e49c-493f-b5d3-f9365ab5dda0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:26.735111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd658f17-e49c-493f-b5d3-f9365ab5dda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:26.736479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd658f17-e49c-493f-b5d3-f9365ab5dda0 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:26.748096 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4406/8739] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:31.298167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238f02f-337a-42df-90bb-400667b9f8e4 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:31.299648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a238f02f-337a-42df-90bb-400667b9f8e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:31.381867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238f02f-337a-42df-90bb-400667b9f8e4 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:31.386939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcacfa-8ffe-46c6-ba0d-7cdbc2e06b20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:31.387558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcacfa-8ffe-46c6-ba0d-7cdbc2e06b20 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:31.387845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcacfa-8ffe-46c6-ba0d-7cdbc2e06b20 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:31.388672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcacfa-8ffe-46c6-ba0d-7cdbc2e06b20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:31.390615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-38fcacfa-8ffe-46c6-ba0d-7cdbc2e06b20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:31.408432 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcacfa-8ffe-46c6-ba0d-7cdbc2e06b20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:31.410463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcacfa-8ffe-46c6-ba0d-7cdbc2e06b20 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:31.424098 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4334/8740] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:13:34.703042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658f17-e49c-493f-b5d3-f9365ab5dda0 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:34.705002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-cd658f17-e49c-493f-b5d3-f9365ab5dda0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:34.721485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658f17-e49c-493f-b5d3-f9365ab5dda0 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:34.727605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:34.728429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:34.728718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:34.728996 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] PATH_INFO: `/v3/users/e276b9fae4594c17a1883dd4e48184c2` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:34.730383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e276b9fae4594c17a1883dd4e48184c2)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:34.733114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:34.782400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e276b9fae4594c17a1883dd4e48184c2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:34.783059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e276b9fae4594c17a1883dd4e48184c2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:34.795959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e276b9fae4594c17a1883dd4e48184c2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:34.796603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e276b9fae4594c17a1883dd4e48184c2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:34.804163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e276b9fae4594c17a1883dd4e48184c2'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:34.818405 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4407/8741] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:13:34 2022] DELETE /identity/v3/users/e276b9fae4594c17a1883dd4e48184c2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:35.004101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcacfa-8ffe-46c6-ba0d-7cdbc2e06b20 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:35.016626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcacfa-8ffe-46c6-ba0d-7cdbc2e06b20 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:35.063786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:35.083842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:35.084481 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:35.084762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:35.085038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] PATH_INFO: `/v3/projects/6fa1c2b97c8748ba831eb63c98d978c2` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:35.086281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa1c2b97c8748ba831eb63c98d978c2)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:35.088209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:35.137732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa1c2b97c8748ba831eb63c98d978c2', 'request_id': 'req-efb0fc90-7127-4201-8b7e-1af367efbd61'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.145212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa1c2b97c8748ba831eb63c98d978c2', 'request_id': 'req-efb0fc90-7127-4201-8b7e-1af367efbd61'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.153174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa1c2b97c8748ba831eb63c98d978c2', 'request_id': 'req-efb0fc90-7127-4201-8b7e-1af367efbd61'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.166061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] The token cache is being invalidate because project 6fa1c2b97c8748ba831eb63c98d978c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:13:35.166350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.167107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.168994 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4335/8742] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:13:35 2022] DELETE /identity/v3/projects/6fa1c2b97c8748ba831eb63c98d978c2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:35.173217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:35.174757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:35.188886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6e310-5ac8-4875-9291-53095ee8d53c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:35.250064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:35.250819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:35.251104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:35.251380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] PATH_INFO: `/v3/users/21a3b05def674718ba8ef668abf7ea46` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:35.262868 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:35.266365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a3b05def674718ba8ef668abf7ea46)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:35.268892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:35.316629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a3b05def674718ba8ef668abf7ea46'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.317221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a3b05def674718ba8ef668abf7ea46'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.328915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a3b05def674718ba8ef668abf7ea46'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.329593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a3b05def674718ba8ef668abf7ea46'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.336337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a3b05def674718ba8ef668abf7ea46'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.348228 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4408/8743] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:13:35 2022] DELETE /identity/v3/users/21a3b05def674718ba8ef668abf7ea46 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:35.526451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:35.527974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:35.542565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0fc90-7127-4201-8b7e-1af367efbd61 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:35.600050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:35.600612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:35.600892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:35.601170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] PATH_INFO: `/v3/projects/30dbcce93a1c4f938180a9d652859531` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:35.612110 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30dbcce93a1c4f938180a9d652859531)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:35.614073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:35.658801 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30dbcce93a1c4f938180a9d652859531', 'request_id': 'req-f36795e0-eb2b-4713-a611-b9b208c762f8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.664201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30dbcce93a1c4f938180a9d652859531', 'request_id': 'req-f36795e0-eb2b-4713-a611-b9b208c762f8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.667731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:35.672151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30dbcce93a1c4f938180a9d652859531', 'request_id': 'req-f36795e0-eb2b-4713-a611-b9b208c762f8'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.684859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] The token cache is being invalidate because project 30dbcce93a1c4f938180a9d652859531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:13:35.685178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.686096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:13:35.687650 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4336/8744] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:13:35 2022] DELETE /identity/v3/projects/30dbcce93a1c4f938180a9d652859531 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:13:45.344686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=28,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:45.681943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:57.893776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:13:57.895545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:58.053117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1417052-0bbc-466d-a0af-82e4f44bcbcd admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:13:58.139498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e973e86-2dfd-4c33-9afc-7623d491cedf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:13:58.140123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e973e86-2dfd-4c33-9afc-7623d491cedf service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:13:58.140412 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e973e86-2dfd-4c33-9afc-7623d491cedf service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:13:58.140687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e973e86-2dfd-4c33-9afc-7623d491cedf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:13:58.142510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5e973e86-2dfd-4c33-9afc-7623d491cedf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:13:58.158679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e973e86-2dfd-4c33-9afc-7623d491cedf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:13:58.160254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e973e86-2dfd-4c33-9afc-7623d491cedf service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:13:58.179052 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4409/8745] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:13:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:08.239840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=81 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:15.821054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:15.822553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:15.910493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36795e0-eb2b-4713-a611-b9b208c762f8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:15.915034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:15.915656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:15.915957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:15.916228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] PATH_INFO: `/v3/users/549d35b431a947eda45ea502b0dc753f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:15.917348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=549d35b431a947eda45ea502b0dc753f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:15.919280 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:15.968312 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549d35b431a947eda45ea502b0dc753f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:15.968966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549d35b431a947eda45ea502b0dc753f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:15.980566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549d35b431a947eda45ea502b0dc753f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:15.988182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549d35b431a947eda45ea502b0dc753f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:15.995881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549d35b431a947eda45ea502b0dc753f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.001769 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4337/8746] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:15 2022] DELETE /identity/v3/users/549d35b431a947eda45ea502b0dc753f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:16.187248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e973e86-2dfd-4c33-9afc-7623d491cedf service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:16.209237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e973e86-2dfd-4c33-9afc-7623d491cedf service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:16.270223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:16.271005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.271289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.271563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] PATH_INFO: `/v3/projects/b055f0d12a17435cb8f8491123b4c8e8` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.272676 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b055f0d12a17435cb8f8491123b4c8e8)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:16.274635 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:16.321240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b055f0d12a17435cb8f8491123b4c8e8', 'request_id': 'req-6e058f86-3148-447b-81df-582293a96aac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.327842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b055f0d12a17435cb8f8491123b4c8e8', 'request_id': 'req-6e058f86-3148-447b-81df-582293a96aac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.334863 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b055f0d12a17435cb8f8491123b4c8e8', 'request_id': 'req-6e058f86-3148-447b-81df-582293a96aac'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.345140 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] The token cache is being invalidate because project b055f0d12a17435cb8f8491123b4c8e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:14:16.345449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.346080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.347552 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4410/8747] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:16 2022] DELETE /identity/v3/projects/b055f0d12a17435cb8f8491123b4c8e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:16.352124 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:16.353563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:16.367680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd8736-b2ed-433c-a9e6-97368f69b75c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:16.417826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:16.426169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:16.427662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.428172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.428646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] PATH_INFO: `/v3/users/fed17418ec8741cd828de2ab3ce1c232` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.429915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed17418ec8741cd828de2ab3ce1c232)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:16.431872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:16.479298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed17418ec8741cd828de2ab3ce1c232'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.479978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed17418ec8741cd828de2ab3ce1c232'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.492579 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed17418ec8741cd828de2ab3ce1c232'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.503304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed17418ec8741cd828de2ab3ce1c232'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.510818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed17418ec8741cd828de2ab3ce1c232'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.516742 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4338/8748] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:16 2022] DELETE /identity/v3/users/fed17418ec8741cd828de2ab3ce1c232 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:16.684835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:16.686586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:16.699783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058f86-3148-447b-81df-582293a96aac admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:16.757117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:16.757773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:16.758056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:16.758329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] PATH_INFO: `/v3/projects/b9b332a8c4484a149d9c56ac66547b4c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:16.759454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b332a8c4484a149d9c56ac66547b4c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:16.761350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:16.794841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:16.812930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b332a8c4484a149d9c56ac66547b4c', 'request_id': 'req-c64af822-e2ec-4924-9d8b-259aa246f9b9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.819169 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b332a8c4484a149d9c56ac66547b4c', 'request_id': 'req-c64af822-e2ec-4924-9d8b-259aa246f9b9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.827110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b332a8c4484a149d9c56ac66547b4c', 'request_id': 'req-c64af822-e2ec-4924-9d8b-259aa246f9b9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.838186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] The token cache is being invalidate because project b9b332a8c4484a149d9c56ac66547b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:14:16.838475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.839110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-c64af822-e2ec-4924-9d8b-259aa246f9b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:16.840610 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4411/8749] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:16 2022] DELETE /identity/v3/projects/b9b332a8c4484a149d9c56ac66547b4c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:17.237961 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:17.239934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:17.334989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf4470-6728-47da-8bb3-38ea66685f00 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:17.400075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4c913-0e4d-4fb7-9913-f73801a91119 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:17.400693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c913-0e4d-4fb7-9913-f73801a91119 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:17.400978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c913-0e4d-4fb7-9913-f73801a91119 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:17.401259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c913-0e4d-4fb7-9913-f73801a91119 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:17.403120 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e4c4c913-0e4d-4fb7-9913-f73801a91119 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:17.412616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:17.422526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4c913-0e4d-4fb7-9913-f73801a91119 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:17.424802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4c913-0e4d-4fb7-9913-f73801a91119 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:17.438324 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4339/8750] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:26.276070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafab63-b971-4ff0-8a1e-0286c41b4949 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:26.276574 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafab63-b971-4ff0-8a1e-0286c41b4949 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:26.276659 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafab63-b971-4ff0-8a1e-0286c41b4949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:26.309038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7eafab63-b971-4ff0-8a1e-0286c41b4949 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:26.310272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7eafab63-b971-4ff0-8a1e-0286c41b4949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:26.378453 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4412/8751] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:26.388318 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c90c9-6e2a-4636-9e81-1bf2800032d3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:26.388762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c90c9-6e2a-4636-9e81-1bf2800032d3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:26.388875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c90c9-6e2a-4636-9e81-1bf2800032d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:26.408238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-983c90c9-6e2a-4636-9e81-1bf2800032d3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:26.409457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-983c90c9-6e2a-4636-9e81-1bf2800032d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:26.418317 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4340/8752] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:26.422995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafab63-b971-4ff0-8a1e-0286c41b4949 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:26.433238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafab63-b971-4ff0-8a1e-0286c41b4949 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:26.438362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf7b57-4981-4b40-9c36-1254f522d97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:26.438955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf7b57-4981-4b40-9c36-1254f522d97c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:26.439236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf7b57-4981-4b40-9c36-1254f522d97c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:26.439511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf7b57-4981-4b40-9c36-1254f522d97c admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:26.440153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf7b57-4981-4b40-9c36-1254f522d97c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:14:26.440459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf7b57-4981-4b40-9c36-1254f522d97c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:26.442713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf7b57-4981-4b40-9c36-1254f522d97c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:26.454414 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4413/8753] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:14:26.468014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c90c9-6e2a-4636-9e81-1bf2800032d3 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:26.477679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c90c9-6e2a-4636-9e81-1bf2800032d3 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:26.482433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad379-472d-4797-b1bd-fb17dc4e685c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:26.483025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad379-472d-4797-b1bd-fb17dc4e685c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:26.483307 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad379-472d-4797-b1bd-fb17dc4e685c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:26.483582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad379-472d-4797-b1bd-fb17dc4e685c admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:26.484207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ad379-472d-4797-b1bd-fb17dc4e685c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:26.486157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ad379-472d-4797-b1bd-fb17dc4e685c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:26.517296 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4341/8754] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:14:26 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:14:26.518399 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf7b57-4981-4b40-9c36-1254f522d97c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:26.528227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf7b57-4981-4b40-9c36-1254f522d97c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:26.585705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9501baf-057a-4545-a329-10249bdd9ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:26.586315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501baf-057a-4545-a329-10249bdd9ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:26.586598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501baf-057a-4545-a329-10249bdd9ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:26.586876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501baf-057a-4545-a329-10249bdd9ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:26.587500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9501baf-057a-4545-a329-10249bdd9ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:26.589448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9501baf-057a-4545-a329-10249bdd9ff1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:26.610681 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4414/8755] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:14:26 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:14:26.615385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad379-472d-4797-b1bd-fb17dc4e685c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:26.625625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad379-472d-4797-b1bd-fb17dc4e685c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:26.630986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba4e5-7878-49f5-9650-7cb252d5dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:26.631543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba4e5-7878-49f5-9650-7cb252d5dd75 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:26.631826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba4e5-7878-49f5-9650-7cb252d5dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:26.632125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba4e5-7878-49f5-9650-7cb252d5dd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:26.632794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ba4e5-7878-49f5-9650-7cb252d5dd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:26.634460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ba4e5-7878-49f5-9650-7cb252d5dd75 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:26.644686 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4342/8756] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:14:26.648359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9501baf-057a-4545-a329-10249bdd9ff1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:26.658247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9501baf-057a-4545-a329-10249bdd9ff1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:26.663430 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15de1b6-d8ba-46a3-8218-1a507a518382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:26.664021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15de1b6-d8ba-46a3-8218-1a507a518382 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:26.664303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15de1b6-d8ba-46a3-8218-1a507a518382 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:26.664580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15de1b6-d8ba-46a3-8218-1a507a518382 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:26.665213 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15de1b6-d8ba-46a3-8218-1a507a518382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:26.666835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15de1b6-d8ba-46a3-8218-1a507a518382 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:26.671960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:26.680075 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4415/8757] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:14:26.682823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba4e5-7878-49f5-9650-7cb252d5dd75 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:26.694593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba4e5-7878-49f5-9650-7cb252d5dd75 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:26.699460 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef265b3-e588-476e-b86a-0452414bc1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:26.700112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef265b3-e588-476e-b86a-0452414bc1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:26.700396 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef265b3-e588-476e-b86a-0452414bc1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:26.700812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef265b3-e588-476e-b86a-0452414bc1c3 admin admin] PATH_INFO: `/v3/projects/743c0e85dcf147169ac52edc63bb0172/users/de59265ac5514a038de91425701e40b7/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:26.717330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef265b3-e588-476e-b86a-0452414bc1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743c0e85dcf147169ac52edc63bb0172, user_id=de59265ac5514a038de91425701e40b7, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:26.720050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef265b3-e588-476e-b86a-0452414bc1c3 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:26.733974 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4343/8758] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:14:26 2022] PUT /identity/v3/projects/743c0e85dcf147169ac52edc63bb0172/users/de59265ac5514a038de91425701e40b7/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:26.747977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d1967-de7d-4198-8b17-dbf1722f4038 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:26.748251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d1967-de7d-4198-8b17-dbf1722f4038 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:26.748524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d1967-de7d-4198-8b17-dbf1722f4038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:26.779072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-542d1967-de7d-4198-8b17-dbf1722f4038 None None] MFA Rules not processed for user `de59265ac5514a038de91425701e40b7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:26.780272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-542d1967-de7d-4198-8b17-dbf1722f4038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:26.843950 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4416/8759] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:26.849037 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef265b3-e588-476e-b86a-0452414bc1c3 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:26.913655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef265b3-e588-476e-b86a-0452414bc1c3 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:26.921813 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e27e74-d0a9-4877-a55a-32a07a0e6e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:26.922424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e27e74-d0a9-4877-a55a-32a07a0e6e01 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:26.922705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e27e74-d0a9-4877-a55a-32a07a0e6e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:26.922981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e27e74-d0a9-4877-a55a-32a07a0e6e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:26.923615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e27e74-d0a9-4877-a55a-32a07a0e6e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:26.925548 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e27e74-d0a9-4877-a55a-32a07a0e6e01 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:26.953752 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4344/8760] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:14:26 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:14:26.956610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d1967-de7d-4198-8b17-dbf1722f4038 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:26.968758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d1967-de7d-4198-8b17-dbf1722f4038 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:27.027428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd5a2b-7cc5-427f-95e4-627ac0798b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:27.028039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd5a2b-7cc5-427f-95e4-627ac0798b6c admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:27.028326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd5a2b-7cc5-427f-95e4-627ac0798b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:27.028603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd5a2b-7cc5-427f-95e4-627ac0798b6c admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:27.029243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd5a2b-7cc5-427f-95e4-627ac0798b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:27.031202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd5a2b-7cc5-427f-95e4-627ac0798b6c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:27.052164 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4417/8761] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:14:26 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:14:27.055993 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e27e74-d0a9-4877-a55a-32a07a0e6e01 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:27.066531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e27e74-d0a9-4877-a55a-32a07a0e6e01 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:27.071610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401db2-cb98-42ff-8354-86b301c431d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:27.072207 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401db2-cb98-42ff-8354-86b301c431d5 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:27.072489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401db2-cb98-42ff-8354-86b301c431d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:27.072766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401db2-cb98-42ff-8354-86b301c431d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:27.073433 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe401db2-cb98-42ff-8354-86b301c431d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:27.075029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe401db2-cb98-42ff-8354-86b301c431d5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:27.086187 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4345/8762] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:14:27.090208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd5a2b-7cc5-427f-95e4-627ac0798b6c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:27.100929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd5a2b-7cc5-427f-95e4-627ac0798b6c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:27.105760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d65b5-76e3-468a-8221-423faae3c778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:27.106400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d65b5-76e3-468a-8221-423faae3c778 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:27.106685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d65b5-76e3-468a-8221-423faae3c778 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:27.106983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d65b5-76e3-468a-8221-423faae3c778 admin admin] PATH_INFO: `/v3/projects/f0b4d6bc931c4700afce5852912c4250/users/f430534b394e4defb5322b65f2ece059/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:27.121604 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d65b5-76e3-468a-8221-423faae3c778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b4d6bc931c4700afce5852912c4250, user_id=f430534b394e4defb5322b65f2ece059, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:27.124256 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d65b5-76e3-468a-8221-423faae3c778 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:27.137145 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4418/8763] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:14:27 2022] PUT /identity/v3/projects/f0b4d6bc931c4700afce5852912c4250/users/f430534b394e4defb5322b65f2ece059/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:27.141141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401db2-cb98-42ff-8354-86b301c431d5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:27.151636 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401db2-cb98-42ff-8354-86b301c431d5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:27.215304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c46d93-d59f-4a64-bde8-d39aadc66a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:27.215842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46d93-d59f-4a64-bde8-d39aadc66a7a admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:27.216122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46d93-d59f-4a64-bde8-d39aadc66a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:27.216412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c46d93-d59f-4a64-bde8-d39aadc66a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:27.217063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c46d93-d59f-4a64-bde8-d39aadc66a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:27.218717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c46d93-d59f-4a64-bde8-d39aadc66a7a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:27.229667 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4346/8764] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:14:27.233816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d65b5-76e3-468a-8221-423faae3c778 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:27.244508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d65b5-76e3-468a-8221-423faae3c778 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:27.249112 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2eabc-e82b-4d63-8cab-93cc082bebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:27.249792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2eabc-e82b-4d63-8cab-93cc082bebe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:27.250095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2eabc-e82b-4d63-8cab-93cc082bebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:27.250368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2eabc-e82b-4d63-8cab-93cc082bebe9 admin admin] PATH_INFO: `/v3/projects/f0b4d6bc931c4700afce5852912c4250/users/f430534b394e4defb5322b65f2ece059/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:27.252337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2eabc-e82b-4d63-8cab-93cc082bebe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b4d6bc931c4700afce5852912c4250, user_id=f430534b394e4defb5322b65f2ece059, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:27.255026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2eabc-e82b-4d63-8cab-93cc082bebe9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:27.265236 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4419/8765] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:14:27 2022] PUT /identity/v3/projects/f0b4d6bc931c4700afce5852912c4250/users/f430534b394e4defb5322b65f2ece059/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:27.276111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee919ce1-81ee-4771-9135-a5f7b197f2bb None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:27.276510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee919ce1-81ee-4771-9135-a5f7b197f2bb None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:27.276873 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee919ce1-81ee-4771-9135-a5f7b197f2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:27.284306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:27.307168 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ee919ce1-81ee-4771-9135-a5f7b197f2bb None None] MFA Rules not processed for user `f430534b394e4defb5322b65f2ece059`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:27.308510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ee919ce1-81ee-4771-9135-a5f7b197f2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:27.376577 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4347/8766] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:14:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:27.390376 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8df0-0b7d-4832-a2ce-f2dd034be79e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:27.390864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8df0-0b7d-4832-a2ce-f2dd034be79e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:27.391007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8df0-0b7d-4832-a2ce-f2dd034be79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:27.411591 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-289c8df0-0b7d-4832-a2ce-f2dd034be79e None None] MFA Rules not processed for user `de59265ac5514a038de91425701e40b7`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:27.412782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-289c8df0-0b7d-4832-a2ce-f2dd034be79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:27.451045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:27.470725 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4420/8767] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:14:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:27.485153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee919ce1-81ee-4771-9135-a5f7b197f2bb None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:27.488385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ee919ce1-81ee-4771-9135-a5f7b197f2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:27.492732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c8df0-0b7d-4832-a2ce-f2dd034be79e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:27.494218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-289c8df0-0b7d-4832-a2ce-f2dd034be79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:27.575327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c8df0-0b7d-4832-a2ce-f2dd034be79e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:27.578787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee919ce1-81ee-4771-9135-a5f7b197f2bb None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:27.580509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c18bda-d808-45c7-9e90-d331451468e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:27.581117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c18bda-d808-45c7-9e90-d331451468e0 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:27.581422 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c18bda-d808-45c7-9e90-d331451468e0 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:27.581705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c18bda-d808-45c7-9e90-d331451468e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:27.583979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-62c18bda-d808-45c7-9e90-d331451468e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:27.585108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8650ca0-e7ba-45ee-b681-0fa7a3b33cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:27.585748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650ca0-e7ba-45ee-b681-0fa7a3b33cd6 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:27.586036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650ca0-e7ba-45ee-b681-0fa7a3b33cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:27.586314 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650ca0-e7ba-45ee-b681-0fa7a3b33cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:27.594350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8650ca0-e7ba-45ee-b681-0fa7a3b33cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:27.595949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8650ca0-e7ba-45ee-b681-0fa7a3b33cd6 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:27.598705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c18bda-d808-45c7-9e90-d331451468e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:27.600279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c18bda-d808-45c7-9e90-d331451468e0 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:27.605766 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4348/8768] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:27.613199 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4421/8769] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:28.065904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ed7ee-f580-43c2-bf00-61a2135c343e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:28.066197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ed7ee-f580-43c2-bf00-61a2135c343e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:28.066689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ed7ee-f580-43c2-bf00-61a2135c343e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:28.119621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4d7ed7ee-f580-43c2-bf00-61a2135c343e None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:28.120868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4d7ed7ee-f580-43c2-bf00-61a2135c343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:28.130430 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4349/8770] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:14:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:28.143407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c18bda-d808-45c7-9e90-d331451468e0 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:28.157007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c18bda-d808-45c7-9e90-d331451468e0 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:28.162577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedf60b-48f2-4987-9c99-0c7aaa7f5fbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:28.163168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf60b-48f2-4987-9c99-0c7aaa7f5fbc service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:28.163449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf60b-48f2-4987-9c99-0c7aaa7f5fbc service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:28.163719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf60b-48f2-4987-9c99-0c7aaa7f5fbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:28.172020 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedf60b-48f2-4987-9c99-0c7aaa7f5fbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:28.173617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedf60b-48f2-4987-9c99-0c7aaa7f5fbc service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:28.183745 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4422/8771] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:30.733510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ed7ee-f580-43c2-bf00-61a2135c343e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:30.750264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ed7ee-f580-43c2-bf00-61a2135c343e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:30.756938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283faeb8-3c4c-425d-b72d-f91e4fe16710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:30.757593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283faeb8-3c4c-425d-b72d-f91e4fe16710 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:30.757876 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283faeb8-3c4c-425d-b72d-f91e4fe16710 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:30.758186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283faeb8-3c4c-425d-b72d-f91e4fe16710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:30.760738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-283faeb8-3c4c-425d-b72d-f91e4fe16710 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:30.776586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283faeb8-3c4c-425d-b72d-f91e4fe16710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:30.778439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283faeb8-3c4c-425d-b72d-f91e4fe16710 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:30.802037 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4350/8772] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:37.031233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedf60b-48f2-4987-9c99-0c7aaa7f5fbc service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:37.046639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedf60b-48f2-4987-9c99-0c7aaa7f5fbc service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:37.052650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029484d-e3cd-4c71-8e78-119be22b79c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:37.053253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029484d-e3cd-4c71-8e78-119be22b79c2 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:37.053576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029484d-e3cd-4c71-8e78-119be22b79c2 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:37.053849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029484d-e3cd-4c71-8e78-119be22b79c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:37.055589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8029484d-e3cd-4c71-8e78-119be22b79c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:37.071556 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029484d-e3cd-4c71-8e78-119be22b79c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:37.073289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029484d-e3cd-4c71-8e78-119be22b79c2 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:37.087241 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4423/8773] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:38.735218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283faeb8-3c4c-425d-b72d-f91e4fe16710 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:38.736735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-283faeb8-3c4c-425d-b72d-f91e4fe16710 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:38.753213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283faeb8-3c4c-425d-b72d-f91e4fe16710 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:38.759323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa587-c358-4170-b315-8e1e915852c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:38.759924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa587-c358-4170-b315-8e1e915852c8 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:38.760208 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa587-c358-4170-b315-8e1e915852c8 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:38.760487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa587-c358-4170-b315-8e1e915852c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:38.768669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467aa587-c358-4170-b315-8e1e915852c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:38.770279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467aa587-c358-4170-b315-8e1e915852c8 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:38.780311 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4351/8774] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:38.795396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f343098-b242-4bf3-8133-4b7f9211f1da None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:38.795835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f343098-b242-4bf3-8133-4b7f9211f1da None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:38.795974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f343098-b242-4bf3-8133-4b7f9211f1da None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:38.797378 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4424/8775] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 16:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 16:14:38.802034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa587-c358-4170-b315-8e1e915852c8 service nova] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 16:14:38.816384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa587-c358-4170-b315-8e1e915852c8 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:38.825701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa587-c358-4170-b315-8e1e915852c8 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:38.830395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7d504-0cb8-4494-bbb7-33982b628f4d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f430534b394e4defb5322b65f2ece059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b4d6bc931c4700afce5852912c4250', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:38.831018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d504-0cb8-4494-bbb7-33982b628f4d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:38.831304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d504-0cb8-4494-bbb7-33982b628f4d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:38.831586 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d504-0cb8-4494-bbb7-33982b628f4d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] PATH_INFO: `/v3/projects/f0b4d6bc931c4700afce5852912c4250` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:38.832716 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7d504-0cb8-4494-bbb7-33982b628f4d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] RBAC: Authorizing `identity:get_project(project_id=f0b4d6bc931c4700afce5852912c4250)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:38.835165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7d504-0cb8-4494-bbb7-33982b628f4d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:38.836802 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4352/8776] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 16:14:38 2022] GET /identity/v3/projects/f0b4d6bc931c4700afce5852912c4250 => generated 393 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:14:39.144675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3512e-3d1b-4d70-9fd6-e19c7cac3795 None None] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:39.144960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3512e-3d1b-4d70-9fd6-e19c7cac3795 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:39.145234 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3512e-3d1b-4d70-9fd6-e19c7cac3795 None None] PATH_INFO: `/` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:39.146656 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4425/8777] 10.222.0.16 () {54 vars in 912 bytes} [Mon Aug 29 16:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 16:14:39.151276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7d504-0cb8-4494-bbb7-33982b628f4d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Authenticating service token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 29 16:14:39.166937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7d504-0cb8-4494-bbb7-33982b628f4d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:39.172278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:39.176167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7d504-0cb8-4494-bbb7-33982b628f4d tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:39.181872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cd331-c6da-409b-8b34-6c45a734c0b9 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f430534b394e4defb5322b65f2ece059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b4d6bc931c4700afce5852912c4250', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:39.182498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd331-c6da-409b-8b34-6c45a734c0b9 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:39.182784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd331-c6da-409b-8b34-6c45a734c0b9 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:39.183064 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cd331-c6da-409b-8b34-6c45a734c0b9 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] PATH_INFO: `/v3/projects/f0b4d6bc931c4700afce5852912c4250` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:39.184180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cd331-c6da-409b-8b34-6c45a734c0b9 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] RBAC: Authorizing `identity:get_project(project_id=f0b4d6bc931c4700afce5852912c4250)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:39.186260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cd331-c6da-409b-8b34-6c45a734c0b9 tempest-ServersAdminNegativeTestJSON-1955494277 tempest-ServersAdminNegativeTestJSON-1955494277-project-admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:39.188351 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4353/8778] 10.222.0.16 () {58 vars in 1443 bytes} [Mon Aug 29 16:14:39 2022] GET /identity/v3/projects/f0b4d6bc931c4700afce5852912c4250 => generated 393 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:14:42.056142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3512e-3d1b-4d70-9fd6-e19c7cac3795 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:42.122927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3512e-3d1b-4d70-9fd6-e19c7cac3795 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:42.127425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9622b-35fa-4e31-bfb4-3d5e1b6e9766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:42.128053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9622b-35fa-4e31-bfb4-3d5e1b6e9766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:42.128339 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9622b-35fa-4e31-bfb4-3d5e1b6e9766 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:42.128648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9622b-35fa-4e31-bfb4-3d5e1b6e9766 admin admin] PATH_INFO: `/v3/users/de59265ac5514a038de91425701e40b7` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:42.129811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9622b-35fa-4e31-bfb4-3d5e1b6e9766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de59265ac5514a038de91425701e40b7)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:42.131819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9622b-35fa-4e31-bfb4-3d5e1b6e9766 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:42.178732 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2de9622b-35fa-4e31-bfb4-3d5e1b6e9766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de59265ac5514a038de91425701e40b7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.179428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2de9622b-35fa-4e31-bfb4-3d5e1b6e9766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de59265ac5514a038de91425701e40b7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.183900 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:42.193633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2de9622b-35fa-4e31-bfb4-3d5e1b6e9766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de59265ac5514a038de91425701e40b7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.194309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2de9622b-35fa-4e31-bfb4-3d5e1b6e9766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de59265ac5514a038de91425701e40b7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.201577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-2de9622b-35fa-4e31-bfb4-3d5e1b6e9766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de59265ac5514a038de91425701e40b7'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.214392 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4426/8779] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:42 2022] DELETE /identity/v3/users/de59265ac5514a038de91425701e40b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:42.219019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4103-95e8-4894-8bed-b70e455a5f98 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:42.219523 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4103-95e8-4894-8bed-b70e455a5f98 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:42.219616 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4103-95e8-4894-8bed-b70e455a5f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:42.248076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-70ce4103-95e8-4894-8bed-b70e455a5f98 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:42.249284 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-70ce4103-95e8-4894-8bed-b70e455a5f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:42.308902 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4354/8780] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:42.318548 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a62f4a-6092-447b-a3b0-e5b9320e5872 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:42.318839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a62f4a-6092-447b-a3b0-e5b9320e5872 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:42.319117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a62f4a-6092-447b-a3b0-e5b9320e5872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:42.382225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f3a62f4a-6092-447b-a3b0-e5b9320e5872 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:42.383454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f3a62f4a-6092-447b-a3b0-e5b9320e5872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:42.433786 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4427/8781] 10.222.0.16 () {58 vars in 1062 bytes} [Mon Aug 29 16:14:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:42.440034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce4103-95e8-4894-8bed-b70e455a5f98 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:42.450443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce4103-95e8-4894-8bed-b70e455a5f98 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:42.456374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3672c-6ff3-4684-a9f9-62f6269b979f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:42.457419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3672c-6ff3-4684-a9f9-62f6269b979f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:42.457955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3672c-6ff3-4684-a9f9-62f6269b979f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:42.459112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3672c-6ff3-4684-a9f9-62f6269b979f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:42.472095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3672c-6ff3-4684-a9f9-62f6269b979f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:42.473550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3672c-6ff3-4684-a9f9-62f6269b979f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:42.483088 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4355/8782] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:42.656183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a62f4a-6092-447b-a3b0-e5b9320e5872 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:42.657781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f3a62f4a-6092-447b-a3b0-e5b9320e5872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:42.679781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a62f4a-6092-447b-a3b0-e5b9320e5872 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:42.686926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:42.687580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:42.687890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:42.688166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] PATH_INFO: `/v3/projects/743c0e85dcf147169ac52edc63bb0172` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:42.689447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=743c0e85dcf147169ac52edc63bb0172)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:42.691371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:42.738792 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743c0e85dcf147169ac52edc63bb0172', 'request_id': 'req-09618957-8b44-42c7-897a-c3a3dbd09579'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.745674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743c0e85dcf147169ac52edc63bb0172', 'request_id': 'req-09618957-8b44-42c7-897a-c3a3dbd09579'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.753469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743c0e85dcf147169ac52edc63bb0172', 'request_id': 'req-09618957-8b44-42c7-897a-c3a3dbd09579'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.763905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] The token cache is being invalidate because project 743c0e85dcf147169ac52edc63bb0172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:14:42.764190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.764833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.766352 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4428/8783] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:42 2022] DELETE /identity/v3/projects/743c0e85dcf147169ac52edc63bb0172 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:42.771003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3672c-6ff3-4684-a9f9-62f6269b979f service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:42.780628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3672c-6ff3-4684-a9f9-62f6269b979f service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:42.836746 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf6f46-bd40-4adf-9045-7edbff617cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:42.837296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6f46-bd40-4adf-9045-7edbff617cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:42.837607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6f46-bd40-4adf-9045-7edbff617cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:42.837883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6f46-bd40-4adf-9045-7edbff617cb7 admin admin] PATH_INFO: `/v3/users/f430534b394e4defb5322b65f2ece059` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:42.838996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf6f46-bd40-4adf-9045-7edbff617cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f430534b394e4defb5322b65f2ece059)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:42.840975 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf6f46-bd40-4adf-9045-7edbff617cb7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:42.886128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-84bf6f46-bd40-4adf-9045-7edbff617cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f430534b394e4defb5322b65f2ece059'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.886792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-84bf6f46-bd40-4adf-9045-7edbff617cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f430534b394e4defb5322b65f2ece059'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.899245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-84bf6f46-bd40-4adf-9045-7edbff617cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f430534b394e4defb5322b65f2ece059'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.906237 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-84bf6f46-bd40-4adf-9045-7edbff617cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f430534b394e4defb5322b65f2ece059'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.913734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-84bf6f46-bd40-4adf-9045-7edbff617cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f430534b394e4defb5322b65f2ece059'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:42.915807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:42.920546 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4356/8784] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:14:42 2022] DELETE /identity/v3/users/f430534b394e4defb5322b65f2ece059 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:43.198007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:43.199621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:43.213425 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09618957-8b44-42c7-897a-c3a3dbd09579 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:43.241816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:43.273164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:43.273827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.274109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.274382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] PATH_INFO: `/v3/projects/f0b4d6bc931c4700afce5852912c4250` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.275495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b4d6bc931c4700afce5852912c4250)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:43.277381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:43.323308 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b4d6bc931c4700afce5852912c4250', 'request_id': 'req-b603fdc1-e2ec-4573-b298-622e5369e71d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:43.329561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b4d6bc931c4700afce5852912c4250', 'request_id': 'req-b603fdc1-e2ec-4573-b298-622e5369e71d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:43.337269 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b4d6bc931c4700afce5852912c4250', 'request_id': 'req-b603fdc1-e2ec-4573-b298-622e5369e71d'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:43.347395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] The token cache is being invalidate because project f0b4d6bc931c4700afce5852912c4250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:14:43.347689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:43.348312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b603fdc1-e2ec-4573-b298-622e5369e71d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:14:43.350346 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4429/8785] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:14:43 2022] DELETE /identity/v3/projects/f0b4d6bc931c4700afce5852912c4250 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:43.356201 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2ee54-5d10-4615-9f2e-a0147a41bdcc None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.356683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2ee54-5d10-4615-9f2e-a0147a41bdcc None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.356777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2ee54-5d10-4615-9f2e-a0147a41bdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.397819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7bd2ee54-5d10-4615-9f2e-a0147a41bdcc None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:43.398942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7bd2ee54-5d10-4615-9f2e-a0147a41bdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:43.456949 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4357/8786] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:43.465368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a29092-52a1-46b2-bc07-8b8b12d187d3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.465684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a29092-52a1-46b2-bc07-8b8b12d187d3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.465967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a29092-52a1-46b2-bc07-8b8b12d187d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.487008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-02a29092-52a1-46b2-bc07-8b8b12d187d3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:43.488333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-02a29092-52a1-46b2-bc07-8b8b12d187d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:43.497357 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4430/8787] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:43.501694 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2ee54-5d10-4615-9f2e-a0147a41bdcc None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:43.511595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2ee54-5d10-4615-9f2e-a0147a41bdcc None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:43.516567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ebfab-9a22-48b0-9951-0fd23779e4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:43.517170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ebfab-9a22-48b0-9951-0fd23779e4bd admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.517493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ebfab-9a22-48b0-9951-0fd23779e4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.517765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ebfab-9a22-48b0-9951-0fd23779e4bd admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.518398 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ebfab-9a22-48b0-9951-0fd23779e4bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:14:43.518695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ebfab-9a22-48b0-9951-0fd23779e4bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:43.520323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ebfab-9a22-48b0-9951-0fd23779e4bd admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:43.532211 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4358/8788] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:14:43.537335 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a29092-52a1-46b2-bc07-8b8b12d187d3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:43.546772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a29092-52a1-46b2-bc07-8b8b12d187d3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:43.551451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee74e9-6d18-452b-a2cc-39f5ed593fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:43.552042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee74e9-6d18-452b-a2cc-39f5ed593fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.552348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee74e9-6d18-452b-a2cc-39f5ed593fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.552621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee74e9-6d18-452b-a2cc-39f5ed593fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.553236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee74e9-6d18-452b-a2cc-39f5ed593fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:43.555161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee74e9-6d18-452b-a2cc-39f5ed593fb2 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:43.582056 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4431/8789] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:14:43 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:14:43.587097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ebfab-9a22-48b0-9951-0fd23779e4bd admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:43.597328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ebfab-9a22-48b0-9951-0fd23779e4bd admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:43.653760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f145638-4450-44f6-836a-9315d41a4b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:43.654286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145638-4450-44f6-836a-9315d41a4b94 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.654563 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145638-4450-44f6-836a-9315d41a4b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.654836 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145638-4450-44f6-836a-9315d41a4b94 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.655452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f145638-4450-44f6-836a-9315d41a4b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:43.657412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f145638-4450-44f6-836a-9315d41a4b94 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:43.678561 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4359/8790] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:14:43 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:14:43.682672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee74e9-6d18-452b-a2cc-39f5ed593fb2 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:43.693640 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee74e9-6d18-452b-a2cc-39f5ed593fb2 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:43.698233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a2557-43da-4a00-a180-54c3aee51e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:43.698848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a2557-43da-4a00-a180-54c3aee51e0d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.699126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a2557-43da-4a00-a180-54c3aee51e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.699398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a2557-43da-4a00-a180-54c3aee51e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.700028 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a2557-43da-4a00-a180-54c3aee51e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:43.701725 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a2557-43da-4a00-a180-54c3aee51e0d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:43.711913 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4432/8791] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:14:43.715827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f145638-4450-44f6-836a-9315d41a4b94 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:43.726326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f145638-4450-44f6-836a-9315d41a4b94 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:43.730935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469fa3b-8168-4721-bd66-c0d969cb1d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:43.731532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469fa3b-8168-4721-bd66-c0d969cb1d71 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.731812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469fa3b-8168-4721-bd66-c0d969cb1d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.732086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469fa3b-8168-4721-bd66-c0d969cb1d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.732724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469fa3b-8168-4721-bd66-c0d969cb1d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:43.734330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469fa3b-8168-4721-bd66-c0d969cb1d71 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:43.744879 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4360/8792] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:14:43.749272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a2557-43da-4a00-a180-54c3aee51e0d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:43.759196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a2557-43da-4a00-a180-54c3aee51e0d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:43.763871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8031c5f-7ea3-4e18-a444-3c7ad488a695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:43.764511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031c5f-7ea3-4e18-a444-3c7ad488a695 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.764793 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031c5f-7ea3-4e18-a444-3c7ad488a695 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.765093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031c5f-7ea3-4e18-a444-3c7ad488a695 admin admin] PATH_INFO: `/v3/projects/a1f6f2ec58644e48a2575089343cab92/users/27aab9392b0a4b428463d86c8d517714/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.780228 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8031c5f-7ea3-4e18-a444-3c7ad488a695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f6f2ec58644e48a2575089343cab92, user_id=27aab9392b0a4b428463d86c8d517714, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:43.782986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8031c5f-7ea3-4e18-a444-3c7ad488a695 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:43.796453 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4433/8793] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:14:43 2022] PUT /identity/v3/projects/a1f6f2ec58644e48a2575089343cab92/users/27aab9392b0a4b428463d86c8d517714/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:14:43.801594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651c3c4-1c16-4b9f-b63d-6c7cdb0e9122 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.801904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651c3c4-1c16-4b9f-b63d-6c7cdb0e9122 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.802167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651c3c4-1c16-4b9f-b63d-6c7cdb0e9122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.821367 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-5651c3c4-1c16-4b9f-b63d-6c7cdb0e9122 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:43.822613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5651c3c4-1c16-4b9f-b63d-6c7cdb0e9122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:43.866945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:43.882865 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4361/8794] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:43.892538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e977a-9280-4a68-a66f-83abcf2939a7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.892831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e977a-9280-4a68-a66f-83abcf2939a7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.893102 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e977a-9280-4a68-a66f-83abcf2939a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.913480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f54e977a-9280-4a68-a66f-83abcf2939a7 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:43.914672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f54e977a-9280-4a68-a66f-83abcf2939a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:43.966963 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4434/8795] 10.222.0.16 () {58 vars in 1062 bytes} [Mon Aug 29 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:43.972956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651c3c4-1c16-4b9f-b63d-6c7cdb0e9122 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:43.982458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651c3c4-1c16-4b9f-b63d-6c7cdb0e9122 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:43.986169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acea70-a860-4a33-80fa-407bc770fe26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:43.986768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acea70-a860-4a33-80fa-407bc770fe26 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:43.987050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acea70-a860-4a33-80fa-407bc770fe26 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:43.987328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acea70-a860-4a33-80fa-407bc770fe26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:43.996292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acea70-a860-4a33-80fa-407bc770fe26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:43.997851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acea70-a860-4a33-80fa-407bc770fe26 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:44.007876 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4362/8796] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:48.448131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a005cd-c4d7-45fc-af5e-c7073c6cf5d7 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:48.448571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a005cd-c4d7-45fc-af5e-c7073c6cf5d7 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:48.448710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a005cd-c4d7-45fc-af5e-c7073c6cf5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:48.456978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:48.484490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f8a005cd-c4d7-45fc-af5e-c7073c6cf5d7 None None] MFA Rules not processed for user `27aab9392b0a4b428463d86c8d517714`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:48.485503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f8a005cd-c4d7-45fc-af5e-c7073c6cf5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:48.573909 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4435/8797] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:14:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:48.587236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc2e2-d24d-4679-ab5d-baffb18b5f8b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:48.587769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc2e2-d24d-4679-ab5d-baffb18b5f8b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:48.587769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc2e2-d24d-4679-ab5d-baffb18b5f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:48.608511 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-53dfc2e2-d24d-4679-ab5d-baffb18b5f8b None None] MFA Rules not processed for user `27aab9392b0a4b428463d86c8d517714`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:48.609780 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-53dfc2e2-d24d-4679-ab5d-baffb18b5f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:48.617057 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4363/8798] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:14:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:48.629372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a005cd-c4d7-45fc-af5e-c7073c6cf5d7 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:48.631375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f8a005cd-c4d7-45fc-af5e-c7073c6cf5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:48.741994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a005cd-c4d7-45fc-af5e-c7073c6cf5d7 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:48.747749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10b8aa-abc3-4b22-9eaa-6db6d49d684a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:48.748510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10b8aa-abc3-4b22-9eaa-6db6d49d684a service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:48.748809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10b8aa-abc3-4b22-9eaa-6db6d49d684a service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:48.749087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10b8aa-abc3-4b22-9eaa-6db6d49d684a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:48.758216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10b8aa-abc3-4b22-9eaa-6db6d49d684a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:48.759995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10b8aa-abc3-4b22-9eaa-6db6d49d684a service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:48.771089 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4436/8799] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:49.341874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bcfeb-7d18-4751-aa88-ebf4158186b7 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.342229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bcfeb-7d18-4751-aa88-ebf4158186b7 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.342519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bcfeb-7d18-4751-aa88-ebf4158186b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.364472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-045bcfeb-7d18-4751-aa88-ebf4158186b7 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:49.365900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-045bcfeb-7d18-4751-aa88-ebf4158186b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:49.446260 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4364/8800] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:49.457950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10b8aa-abc3-4b22-9eaa-6db6d49d684a service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:49.459917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8e10b8aa-abc3-4b22-9eaa-6db6d49d684a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:49.477838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10b8aa-abc3-4b22-9eaa-6db6d49d684a service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:49.482957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb7567-96c1-4b32-b7de-713891d2ae7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:49.483596 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb7567-96c1-4b32-b7de-713891d2ae7a service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:49.483902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb7567-96c1-4b32-b7de-713891d2ae7a service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:49.484183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb7567-96c1-4b32-b7de-713891d2ae7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:49.493874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb7567-96c1-4b32-b7de-713891d2ae7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:49.495480 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb7567-96c1-4b32-b7de-713891d2ae7a service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:49.506862 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4437/8801] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:59.041173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bcfeb-7d18-4751-aa88-ebf4158186b7 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:59.050672 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bcfeb-7d18-4751-aa88-ebf4158186b7 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:59.054294 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ec956-730c-42e8-bbfc-c178a39a11a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:59.054909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec956-730c-42e8-bbfc-c178a39a11a8 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:59.055176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec956-730c-42e8-bbfc-c178a39a11a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:59.055452 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec956-730c-42e8-bbfc-c178a39a11a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:59.057194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4c1ec956-730c-42e8-bbfc-c178a39a11a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:59.070759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ec956-730c-42e8-bbfc-c178a39a11a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:59.072182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ec956-730c-42e8-bbfc-c178a39a11a8 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:59.083718 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4365/8802] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:59.169099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db032bb-ef98-427a-bd0d-ca42277ba03f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:59.169099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db032bb-ef98-427a-bd0d-ca42277ba03f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:59.169099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db032bb-ef98-427a-bd0d-ca42277ba03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:59.186083 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1db032bb-ef98-427a-bd0d-ca42277ba03f None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:14:59.187516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1db032bb-ef98-427a-bd0d-ca42277ba03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:59.196498 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4438/8803] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:14:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:14:59.208887 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ec956-730c-42e8-bbfc-c178a39a11a8 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:59.223875 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ec956-730c-42e8-bbfc-c178a39a11a8 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:59.228946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe2e57-e4aa-430f-a017-7a5b16e5c9c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:59.229584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe2e57-e4aa-430f-a017-7a5b16e5c9c1 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:59.229869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe2e57-e4aa-430f-a017-7a5b16e5c9c1 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:59.230145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe2e57-e4aa-430f-a017-7a5b16e5c9c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:59.238472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe2e57-e4aa-430f-a017-7a5b16e5c9c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:59.240551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe2e57-e4aa-430f-a017-7a5b16e5c9c1 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:59.250442 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4366/8804] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:14:59.419322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db032bb-ef98-427a-bd0d-ca42277ba03f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:14:59.430899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db032bb-ef98-427a-bd0d-ca42277ba03f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:14:59.433131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a54fb7-a7c2-4a54-99cf-f77f986f9f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:14:59.433785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54fb7-a7c2-4a54-99cf-f77f986f9f5f service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:14:59.434138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54fb7-a7c2-4a54-99cf-f77f986f9f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:14:59.434408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54fb7-a7c2-4a54-99cf-f77f986f9f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:14:59.436310 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f6a54fb7-a7c2-4a54-99cf-f77f986f9f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:14:59.452843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a54fb7-a7c2-4a54-99cf-f77f986f9f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:14:59.454302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a54fb7-a7c2-4a54-99cf-f77f986f9f5f service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:14:59.468169 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4439/8805] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:14:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:15:09.246310 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=54 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:09.460772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=87 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:28.112062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe2e57-e4aa-430f-a017-7a5b16e5c9c1 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:28.131733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe2e57-e4aa-430f-a017-7a5b16e5c9c1 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:28.135390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305540f-9889-4b23-8d7e-5feee5bbfcba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:28.135990 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305540f-9889-4b23-8d7e-5feee5bbfcba service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:28.136273 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305540f-9889-4b23-8d7e-5feee5bbfcba service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:28.136550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305540f-9889-4b23-8d7e-5feee5bbfcba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:28.138703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b305540f-9889-4b23-8d7e-5feee5bbfcba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:28.151183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305540f-9889-4b23-8d7e-5feee5bbfcba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:28.152735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305540f-9889-4b23-8d7e-5feee5bbfcba service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:28.163696 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4367/8806] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:15:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:15:38.157241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:39.490692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a54fb7-a7c2-4a54-99cf-f77f986f9f5f service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:39.515620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a54fb7-a7c2-4a54-99cf-f77f986f9f5f service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:39.520406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf811f94-78f6-4702-9945-0e5523234d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:39.521063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf811f94-78f6-4702-9945-0e5523234d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:39.521348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf811f94-78f6-4702-9945-0e5523234d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:39.521660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf811f94-78f6-4702-9945-0e5523234d9b admin admin] PATH_INFO: `/v3/users/27aab9392b0a4b428463d86c8d517714` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:39.522798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf811f94-78f6-4702-9945-0e5523234d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=27aab9392b0a4b428463d86c8d517714)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:39.524848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf811f94-78f6-4702-9945-0e5523234d9b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:39.573608 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cf811f94-78f6-4702-9945-0e5523234d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27aab9392b0a4b428463d86c8d517714'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:39.575070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cf811f94-78f6-4702-9945-0e5523234d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27aab9392b0a4b428463d86c8d517714'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:39.586779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cf811f94-78f6-4702-9945-0e5523234d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27aab9392b0a4b428463d86c8d517714'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:39.587410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cf811f94-78f6-4702-9945-0e5523234d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27aab9392b0a4b428463d86c8d517714'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:39.594204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cf811f94-78f6-4702-9945-0e5523234d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27aab9392b0a4b428463d86c8d517714'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:39.606565 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4440/8807] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:15:39 2022] DELETE /identity/v3/users/27aab9392b0a4b428463d86c8d517714 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:15:39.781157 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305540f-9889-4b23-8d7e-5feee5bbfcba service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:39.792861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305540f-9889-4b23-8d7e-5feee5bbfcba service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:39.852749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:39.853440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:39.853727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:39.854009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] PATH_INFO: `/v3/projects/a1f6f2ec58644e48a2575089343cab92` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:39.855182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f6f2ec58644e48a2575089343cab92)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:39.857158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:39.906144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f6f2ec58644e48a2575089343cab92', 'request_id': 'req-41f8ad1c-d7e7-44bc-a451-088a2236e827'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:39.911912 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f6f2ec58644e48a2575089343cab92', 'request_id': 'req-41f8ad1c-d7e7-44bc-a451-088a2236e827'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:39.919424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f6f2ec58644e48a2575089343cab92', 'request_id': 'req-41f8ad1c-d7e7-44bc-a451-088a2236e827'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:39.930816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] The token cache is being invalidate because project a1f6f2ec58644e48a2575089343cab92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:15:39.931100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:39.931751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-41f8ad1c-d7e7-44bc-a451-088a2236e827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:15:39.933774 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4368/8808] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:15:39 2022] DELETE /identity/v3/projects/a1f6f2ec58644e48a2575089343cab92 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:15:39.939163 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde860d7-9dd0-4fc9-bd5f-2fe4e58d1be5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:39.939495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde860d7-9dd0-4fc9-bd5f-2fe4e58d1be5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:39.939759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde860d7-9dd0-4fc9-bd5f-2fe4e58d1be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:39.960089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bde860d7-9dd0-4fc9-bd5f-2fe4e58d1be5 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:39.961290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bde860d7-9dd0-4fc9-bd5f-2fe4e58d1be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:40.021915 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4441/8809] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:40.029700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912883e4-80a0-45cb-a467-55d17ccc9aa0 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:40.029991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912883e4-80a0-45cb-a467-55d17ccc9aa0 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:40.030269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912883e4-80a0-45cb-a467-55d17ccc9aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:40.051428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-912883e4-80a0-45cb-a467-55d17ccc9aa0 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:40.052627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-912883e4-80a0-45cb-a467-55d17ccc9aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:40.061510 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4369/8810] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:40.065859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde860d7-9dd0-4fc9-bd5f-2fe4e58d1be5 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:40.075488 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde860d7-9dd0-4fc9-bd5f-2fe4e58d1be5 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:40.080050 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f147cc-e811-49e3-ae70-80e5676e1855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:40.080639 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f147cc-e811-49e3-ae70-80e5676e1855 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:40.080923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f147cc-e811-49e3-ae70-80e5676e1855 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:40.081207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f147cc-e811-49e3-ae70-80e5676e1855 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:40.081886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f147cc-e811-49e3-ae70-80e5676e1855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:15:40.082191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f147cc-e811-49e3-ae70-80e5676e1855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:40.083784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f147cc-e811-49e3-ae70-80e5676e1855 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:40.095491 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4442/8811] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:15:40.099448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912883e4-80a0-45cb-a467-55d17ccc9aa0 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:40.109817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912883e4-80a0-45cb-a467-55d17ccc9aa0 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:40.114470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7d6eb-6f45-4891-ac86-ae792e79b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:40.115066 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7d6eb-6f45-4891-ac86-ae792e79b929 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:40.115350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7d6eb-6f45-4891-ac86-ae792e79b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:40.115629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7d6eb-6f45-4891-ac86-ae792e79b929 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:40.116275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7d6eb-6f45-4891-ac86-ae792e79b929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:40.118199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7d6eb-6f45-4891-ac86-ae792e79b929 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:40.146084 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4370/8812] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:15:40 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:15:40.150191 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f147cc-e811-49e3-ae70-80e5676e1855 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:40.163706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f147cc-e811-49e3-ae70-80e5676e1855 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:40.222042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:40.236123 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9c1ca-b724-4eec-9cda-4deef7173858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:40.236742 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9c1ca-b724-4eec-9cda-4deef7173858 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:40.237024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9c1ca-b724-4eec-9cda-4deef7173858 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:40.237301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9c1ca-b724-4eec-9cda-4deef7173858 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:40.237974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9c1ca-b724-4eec-9cda-4deef7173858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:40.239917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9c1ca-b724-4eec-9cda-4deef7173858 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:40.262699 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4443/8813] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:15:40 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:15:40.266744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7d6eb-6f45-4891-ac86-ae792e79b929 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:40.277668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7d6eb-6f45-4891-ac86-ae792e79b929 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:40.282849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b1297-e025-4040-9919-59f1454d6b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:40.283468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b1297-e025-4040-9919-59f1454d6b58 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:40.284010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b1297-e025-4040-9919-59f1454d6b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:40.284010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b1297-e025-4040-9919-59f1454d6b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:40.284663 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b1297-e025-4040-9919-59f1454d6b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:40.286328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b1297-e025-4040-9919-59f1454d6b58 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:40.297935 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4371/8814] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:15:40.302095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9c1ca-b724-4eec-9cda-4deef7173858 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:40.314021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9c1ca-b724-4eec-9cda-4deef7173858 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:40.318846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d7941-d267-426c-86e2-67ac0c4adbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:40.319476 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d7941-d267-426c-86e2-67ac0c4adbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:40.319757 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d7941-d267-426c-86e2-67ac0c4adbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:40.320056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d7941-d267-426c-86e2-67ac0c4adbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:40.320694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d7941-d267-426c-86e2-67ac0c4adbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:40.322589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d7941-d267-426c-86e2-67ac0c4adbb6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:40.333372 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4444/8815] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:15:40.337668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b1297-e025-4040-9919-59f1454d6b58 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:40.349521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b1297-e025-4040-9919-59f1454d6b58 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:40.354859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9325e-f37e-4960-9eca-8fbdfbc4d37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:40.355524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9325e-f37e-4960-9eca-8fbdfbc4d37c admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:40.356549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9325e-f37e-4960-9eca-8fbdfbc4d37c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:40.356843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9325e-f37e-4960-9eca-8fbdfbc4d37c admin admin] PATH_INFO: `/v3/projects/f416d812b5734ed5857f18d76e572411/users/bf3ff92a939c4f08bc18125e3b2c1123/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:40.371681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9325e-f37e-4960-9eca-8fbdfbc4d37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f416d812b5734ed5857f18d76e572411, user_id=bf3ff92a939c4f08bc18125e3b2c1123, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:40.374347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9325e-f37e-4960-9eca-8fbdfbc4d37c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:40.386839 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4372/8816] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:15:40 2022] PUT /identity/v3/projects/f416d812b5734ed5857f18d76e572411/users/bf3ff92a939c4f08bc18125e3b2c1123/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:15:40.392149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c576b-b586-4ebb-b3ea-84563915e883 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:40.392440 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c576b-b586-4ebb-b3ea-84563915e883 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:40.392720 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c576b-b586-4ebb-b3ea-84563915e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:40.412106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-610c576b-b586-4ebb-b3ea-84563915e883 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:40.413307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-610c576b-b586-4ebb-b3ea-84563915e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:40.474981 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4445/8817] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:40.485421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9325e-f37e-4960-9eca-8fbdfbc4d37c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:40.487202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0cc9325e-f37e-4960-9eca-8fbdfbc4d37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:40.518618 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:40.549453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9325e-f37e-4960-9eca-8fbdfbc4d37c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:40.553117 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce4062-b503-4f7a-86cb-5b8e15e6d391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:40.553757 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4062-b503-4f7a-86cb-5b8e15e6d391 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:40.554073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4062-b503-4f7a-86cb-5b8e15e6d391 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:40.554350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4062-b503-4f7a-86cb-5b8e15e6d391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:40.563723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce4062-b503-4f7a-86cb-5b8e15e6d391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:40.565158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce4062-b503-4f7a-86cb-5b8e15e6d391 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:40.574565 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4373/8818] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:15:44.698229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a63302-b8be-4642-a910-237dcc8bfe7e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:44.698812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a63302-b8be-4642-a910-237dcc8bfe7e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:44.698812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a63302-b8be-4642-a910-237dcc8bfe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:44.736513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-98a63302-b8be-4642-a910-237dcc8bfe7e None None] MFA Rules not processed for user `bf3ff92a939c4f08bc18125e3b2c1123`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:44.738917 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-98a63302-b8be-4642-a910-237dcc8bfe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:44.815006 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4446/8819] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:15:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:44.826567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91abba-2725-493b-9e96-4502b6d1b089 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:44.827101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91abba-2725-493b-9e96-4502b6d1b089 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:44.827101 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91abba-2725-493b-9e96-4502b6d1b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:44.847160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6c91abba-2725-493b-9e96-4502b6d1b089 None None] MFA Rules not processed for user `bf3ff92a939c4f08bc18125e3b2c1123`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:15:44.848648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6c91abba-2725-493b-9e96-4502b6d1b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:44.855761 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4374/8820] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:15:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:15:44.867988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a63302-b8be-4642-a910-237dcc8bfe7e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:44.869380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-98a63302-b8be-4642-a910-237dcc8bfe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:44.930571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:44.962378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a63302-b8be-4642-a910-237dcc8bfe7e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:44.968686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f142be9-7678-4aed-9bc0-d30df3a58b84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:44.969590 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142be9-7678-4aed-9bc0-d30df3a58b84 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:44.969874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142be9-7678-4aed-9bc0-d30df3a58b84 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:44.970150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142be9-7678-4aed-9bc0-d30df3a58b84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:44.978835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f142be9-7678-4aed-9bc0-d30df3a58b84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:44.980499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f142be9-7678-4aed-9bc0-d30df3a58b84 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:44.990931 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4447/8821] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:15:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:15:45.254018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91abba-2725-493b-9e96-4502b6d1b089 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:15:45.265093 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91abba-2725-493b-9e96-4502b6d1b089 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:15:45.269658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b173b65-8907-4d2e-a2e6-380a68c6b3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:15:45.270271 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b173b65-8907-4d2e-a2e6-380a68c6b3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:15:45.270550 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b173b65-8907-4d2e-a2e6-380a68c6b3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:15:45.270823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b173b65-8907-4d2e-a2e6-380a68c6b3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:15:45.272535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6b173b65-8907-4d2e-a2e6-380a68c6b3f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:15:45.285238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b173b65-8907-4d2e-a2e6-380a68c6b3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:15:45.286704 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b173b65-8907-4d2e-a2e6-380a68c6b3f2 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:15:45.297716 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4375/8822] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:15:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:15:54.986503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=11 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:55.291041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=23 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:03.190953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f142be9-7678-4aed-9bc0-d30df3a58b84 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:03.192454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0f142be9-7678-4aed-9bc0-d30df3a58b84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:03.204245 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f142be9-7678-4aed-9bc0-d30df3a58b84 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:03.207880 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e52ed-ddd1-415f-a10d-077bf11afb44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:03.208473 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e52ed-ddd1-415f-a10d-077bf11afb44 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:03.208753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e52ed-ddd1-415f-a10d-077bf11afb44 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:03.209029 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e52ed-ddd1-415f-a10d-077bf11afb44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:03.210735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-342e52ed-ddd1-415f-a10d-077bf11afb44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:03.227227 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e52ed-ddd1-415f-a10d-077bf11afb44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:03.228784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e52ed-ddd1-415f-a10d-077bf11afb44 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:03.243513 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4448/8823] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:16:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:16:06.766543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b173b65-8907-4d2e-a2e6-380a68c6b3f2 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:06.775198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b173b65-8907-4d2e-a2e6-380a68c6b3f2 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:06.779368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400380a-1526-4595-ac99-28e42c837789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:06.779971 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400380a-1526-4595-ac99-28e42c837789 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:06.780250 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400380a-1526-4595-ac99-28e42c837789 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:06.780524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400380a-1526-4595-ac99-28e42c837789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:06.782256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0400380a-1526-4595-ac99-28e42c837789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:06.798823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400380a-1526-4595-ac99-28e42c837789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:06.800189 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400380a-1526-4595-ac99-28e42c837789 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:06.814361 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4376/8824] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:16:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:16:13.235620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:16.806320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:38.431294 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110abdc-ff0c-4a96-88c5-c7bec1b58124 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:38.432216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110abdc-ff0c-4a96-88c5-c7bec1b58124 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:38.432568 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110abdc-ff0c-4a96-88c5-c7bec1b58124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:38.452866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0110abdc-ff0c-4a96-88c5-c7bec1b58124 None None] MFA Rules not processed for user `bf3ff92a939c4f08bc18125e3b2c1123`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:16:38.454098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0110abdc-ff0c-4a96-88c5-c7bec1b58124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:38.460908 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4449/8825] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:16:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:16:38.715092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400380a-1526-4595-ac99-28e42c837789 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:16:38.723654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400380a-1526-4595-ac99-28e42c837789 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:16:38.727340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f7d6a-b7fd-4c24-b287-2fcb9cebbdc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:16:38.727940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f7d6a-b7fd-4c24-b287-2fcb9cebbdc2 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:16:38.728224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f7d6a-b7fd-4c24-b287-2fcb9cebbdc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:16:38.728499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f7d6a-b7fd-4c24-b287-2fcb9cebbdc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:16:38.730363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9b0f7d6a-b7fd-4c24-b287-2fcb9cebbdc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:16:38.742895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f7d6a-b7fd-4c24-b287-2fcb9cebbdc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:16:38.744317 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f7d6a-b7fd-4c24-b287-2fcb9cebbdc2 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:16:38.755566 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4377/8826] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:16:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:16:48.447752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:48.749512 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:18.478484 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110abdc-ff0c-4a96-88c5-c7bec1b58124 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:18.488534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110abdc-ff0c-4a96-88c5-c7bec1b58124 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:18.492162 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd893d99-fb05-4034-9724-926fe205e1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:18.492772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd893d99-fb05-4034-9724-926fe205e1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:18.493047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd893d99-fb05-4034-9724-926fe205e1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:18.493314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd893d99-fb05-4034-9724-926fe205e1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:18.495019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dd893d99-fb05-4034-9724-926fe205e1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:18.507985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd893d99-fb05-4034-9724-926fe205e1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:18.509419 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd893d99-fb05-4034-9724-926fe205e1b6 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:18.519951 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4450/8827] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:28.513890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:30.577776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f7d6a-b7fd-4c24-b287-2fcb9cebbdc2 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:30.580060 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9b0f7d6a-b7fd-4c24-b287-2fcb9cebbdc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:30.650318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd893d99-fb05-4034-9724-926fe205e1b6 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:30.673749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd893d99-fb05-4034-9724-926fe205e1b6 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:30.678637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0ef5d-7d5b-43b8-a05f-5f7130151217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:30.679278 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0ef5d-7d5b-43b8-a05f-5f7130151217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:30.679562 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0ef5d-7d5b-43b8-a05f-5f7130151217 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:30.680155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0ef5d-7d5b-43b8-a05f-5f7130151217 admin admin] PATH_INFO: `/v3/users/bf3ff92a939c4f08bc18125e3b2c1123` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:30.681435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0ef5d-7d5b-43b8-a05f-5f7130151217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf3ff92a939c4f08bc18125e3b2c1123)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:30.683280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0ef5d-7d5b-43b8-a05f-5f7130151217 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:30.693815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f7d6a-b7fd-4c24-b287-2fcb9cebbdc2 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:30.700558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698810b3-0ee4-4371-abd5-1aec1d9831a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:30.701567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698810b3-0ee4-4371-abd5-1aec1d9831a1 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:30.701861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698810b3-0ee4-4371-abd5-1aec1d9831a1 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:30.702176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698810b3-0ee4-4371-abd5-1aec1d9831a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:30.704038 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-698810b3-0ee4-4371-abd5-1aec1d9831a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:30.718893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698810b3-0ee4-4371-abd5-1aec1d9831a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:30.720556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698810b3-0ee4-4371-abd5-1aec1d9831a1 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:30.735184 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4378/8828] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:30.744065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1c0ef5d-7d5b-43b8-a05f-5f7130151217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf3ff92a939c4f08bc18125e3b2c1123'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:30.744806 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1c0ef5d-7d5b-43b8-a05f-5f7130151217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf3ff92a939c4f08bc18125e3b2c1123'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:30.757870 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1c0ef5d-7d5b-43b8-a05f-5f7130151217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf3ff92a939c4f08bc18125e3b2c1123'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:30.758631 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1c0ef5d-7d5b-43b8-a05f-5f7130151217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf3ff92a939c4f08bc18125e3b2c1123'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:30.766301 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a1c0ef5d-7d5b-43b8-a05f-5f7130151217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf3ff92a939c4f08bc18125e3b2c1123'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:30.779177 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4451/8829] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:17:30 2022] DELETE /identity/v3/users/bf3ff92a939c4f08bc18125e3b2c1123 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:17:30.954011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698810b3-0ee4-4371-abd5-1aec1d9831a1 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:30.965528 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698810b3-0ee4-4371-abd5-1aec1d9831a1 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.023802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.024439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.024717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.024989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] PATH_INFO: `/v3/projects/f416d812b5734ed5857f18d76e572411` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.026133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f416d812b5734ed5857f18d76e572411)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.028034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.075927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f416d812b5734ed5857f18d76e572411', 'request_id': 'req-2e9b066c-eb05-456c-bf6e-584ddd9266aa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.082824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f416d812b5734ed5857f18d76e572411', 'request_id': 'req-2e9b066c-eb05-456c-bf6e-584ddd9266aa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.090240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f416d812b5734ed5857f18d76e572411', 'request_id': 'req-2e9b066c-eb05-456c-bf6e-584ddd9266aa'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.102440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] The token cache is being invalidate because project f416d812b5734ed5857f18d76e572411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:17:31.102853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.103531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-2e9b066c-eb05-456c-bf6e-584ddd9266aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:17:31.105039 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4379/8830] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:17:30 2022] DELETE /identity/v3/projects/f416d812b5734ed5857f18d76e572411 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:31.110814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b204486-ea29-4a4f-9773-b0c3795c5fdb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.111106 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b204486-ea29-4a4f-9773-b0c3795c5fdb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.111382 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b204486-ea29-4a4f-9773-b0c3795c5fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.132408 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3b204486-ea29-4a4f-9773-b0c3795c5fdb None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:31.133577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3b204486-ea29-4a4f-9773-b0c3795c5fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:31.196999 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4452/8831] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:31.206270 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3969956-bda2-4641-8168-86676e8483fa None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.206561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3969956-bda2-4641-8168-86676e8483fa None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.206840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3969956-bda2-4641-8168-86676e8483fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.228326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f3969956-bda2-4641-8168-86676e8483fa None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:31.229568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f3969956-bda2-4641-8168-86676e8483fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:31.237547 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4380/8832] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:31.241796 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b204486-ea29-4a4f-9773-b0c3795c5fdb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.251820 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b204486-ea29-4a4f-9773-b0c3795c5fdb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.256502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58eb62-b5b5-417c-a4f9-c5472335de6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.257098 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58eb62-b5b5-417c-a4f9-c5472335de6a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.257380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58eb62-b5b5-417c-a4f9-c5472335de6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.257688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58eb62-b5b5-417c-a4f9-c5472335de6a admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.258507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58eb62-b5b5-417c-a4f9-c5472335de6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:17:31.258814 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58eb62-b5b5-417c-a4f9-c5472335de6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.260409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58eb62-b5b5-417c-a4f9-c5472335de6a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.272577 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4453/8833] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:17:31.276932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3969956-bda2-4641-8168-86676e8483fa None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.283292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:31.287522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3969956-bda2-4641-8168-86676e8483fa None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.293439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca542584-1bfb-490d-b1d5-4307e29df231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.294391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca542584-1bfb-490d-b1d5-4307e29df231 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.294829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca542584-1bfb-490d-b1d5-4307e29df231 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.295160 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca542584-1bfb-490d-b1d5-4307e29df231 admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.295940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca542584-1bfb-490d-b1d5-4307e29df231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.297881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca542584-1bfb-490d-b1d5-4307e29df231 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.334377 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4381/8834] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:17:31 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:31.338579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58eb62-b5b5-417c-a4f9-c5472335de6a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.349054 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58eb62-b5b5-417c-a4f9-c5472335de6a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.404313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abbfbd-1eb2-47b3-af85-c8d65518c342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.404840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abbfbd-1eb2-47b3-af85-c8d65518c342 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.405154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abbfbd-1eb2-47b3-af85-c8d65518c342 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.405988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abbfbd-1eb2-47b3-af85-c8d65518c342 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.406616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abbfbd-1eb2-47b3-af85-c8d65518c342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.408521 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abbfbd-1eb2-47b3-af85-c8d65518c342 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.416828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:31.433313 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4454/8835] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:17:31 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:17:31.438111 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca542584-1bfb-490d-b1d5-4307e29df231 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.449153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca542584-1bfb-490d-b1d5-4307e29df231 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.454983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e07bdc-fdd0-4cd6-8b8f-4bde8dad0568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.455695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e07bdc-fdd0-4cd6-8b8f-4bde8dad0568 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.456045 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e07bdc-fdd0-4cd6-8b8f-4bde8dad0568 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.456392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e07bdc-fdd0-4cd6-8b8f-4bde8dad0568 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.457147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e07bdc-fdd0-4cd6-8b8f-4bde8dad0568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.458983 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e07bdc-fdd0-4cd6-8b8f-4bde8dad0568 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.474325 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4382/8836] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:17:31.475517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abbfbd-1eb2-47b3-af85-c8d65518c342 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.487142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abbfbd-1eb2-47b3-af85-c8d65518c342 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.493381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626fd6a-eb08-4b94-ac37-924537356598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.494044 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626fd6a-eb08-4b94-ac37-924537356598 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.494360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626fd6a-eb08-4b94-ac37-924537356598 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.494657 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626fd6a-eb08-4b94-ac37-924537356598 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.495302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626fd6a-eb08-4b94-ac37-924537356598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.496911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626fd6a-eb08-4b94-ac37-924537356598 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.513901 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4455/8837] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:17:31.515885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e07bdc-fdd0-4cd6-8b8f-4bde8dad0568 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.526315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e07bdc-fdd0-4cd6-8b8f-4bde8dad0568 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.531732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87938b6f-8bf3-4e78-b2fe-0e1ca295df97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.532718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87938b6f-8bf3-4e78-b2fe-0e1ca295df97 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.533002 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87938b6f-8bf3-4e78-b2fe-0e1ca295df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.533560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87938b6f-8bf3-4e78-b2fe-0e1ca295df97 admin admin] PATH_INFO: `/v3/projects/65d92a43d3cd4a6d952e95d1cee77d69/users/26f455ab6ad14c2db7727b826a2b32bc/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.549469 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87938b6f-8bf3-4e78-b2fe-0e1ca295df97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d92a43d3cd4a6d952e95d1cee77d69, user_id=26f455ab6ad14c2db7727b826a2b32bc, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.552152 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87938b6f-8bf3-4e78-b2fe-0e1ca295df97 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.566110 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4383/8838] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:17:31 2022] PUT /identity/v3/projects/65d92a43d3cd4a6d952e95d1cee77d69/users/26f455ab6ad14c2db7727b826a2b32bc/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:17:31.571304 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1495095-3013-481a-8051-a6faf6c3ea90 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.571593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1495095-3013-481a-8051-a6faf6c3ea90 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.571901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1495095-3013-481a-8051-a6faf6c3ea90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.591244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-e1495095-3013-481a-8051-a6faf6c3ea90 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:31.592447 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e1495095-3013-481a-8051-a6faf6c3ea90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:31.651589 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4456/8839] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:31.661183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87938b6f-8bf3-4e78-b2fe-0e1ca295df97 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:31.662972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-87938b6f-8bf3-4e78-b2fe-0e1ca295df97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:31.719793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87938b6f-8bf3-4e78-b2fe-0e1ca295df97 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:31.723449 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212c2c6-d9bf-4a10-9849-5d06efd2ebac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:31.724050 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c2c6-d9bf-4a10-9849-5d06efd2ebac service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:31.724328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c2c6-d9bf-4a10-9849-5d06efd2ebac service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:31.724602 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c2c6-d9bf-4a10-9849-5d06efd2ebac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:31.733372 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212c2c6-d9bf-4a10-9849-5d06efd2ebac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:31.734807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212c2c6-d9bf-4a10-9849-5d06efd2ebac service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:31.744138 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4384/8840] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:35.565812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f7b97-820f-4456-9a8c-8f25cce8a208 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.566303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f7b97-820f-4456-9a8c-8f25cce8a208 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.566383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f7b97-820f-4456-9a8c-8f25cce8a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.603038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5a1f7b97-820f-4456-9a8c-8f25cce8a208 None None] MFA Rules not processed for user `26f455ab6ad14c2db7727b826a2b32bc`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:35.604207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5a1f7b97-820f-4456-9a8c-8f25cce8a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:35.675489 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4457/8841] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:35.690613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212c2c6-d9bf-4a10-9849-5d06efd2ebac service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:17:35.692044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f212c2c6-d9bf-4a10-9849-5d06efd2ebac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:35.775179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212c2c6-d9bf-4a10-9849-5d06efd2ebac service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:17:35.780940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb11faf-fd3a-4783-84fd-e3c7cd666d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:17:35.781577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11faf-fd3a-4783-84fd-e3c7cd666d1a service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:35.781855 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11faf-fd3a-4783-84fd-e3c7cd666d1a service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:35.782127 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11faf-fd3a-4783-84fd-e3c7cd666d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:35.790334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb11faf-fd3a-4783-84fd-e3c7cd666d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:17:35.791921 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb11faf-fd3a-4783-84fd-e3c7cd666d1a service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:17:35.802160 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4385/8842] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:17:37.470934 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee480395-e264-4fce-9f5e-84f3773aca22 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:17:37.471417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee480395-e264-4fce-9f5e-84f3773aca22 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:17:37.471525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee480395-e264-4fce-9f5e-84f3773aca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:17:37.491730 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ee480395-e264-4fce-9f5e-84f3773aca22 None None] MFA Rules not processed for user `26f455ab6ad14c2db7727b826a2b32bc`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:17:37.493047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ee480395-e264-4fce-9f5e-84f3773aca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:17:37.501277 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4458/8843] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:17:45.797628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:INSERT=2 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:47.485313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:50.203089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733dd6-987b-4236-9478-5e4dc146c1ca None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:18:50.204163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733dd6-987b-4236-9478-5e4dc146c1ca None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:18:50.204262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733dd6-987b-4236-9478-5e4dc146c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:18:50.223243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-72733dd6-987b-4236-9478-5e4dc146c1ca None None] MFA Rules not processed for user `26f455ab6ad14c2db7727b826a2b32bc`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:18:50.224444 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72733dd6-987b-4236-9478-5e4dc146c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:18:50.231486 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4386/8844] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:18:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:19:00.217717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:20.245282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee480395-e264-4fce-9f5e-84f3773aca22 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:20.246762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ee480395-e264-4fce-9f5e-84f3773aca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:20.322866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee480395-e264-4fce-9f5e-84f3773aca22 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:20.328449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fd5a6-5624-41d7-b1c8-7a1722dbb534 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:20.329049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fd5a6-5624-41d7-b1c8-7a1722dbb534 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:20.329329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fd5a6-5624-41d7-b1c8-7a1722dbb534 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:20.329634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fd5a6-5624-41d7-b1c8-7a1722dbb534 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:20.331509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0d1fd5a6-5624-41d7-b1c8-7a1722dbb534 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:20.346204 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fd5a6-5624-41d7-b1c8-7a1722dbb534 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:20.347777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fd5a6-5624-41d7-b1c8-7a1722dbb534 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:20.360092 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4459/8845] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:30.353353 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=32 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:31.457693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72733dd6-987b-4236-9478-5e4dc146c1ca None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:31.459092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-72733dd6-987b-4236-9478-5e4dc146c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:31.476882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72733dd6-987b-4236-9478-5e4dc146c1ca None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:31.481944 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1c84-6d8c-4d2b-a06b-02f526959d5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:31.482546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1c84-6d8c-4d2b-a06b-02f526959d5a service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:31.482829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1c84-6d8c-4d2b-a06b-02f526959d5a service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:31.483109 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1c84-6d8c-4d2b-a06b-02f526959d5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:31.485407 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6a6e1c84-6d8c-4d2b-a06b-02f526959d5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:31.500427 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e1c84-6d8c-4d2b-a06b-02f526959d5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:31.502067 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e1c84-6d8c-4d2b-a06b-02f526959d5a service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:31.515673 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4387/8846] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:41.507980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:45.861372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fd5a6-5624-41d7-b1c8-7a1722dbb534 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:45.874518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fd5a6-5624-41d7-b1c8-7a1722dbb534 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:45.879597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525e07f-dcb3-454d-a4de-b16eb8e37c4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:45.880190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525e07f-dcb3-454d-a4de-b16eb8e37c4d service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:45.880472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525e07f-dcb3-454d-a4de-b16eb8e37c4d service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:45.880752 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525e07f-dcb3-454d-a4de-b16eb8e37c4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:45.882513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0525e07f-dcb3-454d-a4de-b16eb8e37c4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:45.893627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525e07f-dcb3-454d-a4de-b16eb8e37c4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:45.895195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525e07f-dcb3-454d-a4de-b16eb8e37c4d service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:45.905339 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4460/8847] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:49.782760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1c84-6d8c-4d2b-a06b-02f526959d5a service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:49.798863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1c84-6d8c-4d2b-a06b-02f526959d5a service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:49.804292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caae214-9251-49c9-acc3-c43aa1de3013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:49.804895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caae214-9251-49c9-acc3-c43aa1de3013 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:49.805174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caae214-9251-49c9-acc3-c43aa1de3013 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:49.805471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caae214-9251-49c9-acc3-c43aa1de3013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:49.807196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8caae214-9251-49c9-acc3-c43aa1de3013 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:49.823627 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caae214-9251-49c9-acc3-c43aa1de3013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:49.825360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caae214-9251-49c9-acc3-c43aa1de3013 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:49.838988 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4388/8848] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:55.900941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:55.988089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525e07f-dcb3-454d-a4de-b16eb8e37c4d service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:19:55.989561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0525e07f-dcb3-454d-a4de-b16eb8e37c4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:56.007795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525e07f-dcb3-454d-a4de-b16eb8e37c4d service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:19:56.013344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d177acf-fbf0-456b-af54-526fbefed8b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:19:56.014487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d177acf-fbf0-456b-af54-526fbefed8b5 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:56.014770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d177acf-fbf0-456b-af54-526fbefed8b5 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:56.015041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d177acf-fbf0-456b-af54-526fbefed8b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:56.016759 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7d177acf-fbf0-456b-af54-526fbefed8b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:56.032503 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d177acf-fbf0-456b-af54-526fbefed8b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:19:56.034115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d177acf-fbf0-456b-af54-526fbefed8b5 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:19:56.047280 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4461/8849] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:19:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:19:59.831805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:59.960344 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d9ee-f81b-419f-841a-6cc68aa47630 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:19:59.960499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d9ee-f81b-419f-841a-6cc68aa47630 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:19:59.960710 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215d9ee-f81b-419f-841a-6cc68aa47630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:19:59.979546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1215d9ee-f81b-419f-841a-6cc68aa47630 None None] MFA Rules not processed for user `26f455ab6ad14c2db7727b826a2b32bc`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:19:59.980739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1215d9ee-f81b-419f-841a-6cc68aa47630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:19:59.987604 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4389/8850] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:19:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:20:00.629677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d177acf-fbf0-456b-af54-526fbefed8b5 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:00.643915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d177acf-fbf0-456b-af54-526fbefed8b5 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:00.648845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2a72-3669-4db7-a270-871a4964a39d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:00.649483 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2a72-3669-4db7-a270-871a4964a39d service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:00.649764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2a72-3669-4db7-a270-871a4964a39d service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:00.650034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2a72-3669-4db7-a270-871a4964a39d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:00.651743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bdfc2a72-3669-4db7-a270-871a4964a39d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:00.663878 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc2a72-3669-4db7-a270-871a4964a39d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:00.665538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc2a72-3669-4db7-a270-871a4964a39d service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:00.680636 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4462/8851] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:02.961065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215d9ee-f81b-419f-841a-6cc68aa47630 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:02.981153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215d9ee-f81b-419f-841a-6cc68aa47630 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:02.990251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b2d2-930e-4b25-8222-144cd811038b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:02.990874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b2d2-930e-4b25-8222-144cd811038b service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:02.991439 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b2d2-930e-4b25-8222-144cd811038b service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:02.991882 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b2d2-930e-4b25-8222-144cd811038b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:02.995061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e570b2d2-930e-4b25-8222-144cd811038b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:03.032643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570b2d2-930e-4b25-8222-144cd811038b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:03.034719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570b2d2-930e-4b25-8222-144cd811038b service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:03.051854 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4390/8852] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:10.672756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=12 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:13.044471 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=9 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:44.722392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2a72-3669-4db7-a270-871a4964a39d service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:44.731942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2a72-3669-4db7-a270-871a4964a39d service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:44.736350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc24cf-4d70-4d6b-b28d-67a88757e949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:44.736988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc24cf-4d70-4d6b-b28d-67a88757e949 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:44.737267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc24cf-4d70-4d6b-b28d-67a88757e949 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:44.737586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc24cf-4d70-4d6b-b28d-67a88757e949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:44.739388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fbdc24cf-4d70-4d6b-b28d-67a88757e949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:44.752733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc24cf-4d70-4d6b-b28d-67a88757e949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:44.754217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc24cf-4d70-4d6b-b28d-67a88757e949 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:44.765346 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4463/8853] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:44.863608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b2d2-930e-4b25-8222-144cd811038b service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:44.877795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b2d2-930e-4b25-8222-144cd811038b service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:44.882962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f7f94-a0d5-4f14-93a8-dd43ea5c5704 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:44.883578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7f94-a0d5-4f14-93a8-dd43ea5c5704 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:44.883863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7f94-a0d5-4f14-93a8-dd43ea5c5704 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:44.884138 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7f94-a0d5-4f14-93a8-dd43ea5c5704 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:44.885900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0d4f7f94-a0d5-4f14-93a8-dd43ea5c5704 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:44.901311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f7f94-a0d5-4f14-93a8-dd43ea5c5704 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:44.902940 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f7f94-a0d5-4f14-93a8-dd43ea5c5704 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:44.913256 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4391/8854] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:45.082115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc24cf-4d70-4d6b-b28d-67a88757e949 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:20:45.090809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc24cf-4d70-4d6b-b28d-67a88757e949 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:20:45.095261 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acc2cc-9394-4bc6-b5f2-1544776520d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:20:45.095851 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc2cc-9394-4bc6-b5f2-1544776520d0 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:20:45.096128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc2cc-9394-4bc6-b5f2-1544776520d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:20:45.096394 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc2cc-9394-4bc6-b5f2-1544776520d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:20:45.098243 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c3acc2cc-9394-4bc6-b5f2-1544776520d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:20:45.113896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acc2cc-9394-4bc6-b5f2-1544776520d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:20:45.115289 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acc2cc-9394-4bc6-b5f2-1544776520d0 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:20:45.128375 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4464/8855] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:20:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:20:54.909229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:55.121131 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=12 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:02.460543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f7f94-a0d5-4f14-93a8-dd43ea5c5704 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:02.461998 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0d4f7f94-a0d5-4f14-93a8-dd43ea5c5704 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:02.473142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f7f94-a0d5-4f14-93a8-dd43ea5c5704 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:02.476777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcc258-7f35-4f69-b45f-5e4dbd114ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:02.477377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcc258-7f35-4f69-b45f-5e4dbd114ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:02.477698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcc258-7f35-4f69-b45f-5e4dbd114ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:02.477972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcc258-7f35-4f69-b45f-5e4dbd114ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:02.479620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4bdcc258-7f35-4f69-b45f-5e4dbd114ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:02.495725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcc258-7f35-4f69-b45f-5e4dbd114ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:02.497147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcc258-7f35-4f69-b45f-5e4dbd114ae7 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:02.512061 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4392/8856] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:03.551594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acc2cc-9394-4bc6-b5f2-1544776520d0 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:03.560794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acc2cc-9394-4bc6-b5f2-1544776520d0 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:03.565178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c381f50-2212-4218-beb6-6c5025670378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:03.565840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c381f50-2212-4218-beb6-6c5025670378 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:03.566120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c381f50-2212-4218-beb6-6c5025670378 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:03.566395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c381f50-2212-4218-beb6-6c5025670378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:03.568225 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7c381f50-2212-4218-beb6-6c5025670378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:03.580286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c381f50-2212-4218-beb6-6c5025670378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:03.581733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c381f50-2212-4218-beb6-6c5025670378 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:03.592067 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4465/8857] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:07.466496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcc258-7f35-4f69-b45f-5e4dbd114ae7 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:07.475580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcc258-7f35-4f69-b45f-5e4dbd114ae7 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:07.479266 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68e775-5390-4e78-a017-5c94c95497be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:07.479903 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68e775-5390-4e78-a017-5c94c95497be service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:07.480187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68e775-5390-4e78-a017-5c94c95497be service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:07.480463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68e775-5390-4e78-a017-5c94c95497be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:07.482256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3e68e775-5390-4e78-a017-5c94c95497be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:07.498783 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68e775-5390-4e78-a017-5c94c95497be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:07.500516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68e775-5390-4e78-a017-5c94c95497be service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:07.515441 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4393/8858] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:13.586061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:17.507515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=12 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:18.144173 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33ec2e-811d-48cd-8b2d-cc43b4861a17 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:18.144627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33ec2e-811d-48cd-8b2d-cc43b4861a17 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:18.144760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33ec2e-811d-48cd-8b2d-cc43b4861a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:18.164016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2d33ec2e-811d-48cd-8b2d-cc43b4861a17 None None] MFA Rules not processed for user `26f455ab6ad14c2db7727b826a2b32bc`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:21:18.165212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2d33ec2e-811d-48cd-8b2d-cc43b4861a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:18.172080 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4466/8859] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:21:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:21:18.784230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68e775-5390-4e78-a017-5c94c95497be service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:21:18.792818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68e775-5390-4e78-a017-5c94c95497be service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:21:18.796477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d809540-3fb4-40e3-8cf7-d5d4c6a894c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:21:18.797069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d809540-3fb4-40e3-8cf7-d5d4c6a894c5 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:21:18.797346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d809540-3fb4-40e3-8cf7-d5d4c6a894c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:21:18.797647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d809540-3fb4-40e3-8cf7-d5d4c6a894c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:21:18.799366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1d809540-3fb4-40e3-8cf7-d5d4c6a894c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:21:18.811560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d809540-3fb4-40e3-8cf7-d5d4c6a894c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:21:18.812970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d809540-3fb4-40e3-8cf7-d5d4c6a894c5 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:21:18.823675 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4394/8860] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:21:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:21:28.158605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:28.817775 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:17.965955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20506bd9-66c6-4d04-a425-0b54a32d35ee None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:22:17.966529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20506bd9-66c6-4d04-a425-0b54a32d35ee None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:22:17.966529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20506bd9-66c6-4d04-a425-0b54a32d35ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:22:17.986357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-20506bd9-66c6-4d04-a425-0b54a32d35ee None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:22:17.987554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-20506bd9-66c6-4d04-a425-0b54a32d35ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:22:17.996919 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4467/8861] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Aug 29 16:22:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:22:18.009009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d809540-3fb4-40e3-8cf7-d5d4c6a894c5 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:22:18.024154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d809540-3fb4-40e3-8cf7-d5d4c6a894c5 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:22:18.029278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94ca56-ce8d-4736-9daa-e6fd395091c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:22:18.029911 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ca56-ce8d-4736-9daa-e6fd395091c6 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:22:18.030195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ca56-ce8d-4736-9daa-e6fd395091c6 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:22:18.030473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ca56-ce8d-4736-9daa-e6fd395091c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:22:18.039571 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94ca56-ce8d-4736-9daa-e6fd395091c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:22:18.041145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94ca56-ce8d-4736-9daa-e6fd395091c6 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:22:18.050896 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4395/8862] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:22:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:22:18.664842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20506bd9-66c6-4d04-a425-0b54a32d35ee None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:22:18.673978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20506bd9-66c6-4d04-a425-0b54a32d35ee None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:22:18.677512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab78451-2828-41ab-bb8a-675400cee955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:22:18.678100 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab78451-2828-41ab-bb8a-675400cee955 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:22:18.678381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab78451-2828-41ab-bb8a-675400cee955 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:22:18.678650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab78451-2828-41ab-bb8a-675400cee955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:22:18.681000 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7ab78451-2828-41ab-bb8a-675400cee955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:22:18.692977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab78451-2828-41ab-bb8a-675400cee955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:22:18.694436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab78451-2828-41ab-bb8a-675400cee955 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:22:18.705045 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4468/8863] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:22:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:22:25.226319 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc7d30-be6b-49b7-8976-f91b5ba9cfc4 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:22:25.226914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc7d30-be6b-49b7-8976-f91b5ba9cfc4 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:22:25.227017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc7d30-be6b-49b7-8976-f91b5ba9cfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:22:25.246598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-cffc7d30-be6b-49b7-8976-f91b5ba9cfc4 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:22:25.247819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-cffc7d30-be6b-49b7-8976-f91b5ba9cfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:22:25.256494 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4396/8864] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Aug 29 16:22:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:22:25.267787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d93de-2f36-49e2-9d31-d86d11fa7489 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:22:25.268184 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d93de-2f36-49e2-9d31-d86d11fa7489 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:22:25.268366 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d93de-2f36-49e2-9d31-d86d11fa7489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:22:25.288570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-198d93de-2f36-49e2-9d31-d86d11fa7489 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:22:25.289838 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-198d93de-2f36-49e2-9d31-d86d11fa7489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:22:25.298405 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4469/8865] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Aug 29 16:22:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:22:25.304276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc7d30-be6b-49b7-8976-f91b5ba9cfc4 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:22:25.314850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc7d30-be6b-49b7-8976-f91b5ba9cfc4 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:22:25.320515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95679c-2844-4fd0-8370-a59601d46c76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:22:25.321371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95679c-2844-4fd0-8370-a59601d46c76 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:22:25.321861 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95679c-2844-4fd0-8370-a59601d46c76 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:22:25.322144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95679c-2844-4fd0-8370-a59601d46c76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:22:25.330600 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95679c-2844-4fd0-8370-a59601d46c76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:22:25.332217 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95679c-2844-4fd0-8370-a59601d46c76 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:22:25.343710 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4397/8866] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:22:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:22:35.283385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=12 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:35.339126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=15 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:36.161997 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d93de-2f36-49e2-9d31-d86d11fa7489 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:22:36.177190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d93de-2f36-49e2-9d31-d86d11fa7489 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:22:36.183271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043755f8-64c1-4427-a2a9-4ff8c72dc311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:22:36.183875 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043755f8-64c1-4427-a2a9-4ff8c72dc311 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:22:36.184160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043755f8-64c1-4427-a2a9-4ff8c72dc311 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:22:36.184688 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043755f8-64c1-4427-a2a9-4ff8c72dc311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:22:36.192989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043755f8-64c1-4427-a2a9-4ff8c72dc311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:22:36.195160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043755f8-64c1-4427-a2a9-4ff8c72dc311 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:22:36.205005 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4470/8867] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:22:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:22:46.201061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:21.524211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95679c-2844-4fd0-8370-a59601d46c76 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:21.533405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95679c-2844-4fd0-8370-a59601d46c76 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:21.536984 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97584bd-9a83-4aae-8b85-5fac95ae761c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:21.537612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97584bd-9a83-4aae-8b85-5fac95ae761c service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:21.537893 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97584bd-9a83-4aae-8b85-5fac95ae761c service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:21.538167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97584bd-9a83-4aae-8b85-5fac95ae761c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:21.547322 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97584bd-9a83-4aae-8b85-5fac95ae761c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:21.548738 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97584bd-9a83-4aae-8b85-5fac95ae761c service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:21.558320 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4398/8868] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:23:24.420077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043755f8-64c1-4427-a2a9-4ff8c72dc311 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:24.432592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043755f8-64c1-4427-a2a9-4ff8c72dc311 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:24.438306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33315cf-09e5-4a59-97d6-546330cfd35f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:24.438941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33315cf-09e5-4a59-97d6-546330cfd35f service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:24.439284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33315cf-09e5-4a59-97d6-546330cfd35f service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:24.439622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33315cf-09e5-4a59-97d6-546330cfd35f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:24.441533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e33315cf-09e5-4a59-97d6-546330cfd35f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:24.458292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33315cf-09e5-4a59-97d6-546330cfd35f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:24.461126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33315cf-09e5-4a59-97d6-546330cfd35f service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:24.474578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97584bd-9a83-4aae-8b85-5fac95ae761c service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:24.477134 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4471/8869] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:23:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:23:24.491552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97584bd-9a83-4aae-8b85-5fac95ae761c service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:24.497212 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1a46a-3b4d-4ef6-8d1b-9addb543570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:24.497901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1a46a-3b4d-4ef6-8d1b-9addb543570f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:24.498236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1a46a-3b4d-4ef6-8d1b-9addb543570f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:24.498649 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1a46a-3b4d-4ef6-8d1b-9addb543570f admin admin] PATH_INFO: `/v3/users/26f455ab6ad14c2db7727b826a2b32bc` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:24.499807 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1a46a-3b4d-4ef6-8d1b-9addb543570f admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f455ab6ad14c2db7727b826a2b32bc)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:24.501796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1a46a-3b4d-4ef6-8d1b-9addb543570f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:24.560555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fbd1a46a-3b4d-4ef6-8d1b-9addb543570f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f455ab6ad14c2db7727b826a2b32bc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:24.561140 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fbd1a46a-3b4d-4ef6-8d1b-9addb543570f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f455ab6ad14c2db7727b826a2b32bc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:24.574599 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fbd1a46a-3b4d-4ef6-8d1b-9addb543570f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f455ab6ad14c2db7727b826a2b32bc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:24.582065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fbd1a46a-3b4d-4ef6-8d1b-9addb543570f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f455ab6ad14c2db7727b826a2b32bc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:24.589972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-fbd1a46a-3b4d-4ef6-8d1b-9addb543570f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f455ab6ad14c2db7727b826a2b32bc'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:24.595972 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4399/8870] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:23:24 2022] DELETE /identity/v3/users/26f455ab6ad14c2db7727b826a2b32bc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:23:24.769899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33315cf-09e5-4a59-97d6-546330cfd35f service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:24.780546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33315cf-09e5-4a59-97d6-546330cfd35f service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:24.841409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:24.842056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:24.842337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:24.842612 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] PATH_INFO: `/v3/projects/65d92a43d3cd4a6d952e95d1cee77d69` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:24.843719 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d92a43d3cd4a6d952e95d1cee77d69)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:24.845655 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:24.891056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d92a43d3cd4a6d952e95d1cee77d69', 'request_id': 'req-27f5bd68-c75b-4cdc-8d98-06a2432d8863'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:24.900067 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d92a43d3cd4a6d952e95d1cee77d69', 'request_id': 'req-27f5bd68-c75b-4cdc-8d98-06a2432d8863'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:24.909687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d92a43d3cd4a6d952e95d1cee77d69', 'request_id': 'req-27f5bd68-c75b-4cdc-8d98-06a2432d8863'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:24.920435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] The token cache is being invalidate because project 65d92a43d3cd4a6d952e95d1cee77d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:23:24.920724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:24.921363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-27f5bd68-c75b-4cdc-8d98-06a2432d8863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:24.922987 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4472/8871] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:23:24 2022] DELETE /identity/v3/projects/65d92a43d3cd4a6d952e95d1cee77d69 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:23:24.927978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a119bf-7a8d-4d10-a0c5-45bff7c15cea None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:24.928267 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a119bf-7a8d-4d10-a0c5-45bff7c15cea None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:24.928575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a119bf-7a8d-4d10-a0c5-45bff7c15cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:24.949441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d3a119bf-7a8d-4d10-a0c5-45bff7c15cea None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:24.950581 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d3a119bf-7a8d-4d10-a0c5-45bff7c15cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:25.009795 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4400/8872] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:25.073253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039d6b8-5be1-453b-a54a-e6d69cc29e50 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:25.073571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039d6b8-5be1-453b-a54a-e6d69cc29e50 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:25.073833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039d6b8-5be1-453b-a54a-e6d69cc29e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:25.094058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3039d6b8-5be1-453b-a54a-e6d69cc29e50 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:25.095264 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3039d6b8-5be1-453b-a54a-e6d69cc29e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:25.103756 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4473/8873] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:25.108036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a119bf-7a8d-4d10-a0c5-45bff7c15cea None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:25.118016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a119bf-7a8d-4d10-a0c5-45bff7c15cea None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:25.122609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87389cb-0ea1-4d8c-9830-0b102fc2194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:25.123262 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87389cb-0ea1-4d8c-9830-0b102fc2194d admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:25.123547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87389cb-0ea1-4d8c-9830-0b102fc2194d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:25.123825 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87389cb-0ea1-4d8c-9830-0b102fc2194d admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:25.124472 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87389cb-0ea1-4d8c-9830-0b102fc2194d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:23:25.124777 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87389cb-0ea1-4d8c-9830-0b102fc2194d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:25.127695 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87389cb-0ea1-4d8c-9830-0b102fc2194d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:25.140059 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4401/8874] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:23:25.144306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039d6b8-5be1-453b-a54a-e6d69cc29e50 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:25.154272 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039d6b8-5be1-453b-a54a-e6d69cc29e50 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:25.158927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebca31-877c-402c-a3cc-f451069b39f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:25.159518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebca31-877c-402c-a3cc-f451069b39f7 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:25.159802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebca31-877c-402c-a3cc-f451069b39f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:25.160079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebca31-877c-402c-a3cc-f451069b39f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:25.160702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebca31-877c-402c-a3cc-f451069b39f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:25.162646 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebca31-877c-402c-a3cc-f451069b39f7 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:25.207935 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4474/8875] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:23:25 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:23:25.209538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87389cb-0ea1-4d8c-9830-0b102fc2194d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:25.221927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87389cb-0ea1-4d8c-9830-0b102fc2194d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:25.269281 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:25.289260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72315e67-c135-45f5-9607-b0ba1cc59957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:25.289938 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72315e67-c135-45f5-9607-b0ba1cc59957 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:25.290755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72315e67-c135-45f5-9607-b0ba1cc59957 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:25.290755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72315e67-c135-45f5-9607-b0ba1cc59957 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:25.291151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72315e67-c135-45f5-9607-b0ba1cc59957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:25.293130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72315e67-c135-45f5-9607-b0ba1cc59957 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:25.319083 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4402/8876] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:23:25 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:23:25.321244 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebca31-877c-402c-a3cc-f451069b39f7 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:25.331583 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebca31-877c-402c-a3cc-f451069b39f7 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:25.337017 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991945b-e6b0-47ea-a5a7-176c8fca16f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:25.337650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991945b-e6b0-47ea-a5a7-176c8fca16f1 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:25.337935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991945b-e6b0-47ea-a5a7-176c8fca16f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:25.338215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991945b-e6b0-47ea-a5a7-176c8fca16f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:25.338854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991945b-e6b0-47ea-a5a7-176c8fca16f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:25.340487 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991945b-e6b0-47ea-a5a7-176c8fca16f1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:25.354500 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4475/8877] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:23:25.355759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72315e67-c135-45f5-9607-b0ba1cc59957 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:25.365864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72315e67-c135-45f5-9607-b0ba1cc59957 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:25.371225 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c5d66-0a67-41fd-bf44-a0bcba9090e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:25.371827 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c5d66-0a67-41fd-bf44-a0bcba9090e7 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:25.372113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c5d66-0a67-41fd-bf44-a0bcba9090e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:25.372393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c5d66-0a67-41fd-bf44-a0bcba9090e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:25.373034 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c5d66-0a67-41fd-bf44-a0bcba9090e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:25.374668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c5d66-0a67-41fd-bf44-a0bcba9090e7 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:25.386226 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4403/8878] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:23:25.390344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991945b-e6b0-47ea-a5a7-176c8fca16f1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:25.401104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991945b-e6b0-47ea-a5a7-176c8fca16f1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:25.406137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57179e4-6167-46d5-822e-9b771374f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:25.406787 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57179e4-6167-46d5-822e-9b771374f347 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:25.407186 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57179e4-6167-46d5-822e-9b771374f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:25.407552 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57179e4-6167-46d5-822e-9b771374f347 admin admin] PATH_INFO: `/v3/projects/355a0e654a9f48558ccf4099ea929f86/users/92e7fdc4bd894d9eb9ee25e461be8103/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:25.422375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57179e4-6167-46d5-822e-9b771374f347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355a0e654a9f48558ccf4099ea929f86, user_id=92e7fdc4bd894d9eb9ee25e461be8103, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:25.425030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57179e4-6167-46d5-822e-9b771374f347 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:25.437936 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4476/8879] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:23:25 2022] PUT /identity/v3/projects/355a0e654a9f48558ccf4099ea929f86/users/92e7fdc4bd894d9eb9ee25e461be8103/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:23:25.443181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763fb1a-c6d1-49eb-a594-ec8a675b8192 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:25.443473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763fb1a-c6d1-49eb-a594-ec8a675b8192 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:25.443754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763fb1a-c6d1-49eb-a594-ec8a675b8192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:25.463973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9763fb1a-c6d1-49eb-a594-ec8a675b8192 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:25.465103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9763fb1a-c6d1-49eb-a594-ec8a675b8192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:25.533986 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4404/8880] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:25.543777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57179e4-6167-46d5-822e-9b771374f347 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:25.547652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b57179e4-6167-46d5-822e-9b771374f347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:25.561166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:25.609099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57179e4-6167-46d5-822e-9b771374f347 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:25.612975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9c354-4b3e-475d-aea3-9902f36d7272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:25.613622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9c354-4b3e-475d-aea3-9902f36d7272 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:25.613906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9c354-4b3e-475d-aea3-9902f36d7272 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:25.614181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9c354-4b3e-475d-aea3-9902f36d7272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:25.623839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9c354-4b3e-475d-aea3-9902f36d7272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:25.625286 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9c354-4b3e-475d-aea3-9902f36d7272 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:25.635292 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4477/8881] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:23:29.765700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3de55-7660-453b-9d17-2266221bed55 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:29.766551 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3de55-7660-453b-9d17-2266221bed55 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:29.767003 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3de55-7660-453b-9d17-2266221bed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:29.806857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-f4c3de55-7660-453b-9d17-2266221bed55 None None] MFA Rules not processed for user `92e7fdc4bd894d9eb9ee25e461be8103`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:29.808320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f4c3de55-7660-453b-9d17-2266221bed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:29.878058 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4405/8882] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:29.888268 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f7bc-59ac-4a70-be87-af0f63eb98c2 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:29.888783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f7bc-59ac-4a70-be87-af0f63eb98c2 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:29.888783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f7bc-59ac-4a70-be87-af0f63eb98c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:29.914352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-8f95f7bc-59ac-4a70-be87-af0f63eb98c2 None None] MFA Rules not processed for user `92e7fdc4bd894d9eb9ee25e461be8103`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:29.915594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8f95f7bc-59ac-4a70-be87-af0f63eb98c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:29.923043 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4478/8883] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:29.938240 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3de55-7660-453b-9d17-2266221bed55 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:29.939824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f4c3de55-7660-453b-9d17-2266221bed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:30.008859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:30.036989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3de55-7660-453b-9d17-2266221bed55 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:30.043366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b1fff-989f-433a-9d8f-7cbfadfcaf63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:30.043987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b1fff-989f-433a-9d8f-7cbfadfcaf63 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:30.044263 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b1fff-989f-433a-9d8f-7cbfadfcaf63 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:30.044531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b1fff-989f-433a-9d8f-7cbfadfcaf63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:30.053119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b1fff-989f-433a-9d8f-7cbfadfcaf63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:30.054799 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b1fff-989f-433a-9d8f-7cbfadfcaf63 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:30.064735 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4406/8884] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:23:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:23:30.327498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f7bc-59ac-4a70-be87-af0f63eb98c2 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:30.328928 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8f95f7bc-59ac-4a70-be87-af0f63eb98c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:30.342827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f7bc-59ac-4a70-be87-af0f63eb98c2 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:30.346813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15e785-f68b-4910-8b01-d383f8ad4af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:30.347411 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15e785-f68b-4910-8b01-d383f8ad4af3 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:30.347693 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15e785-f68b-4910-8b01-d383f8ad4af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:30.347964 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15e785-f68b-4910-8b01-d383f8ad4af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:30.349826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0a15e785-f68b-4910-8b01-d383f8ad4af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:30.362963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15e785-f68b-4910-8b01-d383f8ad4af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:30.364326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15e785-f68b-4910-8b01-d383f8ad4af3 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:30.374800 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4479/8885] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:23:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:23:40.060785 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=9 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:40.205462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fba6d-7367-4d8d-afda-b1317ce869f9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:40.205748 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fba6d-7367-4d8d-afda-b1317ce869f9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:40.206024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fba6d-7367-4d8d-afda-b1317ce869f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:40.225410 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4d3fba6d-7367-4d8d-afda-b1317ce869f9 None None] MFA Rules not processed for user `92e7fdc4bd894d9eb9ee25e461be8103`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:40.226594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4d3fba6d-7367-4d8d-afda-b1317ce869f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:40.233462 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4407/8886] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:40.368649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=29 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:47.012233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046ecb-3155-4729-a54b-968192a1618e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:47.013246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046ecb-3155-4729-a54b-968192a1618e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:47.013246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046ecb-3155-4729-a54b-968192a1618e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:47.051747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-37046ecb-3155-4729-a54b-968192a1618e None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:47.053137 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-37046ecb-3155-4729-a54b-968192a1618e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:47.063593 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4480/8887] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Aug 29 16:23:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:48.251116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dbef2-a74e-4f3e-b84b-d2a368fbb360 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:48.251703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dbef2-a74e-4f3e-b84b-d2a368fbb360 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:48.251703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dbef2-a74e-4f3e-b84b-d2a368fbb360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:48.278347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c90dbef2-a74e-4f3e-b84b-d2a368fbb360 None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:48.279568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c90dbef2-a74e-4f3e-b84b-d2a368fbb360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:48.288917 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4408/8888] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Aug 29 16:23:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:53.128395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13795c-21c5-40c5-aec8-7dd3af5010cb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:53.128947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13795c-21c5-40c5-aec8-7dd3af5010cb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:53.128947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13795c-21c5-40c5-aec8-7dd3af5010cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:53.148199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-1c13795c-21c5-40c5-aec8-7dd3af5010cb None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:53.149493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1c13795c-21c5-40c5-aec8-7dd3af5010cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:53.158653 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4481/8889] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:53.169767 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dbef2-a74e-4f3e-b84b-d2a368fbb360 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:53.179086 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dbef2-a74e-4f3e-b84b-d2a368fbb360 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:53.183358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249486b-028e-4ed2-acd8-b0259ebd9c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:53.183957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249486b-028e-4ed2-acd8-b0259ebd9c34 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:53.184490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249486b-028e-4ed2-acd8-b0259ebd9c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:53.184768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249486b-028e-4ed2-acd8-b0259ebd9c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:53.194909 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249486b-028e-4ed2-acd8-b0259ebd9c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:53.196438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249486b-028e-4ed2-acd8-b0259ebd9c34 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:53.207296 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4409/8890] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:23:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:23:59.163667 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13795c-21c5-40c5-aec8-7dd3af5010cb None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:59.175365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13795c-21c5-40c5-aec8-7dd3af5010cb None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:59.181342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a96ff4-58d2-491d-9f1c-1e178114597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:59.182033 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a96ff4-58d2-491d-9f1c-1e178114597f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:59.182318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a96ff4-58d2-491d-9f1c-1e178114597f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:59.182593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a96ff4-58d2-491d-9f1c-1e178114597f admin admin] PATH_INFO: `/v3/users/92e7fdc4bd894d9eb9ee25e461be8103` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:59.183794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a96ff4-58d2-491d-9f1c-1e178114597f admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e7fdc4bd894d9eb9ee25e461be8103)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:59.186113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a96ff4-58d2-491d-9f1c-1e178114597f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:59.238081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29a96ff4-58d2-491d-9f1c-1e178114597f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e7fdc4bd894d9eb9ee25e461be8103'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:59.238843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29a96ff4-58d2-491d-9f1c-1e178114597f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e7fdc4bd894d9eb9ee25e461be8103'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:59.256265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29a96ff4-58d2-491d-9f1c-1e178114597f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e7fdc4bd894d9eb9ee25e461be8103'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:59.256995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29a96ff4-58d2-491d-9f1c-1e178114597f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e7fdc4bd894d9eb9ee25e461be8103'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:59.264165 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-29a96ff4-58d2-491d-9f1c-1e178114597f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e7fdc4bd894d9eb9ee25e461be8103'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:59.278528 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4482/8891] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:23:59 2022] DELETE /identity/v3/users/92e7fdc4bd894d9eb9ee25e461be8103 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:23:59.455674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249486b-028e-4ed2-acd8-b0259ebd9c34 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:59.466994 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249486b-028e-4ed2-acd8-b0259ebd9c34 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:59.536744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:59.537409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:59.537697 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:59.537988 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] PATH_INFO: `/v3/projects/355a0e654a9f48558ccf4099ea929f86` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:59.539698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=355a0e654a9f48558ccf4099ea929f86)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:59.541647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:59.588957 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355a0e654a9f48558ccf4099ea929f86', 'request_id': 'req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:59.594553 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355a0e654a9f48558ccf4099ea929f86', 'request_id': 'req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:59.601566 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355a0e654a9f48558ccf4099ea929f86', 'request_id': 'req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:59.612540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] The token cache is being invalidate because project 355a0e654a9f48558ccf4099ea929f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:23:59.612831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:59.613506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-398a3b1e-9b6e-4e11-be6b-3b3df4bf63c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:23:59.615020 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4410/8892] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:23:59 2022] DELETE /identity/v3/projects/355a0e654a9f48558ccf4099ea929f86 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:23:59.619952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed534b-1c10-4015-8518-768e81383612 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:59.620238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed534b-1c10-4015-8518-768e81383612 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:59.620512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed534b-1c10-4015-8518-768e81383612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:59.651077 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-bbed534b-1c10-4015-8518-768e81383612 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:59.652260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bbed534b-1c10-4015-8518-768e81383612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:59.712181 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4483/8893] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:59.719989 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d444e4-13ba-4281-a7bf-7236d2a851e8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:59.720277 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d444e4-13ba-4281-a7bf-7236d2a851e8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:59.720559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d444e4-13ba-4281-a7bf-7236d2a851e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:59.740008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-22d444e4-13ba-4281-a7bf-7236d2a851e8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:23:59.741200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-22d444e4-13ba-4281-a7bf-7236d2a851e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:23:59.749109 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4411/8894] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:23:59.753209 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed534b-1c10-4015-8518-768e81383612 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:59.763368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed534b-1c10-4015-8518-768e81383612 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:59.768141 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7099c9-923b-4623-83df-6b546812e2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:59.768859 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7099c9-923b-4623-83df-6b546812e2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:59.769142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7099c9-923b-4623-83df-6b546812e2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:59.769443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7099c9-923b-4623-83df-6b546812e2e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:59.770089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7099c9-923b-4623-83df-6b546812e2e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:23:59.770392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7099c9-923b-4623-83df-6b546812e2e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:59.771985 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7099c9-923b-4623-83df-6b546812e2e8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:59.784355 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4484/8895] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:23:59.788591 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d444e4-13ba-4281-a7bf-7236d2a851e8 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:59.798185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d444e4-13ba-4281-a7bf-7236d2a851e8 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:59.802951 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865e066-7281-45a8-a7a7-7f30ffe313ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:59.803556 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e066-7281-45a8-a7a7-7f30ffe313ac admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:59.803838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e066-7281-45a8-a7a7-7f30ffe313ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:59.804114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e066-7281-45a8-a7a7-7f30ffe313ac admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:59.804759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865e066-7281-45a8-a7a7-7f30ffe313ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:59.806773 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865e066-7281-45a8-a7a7-7f30ffe313ac admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:59.835296 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4412/8896] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:23:59 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:23:59.839747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7099c9-923b-4623-83df-6b546812e2e8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:59.849871 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7099c9-923b-4623-83df-6b546812e2e8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:59.870481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:59.908167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fe61f-f811-47b8-b72e-f9dc96ff8621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:59.908967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fe61f-f811-47b8-b72e-f9dc96ff8621 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:59.909199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fe61f-f811-47b8-b72e-f9dc96ff8621 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:59.909532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fe61f-f811-47b8-b72e-f9dc96ff8621 admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:59.910315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fe61f-f811-47b8-b72e-f9dc96ff8621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:59.912333 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fe61f-f811-47b8-b72e-f9dc96ff8621 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:59.935375 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4485/8897] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:23:59 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:23:59.939467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865e066-7281-45a8-a7a7-7f30ffe313ac admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:59.950462 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865e066-7281-45a8-a7a7-7f30ffe313ac admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:59.955246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b68a0-4c21-4550-b9a7-d08f17ac596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:59.955841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b68a0-4c21-4550-b9a7-d08f17ac596e admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:59.956183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b68a0-4c21-4550-b9a7-d08f17ac596e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:59.956441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b68a0-4c21-4550-b9a7-d08f17ac596e admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:59.957029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b68a0-4c21-4550-b9a7-d08f17ac596e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:59.958679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b68a0-4c21-4550-b9a7-d08f17ac596e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:23:59.968607 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4413/8898] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:23:59.972695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fe61f-f811-47b8-b72e-f9dc96ff8621 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:23:59.983092 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fe61f-f811-47b8-b72e-f9dc96ff8621 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:23:59.987784 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42594d-e2f5-4380-86da-b86a35878f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:23:59.988378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42594d-e2f5-4380-86da-b86a35878f6c admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:23:59.988660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42594d-e2f5-4380-86da-b86a35878f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:23:59.988941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42594d-e2f5-4380-86da-b86a35878f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:23:59.989622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42594d-e2f5-4380-86da-b86a35878f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:23:59.991248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42594d-e2f5-4380-86da-b86a35878f6c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:00.002632 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4486/8899] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:24:00.006606 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b68a0-4c21-4550-b9a7-d08f17ac596e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:00.017363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b68a0-4c21-4550-b9a7-d08f17ac596e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:00.022249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacaab3-7ce8-4a9f-bc7d-f43e648eb4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:00.022925 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacaab3-7ce8-4a9f-bc7d-f43e648eb4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:00.023210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacaab3-7ce8-4a9f-bc7d-f43e648eb4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:00.023492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacaab3-7ce8-4a9f-bc7d-f43e648eb4cf admin admin] PATH_INFO: `/v3/projects/d7ee84e825544867bc54ceea04b7565f/users/e0b11b175b8c4e4da456127926837f31/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:00.038035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacaab3-7ce8-4a9f-bc7d-f43e648eb4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ee84e825544867bc54ceea04b7565f, user_id=e0b11b175b8c4e4da456127926837f31, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:00.040802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacaab3-7ce8-4a9f-bc7d-f43e648eb4cf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:00.049467 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:00.055063 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4414/8900] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:24:00 2022] PUT /identity/v3/projects/d7ee84e825544867bc54ceea04b7565f/users/e0b11b175b8c4e4da456127926837f31/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:24:00.068594 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f315e5b-a08b-45ca-9fac-8256e3ffe02b None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:00.069043 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f315e5b-a08b-45ca-9fac-8256e3ffe02b None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:00.069358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f315e5b-a08b-45ca-9fac-8256e3ffe02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:00.097621 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-7f315e5b-a08b-45ca-9fac-8256e3ffe02b None None] MFA Rules not processed for user `e0b11b175b8c4e4da456127926837f31`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:00.098763 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7f315e5b-a08b-45ca-9fac-8256e3ffe02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:00.162210 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4487/8901] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:00.172394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacaab3-7ce8-4a9f-bc7d-f43e648eb4cf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:00.174073 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1bacaab3-7ce8-4a9f-bc7d-f43e648eb4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:00.247908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacaab3-7ce8-4a9f-bc7d-f43e648eb4cf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:00.251692 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df61173-bd85-4914-8f01-c65c37396488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:00.252291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61173-bd85-4914-8f01-c65c37396488 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:00.252576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61173-bd85-4914-8f01-c65c37396488 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:00.252852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61173-bd85-4914-8f01-c65c37396488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:00.261690 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df61173-bd85-4914-8f01-c65c37396488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:00.263115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df61173-bd85-4914-8f01-c65c37396488 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:00.271891 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4415/8902] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:24:08.598449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f315e5b-a08b-45ca-9fac-8256e3ffe02b None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:08.600474 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7f315e5b-a08b-45ca-9fac-8256e3ffe02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:08.734170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f315e5b-a08b-45ca-9fac-8256e3ffe02b None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:08.740351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230b814-b73e-4b7e-8cbd-289e8ba8db46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:08.741066 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b814-b73e-4b7e-8cbd-289e8ba8db46 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:08.741684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b814-b73e-4b7e-8cbd-289e8ba8db46 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:08.742712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b814-b73e-4b7e-8cbd-289e8ba8db46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:08.744887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0230b814-b73e-4b7e-8cbd-289e8ba8db46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:08.765652 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230b814-b73e-4b7e-8cbd-289e8ba8db46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:08.767293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230b814-b73e-4b7e-8cbd-289e8ba8db46 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:08.781123 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4488/8903] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:24:10.267980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=33 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:10.948373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df61173-bd85-4914-8f01-c65c37396488 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:11.012764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df61173-bd85-4914-8f01-c65c37396488 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:11.017335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:11.017992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.018275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.018552 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] PATH_INFO: `/v3/users/e0b11b175b8c4e4da456127926837f31` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.019668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b11b175b8c4e4da456127926837f31)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:11.021630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:11.069046 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b11b175b8c4e4da456127926837f31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:11.069683 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b11b175b8c4e4da456127926837f31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:11.081652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b11b175b8c4e4da456127926837f31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:11.088822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b11b175b8c4e4da456127926837f31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:11.095920 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b11b175b8c4e4da456127926837f31'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:11.102458 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4416/8904] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:24:10 2022] DELETE /identity/v3/users/e0b11b175b8c4e4da456127926837f31 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:24:11.106938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddf797-d43e-4526-9c08-0f1d83aa26cd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.107387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddf797-d43e-4526-9c08-0f1d83aa26cd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.107505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddf797-d43e-4526-9c08-0f1d83aa26cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.126718 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-66ddf797-d43e-4526-9c08-0f1d83aa26cd None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:11.127895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66ddf797-d43e-4526-9c08-0f1d83aa26cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:11.144086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:11.188584 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4489/8905] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:11.199543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:11.201099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:11.260129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca4d55-c083-4962-9c3e-cafee6b3d399 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:11.263815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391f2bb-a454-4e6e-a72f-bd690839ad76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:11.264417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f2bb-a454-4e6e-a72f-bd690839ad76 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.264725 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f2bb-a454-4e6e-a72f-bd690839ad76 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.265004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f2bb-a454-4e6e-a72f-bd690839ad76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.274506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391f2bb-a454-4e6e-a72f-bd690839ad76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:11.275926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391f2bb-a454-4e6e-a72f-bd690839ad76 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:11.285708 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4417/8906] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:24:11.453828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddf797-d43e-4526-9c08-0f1d83aa26cd None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:11.455253 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-66ddf797-d43e-4526-9c08-0f1d83aa26cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:11.473563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddf797-d43e-4526-9c08-0f1d83aa26cd None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:11.480575 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:11.481203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.481508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.481771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] PATH_INFO: `/v3/projects/d7ee84e825544867bc54ceea04b7565f` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.482950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ee84e825544867bc54ceea04b7565f)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:11.484777 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:11.532978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ee84e825544867bc54ceea04b7565f', 'request_id': 'req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:11.540153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ee84e825544867bc54ceea04b7565f', 'request_id': 'req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:11.547943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ee84e825544867bc54ceea04b7565f', 'request_id': 'req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:11.558834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] The token cache is being invalidate because project d7ee84e825544867bc54ceea04b7565f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:24:11.559120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:11.560115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-cbc0b2fc-d543-4ce4-99ac-b9ce701ff03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:11.561641 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4490/8907] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:24:11 2022] DELETE /identity/v3/projects/d7ee84e825544867bc54ceea04b7565f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:24:11.566714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f0786-c45c-485f-ba4b-4f9a98c8a210 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.567036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f0786-c45c-485f-ba4b-4f9a98c8a210 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.567417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f0786-c45c-485f-ba4b-4f9a98c8a210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.588099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-713f0786-c45c-485f-ba4b-4f9a98c8a210 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:11.589315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-713f0786-c45c-485f-ba4b-4f9a98c8a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:11.606257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:11.650130 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4418/8908] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:11.657967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf034b-c75d-4a55-8edd-cf74a78a709c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.658250 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf034b-c75d-4a55-8edd-cf74a78a709c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.658549 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf034b-c75d-4a55-8edd-cf74a78a709c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.677981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-fedf034b-c75d-4a55-8edd-cf74a78a709c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:11.679177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fedf034b-c75d-4a55-8edd-cf74a78a709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:11.687266 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4491/8909] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:11.691406 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f0786-c45c-485f-ba4b-4f9a98c8a210 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:11.701880 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f0786-c45c-485f-ba4b-4f9a98c8a210 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:11.706530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429a0c0-3760-4063-b6af-b76402a29852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:11.707129 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429a0c0-3760-4063-b6af-b76402a29852 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.707411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429a0c0-3760-4063-b6af-b76402a29852 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.707693 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429a0c0-3760-4063-b6af-b76402a29852 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.708370 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429a0c0-3760-4063-b6af-b76402a29852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:24:11.708669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429a0c0-3760-4063-b6af-b76402a29852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:11.710303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429a0c0-3760-4063-b6af-b76402a29852 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:11.722334 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4419/8910] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:24:11.726512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf034b-c75d-4a55-8edd-cf74a78a709c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:11.735690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf034b-c75d-4a55-8edd-cf74a78a709c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:11.740328 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bed5b4-d151-462f-97a8-19bcc7ac603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:11.740916 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bed5b4-d151-462f-97a8-19bcc7ac603a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.741195 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bed5b4-d151-462f-97a8-19bcc7ac603a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.741493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bed5b4-d151-462f-97a8-19bcc7ac603a admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.742160 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bed5b4-d151-462f-97a8-19bcc7ac603a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:11.745045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bed5b4-d151-462f-97a8-19bcc7ac603a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:11.774809 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4492/8911] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:24:11 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:24:11.779350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429a0c0-3760-4063-b6af-b76402a29852 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:11.790252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429a0c0-3760-4063-b6af-b76402a29852 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:11.847216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ebf3-dd3b-488f-9b99-3a5f75757f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:11.847822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ebf3-dd3b-488f-9b99-3a5f75757f1e admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.848105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ebf3-dd3b-488f-9b99-3a5f75757f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.848382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ebf3-dd3b-488f-9b99-3a5f75757f1e admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.849016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161ebf3-dd3b-488f-9b99-3a5f75757f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:11.850976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161ebf3-dd3b-488f-9b99-3a5f75757f1e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:11.874883 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4420/8912] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:24:11 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:24:11.876018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bed5b4-d151-462f-97a8-19bcc7ac603a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:11.886733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bed5b4-d151-462f-97a8-19bcc7ac603a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:11.891332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55fb7c-eef7-442e-9f62-09e377d2eb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:11.891926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55fb7c-eef7-442e-9f62-09e377d2eb82 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.892207 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55fb7c-eef7-442e-9f62-09e377d2eb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.892481 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55fb7c-eef7-442e-9f62-09e377d2eb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.893114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55fb7c-eef7-442e-9f62-09e377d2eb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:11.894897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55fb7c-eef7-442e-9f62-09e377d2eb82 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:11.905287 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4493/8913] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:24:11.909139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ebf3-dd3b-488f-9b99-3a5f75757f1e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:11.919121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ebf3-dd3b-488f-9b99-3a5f75757f1e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:11.923753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865984f-5460-497d-addf-e5c712e04ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:11.924366 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865984f-5460-497d-addf-e5c712e04ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.924626 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865984f-5460-497d-addf-e5c712e04ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.924902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865984f-5460-497d-addf-e5c712e04ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.925577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865984f-5460-497d-addf-e5c712e04ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:11.927176 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865984f-5460-497d-addf-e5c712e04ef1 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:11.938470 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4421/8914] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:24:11.942312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55fb7c-eef7-442e-9f62-09e377d2eb82 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:11.952626 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55fb7c-eef7-442e-9f62-09e377d2eb82 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:11.957464 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e089940-eb84-4a2b-99d7-e9e2016ac6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:11.958158 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e089940-eb84-4a2b-99d7-e9e2016ac6e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:11.958439 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e089940-eb84-4a2b-99d7-e9e2016ac6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:11.958712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e089940-eb84-4a2b-99d7-e9e2016ac6e1 admin admin] PATH_INFO: `/v3/projects/2b514aeebc204904b4f14fea5c38c68d/users/bd7bd85b152346c0bce980ba0e35c813/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:11.974143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e089940-eb84-4a2b-99d7-e9e2016ac6e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b514aeebc204904b4f14fea5c38c68d, user_id=bd7bd85b152346c0bce980ba0e35c813, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:11.976856 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e089940-eb84-4a2b-99d7-e9e2016ac6e1 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:11.994316 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4494/8915] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:24:11 2022] PUT /identity/v3/projects/2b514aeebc204904b4f14fea5c38c68d/users/bd7bd85b152346c0bce980ba0e35c813/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:24:12.004559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ecdea-966c-4b4a-b16a-3f64f4ec4821 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:12.004848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ecdea-966c-4b4a-b16a-3f64f4ec4821 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:12.005132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ecdea-966c-4b4a-b16a-3f64f4ec4821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:12.032834 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a04ecdea-966c-4b4a-b16a-3f64f4ec4821 None None] MFA Rules not processed for user `bd7bd85b152346c0bce980ba0e35c813`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:12.034076 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a04ecdea-966c-4b4a-b16a-3f64f4ec4821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:12.098987 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4422/8916] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:12.109358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e089940-eb84-4a2b-99d7-e9e2016ac6e1 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:12.111108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6e089940-eb84-4a2b-99d7-e9e2016ac6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:12.159710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:12.173203 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e089940-eb84-4a2b-99d7-e9e2016ac6e1 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:12.178570 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573656d6-ede0-4864-9474-31406c58745b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:12.179716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573656d6-ede0-4864-9474-31406c58745b service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:12.180001 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573656d6-ede0-4864-9474-31406c58745b service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:12.180274 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573656d6-ede0-4864-9474-31406c58745b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:12.189277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573656d6-ede0-4864-9474-31406c58745b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:12.190744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573656d6-ede0-4864-9474-31406c58745b service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:12.200404 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4495/8917] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:24:15.889459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ecdea-966c-4b4a-b16a-3f64f4ec4821 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:15.909228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:15.973854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ecdea-966c-4b4a-b16a-3f64f4ec4821 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:15.979027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:15.979654 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:15.979933 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:15.980209 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] PATH_INFO: `/v3/users/bd7bd85b152346c0bce980ba0e35c813` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:15.981353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7bd85b152346c0bce980ba0e35c813)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:15.983323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:16.028977 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7bd85b152346c0bce980ba0e35c813'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:16.029673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7bd85b152346c0bce980ba0e35c813'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:16.042239 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7bd85b152346c0bce980ba0e35c813'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:16.049622 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7bd85b152346c0bce980ba0e35c813'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:16.056790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7bd85b152346c0bce980ba0e35c813'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:16.063266 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4423/8918] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:24:15 2022] DELETE /identity/v3/users/bd7bd85b152346c0bce980ba0e35c813 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:24:16.067756 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53aaf2-830f-4839-ad81-18a9addd3543 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.068202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53aaf2-830f-4839-ad81-18a9addd3543 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.068295 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53aaf2-830f-4839-ad81-18a9addd3543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:16.088058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-ba53aaf2-830f-4839-ad81-18a9addd3543 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:16.089238 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ba53aaf2-830f-4839-ad81-18a9addd3543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:16.147243 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4496/8919] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:16.157440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:16.158847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:16.220421 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095a7fc-136d-48f7-b8e1-9cc640ba1eed admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:16.226819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fcde8-666c-40c9-97e0-3886a91251dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:16.227837 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fcde8-666c-40c9-97e0-3886a91251dd service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.228335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fcde8-666c-40c9-97e0-3886a91251dd service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.228841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fcde8-666c-40c9-97e0-3886a91251dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:16.247598 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fcde8-666c-40c9-97e0-3886a91251dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:16.249027 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fcde8-666c-40c9-97e0-3886a91251dd service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:16.258943 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4424/8920] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:24:16.429920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53aaf2-830f-4839-ad81-18a9addd3543 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:16.431393 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-ba53aaf2-830f-4839-ad81-18a9addd3543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:16.453325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53aaf2-830f-4839-ad81-18a9addd3543 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:16.458021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:16.458661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.458940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.459217 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] PATH_INFO: `/v3/projects/2b514aeebc204904b4f14fea5c38c68d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:16.460502 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b514aeebc204904b4f14fea5c38c68d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:16.462495 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:16.515969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b514aeebc204904b4f14fea5c38c68d', 'request_id': 'req-417ff121-f1de-465b-aa66-ba59a6be2d80'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:16.523551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b514aeebc204904b4f14fea5c38c68d', 'request_id': 'req-417ff121-f1de-465b-aa66-ba59a6be2d80'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:16.539959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b514aeebc204904b4f14fea5c38c68d', 'request_id': 'req-417ff121-f1de-465b-aa66-ba59a6be2d80'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:16.552633 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] The token cache is being invalidate because project 2b514aeebc204904b4f14fea5c38c68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:24:16.552926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:16.553615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-417ff121-f1de-465b-aa66-ba59a6be2d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:24:16.555703 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4497/8921] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:24:16 2022] DELETE /identity/v3/projects/2b514aeebc204904b4f14fea5c38c68d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:24:16.561605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695da6ce-43d2-45ed-966d-6eab9f8c9b5b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.561605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695da6ce-43d2-45ed-966d-6eab9f8c9b5b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.561605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695da6ce-43d2-45ed-966d-6eab9f8c9b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:16.582901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-695da6ce-43d2-45ed-966d-6eab9f8c9b5b None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:16.584121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-695da6ce-43d2-45ed-966d-6eab9f8c9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:16.593865 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:16.651750 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4425/8922] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:16.653674 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106481-5353-4a0a-851b-e9d2e02166a4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.653773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106481-5353-4a0a-851b-e9d2e02166a4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.653999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106481-5353-4a0a-851b-e9d2e02166a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:16.673812 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-30106481-5353-4a0a-851b-e9d2e02166a4 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:16.675021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-30106481-5353-4a0a-851b-e9d2e02166a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:16.683803 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4498/8923] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:16.688374 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695da6ce-43d2-45ed-966d-6eab9f8c9b5b None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:16.698841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695da6ce-43d2-45ed-966d-6eab9f8c9b5b None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:16.703643 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003353c-ae08-4d11-b874-a08539d081e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:16.704249 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003353c-ae08-4d11-b874-a08539d081e2 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.704529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003353c-ae08-4d11-b874-a08539d081e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.704805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003353c-ae08-4d11-b874-a08539d081e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:16.705483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003353c-ae08-4d11-b874-a08539d081e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:24:16.705791 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003353c-ae08-4d11-b874-a08539d081e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:16.707391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003353c-ae08-4d11-b874-a08539d081e2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:16.718972 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4426/8924] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:24:16.723167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30106481-5353-4a0a-851b-e9d2e02166a4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:16.732611 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30106481-5353-4a0a-851b-e9d2e02166a4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:16.737417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6658b3-10a3-4008-a7ca-461bd003246a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:16.738016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6658b3-10a3-4008-a7ca-461bd003246a admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.738300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6658b3-10a3-4008-a7ca-461bd003246a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.738576 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6658b3-10a3-4008-a7ca-461bd003246a admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:16.739241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6658b3-10a3-4008-a7ca-461bd003246a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:16.741161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6658b3-10a3-4008-a7ca-461bd003246a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:16.768890 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4499/8925] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:24:16 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:24:16.773215 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003353c-ae08-4d11-b874-a08539d081e2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:16.783389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003353c-ae08-4d11-b874-a08539d081e2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:16.843941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ff698-5f93-4d19-b357-8e8eb076023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:16.844570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff698-5f93-4d19-b357-8e8eb076023a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.844853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff698-5f93-4d19-b357-8e8eb076023a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.845132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ff698-5f93-4d19-b357-8e8eb076023a admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:16.845822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ff698-5f93-4d19-b357-8e8eb076023a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:16.847774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ff698-5f93-4d19-b357-8e8eb076023a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:16.871615 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4427/8926] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:24:16 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:24:16.875913 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6658b3-10a3-4008-a7ca-461bd003246a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:16.886322 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6658b3-10a3-4008-a7ca-461bd003246a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:16.890876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244e545-ca07-4836-a24e-26545b8c750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:16.891468 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244e545-ca07-4836-a24e-26545b8c750f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.891750 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244e545-ca07-4836-a24e-26545b8c750f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.892024 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244e545-ca07-4836-a24e-26545b8c750f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:16.892662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244e545-ca07-4836-a24e-26545b8c750f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:16.894287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244e545-ca07-4836-a24e-26545b8c750f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:16.904274 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4500/8927] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:24:16.907968 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ff698-5f93-4d19-b357-8e8eb076023a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:16.918535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ff698-5f93-4d19-b357-8e8eb076023a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:16.923287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4805e3-5e39-4339-a1ea-6622d9809f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:16.923895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4805e3-5e39-4339-a1ea-6622d9809f13 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.924161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4805e3-5e39-4339-a1ea-6622d9809f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.924438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4805e3-5e39-4339-a1ea-6622d9809f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:16.925097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4805e3-5e39-4339-a1ea-6622d9809f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:16.926730 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4805e3-5e39-4339-a1ea-6622d9809f13 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:16.938301 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4428/8928] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:24:16.942260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244e545-ca07-4836-a24e-26545b8c750f admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:16.952338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244e545-ca07-4836-a24e-26545b8c750f admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:16.957145 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230c8fe-5ba6-411d-81a8-607c5cf92536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:16.957825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230c8fe-5ba6-411d-81a8-607c5cf92536 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.958110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230c8fe-5ba6-411d-81a8-607c5cf92536 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.958387 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230c8fe-5ba6-411d-81a8-607c5cf92536 admin admin] PATH_INFO: `/v3/projects/8445c72633d149218d47aaf80e16ae99/users/8ca581ef43c64b32b74341b6dd402200/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:16.973979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230c8fe-5ba6-411d-81a8-607c5cf92536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8445c72633d149218d47aaf80e16ae99, user_id=8ca581ef43c64b32b74341b6dd402200, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:16.977148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230c8fe-5ba6-411d-81a8-607c5cf92536 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:16.985012 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:16.991507 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4501/8929] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:24:16 2022] PUT /identity/v3/projects/8445c72633d149218d47aaf80e16ae99/users/8ca581ef43c64b32b74341b6dd402200/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:24:16.997459 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f643fe-42dd-4aec-9759-9f0d0366379c None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:16.997744 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f643fe-42dd-4aec-9759-9f0d0366379c None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:16.998019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f643fe-42dd-4aec-9759-9f0d0366379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:17.016878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-56f643fe-42dd-4aec-9759-9f0d0366379c None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:17.018165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-56f643fe-42dd-4aec-9759-9f0d0366379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:17.077141 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4429/8930] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:17.086867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230c8fe-5ba6-411d-81a8-607c5cf92536 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:17.088571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4230c8fe-5ba6-411d-81a8-607c5cf92536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:17.145465 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230c8fe-5ba6-411d-81a8-607c5cf92536 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:17.149116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c4117-0a2c-47ee-a609-7d235ac79df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:17.149753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c4117-0a2c-47ee-a609-7d235ac79df3 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:17.150037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c4117-0a2c-47ee-a609-7d235ac79df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:17.150319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c4117-0a2c-47ee-a609-7d235ac79df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:17.159323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c4117-0a2c-47ee-a609-7d235ac79df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:17.160736 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c4117-0a2c-47ee-a609-7d235ac79df3 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:17.170796 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4502/8931] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:24:21.197941 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4905797-4ac5-4fb5-812d-de607513c401 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:21.198451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4905797-4ac5-4fb5-812d-de607513c401 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:21.198535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4905797-4ac5-4fb5-812d-de607513c401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:21.232812 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-d4905797-4ac5-4fb5-812d-de607513c401 None None] MFA Rules not processed for user `8ca581ef43c64b32b74341b6dd402200`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:21.234136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d4905797-4ac5-4fb5-812d-de607513c401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:21.244894 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:21.327284 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4430/8932] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:21.328486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c4117-0a2c-47ee-a609-7d235ac79df3 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:21.341837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c4117-0a2c-47ee-a609-7d235ac79df3 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:21.347297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174e378-fcc3-47e4-9b68-b44dba40a428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:21.347905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174e378-fcc3-47e4-9b68-b44dba40a428 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:21.348190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174e378-fcc3-47e4-9b68-b44dba40a428 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:21.348469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174e378-fcc3-47e4-9b68-b44dba40a428 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:21.349096 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174e378-fcc3-47e4-9b68-b44dba40a428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:21.351134 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174e378-fcc3-47e4-9b68-b44dba40a428 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:21.386993 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4503/8933] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:24:21 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:24:21.391375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4905797-4ac5-4fb5-812d-de607513c401 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:21.403248 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4905797-4ac5-4fb5-812d-de607513c401 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:21.463992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372490b0-716d-4271-a820-aae782ef965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:21.464646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372490b0-716d-4271-a820-aae782ef965f admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:21.464924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372490b0-716d-4271-a820-aae782ef965f admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:21.465197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372490b0-716d-4271-a820-aae782ef965f admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:21.465954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372490b0-716d-4271-a820-aae782ef965f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:21.467888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372490b0-716d-4271-a820-aae782ef965f admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:21.491257 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4431/8934] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:24:21 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:24:21.495218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174e378-fcc3-47e4-9b68-b44dba40a428 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:21.508290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174e378-fcc3-47e4-9b68-b44dba40a428 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:21.513157 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec6100-02a9-41d2-8c25-1b0b6ad6b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:21.513953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec6100-02a9-41d2-8c25-1b0b6ad6b08e admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:21.514380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec6100-02a9-41d2-8c25-1b0b6ad6b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:21.514663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec6100-02a9-41d2-8c25-1b0b6ad6b08e admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:21.515312 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec6100-02a9-41d2-8c25-1b0b6ad6b08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:21.516955 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec6100-02a9-41d2-8c25-1b0b6ad6b08e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:21.529966 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4504/8935] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:24:21.534155 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372490b0-716d-4271-a820-aae782ef965f admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:21.545167 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372490b0-716d-4271-a820-aae782ef965f admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:21.549966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32420d9-f764-41d0-bed2-e4182c8adbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:21.550642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32420d9-f764-41d0-bed2-e4182c8adbc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:21.550923 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32420d9-f764-41d0-bed2-e4182c8adbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:21.551198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32420d9-f764-41d0-bed2-e4182c8adbc8 admin admin] PATH_INFO: `/v3/projects/a1d59122756a45dfb23d040366b2f469/users/ee4a607014fa48dba7481f99fa34cbef/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:21.568100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32420d9-f764-41d0-bed2-e4182c8adbc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d59122756a45dfb23d040366b2f469, user_id=ee4a607014fa48dba7481f99fa34cbef, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:21.571714 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32420d9-f764-41d0-bed2-e4182c8adbc8 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:21.589698 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4432/8936] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:24:21 2022] PUT /identity/v3/projects/a1d59122756a45dfb23d040366b2f469/users/ee4a607014fa48dba7481f99fa34cbef/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:24:21.593708 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec6100-02a9-41d2-8c25-1b0b6ad6b08e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:21.604291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec6100-02a9-41d2-8c25-1b0b6ad6b08e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:21.663679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e797332-7f9b-40d1-bb4c-72ffda5a9e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:21.664343 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e797332-7f9b-40d1-bb4c-72ffda5a9e45 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:21.664579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e797332-7f9b-40d1-bb4c-72ffda5a9e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:21.664852 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e797332-7f9b-40d1-bb4c-72ffda5a9e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:21.665535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e797332-7f9b-40d1-bb4c-72ffda5a9e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:21.667142 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e797332-7f9b-40d1-bb4c-72ffda5a9e45 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:21.678176 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4505/8937] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:24:21.682687 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32420d9-f764-41d0-bed2-e4182c8adbc8 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:21.693978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32420d9-f764-41d0-bed2-e4182c8adbc8 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:21.699647 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e21a2-892a-4cd1-ab04-8a5bcf7f3fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:21.700417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e21a2-892a-4cd1-ab04-8a5bcf7f3fad admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:21.700763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e21a2-892a-4cd1-ab04-8a5bcf7f3fad admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:21.701105 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e21a2-892a-4cd1-ab04-8a5bcf7f3fad admin admin] PATH_INFO: `/v3/projects/a1d59122756a45dfb23d040366b2f469/users/ee4a607014fa48dba7481f99fa34cbef/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:21.703190 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e21a2-892a-4cd1-ab04-8a5bcf7f3fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d59122756a45dfb23d040366b2f469, user_id=ee4a607014fa48dba7481f99fa34cbef, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:21.706674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e21a2-892a-4cd1-ab04-8a5bcf7f3fad admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:21.718410 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4433/8938] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:24:21 2022] PUT /identity/v3/projects/a1d59122756a45dfb23d040366b2f469/users/ee4a607014fa48dba7481f99fa34cbef/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:24:26.194309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19752a5-d18d-4b6a-8594-1913b653dfab None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:26.195361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19752a5-d18d-4b6a-8594-1913b653dfab None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:26.195450 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19752a5-d18d-4b6a-8594-1913b653dfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:26.226026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a19752a5-d18d-4b6a-8594-1913b653dfab None None] MFA Rules not processed for user `ee4a607014fa48dba7481f99fa34cbef`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:26.227167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a19752a5-d18d-4b6a-8594-1913b653dfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:26.280156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:26.301156 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4506/8939] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:26.320202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e21a2-892a-4cd1-ab04-8a5bcf7f3fad admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:26.322867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-788e21a2-892a-4cd1-ab04-8a5bcf7f3fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:26.399995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:26.406942 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e21a2-892a-4cd1-ab04-8a5bcf7f3fad admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:26.414015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095cf0b-fb43-4df4-a138-5a7aa2c22564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:26.414637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095cf0b-fb43-4df4-a138-5a7aa2c22564 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:26.414914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095cf0b-fb43-4df4-a138-5a7aa2c22564 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:26.415187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095cf0b-fb43-4df4-a138-5a7aa2c22564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:26.481898 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095cf0b-fb43-4df4-a138-5a7aa2c22564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:26.483515 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095cf0b-fb43-4df4-a138-5a7aa2c22564 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:26.496041 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4434/8940] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:24:26.581748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c028f-08cc-4ffa-92fe-ceb6b73b6712 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:26.582039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c028f-08cc-4ffa-92fe-ceb6b73b6712 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:26.582296 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c028f-08cc-4ffa-92fe-ceb6b73b6712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:26.604396 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-dd1c028f-08cc-4ffa-92fe-ceb6b73b6712 None None] MFA Rules not processed for user `8ca581ef43c64b32b74341b6dd402200`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:26.605926 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dd1c028f-08cc-4ffa-92fe-ceb6b73b6712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:26.612852 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4507/8941] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:26.646755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2187bf-bee0-4123-ad33-38c0f8c0a77e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:26.647136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2187bf-bee0-4123-ad33-38c0f8c0a77e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:26.647524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2187bf-bee0-4123-ad33-38c0f8c0a77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:26.669583 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7d2187bf-bee0-4123-ad33-38c0f8c0a77e None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:26.670584 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7d2187bf-bee0-4123-ad33-38c0f8c0a77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:26.680823 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4435/8942] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:26.692883 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2f7dc-2364-422b-b13d-720860e916eb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:26.693170 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2f7dc-2364-422b-b13d-720860e916eb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:26.693497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2f7dc-2364-422b-b13d-720860e916eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:26.762751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d3c2f7dc-2364-422b-b13d-720860e916eb None None] MFA Rules not processed for user `3f161a87f6fe42aa84e61b33160924ed`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:26.764003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d3c2f7dc-2364-422b-b13d-720860e916eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:26.829789 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4508/8943] 10.222.0.16 () {58 vars in 1064 bytes} [Mon Aug 29 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:26.837329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2187bf-bee0-4123-ad33-38c0f8c0a77e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:26.851686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2187bf-bee0-4123-ad33-38c0f8c0a77e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:26.856324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0364672-3b58-4f0f-9bc5-45f941c0f387 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:26.856946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0364672-3b58-4f0f-9bc5-45f941c0f387 service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:26.857230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0364672-3b58-4f0f-9bc5-45f941c0f387 service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:26.857559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0364672-3b58-4f0f-9bc5-45f941c0f387 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:26.871097 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0364672-3b58-4f0f-9bc5-45f941c0f387 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:26.872525 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0364672-3b58-4f0f-9bc5-45f941c0f387 service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:26.893611 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4436/8944] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:24:29.652220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233d8af-d89d-4df6-90b2-750aafa8b8ce None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:29.652825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233d8af-d89d-4df6-90b2-750aafa8b8ce None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:29.652825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233d8af-d89d-4df6-90b2-750aafa8b8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:29.689614 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-2233d8af-d89d-4df6-90b2-750aafa8b8ce None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:29.691514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-2233d8af-d89d-4df6-90b2-750aafa8b8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:29.756471 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4509/8945] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Aug 29 16:24:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:29.768732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0364672-3b58-4f0f-9bc5-45f941c0f387 service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:29.770373 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e0364672-3b58-4f0f-9bc5-45f941c0f387 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:29.802403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0364672-3b58-4f0f-9bc5-45f941c0f387 service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:29.807087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5bc6c-1628-4880-b880-5d7d5f500e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:29.808174 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bc6c-1628-4880-b880-5d7d5f500e43 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:29.808658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bc6c-1628-4880-b880-5d7d5f500e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:29.809596 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bc6c-1628-4880-b880-5d7d5f500e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:29.818962 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5bc6c-1628-4880-b880-5d7d5f500e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:29.820743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5bc6c-1628-4880-b880-5d7d5f500e43 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:29.830575 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4437/8946] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:24:36.261237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21299-0b67-4db7-b18a-a2f78bb4bcdb None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:36.261790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21299-0b67-4db7-b18a-a2f78bb4bcdb None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:36.261897 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21299-0b67-4db7-b18a-a2f78bb4bcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:36.284236 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d4b21299-0b67-4db7-b18a-a2f78bb4bcdb None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:36.285486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d4b21299-0b67-4db7-b18a-a2f78bb4bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:36.296550 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4510/8947] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:24:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:36.312680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5bc6c-1628-4880-b880-5d7d5f500e43 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:36.314218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-45b5bc6c-1628-4880-b880-5d7d5f500e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:36.330895 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5bc6c-1628-4880-b880-5d7d5f500e43 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:36.337139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b592bbc-80f5-4704-81e8-2a7a5f595a4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:36.338228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b592bbc-80f5-4704-81e8-2a7a5f595a4c service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:36.338228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b592bbc-80f5-4704-81e8-2a7a5f595a4c service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:36.338392 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b592bbc-80f5-4704-81e8-2a7a5f595a4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:36.347549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b592bbc-80f5-4704-81e8-2a7a5f595a4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:36.349121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b592bbc-80f5-4704-81e8-2a7a5f595a4c service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:36.359443 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4438/8948] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:24:38.404862 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb258a-64fd-488c-ab1e-27f820bf83a5 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:38.405282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb258a-64fd-488c-ab1e-27f820bf83a5 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:38.405379 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb258a-64fd-488c-ab1e-27f820bf83a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:38.454779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-0ecb258a-64fd-488c-ab1e-27f820bf83a5 None None] MFA Rules not processed for user `e1ed0648d3b74de89966c6d2e2b8f30a`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:24:38.455981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-0ecb258a-64fd-488c-ab1e-27f820bf83a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:24:38.480061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:38.519253 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4511/8949] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Aug 29 16:24:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:24:38.525768 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b592bbc-80f5-4704-81e8-2a7a5f595a4c service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:24:38.534991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b592bbc-80f5-4704-81e8-2a7a5f595a4c service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:24:38.538847 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625129c-62c4-4977-b8c0-0b7776125c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ed0648d3b74de89966c6d2e2b8f30a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:24:38.539453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625129c-62c4-4977-b8c0-0b7776125c9c service cinder] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:24:38.539735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625129c-62c4-4977-b8c0-0b7776125c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:24:38.540015 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625129c-62c4-4977-b8c0-0b7776125c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:24:38.549699 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625129c-62c4-4977-b8c0-0b7776125c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:24:38.551121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625129c-62c4-4977-b8c0-0b7776125c9c service cinder] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:24:38.561636 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4439/8950] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:24:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:24:48.516407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=14 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:48.556864 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=54 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:02.128988 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0425547-8775-43ee-b84b-0e201f807cdd None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:02.130519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0425547-8775-43ee-b84b-0e201f807cdd None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:02.130519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0425547-8775-43ee-b84b-0e201f807cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:02.177090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d0425547-8775-43ee-b84b-0e201f807cdd None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:25:02.178348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d0425547-8775-43ee-b84b-0e201f807cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:02.198018 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4512/8951] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:25:02.211473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625129c-62c4-4977-b8c0-0b7776125c9c service cinder] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:25:02.223671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625129c-62c4-4977-b8c0-0b7776125c9c service cinder] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:25:02.230568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bd656-e749-426b-b9de-e1deb60a18f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:25:02.231181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bd656-e749-426b-b9de-e1deb60a18f2 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:02.232145 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bd656-e749-426b-b9de-e1deb60a18f2 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:02.233040 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bd656-e749-426b-b9de-e1deb60a18f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:02.242815 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bd656-e749-426b-b9de-e1deb60a18f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:25:02.244568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bd656-e749-426b-b9de-e1deb60a18f2 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:25:02.259200 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4440/8952] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:25:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:25:03.718095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ce871-aee1-4d99-ae38-eda4d7a5e569 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:03.718579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ce871-aee1-4d99-ae38-eda4d7a5e569 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:03.718682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ce871-aee1-4d99-ae38-eda4d7a5e569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:03.738069 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-762ce871-aee1-4d99-ae38-eda4d7a5e569 None None] MFA Rules not processed for user `8ca581ef43c64b32b74341b6dd402200`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:25:03.739259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-762ce871-aee1-4d99-ae38-eda4d7a5e569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:03.746596 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4513/8953] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:25:03.994457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812b20-43af-4533-a46b-c492e8aa35ad None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:03.994976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812b20-43af-4533-a46b-c492e8aa35ad None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:03.995081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812b20-43af-4533-a46b-c492e8aa35ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:04.045628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fb812b20-43af-4533-a46b-c492e8aa35ad None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:25:04.046755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fb812b20-43af-4533-a46b-c492e8aa35ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:04.053339 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4441/8954] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:25:04.065455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ce871-aee1-4d99-ae38-eda4d7a5e569 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:25:04.075398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ce871-aee1-4d99-ae38-eda4d7a5e569 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:25:04.078939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6df78-b564-413b-ae2b-4ab7facb117c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:25:04.079529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6df78-b564-413b-ae2b-4ab7facb117c service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:04.079808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6df78-b564-413b-ae2b-4ab7facb117c service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:04.080081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6df78-b564-413b-ae2b-4ab7facb117c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:04.087520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6df78-b564-413b-ae2b-4ab7facb117c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:25:04.088950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6df78-b564-413b-ae2b-4ab7facb117c service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:25:04.096704 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4514/8955] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:25:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:25:04.433470 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb812b20-43af-4533-a46b-c492e8aa35ad None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:25:04.435226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fb812b20-43af-4533-a46b-c492e8aa35ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:04.529043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb812b20-43af-4533-a46b-c492e8aa35ad None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:25:04.535186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f2a91-a1f1-4d5b-a1f2-fa54011ea0e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:25:04.535976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f2a91-a1f1-4d5b-a1f2-fa54011ea0e6 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:04.536357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f2a91-a1f1-4d5b-a1f2-fa54011ea0e6 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:04.536753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f2a91-a1f1-4d5b-a1f2-fa54011ea0e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:04.538735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-d50f2a91-a1f1-4d5b-a1f2-fa54011ea0e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:04.551496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f2a91-a1f1-4d5b-a1f2-fa54011ea0e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:25:04.553173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f2a91-a1f1-4d5b-a1f2-fa54011ea0e6 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:25:04.564234 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4442/8956] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:25:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:25:14.093291 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=24 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:14.560010 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=57 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:39.201478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfa351-9747-4b8f-94de-5c5db561fee0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:39.202026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfa351-9747-4b8f-94de-5c5db561fee0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:39.202026 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfa351-9747-4b8f-94de-5c5db561fee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:39.220744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-45bfa351-9747-4b8f-94de-5c5db561fee0 None None] MFA Rules not processed for user `8ca581ef43c64b32b74341b6dd402200`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:25:39.221967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-45bfa351-9747-4b8f-94de-5c5db561fee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:39.228773 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4515/8957] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:25:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:25:39.802313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f2a91-a1f1-4d5b-a1f2-fa54011ea0e6 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:25:39.815910 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f2a91-a1f1-4d5b-a1f2-fa54011ea0e6 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:25:39.821242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38601fa-ee4c-4e74-b127-3e67301690de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:25:39.821888 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38601fa-ee4c-4e74-b127-3e67301690de service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:25:39.822172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38601fa-ee4c-4e74-b127-3e67301690de service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:25:39.822446 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38601fa-ee4c-4e74-b127-3e67301690de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:25:39.824183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b38601fa-ee4c-4e74-b127-3e67301690de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:25:39.836501 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38601fa-ee4c-4e74-b127-3e67301690de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:25:39.838142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38601fa-ee4c-4e74-b127-3e67301690de service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:25:39.848726 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4443/8958] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:25:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:25:49.218455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:49.844126 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:16.896109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40eb7-91a2-4099-b0b5-538ab9d2b1c0 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:16.897095 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40eb7-91a2-4099-b0b5-538ab9d2b1c0 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:16.897960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40eb7-91a2-4099-b0b5-538ab9d2b1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:16.942451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-afa40eb7-91a2-4099-b0b5-538ab9d2b1c0 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:16.943780 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-afa40eb7-91a2-4099-b0b5-538ab9d2b1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:16.955443 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4516/8959] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:26:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:16.969051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38601fa-ee4c-4e74-b127-3e67301690de service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:16.970604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b38601fa-ee4c-4e74-b127-3e67301690de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:16.986524 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38601fa-ee4c-4e74-b127-3e67301690de service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:17.000182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754406d-2276-4d5b-bbfe-0f57710b06a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:17.000949 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754406d-2276-4d5b-bbfe-0f57710b06a0 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:17.002463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754406d-2276-4d5b-bbfe-0f57710b06a0 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:17.002849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754406d-2276-4d5b-bbfe-0f57710b06a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:17.012927 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754406d-2276-4d5b-bbfe-0f57710b06a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:17.014709 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754406d-2276-4d5b-bbfe-0f57710b06a0 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:17.029731 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4444/8960] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:26:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:26:19.940121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa40eb7-91a2-4099-b0b5-538ab9d2b1c0 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:20.022721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa40eb7-91a2-4099-b0b5-538ab9d2b1c0 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:20.027326 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:20.027951 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:20.028232 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:20.028512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] PATH_INFO: `/v3/users/8ca581ef43c64b32b74341b6dd402200` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:20.029656 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca581ef43c64b32b74341b6dd402200)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:20.031589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:20.076624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca581ef43c64b32b74341b6dd402200'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.077222 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca581ef43c64b32b74341b6dd402200'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.089197 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca581ef43c64b32b74341b6dd402200'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.089966 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca581ef43c64b32b74341b6dd402200'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.097045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca581ef43c64b32b74341b6dd402200'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.110663 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4517/8961] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:26:19 2022] DELETE /identity/v3/users/8ca581ef43c64b32b74341b6dd402200 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:26:20.286383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754406d-2276-4d5b-bbfe-0f57710b06a0 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:20.297147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754406d-2276-4d5b-bbfe-0f57710b06a0 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:20.356026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:20.356589 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:20.356871 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:20.357165 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] PATH_INFO: `/v3/projects/8445c72633d149218d47aaf80e16ae99` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:20.358303 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8445c72633d149218d47aaf80e16ae99)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:20.360211 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:20.408258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8445c72633d149218d47aaf80e16ae99', 'request_id': 'req-e9f40c35-193c-434b-a9a1-32e5788fa805'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.414012 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8445c72633d149218d47aaf80e16ae99', 'request_id': 'req-e9f40c35-193c-434b-a9a1-32e5788fa805'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.421316 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8445c72633d149218d47aaf80e16ae99', 'request_id': 'req-e9f40c35-193c-434b-a9a1-32e5788fa805'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.446491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] The token cache is being invalidate because project 8445c72633d149218d47aaf80e16ae99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:26:20.446786 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.447451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.448957 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4445/8962] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:26:20 2022] DELETE /identity/v3/projects/8445c72633d149218d47aaf80e16ae99 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:26:20.453056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:20.454498 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:20.467318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d83cba-7ad1-4f9b-8029-2364e9ea6441 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:20.509566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:20.533194 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b5298-988a-4eee-b76f-81f08349b967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:20.533961 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b5298-988a-4eee-b76f-81f08349b967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:20.534325 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b5298-988a-4eee-b76f-81f08349b967 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:20.534610 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b5298-988a-4eee-b76f-81f08349b967 admin admin] PATH_INFO: `/v3/users/ee4a607014fa48dba7481f99fa34cbef` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:20.536321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b5298-988a-4eee-b76f-81f08349b967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4a607014fa48dba7481f99fa34cbef)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:20.540293 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b5298-988a-4eee-b76f-81f08349b967 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:20.588999 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-816b5298-988a-4eee-b76f-81f08349b967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4a607014fa48dba7481f99fa34cbef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.589677 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-816b5298-988a-4eee-b76f-81f08349b967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4a607014fa48dba7481f99fa34cbef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.601368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-816b5298-988a-4eee-b76f-81f08349b967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4a607014fa48dba7481f99fa34cbef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.602030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-816b5298-988a-4eee-b76f-81f08349b967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4a607014fa48dba7481f99fa34cbef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.609053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-816b5298-988a-4eee-b76f-81f08349b967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4a607014fa48dba7481f99fa34cbef'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.622721 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4518/8963] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:26:20 2022] DELETE /identity/v3/users/ee4a607014fa48dba7481f99fa34cbef => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:26:20.797313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:20.799001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:20.815019 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f40c35-193c-434b-a9a1-32e5788fa805 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:20.875000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:20.875560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:20.875843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:20.876121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] PATH_INFO: `/v3/projects/a1d59122756a45dfb23d040366b2f469` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:20.877260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d59122756a45dfb23d040366b2f469)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:20.879254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:20.887703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:20.928453 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d59122756a45dfb23d040366b2f469', 'request_id': 'req-72e26244-971a-4fe6-b362-b1f671ea6183'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.934135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d59122756a45dfb23d040366b2f469', 'request_id': 'req-72e26244-971a-4fe6-b362-b1f671ea6183'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.941613 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d59122756a45dfb23d040366b2f469', 'request_id': 'req-72e26244-971a-4fe6-b362-b1f671ea6183'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.953283 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] The token cache is being invalidate because project a1d59122756a45dfb23d040366b2f469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:26:20.953605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.954247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-72e26244-971a-4fe6-b362-b1f671ea6183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:26:20.955737 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4446/8964] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:26:20 2022] DELETE /identity/v3/projects/a1d59122756a45dfb23d040366b2f469 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:26:20.960705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab18d-bd67-4e90-a06b-cb7f3ae40377 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:20.961298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab18d-bd67-4e90-a06b-cb7f3ae40377 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:20.961298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab18d-bd67-4e90-a06b-cb7f3ae40377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:21.009824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-41fab18d-bd67-4e90-a06b-cb7f3ae40377 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:21.011032 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-41fab18d-bd67-4e90-a06b-cb7f3ae40377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:21.069371 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4519/8965] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:21.077181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90ab86-e8ef-4966-ab83-ddbc5b8c98be None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:21.077506 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90ab86-e8ef-4966-ab83-ddbc5b8c98be None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:21.077790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90ab86-e8ef-4966-ab83-ddbc5b8c98be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:21.102329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-bf90ab86-e8ef-4966-ab83-ddbc5b8c98be None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:21.103538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bf90ab86-e8ef-4966-ab83-ddbc5b8c98be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:21.111507 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4447/8966] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:21.116337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab18d-bd67-4e90-a06b-cb7f3ae40377 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:21.126180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab18d-bd67-4e90-a06b-cb7f3ae40377 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:21.131446 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5b74c-bcbd-4b43-b9d8-f4f69fb26db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:21.132040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b74c-bcbd-4b43-b9d8-f4f69fb26db6 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:21.132319 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b74c-bcbd-4b43-b9d8-f4f69fb26db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:21.132624 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b74c-bcbd-4b43-b9d8-f4f69fb26db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:21.133257 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5b74c-bcbd-4b43-b9d8-f4f69fb26db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89681) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:26:21.133595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5b74c-bcbd-4b43-b9d8-f4f69fb26db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:21.135189 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5b74c-bcbd-4b43-b9d8-f4f69fb26db6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:21.147438 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4520/8967] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:26:21.151764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90ab86-e8ef-4966-ab83-ddbc5b8c98be None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:21.160931 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90ab86-e8ef-4966-ab83-ddbc5b8c98be None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:21.165621 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a730e-b0ca-4ad1-a2dd-8e6ef265762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:21.166214 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a730e-b0ca-4ad1-a2dd-8e6ef265762c admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:21.166493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a730e-b0ca-4ad1-a2dd-8e6ef265762c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:21.166764 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a730e-b0ca-4ad1-a2dd-8e6ef265762c admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:21.167388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a730e-b0ca-4ad1-a2dd-8e6ef265762c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:21.169287 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a730e-b0ca-4ad1-a2dd-8e6ef265762c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:21.197702 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4448/8968] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:26:21 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:26:21.201877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5b74c-bcbd-4b43-b9d8-f4f69fb26db6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:21.212352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5b74c-bcbd-4b43-b9d8-f4f69fb26db6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:21.236620 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:21.270903 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef456d5-a71f-4948-a847-e6a70b9a4f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:21.271509 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef456d5-a71f-4948-a847-e6a70b9a4f4d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:21.271785 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef456d5-a71f-4948-a847-e6a70b9a4f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:21.272055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef456d5-a71f-4948-a847-e6a70b9a4f4d admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:21.272678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef456d5-a71f-4948-a847-e6a70b9a4f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:21.274601 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef456d5-a71f-4948-a847-e6a70b9a4f4d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:21.295432 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4521/8969] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:26:21 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:26:21.299562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a730e-b0ca-4ad1-a2dd-8e6ef265762c admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:21.311032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a730e-b0ca-4ad1-a2dd-8e6ef265762c admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:21.315721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6aef7a-a368-4ad7-a426-910e25194b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:21.316327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aef7a-a368-4ad7-a426-910e25194b53 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:21.316607 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aef7a-a368-4ad7-a426-910e25194b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:21.316885 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aef7a-a368-4ad7-a426-910e25194b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:21.317573 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6aef7a-a368-4ad7-a426-910e25194b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:21.319172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6aef7a-a368-4ad7-a426-910e25194b53 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:21.329295 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4449/8970] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:26:21.333076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef456d5-a71f-4948-a847-e6a70b9a4f4d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:21.343037 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef456d5-a71f-4948-a847-e6a70b9a4f4d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:21.347632 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811086f-b275-44a9-a5b3-6341e2975b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:21.348220 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811086f-b275-44a9-a5b3-6341e2975b40 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:21.348496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811086f-b275-44a9-a5b3-6341e2975b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:21.348767 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811086f-b275-44a9-a5b3-6341e2975b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:21.349948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811086f-b275-44a9-a5b3-6341e2975b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:21.351517 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811086f-b275-44a9-a5b3-6341e2975b40 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:21.361875 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4522/8971] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:26:21.366458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6aef7a-a368-4ad7-a426-910e25194b53 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:21.376375 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6aef7a-a368-4ad7-a426-910e25194b53 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:21.381017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599cd84-12fe-4b32-8b3f-ff34e6309ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:21.381703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599cd84-12fe-4b32-8b3f-ff34e6309ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:21.381978 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599cd84-12fe-4b32-8b3f-ff34e6309ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:21.382261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599cd84-12fe-4b32-8b3f-ff34e6309ed2 admin admin] PATH_INFO: `/v3/projects/bce727fbf3f646fbb1353cfc0072bbcc/users/3bf90dbc02fd42a6b9911f76ccea3b69/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:21.396718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599cd84-12fe-4b32-8b3f-ff34e6309ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce727fbf3f646fbb1353cfc0072bbcc, user_id=3bf90dbc02fd42a6b9911f76ccea3b69, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:21.399489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599cd84-12fe-4b32-8b3f-ff34e6309ed2 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:21.413161 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4450/8972] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:26:21 2022] PUT /identity/v3/projects/bce727fbf3f646fbb1353cfc0072bbcc/users/3bf90dbc02fd42a6b9911f76ccea3b69/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:26:21.419075 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a348e05-65ef-47ca-a159-cb9f82921e2d None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:21.419364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a348e05-65ef-47ca-a159-cb9f82921e2d None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:21.419642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a348e05-65ef-47ca-a159-cb9f82921e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:21.440533 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-9a348e05-65ef-47ca-a159-cb9f82921e2d None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:21.441783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9a348e05-65ef-47ca-a159-cb9f82921e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:21.501268 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4523/8973] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:21.511164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599cd84-12fe-4b32-8b3f-ff34e6309ed2 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:21.512884 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3599cd84-12fe-4b32-8b3f-ff34e6309ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:21.583394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599cd84-12fe-4b32-8b3f-ff34e6309ed2 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:21.587118 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eceb3-27c6-45f0-b570-599f63388e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:21.587749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eceb3-27c6-45f0-b570-599f63388e31 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:21.588071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eceb3-27c6-45f0-b570-599f63388e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:21.588343 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eceb3-27c6-45f0-b570-599f63388e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:21.597260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2eceb3-27c6-45f0-b570-599f63388e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:21.598701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2eceb3-27c6-45f0-b570-599f63388e31 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:21.608565 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4451/8974] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:26:25.639615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b79b3b-f71b-4d3f-87e2-fe6bae538e89 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:25.640116 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b79b3b-f71b-4d3f-87e2-fe6bae538e89 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:25.640306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b79b3b-f71b-4d3f-87e2-fe6bae538e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:25.688672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f4b79b3b-f71b-4d3f-87e2-fe6bae538e89 None None] MFA Rules not processed for user `3bf90dbc02fd42a6b9911f76ccea3b69`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:25.690048 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f4b79b3b-f71b-4d3f-87e2-fe6bae538e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:25.769154 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4524/8975] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:25.774334 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eceb3-27c6-45f0-b570-599f63388e31 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:25.784499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eceb3-27c6-45f0-b570-599f63388e31 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:25.790013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab07a8-2aeb-40ee-b515-ec8505e834ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:25.790628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab07a8-2aeb-40ee-b515-ec8505e834ab admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:25.791072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab07a8-2aeb-40ee-b515-ec8505e834ab admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:25.791357 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab07a8-2aeb-40ee-b515-ec8505e834ab admin admin] PATH_INFO: `/v3/projects` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:25.792000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab07a8-2aeb-40ee-b515-ec8505e834ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:25.794008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab07a8-2aeb-40ee-b515-ec8505e834ab admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:25.829417 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4452/8976] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:26:25 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:26:25.831099 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b79b3b-f71b-4d3f-87e2-fe6bae538e89 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:25.842303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b79b3b-f71b-4d3f-87e2-fe6bae538e89 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:25.881210 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:25.907981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720041b-9941-4a6e-ba8f-1424d7bc211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:25.908701 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720041b-9941-4a6e-ba8f-1424d7bc211d admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:25.908990 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720041b-9941-4a6e-ba8f-1424d7bc211d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:25.909265 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720041b-9941-4a6e-ba8f-1424d7bc211d admin admin] PATH_INFO: `/v3/users` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:25.910007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720041b-9941-4a6e-ba8f-1424d7bc211d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:25.912952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720041b-9941-4a6e-ba8f-1424d7bc211d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:25.937987 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4525/8977] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:26:25 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:26:25.942255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab07a8-2aeb-40ee-b515-ec8505e834ab admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:25.950053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:25.954499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab07a8-2aeb-40ee-b515-ec8505e834ab admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:25.961565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595b9ee-4733-4b01-925e-5b1c4c416286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:25.962489 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595b9ee-4733-4b01-925e-5b1c4c416286 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:25.962953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595b9ee-4733-4b01-925e-5b1c4c416286 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:25.963451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595b9ee-4733-4b01-925e-5b1c4c416286 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:25.964136 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595b9ee-4733-4b01-925e-5b1c4c416286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:25.966077 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595b9ee-4733-4b01-925e-5b1c4c416286 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:25.980326 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4453/8978] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:26:25.984350 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720041b-9941-4a6e-ba8f-1424d7bc211d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:25.995290 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720041b-9941-4a6e-ba8f-1424d7bc211d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:26.000156 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ffd6c-5354-475e-8c44-6664413c14aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:26.000902 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ffd6c-5354-475e-8c44-6664413c14aa admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:26.001183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ffd6c-5354-475e-8c44-6664413c14aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:26.001500 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ffd6c-5354-475e-8c44-6664413c14aa admin admin] PATH_INFO: `/v3/projects/123018fe5fc7474b8ebc492237e0d992/users/31771fa1d9f349968429c35fa6c8d84d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:26.018130 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ffd6c-5354-475e-8c44-6664413c14aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=123018fe5fc7474b8ebc492237e0d992, user_id=31771fa1d9f349968429c35fa6c8d84d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:26.021018 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ffd6c-5354-475e-8c44-6664413c14aa admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:26.034997 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4526/8979] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:26:25 2022] PUT /identity/v3/projects/123018fe5fc7474b8ebc492237e0d992/users/31771fa1d9f349968429c35fa6c8d84d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:26:26.039711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595b9ee-4733-4b01-925e-5b1c4c416286 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:26.050229 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595b9ee-4733-4b01-925e-5b1c4c416286 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:26.117096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69b13f-175c-4b2b-ad7c-cc10f58b4659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:26.122499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69b13f-175c-4b2b-ad7c-cc10f58b4659 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:26.122499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69b13f-175c-4b2b-ad7c-cc10f58b4659 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:26.122499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69b13f-175c-4b2b-ad7c-cc10f58b4659 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:26.122499 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69b13f-175c-4b2b-ad7c-cc10f58b4659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:26.125717 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69b13f-175c-4b2b-ad7c-cc10f58b4659 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:26.144978 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4454/8980] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:26:26.146705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ffd6c-5354-475e-8c44-6664413c14aa admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:26.157190 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ffd6c-5354-475e-8c44-6664413c14aa admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:26.162400 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc382ed8-e472-41b3-a965-0b135e301e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:26.163039 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc382ed8-e472-41b3-a965-0b135e301e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:26.163316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc382ed8-e472-41b3-a965-0b135e301e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:26.163586 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc382ed8-e472-41b3-a965-0b135e301e4b admin admin] PATH_INFO: `/v3/projects/123018fe5fc7474b8ebc492237e0d992/users/31771fa1d9f349968429c35fa6c8d84d/roles/be89abac608f45a6921181bcc574f721` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:26.165510 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc382ed8-e472-41b3-a965-0b135e301e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=123018fe5fc7474b8ebc492237e0d992, user_id=31771fa1d9f349968429c35fa6c8d84d, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:26.168126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc382ed8-e472-41b3-a965-0b135e301e4b admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:26.180717 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4527/8981] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:26:26 2022] PUT /identity/v3/projects/123018fe5fc7474b8ebc492237e0d992/users/31771fa1d9f349968429c35fa6c8d84d/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:26:30.655620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eeda9-968b-4b0b-be8f-7a6ad7f0b03e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:30.656231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eeda9-968b-4b0b-be8f-7a6ad7f0b03e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:30.656330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eeda9-968b-4b0b-be8f-7a6ad7f0b03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:30.689558 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-878eeda9-968b-4b0b-be8f-7a6ad7f0b03e None None] MFA Rules not processed for user `31771fa1d9f349968429c35fa6c8d84d`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:30.690803 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-878eeda9-968b-4b0b-be8f-7a6ad7f0b03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:30.798531 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4455/8982] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:26:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:30.826824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc382ed8-e472-41b3-a965-0b135e301e4b admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:30.829166 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-dc382ed8-e472-41b3-a965-0b135e301e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:30.904451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc382ed8-e472-41b3-a965-0b135e301e4b admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:30.914537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6afaa-fb35-4804-bc87-1862c8a2313e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:30.915442 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6afaa-fb35-4804-bc87-1862c8a2313e service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:30.915886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6afaa-fb35-4804-bc87-1862c8a2313e service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:30.916347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6afaa-fb35-4804-bc87-1862c8a2313e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:30.990300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6afaa-fb35-4804-bc87-1862c8a2313e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:30.991770 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6afaa-fb35-4804-bc87-1862c8a2313e service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:31.003119 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4528/8983] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:26:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:26:31.141313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f2e60-b45a-44fd-9e92-de3782bcd694 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:31.141751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f2e60-b45a-44fd-9e92-de3782bcd694 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:31.142161 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f2e60-b45a-44fd-9e92-de3782bcd694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:31.201840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-714f2e60-b45a-44fd-9e92-de3782bcd694 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:31.203148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-714f2e60-b45a-44fd-9e92-de3782bcd694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:31.251732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=100 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:31.272896 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4456/8984] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:26:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:31.318144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251332aa-e56a-4044-aadc-c5fe53ace369 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:31.318377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251332aa-e56a-4044-aadc-c5fe53ace369 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:31.318648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251332aa-e56a-4044-aadc-c5fe53ace369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:31.369950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-251332aa-e56a-4044-aadc-c5fe53ace369 None None] MFA Rules not processed for user `8fad5b29e028436ca5596434a0cce086`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:31.371161 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-251332aa-e56a-4044-aadc-c5fe53ace369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:31.383479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:31.444381 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4529/8985] 10.222.0.16 () {58 vars in 1040 bytes} [Mon Aug 29 16:26:31 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:31.450580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f2e60-b45a-44fd-9e92-de3782bcd694 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:31.462397 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f2e60-b45a-44fd-9e92-de3782bcd694 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:31.467466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f2fee-6f48-4a8b-adc9-283072dff104 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:31.468061 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f2fee-6f48-4a8b-adc9-283072dff104 service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:31.468336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f2fee-6f48-4a8b-adc9-283072dff104 service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:31.468605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f2fee-6f48-4a8b-adc9-283072dff104 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:31.476554 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f2fee-6f48-4a8b-adc9-283072dff104 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:31.478171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f2fee-6f48-4a8b-adc9-283072dff104 service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:31.486107 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4457/8986] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:26:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:26:40.260579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7adf-0964-41d1-a5c8-8636d2803194 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:40.261080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7adf-0964-41d1-a5c8-8636d2803194 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:40.261178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7adf-0964-41d1-a5c8-8636d2803194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:40.280683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-f44b7adf-0964-41d1-a5c8-8636d2803194 None None] MFA Rules not processed for user `3bf90dbc02fd42a6b9911f76ccea3b69`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:40.281919 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f44b7adf-0964-41d1-a5c8-8636d2803194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:40.289095 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4530/8987] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:26:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:41.482883 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=12 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:42.070290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2f58e-3454-4034-a61f-c5217033e709 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:42.071323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2f58e-3454-4034-a61f-c5217033e709 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:42.071323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2f58e-3454-4034-a61f-c5217033e709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:42.101753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-33c2f58e-3454-4034-a61f-c5217033e709 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:26:42.103094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-33c2f58e-3454-4034-a61f-c5217033e709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:26:42.110749 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4458/8988] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:26:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:26:42.123858 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b7adf-0964-41d1-a5c8-8636d2803194 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:26:42.135927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b7adf-0964-41d1-a5c8-8636d2803194 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:26:42.141072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedd5f9-9396-40d4-b09e-71268d3ff170 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:26:42.141699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedd5f9-9396-40d4-b09e-71268d3ff170 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:26:42.141982 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedd5f9-9396-40d4-b09e-71268d3ff170 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:26:42.142284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedd5f9-9396-40d4-b09e-71268d3ff170 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:26:42.151547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedd5f9-9396-40d4-b09e-71268d3ff170 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:26:42.153135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedd5f9-9396-40d4-b09e-71268d3ff170 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:26:42.162377 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4531/8989] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:26:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:26:52.095615 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:52.158672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=34 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:11.860492 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2f58e-3454-4034-a61f-c5217033e709 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:11.861943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-33c2f58e-3454-4034-a61f-c5217033e709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:11.917184 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2f58e-3454-4034-a61f-c5217033e709 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:11.920784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721cfe7-26fb-4ebb-a815-3d75e8c4020f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:11.921395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721cfe7-26fb-4ebb-a815-3d75e8c4020f service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:11.921691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721cfe7-26fb-4ebb-a815-3d75e8c4020f service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:11.921965 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721cfe7-26fb-4ebb-a815-3d75e8c4020f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:11.931222 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721cfe7-26fb-4ebb-a815-3d75e8c4020f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:11.932644 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721cfe7-26fb-4ebb-a815-3d75e8c4020f service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:11.942961 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4459/8990] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:13.822980 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75539f4b-122d-428c-bcd4-fe31577a2698 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:13.823429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75539f4b-122d-428c-bcd4-fe31577a2698 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:13.824110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75539f4b-122d-428c-bcd4-fe31577a2698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:13.847686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-75539f4b-122d-428c-bcd4-fe31577a2698 None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:13.849300 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75539f4b-122d-428c-bcd4-fe31577a2698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:13.938605 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4532/8991] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:27:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:13.956009 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721cfe7-26fb-4ebb-a815-3d75e8c4020f service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:13.958113 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3721cfe7-26fb-4ebb-a815-3d75e8c4020f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:13.978236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721cfe7-26fb-4ebb-a815-3d75e8c4020f service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:13.986081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ab600-54b8-4a3a-8dee-8cc374a31fc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:13.986656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ab600-54b8-4a3a-8dee-8cc374a31fc5 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:13.986956 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ab600-54b8-4a3a-8dee-8cc374a31fc5 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:13.987232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ab600-54b8-4a3a-8dee-8cc374a31fc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:14.005143 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ab600-54b8-4a3a-8dee-8cc374a31fc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:14.009484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ab600-54b8-4a3a-8dee-8cc374a31fc5 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:14.027030 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4460/8992] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:23.935177 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=35 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:24.022181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=32 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:28.242271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75539f4b-122d-428c-bcd4-fe31577a2698 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:28.243689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-75539f4b-122d-428c-bcd4-fe31577a2698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:28.314975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75539f4b-122d-428c-bcd4-fe31577a2698 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:28.319957 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5657c77-3c7c-465b-a506-2fb004411bf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:28.320563 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5657c77-3c7c-465b-a506-2fb004411bf9 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:28.320845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5657c77-3c7c-465b-a506-2fb004411bf9 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:28.321120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5657c77-3c7c-465b-a506-2fb004411bf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:28.322866 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-f5657c77-3c7c-465b-a506-2fb004411bf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:28.333948 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5657c77-3c7c-465b-a506-2fb004411bf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:28.335527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5657c77-3c7c-465b-a506-2fb004411bf9 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:28.345115 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4533/8993] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:37.447612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a5aa-7593-4836-b306-3a10f344bc66 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:37.448022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a5aa-7593-4836-b306-3a10f344bc66 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:37.448202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a5aa-7593-4836-b306-3a10f344bc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:37.468017 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6a98a5aa-7593-4836-b306-3a10f344bc66 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:27:37.469216 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6a98a5aa-7593-4836-b306-3a10f344bc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:37.487891 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4461/8994] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Aug 29 16:27:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:27:37.493930 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5657c77-3c7c-465b-a506-2fb004411bf9 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:27:37.513954 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5657c77-3c7c-465b-a506-2fb004411bf9 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:27:37.519247 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc658-fadc-48c8-9f9d-64b33dd000a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:27:37.519846 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc658-fadc-48c8-9f9d-64b33dd000a2 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:27:37.520129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc658-fadc-48c8-9f9d-64b33dd000a2 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:27:37.520899 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc658-fadc-48c8-9f9d-64b33dd000a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:27:37.522634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b89bc658-fadc-48c8-9f9d-64b33dd000a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:27:37.533914 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bc658-fadc-48c8-9f9d-64b33dd000a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:27:37.535482 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bc658-fadc-48c8-9f9d-64b33dd000a2 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:27:37.546495 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4534/8995] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:27:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:27:47.484818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=7 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:47.541960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=42 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:55.469530 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a5aa-7593-4836-b306-3a10f344bc66 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:28:55.478797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a5aa-7593-4836-b306-3a10f344bc66 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:28:55.482388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30b0a2-24ea-40ed-b1a4-71d1afabbee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:28:55.482986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30b0a2-24ea-40ed-b1a4-71d1afabbee7 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:28:55.483265 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30b0a2-24ea-40ed-b1a4-71d1afabbee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:28:55.483539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30b0a2-24ea-40ed-b1a4-71d1afabbee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:28:55.485256 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5d30b0a2-24ea-40ed-b1a4-71d1afabbee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:28:55.498325 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30b0a2-24ea-40ed-b1a4-71d1afabbee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:28:55.499759 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30b0a2-24ea-40ed-b1a4-71d1afabbee7 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:28:55.511274 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4462/8996] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:28:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:29:05.505833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:33.631847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc658-fadc-48c8-9f9d-64b33dd000a2 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:29:33.641669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc658-fadc-48c8-9f9d-64b33dd000a2 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:29:33.645346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da3dd1-a7e0-4174-a190-d41dbf77b9d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:29:33.645967 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3dd1-a7e0-4174-a190-d41dbf77b9d5 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:29:33.646249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3dd1-a7e0-4174-a190-d41dbf77b9d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:29:33.646527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3dd1-a7e0-4174-a190-d41dbf77b9d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:29:33.648282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-07da3dd1-a7e0-4174-a190-d41dbf77b9d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:29:33.658324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da3dd1-a7e0-4174-a190-d41dbf77b9d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:29:33.659743 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da3dd1-a7e0-4174-a190-d41dbf77b9d5 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:29:33.667446 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4535/8997] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:29:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:29:43.664167 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:08.431154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30b0a2-24ea-40ed-b1a4-71d1afabbee7 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:30:08.440199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30b0a2-24ea-40ed-b1a4-71d1afabbee7 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:30:08.443810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8829cd7-7f46-498c-bead-8013ced28bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:30:08.444404 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8829cd7-7f46-498c-bead-8013ced28bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:30:08.444686 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8829cd7-7f46-498c-bead-8013ced28bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:30:08.444959 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8829cd7-7f46-498c-bead-8013ced28bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:30:08.446681 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f8829cd7-7f46-498c-bead-8013ced28bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:30:08.460163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8829cd7-7f46-498c-bead-8013ced28bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:30:08.461609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8829cd7-7f46-498c-bead-8013ced28bf0 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:30:08.472257 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4463/8998] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:30:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:30:10.251829 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da3dd1-a7e0-4174-a190-d41dbf77b9d5 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:30:10.254215 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-07da3dd1-a7e0-4174-a190-d41dbf77b9d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:30:10.271924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da3dd1-a7e0-4174-a190-d41dbf77b9d5 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:30:10.277929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703c380-aa18-40f1-8da2-b1d5d9ff864c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:30:10.278607 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703c380-aa18-40f1-8da2-b1d5d9ff864c service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:30:10.279115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703c380-aa18-40f1-8da2-b1d5d9ff864c service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:30:10.279454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703c380-aa18-40f1-8da2-b1d5d9ff864c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:30:10.281315 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8703c380-aa18-40f1-8da2-b1d5d9ff864c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:30:10.307830 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703c380-aa18-40f1-8da2-b1d5d9ff864c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:30:10.309452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703c380-aa18-40f1-8da2-b1d5d9ff864c service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:30:10.321372 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4536/8999] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:30:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:30:18.467629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:20.317541 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:22.853183 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba40c-7de1-424b-b2a7-17730e6b424d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:30:22.853678 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba40c-7de1-424b-b2a7-17730e6b424d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:30:22.853779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba40c-7de1-424b-b2a7-17730e6b424d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:30:22.873631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1deba40c-7de1-424b-b2a7-17730e6b424d None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:30:22.874830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1deba40c-7de1-424b-b2a7-17730e6b424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:30:22.882515 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4464/9000] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:30:22.922636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703c380-aa18-40f1-8da2-b1d5d9ff864c service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:30:22.933717 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703c380-aa18-40f1-8da2-b1d5d9ff864c service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:30:22.938906 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c45e9-4f96-4813-b2b8-8c1d51ea3061 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:30:22.939497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c45e9-4f96-4813-b2b8-8c1d51ea3061 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:30:22.939782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c45e9-4f96-4813-b2b8-8c1d51ea3061 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:30:22.940059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c45e9-4f96-4813-b2b8-8c1d51ea3061 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:30:22.947922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c45e9-4f96-4813-b2b8-8c1d51ea3061 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:30:22.949544 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c45e9-4f96-4813-b2b8-8c1d51ea3061 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:30:22.958069 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4537/9001] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:30:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:23.420642 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4fc57-4c0e-44fb-8dea-69189dca5ed3 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:30:23.420929 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4fc57-4c0e-44fb-8dea-69189dca5ed3 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:30:23.421236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4fc57-4c0e-44fb-8dea-69189dca5ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:30:23.440708 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-29e4fc57-4c0e-44fb-8dea-69189dca5ed3 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:30:23.441934 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-29e4fc57-4c0e-44fb-8dea-69189dca5ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:30:23.449025 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4465/9002] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:30:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:30:23.461881 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c45e9-4f96-4813-b2b8-8c1d51ea3061 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:30:23.472381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c45e9-4f96-4813-b2b8-8c1d51ea3061 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:30:23.477922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dcbfe-b5ec-4715-a491-154af6e1cd26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:30:23.478511 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dcbfe-b5ec-4715-a491-154af6e1cd26 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:30:23.478819 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dcbfe-b5ec-4715-a491-154af6e1cd26 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:30:23.479094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dcbfe-b5ec-4715-a491-154af6e1cd26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:30:23.487003 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dcbfe-b5ec-4715-a491-154af6e1cd26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:30:23.488687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dcbfe-b5ec-4715-a491-154af6e1cd26 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:30:23.496897 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4538/9003] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:30:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:31.815619 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357df68-6ea8-4e32-ad7c-10550e3d5595 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:30:31.816089 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357df68-6ea8-4e32-ad7c-10550e3d5595 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:30:31.816186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357df68-6ea8-4e32-ad7c-10550e3d5595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:30:31.837304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-8357df68-6ea8-4e32-ad7c-10550e3d5595 None None] MFA Rules not processed for user `3bf90dbc02fd42a6b9911f76ccea3b69`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:30:31.838549 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-8357df68-6ea8-4e32-ad7c-10550e3d5595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:30:31.845587 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4466/9004] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:30:32.108485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dcbfe-b5ec-4715-a491-154af6e1cd26 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:30:32.118329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dcbfe-b5ec-4715-a491-154af6e1cd26 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:30:32.121872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46069a-a080-4340-b8de-7f88f84b08df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:30:32.122463 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46069a-a080-4340-b8de-7f88f84b08df service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:30:32.122745 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46069a-a080-4340-b8de-7f88f84b08df service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:30:32.123016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46069a-a080-4340-b8de-7f88f84b08df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:30:32.124697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3c46069a-a080-4340-b8de-7f88f84b08df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:30:32.134542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46069a-a080-4340-b8de-7f88f84b08df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:30:32.135953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46069a-a080-4340-b8de-7f88f84b08df service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:30:32.143582 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4539/9005] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:30:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:30:37.668970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702347a-eb7b-4f77-bb98-713aab9535c5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:30:37.669651 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702347a-eb7b-4f77-bb98-713aab9535c5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:30:37.669770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702347a-eb7b-4f77-bb98-713aab9535c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:30:37.689948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9702347a-eb7b-4f77-bb98-713aab9535c5 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:30:37.691164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9702347a-eb7b-4f77-bb98-713aab9535c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:30:37.699066 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4467/9006] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:30:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:30:37.712946 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46069a-a080-4340-b8de-7f88f84b08df service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:30:37.725462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46069a-a080-4340-b8de-7f88f84b08df service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:30:37.730617 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c663e-546a-4858-831e-3d910325a2bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:30:37.731421 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c663e-546a-4858-831e-3d910325a2bf service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:30:37.731710 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c663e-546a-4858-831e-3d910325a2bf service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:30:37.731987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c663e-546a-4858-831e-3d910325a2bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:30:37.740872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c663e-546a-4858-831e-3d910325a2bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:30:37.743233 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c663e-546a-4858-831e-3d910325a2bf service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:30:37.751597 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4540/9007] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:30:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:47.684130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=12 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:47.748172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=24 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:50.015987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702347a-eb7b-4f77-bb98-713aab9535c5 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:30:50.031013 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702347a-eb7b-4f77-bb98-713aab9535c5 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:30:50.037295 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7390ac-75b7-4e01-a790-88c9eb85a286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:30:50.037932 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7390ac-75b7-4e01-a790-88c9eb85a286 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:30:50.038230 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7390ac-75b7-4e01-a790-88c9eb85a286 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:30:50.038487 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7390ac-75b7-4e01-a790-88c9eb85a286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:30:50.040227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-bd7390ac-75b7-4e01-a790-88c9eb85a286 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:30:50.052535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7390ac-75b7-4e01-a790-88c9eb85a286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:30:50.054178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7390ac-75b7-4e01-a790-88c9eb85a286 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:30:50.064766 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4468/9008] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:30:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:31:00.060139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:31.874154 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c663e-546a-4858-831e-3d910325a2bf service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:31:31.885786 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c663e-546a-4858-831e-3d910325a2bf service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:31:31.891242 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffd47a-c10a-46b9-b840-66996016e5b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:31:31.891822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffd47a-c10a-46b9-b840-66996016e5b5 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:31:31.892103 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffd47a-c10a-46b9-b840-66996016e5b5 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:31:31.892377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffd47a-c10a-46b9-b840-66996016e5b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:31:31.900542 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffd47a-c10a-46b9-b840-66996016e5b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:31:31.902171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffd47a-c10a-46b9-b840-66996016e5b5 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:31:31.910868 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4541/9009] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:31:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:31:41.906993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:22.645966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091e0ce-fbcd-4477-a1d2-b50c6ae5ad89 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:22.646455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091e0ce-fbcd-4477-a1d2-b50c6ae5ad89 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:22.646555 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091e0ce-fbcd-4477-a1d2-b50c6ae5ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:22.665800 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a091e0ce-fbcd-4477-a1d2-b50c6ae5ad89 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:22.666985 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a091e0ce-fbcd-4477-a1d2-b50c6ae5ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:22.674382 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4469/9010] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:22.715636 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffd47a-c10a-46b9-b840-66996016e5b5 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:22.727426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffd47a-c10a-46b9-b840-66996016e5b5 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:22.732496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525604f-85e2-4fb2-8a45-e754844e9b52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:22.733089 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525604f-85e2-4fb2-8a45-e754844e9b52 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:22.733371 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525604f-85e2-4fb2-8a45-e754844e9b52 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:22.733679 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525604f-85e2-4fb2-8a45-e754844e9b52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:22.741579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525604f-85e2-4fb2-8a45-e754844e9b52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:22.743138 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525604f-85e2-4fb2-8a45-e754844e9b52 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:22.751620 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4542/9011] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:32:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:23.101351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091e0ce-fbcd-4477-a1d2-b50c6ae5ad89 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:23.110721 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091e0ce-fbcd-4477-a1d2-b50c6ae5ad89 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:23.114341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6da635-26d0-4253-80bf-3d41da87ab81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:23.114939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6da635-26d0-4253-80bf-3d41da87ab81 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:23.115220 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6da635-26d0-4253-80bf-3d41da87ab81 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:23.115496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6da635-26d0-4253-80bf-3d41da87ab81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:23.177054 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6da635-26d0-4253-80bf-3d41da87ab81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:23.178546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6da635-26d0-4253-80bf-3d41da87ab81 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:23.189174 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4470/9012] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:26.061892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525604f-85e2-4fb2-8a45-e754844e9b52 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:26.074226 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525604f-85e2-4fb2-8a45-e754844e9b52 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:26.079888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741a654-a344-4fb5-9836-a6c98a5fc1ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:26.080694 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741a654-a344-4fb5-9836-a6c98a5fc1ac service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:26.081133 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741a654-a344-4fb5-9836-a6c98a5fc1ac service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:26.081665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741a654-a344-4fb5-9836-a6c98a5fc1ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:26.083648 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-9741a654-a344-4fb5-9836-a6c98a5fc1ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:26.096558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741a654-a344-4fb5-9836-a6c98a5fc1ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:26.098199 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741a654-a344-4fb5-9836-a6c98a5fc1ac service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:26.110733 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4543/9013] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:29.451252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6da635-26d0-4253-80bf-3d41da87ab81 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:29.461657 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6da635-26d0-4253-80bf-3d41da87ab81 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:29.466409 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:29.467122 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:29.468028 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:29.468299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] PATH_INFO: `/v3/users/3bf90dbc02fd42a6b9911f76ccea3b69` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:29.469443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf90dbc02fd42a6b9911f76ccea3b69)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:29.471363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:29.520413 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf90dbc02fd42a6b9911f76ccea3b69'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:29.521068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf90dbc02fd42a6b9911f76ccea3b69'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:29.534187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf90dbc02fd42a6b9911f76ccea3b69'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:29.544290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf90dbc02fd42a6b9911f76ccea3b69'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:29.551735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf90dbc02fd42a6b9911f76ccea3b69'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:29.557749 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4471/9014] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:32:29 2022] DELETE /identity/v3/users/3bf90dbc02fd42a6b9911f76ccea3b69 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:29.733627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741a654-a344-4fb5-9836-a6c98a5fc1ac service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:29.744080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741a654-a344-4fb5-9836-a6c98a5fc1ac service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:29.802849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:29.803469 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:29.803748 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:29.804021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] PATH_INFO: `/v3/projects/bce727fbf3f646fbb1353cfc0072bbcc` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:29.805109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce727fbf3f646fbb1353cfc0072bbcc)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:29.807040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:29.852418 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce727fbf3f646fbb1353cfc0072bbcc', 'request_id': 'req-e91a1bdc-6793-4761-9e2e-6b3437500dc6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:29.859171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce727fbf3f646fbb1353cfc0072bbcc', 'request_id': 'req-e91a1bdc-6793-4761-9e2e-6b3437500dc6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:29.866063 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce727fbf3f646fbb1353cfc0072bbcc', 'request_id': 'req-e91a1bdc-6793-4761-9e2e-6b3437500dc6'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:29.876991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] The token cache is being invalidate because project bce727fbf3f646fbb1353cfc0072bbcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:32:29.877280 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:29.877950 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:29.879440 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4544/9015] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:32:29 2022] DELETE /identity/v3/projects/bce727fbf3f646fbb1353cfc0072bbcc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:29.883633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:29.885043 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:29.898625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f9331-1214-4068-8788-7a8cd77a060e admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:29.956629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc12089-1ec5-407f-bbb6-ed9d8783f135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:29.957259 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc12089-1ec5-407f-bbb6-ed9d8783f135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:29.957567 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc12089-1ec5-407f-bbb6-ed9d8783f135 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:29.957841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc12089-1ec5-407f-bbb6-ed9d8783f135 admin admin] PATH_INFO: `/v3/users/31771fa1d9f349968429c35fa6c8d84d` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:29.958963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc12089-1ec5-407f-bbb6-ed9d8783f135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31771fa1d9f349968429c35fa6c8d84d)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:29.960878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc12089-1ec5-407f-bbb6-ed9d8783f135 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:29.962341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:30.010087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8dc12089-1ec5-407f-bbb6-ed9d8783f135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31771fa1d9f349968429c35fa6c8d84d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:30.010754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8dc12089-1ec5-407f-bbb6-ed9d8783f135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31771fa1d9f349968429c35fa6c8d84d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:30.022578 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8dc12089-1ec5-407f-bbb6-ed9d8783f135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31771fa1d9f349968429c35fa6c8d84d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:30.029769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8dc12089-1ec5-407f-bbb6-ed9d8783f135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31771fa1d9f349968429c35fa6c8d84d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:30.036806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-8dc12089-1ec5-407f-bbb6-ed9d8783f135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31771fa1d9f349968429c35fa6c8d84d'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:30.043116 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4472/9016] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:32:29 2022] DELETE /identity/v3/users/31771fa1d9f349968429c35fa6c8d84d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:30.213983 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:30.215512 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:30.229229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a1bdc-6793-4761-9e2e-6b3437500dc6 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:30.287241 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:30.287872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:30.288183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:30.288459 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] PATH_INFO: `/v3/projects/123018fe5fc7474b8ebc492237e0d992` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:30.289598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=123018fe5fc7474b8ebc492237e0d992)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:30.291513 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:30.298398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:30.339356 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '123018fe5fc7474b8ebc492237e0d992', 'request_id': 'req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:30.345810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '123018fe5fc7474b8ebc492237e0d992', 'request_id': 'req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:30.353148 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '123018fe5fc7474b8ebc492237e0d992', 'request_id': 'req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:30.365998 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] The token cache is being invalidate because project 123018fe5fc7474b8ebc492237e0d992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:32:30.366287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:30.366949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-a3b6770f-16c3-4fd8-948b-98f5b7ff2ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:32:30.368431 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4545/9017] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:32:30 2022] DELETE /identity/v3/projects/123018fe5fc7474b8ebc492237e0d992 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:30.374384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a166cb-2c4f-4465-8a82-d7e6623e1f77 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:30.374705 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a166cb-2c4f-4465-8a82-d7e6623e1f77 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:30.374986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a166cb-2c4f-4465-8a82-d7e6623e1f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:30.395180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-04a166cb-2c4f-4465-8a82-d7e6623e1f77 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:30.396292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-04a166cb-2c4f-4465-8a82-d7e6623e1f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:30.456176 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4473/9018] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:30.464368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbb986-3953-41a5-9cbc-f30556c11c0a None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:30.464653 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbb986-3953-41a5-9cbc-f30556c11c0a None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:30.464949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbb986-3953-41a5-9cbc-f30556c11c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:30.484724 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b8fbb986-3953-41a5-9cbc-f30556c11c0a None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:30.485945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b8fbb986-3953-41a5-9cbc-f30556c11c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:30.494069 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4546/9019] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:30.498360 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a166cb-2c4f-4465-8a82-d7e6623e1f77 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:30.509065 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a166cb-2c4f-4465-8a82-d7e6623e1f77 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:30.513735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6206d4-4317-4501-b100-ffc60236d189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:30.514948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6206d4-4317-4501-b100-ffc60236d189 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:30.515226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6206d4-4317-4501-b100-ffc60236d189 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:30.515500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6206d4-4317-4501-b100-ffc60236d189 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:30.516148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6206d4-4317-4501-b100-ffc60236d189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:32:30.516456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6206d4-4317-4501-b100-ffc60236d189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:30.518079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6206d4-4317-4501-b100-ffc60236d189 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:30.530349 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4474/9020] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:32:30.534438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbb986-3953-41a5-9cbc-f30556c11c0a None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:30.543872 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbb986-3953-41a5-9cbc-f30556c11c0a None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:30.548711 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2294279-52ec-4388-90b2-e772a45850a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:30.549303 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2294279-52ec-4388-90b2-e772a45850a4 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:30.549615 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2294279-52ec-4388-90b2-e772a45850a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:30.549892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2294279-52ec-4388-90b2-e772a45850a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:30.550529 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2294279-52ec-4388-90b2-e772a45850a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:30.552456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2294279-52ec-4388-90b2-e772a45850a4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:30.590205 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4547/9021] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:32:30 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:32:30.594970 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6206d4-4317-4501-b100-ffc60236d189 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:30.605358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6206d4-4317-4501-b100-ffc60236d189 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:30.662085 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990a16b-8852-4d64-9d81-6918f34dc072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:30.662617 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990a16b-8852-4d64-9d81-6918f34dc072 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:30.662901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990a16b-8852-4d64-9d81-6918f34dc072 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:30.663179 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990a16b-8852-4d64-9d81-6918f34dc072 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:30.663808 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990a16b-8852-4d64-9d81-6918f34dc072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:30.665770 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990a16b-8852-4d64-9d81-6918f34dc072 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:30.677081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:30.692796 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4475/9022] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:32:30 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:32:30.694055 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2294279-52ec-4388-90b2-e772a45850a4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:30.705252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2294279-52ec-4388-90b2-e772a45850a4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:30.710021 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec943d-fcfc-49ac-af91-95a748dec4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:30.710623 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec943d-fcfc-49ac-af91-95a748dec4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:30.710911 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec943d-fcfc-49ac-af91-95a748dec4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:30.711187 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec943d-fcfc-49ac-af91-95a748dec4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:30.711826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec943d-fcfc-49ac-af91-95a748dec4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:30.713644 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec943d-fcfc-49ac-af91-95a748dec4d4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:30.724498 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4548/9023] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:32:30.728605 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990a16b-8852-4d64-9d81-6918f34dc072 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:30.741355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990a16b-8852-4d64-9d81-6918f34dc072 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:30.746377 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00cb28-3479-43fc-9689-1558d351fa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:30.746986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00cb28-3479-43fc-9689-1558d351fa1c admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:30.747276 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00cb28-3479-43fc-9689-1558d351fa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:30.747570 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00cb28-3479-43fc-9689-1558d351fa1c admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:30.748313 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00cb28-3479-43fc-9689-1558d351fa1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:30.749950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00cb28-3479-43fc-9689-1558d351fa1c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:30.761585 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4476/9024] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:32:30.766271 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec943d-fcfc-49ac-af91-95a748dec4d4 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:30.778496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec943d-fcfc-49ac-af91-95a748dec4d4 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:30.784485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c7d8-f202-4042-987a-c6ef508f246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:30.785153 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c7d8-f202-4042-987a-c6ef508f246e admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:30.785448 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c7d8-f202-4042-987a-c6ef508f246e admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:30.785749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c7d8-f202-4042-987a-c6ef508f246e admin admin] PATH_INFO: `/v3/projects/ecb98c98f9e648969df435ba25553626/users/73aebcdee9514da2883e50c4d9b3a2f5/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:30.801006 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023c7d8-f202-4042-987a-c6ef508f246e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb98c98f9e648969df435ba25553626, user_id=73aebcdee9514da2883e50c4d9b3a2f5, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:30.803672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023c7d8-f202-4042-987a-c6ef508f246e admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:30.816311 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4549/9025] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:32:30 2022] PUT /identity/v3/projects/ecb98c98f9e648969df435ba25553626/users/73aebcdee9514da2883e50c4d9b3a2f5/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:30.828297 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf4d57-d8a1-4431-ba21-576b54cb3d15 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:30.828593 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf4d57-d8a1-4431-ba21-576b54cb3d15 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:30.828868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf4d57-d8a1-4431-ba21-576b54cb3d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:30.857147 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-6eaf4d57-d8a1-4431-ba21-576b54cb3d15 None None] MFA Rules not processed for user `73aebcdee9514da2883e50c4d9b3a2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:30.858457 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6eaf4d57-d8a1-4431-ba21-576b54cb3d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:30.923250 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4477/9026] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:32:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:30.927853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c7d8-f202-4042-987a-c6ef508f246e admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:30.989833 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c7d8-f202-4042-987a-c6ef508f246e admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:30.994739 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261181d-5c67-4957-b212-d3a38b664b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:30.995360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261181d-5c67-4957-b212-d3a38b664b22 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:30.995642 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261181d-5c67-4957-b212-d3a38b664b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:30.995915 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261181d-5c67-4957-b212-d3a38b664b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:30.996565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261181d-5c67-4957-b212-d3a38b664b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:30.998995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261181d-5c67-4957-b212-d3a38b664b22 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:31.029110 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4550/9027] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:32:30 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:32:31.033363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf4d57-d8a1-4431-ba21-576b54cb3d15 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:31.044440 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf4d57-d8a1-4431-ba21-576b54cb3d15 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:31.102749 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbda14c-59e5-4eb1-adc6-aced182e4d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:31.103353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbda14c-59e5-4eb1-adc6-aced182e4d61 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:31.103631 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbda14c-59e5-4eb1-adc6-aced182e4d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:31.103904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbda14c-59e5-4eb1-adc6-aced182e4d61 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:31.104537 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbda14c-59e5-4eb1-adc6-aced182e4d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:31.106518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbda14c-59e5-4eb1-adc6-aced182e4d61 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:31.127362 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4478/9028] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:32:31 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:32:31.131555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261181d-5c67-4957-b212-d3a38b664b22 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:31.142892 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261181d-5c67-4957-b212-d3a38b664b22 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:31.147776 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dad57-69f5-44f4-99fc-9725606bee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:31.148401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dad57-69f5-44f4-99fc-9725606bee9d admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:31.148685 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dad57-69f5-44f4-99fc-9725606bee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:31.148986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dad57-69f5-44f4-99fc-9725606bee9d admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:31.149709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dad57-69f5-44f4-99fc-9725606bee9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:31.151313 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dad57-69f5-44f4-99fc-9725606bee9d admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:31.152587 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:31.164492 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4551/9029] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:32:31.169455 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbda14c-59e5-4eb1-adc6-aced182e4d61 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:31.182741 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbda14c-59e5-4eb1-adc6-aced182e4d61 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:31.188199 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa2c22-e2f0-4b51-aeb4-b360f04481e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:31.188896 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa2c22-e2f0-4b51-aeb4-b360f04481e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:31.189180 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa2c22-e2f0-4b51-aeb4-b360f04481e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:31.189490 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa2c22-e2f0-4b51-aeb4-b360f04481e6 admin admin] PATH_INFO: `/v3/projects/8b1d9ae4267548549a9648edaf363687/users/788b4e1877f04d49a133fa6ded1ad266/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:31.204901 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa2c22-e2f0-4b51-aeb4-b360f04481e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1d9ae4267548549a9648edaf363687, user_id=788b4e1877f04d49a133fa6ded1ad266, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:31.207609 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa2c22-e2f0-4b51-aeb4-b360f04481e6 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:31.220363 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4479/9030] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:32:31 2022] PUT /identity/v3/projects/8b1d9ae4267548549a9648edaf363687/users/788b4e1877f04d49a133fa6ded1ad266/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:31.224427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dad57-69f5-44f4-99fc-9725606bee9d admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:31.234908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dad57-69f5-44f4-99fc-9725606bee9d admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:31.291888 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2b8de-f8a6-414e-9aff-72bdd252ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:31.292516 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b8de-f8a6-414e-9aff-72bdd252ef16 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:31.292802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b8de-f8a6-414e-9aff-72bdd252ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:31.293086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b8de-f8a6-414e-9aff-72bdd252ef16 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:31.293760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2b8de-f8a6-414e-9aff-72bdd252ef16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:31.295358 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2b8de-f8a6-414e-9aff-72bdd252ef16 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:31.305104 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4552/9031] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:32:31.309245 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa2c22-e2f0-4b51-aeb4-b360f04481e6 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:31.320341 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa2c22-e2f0-4b51-aeb4-b360f04481e6 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:31.325171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b61f4f-45d9-4bbd-8518-f9cae09c2b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:31.325868 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b61f4f-45d9-4bbd-8518-f9cae09c2b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:31.326151 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b61f4f-45d9-4bbd-8518-f9cae09c2b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:31.326426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b61f4f-45d9-4bbd-8518-f9cae09c2b01 admin admin] PATH_INFO: `/v3/projects/8b1d9ae4267548549a9648edaf363687/users/788b4e1877f04d49a133fa6ded1ad266/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:31.329029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b61f4f-45d9-4bbd-8518-f9cae09c2b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1d9ae4267548549a9648edaf363687, user_id=788b4e1877f04d49a133fa6ded1ad266, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:31.331802 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b61f4f-45d9-4bbd-8518-f9cae09c2b01 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:31.343149 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4480/9032] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:32:31 2022] PUT /identity/v3/projects/8b1d9ae4267548549a9648edaf363687/users/788b4e1877f04d49a133fa6ded1ad266/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:32:31.355794 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227257f-23d9-4fb7-b000-98433f6f00d6 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:31.356135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227257f-23d9-4fb7-b000-98433f6f00d6 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:31.356416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227257f-23d9-4fb7-b000-98433f6f00d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:31.384593 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-d227257f-23d9-4fb7-b000-98433f6f00d6 None None] MFA Rules not processed for user `788b4e1877f04d49a133fa6ded1ad266`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:31.385937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d227257f-23d9-4fb7-b000-98433f6f00d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:31.454150 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4553/9033] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:32:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:31.467498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b61f4f-45d9-4bbd-8518-f9cae09c2b01 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:31.469202 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a2b61f4f-45d9-4bbd-8518-f9cae09c2b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:31.502024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:31.546543 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b61f4f-45d9-4bbd-8518-f9cae09c2b01 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:31.552170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bd54f-3e61-40f6-98b3-b3e1a2d68132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:31.552790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bd54f-3e61-40f6-98b3-b3e1a2d68132 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:31.553072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bd54f-3e61-40f6-98b3-b3e1a2d68132 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:31.553347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bd54f-3e61-40f6-98b3-b3e1a2d68132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:31.611443 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bd54f-3e61-40f6-98b3-b3e1a2d68132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:31.613036 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bd54f-3e61-40f6-98b3-b3e1a2d68132 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:31.622338 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4481/9034] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:33.164252 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227257f-23d9-4fb7-b000-98433f6f00d6 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:33.165703 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d227257f-23d9-4fb7-b000-98433f6f00d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:33.243373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227257f-23d9-4fb7-b000-98433f6f00d6 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:33.248321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c170d49-12e6-4557-a724-762bcd087a68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:33.249527 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c170d49-12e6-4557-a724-762bcd087a68 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:33.249808 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c170d49-12e6-4557-a724-762bcd087a68 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:33.250080 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c170d49-12e6-4557-a724-762bcd087a68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:33.251764 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1c170d49-12e6-4557-a724-762bcd087a68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:33.263344 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c170d49-12e6-4557-a724-762bcd087a68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:33.265046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c170d49-12e6-4557-a724-762bcd087a68 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:33.277057 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4554/9035] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:34.669659 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bd54f-3e61-40f6-98b3-b3e1a2d68132 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:34.671139 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-662bd54f-3e61-40f6-98b3-b3e1a2d68132 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:34.731680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bd54f-3e61-40f6-98b3-b3e1a2d68132 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:34.735580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179c4e4-42ea-4d27-b794-0c5dfab27e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:34.736191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179c4e4-42ea-4d27-b794-0c5dfab27e88 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:34.736473 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179c4e4-42ea-4d27-b794-0c5dfab27e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:34.736778 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179c4e4-42ea-4d27-b794-0c5dfab27e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:34.746417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179c4e4-42ea-4d27-b794-0c5dfab27e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:34.747852 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179c4e4-42ea-4d27-b794-0c5dfab27e88 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:34.758156 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4482/9036] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:37.697530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281b8a0-1888-49ac-9a24-d4dcfa07cf6c None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:37.697987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281b8a0-1888-49ac-9a24-d4dcfa07cf6c None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:37.698087 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281b8a0-1888-49ac-9a24-d4dcfa07cf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:37.715861 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:37.723058 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-b281b8a0-1888-49ac-9a24-d4dcfa07cf6c None None] MFA Rules not processed for user `73aebcdee9514da2883e50c4d9b3a2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:32:37.724507 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b281b8a0-1888-49ac-9a24-d4dcfa07cf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:37.732838 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4555/9037] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:32:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:32:39.479293 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179c4e4-42ea-4d27-b794-0c5dfab27e88 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:39.491241 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179c4e4-42ea-4d27-b794-0c5dfab27e88 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:39.496595 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32afe-5aeb-4a57-963c-fa77df9d6d42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:39.497194 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32afe-5aeb-4a57-963c-fa77df9d6d42 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:39.497526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32afe-5aeb-4a57-963c-fa77df9d6d42 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:39.497810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32afe-5aeb-4a57-963c-fa77df9d6d42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:39.499691 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-41c32afe-5aeb-4a57-963c-fa77df9d6d42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:39.517221 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c32afe-5aeb-4a57-963c-fa77df9d6d42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:39.518900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c32afe-5aeb-4a57-963c-fa77df9d6d42 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:39.536977 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4483/9038] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:43.424840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281b8a0-1888-49ac-9a24-d4dcfa07cf6c None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:32:43.438248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281b8a0-1888-49ac-9a24-d4dcfa07cf6c None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:32:43.443713 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cd48d-5eae-4b4a-9081-2d2cdefb823e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:32:43.444429 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cd48d-5eae-4b4a-9081-2d2cdefb823e service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:32:43.444715 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cd48d-5eae-4b4a-9081-2d2cdefb823e service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:32:43.444991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cd48d-5eae-4b4a-9081-2d2cdefb823e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:32:43.446849 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-006cd48d-5eae-4b4a-9081-2d2cdefb823e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:32:43.459045 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006cd48d-5eae-4b4a-9081-2d2cdefb823e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:32:43.460618 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006cd48d-5eae-4b4a-9081-2d2cdefb823e service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:32:43.470546 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4556/9039] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:32:49.524981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=76 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:53.466493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:34.151004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32afe-5aeb-4a57-963c-fa77df9d6d42 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:34.153115 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-41c32afe-5aeb-4a57-963c-fa77df9d6d42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:34.168809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32afe-5aeb-4a57-963c-fa77df9d6d42 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:34.174533 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d148-e5cc-4743-a3ae-9bcde96c18b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:34.176475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d148-e5cc-4743-a3ae-9bcde96c18b8 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:34.176475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d148-e5cc-4743-a3ae-9bcde96c18b8 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:34.176475 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d148-e5cc-4743-a3ae-9bcde96c18b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:34.178153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-0308d148-e5cc-4743-a3ae-9bcde96c18b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:34.191881 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308d148-e5cc-4743-a3ae-9bcde96c18b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:34.193532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308d148-e5cc-4743-a3ae-9bcde96c18b8 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:34.207885 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4484/9040] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:44.202592 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:46.465692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ee8d-a82c-4b81-ae3c-6ba7e96a1b1f None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:46.466566 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ee8d-a82c-4b81-ae3c-6ba7e96a1b1f None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:46.467011 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ee8d-a82c-4b81-ae3c-6ba7e96a1b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:46.493107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-c0b2ee8d-a82c-4b81-ae3c-6ba7e96a1b1f None None] MFA Rules not processed for user `73aebcdee9514da2883e50c4d9b3a2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:33:46.494738 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c0b2ee8d-a82c-4b81-ae3c-6ba7e96a1b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:46.507265 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4557/9041] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:33:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:33:47.200159 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c08c7-c524-4abc-a08e-56df95c35d18 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:47.200667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c08c7-c524-4abc-a08e-56df95c35d18 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:47.200762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c08c7-c524-4abc-a08e-56df95c35d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:47.221465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-584c08c7-c524-4abc-a08e-56df95c35d18 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:33:47.222818 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-584c08c7-c524-4abc-a08e-56df95c35d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:47.229541 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4485/9042] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:33:47.241728 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2ee8d-a82c-4b81-ae3c-6ba7e96a1b1f None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:47.243110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-c0b2ee8d-a82c-4b81-ae3c-6ba7e96a1b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:47.255490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2ee8d-a82c-4b81-ae3c-6ba7e96a1b1f None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:47.259062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a538-ab4b-43ba-9150-3371f59c71b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:47.259661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a538-ab4b-43ba-9150-3371f59c71b3 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:47.259937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a538-ab4b-43ba-9150-3371f59c71b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:47.260208 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a538-ab4b-43ba-9150-3371f59c71b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:47.267277 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92a538-ab4b-43ba-9150-3371f59c71b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:47.268695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92a538-ab4b-43ba-9150-3371f59c71b3 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:47.278174 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4558/9043] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:33:48.645580 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c08c7-c524-4abc-a08e-56df95c35d18 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:48.671733 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c08c7-c524-4abc-a08e-56df95c35d18 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:48.691976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7631d-b7cc-43f8-89a1-d2ab04e73672 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:48.692610 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7631d-b7cc-43f8-89a1-d2ab04e73672 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:48.693021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7631d-b7cc-43f8-89a1-d2ab04e73672 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:48.693300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7631d-b7cc-43f8-89a1-d2ab04e73672 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:48.695186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-54f7631d-b7cc-43f8-89a1-d2ab04e73672 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:48.707843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7631d-b7cc-43f8-89a1-d2ab04e73672 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:48.709495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7631d-b7cc-43f8-89a1-d2ab04e73672 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:48.723997 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4486/9044] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:54.492010 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a538-ab4b-43ba-9150-3371f59c71b3 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:33:54.501292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a538-ab4b-43ba-9150-3371f59c71b3 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:33:54.504943 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed27eb-78cb-4fb0-9a1b-7933d74f4d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:33:54.505571 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed27eb-78cb-4fb0-9a1b-7933d74f4d6a service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:33:54.505854 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed27eb-78cb-4fb0-9a1b-7933d74f4d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:33:54.506129 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed27eb-78cb-4fb0-9a1b-7933d74f4d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:33:54.507882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d6ed27eb-78cb-4fb0-9a1b-7933d74f4d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:33:54.521321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed27eb-78cb-4fb0-9a1b-7933d74f4d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:33:54.522751 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed27eb-78cb-4fb0-9a1b-7933d74f4d6a service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:33:54.534787 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4559/9045] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:33:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:33:58.718790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=9 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:04.529843 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=15 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:33.970197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7631d-b7cc-43f8-89a1-d2ab04e73672 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:34:33.990670 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7631d-b7cc-43f8-89a1-d2ab04e73672 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:34:33.994671 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa560c9-7b98-4f47-839a-21d907c9aa0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:34:33.995320 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa560c9-7b98-4f47-839a-21d907c9aa0e service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:34:33.995604 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa560c9-7b98-4f47-839a-21d907c9aa0e service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:34:33.995872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa560c9-7b98-4f47-839a-21d907c9aa0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:34:33.997715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6aa560c9-7b98-4f47-839a-21d907c9aa0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:34:34.028928 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa560c9-7b98-4f47-839a-21d907c9aa0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:34:34.030394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa560c9-7b98-4f47-839a-21d907c9aa0e service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:34:34.038339 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4487/9046] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:34:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:34:44.034735 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=19 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:10.720749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed27eb-78cb-4fb0-9a1b-7933d74f4d6a service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:10.781597 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed27eb-78cb-4fb0-9a1b-7933d74f4d6a service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:10.789790 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffdcfb-2554-4cb0-8207-4b96a88adade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:10.790783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffdcfb-2554-4cb0-8207-4b96a88adade service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:10.791398 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffdcfb-2554-4cb0-8207-4b96a88adade service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:10.791887 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffdcfb-2554-4cb0-8207-4b96a88adade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:10.793952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-73ffdcfb-2554-4cb0-8207-4b96a88adade service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:10.821155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffdcfb-2554-4cb0-8207-4b96a88adade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:10.822823 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffdcfb-2554-4cb0-8207-4b96a88adade service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:10.847262 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4560/9047] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:35:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:35:12.098302 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa560c9-7b98-4f47-839a-21d907c9aa0e service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:12.107044 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa560c9-7b98-4f47-839a-21d907c9aa0e service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:12.110850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ac2c7-8f70-4034-a4c2-0777171156ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:12.111496 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac2c7-8f70-4034-a4c2-0777171156ad service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:12.111779 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac2c7-8f70-4034-a4c2-0777171156ad service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:12.112057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac2c7-8f70-4034-a4c2-0777171156ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:12.113857 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ba4ac2c7-8f70-4034-a4c2-0777171156ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:12.128070 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ac2c7-8f70-4034-a4c2-0777171156ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:12.129539 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ac2c7-8f70-4034-a4c2-0777171156ad service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:12.141778 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4488/9048] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:35:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:35:16.507945 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d40ea8-c626-4f36-9ffa-cbef8bb0c892 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:16.508451 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d40ea8-c626-4f36-9ffa-cbef8bb0c892 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:16.508534 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d40ea8-c626-4f36-9ffa-cbef8bb0c892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:16.563433 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-14d40ea8-c626-4f36-9ffa-cbef8bb0c892 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:35:16.565168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-14d40ea8-c626-4f36-9ffa-cbef8bb0c892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:16.577886 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4561/9049] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:35:16.592608 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ac2c7-8f70-4034-a4c2-0777171156ad service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:16.608425 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ac2c7-8f70-4034-a4c2-0777171156ad service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:16.614164 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c6f6e-b2f0-4317-bf7d-aac644e8706e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:16.614806 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c6f6e-b2f0-4317-bf7d-aac644e8706e service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:16.615264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c6f6e-b2f0-4317-bf7d-aac644e8706e service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:16.615648 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c6f6e-b2f0-4317-bf7d-aac644e8706e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:16.625465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c6f6e-b2f0-4317-bf7d-aac644e8706e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:16.627231 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c6f6e-b2f0-4317-bf7d-aac644e8706e service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:16.642393 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4489/9050] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:35:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:35:22.813330 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08d32-5007-442e-89be-b9d3e33722c4 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:22.813935 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08d32-5007-442e-89be-b9d3e33722c4 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:22.814053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08d32-5007-442e-89be-b9d3e33722c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:22.836896 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-91a08d32-5007-442e-89be-b9d3e33722c4 None None] MFA Rules not processed for user `73aebcdee9514da2883e50c4d9b3a2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:35:22.838196 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-91a08d32-5007-442e-89be-b9d3e33722c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:22.849724 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4562/9051] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:35:26.471465 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982691c-7d12-4ba1-b7eb-8bbcea2c5b22 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:26.471995 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982691c-7d12-4ba1-b7eb-8bbcea2c5b22 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:26.472103 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982691c-7d12-4ba1-b7eb-8bbcea2c5b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:26.530792 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4982691c-7d12-4ba1-b7eb-8bbcea2c5b22 None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:35:26.532011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4982691c-7d12-4ba1-b7eb-8bbcea2c5b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:35:26.539858 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4490/9052] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Aug 29 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:35:26.551367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08d32-5007-442e-89be-b9d3e33722c4 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:35:26.561989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08d32-5007-442e-89be-b9d3e33722c4 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:35:26.565936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea3940-44fc-4053-b8de-9274cfd99e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:35:26.566536 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3940-44fc-4053-b8de-9274cfd99e5f service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:35:26.566818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3940-44fc-4053-b8de-9274cfd99e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:35:26.567094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3940-44fc-4053-b8de-9274cfd99e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:35:26.574365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea3940-44fc-4053-b8de-9274cfd99e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:35:26.575798 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea3940-44fc-4053-b8de-9274cfd99e5f service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:35:26.583728 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4563/9053] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:35:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:35:36.527387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=26 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:36.580178 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=53 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:08.798788 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8879-58c0-4d77-9604-20d7a37e7c5b None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:08.799363 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8879-58c0-4d77-9604-20d7a37e7c5b None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:08.799972 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8879-58c0-4d77-9604-20d7a37e7c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:08.823346 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4e8d8879-58c0-4d77-9604-20d7a37e7c5b None None] MFA Rules not processed for user `d9d3bea88ab145a4b737bc88339f285c`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:36:08.824640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4e8d8879-58c0-4d77-9604-20d7a37e7c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:08.831692 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4491/9054] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:36:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:36:08.843453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea3940-44fc-4053-b8de-9274cfd99e5f service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:36:08.854822 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea3940-44fc-4053-b8de-9274cfd99e5f service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:36:08.858316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec4b7d-a0d2-446d-b848-fa335a5fb770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:36:08.858923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4b7d-a0d2-446d-b848-fa335a5fb770 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:08.859205 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4b7d-a0d2-446d-b848-fa335a5fb770 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:08.859582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4b7d-a0d2-446d-b848-fa335a5fb770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:08.867712 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec4b7d-a0d2-446d-b848-fa335a5fb770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:36:08.869139 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec4b7d-a0d2-446d-b848-fa335a5fb770 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:36:08.883067 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4564/9055] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:36:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:36:08.973507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38744-74d7-4ead-b42f-9c1af60e2622 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:08.973794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38744-74d7-4ead-b42f-9c1af60e2622 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:08.974095 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38744-74d7-4ead-b42f-9c1af60e2622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:09.001081 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-c3c38744-74d7-4ead-b42f-9c1af60e2622 None None] MFA Rules not processed for user `a0fc274aa6064fda9fab30fbd16df5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:36:09.002335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-c3c38744-74d7-4ead-b42f-9c1af60e2622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:09.011196 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4492/9056] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:36:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:36:09.022800 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec4b7d-a0d2-446d-b848-fa335a5fb770 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:36:09.024171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-d1ec4b7d-a0d2-446d-b848-fa335a5fb770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:09.039686 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec4b7d-a0d2-446d-b848-fa335a5fb770 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:36:09.044705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f3d54-1e10-46da-9a1f-8303f0c17d7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:36:09.045309 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f3d54-1e10-46da-9a1f-8303f0c17d7b service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:09.045690 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f3d54-1e10-46da-9a1f-8303f0c17d7b service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:09.045963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f3d54-1e10-46da-9a1f-8303f0c17d7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:09.055472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f3d54-1e10-46da-9a1f-8303f0c17d7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:36:09.056979 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f3d54-1e10-46da-9a1f-8303f0c17d7b service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:36:09.067064 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4565/9057] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:36:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:36:09.250408 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f60bc-7356-4521-84b7-94ad2cadc0b6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:09.250723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f60bc-7356-4521-84b7-94ad2cadc0b6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:09.251025 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f60bc-7356-4521-84b7-94ad2cadc0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:09.288715 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-942f60bc-7356-4521-84b7-94ad2cadc0b6 None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:36:09.290121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-942f60bc-7356-4521-84b7-94ad2cadc0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:09.299701 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4493/9058] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:36:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:36:09.311275 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f3d54-1e10-46da-9a1f-8303f0c17d7b service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:36:09.320986 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f3d54-1e10-46da-9a1f-8303f0c17d7b service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:36:09.324660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb688e-1c1c-4fe9-b901-be076ff80e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:36:09.325254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb688e-1c1c-4fe9-b901-be076ff80e43 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:09.325582 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb688e-1c1c-4fe9-b901-be076ff80e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:09.325860 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb688e-1c1c-4fe9-b901-be076ff80e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:09.336180 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb688e-1c1c-4fe9-b901-be076ff80e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:36:09.337689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb688e-1c1c-4fe9-b901-be076ff80e43 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:36:09.348424 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4566/9059] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:36:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:36:19.285935 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=15 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:19.343709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=18 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:35.708450 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f60bc-7356-4521-84b7-94ad2cadc0b6 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:36:35.719843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f60bc-7356-4521-84b7-94ad2cadc0b6 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:36:35.725526 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f14ef-2c36-42ad-b40c-a0cbb283ae29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:36:35.726144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f14ef-2c36-42ad-b40c-a0cbb283ae29 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:36:35.726424 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f14ef-2c36-42ad-b40c-a0cbb283ae29 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:36:35.726700 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f14ef-2c36-42ad-b40c-a0cbb283ae29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:36:35.728466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ad1f14ef-2c36-42ad-b40c-a0cbb283ae29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:36:35.741576 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f14ef-2c36-42ad-b40c-a0cbb283ae29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:36:35.743301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f14ef-2c36-42ad-b40c-a0cbb283ae29 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:36:35.757335 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4494/9060] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:36:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:36:45.751497 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:14.547758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664697e-beba-45e9-a4ff-85fc587ce616 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:37:14.548628 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664697e-beba-45e9-a4ff-85fc587ce616 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:37:14.548908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664697e-beba-45e9-a4ff-85fc587ce616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:37:14.569555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-3664697e-beba-45e9-a4ff-85fc587ce616 None None] MFA Rules not processed for user `73aebcdee9514da2883e50c4d9b3a2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:37:14.570765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3664697e-beba-45e9-a4ff-85fc587ce616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:37:14.579782 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4567/9061] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:37:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:37:24.563992 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:40.187850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f14ef-2c36-42ad-b40c-a0cbb283ae29 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:37:40.209969 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f14ef-2c36-42ad-b40c-a0cbb283ae29 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:37:40.215238 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43e9d6-3c23-4ae2-8b54-f7515084f732 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:37:40.215833 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43e9d6-3c23-4ae2-8b54-f7515084f732 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:37:40.216114 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43e9d6-3c23-4ae2-8b54-f7515084f732 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:37:40.216389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43e9d6-3c23-4ae2-8b54-f7515084f732 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:37:40.224915 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43e9d6-3c23-4ae2-8b54-f7515084f732 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:37:40.226513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43e9d6-3c23-4ae2-8b54-f7515084f732 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:37:40.236266 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4495/9062] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:37:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:37:46.419953 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664697e-beba-45e9-a4ff-85fc587ce616 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:37:46.431691 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664697e-beba-45e9-a4ff-85fc587ce616 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:37:46.437494 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6df49-d85b-42c8-a3e7-290760dd2509 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:37:46.438094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6df49-d85b-42c8-a3e7-290760dd2509 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:37:46.438662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6df49-d85b-42c8-a3e7-290760dd2509 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:37:46.438937 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6df49-d85b-42c8-a3e7-290760dd2509 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:37:46.447240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6df49-d85b-42c8-a3e7-290760dd2509 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:37:46.448813 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6df49-d85b-42c8-a3e7-290760dd2509 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:37:46.458544 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4568/9063] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:37:49.550445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43e9d6-3c23-4ae2-8b54-f7515084f732 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:37:49.576822 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43e9d6-3c23-4ae2-8b54-f7515084f732 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:37:49.582640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc012eab-3f13-4488-ac43-b55c1715099d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:37:49.583244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012eab-3f13-4488-ac43-b55c1715099d service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:37:49.583521 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012eab-3f13-4488-ac43-b55c1715099d service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:37:49.583794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012eab-3f13-4488-ac43-b55c1715099d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:37:49.591790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc012eab-3f13-4488-ac43-b55c1715099d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:37:49.593582 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc012eab-3f13-4488-ac43-b55c1715099d service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:37:49.604498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4496/9064] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:37:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:37:56.454428 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:37:59.599701 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=20 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:49.843365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6df49-d85b-42c8-a3e7-290760dd2509 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:49.863978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6df49-d85b-42c8-a3e7-290760dd2509 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:49.867605 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22d420-b2e7-4ca4-bcea-4b288ca48fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:49.868202 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22d420-b2e7-4ca4-bcea-4b288ca48fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:49.868479 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22d420-b2e7-4ca4-bcea-4b288ca48fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:49.868753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22d420-b2e7-4ca4-bcea-4b288ca48fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:49.879164 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22d420-b2e7-4ca4-bcea-4b288ca48fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:49.880589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22d420-b2e7-4ca4-bcea-4b288ca48fb7 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:49.892427 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4569/9065] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:49 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:38:52.574859 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673a6c-474f-4038-b11f-24b07a005ec2 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:52.575416 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673a6c-474f-4038-b11f-24b07a005ec2 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:52.575724 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673a6c-474f-4038-b11f-24b07a005ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:52.598545 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-dc673a6c-474f-4038-b11f-24b07a005ec2 None None] MFA Rules not processed for user `73aebcdee9514da2883e50c4d9b3a2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:38:52.600024 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dc673a6c-474f-4038-b11f-24b07a005ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:52.608020 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4497/9066] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:38:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:38:52.987249 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22d420-b2e7-4ca4-bcea-4b288ca48fb7 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:52.997827 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22d420-b2e7-4ca4-bcea-4b288ca48fb7 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:53.004535 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7892c2-4890-4b44-86fb-5aba89d67069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:53.006251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7892c2-4890-4b44-86fb-5aba89d67069 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:53.007314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7892c2-4890-4b44-86fb-5aba89d67069 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:53.007839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7892c2-4890-4b44-86fb-5aba89d67069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:53.010560 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8c7892c2-4890-4b44-86fb-5aba89d67069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:38:53.023722 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7892c2-4890-4b44-86fb-5aba89d67069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:53.025672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7892c2-4890-4b44-86fb-5aba89d67069 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:53.049376 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4570/9067] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:38:54.473210 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc673a6c-474f-4038-b11f-24b07a005ec2 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:54.486371 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc673a6c-474f-4038-b11f-24b07a005ec2 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:54.491635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9359d-ba17-49a5-882f-f8a10c683493 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:54.492251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9359d-ba17-49a5-882f-f8a10c683493 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:54.492538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9359d-ba17-49a5-882f-f8a10c683493 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:54.492810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9359d-ba17-49a5-882f-f8a10c683493 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:54.507185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9359d-ba17-49a5-882f-f8a10c683493 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:54.508987 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9359d-ba17-49a5-882f-f8a10c683493 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:54.520030 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4498/9068] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:38:56.762978 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7892c2-4890-4b44-86fb-5aba89d67069 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:38:56.772299 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7892c2-4890-4b44-86fb-5aba89d67069 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:38:56.775963 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc0fb0-6241-40e0-85c3-06cfe68a7a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:38:56.776553 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc0fb0-6241-40e0-85c3-06cfe68a7a59 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:38:56.776834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc0fb0-6241-40e0-85c3-06cfe68a7a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:38:56.777107 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc0fb0-6241-40e0-85c3-06cfe68a7a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:38:56.788540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc0fb0-6241-40e0-85c3-06cfe68a7a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:38:56.790435 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc0fb0-6241-40e0-85c3-06cfe68a7a59 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:38:56.808911 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4571/9069] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:38:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:39:00.030063 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9359d-ba17-49a5-882f-f8a10c683493 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:00.042765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9359d-ba17-49a5-882f-f8a10c683493 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:00.048368 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05a84d-be70-4521-bf4a-e4082954e9c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:00.048981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05a84d-be70-4521-bf4a-e4082954e9c2 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:00.049264 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05a84d-be70-4521-bf4a-e4082954e9c2 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:00.049574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05a84d-be70-4521-bf4a-e4082954e9c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:00.058810 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05a84d-be70-4521-bf4a-e4082954e9c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:00.060399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05a84d-be70-4521-bf4a-e4082954e9c2 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:00.072069 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4499/9070] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:39:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:39:06.800086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=22 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:10.067478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=15 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:51.829921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc0fb0-6241-40e0-85c3-06cfe68a7a59 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:51.841113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc0fb0-6241-40e0-85c3-06cfe68a7a59 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:51.846081 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36303f2-936c-4dcf-8310-e13399d13ce4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:51.847403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36303f2-936c-4dcf-8310-e13399d13ce4 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:51.847689 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36303f2-936c-4dcf-8310-e13399d13ce4 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:51.847960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36303f2-936c-4dcf-8310-e13399d13ce4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:51.849781 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b36303f2-936c-4dcf-8310-e13399d13ce4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:51.863841 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36303f2-936c-4dcf-8310-e13399d13ce4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:51.865581 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36303f2-936c-4dcf-8310-e13399d13ce4 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:51.876077 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4572/9071] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:39:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:39:52.123056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05a84d-be70-4521-bf4a-e4082954e9c2 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:52.203393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05a84d-be70-4521-bf4a-e4082954e9c2 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:52.208562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:52.209188 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:52.209516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:52.209796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] PATH_INFO: `/v3/users/73aebcdee9514da2883e50c4d9b3a2f5` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:52.210913 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73aebcdee9514da2883e50c4d9b3a2f5)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:52.212832 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:52.259646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73aebcdee9514da2883e50c4d9b3a2f5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.260569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73aebcdee9514da2883e50c4d9b3a2f5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.277869 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73aebcdee9514da2883e50c4d9b3a2f5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.287814 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73aebcdee9514da2883e50c4d9b3a2f5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.295389 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73aebcdee9514da2883e50c4d9b3a2f5'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.301955 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4500/9072] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:39:52 2022] DELETE /identity/v3/users/73aebcdee9514da2883e50c4d9b3a2f5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:39:52.306733 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7b89c-e373-4eb7-9539-2ea154884134 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:52.307025 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7b89c-e373-4eb7-9539-2ea154884134 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:52.307327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7b89c-e373-4eb7-9539-2ea154884134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:52.357283 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-04e7b89c-e373-4eb7-9539-2ea154884134 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:39:52.360826 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-04e7b89c-e373-4eb7-9539-2ea154884134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:52.418083 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4573/9073] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:39:52.427794 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:52.429247 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:52.492491 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79a709-6540-47c0-b6e3-06ec5d9f2525 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:52.496438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2a131-1b71-42fa-a8e2-476297e31954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:52.497053 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2a131-1b71-42fa-a8e2-476297e31954 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:52.497335 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2a131-1b71-42fa-a8e2-476297e31954 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:52.497655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2a131-1b71-42fa-a8e2-476297e31954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:52.510669 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2a131-1b71-42fa-a8e2-476297e31954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:52.513298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2a131-1b71-42fa-a8e2-476297e31954 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:52.531040 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4501/9074] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:39:52.704662 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7b89c-e373-4eb7-9539-2ea154884134 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:52.706183 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-04e7b89c-e373-4eb7-9539-2ea154884134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:52.718864 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7b89c-e373-4eb7-9539-2ea154884134 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:52.724267 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:52.724901 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:52.725179 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:52.725478 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] PATH_INFO: `/v3/projects/ecb98c98f9e648969df435ba25553626` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:52.726589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb98c98f9e648969df435ba25553626)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:52.728518 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:52.778128 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb98c98f9e648969df435ba25553626', 'request_id': 'req-b0fcc027-a364-49ac-84b9-9c7693b20050'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.784263 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb98c98f9e648969df435ba25553626', 'request_id': 'req-b0fcc027-a364-49ac-84b9-9c7693b20050'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.791592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb98c98f9e648969df435ba25553626', 'request_id': 'req-b0fcc027-a364-49ac-84b9-9c7693b20050'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.802375 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] The token cache is being invalidate because project ecb98c98f9e648969df435ba25553626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:39:52.802665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.803329 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.804972 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4574/9075] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:39:52 2022] DELETE /identity/v3/projects/ecb98c98f9e648969df435ba25553626 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:39:52.809328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2a131-1b71-42fa-a8e2-476297e31954 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:52.816252 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:52.820752 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2a131-1b71-42fa-a8e2-476297e31954 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:52.881243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b2370-afc0-4809-9a11-5faa3e084b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:52.881848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b2370-afc0-4809-9a11-5faa3e084b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:52.882125 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b2370-afc0-4809-9a11-5faa3e084b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:52.882394 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b2370-afc0-4809-9a11-5faa3e084b1c admin admin] PATH_INFO: `/v3/users/788b4e1877f04d49a133fa6ded1ad266` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:52.883529 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b2370-afc0-4809-9a11-5faa3e084b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=788b4e1877f04d49a133fa6ded1ad266)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:52.885474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b2370-afc0-4809-9a11-5faa3e084b1c admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:52.934587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3d0b2370-afc0-4809-9a11-5faa3e084b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788b4e1877f04d49a133fa6ded1ad266'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.935436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3d0b2370-afc0-4809-9a11-5faa3e084b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788b4e1877f04d49a133fa6ded1ad266'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.949327 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3d0b2370-afc0-4809-9a11-5faa3e084b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788b4e1877f04d49a133fa6ded1ad266'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.959154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3d0b2370-afc0-4809-9a11-5faa3e084b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788b4e1877f04d49a133fa6ded1ad266'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.966698 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-3d0b2370-afc0-4809-9a11-5faa3e084b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788b4e1877f04d49a133fa6ded1ad266'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:52.974010 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4502/9076] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:39:52 2022] DELETE /identity/v3/users/788b4e1877f04d49a133fa6ded1ad266 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:39:53.266110 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:53.267744 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:53.283298 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcc027-a364-49ac-84b9-9c7693b20050 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:53.334675 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:53.343490 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:53.344120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:53.344403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:53.344680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] PATH_INFO: `/v3/projects/8b1d9ae4267548549a9648edaf363687` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:53.345834 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1d9ae4267548549a9648edaf363687)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:53.348392 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:53.400221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1d9ae4267548549a9648edaf363687', 'request_id': 'req-82a10377-68e8-4214-ba43-bf022ce930d4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:53.406144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1d9ae4267548549a9648edaf363687', 'request_id': 'req-82a10377-68e8-4214-ba43-bf022ce930d4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:53.414056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1d9ae4267548549a9648edaf363687', 'request_id': 'req-82a10377-68e8-4214-ba43-bf022ce930d4'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:53.424782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] The token cache is being invalidate because project 8b1d9ae4267548549a9648edaf363687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:39:53.425074 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:53.426388 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-82a10377-68e8-4214-ba43-bf022ce930d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:39:53.427876 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4575/9077] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:39:53 2022] DELETE /identity/v3/projects/8b1d9ae4267548549a9648edaf363687 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:39:53.433191 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6751d-b400-4009-87b2-100862de7f88 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:53.433689 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6751d-b400-4009-87b2-100862de7f88 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:53.433819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6751d-b400-4009-87b2-100862de7f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:53.472872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1cc6751d-b400-4009-87b2-100862de7f88 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:39:53.474099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1cc6751d-b400-4009-87b2-100862de7f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:53.533305 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4503/9078] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:39:53.542551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0e9b1-b35f-461b-ab6a-058662a8e8e3 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:53.542840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0e9b1-b35f-461b-ab6a-058662a8e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:53.543111 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0e9b1-b35f-461b-ab6a-058662a8e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:53.563285 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-58b0e9b1-b35f-461b-ab6a-058662a8e8e3 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:39:53.564723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-58b0e9b1-b35f-461b-ab6a-058662a8e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:53.572590 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4576/9079] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:39:53.576892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6751d-b400-4009-87b2-100862de7f88 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:53.586771 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6751d-b400-4009-87b2-100862de7f88 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:53.591426 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f20676-cd66-41d3-81f3-316a41597690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:53.592014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f20676-cd66-41d3-81f3-316a41597690 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:53.592290 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f20676-cd66-41d3-81f3-316a41597690 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:53.592562 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f20676-cd66-41d3-81f3-316a41597690 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:53.593228 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f20676-cd66-41d3-81f3-316a41597690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:39:53.593565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f20676-cd66-41d3-81f3-316a41597690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:53.595148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f20676-cd66-41d3-81f3-316a41597690 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:53.597982 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:53.609947 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4504/9080] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 16:39:53.614760 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0e9b1-b35f-461b-ab6a-058662a8e8e3 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:53.624121 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0e9b1-b35f-461b-ab6a-058662a8e8e3 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:53.628758 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485763-18a8-4c7d-ad98-aac462b1c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:53.629346 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485763-18a8-4c7d-ad98-aac462b1c820 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:53.629654 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485763-18a8-4c7d-ad98-aac462b1c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:53.629924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485763-18a8-4c7d-ad98-aac462b1c820 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:53.630555 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5485763-18a8-4c7d-ad98-aac462b1c820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:53.632427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5485763-18a8-4c7d-ad98-aac462b1c820 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:53.659379 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4577/9081] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:39:53 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:39:53.663900 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f20676-cd66-41d3-81f3-316a41597690 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:53.673838 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f20676-cd66-41d3-81f3-316a41597690 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:53.729863 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e5d2a-9be9-4ac8-9c15-411d5adb639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:53.730463 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5d2a-9be9-4ac8-9c15-411d5adb639d admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:53.730740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5d2a-9be9-4ac8-9c15-411d5adb639d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:53.731011 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5d2a-9be9-4ac8-9c15-411d5adb639d admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:53.731629 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e5d2a-9be9-4ac8-9c15-411d5adb639d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:53.733560 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e5d2a-9be9-4ac8-9c15-411d5adb639d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:53.753670 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4505/9082] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:39:53 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:39:53.758002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485763-18a8-4c7d-ad98-aac462b1c820 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:53.768349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485763-18a8-4c7d-ad98-aac462b1c820 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:53.773557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77948fb-8a74-46a7-b19a-843b3addb366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:53.774149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77948fb-8a74-46a7-b19a-843b3addb366 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:53.774431 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77948fb-8a74-46a7-b19a-843b3addb366 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:53.774706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77948fb-8a74-46a7-b19a-843b3addb366 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:53.775342 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77948fb-8a74-46a7-b19a-843b3addb366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:53.776924 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77948fb-8a74-46a7-b19a-843b3addb366 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:53.787354 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4578/9083] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:39:53.791213 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e5d2a-9be9-4ac8-9c15-411d5adb639d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:53.801158 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e5d2a-9be9-4ac8-9c15-411d5adb639d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:53.805845 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812eeac9-ebb5-4448-9ded-b4983c321737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:53.806438 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eeac9-ebb5-4448-9ded-b4983c321737 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:53.806719 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eeac9-ebb5-4448-9ded-b4983c321737 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:53.806996 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eeac9-ebb5-4448-9ded-b4983c321737 admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:53.807630 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812eeac9-ebb5-4448-9ded-b4983c321737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:53.809218 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812eeac9-ebb5-4448-9ded-b4983c321737 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:53.820451 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4506/9084] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:39:53.824569 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77948fb-8a74-46a7-b19a-843b3addb366 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:53.835262 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77948fb-8a74-46a7-b19a-843b3addb366 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:53.840023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb4e9b-845f-4ad3-a483-4cc43dd82798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:53.840665 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4e9b-845f-4ad3-a483-4cc43dd82798 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:53.840949 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4e9b-845f-4ad3-a483-4cc43dd82798 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:53.841254 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4e9b-845f-4ad3-a483-4cc43dd82798 admin admin] PATH_INFO: `/v3/projects/cddf5a6066704ec5a96d141bf8b96120/users/6f5dd2f1393b413fb8aa410a47d5357f/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:53.857530 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb4e9b-845f-4ad3-a483-4cc43dd82798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cddf5a6066704ec5a96d141bf8b96120, user_id=6f5dd2f1393b413fb8aa410a47d5357f, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:53.860171 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb4e9b-845f-4ad3-a483-4cc43dd82798 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:53.873978 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4579/9085] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:39:53 2022] PUT /identity/v3/projects/cddf5a6066704ec5a96d141bf8b96120/users/6f5dd2f1393b413fb8aa410a47d5357f/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:39:53.881236 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b60a8-9b24-4e13-b5dc-ce4bd34ff1c8 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:53.881633 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b60a8-9b24-4e13-b5dc-ce4bd34ff1c8 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:53.881917 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b60a8-9b24-4e13-b5dc-ce4bd34ff1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:53.902790 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-b27b60a8-9b24-4e13-b5dc-ce4bd34ff1c8 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:39:53.903997 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-b27b60a8-9b24-4e13-b5dc-ce4bd34ff1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:53.963454 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4507/9086] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:39:53.973753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb4e9b-845f-4ad3-a483-4cc43dd82798 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:53.975454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-6dcb4e9b-845f-4ad3-a483-4cc43dd82798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:54.030765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb4e9b-845f-4ad3-a483-4cc43dd82798 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:54.034401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63c901-d73f-4c06-b3f5-b07b38223edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:54.035606 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63c901-d73f-4c06-b3f5-b07b38223edf service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:54.035884 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63c901-d73f-4c06-b3f5-b07b38223edf service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:54.036155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63c901-d73f-4c06-b3f5-b07b38223edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:54.045410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63c901-d73f-4c06-b3f5-b07b38223edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:54.046832 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63c901-d73f-4c06-b3f5-b07b38223edf service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:54.056428 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4580/9087] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:39:58.254743 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea37ba-ed07-4aa6-b0f7-cce1a82218c9 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:58.255329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea37ba-ed07-4aa6-b0f7-cce1a82218c9 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:58.255329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea37ba-ed07-4aa6-b0f7-cce1a82218c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:58.287121 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-7eea37ba-ed07-4aa6-b0f7-cce1a82218c9 None None] MFA Rules not processed for user `6f5dd2f1393b413fb8aa410a47d5357f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:39:58.288348 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-7eea37ba-ed07-4aa6-b0f7-cce1a82218c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:39:58.364684 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4508/9088] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:39:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:39:58.369117 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63c901-d73f-4c06-b3f5-b07b38223edf service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:58.380772 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63c901-d73f-4c06-b3f5-b07b38223edf service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:58.386416 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9102c6c-863d-4225-a6a1-1524a3e0d7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:58.387038 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9102c6c-863d-4225-a6a1-1524a3e0d7be admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:58.387320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9102c6c-863d-4225-a6a1-1524a3e0d7be admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:58.387592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9102c6c-863d-4225-a6a1-1524a3e0d7be admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:58.388218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9102c6c-863d-4225-a6a1-1524a3e0d7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:58.390332 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9102c6c-863d-4225-a6a1-1524a3e0d7be admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:58.414363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:58.425418 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4581/9089] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:39:58 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:39:58.426675 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea37ba-ed07-4aa6-b0f7-cce1a82218c9 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:58.435000 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:58.440817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea37ba-ed07-4aa6-b0f7-cce1a82218c9 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:58.500260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb0c54-7f25-4559-995e-ba9b8cdb8faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:58.501014 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb0c54-7f25-4559-995e-ba9b8cdb8faf admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:58.501353 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb0c54-7f25-4559-995e-ba9b8cdb8faf admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:58.501753 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb0c54-7f25-4559-995e-ba9b8cdb8faf admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:58.502840 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb0c54-7f25-4559-995e-ba9b8cdb8faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:58.505623 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb0c54-7f25-4559-995e-ba9b8cdb8faf admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:58.537447 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4509/9090] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:39:58 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 16:39:58.542104 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9102c6c-863d-4225-a6a1-1524a3e0d7be admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:58.552840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9102c6c-863d-4225-a6a1-1524a3e0d7be admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:58.557629 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad35af-8010-444e-a24f-090117bcf0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:58.558240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad35af-8010-444e-a24f-090117bcf0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:58.558524 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad35af-8010-444e-a24f-090117bcf0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:58.558795 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad35af-8010-444e-a24f-090117bcf0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:58.559438 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad35af-8010-444e-a24f-090117bcf0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:58.561070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad35af-8010-444e-a24f-090117bcf0e3 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:58.573555 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4582/9091] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:39:58.577796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb0c54-7f25-4559-995e-ba9b8cdb8faf admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:58.589185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb0c54-7f25-4559-995e-ba9b8cdb8faf admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:58.594423 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c07b6-0d53-40e8-b2f1-a6010ec499c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:58.595084 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c07b6-0d53-40e8-b2f1-a6010ec499c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:58.595390 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c07b6-0d53-40e8-b2f1-a6010ec499c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:58.595662 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c07b6-0d53-40e8-b2f1-a6010ec499c5 admin admin] PATH_INFO: `/v3/projects/ba36db771d9f4beb95e956f7fde1ab4a/users/41aee396e3774723aff0560a35e314c9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:58.614535 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c07b6-0d53-40e8-b2f1-a6010ec499c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba36db771d9f4beb95e956f7fde1ab4a, user_id=41aee396e3774723aff0560a35e314c9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:58.617306 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c07b6-0d53-40e8-b2f1-a6010ec499c5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:58.632059 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4510/9092] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:39:58 2022] PUT /identity/v3/projects/ba36db771d9f4beb95e956f7fde1ab4a/users/41aee396e3774723aff0560a35e314c9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:39:58.636363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad35af-8010-444e-a24f-090117bcf0e3 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:58.648381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad35af-8010-444e-a24f-090117bcf0e3 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:58.707475 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf79c6b-8eea-4e4c-8ae5-eaffc60b465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:58.708144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf79c6b-8eea-4e4c-8ae5-eaffc60b465f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:58.708427 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf79c6b-8eea-4e4c-8ae5-eaffc60b465f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:58.708706 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf79c6b-8eea-4e4c-8ae5-eaffc60b465f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:58.709349 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf79c6b-8eea-4e4c-8ae5-eaffc60b465f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:58.710987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf79c6b-8eea-4e4c-8ae5-eaffc60b465f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:58.721110 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4583/9093] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:39:58.725476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c07b6-0d53-40e8-b2f1-a6010ec499c5 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:39:58.736057 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c07b6-0d53-40e8-b2f1-a6010ec499c5 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:39:58.740899 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269ad02-e5a5-4e82-a667-eaf7874ec0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:39:58.741597 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ad02-e5a5-4e82-a667-eaf7874ec0df admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:39:58.741879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ad02-e5a5-4e82-a667-eaf7874ec0df admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:39:58.742153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ad02-e5a5-4e82-a667-eaf7874ec0df admin admin] PATH_INFO: `/v3/projects/ba36db771d9f4beb95e956f7fde1ab4a/users/41aee396e3774723aff0560a35e314c9/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:39:58.744112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269ad02-e5a5-4e82-a667-eaf7874ec0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba36db771d9f4beb95e956f7fde1ab4a, user_id=41aee396e3774723aff0560a35e314c9, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:39:58.746819 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269ad02-e5a5-4e82-a667-eaf7874ec0df admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:39:58.757610 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4511/9094] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:39:58 2022] PUT /identity/v3/projects/ba36db771d9f4beb95e956f7fde1ab4a/users/41aee396e3774723aff0560a35e314c9/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:40:03.730584 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196c76f-b74e-4e99-959c-259f5c169fb1 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:40:03.731229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196c76f-b74e-4e99-959c-259f5c169fb1 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:40:03.731229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196c76f-b74e-4e99-959c-259f5c169fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:40:03.763370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a196c76f-b74e-4e99-959c-259f5c169fb1 None None] MFA Rules not processed for user `41aee396e3774723aff0560a35e314c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:40:03.764735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a196c76f-b74e-4e99-959c-259f5c169fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:40:03.844951 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4584/9095] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:40:03.861955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269ad02-e5a5-4e82-a667-eaf7874ec0df admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:40:03.864468 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1269ad02-e5a5-4e82-a667-eaf7874ec0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:40:03.944565 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269ad02-e5a5-4e82-a667-eaf7874ec0df admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:40:03.950255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d536860-6def-47b3-819b-22e858991b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:40:03.950892 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d536860-6def-47b3-819b-22e858991b77 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:40:03.951172 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d536860-6def-47b3-819b-22e858991b77 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:40:03.951451 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d536860-6def-47b3-819b-22e858991b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:40:04.009244 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:04.014052 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d536860-6def-47b3-819b-22e858991b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:40:04.015992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d536860-6def-47b3-819b-22e858991b77 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:40:04.026898 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4512/9096] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:40:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:40:05.066360 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a988ae-ef5f-4341-aac0-64bf3360cddf None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:40:05.066778 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a988ae-ef5f-4341-aac0-64bf3360cddf None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:40:05.067009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a988ae-ef5f-4341-aac0-64bf3360cddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:40:05.093486 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-60a988ae-ef5f-4341-aac0-64bf3360cddf None None] MFA Rules not processed for user `6f5dd2f1393b413fb8aa410a47d5357f`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:40:05.095042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-60a988ae-ef5f-4341-aac0-64bf3360cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:40:05.103289 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4585/9097] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:40:05.460153 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d536860-6def-47b3-819b-22e858991b77 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:40:05.516575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d536860-6def-47b3-819b-22e858991b77 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:40:05.520950 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9934ab4-c070-4f6c-9967-e25e9c76c314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:40:05.521667 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9934ab4-c070-4f6c-9967-e25e9c76c314 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:40:05.521955 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9934ab4-c070-4f6c-9967-e25e9c76c314 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:40:05.522232 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9934ab4-c070-4f6c-9967-e25e9c76c314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:40:05.524016 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e9934ab4-c070-4f6c-9967-e25e9c76c314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:40:05.534853 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9934ab4-c070-4f6c-9967-e25e9c76c314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:40:05.536301 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9934ab4-c070-4f6c-9967-e25e9c76c314 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:40:05.545053 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4513/9098] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:40:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:40:05.893007 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a988ae-ef5f-4341-aac0-64bf3360cddf None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:40:05.894386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-60a988ae-ef5f-4341-aac0-64bf3360cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:40:05.981060 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a988ae-ef5f-4341-aac0-64bf3360cddf None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:40:05.986377 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7f3ab-61c3-4ac3-924c-70d4528d23f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:40:05.987016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7f3ab-61c3-4ac3-924c-70d4528d23f3 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:40:05.987816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7f3ab-61c3-4ac3-924c-70d4528d23f3 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:40:05.988091 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7f3ab-61c3-4ac3-924c-70d4528d23f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:40:05.989905 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a9c7f3ab-61c3-4ac3-924c-70d4528d23f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:40:05.998212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=100 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:06.007397 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7f3ab-61c3-4ac3-924c-70d4528d23f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:40:06.009064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7f3ab-61c3-4ac3-924c-70d4528d23f3 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:40:06.020081 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4586/9099] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:40:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:40:07.879986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9934ab4-c070-4f6c-9967-e25e9c76c314 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:40:07.882369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e9934ab4-c070-4f6c-9967-e25e9c76c314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:40:07.893362 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9934ab4-c070-4f6c-9967-e25e9c76c314 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:40:07.897324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacaa2c-40d9-4699-8ad4-d603a10a18e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:40:07.897980 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacaa2c-40d9-4699-8ad4-d603a10a18e1 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:40:07.898257 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacaa2c-40d9-4699-8ad4-d603a10a18e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:40:07.898673 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacaa2c-40d9-4699-8ad4-d603a10a18e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:40:07.900428 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-5aacaa2c-40d9-4699-8ad4-d603a10a18e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:40:07.911171 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacaa2c-40d9-4699-8ad4-d603a10a18e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:40:07.912620 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacaa2c-40d9-4699-8ad4-d603a10a18e1 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:40:07.921143 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4514/9100] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:40:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:40:12.949378 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7f3ab-61c3-4ac3-924c-70d4528d23f3 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:40:12.959493 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7f3ab-61c3-4ac3-924c-70d4528d23f3 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:40:12.963181 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df2dbb-3f95-4107-86f4-87e01114dda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:40:12.963771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df2dbb-3f95-4107-86f4-87e01114dda8 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:40:12.964052 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df2dbb-3f95-4107-86f4-87e01114dda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:40:12.964327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df2dbb-3f95-4107-86f4-87e01114dda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:40:12.967279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e5df2dbb-3f95-4107-86f4-87e01114dda8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:40:12.981638 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df2dbb-3f95-4107-86f4-87e01114dda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:40:12.983056 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df2dbb-3f95-4107-86f4-87e01114dda8 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:40:12.993812 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4587/9101] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:40:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:40:16.831099 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacaa2c-40d9-4699-8ad4-d603a10a18e1 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:40:16.839674 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacaa2c-40d9-4699-8ad4-d603a10a18e1 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:40:16.843347 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a647fde-ac1a-4b8f-ab54-258bb7015982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:40:16.843943 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a647fde-ac1a-4b8f-ab54-258bb7015982 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:40:16.844224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a647fde-ac1a-4b8f-ab54-258bb7015982 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:40:16.844503 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a647fde-ac1a-4b8f-ab54-258bb7015982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:40:16.854068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a647fde-ac1a-4b8f-ab54-258bb7015982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:40:16.855532 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a647fde-ac1a-4b8f-ab54-258bb7015982 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:40:16.865595 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4515/9102] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:40:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:40:18.794426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df2dbb-3f95-4107-86f4-87e01114dda8 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:40:18.795944 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e5df2dbb-3f95-4107-86f4-87e01114dda8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:40:18.810047 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df2dbb-3f95-4107-86f4-87e01114dda8 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:40:18.815912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ceb43-8867-422f-8ec5-d4a2a4b657ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:40:18.816505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ceb43-8867-422f-8ec5-d4a2a4b657ee service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:40:18.816801 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ceb43-8867-422f-8ec5-d4a2a4b657ee service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:40:18.817072 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ceb43-8867-422f-8ec5-d4a2a4b657ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:40:18.819437 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a1ceb43-8867-422f-8ec5-d4a2a4b657ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:40:18.831361 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ceb43-8867-422f-8ec5-d4a2a4b657ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:40:18.832987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ceb43-8867-422f-8ec5-d4a2a4b657ee service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:40:18.843489 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4588/9103] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:40:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:40:26.860797 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=41 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:28.839115 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=15 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:26.073973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef8b0c-fc3d-4876-8f71-6a0afcca8f9e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:26.074458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef8b0c-fc3d-4876-8f71-6a0afcca8f9e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:26.074559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef8b0c-fc3d-4876-8f71-6a0afcca8f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:26.123751 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-e3ef8b0c-fc3d-4876-8f71-6a0afcca8f9e None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:42:26.124947 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-e3ef8b0c-fc3d-4876-8f71-6a0afcca8f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:26.189285 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4516/9104] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:42:26.235709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ceb43-8867-422f-8ec5-d4a2a4b657ee service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:26.237124 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a1ceb43-8867-422f-8ec5-d4a2a4b657ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:26.326093 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ceb43-8867-422f-8ec5-d4a2a4b657ee service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:26.331090 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3dc29-95bc-4fea-80c3-3a394096a994 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:26.331687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3dc29-95bc-4fea-80c3-3a394096a994 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:26.331971 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3dc29-95bc-4fea-80c3-3a394096a994 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:26.332365 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3dc29-95bc-4fea-80c3-3a394096a994 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:26.340401 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3dc29-95bc-4fea-80c3-3a394096a994 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:26.342053 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3dc29-95bc-4fea-80c3-3a394096a994 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:26.350155 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4589/9105] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:42:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:29.550300 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef8b0c-fc3d-4876-8f71-6a0afcca8f9e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:29.574760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef8b0c-fc3d-4876-8f71-6a0afcca8f9e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:29.580939 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b952f-5334-4d5c-aa1f-bcf296b39b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:29.581732 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b952f-5334-4d5c-aa1f-bcf296b39b22 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:29.582021 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b952f-5334-4d5c-aa1f-bcf296b39b22 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:29.582299 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b952f-5334-4d5c-aa1f-bcf296b39b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:29.584637 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f34b952f-5334-4d5c-aa1f-bcf296b39b22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:29.605324 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b952f-5334-4d5c-aa1f-bcf296b39b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:29.606986 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b952f-5334-4d5c-aa1f-bcf296b39b22 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:29.624634 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4517/9106] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:36.346867 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=41 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:37.787603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e001c7-d6f5-43d3-b1ef-bf7db11973fe None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:37.788302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e001c7-d6f5-43d3-b1ef-bf7db11973fe None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:37.788803 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e001c7-d6f5-43d3-b1ef-bf7db11973fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:37.809223 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-53e001c7-d6f5-43d3-b1ef-bf7db11973fe None None] MFA Rules not processed for user `c235251bc54848279759ba3e71a38306`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:42:37.810410 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-53e001c7-d6f5-43d3-b1ef-bf7db11973fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:37.820230 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4590/9107] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Aug 29 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:42:37.831782 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b952f-5334-4d5c-aa1f-bcf296b39b22 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:37.833204 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f34b952f-5334-4d5c-aa1f-bcf296b39b22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:37.917536 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b952f-5334-4d5c-aa1f-bcf296b39b22 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:37.918154 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595a015-8b08-4bed-9ea4-4189b2faf028 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:37.918787 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a015-8b08-4bed-9ea4-4189b2faf028 service glance] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:37.919079 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a015-8b08-4bed-9ea4-4189b2faf028 service glance] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:37.919338 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a015-8b08-4bed-9ea4-4189b2faf028 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:37.929456 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595a015-8b08-4bed-9ea4-4189b2faf028 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:37.930908 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595a015-8b08-4bed-9ea4-4189b2faf028 service glance] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:37.941993 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4518/9108] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:38.007773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e001c7-d6f5-43d3-b1ef-bf7db11973fe None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:38.017176 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e001c7-d6f5-43d3-b1ef-bf7db11973fe None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:38.020968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe977b12-2445-46d3-8f36-213fa26b7dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:38.021616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe977b12-2445-46d3-8f36-213fa26b7dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:38.021922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe977b12-2445-46d3-8f36-213fa26b7dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:38.022193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe977b12-2445-46d3-8f36-213fa26b7dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:38.024405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-fe977b12-2445-46d3-8f36-213fa26b7dd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:38.033723 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe977b12-2445-46d3-8f36-213fa26b7dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:38.035135 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe977b12-2445-46d3-8f36-213fa26b7dd8 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:38.043497 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4591/9109] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:38.117611 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595a015-8b08-4bed-9ea4-4189b2faf028 service glance] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:38.127500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595a015-8b08-4bed-9ea4-4189b2faf028 service glance] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:38.131144 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddc17a-e248-4d55-96fd-d21317a8a09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:38.131750 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddc17a-e248-4d55-96fd-d21317a8a09a service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:38.132022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddc17a-e248-4d55-96fd-d21317a8a09a service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:38.132296 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddc17a-e248-4d55-96fd-d21317a8a09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:38.134519 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-07ddc17a-e248-4d55-96fd-d21317a8a09a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:38.147547 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddc17a-e248-4d55-96fd-d21317a8a09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:38.149590 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddc17a-e248-4d55-96fd-d21317a8a09a service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:38.160364 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4519/9110] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:38.986561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe977b12-2445-46d3-8f36-213fa26b7dd8 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:38.995059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe977b12-2445-46d3-8f36-213fa26b7dd8 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:38.998765 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5eb6-2e06-439e-b2b0-f624a348b511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:38.999362 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5eb6-2e06-439e-b2b0-f624a348b511 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:38.999649 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5eb6-2e06-439e-b2b0-f624a348b511 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:38.999921 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5eb6-2e06-439e-b2b0-f624a348b511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:39.001702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-846e5eb6-2e06-439e-b2b0-f624a348b511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:39.012436 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e5eb6-2e06-439e-b2b0-f624a348b511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:39.013882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e5eb6-2e06-439e-b2b0-f624a348b511 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:39.022453 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4592/9111] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:40.423033 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf74c0-8665-4af6-b2d6-d2ff278b9fe1 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:40.423540 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf74c0-8665-4af6-b2d6-d2ff278b9fe1 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:40.423625 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf74c0-8665-4af6-b2d6-d2ff278b9fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:40.443292 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-fbbf74c0-8665-4af6-b2d6-d2ff278b9fe1 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:42:40.444478 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-fbbf74c0-8665-4af6-b2d6-d2ff278b9fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:40.452385 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4520/9112] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:42:40.465088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5eb6-2e06-439e-b2b0-f624a348b511 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:40.476853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5eb6-2e06-439e-b2b0-f624a348b511 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:40.482136 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67239008-2515-47a3-ae5d-c5d47d690ca3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:40.482735 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67239008-2515-47a3-ae5d-c5d47d690ca3 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:40.483016 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67239008-2515-47a3-ae5d-c5d47d690ca3 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:40.483292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67239008-2515-47a3-ae5d-c5d47d690ca3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:40.491508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67239008-2515-47a3-ae5d-c5d47d690ca3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:40.493076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67239008-2515-47a3-ae5d-c5d47d690ca3 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:40.508750 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4593/9113] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:42:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:44.144824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf74c0-8665-4af6-b2d6-d2ff278b9fe1 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:44.157311 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf74c0-8665-4af6-b2d6-d2ff278b9fe1 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:44.162414 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061b818-5fb0-4cfc-a94a-e45603b25f42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:44.163026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b818-5fb0-4cfc-a94a-e45603b25f42 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:44.163304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b818-5fb0-4cfc-a94a-e45603b25f42 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:44.163842 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b818-5fb0-4cfc-a94a-e45603b25f42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:44.166289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a061b818-5fb0-4cfc-a94a-e45603b25f42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:44.178399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061b818-5fb0-4cfc-a94a-e45603b25f42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:44.180843 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061b818-5fb0-4cfc-a94a-e45603b25f42 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:44.190634 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4521/9114] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:50.395525 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67239008-2515-47a3-ae5d-c5d47d690ca3 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:50.406669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67239008-2515-47a3-ae5d-c5d47d690ca3 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:50.411695 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a9ae6-5748-4e26-b1ae-4c5ef318c3ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:50.412284 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a9ae6-5748-4e26-b1ae-4c5ef318c3ed service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:50.412580 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a9ae6-5748-4e26-b1ae-4c5ef318c3ed service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:50.412853 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a9ae6-5748-4e26-b1ae-4c5ef318c3ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:50.415088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8f7a9ae6-5748-4e26-b1ae-4c5ef318c3ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:50.426381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a9ae6-5748-4e26-b1ae-4c5ef318c3ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:50.427952 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a9ae6-5748-4e26-b1ae-4c5ef318c3ed service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:50.438638 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4594/9115] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:42:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:42:54.186498 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=96 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:55.636879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32f53-9821-4868-af95-dceb2f25faff None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:55.637513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32f53-9821-4868-af95-dceb2f25faff None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:55.637513 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32f53-9821-4868-af95-dceb2f25faff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:55.656332 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-24d32f53-9821-4868-af95-dceb2f25faff None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:42:55.657557 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-24d32f53-9821-4868-af95-dceb2f25faff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:42:55.665408 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4522/9116] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:42:55.678019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a9ae6-5748-4e26-b1ae-4c5ef318c3ed service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:42:55.689660 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a9ae6-5748-4e26-b1ae-4c5ef318c3ed service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:42:55.694874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03faa26-1c3a-4534-9b0e-1747cbf662e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:42:55.695496 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03faa26-1c3a-4534-9b0e-1747cbf662e2 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:42:55.695775 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03faa26-1c3a-4534-9b0e-1747cbf662e2 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:42:55.696046 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03faa26-1c3a-4534-9b0e-1747cbf662e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:42:55.704407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03faa26-1c3a-4534-9b0e-1747cbf662e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:42:55.706005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03faa26-1c3a-4534-9b0e-1747cbf662e2 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:42:55.715068 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4595/9117] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:42:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:43:05.651718 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=3 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:05.710942 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=33 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:07.663051 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32f53-9821-4868-af95-dceb2f25faff None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:44:07.674937 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32f53-9821-4868-af95-dceb2f25faff None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:44:07.678569 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2a7bd-0440-42ab-8bdc-e344cfa8b1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:44:07.679182 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a7bd-0440-42ab-8bdc-e344cfa8b1ec service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:07.679464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a7bd-0440-42ab-8bdc-e344cfa8b1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:07.679739 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a7bd-0440-42ab-8bdc-e344cfa8b1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:07.682062 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1ec2a7bd-0440-42ab-8bdc-e344cfa8b1ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:07.696288 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2a7bd-0440-42ab-8bdc-e344cfa8b1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:44:07.697872 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2a7bd-0440-42ab-8bdc-e344cfa8b1ec service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:44:07.709159 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4523/9118] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:44:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:44:09.439237 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03faa26-1c3a-4534-9b0e-1747cbf662e2 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:44:09.452251 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03faa26-1c3a-4534-9b0e-1747cbf662e2 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:44:09.458405 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c33d3-3459-48c7-8434-6242dd1152a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:44:09.459008 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c33d3-3459-48c7-8434-6242dd1152a5 service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:09.459314 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c33d3-3459-48c7-8434-6242dd1152a5 service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:09.459603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c33d3-3459-48c7-8434-6242dd1152a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:09.461321 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-b71c33d3-3459-48c7-8434-6242dd1152a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:09.474515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c33d3-3459-48c7-8434-6242dd1152a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:44:09.476108 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c33d3-3459-48c7-8434-6242dd1152a5 service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:44:09.486796 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4596/9119] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:44:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:44:11.327385 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d292d-1351-4b86-9669-cd3b32177b88 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:11.327891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d292d-1351-4b86-9669-cd3b32177b88 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:11.328001 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d292d-1351-4b86-9669-cd3b32177b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:11.346974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-4e6d292d-1351-4b86-9669-cd3b32177b88 None None] MFA Rules not processed for user `6f5dd2f1393b413fb8aa410a47d5357f`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:44:11.348170 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4e6d292d-1351-4b86-9669-cd3b32177b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:11.355087 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4524/9120] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:44:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:44:19.482420 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:21.342029 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=9 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:26.877645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c33d3-3459-48c7-8434-6242dd1152a5 service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:44:26.887499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c33d3-3459-48c7-8434-6242dd1152a5 service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:44:26.891109 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b47ed-7111-4577-90d3-7e71adae983f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:44:26.891704 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b47ed-7111-4577-90d3-7e71adae983f service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:44:26.891984 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b47ed-7111-4577-90d3-7e71adae983f service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:44:26.892260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b47ed-7111-4577-90d3-7e71adae983f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:44:26.893995 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-018b47ed-7111-4577-90d3-7e71adae983f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:44:26.903434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b47ed-7111-4577-90d3-7e71adae983f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:44:26.904847 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b47ed-7111-4577-90d3-7e71adae983f service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:44:26.912962 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4597/9121] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:44:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:44:36.909216 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:43.911796 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d292d-1351-4b86-9669-cd3b32177b88 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:45:43.931461 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d292d-1351-4b86-9669-cd3b32177b88 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:45:43.935181 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001c2c-4c62-44c4-9dee-54df34175e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:45:43.935817 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001c2c-4c62-44c4-9dee-54df34175e54 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:45:43.936100 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001c2c-4c62-44c4-9dee-54df34175e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:45:43.936379 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001c2c-4c62-44c4-9dee-54df34175e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:45:43.944419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42001c2c-4c62-44c4-9dee-54df34175e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:45:43.945919 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42001c2c-4c62-44c4-9dee-54df34175e54 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:45:43.954049 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4525/9122] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:45:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:45:53.950464 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=11 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:44.325969 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b47ed-7111-4577-90d3-7e71adae983f service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:44.377406 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b47ed-7111-4577-90d3-7e71adae983f service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:44.383602 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63633a-8d76-4219-a033-c466585af97f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:44.384193 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63633a-8d76-4219-a033-c466585af97f service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:44.384472 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63633a-8d76-4219-a033-c466585af97f service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:44.384741 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63633a-8d76-4219-a033-c466585af97f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:44.392324 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63633a-8d76-4219-a033-c466585af97f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:44.394538 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63633a-8d76-4219-a033-c466585af97f service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:44.403334 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4598/9123] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:46:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:46:45.768008 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001c2c-4c62-44c4-9dee-54df34175e54 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:45.776510 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001c2c-4c62-44c4-9dee-54df34175e54 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:45.780200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4389a2-588d-48a5-a2b6-18142c3a4295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:45.780795 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4389a2-588d-48a5-a2b6-18142c3a4295 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:45.781075 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4389a2-588d-48a5-a2b6-18142c3a4295 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:45.781350 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4389a2-588d-48a5-a2b6-18142c3a4295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:45.791484 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4389a2-588d-48a5-a2b6-18142c3a4295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:45.792854 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4389a2-588d-48a5-a2b6-18142c3a4295 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:45.804031 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4526/9124] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:46:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:46:54.399255 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=23 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:55.798856 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:59.447802 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63633a-8d76-4219-a033-c466585af97f service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:46:59.458959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63633a-8d76-4219-a033-c466585af97f service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:46:59.464040 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95450fc4-0454-48b9-8962-5f734bd6769b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:46:59.464647 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95450fc4-0454-48b9-8962-5f734bd6769b service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:46:59.464929 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95450fc4-0454-48b9-8962-5f734bd6769b service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:46:59.465201 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95450fc4-0454-48b9-8962-5f734bd6769b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:46:59.466991 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-95450fc4-0454-48b9-8962-5f734bd6769b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:46:59.512514 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95450fc4-0454-48b9-8962-5f734bd6769b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:46:59.514143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95450fc4-0454-48b9-8962-5f734bd6769b service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:46:59.524086 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4599/9125] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:46:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 16:47:09.519811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=19 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:47:49.178745 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4389a2-588d-48a5-a2b6-18142c3a4295 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:47:49.199926 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4389a2-588d-48a5-a2b6-18142c3a4295 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:47:49.206561 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81889a-ce19-4cdb-bec9-1a5ae431a53e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:47:49.207279 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81889a-ce19-4cdb-bec9-1a5ae431a53e service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:47:49.207594 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81889a-ce19-4cdb-bec9-1a5ae431a53e service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:47:49.207870 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81889a-ce19-4cdb-bec9-1a5ae431a53e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:47:49.216904 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81889a-ce19-4cdb-bec9-1a5ae431a53e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:47:49.218531 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81889a-ce19-4cdb-bec9-1a5ae431a53e service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:47:49.229063 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4527/9126] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:47:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:47:55.413457 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95450fc4-0454-48b9-8962-5f734bd6769b service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:47:55.415302 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-95450fc4-0454-48b9-8962-5f734bd6769b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:47:55.439661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95450fc4-0454-48b9-8962-5f734bd6769b service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:47:55.445828 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3962f6e-0875-4180-8968-fdadd3ddb2da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:47:55.446434 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962f6e-0875-4180-8968-fdadd3ddb2da service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:47:55.446716 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962f6e-0875-4180-8968-fdadd3ddb2da service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:47:55.446994 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962f6e-0875-4180-8968-fdadd3ddb2da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:47:55.455705 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3962f6e-0875-4180-8968-fdadd3ddb2da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:47:55.457323 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3962f6e-0875-4180-8968-fdadd3ddb2da service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:47:55.467136 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4600/9127] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:47:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:47:59.224820 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:05.463076 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=10 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:35.985660 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81889a-ce19-4cdb-bec9-1a5ae431a53e service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:36.014071 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81889a-ce19-4cdb-bec9-1a5ae431a53e service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:36.027258 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d12b0a-b523-4f9a-84e4-25d14a8154cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:36.028223 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12b0a-b523-4f9a-84e4-25d14a8154cb service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:36.028441 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12b0a-b523-4f9a-84e4-25d14a8154cb service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:36.028723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12b0a-b523-4f9a-84e4-25d14a8154cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:36.042963 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d12b0a-b523-4f9a-84e4-25d14a8154cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:36.044763 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d12b0a-b523-4f9a-84e4-25d14a8154cb service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:36.057627 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4528/9128] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:48:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:48:43.213627 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3962f6e-0875-4180-8968-fdadd3ddb2da service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:43.223936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3962f6e-0875-4180-8968-fdadd3ddb2da service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:43.227731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f1d99-9921-43e6-8dd0-9ff82a97559f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:43.228338 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f1d99-9921-43e6-8dd0-9ff82a97559f service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:43.228622 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f1d99-9921-43e6-8dd0-9ff82a97559f service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:43.228895 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f1d99-9921-43e6-8dd0-9ff82a97559f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:43.290807 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f1d99-9921-43e6-8dd0-9ff82a97559f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:43.292174 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f1d99-9921-43e6-8dd0-9ff82a97559f service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:43.302651 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4601/9129] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:48:46.052930 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=10 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:46.683831 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d12b0a-b523-4f9a-84e4-25d14a8154cb service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:46.695359 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d12b0a-b523-4f9a-84e4-25d14a8154cb service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:46.700577 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7f0c5-01c5-493b-9bed-6edb45f4a550 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:46.701169 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f0c5-01c5-493b-9bed-6edb45f4a550 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:46.701474 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f0c5-01c5-493b-9bed-6edb45f4a550 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:46.701747 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f0c5-01c5-493b-9bed-6edb45f4a550 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:46.703448 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-96a7f0c5-01c5-493b-9bed-6edb45f4a550 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:48:46.715839 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7f0c5-01c5-493b-9bed-6edb45f4a550 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:46.717476 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7f0c5-01c5-493b-9bed-6edb45f4a550 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:46.731079 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4529/9130] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:48:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:48:49.640409 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f1d99-9921-43e6-8dd0-9ff82a97559f service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:49.664150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f1d99-9921-43e6-8dd0-9ff82a97559f service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:49.676768 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180040ee-b5c5-493b-9c77-7830dc4ebf0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:49.679818 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180040ee-b5c5-493b-9c77-7830dc4ebf0c service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:49.681779 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180040ee-b5c5-493b-9c77-7830dc4ebf0c service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:49.682070 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180040ee-b5c5-493b-9c77-7830dc4ebf0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:49.684532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-180040ee-b5c5-493b-9c77-7830dc4ebf0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:48:49.703087 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7f0c5-01c5-493b-9bed-6edb45f4a550 service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:49.704168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180040ee-b5c5-493b-9c77-7830dc4ebf0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:49.706168 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180040ee-b5c5-493b-9c77-7830dc4ebf0c service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:49.722980 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4602/9131] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:48:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:48:49.732336 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7f0c5-01c5-493b-9bed-6edb45f4a550 service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:49.737729 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:49.742261 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:49.742614 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:49.743119 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] PATH_INFO: `/v3/users/6f5dd2f1393b413fb8aa410a47d5357f` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:49.746403 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5dd2f1393b413fb8aa410a47d5357f)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:49.748668 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:49.802703 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5dd2f1393b413fb8aa410a47d5357f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:49.803349 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5dd2f1393b413fb8aa410a47d5357f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:49.815383 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5dd2f1393b413fb8aa410a47d5357f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:49.825485 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5dd2f1393b413fb8aa410a47d5357f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:49.834308 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5dd2f1393b413fb8aa410a47d5357f'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:49.840699 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4530/9132] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:48:49 2022] DELETE /identity/v3/users/6f5dd2f1393b413fb8aa410a47d5357f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:48:50.027616 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180040ee-b5c5-493b-9c77-7830dc4ebf0c service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:50.040547 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180040ee-b5c5-493b-9c77-7830dc4ebf0c service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:50.099731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:50.100359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:50.100641 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:50.100918 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] PATH_INFO: `/v3/projects/cddf5a6066704ec5a96d141bf8b96120` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:50.102120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cddf5a6066704ec5a96d141bf8b96120)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:50.104022 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:50.150341 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cddf5a6066704ec5a96d141bf8b96120', 'request_id': 'req-68579a7a-83a1-4cae-accf-85fcae82718c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.156373 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cddf5a6066704ec5a96d141bf8b96120', 'request_id': 'req-68579a7a-83a1-4cae-accf-85fcae82718c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.163762 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cddf5a6066704ec5a96d141bf8b96120', 'request_id': 'req-68579a7a-83a1-4cae-accf-85fcae82718c'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.174320 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] The token cache is being invalidate because project cddf5a6066704ec5a96d141bf8b96120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:48:50.174666 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.175348 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.177346 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4603/9133] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:48:50 2022] DELETE /identity/v3/projects/cddf5a6066704ec5a96d141bf8b96120 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:48:50.181329 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:50.182755 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:48:50.196874 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543027-1ef4-4326-8e6a-cfa064fa1832 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:50.253518 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6d528-faf1-4e56-8afb-26646b0557e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:50.254774 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d528-faf1-4e56-8afb-26646b0557e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:50.255058 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d528-faf1-4e56-8afb-26646b0557e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:50.255337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d528-faf1-4e56-8afb-26646b0557e5 admin admin] PATH_INFO: `/v3/users/41aee396e3774723aff0560a35e314c9` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:50.256477 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6d528-faf1-4e56-8afb-26646b0557e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41aee396e3774723aff0560a35e314c9)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:50.258437 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6d528-faf1-4e56-8afb-26646b0557e5 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:50.303447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-acc6d528-faf1-4e56-8afb-26646b0557e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41aee396e3774723aff0560a35e314c9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.304130 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-acc6d528-faf1-4e56-8afb-26646b0557e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41aee396e3774723aff0560a35e314c9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.314142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:50.317286 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-acc6d528-faf1-4e56-8afb-26646b0557e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41aee396e3774723aff0560a35e314c9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.326638 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-acc6d528-faf1-4e56-8afb-26646b0557e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41aee396e3774723aff0560a35e314c9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.333612 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-acc6d528-faf1-4e56-8afb-26646b0557e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41aee396e3774723aff0560a35e314c9'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.339429 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4531/9134] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:48:50 2022] DELETE /identity/v3/users/41aee396e3774723aff0560a35e314c9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:48:50.510782 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:50.512248 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:48:50.526842 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68579a7a-83a1-4cae-accf-85fcae82718c admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:50.537721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:50.592753 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:50.593407 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:50.593697 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:50.593974 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] PATH_INFO: `/v3/projects/ba36db771d9f4beb95e956f7fde1ab4a` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:50.595097 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba36db771d9f4beb95e956f7fde1ab4a)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:50.597064 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:50.643557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba36db771d9f4beb95e956f7fde1ab4a', 'request_id': 'req-1440385c-f48a-4f91-9b6a-a54eae9fef16'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.649702 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba36db771d9f4beb95e956f7fde1ab4a', 'request_id': 'req-1440385c-f48a-4f91-9b6a-a54eae9fef16'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.657061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba36db771d9f4beb95e956f7fde1ab4a', 'request_id': 'req-1440385c-f48a-4f91-9b6a-a54eae9fef16'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.667968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] The token cache is being invalidate because project ba36db771d9f4beb95e956f7fde1ab4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:48:50.668279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.668910 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1440385c-f48a-4f91-9b6a-a54eae9fef16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:48:50.670437 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4604/9135] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:48:50 2022] DELETE /identity/v3/projects/ba36db771d9f4beb95e956f7fde1ab4a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:48:50.675522 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cfc4a-c9b2-409f-97d6-3a50aa08f231 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:50.675846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cfc4a-c9b2-409f-97d6-3a50aa08f231 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:50.676142 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cfc4a-c9b2-409f-97d6-3a50aa08f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:50.707388 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-9a9cfc4a-c9b2-409f-97d6-3a50aa08f231 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:48:50.708624 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-9a9cfc4a-c9b2-409f-97d6-3a50aa08f231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:48:50.767444 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4532/9136] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:48:50.775452 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8185e-d6ef-4d43-a503-f211d87e6157 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:50.775740 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8185e-d6ef-4d43-a503-f211d87e6157 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:50.776019 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8185e-d6ef-4d43-a503-f211d87e6157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:50.796229 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-aaf8185e-d6ef-4d43-a503-f211d87e6157 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:48:50.797449 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-aaf8185e-d6ef-4d43-a503-f211d87e6157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:48:50.806234 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4605/9137] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:48:50.810495 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cfc4a-c9b2-409f-97d6-3a50aa08f231 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:50.820500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cfc4a-c9b2-409f-97d6-3a50aa08f231 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:50.825255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bccf7-ad5d-4d9d-a093-40a75af61666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:50.825902 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bccf7-ad5d-4d9d-a093-40a75af61666 admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:50.826185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bccf7-ad5d-4d9d-a093-40a75af61666 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:50.826466 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bccf7-ad5d-4d9d-a093-40a75af61666 admin admin] PATH_INFO: `/v3/domains` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:50.827116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bccf7-ad5d-4d9d-a093-40a75af61666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 16:48:50.827422 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bccf7-ad5d-4d9d-a093-40a75af61666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:50.829091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bccf7-ad5d-4d9d-a093-40a75af61666 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:50.841358 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4533/9138] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Aug 29 16:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 16:48:50.845558 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8185e-d6ef-4d43-a503-f211d87e6157 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:50.855383 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8185e-d6ef-4d43-a503-f211d87e6157 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:50.860005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a1608-1f6e-487d-811c-91a6230a98c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:50.860598 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a1608-1f6e-487d-811c-91a6230a98c8 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:50.860882 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a1608-1f6e-487d-811c-91a6230a98c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:50.861155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a1608-1f6e-487d-811c-91a6230a98c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:50.861809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a1608-1f6e-487d-811c-91a6230a98c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:50.863699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a1608-1f6e-487d-811c-91a6230a98c8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:50.899400 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4606/9139] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:48:50 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:48:50.903500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bccf7-ad5d-4d9d-a093-40a75af61666 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:50.914141 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bccf7-ad5d-4d9d-a093-40a75af61666 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:50.970246 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d84623-63f8-4a63-95b6-3035e7a0a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:50.970851 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d84623-63f8-4a63-95b6-3035e7a0a170 admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:50.971132 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d84623-63f8-4a63-95b6-3035e7a0a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:50.971411 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d84623-63f8-4a63-95b6-3035e7a0a170 admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:50.972042 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d84623-63f8-4a63-95b6-3035e7a0a170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:50.974587 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d84623-63f8-4a63-95b6-3035e7a0a170 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:50.994824 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4534/9140] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:48:50 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:48:50.999041 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a1608-1f6e-487d-811c-91a6230a98c8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:51.009363 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a1608-1f6e-487d-811c-91a6230a98c8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:51.015520 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddc5a5-66f3-4a29-89d0-33c3b0561d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:51.016114 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddc5a5-66f3-4a29-89d0-33c3b0561d73 admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:51.016403 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddc5a5-66f3-4a29-89d0-33c3b0561d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:51.016669 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddc5a5-66f3-4a29-89d0-33c3b0561d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:51.017306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddc5a5-66f3-4a29-89d0-33c3b0561d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:51.018987 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddc5a5-66f3-4a29-89d0-33c3b0561d73 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:51.029501 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4607/9141] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:48:51.033507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d84623-63f8-4a63-95b6-3035e7a0a170 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:51.044123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d84623-63f8-4a63-95b6-3035e7a0a170 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:51.048809 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26bcae-078a-4d33-969e-45f965f45beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:51.049415 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26bcae-078a-4d33-969e-45f965f45beb admin admin] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:51.049713 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26bcae-078a-4d33-969e-45f965f45beb admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:51.049991 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26bcae-078a-4d33-969e-45f965f45beb admin admin] PATH_INFO: `/v3/roles` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:51.050635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26bcae-078a-4d33-969e-45f965f45beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:51.052255 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26bcae-078a-4d33-969e-45f965f45beb admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:51.062821 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4535/9142] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:48:51.066855 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddc5a5-66f3-4a29-89d0-33c3b0561d73 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:51.077049 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddc5a5-66f3-4a29-89d0-33c3b0561d73 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:51.081682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3c02b-4647-4dee-b22b-88690d6f7c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:51.082837 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c02b-4647-4dee-b22b-88690d6f7c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:51.083150 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c02b-4647-4dee-b22b-88690d6f7c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:51.083426 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c02b-4647-4dee-b22b-88690d6f7c21 admin admin] PATH_INFO: `/v3/projects/14ace7a0d69d4fb49e1bd3e28bb6e74c/users/c7751719651849e5bd2918cfbf24b46a/roles/0aaef5fae9d1491bb3548a12be30bd2d` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:51.098577 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3c02b-4647-4dee-b22b-88690d6f7c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ace7a0d69d4fb49e1bd3e28bb6e74c, user_id=c7751719651849e5bd2918cfbf24b46a, role_id=0aaef5fae9d1491bb3548a12be30bd2d)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:51.101221 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3c02b-4647-4dee-b22b-88690d6f7c21 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:51.113796 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4608/9143] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:48:51 2022] PUT /identity/v3/projects/14ace7a0d69d4fb49e1bd3e28bb6e74c/users/c7751719651849e5bd2918cfbf24b46a/roles/0aaef5fae9d1491bb3548a12be30bd2d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:48:51.118736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426c9d-1c62-49c9-92a8-4116e3091cf6 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:51.119018 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426c9d-1c62-49c9-92a8-4116e3091cf6 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:51.119289 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426c9d-1c62-49c9-92a8-4116e3091cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:51.137784 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-ba426c9d-1c62-49c9-92a8-4116e3091cf6 None None] MFA Rules not processed for user `2731c4a0421d4cc19a655aaf52f9a3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:48:51.138973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ba426c9d-1c62-49c9-92a8-4116e3091cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:48:51.169760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:51.201953 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4536/9144] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:48:51.212175 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3c02b-4647-4dee-b22b-88690d6f7c21 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:51.214661 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-e1b3c02b-4647-4dee-b22b-88690d6f7c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:48:51.248367 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:51.299537 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3c02b-4647-4dee-b22b-88690d6f7c21 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:51.303771 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f7e7-d643-4161-8493-4c3c38a944e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:51.304381 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f7e7-d643-4161-8493-4c3c38a944e4 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:51.304663 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f7e7-d643-4161-8493-4c3c38a944e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:51.304940 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f7e7-d643-4161-8493-4c3c38a944e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:51.314355 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74f7e7-d643-4161-8493-4c3c38a944e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:51.315789 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74f7e7-d643-4161-8493-4c3c38a944e4 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:51.327784 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4609/9145] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:48:55.807135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238345-b7b0-48c8-9451-fd05feee2d5e None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:55.807652 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238345-b7b0-48c8-9451-fd05feee2d5e None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:55.807793 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09238345-b7b0-48c8-9451-fd05feee2d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:55.838445 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-09238345-b7b0-48c8-9451-fd05feee2d5e None None] MFA Rules not processed for user `c7751719651849e5bd2918cfbf24b46a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:48:55.839702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-09238345-b7b0-48c8-9451-fd05feee2d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:48:55.908136 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4537/9146] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:48:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:48:55.912696 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f7e7-d643-4161-8493-4c3c38a944e4 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:55.923009 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f7e7-d643-4161-8493-4c3c38a944e4 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:55.931840 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297313-6091-4c1a-bc5f-694c494e2245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:55.933065 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297313-6091-4c1a-bc5f-694c494e2245 admin admin] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:55.933456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297313-6091-4c1a-bc5f-694c494e2245 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:55.933920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297313-6091-4c1a-bc5f-694c494e2245 admin admin] PATH_INFO: `/v3/projects` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:55.936316 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297313-6091-4c1a-bc5f-694c494e2245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:55.938831 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297313-6091-4c1a-bc5f-694c494e2245 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:55.968861 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4610/9147] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Aug 29 16:48:55 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:48:55.972974 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09238345-b7b0-48c8-9451-fd05feee2d5e None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:55.984382 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09238345-b7b0-48c8-9451-fd05feee2d5e None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:56.042574 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d2e70-5a18-4065-b4f6-726aae84a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:56.043108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d2e70-5a18-4065-b4f6-726aae84a84a admin admin] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:56.043384 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d2e70-5a18-4065-b4f6-726aae84a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:56.043655 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d2e70-5a18-4065-b4f6-726aae84a84a admin admin] PATH_INFO: `/v3/users` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:56.044330 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d2e70-5a18-4065-b4f6-726aae84a84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:56.046483 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d2e70-5a18-4065-b4f6-726aae84a84a admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:56.069243 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4538/9148] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Aug 29 16:48:55 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 16:48:56.073645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297313-6091-4c1a-bc5f-694c494e2245 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:56.084035 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297313-6091-4c1a-bc5f-694c494e2245 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:56.089042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160cb42-84d9-4ffb-ad17-9f07a003817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:56.089678 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160cb42-84d9-4ffb-ad17-9f07a003817a admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:56.090061 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160cb42-84d9-4ffb-ad17-9f07a003817a admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:56.090345 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160cb42-84d9-4ffb-ad17-9f07a003817a admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:56.091005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160cb42-84d9-4ffb-ad17-9f07a003817a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:56.092645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160cb42-84d9-4ffb-ad17-9f07a003817a admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:56.103137 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4611/9149] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 16:48:56.107197 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d2e70-5a18-4065-b4f6-726aae84a84a admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:56.117830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d2e70-5a18-4065-b4f6-726aae84a84a admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:56.122447 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ab63d-cf9c-4e32-af9b-539de9ee8e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:56.123096 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ab63d-cf9c-4e32-af9b-539de9ee8e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:56.123378 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ab63d-cf9c-4e32-af9b-539de9ee8e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:56.123656 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ab63d-cf9c-4e32-af9b-539de9ee8e05 admin admin] PATH_INFO: `/v3/projects/28b29a5a968044f4bb9a959c51a25a30/users/a132f861a4fd482a871bc71ca935195c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:56.138068 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ab63d-cf9c-4e32-af9b-539de9ee8e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b29a5a968044f4bb9a959c51a25a30, user_id=a132f861a4fd482a871bc71ca935195c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:56.140973 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ab63d-cf9c-4e32-af9b-539de9ee8e05 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:56.155407 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4539/9150] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:48:56 2022] PUT /identity/v3/projects/28b29a5a968044f4bb9a959c51a25a30/users/a132f861a4fd482a871bc71ca935195c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:48:56.159573 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160cb42-84d9-4ffb-ad17-9f07a003817a admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:56.170645 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160cb42-84d9-4ffb-ad17-9f07a003817a admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:56.229886 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec81c71-935e-4246-b04b-7fe615ee948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:56.230491 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81c71-935e-4246-b04b-7fe615ee948f admin admin] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:56.230769 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81c71-935e-4246-b04b-7fe615ee948f admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:56.231042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81c71-935e-4246-b04b-7fe615ee948f admin admin] PATH_INFO: `/v3/roles` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:56.231682 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec81c71-935e-4246-b04b-7fe615ee948f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:56.233259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec81c71-935e-4246-b04b-7fe615ee948f admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:56.243877 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4612/9151] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Aug 29 16:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 16:48:56.248023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ab63d-cf9c-4e32-af9b-539de9ee8e05 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:48:56.258458 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ab63d-cf9c-4e32-af9b-539de9ee8e05 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:48:56.263163 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449a935-65ea-49cc-b321-f0e42395e8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:48:56.263841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a935-65ea-49cc-b321-f0e42395e8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:48:56.264128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a935-65ea-49cc-b321-f0e42395e8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:48:56.264405 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a935-65ea-49cc-b321-f0e42395e8b0 admin admin] PATH_INFO: `/v3/projects/28b29a5a968044f4bb9a959c51a25a30/users/a132f861a4fd482a871bc71ca935195c/roles/be89abac608f45a6921181bcc574f721` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:48:56.266391 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449a935-65ea-49cc-b321-f0e42395e8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b29a5a968044f4bb9a959c51a25a30, user_id=a132f861a4fd482a871bc71ca935195c, role_id=be89abac608f45a6921181bcc574f721)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:48:56.269260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449a935-65ea-49cc-b321-f0e42395e8b0 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:48:56.279412 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4540/9152] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Aug 29 16:48:56 2022] PUT /identity/v3/projects/28b29a5a968044f4bb9a959c51a25a30/users/a132f861a4fd482a871bc71ca935195c/roles/be89abac608f45a6921181bcc574f721 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:49:00.967461 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44881800-08f7-4d13-a3ae-3ca1b4406b74 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:49:00.967968 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44881800-08f7-4d13-a3ae-3ca1b4406b74 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:49:00.968079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44881800-08f7-4d13-a3ae-3ca1b4406b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:49:01.008551 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-44881800-08f7-4d13-a3ae-3ca1b4406b74 None None] MFA Rules not processed for user `a132f861a4fd482a871bc71ca935195c`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:49:01.009993 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-44881800-08f7-4d13-a3ae-3ca1b4406b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:49:01.094773 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:01.111677 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4613/9153] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:49:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:49:01.124072 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449a935-65ea-49cc-b321-f0e42395e8b0 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:49:01.125945 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a449a935-65ea-49cc-b321-f0e42395e8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:49:01.155848 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:01.226282 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449a935-65ea-49cc-b321-f0e42395e8b0 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:49:01.233727 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd94901-84c4-4345-a850-b6d6d93577e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:49:01.234891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd94901-84c4-4345-a850-b6d6d93577e7 service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:49:01.234891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd94901-84c4-4345-a850-b6d6d93577e7 service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:49:01.234891 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd94901-84c4-4345-a850-b6d6d93577e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:49:01.332890 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd94901-84c4-4345-a850-b6d6d93577e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:49:01.335200 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd94901-84c4-4345-a850-b6d6d93577e7 service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:49:01.346674 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4541/9154] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:49:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:49:02.391185 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271f4c2-6b4c-45a1-b8c3-898ba869db72 None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:49:02.391709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271f4c2-6b4c-45a1-b8c3-898ba869db72 None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:49:02.391709 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271f4c2-6b4c-45a1-b8c3-898ba869db72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:49:02.410912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-5271f4c2-6b4c-45a1-b8c3-898ba869db72 None None] MFA Rules not processed for user `c7751719651849e5bd2918cfbf24b46a`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:49:02.412088 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5271f4c2-6b4c-45a1-b8c3-898ba869db72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:49:02.418866 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4614/9155] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:49:04.071226 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd94901-84c4-4345-a850-b6d6d93577e7 service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:49:04.072805 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4bd94901-84c4-4345-a850-b6d6d93577e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:49:04.155315 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd94901-84c4-4345-a850-b6d6d93577e7 service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:49:04.161094 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e39ca6-7b0b-43a0-b75a-b01cec1512cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:49:04.161754 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e39ca6-7b0b-43a0-b75a-b01cec1512cd service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:49:04.162026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e39ca6-7b0b-43a0-b75a-b01cec1512cd service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:49:04.162436 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e39ca6-7b0b-43a0-b75a-b01cec1512cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:49:04.164323 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-25e39ca6-7b0b-43a0-b75a-b01cec1512cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:49:04.181187 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e39ca6-7b0b-43a0-b75a-b01cec1512cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:49:04.182849 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e39ca6-7b0b-43a0-b75a-b01cec1512cd service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:49:04.194124 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4542/9156] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:49:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:49:08.575352 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271f4c2-6b4c-45a1-b8c3-898ba869db72 None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:49:08.576938 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-5271f4c2-6b4c-45a1-b8c3-898ba869db72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:49:08.635149 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271f4c2-6b4c-45a1-b8c3-898ba869db72 None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:49:08.638672 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7de32f-50f5-4c46-af8c-f9f025681795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:49:08.639259 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de32f-50f5-4c46-af8c-f9f025681795 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:49:08.639540 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de32f-50f5-4c46-af8c-f9f025681795 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:49:08.639810 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de32f-50f5-4c46-af8c-f9f025681795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:49:08.641546 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8d7de32f-50f5-4c46-af8c-f9f025681795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:49:08.655042 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7de32f-50f5-4c46-af8c-f9f025681795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:49:08.656462 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7de32f-50f5-4c46-af8c-f9f025681795 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:49:08.667525 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4615/9157] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:49:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:49:09.575679 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e39ca6-7b0b-43a0-b75a-b01cec1512cd service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:49:09.589369 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e39ca6-7b0b-43a0-b75a-b01cec1512cd service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:49:09.596816 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28bf6f-492c-45a8-8a45-551a0df505cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:49:09.597830 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28bf6f-492c-45a8-8a45-551a0df505cc service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:49:09.598116 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28bf6f-492c-45a8-8a45-551a0df505cc service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:49:09.598393 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28bf6f-492c-45a8-8a45-551a0df505cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:49:09.600326 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-4c28bf6f-492c-45a8-8a45-551a0df505cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:49:09.613538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28bf6f-492c-45a8-8a45-551a0df505cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:49:09.615173 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28bf6f-492c-45a8-8a45-551a0df505cc service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:49:09.626816 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4543/9158] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:49:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:49:15.398086 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7de32f-50f5-4c46-af8c-f9f025681795 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:49:15.409557 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7de32f-50f5-4c46-af8c-f9f025681795 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:49:15.415143 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2cc6c-5f54-4d25-bbaf-ffdf47d9c22e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:49:15.415747 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2cc6c-5f54-4d25-bbaf-ffdf47d9c22e service nova] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:49:15.416030 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2cc6c-5f54-4d25-bbaf-ffdf47d9c22e service nova] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:49:15.416306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2cc6c-5f54-4d25-bbaf-ffdf47d9c22e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:49:15.418073 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-48e2cc6c-5f54-4d25-bbaf-ffdf47d9c22e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:49:15.432761 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2cc6c-5f54-4d25-bbaf-ffdf47d9c22e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:49:15.434692 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2cc6c-5f54-4d25-bbaf-ffdf47d9c22e service nova] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:49:15.461542 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4616/9159] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:49:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:49:17.230946 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28bf6f-492c-45a8-8a45-551a0df505cc service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:49:17.240696 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28bf6f-492c-45a8-8a45-551a0df505cc service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:49:17.244269 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123abfd3-f40a-4ca5-940a-eccc7db1bf80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:49:17.244858 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123abfd3-f40a-4ca5-940a-eccc7db1bf80 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:49:17.245135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123abfd3-f40a-4ca5-940a-eccc7db1bf80 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:49:17.245434 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123abfd3-f40a-4ca5-940a-eccc7db1bf80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:49:17.254107 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123abfd3-f40a-4ca5-940a-eccc7db1bf80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:49:17.255516 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123abfd3-f40a-4ca5-940a-eccc7db1bf80 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:49:17.265092 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4544/9160] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:49:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:49:25.444499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=35 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:27.260635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=97 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:49.901444 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2cc6c-5f54-4d25-bbaf-ffdf47d9c22e service nova] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:50:49.911306 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2cc6c-5f54-4d25-bbaf-ffdf47d9c22e service nova] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:50:49.914939 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aaa34-c855-473e-b890-8e77c4902824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:50:49.915532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aaa34-c855-473e-b890-8e77c4902824 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:50:49.915816 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aaa34-c855-473e-b890-8e77c4902824 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:50:49.916094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aaa34-c855-473e-b890-8e77c4902824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:50:49.917824 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-412aaa34-c855-473e-b890-8e77c4902824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:50:49.927198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aaa34-c855-473e-b890-8e77c4902824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:50:49.928599 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aaa34-c855-473e-b890-8e77c4902824 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:50:49.936412 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4617/9161] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:50:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:50:59.932981 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:17.395914 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacde2-b652-48b3-8fd4-63e5e2cc4bc5 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:17.396395 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacde2-b652-48b3-8fd4-63e5e2cc4bc5 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:17.396500 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacde2-b652-48b3-8fd4-63e5e2cc4bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:17.428291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-1feacde2-b652-48b3-8fd4-63e5e2cc4bc5 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:51:17.429527 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-1feacde2-b652-48b3-8fd4-63e5e2cc4bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:17.485079 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4545/9162] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:51:17.532532 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aaa34-c855-473e-b890-8e77c4902824 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:17.533956 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-412aaa34-c855-473e-b890-8e77c4902824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:17.602592 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aaa34-c855-473e-b890-8e77c4902824 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:17.607625 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda3206-9a14-4983-b1a7-22fc582344d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:17.608282 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda3206-9a14-4983-b1a7-22fc582344d0 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:17.608595 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda3206-9a14-4983-b1a7-22fc582344d0 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:17.608873 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda3206-9a14-4983-b1a7-22fc582344d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:17.616845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda3206-9a14-4983-b1a7-22fc582344d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:17.618456 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda3206-9a14-4983-b1a7-22fc582344d0 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:17.626472 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4618/9163] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:51:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:51:26.658186 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0547f-f560-4951-a93b-4c63f6ce028d None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:26.658711 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0547f-f560-4951-a93b-4c63f6ce028d None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:26.658826 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0547f-f560-4951-a93b-4c63f6ce028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:26.679022 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-a3b0547f-f560-4951-a93b-4c63f6ce028d None None] MFA Rules not processed for user `c7751719651849e5bd2918cfbf24b46a`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:51:26.680254 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-a3b0547f-f560-4951-a93b-4c63f6ce028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:26.687768 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4546/9164] 10.222.0.16 () {58 vars in 958 bytes} [Mon Aug 29 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 16:51:27.011865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda3206-9a14-4983-b1a7-22fc582344d0 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:27.021684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda3206-9a14-4983-b1a7-22fc582344d0 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:27.026890 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051719c8-1c88-4de0-bf76-2633b9943f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:27.028005 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051719c8-1c88-4de0-bf76-2633b9943f91 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:27.028508 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051719c8-1c88-4de0-bf76-2633b9943f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:27.029031 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051719c8-1c88-4de0-bf76-2633b9943f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:27.031976 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-051719c8-1c88-4de0-bf76-2633b9943f91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:27.042034 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051719c8-1c88-4de0-bf76-2633b9943f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:27.043455 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051719c8-1c88-4de0-bf76-2633b9943f91 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:27.051308 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4619/9165] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:51:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:51:28.587769 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa1198-ad90-4fa6-8a6b-a58a11529917 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:28.588224 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa1198-ad90-4fa6-8a6b-a58a11529917 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:28.588480 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa1198-ad90-4fa6-8a6b-a58a11529917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:28.609275 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-10aa1198-ad90-4fa6-8a6b-a58a11529917 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:51:28.610507 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-10aa1198-ad90-4fa6-8a6b-a58a11529917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:28.617772 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4547/9166] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:51:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:51:28.629749 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051719c8-1c88-4de0-bf76-2633b9943f91 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:28.644287 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051719c8-1c88-4de0-bf76-2633b9943f91 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:28.659848 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb3ef1-029f-4300-8e36-2edd6add102e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:28.661372 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb3ef1-029f-4300-8e36-2edd6add102e service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:28.661809 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb3ef1-029f-4300-8e36-2edd6add102e service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:28.662454 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb3ef1-029f-4300-8e36-2edd6add102e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:28.672385 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb3ef1-029f-4300-8e36-2edd6add102e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:28.674260 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb3ef1-029f-4300-8e36-2edd6add102e service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:28.683087 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4620/9167] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:51:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:51:38.304108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa1198-ad90-4fa6-8a6b-a58a11529917 None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:51:38.314419 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa1198-ad90-4fa6-8a6b-a58a11529917 None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:51:38.318112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06a841-3ea0-43e8-90ff-bb3097afc685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:51:38.318740 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06a841-3ea0-43e8-90ff-bb3097afc685 service neutron] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:51:38.319023 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06a841-3ea0-43e8-90ff-bb3097afc685 service neutron] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:51:38.319298 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06a841-3ea0-43e8-90ff-bb3097afc685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:51:38.321056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ff06a841-3ea0-43e8-90ff-bb3097afc685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:51:38.331575 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06a841-3ea0-43e8-90ff-bb3097afc685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:51:38.333004 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06a841-3ea0-43e8-90ff-bb3097afc685 service neutron] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:51:38.340849 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4548/9168] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:51:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:51:38.679791 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=44 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:48.337352 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=41 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:55.187554 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb3ef1-029f-4300-8e36-2edd6add102e service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:52:55.199417 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb3ef1-029f-4300-8e36-2edd6add102e service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:52:55.204279 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc501674-bd42-4a81-b3bf-4566e1d9d4c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:52:55.204876 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc501674-bd42-4a81-b3bf-4566e1d9d4c2 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:52:55.205144 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc501674-bd42-4a81-b3bf-4566e1d9d4c2 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:52:55.205443 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc501674-bd42-4a81-b3bf-4566e1d9d4c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:52:55.207152 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bc501674-bd42-4a81-b3bf-4566e1d9d4c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:52:55.218266 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc501674-bd42-4a81-b3bf-4566e1d9d4c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:52:55.219825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc501674-bd42-4a81-b3bf-4566e1d9d4c2 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:52:55.229344 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4621/9169] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:52:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:01.360035 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06a841-3ea0-43e8-90ff-bb3097afc685 service neutron] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:01.362198 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-ff06a841-3ea0-43e8-90ff-bb3097afc685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:01.376879 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06a841-3ea0-43e8-90ff-bb3097afc685 service neutron] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:01.381948 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbef5bb-cd28-4ea4-abbf-b712c1b1a756 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:01.382546 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbef5bb-cd28-4ea4-abbf-b712c1b1a756 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:01.382829 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbef5bb-cd28-4ea4-abbf-b712c1b1a756 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:01.383108 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbef5bb-cd28-4ea4-abbf-b712c1b1a756 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:01.384762 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-6bbef5bb-cd28-4ea4-abbf-b712c1b1a756 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:01.396069 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbef5bb-cd28-4ea4-abbf-b712c1b1a756 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:01.397680 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbef5bb-cd28-4ea4-abbf-b712c1b1a756 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:01.408021 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4549/9170] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:05.225307 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=6 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:11.403242 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=6 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:25.990002 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc501674-bd42-4a81-b3bf-4566e1d9d4c2 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:25.991364 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-bc501674-bd42-4a81-b3bf-4566e1d9d4c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:26.068588 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc501674-bd42-4a81-b3bf-4566e1d9d4c2 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:26.072240 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a505fb1-19e2-4f0a-82a8-e0924985ed5b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f161a87f6fe42aa84e61b33160924ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:26.072839 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505fb1-19e2-4f0a-82a8-e0924985ed5b service glance] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:26.073380 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505fb1-19e2-4f0a-82a8-e0924985ed5b service glance] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:26.073684 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505fb1-19e2-4f0a-82a8-e0924985ed5b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:26.075395 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-4a505fb1-19e2-4f0a-82a8-e0924985ed5b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:26.088370 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a505fb1-19e2-4f0a-82a8-e0924985ed5b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:26.089865 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a505fb1-19e2-4f0a-82a8-e0924985ed5b service glance] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:26.101006 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4622/9171] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:30.145148 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a232-5481-4620-9f08-319bd7acc429 None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:30.145658 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a232-5481-4620-9f08-319bd7acc429 None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:30.145766 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a232-5481-4620-9f08-319bd7acc429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:30.195041 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-dcc4a232-5481-4620-9f08-319bd7acc429 None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:53:30.196251 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-dcc4a232-5481-4620-9f08-319bd7acc429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:30.213239 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4550/9172] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Aug 29 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:53:30.255079 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a505fb1-19e2-4f0a-82a8-e0924985ed5b service glance] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:30.275637 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a505fb1-19e2-4f0a-82a8-e0924985ed5b service glance] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:30.280874 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567283d-64ac-466b-99b9-06e5916869d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:30.281497 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567283d-64ac-466b-99b9-06e5916869d0 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:30.281783 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567283d-64ac-466b-99b9-06e5916869d0 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:30.282062 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567283d-64ac-466b-99b9-06e5916869d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:30.290126 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567283d-64ac-466b-99b9-06e5916869d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:30.291699 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567283d-64ac-466b-99b9-06e5916869d0 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:30.302122 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4623/9173] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:53:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:53:39.716092 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d1179-2022-46b7-b051-b1da4713cacd None None] REQUEST_METHOD: `POST` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:39.716776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d1179-2022-46b7-b051-b1da4713cacd None None] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:39.716776 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d1179-2022-46b7-b051-b1da4713cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:39.736867 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.auth.core [None req-572d1179-2022-46b7-b051-b1da4713cacd None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:53:39.738091 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-572d1179-2022-46b7-b051-b1da4713cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:39.745498 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4551/9174] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 16:53:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:53:39.757650 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567283d-64ac-466b-99b9-06e5916869d0 service swift] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:39.767927 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567283d-64ac-466b-99b9-06e5916869d0 service swift] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:39.772959 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798f271-e8f2-4c43-aa6f-235653e7a467 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:39.773589 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798f271-e8f2-4c43-aa6f-235653e7a467 service swift] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:39.773877 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798f271-e8f2-4c43-aa6f-235653e7a467 service swift] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:39.774155 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798f271-e8f2-4c43-aa6f-235653e7a467 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:39.782351 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798f271-e8f2-4c43-aa6f-235653e7a467 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:39.784505 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798f271-e8f2-4c43-aa6f-235653e7a467 service swift] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:39.792481 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4624/9175] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:53:43.070846 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d1179-2022-46b7-b051-b1da4713cacd None None] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:43.072387 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-572d1179-2022-46b7-b051-b1da4713cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:43.089196 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d1179-2022-46b7-b051-b1da4713cacd None None] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:43.094723 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a4766-4ac8-40b5-9728-04dbd755107c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c235251bc54848279759ba3e71a38306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:43.095337 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4766-4ac8-40b5-9728-04dbd755107c service nova] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:43.095635 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4766-4ac8-40b5-9728-04dbd755107c service nova] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:43.095906 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4766-4ac8-40b5-9728-04dbd755107c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:43.097734 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-007a4766-4ac8-40b5-9728-04dbd755107c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:43.109953 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a4766-4ac8-40b5-9728-04dbd755107c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:43.112112 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a4766-4ac8-40b5-9728-04dbd755107c service nova] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:43.123349 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4552/9176] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:44.688125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbe68b-02b9-4c97-b343-92f36231c63e None None] REQUEST_METHOD: `POST` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:44.688545 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbe68b-02b9-4c97-b343-92f36231c63e None None] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:44.688681 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbe68b-02b9-4c97-b343-92f36231c63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:44.708499 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.auth.core [None req-a0dbe68b-02b9-4c97-b343-92f36231c63e None None] MFA Rules not processed for user `f70236f89ced4a209b0451062d3d39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=89681) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 16:53:44.709721 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-a0dbe68b-02b9-4c97-b343-92f36231c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:44.716770 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4625/9177] 10.222.0.16 () {58 vars in 967 bytes} [Mon Aug 29 16:53:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 16:53:44.730992 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a4766-4ac8-40b5-9728-04dbd755107c service nova] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:44.748417 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a4766-4ac8-40b5-9728-04dbd755107c service nova] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:44.754031 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e953a8e-10a7-4d48-b657-8dbc73cc8f2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad5b29e028436ca5596434a0cce086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:44.754736 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e953a8e-10a7-4d48-b657-8dbc73cc8f2a service swift] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:44.755032 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e953a8e-10a7-4d48-b657-8dbc73cc8f2a service swift] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:44.755278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e953a8e-10a7-4d48-b657-8dbc73cc8f2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:44.764227 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e953a8e-10a7-4d48-b657-8dbc73cc8f2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:44.765841 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e953a8e-10a7-4d48-b657-8dbc73cc8f2a service swift] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:44.774394 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4553/9178] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Aug 29 16:53:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 16:53:51.244337 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbe68b-02b9-4c97-b343-92f36231c63e None None] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:51.253683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbe68b-02b9-4c97-b343-92f36231c63e None None] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:51.257246 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7e8e-2282-460b-b821-41f9d28d2684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d3bea88ab145a4b737bc88339f285c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:51.257923 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7e8e-2282-460b-b821-41f9d28d2684 service neutron] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:51.258239 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7e8e-2282-460b-b821-41f9d28d2684 service neutron] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:51.258519 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7e8e-2282-460b-b821-41f9d28d2684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:51.331941 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7e8e-2282-460b-b821-41f9d28d2684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:51.333415 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7e8e-2282-460b-b821-41f9d28d2684 service neutron] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:51.354909 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4626/9179] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:52.152760 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e953a8e-10a7-4d48-b657-8dbc73cc8f2a service swift] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:52.159123 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=34 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:52.166178 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e953a8e-10a7-4d48-b657-8dbc73cc8f2a service swift] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:52.171520 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3f58f-ee05-495b-b1d2-aba29fc236ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:52.172185 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3f58f-ee05-495b-b1d2-aba29fc236ad service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:52.172640 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3f58f-ee05-495b-b1d2-aba29fc236ad service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:52.172981 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3f58f-ee05-495b-b1d2-aba29fc236ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:52.174850 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-3ae3f58f-ee05-495b-b1d2-aba29fc236ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:52.186702 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3f58f-ee05-495b-b1d2-aba29fc236ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:52.188304 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3f58f-ee05-495b-b1d2-aba29fc236ad service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:52.199184 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4554/9180] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:55.395912 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7e8e-2282-460b-b821-41f9d28d2684 service neutron] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:55.402368 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=93 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:55.414561 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7e8e-2282-460b-b821-41f9d28d2684 service neutron] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:55.424059 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7981e-c503-41d6-becf-80f3fbd56275 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:55.424960 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7981e-c503-41d6-becf-80f3fbd56275 service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:55.426292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7981e-c503-41d6-becf-80f3fbd56275 service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:55.426292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7981e-c503-41d6-becf-80f3fbd56275 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:55.428094 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-3de7981e-c503-41d6-becf-80f3fbd56275 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:55.454292 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7981e-c503-41d6-becf-80f3fbd56275 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:55.458734 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7981e-c503-41d6-becf-80f3fbd56275 service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:55.483135 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3f58f-ee05-495b-b1d2-aba29fc236ad service placement] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:55.492024 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4627/9181] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:53:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:53:55.496960 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3f58f-ee05-495b-b1d2-aba29fc236ad service placement] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:55.502878 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:55.503811 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:55.508026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:55.508026 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] PATH_INFO: `/v3/users/c7751719651849e5bd2918cfbf24b46a` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:55.510243 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7751719651849e5bd2918cfbf24b46a)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:55.511219 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:55.583568 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7751719651849e5bd2918cfbf24b46a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:55.584358 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7751719651849e5bd2918cfbf24b46a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:55.598047 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7751719651849e5bd2918cfbf24b46a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:55.605823 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7751719651849e5bd2918cfbf24b46a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:55.613430 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7751719651849e5bd2918cfbf24b46a'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:55.619278 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4555/9182] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:53:55 2022] DELETE /identity/v3/users/c7751719651849e5bd2918cfbf24b46a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:53:55.801603 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7981e-c503-41d6-becf-80f3fbd56275 service placement] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:55.813297 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7981e-c503-41d6-becf-80f3fbd56275 service placement] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:55.870936 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:55.871565 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:55.871845 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:55.872120 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] PATH_INFO: `/v3/projects/14ace7a0d69d4fb49e1bd3e28bb6e74c` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:55.873318 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ace7a0d69d4fb49e1bd3e28bb6e74c)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:55.875347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:55.920825 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'request_id': 'req-1a16d5fe-da55-487c-8cb5-9165174fedb9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:55.927359 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'request_id': 'req-1a16d5fe-da55-487c-8cb5-9165174fedb9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:55.934680 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ace7a0d69d4fb49e1bd3e28bb6e74c', 'request_id': 'req-1a16d5fe-da55-487c-8cb5-9165174fedb9'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:55.960023 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] The token cache is being invalidate because project 14ace7a0d69d4fb49e1bd3e28bb6e74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:53:55.960683 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:55.961327 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:55.962815 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4628/9183] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:53:55 2022] DELETE /identity/v3/projects/14ace7a0d69d4fb49e1bd3e28bb6e74c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 16:53:55.966954 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:55.968355 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:55.982195 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf95ec8-5329-4d29-abd9-4cd286f77873 admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:56.039133 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:56.039765 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:56.040049 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:56.040328 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] PATH_INFO: `/v3/users/a132f861a4fd482a871bc71ca935195c` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:56.041493 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a132f861a4fd482a871bc71ca935195c)` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:56.043412 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:56.092628 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a132f861a4fd482a871bc71ca935195c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:56.093291 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a132f861a4fd482a871bc71ca935195c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:56.104824 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:56.106056 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a132f861a4fd482a871bc71ca935195c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:56.114966 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a132f861a4fd482a871bc71ca935195c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:56.122399 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.notifications [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a132f861a4fd482a871bc71ca935195c'} {{(pid=89680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:56.128255 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4556/9184] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Aug 29 16:53:55 2022] DELETE /identity/v3/users/a132f861a4fd482a871bc71ca935195c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:53:56.302357 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:53:56.303811 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:53:56.316423 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16d5fe-da55-487c-8cb5-9165174fedb9 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:53:56.374172 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2731c4a0421d4cc19a655aaf52f9a3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981474d13fc1406aa4961a388692a3c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:53:56.374835 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:53:56.375113 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:53:56.375386 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] PATH_INFO: `/v3/projects/28b29a5a968044f4bb9a959c51a25a30` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:53:56.376515 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b29a5a968044f4bb9a959c51a25a30)` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:53:56.378453 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:53:56.388687 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:56.425125 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b29a5a968044f4bb9a959c51a25a30', 'request_id': 'req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:56.430947 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b29a5a968044f4bb9a959c51a25a30', 'request_id': 'req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:56.438347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b29a5a968044f4bb9a959c51a25a30', 'request_id': 'req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8'} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:56.449192 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] The token cache is being invalidate because project 28b29a5a968044f4bb9a959c51a25a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89681) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 16:53:56.449579 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:56.450218 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.notifications [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89681) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 16:53:56.451927 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4629/9185] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Aug 29 16:53:56 2022] DELETE /identity/v3/projects/28b29a5a968044f4bb9a959c51a25a30 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 16:54:06.124731 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=1 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:06.445908 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:01.200828 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] Authenticating user token {{(pid=89680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:58:01.202559 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:58:01.343128 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d5e68-ea65-4245-bfb2-7cda935be01d admin admin] Validating token access rules against request {{(pid=89680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:58:01.401340 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dae45c-4ad3-4b20-9acc-3dc293637843 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:58:01.401976 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dae45c-4ad3-4b20-9acc-3dc293637843 service placement] REQUEST_METHOD: `GET` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:58:01.402260 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dae45c-4ad3-4b20-9acc-3dc293637843 service placement] SCRIPT_NAME: `/identity` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:58:01.402538 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dae45c-4ad3-4b20-9acc-3dc293637843 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:58:01.404278 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.fernet_utils [None req-f4dae45c-4ad3-4b20-9acc-3dc293637843 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:58:01.415351 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dae45c-4ad3-4b20-9acc-3dc293637843 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:58:01.416924 n-d-854882-3 devstack@keystone.service[89680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dae45c-4ad3-4b20-9acc-3dc293637843 service placement] RBAC: Authorization granted {{(pid=89680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:58:01.426699 n-d-854882-3 devstack@keystone.service[89680]: [pid: 89680|app: 0|req: 4557/9186] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:58:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:58:05.356485 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] Authenticating user token {{(pid=89681) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 16:58:05.357922 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:58:05.399731 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fc52e-33e6-4fde-a933-ae5624b6d0e8 admin admin] Validating token access rules against request {{(pid=89681) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 16:58:05.404977 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0094e-6074-484f-8bf9-c3012d8ebf7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0fc274aa6064fda9fab30fbd16df5aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c799b729bef4ed483416a87034fceb8', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89681) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 16:58:05.405634 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0094e-6074-484f-8bf9-c3012d8ebf7d service placement] REQUEST_METHOD: `GET` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 16:58:05.405920 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0094e-6074-484f-8bf9-c3012d8ebf7d service placement] SCRIPT_NAME: `/identity` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 16:58:05.406198 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0094e-6074-484f-8bf9-c3012d8ebf7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89681) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 16:58:05.407975 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.fernet_utils [None req-7aa0094e-6074-484f-8bf9-c3012d8ebf7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89681) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 16:58:05.421347 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0094e-6074-484f-8bf9-c3012d8ebf7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 16:58:05.422989 n-d-854882-3 devstack@keystone.service[89681]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0094e-6074-484f-8bf9-c3012d8ebf7d service placement] RBAC: Authorization granted {{(pid=89681) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 16:58:05.434027 n-d-854882-3 devstack@keystone.service[89681]: [pid: 89681|app: 0|req: 4630/9187] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Aug 29 16:58:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 16:58:11.422646 n-d-854882-3 devstack@keystone.service[89680]: DEBUG dbcounter [-] [89680] Writing DB stats keystone:SELECT=89 {{(pid=89680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:15.429212 n-d-854882-3 devstack@keystone.service[89681]: DEBUG dbcounter [-] [89681] Writing DB stats keystone:SELECT=17 {{(pid=89681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}